CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory academic problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory academic problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-100.xml	SAT TT=0.759	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=1.26	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (MO) TT=1221.49	? (TO) TT=1800.05	SAT TT=4.225 ASSIGNMENTS=774 CHECKS=646882	? (TO) TT=1800.07	SAT TT=0.759 ASSIGNMENTS=1 CHECKS=54843	? (TO) TT=1800.02	? TT=140.01	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-10.xml	SAT TT=0.009	SAT TT=0.931 CHECKS=108808 NODES=447	SAT TT=0.902 CHECKS=90998 NODES=255	SAT TT=0.038	SAT TT=0.163 CHECKS=385886	SAT TT=0.249 CHECKS=972583	SAT TT=0.885 ASSIGNMENTS=60	SAT TT=0.783 ASSIGNMENTS=4	SAT TT=0.7 CHECKS=76601 NODES=255	SAT TT=1.075 CHECKS=1842810 NODES=17623	SAT TT=0.697 CHECKS=14838 NODES=58	SAT TT=0.135 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=0.126 ASSIGNMENTS=1577 CHECKS=148870	SAT TT=1.521	SAT TT=1.34	SAT TT=0.116 ASSIGNMENTS=1413 CHECKS=141957	SAT TT=0.01 ASSIGNMENTS=15 CHECKS=1335	SAT TT=0.56	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=528	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=4486	SAT TT=2.591	SAT TT=0.879	SAT TT=0.905
csp/allIntervalSeries/ normalized-series-12.xml	SAT TT=0.011	SAT TT=1.159 CHECKS=503774 NODES=1618	SAT TT=2.304 CHECKS=2364350 NODES=7549	SAT TT=0.044	SAT TT=3.242 CHECKS=14991800	SAT TT=5.181 CHECKS=22998500	SAT TT=1.093 ASSIGNMENTS=532	SAT TT=0.922 ASSIGNMENTS=24	SAT TT=3.425 CHECKS=4641930 NODES=10563	SAT TT=5.435 CHECKS=22957200 NODES=154803	? (TO) TT=1800.02	SAT TT=7.066 ASSIGNMENTS=94 CHECKS=10289	SAT TT=9.438 ASSIGNMENTS=6501 CHECKS=2065960	SAT TT=2.599	SAT TT=1.955	SAT TT=2.29 ASSIGNMENTS=24656 CHECKS=2896690	SAT TT=0.012 ASSIGNMENTS=9 CHECKS=1094	SAT TT=10.128	SAT TT=0.011 ASSIGNMENTS=1 CHECKS=767	SAT TT=0.019 ASSIGNMENTS=94 CHECKS=10289	SAT TT=3.375	SAT TT=2.168	SAT TT=0.824
csp/allIntervalSeries/ normalized-series-15.xml	SAT TT=0.015	SAT TT=69.795 CHECKS=129056000 NODES=342327	SAT TT=64.78 CHECKS=129145000 NODES=342327	SAT TT=0.052	SAT TT=115.591 CHECKS=509513000	SAT TT=22.237 CHECKS=94409100	SAT TT=1.397 ASSIGNMENTS=1106	SAT TT=1.084 ASSIGNMENTS=56	SAT TT=345.999 CHECKS=723681000 NODES=1099340	SAT TT=73.429 CHECKS=437560000 NODES=1911200	? (TO) TT=1800.08	SAT TT=8.942 ASSIGNMENTS=1106	SAT TT=363.23 ASSIGNMENTS=1639580 CHECKS=770219000	SAT TT=32.124	SAT TT=5.566	SAT TT=8.622 ASSIGNMENTS=71133 CHECKS=10765900	SAT TT=0.106 ASSIGNMENTS=928 CHECKS=119954	? (TO) TT=1800.09	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1208	SAT TT=0.151 ASSIGNMENTS=1220 CHECKS=174310	SAT TT=337.443	SAT TT=65.561	SAT TT=3.613
csp/allIntervalSeries/ normalized-series-16.xml	SAT TT=0.015	SAT TT=192.347 CHECKS=386221000 NODES=775841	SAT TT=193.628 CHECKS=386377000 NODES=775841	SAT TT=0.052	SAT TT=20.218 CHECKS=93087300	SAT TT=564.099 CHECKS=2790740000	SAT TT=1.079 ASSIGNMENTS=42	SAT TT=1.114 ASSIGNMENTS=6	SAT TT=1755.05 CHECKS=3789000000 NODES=4952830	SAT TT=103.969 CHECKS=584581000 NODES=2250530	? (TO) TT=1800.08	SAT TT=8.387 ASSIGNMENTS=42	SAT TT=511.855 ASSIGNMENTS=1323 CHECKS=166289	SAT TT=293.332	SAT TT=4.222	SAT TT=0.863 ASSIGNMENTS=6550 CHECKS=1002750	SAT TT=0.019 ASSIGNMENTS=42 CHECKS=5917	? (TO) TT=1800.05	SAT TT=0.015 ASSIGNMENTS=1 CHECKS=1377	SAT TT=0.151 ASSIGNMENTS=1323 CHECKS=166289	? (TO) TT=1800.19	SAT TT=3.945	SAT TT=30.232
csp/allIntervalSeries/ normalized-series-18.xml	SAT TT=0.016	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=0.065	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=2.631 ASSIGNMENTS=4139	SAT TT=1.316 ASSIGNMENTS=91	? (TO) TT=1800.03	SAT TT=955.655 CHECKS=5617760000 NODES=17170000	? (TO) TT=1800.08	SAT TT=10.211 ASSIGNMENTS=4139	SAT TT=512.382 ASSIGNMENTS=3463 CHECKS=566291	SAT TT=190.383	SAT TT=13.327	SAT TT=457.807 ASSIGNMENTS=2807590 CHECKS=528970000	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=1748	? (TO) TT=1800.1	SAT TT=0.016 ASSIGNMENTS=1 CHECKS=1748	SAT TT=0.454 ASSIGNMENTS=3463 CHECKS=566291	? (TO) TT=1800.16	SAT TT=327.544	SAT TT=115.297
csp/allIntervalSeries/ normalized-series-20.xml	SAT TT=0.022	? (TO) TT=1800.11	SAT TT=338.246 CHECKS=688420000 NODES=942071	SAT TT=0.071	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.657 ASSIGNMENTS=1440	SAT TT=1.205 ASSIGNMENTS=19	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=9.206 ASSIGNMENTS=1440	SAT TT=513.083 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=13.884 ASSIGNMENTS=87320 CHECKS=17166300	SAT TT=0.172 ASSIGNMENTS=1067 CHECKS=189121	? (TO) TT=1800.09	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=2163	SAT TT=1.204 ASSIGNMENTS=6771 CHECKS=1368540	? (TO) TT=1800.17	? (TO) TT=1800.13	SAT TT=1024.22
csp/allIntervalSeries/ normalized-series-25.xml	SAT TT=0.031	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=0.103	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1507.95 ASSIGNMENTS=1826070	SAT TT=1.89 ASSIGNMENTS=111	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1524.27 ASSIGNMENTS=1826070	SAT TT=515.015 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=186.661 ASSIGNMENTS=853357 CHECKS=207638000	SAT TT=0.159 ASSIGNMENTS=525 CHECKS=125961	? (TO) TT=1800.12	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=3393	SAT TT=2.687 ASSIGNMENTS=11798 CHECKS=3002610	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/allIntervalSeries/ normalized-series-30.xml	SAT TT=0.039	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.135	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=2.259 ASSIGNMENTS=459	SAT TT=2.019 ASSIGNMENTS=12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=9.521 ASSIGNMENTS=459	SAT TT=512.894 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=9.658 ASSIGNMENTS=19341 CHECKS=6642560	SAT TT=0.769 ASSIGNMENTS=2170 CHECKS=581724	? (TO) TT=1800.11	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=4898	SAT TT=0.843 ASSIGNMENTS=2578 CHECKS=713222	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/allIntervalSeries/ normalized-series-35.xml	SAT TT=0.061	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=0.163	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=2.067 ASSIGNMENTS=64	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=0.233 ASSIGNMENTS=361 CHECKS=115179	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=1 CHECKS=6678	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allIntervalSeries/ normalized-series-70.xml	SAT TT=0.276	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.604	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02	? (MO) TT=1057.9	? (TO) TT=1800.04	SAT TT=6.169 ASSIGNMENTS=2289 CHECKS=1375520	? (TO) TT=1800.12	SAT TT=0.276 ASSIGNMENTS=1 CHECKS=26838	? (TO) TT=1800.07	? TT=63.443	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/allIntervalSeries/ normalized-series-80.xml	SAT TT=0.409	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=0.857	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=19.625 ASSIGNMENTS=2704	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (MO) TT=1151.8	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.409 ASSIGNMENTS=1 CHECKS=35073	? (TO) TT=1800.03	? TT=124.445	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/allIntervalSeries/ normalized-series-8.xml	SAT TT=0.008	SAT TT=0.758 CHECKS=3074 NODES=26	SAT TT=0.786 CHECKS=19140 NODES=107	SAT TT=0.03	SAT TT=0.045 CHECKS=45074	SAT TT=0.023 CHECKS=53567	SAT TT=0.706 ASSIGNMENTS=12	SAT TT=0.727 ASSIGNMENTS=4	SAT TT=0.594 CHECKS=15712 NODES=95	SAT TT=0.59 CHECKS=85743 NODES=1229	SAT TT=0.606 CHECKS=7654 NODES=48	SAT TT=0.025 ASSIGNMENTS=96 CHECKS=7794	SAT TT=0.026 ASSIGNMENTS=96 CHECKS=7794	SAT TT=1.282	SAT TT=1.198	SAT TT=0.014 ASSIGNMENTS=91 CHECKS=7519	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=920	SAT TT=0.371	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=333	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=998	SAT TT=2.117	SAT TT=0.575	SAT TT=0.696
csp/allIntervalSeries/ normalized-series-90.xml	SAT TT=0.526	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=1.076	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (MO) TT=1511.74	? (TO) TT=1800.08	SAT TT=7.14 ASSIGNMENTS=2154 CHECKS=1572860	? (TO) TT=1800.05	SAT TT=0.526 ASSIGNMENTS=1 CHECKS=44408	? (TO) TT=1800.08	? TT=123.138	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/allIntervalSeries/ normalized-series-9.xml	SAT TT=0.007	SAT TT=0.852 CHECKS=28486 NODES=197	SAT TT=0.85 CHECKS=59094 NODES=258	SAT TT=0.035	SAT TT=0.127 CHECKS=252484	SAT TT=0.089 CHECKS=305730	SAT TT=0.781 ASSIGNMENTS=35	SAT TT=0.745 ASSIGNMENTS=7	SAT TT=0.769 CHECKS=151825 NODES=741	SAT TT=0.725 CHECKS=343553 NODES=3987	SAT TT=10.878 CHECKS=69966000 NODES=95857	SAT TT=0.047 ASSIGNMENTS=444 CHECKS=37662	SAT TT=0.048 ASSIGNMENTS=444 CHECKS=37662	SAT TT=1.338	SAT TT=1.362	SAT TT=0.03 ASSIGNMENTS=366 CHECKS=31863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=4023	SAT TT=0.406	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=425	SAT TT=0.01 ASSIGNMENTS=9 CHECKS=1285	SAT TT=1.894	SAT TT=0.654	SAT TT=0.63
csp/chessboardColoration/ normalized-cc-10-10-3.xml	SAT TT=6.211	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=53.314 CHECKS=10347600 NODES=45500	SAT TT=6.211 CHECKS=5068940 NODES=6872	SAT TT=7.255 CHECKS=6273520 NODES=4189	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=6.254	SAT TT=317.459	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=601.332 ASSIGNMENTS=848702 CHECKS=589533000	? (TO) TT=1800.1	SAT TT=27.442	SAT TT=43.644	SAT TT=156.883
csp/chessboardColoration/ normalized-cc-12-12-2.xml	UNSAT TT=2.717	UNSAT TT=4.249 CHECKS=5614 NODES=241	UNSAT TT=4.332 CHECKS=12150 NODES=51	UNSAT TT=44.694	UNSAT TT=2.717 CHECKS=36232	UNSAT TT=4.616 CHECKS=510235	UNSAT TT=18.938 ASSIGNMENTS=9227	UNSAT TT=20.52 ASSIGNMENTS=9227	UNSAT TT=21.663 CHECKS=301067 NODES=6850	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=11.157 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=11.948 ASSIGNMENTS=3385 CHECKS=91917	UNSAT TT=7.321	UNSAT TT=7.034	UNSAT TT=2.989 ASSIGNMENTS=3028 CHECKS=1734300	UNSAT TT=5.904 ASSIGNMENTS=5665 CHECKS=3443600	? (TO) TT=1800.13	UNSAT TT=5.756 ASSIGNMENTS=6617 CHECKS=3162580	UNSAT TT=3.118 ASSIGNMENTS=2587 CHECKS=1865140	UNSAT TT=5.502	UNSAT TT=3.852	UNSAT TT=4.649
csp/chessboardColoration/ normalized-cc-12-12-3.xml		? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/chessboardColoration/ normalized-cc-15-15-2.xml	UNSAT TT=6.48	UNSAT TT=10.489 CHECKS=6910 NODES=262	UNSAT TT=10.507 CHECKS=29782 NODES=63	UNSAT TT=203.091	UNSAT TT=8.145 CHECKS=122259	UNSAT TT=35.263 CHECKS=3460010	UNSAT TT=53.382 ASSIGNMENTS=12745	UNSAT TT=54.227 ASSIGNMENTS=12745	UNSAT TT=77.255 CHECKS=220005 NODES=5056	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=18.027 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=18.157 ASSIGNMENTS=3406 CHECKS=94710	UNSAT TT=18.576	UNSAT TT=16.046	UNSAT TT=6.48 ASSIGNMENTS=3477 CHECKS=3145880	UNSAT TT=12.259 ASSIGNMENTS=6246 CHECKS=5816370	? (TO) TT=1800.07	UNSAT TT=9.982 ASSIGNMENTS=5885 CHECKS=4680700	UNSAT TT=9.509 ASSIGNMENTS=5663 CHECKS=4971690	UNSAT TT=7.761	UNSAT TT=8.643	UNSAT TT=11.217
csp/chessboardColoration/ normalized-cc-15-15-3.xml		? (MO) TT=9.142	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/chessboardColoration/ normalized-cc-20-20-2.xml	UNSAT TT=12.75	UNSAT TT=33.961 CHECKS=9410 NODES=297	UNSAT TT=36.618 CHECKS=95702 NODES=83	? (TO) TT=1800.07	UNSAT TT=144.111 CHECKS=37764000	UNSAT TT=333.737 CHECKS=140789000	UNSAT TT=36.973 ASSIGNMENTS=2197	UNSAT TT=40.637 ASSIGNMENTS=2197	UNSAT TT=782.591 CHECKS=215760 NODES=4918	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=22.429 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=35.684 ASSIGNMENTS=3441 CHECKS=99485	UNSAT TT=66.316	UNSAT TT=54.483	UNSAT TT=17.508 ASSIGNMENTS=4624 CHECKS=8640020	UNSAT TT=41.518 ASSIGNMENTS=9486 CHECKS=16818000	? (TO) TT=1800.01	UNSAT TT=24.02 ASSIGNMENTS=5560 CHECKS=9550420	UNSAT TT=14.107 ASSIGNMENTS=2290 CHECKS=5212680	UNSAT TT=12.75	UNSAT TT=25.474	UNSAT TT=31.26
csp/chessboardColoration/ normalized-cc-20-20-3.xml		? (TO) TT=1800.26	? (TO) TT=1800.34	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/chessboardColoration/ normalized-cc-5-5-2.xml	UNSAT TT=0.027	UNSAT TT=0.92 CHECKS=896 NODES=64	UNSAT TT=1.661 CHECKS=441 NODES=27	UNSAT TT=0.09	UNSAT TT=0.053 CHECKS=3071	UNSAT TT=0.027 CHECKS=5157	UNSAT TT=2.453 ASSIGNMENTS=5615	UNSAT TT=2.384 ASSIGNMENTS=5615	UNSAT TT=1.159 CHECKS=215134 NODES=3021	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.137 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=0.125 ASSIGNMENTS=1111 CHECKS=97184	UNSAT TT=1.119	UNSAT TT=0.944	UNSAT TT=0.098 ASSIGNMENTS=998 CHECKS=84392	UNSAT TT=0.349 ASSIGNMENTS=4722 CHECKS=319252	UNSAT TT=4.854	UNSAT TT=0.276 ASSIGNMENTS=2955 CHECKS=214303	UNSAT TT=0.282 ASSIGNMENTS=2950 CHECKS=243957	UNSAT TT=1.815	UNSAT TT=0.971	UNSAT TT=1.095
csp/chessboardColoration/ normalized-cc-5-5-3.xml	SAT TT=0.012	SAT TT=0.914 CHECKS=381 NODES=27	SAT TT=0.865 CHECKS=408 NODES=0	SAT TT=0.065	SAT TT=29.989 CHECKS=18779000	SAT TT=0.025 CHECKS=2879	SAT TT=0.685 ASSIGNMENTS=23	SAT TT=0.749 ASSIGNMENTS=23	SAT TT=0.714 CHECKS=435 NODES=31	SAT TT=0.82 CHECKS=3202 NODES=2	SAT TT=0.723 CHECKS=2897 NODES=0	SAT TT=0.025 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.023 ASSIGNMENTS=23 CHECKS=865	SAT TT=1.355	SAT TT=1.342	SAT TT=0.012 ASSIGNMENTS=23 CHECKS=865	SAT TT=0.013 ASSIGNMENTS=20 CHECKS=643	SAT TT=0.548	SAT TT=0.015 ASSIGNMENTS=63 CHECKS=1760	SAT TT=0.014 ASSIGNMENTS=23 CHECKS=586	SAT TT=1.537	SAT TT=0.867	SAT TT=0.878
csp/chessboardColoration/ normalized-cc-6-6-2.xml	UNSAT TT=0.055	UNSAT TT=1.041 CHECKS=887 NODES=59	UNSAT TT=1.045 CHECKS=926 NODES=30	UNSAT TT=0.2	UNSAT TT=0.114 CHECKS=3468	UNSAT TT=0.055 CHECKS=9848	UNSAT TT=2.818 ASSIGNMENTS=4354	UNSAT TT=3.173 ASSIGNMENTS=4354	UNSAT TT=1.572 CHECKS=217766 NODES=3138	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.208 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=0.223 ASSIGNMENTS=1105 CHECKS=148266	UNSAT TT=1.205	UNSAT TT=1.169	UNSAT TT=0.216 ASSIGNMENTS=1205 CHECKS=150030	UNSAT TT=0.736 ASSIGNMENTS=4802 CHECKS=591958	UNSAT TT=11.312	UNSAT TT=0.536 ASSIGNMENTS=3074 CHECKS=423175	UNSAT TT=0.549 ASSIGNMENTS=3042 CHECKS=413083	UNSAT TT=2.199	UNSAT TT=1.242	UNSAT TT=1.489
csp/chessboardColoration/ normalized-cc-7-7-2.xml	UNSAT TT=0.26	UNSAT TT=1.389 CHECKS=2259 NODES=113	UNSAT TT=1.292 CHECKS=1771 NODES=35	UNSAT TT=0.304	UNSAT TT=0.26 CHECKS=15303	UNSAT TT=3.315 CHECKS=2371980	UNSAT TT=5.211 ASSIGNMENTS=5697	UNSAT TT=5.151 ASSIGNMENTS=5697	UNSAT TT=2.353 CHECKS=217772 NODES=4948	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=0.531 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=0.536 ASSIGNMENTS=2388 CHECKS=347779	UNSAT TT=1.624	UNSAT TT=1.723	UNSAT TT=0.62 ASSIGNMENTS=3113 CHECKS=430894	UNSAT TT=1.264 ASSIGNMENTS=5803 CHECKS=944336	UNSAT TT=26.355	UNSAT TT=0.881 ASSIGNMENTS=3112 CHECKS=595197	UNSAT TT=0.902 ASSIGNMENTS=3105 CHECKS=638351	UNSAT TT=2.553	UNSAT TT=1.424	UNSAT TT=1.832
csp/chessboardColoration/ normalized-cc-8-8-2.xml	UNSAT TT=0.216	UNSAT TT=1.702 CHECKS=9546 NODES=450	UNSAT TT=1.694 CHECKS=2511 NODES=35	UNSAT TT=0.92	UNSAT TT=0.468 CHECKS=26715	UNSAT TT=0.216 CHECKS=29811	UNSAT TT=6.412 ASSIGNMENTS=5697	UNSAT TT=6.278 ASSIGNMENTS=5697	UNSAT TT=3.357 CHECKS=212474 NODES=4885	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.663 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=0.689 ASSIGNMENTS=2226 CHECKS=461689	UNSAT TT=2.258	UNSAT TT=2.219	UNSAT TT=0.772 ASSIGNMENTS=2400 CHECKS=503872	UNSAT TT=1.571 ASSIGNMENTS=5077 CHECKS=1185400	UNSAT TT=77.142	UNSAT TT=1.315 ASSIGNMENTS=3108 CHECKS=871327	UNSAT TT=1.212 ASSIGNMENTS=2988 CHECKS=865761	UNSAT TT=3.388	UNSAT TT=1.637	UNSAT TT=1.923
csp/chessboardColoration/ normalized-cc-8-8-3.xml	SAT TT=0.068	SAT TT=1.801 CHECKS=35112 NODES=583	SAT TT=2.178 CHECKS=124855 NODES=2024	SAT TT=203.372	SAT TT=23.023 CHECKS=8782280	SAT TT=19.563 CHECKS=12540200	SAT TT=1.644 ASSIGNMENTS=227	SAT TT=1.998 ASSIGNMENTS=227	SAT TT=1.555 CHECKS=11384 NODES=192	SAT TT=1.451 CHECKS=32963 NODES=22	SAT TT=1.467 CHECKS=38629 NODES=14	SAT TT=7.491 ASSIGNMENTS=44 CHECKS=5675	SAT TT=9.256 ASSIGNMENTS=310 CHECKS=19118	SAT TT=3.656	SAT TT=3.462	? (TO) TT=1800.1	SAT TT=0.07 ASSIGNMENTS=105 CHECKS=14763	? (TO) TT=1800.09	SAT TT=0.098 ASSIGNMENTS=229 CHECKS=24018	SAT TT=0.068 ASSIGNMENTS=44 CHECKS=5675	SAT TT=3.448	SAT TT=1.776	SAT TT=1.777
csp/chessboardColoration/ normalized-cc-9-9-2.xml	UNSAT TT=0.385	UNSAT TT=2.005 CHECKS=4471 NODES=220	UNSAT TT=2.164 CHECKS=3929 NODES=39	UNSAT TT=1.303	UNSAT TT=0.74 CHECKS=18085	UNSAT TT=0.385 CHECKS=49236	UNSAT TT=9.303 ASSIGNMENTS=5653	UNSAT TT=8.498 ASSIGNMENTS=5653	UNSAT TT=6.026 CHECKS=291629 NODES=6632	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.938 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=0.967 ASSIGNMENTS=2121 CHECKS=572385	UNSAT TT=3.004	UNSAT TT=3.026	UNSAT TT=0.989 ASSIGNMENTS=2450 CHECKS=618519	UNSAT TT=2.353 ASSIGNMENTS=5074 CHECKS=1622540	UNSAT TT=76.23	UNSAT TT=1.752 ASSIGNMENTS=2877 CHECKS=1087410	UNSAT TT=1.514 ASSIGNMENTS=2765 CHECKS=1026030	UNSAT TT=4.093	UNSAT TT=1.959	UNSAT TT=2.567
csp/chessboardColoration/ normalized-cc-9-9-3.xml	SAT TT=0.2	SAT TT=7.436 CHECKS=1268460 NODES=16368	SAT TT=130.294 CHECKS=35584800 NODES=345696	? (TO) TT=1800.06	SAT TT=32.491 CHECKS=10906600	? (TO) TT=1800.09	SAT TT=4.421 ASSIGNMENTS=1480	SAT TT=3.948 ASSIGNMENTS=1480	SAT TT=3.584 CHECKS=488835 NODES=2590	SAT TT=1.975 CHECKS=121936 NODES=146	SAT TT=2.13 CHECKS=74353 NODES=23	SAT TT=7.796 ASSIGNMENTS=391 CHECKS=134218	SAT TT=11.273 ASSIGNMENTS=4763 CHECKS=569419	SAT TT=4.798	SAT TT=4.58	? (TO) TT=1800.09	SAT TT=0.883 ASSIGNMENTS=2758 CHECKS=663122	? (TO) TT=1800.07	SAT TT=0.2 ASSIGNMENTS=333 CHECKS=78196	SAT TT=0.246 ASSIGNMENTS=391 CHECKS=134218	SAT TT=4.908	SAT TT=3.373	SAT TT=3.743
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity3/ normalized-ruler-17-6-a3.xml	SAT TT=0.01	SAT TT=0.922 CHECKS=71934 NODES=39	SAT TT=1.141 CHECKS=472694 NODES=193	SAT TT=0.051	SAT TT=32.071 CHECKS=189270000	SAT TT=3.218 CHECKS=18839000	SAT TT=0.889 ASSIGNMENTS=44	SAT TT=0.873 ASSIGNMENTS=6	SAT TT=0.792 CHECKS=68106 NODES=37	SAT TT=4.183 CHECKS=17628100 NODES=78437	SAT TT=0.775 CHECKS=181419 NODES=438	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=0.022 ASSIGNMENTS=9 CHECKS=1335	SAT TT=1.941	SAT TT=2.004	SAT TT=0.011 ASSIGNMENTS=12 CHECKS=1687	SAT TT=0.01 ASSIGNMENTS=54 CHECKS=4956	SAT TT=0.417	SAT TT=0.022 ASSIGNMENTS=248 CHECKS=18720	SAT TT=0.012 ASSIGNMENTS=41 CHECKS=4762	SAT TT=3.63	SAT TT=0.732	SAT TT=0.756
csp/golombRulerArity3/ normalized-ruler-17-7-a3.xml	UNSAT TT=0.013	UNSAT TT=0.871 CHECKS=748 NODES=0	UNSAT TT=0.845 CHECKS=748 NODES=0	UNSAT TT=0.056	UNSAT TT=0.219 CHECKS=1011840	UNSAT TT=0.04 CHECKS=131682	UNSAT TT=0.851 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=1.013 CHECKS=206955 NODES=105	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.165	UNSAT TT=2.045	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	UNSAT TT=0.906	UNSAT TT=0.987
csp/golombRulerArity3/ normalized-ruler-25-7-a3.xml	SAT TT=0.016	SAT TT=1.069 CHECKS=561726 NODES=95	SAT TT=2.548 CHECKS=5037270 NODES=1650	SAT TT=0.222	SAT TT=32.001 CHECKS=203766000	SAT TT=3.361 CHECKS=20990600	SAT TT=2.164 ASSIGNMENTS=1036	SAT TT=1.127 ASSIGNMENTS=7	SAT TT=1.636 CHECKS=1255470 NODES=766	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=0.054 ASSIGNMENTS=482 CHECKS=69702	SAT TT=0.053 ASSIGNMENTS=482 CHECKS=69702	SAT TT=5.024	SAT TT=3.657	SAT TT=0.027 ASSIGNMENTS=277 CHECKS=47129	SAT TT=0.026 ASSIGNMENTS=198 CHECKS=24863	SAT TT=0.583	SAT TT=0.029 ASSIGNMENTS=248 CHECKS=27416	SAT TT=0.016 ASSIGNMENTS=51 CHECKS=8195	SAT TT=7.741	SAT TT=0.94	SAT TT=1.093
csp/golombRulerArity3/ normalized-ruler-25-8-a3.xml	UNSAT TT=0.019	UNSAT TT=0.935 CHECKS=9749 NODES=0	UNSAT TT=0.978 CHECKS=9749 NODES=0	UNSAT TT=0.077	UNSAT TT=30.568 CHECKS=222081000	UNSAT TT=4.039 CHECKS=25736200	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.034 ASSIGNMENTS=0	UNSAT TT=2.405 CHECKS=2898580 NODES=1023	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.225	UNSAT TT=5.366	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.846	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=21.933	UNSAT TT=1.296	UNSAT TT=1.64
csp/golombRulerArity3/ normalized-ruler-34-8-a3.xml	SAT TT=0.075	SAT TT=10.579 CHECKS=28958300 NODES=10435	SAT TT=20.538 CHECKS=60744900 NODES=19252	SAT TT=4.59	SAT TT=30.507 CHECKS=220464000	SAT TT=0.841 CHECKS=4430220	SAT TT=9.933 ASSIGNMENTS=9698	SAT TT=1.54 ASSIGNMENTS=201	SAT TT=8.995 CHECKS=17106600 NODES=7420	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=0.075 ASSIGNMENTS=434 CHECKS=100669	SAT TT=38.122	SAT TT=17.069	SAT TT=0.075 ASSIGNMENTS=593 CHECKS=139770	SAT TT=0.34 ASSIGNMENTS=1923 CHECKS=420336	SAT TT=0.688	SAT TT=0.62 ASSIGNMENTS=5113 CHECKS=853030	SAT TT=2.02 ASSIGNMENTS=18266 CHECKS=3375350	SAT TT=156.138	SAT TT=1.842	SAT TT=6.921
csp/golombRulerArity3/ normalized-ruler-34-9-a3.xml	UNSAT TT=0.027	UNSAT TT=1.058 CHECKS=23204 NODES=0	UNSAT TT=1.052 CHECKS=23204 NODES=0	UNSAT TT=0.11	UNSAT TT=43.426 CHECKS=279038000	UNSAT TT=11.989 CHECKS=68180900	UNSAT TT=1.427 ASSIGNMENTS=0	UNSAT TT=1.357 ASSIGNMENTS=0	UNSAT TT=17.947 CHECKS=40363200 NODES=10627	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=42.179	UNSAT TT=49.095	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.16	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=323.549	UNSAT TT=4.342	UNSAT TT=5.091
csp/golombRulerArity3/ normalized-ruler-44-10-a3.xml	UNSAT TT=0.038	UNSAT TT=1.261 CHECKS=48509 NODES=0	UNSAT TT=1.214 CHECKS=48509 NODES=0	UNSAT TT=0.157	UNSAT TT=149.162 CHECKS=880503000	UNSAT TT=234.877 CHECKS=1165490000	UNSAT TT=1.434 ASSIGNMENTS=0	UNSAT TT=1.359 ASSIGNMENTS=0	UNSAT TT=70.374 CHECKS=185049000 NODES=21303	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=369.002	UNSAT TT=679.142	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.798	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	UNSAT TT=53.285	UNSAT TT=57.955
csp/golombRulerArity3/ normalized-ruler-44-9-a3.xml	SAT TT=2.18	SAT TT=101.28 CHECKS=338387000 NODES=85284	SAT TT=306.261 CHECKS=912202000 NODES=192760	SAT TT=99.291	SAT TT=160.481 CHECKS=877464000	SAT TT=16.79 CHECKS=93274300	SAT TT=18.087 ASSIGNMENTS=10804	SAT TT=8.453 ASSIGNMENTS=6288	SAT TT=68.181 CHECKS=181104000 NODES=40844	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=106.611 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=107.545 ASSIGNMENTS=85284 CHECKS=338387000	SAT TT=98.214	SAT TT=235.778	SAT TT=2.18 ASSIGNMENTS=15098 CHECKS=3514780	SAT TT=9.054 ASSIGNMENTS=56230 CHECKS=13240100	SAT TT=2.142	SAT TT=4.541 ASSIGNMENTS=27756 CHECKS=5983490	SAT TT=17.005 ASSIGNMENTS=105241 CHECKS=25440700	? (TO) TT=1800.1	SAT TT=3.605	SAT TT=2.544
csp/golombRulerArity3/ normalized-ruler-55-10-a3.xml	SAT TT=2.627	SAT TT=1518.81 CHECKS=5030680000 NODES=852882	SAT TT=1327.63 CHECKS=4471290000 NODES=815642	SAT TT=1344.27	SAT TT=50.615 CHECKS=312405000	SAT TT=632.905 CHECKS=3374480000	SAT TT=54.158 ASSIGNMENTS=26592	SAT TT=2.627 ASSIGNMENTS=224	SAT TT=212.74 CHECKS=512964000 NODES=82676	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=645.054 ASSIGNMENTS=674738 CHECKS=190649000	SAT TT=643.845 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=17.958 ASSIGNMENTS=75790 CHECKS=25578000	SAT TT=61.987 ASSIGNMENTS=308935 CHECKS=91791700	SAT TT=12.364	SAT TT=33.134 ASSIGNMENTS=171486 CHECKS=48062100	SAT TT=141.823 ASSIGNMENTS=674738 CHECKS=190649000	? (TO) TT=1802.19	SAT TT=80.313	SAT TT=321.18
csp/golombRulerArity3/ normalized-ruler-55-11-a3.xml	UNSAT TT=0.059	? (MO) TT=1.03	? (TO) TT=1800.11	UNSAT TT=0.322	UNSAT TT=651.041 CHECKS=3187240000	UNSAT TT=276.773 CHECKS=1419050000	UNSAT TT=1.898 ASSIGNMENTS=0	UNSAT TT=1.743 ASSIGNMENTS=0	UNSAT TT=758.361 CHECKS=1851230000 NODES=180844	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.068 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.073 ASSIGNMENTS=1 CHECKS=5347	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.059 ASSIGNMENTS=1 CHECKS=5347	UNSAT TT=0.072 ASSIGNMENTS=34 CHECKS=20215	UNSAT TT=49.138	UNSAT TT=0.18 ASSIGNMENTS=185 CHECKS=83910	UNSAT TT=0.641 ASSIGNMENTS=426 CHECKS=303910	? (exit code) TT=229.978	UNSAT TT=576.074	UNSAT TT=663.534
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity3/ normalized-ruler-67-11-a3.xml	UNSAT TT=481.664	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=739.711 ASSIGNMENTS=344041	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1173.04 ASSIGNMENTS=3748360 CHECKS=1707990000	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=481.664 ASSIGNMENTS=1419520 CHECKS=701771000	UNSAT TT=663.864 ASSIGNMENTS=1946100 CHECKS=920254000	UNSAT TT=491.775	? (TO) TT=1800.01	UNSAT TT=1196.01 ASSIGNMENTS=3748360 CHECKS=1707990000	? TT=137.905	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/golombRulerArity3/ normalized-ruler-67-12-a3.xml	UNSAT TT=0.216	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=310.414	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=2.542 ASSIGNMENTS=0	UNSAT TT=2.649 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.382 ASSIGNMENTS=158 CHECKS=165599	UNSAT TT=0.384 ASSIGNMENTS=158 CHECKS=165599	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.303 ASSIGNMENTS=116 CHECKS=122632	UNSAT TT=1.586 ASSIGNMENTS=1839 CHECKS=1228210	UNSAT TT=454.412	UNSAT TT=1.785 ASSIGNMENTS=1148 CHECKS=644305	UNSAT TT=0.216 ASSIGNMENTS=62 CHECKS=76810	? TT=122.391	? (TO) TT=1800.04	? (TO) TT=1800.12
csp/golombRulerArity3/ normalized-ruler-70-12-a3.xml	UNSAT TT=2.633	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.614 ASSIGNMENTS=0	UNSAT TT=2.633 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=479.399 ASSIGNMENTS=983931 CHECKS=605767000	UNSAT TT=938.648 ASSIGNMENTS=983931 CHECKS=605767000	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=306.759 ASSIGNMENTS=758155 CHECKS=458500000	UNSAT TT=408.825 ASSIGNMENTS=987631 CHECKS=542072000	UNSAT TT=581.574	? (TO) TT=1800.09	UNSAT TT=432.31 ASSIGNMENTS=983931 CHECKS=605767000	? (MO) TT=81.524	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/golombRulerArity3/ normalized-ruler-70-13-a3.xml	UNSAT TT=0.109	UNSAT TT=1.557 CHECKS=186374 NODES=0	UNSAT TT=1.606 CHECKS=186374 NODES=0	UNSAT TT=0.409	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=2.441 ASSIGNMENTS=0	UNSAT TT=2.214 ASSIGNMENTS=0	UNSAT TT=1730.48 CHECKS=5479830000 NODES=120218	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.115 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.109 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=702.199	UNSAT TT=0.111 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.114 ASSIGNMENTS=0 CHECKS=1	? TT=121.619	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/golombRulerArity4/ normalized-ruler-17-6-a4.xml	SAT TT=0.015	SAT TT=0.857 CHECKS=6556 NODES=10	SAT TT=0.804 CHECKS=15322 NODES=12	SAT TT=0.041	SAT TT=0.019 CHECKS=21000	SAT TT=0.015 CHECKS=20440	SAT TT=0.876 ASSIGNMENTS=159	SAT TT=0.803 ASSIGNMENTS=33	SAT TT=1.826 CHECKS=30378 NODES=151	SAT TT=1.204 CHECKS=375267 NODES=504	SAT TT=0.815 CHECKS=86307 NODES=93	SAT TT=0.035 ASSIGNMENTS=52 CHECKS=25072	SAT TT=0.036 ASSIGNMENTS=52 CHECKS=25072	SAT TT=7.232	SAT TT=7.27	SAT TT=0.125 ASSIGNMENTS=399 CHECKS=180087	SAT TT=0.304 ASSIGNMENTS=3599 CHECKS=539305	SAT TT=0.445	SAT TT=0.37 ASSIGNMENTS=3182 CHECKS=560361	SAT TT=0.037 ASSIGNMENTS=124 CHECKS=60616	SAT TT=9.911	SAT TT=1.057	SAT TT=2.043
csp/golombRulerArity4/ normalized-ruler-17-7-a4.xml	UNSAT TT=0.064	UNSAT TT=1.088 CHECKS=167936 NODES=285	UNSAT TT=1.126 CHECKS=186965 NODES=290	UNSAT TT=0.064	UNSAT TT=32.135 CHECKS=199230000	UNSAT TT=0.083 CHECKS=271584	UNSAT TT=1.243 ASSIGNMENTS=271	UNSAT TT=1.066 ASSIGNMENTS=150	UNSAT TT=3.706 CHECKS=83261 NODES=200	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=0.172 ASSIGNMENTS=268 CHECKS=250493	UNSAT TT=14.574	UNSAT TT=13.128	UNSAT TT=0.247 ASSIGNMENTS=342 CHECKS=313200	UNSAT TT=0.343 ASSIGNMENTS=3245 CHECKS=579763	UNSAT TT=0.643	UNSAT TT=13.25 ASSIGNMENTS=82632 CHECKS=27788100	UNSAT TT=0.15 ASSIGNMENTS=256 CHECKS=243327	UNSAT TT=21.605	UNSAT TT=1.811	UNSAT TT=2.982
csp/golombRulerArity4/ normalized-ruler-25-7-a4.xml	SAT TT=0.062	SAT TT=0.962 CHECKS=64052 NODES=55	SAT TT=1.016 CHECKS=121496 NODES=138	SAT TT=0.062	SAT TT=0.874 CHECKS=3446860	SAT TT=0.624 CHECKS=2417890	SAT TT=1.21 ASSIGNMENTS=248	SAT TT=1.072 ASSIGNMENTS=46	SAT TT=12.425 CHECKS=231236 NODES=520	SAT TT=1.589 CHECKS=677417 NODES=326	SAT TT=1.385 CHECKS=105646 NODES=27	SAT TT=0.269 ASSIGNMENTS=441 CHECKS=358265	SAT TT=0.293 ASSIGNMENTS=441 CHECKS=358265	SAT TT=47.807	SAT TT=33.464	SAT TT=2.519 ASSIGNMENTS=3332 CHECKS=2844560	SAT TT=3.159 ASSIGNMENTS=7421 CHECKS=4052060	SAT TT=0.642	SAT TT=36.49 ASSIGNMENTS=193090 CHECKS=69831200	SAT TT=2.806 ASSIGNMENTS=4521 CHECKS=3598020	SAT TT=75.282	SAT TT=3.272	SAT TT=11.247
csp/golombRulerArity4/ normalized-ruler-25-8-a4.xml	UNSAT TT=0.167	UNSAT TT=3.228 CHECKS=2205720 NODES=1924	UNSAT TT=2.941 CHECKS=1732700 NODES=1571	UNSAT TT=0.167	UNSAT TT=5.102 CHECKS=19713900	UNSAT TT=7.647 CHECKS=31201300	UNSAT TT=4.001 ASSIGNMENTS=2675	UNSAT TT=2.341 ASSIGNMENTS=1043	UNSAT TT=22.018 CHECKS=933192 NODES=1235	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=10.752 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=10.883 ASSIGNMENTS=1924 CHECKS=2205720	UNSAT TT=110.984	UNSAT TT=112.156	UNSAT TT=3.891 ASSIGNMENTS=2323 CHECKS=3879680	UNSAT TT=3.469 ASSIGNMENTS=4952 CHECKS=3753680	UNSAT TT=0.739	UNSAT TT=131.548 ASSIGNMENTS=454104 CHECKS=258182000	UNSAT TT=2.784 ASSIGNMENTS=2119 CHECKS=3283420	UNSAT TT=137.678	UNSAT TT=23.456	UNSAT TT=42.059
csp/golombRulerArity4/ normalized-ruler-34-8-a4.xml	SAT TT=0.171	SAT TT=1.302 CHECKS=285828 NODES=221	SAT TT=1.486 CHECKS=429803 NODES=408	SAT TT=0.171	SAT TT=38.665 CHECKS=194940000	SAT TT=6.829 CHECKS=25613600	SAT TT=3.337 ASSIGNMENTS=1714	SAT TT=3.093 ASSIGNMENTS=1714	SAT TT=76.302 CHECKS=12241200 NODES=20022	SAT TT=7.284 CHECKS=9428430 NODES=2152	SAT TT=3.759 CHECKS=2601190 NODES=550	SAT TT=8.397 ASSIGNMENTS=221 CHECKS=285828	SAT TT=8.94 ASSIGNMENTS=221 CHECKS=285828	SAT TT=416.736	SAT TT=100.33	SAT TT=3.914 ASSIGNMENTS=2339 CHECKS=3610100	SAT TT=47.726 ASSIGNMENTS=32077 CHECKS=42293600	SAT TT=0.723	SAT TT=288.439 ASSIGNMENTS=735982 CHECKS=482836000	SAT TT=11.873 ASSIGNMENTS=7804 CHECKS=11220800	SAT TT=502.436	SAT TT=16.031	SAT TT=41.31
csp/golombRulerArity4/ normalized-ruler-34-9-a4.xml	UNSAT TT=1.607	UNSAT TT=30.542 CHECKS=27699300 NODES=16325	UNSAT TT=26.796 CHECKS=25650800 NODES=15770	UNSAT TT=1.607	UNSAT TT=95.692 CHECKS=400410000	UNSAT TT=103.372 CHECKS=374609000	UNSAT TT=32.469 ASSIGNMENTS=21235	UNSAT TT=32.768 ASSIGNMENTS=21235	UNSAT TT=74.057 CHECKS=10035600 NODES=8731	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=35.791 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=38.519 ASSIGNMENTS=16325 CHECKS=27699300	UNSAT TT=922.554	UNSAT TT=1653.62	UNSAT TT=41.325 ASSIGNMENTS=10874 CHECKS=29474600	UNSAT TT=61.034 ASSIGNMENTS=18485 CHECKS=42834300	UNSAT TT=1.148	UNSAT TT=1210.33 ASSIGNMENTS=1765970 CHECKS=1623110000	UNSAT TT=28.926 ASSIGNMENTS=10112 CHECKS=24333200	UNSAT TT=922.127	UNSAT TT=238.561	UNSAT TT=632.384
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/golombRulerArity4/ normalized-ruler-44-10-a4.xml	UNSAT TT=8.721	UNSAT TT=242.735 CHECKS=235085000 NODES=82017	UNSAT TT=165.991 CHECKS=137337000 NODES=52987	UNSAT TT=8.721	UNSAT TT=240.374 CHECKS=871265000	UNSAT TT=122.873 CHECKS=475470000	UNSAT TT=629.815 ASSIGNMENTS=229488	UNSAT TT=637.048 ASSIGNMENTS=229488	UNSAT TT=161.465 CHECKS=82702700 NODES=39955	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=257.504 ASSIGNMENTS=82017 CHECKS=235085000	UNSAT TT=250.999 ASSIGNMENTS=82017 CHECKS=235085000	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=302.217 ASSIGNMENTS=46039 CHECKS=166675000	UNSAT TT=543.122 ASSIGNMENTS=71448 CHECKS=280312000	UNSAT TT=4.986	? (TO) TT=1800.09	UNSAT TT=440.378 ASSIGNMENTS=62868 CHECKS=225770000	? (TO) TT=1801.9	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-44-9-a4.xml	SAT TT=3.076	SAT TT=7.169 CHECKS=5585320 NODES=3629	SAT TT=5.018 CHECKS=3567980 NODES=2377	SAT TT=3.076	SAT TT=150.526 CHECKS=550404000	SAT TT=84.71 CHECKS=305916000	SAT TT=93.246 ASSIGNMENTS=38459	SAT TT=102.311 ASSIGNMENTS=38459	SAT TT=191.33 CHECKS=107111000 NODES=105570	SAT TT=76.216 CHECKS=124061000 NODES=14410	? (TO) TT=1800.07	SAT TT=13.696 ASSIGNMENTS=3629 CHECKS=5585320	SAT TT=14.446 ASSIGNMENTS=3629 CHECKS=5585320	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=36.506 ASSIGNMENTS=11429 CHECKS=26049900	SAT TT=431.533 ASSIGNMENTS=114754 CHECKS=263194000	SAT TT=2.166	? (TO) TT=1800.03	SAT TT=641.168 ASSIGNMENTS=187356 CHECKS=435448000	? (TO) TT=1802.2	SAT TT=127.626	SAT TT=1716.08
csp/golombRulerArity4/ normalized-ruler-55-10-a4.xml	SAT TT=10.948	SAT TT=22.868 CHECKS=18865400 NODES=8611	SAT TT=10.948 CHECKS=7960140 NODES=3105	SAT TT=53.028	SAT TT=1034.9 CHECKS=3735620000	SAT TT=866.744 CHECKS=2908610000	SAT TT=180.562 ASSIGNMENTS=66901	SAT TT=183.187 ASSIGNMENTS=66901	SAT TT=191.182 CHECKS=105709000 NODES=40275	SAT TT=1034.52 CHECKS=1759330000 NODES=112358	? (TO) TT=1800.09	SAT TT=28.671 ASSIGNMENTS=8611 CHECKS=18865400	SAT TT=29.087 ASSIGNMENTS=8611 CHECKS=18865400	? (MO) TT=764.52	? (MO) TT=726.7	SAT TT=256.806 ASSIGNMENTS=40183 CHECKS=138122000	SAT TT=328.621 ASSIGNMENTS=49815 CHECKS=163775000	SAT TT=11.704	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.88	? (TO) TT=1800.1	? (TO) TT=1800.08
csp/golombRulerArity4/ normalized-ruler-55-11-a4.xml	UNSAT TT=126.19	? (TO) TT=1800.16	UNSAT TT=1568.97 CHECKS=1326640000 NODES=340090	UNSAT TT=126.19	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.14	UNSAT TT=720.487 ASSIGNMENTS=208157	UNSAT TT=957.629 CHECKS=761886000 NODES=260086	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.04	? (MO) TT=1098.55	? (MO) TT=1205.89	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=17.956	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1801.04	? (TO) TT=1800.27	? (TO) TT=1800.11
csp/golombRulerArity4/ normalized-ruler-67-11-a4.xml		? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=427.536	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1801.28	? (MO) TT=62.96	? (MO) TT=258.11
csp/golombRulerArity4/ normalized-ruler-67-12-a4.xml	UNSAT TT=427.269	? (TO) TT=1800.16	? (TO) TT=1800.12	UNSAT TT=427.269	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=156.998	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1801.76	? (MO) TT=87.96	? (MO) TT=258.87
csp/golombRulerArity4/ normalized-ruler-70-12-a4.xml		? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=455.772	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.54	? (MO) TT=89.48	? (MO) TT=284.33
csp/golombRulerArity4/ normalized-ruler-70-13-a4.xml	UNSAT TT=860.676	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=860.676	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=166.862	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1801.72	? (MO) TT=131.149	? (MO) TT=296.602
csp/graceful/ normalized-graceful--K4-P2.xml	SAT TT=0.022	SAT TT=4.034 CHECKS=8857960 NODES=4514	SAT TT=3.123 CHECKS=6251660 NODES=3627	? (TO) TT=1800.11	SAT TT=0.446 CHECKS=1994830	SAT TT=0.61 CHECKS=2677860	SAT TT=0.906 ASSIGNMENTS=40	SAT TT=0.857 ASSIGNMENTS=17	SAT TT=1.208 CHECKS=753993 NODES=1071	SAT TT=5.363 CHECKS=25780700 NODES=95296	? (TO) TT=1800.09	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=0.163 ASSIGNMENTS=995 CHECKS=128318	SAT TT=5.051	SAT TT=2.235	SAT TT=0.142 ASSIGNMENTS=1048 CHECKS=120877	SAT TT=0.033 ASSIGNMENTS=212 CHECKS=21967	SAT TT=1339.6	SAT TT=0.117 ASSIGNMENTS=806 CHECKS=85848	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=11849	SAT TT=4.143	SAT TT=0.808	SAT TT=1.287
csp/nengfa/ normalized-block.xml	UNSAT TT=3.833	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=1576.66	? (TO) TT=1800.05	? (TO) TT=1800.1	? (problem) TT=2.342	? (problem) TT=2.174	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=15.185	UNSAT TT=17.261	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=23.165	UNSAT TT=3.919	UNSAT TT=3.833
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/nengfa/ normalized-pack.xml	SAT TT=34.225	SAT TT=936.802 CHECKS=1423020000 NODES=27180	SAT TT=925.439 CHECKS=1423020000 NODES=27180	SAT TT=1340.32	SAT TT=771.91 CHECKS=290338000	? (TO) TT=1800.03	? (problem) TT=7.551	? (problem) TT=7.689	SAT TT=735.495 CHECKS=1281730000 NODES=11069	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=538.374 ASSIGNMENTS=114204 CHECKS=280348000	SAT TT=477.911 ASSIGNMENTS=114204 CHECKS=280348000	? (MO) TT=385.89	? (MO) TT=388.27	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=470.74 ASSIGNMENTS=114204 CHECKS=280348000	? TT=122.483	SAT TT=34.225	SAT TT=37.311
csp/nengfa/ normalized-radi.xml	SAT TT=0.036	SAT TT=313.467 CHECKS=465626000 NODES=8948	SAT TT=315.216 CHECKS=459093000 NODES=8905	SAT TT=8.211	SAT TT=0.437 CHECKS=60525	SAT TT=0.364 CHECKS=53261	SAT TT=1.239 ASSIGNMENTS=102	SAT TT=1.13 ASSIGNMENTS=36	SAT TT=172.292 CHECKS=256883000 NODES=200	SAT TT=1556 CHECKS=3501020000 NODES=5558290	? (TO) TT=1800.06	SAT TT=0.046 ASSIGNMENTS=71 CHECKS=18246	SAT TT=0.045 ASSIGNMENTS=71 CHECKS=18246	? (problem) TT=149.148	? (problem) TT=148.095	SAT TT=0.036 ASSIGNMENTS=87 CHECKS=18085	SAT TT=0.846 ASSIGNMENTS=11180 CHECKS=1742310	SAT TT=0.685	SAT TT=0.371 ASSIGNMENTS=2839 CHECKS=437882	SAT TT=0.7 ASSIGNMENTS=7383 CHECKS=1445130	? TT=125.992	SAT TT=1.533	SAT TT=1.907
csp/nengfa/ normalized-schur.xml	SAT TT=0.34	SAT TT=4.623 CHECKS=805771 NODES=2597	SAT TT=8.018 CHECKS=2034400 NODES=6261	SAT TT=17.533	? (TO) TT=1800.06	SAT TT=32.383 CHECKS=33801300	SAT TT=3.504 ASSIGNMENTS=61	SAT TT=3.172 ASSIGNMENTS=61	SAT TT=4.683 CHECKS=12110 NODES=110	SAT TT=8.207 CHECKS=6507370 NODES=7583	SAT TT=5.14 CHECKS=847869 NODES=327	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=0.353 ASSIGNMENTS=60 CHECKS=29428	SAT TT=178.449	SAT TT=181.273	SAT TT=0.34 ASSIGNMENTS=60 CHECKS=29428	SAT TT=25.552 ASSIGNMENTS=19667 CHECKS=25538300	SAT TT=196.688	SAT TT=2.711 ASSIGNMENTS=1800 CHECKS=2317110	SAT TT=9.088 ASSIGNMENTS=4736 CHECKS=8677330	SAT TT=25.208	SAT TT=24.674	SAT TT=9.867
csp/ramsey3/ normalized-ramsey-10-3.xml	SAT TT=0.011	SAT TT=1.044 CHECKS=1038 NODES=85	SAT TT=0.877 CHECKS=835 NODES=46	SAT TT=0.056	SAT TT=0.071 CHECKS=6054	SAT TT=34.704 CHECKS=41831300	SAT TT=0.72 ASSIGNMENTS=40	SAT TT=0.75 ASSIGNMENTS=40	SAT TT=0.814 CHECKS=1232 NODES=102	SAT TT=0.836 CHECKS=3014 NODES=8	SAT TT=0.732 CHECKS=4247 NODES=11	SAT TT=0.024 ASSIGNMENTS=40 CHECKS=664	SAT TT=0.023 ASSIGNMENTS=40 CHECKS=664	SAT TT=1.19	SAT TT=1.187	SAT TT=0.013 ASSIGNMENTS=40 CHECKS=664	SAT TT=0.011 ASSIGNMENTS=35 CHECKS=547	SAT TT=4.809	SAT TT=0.015 ASSIGNMENTS=162 CHECKS=2988	SAT TT=0.013 ASSIGNMENTS=29 CHECKS=578	SAT TT=1.468	SAT TT=0.834	SAT TT=0.883
csp/ramsey3/ normalized-ramsey-13-3.xml	SAT TT=0.021	SAT TT=1.029 CHECKS=1887 NODES=151	SAT TT=1.164 CHECKS=3639 NODES=215	SAT TT=1.431	SAT TT=0.166 CHECKS=16109	? (TO) TT=1800.06	SAT TT=1.126 ASSIGNMENTS=117	SAT TT=1.055 ASSIGNMENTS=117	SAT TT=1.028 CHECKS=2416 NODES=158	SAT TT=0.972 CHECKS=8991 NODES=41	SAT TT=0.953 CHECKS=13235 NODES=28	SAT TT=0.036 ASSIGNMENTS=55 CHECKS=2044	SAT TT=0.035 ASSIGNMENTS=55 CHECKS=2044	SAT TT=1.505	SAT TT=1.732	SAT TT=0.024 ASSIGNMENTS=57 CHECKS=2146	SAT TT=0.05 ASSIGNMENTS=884 CHECKS=30190	? (TO) TT=1800.02	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=9296	SAT TT=0.021 ASSIGNMENTS=46 CHECKS=1614	SAT TT=2.142	SAT TT=1.337	SAT TT=1.355
csp/ramsey3/ normalized-ramsey-15-3.xml	SAT TT=0.161	SAT TT=110.907 CHECKS=36998000 NODES=1274680	SAT TT=49 CHECKS=17802400 NODES=514502	? (TO) TT=1800.11	SAT TT=61.459 CHECKS=51475100	? (TO) TT=1800.12	SAT TT=3.45 ASSIGNMENTS=8136	SAT TT=3.34 ASSIGNMENTS=8136	SAT TT=1.226 CHECKS=18665 NODES=476	SAT TT=1.93 CHECKS=1901810 NODES=24254	SAT TT=2.848 CHECKS=4122970 NODES=10575	SAT TT=9.048 ASSIGNMENTS=4292 CHECKS=156490	SAT TT=9.046 ASSIGNMENTS=4292 CHECKS=156490	SAT TT=1.837	SAT TT=1.911	? (TO) TT=1800.08	SAT TT=1.252 ASSIGNMENTS=15981 CHECKS=1445160	? (TO) TT=1800.08	SAT TT=1.292 ASSIGNMENTS=12472 CHECKS=1544020	SAT TT=0.161 ASSIGNMENTS=1445 CHECKS=148508	SAT TT=2.997	SAT TT=1.831	SAT TT=7.106
csp/ramsey3/ normalized-ramsey-16-3.xml	SAT TT=0.513	SAT TT=94.026 CHECKS=28276500 NODES=918201	? (TO) TT=1800.07	SAT TT=1687.17	SAT TT=29.765 CHECKS=23885700	? (TO) TT=1800.08	SAT TT=2.26 ASSIGNMENTS=2184	SAT TT=1.996 ASSIGNMENTS=2184	SAT TT=1.749 CHECKS=166802 NODES=2250	SAT TT=4.757 CHECKS=7607620 NODES=90420	SAT TT=1.557 CHECKS=739056 NODES=3187	SAT TT=8.727 ASSIGNMENTS=1529 CHECKS=46737	SAT TT=8.939 ASSIGNMENTS=1529 CHECKS=46737	SAT TT=1.903	SAT TT=2.073	? (TO) TT=1800.06	SAT TT=0.828 ASSIGNMENTS=10563 CHECKS=883899	? (TO) TT=1800.12	SAT TT=0.53 ASSIGNMENTS=4651 CHECKS=587430	SAT TT=0.513 ASSIGNMENTS=4538 CHECKS=532646	SAT TT=3.174	SAT TT=2.908	SAT TT=6.545
csp/ramsey3/ normalized-ramsey-17-3.xml	UNSAT TT=11.189	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=11.189 CHECKS=4652950	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/ramsey3/ normalized-ramsey-18-3.xml	UNSAT TT=19.169	UNSAT TT=1721.17 CHECKS=525920000 NODES=13620600	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=19.169 CHECKS=7258600	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1
csp/ramsey3/ normalized-ramsey-20-3.xml	UNSAT TT=23.197	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=23.197 CHECKS=7013200	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ramsey3/ normalized-ramsey-25-3.xml	UNSAT TT=60.424	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.04	UNSAT TT=60.424 CHECKS=25331000	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1
csp/ramsey4/ normalized-ramsey-25-4.xml	SAT TT=0.142	SAT TT=2.707 CHECKS=89277 NODES=2585	SAT TT=4.286 CHECKS=501470 NODES=9263	SAT TT=73.75	SAT TT=71.407 CHECKS=28132200	? (TO) TT=1800.04	SAT TT=2.764 ASSIGNMENTS=438	SAT TT=2.59 ASSIGNMENTS=438	SAT TT=3.534 CHECKS=43922 NODES=1226	SAT TT=2.852 CHECKS=96862 NODES=153	SAT TT=3.137 CHECKS=232676 NODES=89	SAT TT=0.173 ASSIGNMENTS=260 CHECKS=22573	SAT TT=0.171 ASSIGNMENTS=260 CHECKS=22573	SAT TT=3.755	SAT TT=3.563	SAT TT=0.158 ASSIGNMENTS=271 CHECKS=21056	SAT TT=0.28 ASSIGNMENTS=2130 CHECKS=138690	? (TO) TT=1800.09	SAT TT=0.37 ASSIGNMENTS=1476 CHECKS=155520	SAT TT=0.142 ASSIGNMENTS=227 CHECKS=15725	SAT TT=4.429	SAT TT=11.758	SAT TT=19.299
csp/ramsey4/ normalized-ramsey-30-4.xml	SAT TT=0.259	SAT TT=1466.23 CHECKS=696818000 NODES=8969030	SAT TT=6.691 CHECKS=832943 NODES=13765	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=3.775 ASSIGNMENTS=559	SAT TT=3.311 ASSIGNMENTS=559	SAT TT=10.364 CHECKS=379071 NODES=3762	SAT TT=5.921 CHECKS=252713 NODES=587	SAT TT=6.181 CHECKS=680515 NODES=249	SAT TT=0.278 ASSIGNMENTS=312 CHECKS=37314	SAT TT=0.3 ASSIGNMENTS=312 CHECKS=37314	SAT TT=5.458	SAT TT=4.826	SAT TT=0.276 ASSIGNMENTS=297 CHECKS=34633	SAT TT=3.49 ASSIGNMENTS=25464 CHECKS=2490420	? (TO) TT=1800.09	SAT TT=0.71 ASSIGNMENTS=2276 CHECKS=326371	SAT TT=0.259 ASSIGNMENTS=303 CHECKS=37035	SAT TT=6.116	SAT TT=35.599	SAT TT=272.507
csp/ramsey4/ normalized-ramsey-32-4.xml	SAT TT=0.375	SAT TT=36.921 CHECKS=8377680 NODES=124110	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=4.81 ASSIGNMENTS=1314	SAT TT=4.363 ASSIGNMENTS=1314	SAT TT=25.54 CHECKS=1777520 NODES=9817	SAT TT=7.545 CHECKS=362562 NODES=891	SAT TT=8.656 CHECKS=1010300 NODES=302	SAT TT=11.008 ASSIGNMENTS=2938 CHECKS=174510	SAT TT=11.403 ASSIGNMENTS=2938 CHECKS=174510	SAT TT=6.501	SAT TT=10.501	SAT TT=0.375 ASSIGNMENTS=452 CHECKS=89852	SAT TT=4.481 ASSIGNMENTS=27208 CHECKS=3086230	? (TO) TT=1800.05	SAT TT=1.002 ASSIGNMENTS=2657 CHECKS=462746	SAT TT=1.789 ASSIGNMENTS=4803 CHECKS=1743960	SAT TT=9.289	SAT TT=36.434	SAT TT=607.457
csp/ramsey4/ normalized-ramsey-33-4.xml	SAT TT=1.122	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	SAT TT=7.596 ASSIGNMENTS=3942	SAT TT=7.973 ASSIGNMENTS=3942	SAT TT=26.14 CHECKS=1313650 NODES=8275	SAT TT=134.572 CHECKS=224256000 NODES=900966	SAT TT=10.909 CHECKS=2061530 NODES=725	SAT TT=11.283 ASSIGNMENTS=3903 CHECKS=295199	SAT TT=11.61 ASSIGNMENTS=3903 CHECKS=295199	SAT TT=7.573	SAT TT=36.879	? (TO) TT=1800.05	SAT TT=5.228 ASSIGNMENTS=29122 CHECKS=3884310	? (TO) TT=1800.1	SAT TT=1.122 ASSIGNMENTS=2576 CHECKS=513364	SAT TT=8.688 ASSIGNMENTS=23991 CHECKS=10180100	SAT TT=30.879	SAT TT=63.96	SAT TT=828.092
csp/ramsey4/ normalized-ramsey-34-4.xml	SAT TT=1.575	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.02	SAT TT=105.834 ASSIGNMENTS=67156	SAT TT=101.739 ASSIGNMENTS=67156	SAT TT=40.921 CHECKS=2479700 NODES=12242	SAT TT=35.663 CHECKS=39719100 NODES=153985	SAT TT=11.409 CHECKS=1516230 NODES=544	SAT TT=14.573 ASSIGNMENTS=14202 CHECKS=1418260	SAT TT=14.598 ASSIGNMENTS=14202 CHECKS=1418260	SAT TT=7.852	SAT TT=41.776	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=1.575 ASSIGNMENTS=3935 CHECKS=909558	SAT TT=11.317 ASSIGNMENTS=28457 CHECKS=13399600	SAT TT=167.738	SAT TT=366.2	SAT TT=1039.57
csp/ramsey4/ normalized-ramsey-35-4.xml	SAT TT=12.963	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=928.021 ASSIGNMENTS=669213	SAT TT=991.658 ASSIGNMENTS=669213	SAT TT=106.465 CHECKS=7799680 NODES=37035	SAT TT=1674.56 CHECKS=2662960000 NODES=10053200	SAT TT=12.963 CHECKS=1777030 NODES=559	SAT TT=1771.32 ASSIGNMENTS=669213	SAT TT=1063.55 ASSIGNMENTS=722397 CHECKS=394854000	SAT TT=160.261	SAT TT=173.659	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=311.551 ASSIGNMENTS=722397 CHECKS=394854000	? (TO) TT=1800.29	SAT TT=800.17	? (TO) TT=1800
csp/ramsey4/ normalized-ramsey-38-4.xml	SAT TT=551.135	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=564.971 ASSIGNMENTS=1467950 CHECKS=217059000	SAT TT=551.135 ASSIGNMENTS=1467950 CHECKS=217059000	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/ramsey4/ normalized-ramsey-45-4.xml		? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.19	? (TO) TT=1800.04
csp/schurrLemma/ normalized-lemma-100-9-mod.xml	UNSAT TT=0.528	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=0.626	? (TO) TT=1800.05	? (TO) TT=1800.02	? (problem) TT=1.346	? (problem) TT=1.442	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.552 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.554 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1466.44	UNSAT TT=751.587	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.539 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=29.938	UNSAT TT=0.53 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.528 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=351.423	UNSAT TT=6.271	UNSAT TT=19.517
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/schurrLemma/ normalized-lemma-12-9-mod.xml	UNSAT TT=0.006	UNSAT TT=27.7 CHECKS=25613000 NODES=320391	UNSAT TT=26.889 CHECKS=24722700 NODES=295247	UNSAT TT=0.029	UNSAT TT=85.673 CHECKS=453129000	UNSAT TT=86.576 CHECKS=446227000	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=24.763 CHECKS=31248600 NODES=394741	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=409.422	UNSAT TT=43.735	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.881	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=386.472	UNSAT TT=1.03	UNSAT TT=2
csp/schurrLemma/ normalized-lemma-15-9-mod.xml	UNSAT TT=0.007	UNSAT TT=31.263 CHECKS=34497100 NODES=204625	UNSAT TT=32.959 CHECKS=34693600 NODES=202782	UNSAT TT=0.033	UNSAT TT=117.111 CHECKS=583739000	UNSAT TT=116.253 CHECKS=530920000	UNSAT TT=0.676 ASSIGNMENTS=0	UNSAT TT=0.674 ASSIGNMENTS=0	UNSAT TT=37.503 CHECKS=51654000 NODES=259884	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=784.908	UNSAT TT=53.159	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.971	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=295.39	UNSAT TT=1.343	UNSAT TT=4.464
csp/schurrLemma/ normalized-lemma-20-9-mod.xml	UNSAT TT=0.01	UNSAT TT=62.918 CHECKS=75283300 NODES=202721	UNSAT TT=62.38 CHECKS=74485600 NODES=203248	UNSAT TT=0.047	UNSAT TT=87.451 CHECKS=393807000	UNSAT TT=180.19 CHECKS=817337000	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	UNSAT TT=64.881 CHECKS=110513000 NODES=257259	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=823.395	UNSAT TT=77.391	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=6.472	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=470.351	UNSAT TT=1.4	UNSAT TT=5.219
csp/schurrLemma/ normalized-lemma-23-3.xml	SAT TT=0.012	SAT TT=0.867 CHECKS=7356 NODES=163	SAT TT=0.846 CHECKS=417 NODES=0	SAT TT=0.058	SAT TT=0.061 CHECKS=2188	SAT TT=0.049 CHECKS=66058	SAT TT=0.789 ASSIGNMENTS=18	SAT TT=0.68 ASSIGNMENTS=18	SAT TT=0.912 CHECKS=70160 NODES=866	SAT TT=0.888 CHECKS=44108 NODES=426	SAT TT=0.799 CHECKS=13276 NODES=57	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=1109	SAT TT=0.024 ASSIGNMENTS=14 CHECKS=1109	SAT TT=1.235	SAT TT=1.15	SAT TT=0.012 ASSIGNMENTS=14 CHECKS=1109	SAT TT=0.053 ASSIGNMENTS=801 CHECKS=49729	SAT TT=0.682	SAT TT=0.03 ASSIGNMENTS=227 CHECKS=19516	SAT TT=0.07 ASSIGNMENTS=624 CHECKS=68552	SAT TT=1.91	SAT TT=0.838	SAT TT=0.875
csp/schurrLemma/ normalized-lemma-24-3.xml	UNSAT TT=0.083	UNSAT TT=1.613 CHECKS=313553 NODES=5074	UNSAT TT=1.58 CHECKS=305904 NODES=5022	UNSAT TT=0.083	UNSAT TT=1.712 CHECKS=1738540	UNSAT TT=70.438 CHECKS=117852000	UNSAT TT=2.909 ASSIGNMENTS=8068	UNSAT TT=2.905 ASSIGNMENTS=8068	UNSAT TT=1.164 CHECKS=249923 NODES=2782	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.186 ASSIGNMENTS=1549 CHECKS=189500	UNSAT TT=0.186 ASSIGNMENTS=1549 CHECKS=189500	UNSAT TT=1.038	UNSAT TT=0.834	UNSAT TT=0.151 ASSIGNMENTS=1488 CHECKS=182084	UNSAT TT=0.345 ASSIGNMENTS=5217 CHECKS=418785	UNSAT TT=28.658	UNSAT TT=0.431 ASSIGNMENTS=4815 CHECKS=523343	UNSAT TT=0.342 ASSIGNMENTS=3179 CHECKS=386617	UNSAT TT=2.267	UNSAT TT=1.003	UNSAT TT=1.235
csp/schurrLemma/ normalized-lemma-30-9-mod.xml	UNSAT TT=0.015	UNSAT TT=142.409 CHECKS=209016000 NODES=203833	UNSAT TT=154.915 CHECKS=208352000 NODES=202754	UNSAT TT=0.076	UNSAT TT=354.139 CHECKS=1610310000	UNSAT TT=307.782 CHECKS=1537440000	UNSAT TT=1.125 ASSIGNMENTS=0	UNSAT TT=1.138 ASSIGNMENTS=0	UNSAT TT=157.677 CHECKS=274822000 NODES=251327	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=614.607	UNSAT TT=193.522	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=9.654	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=379.171	UNSAT TT=2.516	UNSAT TT=4.402
csp/schurrLemma/ normalized-lemma-50-9-mod.xml	UNSAT TT=0.044	UNSAT TT=493.224 CHECKS=706177000 NODES=202186	UNSAT TT=460.925 CHECKS=710946000 NODES=203588	UNSAT TT=0.171	UNSAT TT=869.283 CHECKS=3766130000	UNSAT TT=856.879 CHECKS=3702890000	UNSAT TT=2.123 ASSIGNMENTS=0	UNSAT TT=1.976 ASSIGNMENTS=0	UNSAT TT=448.819 CHECKS=804566000 NODES=256766	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=808.924	UNSAT TT=608.924	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=15.438	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=534.629	UNSAT TT=3.041	UNSAT TT=6.168
csp/schurrLemma/ normalized-lemma-66-4.xml	SAT TT=0.073	SAT TT=1.38 CHECKS=6355 NODES=79	? (TO) TT=1800.13	SAT TT=1675.52	SAT TT=7.54 CHECKS=6558790	? (TO) TT=1800.04	SAT TT=1.812 ASSIGNMENTS=86	SAT TT=1.547 ASSIGNMENTS=86	? (TO) TT=1800.02	SAT TT=41.464 CHECKS=77632000 NODES=183301	SAT TT=1.71 CHECKS=411248 NODES=387	SAT TT=0.085 ASSIGNMENTS=74 CHECKS=23832	SAT TT=0.089 ASSIGNMENTS=74 CHECKS=23832	SAT TT=444.956	? (TO) TT=1800.12	SAT TT=0.073 ASSIGNMENTS=57 CHECKS=19621	SAT TT=421.705 ASSIGNMENTS=821388 CHECKS=577633000	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.15
csp/schurrLemma/ normalized-lemma-67-4.xml		? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/socialGolfers/ normalized-socialGolfer-6-3-5.xml	SAT TT=8.054	? (TO) TT=1800.12	SAT TT=659.955 CHECKS=135231000 NODES=2529250	? (TO) TT=1800.11	SAT TT=8.054 CHECKS=3369210	SAT TT=16.805 CHECKS=7540830	SAT TT=18.227 ASSIGNMENTS=50236	? (TO) TT=1800.16	SAT TT=241.903 CHECKS=78686900 NODES=154180	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=1661.99 ASSIGNMENTS=48701 CHECKS=42122700	SAT TT=319.841 ASSIGNMENTS=48701 CHECKS=42122700	SAT TT=294.496	SAT TT=24.734	SAT TT=237.562 ASSIGNMENTS=65401 CHECKS=151995000	SAT TT=125.667 ASSIGNMENTS=48774 CHECKS=73355900	? (TO) TT=1800.03	SAT TT=910.112 ASSIGNMENTS=408762 CHECKS=505264000	SAT TT=65.991 ASSIGNMENTS=48701 CHECKS=42122700	? (TO) TT=1800.16	SAT TT=51.289	SAT TT=67.654
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/socialGolfers/ normalized-socialGolfer-6-3-6.xml	SAT TT=2.664	SAT TT=10.484 CHECKS=929194 NODES=20374	SAT TT=987.752 CHECKS=246549000 NODES=2337870	? (TO) TT=1800.1	SAT TT=15.438 CHECKS=2921480	SAT TT=3.716 CHECKS=839495	SAT TT=5.523 ASSIGNMENTS=3038	SAT TT=8.384 ASSIGNMENTS=3832	SAT TT=36.278 CHECKS=9144040 NODES=6829	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=12.619 ASSIGNMENTS=7230 CHECKS=1003200	SAT TT=12.783 ASSIGNMENTS=7230 CHECKS=1003200	SAT TT=10.405	SAT TT=10.435	? (TO) TT=1800.03	SAT TT=7.298 ASSIGNMENTS=82143 CHECKS=5740400	? (TO) TT=1800.11	SAT TT=7.143 ASSIGNMENTS=6226 CHECKS=4721750	SAT TT=8.532 ASSIGNMENTS=4349 CHECKS=5654250	? TT=160.854	SAT TT=20.385	SAT TT=2.664
csp/socialGolfers/ normalized-socialGolfer-6-3-7.xml	SAT TT=2.969	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=12.344 CHECKS=1841210	SAT TT=10.583 CHECKS=1696730	SAT TT=6.991 ASSIGNMENTS=1636	SAT TT=19.181 ASSIGNMENTS=8377	SAT TT=117.361 CHECKS=46589200 NODES=3983	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=23.583 ASSIGNMENTS=6803 CHECKS=6600970	SAT TT=23.175 ASSIGNMENTS=6803 CHECKS=6600970	SAT TT=17.555	SAT TT=19.308	SAT TT=315.559 ASSIGNMENTS=172044 CHECKS=281587000	SAT TT=11.562 ASSIGNMENTS=120393 CHECKS=8509700	? (TO) TT=1800.05	SAT TT=3.27 ASSIGNMENTS=7423 CHECKS=1615370	SAT TT=2.969 ASSIGNMENTS=1443 CHECKS=1423330	? TT=148.518	SAT TT=3.299	SAT TT=4.012
csp/socialGolfers/ normalized-socialGolfer-6-3-8.xml	SAT TT=2.05	SAT TT=52.4 CHECKS=13777800 NODES=31419	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=18.941 CHECKS=2521860	SAT TT=34.389 CHECKS=2977640	SAT TT=10.993 ASSIGNMENTS=3277	SAT TT=38.512 ASSIGNMENTS=12029	SAT TT=359.09 CHECKS=443317000 NODES=4523	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=67.027 ASSIGNMENTS=11581 CHECKS=25089100	SAT TT=67.61 ASSIGNMENTS=11581 CHECKS=25089100	SAT TT=43.288	SAT TT=42.26	SAT TT=2.05 ASSIGNMENTS=1879 CHECKS=893598	SAT TT=18.167 ASSIGNMENTS=168472 CHECKS=12085800	? (TO) TT=1800.07	SAT TT=14.336 ASSIGNMENTS=11581 CHECKS=6563140	SAT TT=2.662 ASSIGNMENTS=2205 CHECKS=1150040	? TT=488.465	SAT TT=4.698	SAT TT=5.079
csp/socialGolfers/ normalized-socialGolfer-6-4-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=158.355	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/socialGolfers/ normalized-socialGolfer-6-4-7.xml	SAT TT=20.854	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.183	SAT TT=327.835	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1076.63 ASSIGNMENTS=267207 CHECKS=755303000	? (TO) TT=1800.1	? TT=673.939	SAT TT=213.301	SAT TT=20.854
csp/socialGolfers/ normalized-socialGolfer-6-4-8.xml	SAT TT=7.338	? (MO) TT=5.216	SAT TT=1573.03 CHECKS=540812000 NODES=101849	? (TO) TT=1800.03	SAT TT=82.521 CHECKS=6397680	SAT TT=92.526 CHECKS=5826430	SAT TT=19.257 ASSIGNMENTS=4458	SAT TT=655.464 ASSIGNMENTS=125573	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=512.04 ASSIGNMENTS=33305 CHECKS=159002000	SAT TT=477.739 ASSIGNMENTS=33305 CHECKS=159002000	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=177.184 ASSIGNMENTS=36154 CHECKS=94642500	? (TO) TT=1800.08	? TT=226.396	SAT TT=67.114	SAT TT=7.338
csp/socialGolfers/ normalized-socialGolfer-7-4-8.xml	SAT TT=339.765	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=731.177 ASSIGNMENTS=140446 CHECKS=411969000	? (TO) TT=1800.05	? TT=193.072	? (TO) TT=1800.1	SAT TT=339.765
csp/socialGolfers/ normalized-socialGolfer-8-4-8.xml		? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=180.57	? (TO) TT=1800	? (TO) TT=1800.03
csp/socialGolfers/ normalized-socialGolfer-9-4-8.xml		? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? TT=215.161	? (TO) TT=1800.07	? (TO) TT=1800.06

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	58	57	65	61	51	72	64	32	24	73	72	62	72	72	69	48	65	66
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	58	57	65	61	51	72	64	32	24	73	72	62	72	72	69	48	65	66
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	1	11	7	5	2	0	1	1	0	2	16	4	19	18	1	1	5
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0