CSP 2008 Competition: results by benchmark

Results by benchmark for category global constraints (GLOBAL), subcategory academic problems

This page displays the results of the different solvers for each benchmark for category global constraints (GLOBAL), subcategory academic problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
cpHydra k_10
cpHydra k_40
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-10-10.xml	SAT TT=0.026	? TT=0.903	? TT=0.855	SAT TT=0.46	SAT TT=0.727 CHECKS=164427	SAT TT=0.255 CHECKS=154527	SAT TT=1.216 ASSIGNMENTS=17	SAT TT=1.433 ASSIGNMENTS=20	SAT TT=0.04 ASSIGNMENTS=25 CHECKS=8352	SAT TT=0.038 ASSIGNMENTS=25 CHECKS=8352	SAT TT=0.026 ASSIGNMENTS=18 CHECKS=6836	SAT TT=0.03 ASSIGNMENTS=47 CHECKS=17524	? (exit code) TT=0.531	SAT TT=0.213 ASSIGNMENTS=1306 CHECKS=360033	SAT TT=0.027 ASSIGNMENTS=25 CHECKS=8353	? TT=2.381	SAT TT=1.22	SAT TT=1.599
csp/allsquares/ normalized-squares-11-11.xml	SAT TT=0.03	? TT=0.847	? TT=0.844	SAT TT=1158.8	SAT TT=0.978 CHECKS=251586	SAT TT=0.225 CHECKS=118247	SAT TT=1.318 ASSIGNMENTS=20	SAT TT=1.536 ASSIGNMENTS=21	SAT TT=0.043 ASSIGNMENTS=26 CHECKS=10371	SAT TT=0.045 ASSIGNMENTS=26 CHECKS=10371	SAT TT=0.03 ASSIGNMENTS=20 CHECKS=8737	SAT TT=0.033 ASSIGNMENTS=40 CHECKS=10721	? (exit code) TT=0.569	SAT TT=0.043 ASSIGNMENTS=138 CHECKS=14464	SAT TT=0.032 ASSIGNMENTS=26 CHECKS=10361	? TT=2.807	SAT TT=1.518	SAT TT=1.762
csp/allsquares/ normalized-squares-12-12.xml	SAT TT=0.036	? TT=0.889	? TT=0.916	? (TO) TT=1800.09	SAT TT=0.95 CHECKS=157703	SAT TT=0.587 CHECKS=284867	SAT TT=1.463 ASSIGNMENTS=20	SAT TT=1.733 ASSIGNMENTS=25	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=11812	SAT TT=0.048 ASSIGNMENTS=92 CHECKS=40323	? (exit code) TT=0.524	SAT TT=0.087 ASSIGNMENTS=295 CHECKS=75984	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=12296	? TT=2.877	SAT TT=1.862	SAT TT=2.017
csp/allsquares/ normalized-squares-13-13.xml	SAT TT=0.044	? TT=0.968	? TT=1.068	SAT TT=1338.97	SAT TT=1.564 CHECKS=371572	SAT TT=0.861 CHECKS=394761	SAT TT=1.549 ASSIGNMENTS=22	SAT TT=1.895 ASSIGNMENTS=28	SAT TT=0.057 ASSIGNMENTS=30 CHECKS=15401	SAT TT=0.055 ASSIGNMENTS=30 CHECKS=15401	SAT TT=0.046 ASSIGNMENTS=33 CHECKS=14808	SAT TT=0.084 ASSIGNMENTS=281 CHECKS=134758	? (exit code) TT=0.602	SAT TT=0.135 ASSIGNMENTS=464 CHECKS=158488	SAT TT=0.044 ASSIGNMENTS=30 CHECKS=15402	? TT=3.504	SAT TT=1.898	SAT TT=2.755
csp/allsquares/ normalized-squares-14-14.xml	SAT TT=0.051	? TT=0.999	? TT=1.141	? (TO) TT=1800.11	SAT TT=8.927 CHECKS=9859980	SAT TT=1.576 CHECKS=807176	SAT TT=1.886 ASSIGNMENTS=23	SAT TT=1.889 ASSIGNMENTS=30	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	SAT TT=0.054 ASSIGNMENTS=35 CHECKS=18128	SAT TT=0.054 ASSIGNMENTS=36 CHECKS=26750	? (exit code) TT=0.615	SAT TT=0.189 ASSIGNMENTS=395 CHECKS=238430	SAT TT=0.051 ASSIGNMENTS=33 CHECKS=18942	? TT=3.751	SAT TT=1.933	SAT TT=3.25
csp/allsquares/ normalized-squares-15-15.xml	SAT TT=0.072	? TT=1.176	? TT=1.176	SAT TT=1340.21	SAT TT=2.422 CHECKS=1193690	SAT TT=1.673 CHECKS=735506	SAT TT=2.143 ASSIGNMENTS=116	SAT TT=2.076 ASSIGNMENTS=29	SAT TT=0.084 ASSIGNMENTS=69 CHECKS=43128	SAT TT=0.08 ASSIGNMENTS=69 CHECKS=43128	SAT TT=0.102 ASSIGNMENTS=192 CHECKS=148958	SAT TT=0.164 ASSIGNMENTS=477 CHECKS=291107	? (exit code) TT=0.415	SAT TT=2.632 ASSIGNMENTS=6749 CHECKS=2890200	SAT TT=0.072 ASSIGNMENTS=76 CHECKS=45774	? TT=4.644	SAT TT=2.568	SAT TT=4.207
csp/allsquares/ normalized-squares-16-16.xml	SAT TT=1.606	? TT=1.124	? TT=1.196	SAT TT=1345.67	? (TO) TT=1800.11	SAT TT=441.93 CHECKS=271392000	SAT TT=7.198 ASSIGNMENTS=3518	SAT TT=2.982 ASSIGNMENTS=644	SAT TT=8.952 ASSIGNMENTS=2085 CHECKS=3836690	SAT TT=8.686 ASSIGNMENTS=2085 CHECKS=3836690	SAT TT=2.092 ASSIGNMENTS=3671 CHECKS=5710140	SAT TT=2.965 ASSIGNMENTS=8878 CHECKS=7771260	? (exit code) TT=0.62	SAT TT=105.031 ASSIGNMENTS=125029 CHECKS=231010000	SAT TT=1.606 ASSIGNMENTS=2085 CHECKS=3836690	? TT=5.639	SAT TT=2.904	SAT TT=4.889
csp/allsquares/ normalized-squares-17-17.xml	SAT TT=2.544	? TT=1.211	? TT=1.28	SAT TT=1349.81	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=2.544 ASSIGNMENTS=345	SAT TT=245.195 ASSIGNMENTS=118078	SAT TT=19.356 ASSIGNMENTS=12856 CHECKS=24916400	SAT TT=18.768 ASSIGNMENTS=12856 CHECKS=24916400	SAT TT=21.678 ASSIGNMENTS=30007 CHECKS=47136800	SAT TT=4.3 ASSIGNMENTS=9433 CHECKS=9578080	? (exit code) TT=0.686	SAT TT=315.266 ASSIGNMENTS=371137 CHECKS=613994000	SAT TT=11.179 ASSIGNMENTS=12856 CHECKS=24916400	? TT=7.896	SAT TT=3.591	SAT TT=6.878
csp/allsquares/ normalized-squares-18-18.xml	SAT TT=1.249	? TT=1.289	? TT=1.288	SAT TT=1345.02	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=9.502 ASSIGNMENTS=4461	SAT TT=1426.5 ASSIGNMENTS=417690	SAT TT=1.249 ASSIGNMENTS=2359 CHECKS=2612060	SAT TT=1.348 ASSIGNMENTS=2359 CHECKS=2612060	SAT TT=5.589 ASSIGNMENTS=7184 CHECKS=11904600	SAT TT=5.215 ASSIGNMENTS=10355 CHECKS=10537200	? (exit code) TT=0.44	SAT TT=161.752 ASSIGNMENTS=164092 CHECKS=259915000	SAT TT=37.89 ASSIGNMENTS=47361 CHECKS=69118000	? TT=8.638	SAT TT=4.578	SAT TT=7.945
csp/allsquares/ normalized-squares-19-19.xml	SAT TT=13.899	? TT=1.47	? TT=1.412	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=32.908 ASSIGNMENTS=18975	? (TO) TT=1800.07	SAT TT=135.083 ASSIGNMENTS=110688 CHECKS=192957000	SAT TT=132.876 ASSIGNMENTS=110688 CHECKS=192957000	SAT TT=84.222 ASSIGNMENTS=66683 CHECKS=149081000	SAT TT=37.588 ASSIGNMENTS=33753 CHECKS=66361300	? (exit code) TT=0.717	SAT TT=884.867 ASSIGNMENTS=509242 CHECKS=1182770000	SAT TT=119.813 ASSIGNMENTS=110688 CHECKS=192957000	? TT=11.04	SAT TT=25.384	SAT TT=13.899
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-20-20.xml	SAT TT=6.734	? TT=1.552	? TT=1.554	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1278.01 ASSIGNMENTS=1088810	? (TO) TT=1800.11	SAT TT=147.321 ASSIGNMENTS=111914 CHECKS=246693000	SAT TT=153.787 ASSIGNMENTS=111914 CHECKS=246693000	SAT TT=139.875 ASSIGNMENTS=110439 CHECKS=224651000	SAT TT=744.468 ASSIGNMENTS=545008 CHECKS=1117940000	? (exit code) TT=0.727	SAT TT=771.309 ASSIGNMENTS=462808 CHECKS=1063180000	SAT TT=147.743 ASSIGNMENTS=111914 CHECKS=246693000	? TT=14.328	SAT TT=6.734	SAT TT=13.653
csp/allsquares/ normalized-squares-21-21.xml	SAT TT=29.692	? TT=1.691	? TT=1.687	SAT TT=1351.22	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=351.29 ASSIGNMENTS=240563 CHECKS=459067000	SAT TT=347.62 ASSIGNMENTS=240563 CHECKS=459067000	SAT TT=161.767 ASSIGNMENTS=92794 CHECKS=238589000	SAT TT=429.572 ASSIGNMENTS=279921 CHECKS=568725000	? (exit code) TT=0.472	? (TO) TT=1800.08	SAT TT=346.911 ASSIGNMENTS=240563 CHECKS=459067000	? TT=18.025	SAT TT=65.959	SAT TT=29.692
csp/allsquares/ normalized-squares-22-22.xml	SAT TT=268.547	? TT=1.893	? TT=1.877	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.15	SAT TT=388.702 ASSIGNMENTS=211898 CHECKS=471170000	SAT TT=386.623 ASSIGNMENTS=211898 CHECKS=471170000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (exit code) TT=0.76	? (TO) TT=1800.09	SAT TT=357.59 ASSIGNMENTS=211898 CHECKS=471170000	? TT=20.968	SAT TT=268.547	SAT TT=486.31
csp/allsquares/ normalized-squares-2-2.xml	SAT TT=0.005	? TT=0.642	? TT=0.569	SAT TT=0.026	SAT TT=0.008 CHECKS=191	SAT TT=0.009 CHECKS=210	SAT TT=0.48 ASSIGNMENTS=2	SAT TT=0.61 ASSIGNMENTS=3	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=49	? (exit code) TT=0.191	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	? TT=0.907	SAT TT=0.49	SAT TT=0.476
csp/allsquares/ normalized-squares-23-23.xml	SAT TT=424.381	? TT=2.029	? TT=2.036	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=1.034	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=26.973	SAT TT=424.381	SAT TT=867.627
csp/allsquares/ normalized-squares-24-24.xml	SAT TT=30.729	? TT=2.321	? TT=2.302	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=212.445 ASSIGNMENTS=105979 CHECKS=355261000	? (TO) TT=1800.01	? (exit code) TT=0.554	? (TO) TT=1800.02	SAT TT=1017.5 ASSIGNMENTS=510581 CHECKS=1416400000	? TT=33.747	SAT TT=43.762	SAT TT=30.729
csp/allsquares/ normalized-squares-25-25.xml	SAT TT=177.971	? TT=2.685	? TT=2.475	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=0.846	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=41.009	SAT TT=267.101	SAT TT=177.971
csp/allsquares/ normalized-squares-26-26.xml	SAT TT=11.424	? TT=2.468	? TT=2.645	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=11.424 ASSIGNMENTS=4096	? (TO) TT=1800.14	SAT TT=18.141 ASSIGNMENTS=4096	SAT TT=1026.79 ASSIGNMENTS=4096	? (TO) TT=1800.09	? (TO) TT=1800.05	? (exit code) TT=0.82	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=50.418	SAT TT=18.541	SAT TT=44.394
csp/allsquares/ normalized-squares-27-27.xml	SAT TT=219.941	? TT=2.171	? TT=2.241	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (exit code) TT=0.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=61.371	SAT TT=219.941	SAT TT=489.652
csp/allsquares/ normalized-squares-28-28.xml	SAT TT=66.947	? TT=2.091	? TT=1.926	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=139.912 ASSIGNMENTS=88693 CHECKS=276034000	? (exit code) TT=0.84	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=77.649	SAT TT=118.323	SAT TT=66.947
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-29-29.xml	SAT TT=1015.17	? TT=1.744	? TT=1.758	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (exit code) TT=0.939	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=169.094	SAT TT=1015.17	? (TO) TT=1800.02
csp/allsquares/ normalized-squares-30-30.xml	SAT TT=341.973	? TT=1.879	? TT=1.703	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.22	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (exit code) TT=0.585	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=710.032	SAT TT=1749.98	SAT TT=341.973
csp/allsquares/ normalized-squares-31-31.xml	SAT TT=353.916	? TT=1.872	? TT=1.857	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.05	? (exit code) TT=0.961	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=90.582	SAT TT=885.136	SAT TT=353.916
csp/allsquares/ normalized-squares-32-32.xml	SAT TT=474.828	? TT=2.092	? TT=1.878	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.11	? (exit code) TT=1.175	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=118.345	SAT TT=1349.87	SAT TT=474.828
csp/allsquares/ normalized-squares-33-33.xml	SAT TT=542.258	? TT=2.084	? TT=2.085	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (exit code) TT=0.53	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=233.51	SAT TT=1759.2	SAT TT=542.258
csp/allsquares/ normalized-squares-3-3.xml	SAT TT=0.005	? TT=0.609	? TT=0.598	SAT TT=0.029	SAT TT=0.018 CHECKS=3072	SAT TT=0.009 CHECKS=1396	SAT TT=0.58 ASSIGNMENTS=6	SAT TT=0.609 ASSIGNMENTS=5	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=253	? (exit code) TT=0.179	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=241	SAT TT=0.005 ASSIGNMENTS=4 CHECKS=245	? TT=0.9	SAT TT=0.526	SAT TT=0.554
csp/allsquares/ normalized-squares-34-34.xml		? TT=2.045	? TT=2.038	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=1.242	? (TO) TT=1800.04	? (TO) TT=1800.06	? (MO) TT=106.499	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquares/ normalized-squares-35-35.xml		? TT=2.016	? TT=2.022	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=1.076	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1802.17	? (TO) TT=1800.32	? (TO) TT=1800.06
csp/allsquares/ normalized-squares-36-36.xml		? TT=1.926	? TT=2.2	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.637	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=202.725	? (TO) TT=1800.27	? (TO) TT=1800.05
csp/allsquares/ normalized-squares-37-37.xml		? TT=2.08	? TT=1.946	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=1.096	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=229.329	? (TO) TT=1800.33	? (TO) TT=1800.3
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-38-38.xml		? TT=1.956	? TT=1.963	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (exit code) TT=1.138	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=108.77	? (MO) TT=55.763	? (TO) TT=1800.18
csp/allsquares/ normalized-squares-4-4.xml	SAT TT=0.007	? TT=0.606	? TT=0.644	SAT TT=0.033	SAT TT=0.038 CHECKS=2979	SAT TT=0.013 CHECKS=5931	SAT TT=0.641 ASSIGNMENTS=7	SAT TT=0.669 ASSIGNMENTS=7	SAT TT=0.02 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=574	? (exit code) TT=0.286	SAT TT=0.011 ASSIGNMENTS=15 CHECKS=608	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=529	? TT=1.019	SAT TT=0.714	SAT TT=0.716
csp/allsquares/ normalized-squares-5-5.xml	SAT TT=0.01	? TT=0.689	? TT=0.649	SAT TT=0.039	SAT TT=0.084 CHECKS=6906	SAT TT=0.032 CHECKS=21882	SAT TT=0.819 ASSIGNMENTS=8	SAT TT=0.807 ASSIGNMENTS=8	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=1155	? (exit code) TT=0.29	SAT TT=0.012 ASSIGNMENTS=17 CHECKS=889	SAT TT=0.011 ASSIGNMENTS=7 CHECKS=959	? TT=1.719	SAT TT=0.769	SAT TT=0.904
csp/allsquares/ normalized-squares-6-6.xml	SAT TT=0.012	? TT=0.684	? TT=0.709	SAT TT=0.044	SAT TT=0.161 CHECKS=11392	SAT TT=0.031 CHECKS=20429	SAT TT=0.869 ASSIGNMENTS=11	SAT TT=0.989 ASSIGNMENTS=10	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.013 ASSIGNMENTS=17 CHECKS=1707	? (exit code) TT=0.252	SAT TT=0.013 ASSIGNMENTS=31 CHECKS=1776	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=1603	? TT=1.673	SAT TT=0.806	SAT TT=0.925
csp/allsquares/ normalized-squares-7-7.xml	SAT TT=0.014	? TT=0.692	? TT=0.668	SAT TT=0.05	SAT TT=0.259 CHECKS=32212	SAT TT=0.046 CHECKS=29555	SAT TT=0.905 ASSIGNMENTS=11	SAT TT=0.95 ASSIGNMENTS=12	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.015 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.014 ASSIGNMENTS=18 CHECKS=2739	? (exit code) TT=0.383	SAT TT=0.016 ASSIGNMENTS=54 CHECKS=3631	SAT TT=0.014 ASSIGNMENTS=10 CHECKS=2376	? TT=1.846	SAT TT=0.913	SAT TT=0.938
csp/allsquares/ normalized-squares-8-8.xml	SAT TT=0.016	? TT=0.797	? TT=0.736	SAT TT=0.061	SAT TT=0.466 CHECKS=131200	SAT TT=0.074 CHECKS=46781	SAT TT=1.031 ASSIGNMENTS=12	SAT TT=1.157 ASSIGNMENTS=15	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	SAT TT=0.017 ASSIGNMENTS=10 CHECKS=3527	SAT TT=0.018 ASSIGNMENTS=12 CHECKS=3536	? (exit code) TT=0.436	SAT TT=0.022 ASSIGNMENTS=68 CHECKS=8493	SAT TT=0.016 ASSIGNMENTS=11 CHECKS=3527	? TT=2.064	SAT TT=0.935	SAT TT=1.016
csp/allsquares/ normalized-squares-9-9.xml	SAT TT=0.021	? TT=0.737	? TT=0.745	SAT TT=0.086	SAT TT=0.551 CHECKS=147320	SAT TT=0.198 CHECKS=143946	SAT TT=1.204 ASSIGNMENTS=15	SAT TT=1.253 ASSIGNMENTS=17	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=5239	SAT TT=0.034 ASSIGNMENTS=19 CHECKS=5239	SAT TT=0.021 ASSIGNMENTS=14 CHECKS=5142	SAT TT=0.022 ASSIGNMENTS=22 CHECKS=8931	? (exit code) TT=0.359	SAT TT=0.033 ASSIGNMENTS=133 CHECKS=19193	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=5400	? TT=2.135	SAT TT=1.196	SAT TT=1.116
csp/allsquaresUnsat/ normalized-squaresUnsat-10-10.xml	UNSAT TT=0.028	? TT=0.842	? TT=0.801	UNSAT TT=144.791	UNSAT TT=2.387 CHECKS=1745340	UNSAT TT=2.957 CHECKS=2574600	UNSAT TT=1.104 ASSIGNMENTS=0	UNSAT TT=1.109 ASSIGNMENTS=0	UNSAT TT=0.038 ASSIGNMENTS=13 CHECKS=11406	UNSAT TT=0.039 ASSIGNMENTS=13 CHECKS=11406	UNSAT TT=0.04 ASSIGNMENTS=84 CHECKS=44203	UNSAT TT=0.582 ASSIGNMENTS=4941 CHECKS=1657480	? (exit code) TT=0.533	UNSAT TT=0.042 ASSIGNMENTS=145 CHECKS=29681	UNSAT TT=0.028 ASSIGNMENTS=13 CHECKS=11406	? TT=2.406	UNSAT TT=1.157	UNSAT TT=1.524
csp/allsquaresUnsat/ normalized-squaresUnsat-11-11.xml	UNSAT TT=0.039	? TT=0.945	? TT=0.898	UNSAT TT=1789.63	UNSAT TT=5.609 CHECKS=3934750	UNSAT TT=6.678 CHECKS=5397490	UNSAT TT=1.304 ASSIGNMENTS=0	UNSAT TT=1.234 ASSIGNMENTS=0	UNSAT TT=0.043 ASSIGNMENTS=11 CHECKS=11735	UNSAT TT=0.044 ASSIGNMENTS=11 CHECKS=11735	UNSAT TT=0.04 ASSIGNMENTS=59 CHECKS=41721	UNSAT TT=0.646 ASSIGNMENTS=5291 CHECKS=1983410	? (exit code) TT=0.566	UNSAT TT=0.298 ASSIGNMENTS=1786 CHECKS=403268	UNSAT TT=0.039 ASSIGNMENTS=50 CHECKS=26440	? TT=2.518	UNSAT TT=1.376	UNSAT TT=1.591
csp/allsquaresUnsat/ normalized-squaresUnsat-12-12.xml	UNSAT TT=0.041	? TT=0.941	? TT=0.869	UNSAT TT=1345.04	UNSAT TT=8.406 CHECKS=6015970	UNSAT TT=9.924 CHECKS=7311620	UNSAT TT=1.218 ASSIGNMENTS=0	UNSAT TT=1.243 ASSIGNMENTS=0	UNSAT TT=0.048 ASSIGNMENTS=19 CHECKS=14649	UNSAT TT=0.05 ASSIGNMENTS=19 CHECKS=14649	UNSAT TT=0.048 ASSIGNMENTS=51 CHECKS=38810	UNSAT TT=0.796 ASSIGNMENTS=5811 CHECKS=2226820	? (exit code) TT=0.389	UNSAT TT=0.411 ASSIGNMENTS=2170 CHECKS=530746	UNSAT TT=0.041 ASSIGNMENTS=29 CHECKS=19176	? TT=2.812	UNSAT TT=1.498	UNSAT TT=2.366
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-13-13.xml	UNSAT TT=0.042	? TT=0.951	? TT=1.05	UNSAT TT=1344.95	UNSAT TT=16.32 CHECKS=10257700	UNSAT TT=16.92 CHECKS=11278300	UNSAT TT=1.339 ASSIGNMENTS=0	UNSAT TT=1.331 ASSIGNMENTS=0	UNSAT TT=0.054 ASSIGNMENTS=19 CHECKS=16161	UNSAT TT=0.053 ASSIGNMENTS=19 CHECKS=16161	UNSAT TT=0.05 ASSIGNMENTS=43 CHECKS=42246	UNSAT TT=0.672 ASSIGNMENTS=4732 CHECKS=1966700	? (exit code) TT=0.684	UNSAT TT=0.185 ASSIGNMENTS=724 CHECKS=191981	UNSAT TT=0.042 ASSIGNMENTS=19 CHECKS=16286	? TT=3.303	UNSAT TT=1.565	UNSAT TT=2.564
csp/allsquaresUnsat/ normalized-squaresUnsat-14-14.xml	UNSAT TT=0.051	? TT=1.004	? TT=0.986	? (TO) TT=1800.02	UNSAT TT=31.416 CHECKS=18151600	UNSAT TT=34.403 CHECKS=21077700	UNSAT TT=1.574 ASSIGNMENTS=0	UNSAT TT=1.611 ASSIGNMENTS=0	UNSAT TT=0.063 ASSIGNMENTS=19 CHECKS=17825	UNSAT TT=0.064 ASSIGNMENTS=19 CHECKS=17825	UNSAT TT=0.077 ASSIGNMENTS=104 CHECKS=74750	UNSAT TT=0.651 ASSIGNMENTS=3001 CHECKS=1447650	? (exit code) TT=0.684	UNSAT TT=0.12 ASSIGNMENTS=260 CHECKS=119424	UNSAT TT=0.051 ASSIGNMENTS=26 CHECKS=22403	? TT=3.697	UNSAT TT=1.975	UNSAT TT=3.043
csp/allsquaresUnsat/ normalized-squaresUnsat-15-15.xml	UNSAT TT=0.06	? TT=1.061	? TT=1.066	UNSAT TT=1343.45	UNSAT TT=1.086 CHECKS=982	UNSAT TT=0.06 CHECKS=982	UNSAT TT=1.335 ASSIGNMENTS=0	UNSAT TT=1.428 ASSIGNMENTS=0	UNSAT TT=0.071 ASSIGNMENTS=19 CHECKS=19530	UNSAT TT=0.072 ASSIGNMENTS=19 CHECKS=19530	UNSAT TT=0.07 ASSIGNMENTS=38 CHECKS=45955	UNSAT TT=1.277 ASSIGNMENTS=6843 CHECKS=3277530	? (exit code) TT=0.42	UNSAT TT=0.158 ASSIGNMENTS=344 CHECKS=110887	UNSAT TT=0.064 ASSIGNMENTS=26 CHECKS=24464	? TT=4.462	UNSAT TT=2.618	UNSAT TT=3.726
csp/allsquaresUnsat/ normalized-squaresUnsat-16-16.xml	UNSAT TT=0.064	? TT=1.249	? TT=1.119	UNSAT TT=1345.01	UNSAT TT=1.232 CHECKS=1106	UNSAT TT=0.065 CHECKS=1106	UNSAT TT=1.428 ASSIGNMENTS=0	UNSAT TT=1.597 ASSIGNMENTS=0	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=21276	UNSAT TT=0.082 ASSIGNMENTS=19 CHECKS=21276	UNSAT TT=0.082 ASSIGNMENTS=40 CHECKS=51044	UNSAT TT=1.61 ASSIGNMENTS=7330 CHECKS=3696930	? (exit code) TT=0.65	UNSAT TT=0.805 ASSIGNMENTS=1149 CHECKS=453440	UNSAT TT=0.064 ASSIGNMENTS=20 CHECKS=24076	? TT=5.466	UNSAT TT=2.549	UNSAT TT=4.445
csp/allsquaresUnsat/ normalized-squaresUnsat-17-17.xml	UNSAT TT=0.076	? TT=1.324	? TT=1.193	UNSAT TT=1352.53	UNSAT TT=1.458 CHECKS=1238	UNSAT TT=0.076 CHECKS=1238	UNSAT TT=1.533 ASSIGNMENTS=0	UNSAT TT=1.338 ASSIGNMENTS=0	UNSAT TT=17.438 ASSIGNMENTS=10642 CHECKS=19776700	UNSAT TT=16.786 ASSIGNMENTS=10642 CHECKS=19776700	UNSAT TT=19.168 ASSIGNMENTS=25918 CHECKS=40754600	UNSAT TT=34.395 ASSIGNMENTS=47618 CHECKS=76834000	? (exit code) TT=0.846	UNSAT TT=334.904 ASSIGNMENTS=399963 CHECKS=596071000	UNSAT TT=10.466 ASSIGNMENTS=10642 CHECKS=19776700	? TT=6.721	UNSAT TT=6.479	UNSAT TT=9.461
csp/allsquaresUnsat/ normalized-squaresUnsat-18-18.xml	UNSAT TT=48.241	? TT=1.29	? TT=1.365	UNSAT TT=1584.82	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=213.202 ASSIGNMENTS=183848 CHECKS=378246000	UNSAT TT=202.911 ASSIGNMENTS=183848 CHECKS=378246000	UNSAT TT=246.526 ASSIGNMENTS=256838 CHECKS=500899000	UNSAT TT=152.011 ASSIGNMENTS=145952 CHECKS=264378000	? (exit code) TT=0.449	UNSAT TT=484.343 ASSIGNMENTS=397120 CHECKS=706295000	UNSAT TT=187.797 ASSIGNMENTS=183848 CHECKS=378246000	? TT=9.19	UNSAT TT=64.219	UNSAT TT=48.241
csp/allsquaresUnsat/ normalized-squaresUnsat-19-19.xml	UNSAT TT=0.102	? TT=1.425	? TT=1.402	UNSAT TT=1489.26	UNSAT TT=1.835 CHECKS=1506	UNSAT TT=0.102 CHECKS=1506	UNSAT TT=1.422 ASSIGNMENTS=0	UNSAT TT=1.559 ASSIGNMENTS=0	UNSAT TT=146.681 ASSIGNMENTS=101469 CHECKS=217456000	UNSAT TT=146.874 ASSIGNMENTS=101469 CHECKS=217456000	UNSAT TT=152.378 ASSIGNMENTS=132277 CHECKS=269853000	UNSAT TT=105.22 ASSIGNMENTS=96427 CHECKS=147682000	? (exit code) TT=0.728	UNSAT TT=529.969 ASSIGNMENTS=363851 CHECKS=712207000	UNSAT TT=134.102 ASSIGNMENTS=101469 CHECKS=217456000	? TT=10.632	UNSAT TT=43.34	UNSAT TT=41.562
csp/allsquaresUnsat/ normalized-squaresUnsat-20-20.xml	UNSAT TT=0.107	? TT=1.617	? TT=1.495	? (TO) TT=1800.02	UNSAT TT=2.077 CHECKS=1662	UNSAT TT=0.107 CHECKS=1662	UNSAT TT=1.547 ASSIGNMENTS=0	UNSAT TT=1.841 ASSIGNMENTS=0	UNSAT TT=1362.46 ASSIGNMENTS=972280 CHECKS=1949310000	UNSAT TT=1016.42 ASSIGNMENTS=0	UNSAT TT=1663.26 ASSIGNMENTS=1211670 CHECKS=2380190000	UNSAT TT=233.569 ASSIGNMENTS=158054 CHECKS=348657000	? (exit code) TT=0.739	UNSAT TT=1018.17 ASSIGNMENTS=588256 CHECKS=1099680000	UNSAT TT=1355.48 ASSIGNMENTS=972280 CHECKS=1949310000	? TT=14.071	UNSAT TT=117.254	UNSAT TT=141.548
csp/allsquaresUnsat/ normalized-squaresUnsat-21-21.xml	UNSAT TT=0.13	? TT=1.757	? TT=1.695	? (TO) TT=1800.05	UNSAT TT=2.196 CHECKS=1806	UNSAT TT=0.13 CHECKS=1806	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=1.617 ASSIGNMENTS=0	UNSAT TT=1665.15 ASSIGNMENTS=0	UNSAT TT=1017.49 ASSIGNMENTS=0	? (TO) TT=1800.1	UNSAT TT=1438.28 ASSIGNMENTS=844124 CHECKS=1853250000	? (exit code) TT=0.44	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=17.748	UNSAT TT=217.067	UNSAT TT=270.054
csp/allsquaresUnsat/ normalized-squaresUnsat-22-22.xml	UNSAT TT=0.146	? TT=1.828	? TT=1.82	? (TO) TT=1800.06	UNSAT TT=2.626 CHECKS=1978	UNSAT TT=0.146 CHECKS=1978	UNSAT TT=1.641 ASSIGNMENTS=0	UNSAT TT=2.198 ASSIGNMENTS=0	UNSAT TT=1017.24 ASSIGNMENTS=0	UNSAT TT=1017.05 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.08	? (exit code) TT=0.77	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=21.811	UNSAT TT=343.792	UNSAT TT=335.978
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-2-2.xml	UNSAT TT=0.006	? TT=0.593	? TT=0.553	UNSAT TT=0.026	UNSAT TT=0.01 CHECKS=53	UNSAT TT=0.008 CHECKS=53	UNSAT TT=0.506 ASSIGNMENTS=0	UNSAT TT=0.513 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=0.193	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=15	? TT=0.906	UNSAT TT=0.488	UNSAT TT=0.504
csp/allsquaresUnsat/ normalized-squaresUnsat-23-23.xml	UNSAT TT=0.168	? TT=2.011	? TT=2.009	? (TO) TT=1800.04	UNSAT TT=2.701 CHECKS=2138	UNSAT TT=0.168 CHECKS=2138	UNSAT TT=1.689 ASSIGNMENTS=0	UNSAT TT=1.827 ASSIGNMENTS=0	UNSAT TT=890.69 ASSIGNMENTS=0	UNSAT TT=1016.83 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.06	? (exit code) TT=0.807	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=26.041	UNSAT TT=402.254	UNSAT TT=469.765
csp/allsquaresUnsat/ normalized-squaresUnsat-24-24.xml		? TT=2.515	? TT=2.276	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.497	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=33.356	? (TO) TT=1800.07	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-25-25.xml	UNSAT TT=0.192	? TT=2.533	? TT=2.484	? (TO) TT=1800.07	UNSAT TT=3.294 CHECKS=2502	UNSAT TT=0.192 CHECKS=2502	UNSAT TT=2.044 ASSIGNMENTS=0	UNSAT TT=2.224 ASSIGNMENTS=0	UNSAT TT=891.527 ASSIGNMENTS=0	UNSAT TT=1016.9 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.05	? (exit code) TT=0.796	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=40.292	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/allsquaresUnsat/ normalized-squaresUnsat-26-26.xml		? TT=2.475	? TT=2.436	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (exit code) TT=1.073	? (TO) TT=1800	? (TO) TT=1800.02	? TT=49.053	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-27-27.xml	UNSAT TT=0.256	? TT=2.292	? TT=2.583	? (TO) TT=1800.05	UNSAT TT=4.331 CHECKS=2918	UNSAT TT=0.256 CHECKS=2918	UNSAT TT=2.226 ASSIGNMENTS=0	UNSAT TT=2.106 ASSIGNMENTS=0	UNSAT TT=9.804 ASSIGNMENTS=0	UNSAT TT=1017.87 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.01	? (exit code) TT=0.511	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=57.082	? (TO) TT=1800.06	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-28-28.xml		? TT=2.179	? TT=2.216	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=1.115	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=73.045	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/allsquaresUnsat/ normalized-squaresUnsat-29-29.xml	UNSAT TT=0.313	? TT=1.998	? TT=1.923	? (TO) TT=1800.03	UNSAT TT=5.162 CHECKS=3366	UNSAT TT=0.313 CHECKS=3366	UNSAT TT=2.201 ASSIGNMENTS=0	UNSAT TT=2.43 ASSIGNMENTS=0	UNSAT TT=9.919 ASSIGNMENTS=0	UNSAT TT=1017.56 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=0.934	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=130.964	? (TO) TT=1800.03	? (TO) TT=1800.07
csp/allsquaresUnsat/ normalized-squaresUnsat-30-30.xml	UNSAT TT=0.349	? TT=1.724	? TT=1.735	? (TO) TT=1800.03	UNSAT TT=5.732 CHECKS=3602	UNSAT TT=0.349 CHECKS=3602	UNSAT TT=2.453 ASSIGNMENTS=0	UNSAT TT=2.552 ASSIGNMENTS=0	UNSAT TT=10.332 ASSIGNMENTS=0	UNSAT TT=1017.9 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.08	? (exit code) TT=0.508	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=453.483	? (TO) TT=1800.05	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-31-31.xml	UNSAT TT=0.383	? TT=1.773	? TT=1.881	? (TO) TT=1800.05	UNSAT TT=6.299 CHECKS=3846	UNSAT TT=0.383 CHECKS=3846	UNSAT TT=2.676 ASSIGNMENTS=0	UNSAT TT=2.767 ASSIGNMENTS=0	UNSAT TT=10.099 ASSIGNMENTS=0	UNSAT TT=1018.17 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=0.964	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=97.302	? (TO) TT=1800.12	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-32-32.xml		? TT=1.948	? TT=1.825	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=1.182	? (TO) TT=1800.04	? (TO) TT=1800.11	? (MO) TT=91.645	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-33-33.xml		? TT=2.102	? TT=1.988	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.541	? (TO) TT=1800.03	? (TO) TT=1800.07	? (MO) TT=112.026	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-3-3.xml	UNSAT TT=0.006	? TT=0.631	? TT=0.563	UNSAT TT=0.03	UNSAT TT=0.012 CHECKS=92	UNSAT TT=0.01 CHECKS=92	UNSAT TT=0.511 ASSIGNMENTS=0	UNSAT TT=0.503 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=22	? (exit code) TT=0.186	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	? TT=0.979	UNSAT TT=0.535	UNSAT TT=0.53
csp/allsquaresUnsat/ normalized-squaresUnsat-34-34.xml		? TT=2.128	? TT=2.046	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=1.114	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=107.77	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-35-35.xml	UNSAT TT=0.547	? TT=1.967	? TT=2.063	? (TO) TT=1800.1	UNSAT TT=7.996 CHECKS=4902	UNSAT TT=0.547 CHECKS=4902	UNSAT TT=2.703 ASSIGNMENTS=0	UNSAT TT=2.734 ASSIGNMENTS=0	UNSAT TT=10.504 ASSIGNMENTS=0	UNSAT TT=1018.23 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.07	? (exit code) TT=1.068	? (TO) TT=1800.03	? (TO) TT=1800.11	? (MO) TT=101.483	? (TO) TT=1800.22	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-36-36.xml	UNSAT TT=0.596	? TT=2.129	? TT=1.942	? (TO) TT=1800.07	UNSAT TT=8.625 CHECKS=5186	UNSAT TT=0.596 CHECKS=5186	UNSAT TT=2.892 ASSIGNMENTS=0	UNSAT TT=3.057 ASSIGNMENTS=0	UNSAT TT=10.856 ASSIGNMENTS=0	UNSAT TT=1018.62 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.635	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1802.14	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-37-37.xml	UNSAT TT=0.641	? TT=1.975	? TT=2.107	? (TO) TT=1800.11	UNSAT TT=8.323 CHECKS=5478	UNSAT TT=0.641 CHECKS=5478	UNSAT TT=3.066 ASSIGNMENTS=0	UNSAT TT=3.41 ASSIGNMENTS=0	UNSAT TT=10.728 ASSIGNMENTS=0	UNSAT TT=1018.24 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (exit code) TT=1.36	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=400.357	? (TO) TT=1800.32	? (TO) TT=1800.01
csp/allsquaresUnsat/ normalized-squaresUnsat-38-38.xml		? TT=1.945	? TT=1.966	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (exit code) TT=1.354	? (TO) TT=1800.11	? (TO) TT=1800.01	? TT=208.941	? (MO) TT=59.215	? (TO) TT=1800.2
csp/allsquaresUnsat/ normalized-squaresUnsat-4-4.xml	UNSAT TT=0.006	? TT=0.61	? TT=0.6	UNSAT TT=0.032	UNSAT TT=0.028 CHECKS=120	UNSAT TT=0.01 CHECKS=120	UNSAT TT=0.551 ASSIGNMENTS=0	UNSAT TT=0.754 ASSIGNMENTS=0	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=160	? (exit code) TT=0.265	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=160	? TT=0.972	UNSAT TT=0.668	UNSAT TT=0.66
csp/allsquaresUnsat/ normalized-squaresUnsat-5-5.xml	UNSAT TT=0.008	? TT=0.687	? TT=0.614	UNSAT TT=0.037	UNSAT TT=0.055 CHECKS=175	UNSAT TT=0.01 CHECKS=175	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=266	? (exit code) TT=0.284	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=266	? TT=1.531	UNSAT TT=0.73	UNSAT TT=0.731
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-6-6.xml	UNSAT TT=0.01	? TT=0.655	? TT=0.749	UNSAT TT=0.043	UNSAT TT=0.124 CHECKS=219	UNSAT TT=0.013 CHECKS=219	UNSAT TT=0.7 ASSIGNMENTS=0	UNSAT TT=0.709 ASSIGNMENTS=0	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=399	? (exit code) TT=0.249	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=399	? TT=1.653	UNSAT TT=0.846	UNSAT TT=0.863
csp/allsquaresUnsat/ normalized-squaresUnsat-7-7.xml	UNSAT TT=0.012	? TT=0.669	? TT=0.675	UNSAT TT=0.047	UNSAT TT=0.206 CHECKS=290	UNSAT TT=0.014 CHECKS=290	UNSAT TT=0.689 ASSIGNMENTS=0	UNSAT TT=0.703 ASSIGNMENTS=0	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=563	? (exit code) TT=0.38	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	? TT=1.795	UNSAT TT=1.075	UNSAT TT=0.947
csp/allsquaresUnsat/ normalized-squaresUnsat-8-8.xml	UNSAT TT=0.017	? TT=0.76	? TT=0.711	UNSAT TT=0.06	UNSAT TT=0.259 CHECKS=350	UNSAT TT=0.018 CHECKS=350	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.898 ASSIGNMENTS=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? (exit code) TT=0.475	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? TT=1.959	UNSAT TT=0.981	UNSAT TT=0.965
csp/allsquaresUnsat/ normalized-squaresUnsat-9-9.xml	UNSAT TT=0.025	? TT=0.826	? TT=0.751	UNSAT TT=1.675	UNSAT TT=0.616 CHECKS=188089	UNSAT TT=0.199 CHECKS=141270	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.986 ASSIGNMENTS=0	UNSAT TT=0.036 ASSIGNMENTS=12 CHECKS=10492	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=10492	UNSAT TT=0.034 ASSIGNMENTS=67 CHECKS=40428	UNSAT TT=0.098 ASSIGNMENTS=709 CHECKS=234513	? (exit code) TT=0.325	UNSAT TT=0.047 ASSIGNMENTS=253 CHECKS=49485	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=12542	? TT=2.305	UNSAT TT=1.072	UNSAT TT=1.111
csp/bibd10-11/ normalized-bibd-10-120-36-3-8_glb.xml	SAT TT=21.153	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.151	SAT TT=29.399	SAT TT=21.153
csp/bibd10-11/ normalized-bibd-10-30-9-3-2_glb.xml	SAT TT=0.104	SAT TT=723.966 CHECKS=109759000 NODES=2889730	SAT TT=72.094 CHECKS=7950540 NODES=278290	SAT TT=3.29	SAT TT=15.525 CHECKS=2472780	SAT TT=19.371 CHECKS=4553240	SAT TT=39.83 ASSIGNMENTS=102877	SAT TT=37.398 ASSIGNMENTS=102877	SAT TT=0.12 ASSIGNMENTS=272 CHECKS=21118	SAT TT=0.119 ASSIGNMENTS=272 CHECKS=21118	SAT TT=0.106 ASSIGNMENTS=330 CHECKS=26648	? (TO) TT=1800.06	SAT TT=1.211	SAT TT=0.305 ASSIGNMENTS=3695 CHECKS=264240	SAT TT=0.104 ASSIGNMENTS=186 CHECKS=6883	? TT=3.558	SAT TT=3.351	SAT TT=4.313
csp/bibd10-11/ normalized-bibd-10-60-18-3-4_glb.xml	SAT TT=0.233	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=977.381 CHECKS=96017400	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=0.534 ASSIGNMENTS=6638 CHECKS=576362	SAT TT=0.497 ASSIGNMENTS=6638 CHECKS=576362	SAT TT=0.33 ASSIGNMENTS=2533 CHECKS=232268	? (TO) TT=1800.1	SAT TT=3.246	SAT TT=8.057 ASSIGNMENTS=48223 CHECKS=4971410	SAT TT=0.233 ASSIGNMENTS=605 CHECKS=38199	? TT=4.839	SAT TT=7.121	SAT TT=7.625
csp/bibd10-11/ normalized-bibd-10-90-27-3-6_glb.xml	SAT TT=0.509	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=35.836 CHECKS=2350580	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=368.908 ASSIGNMENTS=3374 CHECKS=259943	SAT TT=675.111 ASSIGNMENTS=3374 CHECKS=259943	SAT TT=2.641 ASSIGNMENTS=35752 CHECKS=3651970	SAT TT=1.158 ASSIGNMENTS=165092 CHECKS=1831780	SAT TT=613.928	SAT TT=22.16 ASSIGNMENTS=126231 CHECKS=13222700	SAT TT=0.509 ASSIGNMENTS=3374 CHECKS=259943	? TT=5.211	SAT TT=13.746	SAT TT=12.49
csp/bibd10-11/ normalized-bibd-11-110-30-3-6_glb.xml	SAT TT=11.467	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=11.467 ASSIGNMENTS=395622 CHECKS=18522800	? (TO) TT=1800.06	SAT TT=1408.18 ASSIGNMENTS=4600210 CHECKS=560875000	? (TO) TT=1800.08	? TT=6.242	SAT TT=149.712	SAT TT=29.065
csp/bibd10-11/ normalized-bibd-11-55-15-3-3_glb.xml	SAT TT=0.364	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=0.532 ASSIGNMENTS=6640 CHECKS=495336	SAT TT=0.53 ASSIGNMENTS=6640 CHECKS=495336	SAT TT=0.364 ASSIGNMENTS=3693 CHECKS=266337	? (TO) TT=1800.04	SAT TT=12.032	SAT TT=4.382 ASSIGNMENTS=31955 CHECKS=3649540	? (TO) TT=1800.1	? TT=4.657	SAT TT=6.579	SAT TT=9.842
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd12-13/ normalized-bibd-12-132-33-3-6_glb.xml	SAT TT=29	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? TT=7.101	SAT TT=309.765	SAT TT=29
csp/bibd12-13/ normalized-bibd-12-44-11-3-2_glb.xml	SAT TT=0.26	? (TO) TT=1800.16	SAT TT=1288.14 CHECKS=215793000 NODES=2312320	SAT TT=108.413	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	SAT TT=0.338 ASSIGNMENTS=2621 CHECKS=194100	SAT TT=0.351 ASSIGNMENTS=2621 CHECKS=194100	SAT TT=0.327 ASSIGNMENTS=2658 CHECKS=217704	SAT TT=30.944 ASSIGNMENTS=704301 CHECKS=81939300	SAT TT=1.957	SAT TT=4.091 ASSIGNMENTS=33798 CHECKS=3425580	SAT TT=0.26 ASSIGNMENTS=686 CHECKS=59493	? TT=4.909	SAT TT=5.998	SAT TT=8.49
csp/bibd12-13/ normalized-bibd-12-88-22-3-4_glb.xml	SAT TT=10.057	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=67.423 CHECKS=4485680	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=29.741 ASSIGNMENTS=354353 CHECKS=39366900	? (TO) TT=1800.09	SAT TT=10.057	SAT TT=61.92 ASSIGNMENTS=194330 CHECKS=26122000	? (TO) TT=1800.06	? TT=6.138	SAT TT=28.086	SAT TT=19.531
csp/bibd12-13/ normalized-bibd-13-104-24-3-4_glb.xml	SAT TT=23.442	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=407.822 CHECKS=18513700	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=6.62	SAT TT=167.034	SAT TT=23.442
csp/bibd12-13/ normalized-bibd-13-26-6-3-1_glb.xml	SAT TT=0.16	SAT TT=7.836 CHECKS=392839 NODES=8814	SAT TT=199.569 CHECKS=14738900 NODES=495323	SAT TT=11.72	SAT TT=18.987 CHECKS=2453470	SAT TT=12.334 CHECKS=2490340	SAT TT=54.837 ASSIGNMENTS=84247	SAT TT=52.862 ASSIGNMENTS=84247	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	SAT TT=0.16 ASSIGNMENTS=686 CHECKS=59214	SAT TT=1303.38 ASSIGNMENTS=25891600 CHECKS=4041350000	SAT TT=1.758	SAT TT=1.417 ASSIGNMENTS=15474 CHECKS=1918200	SAT TT=0.161 ASSIGNMENTS=244 CHECKS=13099	? TT=3.957	SAT TT=4.043	SAT TT=4.546
csp/bibd12-13/ normalized-bibd-13-52-12-3-2_glb.xml	SAT TT=0.938	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=800.117	? (TO) TT=1800.07	SAT TT=146.969 CHECKS=12437800	? (TO) TT=1800.1	? (TO) TT=1800.14	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	SAT TT=1.732 ASSIGNMENTS=24811 CHECKS=2231020	? (TO) TT=1800.04	SAT TT=2.758	SAT TT=6.46 ASSIGNMENTS=38073 CHECKS=4480870	SAT TT=590.666 ASSIGNMENTS=6738700 CHECKS=804298000	? TT=5.664	SAT TT=9.305	SAT TT=10.62
csp/bibd12-13/ normalized-bibd-13-78-18-3-3_glb.xml	SAT TT=25.354	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=61.537 CHECKS=3239740	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=30.774 ASSIGNMENTS=489695 CHECKS=41055900	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=45.829 ASSIGNMENTS=161298 CHECKS=22615600	? (TO) TT=1800.05	? TT=6.272	SAT TT=25.354	SAT TT=79.565
csp/bibd6/ normalized-bibd-6-100-50-3-20_glb.xml	SAT TT=0.145	SAT TT=5.682 CHECKS=46762 NODES=7452	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=60.266 CHECKS=6299730	SAT TT=76.783 CHECKS=8497670	? (TO) TT=1800.07	? (TO) TT=1800.13	SAT TT=368.47 ASSIGNMENTS=623 CHECKS=28068	SAT TT=674.154 ASSIGNMENTS=623 CHECKS=28068	? (TO) TT=1800.04	SAT TT=28.643 ASSIGNMENTS=781021 CHECKS=42627200	SAT TT=21.47	? (TO) TT=1800.11	SAT TT=0.145 ASSIGNMENTS=623 CHECKS=28068	? TT=3.632	SAT TT=113.607	SAT TT=7.496
csp/bibd6/ normalized-bibd-6-10-5-3-2_glb.xml	SAT TT=0.017	SAT TT=1.095 CHECKS=2794 NODES=440	SAT TT=1.205 CHECKS=17312 NODES=1613	SAT TT=0.075	SAT TT=0.096 CHECKS=9868	SAT TT=0.04 CHECKS=5055	SAT TT=0.825 ASSIGNMENTS=74	SAT TT=0.886 ASSIGNMENTS=74	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.018 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.024 ASSIGNMENTS=545 CHECKS=20936	SAT TT=0.542	SAT TT=0.019 ASSIGNMENTS=268 CHECKS=8775	SAT TT=0.017 ASSIGNMENTS=24 CHECKS=720	? TT=1.119	SAT TT=1.277	SAT TT=1.284
csp/bibd6/ normalized-bibd-6-20-10-3-4_glb.xml	SAT TT=0.028	SAT TT=1.864 CHECKS=5680 NODES=832	SAT TT=2.921 CHECKS=130244 NODES=10142	SAT TT=0.429	SAT TT=0.369 CHECKS=70107	SAT TT=0.229 CHECKS=55893	SAT TT=1.735 ASSIGNMENTS=3135	SAT TT=1.542 ASSIGNMENTS=3135	SAT TT=0.041 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.039 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.03 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.12 ASSIGNMENTS=13120 CHECKS=283293	SAT TT=0.724	SAT TT=0.028 ASSIGNMENTS=52 CHECKS=1440	SAT TT=0.029 ASSIGNMENTS=84 CHECKS=3877	? TT=1.73	SAT TT=1.514	SAT TT=1.999
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd6/ normalized-bibd-6-30-15-3-6_glb.xml	SAT TT=0.082	SAT TT=3.2 CHECKS=9898 NODES=1527	SAT TT=3.256 CHECKS=43947 NODES=5537	SAT TT=105.615	SAT TT=0.82 CHECKS=171996	SAT TT=0.611 CHECKS=137634	SAT TT=4.232 ASSIGNMENTS=20540	SAT TT=4.205 ASSIGNMENTS=20540	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	SAT TT=0.267 ASSIGNMENTS=9950 CHECKS=595078	SAT TT=9.563 ASSIGNMENTS=323773 CHECKS=29408500	SAT TT=0.847	SAT TT=0.082 ASSIGNMENTS=1438 CHECKS=69881	SAT TT=0.311 ASSIGNMENTS=11914 CHECKS=739122	? TT=2.077	SAT TT=2.175	SAT TT=2.041
csp/bibd6/ normalized-bibd-6-40-20-3-8_glb.xml	SAT TT=0.06	SAT TT=6.187 CHECKS=10479 NODES=1748	SAT TT=448.664 CHECKS=52963300 NODES=3487080	? (TO) TT=1800.03	SAT TT=9.36 CHECKS=2057880	SAT TT=3.493 CHECKS=782573	SAT TT=3.37 ASSIGNMENTS=12310	SAT TT=3.639 ASSIGNMENTS=12310	SAT TT=0.067 ASSIGNMENTS=272 CHECKS=15748	SAT TT=0.07 ASSIGNMENTS=272 CHECKS=15748	SAT TT=0.06 ASSIGNMENTS=275 CHECKS=16422	SAT TT=1.052 ASSIGNMENTS=47078 CHECKS=2578880	SAT TT=1.164	SAT TT=0.232 ASSIGNMENTS=4800 CHECKS=283923	SAT TT=0.813 ASSIGNMENTS=23484 CHECKS=1867720	? TT=2.216	SAT TT=2.342	SAT TT=2.707
csp/bibd6/ normalized-bibd-6-50-25-3-10_glb.xml	SAT TT=0.074	SAT TT=12.777 CHECKS=19849 NODES=3419	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=13.371 CHECKS=2692130	SAT TT=4.295 CHECKS=779543	SAT TT=2.786 ASSIGNMENTS=5051	SAT TT=2.826 ASSIGNMENTS=5051	SAT TT=0.196 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.193 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.159 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.277 ASSIGNMENTS=33082 CHECKS=542137	SAT TT=1.047	SAT TT=1.204 ASSIGNMENTS=23249 CHECKS=1586990	SAT TT=0.074 ASSIGNMENTS=402 CHECKS=19997	? TT=2.503	SAT TT=3.064	SAT TT=2.94
csp/bibd6/ normalized-bibd-6-60-30-3-12_glb.xml	SAT TT=1.132	SAT TT=20 CHECKS=16299 NODES=2887	SAT TT=18.768 CHECKS=565247 NODES=19954	? (TO) TT=1800.06	SAT TT=14.793 CHECKS=2304870	SAT TT=23.755 CHECKS=3943900	? (TO) TT=1800.12	? (TO) TT=1800.12	SAT TT=9.959 ASSIGNMENTS=59948 CHECKS=4536220	SAT TT=360.193 ASSIGNMENTS=1832390 CHECKS=65255500	? (TO) TT=1800.1	SAT TT=3.723 ASSIGNMENTS=104134 CHECKS=7917050	SAT TT=1.132	? (TO) TT=1800.03	SAT TT=2.191 ASSIGNMENTS=59948 CHECKS=4536220	? TT=2.834	SAT TT=2.669	SAT TT=3.376
csp/bibd6/ normalized-bibd-6-70-35-3-14_glb.xml	SAT TT=0.091	SAT TT=36.01 CHECKS=18935 NODES=3157	? (TO) TT=1800.13	? (TO) TT=1800.12	SAT TT=36.904 CHECKS=5708050	SAT TT=41.456 CHECKS=6101730	SAT TT=77.36 ASSIGNMENTS=267550	SAT TT=83.456 ASSIGNMENTS=267550	SAT TT=7.603 ASSIGNMENTS=321 CHECKS=12417	SAT TT=674.152 ASSIGNMENTS=321 CHECKS=12417	? (TO) TT=1800.09	SAT TT=773.342 ASSIGNMENTS=13978100 CHECKS=1590520000	SAT TT=1.373	SAT TT=3.362 ASSIGNMENTS=36156 CHECKS=3103070	SAT TT=0.091 ASSIGNMENTS=321 CHECKS=12417	? TT=3.146	SAT TT=3.161	SAT TT=4.336
csp/bibd6/ normalized-bibd-6-80-40-3-16_glb.xml	SAT TT=0.105	SAT TT=4.149 CHECKS=26033 NODES=4524	? (TO) TT=1800.17	? (TO) TT=1800.05	SAT TT=11.218 CHECKS=1367770	SAT TT=45.7 CHECKS=6134450	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=367.771 ASSIGNMENTS=286 CHECKS=10490	SAT TT=673.67 ASSIGNMENTS=286 CHECKS=10490	SAT TT=256.839 ASSIGNMENTS=10116200 CHECKS=440831000	SAT TT=14.713 ASSIGNMENTS=340188 CHECKS=24217700	SAT TT=2.407	SAT TT=2.767 ASSIGNMENTS=30151 CHECKS=2745450	SAT TT=0.105 ASSIGNMENTS=286 CHECKS=10490	? TT=3.059	SAT TT=7.464	SAT TT=5.607
csp/bibd6/ normalized-bibd-6-90-45-3-18_glb.xml	SAT TT=1.295	SAT TT=4.099 CHECKS=16396 NODES=3777	SAT TT=676.199 CHECKS=85573200 NODES=1415260	? (TO) TT=1800.09	SAT TT=105.604 CHECKS=12362100	SAT TT=182.167 CHECKS=21784700	? (TO) TT=1800.13	? (TO) TT=1800.11	SAT TT=369.213 ASSIGNMENTS=15562 CHECKS=1716710	SAT TT=675.973 ASSIGNMENTS=15562 CHECKS=1716710	? (TO) TT=1800.11	SAT TT=90.771 ASSIGNMENTS=1259360 CHECKS=141450000	SAT TT=5.814	? (TO) TT=1800.1	SAT TT=1.295 ASSIGNMENTS=15562 CHECKS=1716710	? TT=3.674	SAT TT=48.7	SAT TT=5.721
csp/bibd7/ normalized-bibd-7-07-3-3-1_glb.xml	SAT TT=0.016	SAT TT=1.047 CHECKS=1719 NODES=233	SAT TT=1.091 CHECKS=2464 NODES=216	SAT TT=0.071	SAT TT=0.083 CHECKS=3577	SAT TT=0.047 CHECKS=8159	SAT TT=0.881 ASSIGNMENTS=29	SAT TT=0.824 ASSIGNMENTS=29	SAT TT=0.03 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.028 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.019 ASSIGNMENTS=111 CHECKS=4968	SAT TT=0.622	SAT TT=0.019 ASSIGNMENTS=69 CHECKS=2031	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=939	? TT=1.2	SAT TT=1.447	SAT TT=1.195
csp/bibd7/ normalized-bibd-7-14-6-3-2_glb.xml	SAT TT=0.026	SAT TT=1.516 CHECKS=32569 NODES=1640	SAT TT=1.671 CHECKS=39651 NODES=2182	SAT TT=0.128	SAT TT=0.3 CHECKS=61353	SAT TT=0.172 CHECKS=48698	SAT TT=1.143 ASSIGNMENTS=325	SAT TT=1.177 ASSIGNMENTS=325	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	SAT TT=0.027 ASSIGNMENTS=51 CHECKS=2299	SAT TT=0.026 ASSIGNMENTS=68 CHECKS=1372	SAT TT=0.712	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=3128	SAT TT=0.03 ASSIGNMENTS=171 CHECKS=12297	? TT=1.694	SAT TT=1.52	SAT TT=1.66
csp/bibd7/ normalized-bibd-7-21-9-3-3_glb.xml	SAT TT=0.035	SAT TT=2.131 CHECKS=57506 NODES=3420	SAT TT=2.307 CHECKS=99781 NODES=5313	SAT TT=0.469	SAT TT=0.674 CHECKS=155722	SAT TT=0.452 CHECKS=115293	SAT TT=1.455 ASSIGNMENTS=1058	SAT TT=1.37 ASSIGNMENTS=1058	SAT TT=0.058 ASSIGNMENTS=417 CHECKS=15349	SAT TT=0.057 ASSIGNMENTS=417 CHECKS=15349	SAT TT=0.088 ASSIGNMENTS=3788 CHECKS=146645	SAT TT=0.312 ASSIGNMENTS=25419 CHECKS=907503	SAT TT=1.074	SAT TT=0.069 ASSIGNMENTS=1345 CHECKS=59358	SAT TT=0.035 ASSIGNMENTS=80 CHECKS=2836	? TT=1.909	SAT TT=1.687	SAT TT=1.833
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd7/ normalized-bibd-7-28-12-3-4_glb.xml	SAT TT=0.048	SAT TT=2.814 CHECKS=34640 NODES=4038	SAT TT=28.574 CHECKS=4774700 NODES=169506	SAT TT=10.583	SAT TT=1.176 CHECKS=226301	SAT TT=0.745 CHECKS=188058	SAT TT=1.893 ASSIGNMENTS=1115	SAT TT=1.663 ASSIGNMENTS=1115	SAT TT=0.996 ASSIGNMENTS=62169 CHECKS=2205400	SAT TT=1.085 ASSIGNMENTS=62169 CHECKS=2205400	SAT TT=1.017 ASSIGNMENTS=62594 CHECKS=2345940	? (TO) TT=1800.02	SAT TT=1.055	SAT TT=0.2 ASSIGNMENTS=3968 CHECKS=305085	SAT TT=0.048 ASSIGNMENTS=98 CHECKS=2972	? TT=2.349	SAT TT=2.28	SAT TT=2.216
csp/bibd7/ normalized-bibd-7-35-15-3-5_glb.xml	SAT TT=0.062	SAT TT=311.658 CHECKS=77787000 NODES=1115990	SAT TT=11.648 CHECKS=2419940 NODES=30363	SAT TT=424.115	SAT TT=1.435 CHECKS=237386	SAT TT=2.4 CHECKS=624761	SAT TT=1.817 ASSIGNMENTS=1173	SAT TT=1.727 ASSIGNMENTS=1173	SAT TT=7.116 ASSIGNMENTS=294 CHECKS=17010	SAT TT=7.94 ASSIGNMENTS=294 CHECKS=17010	SAT TT=15.976 ASSIGNMENTS=877418 CHECKS=37314900	? (TO) TT=1800	SAT TT=1.179	SAT TT=0.304 ASSIGNMENTS=5621 CHECKS=388512	SAT TT=0.062 ASSIGNMENTS=294 CHECKS=17010	? TT=2.499	SAT TT=2.196	SAT TT=2.419
csp/bibd7/ normalized-bibd-7-42-18-3-6_glb.xml	SAT TT=1.002	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=9.224 CHECKS=2070440	SAT TT=1.186 CHECKS=212203	SAT TT=2.04 ASSIGNMENTS=1228	SAT TT=1.944 ASSIGNMENTS=1228	SAT TT=11.361 ASSIGNMENTS=103369 CHECKS=7276900	SAT TT=10.469 ASSIGNMENTS=103369 CHECKS=7276900	SAT TT=72.958 ASSIGNMENTS=3188800 CHECKS=162715000	? (TO) TT=1800.07	SAT TT=1.002	SAT TT=1.65 ASSIGNMENTS=28568 CHECKS=1917350	SAT TT=3.396 ASSIGNMENTS=103369 CHECKS=7276900	? TT=2.97	SAT TT=2.896	SAT TT=3.034
csp/bibd7/ normalized-bibd-7-49-21-3-7_glb.xml	SAT TT=0.393	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=26.21 CHECKS=4502970	SAT TT=1.724 CHECKS=313068	SAT TT=2.185 ASSIGNMENTS=1274	SAT TT=2.532 ASSIGNMENTS=1274	SAT TT=8.109 ASSIGNMENTS=7900 CHECKS=675074	SAT TT=12.403 ASSIGNMENTS=1778 CHECKS=9354	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1.313	SAT TT=0.548 ASSIGNMENTS=6979 CHECKS=515398	SAT TT=0.393 ASSIGNMENTS=7900 CHECKS=675074	? TT=3.182	SAT TT=3.794	SAT TT=3.425
csp/bibd7/ normalized-bibd-7-56-24-3-8_glb.xml	SAT TT=0.152	SAT TT=22.952 CHECKS=3998430 NODES=55162	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=27.427 CHECKS=3470550	SAT TT=2.265 CHECKS=330601	SAT TT=3.08 ASSIGNMENTS=1318	SAT TT=2.833 ASSIGNMENTS=1318	SAT TT=7.647 ASSIGNMENTS=1592 CHECKS=106704	SAT TT=8.854 ASSIGNMENTS=2022 CHECKS=10479	? (TO) TT=1800.01	SAT TT=1.385 ASSIGNMENTS=85591 CHECKS=2681420	SAT TT=1.4	SAT TT=52.764 ASSIGNMENTS=799256 CHECKS=56559600	SAT TT=0.152 ASSIGNMENTS=1592 CHECKS=106704	? TT=2.987	SAT TT=3.344	SAT TT=3.754
csp/bibd7/ normalized-bibd-7-63-27-3-9_glb.xml	SAT TT=0.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=18.197 CHECKS=2478930	SAT TT=3.259 CHECKS=450309	SAT TT=3.128 ASSIGNMENTS=1364	SAT TT=3.367 ASSIGNMENTS=1364	SAT TT=7.122 ASSIGNMENTS=740 CHECKS=53457	SAT TT=8.937 ASSIGNMENTS=2229 CHECKS=11599	SAT TT=322.356 ASSIGNMENTS=7978280 CHECKS=654406000	SAT TT=1210.53 ASSIGNMENTS=28155400 CHECKS=2866900000	SAT TT=1.255	SAT TT=2.465 ASSIGNMENTS=27536 CHECKS=2020620	SAT TT=0.13 ASSIGNMENTS=740 CHECKS=53457	? TT=3.586	SAT TT=4.527	SAT TT=4.409
csp/bibd7/ normalized-bibd-7-70-30-3-10_glb.xml	SAT TT=1.243	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.1	SAT TT=30.246 CHECKS=3472150	SAT TT=3.489 CHECKS=463738	SAT TT=3.112 ASSIGNMENTS=1408	SAT TT=3.363 ASSIGNMENTS=1408	SAT TT=9.083 ASSIGNMENTS=2469 CHECKS=12814	SAT TT=10.085 ASSIGNMENTS=2469 CHECKS=12814	SAT TT=10.877 ASSIGNMENTS=297389 CHECKS=21473500	SAT TT=40.549 ASSIGNMENTS=1098250 CHECKS=84972500	SAT TT=1.243	SAT TT=29.125 ASSIGNMENTS=302858 CHECKS=26035900	SAT TT=8.348 ASSIGNMENTS=171688 CHECKS=15588600	? TT=3.512	SAT TT=953.226	SAT TT=5.469
csp/bibd7/ normalized-bibd-7-77-33-3-11_glb.xml	SAT TT=0.913	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=32.223 CHECKS=3143010	SAT TT=40.138 CHECKS=4402440	SAT TT=4.188 ASSIGNMENTS=1454	SAT TT=3.623 ASSIGNMENTS=1454	SAT TT=9.446 ASSIGNMENTS=2709 CHECKS=14006	SAT TT=10.065 ASSIGNMENTS=2709 CHECKS=14006	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1.624	? (TO) TT=1800.07	SAT TT=0.913 ASSIGNMENTS=15815 CHECKS=1208930	? TT=3.729	SAT TT=6.041	SAT TT=5.425
csp/bibd7/ normalized-bibd-7-84-36-3-12_glb.xml	SAT TT=0.227	? (TO) TT=1800.15	SAT TT=1499.78 CHECKS=199945000 NODES=2220580	? (TO) TT=1800.06	SAT TT=16.726 CHECKS=1428580	SAT TT=39.286 CHECKS=5013330	SAT TT=4.002 ASSIGNMENTS=1496	SAT TT=3.994 ASSIGNMENTS=1496	SAT TT=9.748 ASSIGNMENTS=2949 CHECKS=15196	SAT TT=9.507 ASSIGNMENTS=2949 CHECKS=15196	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.704	SAT TT=1163.06 ASSIGNMENTS=10205300 CHECKS=910157000	SAT TT=0.227 ASSIGNMENTS=1643 CHECKS=117182	? TT=3.843	SAT TT=10.634	SAT TT=8.065
csp/bibd7/ normalized-bibd-7-91-39-3-13_glb.xml	SAT TT=0.213	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.05	SAT TT=33.643 CHECKS=3294560	SAT TT=40.129 CHECKS=3631280	SAT TT=3.973 ASSIGNMENTS=1542	SAT TT=4.227 ASSIGNMENTS=1542	SAT TT=9.362 ASSIGNMENTS=3188 CHECKS=16384	SAT TT=10.12 ASSIGNMENTS=3188 CHECKS=16384	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.523	? (TO) TT=1800.08	SAT TT=0.213 ASSIGNMENTS=1294 CHECKS=106767	? TT=4.027	SAT TT=10.716	SAT TT=7.125
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd7/ normalized-bibd-7-98-42-3-14_glb.xml	SAT TT=0.272	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.78 CHECKS=4800760	SAT TT=5.056 ASSIGNMENTS=1588	SAT TT=4.674 ASSIGNMENTS=1588	SAT TT=10.294 ASSIGNMENTS=3370 CHECKS=17483	SAT TT=10.14 ASSIGNMENTS=3370 CHECKS=17483	? (TO) TT=1800.02	SAT TT=174.78 ASSIGNMENTS=3104970 CHECKS=324341000	SAT TT=1.814	SAT TT=9.232 ASSIGNMENTS=76148 CHECKS=7817730	SAT TT=0.272 ASSIGNMENTS=2664 CHECKS=139611	? TT=4.091	SAT TT=6.654	SAT TT=8.16
csp/bibd8/ normalized-bibd-8-14-7-4-3_glb.xml	SAT TT=0.046	SAT TT=1.578 CHECKS=29418 NODES=1633	SAT TT=2.957 CHECKS=10438 NODES=761	SAT TT=0.165	SAT TT=0.635 CHECKS=156588	SAT TT=0.454 CHECKS=151413	SAT TT=1.476 ASSIGNMENTS=665	SAT TT=1.199 ASSIGNMENTS=665	SAT TT=0.06 ASSIGNMENTS=336 CHECKS=41465	SAT TT=0.061 ASSIGNMENTS=336 CHECKS=41465	SAT TT=0.046 ASSIGNMENTS=331 CHECKS=35214	SAT TT=21.917 ASSIGNMENTS=761594 CHECKS=74014000	SAT TT=0.747	SAT TT=0.073 ASSIGNMENTS=1017 CHECKS=85432	SAT TT=0.051 ASSIGNMENTS=626 CHECKS=63104	? TT=1.763	SAT TT=1.604	SAT TT=1.946
csp/bibd8/ normalized-bibd-8-28-14-4-6_glb.xml	SAT TT=0.071	SAT TT=3.546 CHECKS=105912 NODES=4399	? (TO) TT=1800.09	SAT TT=29.635	? (TO) TT=1800.09	SAT TT=55.44 CHECKS=14017800	SAT TT=5.863 ASSIGNMENTS=16673	SAT TT=5.759 ASSIGNMENTS=16673	SAT TT=1.471 ASSIGNMENTS=41974 CHECKS=3519580	SAT TT=1.466 ASSIGNMENTS=41974 CHECKS=3519580	SAT TT=2.152 ASSIGNMENTS=56543 CHECKS=5610440	? (TO) TT=1800.04	SAT TT=1.36	SAT TT=0.155 ASSIGNMENTS=2045 CHECKS=145907	SAT TT=0.071 ASSIGNMENTS=227 CHECKS=20992	? TT=2.509	SAT TT=2.514	SAT TT=2.917
csp/bibd8/ normalized-bibd-8-42-21-4-9_glb.xml	SAT TT=0.156	SAT TT=114.529 CHECKS=21583500 NODES=321610	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=7.754 ASSIGNMENTS=1654 CHECKS=144137	SAT TT=7.749 ASSIGNMENTS=1654 CHECKS=144137	SAT TT=334.851 ASSIGNMENTS=8429860 CHECKS=762093000	? (TO) TT=1800.03	SAT TT=105.003	SAT TT=9.872 ASSIGNMENTS=127888 CHECKS=10155000	SAT TT=0.156 ASSIGNMENTS=1654 CHECKS=144137	? TT=2.955	SAT TT=3.763	SAT TT=5.361
csp/bibd8/ normalized-bibd-8-56-28-4-12_glb.xml	SAT TT=3.384	SAT TT=8.316 CHECKS=318842 NODES=18791	? (TO) TT=1800.17	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=11.106 ASSIGNMENTS=59651 CHECKS=7118020	SAT TT=677.581 ASSIGNMENTS=59651 CHECKS=7118020	? (TO) TT=1800.06	SAT TT=99.462 ASSIGNMENTS=2520650 CHECKS=221254000	? (TO) TT=1800.11	SAT TT=47.54 ASSIGNMENTS=279777 CHECKS=25351600	SAT TT=3.384 ASSIGNMENTS=59651 CHECKS=7118020	? TT=3.946	SAT TT=10.36	SAT TT=6.124
csp/bibd8/ normalized-bibd-8-70-35-4-15_glb.xml	SAT TT=0.334	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=295.907 ASSIGNMENTS=3522 CHECKS=367591	SAT TT=674.364 ASSIGNMENTS=3522 CHECKS=367591	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1302.61 ASSIGNMENTS=9685250 CHECKS=985236000	SAT TT=0.334 ASSIGNMENTS=3522 CHECKS=367591	? TT=4.399	SAT TT=232.861	SAT TT=17.66
csp/bibd8/ normalized-bibd-8-84-42-4-18_glb.xml	SAT TT=14.725	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=500.797 ASSIGNMENTS=1303030 CHECKS=222039000	SAT TT=792.696 ASSIGNMENTS=1303030 CHECKS=222039000	? (TO) TT=1800.01	SAT TT=806.14 ASSIGNMENTS=13590100 CHECKS=1386400000	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=118.781 ASSIGNMENTS=1303030 CHECKS=222039000	? TT=4.411	SAT TT=520.019	SAT TT=14.725
csp/bibd8/ normalized-bibd-8-98-49-4-21_glb.xml	SAT TT=34.245	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=4.841	? (TO) TT=1800.06	SAT TT=34.245
csp/bibd9/ normalized-bibd-9-108-36-3-9_glb.xml	SAT TT=14.398	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.811 CHECKS=22342100	? (TO) TT=1800.11	SAT TT=22.891 ASSIGNMENTS=13222	SAT TT=23.559 ASSIGNMENTS=13222	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=14.398 ASSIGNMENTS=334519 CHECKS=27771600	? (TO) TT=1800.09	SAT TT=1588.93 ASSIGNMENTS=7647320 CHECKS=700686000	? (TO) TT=1800.04	? TT=5.483	SAT TT=167.193	SAT TT=30.128
csp/bibd9/ normalized-bibd-9-120-40-3-10_glb.xml	SAT TT=0.871	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.14	SAT TT=368.595 ASSIGNMENTS=7085 CHECKS=530573	SAT TT=675.34 ASSIGNMENTS=7085 CHECKS=530573	? (TO) TT=1800.07	SAT TT=99.973 ASSIGNMENTS=1586200 CHECKS=158553000	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=0.871 ASSIGNMENTS=7085 CHECKS=530573	? TT=5.349	SAT TT=115.747	SAT TT=45.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd9/ normalized-bibd-9-12-4-3-1_glb.xml	SAT TT=0.037	SAT TT=2.348 CHECKS=11964 NODES=821	SAT TT=2.191 CHECKS=32263 NODES=1906	SAT TT=0.158	SAT TT=0.631 CHECKS=190577	SAT TT=0.477 CHECKS=167456	SAT TT=1.307 ASSIGNMENTS=115	SAT TT=1.456 ASSIGNMENTS=115	SAT TT=0.045 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.048 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.037 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.169 ASSIGNMENTS=14335 CHECKS=423238	SAT TT=0.933	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=8323	SAT TT=0.038 ASSIGNMENTS=69 CHECKS=4002	? TT=1.957	SAT TT=1.715	SAT TT=2.189
csp/bibd9/ normalized-bibd-9-24-8-3-2_glb.xml	SAT TT=0.07	SAT TT=2.712 CHECKS=74694 NODES=2952	SAT TT=2.801 CHECKS=66623 NODES=3702	SAT TT=0.671	SAT TT=6.911 CHECKS=1617110	SAT TT=1.283 CHECKS=341177	SAT TT=2.741 ASSIGNMENTS=4025	SAT TT=2.778 ASSIGNMENTS=4025	SAT TT=0.084 ASSIGNMENTS=308 CHECKS=18117	SAT TT=0.079 ASSIGNMENTS=308 CHECKS=18117	SAT TT=0.07 ASSIGNMENTS=243 CHECKS=13195	SAT TT=214.547 ASSIGNMENTS=6643700 CHECKS=727034000	SAT TT=0.999	SAT TT=0.152 ASSIGNMENTS=2309 CHECKS=133863	SAT TT=0.076 ASSIGNMENTS=262 CHECKS=21306	? TT=2.937	SAT TT=2.489	SAT TT=2.766
csp/bibd9/ normalized-bibd-9-36-12-3-3_glb.xml	SAT TT=0.106	? (TO) TT=1800.16	SAT TT=5.571 CHECKS=339061 NODES=11710	SAT TT=233.001	SAT TT=41.459 CHECKS=6901980	SAT TT=54.671 CHECKS=10793900	SAT TT=130.377 ASSIGNMENTS=356835	SAT TT=115.796 ASSIGNMENTS=356835	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	SAT TT=0.106 ASSIGNMENTS=375 CHECKS=19837	? (TO) TT=1800.06	SAT TT=268.519	SAT TT=0.579 ASSIGNMENTS=5796 CHECKS=452272	SAT TT=0.795 ASSIGNMENTS=16527 CHECKS=1751210	? TT=3.375	SAT TT=3.71	SAT TT=3.952
csp/bibd9/ normalized-bibd-9-48-16-3-4_glb.xml	SAT TT=0.15	? (TO) TT=1800.07	SAT TT=565.36 CHECKS=69659400 NODES=1518290	? (TO) TT=1800.07	SAT TT=45.564 CHECKS=5967360	SAT TT=66.57 CHECKS=10584200	SAT TT=60.627 ASSIGNMENTS=134470	SAT TT=56.191 ASSIGNMENTS=134470	SAT TT=22.253 ASSIGNMENTS=294382 CHECKS=26675700	SAT TT=202.702 ASSIGNMENTS=866829 CHECKS=21414100	SAT TT=0.15 ASSIGNMENTS=564 CHECKS=33303	SAT TT=0.394 ASSIGNMENTS=70345 CHECKS=771266	SAT TT=2.522	SAT TT=1.479 ASSIGNMENTS=15704 CHECKS=1252640	SAT TT=14.732 ASSIGNMENTS=294382 CHECKS=26675700	? TT=4.133	SAT TT=3.933	SAT TT=4.986
csp/bibd9/ normalized-bibd-9-60-20-3-5_glb.xml	SAT TT=1.151	SAT TT=7.73 CHECKS=135085 NODES=8870	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=10.653 ASSIGNMENTS=5569	SAT TT=8.909 ASSIGNMENTS=5569	SAT TT=163.225 ASSIGNMENTS=2484140 CHECKS=241989000	SAT TT=127.187 ASSIGNMENTS=437888 CHECKS=11860600	SAT TT=39.873 ASSIGNMENTS=711468 CHECKS=71066000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1.151 ASSIGNMENTS=7762 CHECKS=767877	SAT TT=144.648 ASSIGNMENTS=2484140 CHECKS=241989000	? TT=4.198	SAT TT=4.192	SAT TT=6.504
csp/bibd9/ normalized-bibd-9-72-24-3-6_glb.xml	SAT TT=6.305	SAT TT=1302.45 CHECKS=218612000 NODES=1459850	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=52 CHECKS=5525590	? (TO) TT=1800.08	SAT TT=12.21 ASSIGNMENTS=11878	SAT TT=11.478 ASSIGNMENTS=11878	SAT TT=311.361 ASSIGNMENTS=240509 CHECKS=25565200	SAT TT=691.011 ASSIGNMENTS=240509 CHECKS=25565200	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=1077.09	SAT TT=22.735 ASSIGNMENTS=143663 CHECKS=16548800	SAT TT=15.905 ASSIGNMENTS=240509 CHECKS=25565200	? TT=4.444	SAT TT=6.305	SAT TT=8.582
csp/bibd9/ normalized-bibd-9-84-28-3-7_glb.xml	SAT TT=1.794	SAT TT=112.244 CHECKS=9809070 NODES=156280	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=13.793 ASSIGNMENTS=6301	SAT TT=13.592 ASSIGNMENTS=6301	SAT TT=382.144 ASSIGNMENTS=208582 CHECKS=19630600	SAT TT=686.701 ASSIGNMENTS=208582 CHECKS=19630600	SAT TT=1.794 ASSIGNMENTS=26304 CHECKS=2289120	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=298.891 ASSIGNMENTS=1870190 CHECKS=175327000	SAT TT=12.92 ASSIGNMENTS=208582 CHECKS=19630600	? TT=4.936	SAT TT=9.769	SAT TT=9.569
csp/bibd9/ normalized-bibd-9-96-32-3-8_glb.xml	SAT TT=0.406	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=359.146 CHECKS=20042200	SAT TT=1300.31 CHECKS=133010000	SAT TT=30.167 ASSIGNMENTS=14183	SAT TT=30.303 ASSIGNMENTS=14183	SAT TT=368.575 ASSIGNMENTS=2562 CHECKS=126677	SAT TT=676.529 ASSIGNMENTS=2562 CHECKS=126677	? (TO) TT=1800.11	SAT TT=69.628 ASSIGNMENTS=978404 CHECKS=121245000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.406 ASSIGNMENTS=2562 CHECKS=126677	? TT=5.624	SAT TT=32.364	SAT TT=12.968
csp/bibdVariousK/ normalized-bibd-10-15-6-4-2_glb.xml	SAT TT=0.055	SAT TT=8.371 CHECKS=1071520 NODES=45275	SAT TT=2.44 CHECKS=98265 NODES=2725	SAT TT=0.341	SAT TT=3.696 CHECKS=1060730	SAT TT=0.907 CHECKS=293522	SAT TT=1.905 ASSIGNMENTS=2103	SAT TT=2.143 ASSIGNMENTS=2103	SAT TT=0.065 ASSIGNMENTS=116 CHECKS=8968	SAT TT=0.067 ASSIGNMENTS=116 CHECKS=8968	SAT TT=0.055 ASSIGNMENTS=144 CHECKS=11869	SAT TT=28.382 ASSIGNMENTS=906311 CHECKS=91250100	SAT TT=1.226	SAT TT=0.061 ASSIGNMENTS=294 CHECKS=14109	SAT TT=0.095 ASSIGNMENTS=1078 CHECKS=123262	? TT=2.434	SAT TT=2.215	SAT TT=2.763
csp/bibdVariousK/ normalized-bibd-10-18-9-5-4_glb.xml	SAT TT=0.078	SAT TT=45.947 CHECKS=6929210 NODES=262761	SAT TT=29.861 CHECKS=5683630 NODES=155132	SAT TT=0.525	SAT TT=1.64 CHECKS=302509	SAT TT=152.915 CHECKS=48281600	SAT TT=6.145 ASSIGNMENTS=21703	SAT TT=6.391 ASSIGNMENTS=21703	SAT TT=0.079 ASSIGNMENTS=383 CHECKS=32136	SAT TT=0.085 ASSIGNMENTS=383 CHECKS=32136	SAT TT=0.078 ASSIGNMENTS=511 CHECKS=43639	? (TO) TT=1800.05	SAT TT=0.996	SAT TT=0.268 ASSIGNMENTS=3522 CHECKS=317321	SAT TT=0.219 ASSIGNMENTS=4745 CHECKS=426734	? TT=2.752	SAT TT=2.763	SAT TT=2.93
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-11-11-5-5-2_glb.xml	SAT TT=0.049	SAT TT=1.926 CHECKS=33309 NODES=1311	SAT TT=2.482 CHECKS=47962 NODES=2196	SAT TT=0.2	SAT TT=0.81 CHECKS=186374	SAT TT=0.467 CHECKS=153862	SAT TT=1.377 ASSIGNMENTS=165	SAT TT=1.353 ASSIGNMENTS=165	SAT TT=0.061 ASSIGNMENTS=54 CHECKS=4969	SAT TT=0.06 ASSIGNMENTS=54 CHECKS=4969	SAT TT=0.049 ASSIGNMENTS=61 CHECKS=5277	SAT TT=0.465 ASSIGNMENTS=22610 CHECKS=1355340	SAT TT=1.112	SAT TT=0.078 ASSIGNMENTS=772 CHECKS=46017	SAT TT=0.053 ASSIGNMENTS=129 CHECKS=16455	? TT=2.338	SAT TT=2.047	SAT TT=2.456
csp/bibdVariousK/ normalized-bibd-11-22-10-5-4_glb.xml	SAT TT=0.319	SAT TT=798.467 CHECKS=125798000 NODES=3344730	SAT TT=7.627 CHECKS=1448000 NODES=15589	SAT TT=1.692	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=30.544 ASSIGNMENTS=104280	SAT TT=29.054 ASSIGNMENTS=104280	SAT TT=0.327 ASSIGNMENTS=6037 CHECKS=565287	SAT TT=0.319 ASSIGNMENTS=6037 CHECKS=565287	SAT TT=1.353 ASSIGNMENTS=35789 CHECKS=3429870	? (TO) TT=1800.03	SAT TT=1.261	SAT TT=0.417 ASSIGNMENTS=4561 CHECKS=487995	SAT TT=0.499 ASSIGNMENTS=11252 CHECKS=1055430	? TT=2.988	SAT TT=2.673	SAT TT=4.733
csp/bibdVariousK/ normalized-bibd-12-22-11-6-5_glb.xml	SAT TT=0.171	SAT TT=408.848 CHECKS=52060500 NODES=1540310	? (TO) TT=1800.13	SAT TT=2.737	SAT TT=20.694 CHECKS=2300710	SAT TT=19.967 CHECKS=4242880	SAT TT=47.569 ASSIGNMENTS=108490	SAT TT=53.18 ASSIGNMENTS=108490	SAT TT=8.219 ASSIGNMENTS=1869 CHECKS=199414	SAT TT=8.135 ASSIGNMENTS=1869 CHECKS=199414	SAT TT=40.452 ASSIGNMENTS=885487 CHECKS=108857000	? (TO) TT=1800.05	SAT TT=5.101	SAT TT=0.934 ASSIGNMENTS=10043 CHECKS=1199410	SAT TT=0.171 ASSIGNMENTS=1869 CHECKS=199414	? TT=3.347	SAT TT=7.042	SAT TT=10.59
csp/bibdVariousK/ normalized-bibd-13-13-4-4-1_glb.xml	SAT TT=0.078	SAT TT=2.393 CHECKS=36768 NODES=1746	SAT TT=5.405 CHECKS=179926 NODES=12686	SAT TT=0.346	SAT TT=4.909 CHECKS=1398930	SAT TT=2.897 CHECKS=979719	SAT TT=2.147 ASSIGNMENTS=215	SAT TT=1.716 ASSIGNMENTS=215	SAT TT=0.087 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.087 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.078 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.367 ASSIGNMENTS=30505 CHECKS=935746	SAT TT=1.002	SAT TT=0.083 ASSIGNMENTS=161 CHECKS=7200	SAT TT=0.079 ASSIGNMENTS=109 CHECKS=13780	? TT=2.89	SAT TT=2.765	SAT TT=3.121
csp/bibdVariousK/ normalized-bibd-13-26-8-4-2_glb.xml	SAT TT=0.431	SAT TT=7.704 CHECKS=564591 NODES=8297	SAT TT=115.002 CHECKS=14535800 NODES=263626	SAT TT=1.216	SAT TT=12.2 CHECKS=1110670	SAT TT=5.237 CHECKS=943043	SAT TT=5.065 ASSIGNMENTS=1999	SAT TT=5.122 ASSIGNMENTS=1999	SAT TT=0.537 ASSIGNMENTS=6358 CHECKS=949515	SAT TT=0.54 ASSIGNMENTS=6358 CHECKS=949515	SAT TT=0.525 ASSIGNMENTS=6710 CHECKS=961162	? (TO) TT=1800.1	SAT TT=1.457	SAT TT=1.343 ASSIGNMENTS=11961 CHECKS=1820670	SAT TT=0.431 ASSIGNMENTS=4204 CHECKS=631910	? TT=4.179	SAT TT=4.261	SAT TT=7.075
csp/bibdVariousK/ normalized-bibd-14-26-13-7-6_glb.xml	SAT TT=26.222	? (TO) TT=1800.16	? (TO) TT=1800.04	SAT TT=26.222	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=74.611 ASSIGNMENTS=1137880 CHECKS=170945000	SAT TT=74.915 ASSIGNMENTS=1137880 CHECKS=170945000	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=28.629 ASSIGNMENTS=242577 CHECKS=32072600	SAT TT=60.691 ASSIGNMENTS=1137880 CHECKS=170945000	? TT=4.547	SAT TT=41.384	SAT TT=345.198
csp/bibdVariousK/ normalized-bibd-15-15-7-7-3_glb.xml	SAT TT=0.203	SAT TT=45.592 CHECKS=6693710 NODES=159504	? (TO) TT=1800.16	SAT TT=0.568	SAT TT=3.943 CHECKS=577552	SAT TT=6.532 CHECKS=1487960	SAT TT=6.281 ASSIGNMENTS=4230	SAT TT=6.118 ASSIGNMENTS=4230	SAT TT=8.264 ASSIGNMENTS=1743 CHECKS=251439	SAT TT=8.031 ASSIGNMENTS=1743 CHECKS=251439	SAT TT=0.216 ASSIGNMENTS=2744 CHECKS=321799	? (TO) TT=1800.03	SAT TT=1.348	SAT TT=0.522 ASSIGNMENTS=4547 CHECKS=642747	SAT TT=0.203 ASSIGNMENTS=1743 CHECKS=251439	? TT=3.543	SAT TT=3.476	SAT TT=3.632
csp/bibdVariousK/ normalized-bibd-15-21-7-5-2_glb.xml		? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=4.25	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/bibdVariousK/ normalized-bibd-15-35-7-3-1_glb.xml	SAT TT=0.297	SAT TT=12.115 CHECKS=498982 NODES=9543	? (TO) TT=1800.14	SAT TT=2.14	SAT TT=431.927 CHECKS=56524300	SAT TT=105.935 CHECKS=13664200	SAT TT=56.518 ASSIGNMENTS=27234	SAT TT=56.754 ASSIGNMENTS=27234	SAT TT=0.311 ASSIGNMENTS=546 CHECKS=40407	SAT TT=0.314 ASSIGNMENTS=546 CHECKS=40407	SAT TT=0.303 ASSIGNMENTS=548 CHECKS=45046	? (TO) TT=1800.06	SAT TT=2.359	SAT TT=3.099 ASSIGNMENTS=20498 CHECKS=2034390	SAT TT=0.297 ASSIGNMENTS=625 CHECKS=76648	? TT=5.644	SAT TT=6.16	SAT TT=8.034
csp/bibdVariousK/ normalized-bibd-15-45-24-8-12_glb.xml	SAT TT=717.186	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=762.586 ASSIGNMENTS=6870490 CHECKS=1069540000	SAT TT=744.143 ASSIGNMENTS=6870490 CHECKS=1069540000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=764.403 ASSIGNMENTS=6870490 CHECKS=1069540000	? TT=5.988	? (TO) TT=1800.05	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-15-70-14-3-2_glb.xml	SAT TT=1.074	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=221.719 CHECKS=12321900	? (TO) TT=1800.12	? (TO) TT=1800.15	SAT TT=1.827 ASSIGNMENTS=13972 CHECKS=1691190	SAT TT=1.63 ASSIGNMENTS=13972 CHECKS=1691190	SAT TT=1.074 ASSIGNMENTS=5813 CHECKS=688149	? (TO) TT=1800.07	SAT TT=5.208	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.343	SAT TT=35.086	SAT TT=19.995
csp/bibdVariousK/ normalized-bibd-15-75-40-8-20_glb.xml		? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=6.035	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/bibdVariousK/ normalized-bibd-16-16-6-6-2_glb.xml	SAT TT=0.152	SAT TT=73.421 CHECKS=8815960 NODES=173623	SAT TT=1231.89 CHECKS=142994000 NODES=3067590	SAT TT=12.643	SAT TT=17.516 CHECKS=2173460	SAT TT=5.276 CHECKS=1190140	SAT TT=6.687 ASSIGNMENTS=7723	SAT TT=7.279 ASSIGNMENTS=7723	SAT TT=0.159 ASSIGNMENTS=165 CHECKS=18708	SAT TT=0.152 ASSIGNMENTS=165 CHECKS=18708	SAT TT=0.158 ASSIGNMENTS=339 CHECKS=51718	? (TO) TT=1800.06	SAT TT=147.284	SAT TT=0.515 ASSIGNMENTS=3410 CHECKS=684970	SAT TT=0.228 ASSIGNMENTS=1493 CHECKS=243560	? TT=3.876	SAT TT=3.953	SAT TT=4.537
csp/bibdVariousK/ normalized-bibd-16-20-5-4-1_glb.xml	SAT TT=0.199	SAT TT=6.156 CHECKS=216795 NODES=5734	SAT TT=648.254 CHECKS=51318800 NODES=1651900	SAT TT=0.774	SAT TT=27.926 CHECKS=5688060	SAT TT=9.09 CHECKS=2148840	SAT TT=4.136 ASSIGNMENTS=1015	SAT TT=4.587 ASSIGNMENTS=1015	SAT TT=0.228 ASSIGNMENTS=437 CHECKS=99614	SAT TT=0.227 ASSIGNMENTS=437 CHECKS=99614	SAT TT=0.199 ASSIGNMENTS=342 CHECKS=60978	SAT TT=0.679 ASSIGNMENTS=76486 CHECKS=1506930	SAT TT=1.688	SAT TT=1.208 ASSIGNMENTS=7758 CHECKS=1626410	SAT TT=0.558 ASSIGNMENTS=5469 CHECKS=1077860	? TT=4.479	SAT TT=4.118	SAT TT=4.773
csp/bibdVariousK/ normalized-bibd-16-24-9-6-3_glb.xml	SAT TT=0.399	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=2.61	? (TO) TT=1800.12	SAT TT=10.862 CHECKS=1313800	SAT TT=116.588 ASSIGNMENTS=78620	SAT TT=151.006 ASSIGNMENTS=78620	SAT TT=7.447 ASSIGNMENTS=2522 CHECKS=462620	SAT TT=8.364 ASSIGNMENTS=2522 CHECKS=462620	SAT TT=56.773 ASSIGNMENTS=938751 CHECKS=147812000	? (TO) TT=1800.07	SAT TT=1.834	SAT TT=2.08 ASSIGNMENTS=10375 CHECKS=1692080	SAT TT=0.399 ASSIGNMENTS=2522 CHECKS=462620	? TT=4.586	SAT TT=42.336	SAT TT=14.494
csp/bibdVariousK/ normalized-bibd-16-80-15-3-2_glb.xml	SAT TT=7.905	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=36.123 ASSIGNMENTS=302269 CHECKS=34118400	? (TO) TT=1800.06	SAT TT=7.905	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=6.697	SAT TT=35.684	SAT TT=27.411
csp/bibdVariousK/ normalized-bibd-19-19-9-9-4_glb.xml	SAT TT=0.739	? (TO) TT=1800.06	? (TO) TT=1800.13	SAT TT=1.96	SAT TT=17.105 CHECKS=1737900	SAT TT=14.27 CHECKS=1619630	SAT TT=148.528 ASSIGNMENTS=82955	SAT TT=149.537 ASSIGNMENTS=82955	SAT TT=0.743 ASSIGNMENTS=6963 CHECKS=1190440	SAT TT=0.739 ASSIGNMENTS=6963 CHECKS=1190440	SAT TT=99.275 ASSIGNMENTS=1386960 CHECKS=228854000	? (TO) TT=1800.09	SAT TT=2.164	SAT TT=3.82 ASSIGNMENTS=11199 CHECKS=1736870	SAT TT=0.873 ASSIGNMENTS=8278 CHECKS=1474170	? TT=5.529	SAT TT=37.976	SAT TT=39.253
csp/bibdVariousK/ normalized-bibd-19-57-9-3-1_glb.xml	SAT TT=7.185	? (TO) TT=1800.17	? (TO) TT=1800.17	SAT TT=52.3	? (TO) TT=1800.1	SAT TT=136.736 CHECKS=5687450	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=163.954 ASSIGNMENTS=667115 CHECKS=178388000	SAT TT=816.734 ASSIGNMENTS=667115 CHECKS=178388000	SAT TT=1272.85 ASSIGNMENTS=11049200 CHECKS=2137530000	? (TO) TT=1800.03	SAT TT=7.185	? (TO) TT=1800.07	SAT TT=154.017 ASSIGNMENTS=667115 CHECKS=178388000	? TT=6.818	SAT TT=17.235	SAT TT=805.807
csp/bibdVariousK/ normalized-bibd-21-21-5-5-1_glb.xml	SAT TT=0.335	? (TO) TT=1800.08	SAT TT=596.449 CHECKS=43867700 NODES=770759	SAT TT=1.388	SAT TT=65.474 CHECKS=11765700	SAT TT=10.368 CHECKS=1405540	SAT TT=9.343 ASSIGNMENTS=1732	SAT TT=7.827 ASSIGNMENTS=1732	SAT TT=0.335 ASSIGNMENTS=253 CHECKS=27497	SAT TT=0.339 ASSIGNMENTS=253 CHECKS=27497	SAT TT=0.391 ASSIGNMENTS=584 CHECKS=143586	? (TO) TT=1800.03	SAT TT=2.307	SAT TT=159.922 ASSIGNMENTS=722974 CHECKS=220218000	SAT TT=0.556 ASSIGNMENTS=2075 CHECKS=601484	? TT=5.352	SAT TT=6.936	SAT TT=7.663
csp/bibdVariousK/ normalized-bibd-21-28-8-6-2_glb.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=6.315	? (TO) TT=1800.09	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-22-22-7-7-2_glb.xml		? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=6.136	? (TO) TT=1800.06	? (TO) TT=1800.04
csp/bibdVariousK/ normalized-bibd-25-25-9-9-3_glb.xml	SAT TT=1.365	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=9.97	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=577.039 ASSIGNMENTS=141154	SAT TT=579.181 ASSIGNMENTS=141154	SAT TT=1.426 ASSIGNMENTS=7791 CHECKS=1692470	SAT TT=1.365 ASSIGNMENTS=7791 CHECKS=1692470	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=520.464 ASSIGNMENTS=1603970 CHECKS=391247000	SAT TT=176.577 ASSIGNMENTS=1263490 CHECKS=337356000	? TT=5.865	SAT TT=630.377	SAT TT=849.669
csp/bibdVariousK/ normalized-bibd-25-30-6-5-1_glb.xml	SAT TT=0.989	SAT TT=60.18 CHECKS=1947270 NODES=24047	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=191.712 ASSIGNMENTS=44735	SAT TT=172.719 ASSIGNMENTS=44735	SAT TT=0.989 ASSIGNMENTS=1882 CHECKS=736936	SAT TT=0.991 ASSIGNMENTS=1882 CHECKS=736936	SAT TT=117.894 ASSIGNMENTS=684454 CHECKS=288611000	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=6.393	SAT TT=55.076	SAT TT=28.891
csp/bibdVariousK/ normalized-bibd-31-31-6-6-1_glb.xml	SAT TT=1.41	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1.41 ASSIGNMENTS=932 CHECKS=306772	SAT TT=1.41 ASSIGNMENTS=932 CHECKS=306772	SAT TT=932.354 ASSIGNMENTS=3000640 CHECKS=1718230000	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.825 ASSIGNMENTS=2010 CHECKS=707826	? TT=7.739	SAT TT=134.334	SAT TT=65.163
csp/bibdVariousK/ normalized-bibd-7-210-60-2-10_glb.xml	SAT TT=0.708	SAT TT=18.051 CHECKS=212834 NODES=17675	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=34.293 CHECKS=1289420	SAT TT=369.071 CHECKS=12347500	SAT TT=22.307 ASSIGNMENTS=6948	SAT TT=23.05 ASSIGNMENTS=6948	SAT TT=764.51 ASSIGNMENTS=3025 CHECKS=188602	SAT TT=1502.64 ASSIGNMENTS=3025 CHECKS=188602	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=3.329	SAT TT=2.452 ASSIGNMENTS=10035 CHECKS=449325	SAT TT=0.708 ASSIGNMENTS=3025 CHECKS=188602	? TT=5.48	SAT TT=11.846	SAT TT=20.956
csp/bibdVariousK/ normalized-bibd-8-56-21-3-6_glb.xml	SAT TT=0.138	SAT TT=260.701 CHECKS=55128300 NODES=616940	SAT TT=175.886 CHECKS=34236000 NODES=230831	? (TO) TT=1800.11	SAT TT=43.128 CHECKS=6077700	SAT TT=60.501 CHECKS=8364800	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=1.486 ASSIGNMENTS=32282 CHECKS=2722100	SAT TT=1.487 ASSIGNMENTS=32282 CHECKS=2722100	SAT TT=1.397 ASSIGNMENTS=32439 CHECKS=2736920	SAT TT=484.511 ASSIGNMENTS=12931800 CHECKS=1050490000	SAT TT=25.625	SAT TT=0.525 ASSIGNMENTS=4410 CHECKS=265577	SAT TT=0.138 ASSIGNMENTS=505 CHECKS=29146	? TT=4.082	SAT TT=11.447	SAT TT=5.013
csp/bibdVariousK/ normalized-bibd-9-18-8-4-3_glb.xml	SAT TT=0.058	SAT TT=2.306 CHECKS=139820 NODES=4302	SAT TT=2.878 CHECKS=109912 NODES=3300	SAT TT=0.332	SAT TT=7.715 CHECKS=2287710	SAT TT=9.806 CHECKS=3384320	SAT TT=3.98 ASSIGNMENTS=13065	SAT TT=3.857 ASSIGNMENTS=13065	SAT TT=0.068 ASSIGNMENTS=193 CHECKS=15804	SAT TT=0.064 ASSIGNMENTS=193 CHECKS=15804	SAT TT=0.382 ASSIGNMENTS=8326 CHECKS=927274	SAT TT=0.476 ASSIGNMENTS=30636 CHECKS=1317700	SAT TT=0.86	SAT TT=0.288 ASSIGNMENTS=4585 CHECKS=458650	SAT TT=0.058 ASSIGNMENTS=141 CHECKS=14754	? TT=2.236	SAT TT=2.066	SAT TT=2.579
csp/costasArray/ normalized-costasArray-10.xml	SAT TT=0.011	SAT TT=0.833 CHECKS=32729 NODES=66	SAT TT=0.938 CHECKS=282491 NODES=160	SAT TT=0.037	SAT TT=0.122 CHECKS=7825	SAT TT=0.018 CHECKS=6358	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=1.094 ASSIGNMENTS=7	SAT TT=0.024 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.011 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.014 ASSIGNMENTS=61 CHECKS=7715	SAT TT=0.388	SAT TT=0.098 ASSIGNMENTS=619 CHECKS=73290	SAT TT=0.012 ASSIGNMENTS=12 CHECKS=2230	SAT TT=3.687	SAT TT=1.065	SAT TT=0.994
csp/costasArray/ normalized-costasArray-11.xml	SAT TT=0.016	SAT TT=1.024 CHECKS=430029 NODES=346	SAT TT=1.089 CHECKS=507038 NODES=241	SAT TT=0.04	SAT TT=0.144 CHECKS=66321	SAT TT=0.071 CHECKS=65629	SAT TT=1.666 ASSIGNMENTS=111	SAT TT=1.46 ASSIGNMENTS=9	SAT TT=0.085 ASSIGNMENTS=384 CHECKS=79578	SAT TT=0.089 ASSIGNMENTS=384 CHECKS=79578	SAT TT=0.058 ASSIGNMENTS=272 CHECKS=57112	SAT TT=0.198 ASSIGNMENTS=1505 CHECKS=228845	SAT TT=0.453	SAT TT=0.075 ASSIGNMENTS=341 CHECKS=46140	SAT TT=0.016 ASSIGNMENTS=30 CHECKS=5651	SAT TT=4.204	SAT TT=1.273	SAT TT=1.442
csp/costasArray/ normalized-costasArray-12.xml	SAT TT=0.046	SAT TT=1.363 CHECKS=994220 NODES=595	SAT TT=1.01 CHECKS=528725 NODES=114	SAT TT=0.046	SAT TT=0.193 CHECKS=88241	SAT TT=0.098 CHECKS=88238	SAT TT=2.051 ASSIGNMENTS=516	SAT TT=1.652 ASSIGNMENTS=19	SAT TT=0.067 ASSIGNMENTS=201 CHECKS=50613	SAT TT=0.069 ASSIGNMENTS=201 CHECKS=50613	SAT TT=0.049 ASSIGNMENTS=181 CHECKS=46589	SAT TT=0.061 ASSIGNMENTS=316 CHECKS=57495	SAT TT=0.479	SAT TT=0.297 ASSIGNMENTS=1317 CHECKS=229344	SAT TT=0.077 ASSIGNMENTS=293 CHECKS=72354	SAT TT=6.223	SAT TT=1.102	SAT TT=1.64
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/costasArray/ normalized-costasArray-13.xml	SAT TT=0.058	SAT TT=3.553 CHECKS=5253070 NODES=2745	SAT TT=1.63 CHECKS=1707190 NODES=541	SAT TT=0.167	SAT TT=0.308 CHECKS=177217	SAT TT=0.191 CHECKS=184901	SAT TT=3.739 ASSIGNMENTS=1578	SAT TT=2.097 ASSIGNMENTS=112	SAT TT=0.231 ASSIGNMENTS=824 CHECKS=228581	SAT TT=0.218 ASSIGNMENTS=824 CHECKS=228581	SAT TT=0.058 ASSIGNMENTS=148 CHECKS=43778	SAT TT=0.463 ASSIGNMENTS=2456 CHECKS=501267	SAT TT=0.468	SAT TT=0.49 ASSIGNMENTS=1828 CHECKS=380489	SAT TT=0.384 ASSIGNMENTS=1510 CHECKS=399635	SAT TT=12.374	SAT TT=1.339	SAT TT=1.701
csp/costasArray/ normalized-costasArray-14.xml	SAT TT=0.207	SAT TT=1.212 CHECKS=909507 NODES=299	SAT TT=1.987 CHECKS=2760210 NODES=631	SAT TT=0.207	SAT TT=1.775 CHECKS=1678670	SAT TT=2.504 CHECKS=2608430	SAT TT=3.235 ASSIGNMENTS=554	SAT TT=2.982 ASSIGNMENTS=446	SAT TT=0.766 ASSIGNMENTS=2376 CHECKS=775620	SAT TT=0.716 ASSIGNMENTS=2376 CHECKS=775620	SAT TT=1.459 ASSIGNMENTS=4542 CHECKS=1487410	SAT TT=0.371 ASSIGNMENTS=1598 CHECKS=377568	SAT TT=0.763	SAT TT=0.921 ASSIGNMENTS=2869 CHECKS=723258	SAT TT=1.959 ASSIGNMENTS=6765 CHECKS=2089690	SAT TT=6.597	SAT TT=2.74	SAT TT=4.461
csp/costasArray/ normalized-costasArray-15.xml	SAT TT=2.107	SAT TT=96.256 CHECKS=203540000 NODES=72743	SAT TT=17.421 CHECKS=35723600 NODES=11389	SAT TT=3.011	SAT TT=12.501 CHECKS=12844900	SAT TT=8.241 CHECKS=8703210	SAT TT=7.535 ASSIGNMENTS=3437	SAT TT=8.572 ASSIGNMENTS=3626	SAT TT=14.842 ASSIGNMENTS=3437	SAT TT=98.519 ASSIGNMENTS=72743 CHECKS=203540000	SAT TT=20.617 ASSIGNMENTS=56153 CHECKS=20841800	SAT TT=2.107 ASSIGNMENTS=6765 CHECKS=2130540	SAT TT=23.449	SAT TT=2.296 ASSIGNMENTS=6236 CHECKS=1859300	SAT TT=3.148 ASSIGNMENTS=9498 CHECKS=3236820	SAT TT=11.39	SAT TT=2.8	SAT TT=45.389
csp/costasArray/ normalized-costasArray-16.xml	SAT TT=2.038	SAT TT=39.386 CHECKS=87667300 NODES=24445	SAT TT=328.925 CHECKS=680982000 NODES=201749	SAT TT=6.065	SAT TT=5.838 CHECKS=5805990	SAT TT=8.664 CHECKS=9110420	SAT TT=31.844 ASSIGNMENTS=21059	SAT TT=62.53 ASSIGNMENTS=35369	SAT TT=38.865 ASSIGNMENTS=21059	SAT TT=46.029 ASSIGNMENTS=24445 CHECKS=87667300	SAT TT=22.864 ASSIGNMENTS=54410 CHECKS=22512900	SAT TT=4.119 ASSIGNMENTS=10595 CHECKS=4113600	SAT TT=12.761	SAT TT=30.027 ASSIGNMENTS=80687 CHECKS=29031000	SAT TT=2.038 ASSIGNMENTS=4878 CHECKS=1985480	SAT TT=189.949	SAT TT=44.477	SAT TT=14.215
csp/costasArray/ normalized-costasArray-17.xml	SAT TT=13.833	SAT TT=563.132 CHECKS=1313960000 NODES=307706	SAT TT=1346.44 CHECKS=3178030000 NODES=737113	SAT TT=55.331	SAT TT=95.622 CHECKS=84111600	SAT TT=278.657 CHECKS=317420000	SAT TT=171.314 ASSIGNMENTS=190327	SAT TT=13.833 ASSIGNMENTS=9519	SAT TT=178.976 ASSIGNMENTS=190327	SAT TT=560.795 ASSIGNMENTS=307706 CHECKS=1313960000	SAT TT=662.907 ASSIGNMENTS=1491870 CHECKS=704411000	SAT TT=33.107 ASSIGNMENTS=67649 CHECKS=31996400	SAT TT=701.482	SAT TT=99.354 ASSIGNMENTS=226261 CHECKS=92982000	SAT TT=40.834 ASSIGNMENTS=81754 CHECKS=37742600	? (TO) TT=1800.13	SAT TT=41.068	SAT TT=148.646
csp/costasArray/ normalized-costasArray-18.xml	SAT TT=55.982	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=55.982	? (TO) TT=1800.08	SAT TT=669.142 CHECKS=771810000	SAT TT=117.758 ASSIGNMENTS=106218	SAT TT=271.5 ASSIGNMENTS=188683	SAT TT=125.27 ASSIGNMENTS=106218	SAT TT=800.169 ASSIGNMENTS=215964 CHECKS=114674000	SAT TT=188.427 ASSIGNMENTS=342712 CHECKS=179206000	SAT TT=226.905 ASSIGNMENTS=413268 CHECKS=215508000	SAT TT=768.693	? (TO) TT=1800.1	SAT TT=129.089 ASSIGNMENTS=215964 CHECKS=114674000	SAT TT=1091.62	SAT TT=265.22	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-19.xml	SAT TT=270.332	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	SAT TT=270.332 CHECKS=278323000	? (TO) TT=1800.04	? (TO) TT=1800.14	SAT TT=293.928 ASSIGNMENTS=176754	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1103.56 ASSIGNMENTS=1946030 CHECKS=1129800000	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/latinSquare/ normalized-latinSquare-dg-10_all.xml	UNSAT TT=1.398	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.18	UNSAT TT=1.398	UNSAT TT=1.703
csp/latinSquare/ normalized-latinSquare-dg-11_all.xml	SAT TT=1.27	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=1.27	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/latinSquare/ normalized-latinSquare-dg-12_all.xml	UNSAT TT=1.744	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.2	UNSAT TT=1.744	UNSAT TT=2.523
csp/latinSquare/ normalized-latinSquare-dg-3_all.xml	UNSAT TT=0.006	UNSAT TT=0.663 CHECKS=0 NODES=2	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.009 CHECKS=18	UNSAT TT=0.382 ASSIGNMENTS=4	UNSAT TT=0.397 ASSIGNMENTS=4	UNSAT TT=0.015 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.017 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.006 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.007 ASSIGNMENTS=2 CHECKS=83	UNSAT TT=0.255	UNSAT TT=0.007 ASSIGNMENTS=5 CHECKS=122	UNSAT TT=0.007 ASSIGNMENTS=3 CHECKS=98	UNSAT TT=0.696	UNSAT TT=0.49	UNSAT TT=0.485
csp/latinSquare/ normalized-latinSquare-dg-4_all.xml	UNSAT TT=0.005	UNSAT TT=0.639 CHECKS=0 NODES=3	UNSAT TT=0.61 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.007 CHECKS=39	UNSAT TT=0.01 CHECKS=39	UNSAT TT=0.376 ASSIGNMENTS=0	UNSAT TT=0.368 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=9 CHECKS=364	UNSAT TT=0.019 ASSIGNMENTS=9 CHECKS=364	UNSAT TT=0.008 ASSIGNMENTS=9 CHECKS=366	UNSAT TT=0.006 ASSIGNMENTS=6 CHECKS=318	UNSAT TT=0.259	UNSAT TT=0.005 ASSIGNMENTS=18 CHECKS=637	UNSAT TT=0.006 ASSIGNMENTS=9 CHECKS=406	UNSAT TT=0.731	UNSAT TT=0.586	UNSAT TT=0.566
csp/latinSquare/ normalized-latinSquare-dg-5_all.xml	SAT TT=0.006	SAT TT=0.689 CHECKS=26 NODES=27	SAT TT=0.659 CHECKS=26 NODES=0	SAT TT=0.028	SAT TT=0.013 CHECKS=3279	SAT TT=0.012 CHECKS=1868	SAT TT=0.508 ASSIGNMENTS=6	SAT TT=0.575 ASSIGNMENTS=6	SAT TT=0.017 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.007 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.006 ASSIGNMENTS=5 CHECKS=533	SAT TT=0.265	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=5 CHECKS=540	SAT TT=0.712	SAT TT=0.673	SAT TT=0.667
csp/latinSquare/ normalized-latinSquare-dg-6_all.xml	UNSAT TT=0.014	UNSAT TT=0.94 CHECKS=157 NODES=196	UNSAT TT=0.815 CHECKS=210 NODES=206	UNSAT TT=0.165	UNSAT TT=0.021 CHECKS=1769	UNSAT TT=0.021 CHECKS=1871	UNSAT TT=0.868 ASSIGNMENTS=273	UNSAT TT=0.751 ASSIGNMENTS=100	UNSAT TT=0.039 ASSIGNMENTS=509 CHECKS=29628	UNSAT TT=0.041 ASSIGNMENTS=509 CHECKS=29628	UNSAT TT=0.029 ASSIGNMENTS=544 CHECKS=30025	UNSAT TT=0.014 ASSIGNMENTS=144 CHECKS=11200	UNSAT TT=0.301	UNSAT TT=0.045 ASSIGNMENTS=839 CHECKS=43235	UNSAT TT=0.04 ASSIGNMENTS=807 CHECKS=43223	UNSAT TT=1.273	UNSAT TT=0.827	UNSAT TT=0.82
csp/latinSquare/ normalized-latinSquare-dg-7_all.xml	SAT TT=0.009	SAT TT=0.78 CHECKS=74 NODES=53	SAT TT=0.835 CHECKS=74 NODES=57	SAT TT=0.034	SAT TT=0.03 CHECKS=3798	SAT TT=0.03 CHECKS=4097	SAT TT=0.724 ASSIGNMENTS=10	SAT TT=0.738 ASSIGNMENTS=10	SAT TT=0.02 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.01 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.009 ASSIGNMENTS=13 CHECKS=1769	SAT TT=0.303	SAT TT=0.014 ASSIGNMENTS=163 CHECKS=8394	SAT TT=0.011 ASSIGNMENTS=37 CHECKS=5463	SAT TT=0.87	SAT TT=1.057	SAT TT=0.884
csp/latinSquare/ normalized-latinSquare-dg-8_all.xml	UNSAT TT=1.039	UNSAT TT=673.617 CHECKS=52946900 NODES=7379320	UNSAT TT=670.173 CHECKS=64468400 NODES=8128950	? (TO) TT=1800.08	UNSAT TT=204.56 CHECKS=64493400	UNSAT TT=1223.9 CHECKS=486650000	? (TO) TT=1800.41	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=152.087	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	UNSAT TT=1.039	UNSAT TT=1.039
csp/latinSquare/ normalized-latinSquare-dg-9_all.xml	UNSAT TT=1.025	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.19	UNSAT TT=1.025	UNSAT TT=1.15
csp/magicSquare/ normalized-magicSquare-10_glb.xml	SAT TT=1.684	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=897.768	SAT TT=11.69 CHECKS=1031510	SAT TT=17.067 CHECKS=1505360	? (TO) TT=1800.1	SAT TT=27.619 ASSIGNMENTS=27069	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=1.684 ASSIGNMENTS=17786 CHECKS=2032110	? (TO) TT=1800.05	? TT=1.023	SAT TT=85.986	SAT TT=1469.4
csp/magicSquare/ normalized-magicSquare-11_glb.xml	SAT TT=11.823	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=902.69	SAT TT=11.823 CHECKS=634265	SAT TT=17.951 CHECKS=962199	? (TO) TT=1800.09	SAT TT=11.894 ASSIGNMENTS=7539	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=18.713 ASSIGNMENTS=190903 CHECKS=18299700	? (TO) TT=1800.06	? TT=1.03	? (MO) TT=79.22	? (MO) TT=287.98
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/magicSquare/ normalized-magicSquare-12_glb.xml	SAT TT=5.187	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=1127.58	SAT TT=13.175 CHECKS=551132	SAT TT=17.86 CHECKS=650219	? (TO) TT=1800.03	? (TO) TT=1800.12	SAT TT=177.024 ASSIGNMENTS=1374760 CHECKS=208353000	SAT TT=1039.5 ASSIGNMENTS=1374760 CHECKS=208353000	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=5.187 ASSIGNMENTS=37059 CHECKS=6716080	SAT TT=168.943 ASSIGNMENTS=1374760 CHECKS=208353000	? TT=1.036	? (MO) TT=143.12	? (MO) TT=349.53
csp/magicSquare/ normalized-magicSquare-13_glb.xml	SAT TT=2.879	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=949.141	SAT TT=2.879 CHECKS=182281	SAT TT=51.364 CHECKS=3103840	? (TO) TT=1800.12	SAT TT=436.179 ASSIGNMENTS=263294	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=459.794 ASSIGNMENTS=7304620 CHECKS=410981000	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=0.971	? TT=173.272	? TT=180.475
csp/magicSquare/ normalized-magicSquare-14_glb.xml	SAT TT=64.383	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=64.383 CHECKS=5363900	SAT TT=71.769 CHECKS=5967680	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? TT=1.013	? TT=181.403	? TT=180.054
csp/magicSquare/ normalized-magicSquare-15_glb.xml	SAT TT=8.089	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=8.639 CHECKS=328051	SAT TT=8.089 CHECKS=240652	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.1	? (problem) TT=0.444	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1.042	? TT=172.858	? TT=171.081
csp/magicSquare/ normalized-magicSquare-16_glb.xml	SAT TT=48.292	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=48.292 CHECKS=2420730	SAT TT=791.607 CHECKS=67704600	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (problem) TT=0.483	SAT TT=1422.89 ASSIGNMENTS=5194840 CHECKS=1569760000	? (TO) TT=1800.1	? TT=1.024	? TT=173.316	? TT=174.792
csp/magicSquare/ normalized-magicSquare-17_glb.xml	SAT TT=455.393	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	SAT TT=586.94 CHECKS=24257900	SAT TT=455.393 CHECKS=16141600	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (problem) TT=0.512	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=1.086	? TT=170.987	? TT=170.526
csp/magicSquare/ normalized-magicSquare-18_glb.xml	SAT TT=382.126	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=382.126 CHECKS=15470000	SAT TT=467.941 CHECKS=4933040	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=0.549	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=1.147	? TT=167.519	? TT=166.378
csp/magicSquare/ normalized-magicSquare-19_glb.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=0.444	? (TO) TT=1800.05	? (TO) TT=1800.07	? TT=1.105	? TT=171.233	? TT=166.991
csp/magicSquare/ normalized-magicSquare-20_glb.xml		? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=0.467	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=1.177	? TT=173.315	? TT=173.279
csp/magicSquare/ normalized-magicSquare-3_glb.xml	SAT TT=0.005	SAT TT=0.656 CHECKS=69 NODES=96	SAT TT=0.668 CHECKS=71 NODES=73	SAT TT=0.026	SAT TT=0.008 CHECKS=815	SAT TT=3.704 CHECKS=717	SAT TT=0.456 ASSIGNMENTS=3	SAT TT=0.541 ASSIGNMENTS=3	SAT TT=0.018 ASSIGNMENTS=8 CHECKS=252	SAT TT=0.018 ASSIGNMENTS=8 CHECKS=252	SAT TT=0.005 ASSIGNMENTS=8 CHECKS=254	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=148	SAT TT=0.25	SAT TT=0.006 ASSIGNMENTS=22 CHECKS=651	SAT TT=0.007 ASSIGNMENTS=8 CHECKS=252	? TT=0.675	SAT TT=0.541	SAT TT=0.631
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/magicSquare/ normalized-magicSquare-4_glb.xml	SAT TT=0.006	SAT TT=0.743 CHECKS=457 NODES=415	SAT TT=0.768 CHECKS=924 NODES=739	SAT TT=0.03	SAT TT=0.031 CHECKS=7052	SAT TT=0.014 CHECKS=1395	SAT TT=0.444 ASSIGNMENTS=9	SAT TT=0.497 ASSIGNMENTS=6	SAT TT=0.022 ASSIGNMENTS=47 CHECKS=3302	SAT TT=0.022 ASSIGNMENTS=47 CHECKS=3302	SAT TT=0.006 ASSIGNMENTS=32 CHECKS=2135	SAT TT=0.007 ASSIGNMENTS=33 CHECKS=1862	SAT TT=0.274	SAT TT=0.007 ASSIGNMENTS=109 CHECKS=3940	SAT TT=0.007 ASSIGNMENTS=49 CHECKS=3204	? TT=0.692	SAT TT=0.715	SAT TT=0.907
csp/magicSquare/ normalized-magicSquare-5_glb.xml	SAT TT=0.017	SAT TT=1.234 CHECKS=17551 NODES=8654	SAT TT=2.684 CHECKS=123515 NODES=36055	SAT TT=0.851	SAT TT=0.229 CHECKS=71461	SAT TT=0.228 CHECKS=71646	SAT TT=0.668 ASSIGNMENTS=64	SAT TT=0.632 ASSIGNMENTS=177	SAT TT=0.028 ASSIGNMENTS=233 CHECKS=18393	SAT TT=0.028 ASSIGNMENTS=233 CHECKS=18393	SAT TT=0.104 ASSIGNMENTS=2840 CHECKS=228577	SAT TT=0.106 ASSIGNMENTS=3550 CHECKS=211776	SAT TT=0.464	SAT TT=0.036 ASSIGNMENTS=1022 CHECKS=48130	SAT TT=0.017 ASSIGNMENTS=302 CHECKS=23965	? TT=0.676	SAT TT=1.892	SAT TT=3.019
csp/magicSquare/ normalized-magicSquare-6_glb.xml	SAT TT=0.08	SAT TT=1.693 CHECKS=37713 NODES=13992	SAT TT=1.786 CHECKS=39143 NODES=14132	SAT TT=1799.65	SAT TT=10.798 CHECKS=2761000	SAT TT=16.947 CHECKS=4038360	SAT TT=0.784 ASSIGNMENTS=460	SAT TT=0.727 ASSIGNMENTS=186	SAT TT=7.848 ASSIGNMENTS=6772 CHECKS=558799	SAT TT=7.323 ASSIGNMENTS=6772 CHECKS=558799	SAT TT=1.715 ASSIGNMENTS=58740 CHECKS=3127750	SAT TT=259.053 ASSIGNMENTS=6457830 CHECKS=548311000	? (TO) TT=1800.07	SAT TT=0.08 ASSIGNMENTS=2218 CHECKS=122183	SAT TT=0.299 ASSIGNMENTS=6772 CHECKS=558799	? TT=0.667	SAT TT=2.712	SAT TT=7.445
csp/magicSquare/ normalized-magicSquare-7_glb.xml	SAT TT=0.026	SAT TT=13.784 CHECKS=1117200 NODES=163190	? (TO) TT=1800.05	SAT TT=896.631	SAT TT=11.605 CHECKS=2095220	SAT TT=17.125 CHECKS=3084090	SAT TT=914.911 ASSIGNMENTS=1919250	SAT TT=1.319 ASSIGNMENTS=742	SAT TT=7.604 ASSIGNMENTS=314 CHECKS=32107	SAT TT=7.614 ASSIGNMENTS=314 CHECKS=32107	SAT TT=440.359 ASSIGNMENTS=11124100 CHECKS=808020000	? (TO) TT=1800.07	SAT TT=0.425	SAT TT=0.209 ASSIGNMENTS=4432 CHECKS=298159	SAT TT=0.026 ASSIGNMENTS=314 CHECKS=32107	? TT=0.719	SAT TT=7.195	SAT TT=26.429
csp/magicSquare/ normalized-magicSquare-8_glb.xml	SAT TT=2.543	SAT TT=3.42 CHECKS=296792 NODES=23997	SAT TT=3.665 CHECKS=296792 NODES=23997	SAT TT=898.005	SAT TT=11.76 CHECKS=1737520	SAT TT=17.584 CHECKS=2595040	SAT TT=18.988 ASSIGNMENTS=19284	SAT TT=2.603 ASSIGNMENTS=1986	SAT TT=14.198 ASSIGNMENTS=108600 CHECKS=10326200	SAT TT=14.623 ASSIGNMENTS=108600 CHECKS=10326200	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=2.543 ASSIGNMENTS=45148 CHECKS=3448070	SAT TT=6.275 ASSIGNMENTS=108600 CHECKS=10326200	? TT=0.839	SAT TT=26.021	SAT TT=56.141
csp/magicSquare/ normalized-magicSquare-9_glb.xml	SAT TT=0.065	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=893.426	SAT TT=10.648 CHECKS=1471050	SAT TT=17.296 CHECKS=2174290	? (TO) TT=1800.1	SAT TT=1.74 ASSIGNMENTS=183	SAT TT=0.11 ASSIGNMENTS=1423 CHECKS=125827	SAT TT=0.115 ASSIGNMENTS=1423 CHECKS=125827	SAT TT=0.065 ASSIGNMENTS=841 CHECKS=80394	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=1.397 ASSIGNMENTS=18986 CHECKS=1655010	SAT TT=261.797 ASSIGNMENTS=4336780 CHECKS=396504000	? TT=0.921	SAT TT=581.719	SAT TT=569.869
csp/nengfa/ normalized-protein.xml	SAT TT=5.622	SAT TT=1108.33 CHECKS=2555860000 NODES=1738100	SAT TT=552.514 CHECKS=1118470000 NODES=837562	SAT TT=1507.14	SAT TT=5.622 CHECKS=2550550	Signal TT=5.483	SAT TT=148.896 ASSIGNMENTS=138158	? (TO) TT=1800.08	SAT TT=172.737 ASSIGNMENTS=167071	SAT TT=1120.96 ASSIGNMENTS=1738100 CHECKS=2555860000	SAT TT=197.421 ASSIGNMENTS=1178800 CHECKS=342749000	SAT TT=764.168 ASSIGNMENTS=4415720 CHECKS=1306840000	? (problem) TT=0.883	? (TO) TT=1800.03	SAT TT=33.144 ASSIGNMENTS=136824 CHECKS=50246100	SAT TT=262.477	SAT TT=36.222	SAT TT=8.773
csp/nengfa/ normalized-queens2.xml	SAT TT=0.076	SAT TT=3.845 CHECKS=1210500 NODES=316	SAT TT=5.822 CHECKS=3646510 NODES=312	SAT TT=0.5	SAT TT=1.397 CHECKS=19976	SAT TT=0.93 CHECKS=23401	SAT TT=16.308 ASSIGNMENTS=1699	? (TO) TT=1800.15	SAT TT=0.095 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.088 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.083 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.155 ASSIGNMENTS=339 CHECKS=147796	? (TO) TT=1800.09	SAT TT=3.008 ASSIGNMENTS=9069 CHECKS=4885590	SAT TT=0.076 ASSIGNMENTS=93 CHECKS=58763	SAT TT=19.03	SAT TT=16.917	SAT TT=34.222
csp/nengfa/ normalized-sudoku368.xml	SAT TT=0.063	SAT TT=2.87 CHECKS=6477 NODES=4122	SAT TT=18.366 CHECKS=2733 NODES=3698	SAT TT=8.93	SAT TT=0.063 CHECKS=2477	SAT TT=0.083 CHECKS=5599	SAT TT=0.998 ASSIGNMENTS=1	SAT TT=0.935 ASSIGNMENTS=1	SAT TT=0.111 ASSIGNMENTS=302 CHECKS=123211	SAT TT=0.1 ASSIGNMENTS=302 CHECKS=123211	SAT TT=0.19 ASSIGNMENTS=1005 CHECKS=313177	SAT TT=0.546 ASSIGNMENTS=6217 CHECKS=994130	SAT TT=0.834	SAT TT=0.171 ASSIGNMENTS=1197 CHECKS=189375	SAT TT=0.104 ASSIGNMENTS=548 CHECKS=136533	SAT TT=2.834	SAT TT=3.828	SAT TT=4.161
csp/ortholatin/ normalized-ortholatin-10.xml		? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ortholatin/ normalized-ortholatin-15.xml		? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (exit code) TT=1.208	? (TO) TT=1800.08	? (TO) TT=1800.08	? (MO) TT=26.92	? (TO) TT=1800.19	? (TO) TT=1800.18
csp/ortholatin/ normalized-ortholatin-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (exit code) TT=2.503	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=112.215	? (MO) TT=150.63	? (MO) TT=364.24
csp/ortholatin/ normalized-ortholatin-2.xml	UNSAT TT=0.004	UNSAT TT=0.621 CHECKS=0 NODES=2	UNSAT TT=0.631 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.006 CHECKS=100	UNSAT TT=0.008 CHECKS=97	UNSAT TT=0.36 ASSIGNMENTS=0	UNSAT TT=0.412 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.017 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.004 ASSIGNMENTS=3 CHECKS=85	UNSAT TT=0.007 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.271	UNSAT TT=0.007 ASSIGNMENTS=8 CHECKS=165	UNSAT TT=0.006 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.676	UNSAT TT=0.48	UNSAT TT=0.498
csp/ortholatin/ normalized-ortholatin-5.xml	SAT TT=0.012	SAT TT=2.71 CHECKS=44580 NODES=21518	SAT TT=0.754 CHECKS=54 NODES=0	SAT TT=2.26	SAT TT=0.044 CHECKS=5086	SAT TT=0.044 CHECKS=4990	SAT TT=1.013 ASSIGNMENTS=17	SAT TT=0.975 ASSIGNMENTS=18	SAT TT=0.024 ASSIGNMENTS=31 CHECKS=3313	SAT TT=0.025 ASSIGNMENTS=31 CHECKS=3313	SAT TT=0.013 ASSIGNMENTS=29 CHECKS=3197	SAT TT=0.012 ASSIGNMENTS=13 CHECKS=1478	SAT TT=2.024	SAT TT=0.016 ASSIGNMENTS=105 CHECKS=5899	SAT TT=0.012 ASSIGNMENTS=29 CHECKS=2782	SAT TT=1.615	SAT TT=0.926	SAT TT=1.078
csp/ortholatin/ normalized-ortholatin-6.xml		? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ortholatin/ normalized-ortholatin-7.xml	SAT TT=0.289	SAT TT=82.141 CHECKS=1859340 NODES=612971	SAT TT=8.975 CHECKS=144365 NODES=63343	? (TO) TT=1800.1	SAT TT=138.026 CHECKS=30676600	SAT TT=20.929 CHECKS=6541080	? (TO) TT=1800.23	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=30.886 ASSIGNMENTS=158111 CHECKS=32314500	SAT TT=18.699 ASSIGNMENTS=93358 CHECKS=21578600	? (TO) TT=1800.1	SAT TT=270.375 ASSIGNMENTS=1151240 CHECKS=385743000	? (TO) TT=1800.09	SAT TT=383.197	SAT TT=54.156	SAT TT=456.542
csp/ortholatin/ normalized-ortholatin-8.xml	SAT TT=0.539	SAT TT=859.227 CHECKS=16877400 NODES=5667120	? (TO) TT=1800.15	SAT TT=65.375	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=286.404 ASSIGNMENTS=1431890 CHECKS=373770000	? (TO) TT=1800.06	SAT TT=0.539	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.21	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/ortholatin/ normalized-ortholatin-9.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.21	? (TO) TT=1800.1	? (TO) TT=1800.06
csp/pigeons_glb/ normalized-pigeons-10_ext.xml	UNSAT TT=0.004	UNSAT TT=0.614 CHECKS=0 NODES=0	UNSAT TT=0.58 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=10	UNSAT TT=0.007 CHECKS=10	UNSAT TT=0.298 ASSIGNMENTS=0	UNSAT TT=0.341 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.252	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=6.543	UNSAT TT=0.333	UNSAT TT=0.337
csp/pigeons_glb/ normalized-pigeons-11_ext.xml	UNSAT TT=0.006	UNSAT TT=0.608 CHECKS=0 NODES=0	UNSAT TT=0.591 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.006 CHECKS=11	UNSAT TT=0.006 CHECKS=11	UNSAT TT=0.333 ASSIGNMENTS=0	UNSAT TT=0.352 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.254	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=82.262	UNSAT TT=0.336	UNSAT TT=0.334
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons_glb/ normalized-pigeons-12_ext.xml	UNSAT TT=0.004	UNSAT TT=0.578 CHECKS=0 NODES=0	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.005 CHECKS=12	UNSAT TT=0.007 CHECKS=12	UNSAT TT=0.331 ASSIGNMENTS=0	UNSAT TT=0.36 ASSIGNMENTS=0	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.227	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=67	? (TO) TT=1800.14	UNSAT TT=0.356	UNSAT TT=0.335
csp/pigeons_glb/ normalized-pigeons-13_ext.xml	UNSAT TT=0.005	UNSAT TT=0.585 CHECKS=0 NODES=0	UNSAT TT=0.604 CHECKS=0 NODES=0	UNSAT TT=0.025	UNSAT TT=0.007 CHECKS=13	UNSAT TT=0.006 CHECKS=13	UNSAT TT=0.327 ASSIGNMENTS=0	UNSAT TT=0.336 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.238	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=79	? (TO) TT=1800.13	UNSAT TT=0.356	UNSAT TT=0.371
csp/pigeons_glb/ normalized-pigeons-14_ext.xml	UNSAT TT=0.004	UNSAT TT=0.575 CHECKS=0 NODES=0	UNSAT TT=0.581 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.005 CHECKS=14	UNSAT TT=0.007 CHECKS=14	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.339 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.244	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=92	? (TO) TT=1800.09	UNSAT TT=0.381	UNSAT TT=0.366
csp/pigeons_glb/ normalized-pigeons-15_ext.xml	UNSAT TT=0.005	UNSAT TT=0.574 CHECKS=0 NODES=0	UNSAT TT=0.594 CHECKS=0 NODES=0	UNSAT TT=0.028	UNSAT TT=0.008 CHECKS=15	UNSAT TT=0.008 CHECKS=15	UNSAT TT=0.306 ASSIGNMENTS=0	UNSAT TT=0.315 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.239	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=106	? (TO) TT=1800.14	UNSAT TT=0.392	UNSAT TT=0.405
csp/pigeons_glb/ normalized-pigeons-18_ext.xml	UNSAT TT=0.006	UNSAT TT=0.593 CHECKS=0 NODES=0	UNSAT TT=0.623 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=18	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.305 ASSIGNMENTS=0	UNSAT TT=0.357 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.23	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=154	? (TO) TT=1800.13	UNSAT TT=0.419	UNSAT TT=0.414
csp/pigeons_glb/ normalized-pigeons-20_ext.xml	UNSAT TT=0.005	UNSAT TT=0.622 CHECKS=0 NODES=0	UNSAT TT=0.602 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=20	UNSAT TT=0.007 CHECKS=20	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.332 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.243	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=191	? (TO) TT=1800.11	UNSAT TT=0.397	UNSAT TT=0.397
csp/pigeons_glb/ normalized-pigeons-25_ext.xml	UNSAT TT=0.005	UNSAT TT=0.662 CHECKS=0 NODES=0	UNSAT TT=0.634 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.006 CHECKS=25	UNSAT TT=0.006 CHECKS=25	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.318 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.245	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=301	? (TO) TT=1800.6	UNSAT TT=0.568	UNSAT TT=0.484
csp/pigeons_glb/ normalized-pigeons-30_ext.xml	UNSAT TT=0.006	UNSAT TT=0.623 CHECKS=0 NODES=0	UNSAT TT=0.641 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.007 CHECKS=30	UNSAT TT=0.007 CHECKS=30	UNSAT TT=0.332 ASSIGNMENTS=0	UNSAT TT=0.347 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.257	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=436	? (TO) TT=1800.14	UNSAT TT=0.512	UNSAT TT=0.513
csp/pigeons_glb/ normalized-pigeons-35_ext.xml	UNSAT TT=0.006	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.644 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.007 CHECKS=35	UNSAT TT=0.009 CHECKS=35	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.353 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.235	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=596	? (TO) TT=1800.2	UNSAT TT=0.524	UNSAT TT=0.529
csp/pigeons_glb/ normalized-pigeons-40_ext.xml	UNSAT TT=0.006	UNSAT TT=0.633 CHECKS=0 NODES=0	UNSAT TT=0.671 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.006 CHECKS=40	UNSAT TT=0.009 CHECKS=40	UNSAT TT=0.336 ASSIGNMENTS=0	UNSAT TT=0.329 ASSIGNMENTS=0	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.246	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=781	? (TO) TT=1800.11	UNSAT TT=0.544	UNSAT TT=0.555
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons_glb/ normalized-pigeons-45_ext.xml	UNSAT TT=0.006	UNSAT TT=0.673 CHECKS=0 NODES=0	UNSAT TT=0.641 CHECKS=0 NODES=0	UNSAT TT=0.025	UNSAT TT=0.009 CHECKS=45	UNSAT TT=0.006 CHECKS=45	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.337 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.247	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=991	? (TO) TT=1800.23	UNSAT TT=0.524	UNSAT TT=0.73
csp/pigeons_glb/ normalized-pigeons-50_ext.xml	UNSAT TT=0.007	UNSAT TT=0.64 CHECKS=0 NODES=0	UNSAT TT=0.633 CHECKS=0 NODES=0	UNSAT TT=0.028	UNSAT TT=0.009 CHECKS=50	UNSAT TT=0.007 CHECKS=50	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.362 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.258	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1226	? (TO) TT=1800.14	UNSAT TT=0.598	UNSAT TT=0.583
csp/pigeons_glb/ normalized-pigeons-5_ext.xml	UNSAT TT=0.004	UNSAT TT=0.582 CHECKS=0 NODES=0	UNSAT TT=0.587 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.006 CHECKS=5	UNSAT TT=0.006 CHECKS=5	UNSAT TT=0.327 ASSIGNMENTS=0	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.24	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.674	UNSAT TT=0.316	UNSAT TT=0.313
csp/pigeons_glb/ normalized-pigeons-6_ext.xml	UNSAT TT=0.004	UNSAT TT=0.566 CHECKS=0 NODES=0	UNSAT TT=0.686 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=6	UNSAT TT=0.007 CHECKS=6	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.25	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.704	UNSAT TT=0.309	UNSAT TT=0.307
csp/pigeons_glb/ normalized-pigeons-7_ext.xml	UNSAT TT=0.006	UNSAT TT=0.579 CHECKS=0 NODES=0	UNSAT TT=0.604 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.007 CHECKS=7	UNSAT TT=0.006 CHECKS=7	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.3 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.239	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=1.026	UNSAT TT=0.315	UNSAT TT=0.315
csp/pigeons_glb/ normalized-pigeons-8_ext.xml	UNSAT TT=0.005	UNSAT TT=0.588 CHECKS=0 NODES=0	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=8	UNSAT TT=0.006 CHECKS=8	UNSAT TT=0.349 ASSIGNMENTS=0	UNSAT TT=0.302 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.248	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=1.377	UNSAT TT=0.322	UNSAT TT=0.321
csp/pigeons_glb/ normalized-pigeons-9_ext.xml	UNSAT TT=0.005	UNSAT TT=0.606 CHECKS=0 NODES=0	UNSAT TT=0.59 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.006 CHECKS=9	UNSAT TT=0.007 CHECKS=9	UNSAT TT=0.311 ASSIGNMENTS=0	UNSAT TT=0.305 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.235	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=1.729	UNSAT TT=0.323	UNSAT TT=0.338
csp/QG3/ normalized-quasigroup3-10.xml		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=5.106	? (TO) TT=1800.04	? (TO) TT=1800.08
csp/QG3/ normalized-quasigroup3-4.xml	SAT TT=0.008	SAT TT=0.935 CHECKS=931 NODES=52	SAT TT=0.915 CHECKS=931 NODES=0	SAT TT=0.04	SAT TT=0.027 CHECKS=2637	SAT TT=0.043 CHECKS=18113	SAT TT=0.748 ASSIGNMENTS=7	SAT TT=0.715 ASSIGNMENTS=7	SAT TT=0.021 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.023 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.009 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.008 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.426	SAT TT=0.01 ASSIGNMENTS=6 CHECKS=422	SAT TT=0.01 ASSIGNMENTS=6 CHECKS=421	? TT=1.083	SAT TT=0.859	SAT TT=0.853
csp/QG3/ normalized-quasigroup3-5.xml	UNSAT TT=0.018	UNSAT TT=1.276 CHECKS=5073 NODES=61	UNSAT TT=1.255 CHECKS=13136 NODES=77	UNSAT TT=0.055	UNSAT TT=0.069 CHECKS=11966	UNSAT TT=0.204 CHECKS=107584	UNSAT TT=1.068 ASSIGNMENTS=10	UNSAT TT=1.006 ASSIGNMENTS=7	UNSAT TT=0.03 ASSIGNMENTS=11 CHECKS=4225	UNSAT TT=0.028 ASSIGNMENTS=11 CHECKS=4225	UNSAT TT=0.019 ASSIGNMENTS=11 CHECKS=4225	UNSAT TT=0.02 ASSIGNMENTS=17 CHECKS=5883	UNSAT TT=0.624	UNSAT TT=0.063 ASSIGNMENTS=248 CHECKS=43106	UNSAT TT=0.018 ASSIGNMENTS=11 CHECKS=4679	? TT=2.086	UNSAT TT=1.024	UNSAT TT=1.025
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG3/ normalized-quasigroup3-6.xml	UNSAT TT=0.1	UNSAT TT=1.729 CHECKS=86757 NODES=391	UNSAT TT=1.721 CHECKS=121801 NODES=378	UNSAT TT=0.1	UNSAT TT=0.188 CHECKS=51941	UNSAT TT=0.739 CHECKS=351466	UNSAT TT=1.7 ASSIGNMENTS=65	UNSAT TT=1.772 ASSIGNMENTS=55	UNSAT TT=0.287 ASSIGNMENTS=110 CHECKS=184050	UNSAT TT=0.284 ASSIGNMENTS=110 CHECKS=184050	UNSAT TT=0.263 ASSIGNMENTS=111 CHECKS=180068	UNSAT TT=4.593 ASSIGNMENTS=3313 CHECKS=3379770	UNSAT TT=0.671	UNSAT TT=0.479 ASSIGNMENTS=1211 CHECKS=323915	UNSAT TT=0.272 ASSIGNMENTS=116 CHECKS=187532	? TT=2.181	UNSAT TT=1.187	UNSAT TT=1.256
csp/QG3/ normalized-quasigroup3-7.xml	UNSAT TT=1.629	UNSAT TT=20.31 CHECKS=5959460 NODES=11794	UNSAT TT=21.647 CHECKS=6040920 NODES=11994	UNSAT TT=1.84	UNSAT TT=11.337 CHECKS=5669460	UNSAT TT=47.321 CHECKS=17606000	UNSAT TT=38.94 ASSIGNMENTS=16863	UNSAT TT=12.749 ASSIGNMENTS=1840	UNSAT TT=48.031 ASSIGNMENTS=16863	UNSAT TT=26.221 ASSIGNMENTS=11794 CHECKS=5959460	UNSAT TT=15.818 ASSIGNMENTS=3860 CHECKS=9407950	UNSAT TT=26.496 ASSIGNMENTS=7003 CHECKS=14262900	UNSAT TT=1.629	UNSAT TT=35.98 ASSIGNMENTS=11059 CHECKS=21893200	UNSAT TT=30.446 ASSIGNMENTS=6442 CHECKS=16157500	? TT=2.767	UNSAT TT=2.715	UNSAT TT=3.933
csp/QG3/ normalized-quasigroup3-8.xml	SAT TT=0.173	SAT TT=2.382 CHECKS=97097 NODES=204	SAT TT=2.34 CHECKS=131721 NODES=0	SAT TT=0.186	SAT TT=0.474 CHECKS=62420	SAT TT=4.113 CHECKS=1385220	SAT TT=14.493 ASSIGNMENTS=21	SAT TT=17.51 ASSIGNMENTS=337	SAT TT=0.272 ASSIGNMENTS=34 CHECKS=78749	SAT TT=0.27 ASSIGNMENTS=34 CHECKS=78749	SAT TT=0.248 ASSIGNMENTS=32 CHECKS=73157	SAT TT=1.856 ASSIGNMENTS=323 CHECKS=693851	SAT TT=0.843	SAT TT=0.173 ASSIGNMENTS=31 CHECKS=41196	SAT TT=0.204 ASSIGNMENTS=29 CHECKS=57766	? TT=3.076	SAT TT=1.76	SAT TT=2.057
csp/QG3/ normalized-quasigroup3-9.xml		? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? TT=3.634	? (TO) TT=1800.1	? (TO) TT=1800.08
csp/QG4/ normalized-quasigroup4-10.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=5.373	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/QG4/ normalized-quasigroup4-4.xml	UNSAT TT=0.009	UNSAT TT=0.935 CHECKS=575 NODES=24	UNSAT TT=0.917 CHECKS=634 NODES=0	UNSAT TT=0.039	UNSAT TT=0.024 CHECKS=243	UNSAT TT=0.013 CHECKS=195	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.552 ASSIGNMENTS=0	UNSAT TT=0.021 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.022 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.01 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.009 ASSIGNMENTS=1 CHECKS=225	UNSAT TT=0.423	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=248	UNSAT TT=0.009 ASSIGNMENTS=1 CHECKS=228	? TT=1.023	UNSAT TT=0.774	UNSAT TT=0.824
csp/QG4/ normalized-quasigroup4-5.xml	SAT TT=0.015	SAT TT=1.09 CHECKS=3891 NODES=80	SAT TT=1.081 CHECKS=3891 NODES=0	SAT TT=0.052	SAT TT=0.071 CHECKS=14332	SAT TT=0.227 CHECKS=117272	SAT TT=1.043 ASSIGNMENTS=9	SAT TT=1.082 ASSIGNMENTS=9	SAT TT=0.026 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.026 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.015 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.015 ASSIGNMENTS=8 CHECKS=1304	SAT TT=0.567	SAT TT=0.015 ASSIGNMENTS=9 CHECKS=1539	SAT TT=0.017 ASSIGNMENTS=9 CHECKS=1510	? TT=1.895	SAT TT=0.993	SAT TT=1.385
csp/QG4/ normalized-quasigroup4-6.xml	UNSAT TT=0.09	UNSAT TT=1.628 CHECKS=74127 NODES=474	UNSAT TT=1.782 CHECKS=115495 NODES=479	UNSAT TT=0.09	UNSAT TT=0.177 CHECKS=51985	UNSAT TT=0.894 CHECKS=435550	UNSAT TT=1.678 ASSIGNMENTS=78	UNSAT TT=1.818 ASSIGNMENTS=13	UNSAT TT=0.243 ASSIGNMENTS=103 CHECKS=151422	UNSAT TT=0.244 ASSIGNMENTS=103 CHECKS=151422	UNSAT TT=0.184 ASSIGNMENTS=86 CHECKS=125982	UNSAT TT=4.515 ASSIGNMENTS=3287 CHECKS=3304680	UNSAT TT=0.73	UNSAT TT=0.414 ASSIGNMENTS=1225 CHECKS=293527	UNSAT TT=0.197 ASSIGNMENTS=92 CHECKS=142255	? TT=2.174	UNSAT TT=1.188	UNSAT TT=1.209
csp/QG4/ normalized-quasigroup4-7.xml	UNSAT TT=1.592	UNSAT TT=21.671 CHECKS=6631310 NODES=11540	UNSAT TT=22.462 CHECKS=6733580 NODES=11401	UNSAT TT=1.592	UNSAT TT=8.21 CHECKS=4156480	UNSAT TT=14.963 CHECKS=5903740	UNSAT TT=27.817 ASSIGNMENTS=11662	UNSAT TT=12.702 ASSIGNMENTS=1468	UNSAT TT=37.731 ASSIGNMENTS=11662	UNSAT TT=27.886 ASSIGNMENTS=11540 CHECKS=6631310	UNSAT TT=12.358 ASSIGNMENTS=2566 CHECKS=7146310	UNSAT TT=22.913 ASSIGNMENTS=5995 CHECKS=12494500	UNSAT TT=1.615	UNSAT TT=32.683 ASSIGNMENTS=9366 CHECKS=17913200	UNSAT TT=23.685 ASSIGNMENTS=4573 CHECKS=12545300	? TT=2.597	UNSAT TT=2.428	UNSAT TT=3.248
csp/QG4/ normalized-quasigroup4-8.xml	UNSAT TT=80.369	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=174.359	UNSAT TT=546.984 CHECKS=199542000	UNSAT TT=596.926 CHECKS=195226000	? (TO) TT=1800.08	UNSAT TT=960.435 ASSIGNMENTS=131442	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=80.369	? (TO) TT=1800.08	? (TO) TT=1800.01	? TT=2.848	UNSAT TT=255.381	UNSAT TT=428.914
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG4/ normalized-quasigroup4-9.xml	SAT TT=1.109	SAT TT=4.232 CHECKS=742527 NODES=1356	SAT TT=7.008 CHECKS=1758840 NODES=2478	SAT TT=1.243	SAT TT=1.109 CHECKS=189474	SAT TT=3.75 CHECKS=965080	SAT TT=48.036 ASSIGNMENTS=274	SAT TT=59.524 ASSIGNMENTS=2028	SAT TT=59.892 ASSIGNMENTS=274	SAT TT=11.092 ASSIGNMENTS=1356 CHECKS=742519	SAT TT=5.916 ASSIGNMENTS=369 CHECKS=1901520	SAT TT=5.788 ASSIGNMENTS=607 CHECKS=1806810	SAT TT=14.224	SAT TT=24.939 ASSIGNMENTS=3220 CHECKS=6093680	SAT TT=7.969 ASSIGNMENTS=541 CHECKS=2572430	? TT=3.508	SAT TT=2.311	SAT TT=3.034
csp/QG5/ normalized-quasigroup5-10.xml	UNSAT TT=428.683	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=428.683	UNSAT TT=556.808 CHECKS=580615000	UNSAT TT=558.73 CHECKS=597323000	? (TO) TT=1800.11	? (TO) TT=1800.12	UNSAT TT=819.995 ASSIGNMENTS=852548 CHECKS=1142100000	? (TO) TT=1800.06	UNSAT TT=534.935 ASSIGNMENTS=610415 CHECKS=809770000	UNSAT TT=695.74 ASSIGNMENTS=798993 CHECKS=1058240000	UNSAT TT=904.463	? (TO) TT=1800.02	UNSAT TT=812.386 ASSIGNMENTS=852548 CHECKS=1142100000	? TT=1.072	UNSAT TT=1540.36	? (TO) TT=1800.07
csp/QG5/ normalized-quasigroup5-4.xml	UNSAT TT=0.007	UNSAT TT=0.871 CHECKS=137 NODES=3	UNSAT TT=0.777 CHECKS=148 NODES=0	UNSAT TT=0.033	UNSAT TT=0.009 CHECKS=145	UNSAT TT=0.008 CHECKS=145	UNSAT TT=0.418 ASSIGNMENTS=0	UNSAT TT=0.428 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.019 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=159	UNSAT TT=0.336	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=146	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=155	? TT=0.683	UNSAT TT=0.7	UNSAT TT=0.77
csp/QG5/ normalized-quasigroup5-5.xml	SAT TT=0.01	SAT TT=0.92 CHECKS=997 NODES=65	SAT TT=0.89 CHECKS=949 NODES=0	SAT TT=0.039	SAT TT=0.017 CHECKS=10996	SAT TT=0.019 CHECKS=12609	SAT TT=0.625 ASSIGNMENTS=3	SAT TT=0.728 ASSIGNMENTS=3	SAT TT=0.021 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.021 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.01 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.014 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.329	SAT TT=0.012 ASSIGNMENTS=2 CHECKS=669	SAT TT=0.011 ASSIGNMENTS=2 CHECKS=665	? TT=0.723	SAT TT=1.066	SAT TT=0.886
csp/QG5/ normalized-quasigroup5-6.xml	UNSAT TT=0.014	UNSAT TT=1.189 CHECKS=16514 NODES=230	UNSAT TT=1.254 CHECKS=29587 NODES=160	UNSAT TT=0.049	UNSAT TT=0.021 CHECKS=11918	UNSAT TT=0.024 CHECKS=13460	UNSAT TT=0.695 ASSIGNMENTS=26	UNSAT TT=0.795 ASSIGNMENTS=27	UNSAT TT=0.024 ASSIGNMENTS=18 CHECKS=6437	UNSAT TT=0.025 ASSIGNMENTS=18 CHECKS=6437	UNSAT TT=0.014 ASSIGNMENTS=11 CHECKS=5420	UNSAT TT=0.023 ASSIGNMENTS=114 CHECKS=19126	UNSAT TT=0.359	UNSAT TT=0.022 ASSIGNMENTS=117 CHECKS=21780	UNSAT TT=0.015 ASSIGNMENTS=15 CHECKS=5521	? TT=0.728	UNSAT TT=0.941	UNSAT TT=1.026
csp/QG5/ normalized-quasigroup5-7.xml	SAT TT=0.014	SAT TT=1.167 CHECKS=4504 NODES=134	SAT TT=1.292 CHECKS=10632 NODES=0	SAT TT=0.053	SAT TT=0.03 CHECKS=17557	SAT TT=0.033 CHECKS=21233	SAT TT=0.966 ASSIGNMENTS=11	SAT TT=0.941 ASSIGNMENTS=25	SAT TT=0.027 ASSIGNMENTS=5 CHECKS=2638	SAT TT=0.029 ASSIGNMENTS=5 CHECKS=2638	SAT TT=0.014 ASSIGNMENTS=5 CHECKS=2600	SAT TT=0.02 ASSIGNMENTS=40 CHECKS=9649	SAT TT=0.423	SAT TT=0.016 ASSIGNMENTS=5 CHECKS=2513	SAT TT=0.014 ASSIGNMENTS=5 CHECKS=2467	? TT=0.763	SAT TT=1.139	SAT TT=1.209
csp/QG5/ normalized-quasigroup5-8.xml	SAT TT=0.022	SAT TT=1.394 CHECKS=14155 NODES=195	SAT TT=1.443 CHECKS=40037 NODES=178	SAT TT=0.069	SAT TT=0.042 CHECKS=25994	SAT TT=0.038 CHECKS=24625	SAT TT=1.148 ASSIGNMENTS=7	SAT TT=1.198 ASSIGNMENTS=13	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=8184	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=8184	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=8309	SAT TT=0.033 ASSIGNMENTS=77 CHECKS=25405	SAT TT=0.467	SAT TT=0.047 ASSIGNMENTS=128 CHECKS=44830	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=8296	? TT=0.861	SAT TT=1.315	SAT TT=1.45
csp/QG5/ normalized-quasigroup5-9.xml	UNSAT TT=18.436	UNSAT TT=223.091 CHECKS=104450000 NODES=194026	UNSAT TT=223.673 CHECKS=103436000 NODES=190373	UNSAT TT=24.881	UNSAT TT=96.998 CHECKS=101948000	UNSAT TT=92.98 CHECKS=100180000	UNSAT TT=474.216 ASSIGNMENTS=228263	? (TO) TT=1800.11	UNSAT TT=45.24 ASSIGNMENTS=68668 CHECKS=59099100	UNSAT TT=221.612 ASSIGNMENTS=194026 CHECKS=104450000	UNSAT TT=32.938 ASSIGNMENTS=53300 CHECKS=48317400	UNSAT TT=27.848 ASSIGNMENTS=50268 CHECKS=41181500	UNSAT TT=18.436	UNSAT TT=242.042 ASSIGNMENTS=494541 CHECKS=334791000	UNSAT TT=39.84 ASSIGNMENTS=68668 CHECKS=59099100	? TT=1.035	UNSAT TT=39.34	UNSAT TT=43.706
csp/QG6/ normalized-quasigroup6-10.xml		? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=2.935	? (TO) TT=1800.07	? (TO) TT=1800.13
csp/QG6/ normalized-quasigroup6-4.xml	SAT TT=0.012	SAT TT=1.061 CHECKS=1427 NODES=78	SAT TT=1.034 CHECKS=1427 NODES=0	SAT TT=0.046	SAT TT=0.094 CHECKS=63383	SAT TT=0.084 CHECKS=61381	SAT TT=0.801 ASSIGNMENTS=21	SAT TT=0.877 ASSIGNMENTS=21	SAT TT=0.025 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.027 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.501	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	SAT TT=0.012 ASSIGNMENTS=20 CHECKS=714	? TT=0.975	SAT TT=1.182	SAT TT=0.957
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG6/ normalized-quasigroup6-5.xml	UNSAT TT=0.025	UNSAT TT=1.373 CHECKS=3618 NODES=15	UNSAT TT=1.798 CHECKS=105671 NODES=15	UNSAT TT=0.067	UNSAT TT=0.171 CHECKS=146574	UNSAT TT=0.168 CHECKS=165545	UNSAT TT=1.163 ASSIGNMENTS=4	UNSAT TT=1.053 ASSIGNMENTS=4	UNSAT TT=0.037 ASSIGNMENTS=15 CHECKS=6889	UNSAT TT=0.036 ASSIGNMENTS=15 CHECKS=6889	UNSAT TT=0.026 ASSIGNMENTS=15 CHECKS=6889	UNSAT TT=0.081 ASSIGNMENTS=268 CHECKS=54640	UNSAT TT=0.504	UNSAT TT=0.063 ASSIGNMENTS=394 CHECKS=40427	UNSAT TT=0.025 ASSIGNMENTS=14 CHECKS=6311	? TT=1.208	UNSAT TT=1.241	UNSAT TT=1.103
csp/QG6/ normalized-quasigroup6-6.xml	UNSAT TT=0.129	UNSAT TT=1.794 CHECKS=32584 NODES=91	UNSAT TT=3.264 CHECKS=396830 NODES=63	UNSAT TT=0.129	UNSAT TT=0.49 CHECKS=448923	UNSAT TT=0.555 CHECKS=521332	UNSAT TT=1.653 ASSIGNMENTS=17	UNSAT TT=1.596 ASSIGNMENTS=19	UNSAT TT=0.228 ASSIGNMENTS=117 CHECKS=112842	UNSAT TT=0.228 ASSIGNMENTS=117 CHECKS=112842	UNSAT TT=0.215 ASSIGNMENTS=133 CHECKS=126870	UNSAT TT=2.095 ASSIGNMENTS=3990 CHECKS=1393080	UNSAT TT=0.646	UNSAT TT=0.349 ASSIGNMENTS=728 CHECKS=193249	UNSAT TT=0.157 ASSIGNMENTS=76 CHECKS=79036	? TT=1.468	UNSAT TT=1.27	UNSAT TT=1.448
csp/QG6/ normalized-quasigroup6-7.xml	UNSAT TT=1.009	UNSAT TT=4.272 CHECKS=747685 NODES=1037	UNSAT TT=7.902 CHECKS=1680190 NODES=1056	UNSAT TT=1.297	UNSAT TT=1.596 CHECKS=1259190	UNSAT TT=2.437 CHECKS=1634510	UNSAT TT=3.219 ASSIGNMENTS=126	UNSAT TT=4.304 ASSIGNMENTS=425	UNSAT TT=10.824 ASSIGNMENTS=126	UNSAT TT=10.948 ASSIGNMENTS=1037 CHECKS=747685	UNSAT TT=2.542 ASSIGNMENTS=548 CHECKS=1171260	UNSAT TT=6.614 ASSIGNMENTS=4898 CHECKS=3360220	UNSAT TT=1.009	UNSAT TT=11.228 ASSIGNMENTS=4870 CHECKS=5660160	UNSAT TT=2.711 ASSIGNMENTS=517 CHECKS=1252570	? TT=1.927	UNSAT TT=1.892	UNSAT TT=2.081
csp/QG6/ normalized-quasigroup6-8.xml	SAT TT=0.173	SAT TT=3.733 CHECKS=47715 NODES=319	SAT TT=3.628 CHECKS=99204 NODES=0	SAT TT=4.122	SAT TT=2.058 CHECKS=1745820	SAT TT=3.073 CHECKS=2541230	SAT TT=5.416 ASSIGNMENTS=78	SAT TT=6.562 ASSIGNMENTS=230	SAT TT=0.2 ASSIGNMENTS=82 CHECKS=33392	SAT TT=0.197 ASSIGNMENTS=82 CHECKS=33392	SAT TT=0.173 ASSIGNMENTS=82 CHECKS=33392	SAT TT=2.921 ASSIGNMENTS=1557 CHECKS=1018100	SAT TT=0.924	SAT TT=4.146 ASSIGNMENTS=2073 CHECKS=1407610	SAT TT=0.185 ASSIGNMENTS=82 CHECKS=33011	? TT=2.258	SAT TT=2.377	SAT TT=2.635
csp/QG6/ normalized-quasigroup6-9.xml	SAT TT=1.424	SAT TT=7.079 CHECKS=702659 NODES=1069	SAT TT=8.419 CHECKS=898749 NODES=972	SAT TT=2.218	SAT TT=5.398 CHECKS=3735240	SAT TT=4.064 CHECKS=2046270	SAT TT=14.623 ASSIGNMENTS=144	SAT TT=14.573 ASSIGNMENTS=251	SAT TT=20.622 ASSIGNMENTS=144	SAT TT=13.395 ASSIGNMENTS=1069 CHECKS=702573	SAT TT=2.277 ASSIGNMENTS=271 CHECKS=635055	SAT TT=17.812 ASSIGNMENTS=5790 CHECKS=5254200	SAT TT=1.424	SAT TT=6.76 ASSIGNMENTS=2165 CHECKS=1747570	SAT TT=4.356 ASSIGNMENTS=406 CHECKS=1245850	? TT=2.469	SAT TT=2.802	SAT TT=4.38
csp/QG7/ normalized-quasigroup7-10.xml		? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=3.349	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/QG7/ normalized-quasigroup7-4.xml	UNSAT TT=0.011	UNSAT TT=1.047 CHECKS=859 NODES=8	UNSAT TT=1.037 CHECKS=1108 NODES=0	UNSAT TT=0.046	UNSAT TT=0.024 CHECKS=320	UNSAT TT=0.016 CHECKS=260	UNSAT TT=0.634 ASSIGNMENTS=0	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.024 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.023 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.014 ASSIGNMENTS=1 CHECKS=521	UNSAT TT=0.418	UNSAT TT=0.012 ASSIGNMENTS=1 CHECKS=450	UNSAT TT=0.012 ASSIGNMENTS=1 CHECKS=416	? TT=0.992	UNSAT TT=0.904	UNSAT TT=0.932
csp/QG7/ normalized-quasigroup7-5.xml	SAT TT=0.02	SAT TT=1.391 CHECKS=4219 NODES=123	SAT TT=1.433 CHECKS=4320 NODES=0	SAT TT=0.071	SAT TT=0.148 CHECKS=120618	SAT TT=0.173 CHECKS=168127	SAT TT=1.079 ASSIGNMENTS=32	SAT TT=1.053 ASSIGNMENTS=33	SAT TT=0.035 ASSIGNMENTS=32 CHECKS=2451	SAT TT=0.033 ASSIGNMENTS=32 CHECKS=2451	SAT TT=0.022 ASSIGNMENTS=32 CHECKS=2451	SAT TT=0.02 ASSIGNMENTS=39 CHECKS=3059	SAT TT=0.519	SAT TT=0.026 ASSIGNMENTS=42 CHECKS=4573	SAT TT=0.02 ASSIGNMENTS=32 CHECKS=2503	? TT=1.204	SAT TT=1.132	SAT TT=1.134
csp/QG7/ normalized-quasigroup7-6.xml	UNSAT TT=0.168	UNSAT TT=2.126 CHECKS=140424 NODES=283	UNSAT TT=2.993 CHECKS=330659 NODES=221	UNSAT TT=0.168	UNSAT TT=0.486 CHECKS=453180	UNSAT TT=0.546 CHECKS=534519	UNSAT TT=1.49 ASSIGNMENTS=53	UNSAT TT=1.641 ASSIGNMENTS=53	UNSAT TT=0.587 ASSIGNMENTS=338 CHECKS=358238	UNSAT TT=0.584 ASSIGNMENTS=338 CHECKS=358238	UNSAT TT=0.582 ASSIGNMENTS=332 CHECKS=353997	UNSAT TT=2.858 ASSIGNMENTS=4065 CHECKS=1927990	UNSAT TT=0.685	UNSAT TT=0.728 ASSIGNMENTS=971 CHECKS=444615	UNSAT TT=0.534 ASSIGNMENTS=321 CHECKS=337506	? TT=1.562	UNSAT TT=1.452	UNSAT TT=1.43
csp/QG7/ normalized-quasigroup7-7.xml	UNSAT TT=1.879	UNSAT TT=21.802 CHECKS=6966120 NODES=9446	UNSAT TT=17.858 CHECKS=5845890 NODES=6911	UNSAT TT=11.377	UNSAT TT=5.998 CHECKS=3939430	UNSAT TT=6.423 CHECKS=4421760	UNSAT TT=15.216 ASSIGNMENTS=2308	UNSAT TT=9.023 ASSIGNMENTS=1554	UNSAT TT=22.935 ASSIGNMENTS=2308	UNSAT TT=27.487 ASSIGNMENTS=9446 CHECKS=6966120	UNSAT TT=33.961 ASSIGNMENTS=11663 CHECKS=16257400	UNSAT TT=21.009 ASSIGNMENTS=9769 CHECKS=10805900	UNSAT TT=1.879	UNSAT TT=54.825 ASSIGNMENTS=20553 CHECKS=27894900	UNSAT TT=72.549 ASSIGNMENTS=25219 CHECKS=36993900	? TT=1.899	UNSAT TT=2.259	UNSAT TT=2.441
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QG7/ normalized-quasigroup7-8.xml	UNSAT TT=12.221	UNSAT TT=665.958 CHECKS=246908000 NODES=165416	UNSAT TT=672.818 CHECKS=234073000 NODES=156268	? (TO) TT=1800.05	UNSAT TT=164.049 CHECKS=100064000	UNSAT TT=131.626 CHECKS=70476900	UNSAT TT=654.383 ASSIGNMENTS=92715	UNSAT TT=427.621 ASSIGNMENTS=68209	UNSAT TT=667.801 ASSIGNMENTS=92715	UNSAT TT=664.561 ASSIGNMENTS=165416 CHECKS=246908000	? (TO) TT=1800.09	UNSAT TT=1398 ASSIGNMENTS=277514 CHECKS=529825000	UNSAT TT=60.021	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=2.25	UNSAT TT=16.992	UNSAT TT=12.221
csp/QG7/ normalized-quasigroup7-9.xml	SAT TT=1.766	SAT TT=7.916 CHECKS=827627 NODES=1330	SAT TT=13.958 CHECKS=1724580 NODES=0	SAT TT=93.414	SAT TT=10.113 CHECKS=5948000	SAT TT=6.519 CHECKS=2976410	SAT TT=14.252 ASSIGNMENTS=188	SAT TT=22.318 ASSIGNMENTS=1090	SAT TT=20.696 ASSIGNMENTS=188	SAT TT=14.847 ASSIGNMENTS=1330 CHECKS=827541	SAT TT=60.442 ASSIGNMENTS=6994 CHECKS=18042500	SAT TT=113.202 ASSIGNMENTS=16884 CHECKS=34009700	SAT TT=1.766	SAT TT=79.039 ASSIGNMENTS=12198 CHECKS=23084000	SAT TT=62.291 ASSIGNMENTS=7073 CHECKS=18262700	? TT=2.513	SAT TT=3.181	SAT TT=4.413

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	116	103	147	177	186	172	172	197	196	168	150	132	174	182	26	213	210
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	116	103	147	177	186	172	172	197	196	168	150	132	174	182	26	213	210
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	10	11	21	2	1	5	5	43	23	14	20	75	0	12	17
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0