CSP 2008 Competition: results by benchmark

Results by benchmark for category global constraints (GLOBAL)

This page displays the results of the different solvers for each benchmark for category global constraints (GLOBAL)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
cpHydra k_10
cpHydra k_40
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-10-10.xml	SAT TT=0.026	? TT=0.903	? TT=0.855	SAT TT=0.46	SAT TT=0.727 CHECKS=164427	SAT TT=0.255 CHECKS=154527	SAT TT=1.216 ASSIGNMENTS=17	SAT TT=1.433 ASSIGNMENTS=20	SAT TT=0.04 ASSIGNMENTS=25 CHECKS=8352	SAT TT=0.038 ASSIGNMENTS=25 CHECKS=8352	SAT TT=0.026 ASSIGNMENTS=18 CHECKS=6836	SAT TT=0.03 ASSIGNMENTS=47 CHECKS=17524	? (exit code) TT=0.531	SAT TT=0.213 ASSIGNMENTS=1306 CHECKS=360033	SAT TT=0.027 ASSIGNMENTS=25 CHECKS=8353	? TT=2.381	SAT TT=1.22	SAT TT=1.599
csp/allsquares/ normalized-squares-11-11.xml	SAT TT=0.03	? TT=0.847	? TT=0.844	SAT TT=1158.8	SAT TT=0.978 CHECKS=251586	SAT TT=0.225 CHECKS=118247	SAT TT=1.318 ASSIGNMENTS=20	SAT TT=1.536 ASSIGNMENTS=21	SAT TT=0.043 ASSIGNMENTS=26 CHECKS=10371	SAT TT=0.045 ASSIGNMENTS=26 CHECKS=10371	SAT TT=0.03 ASSIGNMENTS=20 CHECKS=8737	SAT TT=0.033 ASSIGNMENTS=40 CHECKS=10721	? (exit code) TT=0.569	SAT TT=0.043 ASSIGNMENTS=138 CHECKS=14464	SAT TT=0.032 ASSIGNMENTS=26 CHECKS=10361	? TT=2.807	SAT TT=1.518	SAT TT=1.762
csp/allsquares/ normalized-squares-12-12.xml	SAT TT=0.036	? TT=0.889	? TT=0.916	? (TO) TT=1800.09	SAT TT=0.95 CHECKS=157703	SAT TT=0.587 CHECKS=284867	SAT TT=1.463 ASSIGNMENTS=20	SAT TT=1.733 ASSIGNMENTS=25	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	SAT TT=0.048 ASSIGNMENTS=27 CHECKS=12296	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=11812	SAT TT=0.048 ASSIGNMENTS=92 CHECKS=40323	? (exit code) TT=0.524	SAT TT=0.087 ASSIGNMENTS=295 CHECKS=75984	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=12296	? TT=2.877	SAT TT=1.862	SAT TT=2.017
csp/allsquares/ normalized-squares-13-13.xml	SAT TT=0.044	? TT=0.968	? TT=1.068	SAT TT=1338.97	SAT TT=1.564 CHECKS=371572	SAT TT=0.861 CHECKS=394761	SAT TT=1.549 ASSIGNMENTS=22	SAT TT=1.895 ASSIGNMENTS=28	SAT TT=0.057 ASSIGNMENTS=30 CHECKS=15401	SAT TT=0.055 ASSIGNMENTS=30 CHECKS=15401	SAT TT=0.046 ASSIGNMENTS=33 CHECKS=14808	SAT TT=0.084 ASSIGNMENTS=281 CHECKS=134758	? (exit code) TT=0.602	SAT TT=0.135 ASSIGNMENTS=464 CHECKS=158488	SAT TT=0.044 ASSIGNMENTS=30 CHECKS=15402	? TT=3.504	SAT TT=1.898	SAT TT=2.755
csp/allsquares/ normalized-squares-14-14.xml	SAT TT=0.051	? TT=0.999	? TT=1.141	? (TO) TT=1800.11	SAT TT=8.927 CHECKS=9859980	SAT TT=1.576 CHECKS=807176	SAT TT=1.886 ASSIGNMENTS=23	SAT TT=1.889 ASSIGNMENTS=30	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	SAT TT=0.064 ASSIGNMENTS=33 CHECKS=18941	SAT TT=0.054 ASSIGNMENTS=35 CHECKS=18128	SAT TT=0.054 ASSIGNMENTS=36 CHECKS=26750	? (exit code) TT=0.615	SAT TT=0.189 ASSIGNMENTS=395 CHECKS=238430	SAT TT=0.051 ASSIGNMENTS=33 CHECKS=18942	? TT=3.751	SAT TT=1.933	SAT TT=3.25
csp/allsquares/ normalized-squares-15-15.xml	SAT TT=0.072	? TT=1.176	? TT=1.176	SAT TT=1340.21	SAT TT=2.422 CHECKS=1193690	SAT TT=1.673 CHECKS=735506	SAT TT=2.143 ASSIGNMENTS=116	SAT TT=2.076 ASSIGNMENTS=29	SAT TT=0.084 ASSIGNMENTS=69 CHECKS=43128	SAT TT=0.08 ASSIGNMENTS=69 CHECKS=43128	SAT TT=0.102 ASSIGNMENTS=192 CHECKS=148958	SAT TT=0.164 ASSIGNMENTS=477 CHECKS=291107	? (exit code) TT=0.415	SAT TT=2.632 ASSIGNMENTS=6749 CHECKS=2890200	SAT TT=0.072 ASSIGNMENTS=76 CHECKS=45774	? TT=4.644	SAT TT=2.568	SAT TT=4.207
csp/allsquares/ normalized-squares-16-16.xml	SAT TT=1.606	? TT=1.124	? TT=1.196	SAT TT=1345.67	? (TO) TT=1800.11	SAT TT=441.93 CHECKS=271392000	SAT TT=7.198 ASSIGNMENTS=3518	SAT TT=2.982 ASSIGNMENTS=644	SAT TT=8.952 ASSIGNMENTS=2085 CHECKS=3836690	SAT TT=8.686 ASSIGNMENTS=2085 CHECKS=3836690	SAT TT=2.092 ASSIGNMENTS=3671 CHECKS=5710140	SAT TT=2.965 ASSIGNMENTS=8878 CHECKS=7771260	? (exit code) TT=0.62	SAT TT=105.031 ASSIGNMENTS=125029 CHECKS=231010000	SAT TT=1.606 ASSIGNMENTS=2085 CHECKS=3836690	? TT=5.639	SAT TT=2.904	SAT TT=4.889
csp/allsquares/ normalized-squares-17-17.xml	SAT TT=2.544	? TT=1.211	? TT=1.28	SAT TT=1349.81	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=2.544 ASSIGNMENTS=345	SAT TT=245.195 ASSIGNMENTS=118078	SAT TT=19.356 ASSIGNMENTS=12856 CHECKS=24916400	SAT TT=18.768 ASSIGNMENTS=12856 CHECKS=24916400	SAT TT=21.678 ASSIGNMENTS=30007 CHECKS=47136800	SAT TT=4.3 ASSIGNMENTS=9433 CHECKS=9578080	? (exit code) TT=0.686	SAT TT=315.266 ASSIGNMENTS=371137 CHECKS=613994000	SAT TT=11.179 ASSIGNMENTS=12856 CHECKS=24916400	? TT=7.896	SAT TT=3.591	SAT TT=6.878
csp/allsquares/ normalized-squares-18-18.xml	SAT TT=1.249	? TT=1.289	? TT=1.288	SAT TT=1345.02	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=9.502 ASSIGNMENTS=4461	SAT TT=1426.5 ASSIGNMENTS=417690	SAT TT=1.249 ASSIGNMENTS=2359 CHECKS=2612060	SAT TT=1.348 ASSIGNMENTS=2359 CHECKS=2612060	SAT TT=5.589 ASSIGNMENTS=7184 CHECKS=11904600	SAT TT=5.215 ASSIGNMENTS=10355 CHECKS=10537200	? (exit code) TT=0.44	SAT TT=161.752 ASSIGNMENTS=164092 CHECKS=259915000	SAT TT=37.89 ASSIGNMENTS=47361 CHECKS=69118000	? TT=8.638	SAT TT=4.578	SAT TT=7.945
csp/allsquares/ normalized-squares-19-19.xml	SAT TT=13.899	? TT=1.47	? TT=1.412	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=32.908 ASSIGNMENTS=18975	? (TO) TT=1800.07	SAT TT=135.083 ASSIGNMENTS=110688 CHECKS=192957000	SAT TT=132.876 ASSIGNMENTS=110688 CHECKS=192957000	SAT TT=84.222 ASSIGNMENTS=66683 CHECKS=149081000	SAT TT=37.588 ASSIGNMENTS=33753 CHECKS=66361300	? (exit code) TT=0.717	SAT TT=884.867 ASSIGNMENTS=509242 CHECKS=1182770000	SAT TT=119.813 ASSIGNMENTS=110688 CHECKS=192957000	? TT=11.04	SAT TT=25.384	SAT TT=13.899
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-20-20.xml	SAT TT=6.734	? TT=1.552	? TT=1.554	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1278.01 ASSIGNMENTS=1088810	? (TO) TT=1800.11	SAT TT=147.321 ASSIGNMENTS=111914 CHECKS=246693000	SAT TT=153.787 ASSIGNMENTS=111914 CHECKS=246693000	SAT TT=139.875 ASSIGNMENTS=110439 CHECKS=224651000	SAT TT=744.468 ASSIGNMENTS=545008 CHECKS=1117940000	? (exit code) TT=0.727	SAT TT=771.309 ASSIGNMENTS=462808 CHECKS=1063180000	SAT TT=147.743 ASSIGNMENTS=111914 CHECKS=246693000	? TT=14.328	SAT TT=6.734	SAT TT=13.653
csp/allsquares/ normalized-squares-21-21.xml	SAT TT=29.692	? TT=1.691	? TT=1.687	SAT TT=1351.22	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=351.29 ASSIGNMENTS=240563 CHECKS=459067000	SAT TT=347.62 ASSIGNMENTS=240563 CHECKS=459067000	SAT TT=161.767 ASSIGNMENTS=92794 CHECKS=238589000	SAT TT=429.572 ASSIGNMENTS=279921 CHECKS=568725000	? (exit code) TT=0.472	? (TO) TT=1800.08	SAT TT=346.911 ASSIGNMENTS=240563 CHECKS=459067000	? TT=18.025	SAT TT=65.959	SAT TT=29.692
csp/allsquares/ normalized-squares-22-22.xml	SAT TT=268.547	? TT=1.893	? TT=1.877	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.15	SAT TT=388.702 ASSIGNMENTS=211898 CHECKS=471170000	SAT TT=386.623 ASSIGNMENTS=211898 CHECKS=471170000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (exit code) TT=0.76	? (TO) TT=1800.09	SAT TT=357.59 ASSIGNMENTS=211898 CHECKS=471170000	? TT=20.968	SAT TT=268.547	SAT TT=486.31
csp/allsquares/ normalized-squares-2-2.xml	SAT TT=0.005	? TT=0.642	? TT=0.569	SAT TT=0.026	SAT TT=0.008 CHECKS=191	SAT TT=0.009 CHECKS=210	SAT TT=0.48 ASSIGNMENTS=2	SAT TT=0.61 ASSIGNMENTS=3	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.019 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=49	? (exit code) TT=0.191	SAT TT=0.007 ASSIGNMENTS=1 CHECKS=46	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=46	? TT=0.907	SAT TT=0.49	SAT TT=0.476
csp/allsquares/ normalized-squares-23-23.xml	SAT TT=424.381	? TT=2.029	? TT=2.036	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=1.034	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=26.973	SAT TT=424.381	SAT TT=867.627
csp/allsquares/ normalized-squares-24-24.xml	SAT TT=30.729	? TT=2.321	? TT=2.302	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=212.445 ASSIGNMENTS=105979 CHECKS=355261000	? (TO) TT=1800.01	? (exit code) TT=0.554	? (TO) TT=1800.02	SAT TT=1017.5 ASSIGNMENTS=510581 CHECKS=1416400000	? TT=33.747	SAT TT=43.762	SAT TT=30.729
csp/allsquares/ normalized-squares-25-25.xml	SAT TT=177.971	? TT=2.685	? TT=2.475	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=0.846	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=41.009	SAT TT=267.101	SAT TT=177.971
csp/allsquares/ normalized-squares-26-26.xml	SAT TT=11.424	? TT=2.468	? TT=2.645	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=11.424 ASSIGNMENTS=4096	? (TO) TT=1800.14	SAT TT=18.141 ASSIGNMENTS=4096	SAT TT=1026.79 ASSIGNMENTS=4096	? (TO) TT=1800.09	? (TO) TT=1800.05	? (exit code) TT=0.82	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=50.418	SAT TT=18.541	SAT TT=44.394
csp/allsquares/ normalized-squares-27-27.xml	SAT TT=219.941	? TT=2.171	? TT=2.241	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (exit code) TT=0.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=61.371	SAT TT=219.941	SAT TT=489.652
csp/allsquares/ normalized-squares-28-28.xml	SAT TT=66.947	? TT=2.091	? TT=1.926	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=139.912 ASSIGNMENTS=88693 CHECKS=276034000	? (exit code) TT=0.84	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=77.649	SAT TT=118.323	SAT TT=66.947
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-29-29.xml	SAT TT=1015.17	? TT=1.744	? TT=1.758	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.04	? (exit code) TT=0.939	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=169.094	SAT TT=1015.17	? (TO) TT=1800.02
csp/allsquares/ normalized-squares-30-30.xml	SAT TT=341.973	? TT=1.879	? TT=1.703	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.22	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (exit code) TT=0.585	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=710.032	SAT TT=1749.98	SAT TT=341.973
csp/allsquares/ normalized-squares-31-31.xml	SAT TT=353.916	? TT=1.872	? TT=1.857	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.05	? (exit code) TT=0.961	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=90.582	SAT TT=885.136	SAT TT=353.916
csp/allsquares/ normalized-squares-32-32.xml	SAT TT=474.828	? TT=2.092	? TT=1.878	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.11	? (exit code) TT=1.175	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=118.345	SAT TT=1349.87	SAT TT=474.828
csp/allsquares/ normalized-squares-33-33.xml	SAT TT=542.258	? TT=2.084	? TT=2.085	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (exit code) TT=0.53	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=233.51	SAT TT=1759.2	SAT TT=542.258
csp/allsquares/ normalized-squares-3-3.xml	SAT TT=0.005	? TT=0.609	? TT=0.598	SAT TT=0.029	SAT TT=0.018 CHECKS=3072	SAT TT=0.009 CHECKS=1396	SAT TT=0.58 ASSIGNMENTS=6	SAT TT=0.609 ASSIGNMENTS=5	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.02 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=245	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=253	? (exit code) TT=0.179	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=241	SAT TT=0.005 ASSIGNMENTS=4 CHECKS=245	? TT=0.9	SAT TT=0.526	SAT TT=0.554
csp/allsquares/ normalized-squares-34-34.xml		? TT=2.045	? TT=2.038	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=1.242	? (TO) TT=1800.04	? (TO) TT=1800.06	? (MO) TT=106.499	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquares/ normalized-squares-35-35.xml		? TT=2.016	? TT=2.022	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=1.076	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1802.17	? (TO) TT=1800.32	? (TO) TT=1800.06
csp/allsquares/ normalized-squares-36-36.xml		? TT=1.926	? TT=2.2	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.637	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=202.725	? (TO) TT=1800.27	? (TO) TT=1800.05
csp/allsquares/ normalized-squares-37-37.xml		? TT=2.08	? TT=1.946	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=1.096	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=229.329	? (TO) TT=1800.33	? (TO) TT=1800.3
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquares/ normalized-squares-38-38.xml		? TT=1.956	? TT=1.963	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (exit code) TT=1.138	? (TO) TT=1800.02	? (TO) TT=1800.08	? (MO) TT=108.77	? (MO) TT=55.763	? (TO) TT=1800.18
csp/allsquares/ normalized-squares-4-4.xml	SAT TT=0.007	? TT=0.606	? TT=0.644	SAT TT=0.033	SAT TT=0.038 CHECKS=2979	SAT TT=0.013 CHECKS=5931	SAT TT=0.641 ASSIGNMENTS=7	SAT TT=0.669 ASSIGNMENTS=7	SAT TT=0.02 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=574	? (exit code) TT=0.286	SAT TT=0.011 ASSIGNMENTS=15 CHECKS=608	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=529	? TT=1.019	SAT TT=0.714	SAT TT=0.716
csp/allsquares/ normalized-squares-5-5.xml	SAT TT=0.01	? TT=0.689	? TT=0.649	SAT TT=0.039	SAT TT=0.084 CHECKS=6906	SAT TT=0.032 CHECKS=21882	SAT TT=0.819 ASSIGNMENTS=8	SAT TT=0.807 ASSIGNMENTS=8	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.021 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=959	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=1155	? (exit code) TT=0.29	SAT TT=0.012 ASSIGNMENTS=17 CHECKS=889	SAT TT=0.011 ASSIGNMENTS=7 CHECKS=959	? TT=1.719	SAT TT=0.769	SAT TT=0.904
csp/allsquares/ normalized-squares-6-6.xml	SAT TT=0.012	? TT=0.684	? TT=0.709	SAT TT=0.044	SAT TT=0.161 CHECKS=11392	SAT TT=0.031 CHECKS=20429	SAT TT=0.869 ASSIGNMENTS=11	SAT TT=0.989 ASSIGNMENTS=10	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.024 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1603	SAT TT=0.013 ASSIGNMENTS=17 CHECKS=1707	? (exit code) TT=0.252	SAT TT=0.013 ASSIGNMENTS=31 CHECKS=1776	SAT TT=0.012 ASSIGNMENTS=10 CHECKS=1603	? TT=1.673	SAT TT=0.806	SAT TT=0.925
csp/allsquares/ normalized-squares-7-7.xml	SAT TT=0.014	? TT=0.692	? TT=0.668	SAT TT=0.05	SAT TT=0.259 CHECKS=32212	SAT TT=0.046 CHECKS=29555	SAT TT=0.905 ASSIGNMENTS=11	SAT TT=0.95 ASSIGNMENTS=12	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.025 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.015 ASSIGNMENTS=10 CHECKS=2376	SAT TT=0.014 ASSIGNMENTS=18 CHECKS=2739	? (exit code) TT=0.383	SAT TT=0.016 ASSIGNMENTS=54 CHECKS=3631	SAT TT=0.014 ASSIGNMENTS=10 CHECKS=2376	? TT=1.846	SAT TT=0.913	SAT TT=0.938
csp/allsquares/ normalized-squares-8-8.xml	SAT TT=0.016	? TT=0.797	? TT=0.736	SAT TT=0.061	SAT TT=0.466 CHECKS=131200	SAT TT=0.074 CHECKS=46781	SAT TT=1.031 ASSIGNMENTS=12	SAT TT=1.157 ASSIGNMENTS=15	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	SAT TT=0.029 ASSIGNMENTS=10 CHECKS=3573	SAT TT=0.017 ASSIGNMENTS=10 CHECKS=3527	SAT TT=0.018 ASSIGNMENTS=12 CHECKS=3536	? (exit code) TT=0.436	SAT TT=0.022 ASSIGNMENTS=68 CHECKS=8493	SAT TT=0.016 ASSIGNMENTS=11 CHECKS=3527	? TT=2.064	SAT TT=0.935	SAT TT=1.016
csp/allsquares/ normalized-squares-9-9.xml	SAT TT=0.021	? TT=0.737	? TT=0.745	SAT TT=0.086	SAT TT=0.551 CHECKS=147320	SAT TT=0.198 CHECKS=143946	SAT TT=1.204 ASSIGNMENTS=15	SAT TT=1.253 ASSIGNMENTS=17	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=5239	SAT TT=0.034 ASSIGNMENTS=19 CHECKS=5239	SAT TT=0.021 ASSIGNMENTS=14 CHECKS=5142	SAT TT=0.022 ASSIGNMENTS=22 CHECKS=8931	? (exit code) TT=0.359	SAT TT=0.033 ASSIGNMENTS=133 CHECKS=19193	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=5400	? TT=2.135	SAT TT=1.196	SAT TT=1.116
csp/allsquaresUnsat/ normalized-squaresUnsat-10-10.xml	UNSAT TT=0.028	? TT=0.842	? TT=0.801	UNSAT TT=144.791	UNSAT TT=2.387 CHECKS=1745340	UNSAT TT=2.957 CHECKS=2574600	UNSAT TT=1.104 ASSIGNMENTS=0	UNSAT TT=1.109 ASSIGNMENTS=0	UNSAT TT=0.038 ASSIGNMENTS=13 CHECKS=11406	UNSAT TT=0.039 ASSIGNMENTS=13 CHECKS=11406	UNSAT TT=0.04 ASSIGNMENTS=84 CHECKS=44203	UNSAT TT=0.582 ASSIGNMENTS=4941 CHECKS=1657480	? (exit code) TT=0.533	UNSAT TT=0.042 ASSIGNMENTS=145 CHECKS=29681	UNSAT TT=0.028 ASSIGNMENTS=13 CHECKS=11406	? TT=2.406	UNSAT TT=1.157	UNSAT TT=1.524
csp/allsquaresUnsat/ normalized-squaresUnsat-11-11.xml	UNSAT TT=0.039	? TT=0.945	? TT=0.898	UNSAT TT=1789.63	UNSAT TT=5.609 CHECKS=3934750	UNSAT TT=6.678 CHECKS=5397490	UNSAT TT=1.304 ASSIGNMENTS=0	UNSAT TT=1.234 ASSIGNMENTS=0	UNSAT TT=0.043 ASSIGNMENTS=11 CHECKS=11735	UNSAT TT=0.044 ASSIGNMENTS=11 CHECKS=11735	UNSAT TT=0.04 ASSIGNMENTS=59 CHECKS=41721	UNSAT TT=0.646 ASSIGNMENTS=5291 CHECKS=1983410	? (exit code) TT=0.566	UNSAT TT=0.298 ASSIGNMENTS=1786 CHECKS=403268	UNSAT TT=0.039 ASSIGNMENTS=50 CHECKS=26440	? TT=2.518	UNSAT TT=1.376	UNSAT TT=1.591
csp/allsquaresUnsat/ normalized-squaresUnsat-12-12.xml	UNSAT TT=0.041	? TT=0.941	? TT=0.869	UNSAT TT=1345.04	UNSAT TT=8.406 CHECKS=6015970	UNSAT TT=9.924 CHECKS=7311620	UNSAT TT=1.218 ASSIGNMENTS=0	UNSAT TT=1.243 ASSIGNMENTS=0	UNSAT TT=0.048 ASSIGNMENTS=19 CHECKS=14649	UNSAT TT=0.05 ASSIGNMENTS=19 CHECKS=14649	UNSAT TT=0.048 ASSIGNMENTS=51 CHECKS=38810	UNSAT TT=0.796 ASSIGNMENTS=5811 CHECKS=2226820	? (exit code) TT=0.389	UNSAT TT=0.411 ASSIGNMENTS=2170 CHECKS=530746	UNSAT TT=0.041 ASSIGNMENTS=29 CHECKS=19176	? TT=2.812	UNSAT TT=1.498	UNSAT TT=2.366
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-13-13.xml	UNSAT TT=0.042	? TT=0.951	? TT=1.05	UNSAT TT=1344.95	UNSAT TT=16.32 CHECKS=10257700	UNSAT TT=16.92 CHECKS=11278300	UNSAT TT=1.339 ASSIGNMENTS=0	UNSAT TT=1.331 ASSIGNMENTS=0	UNSAT TT=0.054 ASSIGNMENTS=19 CHECKS=16161	UNSAT TT=0.053 ASSIGNMENTS=19 CHECKS=16161	UNSAT TT=0.05 ASSIGNMENTS=43 CHECKS=42246	UNSAT TT=0.672 ASSIGNMENTS=4732 CHECKS=1966700	? (exit code) TT=0.684	UNSAT TT=0.185 ASSIGNMENTS=724 CHECKS=191981	UNSAT TT=0.042 ASSIGNMENTS=19 CHECKS=16286	? TT=3.303	UNSAT TT=1.565	UNSAT TT=2.564
csp/allsquaresUnsat/ normalized-squaresUnsat-14-14.xml	UNSAT TT=0.051	? TT=1.004	? TT=0.986	? (TO) TT=1800.02	UNSAT TT=31.416 CHECKS=18151600	UNSAT TT=34.403 CHECKS=21077700	UNSAT TT=1.574 ASSIGNMENTS=0	UNSAT TT=1.611 ASSIGNMENTS=0	UNSAT TT=0.063 ASSIGNMENTS=19 CHECKS=17825	UNSAT TT=0.064 ASSIGNMENTS=19 CHECKS=17825	UNSAT TT=0.077 ASSIGNMENTS=104 CHECKS=74750	UNSAT TT=0.651 ASSIGNMENTS=3001 CHECKS=1447650	? (exit code) TT=0.684	UNSAT TT=0.12 ASSIGNMENTS=260 CHECKS=119424	UNSAT TT=0.051 ASSIGNMENTS=26 CHECKS=22403	? TT=3.697	UNSAT TT=1.975	UNSAT TT=3.043
csp/allsquaresUnsat/ normalized-squaresUnsat-15-15.xml	UNSAT TT=0.06	? TT=1.061	? TT=1.066	UNSAT TT=1343.45	UNSAT TT=1.086 CHECKS=982	UNSAT TT=0.06 CHECKS=982	UNSAT TT=1.335 ASSIGNMENTS=0	UNSAT TT=1.428 ASSIGNMENTS=0	UNSAT TT=0.071 ASSIGNMENTS=19 CHECKS=19530	UNSAT TT=0.072 ASSIGNMENTS=19 CHECKS=19530	UNSAT TT=0.07 ASSIGNMENTS=38 CHECKS=45955	UNSAT TT=1.277 ASSIGNMENTS=6843 CHECKS=3277530	? (exit code) TT=0.42	UNSAT TT=0.158 ASSIGNMENTS=344 CHECKS=110887	UNSAT TT=0.064 ASSIGNMENTS=26 CHECKS=24464	? TT=4.462	UNSAT TT=2.618	UNSAT TT=3.726
csp/allsquaresUnsat/ normalized-squaresUnsat-16-16.xml	UNSAT TT=0.064	? TT=1.249	? TT=1.119	UNSAT TT=1345.01	UNSAT TT=1.232 CHECKS=1106	UNSAT TT=0.065 CHECKS=1106	UNSAT TT=1.428 ASSIGNMENTS=0	UNSAT TT=1.597 ASSIGNMENTS=0	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=21276	UNSAT TT=0.082 ASSIGNMENTS=19 CHECKS=21276	UNSAT TT=0.082 ASSIGNMENTS=40 CHECKS=51044	UNSAT TT=1.61 ASSIGNMENTS=7330 CHECKS=3696930	? (exit code) TT=0.65	UNSAT TT=0.805 ASSIGNMENTS=1149 CHECKS=453440	UNSAT TT=0.064 ASSIGNMENTS=20 CHECKS=24076	? TT=5.466	UNSAT TT=2.549	UNSAT TT=4.445
csp/allsquaresUnsat/ normalized-squaresUnsat-17-17.xml	UNSAT TT=0.076	? TT=1.324	? TT=1.193	UNSAT TT=1352.53	UNSAT TT=1.458 CHECKS=1238	UNSAT TT=0.076 CHECKS=1238	UNSAT TT=1.533 ASSIGNMENTS=0	UNSAT TT=1.338 ASSIGNMENTS=0	UNSAT TT=17.438 ASSIGNMENTS=10642 CHECKS=19776700	UNSAT TT=16.786 ASSIGNMENTS=10642 CHECKS=19776700	UNSAT TT=19.168 ASSIGNMENTS=25918 CHECKS=40754600	UNSAT TT=34.395 ASSIGNMENTS=47618 CHECKS=76834000	? (exit code) TT=0.846	UNSAT TT=334.904 ASSIGNMENTS=399963 CHECKS=596071000	UNSAT TT=10.466 ASSIGNMENTS=10642 CHECKS=19776700	? TT=6.721	UNSAT TT=6.479	UNSAT TT=9.461
csp/allsquaresUnsat/ normalized-squaresUnsat-18-18.xml	UNSAT TT=48.241	? TT=1.29	? TT=1.365	UNSAT TT=1584.82	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=213.202 ASSIGNMENTS=183848 CHECKS=378246000	UNSAT TT=202.911 ASSIGNMENTS=183848 CHECKS=378246000	UNSAT TT=246.526 ASSIGNMENTS=256838 CHECKS=500899000	UNSAT TT=152.011 ASSIGNMENTS=145952 CHECKS=264378000	? (exit code) TT=0.449	UNSAT TT=484.343 ASSIGNMENTS=397120 CHECKS=706295000	UNSAT TT=187.797 ASSIGNMENTS=183848 CHECKS=378246000	? TT=9.19	UNSAT TT=64.219	UNSAT TT=48.241
csp/allsquaresUnsat/ normalized-squaresUnsat-19-19.xml	UNSAT TT=0.102	? TT=1.425	? TT=1.402	UNSAT TT=1489.26	UNSAT TT=1.835 CHECKS=1506	UNSAT TT=0.102 CHECKS=1506	UNSAT TT=1.422 ASSIGNMENTS=0	UNSAT TT=1.559 ASSIGNMENTS=0	UNSAT TT=146.681 ASSIGNMENTS=101469 CHECKS=217456000	UNSAT TT=146.874 ASSIGNMENTS=101469 CHECKS=217456000	UNSAT TT=152.378 ASSIGNMENTS=132277 CHECKS=269853000	UNSAT TT=105.22 ASSIGNMENTS=96427 CHECKS=147682000	? (exit code) TT=0.728	UNSAT TT=529.969 ASSIGNMENTS=363851 CHECKS=712207000	UNSAT TT=134.102 ASSIGNMENTS=101469 CHECKS=217456000	? TT=10.632	UNSAT TT=43.34	UNSAT TT=41.562
csp/allsquaresUnsat/ normalized-squaresUnsat-20-20.xml	UNSAT TT=0.107	? TT=1.617	? TT=1.495	? (TO) TT=1800.02	UNSAT TT=2.077 CHECKS=1662	UNSAT TT=0.107 CHECKS=1662	UNSAT TT=1.547 ASSIGNMENTS=0	UNSAT TT=1.841 ASSIGNMENTS=0	UNSAT TT=1362.46 ASSIGNMENTS=972280 CHECKS=1949310000	UNSAT TT=1016.42 ASSIGNMENTS=0	UNSAT TT=1663.26 ASSIGNMENTS=1211670 CHECKS=2380190000	UNSAT TT=233.569 ASSIGNMENTS=158054 CHECKS=348657000	? (exit code) TT=0.739	UNSAT TT=1018.17 ASSIGNMENTS=588256 CHECKS=1099680000	UNSAT TT=1355.48 ASSIGNMENTS=972280 CHECKS=1949310000	? TT=14.071	UNSAT TT=117.254	UNSAT TT=141.548
csp/allsquaresUnsat/ normalized-squaresUnsat-21-21.xml	UNSAT TT=0.13	? TT=1.757	? TT=1.695	? (TO) TT=1800.05	UNSAT TT=2.196 CHECKS=1806	UNSAT TT=0.13 CHECKS=1806	UNSAT TT=1.949 ASSIGNMENTS=0	UNSAT TT=1.617 ASSIGNMENTS=0	UNSAT TT=1665.15 ASSIGNMENTS=0	UNSAT TT=1017.49 ASSIGNMENTS=0	? (TO) TT=1800.1	UNSAT TT=1438.28 ASSIGNMENTS=844124 CHECKS=1853250000	? (exit code) TT=0.44	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=17.748	UNSAT TT=217.067	UNSAT TT=270.054
csp/allsquaresUnsat/ normalized-squaresUnsat-22-22.xml	UNSAT TT=0.146	? TT=1.828	? TT=1.82	? (TO) TT=1800.06	UNSAT TT=2.626 CHECKS=1978	UNSAT TT=0.146 CHECKS=1978	UNSAT TT=1.641 ASSIGNMENTS=0	UNSAT TT=2.198 ASSIGNMENTS=0	UNSAT TT=1017.24 ASSIGNMENTS=0	UNSAT TT=1017.05 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.08	? (exit code) TT=0.77	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=21.811	UNSAT TT=343.792	UNSAT TT=335.978
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-2-2.xml	UNSAT TT=0.006	? TT=0.593	? TT=0.553	UNSAT TT=0.026	UNSAT TT=0.01 CHECKS=53	UNSAT TT=0.008 CHECKS=53	UNSAT TT=0.506 ASSIGNMENTS=0	UNSAT TT=0.513 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=15	? (exit code) TT=0.193	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=15	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=15	? TT=0.906	UNSAT TT=0.488	UNSAT TT=0.504
csp/allsquaresUnsat/ normalized-squaresUnsat-23-23.xml	UNSAT TT=0.168	? TT=2.011	? TT=2.009	? (TO) TT=1800.04	UNSAT TT=2.701 CHECKS=2138	UNSAT TT=0.168 CHECKS=2138	UNSAT TT=1.689 ASSIGNMENTS=0	UNSAT TT=1.827 ASSIGNMENTS=0	UNSAT TT=890.69 ASSIGNMENTS=0	UNSAT TT=1016.83 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.06	? (exit code) TT=0.807	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=26.041	UNSAT TT=402.254	UNSAT TT=469.765
csp/allsquaresUnsat/ normalized-squaresUnsat-24-24.xml		? TT=2.515	? TT=2.276	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (exit code) TT=0.497	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=33.356	? (TO) TT=1800.07	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-25-25.xml	UNSAT TT=0.192	? TT=2.533	? TT=2.484	? (TO) TT=1800.07	UNSAT TT=3.294 CHECKS=2502	UNSAT TT=0.192 CHECKS=2502	UNSAT TT=2.044 ASSIGNMENTS=0	UNSAT TT=2.224 ASSIGNMENTS=0	UNSAT TT=891.527 ASSIGNMENTS=0	UNSAT TT=1016.9 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.05	? (exit code) TT=0.796	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=40.292	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/allsquaresUnsat/ normalized-squaresUnsat-26-26.xml		? TT=2.475	? TT=2.436	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (exit code) TT=1.073	? (TO) TT=1800	? (TO) TT=1800.02	? TT=49.053	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-27-27.xml	UNSAT TT=0.256	? TT=2.292	? TT=2.583	? (TO) TT=1800.05	UNSAT TT=4.331 CHECKS=2918	UNSAT TT=0.256 CHECKS=2918	UNSAT TT=2.226 ASSIGNMENTS=0	UNSAT TT=2.106 ASSIGNMENTS=0	UNSAT TT=9.804 ASSIGNMENTS=0	UNSAT TT=1017.87 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.01	? (exit code) TT=0.511	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=57.082	? (TO) TT=1800.06	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-28-28.xml		? TT=2.179	? TT=2.216	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=1.115	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=73.045	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/allsquaresUnsat/ normalized-squaresUnsat-29-29.xml	UNSAT TT=0.313	? TT=1.998	? TT=1.923	? (TO) TT=1800.03	UNSAT TT=5.162 CHECKS=3366	UNSAT TT=0.313 CHECKS=3366	UNSAT TT=2.201 ASSIGNMENTS=0	UNSAT TT=2.43 ASSIGNMENTS=0	UNSAT TT=9.919 ASSIGNMENTS=0	UNSAT TT=1017.56 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (exit code) TT=0.934	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=130.964	? (TO) TT=1800.03	? (TO) TT=1800.07
csp/allsquaresUnsat/ normalized-squaresUnsat-30-30.xml	UNSAT TT=0.349	? TT=1.724	? TT=1.735	? (TO) TT=1800.03	UNSAT TT=5.732 CHECKS=3602	UNSAT TT=0.349 CHECKS=3602	UNSAT TT=2.453 ASSIGNMENTS=0	UNSAT TT=2.552 ASSIGNMENTS=0	UNSAT TT=10.332 ASSIGNMENTS=0	UNSAT TT=1017.9 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.08	? (exit code) TT=0.508	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=453.483	? (TO) TT=1800.05	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-31-31.xml	UNSAT TT=0.383	? TT=1.773	? TT=1.881	? (TO) TT=1800.05	UNSAT TT=6.299 CHECKS=3846	UNSAT TT=0.383 CHECKS=3846	UNSAT TT=2.676 ASSIGNMENTS=0	UNSAT TT=2.767 ASSIGNMENTS=0	UNSAT TT=10.099 ASSIGNMENTS=0	UNSAT TT=1018.17 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.04	? (exit code) TT=0.964	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=97.302	? (TO) TT=1800.12	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-32-32.xml		? TT=1.948	? TT=1.825	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (exit code) TT=1.182	? (TO) TT=1800.04	? (TO) TT=1800.11	? (MO) TT=91.645	? (TO) TT=1800.09	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-33-33.xml		? TT=2.102	? TT=1.988	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.541	? (TO) TT=1800.03	? (TO) TT=1800.07	? (MO) TT=112.026	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-3-3.xml	UNSAT TT=0.006	? TT=0.631	? TT=0.563	UNSAT TT=0.03	UNSAT TT=0.012 CHECKS=92	UNSAT TT=0.01 CHECKS=92	UNSAT TT=0.511 ASSIGNMENTS=0	UNSAT TT=0.503 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=22	? (exit code) TT=0.186	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	? TT=0.979	UNSAT TT=0.535	UNSAT TT=0.53
csp/allsquaresUnsat/ normalized-squaresUnsat-34-34.xml		? TT=2.128	? TT=2.046	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=1.114	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=107.77	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/allsquaresUnsat/ normalized-squaresUnsat-35-35.xml	UNSAT TT=0.547	? TT=1.967	? TT=2.063	? (TO) TT=1800.1	UNSAT TT=7.996 CHECKS=4902	UNSAT TT=0.547 CHECKS=4902	UNSAT TT=2.703 ASSIGNMENTS=0	UNSAT TT=2.734 ASSIGNMENTS=0	UNSAT TT=10.504 ASSIGNMENTS=0	UNSAT TT=1018.23 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.07	? (exit code) TT=1.068	? (TO) TT=1800.03	? (TO) TT=1800.11	? (MO) TT=101.483	? (TO) TT=1800.22	? (TO) TT=1800.03
csp/allsquaresUnsat/ normalized-squaresUnsat-36-36.xml	UNSAT TT=0.596	? TT=2.129	? TT=1.942	? (TO) TT=1800.07	UNSAT TT=8.625 CHECKS=5186	UNSAT TT=0.596 CHECKS=5186	UNSAT TT=2.892 ASSIGNMENTS=0	UNSAT TT=3.057 ASSIGNMENTS=0	UNSAT TT=10.856 ASSIGNMENTS=0	UNSAT TT=1018.62 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.635	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1802.14	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/allsquaresUnsat/ normalized-squaresUnsat-37-37.xml	UNSAT TT=0.641	? TT=1.975	? TT=2.107	? (TO) TT=1800.11	UNSAT TT=8.323 CHECKS=5478	UNSAT TT=0.641 CHECKS=5478	UNSAT TT=3.066 ASSIGNMENTS=0	UNSAT TT=3.41 ASSIGNMENTS=0	UNSAT TT=10.728 ASSIGNMENTS=0	UNSAT TT=1018.24 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (exit code) TT=1.36	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=400.357	? (TO) TT=1800.32	? (TO) TT=1800.01
csp/allsquaresUnsat/ normalized-squaresUnsat-38-38.xml		? TT=1.945	? TT=1.966	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (exit code) TT=1.354	? (TO) TT=1800.11	? (TO) TT=1800.01	? TT=208.941	? (MO) TT=59.215	? (TO) TT=1800.2
csp/allsquaresUnsat/ normalized-squaresUnsat-4-4.xml	UNSAT TT=0.006	? TT=0.61	? TT=0.6	UNSAT TT=0.032	UNSAT TT=0.028 CHECKS=120	UNSAT TT=0.01 CHECKS=120	UNSAT TT=0.551 ASSIGNMENTS=0	UNSAT TT=0.754 ASSIGNMENTS=0	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=160	? (exit code) TT=0.265	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=160	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=160	? TT=0.972	UNSAT TT=0.668	UNSAT TT=0.66
csp/allsquaresUnsat/ normalized-squaresUnsat-5-5.xml	UNSAT TT=0.008	? TT=0.687	? TT=0.614	UNSAT TT=0.037	UNSAT TT=0.055 CHECKS=175	UNSAT TT=0.01 CHECKS=175	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=266	? (exit code) TT=0.284	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=266	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=266	? TT=1.531	UNSAT TT=0.73	UNSAT TT=0.731
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/allsquaresUnsat/ normalized-squaresUnsat-6-6.xml	UNSAT TT=0.01	? TT=0.655	? TT=0.749	UNSAT TT=0.043	UNSAT TT=0.124 CHECKS=219	UNSAT TT=0.013 CHECKS=219	UNSAT TT=0.7 ASSIGNMENTS=0	UNSAT TT=0.709 ASSIGNMENTS=0	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=399	? (exit code) TT=0.249	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=399	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=399	? TT=1.653	UNSAT TT=0.846	UNSAT TT=0.863
csp/allsquaresUnsat/ normalized-squaresUnsat-7-7.xml	UNSAT TT=0.012	? TT=0.669	? TT=0.675	UNSAT TT=0.047	UNSAT TT=0.206 CHECKS=290	UNSAT TT=0.014 CHECKS=290	UNSAT TT=0.689 ASSIGNMENTS=0	UNSAT TT=0.703 ASSIGNMENTS=0	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=563	? (exit code) TT=0.38	UNSAT TT=0.014 ASSIGNMENTS=0 CHECKS=563	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=563	? TT=1.795	UNSAT TT=1.075	UNSAT TT=0.947
csp/allsquaresUnsat/ normalized-squaresUnsat-8-8.xml	UNSAT TT=0.017	? TT=0.76	? TT=0.711	UNSAT TT=0.06	UNSAT TT=0.259 CHECKS=350	UNSAT TT=0.018 CHECKS=350	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.898 ASSIGNMENTS=0	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? (exit code) TT=0.475	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=754	? TT=1.959	UNSAT TT=0.981	UNSAT TT=0.965
csp/allsquaresUnsat/ normalized-squaresUnsat-9-9.xml	UNSAT TT=0.025	? TT=0.826	? TT=0.751	UNSAT TT=1.675	UNSAT TT=0.616 CHECKS=188089	UNSAT TT=0.199 CHECKS=141270	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=0.986 ASSIGNMENTS=0	UNSAT TT=0.036 ASSIGNMENTS=12 CHECKS=10492	UNSAT TT=0.035 ASSIGNMENTS=12 CHECKS=10492	UNSAT TT=0.034 ASSIGNMENTS=67 CHECKS=40428	UNSAT TT=0.098 ASSIGNMENTS=709 CHECKS=234513	? (exit code) TT=0.325	UNSAT TT=0.047 ASSIGNMENTS=253 CHECKS=49485	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=12542	? TT=2.305	UNSAT TT=1.072	UNSAT TT=1.111
csp/bibd10-11/ normalized-bibd-10-120-36-3-8_glb.xml	SAT TT=21.153	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.151	SAT TT=29.399	SAT TT=21.153
csp/bibd10-11/ normalized-bibd-10-30-9-3-2_glb.xml	SAT TT=0.104	SAT TT=723.966 CHECKS=109759000 NODES=2889730	SAT TT=72.094 CHECKS=7950540 NODES=278290	SAT TT=3.29	SAT TT=15.525 CHECKS=2472780	SAT TT=19.371 CHECKS=4553240	SAT TT=39.83 ASSIGNMENTS=102877	SAT TT=37.398 ASSIGNMENTS=102877	SAT TT=0.12 ASSIGNMENTS=272 CHECKS=21118	SAT TT=0.119 ASSIGNMENTS=272 CHECKS=21118	SAT TT=0.106 ASSIGNMENTS=330 CHECKS=26648	? (TO) TT=1800.06	SAT TT=1.211	SAT TT=0.305 ASSIGNMENTS=3695 CHECKS=264240	SAT TT=0.104 ASSIGNMENTS=186 CHECKS=6883	? TT=3.558	SAT TT=3.351	SAT TT=4.313
csp/bibd10-11/ normalized-bibd-10-60-18-3-4_glb.xml	SAT TT=0.233	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.13	SAT TT=977.381 CHECKS=96017400	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=0.534 ASSIGNMENTS=6638 CHECKS=576362	SAT TT=0.497 ASSIGNMENTS=6638 CHECKS=576362	SAT TT=0.33 ASSIGNMENTS=2533 CHECKS=232268	? (TO) TT=1800.1	SAT TT=3.246	SAT TT=8.057 ASSIGNMENTS=48223 CHECKS=4971410	SAT TT=0.233 ASSIGNMENTS=605 CHECKS=38199	? TT=4.839	SAT TT=7.121	SAT TT=7.625
csp/bibd10-11/ normalized-bibd-10-90-27-3-6_glb.xml	SAT TT=0.509	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=35.836 CHECKS=2350580	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=368.908 ASSIGNMENTS=3374 CHECKS=259943	SAT TT=675.111 ASSIGNMENTS=3374 CHECKS=259943	SAT TT=2.641 ASSIGNMENTS=35752 CHECKS=3651970	SAT TT=1.158 ASSIGNMENTS=165092 CHECKS=1831780	SAT TT=613.928	SAT TT=22.16 ASSIGNMENTS=126231 CHECKS=13222700	SAT TT=0.509 ASSIGNMENTS=3374 CHECKS=259943	? TT=5.211	SAT TT=13.746	SAT TT=12.49
csp/bibd10-11/ normalized-bibd-11-110-30-3-6_glb.xml	SAT TT=11.467	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=11.467 ASSIGNMENTS=395622 CHECKS=18522800	? (TO) TT=1800.06	SAT TT=1408.18 ASSIGNMENTS=4600210 CHECKS=560875000	? (TO) TT=1800.08	? TT=6.242	SAT TT=149.712	SAT TT=29.065
csp/bibd10-11/ normalized-bibd-11-55-15-3-3_glb.xml	SAT TT=0.364	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=0.532 ASSIGNMENTS=6640 CHECKS=495336	SAT TT=0.53 ASSIGNMENTS=6640 CHECKS=495336	SAT TT=0.364 ASSIGNMENTS=3693 CHECKS=266337	? (TO) TT=1800.04	SAT TT=12.032	SAT TT=4.382 ASSIGNMENTS=31955 CHECKS=3649540	? (TO) TT=1800.1	? TT=4.657	SAT TT=6.579	SAT TT=9.842
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd12-13/ normalized-bibd-12-132-33-3-6_glb.xml	SAT TT=29	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? TT=7.101	SAT TT=309.765	SAT TT=29
csp/bibd12-13/ normalized-bibd-12-44-11-3-2_glb.xml	SAT TT=0.26	? (TO) TT=1800.16	SAT TT=1288.14 CHECKS=215793000 NODES=2312320	SAT TT=108.413	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	SAT TT=0.338 ASSIGNMENTS=2621 CHECKS=194100	SAT TT=0.351 ASSIGNMENTS=2621 CHECKS=194100	SAT TT=0.327 ASSIGNMENTS=2658 CHECKS=217704	SAT TT=30.944 ASSIGNMENTS=704301 CHECKS=81939300	SAT TT=1.957	SAT TT=4.091 ASSIGNMENTS=33798 CHECKS=3425580	SAT TT=0.26 ASSIGNMENTS=686 CHECKS=59493	? TT=4.909	SAT TT=5.998	SAT TT=8.49
csp/bibd12-13/ normalized-bibd-12-88-22-3-4_glb.xml	SAT TT=10.057	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=67.423 CHECKS=4485680	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=29.741 ASSIGNMENTS=354353 CHECKS=39366900	? (TO) TT=1800.09	SAT TT=10.057	SAT TT=61.92 ASSIGNMENTS=194330 CHECKS=26122000	? (TO) TT=1800.06	? TT=6.138	SAT TT=28.086	SAT TT=19.531
csp/bibd12-13/ normalized-bibd-13-104-24-3-4_glb.xml	SAT TT=23.442	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=407.822 CHECKS=18513700	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=6.62	SAT TT=167.034	SAT TT=23.442
csp/bibd12-13/ normalized-bibd-13-26-6-3-1_glb.xml	SAT TT=0.16	SAT TT=7.836 CHECKS=392839 NODES=8814	SAT TT=199.569 CHECKS=14738900 NODES=495323	SAT TT=11.72	SAT TT=18.987 CHECKS=2453470	SAT TT=12.334 CHECKS=2490340	SAT TT=54.837 ASSIGNMENTS=84247	SAT TT=52.862 ASSIGNMENTS=84247	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	SAT TT=0.183 ASSIGNMENTS=707 CHECKS=54023	SAT TT=0.16 ASSIGNMENTS=686 CHECKS=59214	SAT TT=1303.38 ASSIGNMENTS=25891600 CHECKS=4041350000	SAT TT=1.758	SAT TT=1.417 ASSIGNMENTS=15474 CHECKS=1918200	SAT TT=0.161 ASSIGNMENTS=244 CHECKS=13099	? TT=3.957	SAT TT=4.043	SAT TT=4.546
csp/bibd12-13/ normalized-bibd-13-52-12-3-2_glb.xml	SAT TT=0.938	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=800.117	? (TO) TT=1800.07	SAT TT=146.969 CHECKS=12437800	? (TO) TT=1800.1	? (TO) TT=1800.14	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	SAT TT=0.938 ASSIGNMENTS=10516 CHECKS=1175410	SAT TT=1.732 ASSIGNMENTS=24811 CHECKS=2231020	? (TO) TT=1800.04	SAT TT=2.758	SAT TT=6.46 ASSIGNMENTS=38073 CHECKS=4480870	SAT TT=590.666 ASSIGNMENTS=6738700 CHECKS=804298000	? TT=5.664	SAT TT=9.305	SAT TT=10.62
csp/bibd12-13/ normalized-bibd-13-78-18-3-3_glb.xml	SAT TT=25.354	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=61.537 CHECKS=3239740	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=30.774 ASSIGNMENTS=489695 CHECKS=41055900	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=45.829 ASSIGNMENTS=161298 CHECKS=22615600	? (TO) TT=1800.05	? TT=6.272	SAT TT=25.354	SAT TT=79.565
csp/bibd6/ normalized-bibd-6-100-50-3-20_glb.xml	SAT TT=0.145	SAT TT=5.682 CHECKS=46762 NODES=7452	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=60.266 CHECKS=6299730	SAT TT=76.783 CHECKS=8497670	? (TO) TT=1800.07	? (TO) TT=1800.13	SAT TT=368.47 ASSIGNMENTS=623 CHECKS=28068	SAT TT=674.154 ASSIGNMENTS=623 CHECKS=28068	? (TO) TT=1800.04	SAT TT=28.643 ASSIGNMENTS=781021 CHECKS=42627200	SAT TT=21.47	? (TO) TT=1800.11	SAT TT=0.145 ASSIGNMENTS=623 CHECKS=28068	? TT=3.632	SAT TT=113.607	SAT TT=7.496
csp/bibd6/ normalized-bibd-6-10-5-3-2_glb.xml	SAT TT=0.017	SAT TT=1.095 CHECKS=2794 NODES=440	SAT TT=1.205 CHECKS=17312 NODES=1613	SAT TT=0.075	SAT TT=0.096 CHECKS=9868	SAT TT=0.04 CHECKS=5055	SAT TT=0.825 ASSIGNMENTS=74	SAT TT=0.886 ASSIGNMENTS=74	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.03 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.018 ASSIGNMENTS=24 CHECKS=720	SAT TT=0.024 ASSIGNMENTS=545 CHECKS=20936	SAT TT=0.542	SAT TT=0.019 ASSIGNMENTS=268 CHECKS=8775	SAT TT=0.017 ASSIGNMENTS=24 CHECKS=720	? TT=1.119	SAT TT=1.277	SAT TT=1.284
csp/bibd6/ normalized-bibd-6-20-10-3-4_glb.xml	SAT TT=0.028	SAT TT=1.864 CHECKS=5680 NODES=832	SAT TT=2.921 CHECKS=130244 NODES=10142	SAT TT=0.429	SAT TT=0.369 CHECKS=70107	SAT TT=0.229 CHECKS=55893	SAT TT=1.735 ASSIGNMENTS=3135	SAT TT=1.542 ASSIGNMENTS=3135	SAT TT=0.041 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.039 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.03 ASSIGNMENTS=62 CHECKS=2035	SAT TT=0.12 ASSIGNMENTS=13120 CHECKS=283293	SAT TT=0.724	SAT TT=0.028 ASSIGNMENTS=52 CHECKS=1440	SAT TT=0.029 ASSIGNMENTS=84 CHECKS=3877	? TT=1.73	SAT TT=1.514	SAT TT=1.999
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd6/ normalized-bibd-6-30-15-3-6_glb.xml	SAT TT=0.082	SAT TT=3.2 CHECKS=9898 NODES=1527	SAT TT=3.256 CHECKS=43947 NODES=5537	SAT TT=105.615	SAT TT=0.82 CHECKS=171996	SAT TT=0.611 CHECKS=137634	SAT TT=4.232 ASSIGNMENTS=20540	SAT TT=4.205 ASSIGNMENTS=20540	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	SAT TT=0.284 ASSIGNMENTS=9635 CHECKS=572445	SAT TT=0.267 ASSIGNMENTS=9950 CHECKS=595078	SAT TT=9.563 ASSIGNMENTS=323773 CHECKS=29408500	SAT TT=0.847	SAT TT=0.082 ASSIGNMENTS=1438 CHECKS=69881	SAT TT=0.311 ASSIGNMENTS=11914 CHECKS=739122	? TT=2.077	SAT TT=2.175	SAT TT=2.041
csp/bibd6/ normalized-bibd-6-40-20-3-8_glb.xml	SAT TT=0.06	SAT TT=6.187 CHECKS=10479 NODES=1748	SAT TT=448.664 CHECKS=52963300 NODES=3487080	? (TO) TT=1800.03	SAT TT=9.36 CHECKS=2057880	SAT TT=3.493 CHECKS=782573	SAT TT=3.37 ASSIGNMENTS=12310	SAT TT=3.639 ASSIGNMENTS=12310	SAT TT=0.067 ASSIGNMENTS=272 CHECKS=15748	SAT TT=0.07 ASSIGNMENTS=272 CHECKS=15748	SAT TT=0.06 ASSIGNMENTS=275 CHECKS=16422	SAT TT=1.052 ASSIGNMENTS=47078 CHECKS=2578880	SAT TT=1.164	SAT TT=0.232 ASSIGNMENTS=4800 CHECKS=283923	SAT TT=0.813 ASSIGNMENTS=23484 CHECKS=1867720	? TT=2.216	SAT TT=2.342	SAT TT=2.707
csp/bibd6/ normalized-bibd-6-50-25-3-10_glb.xml	SAT TT=0.074	SAT TT=12.777 CHECKS=19849 NODES=3419	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=13.371 CHECKS=2692130	SAT TT=4.295 CHECKS=779543	SAT TT=2.786 ASSIGNMENTS=5051	SAT TT=2.826 ASSIGNMENTS=5051	SAT TT=0.196 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.193 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.159 ASSIGNMENTS=2728 CHECKS=243038	SAT TT=0.277 ASSIGNMENTS=33082 CHECKS=542137	SAT TT=1.047	SAT TT=1.204 ASSIGNMENTS=23249 CHECKS=1586990	SAT TT=0.074 ASSIGNMENTS=402 CHECKS=19997	? TT=2.503	SAT TT=3.064	SAT TT=2.94
csp/bibd6/ normalized-bibd-6-60-30-3-12_glb.xml	SAT TT=1.132	SAT TT=20 CHECKS=16299 NODES=2887	SAT TT=18.768 CHECKS=565247 NODES=19954	? (TO) TT=1800.06	SAT TT=14.793 CHECKS=2304870	SAT TT=23.755 CHECKS=3943900	? (TO) TT=1800.12	? (TO) TT=1800.12	SAT TT=9.959 ASSIGNMENTS=59948 CHECKS=4536220	SAT TT=360.193 ASSIGNMENTS=1832390 CHECKS=65255500	? (TO) TT=1800.1	SAT TT=3.723 ASSIGNMENTS=104134 CHECKS=7917050	SAT TT=1.132	? (TO) TT=1800.03	SAT TT=2.191 ASSIGNMENTS=59948 CHECKS=4536220	? TT=2.834	SAT TT=2.669	SAT TT=3.376
csp/bibd6/ normalized-bibd-6-70-35-3-14_glb.xml	SAT TT=0.091	SAT TT=36.01 CHECKS=18935 NODES=3157	? (TO) TT=1800.13	? (TO) TT=1800.12	SAT TT=36.904 CHECKS=5708050	SAT TT=41.456 CHECKS=6101730	SAT TT=77.36 ASSIGNMENTS=267550	SAT TT=83.456 ASSIGNMENTS=267550	SAT TT=7.603 ASSIGNMENTS=321 CHECKS=12417	SAT TT=674.152 ASSIGNMENTS=321 CHECKS=12417	? (TO) TT=1800.09	SAT TT=773.342 ASSIGNMENTS=13978100 CHECKS=1590520000	SAT TT=1.373	SAT TT=3.362 ASSIGNMENTS=36156 CHECKS=3103070	SAT TT=0.091 ASSIGNMENTS=321 CHECKS=12417	? TT=3.146	SAT TT=3.161	SAT TT=4.336
csp/bibd6/ normalized-bibd-6-80-40-3-16_glb.xml	SAT TT=0.105	SAT TT=4.149 CHECKS=26033 NODES=4524	? (TO) TT=1800.17	? (TO) TT=1800.05	SAT TT=11.218 CHECKS=1367770	SAT TT=45.7 CHECKS=6134450	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=367.771 ASSIGNMENTS=286 CHECKS=10490	SAT TT=673.67 ASSIGNMENTS=286 CHECKS=10490	SAT TT=256.839 ASSIGNMENTS=10116200 CHECKS=440831000	SAT TT=14.713 ASSIGNMENTS=340188 CHECKS=24217700	SAT TT=2.407	SAT TT=2.767 ASSIGNMENTS=30151 CHECKS=2745450	SAT TT=0.105 ASSIGNMENTS=286 CHECKS=10490	? TT=3.059	SAT TT=7.464	SAT TT=5.607
csp/bibd6/ normalized-bibd-6-90-45-3-18_glb.xml	SAT TT=1.295	SAT TT=4.099 CHECKS=16396 NODES=3777	SAT TT=676.199 CHECKS=85573200 NODES=1415260	? (TO) TT=1800.09	SAT TT=105.604 CHECKS=12362100	SAT TT=182.167 CHECKS=21784700	? (TO) TT=1800.13	? (TO) TT=1800.11	SAT TT=369.213 ASSIGNMENTS=15562 CHECKS=1716710	SAT TT=675.973 ASSIGNMENTS=15562 CHECKS=1716710	? (TO) TT=1800.11	SAT TT=90.771 ASSIGNMENTS=1259360 CHECKS=141450000	SAT TT=5.814	? (TO) TT=1800.1	SAT TT=1.295 ASSIGNMENTS=15562 CHECKS=1716710	? TT=3.674	SAT TT=48.7	SAT TT=5.721
csp/bibd7/ normalized-bibd-7-07-3-3-1_glb.xml	SAT TT=0.016	SAT TT=1.047 CHECKS=1719 NODES=233	SAT TT=1.091 CHECKS=2464 NODES=216	SAT TT=0.071	SAT TT=0.083 CHECKS=3577	SAT TT=0.047 CHECKS=8159	SAT TT=0.881 ASSIGNMENTS=29	SAT TT=0.824 ASSIGNMENTS=29	SAT TT=0.03 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.028 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=911	SAT TT=0.019 ASSIGNMENTS=111 CHECKS=4968	SAT TT=0.622	SAT TT=0.019 ASSIGNMENTS=69 CHECKS=2031	SAT TT=0.016 ASSIGNMENTS=23 CHECKS=939	? TT=1.2	SAT TT=1.447	SAT TT=1.195
csp/bibd7/ normalized-bibd-7-14-6-3-2_glb.xml	SAT TT=0.026	SAT TT=1.516 CHECKS=32569 NODES=1640	SAT TT=1.671 CHECKS=39651 NODES=2182	SAT TT=0.128	SAT TT=0.3 CHECKS=61353	SAT TT=0.172 CHECKS=48698	SAT TT=1.143 ASSIGNMENTS=325	SAT TT=1.177 ASSIGNMENTS=325	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	SAT TT=0.038 ASSIGNMENTS=53 CHECKS=2300	SAT TT=0.027 ASSIGNMENTS=51 CHECKS=2299	SAT TT=0.026 ASSIGNMENTS=68 CHECKS=1372	SAT TT=0.712	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=3128	SAT TT=0.03 ASSIGNMENTS=171 CHECKS=12297	? TT=1.694	SAT TT=1.52	SAT TT=1.66
csp/bibd7/ normalized-bibd-7-21-9-3-3_glb.xml	SAT TT=0.035	SAT TT=2.131 CHECKS=57506 NODES=3420	SAT TT=2.307 CHECKS=99781 NODES=5313	SAT TT=0.469	SAT TT=0.674 CHECKS=155722	SAT TT=0.452 CHECKS=115293	SAT TT=1.455 ASSIGNMENTS=1058	SAT TT=1.37 ASSIGNMENTS=1058	SAT TT=0.058 ASSIGNMENTS=417 CHECKS=15349	SAT TT=0.057 ASSIGNMENTS=417 CHECKS=15349	SAT TT=0.088 ASSIGNMENTS=3788 CHECKS=146645	SAT TT=0.312 ASSIGNMENTS=25419 CHECKS=907503	SAT TT=1.074	SAT TT=0.069 ASSIGNMENTS=1345 CHECKS=59358	SAT TT=0.035 ASSIGNMENTS=80 CHECKS=2836	? TT=1.909	SAT TT=1.687	SAT TT=1.833
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd7/ normalized-bibd-7-28-12-3-4_glb.xml	SAT TT=0.048	SAT TT=2.814 CHECKS=34640 NODES=4038	SAT TT=28.574 CHECKS=4774700 NODES=169506	SAT TT=10.583	SAT TT=1.176 CHECKS=226301	SAT TT=0.745 CHECKS=188058	SAT TT=1.893 ASSIGNMENTS=1115	SAT TT=1.663 ASSIGNMENTS=1115	SAT TT=0.996 ASSIGNMENTS=62169 CHECKS=2205400	SAT TT=1.085 ASSIGNMENTS=62169 CHECKS=2205400	SAT TT=1.017 ASSIGNMENTS=62594 CHECKS=2345940	? (TO) TT=1800.02	SAT TT=1.055	SAT TT=0.2 ASSIGNMENTS=3968 CHECKS=305085	SAT TT=0.048 ASSIGNMENTS=98 CHECKS=2972	? TT=2.349	SAT TT=2.28	SAT TT=2.216
csp/bibd7/ normalized-bibd-7-35-15-3-5_glb.xml	SAT TT=0.062	SAT TT=311.658 CHECKS=77787000 NODES=1115990	SAT TT=11.648 CHECKS=2419940 NODES=30363	SAT TT=424.115	SAT TT=1.435 CHECKS=237386	SAT TT=2.4 CHECKS=624761	SAT TT=1.817 ASSIGNMENTS=1173	SAT TT=1.727 ASSIGNMENTS=1173	SAT TT=7.116 ASSIGNMENTS=294 CHECKS=17010	SAT TT=7.94 ASSIGNMENTS=294 CHECKS=17010	SAT TT=15.976 ASSIGNMENTS=877418 CHECKS=37314900	? (TO) TT=1800	SAT TT=1.179	SAT TT=0.304 ASSIGNMENTS=5621 CHECKS=388512	SAT TT=0.062 ASSIGNMENTS=294 CHECKS=17010	? TT=2.499	SAT TT=2.196	SAT TT=2.419
csp/bibd7/ normalized-bibd-7-42-18-3-6_glb.xml	SAT TT=1.002	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=9.224 CHECKS=2070440	SAT TT=1.186 CHECKS=212203	SAT TT=2.04 ASSIGNMENTS=1228	SAT TT=1.944 ASSIGNMENTS=1228	SAT TT=11.361 ASSIGNMENTS=103369 CHECKS=7276900	SAT TT=10.469 ASSIGNMENTS=103369 CHECKS=7276900	SAT TT=72.958 ASSIGNMENTS=3188800 CHECKS=162715000	? (TO) TT=1800.07	SAT TT=1.002	SAT TT=1.65 ASSIGNMENTS=28568 CHECKS=1917350	SAT TT=3.396 ASSIGNMENTS=103369 CHECKS=7276900	? TT=2.97	SAT TT=2.896	SAT TT=3.034
csp/bibd7/ normalized-bibd-7-49-21-3-7_glb.xml	SAT TT=0.393	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=26.21 CHECKS=4502970	SAT TT=1.724 CHECKS=313068	SAT TT=2.185 ASSIGNMENTS=1274	SAT TT=2.532 ASSIGNMENTS=1274	SAT TT=8.109 ASSIGNMENTS=7900 CHECKS=675074	SAT TT=12.403 ASSIGNMENTS=1778 CHECKS=9354	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=1.313	SAT TT=0.548 ASSIGNMENTS=6979 CHECKS=515398	SAT TT=0.393 ASSIGNMENTS=7900 CHECKS=675074	? TT=3.182	SAT TT=3.794	SAT TT=3.425
csp/bibd7/ normalized-bibd-7-56-24-3-8_glb.xml	SAT TT=0.152	SAT TT=22.952 CHECKS=3998430 NODES=55162	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=27.427 CHECKS=3470550	SAT TT=2.265 CHECKS=330601	SAT TT=3.08 ASSIGNMENTS=1318	SAT TT=2.833 ASSIGNMENTS=1318	SAT TT=7.647 ASSIGNMENTS=1592 CHECKS=106704	SAT TT=8.854 ASSIGNMENTS=2022 CHECKS=10479	? (TO) TT=1800.01	SAT TT=1.385 ASSIGNMENTS=85591 CHECKS=2681420	SAT TT=1.4	SAT TT=52.764 ASSIGNMENTS=799256 CHECKS=56559600	SAT TT=0.152 ASSIGNMENTS=1592 CHECKS=106704	? TT=2.987	SAT TT=3.344	SAT TT=3.754
csp/bibd7/ normalized-bibd-7-63-27-3-9_glb.xml	SAT TT=0.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=18.197 CHECKS=2478930	SAT TT=3.259 CHECKS=450309	SAT TT=3.128 ASSIGNMENTS=1364	SAT TT=3.367 ASSIGNMENTS=1364	SAT TT=7.122 ASSIGNMENTS=740 CHECKS=53457	SAT TT=8.937 ASSIGNMENTS=2229 CHECKS=11599	SAT TT=322.356 ASSIGNMENTS=7978280 CHECKS=654406000	SAT TT=1210.53 ASSIGNMENTS=28155400 CHECKS=2866900000	SAT TT=1.255	SAT TT=2.465 ASSIGNMENTS=27536 CHECKS=2020620	SAT TT=0.13 ASSIGNMENTS=740 CHECKS=53457	? TT=3.586	SAT TT=4.527	SAT TT=4.409
csp/bibd7/ normalized-bibd-7-70-30-3-10_glb.xml	SAT TT=1.243	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.1	SAT TT=30.246 CHECKS=3472150	SAT TT=3.489 CHECKS=463738	SAT TT=3.112 ASSIGNMENTS=1408	SAT TT=3.363 ASSIGNMENTS=1408	SAT TT=9.083 ASSIGNMENTS=2469 CHECKS=12814	SAT TT=10.085 ASSIGNMENTS=2469 CHECKS=12814	SAT TT=10.877 ASSIGNMENTS=297389 CHECKS=21473500	SAT TT=40.549 ASSIGNMENTS=1098250 CHECKS=84972500	SAT TT=1.243	SAT TT=29.125 ASSIGNMENTS=302858 CHECKS=26035900	SAT TT=8.348 ASSIGNMENTS=171688 CHECKS=15588600	? TT=3.512	SAT TT=953.226	SAT TT=5.469
csp/bibd7/ normalized-bibd-7-77-33-3-11_glb.xml	SAT TT=0.913	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=32.223 CHECKS=3143010	SAT TT=40.138 CHECKS=4402440	SAT TT=4.188 ASSIGNMENTS=1454	SAT TT=3.623 ASSIGNMENTS=1454	SAT TT=9.446 ASSIGNMENTS=2709 CHECKS=14006	SAT TT=10.065 ASSIGNMENTS=2709 CHECKS=14006	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1.624	? (TO) TT=1800.07	SAT TT=0.913 ASSIGNMENTS=15815 CHECKS=1208930	? TT=3.729	SAT TT=6.041	SAT TT=5.425
csp/bibd7/ normalized-bibd-7-84-36-3-12_glb.xml	SAT TT=0.227	? (TO) TT=1800.15	SAT TT=1499.78 CHECKS=199945000 NODES=2220580	? (TO) TT=1800.06	SAT TT=16.726 CHECKS=1428580	SAT TT=39.286 CHECKS=5013330	SAT TT=4.002 ASSIGNMENTS=1496	SAT TT=3.994 ASSIGNMENTS=1496	SAT TT=9.748 ASSIGNMENTS=2949 CHECKS=15196	SAT TT=9.507 ASSIGNMENTS=2949 CHECKS=15196	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=1.704	SAT TT=1163.06 ASSIGNMENTS=10205300 CHECKS=910157000	SAT TT=0.227 ASSIGNMENTS=1643 CHECKS=117182	? TT=3.843	SAT TT=10.634	SAT TT=8.065
csp/bibd7/ normalized-bibd-7-91-39-3-13_glb.xml	SAT TT=0.213	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.05	SAT TT=33.643 CHECKS=3294560	SAT TT=40.129 CHECKS=3631280	SAT TT=3.973 ASSIGNMENTS=1542	SAT TT=4.227 ASSIGNMENTS=1542	SAT TT=9.362 ASSIGNMENTS=3188 CHECKS=16384	SAT TT=10.12 ASSIGNMENTS=3188 CHECKS=16384	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.523	? (TO) TT=1800.08	SAT TT=0.213 ASSIGNMENTS=1294 CHECKS=106767	? TT=4.027	SAT TT=10.716	SAT TT=7.125
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd7/ normalized-bibd-7-98-42-3-14_glb.xml	SAT TT=0.272	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.78 CHECKS=4800760	SAT TT=5.056 ASSIGNMENTS=1588	SAT TT=4.674 ASSIGNMENTS=1588	SAT TT=10.294 ASSIGNMENTS=3370 CHECKS=17483	SAT TT=10.14 ASSIGNMENTS=3370 CHECKS=17483	? (TO) TT=1800.02	SAT TT=174.78 ASSIGNMENTS=3104970 CHECKS=324341000	SAT TT=1.814	SAT TT=9.232 ASSIGNMENTS=76148 CHECKS=7817730	SAT TT=0.272 ASSIGNMENTS=2664 CHECKS=139611	? TT=4.091	SAT TT=6.654	SAT TT=8.16
csp/bibd8/ normalized-bibd-8-14-7-4-3_glb.xml	SAT TT=0.046	SAT TT=1.578 CHECKS=29418 NODES=1633	SAT TT=2.957 CHECKS=10438 NODES=761	SAT TT=0.165	SAT TT=0.635 CHECKS=156588	SAT TT=0.454 CHECKS=151413	SAT TT=1.476 ASSIGNMENTS=665	SAT TT=1.199 ASSIGNMENTS=665	SAT TT=0.06 ASSIGNMENTS=336 CHECKS=41465	SAT TT=0.061 ASSIGNMENTS=336 CHECKS=41465	SAT TT=0.046 ASSIGNMENTS=331 CHECKS=35214	SAT TT=21.917 ASSIGNMENTS=761594 CHECKS=74014000	SAT TT=0.747	SAT TT=0.073 ASSIGNMENTS=1017 CHECKS=85432	SAT TT=0.051 ASSIGNMENTS=626 CHECKS=63104	? TT=1.763	SAT TT=1.604	SAT TT=1.946
csp/bibd8/ normalized-bibd-8-28-14-4-6_glb.xml	SAT TT=0.071	SAT TT=3.546 CHECKS=105912 NODES=4399	? (TO) TT=1800.09	SAT TT=29.635	? (TO) TT=1800.09	SAT TT=55.44 CHECKS=14017800	SAT TT=5.863 ASSIGNMENTS=16673	SAT TT=5.759 ASSIGNMENTS=16673	SAT TT=1.471 ASSIGNMENTS=41974 CHECKS=3519580	SAT TT=1.466 ASSIGNMENTS=41974 CHECKS=3519580	SAT TT=2.152 ASSIGNMENTS=56543 CHECKS=5610440	? (TO) TT=1800.04	SAT TT=1.36	SAT TT=0.155 ASSIGNMENTS=2045 CHECKS=145907	SAT TT=0.071 ASSIGNMENTS=227 CHECKS=20992	? TT=2.509	SAT TT=2.514	SAT TT=2.917
csp/bibd8/ normalized-bibd-8-42-21-4-9_glb.xml	SAT TT=0.156	SAT TT=114.529 CHECKS=21583500 NODES=321610	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=7.754 ASSIGNMENTS=1654 CHECKS=144137	SAT TT=7.749 ASSIGNMENTS=1654 CHECKS=144137	SAT TT=334.851 ASSIGNMENTS=8429860 CHECKS=762093000	? (TO) TT=1800.03	SAT TT=105.003	SAT TT=9.872 ASSIGNMENTS=127888 CHECKS=10155000	SAT TT=0.156 ASSIGNMENTS=1654 CHECKS=144137	? TT=2.955	SAT TT=3.763	SAT TT=5.361
csp/bibd8/ normalized-bibd-8-56-28-4-12_glb.xml	SAT TT=3.384	SAT TT=8.316 CHECKS=318842 NODES=18791	? (TO) TT=1800.17	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=11.106 ASSIGNMENTS=59651 CHECKS=7118020	SAT TT=677.581 ASSIGNMENTS=59651 CHECKS=7118020	? (TO) TT=1800.06	SAT TT=99.462 ASSIGNMENTS=2520650 CHECKS=221254000	? (TO) TT=1800.11	SAT TT=47.54 ASSIGNMENTS=279777 CHECKS=25351600	SAT TT=3.384 ASSIGNMENTS=59651 CHECKS=7118020	? TT=3.946	SAT TT=10.36	SAT TT=6.124
csp/bibd8/ normalized-bibd-8-70-35-4-15_glb.xml	SAT TT=0.334	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=295.907 ASSIGNMENTS=3522 CHECKS=367591	SAT TT=674.364 ASSIGNMENTS=3522 CHECKS=367591	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1302.61 ASSIGNMENTS=9685250 CHECKS=985236000	SAT TT=0.334 ASSIGNMENTS=3522 CHECKS=367591	? TT=4.399	SAT TT=232.861	SAT TT=17.66
csp/bibd8/ normalized-bibd-8-84-42-4-18_glb.xml	SAT TT=14.725	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=500.797 ASSIGNMENTS=1303030 CHECKS=222039000	SAT TT=792.696 ASSIGNMENTS=1303030 CHECKS=222039000	? (TO) TT=1800.01	SAT TT=806.14 ASSIGNMENTS=13590100 CHECKS=1386400000	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=118.781 ASSIGNMENTS=1303030 CHECKS=222039000	? TT=4.411	SAT TT=520.019	SAT TT=14.725
csp/bibd8/ normalized-bibd-8-98-49-4-21_glb.xml	SAT TT=34.245	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=4.841	? (TO) TT=1800.06	SAT TT=34.245
csp/bibd9/ normalized-bibd-9-108-36-3-9_glb.xml	SAT TT=14.398	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=291.811 CHECKS=22342100	? (TO) TT=1800.11	SAT TT=22.891 ASSIGNMENTS=13222	SAT TT=23.559 ASSIGNMENTS=13222	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=14.398 ASSIGNMENTS=334519 CHECKS=27771600	? (TO) TT=1800.09	SAT TT=1588.93 ASSIGNMENTS=7647320 CHECKS=700686000	? (TO) TT=1800.04	? TT=5.483	SAT TT=167.193	SAT TT=30.128
csp/bibd9/ normalized-bibd-9-120-40-3-10_glb.xml	SAT TT=0.871	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.14	SAT TT=368.595 ASSIGNMENTS=7085 CHECKS=530573	SAT TT=675.34 ASSIGNMENTS=7085 CHECKS=530573	? (TO) TT=1800.07	SAT TT=99.973 ASSIGNMENTS=1586200 CHECKS=158553000	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=0.871 ASSIGNMENTS=7085 CHECKS=530573	? TT=5.349	SAT TT=115.747	SAT TT=45.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibd9/ normalized-bibd-9-12-4-3-1_glb.xml	SAT TT=0.037	SAT TT=2.348 CHECKS=11964 NODES=821	SAT TT=2.191 CHECKS=32263 NODES=1906	SAT TT=0.158	SAT TT=0.631 CHECKS=190577	SAT TT=0.477 CHECKS=167456	SAT TT=1.307 ASSIGNMENTS=115	SAT TT=1.456 ASSIGNMENTS=115	SAT TT=0.045 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.048 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.037 ASSIGNMENTS=58 CHECKS=2378	SAT TT=0.169 ASSIGNMENTS=14335 CHECKS=423238	SAT TT=0.933	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=8323	SAT TT=0.038 ASSIGNMENTS=69 CHECKS=4002	? TT=1.957	SAT TT=1.715	SAT TT=2.189
csp/bibd9/ normalized-bibd-9-24-8-3-2_glb.xml	SAT TT=0.07	SAT TT=2.712 CHECKS=74694 NODES=2952	SAT TT=2.801 CHECKS=66623 NODES=3702	SAT TT=0.671	SAT TT=6.911 CHECKS=1617110	SAT TT=1.283 CHECKS=341177	SAT TT=2.741 ASSIGNMENTS=4025	SAT TT=2.778 ASSIGNMENTS=4025	SAT TT=0.084 ASSIGNMENTS=308 CHECKS=18117	SAT TT=0.079 ASSIGNMENTS=308 CHECKS=18117	SAT TT=0.07 ASSIGNMENTS=243 CHECKS=13195	SAT TT=214.547 ASSIGNMENTS=6643700 CHECKS=727034000	SAT TT=0.999	SAT TT=0.152 ASSIGNMENTS=2309 CHECKS=133863	SAT TT=0.076 ASSIGNMENTS=262 CHECKS=21306	? TT=2.937	SAT TT=2.489	SAT TT=2.766
csp/bibd9/ normalized-bibd-9-36-12-3-3_glb.xml	SAT TT=0.106	? (TO) TT=1800.16	SAT TT=5.571 CHECKS=339061 NODES=11710	SAT TT=233.001	SAT TT=41.459 CHECKS=6901980	SAT TT=54.671 CHECKS=10793900	SAT TT=130.377 ASSIGNMENTS=356835	SAT TT=115.796 ASSIGNMENTS=356835	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	SAT TT=0.12 ASSIGNMENTS=420 CHECKS=26450	SAT TT=0.106 ASSIGNMENTS=375 CHECKS=19837	? (TO) TT=1800.06	SAT TT=268.519	SAT TT=0.579 ASSIGNMENTS=5796 CHECKS=452272	SAT TT=0.795 ASSIGNMENTS=16527 CHECKS=1751210	? TT=3.375	SAT TT=3.71	SAT TT=3.952
csp/bibd9/ normalized-bibd-9-48-16-3-4_glb.xml	SAT TT=0.15	? (TO) TT=1800.07	SAT TT=565.36 CHECKS=69659400 NODES=1518290	? (TO) TT=1800.07	SAT TT=45.564 CHECKS=5967360	SAT TT=66.57 CHECKS=10584200	SAT TT=60.627 ASSIGNMENTS=134470	SAT TT=56.191 ASSIGNMENTS=134470	SAT TT=22.253 ASSIGNMENTS=294382 CHECKS=26675700	SAT TT=202.702 ASSIGNMENTS=866829 CHECKS=21414100	SAT TT=0.15 ASSIGNMENTS=564 CHECKS=33303	SAT TT=0.394 ASSIGNMENTS=70345 CHECKS=771266	SAT TT=2.522	SAT TT=1.479 ASSIGNMENTS=15704 CHECKS=1252640	SAT TT=14.732 ASSIGNMENTS=294382 CHECKS=26675700	? TT=4.133	SAT TT=3.933	SAT TT=4.986
csp/bibd9/ normalized-bibd-9-60-20-3-5_glb.xml	SAT TT=1.151	SAT TT=7.73 CHECKS=135085 NODES=8870	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=10.653 ASSIGNMENTS=5569	SAT TT=8.909 ASSIGNMENTS=5569	SAT TT=163.225 ASSIGNMENTS=2484140 CHECKS=241989000	SAT TT=127.187 ASSIGNMENTS=437888 CHECKS=11860600	SAT TT=39.873 ASSIGNMENTS=711468 CHECKS=71066000	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1.151 ASSIGNMENTS=7762 CHECKS=767877	SAT TT=144.648 ASSIGNMENTS=2484140 CHECKS=241989000	? TT=4.198	SAT TT=4.192	SAT TT=6.504
csp/bibd9/ normalized-bibd-9-72-24-3-6_glb.xml	SAT TT=6.305	SAT TT=1302.45 CHECKS=218612000 NODES=1459850	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=52 CHECKS=5525590	? (TO) TT=1800.08	SAT TT=12.21 ASSIGNMENTS=11878	SAT TT=11.478 ASSIGNMENTS=11878	SAT TT=311.361 ASSIGNMENTS=240509 CHECKS=25565200	SAT TT=691.011 ASSIGNMENTS=240509 CHECKS=25565200	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=1077.09	SAT TT=22.735 ASSIGNMENTS=143663 CHECKS=16548800	SAT TT=15.905 ASSIGNMENTS=240509 CHECKS=25565200	? TT=4.444	SAT TT=6.305	SAT TT=8.582
csp/bibd9/ normalized-bibd-9-84-28-3-7_glb.xml	SAT TT=1.794	SAT TT=112.244 CHECKS=9809070 NODES=156280	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=13.793 ASSIGNMENTS=6301	SAT TT=13.592 ASSIGNMENTS=6301	SAT TT=382.144 ASSIGNMENTS=208582 CHECKS=19630600	SAT TT=686.701 ASSIGNMENTS=208582 CHECKS=19630600	SAT TT=1.794 ASSIGNMENTS=26304 CHECKS=2289120	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=298.891 ASSIGNMENTS=1870190 CHECKS=175327000	SAT TT=12.92 ASSIGNMENTS=208582 CHECKS=19630600	? TT=4.936	SAT TT=9.769	SAT TT=9.569
csp/bibd9/ normalized-bibd-9-96-32-3-8_glb.xml	SAT TT=0.406	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=359.146 CHECKS=20042200	SAT TT=1300.31 CHECKS=133010000	SAT TT=30.167 ASSIGNMENTS=14183	SAT TT=30.303 ASSIGNMENTS=14183	SAT TT=368.575 ASSIGNMENTS=2562 CHECKS=126677	SAT TT=676.529 ASSIGNMENTS=2562 CHECKS=126677	? (TO) TT=1800.11	SAT TT=69.628 ASSIGNMENTS=978404 CHECKS=121245000	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=0.406 ASSIGNMENTS=2562 CHECKS=126677	? TT=5.624	SAT TT=32.364	SAT TT=12.968
csp/bibdVariousK/ normalized-bibd-10-15-6-4-2_glb.xml	SAT TT=0.055	SAT TT=8.371 CHECKS=1071520 NODES=45275	SAT TT=2.44 CHECKS=98265 NODES=2725	SAT TT=0.341	SAT TT=3.696 CHECKS=1060730	SAT TT=0.907 CHECKS=293522	SAT TT=1.905 ASSIGNMENTS=2103	SAT TT=2.143 ASSIGNMENTS=2103	SAT TT=0.065 ASSIGNMENTS=116 CHECKS=8968	SAT TT=0.067 ASSIGNMENTS=116 CHECKS=8968	SAT TT=0.055 ASSIGNMENTS=144 CHECKS=11869	SAT TT=28.382 ASSIGNMENTS=906311 CHECKS=91250100	SAT TT=1.226	SAT TT=0.061 ASSIGNMENTS=294 CHECKS=14109	SAT TT=0.095 ASSIGNMENTS=1078 CHECKS=123262	? TT=2.434	SAT TT=2.215	SAT TT=2.763
csp/bibdVariousK/ normalized-bibd-10-18-9-5-4_glb.xml	SAT TT=0.078	SAT TT=45.947 CHECKS=6929210 NODES=262761	SAT TT=29.861 CHECKS=5683630 NODES=155132	SAT TT=0.525	SAT TT=1.64 CHECKS=302509	SAT TT=152.915 CHECKS=48281600	SAT TT=6.145 ASSIGNMENTS=21703	SAT TT=6.391 ASSIGNMENTS=21703	SAT TT=0.079 ASSIGNMENTS=383 CHECKS=32136	SAT TT=0.085 ASSIGNMENTS=383 CHECKS=32136	SAT TT=0.078 ASSIGNMENTS=511 CHECKS=43639	? (TO) TT=1800.05	SAT TT=0.996	SAT TT=0.268 ASSIGNMENTS=3522 CHECKS=317321	SAT TT=0.219 ASSIGNMENTS=4745 CHECKS=426734	? TT=2.752	SAT TT=2.763	SAT TT=2.93
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-11-11-5-5-2_glb.xml	SAT TT=0.049	SAT TT=1.926 CHECKS=33309 NODES=1311	SAT TT=2.482 CHECKS=47962 NODES=2196	SAT TT=0.2	SAT TT=0.81 CHECKS=186374	SAT TT=0.467 CHECKS=153862	SAT TT=1.377 ASSIGNMENTS=165	SAT TT=1.353 ASSIGNMENTS=165	SAT TT=0.061 ASSIGNMENTS=54 CHECKS=4969	SAT TT=0.06 ASSIGNMENTS=54 CHECKS=4969	SAT TT=0.049 ASSIGNMENTS=61 CHECKS=5277	SAT TT=0.465 ASSIGNMENTS=22610 CHECKS=1355340	SAT TT=1.112	SAT TT=0.078 ASSIGNMENTS=772 CHECKS=46017	SAT TT=0.053 ASSIGNMENTS=129 CHECKS=16455	? TT=2.338	SAT TT=2.047	SAT TT=2.456
csp/bibdVariousK/ normalized-bibd-11-22-10-5-4_glb.xml	SAT TT=0.319	SAT TT=798.467 CHECKS=125798000 NODES=3344730	SAT TT=7.627 CHECKS=1448000 NODES=15589	SAT TT=1.692	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=30.544 ASSIGNMENTS=104280	SAT TT=29.054 ASSIGNMENTS=104280	SAT TT=0.327 ASSIGNMENTS=6037 CHECKS=565287	SAT TT=0.319 ASSIGNMENTS=6037 CHECKS=565287	SAT TT=1.353 ASSIGNMENTS=35789 CHECKS=3429870	? (TO) TT=1800.03	SAT TT=1.261	SAT TT=0.417 ASSIGNMENTS=4561 CHECKS=487995	SAT TT=0.499 ASSIGNMENTS=11252 CHECKS=1055430	? TT=2.988	SAT TT=2.673	SAT TT=4.733
csp/bibdVariousK/ normalized-bibd-12-22-11-6-5_glb.xml	SAT TT=0.171	SAT TT=408.848 CHECKS=52060500 NODES=1540310	? (TO) TT=1800.13	SAT TT=2.737	SAT TT=20.694 CHECKS=2300710	SAT TT=19.967 CHECKS=4242880	SAT TT=47.569 ASSIGNMENTS=108490	SAT TT=53.18 ASSIGNMENTS=108490	SAT TT=8.219 ASSIGNMENTS=1869 CHECKS=199414	SAT TT=8.135 ASSIGNMENTS=1869 CHECKS=199414	SAT TT=40.452 ASSIGNMENTS=885487 CHECKS=108857000	? (TO) TT=1800.05	SAT TT=5.101	SAT TT=0.934 ASSIGNMENTS=10043 CHECKS=1199410	SAT TT=0.171 ASSIGNMENTS=1869 CHECKS=199414	? TT=3.347	SAT TT=7.042	SAT TT=10.59
csp/bibdVariousK/ normalized-bibd-13-13-4-4-1_glb.xml	SAT TT=0.078	SAT TT=2.393 CHECKS=36768 NODES=1746	SAT TT=5.405 CHECKS=179926 NODES=12686	SAT TT=0.346	SAT TT=4.909 CHECKS=1398930	SAT TT=2.897 CHECKS=979719	SAT TT=2.147 ASSIGNMENTS=215	SAT TT=1.716 ASSIGNMENTS=215	SAT TT=0.087 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.087 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.078 ASSIGNMENTS=82 CHECKS=5407	SAT TT=0.367 ASSIGNMENTS=30505 CHECKS=935746	SAT TT=1.002	SAT TT=0.083 ASSIGNMENTS=161 CHECKS=7200	SAT TT=0.079 ASSIGNMENTS=109 CHECKS=13780	? TT=2.89	SAT TT=2.765	SAT TT=3.121
csp/bibdVariousK/ normalized-bibd-13-26-8-4-2_glb.xml	SAT TT=0.431	SAT TT=7.704 CHECKS=564591 NODES=8297	SAT TT=115.002 CHECKS=14535800 NODES=263626	SAT TT=1.216	SAT TT=12.2 CHECKS=1110670	SAT TT=5.237 CHECKS=943043	SAT TT=5.065 ASSIGNMENTS=1999	SAT TT=5.122 ASSIGNMENTS=1999	SAT TT=0.537 ASSIGNMENTS=6358 CHECKS=949515	SAT TT=0.54 ASSIGNMENTS=6358 CHECKS=949515	SAT TT=0.525 ASSIGNMENTS=6710 CHECKS=961162	? (TO) TT=1800.1	SAT TT=1.457	SAT TT=1.343 ASSIGNMENTS=11961 CHECKS=1820670	SAT TT=0.431 ASSIGNMENTS=4204 CHECKS=631910	? TT=4.179	SAT TT=4.261	SAT TT=7.075
csp/bibdVariousK/ normalized-bibd-14-26-13-7-6_glb.xml	SAT TT=26.222	? (TO) TT=1800.16	? (TO) TT=1800.04	SAT TT=26.222	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=74.611 ASSIGNMENTS=1137880 CHECKS=170945000	SAT TT=74.915 ASSIGNMENTS=1137880 CHECKS=170945000	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=28.629 ASSIGNMENTS=242577 CHECKS=32072600	SAT TT=60.691 ASSIGNMENTS=1137880 CHECKS=170945000	? TT=4.547	SAT TT=41.384	SAT TT=345.198
csp/bibdVariousK/ normalized-bibd-15-15-7-7-3_glb.xml	SAT TT=0.203	SAT TT=45.592 CHECKS=6693710 NODES=159504	? (TO) TT=1800.16	SAT TT=0.568	SAT TT=3.943 CHECKS=577552	SAT TT=6.532 CHECKS=1487960	SAT TT=6.281 ASSIGNMENTS=4230	SAT TT=6.118 ASSIGNMENTS=4230	SAT TT=8.264 ASSIGNMENTS=1743 CHECKS=251439	SAT TT=8.031 ASSIGNMENTS=1743 CHECKS=251439	SAT TT=0.216 ASSIGNMENTS=2744 CHECKS=321799	? (TO) TT=1800.03	SAT TT=1.348	SAT TT=0.522 ASSIGNMENTS=4547 CHECKS=642747	SAT TT=0.203 ASSIGNMENTS=1743 CHECKS=251439	? TT=3.543	SAT TT=3.476	SAT TT=3.632
csp/bibdVariousK/ normalized-bibd-15-21-7-5-2_glb.xml		? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=4.25	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/bibdVariousK/ normalized-bibd-15-35-7-3-1_glb.xml	SAT TT=0.297	SAT TT=12.115 CHECKS=498982 NODES=9543	? (TO) TT=1800.14	SAT TT=2.14	SAT TT=431.927 CHECKS=56524300	SAT TT=105.935 CHECKS=13664200	SAT TT=56.518 ASSIGNMENTS=27234	SAT TT=56.754 ASSIGNMENTS=27234	SAT TT=0.311 ASSIGNMENTS=546 CHECKS=40407	SAT TT=0.314 ASSIGNMENTS=546 CHECKS=40407	SAT TT=0.303 ASSIGNMENTS=548 CHECKS=45046	? (TO) TT=1800.06	SAT TT=2.359	SAT TT=3.099 ASSIGNMENTS=20498 CHECKS=2034390	SAT TT=0.297 ASSIGNMENTS=625 CHECKS=76648	? TT=5.644	SAT TT=6.16	SAT TT=8.034
csp/bibdVariousK/ normalized-bibd-15-45-24-8-12_glb.xml	SAT TT=717.186	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.16	SAT TT=762.586 ASSIGNMENTS=6870490 CHECKS=1069540000	SAT TT=744.143 ASSIGNMENTS=6870490 CHECKS=1069540000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=764.403 ASSIGNMENTS=6870490 CHECKS=1069540000	? TT=5.988	? (TO) TT=1800.05	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-15-70-14-3-2_glb.xml	SAT TT=1.074	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=221.719 CHECKS=12321900	? (TO) TT=1800.12	? (TO) TT=1800.15	SAT TT=1.827 ASSIGNMENTS=13972 CHECKS=1691190	SAT TT=1.63 ASSIGNMENTS=13972 CHECKS=1691190	SAT TT=1.074 ASSIGNMENTS=5813 CHECKS=688149	? (TO) TT=1800.07	SAT TT=5.208	? (TO) TT=1800.09	? (TO) TT=1800.02	? TT=6.343	SAT TT=35.086	SAT TT=19.995
csp/bibdVariousK/ normalized-bibd-15-75-40-8-20_glb.xml		? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=6.035	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/bibdVariousK/ normalized-bibd-16-16-6-6-2_glb.xml	SAT TT=0.152	SAT TT=73.421 CHECKS=8815960 NODES=173623	SAT TT=1231.89 CHECKS=142994000 NODES=3067590	SAT TT=12.643	SAT TT=17.516 CHECKS=2173460	SAT TT=5.276 CHECKS=1190140	SAT TT=6.687 ASSIGNMENTS=7723	SAT TT=7.279 ASSIGNMENTS=7723	SAT TT=0.159 ASSIGNMENTS=165 CHECKS=18708	SAT TT=0.152 ASSIGNMENTS=165 CHECKS=18708	SAT TT=0.158 ASSIGNMENTS=339 CHECKS=51718	? (TO) TT=1800.06	SAT TT=147.284	SAT TT=0.515 ASSIGNMENTS=3410 CHECKS=684970	SAT TT=0.228 ASSIGNMENTS=1493 CHECKS=243560	? TT=3.876	SAT TT=3.953	SAT TT=4.537
csp/bibdVariousK/ normalized-bibd-16-20-5-4-1_glb.xml	SAT TT=0.199	SAT TT=6.156 CHECKS=216795 NODES=5734	SAT TT=648.254 CHECKS=51318800 NODES=1651900	SAT TT=0.774	SAT TT=27.926 CHECKS=5688060	SAT TT=9.09 CHECKS=2148840	SAT TT=4.136 ASSIGNMENTS=1015	SAT TT=4.587 ASSIGNMENTS=1015	SAT TT=0.228 ASSIGNMENTS=437 CHECKS=99614	SAT TT=0.227 ASSIGNMENTS=437 CHECKS=99614	SAT TT=0.199 ASSIGNMENTS=342 CHECKS=60978	SAT TT=0.679 ASSIGNMENTS=76486 CHECKS=1506930	SAT TT=1.688	SAT TT=1.208 ASSIGNMENTS=7758 CHECKS=1626410	SAT TT=0.558 ASSIGNMENTS=5469 CHECKS=1077860	? TT=4.479	SAT TT=4.118	SAT TT=4.773
csp/bibdVariousK/ normalized-bibd-16-24-9-6-3_glb.xml	SAT TT=0.399	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=2.61	? (TO) TT=1800.12	SAT TT=10.862 CHECKS=1313800	SAT TT=116.588 ASSIGNMENTS=78620	SAT TT=151.006 ASSIGNMENTS=78620	SAT TT=7.447 ASSIGNMENTS=2522 CHECKS=462620	SAT TT=8.364 ASSIGNMENTS=2522 CHECKS=462620	SAT TT=56.773 ASSIGNMENTS=938751 CHECKS=147812000	? (TO) TT=1800.07	SAT TT=1.834	SAT TT=2.08 ASSIGNMENTS=10375 CHECKS=1692080	SAT TT=0.399 ASSIGNMENTS=2522 CHECKS=462620	? TT=4.586	SAT TT=42.336	SAT TT=14.494
csp/bibdVariousK/ normalized-bibd-16-80-15-3-2_glb.xml	SAT TT=7.905	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=36.123 ASSIGNMENTS=302269 CHECKS=34118400	? (TO) TT=1800.06	SAT TT=7.905	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=6.697	SAT TT=35.684	SAT TT=27.411
csp/bibdVariousK/ normalized-bibd-19-19-9-9-4_glb.xml	SAT TT=0.739	? (TO) TT=1800.06	? (TO) TT=1800.13	SAT TT=1.96	SAT TT=17.105 CHECKS=1737900	SAT TT=14.27 CHECKS=1619630	SAT TT=148.528 ASSIGNMENTS=82955	SAT TT=149.537 ASSIGNMENTS=82955	SAT TT=0.743 ASSIGNMENTS=6963 CHECKS=1190440	SAT TT=0.739 ASSIGNMENTS=6963 CHECKS=1190440	SAT TT=99.275 ASSIGNMENTS=1386960 CHECKS=228854000	? (TO) TT=1800.09	SAT TT=2.164	SAT TT=3.82 ASSIGNMENTS=11199 CHECKS=1736870	SAT TT=0.873 ASSIGNMENTS=8278 CHECKS=1474170	? TT=5.529	SAT TT=37.976	SAT TT=39.253
csp/bibdVariousK/ normalized-bibd-19-57-9-3-1_glb.xml	SAT TT=7.185	? (TO) TT=1800.17	? (TO) TT=1800.17	SAT TT=52.3	? (TO) TT=1800.1	SAT TT=136.736 CHECKS=5687450	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=163.954 ASSIGNMENTS=667115 CHECKS=178388000	SAT TT=816.734 ASSIGNMENTS=667115 CHECKS=178388000	SAT TT=1272.85 ASSIGNMENTS=11049200 CHECKS=2137530000	? (TO) TT=1800.03	SAT TT=7.185	? (TO) TT=1800.07	SAT TT=154.017 ASSIGNMENTS=667115 CHECKS=178388000	? TT=6.818	SAT TT=17.235	SAT TT=805.807
csp/bibdVariousK/ normalized-bibd-21-21-5-5-1_glb.xml	SAT TT=0.335	? (TO) TT=1800.08	SAT TT=596.449 CHECKS=43867700 NODES=770759	SAT TT=1.388	SAT TT=65.474 CHECKS=11765700	SAT TT=10.368 CHECKS=1405540	SAT TT=9.343 ASSIGNMENTS=1732	SAT TT=7.827 ASSIGNMENTS=1732	SAT TT=0.335 ASSIGNMENTS=253 CHECKS=27497	SAT TT=0.339 ASSIGNMENTS=253 CHECKS=27497	SAT TT=0.391 ASSIGNMENTS=584 CHECKS=143586	? (TO) TT=1800.03	SAT TT=2.307	SAT TT=159.922 ASSIGNMENTS=722974 CHECKS=220218000	SAT TT=0.556 ASSIGNMENTS=2075 CHECKS=601484	? TT=5.352	SAT TT=6.936	SAT TT=7.663
csp/bibdVariousK/ normalized-bibd-21-28-8-6-2_glb.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=6.315	? (TO) TT=1800.09	? (TO) TT=1800
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bibdVariousK/ normalized-bibd-22-22-7-7-2_glb.xml		? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=6.136	? (TO) TT=1800.06	? (TO) TT=1800.04
csp/bibdVariousK/ normalized-bibd-25-25-9-9-3_glb.xml	SAT TT=1.365	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=9.97	? (TO) TT=1800.13	? (TO) TT=1800.03	SAT TT=577.039 ASSIGNMENTS=141154	SAT TT=579.181 ASSIGNMENTS=141154	SAT TT=1.426 ASSIGNMENTS=7791 CHECKS=1692470	SAT TT=1.365 ASSIGNMENTS=7791 CHECKS=1692470	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=520.464 ASSIGNMENTS=1603970 CHECKS=391247000	SAT TT=176.577 ASSIGNMENTS=1263490 CHECKS=337356000	? TT=5.865	SAT TT=630.377	SAT TT=849.669
csp/bibdVariousK/ normalized-bibd-25-30-6-5-1_glb.xml	SAT TT=0.989	SAT TT=60.18 CHECKS=1947270 NODES=24047	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=191.712 ASSIGNMENTS=44735	SAT TT=172.719 ASSIGNMENTS=44735	SAT TT=0.989 ASSIGNMENTS=1882 CHECKS=736936	SAT TT=0.991 ASSIGNMENTS=1882 CHECKS=736936	SAT TT=117.894 ASSIGNMENTS=684454 CHECKS=288611000	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=6.393	SAT TT=55.076	SAT TT=28.891
csp/bibdVariousK/ normalized-bibd-31-31-6-6-1_glb.xml	SAT TT=1.41	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1.41 ASSIGNMENTS=932 CHECKS=306772	SAT TT=1.41 ASSIGNMENTS=932 CHECKS=306772	SAT TT=932.354 ASSIGNMENTS=3000640 CHECKS=1718230000	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=1.825 ASSIGNMENTS=2010 CHECKS=707826	? TT=7.739	SAT TT=134.334	SAT TT=65.163
csp/bibdVariousK/ normalized-bibd-7-210-60-2-10_glb.xml	SAT TT=0.708	SAT TT=18.051 CHECKS=212834 NODES=17675	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=34.293 CHECKS=1289420	SAT TT=369.071 CHECKS=12347500	SAT TT=22.307 ASSIGNMENTS=6948	SAT TT=23.05 ASSIGNMENTS=6948	SAT TT=764.51 ASSIGNMENTS=3025 CHECKS=188602	SAT TT=1502.64 ASSIGNMENTS=3025 CHECKS=188602	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=3.329	SAT TT=2.452 ASSIGNMENTS=10035 CHECKS=449325	SAT TT=0.708 ASSIGNMENTS=3025 CHECKS=188602	? TT=5.48	SAT TT=11.846	SAT TT=20.956
csp/bibdVariousK/ normalized-bibd-8-56-21-3-6_glb.xml	SAT TT=0.138	SAT TT=260.701 CHECKS=55128300 NODES=616940	SAT TT=175.886 CHECKS=34236000 NODES=230831	? (TO) TT=1800.11	SAT TT=43.128 CHECKS=6077700	SAT TT=60.501 CHECKS=8364800	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=1.486 ASSIGNMENTS=32282 CHECKS=2722100	SAT TT=1.487 ASSIGNMENTS=32282 CHECKS=2722100	SAT TT=1.397 ASSIGNMENTS=32439 CHECKS=2736920	SAT TT=484.511 ASSIGNMENTS=12931800 CHECKS=1050490000	SAT TT=25.625	SAT TT=0.525 ASSIGNMENTS=4410 CHECKS=265577	SAT TT=0.138 ASSIGNMENTS=505 CHECKS=29146	? TT=4.082	SAT TT=11.447	SAT TT=5.013
csp/bibdVariousK/ normalized-bibd-9-18-8-4-3_glb.xml	SAT TT=0.058	SAT TT=2.306 CHECKS=139820 NODES=4302	SAT TT=2.878 CHECKS=109912 NODES=3300	SAT TT=0.332	SAT TT=7.715 CHECKS=2287710	SAT TT=9.806 CHECKS=3384320	SAT TT=3.98 ASSIGNMENTS=13065	SAT TT=3.857 ASSIGNMENTS=13065	SAT TT=0.068 ASSIGNMENTS=193 CHECKS=15804	SAT TT=0.064 ASSIGNMENTS=193 CHECKS=15804	SAT TT=0.382 ASSIGNMENTS=8326 CHECKS=927274	SAT TT=0.476 ASSIGNMENTS=30636 CHECKS=1317700	SAT TT=0.86	SAT TT=0.288 ASSIGNMENTS=4585 CHECKS=458650	SAT TT=0.058 ASSIGNMENTS=141 CHECKS=14754	? TT=2.236	SAT TT=2.066	SAT TT=2.579
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-13_glb.xml	SAT TT=0.011	SAT TT=0.795 CHECKS=605 NODES=473	SAT TT=0.985 CHECKS=104 NODES=124	SAT TT=0.044	SAT TT=0.015 CHECKS=1084	SAT TT=0.012 CHECKS=1270	SAT TT=0.566 ASSIGNMENTS=4	SAT TT=0.515 ASSIGNMENTS=4	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=3051	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=3051	SAT TT=0.011 ASSIGNMENTS=39 CHECKS=3739	SAT TT=0.16 ASSIGNMENTS=4003 CHECKS=297875	SAT TT=0.368	SAT TT=0.02 ASSIGNMENTS=240 CHECKS=14646	SAT TT=0.016 ASSIGNMENTS=97 CHECKS=12613	SAT TT=1.181	SAT TT=1.134	SAT TT=1.102
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-31_glb.xml	SAT TT=0.022	SAT TT=0.866 CHECKS=350 NODES=448	SAT TT=0.807 CHECKS=103 NODES=181	SAT TT=0.051	SAT TT=0.046 CHECKS=15542	SAT TT=0.024 CHECKS=4648	SAT TT=0.708 ASSIGNMENTS=11	SAT TT=0.738 ASSIGNMENTS=9	SAT TT=0.045 ASSIGNMENTS=412 CHECKS=42094	SAT TT=0.045 ASSIGNMENTS=412 CHECKS=42094	SAT TT=0.022 ASSIGNMENTS=227 CHECKS=24344	SAT TT=0.045 ASSIGNMENTS=941 CHECKS=67526	SAT TT=0.407	SAT TT=0.029 ASSIGNMENTS=396 CHECKS=29043	SAT TT=0.022 ASSIGNMENTS=233 CHECKS=23280	SAT TT=1.005	SAT TT=1.051	SAT TT=1.179
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-33_glb.xml	SAT TT=0.012	SAT TT=0.927 CHECKS=1309 NODES=751	SAT TT=0.941 CHECKS=1218 NODES=763	SAT TT=0.049	SAT TT=0.15 CHECKS=72043	SAT TT=0.173 CHECKS=86937	SAT TT=0.91 ASSIGNMENTS=7	SAT TT=0.853 ASSIGNMENTS=7	SAT TT=0.025 ASSIGNMENTS=66 CHECKS=5560	SAT TT=0.024 ASSIGNMENTS=66 CHECKS=5560	SAT TT=0.012 ASSIGNMENTS=55 CHECKS=5105	SAT TT=0.166 ASSIGNMENTS=4017 CHECKS=296163	SAT TT=0.432	SAT TT=0.041 ASSIGNMENTS=635 CHECKS=52962	SAT TT=0.035 ASSIGNMENTS=398 CHECKS=45862	SAT TT=1.282	SAT TT=1.264	SAT TT=1.073
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-63_glb.xml	SAT TT=0.026	SAT TT=0.842 CHECKS=1816 NODES=849	SAT TT=0.977 CHECKS=907 NODES=669	SAT TT=0.046	SAT TT=0.05 CHECKS=22866	SAT TT=0.051 CHECKS=22331	SAT TT=0.711 ASSIGNMENTS=4	SAT TT=0.691 ASSIGNMENTS=6	SAT TT=0.045 ASSIGNMENTS=417 CHECKS=52336	SAT TT=0.046 ASSIGNMENTS=417 CHECKS=52336	SAT TT=0.037 ASSIGNMENTS=494 CHECKS=58735	SAT TT=0.165 ASSIGNMENTS=4205 CHECKS=314230	SAT TT=0.37	SAT TT=0.026 ASSIGNMENTS=350 CHECKS=25978	SAT TT=0.039 ASSIGNMENTS=457 CHECKS=62340	SAT TT=1.12	SAT TT=1.136	SAT TT=1.158
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-67_glb.xml	SAT TT=0.015	SAT TT=0.831 CHECKS=1875 NODES=908	SAT TT=0.862 CHECKS=30 NODES=0	SAT TT=0.062	SAT TT=0.018 CHECKS=3678	SAT TT=0.015 CHECKS=1862	SAT TT=0.538 ASSIGNMENTS=2	SAT TT=0.545 ASSIGNMENTS=4	SAT TT=0.036 ASSIGNMENTS=225 CHECKS=30433	SAT TT=0.039 ASSIGNMENTS=225 CHECKS=30433	SAT TT=0.032 ASSIGNMENTS=313 CHECKS=48192	SAT TT=0.173 ASSIGNMENTS=3812 CHECKS=314521	SAT TT=0.367	SAT TT=0.023 ASSIGNMENTS=308 CHECKS=19180	SAT TT=0.028 ASSIGNMENTS=287 CHECKS=37196	SAT TT=1.068	SAT TT=1.135	SAT TT=1.174
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-75_glb.xml	SAT TT=0.013	SAT TT=0.794 CHECKS=831 NODES=611	SAT TT=0.794 CHECKS=30 NODES=109	SAT TT=0.049	SAT TT=0.041 CHECKS=13519	SAT TT=0.056 CHECKS=18452	SAT TT=0.857 ASSIGNMENTS=20	SAT TT=0.914 ASSIGNMENTS=7	SAT TT=0.024 ASSIGNMENTS=63 CHECKS=4047	SAT TT=0.021 ASSIGNMENTS=63 CHECKS=4047	SAT TT=0.013 ASSIGNMENTS=97 CHECKS=6552	SAT TT=0.054 ASSIGNMENTS=1380 CHECKS=83090	SAT TT=0.391	SAT TT=0.022 ASSIGNMENTS=345 CHECKS=15863	SAT TT=0.013 ASSIGNMENTS=50 CHECKS=5097	SAT TT=0.99	SAT TT=1.329	SAT TT=1.352
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-82_glb.xml	SAT TT=0.014	SAT TT=0.843 CHECKS=1451 NODES=754	SAT TT=0.805 CHECKS=281 NODES=283	SAT TT=0.047	SAT TT=0.02 CHECKS=3223	SAT TT=0.026 CHECKS=5864	SAT TT=0.751 ASSIGNMENTS=8	SAT TT=0.829 ASSIGNMENTS=14	SAT TT=0.026 ASSIGNMENTS=106 CHECKS=7593	SAT TT=0.025 ASSIGNMENTS=106 CHECKS=7593	SAT TT=0.015 ASSIGNMENTS=133 CHECKS=9470	SAT TT=0.014 ASSIGNMENTS=105 CHECKS=8546	SAT TT=0.384	SAT TT=0.039 ASSIGNMENTS=682 CHECKS=48368	SAT TT=0.023 ASSIGNMENTS=264 CHECKS=26101	SAT TT=1.04	SAT TT=1.09	SAT TT=1.082
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-83_glb.xml	SAT TT=0.047	SAT TT=0.824 CHECKS=949 NODES=599	SAT TT=0.946 CHECKS=1836 NODES=987	SAT TT=0.047	SAT TT=0.104 CHECKS=34417	SAT TT=0.072 CHECKS=25778	SAT TT=0.937 ASSIGNMENTS=12	SAT TT=0.778 ASSIGNMENTS=10	SAT TT=0.056 ASSIGNMENTS=586 CHECKS=69930	SAT TT=0.058 ASSIGNMENTS=586 CHECKS=69930	SAT TT=0.171 ASSIGNMENTS=2621 CHECKS=312912	SAT TT=0.191 ASSIGNMENTS=4210 CHECKS=363591	SAT TT=0.393	SAT TT=0.133 ASSIGNMENTS=1795 CHECKS=203463	SAT TT=0.078 ASSIGNMENTS=1015 CHECKS=135933	SAT TT=1.081	SAT TT=1.089	SAT TT=1.122
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-98_glb.xml	SAT TT=0.015	SAT TT=0.899 CHECKS=804 NODES=444	SAT TT=0.815 CHECKS=86 NODES=127	SAT TT=0.046	SAT TT=0.051 CHECKS=24996	SAT TT=0.057 CHECKS=26060	SAT TT=0.695 ASSIGNMENTS=5	SAT TT=0.661 ASSIGNMENTS=5	SAT TT=0.026 ASSIGNMENTS=98 CHECKS=10798	SAT TT=0.026 ASSIGNMENTS=98 CHECKS=10798	SAT TT=0.015 ASSIGNMENTS=86 CHECKS=8090	SAT TT=0.158 ASSIGNMENTS=4090 CHECKS=326420	SAT TT=0.348	SAT TT=0.023 ASSIGNMENTS=309 CHECKS=16923	SAT TT=0.024 ASSIGNMENTS=353 CHECKS=34721	SAT TT=0.971	SAT TT=1.09	SAT TT=1.125
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-99_glb.xml	SAT TT=0.016	SAT TT=0.872 CHECKS=663 NODES=553	SAT TT=0.827 CHECKS=453 NODES=390	SAT TT=0.045	SAT TT=0.017 CHECKS=3084	SAT TT=0.021 CHECKS=3953	SAT TT=0.726 ASSIGNMENTS=12	SAT TT=0.827 ASSIGNMENTS=11	SAT TT=0.058 ASSIGNMENTS=589 CHECKS=71306	SAT TT=0.061 ASSIGNMENTS=589 CHECKS=71306	SAT TT=0.042 ASSIGNMENTS=619 CHECKS=61863	SAT TT=0.164 ASSIGNMENTS=4554 CHECKS=284551	SAT TT=0.37	SAT TT=0.032 ASSIGNMENTS=422 CHECKS=28156	SAT TT=0.016 ASSIGNMENTS=113 CHECKS=11789	SAT TT=0.979	SAT TT=1.096	SAT TT=1.093
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-0_glb.xml	SAT TT=0.032	SAT TT=1.125 CHECKS=8200 NODES=3370	SAT TT=0.963 CHECKS=1707 NODES=911	SAT TT=0.072	SAT TT=0.032 CHECKS=6410	SAT TT=0.109 CHECKS=32391	SAT TT=1.099 ASSIGNMENTS=51	SAT TT=1.114 ASSIGNMENTS=21	SAT TT=0.077 ASSIGNMENTS=729 CHECKS=94465	SAT TT=0.075 ASSIGNMENTS=729 CHECKS=94465	SAT TT=0.043 ASSIGNMENTS=540 CHECKS=58273	SAT TT=0.255 ASSIGNMENTS=5357 CHECKS=485477	SAT TT=0.456	SAT TT=0.042 ASSIGNMENTS=572 CHECKS=42287	SAT TT=0.334 ASSIGNMENTS=4125 CHECKS=610270	SAT TT=1.832	SAT TT=1.347	SAT TT=1.513
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-14_glb.xml	SAT TT=0.033	SAT TT=2.037 CHECKS=46818 NODES=14371	SAT TT=1.569 CHECKS=21560 NODES=7151	SAT TT=0.315	SAT TT=0.034 CHECKS=10457	SAT TT=0.033 CHECKS=9951	SAT TT=0.795 ASSIGNMENTS=3	SAT TT=0.796 ASSIGNMENTS=5	SAT TT=0.557 ASSIGNMENTS=6973 CHECKS=1000420	SAT TT=0.535 ASSIGNMENTS=6973 CHECKS=1000420	SAT TT=0.705 ASSIGNMENTS=10076 CHECKS=1433040	SAT TT=0.871 ASSIGNMENTS=14860 CHECKS=1850530	SAT TT=0.419	SAT TT=2.839 ASSIGNMENTS=33027 CHECKS=4457020	SAT TT=0.803 ASSIGNMENTS=10657 CHECKS=1666760	SAT TT=1.604	SAT TT=1.324	SAT TT=1.321
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-2_glb.xml	SAT TT=0.054	SAT TT=1.516 CHECKS=23233 NODES=8227	SAT TT=4.688 CHECKS=210427 NODES=50965	SAT TT=0.073	SAT TT=0.054 CHECKS=14796	SAT TT=0.161 CHECKS=50028	SAT TT=0.997 ASSIGNMENTS=21	SAT TT=1.096 ASSIGNMENTS=57	SAT TT=0.422 ASSIGNMENTS=5596 CHECKS=775727	SAT TT=0.431 ASSIGNMENTS=5596 CHECKS=775727	SAT TT=0.072 ASSIGNMENTS=1027 CHECKS=129429	SAT TT=0.97 ASSIGNMENTS=15796 CHECKS=1924050	SAT TT=0.451	SAT TT=47.082 ASSIGNMENTS=542471 CHECKS=73789300	SAT TT=0.412 ASSIGNMENTS=6621 CHECKS=854464	SAT TT=1.68	SAT TT=1.343	SAT TT=1.433
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-37_glb.xml	SAT TT=0.03	SAT TT=1.155 CHECKS=9137 NODES=3380	SAT TT=1.078 CHECKS=1291 NODES=824	SAT TT=0.204	SAT TT=0.131 CHECKS=69241	SAT TT=0.165 CHECKS=79226	SAT TT=0.985 ASSIGNMENTS=4	SAT TT=1.223 ASSIGNMENTS=3	SAT TT=0.227 ASSIGNMENTS=3055 CHECKS=396741	SAT TT=0.234 ASSIGNMENTS=3055 CHECKS=396741	SAT TT=0.091 ASSIGNMENTS=1053 CHECKS=147109	SAT TT=0.333 ASSIGNMENTS=6833 CHECKS=613945	SAT TT=0.468	SAT TT=0.932 ASSIGNMENTS=9362 CHECKS=1351360	SAT TT=0.03 ASSIGNMENTS=326 CHECKS=35440	SAT TT=1.63	SAT TT=1.311	SAT TT=1.419
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-40_glb.xml	SAT TT=0.032	SAT TT=1.052 CHECKS=5783 NODES=3281	SAT TT=0.96 CHECKS=1098 NODES=704	SAT TT=0.12	SAT TT=0.042 CHECKS=12005	SAT TT=0.046 CHECKS=12438	SAT TT=0.984 ASSIGNMENTS=50	SAT TT=0.978 ASSIGNMENTS=17	SAT TT=0.046 ASSIGNMENTS=452 CHECKS=42336	SAT TT=0.047 ASSIGNMENTS=452 CHECKS=42336	SAT TT=0.171 ASSIGNMENTS=2480 CHECKS=307072	SAT TT=0.387 ASSIGNMENTS=8952 CHECKS=772976	SAT TT=0.48	SAT TT=0.079 ASSIGNMENTS=1107 CHECKS=90985	SAT TT=0.032 ASSIGNMENTS=285 CHECKS=37150	SAT TT=1.797	SAT TT=1.214	SAT TT=1.602
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-47_glb.xml	SAT TT=0.06	SAT TT=2.802 CHECKS=100871 NODES=25432	SAT TT=1.597 CHECKS=36628 NODES=9699	SAT TT=0.783	SAT TT=0.073 CHECKS=25326	SAT TT=0.06 CHECKS=20080	SAT TT=1.089 ASSIGNMENTS=3	SAT TT=0.957 ASSIGNMENTS=3	SAT TT=8.541 ASSIGNMENTS=3	SAT TT=8.524 ASSIGNMENTS=3	SAT TT=2.935 ASSIGNMENTS=39543 CHECKS=5759730	SAT TT=1.779 ASSIGNMENTS=29320 CHECKS=3779510	SAT TT=0.445	SAT TT=1.082 ASSIGNMENTS=12425 CHECKS=1708670	SAT TT=1.493 ASSIGNMENTS=22097 CHECKS=3156010	SAT TT=1.722	SAT TT=1.233	SAT TT=1.476
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-64_glb.xml	SAT TT=0.034	SAT TT=0.811 CHECKS=577 NODES=421	SAT TT=1.834 CHECKS=31564 NODES=10411	SAT TT=0.351	SAT TT=0.051 CHECKS=14407	SAT TT=0.061 CHECKS=16291	SAT TT=0.935 ASSIGNMENTS=6	SAT TT=1.003 ASSIGNMENTS=11	SAT TT=0.07 ASSIGNMENTS=645 CHECKS=88705	SAT TT=0.072 ASSIGNMENTS=645 CHECKS=88705	SAT TT=0.034 ASSIGNMENTS=290 CHECKS=39106	SAT TT=0.208 ASSIGNMENTS=5575 CHECKS=410786	SAT TT=0.489	SAT TT=0.404 ASSIGNMENTS=5230 CHECKS=618761	SAT TT=2.73 ASSIGNMENTS=42387 CHECKS=5744570	SAT TT=1.819	SAT TT=1.477	SAT TT=1.457
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-65_glb.xml	SAT TT=0.021	SAT TT=0.834 CHECKS=483 NODES=395	SAT TT=1.34 CHECKS=8037 NODES=3198	SAT TT=0.125	SAT TT=0.022 CHECKS=4510	SAT TT=0.021 CHECKS=4259	SAT TT=0.605 ASSIGNMENTS=2	SAT TT=0.64 ASSIGNMENTS=2	SAT TT=0.464 ASSIGNMENTS=5236 CHECKS=861749	SAT TT=0.449 ASSIGNMENTS=5236 CHECKS=861749	SAT TT=0.338 ASSIGNMENTS=3910 CHECKS=649668	SAT TT=0.28 ASSIGNMENTS=5656 CHECKS=549370	SAT TT=0.406	SAT TT=0.453 ASSIGNMENTS=5252 CHECKS=734925	SAT TT=0.177 ASSIGNMENTS=2243 CHECKS=337703	SAT TT=1.39	SAT TT=1.423	SAT TT=1.249
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-89_glb.xml	SAT TT=0.03	SAT TT=0.92 CHECKS=1822 NODES=1168	SAT TT=1.012 CHECKS=425 NODES=369	SAT TT=0.534	SAT TT=0.184 CHECKS=68187	SAT TT=0.174 CHECKS=66523	SAT TT=1.075 ASSIGNMENTS=7	SAT TT=1.082 ASSIGNMENTS=11	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=14460	SAT TT=0.032 ASSIGNMENTS=168 CHECKS=14460	SAT TT=0.039 ASSIGNMENTS=534 CHECKS=50005	SAT TT=0.229 ASSIGNMENTS=5783 CHECKS=456240	SAT TT=0.456	SAT TT=1.651 ASSIGNMENTS=23564 CHECKS=2666620	SAT TT=0.195 ASSIGNMENTS=3214 CHECKS=393093	SAT TT=1.486	SAT TT=1.347	SAT TT=1.329
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-91_glb.xml	SAT TT=0.146	SAT TT=2.734 CHECKS=86161 NODES=25073	SAT TT=1.521 CHECKS=19571 NODES=6672	SAT TT=0.188	SAT TT=0.146 CHECKS=72860	SAT TT=0.151 CHECKS=73186	SAT TT=0.941 ASSIGNMENTS=4	SAT TT=1.091 ASSIGNMENTS=7	SAT TT=0.305 ASSIGNMENTS=3730 CHECKS=553543	SAT TT=0.299 ASSIGNMENTS=3730 CHECKS=553543	SAT TT=0.25 ASSIGNMENTS=3243 CHECKS=476810	SAT TT=0.896 ASSIGNMENTS=13992 CHECKS=1781910	SAT TT=0.525	SAT TT=0.508 ASSIGNMENTS=5410 CHECKS=812856	SAT TT=0.186 ASSIGNMENTS=2697 CHECKS=376476	SAT TT=1.714	SAT TT=1.278	SAT TT=1.323
csp/CabinetStart1/ normalized-cabinet-5561.xml	UNSAT TT=0.284	? (TO) TT=1800.16	? (TO) TT=1800.11	UNSAT TT=0.284	UNSAT TT=11.406 CHECKS=7114500	UNSAT TT=8.056 CHECKS=3302880	UNSAT TT=11.558 ASSIGNMENTS=38275	? (TO) TT=1800.12	UNSAT TT=0.689 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.772 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.71 ASSIGNMENTS=10816 CHECKS=466154	? (exit code) TT=0.406	UNSAT TT=2.365 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.386 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.214	? TT=306.179	? TT=282.416
csp/CabinetStart1/ normalized-cabinet-5562.xml	UNSAT TT=0.291	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=0.291	UNSAT TT=12.538 CHECKS=7450330	UNSAT TT=8.038 CHECKS=3304980	UNSAT TT=12.619 ASSIGNMENTS=38275	? (TO) TT=1800.07	UNSAT TT=0.732 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.73 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.781 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.697 ASSIGNMENTS=10368 CHECKS=459846	? (exit code) TT=0.543	UNSAT TT=2.522 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.579 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.164	? (TO) TT=286.024	? TT=305.102
csp/CabinetStart1/ normalized-cabinet-5563.xml	UNSAT TT=0.268	? (TO) TT=1800.14	? (TO) TT=1800.15	UNSAT TT=0.268	UNSAT TT=11.552 CHECKS=7146360	UNSAT TT=8.675 CHECKS=3324820	UNSAT TT=12.489 ASSIGNMENTS=38275	? (TO) TT=1800.07	UNSAT TT=0.697 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.688 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.782 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.706 ASSIGNMENTS=10512 CHECKS=461168	? (exit code) TT=0.387	UNSAT TT=2.518 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.55 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.426	? TT=282.761	? TT=302.893
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5564.xml	UNSAT TT=0.29	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.29	UNSAT TT=11.323 CHECKS=7123220	UNSAT TT=8.055 CHECKS=3295750	UNSAT TT=11.598 ASSIGNMENTS=38275	? (TO) TT=1800.14	UNSAT TT=0.696 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.694 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.724 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.706 ASSIGNMENTS=11376 CHECKS=504429	? (exit code) TT=0.372	UNSAT TT=2.367 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.391 ASSIGNMENTS=28555 CHECKS=1785950	? TT=2.83	? TT=294.244	? TT=284.202
csp/CabinetStart1/ normalized-cabinet-5565.xml	UNSAT TT=0.289	? (MO) TT=1.135	? (TO) TT=1800.11	UNSAT TT=0.289	UNSAT TT=11.441 CHECKS=7124910	UNSAT TT=7.967 CHECKS=3289840	UNSAT TT=12.569 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.683 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.682 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.785 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.715 ASSIGNMENTS=10925 CHECKS=469228	? (exit code) TT=0.389	UNSAT TT=2.54 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.554 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.247	? TT=283.717	? TT=306.186
csp/CabinetStart1/ normalized-cabinet-5566.xml	UNSAT TT=0.287	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=0.287	UNSAT TT=12.568 CHECKS=7429590	UNSAT TT=8.695 CHECKS=3282580	UNSAT TT=12.547 ASSIGNMENTS=38275	? (TO) TT=1800.1	UNSAT TT=0.692 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.734 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.724 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.644 ASSIGNMENTS=10666 CHECKS=457138	? (exit code) TT=0.502	UNSAT TT=2.361 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.565 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.27	? TT=283.275	? TT=305.846
csp/CabinetStart1/ normalized-cabinet-5567.xml	UNSAT TT=0.269	? (TO) TT=1800.1	? (TO) TT=1800.15	UNSAT TT=0.269	UNSAT TT=11.37 CHECKS=7121260	UNSAT TT=8.224 CHECKS=3318140	UNSAT TT=11.614 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.697 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.692 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.726 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.702 ASSIGNMENTS=10857 CHECKS=498040	? (exit code) TT=0.471	UNSAT TT=2.393 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.399 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.673	? TT=305.484	? (TO) TT=286.193
csp/CabinetStart1/ normalized-cabinet-5568.xml	UNSAT TT=0.288	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=0.288	UNSAT TT=12.211 CHECKS=7116520	UNSAT TT=8.676 CHECKS=3297890	UNSAT TT=11.558 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.736 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.734 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.776 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.666 ASSIGNMENTS=10190 CHECKS=441920	? (exit code) TT=0.47	UNSAT TT=2.53 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.585 ASSIGNMENTS=28555 CHECKS=1785950	? TT=2.971	? TT=304.841	? TT=305.267
csp/CabinetStart1/ normalized-cabinet-5569.xml	UNSAT TT=0.269	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=0.269	UNSAT TT=12.502 CHECKS=7437300	UNSAT TT=8.69 CHECKS=3292880	UNSAT TT=13.861 ASSIGNMENTS=38275	? (TO) TT=1800.1	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.774 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.694 ASSIGNMENTS=10495 CHECKS=457235	? (exit code) TT=0.498	UNSAT TT=2.551 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.578 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.318	? TT=293.134	? TT=304.502
csp/CabinetStart1/ normalized-cabinet-5570.xml	UNSAT TT=0.27	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=0.27	UNSAT TT=12.398 CHECKS=7111560	UNSAT TT=8.672 CHECKS=3297890	UNSAT TT=11.529 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.685 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.688 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.774 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.623 ASSIGNMENTS=9716 CHECKS=412116	? (exit code) TT=0.383	UNSAT TT=2.547 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.396 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.221	? TT=285.791	? TT=307.043
csp/CabinetStart1/ normalized-cabinet-5571.xml	UNSAT TT=0.292	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=0.292	UNSAT TT=11.817 CHECKS=7455390	UNSAT TT=8.059 CHECKS=3302380	UNSAT TT=12.004 ASSIGNMENTS=39462	? (TO) TT=1800.09	UNSAT TT=0.669 ASSIGNMENTS=8441 CHECKS=466270	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466270	UNSAT TT=0.672 ASSIGNMENTS=9066 CHECKS=447718	UNSAT TT=0.79 ASSIGNMENTS=12450 CHECKS=570527	? (exit code) TT=0.373	UNSAT TT=2.667 ASSIGNMENTS=78487 CHECKS=1811980	UNSAT TT=2.745 ASSIGNMENTS=34187 CHECKS=2035180	? TT=3.452	? TT=325.627	? TT=308.704
csp/CabinetStart1/ normalized-cabinet-5572.xml	UNSAT TT=0.269	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.269	UNSAT TT=11.692 CHECKS=7450440	UNSAT TT=8.136 CHECKS=3322040	UNSAT TT=12.087 ASSIGNMENTS=39460	? (TO) TT=1800.15	UNSAT TT=0.664 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.771 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.788 ASSIGNMENTS=12596 CHECKS=555689	? (exit code) TT=0.484	UNSAT TT=2.645 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.117 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.011	? TT=289.438	? TT=307.678
csp/CabinetStart1/ normalized-cabinet-5573.xml	UNSAT TT=0.271	? (TO) TT=1800.07	? (MO) TT=0.96	UNSAT TT=0.271	UNSAT TT=12.588 CHECKS=7455190	UNSAT TT=8.488 CHECKS=3270480	UNSAT TT=12.024 ASSIGNMENTS=39462	? (TO) TT=1800.06	UNSAT TT=0.722 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.723 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.729 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.607 ASSIGNMENTS=9751 CHECKS=436963	? (exit code) TT=0.403	UNSAT TT=2.849 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.359 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.06	? TT=313	? TT=286.233
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5574.xml	UNSAT TT=0.287	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.287	UNSAT TT=12.553 CHECKS=7432830	UNSAT TT=8.511 CHECKS=3276460	UNSAT TT=12.668 ASSIGNMENTS=39462	? (TO) TT=1800.09	UNSAT TT=0.668 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.673 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.725 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.718 ASSIGNMENTS=11044 CHECKS=514701	? (exit code) TT=0.377	UNSAT TT=2.865 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.366 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.157	? TT=303.073	? TT=284.079
csp/CabinetStart1/ normalized-cabinet-5575.xml	UNSAT TT=0.291	? (TO) TT=1800.08	? (TO) TT=1800.11	UNSAT TT=0.291	UNSAT TT=12.684 CHECKS=7461890	UNSAT TT=8.661 CHECKS=3294400	UNSAT TT=12.711 ASSIGNMENTS=39462	? (TO) TT=1800.14	UNSAT TT=0.678 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.781 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.726 ASSIGNMENTS=11115 CHECKS=478572	? (exit code) TT=0.482	UNSAT TT=2.854 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.341 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.205	? TT=698.232	? TT=308.5
csp/CabinetStart1/ normalized-cabinet-5576.xml	UNSAT TT=0.269	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=0.269	UNSAT TT=11.758 CHECKS=7454600	UNSAT TT=8.632 CHECKS=3298300	UNSAT TT=12.766 ASSIGNMENTS=40031	? (TO) TT=1800.15	UNSAT TT=0.85 ASSIGNMENTS=10710 CHECKS=537435	UNSAT TT=0.849 ASSIGNMENTS=10710 CHECKS=537435	UNSAT TT=0.686 ASSIGNMENTS=8731 CHECKS=451879	UNSAT TT=0.798 ASSIGNMENTS=11218 CHECKS=535326	? (exit code) TT=0.445	UNSAT TT=2.085 ASSIGNMENTS=38593 CHECKS=1326990	UNSAT TT=3.111 ASSIGNMENTS=36670 CHECKS=2147730	? TT=3.144	? TT=288.126	? TT=303.94
csp/CabinetStart1/ normalized-cabinet-5577.xml	UNSAT TT=0.29	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=0.29	UNSAT TT=12.673 CHECKS=7443820	UNSAT TT=8.069 CHECKS=3287870	UNSAT TT=12.009 ASSIGNMENTS=40201	? (TO) TT=1800.11	UNSAT TT=0.823 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.823 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.692 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.693 ASSIGNMENTS=10364 CHECKS=461392	? (exit code) TT=0.447	UNSAT TT=2.355 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=1.912 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.428	? TT=302.09	? TT=307.88
csp/CabinetStart1/ normalized-cabinet-5578.xml	UNSAT TT=0.29	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=0.29	UNSAT TT=12.659 CHECKS=7457420	UNSAT TT=8.547 CHECKS=3270660	UNSAT TT=11.635 ASSIGNMENTS=39137	? (TO) TT=1800.07	UNSAT TT=0.759 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.822 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.644 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.611 ASSIGNMENTS=10517 CHECKS=442125	? (exit code) TT=0.393	UNSAT TT=2.324 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=2.038 ASSIGNMENTS=25517 CHECKS=1413600	? TT=2.991	? TT=289.782	? TT=307.153
csp/CabinetStart1/ normalized-cabinet-5579.xml	UNSAT TT=0.272	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=0.272	UNSAT TT=11.841 CHECKS=7447800	UNSAT TT=8.682 CHECKS=3291720	UNSAT TT=11.9 ASSIGNMENTS=40137	? (TO) TT=1800.15	UNSAT TT=0.82 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.816 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.687 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.792 ASSIGNMENTS=11906 CHECKS=529763	? (exit code) TT=0.401	UNSAT TT=2.363 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=2.053 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.202	? TT=286.458	? TT=309.661
csp/CabinetStart1/ normalized-cabinet-5580.xml	UNSAT TT=0.27	? (TO) TT=1800.14	? (TO) TT=1800.16	UNSAT TT=0.27	UNSAT TT=11.838 CHECKS=7430890	UNSAT TT=8.113 CHECKS=3291660	UNSAT TT=11.958 ASSIGNMENTS=39267	? (TO) TT=1800.17	UNSAT TT=0.762 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.756 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.637 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.645 ASSIGNMENTS=11030 CHECKS=461402	? (exit code) TT=0.376	UNSAT TT=2.168 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=1.922 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.037	? TT=286.938	? TT=287.011
csp/CabinetStart1/ normalized-cabinet-5581.xml	SAT TT=0.025	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.061	SAT TT=10.84 CHECKS=6305790	SAT TT=6.716 CHECKS=1948630	SAT TT=6.965 ASSIGNMENTS=6049	? (TO) TT=1800.14	SAT TT=0.043 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.036 ASSIGNMENTS=159 CHECKS=6886	? (exit code) TT=0.506	SAT TT=0.806 ASSIGNMENTS=19526 CHECKS=497102	SAT TT=0.025 ASSIGNMENTS=16 CHECKS=1481	? TT=3.049	? TT=300.825	? TT=290.904
csp/CabinetStart1/ normalized-cabinet-5582.xml	SAT TT=0.023	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.061	SAT TT=10.616 CHECKS=6301260	SAT TT=7.053 CHECKS=1939440	SAT TT=7.574 ASSIGNMENTS=6052	? (TO) TT=1800.07	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.063 ASSIGNMENTS=755 CHECKS=29306	? (exit code) TT=0.459	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=2.908	? TT=308.122	? TT=289.31
csp/CabinetStart1/ normalized-cabinet-5583.xml	SAT TT=0.026	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.063	SAT TT=11.338 CHECKS=6297920	SAT TT=7.08 CHECKS=1945670	SAT TT=6.896 ASSIGNMENTS=6049	? (TO) TT=1800.15	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.033 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=171 CHECKS=6827	? (exit code) TT=0.402	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.007	? (TO) TT=279.433	? (TO) TT=282.599
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5584.xml	SAT TT=0.023	? (TO) TT=1800.17	? (TO) TT=1800.12	SAT TT=0.06	SAT TT=10.619 CHECKS=6302680	SAT TT=6.57 CHECKS=1941980	SAT TT=6.889 ASSIGNMENTS=6049	SAT TT=1207.97 ASSIGNMENTS=963829	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=264 CHECKS=10386	? (exit code) TT=0.497	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=2.836	? TT=309.925	? TT=289.202
csp/CabinetStart1/ normalized-cabinet-5585.xml	SAT TT=0.026	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.064	SAT TT=11.508 CHECKS=6334000	SAT TT=6.572 CHECKS=1941020	SAT TT=7.55 ASSIGNMENTS=6049	SAT TT=1543.41 ASSIGNMENTS=1698160	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=170 CHECKS=6878	? (exit code) TT=0.494	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.105	? TT=344.632	? TT=309.957
csp/CabinetStart1/ normalized-cabinet-5586.xml	SAT TT=0.024	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=0.062	SAT TT=11.575 CHECKS=6312880	SAT TT=7.05 CHECKS=1935290	SAT TT=7.794 ASSIGNMENTS=6049	SAT TT=911.331 ASSIGNMENTS=1400040	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.044 ASSIGNMENTS=294 CHECKS=12512	? (exit code) TT=0.383	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.024 ASSIGNMENTS=17 CHECKS=1476	? TT=3.413	? TT=537.529	? TT=310.182
csp/CabinetStart1/ normalized-cabinet-5587.xml	SAT TT=0.024	? (TO) TT=1800.16	? (TO) TT=1800.08	SAT TT=0.059	SAT TT=11.335 CHECKS=6293510	SAT TT=6.54 CHECKS=1952360	SAT TT=7.58 ASSIGNMENTS=6049	? (TO) TT=1800.1	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=68 CHECKS=3386	? (exit code) TT=0.402	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.028 ASSIGNMENTS=17 CHECKS=1476	? TT=3.155	? TT=292.916	? TT=287.529
csp/CabinetStart1/ normalized-cabinet-5588.xml	SAT TT=0.025	? (TO) TT=1800.12	? (TO) TT=1800.07	SAT TT=0.06	SAT TT=11.481 CHECKS=6314090	SAT TT=7.168 CHECKS=1925680	SAT TT=7.646 ASSIGNMENTS=6049	? (TO) TT=1800.13	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=162 CHECKS=7229	? (exit code) TT=0.503	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.08	? TT=290.288	? TT=310.364
csp/CabinetStart1/ normalized-cabinet-5589.xml	SAT TT=0.026	? (TO) TT=1800.18	? (TO) TT=1800.14	SAT TT=0.065	SAT TT=10.887 CHECKS=6320890	SAT TT=6.478 CHECKS=1931750	SAT TT=8.227 ASSIGNMENTS=6049	? (TO) TT=1800.09	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=37 CHECKS=2134	? (exit code) TT=0.401	SAT TT=0.042 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.121	? TT=282.97	? TT=310.92
csp/CabinetStart1/ normalized-cabinet-5590.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.15	SAT TT=0.065	SAT TT=11.475 CHECKS=6288070	SAT TT=7.027 CHECKS=1958730	SAT TT=7.533 ASSIGNMENTS=6049	SAT TT=41.465 ASSIGNMENTS=27035	SAT TT=0.044 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.033 ASSIGNMENTS=85 CHECKS=3407	? (exit code) TT=0.493	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=1476	? TT=3.22	? TT=291.099	? TT=288.976
csp/CabinetStart1/ normalized-cabinet-5591.xml	SAT TT=0.023	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=0.064	SAT TT=11.674 CHECKS=6306340	SAT TT=6.903 CHECKS=1908830	SAT TT=7.377 ASSIGNMENTS=6049	SAT TT=40.046 ASSIGNMENTS=27004	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.036 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.06 ASSIGNMENTS=635 CHECKS=22805	? (exit code) TT=0.376	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.216	? TT=307.996	? TT=311.433
csp/CabinetStart1/ normalized-cabinet-5592.xml	SAT TT=0.023	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=0.059	SAT TT=12.522 CHECKS=6318360	SAT TT=7.207 CHECKS=1934820	SAT TT=7.373 ASSIGNMENTS=6049	? (TO) TT=1800.14	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=169 CHECKS=6990	? (exit code) TT=0.401	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.26	? TT=514.882	? TT=301.651
csp/CabinetStart1/ normalized-cabinet-5593.xml	SAT TT=0.026	? (TO) TT=1800.16	? (TO) TT=1800.17	SAT TT=0.063	SAT TT=6.926 CHECKS=1932440	SAT TT=7.21 CHECKS=1956130	SAT TT=7.13 ASSIGNMENTS=6049	? (TO) TT=1800.07	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.031 ASSIGNMENTS=79 CHECKS=3763	? (exit code) TT=0.408	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=1476	? TT=3.208	? TT=289.768	? TT=300.662
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5594.xml	SAT TT=0.029	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=0.065	SAT TT=10.877 CHECKS=6309110	SAT TT=7.098 CHECKS=1943840	SAT TT=6.89 ASSIGNMENTS=6049	SAT TT=815.095 ASSIGNMENTS=961156	SAT TT=0.035 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.029 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=165 CHECKS=6524	? (exit code) TT=0.394	SAT TT=0.046 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.031 ASSIGNMENTS=17 CHECKS=1476	? TT=3.718	? TT=278.632	? TT=288.086
csp/CabinetStart1/ normalized-cabinet-5595.xml	SAT TT=0.026	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=0.062	SAT TT=10.823 CHECKS=6292590	SAT TT=6.472 CHECKS=1928350	SAT TT=7.368 ASSIGNMENTS=6049	? (TO) TT=1800.09	SAT TT=0.043 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.042 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.046 ASSIGNMENTS=412 CHECKS=16340	? (exit code) TT=0.436	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=1476	? TT=3.199	? TT=306.01	? TT=293.023
csp/CabinetStart1/ normalized-cabinet-5596.xml	SAT TT=0.023	? (TO) TT=1800.19	? (TO) TT=1800.17	SAT TT=0.057	SAT TT=7.023 CHECKS=1945790	SAT TT=1.208 CHECKS=601531	SAT TT=6.983 ASSIGNMENTS=6049	? (TO) TT=1800.11	SAT TT=0.053 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.057 ASSIGNMENTS=354 CHECKS=13900	? (exit code) TT=0.392	SAT TT=0.048 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=3.613	? TT=294.481	? TT=286.281
csp/CabinetStart1/ normalized-cabinet-5597.xml	SAT TT=0.025	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=0.062	SAT TT=11.502 CHECKS=6298900	SAT TT=7.221 CHECKS=1943420	SAT TT=7.587 ASSIGNMENTS=6049	? (TO) TT=1800.17	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.028 ASSIGNMENTS=70 CHECKS=3418	? (exit code) TT=0.415	SAT TT=0.035 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=2.8	? TT=289.985	? TT=315.195
csp/CabinetStart1/ normalized-cabinet-5598.xml	SAT TT=0.026	? (TO) TT=1800.18	? (TO) TT=1800.16	SAT TT=0.058	SAT TT=11.634 CHECKS=6316010	SAT TT=7.012 CHECKS=1933150	SAT TT=7.603 ASSIGNMENTS=6049	? (TO) TT=1800.09	SAT TT=0.042 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.034 ASSIGNMENTS=123 CHECKS=6207	? (exit code) TT=0.493	SAT TT=0.041 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.169	? TT=302.984	? TT=312.256
csp/CabinetStart1/ normalized-cabinet-5599.xml	SAT TT=0.023	? (MO) TT=0.908	? (TO) TT=1800.1	SAT TT=0.062	SAT TT=6.721 CHECKS=1957880	SAT TT=7.037 CHECKS=1944160	SAT TT=6.911 ASSIGNMENTS=6049	? (TO) TT=1800.15	SAT TT=0.044 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.044 ASSIGNMENTS=313 CHECKS=12973	? (exit code) TT=0.424	SAT TT=0.035 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=3.312	? TT=293.623	? TT=311.925
csp/CabinetStart1/ normalized-cabinet-5600.xml	SAT TT=0.027	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=0.059	SAT TT=10.735 CHECKS=6302160	SAT TT=6.938 CHECKS=1922710	SAT TT=7.531 ASSIGNMENTS=6049	? (TO) TT=1800.11	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=196 CHECKS=7555	? (exit code) TT=0.489	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.24	? TT=310.159	? TT=312.2
csp/cjss/ normalized-ft06x2-54.xml	UNSAT TT=3.277	? TT=0.64	? TT=0.635	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=1139.59 CHECKS=426796000	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=632.041 ASSIGNMENTS=905883 CHECKS=1753910000	UNSAT TT=666.989 ASSIGNMENTS=905883 CHECKS=1753910000	UNSAT TT=456.612 ASSIGNMENTS=608537 CHECKS=1228740000	UNSAT TT=290.169 ASSIGNMENTS=419689 CHECKS=797346000	? (exit code) TT=0.262	UNSAT TT=911.449 ASSIGNMENTS=1158090 CHECKS=2193450000	UNSAT TT=672.608 ASSIGNMENTS=905883 CHECKS=1753910000	? TT=2.184	UNSAT TT=3.277	UNSAT TT=3.737
csp/cjss/ normalized-ft06x2-55.xml	SAT TT=2.567	? TT=0.629	? TT=0.632	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1751.04 CHECKS=644056000	SAT TT=262.589 ASSIGNMENTS=261438	? (TO) TT=1800.1	SAT TT=20.305 ASSIGNMENTS=20109 CHECKS=30608300	SAT TT=20.16 ASSIGNMENTS=20109 CHECKS=30608300	SAT TT=532.763 ASSIGNMENTS=661201 CHECKS=1520070000	SAT TT=43.993 ASSIGNMENTS=70949 CHECKS=122017000	? (exit code) TT=0.249	SAT TT=6.54 ASSIGNMENTS=8683 CHECKS=13029400	SAT TT=12.56 ASSIGNMENTS=20109 CHECKS=30608300	? TT=2.276	SAT TT=2.567	SAT TT=3.19
csp/cjss/ normalized-ft06x3-54.xml	UNSAT TT=112.238	? TT=0.695	? TT=0.721	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (exit code) TT=0.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=2.576	UNSAT TT=119.279	UNSAT TT=112.238
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/cjss/ normalized-ft06x3-55.xml	SAT TT=3.2	? TT=0.674	? TT=0.716	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (exit code) TT=0.286	SAT TT=22.595 ASSIGNMENTS=125238 CHECKS=63478500	? (TO) TT=1800.05	? TT=2.413	SAT TT=3.2	SAT TT=4.154
csp/cjss/ normalized-ft10x2-837.xml		? TT=6.844	? TT=6.733	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (exit code) TT=0.448	? (TO) TT=1800.15	? (TO) TT=1800.16	? TT=154.766	? (TO) TT=1800.06	? (TO) TT=1800.09
csp/cjss/ normalized-ft10x3-838.xml		? TT=7.55	? TT=7.018	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.11	? (exit code) TT=0.378	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=196.677	? TT=361.4	? TT=360.371
csp/cjss/ normalized-la03x2-593.xml		? TT=2.927	? TT=2.463	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (exit code) TT=0.357	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=35.177	? (TO) TT=1800	? (TO) TT=1800.09
csp/cjss/ normalized-la03x3-590.xml		? TT=2.54	? TT=2.521	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (exit code) TT=0.3	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=50.704	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/cjss/ normalized-la04x2-572.xml		? TT=2.814	? TT=2.291	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (exit code) TT=0.407	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=35.263	? (TO) TT=1800.03	? (TO) TT=1800
csp/cjss/ normalized-la04x3-570.xml		? TT=2.35	? TT=2.91	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.09	? (exit code) TT=0.29	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=47.058	? (TO) TT=1800.02	? (TO) TT=1800.06
csp/compet02/ normalized-patat-02-comp-10.xml	SAT TT=134.588	? (TO) TT=1800.18	? (TO) TT=1800.24	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.24	? (TO) TT=1800.15	SAT TT=692.986 ASSIGNMENTS=84246 CHECKS=1344450000	SAT TT=1293.95 ASSIGNMENTS=84246 CHECKS=1344450000	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=710.655 ASSIGNMENTS=84246 CHECKS=1344450000	? (TO) TT=1800.22	? (TO) TT=1800.26	SAT TT=134.588
csp/compet02/ normalized-patat-02-comp-11.xml	SAT TT=77.463	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=259.776 ASSIGNMENTS=138287 CHECKS=555645000	SAT TT=839.563 ASSIGNMENTS=138287 CHECKS=555645000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=265.54 ASSIGNMENTS=138287 CHECKS=555645000	? (TO) TT=1800.22	? (TO) TT=1800.1	SAT TT=77.463
csp/compet02/ normalized-patat-02-comp-12.xml	SAT TT=26.185	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=36.579 ASSIGNMENTS=6853 CHECKS=54223200	SAT TT=613.154 ASSIGNMENTS=6853 CHECKS=54223200	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=122.375 ASSIGNMENTS=35475 CHECKS=242051000	SAT TT=26.185 ASSIGNMENTS=6853 CHECKS=54223200	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=79.482
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet02/ normalized-patat-02-comp-13.xml	SAT TT=87.969	SAT TT=1327.07 CHECKS=808815000 NODES=92749	SAT TT=1467.43 CHECKS=752048000 NODES=77379	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.18	SAT TT=135.36 ASSIGNMENTS=58873 CHECKS=262448000	SAT TT=723.911 ASSIGNMENTS=58873 CHECKS=262448000	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1390.29 ASSIGNMENTS=463455 CHECKS=2779750000	SAT TT=126.682 ASSIGNMENTS=58873 CHECKS=262448000	? (TO) TT=1800.23	? (TO) TT=1800.12	SAT TT=87.969
csp/compet02/ normalized-patat-02-comp-14.xml	SAT TT=58.726	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.19	SAT TT=64.249 ASSIGNMENTS=4674 CHECKS=114248000	SAT TT=647.87 ASSIGNMENTS=4674 CHECKS=114248000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=940.265 ASSIGNMENTS=140527 CHECKS=2066530000	SAT TT=58.726 ASSIGNMENTS=4674 CHECKS=114248000	SAT TT=1437.58	SAT TT=1250	SAT TT=108.1
csp/compet02/ normalized-patat-02-comp-15.xml	SAT TT=35.759	SAT TT=1137.45 CHECKS=753690000 NODES=58620	SAT TT=1291.45 CHECKS=944055000 NODES=61033	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=44.948 ASSIGNMENTS=8509 CHECKS=78292300	SAT TT=622.022 ASSIGNMENTS=8509 CHECKS=78292300	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=1538.51 ASSIGNMENTS=692073 CHECKS=3505520000	SAT TT=35.759 ASSIGNMENTS=8509 CHECKS=78292300	SAT TT=571.687	SAT TT=117.464	SAT TT=74.036
csp/compet02/ normalized-patat-02-comp-16.xml	SAT TT=93.319	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.08	SAT TT=593.586 ASSIGNMENTS=113917 CHECKS=1175080000	SAT TT=1134.15 ASSIGNMENTS=113917 CHECKS=1175080000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	SAT TT=572.637 ASSIGNMENTS=113917 CHECKS=1175080000	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=93.319
csp/compet02/ normalized-patat-02-comp-17.xml	SAT TT=4.208	SAT TT=4.208 CHECKS=203750 NODES=701	SAT TT=7.197 CHECKS=753287 NODES=1321	? (TO) TT=1800.02	SAT TT=551.247 CHECKS=56347400	SAT TT=35.985 CHECKS=15863600	? (TO) TT=1800.16	? (TO) TT=1800.11	SAT TT=19.105 ASSIGNMENTS=35191 CHECKS=17468500	SAT TT=11.934 ASSIGNMENTS=700 CHECKS=203676	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=12.793 ASSIGNMENTS=35191 CHECKS=17468500	SAT TT=48.554	SAT TT=21.29	SAT TT=58.944
csp/compet02/ normalized-patat-02-comp-18.xml	SAT TT=58.771	SAT TT=642.684 CHECKS=265005000 NODES=87433	SAT TT=812.173 CHECKS=353601000 NODES=117232	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.1	SAT TT=98.957 ASSIGNMENTS=82584 CHECKS=200948000	SAT TT=671.211 ASSIGNMENTS=82584 CHECKS=200948000	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=974.014 ASSIGNMENTS=1046680 CHECKS=2463870000	SAT TT=87.382 ASSIGNMENTS=82584 CHECKS=200948000	? (TO) TT=1800.26	? (TO) TT=1800.07	SAT TT=58.771
csp/compet02/ normalized-patat-02-comp-19.xml	SAT TT=121.312	? (TO) TT=1800.21	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.46	SAT TT=131.284 ASSIGNMENTS=20467 CHECKS=234105000	SAT TT=716.911 ASSIGNMENTS=20467 CHECKS=234105000	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1202.43 ASSIGNMENTS=217261 CHECKS=2546930000	SAT TT=121.312 ASSIGNMENTS=20467 CHECKS=234105000	? (TO) TT=1800.22	? (TO) TT=1800.2	SAT TT=152.128
csp/compet02/ normalized-patat-02-comp-1.xml	SAT TT=80.874	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.13	SAT TT=219.409 ASSIGNMENTS=104575 CHECKS=454103000	SAT TT=795.316 ASSIGNMENTS=104575 CHECKS=454103000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=194.779 ASSIGNMENTS=104575 CHECKS=454103000	? (TO) TT=1800.21	SAT TT=604.875	SAT TT=80.874
csp/compet02/ normalized-patat-02-comp-20.xml	SAT TT=115.765	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=390.815 ASSIGNMENTS=42542 CHECKS=765043000	SAT TT=946.44 ASSIGNMENTS=42542 CHECKS=765043000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=393.952 ASSIGNMENTS=42542 CHECKS=765043000	? (TO) TT=1800.38	SAT TT=1340.7	SAT TT=115.765
csp/compet02/ normalized-patat-02-comp-2.xml	SAT TT=53.35	SAT TT=808.007 CHECKS=299921000 NODES=57280	SAT TT=627.033 CHECKS=203021000 NODES=40232	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.15	SAT TT=58.378 ASSIGNMENTS=24100 CHECKS=111248000	SAT TT=644.269 ASSIGNMENTS=24100 CHECKS=111248000	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=1213.83 ASSIGNMENTS=359442 CHECKS=2406700000	SAT TT=53.35 ASSIGNMENTS=24100 CHECKS=111248000	? (TO) TT=1800.23	SAT TT=534.13	SAT TT=64.55
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet02/ normalized-patat-02-comp-3.xml	SAT TT=82.25	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.2	SAT TT=183.08 ASSIGNMENTS=60977 CHECKS=335861000	SAT TT=750.984 ASSIGNMENTS=60977 CHECKS=335861000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=894.441 ASSIGNMENTS=319269 CHECKS=1890540000	SAT TT=151.029 ASSIGNMENTS=60977 CHECKS=335861000	? (TO) TT=1800.19	? (TO) TT=1800.14	SAT TT=82.25
csp/compet02/ normalized-patat-02-comp-4.xml	SAT TT=96.841	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=96.841 ASSIGNMENTS=16165 CHECKS=196125000	SAT TT=687.867 ASSIGNMENTS=16165 CHECKS=196125000	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=97.039 ASSIGNMENTS=16165 CHECKS=196125000	? (TO) TT=1800.24	SAT TT=941.351	SAT TT=105.118
csp/compet02/ normalized-patat-02-comp-5.xml	SAT TT=19.167	SAT TT=506.75 CHECKS=359389000 NODES=46435	SAT TT=543.617 CHECKS=374466000 NODES=55990	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=27.08 ASSIGNMENTS=5744 CHECKS=43689400	SAT TT=485.644 ASSIGNMENTS=46427 CHECKS=359389000	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=179.91 ASSIGNMENTS=91967 CHECKS=387997000	SAT TT=19.167 ASSIGNMENTS=5744 CHECKS=43689400	SAT TT=290.227	SAT TT=25.382	SAT TT=61.555
csp/compet02/ normalized-patat-02-comp-6.xml	SAT TT=118.276	? (TO) TT=1800.23	? (MO) TT=11.965	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=203.776 ASSIGNMENTS=24672 CHECKS=382082000	SAT TT=769.533 ASSIGNMENTS=24672 CHECKS=382082000	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=1246.69 ASSIGNMENTS=194898 CHECKS=2565580000	SAT TT=178.667 ASSIGNMENTS=24672 CHECKS=382082000	? (TO) TT=1800.15	SAT TT=1389.13	SAT TT=118.276
csp/compet02/ normalized-patat-02-comp-7.xml	SAT TT=28.608	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=43.295 ASSIGNMENTS=9034 CHECKS=61085600	SAT TT=619.01 ASSIGNMENTS=9034 CHECKS=61085600	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=668.211 ASSIGNMENTS=185111 CHECKS=1327920000	SAT TT=28.608 ASSIGNMENTS=9034 CHECKS=61085600	SAT TT=1261.71	SAT TT=1345.61	SAT TT=105.455
csp/compet02/ normalized-patat-02-comp-8.xml	SAT TT=111.339	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=502.63 ASSIGNMENTS=139601 CHECKS=890948000	SAT TT=1038.26 ASSIGNMENTS=139601 CHECKS=890948000	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=433.424 ASSIGNMENTS=139601 CHECKS=890948000	? (TO) TT=1800.21	? (TO) TT=1800.21	SAT TT=111.339
csp/compet02/ normalized-patat-02-comp-9.xml	SAT TT=108.522	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.56	SAT TT=139.079 ASSIGNMENTS=39218 CHECKS=264211000	SAT TT=709.006 ASSIGNMENTS=39218 CHECKS=264211000	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1619.29 ASSIGNMENTS=139259 CHECKS=3226830000	SAT TT=121.335 ASSIGNMENTS=39218 CHECKS=264211000	? (TO) TT=1802.2	? (TO) TT=1800.12	SAT TT=108.522
csp/compet08/ normalized-patat-08-comp-10.xml	SAT TT=1.68	SAT TT=40.109 CHECKS=4472790 NODES=4074	SAT TT=11.868 CHECKS=1821520 NODES=400	? (TO) TT=1800.1	SAT TT=54.27 CHECKS=4875970	SAT TT=20.187 CHECKS=3019170	? (TO) TT=1800.16	? (TO) TT=1800.17	SAT TT=1.716 ASSIGNMENTS=495 CHECKS=1177090	SAT TT=2.055 ASSIGNMENTS=495 CHECKS=1177090	SAT TT=2.025 ASSIGNMENTS=583 CHECKS=1493780	SAT TT=19.867 ASSIGNMENTS=62294 CHECKS=27272000	? (TO) TT=1800.09	SAT TT=419.434 ASSIGNMENTS=74541 CHECKS=336582000	SAT TT=1.68 ASSIGNMENTS=495 CHECKS=1177120	SAT TT=273.877	SAT TT=86.484	SAT TT=112.281
csp/compet08/ normalized-patat-08-comp-11.xml	SAT TT=6.158	SAT TT=31.406 CHECKS=4692210 NODES=2919	SAT TT=35.457 CHECKS=6886030 NODES=2919	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.32	? (TO) TT=1800.14	SAT TT=14.402 ASSIGNMENTS=1941 CHECKS=8182670	SAT TT=36.168 ASSIGNMENTS=2919 CHECKS=4692210	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=37.738 ASSIGNMENTS=16959 CHECKS=52534400	SAT TT=6.158 ASSIGNMENTS=1941 CHECKS=8182670	SAT TT=416.181	SAT TT=91.105	SAT TT=120.096
csp/compet08/ normalized-patat-08-comp-12.xml	SAT TT=70.648	SAT TT=375.454 CHECKS=102136000 NODES=25564	SAT TT=242.452 CHECKS=69648000 NODES=13641	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.2	SAT TT=92.454 ASSIGNMENTS=17376 CHECKS=132872000	SAT TT=344.985 ASSIGNMENTS=25564 CHECKS=102136000	? (TO) TT=1800.11	SAT TT=96.854 ASSIGNMENTS=48703 CHECKS=142565000	? (TO) TT=1800.05	SAT TT=70.648 ASSIGNMENTS=25904 CHECKS=118730000	SAT TT=88.791 ASSIGNMENTS=17376 CHECKS=132872000	? (TO) TT=1800.1	SAT TT=172.851	SAT TT=137.686
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet08/ normalized-patat-08-comp-13.xml	SAT TT=11.438	SAT TT=110.813 CHECKS=26200300 NODES=10815	SAT TT=208.905 CHECKS=59178400 NODES=19170	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.45	SAT TT=21.316 ASSIGNMENTS=3472 CHECKS=15885400	SAT TT=113.58 ASSIGNMENTS=10815 CHECKS=26200300	? (TO) TT=1800.03	SAT TT=65.153 ASSIGNMENTS=45129 CHECKS=104727000	? (TO) TT=1800.08	SAT TT=59.829 ASSIGNMENTS=27896 CHECKS=97781400	SAT TT=11.438 ASSIGNMENTS=3472 CHECKS=15885400	SAT TT=1191.88	SAT TT=91.213	SAT TT=138.781
csp/compet08/ normalized-patat-08-comp-14.xml	SAT TT=143.661	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=726.095 ASSIGNMENTS=72370 CHECKS=201719000	SAT TT=733.155 ASSIGNMENTS=72370 CHECKS=201719000	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=233.838 ASSIGNMENTS=143690 CHECKS=283600000	SAT TT=143.661 ASSIGNMENTS=72370 CHECKS=201719000	? (TO) TT=1800.18	? (TO) TT=1800.03	SAT TT=168.193
csp/compet08/ normalized-patat-08-comp-15.xml	SAT TT=0.982	SAT TT=4.43 CHECKS=40242 NODES=1027	SAT TT=10.326 CHECKS=237524 NODES=4484	SAT TT=0.982	SAT TT=372.537 CHECKS=80784700	SAT TT=92.412 CHECKS=18466700	SAT TT=146.961 ASSIGNMENTS=1213	? (TO) TT=1800.06	SAT TT=11.373 ASSIGNMENTS=1027 CHECKS=40242	SAT TT=10.65 ASSIGNMENTS=1027 CHECKS=40242	SAT TT=9.839 ASSIGNMENTS=5948 CHECKS=12719200	SAT TT=5.814 ASSIGNMENTS=25245 CHECKS=6592620	? (TO) TT=1800.08	SAT TT=11.281 ASSIGNMENTS=9916 CHECKS=11706100	SAT TT=1.044 ASSIGNMENTS=690 CHECKS=1105840	SAT TT=16.013	SAT TT=43.605	SAT TT=44.627
csp/compet08/ normalized-patat-08-comp-16.xml		? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.26	? TT=129.916	? TT=144.883
csp/compet08/ normalized-patat-08-comp-1.xml		? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.19	? TT=236.659	? TT=215.385
csp/compet08/ normalized-patat-08-comp-2.xml		? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/compet08/ normalized-patat-08-comp-3.xml	SAT TT=21.456	? (TO) TT=1800.09	SAT TT=170.485 CHECKS=14354600 NODES=16755	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=29.066 ASSIGNMENTS=4645 CHECKS=27233800	SAT TT=607.954 ASSIGNMENTS=4645 CHECKS=27233800	? (TO) TT=1800.02	SAT TT=35.024 ASSIGNMENTS=25346 CHECKS=35904700	? (TO) TT=1800.11	SAT TT=58.951 ASSIGNMENTS=19407 CHECKS=79247000	SAT TT=21.456 ASSIGNMENTS=4645 CHECKS=27233800	SAT TT=135.524	SAT TT=94.946	SAT TT=138.493
csp/compet08/ normalized-patat-08-comp-4.xml	SAT TT=133.767	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.18	SAT TT=1052.03 ASSIGNMENTS=173060 CHECKS=1164580000	SAT TT=1663.61 ASSIGNMENTS=173060 CHECKS=1164580000	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=1100.25 ASSIGNMENTS=173060 CHECKS=1164580000	? (TO) TT=1800.18	? (TO) TT=1800.03	SAT TT=133.767
csp/compet08/ normalized-patat-08-comp-5.xml	SAT TT=57.047	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	SAT TT=66.263 ASSIGNMENTS=8100 CHECKS=90123900	SAT TT=651.429 ASSIGNMENTS=8100 CHECKS=90123900	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=794.575 ASSIGNMENTS=115106 CHECKS=1203800000	SAT TT=57.047 ASSIGNMENTS=8100 CHECKS=90123900	? (TO) TT=1800.19	SAT TT=474.855	SAT TT=178.162
csp/compet08/ normalized-patat-08-comp-6.xml	SAT TT=148.249	? (TO) TT=1800.13	SAT TT=1327.2 CHECKS=392426000 NODES=69848	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.49	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=1402.25 ASSIGNMENTS=194941 CHECKS=2063610000	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=148.249
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet08/ normalized-patat-08-comp-7.xml	SAT TT=7.703	SAT TT=27.343 CHECKS=972732 NODES=10794	SAT TT=258.025 CHECKS=15164400 NODES=121326	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=88.107 CHECKS=22813100	SAT TT=240.311 ASSIGNMENTS=3580	? (TO) TT=1800.12	SAT TT=34.978 ASSIGNMENTS=10794 CHECKS=972732	SAT TT=33.434 ASSIGNMENTS=10794 CHECKS=972732	SAT TT=7.703 ASSIGNMENTS=3699 CHECKS=10423400	SAT TT=365.843 ASSIGNMENTS=163208 CHECKS=406517000	? (TO) TT=1800.04	SAT TT=35.498 ASSIGNMENTS=17617 CHECKS=33312300	SAT TT=29.984 ASSIGNMENTS=12717 CHECKS=42440800	SAT TT=20.636	SAT TT=37.686	SAT TT=47.454
csp/compet08/ normalized-patat-08-comp-8.xml	SAT TT=0.885	SAT TT=6.316 CHECKS=71895 NODES=1793	SAT TT=5.707 CHECKS=80973 NODES=419	? (TO) TT=1800.1	SAT TT=14.183 CHECKS=1449550	SAT TT=25.981 CHECKS=6206090	? (TO) TT=1800.12	? (TO) TT=1800.11	SAT TT=12.312 ASSIGNMENTS=1793 CHECKS=71895	SAT TT=12.602 ASSIGNMENTS=1793 CHECKS=71895	SAT TT=5.669 ASSIGNMENTS=5469 CHECKS=5811230	SAT TT=6.128 ASSIGNMENTS=29278 CHECKS=8316910	? (TO) TT=1800.04	SAT TT=6.125 ASSIGNMENTS=8113 CHECKS=4643160	SAT TT=0.885 ASSIGNMENTS=742 CHECKS=672528	SAT TT=17.614	SAT TT=33.727	SAT TT=46.678
csp/compet08/ normalized-patat-08-comp-9.xml		? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.26	? TT=449.991	? TT=467.154
csp/costasArray/ normalized-costasArray-10.xml	SAT TT=0.011	SAT TT=0.833 CHECKS=32729 NODES=66	SAT TT=0.938 CHECKS=282491 NODES=160	SAT TT=0.037	SAT TT=0.122 CHECKS=7825	SAT TT=0.018 CHECKS=6358	SAT TT=1.227 ASSIGNMENTS=12	SAT TT=1.094 ASSIGNMENTS=7	SAT TT=0.024 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.021 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.011 ASSIGNMENTS=17 CHECKS=3021	SAT TT=0.014 ASSIGNMENTS=61 CHECKS=7715	SAT TT=0.388	SAT TT=0.098 ASSIGNMENTS=619 CHECKS=73290	SAT TT=0.012 ASSIGNMENTS=12 CHECKS=2230	SAT TT=3.687	SAT TT=1.065	SAT TT=0.994
csp/costasArray/ normalized-costasArray-11.xml	SAT TT=0.016	SAT TT=1.024 CHECKS=430029 NODES=346	SAT TT=1.089 CHECKS=507038 NODES=241	SAT TT=0.04	SAT TT=0.144 CHECKS=66321	SAT TT=0.071 CHECKS=65629	SAT TT=1.666 ASSIGNMENTS=111	SAT TT=1.46 ASSIGNMENTS=9	SAT TT=0.085 ASSIGNMENTS=384 CHECKS=79578	SAT TT=0.089 ASSIGNMENTS=384 CHECKS=79578	SAT TT=0.058 ASSIGNMENTS=272 CHECKS=57112	SAT TT=0.198 ASSIGNMENTS=1505 CHECKS=228845	SAT TT=0.453	SAT TT=0.075 ASSIGNMENTS=341 CHECKS=46140	SAT TT=0.016 ASSIGNMENTS=30 CHECKS=5651	SAT TT=4.204	SAT TT=1.273	SAT TT=1.442
csp/costasArray/ normalized-costasArray-12.xml	SAT TT=0.046	SAT TT=1.363 CHECKS=994220 NODES=595	SAT TT=1.01 CHECKS=528725 NODES=114	SAT TT=0.046	SAT TT=0.193 CHECKS=88241	SAT TT=0.098 CHECKS=88238	SAT TT=2.051 ASSIGNMENTS=516	SAT TT=1.652 ASSIGNMENTS=19	SAT TT=0.067 ASSIGNMENTS=201 CHECKS=50613	SAT TT=0.069 ASSIGNMENTS=201 CHECKS=50613	SAT TT=0.049 ASSIGNMENTS=181 CHECKS=46589	SAT TT=0.061 ASSIGNMENTS=316 CHECKS=57495	SAT TT=0.479	SAT TT=0.297 ASSIGNMENTS=1317 CHECKS=229344	SAT TT=0.077 ASSIGNMENTS=293 CHECKS=72354	SAT TT=6.223	SAT TT=1.102	SAT TT=1.64
csp/costasArray/ normalized-costasArray-13.xml	SAT TT=0.058	SAT TT=3.553 CHECKS=5253070 NODES=2745	SAT TT=1.63 CHECKS=1707190 NODES=541	SAT TT=0.167	SAT TT=0.308 CHECKS=177217	SAT TT=0.191 CHECKS=184901	SAT TT=3.739 ASSIGNMENTS=1578	SAT TT=2.097 ASSIGNMENTS=112	SAT TT=0.231 ASSIGNMENTS=824 CHECKS=228581	SAT TT=0.218 ASSIGNMENTS=824 CHECKS=228581	SAT TT=0.058 ASSIGNMENTS=148 CHECKS=43778	SAT TT=0.463 ASSIGNMENTS=2456 CHECKS=501267	SAT TT=0.468	SAT TT=0.49 ASSIGNMENTS=1828 CHECKS=380489	SAT TT=0.384 ASSIGNMENTS=1510 CHECKS=399635	SAT TT=12.374	SAT TT=1.339	SAT TT=1.701
csp/costasArray/ normalized-costasArray-14.xml	SAT TT=0.207	SAT TT=1.212 CHECKS=909507 NODES=299	SAT TT=1.987 CHECKS=2760210 NODES=631	SAT TT=0.207	SAT TT=1.775 CHECKS=1678670	SAT TT=2.504 CHECKS=2608430	SAT TT=3.235 ASSIGNMENTS=554	SAT TT=2.982 ASSIGNMENTS=446	SAT TT=0.766 ASSIGNMENTS=2376 CHECKS=775620	SAT TT=0.716 ASSIGNMENTS=2376 CHECKS=775620	SAT TT=1.459 ASSIGNMENTS=4542 CHECKS=1487410	SAT TT=0.371 ASSIGNMENTS=1598 CHECKS=377568	SAT TT=0.763	SAT TT=0.921 ASSIGNMENTS=2869 CHECKS=723258	SAT TT=1.959 ASSIGNMENTS=6765 CHECKS=2089690	SAT TT=6.597	SAT TT=2.74	SAT TT=4.461
csp/costasArray/ normalized-costasArray-15.xml	SAT TT=2.107	SAT TT=96.256 CHECKS=203540000 NODES=72743	SAT TT=17.421 CHECKS=35723600 NODES=11389	SAT TT=3.011	SAT TT=12.501 CHECKS=12844900	SAT TT=8.241 CHECKS=8703210	SAT TT=7.535 ASSIGNMENTS=3437	SAT TT=8.572 ASSIGNMENTS=3626	SAT TT=14.842 ASSIGNMENTS=3437	SAT TT=98.519 ASSIGNMENTS=72743 CHECKS=203540000	SAT TT=20.617 ASSIGNMENTS=56153 CHECKS=20841800	SAT TT=2.107 ASSIGNMENTS=6765 CHECKS=2130540	SAT TT=23.449	SAT TT=2.296 ASSIGNMENTS=6236 CHECKS=1859300	SAT TT=3.148 ASSIGNMENTS=9498 CHECKS=3236820	SAT TT=11.39	SAT TT=2.8	SAT TT=45.389
csp/costasArray/ normalized-costasArray-16.xml	SAT TT=2.038	SAT TT=39.386 CHECKS=87667300 NODES=24445	SAT TT=328.925 CHECKS=680982000 NODES=201749	SAT TT=6.065	SAT TT=5.838 CHECKS=5805990	SAT TT=8.664 CHECKS=9110420	SAT TT=31.844 ASSIGNMENTS=21059	SAT TT=62.53 ASSIGNMENTS=35369	SAT TT=38.865 ASSIGNMENTS=21059	SAT TT=46.029 ASSIGNMENTS=24445 CHECKS=87667300	SAT TT=22.864 ASSIGNMENTS=54410 CHECKS=22512900	SAT TT=4.119 ASSIGNMENTS=10595 CHECKS=4113600	SAT TT=12.761	SAT TT=30.027 ASSIGNMENTS=80687 CHECKS=29031000	SAT TT=2.038 ASSIGNMENTS=4878 CHECKS=1985480	SAT TT=189.949	SAT TT=44.477	SAT TT=14.215
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/costasArray/ normalized-costasArray-17.xml	SAT TT=13.833	SAT TT=563.132 CHECKS=1313960000 NODES=307706	SAT TT=1346.44 CHECKS=3178030000 NODES=737113	SAT TT=55.331	SAT TT=95.622 CHECKS=84111600	SAT TT=278.657 CHECKS=317420000	SAT TT=171.314 ASSIGNMENTS=190327	SAT TT=13.833 ASSIGNMENTS=9519	SAT TT=178.976 ASSIGNMENTS=190327	SAT TT=560.795 ASSIGNMENTS=307706 CHECKS=1313960000	SAT TT=662.907 ASSIGNMENTS=1491870 CHECKS=704411000	SAT TT=33.107 ASSIGNMENTS=67649 CHECKS=31996400	SAT TT=701.482	SAT TT=99.354 ASSIGNMENTS=226261 CHECKS=92982000	SAT TT=40.834 ASSIGNMENTS=81754 CHECKS=37742600	? (TO) TT=1800.13	SAT TT=41.068	SAT TT=148.646
csp/costasArray/ normalized-costasArray-18.xml	SAT TT=55.982	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=55.982	? (TO) TT=1800.08	SAT TT=669.142 CHECKS=771810000	SAT TT=117.758 ASSIGNMENTS=106218	SAT TT=271.5 ASSIGNMENTS=188683	SAT TT=125.27 ASSIGNMENTS=106218	SAT TT=800.169 ASSIGNMENTS=215964 CHECKS=114674000	SAT TT=188.427 ASSIGNMENTS=342712 CHECKS=179206000	SAT TT=226.905 ASSIGNMENTS=413268 CHECKS=215508000	SAT TT=768.693	? (TO) TT=1800.1	SAT TT=129.089 ASSIGNMENTS=215964 CHECKS=114674000	SAT TT=1091.62	SAT TT=265.22	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-19.xml	SAT TT=270.332	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	SAT TT=270.332 CHECKS=278323000	? (TO) TT=1800.04	? (TO) TT=1800.14	SAT TT=293.928 ASSIGNMENTS=176754	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1103.56 ASSIGNMENTS=1946030 CHECKS=1129800000	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/latinSquare/ normalized-latinSquare-dg-10_all.xml	UNSAT TT=1.398	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.18	UNSAT TT=1.398	UNSAT TT=1.703
csp/latinSquare/ normalized-latinSquare-dg-11_all.xml	SAT TT=1.27	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	SAT TT=1.27	? (TO) TT=1800.06
csp/latinSquare/ normalized-latinSquare-dg-12_all.xml	UNSAT TT=1.744	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.2	UNSAT TT=1.744	UNSAT TT=2.523
csp/latinSquare/ normalized-latinSquare-dg-3_all.xml	UNSAT TT=0.006	UNSAT TT=0.663 CHECKS=0 NODES=2	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.009 CHECKS=18	UNSAT TT=0.382 ASSIGNMENTS=4	UNSAT TT=0.397 ASSIGNMENTS=4	UNSAT TT=0.015 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.017 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.006 ASSIGNMENTS=3 CHECKS=102	UNSAT TT=0.007 ASSIGNMENTS=2 CHECKS=83	UNSAT TT=0.255	UNSAT TT=0.007 ASSIGNMENTS=5 CHECKS=122	UNSAT TT=0.007 ASSIGNMENTS=3 CHECKS=98	UNSAT TT=0.696	UNSAT TT=0.49	UNSAT TT=0.485
csp/latinSquare/ normalized-latinSquare-dg-4_all.xml	UNSAT TT=0.005	UNSAT TT=0.639 CHECKS=0 NODES=3	UNSAT TT=0.61 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.007 CHECKS=39	UNSAT TT=0.01 CHECKS=39	UNSAT TT=0.376 ASSIGNMENTS=0	UNSAT TT=0.368 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=9 CHECKS=364	UNSAT TT=0.019 ASSIGNMENTS=9 CHECKS=364	UNSAT TT=0.008 ASSIGNMENTS=9 CHECKS=366	UNSAT TT=0.006 ASSIGNMENTS=6 CHECKS=318	UNSAT TT=0.259	UNSAT TT=0.005 ASSIGNMENTS=18 CHECKS=637	UNSAT TT=0.006 ASSIGNMENTS=9 CHECKS=406	UNSAT TT=0.731	UNSAT TT=0.586	UNSAT TT=0.566
csp/latinSquare/ normalized-latinSquare-dg-5_all.xml	SAT TT=0.006	SAT TT=0.689 CHECKS=26 NODES=27	SAT TT=0.659 CHECKS=26 NODES=0	SAT TT=0.028	SAT TT=0.013 CHECKS=3279	SAT TT=0.012 CHECKS=1868	SAT TT=0.508 ASSIGNMENTS=6	SAT TT=0.575 ASSIGNMENTS=6	SAT TT=0.017 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.018 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.007 ASSIGNMENTS=5 CHECKS=542	SAT TT=0.006 ASSIGNMENTS=5 CHECKS=533	SAT TT=0.265	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=529	SAT TT=0.007 ASSIGNMENTS=5 CHECKS=540	SAT TT=0.712	SAT TT=0.673	SAT TT=0.667
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/latinSquare/ normalized-latinSquare-dg-6_all.xml	UNSAT TT=0.014	UNSAT TT=0.94 CHECKS=157 NODES=196	UNSAT TT=0.815 CHECKS=210 NODES=206	UNSAT TT=0.165	UNSAT TT=0.021 CHECKS=1769	UNSAT TT=0.021 CHECKS=1871	UNSAT TT=0.868 ASSIGNMENTS=273	UNSAT TT=0.751 ASSIGNMENTS=100	UNSAT TT=0.039 ASSIGNMENTS=509 CHECKS=29628	UNSAT TT=0.041 ASSIGNMENTS=509 CHECKS=29628	UNSAT TT=0.029 ASSIGNMENTS=544 CHECKS=30025	UNSAT TT=0.014 ASSIGNMENTS=144 CHECKS=11200	UNSAT TT=0.301	UNSAT TT=0.045 ASSIGNMENTS=839 CHECKS=43235	UNSAT TT=0.04 ASSIGNMENTS=807 CHECKS=43223	UNSAT TT=1.273	UNSAT TT=0.827	UNSAT TT=0.82
csp/latinSquare/ normalized-latinSquare-dg-7_all.xml	SAT TT=0.009	SAT TT=0.78 CHECKS=74 NODES=53	SAT TT=0.835 CHECKS=74 NODES=57	SAT TT=0.034	SAT TT=0.03 CHECKS=3798	SAT TT=0.03 CHECKS=4097	SAT TT=0.724 ASSIGNMENTS=10	SAT TT=0.738 ASSIGNMENTS=10	SAT TT=0.02 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.021 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.01 ASSIGNMENTS=13 CHECKS=2140	SAT TT=0.009 ASSIGNMENTS=13 CHECKS=1769	SAT TT=0.303	SAT TT=0.014 ASSIGNMENTS=163 CHECKS=8394	SAT TT=0.011 ASSIGNMENTS=37 CHECKS=5463	SAT TT=0.87	SAT TT=1.057	SAT TT=0.884
csp/latinSquare/ normalized-latinSquare-dg-8_all.xml	UNSAT TT=1.039	UNSAT TT=673.617 CHECKS=52946900 NODES=7379320	UNSAT TT=670.173 CHECKS=64468400 NODES=8128950	? (TO) TT=1800.08	UNSAT TT=204.56 CHECKS=64493400	UNSAT TT=1223.9 CHECKS=486650000	? (TO) TT=1800.41	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=152.087	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	UNSAT TT=1.039	UNSAT TT=1.039
csp/latinSquare/ normalized-latinSquare-dg-9_all.xml	UNSAT TT=1.025	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.19	UNSAT TT=1.025	UNSAT TT=1.15
csp/magicSquare/ normalized-magicSquare-10_glb.xml	SAT TT=1.684	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=897.768	SAT TT=11.69 CHECKS=1031510	SAT TT=17.067 CHECKS=1505360	? (TO) TT=1800.1	SAT TT=27.619 ASSIGNMENTS=27069	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=1.684 ASSIGNMENTS=17786 CHECKS=2032110	? (TO) TT=1800.05	? TT=1.023	SAT TT=85.986	SAT TT=1469.4
csp/magicSquare/ normalized-magicSquare-11_glb.xml	SAT TT=11.823	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=902.69	SAT TT=11.823 CHECKS=634265	SAT TT=17.951 CHECKS=962199	? (TO) TT=1800.09	SAT TT=11.894 ASSIGNMENTS=7539	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=18.713 ASSIGNMENTS=190903 CHECKS=18299700	? (TO) TT=1800.06	? TT=1.03	? (MO) TT=79.22	? (MO) TT=287.98
csp/magicSquare/ normalized-magicSquare-12_glb.xml	SAT TT=5.187	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=1127.58	SAT TT=13.175 CHECKS=551132	SAT TT=17.86 CHECKS=650219	? (TO) TT=1800.03	? (TO) TT=1800.12	SAT TT=177.024 ASSIGNMENTS=1374760 CHECKS=208353000	SAT TT=1039.5 ASSIGNMENTS=1374760 CHECKS=208353000	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=5.187 ASSIGNMENTS=37059 CHECKS=6716080	SAT TT=168.943 ASSIGNMENTS=1374760 CHECKS=208353000	? TT=1.036	? (MO) TT=143.12	? (MO) TT=349.53
csp/magicSquare/ normalized-magicSquare-13_glb.xml	SAT TT=2.879	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=949.141	SAT TT=2.879 CHECKS=182281	SAT TT=51.364 CHECKS=3103840	? (TO) TT=1800.12	SAT TT=436.179 ASSIGNMENTS=263294	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=459.794 ASSIGNMENTS=7304620 CHECKS=410981000	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=0.971	? TT=173.272	? TT=180.475
csp/magicSquare/ normalized-magicSquare-14_glb.xml	SAT TT=64.383	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=64.383 CHECKS=5363900	SAT TT=71.769 CHECKS=5967680	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? TT=1.013	? TT=181.403	? TT=180.054
csp/magicSquare/ normalized-magicSquare-15_glb.xml	SAT TT=8.089	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=8.639 CHECKS=328051	SAT TT=8.089 CHECKS=240652	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.1	? (problem) TT=0.444	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1.042	? TT=172.858	? TT=171.081
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/magicSquare/ normalized-magicSquare-16_glb.xml	SAT TT=48.292	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=48.292 CHECKS=2420730	SAT TT=791.607 CHECKS=67704600	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (problem) TT=0.483	SAT TT=1422.89 ASSIGNMENTS=5194840 CHECKS=1569760000	? (TO) TT=1800.1	? TT=1.024	? TT=173.316	? TT=174.792
csp/magicSquare/ normalized-magicSquare-17_glb.xml	SAT TT=455.393	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	SAT TT=586.94 CHECKS=24257900	SAT TT=455.393 CHECKS=16141600	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (problem) TT=0.512	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=1.086	? TT=170.987	? TT=170.526
csp/magicSquare/ normalized-magicSquare-18_glb.xml	SAT TT=382.126	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=382.126 CHECKS=15470000	SAT TT=467.941 CHECKS=4933040	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=0.549	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=1.147	? TT=167.519	? TT=166.378
csp/magicSquare/ normalized-magicSquare-19_glb.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=0.444	? (TO) TT=1800.05	? (TO) TT=1800.07	? TT=1.105	? TT=171.233	? TT=166.991
csp/magicSquare/ normalized-magicSquare-20_glb.xml		? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=0.467	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=1.177	? TT=173.315	? TT=173.279
csp/magicSquare/ normalized-magicSquare-3_glb.xml	SAT TT=0.005	SAT TT=0.656 CHECKS=69 NODES=96	SAT TT=0.668 CHECKS=71 NODES=73	SAT TT=0.026	SAT TT=0.008 CHECKS=815	SAT TT=3.704 CHECKS=717	SAT TT=0.456 ASSIGNMENTS=3	SAT TT=0.541 ASSIGNMENTS=3	SAT TT=0.018 ASSIGNMENTS=8 CHECKS=252	SAT TT=0.018 ASSIGNMENTS=8 CHECKS=252	SAT TT=0.005 ASSIGNMENTS=8 CHECKS=254	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=148	SAT TT=0.25	SAT TT=0.006 ASSIGNMENTS=22 CHECKS=651	SAT TT=0.007 ASSIGNMENTS=8 CHECKS=252	? TT=0.675	SAT TT=0.541	SAT TT=0.631
csp/magicSquare/ normalized-magicSquare-4_glb.xml	SAT TT=0.006	SAT TT=0.743 CHECKS=457 NODES=415	SAT TT=0.768 CHECKS=924 NODES=739	SAT TT=0.03	SAT TT=0.031 CHECKS=7052	SAT TT=0.014 CHECKS=1395	SAT TT=0.444 ASSIGNMENTS=9	SAT TT=0.497 ASSIGNMENTS=6	SAT TT=0.022 ASSIGNMENTS=47 CHECKS=3302	SAT TT=0.022 ASSIGNMENTS=47 CHECKS=3302	SAT TT=0.006 ASSIGNMENTS=32 CHECKS=2135	SAT TT=0.007 ASSIGNMENTS=33 CHECKS=1862	SAT TT=0.274	SAT TT=0.007 ASSIGNMENTS=109 CHECKS=3940	SAT TT=0.007 ASSIGNMENTS=49 CHECKS=3204	? TT=0.692	SAT TT=0.715	SAT TT=0.907
csp/magicSquare/ normalized-magicSquare-5_glb.xml	SAT TT=0.017	SAT TT=1.234 CHECKS=17551 NODES=8654	SAT TT=2.684 CHECKS=123515 NODES=36055	SAT TT=0.851	SAT TT=0.229 CHECKS=71461	SAT TT=0.228 CHECKS=71646	SAT TT=0.668 ASSIGNMENTS=64	SAT TT=0.632 ASSIGNMENTS=177	SAT TT=0.028 ASSIGNMENTS=233 CHECKS=18393	SAT TT=0.028 ASSIGNMENTS=233 CHECKS=18393	SAT TT=0.104 ASSIGNMENTS=2840 CHECKS=228577	SAT TT=0.106 ASSIGNMENTS=3550 CHECKS=211776	SAT TT=0.464	SAT TT=0.036 ASSIGNMENTS=1022 CHECKS=48130	SAT TT=0.017 ASSIGNMENTS=302 CHECKS=23965	? TT=0.676	SAT TT=1.892	SAT TT=3.019
csp/magicSquare/ normalized-magicSquare-6_glb.xml	SAT TT=0.08	SAT TT=1.693 CHECKS=37713 NODES=13992	SAT TT=1.786 CHECKS=39143 NODES=14132	SAT TT=1799.65	SAT TT=10.798 CHECKS=2761000	SAT TT=16.947 CHECKS=4038360	SAT TT=0.784 ASSIGNMENTS=460	SAT TT=0.727 ASSIGNMENTS=186	SAT TT=7.848 ASSIGNMENTS=6772 CHECKS=558799	SAT TT=7.323 ASSIGNMENTS=6772 CHECKS=558799	SAT TT=1.715 ASSIGNMENTS=58740 CHECKS=3127750	SAT TT=259.053 ASSIGNMENTS=6457830 CHECKS=548311000	? (TO) TT=1800.07	SAT TT=0.08 ASSIGNMENTS=2218 CHECKS=122183	SAT TT=0.299 ASSIGNMENTS=6772 CHECKS=558799	? TT=0.667	SAT TT=2.712	SAT TT=7.445
csp/magicSquare/ normalized-magicSquare-7_glb.xml	SAT TT=0.026	SAT TT=13.784 CHECKS=1117200 NODES=163190	? (TO) TT=1800.05	SAT TT=896.631	SAT TT=11.605 CHECKS=2095220	SAT TT=17.125 CHECKS=3084090	SAT TT=914.911 ASSIGNMENTS=1919250	SAT TT=1.319 ASSIGNMENTS=742	SAT TT=7.604 ASSIGNMENTS=314 CHECKS=32107	SAT TT=7.614 ASSIGNMENTS=314 CHECKS=32107	SAT TT=440.359 ASSIGNMENTS=11124100 CHECKS=808020000	? (TO) TT=1800.07	SAT TT=0.425	SAT TT=0.209 ASSIGNMENTS=4432 CHECKS=298159	SAT TT=0.026 ASSIGNMENTS=314 CHECKS=32107	? TT=0.719	SAT TT=7.195	SAT TT=26.429
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/magicSquare/ normalized-magicSquare-8_glb.xml	SAT TT=2.543	SAT TT=3.42 CHECKS=296792 NODES=23997	SAT TT=3.665 CHECKS=296792 NODES=23997	SAT TT=898.005	SAT TT=11.76 CHECKS=1737520	SAT TT=17.584 CHECKS=2595040	SAT TT=18.988 ASSIGNMENTS=19284	SAT TT=2.603 ASSIGNMENTS=1986	SAT TT=14.198 ASSIGNMENTS=108600 CHECKS=10326200	SAT TT=14.623 ASSIGNMENTS=108600 CHECKS=10326200	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=2.543 ASSIGNMENTS=45148 CHECKS=3448070	SAT TT=6.275 ASSIGNMENTS=108600 CHECKS=10326200	? TT=0.839	SAT TT=26.021	SAT TT=56.141
csp/magicSquare/ normalized-magicSquare-9_glb.xml	SAT TT=0.065	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=893.426	SAT TT=10.648 CHECKS=1471050	SAT TT=17.296 CHECKS=2174290	? (TO) TT=1800.1	SAT TT=1.74 ASSIGNMENTS=183	SAT TT=0.11 ASSIGNMENTS=1423 CHECKS=125827	SAT TT=0.115 ASSIGNMENTS=1423 CHECKS=125827	SAT TT=0.065 ASSIGNMENTS=841 CHECKS=80394	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=1.397 ASSIGNMENTS=18986 CHECKS=1655010	SAT TT=261.797 ASSIGNMENTS=4336780 CHECKS=396504000	? TT=0.921	SAT TT=581.719	SAT TT=569.869
csp/medium/ normalized-patat-02-medium-1.xml	SAT TT=128.007	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.15	SAT TT=1738.73 ASSIGNMENTS=250470 CHECKS=3520620000	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1692.09 ASSIGNMENTS=250470 CHECKS=3520620000	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=128.007
csp/medium/ normalized-patat-02-medium-2.xml	SAT TT=102.676	? (TO) TT=1800.23	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.11	SAT TT=115.198 ASSIGNMENTS=14243 CHECKS=219525000	SAT TT=703.06 ASSIGNMENTS=14243 CHECKS=219525000	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=102.676 ASSIGNMENTS=14243 CHECKS=219525000	? (TO) TT=1800.13	? (TO) TT=1800.23	SAT TT=120.645
csp/medium/ normalized-patat-02-medium-3.xml	SAT TT=121.831	? (TO) TT=1800.19	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.2	SAT TT=187.465 ASSIGNMENTS=20329 CHECKS=365668000	SAT TT=777.083 ASSIGNMENTS=20329 CHECKS=365668000	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=166.621 ASSIGNMENTS=20329 CHECKS=365668000	? (TO) TT=1800.12	? (TO) TT=1800.26	SAT TT=121.831
csp/medium/ normalized-patat-02-medium-4.xml	SAT TT=118.807	? (TO) TT=1800.17	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.2	SAT TT=1008.44 ASSIGNMENTS=187436 CHECKS=2144250000	SAT TT=1560.57 ASSIGNMENTS=187436 CHECKS=2144250000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=965.629 ASSIGNMENTS=187436 CHECKS=2144250000	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=118.807
csp/medium/ normalized-patat-02-medium-5.xml	SAT TT=93.899	? (TO) TT=1800.19	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=407.486 ASSIGNMENTS=185341 CHECKS=887187000	SAT TT=997.173 ASSIGNMENTS=185341 CHECKS=887187000	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=383.096 ASSIGNMENTS=185341 CHECKS=887187000	? (TO) TT=1802.23	? (TO) TT=1800.15	SAT TT=93.899
csp/nengfa/ normalized-protein.xml	SAT TT=5.622	SAT TT=1108.33 CHECKS=2555860000 NODES=1738100	SAT TT=552.514 CHECKS=1118470000 NODES=837562	SAT TT=1507.14	SAT TT=5.622 CHECKS=2550550	Signal TT=5.483	SAT TT=148.896 ASSIGNMENTS=138158	? (TO) TT=1800.08	SAT TT=172.737 ASSIGNMENTS=167071	SAT TT=1120.96 ASSIGNMENTS=1738100 CHECKS=2555860000	SAT TT=197.421 ASSIGNMENTS=1178800 CHECKS=342749000	SAT TT=764.168 ASSIGNMENTS=4415720 CHECKS=1306840000	? (problem) TT=0.883	? (TO) TT=1800.03	SAT TT=33.144 ASSIGNMENTS=136824 CHECKS=50246100	SAT TT=262.477	SAT TT=36.222	SAT TT=8.773
csp/nengfa/ normalized-queens2.xml	SAT TT=0.076	SAT TT=3.845 CHECKS=1210500 NODES=316	SAT TT=5.822 CHECKS=3646510 NODES=312	SAT TT=0.5	SAT TT=1.397 CHECKS=19976	SAT TT=0.93 CHECKS=23401	SAT TT=16.308 ASSIGNMENTS=1699	? (TO) TT=1800.15	SAT TT=0.095 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.088 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.083 ASSIGNMENTS=92 CHECKS=59818	SAT TT=0.155 ASSIGNMENTS=339 CHECKS=147796	? (TO) TT=1800.09	SAT TT=3.008 ASSIGNMENTS=9069 CHECKS=4885590	SAT TT=0.076 ASSIGNMENTS=93 CHECKS=58763	SAT TT=19.03	SAT TT=16.917	SAT TT=34.222
csp/nengfa/ normalized-sudoku368.xml	SAT TT=0.063	SAT TT=2.87 CHECKS=6477 NODES=4122	SAT TT=18.366 CHECKS=2733 NODES=3698	SAT TT=8.93	SAT TT=0.063 CHECKS=2477	SAT TT=0.083 CHECKS=5599	SAT TT=0.998 ASSIGNMENTS=1	SAT TT=0.935 ASSIGNMENTS=1	SAT TT=0.111 ASSIGNMENTS=302 CHECKS=123211	SAT TT=0.1 ASSIGNMENTS=302 CHECKS=123211	SAT TT=0.19 ASSIGNMENTS=1005 CHECKS=313177	SAT TT=0.546 ASSIGNMENTS=6217 CHECKS=994130	SAT TT=0.834	SAT TT=0.171 ASSIGNMENTS=1197 CHECKS=189375	SAT TT=0.104 ASSIGNMENTS=548 CHECKS=136533	SAT TT=2.834	SAT TT=3.828	SAT TT=4.161
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ortholatin/ normalized-ortholatin-10.xml		? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/ortholatin/ normalized-ortholatin-15.xml		? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (exit code) TT=1.208	? (TO) TT=1800.08	? (TO) TT=1800.08	? (MO) TT=26.92	? (TO) TT=1800.19	? (TO) TT=1800.18
csp/ortholatin/ normalized-ortholatin-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (exit code) TT=2.503	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=112.215	? (MO) TT=150.63	? (MO) TT=364.24
csp/ortholatin/ normalized-ortholatin-2.xml	UNSAT TT=0.004	UNSAT TT=0.621 CHECKS=0 NODES=2	UNSAT TT=0.631 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.006 CHECKS=100	UNSAT TT=0.008 CHECKS=97	UNSAT TT=0.36 ASSIGNMENTS=0	UNSAT TT=0.412 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.017 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.004 ASSIGNMENTS=3 CHECKS=85	UNSAT TT=0.007 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.271	UNSAT TT=0.007 ASSIGNMENTS=8 CHECKS=165	UNSAT TT=0.006 ASSIGNMENTS=3 CHECKS=87	UNSAT TT=0.676	UNSAT TT=0.48	UNSAT TT=0.498
csp/ortholatin/ normalized-ortholatin-5.xml	SAT TT=0.012	SAT TT=2.71 CHECKS=44580 NODES=21518	SAT TT=0.754 CHECKS=54 NODES=0	SAT TT=2.26	SAT TT=0.044 CHECKS=5086	SAT TT=0.044 CHECKS=4990	SAT TT=1.013 ASSIGNMENTS=17	SAT TT=0.975 ASSIGNMENTS=18	SAT TT=0.024 ASSIGNMENTS=31 CHECKS=3313	SAT TT=0.025 ASSIGNMENTS=31 CHECKS=3313	SAT TT=0.013 ASSIGNMENTS=29 CHECKS=3197	SAT TT=0.012 ASSIGNMENTS=13 CHECKS=1478	SAT TT=2.024	SAT TT=0.016 ASSIGNMENTS=105 CHECKS=5899	SAT TT=0.012 ASSIGNMENTS=29 CHECKS=2782	SAT TT=1.615	SAT TT=0.926	SAT TT=1.078
csp/ortholatin/ normalized-ortholatin-6.xml		? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04
csp/ortholatin/ normalized-ortholatin-7.xml	SAT TT=0.289	SAT TT=82.141 CHECKS=1859340 NODES=612971	SAT TT=8.975 CHECKS=144365 NODES=63343	? (TO) TT=1800.1	SAT TT=138.026 CHECKS=30676600	SAT TT=20.929 CHECKS=6541080	? (TO) TT=1800.23	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=30.886 ASSIGNMENTS=158111 CHECKS=32314500	SAT TT=18.699 ASSIGNMENTS=93358 CHECKS=21578600	? (TO) TT=1800.1	SAT TT=270.375 ASSIGNMENTS=1151240 CHECKS=385743000	? (TO) TT=1800.09	SAT TT=383.197	SAT TT=54.156	SAT TT=456.542
csp/ortholatin/ normalized-ortholatin-8.xml	SAT TT=0.539	SAT TT=859.227 CHECKS=16877400 NODES=5667120	? (TO) TT=1800.15	SAT TT=65.375	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=286.404 ASSIGNMENTS=1431890 CHECKS=373770000	? (TO) TT=1800.06	SAT TT=0.539	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.21	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/ortholatin/ normalized-ortholatin-9.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.21	? (TO) TT=1800.1	? (TO) TT=1800.06
csp/pigeons_glb/ normalized-pigeons-10_ext.xml	UNSAT TT=0.004	UNSAT TT=0.614 CHECKS=0 NODES=0	UNSAT TT=0.58 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=10	UNSAT TT=0.007 CHECKS=10	UNSAT TT=0.298 ASSIGNMENTS=0	UNSAT TT=0.341 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.252	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=46	UNSAT TT=6.543	UNSAT TT=0.333	UNSAT TT=0.337
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons_glb/ normalized-pigeons-11_ext.xml	UNSAT TT=0.006	UNSAT TT=0.608 CHECKS=0 NODES=0	UNSAT TT=0.591 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.006 CHECKS=11	UNSAT TT=0.006 CHECKS=11	UNSAT TT=0.333 ASSIGNMENTS=0	UNSAT TT=0.352 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.254	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=56	UNSAT TT=82.262	UNSAT TT=0.336	UNSAT TT=0.334
csp/pigeons_glb/ normalized-pigeons-12_ext.xml	UNSAT TT=0.004	UNSAT TT=0.578 CHECKS=0 NODES=0	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.005 CHECKS=12	UNSAT TT=0.007 CHECKS=12	UNSAT TT=0.331 ASSIGNMENTS=0	UNSAT TT=0.36 ASSIGNMENTS=0	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.227	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=67	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=67	? (TO) TT=1800.14	UNSAT TT=0.356	UNSAT TT=0.335
csp/pigeons_glb/ normalized-pigeons-13_ext.xml	UNSAT TT=0.005	UNSAT TT=0.585 CHECKS=0 NODES=0	UNSAT TT=0.604 CHECKS=0 NODES=0	UNSAT TT=0.025	UNSAT TT=0.007 CHECKS=13	UNSAT TT=0.006 CHECKS=13	UNSAT TT=0.327 ASSIGNMENTS=0	UNSAT TT=0.336 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.238	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=79	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=79	? (TO) TT=1800.13	UNSAT TT=0.356	UNSAT TT=0.371
csp/pigeons_glb/ normalized-pigeons-14_ext.xml	UNSAT TT=0.004	UNSAT TT=0.575 CHECKS=0 NODES=0	UNSAT TT=0.581 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.005 CHECKS=14	UNSAT TT=0.007 CHECKS=14	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.339 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.244	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=92	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=92	? (TO) TT=1800.09	UNSAT TT=0.381	UNSAT TT=0.366
csp/pigeons_glb/ normalized-pigeons-15_ext.xml	UNSAT TT=0.005	UNSAT TT=0.574 CHECKS=0 NODES=0	UNSAT TT=0.594 CHECKS=0 NODES=0	UNSAT TT=0.028	UNSAT TT=0.008 CHECKS=15	UNSAT TT=0.008 CHECKS=15	UNSAT TT=0.306 ASSIGNMENTS=0	UNSAT TT=0.315 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.239	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=106	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=106	? (TO) TT=1800.14	UNSAT TT=0.392	UNSAT TT=0.405
csp/pigeons_glb/ normalized-pigeons-18_ext.xml	UNSAT TT=0.006	UNSAT TT=0.593 CHECKS=0 NODES=0	UNSAT TT=0.623 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=18	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.305 ASSIGNMENTS=0	UNSAT TT=0.357 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.23	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=154	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=154	? (TO) TT=1800.13	UNSAT TT=0.419	UNSAT TT=0.414
csp/pigeons_glb/ normalized-pigeons-20_ext.xml	UNSAT TT=0.005	UNSAT TT=0.622 CHECKS=0 NODES=0	UNSAT TT=0.602 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=20	UNSAT TT=0.007 CHECKS=20	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.332 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.243	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=191	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=191	? (TO) TT=1800.11	UNSAT TT=0.397	UNSAT TT=0.397
csp/pigeons_glb/ normalized-pigeons-25_ext.xml	UNSAT TT=0.005	UNSAT TT=0.662 CHECKS=0 NODES=0	UNSAT TT=0.634 CHECKS=0 NODES=0	UNSAT TT=0.026	UNSAT TT=0.006 CHECKS=25	UNSAT TT=0.006 CHECKS=25	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.318 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.245	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=301	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=301	? (TO) TT=1800.6	UNSAT TT=0.568	UNSAT TT=0.484
csp/pigeons_glb/ normalized-pigeons-30_ext.xml	UNSAT TT=0.006	UNSAT TT=0.623 CHECKS=0 NODES=0	UNSAT TT=0.641 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.007 CHECKS=30	UNSAT TT=0.007 CHECKS=30	UNSAT TT=0.332 ASSIGNMENTS=0	UNSAT TT=0.347 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.257	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=436	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=436	? (TO) TT=1800.14	UNSAT TT=0.512	UNSAT TT=0.513
csp/pigeons_glb/ normalized-pigeons-35_ext.xml	UNSAT TT=0.006	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.644 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.007 CHECKS=35	UNSAT TT=0.009 CHECKS=35	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.353 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.235	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=596	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=596	? (TO) TT=1800.2	UNSAT TT=0.524	UNSAT TT=0.529
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons_glb/ normalized-pigeons-40_ext.xml	UNSAT TT=0.006	UNSAT TT=0.633 CHECKS=0 NODES=0	UNSAT TT=0.671 CHECKS=0 NODES=0	UNSAT TT=0.027	UNSAT TT=0.006 CHECKS=40	UNSAT TT=0.009 CHECKS=40	UNSAT TT=0.336 ASSIGNMENTS=0	UNSAT TT=0.329 ASSIGNMENTS=0	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.246	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=781	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=781	? (TO) TT=1800.11	UNSAT TT=0.544	UNSAT TT=0.555
csp/pigeons_glb/ normalized-pigeons-45_ext.xml	UNSAT TT=0.006	UNSAT TT=0.673 CHECKS=0 NODES=0	UNSAT TT=0.641 CHECKS=0 NODES=0	UNSAT TT=0.025	UNSAT TT=0.009 CHECKS=45	UNSAT TT=0.006 CHECKS=45	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.337 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.247	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=991	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=991	? (TO) TT=1800.23	UNSAT TT=0.524	UNSAT TT=0.73
csp/pigeons_glb/ normalized-pigeons-50_ext.xml	UNSAT TT=0.007	UNSAT TT=0.64 CHECKS=0 NODES=0	UNSAT TT=0.633 CHECKS=0 NODES=0	UNSAT TT=0.028	UNSAT TT=0.009 CHECKS=50	UNSAT TT=0.007 CHECKS=50	UNSAT TT=0.38 ASSIGNMENTS=0	UNSAT TT=0.362 ASSIGNMENTS=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.258	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1226	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1226	? (TO) TT=1800.14	UNSAT TT=0.598	UNSAT TT=0.583
csp/pigeons_glb/ normalized-pigeons-5_ext.xml	UNSAT TT=0.004	UNSAT TT=0.582 CHECKS=0 NODES=0	UNSAT TT=0.587 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.006 CHECKS=5	UNSAT TT=0.006 CHECKS=5	UNSAT TT=0.327 ASSIGNMENTS=0	UNSAT TT=0.346 ASSIGNMENTS=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.24	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.674	UNSAT TT=0.316	UNSAT TT=0.313
csp/pigeons_glb/ normalized-pigeons-6_ext.xml	UNSAT TT=0.004	UNSAT TT=0.566 CHECKS=0 NODES=0	UNSAT TT=0.686 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=6	UNSAT TT=0.007 CHECKS=6	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.325 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.25	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.004 ASSIGNMENTS=0 CHECKS=16	UNSAT TT=0.704	UNSAT TT=0.309	UNSAT TT=0.307
csp/pigeons_glb/ normalized-pigeons-7_ext.xml	UNSAT TT=0.006	UNSAT TT=0.579 CHECKS=0 NODES=0	UNSAT TT=0.604 CHECKS=0 NODES=0	UNSAT TT=0.023	UNSAT TT=0.007 CHECKS=7	UNSAT TT=0.006 CHECKS=7	UNSAT TT=0.32 ASSIGNMENTS=0	UNSAT TT=0.3 ASSIGNMENTS=0	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.239	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=1.026	UNSAT TT=0.315	UNSAT TT=0.315
csp/pigeons_glb/ normalized-pigeons-8_ext.xml	UNSAT TT=0.005	UNSAT TT=0.588 CHECKS=0 NODES=0	UNSAT TT=0.615 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.007 CHECKS=8	UNSAT TT=0.006 CHECKS=8	UNSAT TT=0.349 ASSIGNMENTS=0	UNSAT TT=0.302 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.248	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=29	UNSAT TT=1.377	UNSAT TT=0.322	UNSAT TT=0.321
csp/pigeons_glb/ normalized-pigeons-9_ext.xml	UNSAT TT=0.005	UNSAT TT=0.606 CHECKS=0 NODES=0	UNSAT TT=0.59 CHECKS=0 NODES=0	UNSAT TT=0.024	UNSAT TT=0.006 CHECKS=9	UNSAT TT=0.007 CHECKS=9	UNSAT TT=0.311 ASSIGNMENTS=0	UNSAT TT=0.305 ASSIGNMENTS=0	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.235	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=37	UNSAT TT=1.729	UNSAT TT=0.323	UNSAT TT=0.338
csp/pseudoGLB/ normalized-43s-smv.xml	UNSAT TT=111.955	? TT=0.929	? TT=0.8	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	? (problem) TT=1.593	? (problem) TT=3.653	? (TO) TT=1800.09	? (problem) TT=1474.75	? (problem) TT=1.591	? TT=1.845	UNSAT TT=111.955	UNSAT TT=238.32
csp/pseudoGLB/ normalized-army12-21bt.xml		? TT=0.621	? TT=0.65	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=0.818	? (TO) TT=1800.06	? (TO) TT=1800.14
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-army12-21ls.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=0.819	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/pseudoGLB/ normalized-army13-24ls.xml		? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=0.828	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/pseudoGLB/ normalized-army9-12ls.xml	SAT TT=2.98	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=955.134	SAT TT=1169.67 CHECKS=451769000	? (TO) TT=1800.06	SAT TT=1739.74 ASSIGNMENTS=11510000	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=142.661	SAT TT=4.743 ASSIGNMENTS=15281 CHECKS=3547570	? (TO) TT=1800.03	? TT=0.77	SAT TT=23.531	SAT TT=2.98
csp/pseudoGLB/ normalized-cache-inv10-ucl.xml	UNSAT TT=5.679	? TT=0.936	? TT=0.974	UNSAT TT=10.151	UNSAT TT=16.192 CHECKS=1935330	UNSAT TT=16.564 CHECKS=2361740	UNSAT TT=10.917 ASSIGNMENTS=0	UNSAT TT=14.308 ASSIGNMENTS=0	? (problem) TT=18.937	UNSAT TT=29.304 ASSIGNMENTS=0	? (problem) TT=94.054	? (problem) TT=226.705	UNSAT TT=5.679	? (problem) TT=458.7	? (problem) TT=10.137	? TT=2.548	UNSAT TT=7.162	UNSAT TT=7.04
csp/pseudoGLB/ normalized-cache-inv12-ucl.xml	UNSAT TT=24.393	? TT=1.61	? TT=1.54	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.2	? (TO) TT=1800.13	? (problem) TT=31.146	? (TO) TT=1800.08	? (problem) TT=99.343	? (problem) TT=114.222	UNSAT TT=1514.22	? (TO) TT=1800.1	? (problem) TT=16.763	? TT=3.667	UNSAT TT=24.393	UNSAT TT=25.602
csp/pseudoGLB/ normalized-chnl10-15-pb-cnf-cr.xml	UNSAT TT=0.074	UNSAT TT=1.9 CHECKS=68173 NODES=19735	UNSAT TT=2.331 CHECKS=108997 NODES=25607	? (TO) TT=1800.1	UNSAT TT=0.074 CHECKS=7852	UNSAT TT=0.104 CHECKS=17083	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=50.777	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=0.804	UNSAT TT=16.295	UNSAT TT=6.202
csp/pseudoGLB/ normalized-chnl10-20-pb-cnf-cr.xml	UNSAT TT=0.105	UNSAT TT=3.153 CHECKS=75102 NODES=35388	UNSAT TT=3.496 CHECKS=92593 NODES=39340	? (TO) TT=1800.02	UNSAT TT=0.106 CHECKS=10219	UNSAT TT=0.105 CHECKS=8507	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=61.773	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=0.763	UNSAT TT=20.808	UNSAT TT=7.023
csp/pseudoGLB/ normalized-chnl15-20-pb-cnf-cr.xml	UNSAT TT=0.391	UNSAT TT=60.912 CHECKS=1960670 NODES=769275	UNSAT TT=140.354 CHECKS=6238600 NODES=1722070	? (TO) TT=1800.02	UNSAT TT=0.462 CHECKS=85632	UNSAT TT=0.391 CHECKS=66820	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=0.819	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/pseudoGLB/ normalized-chnl15-25-pb-cnf-cr.xml	UNSAT TT=0.63	UNSAT TT=123.762 CHECKS=3394620 NODES=1394070	UNSAT TT=223.337 CHECKS=6403000 NODES=2443880	? (TO) TT=1800.1	UNSAT TT=0.673 CHECKS=124985	UNSAT TT=0.63 CHECKS=121942	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=0.877	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-chnl35-40-pb-cnf-cr.xml	UNSAT TT=14.277	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=14.277 CHECKS=1842180	UNSAT TT=28.227 CHECKS=2505810	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? TT=1.597	? (TO) TT=1800.09	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-chnl35-45-pb-cnf-cr.xml	UNSAT TT=19.312	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.04	UNSAT TT=19.312 CHECKS=2267900	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? TT=1.669	? (TO) TT=1800.1	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-chnl40-45-pb-cnf-cr.xml	UNSAT TT=27.412	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	UNSAT TT=27.412 CHECKS=3209810	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=1.858	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl40-50-pb-cnf-cr.xml		? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=1.939	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl50-60-pb-cnf-cr.xml		? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=2.53	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/pseudoGLB/ normalized-dbst-v30-e350-d15-mw10-3.PB06.xml	SAT TT=32.668	? (MO) TT=21.624	? (MO) TT=20.626	SAT TT=882.268	? TT=24.447	? TT=22.253	? (MO) TT=56.845	? (MO) TT=72.231	? (problem) TT=126.527	SAT TT=1102.15 ASSIGNMENTS=761 CHECKS=2641290	SAT TT=69.859 ASSIGNMENTS=1143 CHECKS=26800700	SAT TT=364.402 ASSIGNMENTS=144336 CHECKS=165586000	? (MO) TT=215.65	SAT TT=96.513 ASSIGNMENTS=3292 CHECKS=52623000	SAT TT=32.668 ASSIGNMENTS=761 CHECKS=2641290	? TT=1.082	? (MO) TT=189.01	? (MO) TT=361.134
csp/pseudoGLB/ normalized-elf-rf7-ucl.xml	UNSAT TT=1.461	? TT=0.704	? TT=0.832	? (TO) TT=1800.02	UNSAT TT=2.549 CHECKS=1589780	UNSAT TT=2.456 CHECKS=1551410	UNSAT TT=2.745 ASSIGNMENTS=760	UNSAT TT=2.497 ASSIGNMENTS=46	UNSAT TT=8.874 ASSIGNMENTS=760	UNSAT TT=9.328 ASSIGNMENTS=760	? (problem) TT=0.248	? (problem) TT=1.442	UNSAT TT=1.461	? (problem) TT=396.465	? (problem) TT=0.255	? TT=1.034	UNSAT TT=2.755	UNSAT TT=4.226
csp/pseudoGLB/ normalized-fpga10-10-sat-pb-cnf-cr.xml	SAT TT=0.064	SAT TT=10.956 CHECKS=2516440 NODES=298884	SAT TT=7.515 CHECKS=2083110 NODES=174218	SAT TT=1794.12	SAT TT=0.129 CHECKS=29530	SAT TT=0.124 CHECKS=27874	SAT TT=4.62 ASSIGNMENTS=63895	SAT TT=0.638 ASSIGNMENTS=66	SAT TT=62.499 ASSIGNMENTS=1174710 CHECKS=56932200	SAT TT=63.247 ASSIGNMENTS=1174710 CHECKS=56932200	? (TO) TT=1800.06	SAT TT=494.505 ASSIGNMENTS=9836430 CHECKS=515575000	SAT TT=19.716	SAT TT=0.064 ASSIGNMENTS=1110 CHECKS=38055	SAT TT=50.565 ASSIGNMENTS=1174710 CHECKS=56932200	? TT=0.728	SAT TT=1.125	SAT TT=1.177
csp/pseudoGLB/ normalized-fpga11-9-sat-pb-cnf-cr.xml	SAT TT=0.621	SAT TT=95.93 CHECKS=31372800 NODES=2720840	SAT TT=71.956 CHECKS=23961200 NODES=2007370	SAT TT=893.445	SAT TT=0.621 CHECKS=267981	SAT TT=0.773 CHECKS=347038	SAT TT=9.134 ASSIGNMENTS=135001	SAT TT=1.547 ASSIGNMENTS=5805	SAT TT=519.224 ASSIGNMENTS=12547100 CHECKS=538253000	SAT TT=499.08 ASSIGNMENTS=12547100 CHECKS=538253000	? (TO) TT=1800.05	SAT TT=50.819 ASSIGNMENTS=1146160 CHECKS=54569500	SAT TT=1627.88	SAT TT=2.363 ASSIGNMENTS=20286 CHECKS=2193560	SAT TT=511.315 ASSIGNMENTS=12547100 CHECKS=538253000	? TT=0.753	SAT TT=0.95	SAT TT=0.971
csp/pseudoGLB/ normalized-fpga13-13-sat-pb-cnf-cr.xml	SAT TT=0.477	? (TO) TT=1800.15	SAT TT=1294.69 CHECKS=405977000 NODES=26011500	? (TO) TT=1800.1	SAT TT=0.519 CHECKS=142055	SAT TT=0.477 CHECKS=140126	SAT TT=51.261 ASSIGNMENTS=697509	SAT TT=0.763 ASSIGNMENTS=115	? (TO) TT=1800.05	SAT TT=1717.79 ASSIGNMENTS=697509	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=0.562 ASSIGNMENTS=4592 CHECKS=314745	? (TO) TT=1800.1	? TT=0.721	SAT TT=9.116	SAT TT=1.284
csp/pseudoGLB/ normalized-fpga14-12-sat-pb-cnf-cr.xml	SAT TT=0.826	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=898.458	SAT TT=1.024 CHECKS=341240	SAT TT=17.139 CHECKS=7053220	SAT TT=181.628 ASSIGNMENTS=2638800	SAT TT=0.826 ASSIGNMENTS=580	SAT TT=1064.92 ASSIGNMENTS=17986500 CHECKS=970322000	SAT TT=1071.92 ASSIGNMENTS=17986500 CHECKS=970322000	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=1353.62 ASSIGNMENTS=6150600 CHECKS=1158530000	SAT TT=1057.32 ASSIGNMENTS=17986500 CHECKS=970322000	? TT=0.785	? (TO) TT=1800.1	SAT TT=1.311
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-fpga14-13-sat-pb-cnf-cr.xml	SAT TT=0.66	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=1786.83	SAT TT=0.789 CHECKS=232522	SAT TT=0.66 CHECKS=184982	SAT TT=577.847 ASSIGNMENTS=7181960	SAT TT=0.97 ASSIGNMENTS=134	SAT TT=1768.25 ASSIGNMENTS=25845000 CHECKS=1496540000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=316.671 ASSIGNMENTS=2019240 CHECKS=185447000	? (TO) TT=1800.05	? TT=0.799	SAT TT=13.375	SAT TT=1.381
csp/pseudoGLB/ normalized-fpga14-14-sat-pb-cnf-cr.xml	SAT TT=0.702	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	SAT TT=0.74 CHECKS=199492	SAT TT=0.702 CHECKS=186245	SAT TT=493.404 ASSIGNMENTS=6039580	SAT TT=0.979 ASSIGNMENTS=134	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=17.844 ASSIGNMENTS=105858 CHECKS=8282440	? (TO) TT=1800.03	? TT=0.787	SAT TT=18.902	SAT TT=1.545
csp/pseudoGLB/ normalized-fpga20-20-sat-pb-cnf-cr.xml	SAT TT=1.067	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=6.187 CHECKS=1542100	SAT TT=898.037 CHECKS=178471000	? (TO) TT=1800.06	SAT TT=1.067 ASSIGNMENTS=281	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=0.838	? (TO) TT=1800.04	SAT TT=2.656
csp/pseudoGLB/ normalized-fpga25-24-sat-pb-cnf-cr.xml	SAT TT=3.997	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=24.412 CHECKS=5427660	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=11.213 ASSIGNMENTS=33636	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=0.938	? (TO) TT=1800	SAT TT=3.997
csp/pseudoGLB/ normalized-fpga25-25-sat-pb-cnf-cr.xml	SAT TT=1.421	? (TO) TT=1800.19	? (TO) TT=1800.16	SAT TT=1344.02	SAT TT=23.048 CHECKS=5355780	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=1.421 ASSIGNMENTS=445	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=0.92	? (TO) TT=1800.08	SAT TT=5.048
csp/pseudoGLB/ normalized-fpga30-30-sat-pb-cnf-cr.xml	SAT TT=2.156	? (TO) TT=1800.12	? (TO) TT=1800.18	SAT TT=1345.22	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=2.156 ASSIGNMENTS=646	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=1.023	? (TO) TT=1800.06	SAT TT=6.45
csp/pseudoGLB/ normalized-fpga35-34-sat-pb-cnf-cr.xml	SAT TT=10.776	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=81.418 ASSIGNMENTS=135627	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=1.264	? (TO) TT=1800.07	SAT TT=10.776
csp/pseudoGLB/ normalized-ooo-rf8-ucl.xml	UNSAT TT=8.423	? TT=0.918	? TT=0.872	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.02	? (problem) TT=1.535	? (problem) TT=12.738	UNSAT TT=483.595	? (problem) TT=170.813	? (problem) TT=1.555	? TT=2.403	UNSAT TT=8.423	UNSAT TT=14.45
csp/pseudoGLB/ normalized-ooo-tag12-ucl.xml	UNSAT TT=45.558	? TT=1.408	? TT=1.49	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.01	? (TO) TT=1800.06	? (problem) TT=4.722	? (problem) TT=34.524	? (TO) TT=1800.06	? (problem) TT=1760.55	? (problem) TT=4.759	? TT=3.558	UNSAT TT=45.558	UNSAT TT=55.36
csp/pseudoGLB/ normalized-pigeon-cardinality-105-100.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=3.219	? (TO) TT=1800.03	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-pigeon-cardinality-15-10.xml	UNSAT TT=0.05	UNSAT TT=1.32 CHECKS=57416 NODES=15550	UNSAT TT=1.427 CHECKS=46460 NODES=18649	UNSAT TT=464.795	UNSAT TT=0.05 CHECKS=9362	UNSAT TT=0.055 CHECKS=10353	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=33.916	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=0.704	UNSAT TT=81.191	UNSAT TT=361.502
csp/pseudoGLB/ normalized-pigeon-cardinality-25-20.xml	UNSAT TT=0.765	UNSAT TT=1371.69 CHECKS=99863900 NODES=22092500	? (TO) TT=1800.17	? (TO) TT=1800.04	UNSAT TT=0.765 CHECKS=137091	UNSAT TT=0.807 CHECKS=145695	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=0.826	? (TO) TT=1800.11	? (TO) TT=1800.07
csp/pseudoGLB/ normalized-pigeon-cardinality-55-50.xml		? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=1.504	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-pigeon-cardinality-71-70.xml		? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=2.257	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/pseudoGLB/ normalized-pigeon-cardinality-75-70.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? TT=2.517	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-pigeon-cardinality-95-90.xml		? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=2.502	? (TO) TT=1800.02	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-pigeon-clauses-45-40.xml		? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? TT=1.291	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/pseudoGLB/ normalized-pigeon-clauses-65-60.xml		? (MO) TT=22.846	? (MO) TT=22.743	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.41	? (TO) TT=1800.3	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? TT=2.079	? (TO) TT=1800.04	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-pigeon-clauses-71-70.xml		? (MO) TT=11.702	? (MO) TT=9.477	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.25	? (TO) TT=1800.7	? (MO) TT=1594.71	? (MO) TT=1101.75	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=2.291	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/pseudoGLB/ normalized-pigeon-clauses-91-90.xml		? (MO) TT=18.266	? (MO) TT=20.523	? (TO) TT=1800.09	? TT=23.043	? TT=22.428	? (problem) TT=291.593	? (MO) TT=76.881	? (TO) TT=1800.03	? (problem) TT=1539.62	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.1	? TT=2.494	? (TO) TT=1800.05	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-pigeon-clauses-95-90.xml		? (MO) TT=21.777	? (MO) TT=21.308	? (TO) TT=1800.06	? TT=24.517	? TT=22.257	? (problem) TT=265.636	? (problem) TT=270.813	? (problem) TT=1591.42	? (problem) TT=1087.55	? (TO) TT=1800.15	? (TO) TT=1800.13	? (exit code) TT=82.039	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=2.491	? (TO) TT=1800.08	? (MO) TT=6.298
csp/pseudoGLB/ normalized-ppp:1-9-16-19.xml	SAT TT=1429.89	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=15.662	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1.975	SAT TT=1429.89	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-reduced-cuww2.xml	SAT TT=0.01	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=0.038	SAT TT=3.747 CHECKS=189255	SAT TT=5.059 CHECKS=270004	SAT TT=0.877 ASSIGNMENTS=6983	SAT TT=0.441 ASSIGNMENTS=51	SAT TT=0.127 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.117 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.117 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.019 ASSIGNMENTS=424 CHECKS=1793	SAT TT=0.347	SAT TT=0.016 ASSIGNMENTS=202 CHECKS=1272	SAT TT=0.01 ASSIGNMENTS=57 CHECKS=203	? TT=0.654	? TT=1478.16	? TT=466.925
csp/pseudoGLB/ normalized-reduced-prob10.xml	SAT TT=0.015	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=0.038	SAT TT=0.084 CHECKS=2024	SAT TT=0.085 CHECKS=2008	SAT TT=0.426 ASSIGNMENTS=132	SAT TT=0.474 ASSIGNMENTS=171	SAT TT=0.027 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.026 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.015 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.018 ASSIGNMENTS=223 CHECKS=815	SAT TT=0.328	SAT TT=0.017 ASSIGNMENTS=175 CHECKS=1035	SAT TT=0.024 ASSIGNMENTS=296 CHECKS=1834	? TT=0.697	? TT=895.488	? TT=912.307
csp/pseudoGLB/ normalized-reduced-prob1.xml	SAT TT=0.017	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.034	SAT TT=0.107 CHECKS=3642	SAT TT=0.106 CHECKS=3622	SAT TT=0.469 ASSIGNMENTS=197	SAT TT=0.517 ASSIGNMENTS=198	SAT TT=0.032 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.031 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.02 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.021 ASSIGNMENTS=377 CHECKS=1658	SAT TT=0.32	SAT TT=0.033 ASSIGNMENTS=468 CHECKS=3104	SAT TT=0.017 ASSIGNMENTS=258 CHECKS=1304	? TT=0.704	? TT=801.198	? TT=787.216
csp/pseudoGLB/ normalized-reduced-prob3.xml	SAT TT=0.019	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=0.035	SAT TT=0.231 CHECKS=14987	SAT TT=0.228 CHECKS=15344	SAT TT=0.519 ASSIGNMENTS=1451	SAT TT=0.656 ASSIGNMENTS=1904	SAT TT=0.031 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.032 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.019 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.133 ASSIGNMENTS=5835 CHECKS=28841	SAT TT=0.299	SAT TT=0.027 ASSIGNMENTS=610 CHECKS=4245	SAT TT=0.067 ASSIGNMENTS=1650 CHECKS=12596	? TT=0.702	? TT=241.347	? TT=243.218
csp/pseudoGLB/ normalized-reduced-prob4.xml	SAT TT=0.015	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=0.035	SAT TT=0.13 CHECKS=4198	SAT TT=0.232 CHECKS=7880	SAT TT=0.474 ASSIGNMENTS=220	SAT TT=0.555 ASSIGNMENTS=101	SAT TT=0.034 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.031 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.02 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.029 ASSIGNMENTS=691 CHECKS=3029	SAT TT=0.363	SAT TT=0.029 ASSIGNMENTS=345 CHECKS=2850	SAT TT=0.015 ASSIGNMENTS=123 CHECKS=791	? TT=0.683	? TT=332.609	? TT=327.75
csp/pseudoGLB/ normalized-robin10.xml	SAT TT=7.256	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=24.253 ASSIGNMENTS=60110	SAT TT=10.722 ASSIGNMENTS=8653	SAT TT=27.081 ASSIGNMENTS=11347 CHECKS=4560900	SAT TT=27.189 ASSIGNMENTS=11347 CHECKS=4560900	SAT TT=29.481 ASSIGNMENTS=15635 CHECKS=7028610	SAT TT=844.801 ASSIGNMENTS=568788 CHECKS=217775000	SAT TT=1532.03	SAT TT=1397.68 ASSIGNMENTS=819382 CHECKS=346444000	SAT TT=19.454 ASSIGNMENTS=11347 CHECKS=4560900	? TT=1.235	SAT TT=7.256	SAT TT=47.115
csp/pseudoGLB/ normalized-robin12.xml	SAT TT=53.734	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=280.36 ASSIGNMENTS=399560	? (TO) TT=1800.14	? (TO) TT=1800.01	SAT TT=1189.42 ASSIGNMENTS=399560	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=1.929	SAT TT=53.734	SAT TT=543.542
csp/pseudoGLB/ normalized-robin16.xml		? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1819.67	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=3.264	? (TO) TT=1800.07	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1110966688.xml	UNSAT TT=2.307	UNSAT TT=1395.12 CHECKS=292605000 NODES=42673900	UNSAT TT=229.203 CHECKS=51231100 NODES=7317180	UNSAT TT=9.488	UNSAT TT=290.62 CHECKS=22616200	UNSAT TT=300.481 CHECKS=21755200	UNSAT TT=13.914 ASSIGNMENTS=117121	UNSAT TT=28.806 ASSIGNMENTS=251948	UNSAT TT=85.92 ASSIGNMENTS=275090 CHECKS=25961000	UNSAT TT=1311.56 ASSIGNMENTS=42673900 CHECKS=292605000	UNSAT TT=30.105 ASSIGNMENTS=109917 CHECKS=9123780	UNSAT TT=22.303 ASSIGNMENTS=98767 CHECKS=7364380	UNSAT TT=2.307	UNSAT TT=58.422 ASSIGNMENTS=213355 CHECKS=16719700	UNSAT TT=79.272 ASSIGNMENTS=275090 CHECKS=25961000	? TT=0.723	UNSAT TT=24.139	UNSAT TT=30.996
csp/pseudoGLB/ normalized-t2001-13queen13-1110967523.xml	UNSAT TT=3.314	UNSAT TT=465.664 CHECKS=84608400 NODES=15260200	UNSAT TT=1083.03 CHECKS=230575000 NODES=34998500	UNSAT TT=11.908	UNSAT TT=298.003 CHECKS=22902500	UNSAT TT=145.048 CHECKS=9546150	UNSAT TT=44.334 ASSIGNMENTS=441003	UNSAT TT=40.513 ASSIGNMENTS=335533	UNSAT TT=156.586 ASSIGNMENTS=486776 CHECKS=45075400	UNSAT TT=506.596 ASSIGNMENTS=15260200 CHECKS=84608400	UNSAT TT=47.977 ASSIGNMENTS=194708 CHECKS=14772000	UNSAT TT=41.11 ASSIGNMENTS=179201 CHECKS=13735900	UNSAT TT=3.314	UNSAT TT=137.075 ASSIGNMENTS=516401 CHECKS=39724300	UNSAT TT=147.742 ASSIGNMENTS=486776 CHECKS=45075400	? TT=0.744	UNSAT TT=48.603	UNSAT TT=63.647
csp/pseudoGLB/ normalized-t2001-13queen13-1110968898.xml	UNSAT TT=2.48	UNSAT TT=807.428 CHECKS=141797000 NODES=26679200	UNSAT TT=304.532 CHECKS=54367000 NODES=9896390	UNSAT TT=11.469	UNSAT TT=255.713 CHECKS=21956900	UNSAT TT=204.766 CHECKS=14577300	UNSAT TT=25.927 ASSIGNMENTS=222762	UNSAT TT=40.825 ASSIGNMENTS=327491	UNSAT TT=98.231 ASSIGNMENTS=289749 CHECKS=27446900	UNSAT TT=823.616 ASSIGNMENTS=26679200 CHECKS=141797000	UNSAT TT=43.5 ASSIGNMENTS=168219 CHECKS=13152700	UNSAT TT=33.372 ASSIGNMENTS=139025 CHECKS=10895000	UNSAT TT=2.48	UNSAT TT=87.122 ASSIGNMENTS=373447 CHECKS=26537900	UNSAT TT=90.092 ASSIGNMENTS=289749 CHECKS=27446900	? TT=0.746	UNSAT TT=38.77	UNSAT TT=43.165
csp/pseudoGLB/ normalized-t2001-13queen13-1110969577.xml	UNSAT TT=2.413	UNSAT TT=662.843 CHECKS=119791000 NODES=19731700	UNSAT TT=758.389 CHECKS=153063000 NODES=22348100	UNSAT TT=7.672	UNSAT TT=265.654 CHECKS=21691800	UNSAT TT=136.159 CHECKS=8752900	UNSAT TT=26.754 ASSIGNMENTS=226749	UNSAT TT=30.924 ASSIGNMENTS=243695	UNSAT TT=93.765 ASSIGNMENTS=286366 CHECKS=25823600	UNSAT TT=625.594 ASSIGNMENTS=19731700 CHECKS=119791000	UNSAT TT=22.554 ASSIGNMENTS=82058 CHECKS=6767800	UNSAT TT=21.953 ASSIGNMENTS=92616 CHECKS=6742640	UNSAT TT=2.413	UNSAT TT=95.782 ASSIGNMENTS=361527 CHECKS=27320100	UNSAT TT=78.812 ASSIGNMENTS=286366 CHECKS=25823600	? TT=0.73	UNSAT TT=30.983	UNSAT TT=37.033
csp/pseudoGLB/ normalized-t2001-13queen13-1110970631.xml	UNSAT TT=2.765	UNSAT TT=1101.25 CHECKS=233661000 NODES=33202400	UNSAT TT=227.236 CHECKS=41533900 NODES=6734240	UNSAT TT=8.462	UNSAT TT=332.019 CHECKS=24128200	UNSAT TT=285.776 CHECKS=17160200	UNSAT TT=33.716 ASSIGNMENTS=296808	UNSAT TT=28.484 ASSIGNMENTS=244600	UNSAT TT=112.491 ASSIGNMENTS=387780 CHECKS=32023400	UNSAT TT=1028.66 ASSIGNMENTS=33202400 CHECKS=233661000	UNSAT TT=39.239 ASSIGNMENTS=167989 CHECKS=11979000	UNSAT TT=34.286 ASSIGNMENTS=155012 CHECKS=10595100	UNSAT TT=2.765	UNSAT TT=120.876 ASSIGNMENTS=490107 CHECKS=34302200	UNSAT TT=103.883 ASSIGNMENTS=387780 CHECKS=32023400	? TT=0.712	UNSAT TT=25.678	UNSAT TT=32.205
csp/pseudoGLB/ normalized-t2001-13queen13-1110972763.xml	UNSAT TT=3.706	UNSAT TT=946.865 CHECKS=170204000 NODES=28873700	UNSAT TT=904.206 CHECKS=177285000 NODES=28596300	UNSAT TT=11.471	UNSAT TT=217.396 CHECKS=14979000	UNSAT TT=497.301 CHECKS=38525800	UNSAT TT=13.869 ASSIGNMENTS=118057	UNSAT TT=30.018 ASSIGNMENTS=238012	UNSAT TT=69.284 ASSIGNMENTS=217209 CHECKS=20270500	UNSAT TT=879.271 ASSIGNMENTS=28873700 CHECKS=170204000	UNSAT TT=34.942 ASSIGNMENTS=131599 CHECKS=10574600	UNSAT TT=25.919 ASSIGNMENTS=103639 CHECKS=7922360	UNSAT TT=3.706	UNSAT TT=123.827 ASSIGNMENTS=469763 CHECKS=35484000	UNSAT TT=62.248 ASSIGNMENTS=217209 CHECKS=20270500	? TT=0.738	UNSAT TT=31.463	UNSAT TT=36.494
csp/pseudoGLB/ normalized-t2001-13queen13-1110972958.xml	SAT TT=0.457	SAT TT=175.997 CHECKS=31677500 NODES=5341920	SAT TT=431.39 CHECKS=94251000 NODES=12843600	SAT TT=6.314	SAT TT=18.533 CHECKS=1228020	SAT TT=22.251 CHECKS=1549060	SAT TT=16.61 ASSIGNMENTS=139594	SAT TT=3.01 ASSIGNMENTS=16536	SAT TT=7.494 ASSIGNMENTS=1312 CHECKS=132791	SAT TT=170.292 ASSIGNMENTS=5341920 CHECKS=31677500	SAT TT=41.337 ASSIGNMENTS=162503 CHECKS=13497600	SAT TT=24.241 ASSIGNMENTS=100804 CHECKS=8059580	SAT TT=3.452	SAT TT=7.019 ASSIGNMENTS=28745 CHECKS=1989630	SAT TT=0.457 ASSIGNMENTS=1312 CHECKS=132791	? TT=0.724	SAT TT=19.718	SAT TT=30.023
csp/pseudoGLB/ normalized-t2001-13queen13-1110973670.xml	UNSAT TT=2.747	UNSAT TT=1259.18 CHECKS=265073000 NODES=39310300	UNSAT TT=1094.69 CHECKS=241123000 NODES=32724500	UNSAT TT=13.079	UNSAT TT=265.448 CHECKS=20769400	UNSAT TT=190.481 CHECKS=13205900	UNSAT TT=25.014 ASSIGNMENTS=210721	UNSAT TT=38.805 ASSIGNMENTS=348239	UNSAT TT=60.172 ASSIGNMENTS=158900 CHECKS=15713000	UNSAT TT=1206.59 ASSIGNMENTS=39310300 CHECKS=265073000	UNSAT TT=22.753 ASSIGNMENTS=88517 CHECKS=7358070	UNSAT TT=15.226 ASSIGNMENTS=62836 CHECKS=4994090	UNSAT TT=2.747	UNSAT TT=153.655 ASSIGNMENTS=662250 CHECKS=46548000	UNSAT TT=52.91 ASSIGNMENTS=158900 CHECKS=15713000	? TT=0.744	UNSAT TT=29.467	UNSAT TT=47.967
csp/pseudoGLB/ normalized-t2001-13queen13-1110975607.xml	UNSAT TT=1.907	UNSAT TT=315.152 CHECKS=77290800 NODES=10162000	UNSAT TT=211.581 CHECKS=35757300 NODES=6276880	UNSAT TT=11.892	UNSAT TT=117.815 CHECKS=7250890	UNSAT TT=286.032 CHECKS=17730200	UNSAT TT=10.53 ASSIGNMENTS=86346	UNSAT TT=27.954 ASSIGNMENTS=238556	UNSAT TT=56.879 ASSIGNMENTS=156452 CHECKS=14813800	UNSAT TT=325.434 ASSIGNMENTS=10162000 CHECKS=77290800	UNSAT TT=22.05 ASSIGNMENTS=88367 CHECKS=7052390	UNSAT TT=13.762 ASSIGNMENTS=60699 CHECKS=4162810	UNSAT TT=1.907	UNSAT TT=90.262 ASSIGNMENTS=359097 CHECKS=25640500	UNSAT TT=45.874 ASSIGNMENTS=156452 CHECKS=14813800	? TT=0.72	UNSAT TT=19.868	UNSAT TT=25.341
csp/pseudoGLB/ normalized-t2001-13queen13-1110976730.xml	UNSAT TT=7.307	UNSAT TT=867.439 CHECKS=146101000 NODES=28151600	UNSAT TT=763.369 CHECKS=152851000 NODES=23281900	UNSAT TT=11.182	UNSAT TT=871.176 CHECKS=74821200	UNSAT TT=485.946 CHECKS=38417900	UNSAT TT=26.964 ASSIGNMENTS=224839	UNSAT TT=38.423 ASSIGNMENTS=337438	UNSAT TT=325.652 ASSIGNMENTS=1160150 CHECKS=97597000	UNSAT TT=887.441 ASSIGNMENTS=28151600 CHECKS=146101000	UNSAT TT=72.51 ASSIGNMENTS=291373 CHECKS=22181100	UNSAT TT=60.103 ASSIGNMENTS=252358 CHECKS=19689600	UNSAT TT=7.307	UNSAT TT=169.358 ASSIGNMENTS=651168 CHECKS=48911500	UNSAT TT=316.725 ASSIGNMENTS=1160150 CHECKS=97597000	? TT=0.747	UNSAT TT=58.235	UNSAT TT=88.155
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1110976935.xml	UNSAT TT=2.841	UNSAT TT=236.513 CHECKS=47953100 NODES=7544040	UNSAT TT=653.411 CHECKS=125229000 NODES=21035900	UNSAT TT=11.79	UNSAT TT=187.841 CHECKS=13658600	UNSAT TT=293.467 CHECKS=21472100	UNSAT TT=14.392 ASSIGNMENTS=117566	UNSAT TT=53.06 ASSIGNMENTS=447053	UNSAT TT=116.975 ASSIGNMENTS=375027 CHECKS=33285600	UNSAT TT=239.683 ASSIGNMENTS=7544040 CHECKS=47953100	UNSAT TT=32.766 ASSIGNMENTS=121612 CHECKS=9970130	UNSAT TT=23.352 ASSIGNMENTS=98157 CHECKS=7092340	UNSAT TT=2.841	UNSAT TT=96.12 ASSIGNMENTS=390558 CHECKS=27418300	UNSAT TT=100.686 ASSIGNMENTS=375027 CHECKS=33285600	? TT=0.72	UNSAT TT=32.704	UNSAT TT=36.483
csp/pseudoGLB/ normalized-t2001-13queen13-1110977464.xml	SAT TT=2.312	SAT TT=178.225 CHECKS=27265700 NODES=5327440	SAT TT=803.016 CHECKS=138050000 NODES=24512800	SAT TT=2.312	SAT TT=189.985 CHECKS=16862800	SAT TT=149.717 CHECKS=11310000	SAT TT=31.03 ASSIGNMENTS=271875	SAT TT=5.844 ASSIGNMENTS=40056	SAT TT=70.314 ASSIGNMENTS=205435 CHECKS=19199300	SAT TT=170.211 ASSIGNMENTS=5327440 CHECKS=27265700	SAT TT=15.998 ASSIGNMENTS=59643 CHECKS=4854110	SAT TT=19.767 ASSIGNMENTS=86817 CHECKS=6570960	SAT TT=2.362	SAT TT=23.29 ASSIGNMENTS=104584 CHECKS=7079100	SAT TT=63.021 ASSIGNMENTS=205435 CHECKS=19199300	? TT=0.695	SAT TT=14.773	SAT TT=32.946
csp/pseudoGLB/ normalized-t2001-13queen13-1111212923.xml	UNSAT TT=4.294	UNSAT TT=578.644 CHECKS=106337000 NODES=19015400	UNSAT TT=251.131 CHECKS=41066500 NODES=7604240	UNSAT TT=8.673	UNSAT TT=376.384 CHECKS=28001700	UNSAT TT=482.075 CHECKS=36170300	UNSAT TT=17.773 ASSIGNMENTS=160627	UNSAT TT=40.477 ASSIGNMENTS=326001	UNSAT TT=132.923 ASSIGNMENTS=500784 CHECKS=40872700	UNSAT TT=582.02 ASSIGNMENTS=19015400 CHECKS=106337000	UNSAT TT=48.756 ASSIGNMENTS=201462 CHECKS=15055400	UNSAT TT=37.423 ASSIGNMENTS=152267 CHECKS=11484100	UNSAT TT=4.294	UNSAT TT=80.049 ASSIGNMENTS=291113 CHECKS=22871400	UNSAT TT=133.954 ASSIGNMENTS=500784 CHECKS=40872700	? TT=0.739	UNSAT TT=28.165	UNSAT TT=33.94
csp/pseudoGLB/ normalized-t2001-13queen13-1111213670.xml	UNSAT TT=2.469	UNSAT TT=421.74 CHECKS=89258400 NODES=13635700	? (TO) TT=1800.07	UNSAT TT=9.997	UNSAT TT=146.614 CHECKS=8783090	UNSAT TT=298.953 CHECKS=18687800	UNSAT TT=15.184 ASSIGNMENTS=112336	UNSAT TT=41.704 ASSIGNMENTS=329741	UNSAT TT=92.497 ASSIGNMENTS=280918 CHECKS=25829200	UNSAT TT=427.657 ASSIGNMENTS=13635700 CHECKS=89258400	UNSAT TT=28.871 ASSIGNMENTS=112855 CHECKS=8829930	UNSAT TT=21.167 ASSIGNMENTS=87347 CHECKS=6455680	UNSAT TT=2.469	UNSAT TT=69.761 ASSIGNMENTS=284668 CHECKS=19964000	UNSAT TT=84.507 ASSIGNMENTS=280918 CHECKS=25829200	? TT=0.709	UNSAT TT=20.686	UNSAT TT=38.525
csp/pseudoGLB/ normalized-t2001-13queen13-1111217374.xml	SAT TT=0.936	SAT TT=91.962 CHECKS=17509700 NODES=2835970	SAT TT=848.461 CHECKS=202373000 NODES=26024700	SAT TT=1.459	SAT TT=34.147 CHECKS=2858820	SAT TT=17.003 CHECKS=1483850	SAT TT=3.217 ASSIGNMENTS=19611	SAT TT=9.199 ASSIGNMENTS=75279	SAT TT=59.504 ASSIGNMENTS=152331 CHECKS=16018500	SAT TT=94.62 ASSIGNMENTS=2835970 CHECKS=17509700	SAT TT=6.57 ASSIGNMENTS=22384 CHECKS=1981250	SAT TT=4.149 ASSIGNMENTS=22752 CHECKS=1291760	SAT TT=0.936	SAT TT=23.987 ASSIGNMENTS=92135 CHECKS=6753460	SAT TT=51.784 ASSIGNMENTS=152331 CHECKS=16018500	? TT=0.744	SAT TT=2.641	SAT TT=5.706
csp/pseudoGLB/ normalized-t2001-13queen13-1111219348.xml	UNSAT TT=3.272	UNSAT TT=619.328 CHECKS=110378000 NODES=20147400	UNSAT TT=757.213 CHECKS=129516000 NODES=22396400	UNSAT TT=9.78	UNSAT TT=382.321 CHECKS=31484900	UNSAT TT=514.205 CHECKS=35984000	UNSAT TT=17.508 ASSIGNMENTS=158596	UNSAT TT=42.42 ASSIGNMENTS=351131	UNSAT TT=87.812 ASSIGNMENTS=282151 CHECKS=26144700	UNSAT TT=622.441 ASSIGNMENTS=20147400 CHECKS=110378000	UNSAT TT=40.787 ASSIGNMENTS=147054 CHECKS=12316600	UNSAT TT=27.29 ASSIGNMENTS=116625 CHECKS=9019550	UNSAT TT=3.272	UNSAT TT=74.082 ASSIGNMENTS=284619 CHECKS=21213700	UNSAT TT=86.662 ASSIGNMENTS=282151 CHECKS=26144700	? TT=0.719	UNSAT TT=26.66	UNSAT TT=40.928
csp/pseudoGLB/ normalized-t2001-13queen13-1111220019.xml	UNSAT TT=2.606	UNSAT TT=850.313 CHECKS=153641000 NODES=25432100	UNSAT TT=339.153 CHECKS=63063900 NODES=10715100	UNSAT TT=10.076	UNSAT TT=234.144 CHECKS=18832000	UNSAT TT=289.69 CHECKS=19822600	UNSAT TT=18.85 ASSIGNMENTS=168426	UNSAT TT=37.818 ASSIGNMENTS=307871	UNSAT TT=111.744 ASSIGNMENTS=364091 CHECKS=34111300	UNSAT TT=792.91 ASSIGNMENTS=25432100 CHECKS=153641000	UNSAT TT=34.952 ASSIGNMENTS=139124 CHECKS=11319000	UNSAT TT=27.71 ASSIGNMENTS=105706 CHECKS=8443160	UNSAT TT=2.606	UNSAT TT=102.656 ASSIGNMENTS=385536 CHECKS=29327800	UNSAT TT=112.567 ASSIGNMENTS=364091 CHECKS=34111300	? TT=0.698	UNSAT TT=28.286	UNSAT TT=39.71
csp/pseudoGLB/ normalized-t2001-13queen13-1111221203.xml	UNSAT TT=5.056	? (TO) TT=1800.12	UNSAT TT=714.867 CHECKS=156838000 NODES=23018000	UNSAT TT=9.805	UNSAT TT=197.623 CHECKS=14966600	UNSAT TT=298.528 CHECKS=21528600	UNSAT TT=19.492 ASSIGNMENTS=169305	UNSAT TT=37.037 ASSIGNMENTS=321796	UNSAT TT=145.937 ASSIGNMENTS=478174 CHECKS=43187900	UNSAT TT=1650.62 ASSIGNMENTS=478174 CHECKS=43187900	UNSAT TT=38.553 ASSIGNMENTS=159067 CHECKS=12667600	UNSAT TT=23.757 ASSIGNMENTS=94395 CHECKS=7362220	UNSAT TT=5.056	UNSAT TT=201.693 ASSIGNMENTS=863676 CHECKS=62983300	UNSAT TT=130.875 ASSIGNMENTS=478174 CHECKS=43187900	? TT=0.695	UNSAT TT=29.767	UNSAT TT=42.449
csp/pseudoGLB/ normalized-t2001-13queen13-1111221953.xml	SAT TT=1.121	SAT TT=815.181 CHECKS=167403000 NODES=24725800	SAT TT=1051.76 CHECKS=232429000 NODES=34804100	SAT TT=2.227	SAT TT=42.228 CHECKS=2876040	SAT TT=99.973 CHECKS=6552900	SAT TT=15.983 ASSIGNMENTS=144314	SAT TT=6.885 ASSIGNMENTS=50427	SAT TT=38.313 ASSIGNMENTS=116881 CHECKS=10359200	SAT TT=761.786 ASSIGNMENTS=24725800 CHECKS=167403000	SAT TT=15.691 ASSIGNMENTS=62768 CHECKS=4828570	SAT TT=25.639 ASSIGNMENTS=115226 CHECKS=8498340	SAT TT=1.121	SAT TT=86.655 ASSIGNMENTS=373039 CHECKS=26555100	SAT TT=31.261 ASSIGNMENTS=116881 CHECKS=10359200	? TT=0.74	SAT TT=18.772	SAT TT=24.478
csp/pseudoGLB/ normalized-t2001-13queen13-1111222257.xml	UNSAT TT=3.572	UNSAT TT=541.872 CHECKS=141824000 NODES=17127900	UNSAT TT=217.918 CHECKS=42128600 NODES=6325690	UNSAT TT=10.844	UNSAT TT=460.617 CHECKS=32281100	UNSAT TT=175.951 CHECKS=10974400	UNSAT TT=27.195 ASSIGNMENTS=231727	UNSAT TT=29.513 ASSIGNMENTS=234927	UNSAT TT=141.93 ASSIGNMENTS=498882 CHECKS=40872400	UNSAT TT=542.019 ASSIGNMENTS=17127900 CHECKS=141824000	UNSAT TT=39.228 ASSIGNMENTS=156121 CHECKS=11974200	UNSAT TT=29.185 ASSIGNMENTS=129318 CHECKS=9669900	UNSAT TT=3.572	UNSAT TT=160.529 ASSIGNMENTS=651460 CHECKS=46139700	UNSAT TT=133.692 ASSIGNMENTS=498882 CHECKS=40872400	? TT=0.753	UNSAT TT=34.774	UNSAT TT=52.299
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1111223696.xml	SAT TT=2.078	SAT TT=418.793 CHECKS=70335300 NODES=12727400	SAT TT=315.09 CHECKS=56445600 NODES=9574350	SAT TT=9.372	SAT TT=260.432 CHECKS=24771600	SAT TT=100.07 CHECKS=8269320	SAT TT=22.556 ASSIGNMENTS=193925	SAT TT=36.1 ASSIGNMENTS=321701	SAT TT=70.358 ASSIGNMENTS=203071 CHECKS=19264700	SAT TT=392.463 ASSIGNMENTS=12727400 CHECKS=70335300	SAT TT=27.492 ASSIGNMENTS=100830 CHECKS=8391310	SAT TT=17.532 ASSIGNMENTS=70447 CHECKS=5413610	SAT TT=2.078	SAT TT=29.185 ASSIGNMENTS=111237 CHECKS=8320770	SAT TT=62.624 ASSIGNMENTS=203071 CHECKS=19264700	? TT=0.724	SAT TT=28.967	SAT TT=14.543
csp/pseudoGLB/ normalized-t2001-13queen13-1111224929.xml	UNSAT TT=2.957	UNSAT TT=893 CHECKS=156141000 NODES=27261000	UNSAT TT=253.894 CHECKS=49371200 NODES=8173050	UNSAT TT=8.713	UNSAT TT=354.677 CHECKS=27179700	UNSAT TT=534.185 CHECKS=38775600	UNSAT TT=15.287 ASSIGNMENTS=124013	UNSAT TT=37.408 ASSIGNMENTS=326373	UNSAT TT=90.139 ASSIGNMENTS=287871 CHECKS=24733000	UNSAT TT=829.991 ASSIGNMENTS=27261000 CHECKS=156141000	UNSAT TT=42.515 ASSIGNMENTS=174672 CHECKS=13027200	UNSAT TT=21.216 ASSIGNMENTS=88768 CHECKS=6516630	UNSAT TT=2.957	UNSAT TT=72.117 ASSIGNMENTS=294074 CHECKS=22311900	UNSAT TT=80.514 ASSIGNMENTS=287871 CHECKS=24733000	? TT=0.778	UNSAT TT=32.794	UNSAT TT=45.381
csp/pseudoGLB/ normalized-t2001-13queen13-1111225605.xml	UNSAT TT=2.269	UNSAT TT=830.743 CHECKS=172297000 NODES=25212600	UNSAT TT=556.406 CHECKS=90406600 NODES=16748100	UNSAT TT=13.094	UNSAT TT=156.222 CHECKS=10537400	UNSAT TT=158.544 CHECKS=10802100	UNSAT TT=26.5 ASSIGNMENTS=232145	UNSAT TT=41.018 ASSIGNMENTS=345385	UNSAT TT=243.416 ASSIGNMENTS=862578 CHECKS=71927200	UNSAT TT=778.095 ASSIGNMENTS=25212600 CHECKS=172297000	UNSAT TT=49.631 ASSIGNMENTS=215979 CHECKS=15922400	UNSAT TT=40.538 ASSIGNMENTS=166295 CHECKS=12457900	UNSAT TT=2.269	UNSAT TT=122.296 ASSIGNMENTS=487018 CHECKS=35058500	UNSAT TT=234.683 ASSIGNMENTS=862578 CHECKS=71927200	? TT=0.746	UNSAT TT=31.741	UNSAT TT=48.853
csp/pseudoGLB/ normalized-t2001-13queen13-1111227012.xml	UNSAT TT=3.181	UNSAT TT=1215.03 CHECKS=257188000 NODES=39454100	UNSAT TT=365.201 CHECKS=67181400 NODES=11805900	UNSAT TT=14.949	UNSAT TT=170.863 CHECKS=13074400	UNSAT TT=210.478 CHECKS=13660800	UNSAT TT=26.236 ASSIGNMENTS=236305	UNSAT TT=42.141 ASSIGNMENTS=345556	UNSAT TT=121.632 ASSIGNMENTS=379073 CHECKS=34249100	UNSAT TT=1212.87 ASSIGNMENTS=39454100 CHECKS=257188000	UNSAT TT=41.231 ASSIGNMENTS=155660 CHECKS=12402900	UNSAT TT=27.631 ASSIGNMENTS=105344 CHECKS=8428350	UNSAT TT=3.181	UNSAT TT=93.034 ASSIGNMENTS=364291 CHECKS=28646800	UNSAT TT=109.399 ASSIGNMENTS=379073 CHECKS=34249100	? TT=0.757	UNSAT TT=30.022	UNSAT TT=41.012
csp/pseudoGLB/ normalized-t3002-11tsp11-1900546417.xml	UNSAT TT=46.892	? (TO) TT=1800.16	? (TO) TT=1800.07	UNSAT TT=46.892	UNSAT TT=94.524 CHECKS=51553600	UNSAT TT=183.385 CHECKS=102580000	? (TO) TT=1800.09	UNSAT TT=1068.55 ASSIGNMENTS=1516120	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=296.807	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=0.756	UNSAT TT=73.918	UNSAT TT=313.859
csp/pseudoGLB/ normalized-t3002-11tsp11-1900547334.xml	SAT TT=1.32	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=1.32	SAT TT=36.588 CHECKS=20939900	SAT TT=244.496 CHECKS=141593000	SAT TT=64.73 ASSIGNMENTS=111326	SAT TT=8.895 ASSIGNMENTS=10824	SAT TT=153.557 ASSIGNMENTS=121355 CHECKS=115262000	SAT TT=222.558 ASSIGNMENTS=121355 CHECKS=115262000	SAT TT=44.082 ASSIGNMENTS=31743 CHECKS=33322200	SAT TT=30.897 ASSIGNMENTS=44489 CHECKS=23345400	SAT TT=10.689	? (TO) TT=1800.08	SAT TT=131.782 ASSIGNMENTS=121355 CHECKS=115262000	? TT=0.722	SAT TT=14.206	SAT TT=2.342
csp/pseudoGLB/ normalized-t3002-11tsp11-1900548667.xml	UNSAT TT=80.213	? (TO) TT=1800.1	? (TO) TT=1800.12	UNSAT TT=80.213	UNSAT TT=516.526 CHECKS=314721000	UNSAT TT=495.449 CHECKS=326349000	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=340.752	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=0.711	UNSAT TT=574.458	? (TO) TT=1800.15
csp/pseudoGLB/ normalized-t3002-11tsp11-1900552423.xml	UNSAT TT=7.67	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=15.29	UNSAT TT=50.061 CHECKS=26353700	UNSAT TT=82.146 CHECKS=41514900	UNSAT TT=1743.39 ASSIGNMENTS=2829690	UNSAT TT=260.052 ASSIGNMENTS=308752	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=71.335	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=0.764	UNSAT TT=10.548	UNSAT TT=7.67
csp/pseudoGLB/ normalized-t3002-11tsp11-1900553812.xml	UNSAT TT=22.858	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=22.858	UNSAT TT=162.932 CHECKS=97722600	UNSAT TT=164.232 CHECKS=93450400	? (TO) TT=1800.16	UNSAT TT=367.973 ASSIGNMENTS=483236	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=124.449	? (TO) TT=1800.01	? (TO) TT=1800.08	? TT=0.747	UNSAT TT=32.462	UNSAT TT=35.765
csp/pseudoGLB/ normalized-t3002-11tsp11-1900554375.xml	SAT TT=0.622	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=0.622	SAT TT=33.045 CHECKS=18847900	SAT TT=22.327 CHECKS=11754400	SAT TT=4.544 ASSIGNMENTS=5138	SAT TT=2.73 ASSIGNMENTS=1436	SAT TT=33.476 ASSIGNMENTS=21600 CHECKS=19812600	SAT TT=103.783 ASSIGNMENTS=21600 CHECKS=19812600	SAT TT=17.707 ASSIGNMENTS=12482 CHECKS=13035100	SAT TT=1.665 ASSIGNMENTS=23172 CHECKS=1248240	SAT TT=1.312	SAT TT=400.388 ASSIGNMENTS=219327 CHECKS=227804000	SAT TT=25.359 ASSIGNMENTS=21600 CHECKS=19812600	? TT=0.738	SAT TT=2.472	SAT TT=2.817
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t3002-11tsp11-1900557362.xml	UNSAT TT=24.335	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=25.842	UNSAT TT=199.509 CHECKS=105983000	UNSAT TT=165.031 CHECKS=84785700	? (TO) TT=1800.15	UNSAT TT=508.382 ASSIGNMENTS=638722	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=1507.99 ASSIGNMENTS=963493 CHECKS=1152120000	? (TO) TT=1800.02	UNSAT TT=135.562	? (TO) TT=1800.05	? (TO) TT=1800.08	? TT=0.784	UNSAT TT=24.335	UNSAT TT=29.676
csp/pseudoGLB/ normalized-t3002-11tsp11-1900557957.xml	UNSAT TT=23.761	? (TO) TT=1800.14	? (TO) TT=1800.06	UNSAT TT=23.761	UNSAT TT=165.718 CHECKS=87657000	UNSAT TT=162.824 CHECKS=89186300	? (TO) TT=1800.13	UNSAT TT=537.426 ASSIGNMENTS=614827	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=118.278	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=0.772	UNSAT TT=50.867	UNSAT TT=62.735
csp/pseudoGLB/ normalized-t3002-11tsp11-1900558739.xml	UNSAT TT=66.887	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=66.887	UNSAT TT=341.284 CHECKS=203221000	UNSAT TT=172.118 CHECKS=96406400	? (TO) TT=1800.09	UNSAT TT=1121.82 ASSIGNMENTS=1663200	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=376.814	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=0.781	UNSAT TT=121.954	UNSAT TT=444.378
csp/pseudoGLB/ normalized-t3002-11tsp11-1900563801.xml	UNSAT TT=11.179	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=27.548	UNSAT TT=171.847 CHECKS=98278800	UNSAT TT=173.828 CHECKS=95197000	? (TO) TT=1800.14	UNSAT TT=571.85 ASSIGNMENTS=841057	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=165.728	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=0.741	UNSAT TT=11.179	UNSAT TT=14.532
csp/pseudoGLB/ normalized-t3002-11tsp11-1900564824.xml	UNSAT TT=4.41	? (TO) TT=1800.07	? (TO) TT=1800.12	UNSAT TT=11.609	UNSAT TT=31.209 CHECKS=15806100	UNSAT TT=35.803 CHECKS=18246000	UNSAT TT=1447.4 ASSIGNMENTS=2290220	UNSAT TT=192.131 ASSIGNMENTS=224062	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=1534.6 ASSIGNMENTS=1060560 CHECKS=1208050000	? (TO) TT=1800.08	UNSAT TT=66.013	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=0.726	UNSAT TT=6.631	UNSAT TT=4.41
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567135.xml	UNSAT TT=17.68	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=17.68	UNSAT TT=158.165 CHECKS=85594400	UNSAT TT=133.222 CHECKS=74166600	? (TO) TT=1800.07	UNSAT TT=353.995 ASSIGNMENTS=432837	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=105.229	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=0.722	UNSAT TT=67.607	UNSAT TT=37.04
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567939.xml	SAT TT=2.981	? (TO) TT=1800.14	? (TO) TT=1800.12