CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in extension (2-ARY-EXT), subcategory problems with patterns

This page displays the results of the different solvers for each benchmark for category binary constraints in extension (2-ARY-EXT), subcategory problems with patterns

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-13/ normalized-BlackHole-4-13-e-0_ext.xml	UNSAT TT=0.179	UNSAT TT=1.315 CHECKS=59584 NODES=0	UNSAT TT=1.301 CHECKS=59584 NODES=0	UNSAT TT=0.632	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=1.527 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	? (MO) TT=1501.33	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	UNSAT TT=0.179 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.181 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-e-1_ext.xml	UNSAT TT=0.186	UNSAT TT=1.277 CHECKS=59585 NODES=0	UNSAT TT=1.406 CHECKS=59585 NODES=0	UNSAT TT=0.625	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1.833 ASSIGNMENTS=0	UNSAT TT=1.86 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.04	? (MO) TT=1771.6	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.08	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/BH-4-13/ normalized-BlackHole-4-13-e-2_ext.xml	UNSAT TT=0.185	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=1.272 CHECKS=59488 NODES=0	UNSAT TT=0.635	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.551 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.195 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.08	? (MO) TT=1454.74	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.05	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/BH-4-13/ normalized-BlackHole-4-13-e-3_ext.xml	UNSAT TT=0.184	UNSAT TT=1.368 CHECKS=59488 NODES=0	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=0.591	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=1.579 ASSIGNMENTS=0	UNSAT TT=1.722 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.19 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.1	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-m-0_ext.xml	UNSAT TT=0.185	UNSAT TT=1.395 CHECKS=59488 NODES=0	UNSAT TT=1.281 CHECKS=59488 NODES=0	UNSAT TT=1341.56	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.933 ASSIGNMENTS=0	UNSAT TT=1.66 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.08	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/BH-4-13/ normalized-BlackHole-4-13-m-1_ext.xml	UNSAT TT=0.184	UNSAT TT=1.277 CHECKS=59488 NODES=0	UNSAT TT=1.313 CHECKS=59488 NODES=0	UNSAT TT=1339.46	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=1.601 ASSIGNMENTS=0	UNSAT TT=1.568 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.202 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.06	? (MO) TT=1543.57	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.14
csp/BH-4-13/ normalized-BlackHole-4-13-m-2_ext.xml	UNSAT TT=0.186	UNSAT TT=1.393 CHECKS=59489 NODES=0	UNSAT TT=1.271 CHECKS=59489 NODES=0	UNSAT TT=0.63	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=1.638 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.07	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/BH-4-4/ normalized-BlackHole-4-4-e-0_ext.xml	UNSAT TT=0.016	UNSAT TT=0.777 CHECKS=5952 NODES=0	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.102 CHECKS=3152700	UNSAT TT=2.781 CHECKS=2102480	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=1.718 CHECKS=81673 NODES=5880	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.235	UNSAT TT=1.4	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=2.527	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.94	UNSAT TT=420.986 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.057	UNSAT TT=1.311
csp/BH-4-4/ normalized-BlackHole-4-4-e-1_ext.xml	UNSAT TT=0.016	UNSAT TT=0.843 CHECKS=5952 NODES=0	UNSAT TT=0.827 CHECKS=5952 NODES=0	UNSAT TT=0.077	UNSAT TT=5.426 CHECKS=3127470	UNSAT TT=2.546 CHECKS=2112960	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=1.788 CHECKS=79133 NODES=5623	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=1.532	UNSAT TT=1.361	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.537	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.012	UNSAT TT=429.179 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.978	UNSAT TT=1.041
csp/BH-4-4/ normalized-BlackHole-4-4-e-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.829 CHECKS=5952 NODES=0	UNSAT TT=0.073	UNSAT TT=4.623 CHECKS=2635430	UNSAT TT=2.742 CHECKS=2122950	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.574 ASSIGNMENTS=0	UNSAT TT=1.703 CHECKS=80971 NODES=5841	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.275	UNSAT TT=1.33	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=2.542	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.934	UNSAT TT=419.059 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.075	UNSAT TT=1.088
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-4/ normalized-BlackHole-4-4-e-3_ext.xml	UNSAT TT=0.015	UNSAT TT=0.926 CHECKS=5952 NODES=0	UNSAT TT=0.857 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.107 CHECKS=3119390	UNSAT TT=2.793 CHECKS=2122970	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=1.905 CHECKS=80874 NODES=5840	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=1.524	UNSAT TT=1.508	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.472	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.037	UNSAT TT=450.57 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.97	UNSAT TT=1.281
csp/BH-4-4/ normalized-BlackHole-4-4-e-4_ext.xml	UNSAT TT=0.016	UNSAT TT=0.828 CHECKS=5952 NODES=0	UNSAT TT=0.801 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.433 CHECKS=3141050	UNSAT TT=2.79 CHECKS=2122930	UNSAT TT=0.69 ASSIGNMENTS=0	UNSAT TT=0.558 ASSIGNMENTS=0	UNSAT TT=1.715 CHECKS=81605 NODES=5880	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.641	UNSAT TT=1.336	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.505	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.798	UNSAT TT=450.615 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=1.061	UNSAT TT=0.982
csp/BH-4-4/ normalized-BlackHole-4-4-e-5_ext.xml	UNSAT TT=0.016	UNSAT TT=0.795 CHECKS=5952 NODES=0	UNSAT TT=0.778 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.431 CHECKS=3130040	UNSAT TT=2.769 CHECKS=2114300	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	UNSAT TT=1.863 CHECKS=81626 NODES=5880	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.671	UNSAT TT=1.263	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.552	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.778	UNSAT TT=448.105 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.975	UNSAT TT=0.976
csp/BH-4-4/ normalized-BlackHole-4-4-e-6_ext.xml	UNSAT TT=0.016	UNSAT TT=0.823 CHECKS=5952 NODES=0	UNSAT TT=0.79 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.077 CHECKS=3183010	UNSAT TT=2.768 CHECKS=2140010	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	UNSAT TT=1.976 CHECKS=80410 NODES=5889	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.691	UNSAT TT=1.54	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.653	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.085	UNSAT TT=453.138 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.104	UNSAT TT=1.327
csp/BH-4-4/ normalized-BlackHole-4-4-e-7_ext.xml	UNSAT TT=0.017	UNSAT TT=0.833 CHECKS=5952 NODES=0	UNSAT TT=0.788 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.441 CHECKS=3081900	UNSAT TT=2.591 CHECKS=2153790	UNSAT TT=0.591 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=1.828 CHECKS=79569 NODES=5836	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.393	UNSAT TT=1.406	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.536	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.803	UNSAT TT=418.115 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.309	UNSAT TT=1.047
csp/BH-4-4/ normalized-BlackHole-4-4-e-8_ext.xml	UNSAT TT=0.016	UNSAT TT=0.826 CHECKS=5952 NODES=0	UNSAT TT=0.924 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.004 CHECKS=3080150	UNSAT TT=2.767 CHECKS=2122160	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.561 ASSIGNMENTS=0	UNSAT TT=1.707 CHECKS=80400 NODES=5890	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=1.511	UNSAT TT=1.385	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.508	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.066	UNSAT TT=448.144 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.197	UNSAT TT=1.029
csp/BH-4-4/ normalized-BlackHole-4-4-e-9_ext.xml	UNSAT TT=0.016	UNSAT TT=0.817 CHECKS=5952 NODES=0	UNSAT TT=0.86 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.096 CHECKS=3096090	UNSAT TT=2.734 CHECKS=2132950	UNSAT TT=0.565 ASSIGNMENTS=0	UNSAT TT=0.73 ASSIGNMENTS=0	UNSAT TT=1.845 CHECKS=81620 NODES=5882	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.404	UNSAT TT=1.28	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=2.366	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.978	UNSAT TT=437.595 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.978	UNSAT TT=1.025
csp/BH-4-7/ normalized-BlackHole-4-7-e-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.957 CHECKS=10265 NODES=0	UNSAT TT=0.924 CHECKS=10265 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.718 ASSIGNMENTS=0	UNSAT TT=0.749 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.11	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.2	? (TO) TT=1800.02	UNSAT TT=792.95	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-1_ext.xml	UNSAT TT=0.041	UNSAT TT=0.979 CHECKS=10265 NODES=0	UNSAT TT=0.923 CHECKS=10265 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.739 ASSIGNMENTS=0	UNSAT TT=0.723 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=894.724	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-e-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.936 CHECKS=10313 NODES=0	UNSAT TT=1.002 CHECKS=10313 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.736 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1359.03	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-e-3_ext.xml	UNSAT TT=0.042	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=1 CHECKS=10264 NODES=0	UNSAT TT=74.257	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.22	? (TO) TT=1800.06	UNSAT TT=842.823	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-e-4_ext.xml	UNSAT TT=0.045	UNSAT TT=1.094 CHECKS=10312 NODES=0	UNSAT TT=0.91 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.815 ASSIGNMENTS=0	UNSAT TT=0.941 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=797.83	? (TO) TT=1800.09
csp/BH-4-7/ normalized-BlackHole-4-7-e-5_ext.xml	UNSAT TT=0.043	UNSAT TT=0.952 CHECKS=10264 NODES=0	UNSAT TT=0.92 CHECKS=10264 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=0.768 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1190.02	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-6_ext.xml	UNSAT TT=0.043	UNSAT TT=0.992 CHECKS=10264 NODES=0	UNSAT TT=0.971 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.717 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.13	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1571.33	? (TO) TT=1800.08
csp/BH-4-7/ normalized-BlackHole-4-7-e-7_ext.xml	UNSAT TT=0.041	UNSAT TT=0.91 CHECKS=10265 NODES=0	UNSAT TT=0.933 CHECKS=10265 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.943 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.14	? (TO) TT=1800.05	UNSAT TT=820.818	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-8_ext.xml	UNSAT TT=0.04	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.75 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.14	? (TO) TT=1800.03	UNSAT TT=827.602	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-e-9_ext.xml	UNSAT TT=0.041	UNSAT TT=1.004 CHECKS=10312 NODES=0	UNSAT TT=0.912 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.931 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.03	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.19	? (TO) TT=1800.03	UNSAT TT=883.361	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.929 CHECKS=10264 NODES=0	UNSAT TT=0.923 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.71 ASSIGNMENTS=0	UNSAT TT=0.781 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=1692.7	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-1_ext.xml	UNSAT TT=0.042	UNSAT TT=1.081 CHECKS=10264 NODES=0	UNSAT TT=0.925 CHECKS=10264 NODES=0	UNSAT TT=68.847	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.982 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=690.887	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.963 CHECKS=10265 NODES=0	UNSAT TT=1.002 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=0.95 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.17	? (TO) TT=1800.02	UNSAT TT=887.297	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-h-3_ext.xml	UNSAT TT=0.04	UNSAT TT=0.976 CHECKS=10265 NODES=0	UNSAT TT=1.078 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=960.49	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-4_ext.xml	UNSAT TT=0.042	UNSAT TT=0.976 CHECKS=10312 NODES=0	UNSAT TT=0.959 CHECKS=10312 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.708 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=763.982	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-h-5_ext.xml	UNSAT TT=0.045	UNSAT TT=1.003 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.935 ASSIGNMENTS=0	UNSAT TT=0.946 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.1	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.17	? (TO) TT=1800.08	UNSAT TT=996.538	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-6_ext.xml	UNSAT TT=0.041	UNSAT TT=1.065 CHECKS=10313 NODES=0	UNSAT TT=0.913 CHECKS=10313 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.08	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=831.31	? (TO) TT=1800.11
csp/BH-4-7/ normalized-BlackHole-4-7-h-7_ext.xml	UNSAT TT=0.046	UNSAT TT=1.012 CHECKS=10312 NODES=0	UNSAT TT=1.022 CHECKS=10312 NODES=0	UNSAT TT=0.164	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.707 ASSIGNMENTS=0	UNSAT TT=0.952 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.07	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1374.78	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-h-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.982 CHECKS=10313 NODES=0	UNSAT TT=0.918 CHECKS=10313 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.924 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.13	? (TO) TT=1800.05	UNSAT TT=556.01	? (TO) TT=1800.06
csp/BH-4-7/ normalized-BlackHole-4-7-h-9_ext.xml	UNSAT TT=0.043	UNSAT TT=1.108 CHECKS=10264 NODES=0	UNSAT TT=0.914 CHECKS=10264 NODES=0	UNSAT TT=74.22	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.92 ASSIGNMENTS=0	UNSAT TT=0.783 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.19	? (TO) TT=1800.09	UNSAT TT=794.336	? (TO) TT=1800.1
csp/bqwh-15-106/ normalized-bqwh-15-106-24_ext.xml	SAT TT=0.039	SAT TT=1.145 CHECKS=100396 NODES=1144	SAT TT=1.191 CHECKS=109962 NODES=1098	SAT TT=0.234	SAT TT=0.142 CHECKS=128871	SAT TT=0.666 CHECKS=888959	SAT TT=1.102 ASSIGNMENTS=10	SAT TT=1.113 ASSIGNMENTS=11	SAT TT=0.852 CHECKS=22442 NODES=535	SAT TT=0.799 CHECKS=792967 NODES=18806	SAT TT=1.334 CHECKS=4545710 NODES=15610	SAT TT=0.195 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=0.183 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.702	SAT TT=1.416	SAT TT=0.226 ASSIGNMENTS=2460 CHECKS=665843	SAT TT=0.322 ASSIGNMENTS=5654 CHECKS=957091	SAT TT=0.787	SAT TT=0.039 ASSIGNMENTS=316 CHECKS=44265	SAT TT=0.18 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.619	SAT TT=0.875 ASSIGNMENTS=532 CHECKS=71428	SAT TT=1.061	SAT TT=1.026
csp/bqwh-15-106/ normalized-bqwh-15-106-26_ext.xml	SAT TT=0.048	SAT TT=1.179 CHECKS=158828 NODES=1486	SAT TT=1.222 CHECKS=123121 NODES=1168	SAT TT=0.212	SAT TT=0.048 CHECKS=27155	SAT TT=0.048 CHECKS=31076	SAT TT=1.084 ASSIGNMENTS=43	SAT TT=1.138 ASSIGNMENTS=16	SAT TT=0.978 CHECKS=84995 NODES=1514	SAT TT=0.816 CHECKS=840414 NODES=19834	? (TO) TT=1800.05	SAT TT=0.097 ASSIGNMENTS=659 CHECKS=172553	SAT TT=0.09 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.464	SAT TT=1.669	SAT TT=0.063 ASSIGNMENTS=449 CHECKS=110598	SAT TT=0.229 ASSIGNMENTS=4031 CHECKS=608822	SAT TT=0.821	SAT TT=0.146 ASSIGNMENTS=1347 CHECKS=356917	SAT TT=0.083 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.442	SAT TT=0.136 ASSIGNMENTS=521 CHECKS=57840	SAT TT=1.008	SAT TT=1.373
csp/bqwh-15-106/ normalized-bqwh-15-106-28_ext.xml	SAT TT=0.037	SAT TT=1.101 CHECKS=55628 NODES=707	SAT TT=1.076 CHECKS=22366 NODES=0	SAT TT=0.233	SAT TT=0.211 CHECKS=224297	SAT TT=0.078 CHECKS=74568	SAT TT=0.845 ASSIGNMENTS=5	SAT TT=0.916 ASSIGNMENTS=5	SAT TT=0.914 CHECKS=50617 NODES=1173	SAT TT=0.68 CHECKS=124533 NODES=2734	SAT TT=0.79 CHECKS=758569 NODES=3923	SAT TT=0.053 ASSIGNMENTS=209 CHECKS=51803	SAT TT=0.054 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.507	SAT TT=1.717	SAT TT=0.04 ASSIGNMENTS=206 CHECKS=45369	SAT TT=0.233 ASSIGNMENTS=4320 CHECKS=617494	SAT TT=0.605	SAT TT=0.051 ASSIGNMENTS=485 CHECKS=75484	SAT TT=0.037 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.535	SAT TT=0.157 ASSIGNMENTS=1046 CHECKS=135716	SAT TT=1.062	SAT TT=1.068
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106/ normalized-bqwh-15-106-2_ext.xml	SAT TT=0.029	SAT TT=1.401 CHECKS=298547 NODES=2964	SAT TT=1.095 CHECKS=65050 NODES=687	SAT TT=0.134	SAT TT=0.083 CHECKS=68061	SAT TT=0.042 CHECKS=24112	SAT TT=1.028 ASSIGNMENTS=14	SAT TT=1.084 ASSIGNMENTS=20	SAT TT=1.879 CHECKS=234609 NODES=5231	SAT TT=0.785 CHECKS=708557 NODES=16990	SAT TT=0.668 CHECKS=413156 NODES=2022	SAT TT=0.044 ASSIGNMENTS=80 CHECKS=16593	SAT TT=0.042 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.444	SAT TT=1.593	SAT TT=0.029 ASSIGNMENTS=69 CHECKS=15647	SAT TT=0.303 ASSIGNMENTS=5637 CHECKS=890572	SAT TT=0.655	SAT TT=0.051 ASSIGNMENTS=441 CHECKS=76168	SAT TT=0.029 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.714	SAT TT=1.465 ASSIGNMENTS=11890 CHECKS=2074690	SAT TT=1.025	SAT TT=1.054
csp/bqwh-15-106/ normalized-bqwh-15-106-51_ext.xml	SAT TT=0.036	SAT TT=1.106 CHECKS=73534 NODES=876	SAT TT=1.102 CHECKS=54740 NODES=431	SAT TT=0.288	SAT TT=0.171 CHECKS=155758	SAT TT=0.125 CHECKS=125583	SAT TT=1.147 ASSIGNMENTS=9	SAT TT=1.081 ASSIGNMENTS=9	SAT TT=0.665 CHECKS=8118 NODES=219	SAT TT=0.708 CHECKS=225571 NODES=5089	SAT TT=1.004 CHECKS=1551240 NODES=5649	SAT TT=0.067 ASSIGNMENTS=398 CHECKS=94326	SAT TT=0.068 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.468	SAT TT=1.662	SAT TT=0.036 ASSIGNMENTS=140 CHECKS=33205	SAT TT=0.231 ASSIGNMENTS=4413 CHECKS=648137	SAT TT=0.624	SAT TT=0.041 ASSIGNMENTS=346 CHECKS=57116	SAT TT=0.052 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.528	SAT TT=0.059 ASSIGNMENTS=227 CHECKS=21228	SAT TT=1.242	SAT TT=1.067
csp/bqwh-15-106/ normalized-bqwh-15-106-52_ext.xml	SAT TT=0.03	SAT TT=1.411 CHECKS=319800 NODES=3226	SAT TT=1.074 CHECKS=35172 NODES=392	SAT TT=0.243	SAT TT=0.07 CHECKS=50343	SAT TT=0.146 CHECKS=181531	SAT TT=1.044 ASSIGNMENTS=11	SAT TT=1.059 ASSIGNMENTS=7	SAT TT=0.925 CHECKS=53239 NODES=1180	SAT TT=1.018 CHECKS=973881 NODES=22892	SAT TT=0.64 CHECKS=247236 NODES=1304	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=7318	SAT TT=0.036 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.599	SAT TT=1.689	SAT TT=0.03 ASSIGNMENTS=70 CHECKS=17163	SAT TT=0.306 ASSIGNMENTS=4963 CHECKS=841076	SAT TT=0.614	SAT TT=0.109 ASSIGNMENTS=1109 CHECKS=266851	SAT TT=0.03 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.66	SAT TT=0.098 ASSIGNMENTS=796 CHECKS=77988	SAT TT=1.149	SAT TT=1.022
csp/bqwh-15-106/ normalized-bqwh-15-106-7_ext.xml	SAT TT=0.049	SAT TT=1.37 CHECKS=251056 NODES=2553	SAT TT=1.211 CHECKS=78254 NODES=855	SAT TT=0.185	SAT TT=0.488 CHECKS=518036	SAT TT=0.5 CHECKS=667494	SAT TT=1.079 ASSIGNMENTS=48	SAT TT=1.311 ASSIGNMENTS=8	SAT TT=0.985 CHECKS=75899 NODES=1793	SAT TT=1.147 CHECKS=1828330 NODES=43827	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=372 CHECKS=85935	SAT TT=0.066 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.436	SAT TT=1.73	SAT TT=0.049 ASSIGNMENTS=336 CHECKS=69647	SAT TT=0.4 ASSIGNMENTS=6446 CHECKS=1181050	SAT TT=0.685	SAT TT=0.142 ASSIGNMENTS=1752 CHECKS=354930	SAT TT=0.053 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.685	SAT TT=0.211 ASSIGNMENTS=830 CHECKS=93256	SAT TT=1.073	SAT TT=1.068
csp/bqwh-15-106/ normalized-bqwh-15-106-81_ext.xml	SAT TT=0.038	SAT TT=1.228 CHECKS=135966 NODES=1415	SAT TT=1.096 CHECKS=45539 NODES=433	SAT TT=0.202	SAT TT=0.669 CHECKS=765030	SAT TT=0.103 CHECKS=93482	SAT TT=1.164 ASSIGNMENTS=5	SAT TT=1.121 ASSIGNMENTS=7	SAT TT=1.304 CHECKS=124758 NODES=2649	SAT TT=0.683 CHECKS=138637 NODES=3093	SAT TT=0.789 CHECKS=857106 NODES=3798	SAT TT=0.109 ASSIGNMENTS=917 CHECKS=212840	SAT TT=0.102 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.799	SAT TT=1.551	SAT TT=0.038 ASSIGNMENTS=175 CHECKS=37852	SAT TT=0.322 ASSIGNMENTS=5296 CHECKS=900062	SAT TT=1.08	SAT TT=0.071 ASSIGNMENTS=730 CHECKS=152727	SAT TT=0.09 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.662	SAT TT=0.978 ASSIGNMENTS=4431 CHECKS=812661	SAT TT=1.181	SAT TT=1.077
csp/bqwh-15-106/ normalized-bqwh-15-106-85_ext.xml	SAT TT=0.065	SAT TT=1.043 CHECKS=21842 NODES=330	SAT TT=1.012 CHECKS=19434 NODES=227	SAT TT=0.468	SAT TT=0.479 CHECKS=518289	SAT TT=0.185 CHECKS=206141	SAT TT=1.068 ASSIGNMENTS=2	SAT TT=1.101 ASSIGNMENTS=8	SAT TT=1.478 CHECKS=135956 NODES=2913	SAT TT=0.684 CHECKS=155310 NODES=3528	? (TO) TT=1800.04	SAT TT=0.091 ASSIGNMENTS=702 CHECKS=167198	SAT TT=0.095 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.451	SAT TT=1.535	SAT TT=0.065 ASSIGNMENTS=531 CHECKS=116375	SAT TT=0.271 ASSIGNMENTS=4244 CHECKS=723496	SAT TT=0.636	SAT TT=0.107 ASSIGNMENTS=992 CHECKS=256985	SAT TT=0.077 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.846	SAT TT=0.508 ASSIGNMENTS=1470 CHECKS=253802	SAT TT=1.053	SAT TT=1.267
csp/bqwh-15-106/ normalized-bqwh-15-106-97_ext.xml	SAT TT=0.051	SAT TT=1.184 CHECKS=99563 NODES=1227	SAT TT=1.224 CHECKS=45180 NODES=526	SAT TT=0.154	SAT TT=0.175 CHECKS=169337	SAT TT=0.158 CHECKS=179270	SAT TT=1.033 ASSIGNMENTS=8	SAT TT=1.061 ASSIGNMENTS=6	SAT TT=0.657 CHECKS=13421 NODES=335	SAT TT=0.854 CHECKS=363920 NODES=8658	? (TO) TT=1800.07	SAT TT=0.081 ASSIGNMENTS=500 CHECKS=124762	SAT TT=0.078 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.693	SAT TT=1.549	SAT TT=0.051 ASSIGNMENTS=332 CHECKS=73138	SAT TT=0.21 ASSIGNMENTS=4065 CHECKS=601033	SAT TT=0.655	SAT TT=0.088 ASSIGNMENTS=905 CHECKS=175586	SAT TT=0.063 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.598	SAT TT=0.094 ASSIGNMENTS=553 CHECKS=65832	SAT TT=1.022	SAT TT=1.048
csp/bqwh-18-141/ normalized-bqwh-18-141-11_ext.xml	SAT TT=0.054	SAT TT=1.506 CHECKS=284208 NODES=2838	SAT TT=1.138 CHECKS=29756 NODES=316	SAT TT=0.173	SAT TT=0.138 CHECKS=115672	SAT TT=0.062 CHECKS=36064	SAT TT=1.265 ASSIGNMENTS=28	SAT TT=1.337 ASSIGNMENTS=23	SAT TT=2.269 CHECKS=239529 NODES=4254	SAT TT=1.183 CHECKS=1116660 NODES=22495	SAT TT=0.871 CHECKS=376575 NODES=1723	SAT TT=0.071 ASSIGNMENTS=230 CHECKS=77161	SAT TT=0.072 ASSIGNMENTS=230 CHECKS=77161	SAT TT=1.929	SAT TT=1.81	SAT TT=0.054 ASSIGNMENTS=195 CHECKS=57662	SAT TT=0.334 ASSIGNMENTS=4912 CHECKS=845070	SAT TT=1.11	SAT TT=0.092 ASSIGNMENTS=733 CHECKS=156330	SAT TT=0.059 ASSIGNMENTS=230 CHECKS=77161	SAT TT=2.26	SAT TT=0.259 ASSIGNMENTS=1391 CHECKS=223636	SAT TT=1.189	SAT TT=1.477
csp/bqwh-18-141/ normalized-bqwh-18-141-19_ext.xml	SAT TT=0.223	SAT TT=2.523 CHECKS=1408250 NODES=10026	SAT TT=1.568 CHECKS=357886 NODES=3075	SAT TT=0.389	SAT TT=1.739 CHECKS=1804600	SAT TT=0.241 CHECKS=241010	SAT TT=1.369 ASSIGNMENTS=7	SAT TT=1.464 ASSIGNMENTS=6	SAT TT=1.215 CHECKS=90831 NODES=1502	SAT TT=0.905 CHECKS=482275 NODES=9192	? (TO) TT=1800.09	SAT TT=0.247 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=0.25 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.765	SAT TT=1.769	SAT TT=0.343 ASSIGNMENTS=3253 CHECKS=1004950	SAT TT=0.408 ASSIGNMENTS=5494 CHECKS=1321650	SAT TT=1.26	SAT TT=0.223 ASSIGNMENTS=1674 CHECKS=623176	SAT TT=0.232 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.91	SAT TT=0.846 ASSIGNMENTS=1785 CHECKS=384816	SAT TT=1.132	SAT TT=1.615
csp/bqwh-18-141/ normalized-bqwh-18-141-21_ext.xml	SAT TT=0.046	SAT TT=1.565 CHECKS=448647 NODES=4069	SAT TT=2.257 CHECKS=1073330 NODES=8263	SAT TT=0.182	SAT TT=0.086 CHECKS=50960	SAT TT=0.046 CHECKS=14102	SAT TT=1.37 ASSIGNMENTS=4	SAT TT=1.558 ASSIGNMENTS=6	SAT TT=0.916 CHECKS=25933 NODES=575	SAT TT=1.032 CHECKS=1208490 NODES=24522	SAT TT=1.132 CHECKS=2215980 NODES=8030	SAT TT=0.443 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=0.444 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=1.754	SAT TT=1.678	SAT TT=0.414 ASSIGNMENTS=3871 CHECKS=1147500	SAT TT=0.299 ASSIGNMENTS=4678 CHECKS=786868	SAT TT=1.314	SAT TT=0.219 ASSIGNMENTS=1947 CHECKS=546992	SAT TT=0.42 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=2.314	SAT TT=2.064 ASSIGNMENTS=8440 CHECKS=2015210	SAT TT=1.376	SAT TT=1.409
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141/ normalized-bqwh-18-141-3_ext.xml	SAT TT=0.258	SAT TT=16.573 CHECKS=16551100 NODES=129906	SAT TT=13.396 CHECKS=13254000 NODES=107724	SAT TT=2.999	SAT TT=2.862 CHECKS=3074660	SAT TT=0.258 CHECKS=280755	SAT TT=1.504 ASSIGNMENTS=71	SAT TT=1.592 ASSIGNMENTS=69	SAT TT=3.039 CHECKS=351226 NODES=6716	SAT TT=1.718 CHECKS=3412370 NODES=68716	? (TO) TT=1800.06	SAT TT=0.319 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=0.317 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=1.882	SAT TT=1.859	SAT TT=0.747 ASSIGNMENTS=7458 CHECKS=2197000	SAT TT=0.406 ASSIGNMENTS=6142 CHECKS=1143690	SAT TT=1.705	SAT TT=6.23 ASSIGNMENTS=63495 CHECKS=19093000	SAT TT=0.305 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=2.096	SAT TT=1.936 ASSIGNMENTS=9626 CHECKS=1770000	SAT TT=1.451	SAT TT=1.43
csp/bqwh-18-141/ normalized-bqwh-18-141-42_ext.xml	SAT TT=0.243	SAT TT=7.257 CHECKS=6569900 NODES=44702	SAT TT=6.586 CHECKS=5771170 NODES=40818	SAT TT=2.277	SAT TT=2.144 CHECKS=2304000	SAT TT=0.552 CHECKS=611698	SAT TT=1.616 ASSIGNMENTS=73	SAT TT=1.759 ASSIGNMENTS=85	SAT TT=8.51 CHECKS=1425510 NODES=24447	SAT TT=5.161 CHECKS=17067300 NODES=348295	? (TO) TT=1800.02	SAT TT=0.288 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=0.289 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=1.75	SAT TT=1.862	SAT TT=0.243 ASSIGNMENTS=1947 CHECKS=634476	SAT TT=1.427 ASSIGNMENTS=15919 CHECKS=4122020	SAT TT=5.59	SAT TT=0.427 ASSIGNMENTS=3876 CHECKS=1142500	SAT TT=0.272 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=2.585	SAT TT=2.47 ASSIGNMENTS=275 CHECKS=43049	SAT TT=1.468	SAT TT=1.165
csp/bqwh-18-141/ normalized-bqwh-18-141-72_ext.xml	SAT TT=0.106	SAT TT=2.14 CHECKS=1143180 NODES=8627	SAT TT=1.37 CHECKS=224404 NODES=1812	SAT TT=0.334	SAT TT=0.303 CHECKS=330761	SAT TT=0.42 CHECKS=469573	SAT TT=1.449 ASSIGNMENTS=8	SAT TT=1.344 ASSIGNMENTS=7	SAT TT=1.022 CHECKS=45793 NODES=880	SAT TT=0.739 CHECKS=146737 NODES=2993	? (TO) TT=1800.06	SAT TT=0.334 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=0.311 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=1.782	SAT TT=1.693	SAT TT=0.184 ASSIGNMENTS=1486 CHECKS=458969	SAT TT=0.34 ASSIGNMENTS=5100 CHECKS=976793	SAT TT=1.088	SAT TT=0.106 ASSIGNMENTS=779 CHECKS=213187	SAT TT=0.319 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=2.357	SAT TT=0.523 ASSIGNMENTS=2242 CHECKS=537472	SAT TT=1.246	SAT TT=1.266
csp/bqwh-18-141/ normalized-bqwh-18-141-73_ext.xml	SAT TT=0.098	SAT TT=1.981 CHECKS=739890 NODES=6134	SAT TT=2.168 CHECKS=881477 NODES=6902	SAT TT=0.999	SAT TT=0.429 CHECKS=425415	SAT TT=0.098 CHECKS=75655	SAT TT=1.388 ASSIGNMENTS=58	SAT TT=1.435 ASSIGNMENTS=52	SAT TT=9.209 CHECKS=1288590 NODES=25863	SAT TT=1.214 CHECKS=1145820 NODES=22455	? (TO) TT=1800.07	SAT TT=8.28 ASSIGNMENTS=58	SAT TT=9.242 ASSIGNMENTS=58	SAT TT=1.945	SAT TT=1.851	SAT TT=0.668 ASSIGNMENTS=5872 CHECKS=1952910	SAT TT=2.723 ASSIGNMENTS=28945 CHECKS=8429730	SAT TT=25.672	SAT TT=2.064 ASSIGNMENTS=21270 CHECKS=6577230	SAT TT=2.887 ASSIGNMENTS=34143 CHECKS=9395700	SAT TT=2.431	SAT TT=0.839 ASSIGNMENTS=5161 CHECKS=851609	SAT TT=1.18	SAT TT=1.154
csp/bqwh-18-141/ normalized-bqwh-18-141-78_ext.xml	SAT TT=0.129	SAT TT=1.545 CHECKS=361033 NODES=3455	SAT TT=1.494 CHECKS=224455 NODES=1778	SAT TT=0.523	SAT TT=0.359 CHECKS=397093	SAT TT=0.172 CHECKS=180165	SAT TT=1.182 ASSIGNMENTS=4	SAT TT=1.212 ASSIGNMENTS=3	SAT TT=0.96 CHECKS=43239 NODES=861	SAT TT=1.471 CHECKS=2511080 NODES=53055	? (TO) TT=1800.06	SAT TT=0.179 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=0.181 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=1.919	SAT TT=1.753	SAT TT=0.138 ASSIGNMENTS=1137 CHECKS=359250	SAT TT=0.43 ASSIGNMENTS=5476 CHECKS=1151360	SAT TT=1.035	SAT TT=0.143 ASSIGNMENTS=1329 CHECKS=346124	SAT TT=0.168 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=2.002	SAT TT=0.129 ASSIGNMENTS=551 CHECKS=56083	SAT TT=1.38	SAT TT=1.188
csp/bqwh-18-141/ normalized-bqwh-18-141-83_ext.xml	SAT TT=0.042	SAT TT=2.013 CHECKS=910266 NODES=7763	SAT TT=2.071 CHECKS=880500 NODES=7704	SAT TT=0.696	SAT TT=0.323 CHECKS=342669	SAT TT=0.63 CHECKS=832846	SAT TT=1.503 ASSIGNMENTS=5	SAT TT=1.291 ASSIGNMENTS=10	SAT TT=0.961 CHECKS=36427 NODES=766	SAT TT=0.832 CHECKS=338050 NODES=7083	SAT TT=0.873 CHECKS=741497 NODES=2607	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=35089	SAT TT=0.057 ASSIGNMENTS=116 CHECKS=35089	SAT TT=1.749	SAT TT=1.758	SAT TT=0.046 ASSIGNMENTS=128 CHECKS=40030	SAT TT=0.293 ASSIGNMENTS=4745 CHECKS=742269	SAT TT=0.779	SAT TT=0.094 ASSIGNMENTS=819 CHECKS=178013	SAT TT=0.042 ASSIGNMENTS=116 CHECKS=35089	SAT TT=2.061	SAT TT=0.1 ASSIGNMENTS=513 CHECKS=57747	SAT TT=1.546	SAT TT=1.363
csp/bqwh-18-141/ normalized-bqwh-18-141-8_ext.xml	SAT TT=0.056	SAT TT=1.156 CHECKS=72926 NODES=868	SAT TT=1.28 CHECKS=61774 NODES=685	SAT TT=0.189	SAT TT=0.104 CHECKS=69526	SAT TT=0.056 CHECKS=21517	SAT TT=1.496 ASSIGNMENTS=90	SAT TT=1.382 ASSIGNMENTS=12	SAT TT=0.917 CHECKS=26245 NODES=602	SAT TT=1.355 CHECKS=2566000 NODES=49976	? (TO) TT=1800.01	SAT TT=0.086 ASSIGNMENTS=473 CHECKS=120522	SAT TT=0.09 ASSIGNMENTS=473 CHECKS=120522	SAT TT=1.94	SAT TT=1.831	SAT TT=0.339 ASSIGNMENTS=2985 CHECKS=915924	SAT TT=0.362 ASSIGNMENTS=5209 CHECKS=969287	SAT TT=0.83	SAT TT=0.09 ASSIGNMENTS=673 CHECKS=158725	SAT TT=0.078 ASSIGNMENTS=473 CHECKS=120522	SAT TT=2.395	SAT TT=0.138 ASSIGNMENTS=797 CHECKS=87718	SAT TT=1.371	SAT TT=1.178
csp/coloring/ normalized-dsjc-125-1-4-ext.xml	UNSAT TT=0.025	UNSAT TT=1.029 CHECKS=44992 NODES=217	UNSAT TT=0.963 CHECKS=39816 NODES=142	UNSAT TT=0.125	UNSAT TT=0.082 CHECKS=39193	UNSAT TT=0.041 CHECKS=6524	UNSAT TT=0.64 ASSIGNMENTS=0	UNSAT TT=0.631 ASSIGNMENTS=0	UNSAT TT=0.602 CHECKS=6527 NODES=97	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.826	UNSAT TT=0.862	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=14815	UNSAT TT=0.183 ASSIGNMENTS=4192 CHECKS=1013730	UNSAT TT=0.58	UNSAT TT=0.036 ASSIGNMENTS=390 CHECKS=90966	UNSAT TT=0.026 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=1.345	UNSAT TT=0.053 ASSIGNMENTS=50 CHECKS=37896	UNSAT TT=0.921	UNSAT TT=1.269
csp/coloring/ normalized-dsjc-125-1-5-ext.xml	SAT TT=0.045	SAT TT=1.178 CHECKS=247766 NODES=1812	SAT TT=1.125 CHECKS=159392 NODES=1149	SAT TT=0.13	SAT TT=0.12 CHECKS=61069	SAT TT=0.048 CHECKS=16747	SAT TT=1.014 ASSIGNMENTS=62	SAT TT=0.839 ASSIGNMENTS=85	SAT TT=1.005 CHECKS=51367 NODES=800	SAT TT=0.906 CHECKS=1480500 NODES=23086	SAT TT=0.853 CHECKS=1565040 NODES=4099	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.557	SAT TT=1.643	SAT TT=0.077 ASSIGNMENTS=746 CHECKS=296500	SAT TT=0.181 ASSIGNMENTS=6405 CHECKS=762341	SAT TT=5.737	SAT TT=0.045 ASSIGNMENTS=647 CHECKS=117453	SAT TT=0.064 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.503	SAT TT=0.208 ASSIGNMENTS=449 CHECKS=89541	SAT TT=0.962	SAT TT=1.03
csp/coloring/ normalized-geom-30a-3-ext.xml	UNSAT TT=0.007	UNSAT TT=0.807 CHECKS=6 NODES=0	UNSAT TT=0.701 CHECKS=6 NODES=0	UNSAT TT=0.032	UNSAT TT=0.01 CHECKS=740	UNSAT TT=0.009 CHECKS=398	UNSAT TT=0.387 ASSIGNMENTS=0	UNSAT TT=0.373 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=288 NODES=16	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.475	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.323	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.758	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=870	UNSAT TT=0.559	UNSAT TT=0.598
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-geom-30a-4-ext.xml	UNSAT TT=0.006	UNSAT TT=0.686 CHECKS=8 NODES=0	UNSAT TT=0.68 CHECKS=8 NODES=0	UNSAT TT=0.033	UNSAT TT=0.017 CHECKS=5418	UNSAT TT=0.011 CHECKS=821	UNSAT TT=0.362 ASSIGNMENTS=0	UNSAT TT=0.395 ASSIGNMENTS=0	UNSAT TT=0.341 CHECKS=723 NODES=41	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.651	UNSAT TT=0.677	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.726	UNSAT TT=0.013 ASSIGNMENTS=28 CHECKS=4094	UNSAT TT=0.63	UNSAT TT=0.544
csp/coloring/ normalized-geom-30a-5-ext.xml	UNSAT TT=0.007	UNSAT TT=0.745 CHECKS=10 NODES=0	UNSAT TT=0.703 CHECKS=10 NODES=0	UNSAT TT=0.034	UNSAT TT=0.035 CHECKS=19850	UNSAT TT=0.013 CHECKS=3378	UNSAT TT=0.388 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=2141 NODES=168	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.567	UNSAT TT=0.694	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.313	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.944	UNSAT TT=0.02 ASSIGNMENTS=145 CHECKS=18345	UNSAT TT=0.583	UNSAT TT=0.613
csp/coloring/ normalized-geom-30a-6-ext.xml	SAT TT=0.006	SAT TT=0.737 CHECKS=533 NODES=30	SAT TT=0.719 CHECKS=523 NODES=0	SAT TT=0.032	SAT TT=0.015 CHECKS=2193	SAT TT=0.012 CHECKS=502	SAT TT=0.444 ASSIGNMENTS=24	SAT TT=0.453 ASSIGNMENTS=25	SAT TT=0.357 CHECKS=374 NODES=30	SAT TT=0.335 CHECKS=2448 NODES=10	SAT TT=0.339 CHECKS=3237 NODES=11	SAT TT=0.02 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.021 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.918	SAT TT=0.882	SAT TT=0.006 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=443	SAT TT=0.302	SAT TT=0.009 ASSIGNMENTS=26 CHECKS=451	SAT TT=0.008 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.744	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1742	SAT TT=0.592	SAT TT=0.566
csp/coloring/ normalized-geom-40-2-ext.xml	UNSAT TT=0.006	UNSAT TT=0.679 CHECKS=0 NODES=0	UNSAT TT=0.688 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.372 ASSIGNMENTS=0	UNSAT TT=0.436 ASSIGNMENTS=0	UNSAT TT=0.337 CHECKS=30 NODES=1	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.484	UNSAT TT=0.477	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.299	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.718	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=26	UNSAT TT=0.564	UNSAT TT=0.545
csp/coloring/ normalized-geom-40-3-ext.xml	UNSAT TT=0.006	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.676 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.012 CHECKS=256	UNSAT TT=0.009 CHECKS=155	UNSAT TT=0.384 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.332 CHECKS=117 NODES=7	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.512	UNSAT TT=0.642	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.289	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.711	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=383	UNSAT TT=0.561	UNSAT TT=0.581
csp/coloring/ normalized-geom-40-4-ext.xml	UNSAT TT=0.008	UNSAT TT=0.693 CHECKS=8 NODES=0	UNSAT TT=0.778 CHECKS=8 NODES=0	UNSAT TT=0.035	UNSAT TT=0.012 CHECKS=311	UNSAT TT=0.009 CHECKS=200	UNSAT TT=0.367 ASSIGNMENTS=0	UNSAT TT=0.411 ASSIGNMENTS=0	UNSAT TT=0.35 CHECKS=431 NODES=46	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.526	UNSAT TT=0.678	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.308	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.72	UNSAT TT=0.012 ASSIGNMENTS=28 CHECKS=1635	UNSAT TT=0.599	UNSAT TT=0.607
csp/coloring/ normalized-geom-40-5-ext.xml	UNSAT TT=0.005	UNSAT TT=0.746 CHECKS=10 NODES=0	UNSAT TT=0.676 CHECKS=10 NODES=0	UNSAT TT=0.032	UNSAT TT=0.013 CHECKS=2625	UNSAT TT=0.012 CHECKS=480	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.371 ASSIGNMENTS=0	UNSAT TT=0.364 CHECKS=1122 NODES=169	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.755	UNSAT TT=0.532	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.313	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.819	UNSAT TT=0.015 ASSIGNMENTS=149 CHECKS=5135	UNSAT TT=0.576	UNSAT TT=0.614
csp/coloring/ normalized-geom-40-6-ext.xml	SAT TT=0.006	SAT TT=0.712 CHECKS=504 NODES=40	SAT TT=0.73 CHECKS=518 NODES=0	SAT TT=0.034	SAT TT=0.022 CHECKS=6041	SAT TT=0.012 CHECKS=1072	SAT TT=0.546 ASSIGNMENTS=35	SAT TT=0.476 ASSIGNMENTS=35	SAT TT=0.34 CHECKS=386 NODES=40	SAT TT=0.341 CHECKS=2340 NODES=11	SAT TT=0.322 CHECKS=2820 NODES=10	SAT TT=0.019 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.02 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.872	SAT TT=1.053	SAT TT=0.006 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.009 ASSIGNMENTS=39 CHECKS=333	SAT TT=0.339	SAT TT=0.008 ASSIGNMENTS=37 CHECKS=336	SAT TT=0.008 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.726	SAT TT=0.011 ASSIGNMENTS=40 CHECKS=1358	SAT TT=0.545	SAT TT=0.613
csp/coloring/ normalized-le-450-5a-2-ext.xml	UNSAT TT=0.149	UNSAT TT=1.577 CHECKS=0 NODES=0	UNSAT TT=1.556 CHECKS=0 NODES=0	UNSAT TT=0.586	UNSAT TT=0.205 CHECKS=5770	UNSAT TT=0.188 CHECKS=5778	UNSAT TT=1.237 ASSIGNMENTS=0	UNSAT TT=1.257 ASSIGNMENTS=0	UNSAT TT=6.052 CHECKS=134 NODES=1	? (TO) TT=1800.08	Wrong Cert. TT=1714 CHECKS=6999240000 NODES=641436	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.162 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.369	UNSAT TT=2.115	UNSAT TT=0.149 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.171	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.722	UNSAT TT=0.528 ASSIGNMENTS=1 CHECKS=198	UNSAT TT=1.577	UNSAT TT=1.67
csp/coloring/ normalized-le-450-5a-3-ext.xml	UNSAT TT=0.154	UNSAT TT=1.378 CHECKS=0 NODES=0	UNSAT TT=1.452 CHECKS=0 NODES=0	UNSAT TT=0.664	UNSAT TT=0.729 CHECKS=300996	UNSAT TT=0.237 CHECKS=18117	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=1.216 ASSIGNMENTS=0	UNSAT TT=5.803 CHECKS=1855 NODES=16	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.286	UNSAT TT=1.863	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.736	UNSAT TT=0.155 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.684	UNSAT TT=0.53 ASSIGNMENTS=6 CHECKS=14253	UNSAT TT=1.656	UNSAT TT=1.789
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-le-450-5a-4-ext.xml	UNSAT TT=0.15	UNSAT TT=1.553 CHECKS=0 NODES=0	UNSAT TT=1.528 CHECKS=0 NODES=0	UNSAT TT=0.624	UNSAT TT=1.018 CHECKS=352263	UNSAT TT=0.431 CHECKS=31362	UNSAT TT=1.102 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=6.672 CHECKS=12651 NODES=111	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.173 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.168 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.287	UNSAT TT=2.148	UNSAT TT=0.166 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.167 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.608	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.165 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=3.686	UNSAT TT=0.631 ASSIGNMENTS=115 CHECKS=291880	UNSAT TT=1.887	UNSAT TT=2.085
csp/coloring/ normalized-le-450-5a-5-ext.xml	SAT TT=0.553	SAT TT=1.771 CHECKS=110856 NODES=595	SAT TT=2.033 CHECKS=184794 NODES=581	SAT TT=1.105	SAT TT=6.867 CHECKS=2289410	SAT TT=3.262 CHECKS=474073	SAT TT=5.541 ASSIGNMENTS=13	SAT TT=5.664 ASSIGNMENTS=18	SAT TT=8.744 CHECKS=190382 NODES=1194	? (TO) TT=1800.01	SAT TT=26.852 CHECKS=116016000 NODES=45720	SAT TT=0.587 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=0.602 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.176	SAT TT=4.24	SAT TT=0.714 ASSIGNMENTS=540 CHECKS=2813410	SAT TT=4.285 ASSIGNMENTS=4474 CHECKS=18796100	SAT TT=24.058	SAT TT=0.595 ASSIGNMENTS=1778 CHECKS=1926740	SAT TT=0.553 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.518	SAT TT=1.792 ASSIGNMENTS=1035 CHECKS=1236950	SAT TT=2.15	SAT TT=2.306
csp/coloring/ normalized-myciel-5g-3-ext.xml	UNSAT TT=0.012	UNSAT TT=0.776 CHECKS=2004 NODES=8	UNSAT TT=0.796 CHECKS=4330 NODES=0	UNSAT TT=0.05	UNSAT TT=0.025 CHECKS=8502	UNSAT TT=0.019 CHECKS=3832	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.485 ASSIGNMENTS=0	UNSAT TT=0.419 CHECKS=3076 NODES=38	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.643	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4640	UNSAT TT=0.018 ASSIGNMENTS=175 CHECKS=27510	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=99 CHECKS=13796	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.892	UNSAT TT=0.019 ASSIGNMENTS=26 CHECKS=10566	UNSAT TT=0.76	UNSAT TT=0.734
csp/coloring/ normalized-myciel-5g-4-ext.xml	UNSAT TT=0.049	UNSAT TT=0.925 CHECKS=53921 NODES=442	UNSAT TT=0.934 CHECKS=64809 NODES=527	UNSAT TT=0.104	UNSAT TT=0.125 CHECKS=98352	UNSAT TT=0.065 CHECKS=66999	UNSAT TT=0.579 ASSIGNMENTS=122	UNSAT TT=0.564 ASSIGNMENTS=122	UNSAT TT=0.773 CHECKS=90367 NODES=2704	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=0.063 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.064 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.712	UNSAT TT=0.728	UNSAT TT=0.052 ASSIGNMENTS=1295 CHECKS=235294	UNSAT TT=0.122 ASSIGNMENTS=5278 CHECKS=544267	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=1259 CHECKS=207545	UNSAT TT=0.054 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=2.095	UNSAT TT=0.577 ASSIGNMENTS=4317 CHECKS=879438	UNSAT TT=0.759	UNSAT TT=0.81
csp/coloring/ normalized-myciel-5g-5-ext.xml	UNSAT TT=22.193	UNSAT TT=27.413 CHECKS=34788100 NODES=397254	UNSAT TT=30.607 CHECKS=39853800 NODES=458975	UNSAT TT=666.797	UNSAT TT=110.814 CHECKS=116359000	UNSAT TT=89.79 CHECKS=125270000	UNSAT TT=47.285 ASSIGNMENTS=574723	UNSAT TT=51.432 ASSIGNMENTS=574723	UNSAT TT=422.62 CHECKS=96524000 NODES=4328700	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=49.341 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=49.679 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=181.241	UNSAT TT=211.144	UNSAT TT=39.629 ASSIGNMENTS=2237490 CHECKS=197792000	UNSAT TT=37.626 ASSIGNMENTS=1982710 CHECKS=176954000	UNSAT TT=346.871	UNSAT TT=52.163 ASSIGNMENTS=2631860 CHECKS=235108000	UNSAT TT=40.565 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=1634.05	UNSAT TT=1076.15 ASSIGNMENTS=14289000 CHECKS=1449620000	UNSAT TT=22.193	UNSAT TT=163.314
csp/coloring/ normalized-myciel-5g-6-ext.xml	SAT TT=0.011	SAT TT=0.847 CHECKS=1356 NODES=47	SAT TT=0.79 CHECKS=1353 NODES=0	SAT TT=0.049	SAT TT=0.038 CHECKS=10217	SAT TT=0.025 CHECKS=6875	SAT TT=0.663 ASSIGNMENTS=45	SAT TT=0.549 ASSIGNMENTS=45	SAT TT=0.416 CHECKS=1047 NODES=47	SAT TT=0.478 CHECKS=7462 NODES=21	SAT TT=0.417 CHECKS=11352 NODES=22	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=1.317	SAT TT=1.223	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=1262	SAT TT=0.483	SAT TT=0.012 ASSIGNMENTS=46 CHECKS=1280	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.879	SAT TT=0.017 ASSIGNMENTS=47 CHECKS=5185	SAT TT=0.722	SAT TT=0.792
csp/coloring/ normalized-queens-5-5-3-ext.xml	UNSAT TT=0.01	UNSAT TT=0.715 CHECKS=6 NODES=0	UNSAT TT=0.747 CHECKS=6 NODES=0	UNSAT TT=0.039	UNSAT TT=0.017 CHECKS=4354	UNSAT TT=0.015 CHECKS=434	UNSAT TT=0.417 ASSIGNMENTS=0	UNSAT TT=0.394 ASSIGNMENTS=0	UNSAT TT=0.348 CHECKS=325 NODES=5	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.576	UNSAT TT=0.547	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.328	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.786	UNSAT TT=0.014 ASSIGNMENTS=6 CHECKS=2410	UNSAT TT=0.638	UNSAT TT=0.634
csp/coloring/ normalized-queens-5-5-4-ext.xml	UNSAT TT=0.01	UNSAT TT=0.752 CHECKS=8 NODES=0	UNSAT TT=0.809 CHECKS=8 NODES=0	UNSAT TT=0.04	UNSAT TT=0.038 CHECKS=18958	UNSAT TT=0.015 CHECKS=1623	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.404 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=1113 NODES=26	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.608	UNSAT TT=0.613	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.352	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.787	UNSAT TT=0.016 ASSIGNMENTS=28 CHECKS=12272	UNSAT TT=0.71	UNSAT TT=0.672
csp/coloring/ normalized-queens-5-5-5-ext.xml	SAT TT=0.009	SAT TT=0.779 CHECKS=800 NODES=25	SAT TT=0.762 CHECKS=821 NODES=0	SAT TT=0.041	SAT TT=0.034 CHECKS=13724	SAT TT=0.015 CHECKS=1328	SAT TT=0.552 ASSIGNMENTS=2	SAT TT=0.531 ASSIGNMENTS=2	SAT TT=0.355 CHECKS=524 NODES=25	SAT TT=0.465 CHECKS=7590 NODES=63	SAT TT=0.384 CHECKS=7570 NODES=23	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.021 ASSIGNMENTS=5 CHECKS=1199	SAT TT=1.02	SAT TT=1.226	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.009 ASSIGNMENTS=6 CHECKS=1460	SAT TT=0.334	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1255	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.768	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=3251	SAT TT=0.621	SAT TT=0.727
csp/QCP-10/ normalized-qcp-10-67-0_ext.xml	SAT TT=0.022	SAT TT=0.958 CHECKS=7709 NODES=100	SAT TT=0.964 CHECKS=14349 NODES=100	SAT TT=0.108	SAT TT=0.063 CHECKS=17902	SAT TT=0.043 CHECKS=3991	SAT TT=0.978 ASSIGNMENTS=26	SAT TT=0.993 ASSIGNMENTS=21	SAT TT=0.632 CHECKS=5307 NODES=105	SAT TT=0.672 CHECKS=18803 NODES=77	SAT TT=0.815 CHECKS=120657 NODES=310	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.589	SAT TT=1.817	SAT TT=0.025 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.029 ASSIGNMENTS=167 CHECKS=19795	SAT TT=1.092	SAT TT=0.03 ASSIGNMENTS=226 CHECKS=24850	SAT TT=0.022 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.252	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44647	SAT TT=1.096	SAT TT=1.043
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-10_ext.xml	UNSAT TT=0.037	UNSAT TT=1.002 CHECKS=21618 NODES=288	UNSAT TT=0.929 CHECKS=7971 NODES=0	UNSAT TT=91.664	UNSAT TT=0.152 CHECKS=91803	UNSAT TT=0.074 CHECKS=28058	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.838 ASSIGNMENTS=0	UNSAT TT=0.736 CHECKS=14126 NODES=480	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=8.065 ASSIGNMENTS=0	UNSAT TT=14.353 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.013	UNSAT TT=1.125	UNSAT TT=0.037 ASSIGNMENTS=495 CHECKS=50804	UNSAT TT=0.166 ASSIGNMENTS=4988 CHECKS=539894	UNSAT TT=0.8	UNSAT TT=0.047 ASSIGNMENTS=851 CHECKS=92584	UNSAT TT=6.781 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.574	UNSAT TT=0.314 ASSIGNMENTS=1562 CHECKS=722588	UNSAT TT=1.143	UNSAT TT=1.355
csp/QCP-10/ normalized-qcp-10-67-11_ext.xml	UNSAT TT=0.042	UNSAT TT=1.068 CHECKS=82024 NODES=963	UNSAT TT=1.104 CHECKS=76300 NODES=767	UNSAT TT=109.178	UNSAT TT=0.076 CHECKS=25866	UNSAT TT=0.048 CHECKS=6571	UNSAT TT=0.604 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=0.694 CHECKS=6518 NODES=114	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.075 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=0.076 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.235	UNSAT TT=1.134	UNSAT TT=0.051 ASSIGNMENTS=1016 CHECKS=116613	UNSAT TT=0.165 ASSIGNMENTS=5200 CHECKS=481072	UNSAT TT=0.693	UNSAT TT=0.042 ASSIGNMENTS=732 CHECKS=72292	UNSAT TT=0.061 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.431	UNSAT TT=0.569 ASSIGNMENTS=2806 CHECKS=1125400	UNSAT TT=0.987	UNSAT TT=1.331
csp/QCP-10/ normalized-qcp-10-67-12_ext.xml	UNSAT TT=0.025	UNSAT TT=0.887 CHECKS=3245 NODES=0	UNSAT TT=0.882 CHECKS=3245 NODES=0	UNSAT TT=46.229	UNSAT TT=0.098 CHECKS=45697	UNSAT TT=0.05 CHECKS=11019	UNSAT TT=0.834 ASSIGNMENTS=0	UNSAT TT=0.702 ASSIGNMENTS=0	UNSAT TT=0.636 CHECKS=4630 NODES=40	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.041 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.038 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.979	UNSAT TT=0.907	UNSAT TT=0.025 ASSIGNMENTS=150 CHECKS=14109	UNSAT TT=0.147 ASSIGNMENTS=4484 CHECKS=474271	UNSAT TT=0.808	UNSAT TT=0.032 ASSIGNMENTS=315 CHECKS=32076	UNSAT TT=0.028 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=1.796	UNSAT TT=0.08 ASSIGNMENTS=98 CHECKS=56023	UNSAT TT=0.916	UNSAT TT=1.006
csp/QCP-10/ normalized-qcp-10-67-13_ext.xml	UNSAT TT=0.022	UNSAT TT=1.005 CHECKS=3248 NODES=0	UNSAT TT=0.906 CHECKS=3248 NODES=0	UNSAT TT=0.101	UNSAT TT=0.057 CHECKS=12384	UNSAT TT=0.042 CHECKS=6609	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.622 ASSIGNMENTS=0	UNSAT TT=0.632 CHECKS=5626 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.977	UNSAT TT=0.996	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.675	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.307	UNSAT TT=0.059 ASSIGNMENTS=47 CHECKS=41092	UNSAT TT=1.089	UNSAT TT=1.201
csp/QCP-10/ normalized-qcp-10-67-14_ext.xml	UNSAT TT=0.022	UNSAT TT=0.867 CHECKS=3258 NODES=0	UNSAT TT=1.036 CHECKS=3258 NODES=0	UNSAT TT=2.759	UNSAT TT=0.072 CHECKS=24253	UNSAT TT=0.045 CHECKS=5870	UNSAT TT=0.609 ASSIGNMENTS=0	UNSAT TT=0.66 ASSIGNMENTS=0	UNSAT TT=0.617 CHECKS=4349 NODES=28	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.036 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.999	UNSAT TT=1.131	UNSAT TT=0.024 ASSIGNMENTS=27 CHECKS=3048	UNSAT TT=0.144 ASSIGNMENTS=4599 CHECKS=407591	UNSAT TT=0.674	UNSAT TT=0.029 ASSIGNMENTS=276 CHECKS=26418	UNSAT TT=0.022 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=1.395	UNSAT TT=0.061 ASSIGNMENTS=62 CHECKS=46069	UNSAT TT=0.938	UNSAT TT=1.027
csp/QCP-10/ normalized-qcp-10-67-1_ext.xml	SAT TT=0.024	SAT TT=0.962 CHECKS=7966 NODES=102	SAT TT=0.915 CHECKS=7867 NODES=0	SAT TT=0.11	SAT TT=0.061 CHECKS=14587	SAT TT=0.041 CHECKS=3386	SAT TT=1.095 ASSIGNMENTS=25	SAT TT=1.038 ASSIGNMENTS=19	SAT TT=0.665 CHECKS=5261 NODES=103	SAT TT=0.687 CHECKS=23009 NODES=140	SAT TT=0.677 CHECKS=77767 NODES=135	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.598	SAT TT=1.71	SAT TT=0.025 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.028 ASSIGNMENTS=105 CHECKS=12586	SAT TT=0.667	SAT TT=0.027 ASSIGNMENTS=72 CHECKS=7360	SAT TT=0.024 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.247	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44400	SAT TT=1.14	SAT TT=1.481
csp/QCP-10/ normalized-qcp-10-67-2_ext.xml	SAT TT=0.023	SAT TT=0.963 CHECKS=7583 NODES=100	SAT TT=0.914 CHECKS=7702 NODES=0	SAT TT=0.109	SAT TT=0.06 CHECKS=14122	SAT TT=0.039 CHECKS=3327	SAT TT=1.065 ASSIGNMENTS=18	SAT TT=1.17 ASSIGNMENTS=16	SAT TT=0.777 CHECKS=5314 NODES=106	SAT TT=0.683 CHECKS=31100 NODES=288	SAT TT=0.686 CHECKS=105791 NODES=233	SAT TT=0.037 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.035 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.581	SAT TT=1.62	SAT TT=0.023 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=11280	SAT TT=0.707	SAT TT=0.025 ASSIGNMENTS=49 CHECKS=4932	SAT TT=0.025 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.322	SAT TT=0.064 ASSIGNMENTS=101 CHECKS=45899	SAT TT=1.285	SAT TT=1.162
csp/QCP-10/ normalized-qcp-10-67-3_ext.xml	SAT TT=0.025	SAT TT=0.967 CHECKS=7774 NODES=102	SAT TT=1.002 CHECKS=14811 NODES=113	SAT TT=0.106	SAT TT=0.06 CHECKS=15199	SAT TT=0.041 CHECKS=3064	SAT TT=0.988 ASSIGNMENTS=23	SAT TT=1.052 ASSIGNMENTS=22	SAT TT=0.63 CHECKS=5453 NODES=109	SAT TT=0.799 CHECKS=27085 NODES=224	SAT TT=0.682 CHECKS=120121 NODES=252	SAT TT=0.037 ASSIGNMENTS=118 CHECKS=12066	SAT TT=0.038 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.581	SAT TT=1.619	SAT TT=0.025 ASSIGNMENTS=68 CHECKS=7250	SAT TT=0.032 ASSIGNMENTS=294 CHECKS=30048	SAT TT=0.873	SAT TT=0.028 ASSIGNMENTS=172 CHECKS=18039	SAT TT=0.026 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.407	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44652	SAT TT=1.108	SAT TT=1.033
csp/QCP-10/ normalized-qcp-10-67-4_ext.xml	SAT TT=0.027	SAT TT=0.962 CHECKS=8036 NODES=103	SAT TT=0.951 CHECKS=9535 NODES=0	SAT TT=0.099	SAT TT=0.058 CHECKS=16410	SAT TT=0.042 CHECKS=4222	SAT TT=1.011 ASSIGNMENTS=27	SAT TT=1.112 ASSIGNMENTS=25	SAT TT=0.675 CHECKS=5597 NODES=107	SAT TT=0.658 CHECKS=25340 NODES=181	SAT TT=0.634 CHECKS=104232 NODES=248	SAT TT=0.096 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=0.097 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.631	SAT TT=1.588	SAT TT=0.073 ASSIGNMENTS=2009 CHECKS=181849	SAT TT=0.027 ASSIGNMENTS=108 CHECKS=14869	SAT TT=0.82	SAT TT=0.027 ASSIGNMENTS=49 CHECKS=5219	SAT TT=0.081 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.241	SAT TT=0.058 ASSIGNMENTS=102 CHECKS=45139	SAT TT=1.152	SAT TT=1.336
csp/QCP-10/ normalized-qcp-10-67-5_ext.xml	SAT TT=0.024	SAT TT=0.936 CHECKS=7669 NODES=101	SAT TT=0.93 CHECKS=9196 NODES=0	SAT TT=0.106	SAT TT=0.058 CHECKS=13480	SAT TT=0.04 CHECKS=3494	SAT TT=0.966 ASSIGNMENTS=17	SAT TT=0.987 ASSIGNMENTS=23	SAT TT=0.652 CHECKS=5330 NODES=107	SAT TT=0.668 CHECKS=24709 NODES=184	SAT TT=0.703 CHECKS=158421 NODES=374	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=2639	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.803	SAT TT=1.776	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=2748	SAT TT=0.027 ASSIGNMENTS=73 CHECKS=9987	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=253 CHECKS=26126	SAT TT=0.025 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.309	SAT TT=0.057 ASSIGNMENTS=101 CHECKS=45072	SAT TT=1.025	SAT TT=1.227
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-6_ext.xml	SAT TT=0.024	SAT TT=1.007 CHECKS=21395 NODES=318	SAT TT=1.059 CHECKS=22775 NODES=203	SAT TT=0.101	SAT TT=0.062 CHECKS=17693	SAT TT=0.042 CHECKS=3780	SAT TT=0.999 ASSIGNMENTS=25	SAT TT=1.029 ASSIGNMENTS=28	SAT TT=0.67 CHECKS=6232 NODES=130	SAT TT=0.792 CHECKS=38727 NODES=380	SAT TT=0.682 CHECKS=65245 NODES=109	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.713	SAT TT=1.48	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.026 ASSIGNMENTS=60 CHECKS=8529	SAT TT=0.681	SAT TT=0.027 ASSIGNMENTS=143 CHECKS=14283	SAT TT=0.026 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.251	SAT TT=0.063 ASSIGNMENTS=101 CHECKS=44975	SAT TT=1.165	SAT TT=1.138
csp/QCP-10/ normalized-qcp-10-67-7_ext.xml	SAT TT=0.024	SAT TT=0.973 CHECKS=8333 NODES=113	SAT TT=0.962 CHECKS=17078 NODES=100	SAT TT=0.119	SAT TT=0.072 CHECKS=26224	SAT TT=0.043 CHECKS=5693	SAT TT=1.09 ASSIGNMENTS=27	SAT TT=0.997 ASSIGNMENTS=20	SAT TT=0.612 CHECKS=5490 NODES=107	SAT TT=0.664 CHECKS=38060 NODES=395	SAT TT=0.689 CHECKS=104691 NODES=202	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.485	SAT TT=1.734	SAT TT=0.025 ASSIGNMENTS=84 CHECKS=7542	SAT TT=0.026 ASSIGNMENTS=16 CHECKS=2073	SAT TT=0.843	SAT TT=0.028 ASSIGNMENTS=151 CHECKS=16169	SAT TT=0.024 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.329	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=44742	SAT TT=1.175	SAT TT=0.977
csp/QCP-10/ normalized-qcp-10-67-8_ext.xml	SAT TT=0.023	SAT TT=0.956 CHECKS=7755 NODES=100	SAT TT=1.133 CHECKS=16331 NODES=108	SAT TT=0.11	SAT TT=0.07 CHECKS=23734	SAT TT=0.043 CHECKS=6398	SAT TT=1.023 ASSIGNMENTS=28	SAT TT=1.15 ASSIGNMENTS=18	SAT TT=0.631 CHECKS=5897 NODES=129	SAT TT=0.688 CHECKS=27572 NODES=208	SAT TT=0.674 CHECKS=70595 NODES=132	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.489	SAT TT=1.677	SAT TT=0.024 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.032 ASSIGNMENTS=166 CHECKS=20046	SAT TT=0.847	SAT TT=0.026 ASSIGNMENTS=120 CHECKS=11940	SAT TT=0.023 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.322	SAT TT=0.063 ASSIGNMENTS=100 CHECKS=45030	SAT TT=1.161	SAT TT=1.023
csp/QCP-10/ normalized-qcp-10-67-9_ext.xml	SAT TT=0.026	SAT TT=0.973 CHECKS=7768 NODES=100	SAT TT=1.008 CHECKS=17363 NODES=108	SAT TT=0.107	SAT TT=0.081 CHECKS=34024	SAT TT=0.049 CHECKS=10292	SAT TT=1.036 ASSIGNMENTS=19	SAT TT=1.17 ASSIGNMENTS=17	SAT TT=0.659 CHECKS=9469 NODES=229	SAT TT=0.675 CHECKS=29872 NODES=247	SAT TT=0.69 CHECKS=72531 NODES=124	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.504	SAT TT=1.638	SAT TT=0.026 ASSIGNMENTS=35 CHECKS=3212	SAT TT=0.026 ASSIGNMENTS=117 CHECKS=11343	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=228 CHECKS=22666	SAT TT=0.026 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.407	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=45020	SAT TT=0.994	SAT TT=0.982
csp/QCP-15/ normalized-qcp-15-120-0_ext.xml	SAT TT=0.164	SAT TT=1.485 CHECKS=189507 NODES=2100	SAT TT=1.398 CHECKS=148143 NODES=1429	SAT TT=0.487	SAT TT=0.942 CHECKS=566342	SAT TT=0.164 CHECKS=49748	SAT TT=2.562 ASSIGNMENTS=27	SAT TT=2.405 ASSIGNMENTS=22	SAT TT=2.509 CHECKS=65931 NODES=1181	SAT TT=1.753 CHECKS=604792 NODES=7337	SAT TT=1.791 CHECKS=1944370 NODES=2601	SAT TT=9.372 ASSIGNMENTS=27	SAT TT=9.33 ASSIGNMENTS=2100 CHECKS=189507	SAT TT=2.561	SAT TT=2.503	SAT TT=2.053 ASSIGNMENTS=27436 CHECKS=8057580	SAT TT=0.29 ASSIGNMENTS=6077 CHECKS=920873	SAT TT=6.021	SAT TT=0.598 ASSIGNMENTS=7159 CHECKS=2204480	SAT TT=1.543 ASSIGNMENTS=20153 CHECKS=6217020	SAT TT=3.191	SAT TT=1.729 ASSIGNMENTS=5002 CHECKS=1406630	SAT TT=1.37	SAT TT=1.526
csp/QCP-15/ normalized-qcp-15-120-10_ext.xml	UNSAT TT=0.855	UNSAT TT=68.126 CHECKS=68894600 NODES=422203	UNSAT TT=81.098 CHECKS=75128700 NODES=444833	UNSAT TT=196.516	UNSAT TT=927.338 CHECKS=764965000	UNSAT TT=246.16 CHECKS=227269000	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=689.474 CHECKS=36151400 NODES=820062	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=8.754 ASSIGNMENTS=0	UNSAT TT=77.366 ASSIGNMENTS=422203 CHECKS=68894600	UNSAT TT=1.8	UNSAT TT=1.917	UNSAT TT=6.233 ASSIGNMENTS=114695 CHECKS=25015600	UNSAT TT=2.846 ASSIGNMENTS=51484 CHECKS=11391500	UNSAT TT=57.083	UNSAT TT=2.844 ASSIGNMENTS=51074 CHECKS=11412000	UNSAT TT=22.171 ASSIGNMENTS=295614 CHECKS=87749900	UNSAT TT=3.067	UNSAT TT=978.191 ASSIGNMENTS=4124300 CHECKS=1017790000	UNSAT TT=1.314	UNSAT TT=1.798
csp/QCP-15/ normalized-qcp-15-120-11_ext.xml	UNSAT TT=0.069	UNSAT TT=1.263 CHECKS=54673 NODES=497	UNSAT TT=1.321 CHECKS=81068 NODES=539	UNSAT TT=18.225	UNSAT TT=0.336 CHECKS=120858	UNSAT TT=0.177 CHECKS=36111	UNSAT TT=0.868 ASSIGNMENTS=0	UNSAT TT=0.872 ASSIGNMENTS=0	UNSAT TT=1.53 CHECKS=18914 NODES=36	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=8.401 ASSIGNMENTS=0	UNSAT TT=8.934 ASSIGNMENTS=497 CHECKS=54673	UNSAT TT=1.705	UNSAT TT=1.671	UNSAT TT=0.069 ASSIGNMENTS=193 CHECKS=30906	UNSAT TT=0.265 ASSIGNMENTS=4750 CHECKS=805375	UNSAT TT=1.644	UNSAT TT=0.074 ASSIGNMENTS=431 CHECKS=71014	UNSAT TT=66.288 ASSIGNMENTS=808430 CHECKS=280336000	UNSAT TT=2.605	UNSAT TT=0.256 ASSIGNMENTS=180 CHECKS=235109	UNSAT TT=1.361	UNSAT TT=1.477
csp/QCP-15/ normalized-qcp-15-120-12_ext.xml	UNSAT TT=0.065	UNSAT TT=1.082 CHECKS=15538 NODES=0	UNSAT TT=1.153 CHECKS=15538 NODES=0	UNSAT TT=269.804	UNSAT TT=0.306 CHECKS=118616	UNSAT TT=0.2 CHECKS=37815	UNSAT TT=0.858 ASSIGNMENTS=0	UNSAT TT=0.848 ASSIGNMENTS=0	UNSAT TT=1.556 CHECKS=18113 NODES=65	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.071 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=0.079 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=1.693	UNSAT TT=1.637	UNSAT TT=0.065 ASSIGNMENTS=179 CHECKS=20669	UNSAT TT=0.244 ASSIGNMENTS=5392 CHECKS=791596	UNSAT TT=1.667	UNSAT TT=0.085 ASSIGNMENTS=893 CHECKS=116867	UNSAT TT=0.068 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=2.63	UNSAT TT=0.335 ASSIGNMENTS=369 CHECKS=384177	UNSAT TT=1.316	UNSAT TT=1.422
csp/QCP-15/ normalized-qcp-15-120-13_ext.xml	UNSAT TT=1.671	UNSAT TT=29.813 CHECKS=30937800 NODES=165801	UNSAT TT=17.16 CHECKS=16417600 NODES=92199	UNSAT TT=98.304	UNSAT TT=338.257 CHECKS=281322000	UNSAT TT=88.296 CHECKS=80225600	UNSAT TT=2.125 ASSIGNMENTS=0	UNSAT TT=2.182 ASSIGNMENTS=0	UNSAT TT=150.956 CHECKS=8564360 NODES=176439	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=9.718 ASSIGNMENTS=0	UNSAT TT=38.444 ASSIGNMENTS=165801 CHECKS=30937800	UNSAT TT=2.003	UNSAT TT=1.816	UNSAT TT=6.288 ASSIGNMENTS=72751 CHECKS=25324200	UNSAT TT=12.449 ASSIGNMENTS=150850 CHECKS=50530200	UNSAT TT=156.892	UNSAT TT=18.691 ASSIGNMENTS=237628 CHECKS=79574600	UNSAT TT=8.021 ASSIGNMENTS=97193 CHECKS=32937500	UNSAT TT=3.186	UNSAT TT=173.665 ASSIGNMENTS=869150 CHECKS=312800000	UNSAT TT=1.746	UNSAT TT=1.671
csp/QCP-15/ normalized-qcp-15-120-14_ext.xml	UNSAT TT=0.066	UNSAT TT=1.333 CHECKS=80695 NODES=803	UNSAT TT=1.441 CHECKS=79108 NODES=517	UNSAT TT=64.267	UNSAT TT=0.392 CHECKS=143943	UNSAT TT=0.575 CHECKS=336466	UNSAT TT=0.975 ASSIGNMENTS=0	UNSAT TT=0.867 ASSIGNMENTS=0	UNSAT TT=1.643 CHECKS=22826 NODES=116	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=0.078 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=1.751	UNSAT TT=1.625	UNSAT TT=0.066 ASSIGNMENTS=178 CHECKS=26271	UNSAT TT=0.249 ASSIGNMENTS=5044 CHECKS=734442	UNSAT TT=1.942	UNSAT TT=0.082 ASSIGNMENTS=571 CHECKS=84924	UNSAT TT=0.066 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=2.492	UNSAT TT=0.241 ASSIGNMENTS=192 CHECKS=235794	UNSAT TT=1.373	UNSAT TT=1.497
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-15/ normalized-qcp-15-120-1_ext.xml	SAT TT=0.096	SAT TT=1.518 CHECKS=222886 NODES=2456	SAT TT=1.553 CHECKS=211142 NODES=1960	SAT TT=8.076	SAT TT=1.426 CHECKS=838157	SAT TT=0.299 CHECKS=176181	SAT TT=2.821 ASSIGNMENTS=87	SAT TT=2.671 ASSIGNMENTS=40	SAT TT=4.585 CHECKS=184388 NODES=3400	SAT TT=1.617 CHECKS=282696 NODES=3280	SAT TT=2.108 CHECKS=2556870 NODES=3189	SAT TT=0.116 ASSIGNMENTS=437 CHECKS=139504	SAT TT=0.111 ASSIGNMENTS=437 CHECKS=139504	SAT TT=2.605	SAT TT=2.565	SAT TT=0.11 ASSIGNMENTS=602 CHECKS=201213	SAT TT=0.292 ASSIGNMENTS=5020 CHECKS=893730	SAT TT=124.507	SAT TT=0.109 ASSIGNMENTS=761 CHECKS=194113	SAT TT=0.096 ASSIGNMENTS=437 CHECKS=139504	SAT TT=3.123	SAT TT=0.69 ASSIGNMENTS=2577 CHECKS=627411	SAT TT=1.483	SAT TT=1.51
csp/QCP-15/ normalized-qcp-15-120-2_ext.xml	SAT TT=0.298	SAT TT=1.785 CHECKS=395998 NODES=3709	SAT TT=10.585 CHECKS=9043460 NODES=64907	SAT TT=0.617	SAT TT=33.879 CHECKS=24148300	SAT TT=0.613 CHECKS=359549	SAT TT=2.523 ASSIGNMENTS=17	SAT TT=2.621 ASSIGNMENTS=19	SAT TT=3.167 CHECKS=100270 NODES=1856	SAT TT=1.88 CHECKS=1005300 NODES=12785	SAT TT=3.166 CHECKS=9988960 NODES=9645	SAT TT=10.572 ASSIGNMENTS=17	SAT TT=11.98 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.61	SAT TT=2.554	SAT TT=2.924 ASSIGNMENTS=52118 CHECKS=11976600	SAT TT=0.298 ASSIGNMENTS=5898 CHECKS=982607	SAT TT=20.78	SAT TT=3.571 ASSIGNMENTS=67370 CHECKS=13278400	SAT TT=4.692 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.827	SAT TT=2.299 ASSIGNMENTS=14225 CHECKS=3243460	SAT TT=1.357	SAT TT=1.749
csp/QCP-15/ normalized-qcp-15-120-3_ext.xml	SAT TT=0.089	SAT TT=4.12 CHECKS=2768200 NODES=18180	SAT TT=1.869 CHECKS=377772 NODES=3508	SAT TT=25.651	SAT TT=0.265 CHECKS=98287	SAT TT=0.158 CHECKS=30306	SAT TT=2.658 ASSIGNMENTS=22	SAT TT=2.617 ASSIGNMENTS=26	SAT TT=13.745 CHECKS=762223 NODES=16089	SAT TT=2.106 CHECKS=984197 NODES=12860	SAT TT=2.064 CHECKS=3632730 NODES=4371	SAT TT=0.106 ASSIGNMENTS=351 CHECKS=120599	SAT TT=0.107 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.758	SAT TT=2.439	SAT TT=0.167 ASSIGNMENTS=1224 CHECKS=429617	SAT TT=8.377 ASSIGNMENTS=132785 CHECKS=33829300	SAT TT=11.585	SAT TT=0.937 ASSIGNMENTS=10250 CHECKS=3412800	SAT TT=0.089 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.843	SAT TT=0.261 ASSIGNMENTS=411 CHECKS=253294	SAT TT=1.502	SAT TT=1.884
csp/QCP-15/ normalized-qcp-15-120-4_ext.xml	SAT TT=0.066	SAT TT=1.824 CHECKS=457461 NODES=4186	SAT TT=1.693 CHECKS=365624 NODES=2757	SAT TT=85.144	SAT TT=0.817 CHECKS=502288	SAT TT=1.022 CHECKS=706131	SAT TT=3.191 ASSIGNMENTS=167	SAT TT=2.291 ASSIGNMENTS=18	SAT TT=2.827 CHECKS=86780 NODES=1563	SAT TT=3.794 CHECKS=6303240 NODES=84151	? (TO) TT=1800.08	SAT TT=0.076 ASSIGNMENTS=165 CHECKS=31018	SAT TT=0.081 ASSIGNMENTS=165 CHECKS=31018	SAT TT=2.506	SAT TT=2.547	SAT TT=0.394 ASSIGNMENTS=4066 CHECKS=1298560	SAT TT=0.393 ASSIGNMENTS=6544 CHECKS=1430490	SAT TT=5.526	SAT TT=1.423 ASSIGNMENTS=15871 CHECKS=5448940	SAT TT=0.066 ASSIGNMENTS=165 CHECKS=31018	SAT TT=3.019	SAT TT=2.776 ASSIGNMENTS=9219 CHECKS=3201800	SAT TT=1.405	SAT TT=1.782
csp/QCP-15/ normalized-qcp-15-120-5_ext.xml	SAT TT=0.367	SAT TT=2.204 CHECKS=810869 NODES=5495	SAT TT=10.015 CHECKS=8119460 NODES=50490	SAT TT=0.367	SAT TT=14.96 CHECKS=10200600	SAT TT=8.273 CHECKS=7781820	SAT TT=3.451 ASSIGNMENTS=62	SAT TT=3.083 ASSIGNMENTS=26	SAT TT=30.152 CHECKS=1758240 NODES=33141	SAT TT=8.387 CHECKS=17303400 NODES=244991	SAT TT=1.661 CHECKS=588870 NODES=1002	SAT TT=10.394 ASSIGNMENTS=62	SAT TT=9.892 ASSIGNMENTS=5495 CHECKS=810869	SAT TT=2.598	SAT TT=2.963	SAT TT=11.554 ASSIGNMENTS=140271 CHECKS=50270700	SAT TT=1.229 ASSIGNMENTS=15737 CHECKS=4843560	SAT TT=1315.66	SAT TT=5.147 ASSIGNMENTS=55178 CHECKS=20607700	SAT TT=9.578 ASSIGNMENTS=116993 CHECKS=42085400	SAT TT=3.454	SAT TT=69.82 ASSIGNMENTS=338940 CHECKS=94993700	SAT TT=1.611	SAT TT=2.111
csp/QCP-15/ normalized-qcp-15-120-6_ext.xml	SAT TT=0.465	SAT TT=1.776 CHECKS=417725 NODES=3570	SAT TT=1.886 CHECKS=383716 NODES=3193	SAT TT=19.578	SAT TT=2.197 CHECKS=1401790	SAT TT=0.465 CHECKS=307968	SAT TT=2.689 ASSIGNMENTS=67	SAT TT=2.606 ASSIGNMENTS=32	SAT TT=2.841 CHECKS=86326 NODES=1794	SAT TT=1.915 CHECKS=1086130 NODES=14291	SAT TT=2.794 CHECKS=8723290 NODES=9058	SAT TT=1.374 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=1.514 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.458	SAT TT=2.579	SAT TT=1.957 ASSIGNMENTS=23710 CHECKS=8258540	SAT TT=0.632 ASSIGNMENTS=9160 CHECKS=2191040	SAT TT=1.811	SAT TT=2.117 ASSIGNMENTS=26306 CHECKS=8026020	SAT TT=1.335 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.666	SAT TT=7.983 ASSIGNMENTS=31231 CHECKS=7469300	SAT TT=1.441	SAT TT=1.624
csp/QCP-15/ normalized-qcp-15-120-7_ext.xml	SAT TT=0.384	SAT TT=1.568 CHECKS=263854 NODES=2427	SAT TT=1.446 CHECKS=172508 NODES=1414	SAT TT=0.97	SAT TT=9.276 CHECKS=6340330	SAT TT=1.158 CHECKS=908072	SAT TT=2.781 ASSIGNMENTS=40	SAT TT=2.809 ASSIGNMENTS=44	SAT TT=1.804 CHECKS=31917 NODES=458	SAT TT=1.755 CHECKS=173516 NODES=1788	SAT TT=1.969 CHECKS=3075520 NODES=4321	SAT TT=1.26 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=1.258 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.709	SAT TT=2.582	SAT TT=0.813 ASSIGNMENTS=10788 CHECKS=3171960	SAT TT=0.684 ASSIGNMENTS=9831 CHECKS=2373610	SAT TT=53.567	SAT TT=1.411 ASSIGNMENTS=15828 CHECKS=5164040	SAT TT=1.203 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.922	SAT TT=9.665 ASSIGNMENTS=54258 CHECKS=13817100	SAT TT=1.435	SAT TT=1.482
csp/QCP-15/ normalized-qcp-15-120-8_ext.xml	SAT TT=0.255	SAT TT=2.542 CHECKS=1295610 NODES=9088	SAT TT=1.868 CHECKS=560127 NODES=4085	SAT TT=15.666	SAT TT=2.318 CHECKS=1538240	SAT TT=1.049 CHECKS=881616	SAT TT=2.606 ASSIGNMENTS=42	SAT TT=2.498 ASSIGNMENTS=26	SAT TT=2.125 CHECKS=45436 NODES=834	SAT TT=2.055 CHECKS=1241460 NODES=16130	SAT TT=2.332 CHECKS=5588600 NODES=5826	SAT TT=0.259 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=0.258 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=2.624	SAT TT=2.629	SAT TT=0.297 ASSIGNMENTS=2359 CHECKS=958233	SAT TT=0.522 ASSIGNMENTS=7929 CHECKS=1814400	SAT TT=33.836	SAT TT=2.2 ASSIGNMENTS=26530 CHECKS=8919850	SAT TT=0.255 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=3.191	SAT TT=0.711 ASSIGNMENTS=1749 CHECKS=499081	SAT TT=1.45	SAT TT=1.535
csp/QCP-15/ normalized-qcp-15-120-9_ext.xml	SAT TT=1.303	SAT TT=12.64 CHECKS=11213100 NODES=71894	SAT TT=6.327 CHECKS=4588480 NODES=24366	SAT TT=108.657	SAT TT=4.641 CHECKS=2966030	SAT TT=15.418 CHECKS=13318100	SAT TT=2.754 ASSIGNMENTS=29	SAT TT=2.718 ASSIGNMENTS=6	SAT TT=2.997 CHECKS=99776 NODES=1809	SAT TT=26.488 CHECKS=65705000 NODES=903393	? (TO) TT=1800	SAT TT=10.403 ASSIGNMENTS=29	SAT TT=19.644 ASSIGNMENTS=71894 CHECKS=11213100	SAT TT=2.617	SAT TT=2.568	SAT TT=58.625 ASSIGNMENTS=808661 CHECKS=227102000	SAT TT=1.303 ASSIGNMENTS=16405 CHECKS=5035400	? (TO) TT=1800.11	SAT TT=9.282 ASSIGNMENTS=108559 CHECKS=35135000	SAT TT=83.526 ASSIGNMENTS=1146480 CHECKS=356217000	SAT TT=3.457	SAT TT=716.602 ASSIGNMENTS=1850280 CHECKS=459937000	SAT TT=1.531	SAT TT=1.638
csp/QCP-20/ normalized-qcp-20-187-0_ext.xml	SAT TT=3.689	SAT TT=86.178 CHECKS=71044700 NODES=296824	SAT TT=68.355 CHECKS=59193100 NODES=267618	? (TO) TT=1800.04	SAT TT=1559.42 CHECKS=750580000	? (TO) TT=1800.07	SAT TT=12.586 ASSIGNMENTS=308	SAT TT=7.945 ASSIGNMENTS=88	? (TO) TT=1800.08	SAT TT=35.998 CHECKS=63552400 NODES=661720	? (TO) TT=1800.06	SAT TT=15.179 ASSIGNMENTS=308	SAT TT=87.566 ASSIGNMENTS=296824 CHECKS=71044700	SAT TT=4.737	SAT TT=5.139	SAT TT=371.034 ASSIGNMENTS=3413270 CHECKS=1544380000	SAT TT=3.689 ASSIGNMENTS=34612 CHECKS=15672000	? (TO) TT=1800.07	SAT TT=549.796 ASSIGNMENTS=5052710 CHECKS=2389460000	SAT TT=294.592 ASSIGNMENTS=2884700 CHECKS=1306400000	SAT TT=7.722	? (TO) TT=1800.1	SAT TT=4.273	SAT TT=7.71
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-10_ext.xml	UNSAT TT=5.808	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=196.177 ASSIGNMENTS=8438	UNSAT TT=88.792 ASSIGNMENTS=2468	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=67.933 ASSIGNMENTS=2434	UNSAT TT=734.904 ASSIGNMENTS=2434	UNSAT TT=5.808	UNSAT TT=20.349	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=13.604	? (TO) TT=1800.1	UNSAT TT=9.165	UNSAT TT=9.768
csp/QCP-20/ normalized-qcp-20-187-11_ext.xml	UNSAT TT=0.201	UNSAT TT=4.086 CHECKS=1821240 NODES=9837	UNSAT TT=2.87 CHECKS=543852 NODES=3228	? (TO) TT=1800.1	UNSAT TT=3.116 CHECKS=1294710	UNSAT TT=1.484 CHECKS=240400	UNSAT TT=1.011 ASSIGNMENTS=0	UNSAT TT=1.213 ASSIGNMENTS=0	UNSAT TT=10.067 CHECKS=145949 NODES=2142	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.222 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=0.223 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=2.882	UNSAT TT=3.03	UNSAT TT=0.224 ASSIGNMENTS=2069 CHECKS=390152	UNSAT TT=0.48 ASSIGNMENTS=7313 CHECKS=1482210	UNSAT TT=11.104	UNSAT TT=0.201 ASSIGNMENTS=1518 CHECKS=288165	UNSAT TT=0.216 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=4.041	UNSAT TT=2.509 ASSIGNMENTS=1786 CHECKS=2862110	UNSAT TT=1.991	UNSAT TT=2.657
csp/QCP-20/ normalized-qcp-20-187-12_ext.xml	UNSAT TT=5.556	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=8.817 ASSIGNMENTS=3	UNSAT TT=8.318 ASSIGNMENTS=22	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=13.111 ASSIGNMENTS=170	UNSAT TT=679.857 ASSIGNMENTS=170	UNSAT TT=5.731	UNSAT TT=5.556	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=10.037	? (TO) TT=1800.11	UNSAT TT=17.393	UNSAT TT=5.659
csp/QCP-20/ normalized-qcp-20-187-13_ext.xml	UNSAT TT=3.918	UNSAT TT=1004.12 CHECKS=850273000 NODES=3819070	UNSAT TT=1109.52 CHECKS=901767000 NODES=3912150	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=61.909 ASSIGNMENTS=2738	UNSAT TT=20.154 ASSIGNMENTS=364	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=73.849 ASSIGNMENTS=2808	UNSAT TT=737.606 ASSIGNMENTS=2808	UNSAT TT=4.708	UNSAT TT=3.918	UNSAT TT=687.067 ASSIGNMENTS=6765400 CHECKS=2829090000	UNSAT TT=657.699 ASSIGNMENTS=6901810 CHECKS=2918940000	? (TO) TT=1800.08	UNSAT TT=389.174 ASSIGNMENTS=3747130 CHECKS=1573070000	UNSAT TT=749.406 ASSIGNMENTS=7567830 CHECKS=3147200000	UNSAT TT=6.871	? (TO) TT=1800.08	UNSAT TT=4.907	UNSAT TT=5.638
csp/QCP-20/ normalized-qcp-20-187-14_ext.xml	UNSAT TT=3.586	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=4.106 ASSIGNMENTS=0	UNSAT TT=4.118 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=11.324 ASSIGNMENTS=110	UNSAT TT=679.022 ASSIGNMENTS=110	UNSAT TT=5.341	UNSAT TT=3.625	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=5.31	? (TO) TT=1800.03	UNSAT TT=4.069	UNSAT TT=3.586
csp/QCP-20/ normalized-qcp-20-187-1_ext.xml	SAT TT=1.284	SAT TT=247.054 CHECKS=194819000 NODES=894042	SAT TT=106.901 CHECKS=86207800 NODES=361496	? (TO) TT=1800.09	SAT TT=1772.73 CHECKS=889563000	SAT TT=185.742 CHECKS=74609700	SAT TT=7.571 ASSIGNMENTS=30	SAT TT=7.366 ASSIGNMENTS=26	? (TO) TT=1800.09	SAT TT=98.953 CHECKS=191936000 NODES=1974040	? (TO) TT=1800.07	SAT TT=1.3 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=1.323 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=8.255	SAT TT=4.236	SAT TT=3.046 ASSIGNMENTS=28113 CHECKS=11572400	SAT TT=31.858 ASSIGNMENTS=352100 CHECKS=134727000	? (TO) TT=1800.05	SAT TT=7.487 ASSIGNMENTS=85564 CHECKS=31309100	SAT TT=1.284 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=4.123	? (TO) TT=1800.08	SAT TT=2.718	SAT TT=2.805
csp/QCP-20/ normalized-qcp-20-187-2_ext.xml	SAT TT=4.617	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1354.15 CHECKS=504683000	SAT TT=15.658 ASSIGNMENTS=351	SAT TT=13.643 ASSIGNMENTS=213	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=30.475 ASSIGNMENTS=1028	SAT TT=699.321 ASSIGNMENTS=1028	SAT TT=6.022	SAT TT=7.225	? (TO) TT=1800.06	SAT TT=735.499 ASSIGNMENTS=7282480 CHECKS=3353870000	? (TO) TT=1800.05	SAT TT=1371.13 ASSIGNMENTS=13209900 CHECKS=1456490000	SAT TT=997.939 ASSIGNMENTS=9104530 CHECKS=100722000	SAT TT=10.076	? (TO) TT=1800.1	SAT TT=8.19	SAT TT=4.617
csp/QCP-20/ normalized-qcp-20-187-3_ext.xml	SAT TT=4.797	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=10.955 ASSIGNMENTS=82	SAT TT=9.772 ASSIGNMENTS=34	? (TO) TT=1800.06	SAT TT=270.7 CHECKS=553253000 NODES=5810500	? (TO) TT=1800.08	SAT TT=32.802 ASSIGNMENTS=1154	SAT TT=702.01 ASSIGNMENTS=1154	SAT TT=5.648	SAT TT=4.965	SAT TT=1087.8 ASSIGNMENTS=10250300 CHECKS=426425000	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=869.756 ASSIGNMENTS=7511240 CHECKS=3554840000	? (TO) TT=1800.04	SAT TT=7.375	? (TO) TT=1800.07	SAT TT=5.945	SAT TT=4.797
csp/QCP-20/ normalized-qcp-20-187-4_ext.xml	SAT TT=5.092	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=27.782 ASSIGNMENTS=1026	SAT TT=11.569 ASSIGNMENTS=172	? (TO) TT=1800.03	SAT TT=20.191 CHECKS=34876100 NODES=372428	? (TO) TT=1800.09	SAT TT=99.815 ASSIGNMENTS=4017	SAT TT=758.606 ASSIGNMENTS=4017	SAT TT=5.092	SAT TT=6.342	? (TO) TT=1800.09	SAT TT=1495.3 ASSIGNMENTS=14166800 CHECKS=2472280000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.3	? (TO) TT=1800.1	SAT TT=16.893	SAT TT=5.912
csp/QCP-20/ normalized-qcp-20-187-5_ext.xml	SAT TT=2.514	SAT TT=136.215 CHECKS=107969000 NODES=460722	SAT TT=611.783 CHECKS=534493000 NODES=2470600	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=6.896 CHECKS=1833940	SAT TT=10.422 ASSIGNMENTS=120	SAT TT=7.483 ASSIGNMENTS=24	? (TO) TT=1800.01	SAT TT=11.417 CHECKS=13794900 NODES=140757	? (TO) TT=1800.06	SAT TT=20.132 ASSIGNMENTS=521	SAT TT=129.725 ASSIGNMENTS=460722 CHECKS=107969000	SAT TT=4.403	SAT TT=4.24	? (TO) TT=1800.07	SAT TT=50.736 ASSIGNMENTS=538921 CHECKS=208806000	? (TO) TT=1800.06	SAT TT=56.666 ASSIGNMENTS=582246 CHECKS=253759000	? (TO) TT=1800.02	SAT TT=4.905	? (TO) TT=1800.11	SAT TT=2.514	SAT TT=4.292
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-6_ext.xml	SAT TT=4.988	? (TO) TT=1800.1	SAT TT=1384.09 CHECKS=1230110000 NODES=4741160	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1147.44 CHECKS=488402000	SAT TT=27.2 ASSIGNMENTS=1090	SAT TT=7.793 ASSIGNMENTS=63	? (TO) TT=1800.05	SAT TT=13.019 CHECKS=16341800 NODES=170729	? (TO) TT=1800.05	SAT TT=23.137 ASSIGNMENTS=807	SAT TT=691.743 ASSIGNMENTS=807	SAT TT=5.841	SAT TT=4.988	SAT TT=37.453 ASSIGNMENTS=354247 CHECKS=167088000	SAT TT=956.689 ASSIGNMENTS=8572940 CHECKS=3994410000	? (TO) TT=1800.05	SAT TT=1425.12 ASSIGNMENTS=12144500 CHECKS=1324030000	SAT TT=135.171 ASSIGNMENTS=1126510 CHECKS=549540000	SAT TT=6.375	SAT TT=722.274 ASSIGNMENTS=2291300 CHECKS=709389000	SAT TT=7.797	SAT TT=10.33
csp/QCP-20/ normalized-qcp-20-187-7_ext.xml	SAT TT=3.473	SAT TT=1125.21 CHECKS=997941000 NODES=4322420	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.991 ASSIGNMENTS=131	SAT TT=8.906 ASSIGNMENTS=100	? (TO) TT=1800.03	SAT TT=31.612 CHECKS=53466000 NODES=564896	? (TO) TT=1800.01	SAT TT=11.663 ASSIGNMENTS=131	SAT TT=678.678 ASSIGNMENTS=131	SAT TT=6.406	SAT TT=6.537	SAT TT=1511.79 ASSIGNMENTS=14831300 CHECKS=2128970000	SAT TT=138.199 ASSIGNMENTS=1300120 CHECKS=621673000	? (TO) TT=1800.08	SAT TT=1760.55 ASSIGNMENTS=16280500 CHECKS=3237210000	? (TO) TT=1800.04	SAT TT=4.966	SAT TT=1386.64 ASSIGNMENTS=5868380 CHECKS=1619470000	SAT TT=3.473	SAT TT=13.434
csp/QCP-20/ normalized-qcp-20-187-8_ext.xml	SAT TT=3.369	SAT TT=103.779 CHECKS=85623200 NODES=369967	SAT TT=3.97 CHECKS=1805770 NODES=10365	? (TO) TT=1800.02	SAT TT=148.427 CHECKS=77597100	SAT TT=1376.39 CHECKS=1311560000	SAT TT=8.46 ASSIGNMENTS=53	SAT TT=13.154 ASSIGNMENTS=228	SAT TT=396.684 CHECKS=11067600 NODES=192251	SAT TT=51.755 CHECKS=100310000 NODES=1038730	? (TO) TT=1800.04	SAT TT=13.966 ASSIGNMENTS=206	SAT TT=112.52 ASSIGNMENTS=369967 CHECKS=85623200	SAT TT=5.835	SAT TT=4.605	SAT TT=301.348 ASSIGNMENTS=3260060 CHECKS=1260420000	SAT TT=7.867 ASSIGNMENTS=79487 CHECKS=32450600	? (TO) TT=1800.11	SAT TT=432.599 ASSIGNMENTS=3830550 CHECKS=1769440000	SAT TT=278.883 ASSIGNMENTS=2931480 CHECKS=1155290000	SAT TT=4.524	? (TO) TT=1800.04	SAT TT=3.712	SAT TT=3.369
csp/QCP-20/ normalized-qcp-20-187-9_ext.xml	SAT TT=1.527	SAT TT=771.553 CHECKS=643145000 NODES=2667110	SAT TT=5.795 CHECKS=3102290 NODES=15098	? (TO) TT=1800.04	SAT TT=18.857 CHECKS=8505560	SAT TT=788.028 CHECKS=260390000	SAT TT=7.727 ASSIGNMENTS=78	SAT TT=8.76 ASSIGNMENTS=153	? (TO) TT=1800.03	SAT TT=7.235 CHECKS=4154440 NODES=42970	? (TO) TT=1800	SAT TT=17.289 ASSIGNMENTS=408	SAT TT=684.963 ASSIGNMENTS=408	SAT TT=4.688	SAT TT=4.577	SAT TT=193.378 ASSIGNMENTS=2148000 CHECKS=864870000	SAT TT=150.446 ASSIGNMENTS=1164980 CHECKS=631978000	? (TO) TT=1800.03	SAT TT=1.527 ASSIGNMENTS=11480 CHECKS=5951810	SAT TT=207.332 ASSIGNMENTS=2193810 CHECKS=876188000	SAT TT=5.019	? (TO) TT=1800.07	SAT TT=3.738	SAT TT=3.993
csp/QCP-25/ normalized-qcp-25-264-0_ext.xml	SAT TT=31.548	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=489.462 ASSIGNMENTS=10433	SAT TT=94.367 ASSIGNMENTS=1329	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=482.805 ASSIGNMENTS=10433	SAT TT=1177.74 ASSIGNMENTS=10433	SAT TT=43.353	SAT TT=34.017	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=31.548	? (TO) TT=1800.12	SAT TT=273.693	SAT TT=107.804
csp/QCP-25/ normalized-qcp-25-264-10_ext.xml	UNSAT TT=19.47	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=148.3 ASSIGNMENTS=2369	UNSAT TT=129.935 ASSIGNMENTS=1263	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=132.104 ASSIGNMENTS=2369	UNSAT TT=797.306 ASSIGNMENTS=2369	UNSAT TT=42.075	UNSAT TT=19.47	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=86.44	? (TO) TT=1800.09	UNSAT TT=255.43	UNSAT TT=129.58
csp/QCP-25/ normalized-qcp-25-264-11_ext.xml	UNSAT TT=0.356	UNSAT TT=1.828 CHECKS=102046 NODES=0	UNSAT TT=1.836 CHECKS=102046 NODES=0	? (TO) TT=1800.04	UNSAT TT=4.012 CHECKS=728022	UNSAT TT=5.96 CHECKS=342599	UNSAT TT=1.163 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=18.254 CHECKS=115324 NODES=244	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=0.383 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=0.384 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=5.264	UNSAT TT=6.896	UNSAT TT=0.402 ASSIGNMENTS=2888 CHECKS=673016	UNSAT TT=0.615 ASSIGNMENTS=8328 CHECKS=1813620	UNSAT TT=44.034	UNSAT TT=0.711 ASSIGNMENTS=7921 CHECKS=1887400	UNSAT TT=0.356 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=4.87	UNSAT TT=2.95 ASSIGNMENTS=1617 CHECKS=2890660	UNSAT TT=3.13	UNSAT TT=3.384
csp/QCP-25/ normalized-qcp-25-264-12_ext.xml	UNSAT TT=1.469	UNSAT TT=1465.74 CHECKS=1217050000 NODES=4495920	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=1.469 ASSIGNMENTS=0	UNSAT TT=1.483 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=9.137 ASSIGNMENTS=0	UNSAT TT=676.066 ASSIGNMENTS=0	UNSAT TT=5.694	UNSAT TT=5.498	? (TO) TT=1800.08	UNSAT TT=793.615 ASSIGNMENTS=11236600 CHECKS=3780190000	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=5.014	? (TO) TT=1800.15	UNSAT TT=3.181	UNSAT TT=3.889
csp/QCP-25/ normalized-qcp-25-264-13_ext.xml	UNSAT TT=1.4	? (TO) TT=1800.1	UNSAT TT=32.759 CHECKS=19295600 NODES=78577	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.4 ASSIGNMENTS=0	UNSAT TT=1.413 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.332 ASSIGNMENTS=0	UNSAT TT=675.912 ASSIGNMENTS=0	UNSAT TT=5.766	UNSAT TT=5.977	? (TO) TT=1800.07	UNSAT TT=191.924 ASSIGNMENTS=3029480 CHECKS=840137000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=5.366	? (TO) TT=1800.14	UNSAT TT=3.26	UNSAT TT=4.098
csp/QCP-25/ normalized-qcp-25-264-14_ext.xml	UNSAT TT=32.393	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=187.054 ASSIGNMENTS=2650	UNSAT TT=111.985 ASSIGNMENTS=1014	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=148.726 ASSIGNMENTS=2487	UNSAT TT=800.345 ASSIGNMENTS=2487	UNSAT TT=32.474	UNSAT TT=32.393	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=70.472	? (TO) TT=1800.15	UNSAT TT=65.879	UNSAT TT=105.436
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-25/ normalized-qcp-25-264-1_ext.xml	SAT TT=137.596	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=656.988	SAT TT=137.596	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=371.733	? (TO) TT=1800.11	SAT TT=654.826	SAT TT=1696.08
csp/QCP-25/ normalized-qcp-25-264-2_ext.xml	SAT TT=10.57	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=30.048 ASSIGNMENTS=160	SAT TT=94.941 ASSIGNMENTS=1221	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=158.12 ASSIGNMENTS=2681	SAT TT=831.742 ASSIGNMENTS=2681	SAT TT=17.961	SAT TT=21.711	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=10.57	? (TO) TT=1800.12	SAT TT=38.422	SAT TT=37.986
csp/QCP-25/ normalized-qcp-25-264-3_ext.xml	SAT TT=47.242	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1391.47 ASSIGNMENTS=28060	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1419.53 ASSIGNMENTS=28060	? (TO) TT=1800.01	SAT TT=204.922	SAT TT=47.242	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=299.072	? (TO) TT=1800.09	SAT TT=1169.24	SAT TT=93.987
csp/QCP-25/ normalized-qcp-25-264-4_ext.xml	SAT TT=27.328	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1477.49 ASSIGNMENTS=26778	SAT TT=221.842 ASSIGNMENTS=2446	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=27.328	SAT TT=98.283	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=166.727	? (TO) TT=1800.09	SAT TT=342.65	SAT TT=71.447
csp/QCP-25/ normalized-qcp-25-264-5_ext.xml	SAT TT=35.778	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=962.125 ASSIGNMENTS=11219	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=35.778	SAT TT=116.864	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=285.904	? (TO) TT=1800.13	SAT TT=230.37	SAT TT=97.073
csp/QCP-25/ normalized-qcp-25-264-6_ext.xml	SAT TT=57.228	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=57.228 ASSIGNMENTS=737	SAT TT=1151.55 ASSIGNMENTS=15852	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=119.394 ASSIGNMENTS=2319	SAT TT=786.463 ASSIGNMENTS=2319	SAT TT=366.619	SAT TT=141.766	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=654.663	? (TO) TT=1800.07	SAT TT=166.843	SAT TT=166.095
csp/QCP-25/ normalized-qcp-25-264-7_ext.xml	SAT TT=43.883	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=943.746 ASSIGNMENTS=22317	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1453.41 CHECKS=2264150000 NODES=19452500	? (TO) TT=1800.06	SAT TT=252.841 ASSIGNMENTS=5745	SAT TT=918.357 ASSIGNMENTS=5745	SAT TT=70.143	SAT TT=43.883	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=64.991	? (TO) TT=1800.14	SAT TT=53.629	SAT TT=228.492
csp/QCP-25/ normalized-qcp-25-264-8_ext.xml	SAT TT=25.145	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=727.454 ASSIGNMENTS=15922	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=130.551 ASSIGNMENTS=2149	SAT TT=797.46 ASSIGNMENTS=2149	SAT TT=73.27	SAT TT=25.145	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=61.858	? (TO) TT=1800.16	SAT TT=125.736	SAT TT=89.797
csp/QCP-25/ normalized-qcp-25-264-9_ext.xml	SAT TT=26.164	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=46.516 ASSIGNMENTS=447	SAT TT=1775.36 ASSIGNMENTS=21093	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=26.164	SAT TT=37.713	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=380.529	? (TO) TT=1800.16	SAT TT=264.981	SAT TT=96.707
csp/QWH-10/ normalized-qwh-10-57-0_ext.xml	SAT TT=0.021	SAT TT=0.938 CHECKS=7497 NODES=101	SAT TT=1.016 CHECKS=24710 NODES=0	SAT TT=0.102	SAT TT=0.114 CHECKS=109640	SAT TT=0.04 CHECKS=14117	SAT TT=1.227 ASSIGNMENTS=4	SAT TT=0.937 ASSIGNMENTS=9	SAT TT=0.587 CHECKS=5245 NODES=108	SAT TT=0.646 CHECKS=25298 NODES=379	SAT TT=0.662 CHECKS=282044 NODES=745	SAT TT=0.034 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.033 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.49	SAT TT=1.438	SAT TT=0.024 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=3202	SAT TT=0.62	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=3579	SAT TT=0.021 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.301	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=34312	SAT TT=0.956	SAT TT=1.144
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-10/ normalized-qwh-10-57-1_ext.xml	SAT TT=0.022	SAT TT=0.953 CHECKS=9265 NODES=145	SAT TT=1.02 CHECKS=19847 NODES=0	SAT TT=0.106	SAT TT=0.121 CHECKS=112630	SAT TT=0.049 CHECKS=33631	SAT TT=0.833 ASSIGNMENTS=5	SAT TT=1.051 ASSIGNMENTS=4	SAT TT=0.624 CHECKS=6626 NODES=153	SAT TT=0.621 CHECKS=61113 NODES=1221	SAT TT=0.867 CHECKS=84676 NODES=280	SAT TT=0.029 ASSIGNMENTS=32 CHECKS=4937	SAT TT=0.033 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.529	SAT TT=1.593	SAT TT=0.022 ASSIGNMENTS=35 CHECKS=5718	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=10042	SAT TT=0.824	SAT TT=0.026 ASSIGNMENTS=137 CHECKS=13855	SAT TT=0.023 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.301	SAT TT=0.055 ASSIGNMENTS=133 CHECKS=36754	SAT TT=0.992	SAT TT=1.001
csp/QWH-10/ normalized-qwh-10-57-2_ext.xml	SAT TT=0.022	SAT TT=0.906 CHECKS=6664 NODES=100	SAT TT=0.934 CHECKS=7844 NODES=0	SAT TT=0.103	SAT TT=0.057 CHECKS=23137	SAT TT=0.04 CHECKS=24242	SAT TT=1.065 ASSIGNMENTS=5	SAT TT=1.029 ASSIGNMENTS=6	SAT TT=0.624 CHECKS=5485 NODES=116	SAT TT=0.644 CHECKS=43398 NODES=807	SAT TT=0.659 CHECKS=52021 NODES=148	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.609	SAT TT=1.56	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=2064	SAT TT=0.022 ASSIGNMENTS=38 CHECKS=4669	SAT TT=0.662	SAT TT=0.023 ASSIGNMENTS=111 CHECKS=12201	SAT TT=0.023 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.191	SAT TT=0.055 ASSIGNMENTS=139 CHECKS=38982	SAT TT=0.956	SAT TT=0.983
csp/QWH-10/ normalized-qwh-10-57-3_ext.xml	SAT TT=0.021	SAT TT=0.992 CHECKS=12727 NODES=204	SAT TT=0.938 CHECKS=17818 NODES=127	SAT TT=0.104	SAT TT=0.049 CHECKS=15467	SAT TT=0.036 CHECKS=4447	SAT TT=1.009 ASSIGNMENTS=5	SAT TT=1.184 ASSIGNMENTS=9	SAT TT=0.628 CHECKS=4820 NODES=104	SAT TT=0.622 CHECKS=20416 NODES=245	SAT TT=0.747 CHECKS=598645 NODES=1499	SAT TT=0.034 ASSIGNMENTS=36 CHECKS=3598	SAT TT=0.033 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.681	SAT TT=1.526	SAT TT=0.023 ASSIGNMENTS=42 CHECKS=4846	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=2112	SAT TT=0.652	SAT TT=0.023 ASSIGNMENTS=38 CHECKS=4571	SAT TT=0.021 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.279	SAT TT=0.053 ASSIGNMENTS=118 CHECKS=35943	SAT TT=1.127	SAT TT=1.175
csp/QWH-10/ normalized-qwh-10-57-4_ext.xml	SAT TT=0.02	SAT TT=0.936 CHECKS=7332 NODES=106	SAT TT=0.985 CHECKS=31345 NODES=237	SAT TT=0.105	SAT TT=0.098 CHECKS=81484	SAT TT=0.044 CHECKS=18791	SAT TT=1.015 ASSIGNMENTS=9	SAT TT=0.959 ASSIGNMENTS=8	SAT TT=0.588 CHECKS=4900 NODES=105	SAT TT=0.62 CHECKS=18288 NODES=181	SAT TT=0.654 CHECKS=72467 NODES=172	SAT TT=0.034 ASSIGNMENTS=20 CHECKS=2512	SAT TT=0.033 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.593	SAT TT=1.434	SAT TT=0.023 ASSIGNMENTS=20 CHECKS=2518	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=2033	SAT TT=0.647	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=6051	SAT TT=0.02 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.32	SAT TT=0.057 ASSIGNMENTS=139 CHECKS=38338	SAT TT=0.976	SAT TT=1.016
csp/QWH-10/ normalized-qwh-10-57-5_ext.xml	SAT TT=0.022	SAT TT=1.001 CHECKS=18178 NODES=384	SAT TT=0.984 CHECKS=20199 NODES=119	SAT TT=0.107	SAT TT=0.112 CHECKS=102120	SAT TT=0.035 CHECKS=3311	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=0.953 ASSIGNMENTS=9	SAT TT=0.864 CHECKS=5122 NODES=112	SAT TT=0.62 CHECKS=31715 NODES=513	SAT TT=0.613 CHECKS=56968 NODES=137	SAT TT=0.035 ASSIGNMENTS=29 CHECKS=4622	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.448	SAT TT=1.678	SAT TT=0.024 ASSIGNMENTS=30 CHECKS=5180	SAT TT=0.023 ASSIGNMENTS=14 CHECKS=1509	SAT TT=0.624	SAT TT=0.022 ASSIGNMENTS=25 CHECKS=2885	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.212	SAT TT=0.058 ASSIGNMENTS=109 CHECKS=35529	SAT TT=1.22	SAT TT=1.004
csp/QWH-10/ normalized-qwh-10-57-6_ext.xml	SAT TT=0.02	SAT TT=0.944 CHECKS=6803 NODES=101	SAT TT=0.869 CHECKS=6741 NODES=0	SAT TT=0.103	SAT TT=0.05 CHECKS=12703	SAT TT=0.032 CHECKS=3291	SAT TT=1.184 ASSIGNMENTS=12	SAT TT=0.961 ASSIGNMENTS=10	SAT TT=0.67 CHECKS=5941 NODES=126	SAT TT=0.653 CHECKS=27398 NODES=387	SAT TT=0.668 CHECKS=130105 NODES=368	SAT TT=0.033 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.69	SAT TT=1.608	SAT TT=0.02 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.024 ASSIGNMENTS=19 CHECKS=2538	SAT TT=0.642	SAT TT=0.023 ASSIGNMENTS=60 CHECKS=6026	SAT TT=0.022 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.275	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=34102	SAT TT=1.084	SAT TT=1.387
csp/QWH-10/ normalized-qwh-10-57-7_ext.xml	SAT TT=0.022	SAT TT=0.947 CHECKS=9127 NODES=139	SAT TT=1.096 CHECKS=29504 NODES=372	SAT TT=0.103	SAT TT=0.052 CHECKS=23299	SAT TT=0.043 CHECKS=16318	SAT TT=1.243 ASSIGNMENTS=13	SAT TT=1.104 ASSIGNMENTS=7	SAT TT=0.727 CHECKS=5340 NODES=114	SAT TT=0.643 CHECKS=24139 NODES=349	SAT TT=0.654 CHECKS=63343 NODES=156	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.581	SAT TT=1.524	SAT TT=0.022 ASSIGNMENTS=8 CHECKS=2252	SAT TT=0.022 ASSIGNMENTS=6 CHECKS=1168	SAT TT=0.661	SAT TT=0.026 ASSIGNMENTS=113 CHECKS=14245	SAT TT=0.022 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.275	SAT TT=0.058 ASSIGNMENTS=175 CHECKS=40589	SAT TT=1.061	SAT TT=1.212
csp/QWH-10/ normalized-qwh-10-57-8_ext.xml	SAT TT=0.022	SAT TT=0.926 CHECKS=7294 NODES=106	SAT TT=0.931 CHECKS=15074 NODES=101	SAT TT=0.102	SAT TT=0.052 CHECKS=20077	SAT TT=0.037 CHECKS=7559	SAT TT=0.969 ASSIGNMENTS=11	SAT TT=0.988 ASSIGNMENTS=8	SAT TT=0.643 CHECKS=5458 NODES=114	SAT TT=0.638 CHECKS=24212 NODES=303	SAT TT=0.665 CHECKS=219994 NODES=597	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.468	SAT TT=1.531	SAT TT=0.023 ASSIGNMENTS=19 CHECKS=2347	SAT TT=0.023 ASSIGNMENTS=30 CHECKS=3099	SAT TT=0.685	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=2645	SAT TT=0.022 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.282	SAT TT=0.058 ASSIGNMENTS=172 CHECKS=41573	SAT TT=1.05	SAT TT=0.992
csp/QWH-10/ normalized-qwh-10-57-9_ext.xml	SAT TT=0.024	SAT TT=0.982 CHECKS=7193 NODES=103	SAT TT=0.904 CHECKS=7161 NODES=0	SAT TT=0.102	SAT TT=0.045 CHECKS=12762	SAT TT=0.036 CHECKS=2847	SAT TT=0.992 ASSIGNMENTS=14	SAT TT=0.991 ASSIGNMENTS=14	SAT TT=0.712 CHECKS=8291 NODES=226	SAT TT=0.616 CHECKS=27488 NODES=350	SAT TT=0.661 CHECKS=97250 NODES=237	SAT TT=0.048 ASSIGNMENTS=320 CHECKS=41940	SAT TT=0.047 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.84	SAT TT=1.591	SAT TT=0.033 ASSIGNMENTS=267 CHECKS=35614	SAT TT=0.038 ASSIGNMENTS=708 CHECKS=51125	SAT TT=0.642	SAT TT=0.024 ASSIGNMENTS=132 CHECKS=11342	SAT TT=0.034 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.283	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=33514	SAT TT=0.962	SAT TT=0.99
csp/QWH-15/ normalized-qwh-15-106-0_ext.xml	SAT TT=0.061	SAT TT=1.437 CHECKS=215823 NODES=1788	SAT TT=1.433 CHECKS=132580 NODES=1141	SAT TT=0.259	SAT TT=0.339 CHECKS=165410	SAT TT=0.249 CHECKS=138364	SAT TT=2.583 ASSIGNMENTS=20	SAT TT=2.382 ASSIGNMENTS=13	SAT TT=2.169 CHECKS=46802 NODES=775	SAT TT=1.547 CHECKS=235335 NODES=3316	SAT TT=1.807 CHECKS=858933 NODES=1279	SAT TT=0.072 ASSIGNMENTS=88 CHECKS=22046	SAT TT=0.074 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.5	SAT TT=2.525	SAT TT=0.061 ASSIGNMENTS=103 CHECKS=20156	SAT TT=0.259 ASSIGNMENTS=4056 CHECKS=711439	SAT TT=1.98	SAT TT=0.098 ASSIGNMENTS=603 CHECKS=150810	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.651	SAT TT=2.485 ASSIGNMENTS=7855 CHECKS=1647510	SAT TT=1.558	SAT TT=1.881
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-15/ normalized-qwh-15-106-1_ext.xml	SAT TT=0.21	SAT TT=2.429 CHECKS=1128980 NODES=8034	SAT TT=2.79 CHECKS=1260490 NODES=8323	SAT TT=0.323	SAT TT=13.252 CHECKS=10335300	SAT TT=9.845 CHECKS=8684920	SAT TT=1.741 ASSIGNMENTS=10	SAT TT=1.914 ASSIGNMENTS=7	SAT TT=12.09 CHECKS=551278 NODES=12658	SAT TT=1.673 CHECKS=534970 NODES=7873	? (TO) TT=1800.06	SAT TT=0.309 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=0.305 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.515	SAT TT=2.508	SAT TT=0.21 ASSIGNMENTS=2257 CHECKS=602641	SAT TT=0.329 ASSIGNMENTS=5757 CHECKS=1014420	SAT TT=1.994	SAT TT=0.227 ASSIGNMENTS=2486 CHECKS=688388	SAT TT=0.292 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.573	SAT TT=27.914 ASSIGNMENTS=130558 CHECKS=31653400	SAT TT=1.474	SAT TT=1.486
csp/QWH-15/ normalized-qwh-15-106-2_ext.xml	SAT TT=0.076	SAT TT=1.374 CHECKS=104267 NODES=1223	SAT TT=1.611 CHECKS=266546 NODES=1937	SAT TT=0.283	SAT TT=3.981 CHECKS=2968070	SAT TT=1.324 CHECKS=1294420	SAT TT=2.455 ASSIGNMENTS=8	SAT TT=2.469 ASSIGNMENTS=17	SAT TT=2.125 CHECKS=42223 NODES=696	SAT TT=1.876 CHECKS=1008410 NODES=16561	SAT TT=1.414 CHECKS=261884 NODES=375	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.59	SAT TT=2.43	SAT TT=0.078 ASSIGNMENTS=321 CHECKS=79702	SAT TT=0.3 ASSIGNMENTS=4428 CHECKS=884034	SAT TT=2.402	SAT TT=0.193 ASSIGNMENTS=1570 CHECKS=485926	SAT TT=0.076 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.442	SAT TT=10.249 ASSIGNMENTS=32104 CHECKS=17725100	SAT TT=1.322	SAT TT=1.629
csp/QWH-15/ normalized-qwh-15-106-3_ext.xml	SAT TT=0.068	SAT TT=1.453 CHECKS=58343 NODES=714	SAT TT=1.531 CHECKS=119389 NODES=1094	SAT TT=0.258	SAT TT=0.413 CHECKS=236147	SAT TT=0.238 CHECKS=143199	SAT TT=2.902 ASSIGNMENTS=22	SAT TT=2.791 ASSIGNMENTS=15	SAT TT=2.346 CHECKS=61010 NODES=1136	SAT TT=1.663 CHECKS=223561 NODES=2882	SAT TT=1.709 CHECKS=2403780 NODES=3030	SAT TT=0.129 ASSIGNMENTS=808 CHECKS=221305	SAT TT=0.128 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.484	SAT TT=2.525	SAT TT=0.068 ASSIGNMENTS=127 CHECKS=28913	SAT TT=0.131 ASSIGNMENTS=1891 CHECKS=258609	SAT TT=1.667	SAT TT=0.088 ASSIGNMENTS=639 CHECKS=109322	SAT TT=0.119 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.576	SAT TT=0.406 ASSIGNMENTS=1238 CHECKS=305943	SAT TT=1.527	SAT TT=1.721
csp/QWH-15/ normalized-qwh-15-106-4_ext.xml	SAT TT=0.072	SAT TT=1.37 CHECKS=102231 NODES=1229	SAT TT=2.156 CHECKS=800977 NODES=5196	SAT TT=0.263	SAT TT=0.207 CHECKS=85489	SAT TT=0.125 CHECKS=31497	SAT TT=2.739 ASSIGNMENTS=20	SAT TT=2.551 ASSIGNMENTS=12	SAT TT=1.921 CHECKS=38606 NODES=585	SAT TT=1.862 CHECKS=959963 NODES=15578	SAT TT=3.161 CHECKS=11806900 NODES=11813	SAT TT=0.148 ASSIGNMENTS=827 CHECKS=315173	SAT TT=0.15 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.52	SAT TT=2.653	SAT TT=0.072 ASSIGNMENTS=263 CHECKS=87698	SAT TT=0.171 ASSIGNMENTS=2596 CHECKS=469073	SAT TT=2.742	SAT TT=0.088 ASSIGNMENTS=570 CHECKS=152598	SAT TT=0.131 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.793	SAT TT=3.472 ASSIGNMENTS=17878 CHECKS=4092040	SAT TT=1.243	SAT TT=1.446
csp/QWH-15/ normalized-qwh-15-106-5_ext.xml	SAT TT=0.362	SAT TT=1.304 CHECKS=88361 NODES=1089	SAT TT=1.637 CHECKS=148427 NODES=1478	SAT TT=0.564	SAT TT=0.785 CHECKS=533850	SAT TT=1.519 CHECKS=1389770	SAT TT=2.517 ASSIGNMENTS=4	SAT TT=2.64 ASSIGNMENTS=9	SAT TT=2.217 CHECKS=52372 NODES=969	SAT TT=1.744 CHECKS=1007920 NODES=15831	? (TO) TT=1800.04	SAT TT=0.709 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=0.665 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=2.369	SAT TT=2.499	SAT TT=0.362 ASSIGNMENTS=4473 CHECKS=1280560	SAT TT=0.415 ASSIGNMENTS=6466 CHECKS=1321430	SAT TT=4.412	SAT TT=0.378 ASSIGNMENTS=4031 CHECKS=1163710	SAT TT=0.693 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=3.096	SAT TT=1.435 ASSIGNMENTS=1271 CHECKS=391064	SAT TT=1.338	SAT TT=1.78
csp/QWH-15/ normalized-qwh-15-106-6_ext.xml	SAT TT=0.057	SAT TT=1.333 CHECKS=60314 NODES=803	SAT TT=1.319 CHECKS=61997 NODES=437	SAT TT=0.485	SAT TT=0.31 CHECKS=156435	SAT TT=0.213 CHECKS=108153	SAT TT=2.565 ASSIGNMENTS=17	SAT TT=2.38 ASSIGNMENTS=15	SAT TT=1.643 CHECKS=26207 NODES=392	SAT TT=1.499 CHECKS=117565 NODES=1256	SAT TT=1.622 CHECKS=1189680 NODES=1487	SAT TT=0.07 ASSIGNMENTS=57 CHECKS=8104	SAT TT=0.072 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.381	SAT TT=2.55	SAT TT=0.063 ASSIGNMENTS=83 CHECKS=15568	SAT TT=0.223 ASSIGNMENTS=3906 CHECKS=600434	SAT TT=1.897	SAT TT=0.073 ASSIGNMENTS=391 CHECKS=60088	SAT TT=0.057 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.624	SAT TT=3.12 ASSIGNMENTS=15534 CHECKS=3419420	SAT TT=1.343	SAT TT=1.426
csp/QWH-15/ normalized-qwh-15-106-7_ext.xml	SAT TT=0.139	SAT TT=2.566 CHECKS=1279100 NODES=7906	SAT TT=1.802 CHECKS=431497 NODES=3295	SAT TT=0.508	SAT TT=8.292 CHECKS=6505890	SAT TT=0.619 CHECKS=511293	SAT TT=2.866 ASSIGNMENTS=33	SAT TT=2.779 ASSIGNMENTS=27	SAT TT=4.766 CHECKS=200271 NODES=3884	SAT TT=1.81 CHECKS=782172 NODES=12169	SAT TT=1.903 CHECKS=2910910 NODES=3825	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=0.201 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=2.515	SAT TT=2.675	SAT TT=0.139 ASSIGNMENTS=1017 CHECKS=298371	SAT TT=0.166 ASSIGNMENTS=2230 CHECKS=379518	SAT TT=1.631	SAT TT=0.239 ASSIGNMENTS=2564 CHECKS=642280	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=3.168	SAT TT=3.538 ASSIGNMENTS=14925 CHECKS=2825110	SAT TT=1.406	SAT TT=1.685
csp/QWH-15/ normalized-qwh-15-106-8_ext.xml	SAT TT=0.107	SAT TT=1.873 CHECKS=451515 NODES=3199	SAT TT=1.66 CHECKS=325371 NODES=2130	SAT TT=0.309	SAT TT=2.036 CHECKS=1459400	SAT TT=0.671 CHECKS=547997	SAT TT=1.645 ASSIGNMENTS=2	SAT TT=1.565 ASSIGNMENTS=2	SAT TT=3.954 CHECKS=157607 NODES=2629	SAT TT=4.079 CHECKS=5663200 NODES=97312	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=761 CHECKS=266823	SAT TT=0.138 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.539	SAT TT=2.528	SAT TT=0.107 ASSIGNMENTS=562 CHECKS=197270	SAT TT=0.249 ASSIGNMENTS=4030 CHECKS=713042	SAT TT=3.065	SAT TT=0.112 ASSIGNMENTS=800 CHECKS=196145	SAT TT=0.13 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.659	SAT TT=2.398 ASSIGNMENTS=14266 CHECKS=3197610	SAT TT=1.337	SAT TT=1.449
csp/QWH-15/ normalized-qwh-15-106-9_ext.xml	SAT TT=0.058	SAT TT=1.429 CHECKS=182791 NODES=1754	SAT TT=1.42 CHECKS=89898 NODES=878	SAT TT=0.56	SAT TT=0.318 CHECKS=171747	SAT TT=0.241 CHECKS=139235	SAT TT=2.572 ASSIGNMENTS=38	SAT TT=2.367 ASSIGNMENTS=12	SAT TT=1.852 CHECKS=41959 NODES=734	SAT TT=1.545 CHECKS=259056 NODES=3564	SAT TT=1.71 CHECKS=1643710 NODES=2386	SAT TT=0.069 ASSIGNMENTS=54 CHECKS=9570	SAT TT=0.07 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.665	SAT TT=2.825	SAT TT=0.062 ASSIGNMENTS=60 CHECKS=9931	SAT TT=0.177 ASSIGNMENTS=2798 CHECKS=433332	SAT TT=1.814	SAT TT=0.127 ASSIGNMENTS=1050 CHECKS=245841	SAT TT=0.058 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.655	SAT TT=5.304 ASSIGNMENTS=20708 CHECKS=3564490	SAT TT=1.427	SAT TT=1.528
csp/QWH-20/ normalized-qwh-20-166-0_ext.xml	SAT TT=2.236	SAT TT=15.508 CHECKS=11517500 NODES=50375	SAT TT=33.152 CHECKS=26904800 NODES=107063	SAT TT=89.149	SAT TT=243.652 CHECKS=174070000	SAT TT=90.837 CHECKS=60911100	SAT TT=6.908 ASSIGNMENTS=35	SAT TT=7.862 ASSIGNMENTS=72	SAT TT=63.922 CHECKS=1662390 NODES=27289	SAT TT=5.767 CHECKS=3769410 NODES=45728	? (TO) TT=1800.01	SAT TT=16.96 ASSIGNMENTS=529	SAT TT=21.421 ASSIGNMENTS=50375 CHECKS=11517500	SAT TT=3.999	SAT TT=3.936	SAT TT=17.473 ASSIGNMENTS=169822 CHECKS=68856000	SAT TT=4.476 ASSIGNMENTS=42006 CHECKS=17449900	SAT TT=347.054	SAT TT=3.084 ASSIGNMENTS=28377 CHECKS=12348400	SAT TT=17.799 ASSIGNMENTS=170479 CHECKS=69731100	SAT TT=4.25	SAT TT=514.774 ASSIGNMENTS=2591790 CHECKS=545638000	SAT TT=2.236	SAT TT=2.563
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-20/ normalized-qwh-20-166-1_ext.xml	SAT TT=1.716	SAT TT=8.83 CHECKS=5725340 NODES=25633	SAT TT=27.383 CHECKS=22496500 NODES=89605	SAT TT=1.716	SAT TT=150.916 CHECKS=96048600	SAT TT=18.888 CHECKS=8932730	SAT TT=8.995 ASSIGNMENTS=73	SAT TT=8.14 ASSIGNMENTS=10	SAT TT=24.986 CHECKS=618756 NODES=8848	SAT TT=27.535 CHECKS=51015800 NODES=638419	? (TO) TT=1800.03	SAT TT=9.819 ASSIGNMENTS=38	SAT TT=15.634 ASSIGNMENTS=25633 CHECKS=5725340	SAT TT=4.326	SAT TT=4.232	SAT TT=3.883 ASSIGNMENTS=32061 CHECKS=14751700	SAT TT=4.154 ASSIGNMENTS=38437 CHECKS=16557200	SAT TT=174.528	SAT TT=3.513 ASSIGNMENTS=27702 CHECKS=13280200	SAT TT=5.499 ASSIGNMENTS=46586 CHECKS=21202900	SAT TT=4.941	? (TO) TT=1800.11	SAT TT=2.547	SAT TT=2.619
csp/QWH-20/ normalized-qwh-20-166-2_ext.xml	SAT TT=2.183	SAT TT=83.832 CHECKS=70261400 NODES=306910	SAT TT=56.864 CHECKS=46400900 NODES=200566	SAT TT=122.216	? (TO) TT=1800.05	SAT TT=939.622 CHECKS=883736000	SAT TT=8.085 ASSIGNMENTS=17	SAT TT=9.044 ASSIGNMENTS=19	SAT TT=241.482 CHECKS=5534910 NODES=103299	SAT TT=51.245 CHECKS=98857800 NODES=1174550	? (TO) TT=1800	SAT TT=11.542 ASSIGNMENTS=132	SAT TT=97.886 ASSIGNMENTS=306910 CHECKS=70261400	SAT TT=4.186	SAT TT=4.251	SAT TT=40.889 ASSIGNMENTS=425229 CHECKS=164033000	SAT TT=11.921 ASSIGNMENTS=126256 CHECKS=48426500	SAT TT=491.933	SAT TT=11.821 ASSIGNMENTS=116001 CHECKS=46881500	SAT TT=34.723 ASSIGNMENTS=353975 CHECKS=138431000	SAT TT=4.787	? (TO) TT=1800.05	SAT TT=2.183	SAT TT=2.407
csp/QWH-20/ normalized-qwh-20-166-3_ext.xml	SAT TT=2.38	SAT TT=62.008 CHECKS=50666800 NODES=209532	SAT TT=93.066 CHECKS=76454500 NODES=310267	SAT TT=15.367	SAT TT=90.834 CHECKS=60274500	SAT TT=25.778 CHECKS=11638200	SAT TT=7.173 ASSIGNMENTS=19	SAT TT=6.863 ASSIGNMENTS=29	SAT TT=24.426 CHECKS=534323 NODES=8388	SAT TT=5.774 CHECKS=3844450 NODES=47110	? (TO) TT=1800.03	SAT TT=10.404 ASSIGNMENTS=66	SAT TT=64.659 ASSIGNMENTS=209532 CHECKS=50666800	SAT TT=4.412	SAT TT=4.094	SAT TT=8.938 ASSIGNMENTS=78624 CHECKS=34123200	SAT TT=11.541 ASSIGNMENTS=99621 CHECKS=46252900	SAT TT=881.654	SAT TT=3.465 ASSIGNMENTS=28585 CHECKS=13053700	SAT TT=13.355 ASSIGNMENTS=109728 CHECKS=51367400	SAT TT=5.251	? (TO) TT=1800.11	SAT TT=2.38	SAT TT=2.509
csp/QWH-20/ normalized-qwh-20-166-4_ext.xml	SAT TT=1.187	SAT TT=12.823 CHECKS=8778950 NODES=39697	SAT TT=4.969 CHECKS=2796380 NODES=13196	SAT TT=1.526	SAT TT=11.202 CHECKS=6001560	SAT TT=4.64 CHECKS=1976180	SAT TT=6.64 ASSIGNMENTS=16	SAT TT=6.771 ASSIGNMENTS=14	SAT TT=6.86 CHECKS=105061 NODES=1322	SAT TT=5.26 CHECKS=2580650 NODES=31537	? (TO) TT=1800.09	SAT TT=9.195 ASSIGNMENTS=31	SAT TT=19.445 ASSIGNMENTS=39697 CHECKS=8778950	SAT TT=4.032	SAT TT=4.122	SAT TT=2.256 ASSIGNMENTS=20693 CHECKS=8539040	SAT TT=3.589 ASSIGNMENTS=34287 CHECKS=13839200	SAT TT=199.061	SAT TT=1.187 ASSIGNMENTS=9389 CHECKS=4318250	SAT TT=1.814 ASSIGNMENTS=15648 CHECKS=6886240	SAT TT=4.486	SAT TT=169.447 ASSIGNMENTS=653808 CHECKS=191929000	SAT TT=2.085	SAT TT=2.726
csp/QWH-20/ normalized-qwh-20-166-5_ext.xml	SAT TT=1.941	SAT TT=13.167 CHECKS=9460090 NODES=45533	SAT TT=5.874 CHECKS=3123370 NODES=15218	SAT TT=1.941	SAT TT=6.84 CHECKS=3567520	SAT TT=23.014 CHECKS=11522400	SAT TT=8.518 ASSIGNMENTS=208	SAT TT=6.192 ASSIGNMENTS=10	SAT TT=141.922 CHECKS=3499360 NODES=62078	SAT TT=6.608 CHECKS=4091910 NODES=50111	? (TO) TT=1800.09	SAT TT=9.495 ASSIGNMENTS=32	SAT TT=20.402 ASSIGNMENTS=45533 CHECKS=9460090	SAT TT=4.246	SAT TT=4.243	SAT TT=3.746 ASSIGNMENTS=35579 CHECKS=14496900	SAT TT=12.308 ASSIGNMENTS=110498 CHECKS=48128900	SAT TT=114.592	SAT TT=7.746 ASSIGNMENTS=71292 CHECKS=30423800	SAT TT=15.366 ASSIGNMENTS=135868 CHECKS=60617800	SAT TT=4.596	SAT TT=316.2 ASSIGNMENTS=1555780 CHECKS=348153000	SAT TT=1.983	SAT TT=2.179
csp/QWH-20/ normalized-qwh-20-166-6_ext.xml	SAT TT=2.093	SAT TT=678.38 CHECKS=578453000 NODES=2289160	SAT TT=733.98 CHECKS=617480000 NODES=2449220	SAT TT=26.211	SAT TT=630.792 CHECKS=426506000	SAT TT=743.975 CHECKS=686394000	SAT TT=13.455 ASSIGNMENTS=355	SAT TT=7.137 ASSIGNMENTS=35	SAT TT=1023.6 CHECKS=30148200 NODES=484442	SAT TT=19.064 CHECKS=31813800 NODES=396025	? (TO) TT=1800	SAT TT=14.513 ASSIGNMENTS=344	SAT TT=627.073 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4	SAT TT=4.761	SAT TT=72.722 ASSIGNMENTS=647024 CHECKS=282775000	SAT TT=95.031 ASSIGNMENTS=1011610 CHECKS=402841000	SAT TT=780.898	SAT TT=184.517 ASSIGNMENTS=1777640 CHECKS=709264000	SAT TT=75.137 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4.22	? (TO) TT=1800.05	SAT TT=2.093	SAT TT=3.218
csp/QWH-20/ normalized-qwh-20-166-7_ext.xml	SAT TT=0.958	SAT TT=41.942 CHECKS=33707000 NODES=127619	SAT TT=11.904 CHECKS=9003780 NODES=38014	SAT TT=0.958	SAT TT=100.448 CHECKS=72003400	SAT TT=112.313 CHECKS=89976700	SAT TT=8.087 ASSIGNMENTS=51	SAT TT=7.975 ASSIGNMENTS=27	SAT TT=205.782 CHECKS=5035250 NODES=87964	SAT TT=12.327 CHECKS=18455200 NODES=226394	? (TO) TT=1800.1	SAT TT=15.568 ASSIGNMENTS=51	SAT TT=44.722 ASSIGNMENTS=127619 CHECKS=33707000	SAT TT=3.735	SAT TT=4.041	SAT TT=3.465 ASSIGNMENTS=28393 CHECKS=13047700	SAT TT=11.602 ASSIGNMENTS=116825 CHECKS=49517700	SAT TT=441.75	SAT TT=6.603 ASSIGNMENTS=58019 CHECKS=24849900	SAT TT=3.53 ASSIGNMENTS=31841 CHECKS=14313600	SAT TT=4.18	? (TO) TT=1800.04	SAT TT=2.229	SAT TT=2.585
csp/QWH-20/ normalized-qwh-20-166-8_ext.xml	SAT TT=2.007	SAT TT=84.218 CHECKS=71402200 NODES=272925	SAT TT=21.75 CHECKS=16821300 NODES=69120	SAT TT=71.257	SAT TT=896.464 CHECKS=647662000	SAT TT=20.241 CHECKS=10284500	SAT TT=8.278 ASSIGNMENTS=120	SAT TT=6.99 ASSIGNMENTS=39	SAT TT=83.253 CHECKS=2131390 NODES=38238	SAT TT=5.235 CHECKS=2514800 NODES=29043	? (TO) TT=1800.08	SAT TT=10.001 ASSIGNMENTS=70	SAT TT=83.624 ASSIGNMENTS=272925 CHECKS=71402200	SAT TT=3.843	SAT TT=3.811	SAT TT=8.494 ASSIGNMENTS=80871 CHECKS=33500100	SAT TT=7.827 ASSIGNMENTS=80558 CHECKS=33414100	SAT TT=306.823	SAT TT=4.492 ASSIGNMENTS=40807 CHECKS=19010900	SAT TT=8.109 ASSIGNMENTS=77692 CHECKS=31563100	SAT TT=4.437	SAT TT=229.047 ASSIGNMENTS=480934 CHECKS=134917000	SAT TT=2.007	SAT TT=2.519
csp/QWH-20/ normalized-qwh-20-166-9_ext.xml	SAT TT=0.841	SAT TT=21.36 CHECKS=16379600 NODES=73618	SAT TT=11.699 CHECKS=7600770 NODES=35262	SAT TT=0.846	SAT TT=428.237 CHECKS=317784000	SAT TT=2.296 CHECKS=665759	SAT TT=7.477 ASSIGNMENTS=80	SAT TT=6.889 ASSIGNMENTS=30	SAT TT=8.993 CHECKS=175160 NODES=2514	SAT TT=6.216 CHECKS=4654520 NODES=58992	? (TO) TT=1800	SAT TT=10.124 ASSIGNMENTS=96	SAT TT=27.502 ASSIGNMENTS=73618 CHECKS=16379600	SAT TT=3.943	SAT TT=4.088	SAT TT=3.675 ASSIGNMENTS=29011 CHECKS=14404000	SAT TT=0.841 ASSIGNMENTS=8644 CHECKS=2821260	SAT TT=63.026	SAT TT=3.088 ASSIGNMENTS=27411 CHECKS=13017300	SAT TT=2.932 ASSIGNMENTS=24655 CHECKS=12165800	SAT TT=4.431	? (TO) TT=1800.08	SAT TT=2.212	SAT TT=2.494
csp/QWH-25/ normalized-qwh-25-235-0_ext.xml	SAT TT=19.9	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=399.005 ASSIGNMENTS=9494	SAT TT=335.483 ASSIGNMENTS=5457	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.013 ASSIGNMENTS=7890	SAT TT=991.238 ASSIGNMENTS=7890	SAT TT=48.226	SAT TT=22.389	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=32.764	? (TO) TT=1800.12	SAT TT=86.579	SAT TT=19.9
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-25/ normalized-qwh-25-235-1_ext.xml	SAT TT=7.361	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=23.131 ASSIGNMENTS=198	SAT TT=65.014 ASSIGNMENTS=960	? (TO) TT=1800	SAT TT=963.326 CHECKS=1345400000 NODES=13734500	? (TO) TT=1800.05	SAT TT=23.459 ASSIGNMENTS=334	SAT TT=690.394 ASSIGNMENTS=334	SAT TT=8.505	SAT TT=7.361	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=640.229 ASSIGNMENTS=4632240 CHECKS=2618280000	? (TO) TT=1800.06	SAT TT=9.069	? (TO) TT=1800.15	SAT TT=9.755	SAT TT=7.458
csp/QWH-25/ normalized-qwh-25-235-2_ext.xml	SAT TT=5.692	? (TO) TT=1800.14	SAT TT=1532.01 CHECKS=1246070000 NODES=4261460	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=22.389 ASSIGNMENTS=195	SAT TT=27.407 ASSIGNMENTS=206	? (TO) TT=1800.02	SAT TT=140.889 CHECKS=193682000 NODES=1935340	? (TO) TT=1800	SAT TT=124.7 ASSIGNMENTS=2703	SAT TT=772.638 ASSIGNMENTS=2703	SAT TT=9.178	SAT TT=8.742	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=179.871 ASSIGNMENTS=1445520 CHECKS=711821000	? (TO) TT=1800.02	SAT TT=10.874	? (TO) TT=1800.14	SAT TT=5.692	SAT TT=8.045
csp/QWH-25/ normalized-qwh-25-235-3_ext.xml	SAT TT=6.393	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=63.268 ASSIGNMENTS=1043	SAT TT=29.985 ASSIGNMENTS=163	? (TO) TT=1800.09	SAT TT=95.901 CHECKS=131244000 NODES=1347400	? (TO) TT=1800.09	SAT TT=59.641 ASSIGNMENTS=1055	SAT TT=726.237 ASSIGNMENTS=1055	SAT TT=7.524	SAT TT=9.301	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=8.943	? (TO) TT=1800.14	SAT TT=7.895	SAT TT=6.393
csp/QWH-25/ normalized-qwh-25-235-4_ext.xml	SAT TT=5.744	SAT TT=851.102 CHECKS=691923000 NODES=2374620	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=98.695 ASSIGNMENTS=2144	SAT TT=24.8 ASSIGNMENTS=201	? (TO) TT=1800.07	SAT TT=277.508 CHECKS=419937000 NODES=4227880	? (TO) TT=1800.05	SAT TT=199.635 ASSIGNMENTS=4963	SAT TT=845.541 ASSIGNMENTS=4963	SAT TT=14.262	SAT TT=8.012	? (TO) TT=1800.03	SAT TT=54.891 ASSIGNMENTS=407004 CHECKS=226938000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=6.335	? (TO) TT=1800.14	SAT TT=9.52	SAT TT=5.744
csp/QWH-25/ normalized-qwh-25-235-5_ext.xml	SAT TT=2.685	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.613 ASSIGNMENTS=542	SAT TT=20.195 ASSIGNMENTS=87	? (TO) TT=1800.06	SAT TT=984.404 CHECKS=1513140000 NODES=15523500	? (TO) TT=1800.06	SAT TT=97.5 ASSIGNMENTS=1745	SAT TT=757.572 ASSIGNMENTS=1745	SAT TT=7.827	SAT TT=8.491	? (TO) TT=1800.1	SAT TT=826.678 ASSIGNMENTS=6686550 CHECKS=3398580000	? (TO) TT=1800.06	SAT TT=238.706 ASSIGNMENTS=1894360 CHECKS=946654000	? (TO) TT=1800.08	SAT TT=10.604	? (TO) TT=1800.08	SAT TT=2.685	SAT TT=8.27
csp/QWH-25/ normalized-qwh-25-235-6_ext.xml	SAT TT=5.536	SAT TT=416.661 CHECKS=367598000 NODES=1287530	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=26.723 ASSIGNMENTS=267	SAT TT=24.777 ASSIGNMENTS=197	? (TO) TT=1800.01	SAT TT=1118.34 CHECKS=1752430000 NODES=17638400	? (TO) TT=1800.08	SAT TT=63.076 ASSIGNMENTS=1413	SAT TT=466.091 ASSIGNMENTS=1287530 CHECKS=367598000	SAT TT=9.066	SAT TT=9.045	SAT TT=1338.31 ASSIGNMENTS=11559000 CHECKS=1437760000	? (TO) TT=1800.02	SAT TT=1275.86	SAT TT=1610.55 ASSIGNMENTS=13712000 CHECKS=2365100000	? (TO) TT=1800.11	SAT TT=5.74	? (TO) TT=1800.14	SAT TT=5.774	SAT TT=5.536
csp/QWH-25/ normalized-qwh-25-235-7_ext.xml	SAT TT=9.976	? (TO) TT=1800.15	SAT TT=1012.88 CHECKS=891983000 NODES=3159650	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=1078.93 ASSIGNMENTS=28993	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=34.93 CHECKS=34652100 NODES=353146	? (TO) TT=1800.02	SAT TT=94.405 ASSIGNMENTS=2075	SAT TT=736.61 ASSIGNMENTS=2075	SAT TT=16.464	SAT TT=9.976	SAT TT=1439.83 ASSIGNMENTS=12193300 CHECKS=1970930000	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=53.854	? (TO) TT=1800.06	SAT TT=83.951	SAT TT=25.78
csp/QWH-25/ normalized-qwh-25-235-8_ext.xml	SAT TT=6.162	? (TO) TT=1800.16	SAT TT=1328.48 CHECKS=1127200000 NODES=3879170	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=389.248 ASSIGNMENTS=8273	SAT TT=34.871 ASSIGNMENTS=381	? (TO) TT=1800.03	SAT TT=75.15 CHECKS=86619000 NODES=872996	? (TO) TT=1800.04	SAT TT=17.73 ASSIGNMENTS=208	SAT TT=684.913 ASSIGNMENTS=208	SAT TT=7.592	SAT TT=9.335	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=17.327	? (TO) TT=1800.15	SAT TT=6.162	SAT TT=10.321
csp/QWH-25/ normalized-qwh-25-235-9_ext.xml	SAT TT=7.719	SAT TT=1123.08 CHECKS=890204000 NODES=3172820	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=376.323 ASSIGNMENTS=8346	SAT TT=19.661 ASSIGNMENTS=90	? (TO) TT=1800.01	SAT TT=147.261 CHECKS=195806000 NODES=2003980	? (TO) TT=1800.06	SAT TT=374.027 ASSIGNMENTS=8346	SAT TT=1066.64 ASSIGNMENTS=8346	SAT TT=8.724	SAT TT=7.719	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=723.251 ASSIGNMENTS=5604060 CHECKS=2888380000	? (TO) TT=1800.07	SAT TT=23.533	? (TO) TT=1800.13	SAT TT=17.934	SAT TT=8.402

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	152	152	139	117	120	177	174	115	94	175	174	152	152	151	155	114	156	148	152	110	172	152
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	152	152	139	117	120	177	174	115	94	175	174	152	152	151	155	114	156	148	152	110	172	152
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	4	1	7	4	0	0	0	0	0	5	12	45	23	0	33	41	2	1	11	9
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0