CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in extension (2-ARY-EXT)

This page displays the results of the different solvers for each benchmark for category binary constraints in extension (2-ARY-EXT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-13/ normalized-BlackHole-4-13-e-0_ext.xml	UNSAT TT=0.179	UNSAT TT=1.315 CHECKS=59584 NODES=0	UNSAT TT=1.301 CHECKS=59584 NODES=0	UNSAT TT=0.632	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=1.527 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	? (MO) TT=1501.33	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	UNSAT TT=0.179 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.181 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-e-1_ext.xml	UNSAT TT=0.186	UNSAT TT=1.277 CHECKS=59585 NODES=0	UNSAT TT=1.406 CHECKS=59585 NODES=0	UNSAT TT=0.625	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1.833 ASSIGNMENTS=0	UNSAT TT=1.86 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.04	? (MO) TT=1771.6	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.08	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/BH-4-13/ normalized-BlackHole-4-13-e-2_ext.xml	UNSAT TT=0.185	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=1.272 CHECKS=59488 NODES=0	UNSAT TT=0.635	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.551 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.195 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.08	? (MO) TT=1454.74	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.05	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/BH-4-13/ normalized-BlackHole-4-13-e-3_ext.xml	UNSAT TT=0.184	UNSAT TT=1.368 CHECKS=59488 NODES=0	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=0.591	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=1.579 ASSIGNMENTS=0	UNSAT TT=1.722 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.19 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.1	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-m-0_ext.xml	UNSAT TT=0.185	UNSAT TT=1.395 CHECKS=59488 NODES=0	UNSAT TT=1.281 CHECKS=59488 NODES=0	UNSAT TT=1341.56	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.933 ASSIGNMENTS=0	UNSAT TT=1.66 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.08	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/BH-4-13/ normalized-BlackHole-4-13-m-1_ext.xml	UNSAT TT=0.184	UNSAT TT=1.277 CHECKS=59488 NODES=0	UNSAT TT=1.313 CHECKS=59488 NODES=0	UNSAT TT=1339.46	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=1.601 ASSIGNMENTS=0	UNSAT TT=1.568 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.202 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.06	? (MO) TT=1543.57	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.14
csp/BH-4-13/ normalized-BlackHole-4-13-m-2_ext.xml	UNSAT TT=0.186	UNSAT TT=1.393 CHECKS=59489 NODES=0	UNSAT TT=1.271 CHECKS=59489 NODES=0	UNSAT TT=0.63	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=1.638 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.07	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/BH-4-4/ normalized-BlackHole-4-4-e-0_ext.xml	UNSAT TT=0.016	UNSAT TT=0.777 CHECKS=5952 NODES=0	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.102 CHECKS=3152700	UNSAT TT=2.781 CHECKS=2102480	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=1.718 CHECKS=81673 NODES=5880	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.235	UNSAT TT=1.4	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=2.527	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.94	UNSAT TT=420.986 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.057	UNSAT TT=1.311
csp/BH-4-4/ normalized-BlackHole-4-4-e-1_ext.xml	UNSAT TT=0.016	UNSAT TT=0.843 CHECKS=5952 NODES=0	UNSAT TT=0.827 CHECKS=5952 NODES=0	UNSAT TT=0.077	UNSAT TT=5.426 CHECKS=3127470	UNSAT TT=2.546 CHECKS=2112960	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=1.788 CHECKS=79133 NODES=5623	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=1.532	UNSAT TT=1.361	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.537	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.012	UNSAT TT=429.179 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.978	UNSAT TT=1.041
csp/BH-4-4/ normalized-BlackHole-4-4-e-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.829 CHECKS=5952 NODES=0	UNSAT TT=0.073	UNSAT TT=4.623 CHECKS=2635430	UNSAT TT=2.742 CHECKS=2122950	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.574 ASSIGNMENTS=0	UNSAT TT=1.703 CHECKS=80971 NODES=5841	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.275	UNSAT TT=1.33	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=2.542	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.934	UNSAT TT=419.059 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.075	UNSAT TT=1.088
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-4/ normalized-BlackHole-4-4-e-3_ext.xml	UNSAT TT=0.015	UNSAT TT=0.926 CHECKS=5952 NODES=0	UNSAT TT=0.857 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.107 CHECKS=3119390	UNSAT TT=2.793 CHECKS=2122970	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=1.905 CHECKS=80874 NODES=5840	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=1.524	UNSAT TT=1.508	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.472	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.037	UNSAT TT=450.57 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.97	UNSAT TT=1.281
csp/BH-4-4/ normalized-BlackHole-4-4-e-4_ext.xml	UNSAT TT=0.016	UNSAT TT=0.828 CHECKS=5952 NODES=0	UNSAT TT=0.801 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.433 CHECKS=3141050	UNSAT TT=2.79 CHECKS=2122930	UNSAT TT=0.69 ASSIGNMENTS=0	UNSAT TT=0.558 ASSIGNMENTS=0	UNSAT TT=1.715 CHECKS=81605 NODES=5880	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.641	UNSAT TT=1.336	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.505	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.798	UNSAT TT=450.615 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=1.061	UNSAT TT=0.982
csp/BH-4-4/ normalized-BlackHole-4-4-e-5_ext.xml	UNSAT TT=0.016	UNSAT TT=0.795 CHECKS=5952 NODES=0	UNSAT TT=0.778 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.431 CHECKS=3130040	UNSAT TT=2.769 CHECKS=2114300	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	UNSAT TT=1.863 CHECKS=81626 NODES=5880	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.671	UNSAT TT=1.263	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.552	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.778	UNSAT TT=448.105 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.975	UNSAT TT=0.976
csp/BH-4-4/ normalized-BlackHole-4-4-e-6_ext.xml	UNSAT TT=0.016	UNSAT TT=0.823 CHECKS=5952 NODES=0	UNSAT TT=0.79 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.077 CHECKS=3183010	UNSAT TT=2.768 CHECKS=2140010	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	UNSAT TT=1.976 CHECKS=80410 NODES=5889	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.691	UNSAT TT=1.54	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.653	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.085	UNSAT TT=453.138 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.104	UNSAT TT=1.327
csp/BH-4-4/ normalized-BlackHole-4-4-e-7_ext.xml	UNSAT TT=0.017	UNSAT TT=0.833 CHECKS=5952 NODES=0	UNSAT TT=0.788 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.441 CHECKS=3081900	UNSAT TT=2.591 CHECKS=2153790	UNSAT TT=0.591 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=1.828 CHECKS=79569 NODES=5836	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.393	UNSAT TT=1.406	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.536	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.803	UNSAT TT=418.115 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.309	UNSAT TT=1.047
csp/BH-4-4/ normalized-BlackHole-4-4-e-8_ext.xml	UNSAT TT=0.016	UNSAT TT=0.826 CHECKS=5952 NODES=0	UNSAT TT=0.924 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.004 CHECKS=3080150	UNSAT TT=2.767 CHECKS=2122160	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.561 ASSIGNMENTS=0	UNSAT TT=1.707 CHECKS=80400 NODES=5890	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=1.511	UNSAT TT=1.385	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.508	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.066	UNSAT TT=448.144 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.197	UNSAT TT=1.029
csp/BH-4-4/ normalized-BlackHole-4-4-e-9_ext.xml	UNSAT TT=0.016	UNSAT TT=0.817 CHECKS=5952 NODES=0	UNSAT TT=0.86 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.096 CHECKS=3096090	UNSAT TT=2.734 CHECKS=2132950	UNSAT TT=0.565 ASSIGNMENTS=0	UNSAT TT=0.73 ASSIGNMENTS=0	UNSAT TT=1.845 CHECKS=81620 NODES=5882	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.404	UNSAT TT=1.28	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=2.366	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.978	UNSAT TT=437.595 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.978	UNSAT TT=1.025
csp/BH-4-7/ normalized-BlackHole-4-7-e-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.957 CHECKS=10265 NODES=0	UNSAT TT=0.924 CHECKS=10265 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.718 ASSIGNMENTS=0	UNSAT TT=0.749 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.11	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.2	? (TO) TT=1800.02	UNSAT TT=792.95	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-1_ext.xml	UNSAT TT=0.041	UNSAT TT=0.979 CHECKS=10265 NODES=0	UNSAT TT=0.923 CHECKS=10265 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.739 ASSIGNMENTS=0	UNSAT TT=0.723 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=894.724	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-e-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.936 CHECKS=10313 NODES=0	UNSAT TT=1.002 CHECKS=10313 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.736 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1359.03	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-e-3_ext.xml	UNSAT TT=0.042	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=1 CHECKS=10264 NODES=0	UNSAT TT=74.257	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.22	? (TO) TT=1800.06	UNSAT TT=842.823	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-e-4_ext.xml	UNSAT TT=0.045	UNSAT TT=1.094 CHECKS=10312 NODES=0	UNSAT TT=0.91 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.815 ASSIGNMENTS=0	UNSAT TT=0.941 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=797.83	? (TO) TT=1800.09
csp/BH-4-7/ normalized-BlackHole-4-7-e-5_ext.xml	UNSAT TT=0.043	UNSAT TT=0.952 CHECKS=10264 NODES=0	UNSAT TT=0.92 CHECKS=10264 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=0.768 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1190.02	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-6_ext.xml	UNSAT TT=0.043	UNSAT TT=0.992 CHECKS=10264 NODES=0	UNSAT TT=0.971 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.717 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.13	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1571.33	? (TO) TT=1800.08
csp/BH-4-7/ normalized-BlackHole-4-7-e-7_ext.xml	UNSAT TT=0.041	UNSAT TT=0.91 CHECKS=10265 NODES=0	UNSAT TT=0.933 CHECKS=10265 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.943 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.14	? (TO) TT=1800.05	UNSAT TT=820.818	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-8_ext.xml	UNSAT TT=0.04	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.75 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.14	? (TO) TT=1800.03	UNSAT TT=827.602	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-e-9_ext.xml	UNSAT TT=0.041	UNSAT TT=1.004 CHECKS=10312 NODES=0	UNSAT TT=0.912 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.931 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.03	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.19	? (TO) TT=1800.03	UNSAT TT=883.361	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.929 CHECKS=10264 NODES=0	UNSAT TT=0.923 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.71 ASSIGNMENTS=0	UNSAT TT=0.781 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=1692.7	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-1_ext.xml	UNSAT TT=0.042	UNSAT TT=1.081 CHECKS=10264 NODES=0	UNSAT TT=0.925 CHECKS=10264 NODES=0	UNSAT TT=68.847	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.982 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=690.887	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.963 CHECKS=10265 NODES=0	UNSAT TT=1.002 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=0.95 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.17	? (TO) TT=1800.02	UNSAT TT=887.297	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-h-3_ext.xml	UNSAT TT=0.04	UNSAT TT=0.976 CHECKS=10265 NODES=0	UNSAT TT=1.078 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=960.49	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-4_ext.xml	UNSAT TT=0.042	UNSAT TT=0.976 CHECKS=10312 NODES=0	UNSAT TT=0.959 CHECKS=10312 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.708 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=763.982	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-h-5_ext.xml	UNSAT TT=0.045	UNSAT TT=1.003 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.935 ASSIGNMENTS=0	UNSAT TT=0.946 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.1	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.17	? (TO) TT=1800.08	UNSAT TT=996.538	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-6_ext.xml	UNSAT TT=0.041	UNSAT TT=1.065 CHECKS=10313 NODES=0	UNSAT TT=0.913 CHECKS=10313 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.08	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=831.31	? (TO) TT=1800.11
csp/BH-4-7/ normalized-BlackHole-4-7-h-7_ext.xml	UNSAT TT=0.046	UNSAT TT=1.012 CHECKS=10312 NODES=0	UNSAT TT=1.022 CHECKS=10312 NODES=0	UNSAT TT=0.164	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.707 ASSIGNMENTS=0	UNSAT TT=0.952 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.07	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1374.78	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-h-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.982 CHECKS=10313 NODES=0	UNSAT TT=0.918 CHECKS=10313 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.924 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.13	? (TO) TT=1800.05	UNSAT TT=556.01	? (TO) TT=1800.06
csp/BH-4-7/ normalized-BlackHole-4-7-h-9_ext.xml	UNSAT TT=0.043	UNSAT TT=1.108 CHECKS=10264 NODES=0	UNSAT TT=0.914 CHECKS=10264 NODES=0	UNSAT TT=74.22	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.92 ASSIGNMENTS=0	UNSAT TT=0.783 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.19	? (TO) TT=1800.09	UNSAT TT=794.336	? (TO) TT=1800.1
csp/bqwh-15-106/ normalized-bqwh-15-106-24_ext.xml	SAT TT=0.039	SAT TT=1.145 CHECKS=100396 NODES=1144	SAT TT=1.191 CHECKS=109962 NODES=1098	SAT TT=0.234	SAT TT=0.142 CHECKS=128871	SAT TT=0.666 CHECKS=888959	SAT TT=1.102 ASSIGNMENTS=10	SAT TT=1.113 ASSIGNMENTS=11	SAT TT=0.852 CHECKS=22442 NODES=535	SAT TT=0.799 CHECKS=792967 NODES=18806	SAT TT=1.334 CHECKS=4545710 NODES=15610	SAT TT=0.195 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=0.183 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.702	SAT TT=1.416	SAT TT=0.226 ASSIGNMENTS=2460 CHECKS=665843	SAT TT=0.322 ASSIGNMENTS=5654 CHECKS=957091	SAT TT=0.787	SAT TT=0.039 ASSIGNMENTS=316 CHECKS=44265	SAT TT=0.18 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.619	SAT TT=0.875 ASSIGNMENTS=532 CHECKS=71428	SAT TT=1.061	SAT TT=1.026
csp/bqwh-15-106/ normalized-bqwh-15-106-26_ext.xml	SAT TT=0.048	SAT TT=1.179 CHECKS=158828 NODES=1486	SAT TT=1.222 CHECKS=123121 NODES=1168	SAT TT=0.212	SAT TT=0.048 CHECKS=27155	SAT TT=0.048 CHECKS=31076	SAT TT=1.084 ASSIGNMENTS=43	SAT TT=1.138 ASSIGNMENTS=16	SAT TT=0.978 CHECKS=84995 NODES=1514	SAT TT=0.816 CHECKS=840414 NODES=19834	? (TO) TT=1800.05	SAT TT=0.097 ASSIGNMENTS=659 CHECKS=172553	SAT TT=0.09 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.464	SAT TT=1.669	SAT TT=0.063 ASSIGNMENTS=449 CHECKS=110598	SAT TT=0.229 ASSIGNMENTS=4031 CHECKS=608822	SAT TT=0.821	SAT TT=0.146 ASSIGNMENTS=1347 CHECKS=356917	SAT TT=0.083 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.442	SAT TT=0.136 ASSIGNMENTS=521 CHECKS=57840	SAT TT=1.008	SAT TT=1.373
csp/bqwh-15-106/ normalized-bqwh-15-106-28_ext.xml	SAT TT=0.037	SAT TT=1.101 CHECKS=55628 NODES=707	SAT TT=1.076 CHECKS=22366 NODES=0	SAT TT=0.233	SAT TT=0.211 CHECKS=224297	SAT TT=0.078 CHECKS=74568	SAT TT=0.845 ASSIGNMENTS=5	SAT TT=0.916 ASSIGNMENTS=5	SAT TT=0.914 CHECKS=50617 NODES=1173	SAT TT=0.68 CHECKS=124533 NODES=2734	SAT TT=0.79 CHECKS=758569 NODES=3923	SAT TT=0.053 ASSIGNMENTS=209 CHECKS=51803	SAT TT=0.054 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.507	SAT TT=1.717	SAT TT=0.04 ASSIGNMENTS=206 CHECKS=45369	SAT TT=0.233 ASSIGNMENTS=4320 CHECKS=617494	SAT TT=0.605	SAT TT=0.051 ASSIGNMENTS=485 CHECKS=75484	SAT TT=0.037 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.535	SAT TT=0.157 ASSIGNMENTS=1046 CHECKS=135716	SAT TT=1.062	SAT TT=1.068
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106/ normalized-bqwh-15-106-2_ext.xml	SAT TT=0.029	SAT TT=1.401 CHECKS=298547 NODES=2964	SAT TT=1.095 CHECKS=65050 NODES=687	SAT TT=0.134	SAT TT=0.083 CHECKS=68061	SAT TT=0.042 CHECKS=24112	SAT TT=1.028 ASSIGNMENTS=14	SAT TT=1.084 ASSIGNMENTS=20	SAT TT=1.879 CHECKS=234609 NODES=5231	SAT TT=0.785 CHECKS=708557 NODES=16990	SAT TT=0.668 CHECKS=413156 NODES=2022	SAT TT=0.044 ASSIGNMENTS=80 CHECKS=16593	SAT TT=0.042 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.444	SAT TT=1.593	SAT TT=0.029 ASSIGNMENTS=69 CHECKS=15647	SAT TT=0.303 ASSIGNMENTS=5637 CHECKS=890572	SAT TT=0.655	SAT TT=0.051 ASSIGNMENTS=441 CHECKS=76168	SAT TT=0.029 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.714	SAT TT=1.465 ASSIGNMENTS=11890 CHECKS=2074690	SAT TT=1.025	SAT TT=1.054
csp/bqwh-15-106/ normalized-bqwh-15-106-51_ext.xml	SAT TT=0.036	SAT TT=1.106 CHECKS=73534 NODES=876	SAT TT=1.102 CHECKS=54740 NODES=431	SAT TT=0.288	SAT TT=0.171 CHECKS=155758	SAT TT=0.125 CHECKS=125583	SAT TT=1.147 ASSIGNMENTS=9	SAT TT=1.081 ASSIGNMENTS=9	SAT TT=0.665 CHECKS=8118 NODES=219	SAT TT=0.708 CHECKS=225571 NODES=5089	SAT TT=1.004 CHECKS=1551240 NODES=5649	SAT TT=0.067 ASSIGNMENTS=398 CHECKS=94326	SAT TT=0.068 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.468	SAT TT=1.662	SAT TT=0.036 ASSIGNMENTS=140 CHECKS=33205	SAT TT=0.231 ASSIGNMENTS=4413 CHECKS=648137	SAT TT=0.624	SAT TT=0.041 ASSIGNMENTS=346 CHECKS=57116	SAT TT=0.052 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.528	SAT TT=0.059 ASSIGNMENTS=227 CHECKS=21228	SAT TT=1.242	SAT TT=1.067
csp/bqwh-15-106/ normalized-bqwh-15-106-52_ext.xml	SAT TT=0.03	SAT TT=1.411 CHECKS=319800 NODES=3226	SAT TT=1.074 CHECKS=35172 NODES=392	SAT TT=0.243	SAT TT=0.07 CHECKS=50343	SAT TT=0.146 CHECKS=181531	SAT TT=1.044 ASSIGNMENTS=11	SAT TT=1.059 ASSIGNMENTS=7	SAT TT=0.925 CHECKS=53239 NODES=1180	SAT TT=1.018 CHECKS=973881 NODES=22892	SAT TT=0.64 CHECKS=247236 NODES=1304	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=7318	SAT TT=0.036 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.599	SAT TT=1.689	SAT TT=0.03 ASSIGNMENTS=70 CHECKS=17163	SAT TT=0.306 ASSIGNMENTS=4963 CHECKS=841076	SAT TT=0.614	SAT TT=0.109 ASSIGNMENTS=1109 CHECKS=266851	SAT TT=0.03 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.66	SAT TT=0.098 ASSIGNMENTS=796 CHECKS=77988	SAT TT=1.149	SAT TT=1.022
csp/bqwh-15-106/ normalized-bqwh-15-106-7_ext.xml	SAT TT=0.049	SAT TT=1.37 CHECKS=251056 NODES=2553	SAT TT=1.211 CHECKS=78254 NODES=855	SAT TT=0.185	SAT TT=0.488 CHECKS=518036	SAT TT=0.5 CHECKS=667494	SAT TT=1.079 ASSIGNMENTS=48	SAT TT=1.311 ASSIGNMENTS=8	SAT TT=0.985 CHECKS=75899 NODES=1793	SAT TT=1.147 CHECKS=1828330 NODES=43827	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=372 CHECKS=85935	SAT TT=0.066 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.436	SAT TT=1.73	SAT TT=0.049 ASSIGNMENTS=336 CHECKS=69647	SAT TT=0.4 ASSIGNMENTS=6446 CHECKS=1181050	SAT TT=0.685	SAT TT=0.142 ASSIGNMENTS=1752 CHECKS=354930	SAT TT=0.053 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.685	SAT TT=0.211 ASSIGNMENTS=830 CHECKS=93256	SAT TT=1.073	SAT TT=1.068
csp/bqwh-15-106/ normalized-bqwh-15-106-81_ext.xml	SAT TT=0.038	SAT TT=1.228 CHECKS=135966 NODES=1415	SAT TT=1.096 CHECKS=45539 NODES=433	SAT TT=0.202	SAT TT=0.669 CHECKS=765030	SAT TT=0.103 CHECKS=93482	SAT TT=1.164 ASSIGNMENTS=5	SAT TT=1.121 ASSIGNMENTS=7	SAT TT=1.304 CHECKS=124758 NODES=2649	SAT TT=0.683 CHECKS=138637 NODES=3093	SAT TT=0.789 CHECKS=857106 NODES=3798	SAT TT=0.109 ASSIGNMENTS=917 CHECKS=212840	SAT TT=0.102 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.799	SAT TT=1.551	SAT TT=0.038 ASSIGNMENTS=175 CHECKS=37852	SAT TT=0.322 ASSIGNMENTS=5296 CHECKS=900062	SAT TT=1.08	SAT TT=0.071 ASSIGNMENTS=730 CHECKS=152727	SAT TT=0.09 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.662	SAT TT=0.978 ASSIGNMENTS=4431 CHECKS=812661	SAT TT=1.181	SAT TT=1.077
csp/bqwh-15-106/ normalized-bqwh-15-106-85_ext.xml	SAT TT=0.065	SAT TT=1.043 CHECKS=21842 NODES=330	SAT TT=1.012 CHECKS=19434 NODES=227	SAT TT=0.468	SAT TT=0.479 CHECKS=518289	SAT TT=0.185 CHECKS=206141	SAT TT=1.068 ASSIGNMENTS=2	SAT TT=1.101 ASSIGNMENTS=8	SAT TT=1.478 CHECKS=135956 NODES=2913	SAT TT=0.684 CHECKS=155310 NODES=3528	? (TO) TT=1800.04	SAT TT=0.091 ASSIGNMENTS=702 CHECKS=167198	SAT TT=0.095 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.451	SAT TT=1.535	SAT TT=0.065 ASSIGNMENTS=531 CHECKS=116375	SAT TT=0.271 ASSIGNMENTS=4244 CHECKS=723496	SAT TT=0.636	SAT TT=0.107 ASSIGNMENTS=992 CHECKS=256985	SAT TT=0.077 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.846	SAT TT=0.508 ASSIGNMENTS=1470 CHECKS=253802	SAT TT=1.053	SAT TT=1.267
csp/bqwh-15-106/ normalized-bqwh-15-106-97_ext.xml	SAT TT=0.051	SAT TT=1.184 CHECKS=99563 NODES=1227	SAT TT=1.224 CHECKS=45180 NODES=526	SAT TT=0.154	SAT TT=0.175 CHECKS=169337	SAT TT=0.158 CHECKS=179270	SAT TT=1.033 ASSIGNMENTS=8	SAT TT=1.061 ASSIGNMENTS=6	SAT TT=0.657 CHECKS=13421 NODES=335	SAT TT=0.854 CHECKS=363920 NODES=8658	? (TO) TT=1800.07	SAT TT=0.081 ASSIGNMENTS=500 CHECKS=124762	SAT TT=0.078 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.693	SAT TT=1.549	SAT TT=0.051 ASSIGNMENTS=332 CHECKS=73138	SAT TT=0.21 ASSIGNMENTS=4065 CHECKS=601033	SAT TT=0.655	SAT TT=0.088 ASSIGNMENTS=905 CHECKS=175586	SAT TT=0.063 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.598	SAT TT=0.094 ASSIGNMENTS=553 CHECKS=65832	SAT TT=1.022	SAT TT=1.048
csp/bqwh-18-141/ normalized-bqwh-18-141-11_ext.xml	SAT TT=0.054	SAT TT=1.506 CHECKS=284208 NODES=2838	SAT TT=1.138 CHECKS=29756 NODES=316	SAT TT=0.173	SAT TT=0.138 CHECKS=115672	SAT TT=0.062 CHECKS=36064	SAT TT=1.265 ASSIGNMENTS=28	SAT TT=1.337 ASSIGNMENTS=23	SAT TT=2.269 CHECKS=239529 NODES=4254	SAT TT=1.183 CHECKS=1116660 NODES=22495	SAT TT=0.871 CHECKS=376575 NODES=1723	SAT TT=0.071 ASSIGNMENTS=230 CHECKS=77161	SAT TT=0.072 ASSIGNMENTS=230 CHECKS=77161	SAT TT=1.929	SAT TT=1.81	SAT TT=0.054 ASSIGNMENTS=195 CHECKS=57662	SAT TT=0.334 ASSIGNMENTS=4912 CHECKS=845070	SAT TT=1.11	SAT TT=0.092 ASSIGNMENTS=733 CHECKS=156330	SAT TT=0.059 ASSIGNMENTS=230 CHECKS=77161	SAT TT=2.26	SAT TT=0.259 ASSIGNMENTS=1391 CHECKS=223636	SAT TT=1.189	SAT TT=1.477
csp/bqwh-18-141/ normalized-bqwh-18-141-19_ext.xml	SAT TT=0.223	SAT TT=2.523 CHECKS=1408250 NODES=10026	SAT TT=1.568 CHECKS=357886 NODES=3075	SAT TT=0.389	SAT TT=1.739 CHECKS=1804600	SAT TT=0.241 CHECKS=241010	SAT TT=1.369 ASSIGNMENTS=7	SAT TT=1.464 ASSIGNMENTS=6	SAT TT=1.215 CHECKS=90831 NODES=1502	SAT TT=0.905 CHECKS=482275 NODES=9192	? (TO) TT=1800.09	SAT TT=0.247 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=0.25 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.765	SAT TT=1.769	SAT TT=0.343 ASSIGNMENTS=3253 CHECKS=1004950	SAT TT=0.408 ASSIGNMENTS=5494 CHECKS=1321650	SAT TT=1.26	SAT TT=0.223 ASSIGNMENTS=1674 CHECKS=623176	SAT TT=0.232 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.91	SAT TT=0.846 ASSIGNMENTS=1785 CHECKS=384816	SAT TT=1.132	SAT TT=1.615
csp/bqwh-18-141/ normalized-bqwh-18-141-21_ext.xml	SAT TT=0.046	SAT TT=1.565 CHECKS=448647 NODES=4069	SAT TT=2.257 CHECKS=1073330 NODES=8263	SAT TT=0.182	SAT TT=0.086 CHECKS=50960	SAT TT=0.046 CHECKS=14102	SAT TT=1.37 ASSIGNMENTS=4	SAT TT=1.558 ASSIGNMENTS=6	SAT TT=0.916 CHECKS=25933 NODES=575	SAT TT=1.032 CHECKS=1208490 NODES=24522	SAT TT=1.132 CHECKS=2215980 NODES=8030	SAT TT=0.443 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=0.444 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=1.754	SAT TT=1.678	SAT TT=0.414 ASSIGNMENTS=3871 CHECKS=1147500	SAT TT=0.299 ASSIGNMENTS=4678 CHECKS=786868	SAT TT=1.314	SAT TT=0.219 ASSIGNMENTS=1947 CHECKS=546992	SAT TT=0.42 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=2.314	SAT TT=2.064 ASSIGNMENTS=8440 CHECKS=2015210	SAT TT=1.376	SAT TT=1.409
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141/ normalized-bqwh-18-141-3_ext.xml	SAT TT=0.258	SAT TT=16.573 CHECKS=16551100 NODES=129906	SAT TT=13.396 CHECKS=13254000 NODES=107724	SAT TT=2.999	SAT TT=2.862 CHECKS=3074660	SAT TT=0.258 CHECKS=280755	SAT TT=1.504 ASSIGNMENTS=71	SAT TT=1.592 ASSIGNMENTS=69	SAT TT=3.039 CHECKS=351226 NODES=6716	SAT TT=1.718 CHECKS=3412370 NODES=68716	? (TO) TT=1800.06	SAT TT=0.319 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=0.317 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=1.882	SAT TT=1.859	SAT TT=0.747 ASSIGNMENTS=7458 CHECKS=2197000	SAT TT=0.406 ASSIGNMENTS=6142 CHECKS=1143690	SAT TT=1.705	SAT TT=6.23 ASSIGNMENTS=63495 CHECKS=19093000	SAT TT=0.305 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=2.096	SAT TT=1.936 ASSIGNMENTS=9626 CHECKS=1770000	SAT TT=1.451	SAT TT=1.43
csp/bqwh-18-141/ normalized-bqwh-18-141-42_ext.xml	SAT TT=0.243	SAT TT=7.257 CHECKS=6569900 NODES=44702	SAT TT=6.586 CHECKS=5771170 NODES=40818	SAT TT=2.277	SAT TT=2.144 CHECKS=2304000	SAT TT=0.552 CHECKS=611698	SAT TT=1.616 ASSIGNMENTS=73	SAT TT=1.759 ASSIGNMENTS=85	SAT TT=8.51 CHECKS=1425510 NODES=24447	SAT TT=5.161 CHECKS=17067300 NODES=348295	? (TO) TT=1800.02	SAT TT=0.288 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=0.289 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=1.75	SAT TT=1.862	SAT TT=0.243 ASSIGNMENTS=1947 CHECKS=634476	SAT TT=1.427 ASSIGNMENTS=15919 CHECKS=4122020	SAT TT=5.59	SAT TT=0.427 ASSIGNMENTS=3876 CHECKS=1142500	SAT TT=0.272 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=2.585	SAT TT=2.47 ASSIGNMENTS=275 CHECKS=43049	SAT TT=1.468	SAT TT=1.165
csp/bqwh-18-141/ normalized-bqwh-18-141-72_ext.xml	SAT TT=0.106	SAT TT=2.14 CHECKS=1143180 NODES=8627	SAT TT=1.37 CHECKS=224404 NODES=1812	SAT TT=0.334	SAT TT=0.303 CHECKS=330761	SAT TT=0.42 CHECKS=469573	SAT TT=1.449 ASSIGNMENTS=8	SAT TT=1.344 ASSIGNMENTS=7	SAT TT=1.022 CHECKS=45793 NODES=880	SAT TT=0.739 CHECKS=146737 NODES=2993	? (TO) TT=1800.06	SAT TT=0.334 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=0.311 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=1.782	SAT TT=1.693	SAT TT=0.184 ASSIGNMENTS=1486 CHECKS=458969	SAT TT=0.34 ASSIGNMENTS=5100 CHECKS=976793	SAT TT=1.088	SAT TT=0.106 ASSIGNMENTS=779 CHECKS=213187	SAT TT=0.319 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=2.357	SAT TT=0.523 ASSIGNMENTS=2242 CHECKS=537472	SAT TT=1.246	SAT TT=1.266
csp/bqwh-18-141/ normalized-bqwh-18-141-73_ext.xml	SAT TT=0.098	SAT TT=1.981 CHECKS=739890 NODES=6134	SAT TT=2.168 CHECKS=881477 NODES=6902	SAT TT=0.999	SAT TT=0.429 CHECKS=425415	SAT TT=0.098 CHECKS=75655	SAT TT=1.388 ASSIGNMENTS=58	SAT TT=1.435 ASSIGNMENTS=52	SAT TT=9.209 CHECKS=1288590 NODES=25863	SAT TT=1.214 CHECKS=1145820 NODES=22455	? (TO) TT=1800.07	SAT TT=8.28 ASSIGNMENTS=58	SAT TT=9.242 ASSIGNMENTS=58	SAT TT=1.945	SAT TT=1.851	SAT TT=0.668 ASSIGNMENTS=5872 CHECKS=1952910	SAT TT=2.723 ASSIGNMENTS=28945 CHECKS=8429730	SAT TT=25.672	SAT TT=2.064 ASSIGNMENTS=21270 CHECKS=6577230	SAT TT=2.887 ASSIGNMENTS=34143 CHECKS=9395700	SAT TT=2.431	SAT TT=0.839 ASSIGNMENTS=5161 CHECKS=851609	SAT TT=1.18	SAT TT=1.154
csp/bqwh-18-141/ normalized-bqwh-18-141-78_ext.xml	SAT TT=0.129	SAT TT=1.545 CHECKS=361033 NODES=3455	SAT TT=1.494 CHECKS=224455 NODES=1778	SAT TT=0.523	SAT TT=0.359 CHECKS=397093	SAT TT=0.172 CHECKS=180165	SAT TT=1.182 ASSIGNMENTS=4	SAT TT=1.212 ASSIGNMENTS=3	SAT TT=0.96 CHECKS=43239 NODES=861	SAT TT=1.471 CHECKS=2511080 NODES=53055	? (TO) TT=1800.06	SAT TT=0.179 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=0.181 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=1.919	SAT TT=1.753	SAT TT=0.138 ASSIGNMENTS=1137 CHECKS=359250	SAT TT=0.43 ASSIGNMENTS=5476 CHECKS=1151360	SAT TT=1.035	SAT TT=0.143 ASSIGNMENTS=1329 CHECKS=346124	SAT TT=0.168 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=2.002	SAT TT=0.129 ASSIGNMENTS=551 CHECKS=56083	SAT TT=1.38	SAT TT=1.188
csp/bqwh-18-141/ normalized-bqwh-18-141-83_ext.xml	SAT TT=0.042	SAT TT=2.013 CHECKS=910266 NODES=7763	SAT TT=2.071 CHECKS=880500 NODES=7704	SAT TT=0.696	SAT TT=0.323 CHECKS=342669	SAT TT=0.63 CHECKS=832846	SAT TT=1.503 ASSIGNMENTS=5	SAT TT=1.291 ASSIGNMENTS=10	SAT TT=0.961 CHECKS=36427 NODES=766	SAT TT=0.832 CHECKS=338050 NODES=7083	SAT TT=0.873 CHECKS=741497 NODES=2607	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=35089	SAT TT=0.057 ASSIGNMENTS=116 CHECKS=35089	SAT TT=1.749	SAT TT=1.758	SAT TT=0.046 ASSIGNMENTS=128 CHECKS=40030	SAT TT=0.293 ASSIGNMENTS=4745 CHECKS=742269	SAT TT=0.779	SAT TT=0.094 ASSIGNMENTS=819 CHECKS=178013	SAT TT=0.042 ASSIGNMENTS=116 CHECKS=35089	SAT TT=2.061	SAT TT=0.1 ASSIGNMENTS=513 CHECKS=57747	SAT TT=1.546	SAT TT=1.363
csp/bqwh-18-141/ normalized-bqwh-18-141-8_ext.xml	SAT TT=0.056	SAT TT=1.156 CHECKS=72926 NODES=868	SAT TT=1.28 CHECKS=61774 NODES=685	SAT TT=0.189	SAT TT=0.104 CHECKS=69526	SAT TT=0.056 CHECKS=21517	SAT TT=1.496 ASSIGNMENTS=90	SAT TT=1.382 ASSIGNMENTS=12	SAT TT=0.917 CHECKS=26245 NODES=602	SAT TT=1.355 CHECKS=2566000 NODES=49976	? (TO) TT=1800.01	SAT TT=0.086 ASSIGNMENTS=473 CHECKS=120522	SAT TT=0.09 ASSIGNMENTS=473 CHECKS=120522	SAT TT=1.94	SAT TT=1.831	SAT TT=0.339 ASSIGNMENTS=2985 CHECKS=915924	SAT TT=0.362 ASSIGNMENTS=5209 CHECKS=969287	SAT TT=0.83	SAT TT=0.09 ASSIGNMENTS=673 CHECKS=158725	SAT TT=0.078 ASSIGNMENTS=473 CHECKS=120522	SAT TT=2.395	SAT TT=0.138 ASSIGNMENTS=797 CHECKS=87718	SAT TT=1.371	SAT TT=1.178
csp/coloring/ normalized-dsjc-125-1-4-ext.xml	UNSAT TT=0.025	UNSAT TT=1.029 CHECKS=44992 NODES=217	UNSAT TT=0.963 CHECKS=39816 NODES=142	UNSAT TT=0.125	UNSAT TT=0.082 CHECKS=39193	UNSAT TT=0.041 CHECKS=6524	UNSAT TT=0.64 ASSIGNMENTS=0	UNSAT TT=0.631 ASSIGNMENTS=0	UNSAT TT=0.602 CHECKS=6527 NODES=97	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.826	UNSAT TT=0.862	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=14815	UNSAT TT=0.183 ASSIGNMENTS=4192 CHECKS=1013730	UNSAT TT=0.58	UNSAT TT=0.036 ASSIGNMENTS=390 CHECKS=90966	UNSAT TT=0.026 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=1.345	UNSAT TT=0.053 ASSIGNMENTS=50 CHECKS=37896	UNSAT TT=0.921	UNSAT TT=1.269
csp/coloring/ normalized-dsjc-125-1-5-ext.xml	SAT TT=0.045	SAT TT=1.178 CHECKS=247766 NODES=1812	SAT TT=1.125 CHECKS=159392 NODES=1149	SAT TT=0.13	SAT TT=0.12 CHECKS=61069	SAT TT=0.048 CHECKS=16747	SAT TT=1.014 ASSIGNMENTS=62	SAT TT=0.839 ASSIGNMENTS=85	SAT TT=1.005 CHECKS=51367 NODES=800	SAT TT=0.906 CHECKS=1480500 NODES=23086	SAT TT=0.853 CHECKS=1565040 NODES=4099	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.557	SAT TT=1.643	SAT TT=0.077 ASSIGNMENTS=746 CHECKS=296500	SAT TT=0.181 ASSIGNMENTS=6405 CHECKS=762341	SAT TT=5.737	SAT TT=0.045 ASSIGNMENTS=647 CHECKS=117453	SAT TT=0.064 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.503	SAT TT=0.208 ASSIGNMENTS=449 CHECKS=89541	SAT TT=0.962	SAT TT=1.03
csp/coloring/ normalized-geom-30a-3-ext.xml	UNSAT TT=0.007	UNSAT TT=0.807 CHECKS=6 NODES=0	UNSAT TT=0.701 CHECKS=6 NODES=0	UNSAT TT=0.032	UNSAT TT=0.01 CHECKS=740	UNSAT TT=0.009 CHECKS=398	UNSAT TT=0.387 ASSIGNMENTS=0	UNSAT TT=0.373 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=288 NODES=16	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.475	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.323	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.758	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=870	UNSAT TT=0.559	UNSAT TT=0.598
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-geom-30a-4-ext.xml	UNSAT TT=0.006	UNSAT TT=0.686 CHECKS=8 NODES=0	UNSAT TT=0.68 CHECKS=8 NODES=0	UNSAT TT=0.033	UNSAT TT=0.017 CHECKS=5418	UNSAT TT=0.011 CHECKS=821	UNSAT TT=0.362 ASSIGNMENTS=0	UNSAT TT=0.395 ASSIGNMENTS=0	UNSAT TT=0.341 CHECKS=723 NODES=41	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.651	UNSAT TT=0.677	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.726	UNSAT TT=0.013 ASSIGNMENTS=28 CHECKS=4094	UNSAT TT=0.63	UNSAT TT=0.544
csp/coloring/ normalized-geom-30a-5-ext.xml	UNSAT TT=0.007	UNSAT TT=0.745 CHECKS=10 NODES=0	UNSAT TT=0.703 CHECKS=10 NODES=0	UNSAT TT=0.034	UNSAT TT=0.035 CHECKS=19850	UNSAT TT=0.013 CHECKS=3378	UNSAT TT=0.388 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=2141 NODES=168	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.567	UNSAT TT=0.694	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.313	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.944	UNSAT TT=0.02 ASSIGNMENTS=145 CHECKS=18345	UNSAT TT=0.583	UNSAT TT=0.613
csp/coloring/ normalized-geom-30a-6-ext.xml	SAT TT=0.006	SAT TT=0.737 CHECKS=533 NODES=30	SAT TT=0.719 CHECKS=523 NODES=0	SAT TT=0.032	SAT TT=0.015 CHECKS=2193	SAT TT=0.012 CHECKS=502	SAT TT=0.444 ASSIGNMENTS=24	SAT TT=0.453 ASSIGNMENTS=25	SAT TT=0.357 CHECKS=374 NODES=30	SAT TT=0.335 CHECKS=2448 NODES=10	SAT TT=0.339 CHECKS=3237 NODES=11	SAT TT=0.02 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.021 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.918	SAT TT=0.882	SAT TT=0.006 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=443	SAT TT=0.302	SAT TT=0.009 ASSIGNMENTS=26 CHECKS=451	SAT TT=0.008 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.744	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1742	SAT TT=0.592	SAT TT=0.566
csp/coloring/ normalized-geom-40-2-ext.xml	UNSAT TT=0.006	UNSAT TT=0.679 CHECKS=0 NODES=0	UNSAT TT=0.688 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.372 ASSIGNMENTS=0	UNSAT TT=0.436 ASSIGNMENTS=0	UNSAT TT=0.337 CHECKS=30 NODES=1	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.484	UNSAT TT=0.477	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.299	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.718	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=26	UNSAT TT=0.564	UNSAT TT=0.545
csp/coloring/ normalized-geom-40-3-ext.xml	UNSAT TT=0.006	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.676 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.012 CHECKS=256	UNSAT TT=0.009 CHECKS=155	UNSAT TT=0.384 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.332 CHECKS=117 NODES=7	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.512	UNSAT TT=0.642	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.289	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.711	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=383	UNSAT TT=0.561	UNSAT TT=0.581
csp/coloring/ normalized-geom-40-4-ext.xml	UNSAT TT=0.008	UNSAT TT=0.693 CHECKS=8 NODES=0	UNSAT TT=0.778 CHECKS=8 NODES=0	UNSAT TT=0.035	UNSAT TT=0.012 CHECKS=311	UNSAT TT=0.009 CHECKS=200	UNSAT TT=0.367 ASSIGNMENTS=0	UNSAT TT=0.411 ASSIGNMENTS=0	UNSAT TT=0.35 CHECKS=431 NODES=46	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.526	UNSAT TT=0.678	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.308	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.72	UNSAT TT=0.012 ASSIGNMENTS=28 CHECKS=1635	UNSAT TT=0.599	UNSAT TT=0.607
csp/coloring/ normalized-geom-40-5-ext.xml	UNSAT TT=0.005	UNSAT TT=0.746 CHECKS=10 NODES=0	UNSAT TT=0.676 CHECKS=10 NODES=0	UNSAT TT=0.032	UNSAT TT=0.013 CHECKS=2625	UNSAT TT=0.012 CHECKS=480	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.371 ASSIGNMENTS=0	UNSAT TT=0.364 CHECKS=1122 NODES=169	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.755	UNSAT TT=0.532	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.313	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.819	UNSAT TT=0.015 ASSIGNMENTS=149 CHECKS=5135	UNSAT TT=0.576	UNSAT TT=0.614
csp/coloring/ normalized-geom-40-6-ext.xml	SAT TT=0.006	SAT TT=0.712 CHECKS=504 NODES=40	SAT TT=0.73 CHECKS=518 NODES=0	SAT TT=0.034	SAT TT=0.022 CHECKS=6041	SAT TT=0.012 CHECKS=1072	SAT TT=0.546 ASSIGNMENTS=35	SAT TT=0.476 ASSIGNMENTS=35	SAT TT=0.34 CHECKS=386 NODES=40	SAT TT=0.341 CHECKS=2340 NODES=11	SAT TT=0.322 CHECKS=2820 NODES=10	SAT TT=0.019 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.02 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.872	SAT TT=1.053	SAT TT=0.006 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.009 ASSIGNMENTS=39 CHECKS=333	SAT TT=0.339	SAT TT=0.008 ASSIGNMENTS=37 CHECKS=336	SAT TT=0.008 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.726	SAT TT=0.011 ASSIGNMENTS=40 CHECKS=1358	SAT TT=0.545	SAT TT=0.613
csp/coloring/ normalized-le-450-5a-2-ext.xml	UNSAT TT=0.149	UNSAT TT=1.577 CHECKS=0 NODES=0	UNSAT TT=1.556 CHECKS=0 NODES=0	UNSAT TT=0.586	UNSAT TT=0.205 CHECKS=5770	UNSAT TT=0.188 CHECKS=5778	UNSAT TT=1.237 ASSIGNMENTS=0	UNSAT TT=1.257 ASSIGNMENTS=0	UNSAT TT=6.052 CHECKS=134 NODES=1	? (TO) TT=1800.08	Wrong Cert. TT=1714 CHECKS=6999240000 NODES=641436	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.162 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.369	UNSAT TT=2.115	UNSAT TT=0.149 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.171	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.722	UNSAT TT=0.528 ASSIGNMENTS=1 CHECKS=198	UNSAT TT=1.577	UNSAT TT=1.67
csp/coloring/ normalized-le-450-5a-3-ext.xml	UNSAT TT=0.154	UNSAT TT=1.378 CHECKS=0 NODES=0	UNSAT TT=1.452 CHECKS=0 NODES=0	UNSAT TT=0.664	UNSAT TT=0.729 CHECKS=300996	UNSAT TT=0.237 CHECKS=18117	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=1.216 ASSIGNMENTS=0	UNSAT TT=5.803 CHECKS=1855 NODES=16	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.286	UNSAT TT=1.863	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.736	UNSAT TT=0.155 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.684	UNSAT TT=0.53 ASSIGNMENTS=6 CHECKS=14253	UNSAT TT=1.656	UNSAT TT=1.789
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-le-450-5a-4-ext.xml	UNSAT TT=0.15	UNSAT TT=1.553 CHECKS=0 NODES=0	UNSAT TT=1.528 CHECKS=0 NODES=0	UNSAT TT=0.624	UNSAT TT=1.018 CHECKS=352263	UNSAT TT=0.431 CHECKS=31362	UNSAT TT=1.102 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=6.672 CHECKS=12651 NODES=111	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.173 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.168 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.287	UNSAT TT=2.148	UNSAT TT=0.166 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.167 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.608	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.165 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=3.686	UNSAT TT=0.631 ASSIGNMENTS=115 CHECKS=291880	UNSAT TT=1.887	UNSAT TT=2.085
csp/coloring/ normalized-le-450-5a-5-ext.xml	SAT TT=0.553	SAT TT=1.771 CHECKS=110856 NODES=595	SAT TT=2.033 CHECKS=184794 NODES=581	SAT TT=1.105	SAT TT=6.867 CHECKS=2289410	SAT TT=3.262 CHECKS=474073	SAT TT=5.541 ASSIGNMENTS=13	SAT TT=5.664 ASSIGNMENTS=18	SAT TT=8.744 CHECKS=190382 NODES=1194	? (TO) TT=1800.01	SAT TT=26.852 CHECKS=116016000 NODES=45720	SAT TT=0.587 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=0.602 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.176	SAT TT=4.24	SAT TT=0.714 ASSIGNMENTS=540 CHECKS=2813410	SAT TT=4.285 ASSIGNMENTS=4474 CHECKS=18796100	SAT TT=24.058	SAT TT=0.595 ASSIGNMENTS=1778 CHECKS=1926740	SAT TT=0.553 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.518	SAT TT=1.792 ASSIGNMENTS=1035 CHECKS=1236950	SAT TT=2.15	SAT TT=2.306
csp/coloring/ normalized-myciel-5g-3-ext.xml	UNSAT TT=0.012	UNSAT TT=0.776 CHECKS=2004 NODES=8	UNSAT TT=0.796 CHECKS=4330 NODES=0	UNSAT TT=0.05	UNSAT TT=0.025 CHECKS=8502	UNSAT TT=0.019 CHECKS=3832	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.485 ASSIGNMENTS=0	UNSAT TT=0.419 CHECKS=3076 NODES=38	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.643	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4640	UNSAT TT=0.018 ASSIGNMENTS=175 CHECKS=27510	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=99 CHECKS=13796	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.892	UNSAT TT=0.019 ASSIGNMENTS=26 CHECKS=10566	UNSAT TT=0.76	UNSAT TT=0.734
csp/coloring/ normalized-myciel-5g-4-ext.xml	UNSAT TT=0.049	UNSAT TT=0.925 CHECKS=53921 NODES=442	UNSAT TT=0.934 CHECKS=64809 NODES=527	UNSAT TT=0.104	UNSAT TT=0.125 CHECKS=98352	UNSAT TT=0.065 CHECKS=66999	UNSAT TT=0.579 ASSIGNMENTS=122	UNSAT TT=0.564 ASSIGNMENTS=122	UNSAT TT=0.773 CHECKS=90367 NODES=2704	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=0.063 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.064 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.712	UNSAT TT=0.728	UNSAT TT=0.052 ASSIGNMENTS=1295 CHECKS=235294	UNSAT TT=0.122 ASSIGNMENTS=5278 CHECKS=544267	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=1259 CHECKS=207545	UNSAT TT=0.054 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=2.095	UNSAT TT=0.577 ASSIGNMENTS=4317 CHECKS=879438	UNSAT TT=0.759	UNSAT TT=0.81
csp/coloring/ normalized-myciel-5g-5-ext.xml	UNSAT TT=22.193	UNSAT TT=27.413 CHECKS=34788100 NODES=397254	UNSAT TT=30.607 CHECKS=39853800 NODES=458975	UNSAT TT=666.797	UNSAT TT=110.814 CHECKS=116359000	UNSAT TT=89.79 CHECKS=125270000	UNSAT TT=47.285 ASSIGNMENTS=574723	UNSAT TT=51.432 ASSIGNMENTS=574723	UNSAT TT=422.62 CHECKS=96524000 NODES=4328700	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=49.341 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=49.679 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=181.241	UNSAT TT=211.144	UNSAT TT=39.629 ASSIGNMENTS=2237490 CHECKS=197792000	UNSAT TT=37.626 ASSIGNMENTS=1982710 CHECKS=176954000	UNSAT TT=346.871	UNSAT TT=52.163 ASSIGNMENTS=2631860 CHECKS=235108000	UNSAT TT=40.565 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=1634.05	UNSAT TT=1076.15 ASSIGNMENTS=14289000 CHECKS=1449620000	UNSAT TT=22.193	UNSAT TT=163.314
csp/coloring/ normalized-myciel-5g-6-ext.xml	SAT TT=0.011	SAT TT=0.847 CHECKS=1356 NODES=47	SAT TT=0.79 CHECKS=1353 NODES=0	SAT TT=0.049	SAT TT=0.038 CHECKS=10217	SAT TT=0.025 CHECKS=6875	SAT TT=0.663 ASSIGNMENTS=45	SAT TT=0.549 ASSIGNMENTS=45	SAT TT=0.416 CHECKS=1047 NODES=47	SAT TT=0.478 CHECKS=7462 NODES=21	SAT TT=0.417 CHECKS=11352 NODES=22	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=1.317	SAT TT=1.223	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=1262	SAT TT=0.483	SAT TT=0.012 ASSIGNMENTS=46 CHECKS=1280	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.879	SAT TT=0.017 ASSIGNMENTS=47 CHECKS=5185	SAT TT=0.722	SAT TT=0.792
csp/coloring/ normalized-queens-5-5-3-ext.xml	UNSAT TT=0.01	UNSAT TT=0.715 CHECKS=6 NODES=0	UNSAT TT=0.747 CHECKS=6 NODES=0	UNSAT TT=0.039	UNSAT TT=0.017 CHECKS=4354	UNSAT TT=0.015 CHECKS=434	UNSAT TT=0.417 ASSIGNMENTS=0	UNSAT TT=0.394 ASSIGNMENTS=0	UNSAT TT=0.348 CHECKS=325 NODES=5	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.576	UNSAT TT=0.547	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.328	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.786	UNSAT TT=0.014 ASSIGNMENTS=6 CHECKS=2410	UNSAT TT=0.638	UNSAT TT=0.634
csp/coloring/ normalized-queens-5-5-4-ext.xml	UNSAT TT=0.01	UNSAT TT=0.752 CHECKS=8 NODES=0	UNSAT TT=0.809 CHECKS=8 NODES=0	UNSAT TT=0.04	UNSAT TT=0.038 CHECKS=18958	UNSAT TT=0.015 CHECKS=1623	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.404 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=1113 NODES=26	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.608	UNSAT TT=0.613	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.352	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.787	UNSAT TT=0.016 ASSIGNMENTS=28 CHECKS=12272	UNSAT TT=0.71	UNSAT TT=0.672
csp/coloring/ normalized-queens-5-5-5-ext.xml	SAT TT=0.009	SAT TT=0.779 CHECKS=800 NODES=25	SAT TT=0.762 CHECKS=821 NODES=0	SAT TT=0.041	SAT TT=0.034 CHECKS=13724	SAT TT=0.015 CHECKS=1328	SAT TT=0.552 ASSIGNMENTS=2	SAT TT=0.531 ASSIGNMENTS=2	SAT TT=0.355 CHECKS=524 NODES=25	SAT TT=0.465 CHECKS=7590 NODES=63	SAT TT=0.384 CHECKS=7570 NODES=23	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.021 ASSIGNMENTS=5 CHECKS=1199	SAT TT=1.02	SAT TT=1.226	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.009 ASSIGNMENTS=6 CHECKS=1460	SAT TT=0.334	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1255	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.768	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=3251	SAT TT=0.621	SAT TT=0.727
csp/composed-25-10-20/ normalized-composed-25-10-20-2_ext.xml	SAT TT=0.052	SAT TT=1.044 CHECKS=94780 NODES=527	SAT TT=1.108 CHECKS=243885 NODES=110	SAT TT=0.637	SAT TT=1.486 CHECKS=568907	SAT TT=0.614 CHECKS=131936	SAT TT=1.062 ASSIGNMENTS=48	SAT TT=0.844 ASSIGNMENTS=48	SAT TT=0.724 CHECKS=9029 NODES=150	SAT TT=0.788 CHECKS=125432 NODES=831	SAT TT=0.758 CHECKS=201238 NODES=446	SAT TT=0.068 ASSIGNMENTS=468 CHECKS=30191	SAT TT=0.065 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.419	SAT TT=2.33	SAT TT=0.058 ASSIGNMENTS=489 CHECKS=31777	SAT TT=0.084 ASSIGNMENTS=1669 CHECKS=175712	SAT TT=0.786	SAT TT=0.062 ASSIGNMENTS=822 CHECKS=105285	SAT TT=0.052 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.774	SAT TT=0.121 ASSIGNMENTS=135 CHECKS=31404	SAT TT=1.186	SAT TT=1.338
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-10-20/ normalized-composed-25-10-20-3_ext.xml	SAT TT=0.053	SAT TT=1.096 CHECKS=32520 NODES=262	SAT TT=1.228 CHECKS=385480 NODES=165	? (TO) TT=1800.1	SAT TT=1.825 CHECKS=728350	SAT TT=0.617 CHECKS=153413	SAT TT=1.048 ASSIGNMENTS=43	SAT TT=0.843 ASSIGNMENTS=43	SAT TT=0.781 CHECKS=15485 NODES=277	SAT TT=0.906 CHECKS=179215 NODES=1644	SAT TT=0.838 CHECKS=420946 NODES=897	SAT TT=0.066 ASSIGNMENTS=412 CHECKS=28502	SAT TT=0.065 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.663	SAT TT=2.394	SAT TT=0.054 ASSIGNMENTS=543 CHECKS=40277	SAT TT=0.07 ASSIGNMENTS=1074 CHECKS=127336	SAT TT=0.73	SAT TT=0.069 ASSIGNMENTS=815 CHECKS=103798	SAT TT=0.053 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.911	SAT TT=0.148 ASSIGNMENTS=143 CHECKS=33084	SAT TT=1.451	SAT TT=1.365
csp/composed-25-10-20/ normalized-composed-25-10-20-4_ext.xml	SAT TT=0.045	SAT TT=1.047 CHECKS=65176 NODES=364	SAT TT=1.208 CHECKS=351310 NODES=464	SAT TT=79.985	SAT TT=0.508 CHECKS=145094	SAT TT=0.791 CHECKS=174398	SAT TT=0.862 ASSIGNMENTS=37	SAT TT=0.905 ASSIGNMENTS=37	SAT TT=0.789 CHECKS=17839 NODES=350	SAT TT=0.92 CHECKS=215186 NODES=2245	SAT TT=0.77 CHECKS=538053 NODES=795	SAT TT=0.055 ASSIGNMENTS=64 CHECKS=5497	SAT TT=0.059 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.28	SAT TT=2.24	SAT TT=0.045 ASSIGNMENTS=66 CHECKS=5656	SAT TT=0.163 ASSIGNMENTS=4954 CHECKS=614678	SAT TT=0.779	SAT TT=0.069 ASSIGNMENTS=801 CHECKS=103671	SAT TT=0.048 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.945	SAT TT=0.105 ASSIGNMENTS=138 CHECKS=31096	SAT TT=1.285	SAT TT=1.729
csp/composed-25-10-20/ normalized-composed-25-10-20-5_ext.xml	SAT TT=0.048	SAT TT=0.983 CHECKS=11695 NODES=115	SAT TT=1.131 CHECKS=224939 NODES=195	SAT TT=1.59	SAT TT=1.936 CHECKS=755036	SAT TT=0.641 CHECKS=144125	SAT TT=0.896 ASSIGNMENTS=51	SAT TT=0.853 ASSIGNMENTS=51	SAT TT=0.744 CHECKS=14762 NODES=258	SAT TT=0.794 CHECKS=115440 NODES=1004	SAT TT=0.752 CHECKS=168979 NODES=297	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.499	SAT TT=2.308	SAT TT=0.051 ASSIGNMENTS=224 CHECKS=15923	SAT TT=0.053 ASSIGNMENTS=262 CHECKS=28343	SAT TT=0.765	SAT TT=0.064 ASSIGNMENTS=822 CHECKS=108352	SAT TT=0.048 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.992	SAT TT=0.12 ASSIGNMENTS=129 CHECKS=29630	SAT TT=1.567	SAT TT=1.346
csp/composed-25-10-20/ normalized-composed-25-10-20-7_ext.xml	SAT TT=0.048	SAT TT=1.029 CHECKS=11266 NODES=110	SAT TT=1.103 CHECKS=173954 NODES=112	SAT TT=0.55	SAT TT=1.987 CHECKS=726918	SAT TT=0.754 CHECKS=166666	SAT TT=0.846 ASSIGNMENTS=70	SAT TT=1.078 ASSIGNMENTS=70	SAT TT=0.788 CHECKS=14580 NODES=256	SAT TT=0.771 CHECKS=50804 NODES=248	SAT TT=0.798 CHECKS=128888 NODES=192	SAT TT=0.057 ASSIGNMENTS=96 CHECKS=7209	SAT TT=0.061 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.279	SAT TT=2.449	SAT TT=0.052 ASSIGNMENTS=84 CHECKS=6524	SAT TT=0.135 ASSIGNMENTS=3846 CHECKS=440807	SAT TT=0.755	SAT TT=0.067 ASSIGNMENTS=812 CHECKS=105662	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.997	SAT TT=0.108 ASSIGNMENTS=128 CHECKS=30298	SAT TT=1.275	SAT TT=1.733
csp/composed-25-1-25/ normalized-composed-25-1-25-1_ext.xml	UNSAT TT=0.02	UNSAT TT=0.809 CHECKS=1788 NODES=3	UNSAT TT=0.839 CHECKS=1745 NODES=0	UNSAT TT=0.168	UNSAT TT=0.046 CHECKS=6637	UNSAT TT=0.033 CHECKS=1217	UNSAT TT=0.693 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=3036 NODES=32	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.034 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.989	UNSAT TT=1.094	UNSAT TT=0.022 ASSIGNMENTS=99 CHECKS=12791	UNSAT TT=0.033 ASSIGNMENTS=594 CHECKS=63961	UNSAT TT=0.641	UNSAT TT=0.025 ASSIGNMENTS=217 CHECKS=32567	UNSAT TT=0.02 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=1.769	UNSAT TT=0.038 ASSIGNMENTS=4 CHECKS=2573	UNSAT TT=1.09	UNSAT TT=1.016
csp/composed-25-1-25/ normalized-composed-25-1-25-2_ext.xml	UNSAT TT=0.021	UNSAT TT=0.891 CHECKS=2824 NODES=6	UNSAT TT=0.953 CHECKS=6638 NODES=0	UNSAT TT=0.174	UNSAT TT=0.076 CHECKS=18119	UNSAT TT=0.034 CHECKS=2600	UNSAT TT=0.806 ASSIGNMENTS=0	UNSAT TT=0.687 ASSIGNMENTS=0	UNSAT TT=0.581 CHECKS=3233 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=0.033 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.229	UNSAT TT=0.996	UNSAT TT=0.023 ASSIGNMENTS=150 CHECKS=12416	UNSAT TT=0.046 ASSIGNMENTS=978 CHECKS=123605	UNSAT TT=0.518	UNSAT TT=0.024 ASSIGNMENTS=196 CHECKS=26831	UNSAT TT=0.021 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.857	UNSAT TT=0.044 ASSIGNMENTS=5 CHECKS=2503	UNSAT TT=0.992	UNSAT TT=1.021
csp/composed-25-1-25/ normalized-composed-25-1-25-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.861 CHECKS=2121 NODES=5	UNSAT TT=0.846 CHECKS=5064 NODES=0	UNSAT TT=0.173	UNSAT TT=0.072 CHECKS=16749	UNSAT TT=0.032 CHECKS=2282	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.713 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=2346 NODES=20	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.988	UNSAT TT=1.17	UNSAT TT=0.023 ASSIGNMENTS=149 CHECKS=15056	UNSAT TT=0.034 ASSIGNMENTS=531 CHECKS=67496	UNSAT TT=0.508	UNSAT TT=0.024 ASSIGNMENTS=100 CHECKS=18174	UNSAT TT=0.023 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=1.777	UNSAT TT=0.041 ASSIGNMENTS=3 CHECKS=1736	UNSAT TT=0.96	UNSAT TT=0.99
csp/composed-25-1-25/ normalized-composed-25-1-25-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.808 CHECKS=2689 NODES=7	UNSAT TT=1.066 CHECKS=6045 NODES=0	UNSAT TT=0.159	UNSAT TT=0.079 CHECKS=19810	UNSAT TT=0.033 CHECKS=2714	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.664 ASSIGNMENTS=0	UNSAT TT=0.539 CHECKS=2921 NODES=31	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.109	UNSAT TT=0.908	UNSAT TT=0.022 ASSIGNMENTS=147 CHECKS=14236	UNSAT TT=0.049 ASSIGNMENTS=1239 CHECKS=145284	UNSAT TT=0.66	UNSAT TT=0.023 ASSIGNMENTS=198 CHECKS=26473	UNSAT TT=0.022 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.838	UNSAT TT=0.038 ASSIGNMENTS=6 CHECKS=3126	UNSAT TT=1.095	UNSAT TT=0.993
csp/composed-25-1-25/ normalized-composed-25-1-25-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.873 CHECKS=1996 NODES=4	UNSAT TT=0.868 CHECKS=4024 NODES=0	UNSAT TT=0.169	UNSAT TT=0.042 CHECKS=4883	UNSAT TT=0.034 CHECKS=2711	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3132 NODES=25	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=0.034 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.116	UNSAT TT=0.97	UNSAT TT=0.022 ASSIGNMENTS=87 CHECKS=9974	UNSAT TT=0.054 ASSIGNMENTS=1440 CHECKS=175058	UNSAT TT=0.648	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=21820	UNSAT TT=0.022 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.662	UNSAT TT=0.039 ASSIGNMENTS=5 CHECKS=2729	UNSAT TT=1.04	UNSAT TT=0.989
csp/composed-25-1-2/ normalized-composed-25-1-2-0_ext.xml	UNSAT TT=0.02	UNSAT TT=0.802 CHECKS=1657 NODES=4	UNSAT TT=0.834 CHECKS=4458 NODES=0	UNSAT TT=0.164	UNSAT TT=0.041 CHECKS=5707	UNSAT TT=0.03 CHECKS=1478	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.695 ASSIGNMENTS=0	UNSAT TT=0.568 CHECKS=2741 NODES=31	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.965	UNSAT TT=0.918	UNSAT TT=0.021 ASSIGNMENTS=166 CHECKS=9909	UNSAT TT=0.05 ASSIGNMENTS=2015 CHECKS=142789	UNSAT TT=0.507	UNSAT TT=0.022 ASSIGNMENTS=207 CHECKS=23608	UNSAT TT=0.02 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=1.636	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=949	UNSAT TT=0.945	UNSAT TT=1.122
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-2/ normalized-composed-25-1-2-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.81 CHECKS=2153 NODES=7	UNSAT TT=0.82 CHECKS=6829 NODES=0	UNSAT TT=0.155	UNSAT TT=0.058 CHECKS=12965	UNSAT TT=0.031 CHECKS=1806	UNSAT TT=0.638 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=2697 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.033 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.967	UNSAT TT=0.912	UNSAT TT=0.023 ASSIGNMENTS=185 CHECKS=12365	UNSAT TT=0.035 ASSIGNMENTS=1100 CHECKS=77179	UNSAT TT=0.734	UNSAT TT=0.022 ASSIGNMENTS=193 CHECKS=21883	UNSAT TT=0.022 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=1.668	UNSAT TT=0.036 ASSIGNMENTS=8 CHECKS=1106	UNSAT TT=1.007	UNSAT TT=0.965
csp/composed-25-1-2/ normalized-composed-25-1-2-7_ext.xml	UNSAT TT=0.02	UNSAT TT=0.785 CHECKS=1807 NODES=5	UNSAT TT=0.94 CHECKS=7699 NODES=0	UNSAT TT=0.152	UNSAT TT=0.067 CHECKS=15940	UNSAT TT=0.031 CHECKS=1763	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.616 ASSIGNMENTS=0	UNSAT TT=0.529 CHECKS=2808 NODES=34	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.939	UNSAT TT=1.2	UNSAT TT=0.02 ASSIGNMENTS=183 CHECKS=10858	UNSAT TT=0.035 ASSIGNMENTS=1230 CHECKS=86619	UNSAT TT=0.481	UNSAT TT=0.021 ASSIGNMENTS=215 CHECKS=23310	UNSAT TT=0.021 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=1.667	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=977	UNSAT TT=0.934	UNSAT TT=0.949
csp/composed-25-1-2/ normalized-composed-25-1-2-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.946 CHECKS=1977 NODES=4	UNSAT TT=0.959 CHECKS=6449 NODES=0	UNSAT TT=0.164	UNSAT TT=0.063 CHECKS=11893	UNSAT TT=0.029 CHECKS=1034	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.62 ASSIGNMENTS=0	UNSAT TT=0.6 CHECKS=2665 NODES=30	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.168	UNSAT TT=1.11	UNSAT TT=0.021 ASSIGNMENTS=181 CHECKS=11012	UNSAT TT=0.032 ASSIGNMENTS=824 CHECKS=59481	UNSAT TT=0.517	UNSAT TT=0.021 ASSIGNMENTS=204 CHECKS=22768	UNSAT TT=0.023 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.78	UNSAT TT=0.037 ASSIGNMENTS=5 CHECKS=891	UNSAT TT=1.053	UNSAT TT=0.975
csp/composed-25-1-2/ normalized-composed-25-1-2-9_ext.xml	UNSAT TT=0.02	UNSAT TT=0.84 CHECKS=1957 NODES=7	UNSAT TT=0.819 CHECKS=7145 NODES=0	UNSAT TT=0.162	UNSAT TT=0.066 CHECKS=13700	UNSAT TT=0.032 CHECKS=1825	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.532 CHECKS=2842 NODES=31	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.936	UNSAT TT=0.953	UNSAT TT=0.021 ASSIGNMENTS=230 CHECKS=12987	UNSAT TT=0.03 ASSIGNMENTS=668 CHECKS=44608	UNSAT TT=0.611	UNSAT TT=0.021 ASSIGNMENTS=220 CHECKS=24330	UNSAT TT=0.02 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=1.651	UNSAT TT=0.043 ASSIGNMENTS=6 CHECKS=868	UNSAT TT=0.925	UNSAT TT=0.963
csp/composed-25-1-40/ normalized-composed-25-1-40-0_ext.xml	UNSAT TT=0.022	UNSAT TT=0.852 CHECKS=2608 NODES=4	UNSAT TT=0.809 CHECKS=2919 NODES=0	UNSAT TT=0.163	UNSAT TT=0.074 CHECKS=20999	UNSAT TT=0.036 CHECKS=2693	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.54 CHECKS=3284 NODES=23	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.009	UNSAT TT=0.93	UNSAT TT=0.023 ASSIGNMENTS=109 CHECKS=14171	UNSAT TT=0.052 ASSIGNMENTS=1322 CHECKS=186886	UNSAT TT=0.519	UNSAT TT=0.022 ASSIGNMENTS=152 CHECKS=25789	UNSAT TT=0.022 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.665	UNSAT TT=0.038 ASSIGNMENTS=7 CHECKS=5120	UNSAT TT=1.259	UNSAT TT=1.004
csp/composed-25-1-40/ normalized-composed-25-1-40-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.805 CHECKS=3096 NODES=6	UNSAT TT=0.826 CHECKS=6925 NODES=0	UNSAT TT=0.173	UNSAT TT=0.081 CHECKS=20289	UNSAT TT=0.034 CHECKS=1323	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=3314 NODES=29	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.033 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=0.034 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.183	UNSAT TT=0.919	UNSAT TT=0.025 ASSIGNMENTS=129 CHECKS=15763	UNSAT TT=0.037 ASSIGNMENTS=785 CHECKS=103843	UNSAT TT=0.517	UNSAT TT=0.024 ASSIGNMENTS=150 CHECKS=22448	UNSAT TT=0.023 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.798	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=4114	UNSAT TT=0.982	UNSAT TT=1.296
csp/composed-25-1-40/ normalized-composed-25-1-40-3_ext.xml	UNSAT TT=0.022	UNSAT TT=0.811 CHECKS=2561 NODES=5	UNSAT TT=0.816 CHECKS=3829 NODES=0	UNSAT TT=0.176	UNSAT TT=0.044 CHECKS=6256	UNSAT TT=0.033 CHECKS=1609	UNSAT TT=0.809 ASSIGNMENTS=0	UNSAT TT=0.642 ASSIGNMENTS=0	UNSAT TT=0.789 CHECKS=2307 NODES=18	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.035 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.033 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.931	UNSAT TT=0.922	UNSAT TT=0.024 ASSIGNMENTS=127 CHECKS=22099	UNSAT TT=0.052 ASSIGNMENTS=1071 CHECKS=170496	UNSAT TT=0.478	UNSAT TT=0.022 ASSIGNMENTS=77 CHECKS=14575	UNSAT TT=0.023 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=1.69	UNSAT TT=0.048 ASSIGNMENTS=4 CHECKS=3161	UNSAT TT=1.12	UNSAT TT=1.003
csp/composed-25-1-40/ normalized-composed-25-1-40-4_ext.xml	UNSAT TT=0.021	UNSAT TT=0.81 CHECKS=2413 NODES=5	UNSAT TT=0.825 CHECKS=6054 NODES=0	UNSAT TT=0.176	UNSAT TT=0.047 CHECKS=7088	UNSAT TT=0.035 CHECKS=3082	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.552 CHECKS=3458 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.999	UNSAT TT=1.06	UNSAT TT=0.021 ASSIGNMENTS=108 CHECKS=14464	UNSAT TT=0.042 ASSIGNMENTS=960 CHECKS=130925	UNSAT TT=0.484	UNSAT TT=0.024 ASSIGNMENTS=136 CHECKS=23277	UNSAT TT=0.021 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=1.669	UNSAT TT=0.041 ASSIGNMENTS=7 CHECKS=4591	UNSAT TT=1.087	UNSAT TT=0.997
csp/composed-25-1-40/ normalized-composed-25-1-40-5_ext.xml	UNSAT TT=0.02	UNSAT TT=0.805 CHECKS=2585 NODES=6	UNSAT TT=0.859 CHECKS=2758 NODES=0	UNSAT TT=0.164	UNSAT TT=0.047 CHECKS=7304	UNSAT TT=0.031 CHECKS=1056	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.662 ASSIGNMENTS=0	UNSAT TT=0.541 CHECKS=3038 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.032 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.997	UNSAT TT=1.057	UNSAT TT=0.022 ASSIGNMENTS=68 CHECKS=12604	UNSAT TT=0.039 ASSIGNMENTS=637 CHECKS=97538	UNSAT TT=0.626	UNSAT TT=0.024 ASSIGNMENTS=78 CHECKS=14356	UNSAT TT=0.02 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=1.797	UNSAT TT=0.041 ASSIGNMENTS=6 CHECKS=3717	UNSAT TT=0.974	UNSAT TT=1.222
csp/composed-25-1-80/ normalized-composed-25-1-80-0_ext.xml	UNSAT TT=0.023	UNSAT TT=0.813 CHECKS=3403 NODES=4	UNSAT TT=0.827 CHECKS=3737 NODES=0	UNSAT TT=0.189	UNSAT TT=0.05 CHECKS=8570	UNSAT TT=0.037 CHECKS=1865	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.686 ASSIGNMENTS=0	UNSAT TT=0.595 CHECKS=3507 NODES=21	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.253	UNSAT TT=0.995	UNSAT TT=0.028 ASSIGNMENTS=92 CHECKS=20520	UNSAT TT=0.043 ASSIGNMENTS=638 CHECKS=119040	UNSAT TT=0.528	UNSAT TT=0.025 ASSIGNMENTS=82 CHECKS=18397	UNSAT TT=0.023 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.728	UNSAT TT=0.048 ASSIGNMENTS=5 CHECKS=5819	UNSAT TT=1.168	UNSAT TT=1.081
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-80/ normalized-composed-25-1-80-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.873 CHECKS=3909 NODES=6	UNSAT TT=0.828 CHECKS=8069 NODES=0	UNSAT TT=0.174	UNSAT TT=0.048 CHECKS=9236	UNSAT TT=0.036 CHECKS=3520	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.644 ASSIGNMENTS=0	UNSAT TT=0.556 CHECKS=4210 NODES=24	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.033 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=0.035 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.019	UNSAT TT=0.989	UNSAT TT=0.025 ASSIGNMENTS=123 CHECKS=23941	UNSAT TT=0.05 ASSIGNMENTS=869 CHECKS=163457	UNSAT TT=0.563	UNSAT TT=0.026 ASSIGNMENTS=131 CHECKS=28954	UNSAT TT=0.023 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.733	UNSAT TT=0.049 ASSIGNMENTS=5 CHECKS=5913	UNSAT TT=1.15	UNSAT TT=1.183
csp/composed-25-1-80/ normalized-composed-25-1-80-7_ext.xml	UNSAT TT=0.026	UNSAT TT=0.834 CHECKS=4073 NODES=6	UNSAT TT=0.806 CHECKS=3584 NODES=0	UNSAT TT=0.183	UNSAT TT=0.091 CHECKS=26444	UNSAT TT=0.04 CHECKS=3681	UNSAT TT=0.821 ASSIGNMENTS=0	UNSAT TT=0.733 ASSIGNMENTS=0	UNSAT TT=0.564 CHECKS=3680 NODES=23	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.038 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.037 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.948	UNSAT TT=1.149	UNSAT TT=0.027 ASSIGNMENTS=151 CHECKS=25908	UNSAT TT=0.056 ASSIGNMENTS=1161 CHECKS=232847	UNSAT TT=0.541	UNSAT TT=0.028 ASSIGNMENTS=135 CHECKS=29871	UNSAT TT=0.026 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=6327	UNSAT TT=1.015	UNSAT TT=0.982
csp/composed-25-1-80/ normalized-composed-25-1-80-8_ext.xml	UNSAT TT=0.022	UNSAT TT=0.848 CHECKS=3064 NODES=4	UNSAT TT=0.834 CHECKS=4175 NODES=0	UNSAT TT=0.177	UNSAT TT=0.099 CHECKS=30903	UNSAT TT=0.033 CHECKS=1358	UNSAT TT=0.645 ASSIGNMENTS=0	UNSAT TT=0.663 ASSIGNMENTS=0	UNSAT TT=0.574 CHECKS=3587 NODES=23	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.034 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.009	UNSAT TT=0.967	UNSAT TT=0.022 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.064 ASSIGNMENTS=1216 CHECKS=247400	UNSAT TT=0.574	UNSAT TT=0.025 ASSIGNMENTS=52 CHECKS=10486	UNSAT TT=0.024 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.886	UNSAT TT=0.048 ASSIGNMENTS=7 CHECKS=7658	UNSAT TT=1.311	UNSAT TT=1.007
csp/composed-25-1-80/ normalized-composed-25-1-80-9_ext.xml	UNSAT TT=0.024	UNSAT TT=0.81 CHECKS=4729 NODES=8	UNSAT TT=0.852 CHECKS=6657 NODES=0	UNSAT TT=0.189	UNSAT TT=0.062 CHECKS=14835	UNSAT TT=0.04 CHECKS=4278	UNSAT TT=0.632 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3417 NODES=24	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.038 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=0.037 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.171	UNSAT TT=1.016	UNSAT TT=0.029 ASSIGNMENTS=179 CHECKS=41164	UNSAT TT=0.064 ASSIGNMENTS=1230 CHECKS=252489	UNSAT TT=0.5	UNSAT TT=0.024 ASSIGNMENTS=75 CHECKS=16749	UNSAT TT=0.026 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=5725	UNSAT TT=0.951	UNSAT TT=1.06
csp/composed-75-1-25/ normalized-composed-75-1-25-2_ext.xml	UNSAT TT=0.051	UNSAT TT=0.946 CHECKS=2223 NODES=6	UNSAT TT=0.95 CHECKS=12138 NODES=0	UNSAT TT=0.399	UNSAT TT=0.215 CHECKS=54998	UNSAT TT=0.08 CHECKS=5385	UNSAT TT=0.748 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.748 CHECKS=6488 NODES=50	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.064 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=0.063 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=1.406	UNSAT TT=1.38	UNSAT TT=0.051 ASSIGNMENTS=304 CHECKS=31909	UNSAT TT=0.152 ASSIGNMENTS=4853 CHECKS=586337	UNSAT TT=0.653	UNSAT TT=0.056 ASSIGNMENTS=470 CHECKS=68700	UNSAT TT=0.052 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=2.512	UNSAT TT=0.099 ASSIGNMENTS=6 CHECKS=3286	UNSAT TT=1.536	UNSAT TT=1.259
csp/composed-75-1-25/ normalized-composed-75-1-25-4_ext.xml	UNSAT TT=0.047	UNSAT TT=0.993 CHECKS=2300 NODES=6	UNSAT TT=1.1 CHECKS=1981 NODES=0	UNSAT TT=0.405	UNSAT TT=0.122 CHECKS=16988	UNSAT TT=0.077 CHECKS=5168	UNSAT TT=0.775 ASSIGNMENTS=0	UNSAT TT=0.788 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=6264 NODES=54	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.063 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=0.062 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=1.435	UNSAT TT=1.378	UNSAT TT=0.051 ASSIGNMENTS=214 CHECKS=19167	UNSAT TT=0.154 ASSIGNMENTS=5113 CHECKS=582357	UNSAT TT=0.655	UNSAT TT=0.06 ASSIGNMENTS=553 CHECKS=79081	UNSAT TT=0.047 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=2.518	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=3075	UNSAT TT=1.319	UNSAT TT=1.466
csp/composed-75-1-25/ normalized-composed-75-1-25-5_ext.xml	UNSAT TT=0.048	UNSAT TT=0.976 CHECKS=2104 NODES=5	UNSAT TT=0.987 CHECKS=20212 NODES=0	UNSAT TT=0.401	UNSAT TT=0.211 CHECKS=53887	UNSAT TT=0.076 CHECKS=2534	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.867 CHECKS=6594 NODES=48	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.063 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=0.059 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=1.641	UNSAT TT=1.403	UNSAT TT=0.054 ASSIGNMENTS=272 CHECKS=24806	UNSAT TT=0.175 ASSIGNMENTS=6252 CHECKS=692225	UNSAT TT=0.659	UNSAT TT=0.056 ASSIGNMENTS=532 CHECKS=80384	UNSAT TT=0.048 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=2.369	UNSAT TT=0.098 ASSIGNMENTS=7 CHECKS=2357	UNSAT TT=1.388	UNSAT TT=1.442
csp/composed-75-1-25/ normalized-composed-75-1-25-6_ext.xml	UNSAT TT=0.049	UNSAT TT=0.983 CHECKS=1998 NODES=4	UNSAT TT=1 CHECKS=19651 NODES=0	UNSAT TT=0.401	UNSAT TT=0.214 CHECKS=55945	UNSAT TT=0.075 CHECKS=5312	UNSAT TT=0.772 ASSIGNMENTS=0	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.754 CHECKS=6411 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.061 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=0.064 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=1.433	UNSAT TT=1.394	UNSAT TT=0.049 ASSIGNMENTS=344 CHECKS=24991	UNSAT TT=0.166 ASSIGNMENTS=6230 CHECKS=691261	UNSAT TT=0.66	UNSAT TT=0.053 ASSIGNMENTS=514 CHECKS=68300	UNSAT TT=0.049 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=2.308	UNSAT TT=0.095 ASSIGNMENTS=8 CHECKS=3043	UNSAT TT=1.382	UNSAT TT=1.394
csp/composed-75-1-25/ normalized-composed-75-1-25-9_ext.xml	UNSAT TT=0.049	UNSAT TT=1.079 CHECKS=2301 NODES=5	UNSAT TT=1.003 CHECKS=13015 NODES=0	UNSAT TT=0.402	UNSAT TT=0.198 CHECKS=51657	UNSAT TT=0.082 CHECKS=11771	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=0.743 CHECKS=6760 NODES=63	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.065 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=0.06 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=1.413	UNSAT TT=1.409	UNSAT TT=0.051 ASSIGNMENTS=329 CHECKS=25050	UNSAT TT=0.176 ASSIGNMENTS=6351 CHECKS=691833	UNSAT TT=0.825	UNSAT TT=0.055 ASSIGNMENTS=537 CHECKS=82350	UNSAT TT=0.049 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=2.328	UNSAT TT=0.092 ASSIGNMENTS=7 CHECKS=3052	UNSAT TT=1.174	UNSAT TT=1.347
csp/composed-75-1-2/ normalized-composed-75-1-2-0_ext.xml	UNSAT TT=0.047	UNSAT TT=0.942 CHECKS=1852 NODES=5	UNSAT TT=1.127 CHECKS=17117 NODES=0	UNSAT TT=0.399	UNSAT TT=0.199 CHECKS=49100	UNSAT TT=0.075 CHECKS=4898	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.997 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=8367 NODES=94	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.059 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=0.061 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=1.68	UNSAT TT=1.575	UNSAT TT=0.05 ASSIGNMENTS=279 CHECKS=19618	UNSAT TT=0.107 ASSIGNMENTS=3874 CHECKS=355491	UNSAT TT=0.6	UNSAT TT=0.052 ASSIGNMENTS=555 CHECKS=66796	UNSAT TT=0.047 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=2.457	UNSAT TT=0.098 ASSIGNMENTS=5 CHECKS=957	UNSAT TT=1.182	UNSAT TT=1.472
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-2/ normalized-composed-75-1-2-1_ext.xml	UNSAT TT=0.047	UNSAT TT=0.94 CHECKS=1801 NODES=5	UNSAT TT=1.011 CHECKS=17108 NODES=0	UNSAT TT=0.396	UNSAT TT=0.192 CHECKS=45987	UNSAT TT=0.078 CHECKS=4860	UNSAT TT=0.87 ASSIGNMENTS=0	UNSAT TT=0.752 ASSIGNMENTS=0	UNSAT TT=0.947 CHECKS=6473 NODES=56	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.062 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=0.061 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=1.538	UNSAT TT=1.361	UNSAT TT=0.049 ASSIGNMENTS=413 CHECKS=23658	UNSAT TT=0.151 ASSIGNMENTS=6633 CHECKS=584150	UNSAT TT=0.65	UNSAT TT=0.054 ASSIGNMENTS=527 CHECKS=72323	UNSAT TT=0.047 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=2.307	UNSAT TT=0.091 ASSIGNMENTS=8 CHECKS=1063	UNSAT TT=1.39	UNSAT TT=1.431
csp/composed-75-1-2/ normalized-composed-75-1-2-2_ext.xml	UNSAT TT=0.047	UNSAT TT=0.974 CHECKS=1888 NODES=6	UNSAT TT=1.147 CHECKS=19142 NODES=0	UNSAT TT=0.393	UNSAT TT=0.198 CHECKS=47297	UNSAT TT=0.079 CHECKS=4813	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.953 CHECKS=6242 NODES=62	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=1.404	UNSAT TT=1.499	UNSAT TT=0.05 ASSIGNMENTS=364 CHECKS=23340	UNSAT TT=0.109 ASSIGNMENTS=4024 CHECKS=358778	UNSAT TT=0.716	UNSAT TT=0.056 ASSIGNMENTS=579 CHECKS=77807	UNSAT TT=0.047 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=2.483	UNSAT TT=0.097 ASSIGNMENTS=6 CHECKS=977	UNSAT TT=1.226	UNSAT TT=1.434
csp/composed-75-1-2/ normalized-composed-75-1-2-5_ext.xml	UNSAT TT=0.047	UNSAT TT=0.943 CHECKS=1528 NODES=5	UNSAT TT=0.99 CHECKS=17462 NODES=0	UNSAT TT=0.394	UNSAT TT=0.114 CHECKS=14512	UNSAT TT=0.074 CHECKS=4787	UNSAT TT=0.819 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.738 CHECKS=6352 NODES=51	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.06 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=0.062 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=1.402	UNSAT TT=1.483	UNSAT TT=0.047 ASSIGNMENTS=388 CHECKS=23947	UNSAT TT=0.144 ASSIGNMENTS=6082 CHECKS=529241	UNSAT TT=0.639	UNSAT TT=0.055 ASSIGNMENTS=562 CHECKS=73130	UNSAT TT=0.05 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=2.484	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1019	UNSAT TT=1.361	UNSAT TT=1.43
csp/composed-75-1-2/ normalized-composed-75-1-2-7_ext.xml	UNSAT TT=0.047	UNSAT TT=0.998 CHECKS=1673 NODES=4	UNSAT TT=1.102 CHECKS=17171 NODES=0	UNSAT TT=0.399	UNSAT TT=0.218 CHECKS=57838	UNSAT TT=0.071 CHECKS=2268	UNSAT TT=0.958 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.904 CHECKS=6066 NODES=68	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=0.062 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=1.321	UNSAT TT=1.381	UNSAT TT=0.047 ASSIGNMENTS=389 CHECKS=22732	UNSAT TT=0.155 ASSIGNMENTS=6524 CHECKS=593423	UNSAT TT=0.641	UNSAT TT=0.054 ASSIGNMENTS=590 CHECKS=79866	UNSAT TT=0.048 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=2.476	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1051	UNSAT TT=1.201	UNSAT TT=1.353
csp/composed-75-1-40/ normalized-composed-75-1-40-1_ext.xml	UNSAT TT=0.049	UNSAT TT=0.978 CHECKS=2367 NODES=5	UNSAT TT=0.963 CHECKS=18242 NODES=0	UNSAT TT=0.404	UNSAT TT=0.227 CHECKS=59123	UNSAT TT=0.072 CHECKS=2486	UNSAT TT=0.987 ASSIGNMENTS=0	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=6854 NODES=39	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.065 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=0.059 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=1.426	UNSAT TT=1.512	UNSAT TT=0.052 ASSIGNMENTS=307 CHECKS=26165	UNSAT TT=0.184 ASSIGNMENTS=6210 CHECKS=748357	UNSAT TT=0.675	UNSAT TT=0.058 ASSIGNMENTS=500 CHECKS=83243	UNSAT TT=0.049 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=2.331	UNSAT TT=0.101 ASSIGNMENTS=8 CHECKS=4165	UNSAT TT=1.129	UNSAT TT=1.264
csp/composed-75-1-40/ normalized-composed-75-1-40-2_ext.xml	UNSAT TT=0.05	UNSAT TT=0.938 CHECKS=2453 NODES=6	UNSAT TT=1.029 CHECKS=11787 NODES=0	UNSAT TT=0.407	UNSAT TT=0.129 CHECKS=20089	UNSAT TT=0.081 CHECKS=5532	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=1.001 ASSIGNMENTS=0	UNSAT TT=0.799 CHECKS=6663 NODES=40	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.062 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=0.066 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=1.459	UNSAT TT=1.369	UNSAT TT=0.052 ASSIGNMENTS=259 CHECKS=27119	UNSAT TT=0.205 ASSIGNMENTS=5936 CHECKS=878926	UNSAT TT=0.659	UNSAT TT=0.053 ASSIGNMENTS=359 CHECKS=58059	UNSAT TT=0.05 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=2.496	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=4554	UNSAT TT=1.206	UNSAT TT=1.372
csp/composed-75-1-40/ normalized-composed-75-1-40-5_ext.xml	UNSAT TT=0.049	UNSAT TT=0.946 CHECKS=2565 NODES=5	UNSAT TT=1.111 CHECKS=8496 NODES=0	UNSAT TT=0.379	UNSAT TT=0.129 CHECKS=20493	UNSAT TT=0.079 CHECKS=5540	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.907 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=7403 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.06 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=0.058 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=1.422	UNSAT TT=1.396	UNSAT TT=0.05 ASSIGNMENTS=206 CHECKS=24405	UNSAT TT=0.204 ASSIGNMENTS=5940 CHECKS=826891	UNSAT TT=0.815	UNSAT TT=0.059 ASSIGNMENTS=564 CHECKS=95606	UNSAT TT=0.049 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=2.356	UNSAT TT=0.101 ASSIGNMENTS=7 CHECKS=4342	UNSAT TT=1.16	UNSAT TT=1.456
csp/composed-75-1-40/ normalized-composed-75-1-40-6_ext.xml	UNSAT TT=0.048	UNSAT TT=0.945 CHECKS=2961 NODES=6	UNSAT TT=1.027 CHECKS=13797 NODES=0	UNSAT TT=0.402	UNSAT TT=0.223 CHECKS=59180	UNSAT TT=0.076 CHECKS=3007	UNSAT TT=0.754 ASSIGNMENTS=0	UNSAT TT=0.831 ASSIGNMENTS=0	UNSAT TT=0.759 CHECKS=6946 NODES=41	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=1.577	UNSAT TT=1.386	UNSAT TT=0.048 ASSIGNMENTS=238 CHECKS=28730	UNSAT TT=0.133 ASSIGNMENTS=3361 CHECKS=469964	UNSAT TT=0.661	UNSAT TT=0.06 ASSIGNMENTS=590 CHECKS=86812	UNSAT TT=0.05 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=2.514	UNSAT TT=0.091 ASSIGNMENTS=6 CHECKS=3968	UNSAT TT=1.397	UNSAT TT=1.261
csp/composed-75-1-40/ normalized-composed-75-1-40-9_ext.xml	UNSAT TT=0.05	UNSAT TT=0.963 CHECKS=2778 NODES=5	UNSAT TT=0.968 CHECKS=14100 NODES=0	UNSAT TT=0.409	UNSAT TT=0.135 CHECKS=23434	UNSAT TT=0.082 CHECKS=5660	UNSAT TT=0.76 ASSIGNMENTS=0	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=0.77 CHECKS=6978 NODES=63	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.064 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=0.063 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=1.431	UNSAT TT=1.374	UNSAT TT=0.052 ASSIGNMENTS=272 CHECKS=27389	UNSAT TT=0.194 ASSIGNMENTS=6127 CHECKS=787308	UNSAT TT=0.656	UNSAT TT=0.053 ASSIGNMENTS=353 CHECKS=59456	UNSAT TT=0.05 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=2.446	UNSAT TT=0.099 ASSIGNMENTS=8 CHECKS=3659	UNSAT TT=1.184	UNSAT TT=1.446
csp/composed-75-1-80/ normalized-composed-75-1-80-1_ext.xml	UNSAT TT=0.049	UNSAT TT=1.109 CHECKS=3548 NODES=6	UNSAT TT=1.023 CHECKS=12036 NODES=0	UNSAT TT=0.417	UNSAT TT=0.232 CHECKS=61937	UNSAT TT=0.084 CHECKS=6114	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.776 CHECKS=5267 NODES=30	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.065 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=0.06 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=1.588	UNSAT TT=1.306	UNSAT TT=0.053 ASSIGNMENTS=215 CHECKS=34722	UNSAT TT=0.155 ASSIGNMENTS=3438 CHECKS=598000	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=173 CHECKS=32381	UNSAT TT=0.051 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=2.672	UNSAT TT=0.104 ASSIGNMENTS=8 CHECKS=7474	UNSAT TT=1.386	UNSAT TT=1.235
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-80/ normalized-composed-75-1-80-3_ext.xml	UNSAT TT=0.047	UNSAT TT=0.944 CHECKS=3487 NODES=6	UNSAT TT=1.104 CHECKS=6399 NODES=0	UNSAT TT=0.416	UNSAT TT=0.247 CHECKS=69188	UNSAT TT=0.09 CHECKS=8103	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.816 ASSIGNMENTS=0	UNSAT TT=0.722 CHECKS=4469 NODES=31	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=0.06 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=1.363	UNSAT TT=1.524	UNSAT TT=0.047 ASSIGNMENTS=122 CHECKS=25767	UNSAT TT=0.069 ASSIGNMENTS=815 CHECKS=157633	UNSAT TT=0.63	UNSAT TT=0.049 ASSIGNMENTS=158 CHECKS=29975	UNSAT TT=0.048 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=2.486	UNSAT TT=0.104 ASSIGNMENTS=5 CHECKS=7797	UNSAT TT=1.359	UNSAT TT=1.228
csp/composed-75-1-80/ normalized-composed-75-1-80-6_ext.xml	UNSAT TT=0.05	UNSAT TT=0.981 CHECKS=3918 NODES=6	UNSAT TT=0.962 CHECKS=8245 NODES=0	UNSAT TT=0.39	UNSAT TT=0.216 CHECKS=64176	UNSAT TT=0.078 CHECKS=6342	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	UNSAT TT=0.843 CHECKS=5346 NODES=28	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.058 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=0.057 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=1.385	UNSAT TT=1.404	UNSAT TT=0.052 ASSIGNMENTS=172 CHECKS=26930	UNSAT TT=0.161 ASSIGNMENTS=3825 CHECKS=727874	UNSAT TT=0.629	UNSAT TT=0.053 ASSIGNMENTS=203 CHECKS=39726	UNSAT TT=0.05 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=2.702	UNSAT TT=0.105 ASSIGNMENTS=7 CHECKS=7103	UNSAT TT=1.392	UNSAT TT=1.305
csp/composed-75-1-80/ normalized-composed-75-1-80-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.956 CHECKS=2943 NODES=3	UNSAT TT=1.015 CHECKS=8962 NODES=0	UNSAT TT=0.392	UNSAT TT=0.241 CHECKS=74686	UNSAT TT=0.086 CHECKS=7160	UNSAT TT=0.767 ASSIGNMENTS=0	UNSAT TT=0.813 ASSIGNMENTS=0	UNSAT TT=0.779 CHECKS=5973 NODES=32	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.059 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=0.06 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=1.452	UNSAT TT=1.347	UNSAT TT=0.05 ASSIGNMENTS=101 CHECKS=27615	UNSAT TT=0.171 ASSIGNMENTS=3589 CHECKS=710950	UNSAT TT=0.834	UNSAT TT=0.045 ASSIGNMENTS=118 CHECKS=24676	UNSAT TT=0.047 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=2.691	UNSAT TT=0.115 ASSIGNMENTS=8 CHECKS=8407	UNSAT TT=1.315	UNSAT TT=1.385
csp/composed-75-1-80/ normalized-composed-75-1-80-9_ext.xml	UNSAT TT=0.046	UNSAT TT=0.973 CHECKS=3562 NODES=5	UNSAT TT=0.944 CHECKS=10216 NODES=0	UNSAT TT=0.415	UNSAT TT=0.223 CHECKS=59283	UNSAT TT=0.075 CHECKS=3521	UNSAT TT=0.773 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.783 CHECKS=4457 NODES=24	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.063 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=0.061 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=1.337	UNSAT TT=1.398	UNSAT TT=0.052 ASSIGNMENTS=232 CHECKS=34355	UNSAT TT=0.199 ASSIGNMENTS=5068 CHECKS=949522	UNSAT TT=0.668	UNSAT TT=0.046 ASSIGNMENTS=115 CHECKS=22510	UNSAT TT=0.051 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=2.685	UNSAT TT=0.096 ASSIGNMENTS=8 CHECKS=7375	UNSAT TT=1.144	UNSAT TT=1.285
csp/driver/ normalized-driverlogw-01c-sat_ext.xml	SAT TT=0.01	SAT TT=0.771 CHECKS=1271 NODES=71	SAT TT=0.736 CHECKS=1242 NODES=0	SAT TT=0.047	SAT TT=0.018 CHECKS=4665	SAT TT=0.016 CHECKS=3190	SAT TT=0.509 ASSIGNMENTS=24	SAT TT=0.518 ASSIGNMENTS=24	SAT TT=0.378 CHECKS=733 NODES=71	SAT TT=0.412 CHECKS=3422 NODES=31	SAT TT=0.389 CHECKS=6207 NODES=19	SAT TT=0.023 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.023 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.998	SAT TT=1.01	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.011 ASSIGNMENTS=20 CHECKS=512	SAT TT=0.386	SAT TT=0.01 ASSIGNMENTS=23 CHECKS=460	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.844	SAT TT=0.019 ASSIGNMENTS=71 CHECKS=1442	SAT TT=0.699	SAT TT=0.688
csp/driver/ normalized-driverlogw-02c-sat_ext.xml	SAT TT=0.136	SAT TT=2.307 CHECKS=1742190 NODES=4000	SAT TT=3.196 CHECKS=2504230 NODES=4111	SAT TT=0.477	SAT TT=4.127 CHECKS=3171710	SAT TT=1.333 CHECKS=1153110	SAT TT=1.573 ASSIGNMENTS=65	SAT TT=1.774 ASSIGNMENTS=65	SAT TT=3.114 CHECKS=35400 NODES=423	SAT TT=5.566 CHECKS=9618040 NODES=59971	SAT TT=4.35 CHECKS=7845390 NODES=3763	SAT TT=0.139 ASSIGNMENTS=180 CHECKS=117043	SAT TT=0.142 ASSIGNMENTS=180 CHECKS=117043	SAT TT=2.919	SAT TT=3.028	SAT TT=0.143 ASSIGNMENTS=201 CHECKS=150798	SAT TT=0.781 ASSIGNMENTS=9610 CHECKS=2701420	SAT TT=1.352	SAT TT=0.447 ASSIGNMENTS=1308 CHECKS=1602120	SAT TT=0.136 ASSIGNMENTS=180 CHECKS=117043	SAT TT=3.679	SAT TT=0.897 ASSIGNMENTS=1248 CHECKS=609322	SAT TT=1.567	SAT TT=1.728
csp/driver/ normalized-driverlogw-04c-sat_ext.xml	SAT TT=0.118	SAT TT=1.635 CHECKS=420610 NODES=884	SAT TT=1.865 CHECKS=563609 NODES=627	SAT TT=0.52	? (TO) TT=1800.05	SAT TT=1.208 CHECKS=1017290	SAT TT=1.173 ASSIGNMENTS=31	SAT TT=1.18 ASSIGNMENTS=31	SAT TT=2.69 CHECKS=24260 NODES=292	SAT TT=2.716 CHECKS=479876 NODES=2435	SAT TT=2.669 CHECKS=851220 NODES=355	SAT TT=0.129 ASSIGNMENTS=95 CHECKS=64460	SAT TT=0.131 ASSIGNMENTS=95 CHECKS=64460	SAT TT=2.928	SAT TT=2.808	SAT TT=0.124 ASSIGNMENTS=97 CHECKS=66005	SAT TT=0.145 ASSIGNMENTS=458 CHECKS=150402	SAT TT=1.136	SAT TT=0.285 ASSIGNMENTS=591 CHECKS=754943	SAT TT=0.118 ASSIGNMENTS=95 CHECKS=64460	SAT TT=4.484	SAT TT=0.415 ASSIGNMENTS=539 CHECKS=390557	SAT TT=1.495	SAT TT=1.625
csp/driver/ normalized-driverlogw-05c-sat_ext.xml	SAT TT=0.174	SAT TT=1.939 CHECKS=517412 NODES=1333	SAT TT=1.71 CHECKS=216933 NODES=0	SAT TT=0.733	SAT TT=18.462 CHECKS=10742900	SAT TT=3.754 CHECKS=2207510	SAT TT=3.474 ASSIGNMENTS=95	SAT TT=3.633 ASSIGNMENTS=95	SAT TT=5.845 CHECKS=38628 NODES=378	SAT TT=8.709 CHECKS=10323200 NODES=41956	SAT TT=6 CHECKS=1051790 NODES=289	SAT TT=0.183 ASSIGNMENTS=74 CHECKS=59750	SAT TT=0.179 ASSIGNMENTS=74 CHECKS=59750	SAT TT=3.677	SAT TT=3.603	SAT TT=0.196 ASSIGNMENTS=117 CHECKS=133099	SAT TT=0.736 ASSIGNMENTS=5825 CHECKS=2512870	SAT TT=1.874	SAT TT=0.603 ASSIGNMENTS=873 CHECKS=1787770	SAT TT=0.174 ASSIGNMENTS=74 CHECKS=59750	SAT TT=4.455	SAT TT=0.927 ASSIGNMENTS=1279 CHECKS=418105	SAT TT=2.115	SAT TT=1.861
csp/driver/ normalized-driverlogw-08cc-sat_ext.xml	SAT TT=0.359	SAT TT=2.762 CHECKS=2027910 NODES=2613	SAT TT=3.832 CHECKS=4430730 NODES=2706	SAT TT=1.308	SAT TT=30.815 CHECKS=15004800	SAT TT=6.917 CHECKS=2820000	SAT TT=6.203 ASSIGNMENTS=76	SAT TT=6.139 ASSIGNMENTS=76	SAT TT=13.984 CHECKS=76029 NODES=489	SAT TT=17.597 CHECKS=13907500 NODES=47630	SAT TT=20.227 CHECKS=20735900 NODES=5463	SAT TT=0.365 ASSIGNMENTS=174 CHECKS=476259	SAT TT=0.367 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.484	SAT TT=4.615	SAT TT=0.53 ASSIGNMENTS=470 CHECKS=1122820	SAT TT=2.093 ASSIGNMENTS=9657 CHECKS=6612560	SAT TT=3.392	SAT TT=1.383 ASSIGNMENTS=1191 CHECKS=4009560	SAT TT=0.359 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.288	SAT TT=2.164 ASSIGNMENTS=1141 CHECKS=648302	SAT TT=2.208	SAT TT=2.282
csp/driver/ normalized-driverlogw-08c-sat_ext.xml	SAT TT=0.351	SAT TT=3.349 CHECKS=3976790 NODES=3591	SAT TT=4.645 CHECKS=5487000 NODES=3194	SAT TT=1.269	SAT TT=31.053 CHECKS=17547300	SAT TT=5.419 CHECKS=2209600	SAT TT=6.107 ASSIGNMENTS=76	SAT TT=6.154 ASSIGNMENTS=76	SAT TT=14.138 CHECKS=76056 NODES=489	SAT TT=57.988 CHECKS=134653000 NODES=490165	SAT TT=15.427 CHECKS=6441340 NODES=2234	SAT TT=0.366 ASSIGNMENTS=174 CHECKS=476259	SAT TT=0.363 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.097	SAT TT=4.959	SAT TT=0.516 ASSIGNMENTS=470 CHECKS=1122820	SAT TT=2.111 ASSIGNMENTS=9682 CHECKS=6424930	SAT TT=3.491	SAT TT=1.407 ASSIGNMENTS=1191 CHECKS=4009560	SAT TT=0.351 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.217	SAT TT=2.209 ASSIGNMENTS=1141 CHECKS=648251	SAT TT=2.264	SAT TT=2.23
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/driver/ normalized-driverlogw-09-sat_ext.xml	SAT TT=2.291	SAT TT=152.666 CHECKS=35571000 NODES=27204	SAT TT=143.575 CHECKS=33533600 NODES=23806	SAT TT=42.351	SAT TT=80.622 CHECKS=34515400	SAT TT=93.872 CHECKS=41022300	SAT TT=15.952 ASSIGNMENTS=345	SAT TT=17.887 ASSIGNMENTS=345	SAT TT=141.088 CHECKS=1964450 NODES=6371	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=34.14 ASSIGNMENTS=28499 CHECKS=36491500	SAT TT=37.224 ASSIGNMENTS=28499 CHECKS=36491500	SAT TT=10.527	SAT TT=9.623	SAT TT=2.291 ASSIGNMENTS=1581 CHECKS=5209070	SAT TT=7.406 ASSIGNMENTS=14916 CHECKS=17398700	SAT TT=8.216	SAT TT=6.433 ASSIGNMENTS=2328 CHECKS=14564800	SAT TT=2.975 ASSIGNMENTS=2280 CHECKS=6973980	SAT TT=6.641	SAT TT=39.181 ASSIGNMENTS=22420 CHECKS=20207800	SAT TT=3.539	SAT TT=3.934
csp/ehi-85/ normalized-ehi-85-297-27_ext.xml	UNSAT TT=0.117	UNSAT TT=2.884 CHECKS=3285910 NODES=3193	UNSAT TT=1.264 CHECKS=36905 NODES=0	UNSAT TT=0.476	UNSAT TT=2.05 CHECKS=266353	UNSAT TT=0.565 CHECKS=6912	UNSAT TT=1.141 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=3.067 CHECKS=7188 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.139 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=0.126 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.837	UNSAT TT=4.281	UNSAT TT=0.267 ASSIGNMENTS=275 CHECKS=649240	UNSAT TT=1.299 ASSIGNMENTS=2191 CHECKS=4715440	UNSAT TT=1.645	UNSAT TT=0.117 ASSIGNMENTS=5 CHECKS=9371	UNSAT TT=0.124 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.059	UNSAT TT=2.306 ASSIGNMENTS=3 CHECKS=6698	UNSAT TT=2.043	UNSAT TT=2.695
csp/ehi-85/ normalized-ehi-85-297-30_ext.xml	UNSAT TT=0.117	UNSAT TT=1.694 CHECKS=869721 NODES=638	UNSAT TT=1.386 CHECKS=89206 NODES=0	UNSAT TT=113.315	UNSAT TT=0.641 CHECKS=16582	UNSAT TT=0.568 CHECKS=9590	UNSAT TT=1.164 ASSIGNMENTS=0	UNSAT TT=1.176 ASSIGNMENTS=0	UNSAT TT=3.156 CHECKS=12777 NODES=6	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.159 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=0.172 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.979	UNSAT TT=3.92	UNSAT TT=0.321 ASSIGNMENTS=413 CHECKS=983353	UNSAT TT=0.984 ASSIGNMENTS=1687 CHECKS=3505690	UNSAT TT=1.519	UNSAT TT=0.117 ASSIGNMENTS=15 CHECKS=17557	UNSAT TT=0.155 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.023	UNSAT TT=1.506 ASSIGNMENTS=4 CHECKS=23638	UNSAT TT=2.236	UNSAT TT=2.24
csp/ehi-85/ normalized-ehi-85-297-55_ext.xml	UNSAT TT=0.113	UNSAT TT=2.441 CHECKS=2418180 NODES=2647	UNSAT TT=1.397 CHECKS=123287 NODES=0	UNSAT TT=174.964	UNSAT TT=1.756 CHECKS=218889	UNSAT TT=0.607 CHECKS=9329	UNSAT TT=1.167 ASSIGNMENTS=0	UNSAT TT=1.165 ASSIGNMENTS=0	UNSAT TT=2.813 CHECKS=6773 NODES=4	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.199 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=0.202 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.401	UNSAT TT=4.392	UNSAT TT=0.28 ASSIGNMENTS=361 CHECKS=712175	UNSAT TT=1.803 ASSIGNMENTS=3270 CHECKS=6926100	UNSAT TT=1.713	UNSAT TT=0.113 ASSIGNMENTS=8 CHECKS=13223	UNSAT TT=0.189 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.315	UNSAT TT=1.203 ASSIGNMENTS=4 CHECKS=13836	UNSAT TT=2.319	UNSAT TT=2.653
csp/ehi-85/ normalized-ehi-85-297-78_ext.xml	UNSAT TT=0.116	UNSAT TT=1.785 CHECKS=1322880 NODES=951	UNSAT TT=1.278 CHECKS=25156 NODES=0	UNSAT TT=0.481	UNSAT TT=0.684 CHECKS=20921	UNSAT TT=0.532 CHECKS=7925	UNSAT TT=0.916 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	UNSAT TT=2.747 CHECKS=9420 NODES=9	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.169 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=0.163 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=4.797	UNSAT TT=4.208	UNSAT TT=0.354 ASSIGNMENTS=357 CHECKS=998078	UNSAT TT=1.799 ASSIGNMENTS=3047 CHECKS=6753030	UNSAT TT=1.596	UNSAT TT=0.116 ASSIGNMENTS=5 CHECKS=10548	UNSAT TT=0.15 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=3.915	UNSAT TT=0.509 ASSIGNMENTS=4 CHECKS=13540	UNSAT TT=2.081	UNSAT TT=2.476
csp/ehi-85/ normalized-ehi-85-297-96_ext.xml	UNSAT TT=0.114	UNSAT TT=1.774 CHECKS=1016450 NODES=987	UNSAT TT=1.272 CHECKS=13771 NODES=0	UNSAT TT=0.488	UNSAT TT=0.655 CHECKS=15148	UNSAT TT=0.619 CHECKS=10155	UNSAT TT=1.06 ASSIGNMENTS=0	UNSAT TT=0.969 ASSIGNMENTS=0	UNSAT TT=2.785 CHECKS=7433 NODES=4	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.13 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=0.129 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=4.858	UNSAT TT=3.981	UNSAT TT=0.119 ASSIGNMENTS=4 CHECKS=8925	UNSAT TT=1.935 ASSIGNMENTS=3569 CHECKS=7550430	UNSAT TT=1.628	UNSAT TT=0.115 ASSIGNMENTS=9 CHECKS=14698	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=3.896	UNSAT TT=0.8 ASSIGNMENTS=3 CHECKS=17099	UNSAT TT=2.054	UNSAT TT=2.501
csp/ehi-90/ normalized-ehi-90-315-51_ext.xml	UNSAT TT=0.121	UNSAT TT=2.365 CHECKS=2305600 NODES=2598	UNSAT TT=1.267 CHECKS=13957 NODES=0	UNSAT TT=0.477	UNSAT TT=0.657 CHECKS=15653	UNSAT TT=0.606 CHECKS=9327	UNSAT TT=0.904 ASSIGNMENTS=0	UNSAT TT=0.923 ASSIGNMENTS=0	UNSAT TT=3.124 CHECKS=8151 NODES=8	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.204 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=0.199 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.572	UNSAT TT=4.557	UNSAT TT=0.247 ASSIGNMENTS=298 CHECKS=607334	UNSAT TT=2.26 ASSIGNMENTS=3655 CHECKS=8660490	UNSAT TT=1.638	UNSAT TT=0.121 ASSIGNMENTS=4 CHECKS=10599	UNSAT TT=0.177 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.065	UNSAT TT=1.051 ASSIGNMENTS=5 CHECKS=14051	UNSAT TT=2.456	UNSAT TT=2.286
csp/ehi-90/ normalized-ehi-90-315-54_ext.xml	UNSAT TT=0.12	UNSAT TT=1.718 CHECKS=1007030 NODES=764	UNSAT TT=1.325 CHECKS=8062 NODES=0	UNSAT TT=0.506	UNSAT TT=0.647 CHECKS=15589	UNSAT TT=0.594 CHECKS=11232	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.908 ASSIGNMENTS=0	UNSAT TT=3.004 CHECKS=5566 NODES=6	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.192 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=0.193 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=4.621	UNSAT TT=4.449	UNSAT TT=0.444 ASSIGNMENTS=534 CHECKS=1286630	UNSAT TT=1.884 ASSIGNMENTS=3315 CHECKS=7238890	UNSAT TT=1.466	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=9936	UNSAT TT=0.184 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=3.824	UNSAT TT=1.363 ASSIGNMENTS=17 CHECKS=40585	UNSAT TT=2.183	UNSAT TT=2.731
csp/ehi-90/ normalized-ehi-90-315-65_ext.xml	UNSAT TT=0.12	UNSAT TT=1.987 CHECKS=1482220 NODES=1255	UNSAT TT=1.306 CHECKS=16111 NODES=0	UNSAT TT=0.505	UNSAT TT=0.643 CHECKS=10958	UNSAT TT=0.564 CHECKS=8441	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=0.957 ASSIGNMENTS=0	UNSAT TT=3.205 CHECKS=7211 NODES=4	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.134 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=0.136 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=4.571	UNSAT TT=4.284	UNSAT TT=0.272 ASSIGNMENTS=277 CHECKS=622360	UNSAT TT=0.686 ASSIGNMENTS=1149 CHECKS=2491840	UNSAT TT=1.646	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=10432	UNSAT TT=0.122 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=3.994	UNSAT TT=1.589 ASSIGNMENTS=4 CHECKS=15331	UNSAT TT=2.144	UNSAT TT=2.437
csp/ehi-90/ normalized-ehi-90-315-71_ext.xml	UNSAT TT=0.121	UNSAT TT=2.521 CHECKS=2640420 NODES=2648	UNSAT TT=1.259 CHECKS=11438 NODES=0	UNSAT TT=0.502	UNSAT TT=0.65 CHECKS=18297	UNSAT TT=0.552 CHECKS=8734	UNSAT TT=0.883 ASSIGNMENTS=0	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=3.071 CHECKS=5925 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.159 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=0.156 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.592	UNSAT TT=4.417	UNSAT TT=0.325 ASSIGNMENTS=327 CHECKS=913000	UNSAT TT=1.124 ASSIGNMENTS=1792 CHECKS=4009430	UNSAT TT=1.59	UNSAT TT=0.121 ASSIGNMENTS=5 CHECKS=10324	UNSAT TT=0.139 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.203	UNSAT TT=1.619 ASSIGNMENTS=5 CHECKS=16829	UNSAT TT=2.24	UNSAT TT=2.611
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ehi-90/ normalized-ehi-90-315-95_ext.xml	UNSAT TT=0.114	UNSAT TT=1.996 CHECKS=877654 NODES=1509	UNSAT TT=1.37 CHECKS=66886 NODES=0	UNSAT TT=34.105	UNSAT TT=0.61 CHECKS=15631	UNSAT TT=0.556 CHECKS=6983	UNSAT TT=0.879 ASSIGNMENTS=0	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=3.118 CHECKS=6624 NODES=4	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.134 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=0.13 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=4.547	UNSAT TT=4.613	UNSAT TT=0.129 ASSIGNMENTS=71 CHECKS=41844	UNSAT TT=1.017 ASSIGNMENTS=1621 CHECKS=3669060	UNSAT TT=1.511	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=9430	UNSAT TT=0.125 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=3.853	UNSAT TT=2.05 ASSIGNMENTS=3 CHECKS=8570	UNSAT TT=2.159	UNSAT TT=2.525
csp/frb30-15/ normalized-frb30-15-2_ext.xml	SAT TT=0.48	SAT TT=1.176 CHECKS=1297170 NODES=1277	SAT TT=1.227 CHECKS=1322770 NODES=1268	SAT TT=1.118	SAT TT=4.227 CHECKS=1528470	SAT TT=12.847 CHECKS=5075230	SAT TT=3.55 ASSIGNMENTS=4256	SAT TT=6.611 ASSIGNMENTS=4256	SAT TT=3.175 CHECKS=730474 NODES=9587	SAT TT=0.746 CHECKS=1117400 NODES=3869	? (TO) TT=1800.01	SAT TT=0.772 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=0.767 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=3.906	SAT TT=8.538	SAT TT=0.48 ASSIGNMENTS=5794 CHECKS=2176340	SAT TT=0.791 ASSIGNMENTS=10173 CHECKS=3325610	SAT TT=7.818	SAT TT=0.759 ASSIGNMENTS=8492 CHECKS=3243040	SAT TT=0.742 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=7.679	SAT TT=6.992 ASSIGNMENTS=3908 CHECKS=5281080	SAT TT=2.372	SAT TT=4.91
csp/frb30-15/ normalized-frb30-15-3_ext.xml	SAT TT=0.232	SAT TT=1.436 CHECKS=2200670 NODES=2076	SAT TT=1.374 CHECKS=2245180 NODES=2116	SAT TT=0.873	SAT TT=8.603 CHECKS=2986530	SAT TT=1.246 CHECKS=447432	SAT TT=3.11 ASSIGNMENTS=3205	SAT TT=2.925 ASSIGNMENTS=3205	SAT TT=1.391 CHECKS=255344 NODES=3153	SAT TT=0.847 CHECKS=1484340 NODES=5241	? (TO) TT=1800.01	SAT TT=0.618 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=0.611 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=3.224	SAT TT=3.781	SAT TT=0.251 ASSIGNMENTS=2502 CHECKS=981803	SAT TT=0.232 ASSIGNMENTS=3601 CHECKS=870854	SAT TT=2.914	SAT TT=0.564 ASSIGNMENTS=6040 CHECKS=2325810	SAT TT=0.55 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=10.667	SAT TT=1.787 ASSIGNMENTS=902 CHECKS=1402030	SAT TT=3.212	SAT TT=2.107
csp/frb30-15/ normalized-frb30-15-3-mgd_ext.xml	SAT TT=0.104	SAT TT=1.485 CHECKS=2050380 NODES=1974	SAT TT=1.56 CHECKS=2357120 NODES=2190	SAT TT=0.844	SAT TT=7.032 CHECKS=2593850	SAT TT=0.756 CHECKS=239356	SAT TT=2.013 ASSIGNMENTS=1872	SAT TT=2.193 ASSIGNMENTS=1872	SAT TT=0.625 CHECKS=20868 NODES=190	SAT TT=1.414 CHECKS=4458570 NODES=20899	? (TO) TT=1800.03	SAT TT=0.117 ASSIGNMENTS=946 CHECKS=358327	SAT TT=0.124 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.446	SAT TT=3.781	SAT TT=0.104 ASSIGNMENTS=829 CHECKS=311856	SAT TT=0.225 ASSIGNMENTS=3494 CHECKS=796360	SAT TT=1.298	SAT TT=0.124 ASSIGNMENTS=1188 CHECKS=412758	SAT TT=0.114 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.645	SAT TT=4.139 ASSIGNMENTS=2754 CHECKS=4194390	SAT TT=1.174	SAT TT=1.375
csp/frb30-15/ normalized-frb30-15-4_ext.xml	SAT TT=0.535	SAT TT=1.471 CHECKS=2149640 NODES=2044	SAT TT=1.476 CHECKS=2001490 NODES=1873	SAT TT=0.569	SAT TT=13.818 CHECKS=4880750	SAT TT=7.603 CHECKS=3098850	SAT TT=2.69 ASSIGNMENTS=3280	SAT TT=2.671 ASSIGNMENTS=3280	SAT TT=1.934 CHECKS=385312 NODES=4958	SAT TT=0.795 CHECKS=1387120 NODES=4912	SAT TT=1.094 CHECKS=2253980 NODES=4524	SAT TT=0.563 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=0.549 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=3.375	SAT TT=5.238	SAT TT=0.569 ASSIGNMENTS=6310 CHECKS=2346240	SAT TT=0.626 ASSIGNMENTS=8407 CHECKS=2575520	SAT TT=5.152	SAT TT=0.538 ASSIGNMENTS=6574 CHECKS=2432320	SAT TT=0.535 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=5.162	SAT TT=3.59 ASSIGNMENTS=1245 CHECKS=1766670	SAT TT=2.1	SAT TT=1.962
csp/frb30-15/ normalized-frb30-15-5-mgd_ext.xml	SAT TT=0.076	SAT TT=1.641 CHECKS=3631220 NODES=3306	SAT TT=1.642 CHECKS=3560470 NODES=3191	SAT TT=0.575	SAT TT=23.173 CHECKS=8382770	SAT TT=1.881 CHECKS=583739	SAT TT=1.315 ASSIGNMENTS=867	SAT TT=1.311 ASSIGNMENTS=867	SAT TT=1.028 CHECKS=159171 NODES=1547	SAT TT=0.951 CHECKS=2146380 NODES=10447	? (TO) TT=1800.03	SAT TT=0.086 ASSIGNMENTS=515 CHECKS=198122	SAT TT=0.087 ASSIGNMENTS=515 CHECKS=198122	SAT TT=2.669	SAT TT=2.176	SAT TT=0.167 ASSIGNMENTS=1652 CHECKS=656748	SAT TT=0.33 ASSIGNMENTS=4633 CHECKS=1235290	SAT TT=2.201	SAT TT=0.161 ASSIGNMENTS=1668 CHECKS=610834	SAT TT=0.076 ASSIGNMENTS=515 CHECKS=198122	SAT TT=4.008	SAT TT=1.455 ASSIGNMENTS=1473 CHECKS=2469010	SAT TT=1.161	SAT TT=1.591
csp/frb35-17/ normalized-frb35-17-1_ext.xml	SAT TT=1.414	SAT TT=4.267 CHECKS=17982000 NODES=13236	SAT TT=4.222 CHECKS=17404500 NODES=12846	SAT TT=1.711	SAT TT=20.617 CHECKS=6364460	SAT TT=10.276 CHECKS=3036390	SAT TT=5.716 ASSIGNMENTS=6144	SAT TT=5.852 ASSIGNMENTS=6144	SAT TT=5.297 CHECKS=1370210 NODES=14470	SAT TT=2.361 CHECKS=13076700 NODES=38829	? (TO) TT=1800.04	SAT TT=1.505 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=9.1 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=12.389	SAT TT=77.162	SAT TT=1.414 ASSIGNMENTS=13166 CHECKS=5972560	SAT TT=1.427 ASSIGNMENTS=14626 CHECKS=5926340	SAT TT=26.611	SAT TT=1.445 ASSIGNMENTS=13301 CHECKS=6010240	SAT TT=1.583 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=56.176	SAT TT=14.269 ASSIGNMENTS=7192 CHECKS=13335200	SAT TT=14.802	SAT TT=15.327
csp/frb35-17/ normalized-frb35-17-1-mgd_ext.xml	SAT TT=0.455	SAT TT=4.074 CHECKS=16945800 NODES=12506	SAT TT=4.231 CHECKS=17529200 NODES=12965	SAT TT=2.011	SAT TT=13.679 CHECKS=4191500	SAT TT=14.89 CHECKS=3985110	SAT TT=8.823 ASSIGNMENTS=9389	SAT TT=8.923 ASSIGNMENTS=9389	SAT TT=2.899 CHECKS=925837 NODES=7788	SAT TT=6.556 CHECKS=43404000 NODES=171674	? (TO) TT=1800.02	SAT TT=1.436 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=1.435 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=14.304	SAT TT=47.528	SAT TT=1.032 ASSIGNMENTS=9529 CHECKS=4391920	SAT TT=1.053 ASSIGNMENTS=10522 CHECKS=4107470	SAT TT=19.22	SAT TT=0.455 ASSIGNMENTS=3877 CHECKS=1665750	SAT TT=1.422 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=24.086	SAT TT=15.484 ASSIGNMENTS=12733 CHECKS=24512300	SAT TT=10.009	SAT TT=19.222
csp/frb35-17/ normalized-frb35-17-2_ext.xml	SAT TT=1.292	SAT TT=6.764 CHECKS=32619000 NODES=26172	SAT TT=7.012 CHECKS=30940000 NODES=24648	SAT TT=1.292	SAT TT=109.451 CHECKS=34546600	SAT TT=71.819 CHECKS=23712600	SAT TT=23.19 ASSIGNMENTS=30811	SAT TT=21.731 ASSIGNMENTS=30811	SAT TT=16.052 CHECKS=4642070 NODES=53894	SAT TT=32.967 CHECKS=239608000 NODES=719505	? (TO) TT=1800.08	SAT TT=9.625 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.263 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.045	SAT TT=122.021	SAT TT=6.453 ASSIGNMENTS=63528 CHECKS=27836600	SAT TT=1.626 ASSIGNMENTS=18543 CHECKS=7393470	SAT TT=119.057	SAT TT=1.646 ASSIGNMENTS=15967 CHECKS=6859800	SAT TT=2.796 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=217.797	SAT TT=41.848 ASSIGNMENTS=28391 CHECKS=45506800	SAT TT=22.863	SAT TT=4.26
csp/frb35-17/ normalized-frb35-17-2-mgd_ext.xml	SAT TT=1.04	SAT TT=7.054 CHECKS=31423100 NODES=25353	SAT TT=7.378 CHECKS=33449100 NODES=26916	SAT TT=1.206	SAT TT=144.091 CHECKS=44230300	SAT TT=95.396 CHECKS=24573400	SAT TT=14.69 ASSIGNMENTS=19103	SAT TT=14.864 ASSIGNMENTS=19103	SAT TT=12.415 CHECKS=4583950 NODES=43269	SAT TT=11.06 CHECKS=73984900 NODES=294981	? (TO) TT=1800.02	SAT TT=1.424 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=1.404 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=146.405	SAT TT=33.868	SAT TT=1.66 ASSIGNMENTS=15533 CHECKS=6716900	SAT TT=1.407 ASSIGNMENTS=15433 CHECKS=6100480	SAT TT=37.496	SAT TT=1.04 ASSIGNMENTS=9896 CHECKS=4141940	SAT TT=1.507 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=170.818	SAT TT=12.521 ASSIGNMENTS=10627 CHECKS=17243600	SAT TT=71.743	SAT TT=41.51
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb35-17/ normalized-frb35-17-5_ext.xml	SAT TT=0.369	SAT TT=17.705 CHECKS=89886200 NODES=68293	SAT TT=16.402 CHECKS=89154700 NODES=67925	SAT TT=5.24	SAT TT=22.799 CHECKS=7397240	SAT TT=107.386 CHECKS=35261300	SAT TT=22.693 ASSIGNMENTS=29214	SAT TT=23.09 ASSIGNMENTS=29214	SAT TT=12.484 CHECKS=3462450 NODES=38369	SAT TT=3.645 CHECKS=20069400 NODES=60271	? (TO) TT=1800.06	SAT TT=9.848 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=9.46 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=34.783	SAT TT=194.048	SAT TT=3.725 ASSIGNMENTS=35072 CHECKS=16211400	SAT TT=0.465 ASSIGNMENTS=5323 CHECKS=1795740	SAT TT=35.136	SAT TT=2.086 ASSIGNMENTS=19113 CHECKS=8798110	SAT TT=2.434 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=393.296	SAT TT=0.369 ASSIGNMENTS=224 CHECKS=269523	SAT TT=56.455	SAT TT=76.906
csp/frb40-19/ normalized-frb40-19-1_ext.xml	SAT TT=1.284	SAT TT=1.473 CHECKS=1486350 NODES=1112	SAT TT=1.284 CHECKS=1395190 NODES=997	SAT TT=9.429	SAT TT=444.893 CHECKS=113052000	SAT TT=476.993 CHECKS=135474000	SAT TT=28.796 ASSIGNMENTS=31770	SAT TT=29.867 ASSIGNMENTS=31770	SAT TT=29.909 CHECKS=8685270 NODES=81694	SAT TT=2.871 CHECKS=16974000 NODES=44106	? (TO) TT=1800.06	SAT TT=17.506 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=8.907 ASSIGNMENTS=1112 CHECKS=1486350	SAT TT=32.975	SAT TT=4.168	SAT TT=10.181 ASSIGNMENTS=81156 CHECKS=41923900	SAT TT=10.059 ASSIGNMENTS=81824 CHECKS=41651600	SAT TT=73.093	SAT TT=9.4 ASSIGNMENTS=78925 CHECKS=40697200	SAT TT=9.914 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=276.901	SAT TT=116.309 ASSIGNMENTS=50335 CHECKS=104712000	SAT TT=46.349	SAT TT=40.14
csp/frb40-19/ normalized-frb40-19-1-mgd_ext.xml	SAT TT=1.265	SAT TT=1.462 CHECKS=2543180 NODES=1893	SAT TT=1.265 CHECKS=1047030 NODES=744	SAT TT=9.971	SAT TT=703.803 CHECKS=189262000	SAT TT=29.645 CHECKS=5676960	SAT TT=29.123 ASSIGNMENTS=30271	SAT TT=29.503 ASSIGNMENTS=30271	SAT TT=15.225 CHECKS=5281000 NODES=40765	SAT TT=2.509 CHECKS=13794700 NODES=45990	? (TO) TT=1800.03	SAT TT=12.722 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=8.661 ASSIGNMENTS=1893 CHECKS=2543180	SAT TT=56.419	SAT TT=132.725	SAT TT=5.454 ASSIGNMENTS=43261 CHECKS=23091600	SAT TT=5.362 ASSIGNMENTS=41197 CHECKS=21070800	SAT TT=53.618	SAT TT=5.451 ASSIGNMENTS=43164 CHECKS=23027900	SAT TT=6.021 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=68.325	SAT TT=79.653 ASSIGNMENTS=49268 CHECKS=103013000	SAT TT=8.493	SAT TT=35.889
csp/frb40-19/ normalized-frb40-19-2_ext.xml	SAT TT=1.401	SAT TT=1.401 CHECKS=1968880 NODES=1491	SAT TT=1.492 CHECKS=2250610 NODES=1749	SAT TT=35.332	SAT TT=412.852 CHECKS=109540000	SAT TT=139.972 CHECKS=36091400	SAT TT=51.201 ASSIGNMENTS=62844	SAT TT=54.55 ASSIGNMENTS=62844	SAT TT=29.252 CHECKS=7789540 NODES=73522	SAT TT=51.095 CHECKS=365420000 NODES=951552	? (TO) TT=1800.04	SAT TT=22.778 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=9.219 ASSIGNMENTS=1491 CHECKS=1968880	SAT TT=67.686	SAT TT=383.43	SAT TT=14.262 ASSIGNMENTS=123409 CHECKS=63059400	SAT TT=8.142 ASSIGNMENTS=66182 CHECKS=33546700	SAT TT=108.797	SAT TT=9.856 ASSIGNMENTS=78210 CHECKS=40268900	SAT TT=15.19 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=333.918	SAT TT=168.113 ASSIGNMENTS=137602 CHECKS=273439000	SAT TT=80.349	SAT TT=194.22
csp/frb40-19/ normalized-frb40-19-2-mgd_ext.xml	SAT TT=1.833	SAT TT=2.053 CHECKS=4801120 NODES=3785	SAT TT=1.908 CHECKS=3823490 NODES=2909	SAT TT=11.158	SAT TT=344.771 CHECKS=88365000	SAT TT=161.67 CHECKS=32992300	SAT TT=16.038 ASSIGNMENTS=17329	SAT TT=17.402 ASSIGNMENTS=17329	SAT TT=24.206 CHECKS=8871590 NODES=69356	SAT TT=27.059 CHECKS=184894000 NODES=610905	? (TO) TT=1800	SAT TT=18.743 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=9.836 ASSIGNMENTS=3785 CHECKS=4801120	SAT TT=97.854	SAT TT=226.271	SAT TT=11.777 ASSIGNMENTS=88457 CHECKS=46753900	SAT TT=10.891 ASSIGNMENTS=89318 CHECKS=46667200	SAT TT=37.788	SAT TT=1.833 ASSIGNMENTS=14154 CHECKS=6941560	SAT TT=11.657 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=485.443	SAT TT=122.091 ASSIGNMENTS=48051 CHECKS=95391700	SAT TT=113.424	SAT TT=118.982
csp/frb40-19/ normalized-frb40-19-4-mgd_ext.xml	SAT TT=11.577	SAT TT=77.087 CHECKS=461083000 NODES=305197	SAT TT=80.622 CHECKS=451112000 NODES=297888	SAT TT=11.577	SAT TT=553.672 CHECKS=156444000	SAT TT=548.543 CHECKS=118406000	SAT TT=23.744 ASSIGNMENTS=24644	SAT TT=23.428 ASSIGNMENTS=24644	SAT TT=28.12 CHECKS=9476980 NODES=76187	SAT TT=21.197 CHECKS=152218000 NODES=494901	? (TO) TT=1800.01	SAT TT=33.728 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=84.116 ASSIGNMENTS=305197 CHECKS=461083000	SAT TT=1688.18	SAT TT=204.461	SAT TT=27.784 ASSIGNMENTS=213490 CHECKS=110685000	SAT TT=26.586 ASSIGNMENTS=201173 CHECKS=103774000	SAT TT=163.345	SAT TT=25.784 ASSIGNMENTS=196827 CHECKS=102505000	SAT TT=25.79 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=1395.18	SAT TT=306.9 ASSIGNMENTS=221577 CHECKS=455603000	SAT TT=183.355	SAT TT=192.929
csp/frb45-21/ normalized-frb45-21-1-mgd_ext.xml	SAT TT=6.494	SAT TT=6.494 CHECKS=30155700 NODES=19236	SAT TT=11.591 CHECKS=59132800 NODES=36674	SAT TT=850.839	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1393.89 ASSIGNMENTS=1528250	SAT TT=1419.21 ASSIGNMENTS=1528250	SAT TT=1445.67 CHECKS=453893000 NODES=3615300	SAT TT=76.666 CHECKS=591535000 NODES=1628720	? (TO) TT=1800.1	SAT TT=13.345 ASSIGNMENTS=19236 CHECKS=30155700	SAT TT=13.666 ASSIGNMENTS=19236 CHECKS=30155700	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=343.817 ASSIGNMENTS=2424200 CHECKS=1408590000	SAT TT=545.998 ASSIGNMENTS=3944080 CHECKS=2290690000	? (TO) TT=1800.12	SAT TT=732.982 ASSIGNMENTS=5262120 CHECKS=3087180000	SAT TT=726.1 ASSIGNMENTS=5272420 CHECKS=3090050000	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/frb45-21/ normalized-frb45-21-2_ext.xml	SAT TT=56.465	SAT TT=281.714 CHECKS=1630410000 NODES=992992	SAT TT=267.357 CHECKS=1643270000 NODES=1001220	SAT TT=162.023	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=364.334 ASSIGNMENTS=415146	SAT TT=370.812 ASSIGNMENTS=415146	SAT TT=62.15 CHECKS=15563400 NODES=143904	SAT TT=93.128 CHECKS=734694000 NODES=1675070	? (TO) TT=1800.05	SAT TT=287.579 ASSIGNMENTS=992992 CHECKS=1630410000	SAT TT=266.698 ASSIGNMENTS=992992 CHECKS=1630410000	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=157.098 ASSIGNMENTS=1136460 CHECKS=634265000	SAT TT=74.146 ASSIGNMENTS=539450 CHECKS=299255000	? (TO) TT=1800.11	SAT TT=175.98 ASSIGNMENTS=1258950 CHECKS=701831000	SAT TT=171.932 ASSIGNMENTS=1255070 CHECKS=699122000	? (TO) TT=1800.13	SAT TT=1622.18 ASSIGNMENTS=1446710 CHECKS=2843190000	SAT TT=56.465	SAT TT=754.475
csp/frb45-21/ normalized-frb45-21-3_ext.xml	SAT TT=148.506	SAT TT=181.416 CHECKS=1051930000 NODES=646600	SAT TT=174.114 CHECKS=1006020000 NODES=617234	SAT TT=148.506	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=487.654 ASSIGNMENTS=540035	SAT TT=491.026 ASSIGNMENTS=540035	SAT TT=1029.22 CHECKS=276126000 NODES=2527100	SAT TT=544.747 CHECKS=3873220000 NODES=8840730	? (TO) TT=1800.06	SAT TT=175.484 ASSIGNMENTS=646600 CHECKS=1051930000	SAT TT=175.45 ASSIGNMENTS=646600 CHECKS=1051930000	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=323.165 ASSIGNMENTS=2494740 CHECKS=1396940000	SAT TT=350.881 ASSIGNMENTS=2492820 CHECKS=1395820000	? (TO) TT=1800.1	SAT TT=371.761 ASSIGNMENTS=2688050 CHECKS=1496940000	SAT TT=306.679 ASSIGNMENTS=2298810 CHECKS=1279990000	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.04
csp/frb45-21/ normalized-frb45-21-4-mgd_ext.xml	SAT TT=33.995	SAT TT=464.625 CHECKS=2713320000 NODES=1581910	SAT TT=475.64 CHECKS=2712720000 NODES=1581220	SAT TT=212.315	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=468.567 ASSIGNMENTS=457995	SAT TT=456.294 ASSIGNMENTS=457995	SAT TT=258.271 CHECKS=86349900 NODES=637252	SAT TT=33.995 CHECKS=254471000 NODES=729987	? (TO) TT=1800.07	SAT TT=510.08 ASSIGNMENTS=740055 CHECKS=432669000	SAT TT=533.522 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=116.442 ASSIGNMENTS=813570 CHECKS=476930000	SAT TT=115.028 ASSIGNMENTS=809045 CHECKS=471841000	SAT TT=594.335	SAT TT=100.864 ASSIGNMENTS=703434 CHECKS=410663000	SAT TT=111.353 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.16	SAT TT=1410.35 ASSIGNMENTS=771186 CHECKS=1766350000	? (TO) TT=1800.14	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb45-21/ normalized-frb45-21-5_ext.xml	SAT TT=51.605	SAT TT=1205.42 CHECKS=7698180000 NODES=4608170	SAT TT=1192.99 CHECKS=7596680000 NODES=4566800	SAT TT=310.574	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=1417.99 ASSIGNMENTS=1634200	SAT TT=1379.45 ASSIGNMENTS=1634200	SAT TT=1715.49 CHECKS=447491000 NODES=4066110	SAT TT=1439.2 CHECKS=11194400000 NODES=25467000	? (TO) TT=1800.09	SAT TT=1217.77 ASSIGNMENTS=4608170 CHECKS=7698180000	SAT TT=616.419 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=146.384 ASSIGNMENTS=1131400 CHECKS=639110000	SAT TT=51.605 ASSIGNMENTS=395471 CHECKS=221508000	? (TO) TT=1800.06	SAT TT=228.028 ASSIGNMENTS=1635840 CHECKS=922834000	SAT TT=211.723 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	SAT TT=303.121 ASSIGNMENTS=134246 CHECKS=285696000	SAT TT=1169.44	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-1_ext.xml	SAT TT=146.492	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=146.492 CHECKS=1173860000 NODES=2373200	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=695.497 ASSIGNMENTS=4795790 CHECKS=2908190000	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/frb50-23/ normalized-frb50-23-2_ext.xml	SAT TT=723.997	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=723.997 CHECKS=5766420000 NODES=11594900	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/frb50-23/ normalized-frb50-23-3-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/frb50-23/ normalized-frb50-23-4_ext.xml	SAT TT=31.085	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.01	SAT TT=31.085 CHECKS=244381000 NODES=496298	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1092.62 ASSIGNMENTS=7048760 CHECKS=4249560000	SAT TT=1217.49 ASSIGNMENTS=8344290 CHECKS=837528000	? (TO) TT=1800.12	SAT TT=53.65 ASSIGNMENTS=352179 CHECKS=210349000	SAT TT=1013.87 ASSIGNMENTS=7063340 CHECKS=4262920000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-5-mgd_ext.xml	SAT TT=114.342	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=114.342 CHECKS=827626000 NODES=2125900	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=873.609 ASSIGNMENTS=5087140 CHECKS=3257300000	SAT TT=857.956 ASSIGNMENTS=5080320 CHECKS=3251550000	? (TO) TT=1800.09	SAT TT=497.023 ASSIGNMENTS=3112150 CHECKS=1970790000	SAT TT=892.124 ASSIGNMENTS=5637970 CHECKS=3604650000	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/frb53-24/ normalized-frb53-24-1_ext.xml	SAT TT=321.702	SAT TT=342.275 CHECKS=2177490000 NODES=1127960	SAT TT=321.702 CHECKS=2106410000 NODES=1085060	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=359.785 ASSIGNMENTS=1127960 CHECKS=2177490000	SAT TT=347.514 ASSIGNMENTS=1127960 CHECKS=2177490000	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/frb53-24/ normalized-frb53-24-2-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/frb53-24/ normalized-frb53-24-3-mgd_ext.xml	SAT TT=166.74	SAT TT=1232.69 CHECKS=7918130000 NODES=4090410	SAT TT=166.74 CHECKS=970369000 NODES=524253	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=483.531 CHECKS=3459900000 NODES=8210420	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/frb53-24/ normalized-frb53-24-5_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb53-24/ normalized-frb53-24-5-mgd_ext.xml	SAT TT=357.979	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=357.979 CHECKS=2528940000 NODES=5884320	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/frb56-25/ normalized-frb56-25-2_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-2-mgd_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/frb56-25/ normalized-frb56-25-4_ext.xml	SAT TT=1708.24	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT TT=1708.24 CHECKS=13675700000 NODES=24792100	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/frb56-25/ normalized-frb56-25-4-mgd_ext.xml	SAT TT=799.497	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=799.497 CHECKS=6301600000 NODES=13590800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-5-mgd_ext.xml	SAT TT=198.782	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=198.782 CHECKS=1553000000 NODES=3433000	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/frb59-26/ normalized-frb59-26-2_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/frb59-26/ normalized-frb59-26-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/frb59-26/ normalized-frb59-26-3-mgd_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15
csp/frb59-26/ normalized-frb59-26-4-mgd_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb59-26/ normalized-frb59-26-5-mgd_ext.xml	SAT TT=60.642	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=60.642 CHECKS=442901000 NODES=937734	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/geom/ normalized-geo50-20-d4-75-18_ext.xml	SAT TT=0.081	SAT TT=1.266 CHECKS=68641 NODES=97	SAT TT=0.991 CHECKS=89174 NODES=58	SAT TT=1.231	SAT TT=0.483 CHECKS=48545	SAT TT=0.278 CHECKS=17437	SAT TT=1.107 ASSIGNMENTS=62	SAT TT=1.113 ASSIGNMENTS=62	SAT TT=0.913 CHECKS=36939 NODES=234	SAT TT=0.782 CHECKS=218585 NODES=474	SAT TT=1.368 CHECKS=4832670 NODES=7293	SAT TT=0.094 ASSIGNMENTS=110 CHECKS=53835	SAT TT=0.095 ASSIGNMENTS=110 CHECKS=53835	SAT TT=4.098	SAT TT=3.394	SAT TT=0.081 ASSIGNMENTS=103 CHECKS=48110	SAT TT=0.435 ASSIGNMENTS=4975 CHECKS=1398780	SAT TT=2.128	SAT TT=0.148 ASSIGNMENTS=1125 CHECKS=357505	SAT TT=0.081 ASSIGNMENTS=110 CHECKS=53835	SAT TT=3.515	SAT TT=0.257 ASSIGNMENTS=62 CHECKS=80140	SAT TT=1.734	SAT TT=1.899
csp/geom/ normalized-geo50-20-d4-75-40_ext.xml	SAT TT=0.057	SAT TT=0.963 CHECKS=17947 NODES=54	SAT TT=0.99 CHECKS=53787 NODES=52	SAT TT=1.025	SAT TT=0.274 CHECKS=12365	SAT TT=0.184 CHECKS=2024	SAT TT=0.831 ASSIGNMENTS=31	SAT TT=0.807 ASSIGNMENTS=31	SAT TT=0.746 CHECKS=10454 NODES=69	SAT TT=0.737 CHECKS=65689 NODES=100	SAT TT=0.929 CHECKS=114498 NODES=138	SAT TT=0.073 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.072 ASSIGNMENTS=33 CHECKS=4305	SAT TT=3.298	SAT TT=3.113	SAT TT=0.057 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=3718	SAT TT=0.989	SAT TT=0.066 ASSIGNMENTS=104 CHECKS=26390	SAT TT=0.061 ASSIGNMENTS=33 CHECKS=4305	SAT TT=2.387	SAT TT=0.15 ASSIGNMENTS=50 CHECKS=44682	SAT TT=1.542	SAT TT=1.782
csp/geom/ normalized-geo50-20-d4-75-42_ext.xml	SAT TT=0.067	SAT TT=0.937 CHECKS=18396 NODES=50	SAT TT=1.045 CHECKS=63541 NODES=50	SAT TT=1.196	SAT TT=0.313 CHECKS=21426	SAT TT=0.21 CHECKS=5152	SAT TT=1.038 ASSIGNMENTS=31	SAT TT=0.885 ASSIGNMENTS=31	SAT TT=0.964 CHECKS=15810 NODES=99	SAT TT=0.812 CHECKS=95424 NODES=183	SAT TT=0.806 CHECKS=95470 NODES=99	SAT TT=0.079 ASSIGNMENTS=42 CHECKS=9017	SAT TT=0.074 ASSIGNMENTS=42 CHECKS=9017	SAT TT=3.75	SAT TT=2.91	SAT TT=0.069 ASSIGNMENTS=42 CHECKS=9434	SAT TT=0.268 ASSIGNMENTS=4339 CHECKS=874003	SAT TT=0.852	SAT TT=0.126 ASSIGNMENTS=1144 CHECKS=281803	SAT TT=0.067 ASSIGNMENTS=42 CHECKS=9017	SAT TT=2.667	SAT TT=0.16 ASSIGNMENTS=100 CHECKS=72018	SAT TT=1.825	SAT TT=1.819
csp/geom/ normalized-geo50-20-d4-75-45_ext.xml	SAT TT=0.069	SAT TT=1.077 CHECKS=628215 NODES=487	SAT TT=1.173 CHECKS=108918 NODES=81	SAT TT=1.185	SAT TT=1.094 CHECKS=191078	SAT TT=0.331 CHECKS=29852	SAT TT=0.943 ASSIGNMENTS=185	SAT TT=1.024 ASSIGNMENTS=185	SAT TT=1.002 CHECKS=65734 NODES=557	SAT TT=0.788 CHECKS=359377 NODES=822	SAT TT=0.808 CHECKS=185624 NODES=287	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=3.53	SAT TT=7.458	SAT TT=0.079 ASSIGNMENTS=222 CHECKS=79863	SAT TT=0.315 ASSIGNMENTS=4708 CHECKS=1024100	SAT TT=1.187	SAT TT=0.16 ASSIGNMENTS=1395 CHECKS=421629	SAT TT=0.069 ASSIGNMENTS=106 CHECKS=32570	SAT TT=4.51	SAT TT=0.233 ASSIGNMENTS=82 CHECKS=126800	SAT TT=1.655	SAT TT=2.206
csp/geom/ normalized-geo50-20-d4-75-49_ext.xml	SAT TT=0.07	SAT TT=0.963 CHECKS=56150 NODES=83	SAT TT=1.049 CHECKS=124721 NODES=91	SAT TT=1.269	SAT TT=0.389 CHECKS=28976	SAT TT=0.225 CHECKS=5981	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.865 CHECKS=37777 NODES=338	SAT TT=1.193 CHECKS=3438000 NODES=9335	SAT TT=0.802 CHECKS=347199 NODES=553	SAT TT=0.082 ASSIGNMENTS=69 CHECKS=21485	SAT TT=0.086 ASSIGNMENTS=69 CHECKS=21485	SAT TT=3.919	SAT TT=3.486	SAT TT=0.07 ASSIGNMENTS=64 CHECKS=18153	SAT TT=0.325 ASSIGNMENTS=4391 CHECKS=1032260	SAT TT=1.383	SAT TT=0.13 ASSIGNMENTS=1125 CHECKS=308038	SAT TT=0.075 ASSIGNMENTS=69 CHECKS=21485	SAT TT=2.886	SAT TT=0.283 ASSIGNMENTS=55 CHECKS=54416	SAT TT=1.879	SAT TT=1.897
csp/geom/ normalized-geo50-20-d4-75-5_ext.xml	SAT TT=0.065	SAT TT=0.966 CHECKS=21864 NODES=57	SAT TT=0.972 CHECKS=93282 NODES=72	SAT TT=1.096	SAT TT=0.37 CHECKS=37136	SAT TT=0.218 CHECKS=10452	SAT TT=0.883 ASSIGNMENTS=75	SAT TT=1.109 ASSIGNMENTS=75	SAT TT=0.759 CHECKS=13455 NODES=98	SAT TT=0.76 CHECKS=391035 NODES=1032	SAT TT=0.724 CHECKS=92963 NODES=114	SAT TT=0.081 ASSIGNMENTS=117 CHECKS=29885	SAT TT=0.079 ASSIGNMENTS=117 CHECKS=29885	SAT TT=3.19	SAT TT=3.185	SAT TT=0.065 ASSIGNMENTS=99 CHECKS=23863	SAT TT=0.181 ASSIGNMENTS=2871 CHECKS=457140	SAT TT=0.996	SAT TT=0.117 ASSIGNMENTS=1133 CHECKS=240310	SAT TT=0.066 ASSIGNMENTS=117 CHECKS=29885	SAT TT=2.937	SAT TT=0.197 ASSIGNMENTS=88 CHECKS=83049	SAT TT=1.821	SAT TT=1.739
csp/geom/ normalized-geo50-20-d4-75-61_ext.xml	SAT TT=0.061	SAT TT=0.954 CHECKS=38010 NODES=91	SAT TT=1.03 CHECKS=97739 NODES=92	SAT TT=1.047	SAT TT=0.324 CHECKS=26359	SAT TT=0.202 CHECKS=5972	SAT TT=1.039 ASSIGNMENTS=44	SAT TT=0.865 ASSIGNMENTS=44	SAT TT=0.789 CHECKS=11221 NODES=76	SAT TT=0.784 CHECKS=176540 NODES=412	SAT TT=0.778 CHECKS=345412 NODES=608	SAT TT=0.075 ASSIGNMENTS=47 CHECKS=11763	SAT TT=0.074 ASSIGNMENTS=47 CHECKS=11763	SAT TT=3.453	SAT TT=2.81	SAT TT=0.066 ASSIGNMENTS=47 CHECKS=12102	SAT TT=0.216 ASSIGNMENTS=3897 CHECKS=652392	SAT TT=1.02	SAT TT=0.075 ASSIGNMENTS=374 CHECKS=97387	SAT TT=0.061 ASSIGNMENTS=47 CHECKS=11763	SAT TT=2.625	SAT TT=0.169 ASSIGNMENTS=87 CHECKS=98809	SAT TT=1.852	SAT TT=2.043
csp/geom/ normalized-geo50-20-d4-75-76_ext.xml	SAT TT=0.055	SAT TT=0.955 CHECKS=15975 NODES=50	SAT TT=0.927 CHECKS=50973 NODES=50	SAT TT=1.057	SAT TT=0.274 CHECKS=13171	SAT TT=0.18 CHECKS=2113	SAT TT=0.831 ASSIGNMENTS=35	SAT TT=0.841 ASSIGNMENTS=35	SAT TT=0.889 CHECKS=10428 NODES=79	SAT TT=0.722 CHECKS=73141 NODES=138	SAT TT=0.773 CHECKS=67642 NODES=73	SAT TT=0.072 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.071 ASSIGNMENTS=32 CHECKS=3782	SAT TT=3.385	SAT TT=2.817	SAT TT=0.061 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.061 ASSIGNMENTS=29 CHECKS=4008	SAT TT=0.797	SAT TT=0.062 ASSIGNMENTS=183 CHECKS=29602	SAT TT=0.055 ASSIGNMENTS=32 CHECKS=3782	SAT TT=2.373	SAT TT=0.151 ASSIGNMENTS=53 CHECKS=46198	SAT TT=1.599	SAT TT=1.922
csp/geom/ normalized-geo50-20-d4-75-94_ext.xml	UNSAT TT=33.347	UNSAT TT=117.775 CHECKS=760436000 NODES=317038	UNSAT TT=117.55 CHECKS=758397000 NODES=316376	UNSAT TT=207.383	UNSAT TT=931.035 CHECKS=182508000	UNSAT TT=396.495 CHECKS=77508800	UNSAT TT=125.408 ASSIGNMENTS=100194	UNSAT TT=125.617 ASSIGNMENTS=100194	UNSAT TT=98.615 CHECKS=27324700 NODES=201897	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=118.475 ASSIGNMENTS=317038 CHECKS=760436000	UNSAT TT=116.389 ASSIGNMENTS=317038 CHECKS=760436000	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=33.347 ASSIGNMENTS=196882 CHECKS=133720000	UNSAT TT=33.477 ASSIGNMENTS=198475 CHECKS=134262000	UNSAT TT=1354.74	UNSAT TT=33.612 ASSIGNMENTS=197273 CHECKS=133647000	UNSAT TT=33.943 ASSIGNMENTS=200233 CHECKS=136053000	? (TO) TT=1800.2	UNSAT TT=573.984 ASSIGNMENTS=210104 CHECKS=748427000	? (TO) TT=1800.05	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/geom/ normalized-geo50-20-d4-75-9_ext.xml	SAT TT=0.299	SAT TT=1.17 CHECKS=302609 NODES=244	SAT TT=1.26 CHECKS=432669 NODES=267	SAT TT=3.934	SAT TT=13.154 CHECKS=2891450	SAT TT=6.423 CHECKS=1253930	SAT TT=7.53 ASSIGNMENTS=6872	SAT TT=8.305 ASSIGNMENTS=6872	SAT TT=2.806 CHECKS=634910 NODES=4999	SAT TT=1.545 CHECKS=5144880 NODES=13132	? (TO) TT=1800.07	SAT TT=0.773 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=0.822 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=10.023	SAT TT=20.472	SAT TT=1.008 ASSIGNMENTS=7007 CHECKS=3885630	SAT TT=1.772 ASSIGNMENTS=14132 CHECKS=6607620	SAT TT=20.917	SAT TT=0.299 ASSIGNMENTS=2109 CHECKS=947107	SAT TT=0.811 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=3.138	SAT TT=0.672 ASSIGNMENTS=58 CHECKS=82264	SAT TT=1.897	SAT TT=6.247
csp/hanoi/ normalized-hanoi-3_ext.xml	SAT TT=0.006	SAT TT=0.611 CHECKS=164 NODES=6	SAT TT=0.593 CHECKS=164 NODES=0	SAT TT=0.027	SAT TT=0.006 CHECKS=17	SAT TT=0.009 CHECKS=17	SAT TT=0.327 ASSIGNMENTS=1	SAT TT=0.338 ASSIGNMENTS=1	SAT TT=0.284 CHECKS=145 NODES=6	SAT TT=0.273 CHECKS=165 NODES=0	SAT TT=0.275 CHECKS=165 NODES=0	SAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.962	SAT TT=0.837	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.269	SAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.702	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=835	SAT TT=0.462	SAT TT=0.482
csp/hanoi/ normalized-hanoi-4_ext.xml	SAT TT=0.007	SAT TT=0.619 CHECKS=2211 NODES=14	SAT TT=0.618 CHECKS=2210 NODES=0	SAT TT=0.032	SAT TT=0.018 CHECKS=49	SAT TT=0.019 CHECKS=49	SAT TT=0.37 ASSIGNMENTS=1	SAT TT=0.365 ASSIGNMENTS=1	SAT TT=0.329 CHECKS=2970 NODES=14	SAT TT=0.305 CHECKS=3157 NODES=0	SAT TT=0.305 CHECKS=3157 NODES=0	SAT TT=0.021 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.018 ASSIGNMENTS=0 CHECKS=48	SAT TT=1.742	SAT TT=1.673	SAT TT=0.008 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.301	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.008 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.973	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=13167	SAT TT=0.733	SAT TT=0.618
csp/hanoi/ normalized-hanoi-5_ext.xml	SAT TT=0.009	SAT TT=0.673 CHECKS=30105 NODES=30	SAT TT=1.231 CHECKS=30105 NODES=0	SAT TT=0.066	SAT TT=0.208 CHECKS=113	SAT TT=0.215 CHECKS=113	SAT TT=0.578 ASSIGNMENTS=1	SAT TT=0.571 ASSIGNMENTS=1	SAT TT=0.754 CHECKS=55621 NODES=30	SAT TT=0.372 CHECKS=58513 NODES=0	SAT TT=0.39 CHECKS=58513 NODES=0	SAT TT=0.021 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.019 ASSIGNMENTS=0 CHECKS=112	SAT TT=19.202	SAT TT=14.622	SAT TT=0.01 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.011 ASSIGNMENTS=0 CHECKS=112	? (problem) TT=0.443	SAT TT=0.009 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.009 ASSIGNMENTS=0 CHECKS=112	SAT TT=1.543	SAT TT=0.101 ASSIGNMENTS=31 CHECKS=528638	SAT TT=1.397	SAT TT=1.684
csp/hanoi/ normalized-hanoi-6_ext.xml	SAT TT=0.041	SAT TT=0.868 CHECKS=570583 NODES=62	SAT TT=0.732 CHECKS=570583 NODES=0	SAT TT=0.356	SAT TT=5.463 CHECKS=241	SAT TT=5.519 CHECKS=241	SAT TT=3.422 ASSIGNMENTS=1	SAT TT=3.392 ASSIGNMENTS=1	SAT TT=5.704 CHECKS=1045260 NODES=62	SAT TT=0.533 CHECKS=1096760 NODES=0	SAT TT=0.55 CHECKS=1096760 NODES=0	SAT TT=0.062 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.058 ASSIGNMENTS=0 CHECKS=240	SAT TT=274.011	SAT TT=271.254	SAT TT=0.046 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.041 ASSIGNMENTS=0 CHECKS=240	? (problem) TT=1.33	SAT TT=0.048 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.044 ASSIGNMENTS=0 CHECKS=240	SAT TT=4.14	SAT TT=0.925 ASSIGNMENTS=62 CHECKS=5075380	SAT TT=17.11	SAT TT=16.641
csp/hanoi/ normalized-hanoi-7_ext.xml	SAT TT=0.391	SAT TT=1.042 CHECKS=10427700 NODES=126	SAT TT=1.09 CHECKS=10427700 NODES=126	SAT TT=5.435	SAT TT=203.012 CHECKS=497	SAT TT=203.165 CHECKS=497	SAT TT=55.823 ASSIGNMENTS=1	SAT TT=55.218 ASSIGNMENTS=1	SAT TT=60.605 CHECKS=19969000 NODES=126	SAT TT=1.075 CHECKS=20567700 NODES=0	SAT TT=1.117 CHECKS=20567700 NODES=0	SAT TT=0.409 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.442 ASSIGNMENTS=0 CHECKS=496	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.425 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.391 ASSIGNMENTS=0 CHECKS=496	? (problem) TT=5.34	SAT TT=0.407 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.425 ASSIGNMENTS=0 CHECKS=496	SAT TT=28.386	SAT TT=30.896 ASSIGNMENTS=127 CHECKS=185321000	SAT TT=475.201	SAT TT=368.853
csp/langford/ normalized-langford-2-4-ext.xml	SAT TT=0.005	SAT TT=0.669 CHECKS=242 NODES=8	SAT TT=0.704 CHECKS=242 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=3422	SAT TT=0.011 CHECKS=2609	SAT TT=0.395 ASSIGNMENTS=2	SAT TT=0.412 ASSIGNMENTS=2	SAT TT=0.315 CHECKS=270 NODES=10	SAT TT=0.324 CHECKS=2762 NODES=55	SAT TT=0.325 CHECKS=32159 NODES=349	SAT TT=0.017 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.809	SAT TT=0.812	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=192	SAT TT=0.274	SAT TT=0.005 ASSIGNMENTS=2 CHECKS=226	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.715	SAT TT=0.009 ASSIGNMENTS=10 CHECKS=1024	SAT TT=0.503	SAT TT=0.499
csp/langford/ normalized-langford-3-11-ext.xml	UNSAT TT=1.162	UNSAT TT=7.291 CHECKS=10053800 NODES=34361	UNSAT TT=7.19 CHECKS=10075500 NODES=34337	UNSAT TT=2.278	UNSAT TT=77.72 CHECKS=38638200	UNSAT TT=83.566 CHECKS=60527400	UNSAT TT=2.831 ASSIGNMENTS=4009	UNSAT TT=5.009 ASSIGNMENTS=7542	UNSAT TT=9.355 CHECKS=3182420 NODES=19411	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=1.203 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=1.214 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=13.894	UNSAT TT=11.687	UNSAT TT=1.174 ASSIGNMENTS=8211 CHECKS=7306140	UNSAT TT=1.602 ASSIGNMENTS=11454 CHECKS=10053200	UNSAT TT=128.27	UNSAT TT=1.162 ASSIGNMENTS=8504 CHECKS=7670600	UNSAT TT=1.168 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=38.073	UNSAT TT=37.46 ASSIGNMENTS=38939 CHECKS=51069000	UNSAT TT=10.274	UNSAT TT=12.742
csp/langford/ normalized-langford-3-9-ext.xml	SAT TT=0.019	SAT TT=0.954 CHECKS=123859 NODES=438	SAT TT=0.977 CHECKS=140446 NODES=432	SAT TT=0.088	SAT TT=1.919 CHECKS=1011290	SAT TT=0.121 CHECKS=61258	SAT TT=0.808 ASSIGNMENTS=47	SAT TT=0.815 ASSIGNMENTS=93	SAT TT=0.555 CHECKS=5001 NODES=32	SAT TT=0.784 CHECKS=1932420 NODES=4662	? (TO) TT=1800.03	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=81976	SAT TT=0.039 ASSIGNMENTS=110 CHECKS=81976	SAT TT=1.94	SAT TT=1.838	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=81548	SAT TT=0.019 ASSIGNMENTS=21 CHECKS=14078	SAT TT=0.61	SAT TT=0.048 ASSIGNMENTS=249 CHECKS=236445	SAT TT=0.028 ASSIGNMENTS=110 CHECKS=81976	SAT TT=1.696	SAT TT=0.144 ASSIGNMENTS=47 CHECKS=59638	SAT TT=1.102	SAT TT=1.25
csp/langford/ normalized-slangford-3-11-ext.xml	UNSAT TT=1.246	UNSAT TT=7.164 CHECKS=10089200 NODES=34311	UNSAT TT=7.188 CHECKS=10107900 NODES=34344	UNSAT TT=2.366	UNSAT TT=291.228 CHECKS=132919000	UNSAT TT=89.689 CHECKS=48258100	UNSAT TT=3.31 ASSIGNMENTS=4019	UNSAT TT=6.048 ASSIGNMENTS=7542	UNSAT TT=9.424 CHECKS=3191300 NODES=19411	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=1.36 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=1.246 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=13.656	UNSAT TT=19.671	UNSAT TT=1.345 ASSIGNMENTS=8273 CHECKS=7820000	UNSAT TT=1.852 ASSIGNMENTS=11450 CHECKS=10681500	UNSAT TT=145.631	UNSAT TT=1.397 ASSIGNMENTS=8465 CHECKS=8144540	UNSAT TT=1.31 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=37.618	UNSAT TT=41.949 ASSIGNMENTS=50339 CHECKS=65965600	UNSAT TT=11.155	UNSAT TT=14.969
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lard/ normalized-lard-83-83.xml	SAT TT=10.523	SAT TT=15.563 CHECKS=628603 NODES=83	SAT TT=16.663 CHECKS=609336 NODES=0	? (problem) TT=295.569	? TT=25.698	? TT=23.439	SAT TT=16.305 ASSIGNMENTS=84	SAT TT=16.005 ASSIGNMENTS=84	SAT TT=53.668 CHECKS=297801 NODES=83	SAT TT=49.869 CHECKS=598266 NODES=4	SAT TT=52.744 CHECKS=615327 NODES=5	SAT TT=11.635 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.774 ASSIGNMENTS=83 CHECKS=13842	? (problem) TT=133.439	? (problem) TT=133.725	SAT TT=11.564 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.227 ASSIGNMENTS=83 CHECKS=14089	? (exit code) TT=29.978	SAT TT=11.446 ASSIGNMENTS=83 CHECKS=20092	SAT TT=10.523 ASSIGNMENTS=83 CHECKS=13842	SAT TT=56.082	SAT TT=32.246 ASSIGNMENTS=83 CHECKS=432750	? (MO) TT=25.38	? (MO) TT=24.65
csp/lard/ normalized-lard-84-84.xml	SAT TT=11.147	SAT TT=16.266 CHECKS=642809 NODES=84	SAT TT=16.113 CHECKS=609986 NODES=0	? (problem) TT=309.616	? TT=24.217	? TT=27.203	SAT TT=15.315 ASSIGNMENTS=85	SAT TT=15.726 ASSIGNMENTS=85	SAT TT=56.9 CHECKS=305592 NODES=84	SAT TT=51.775 CHECKS=599734 NODES=0	SAT TT=51.145 CHECKS=599734 NODES=0	SAT TT=12.337 ASSIGNMENTS=84 CHECKS=14093	SAT TT=12.203 ASSIGNMENTS=84 CHECKS=14093	? (problem) TT=172.57	? (problem) TT=196.036	SAT TT=12.085 ASSIGNMENTS=84 CHECKS=14093	SAT TT=11.985 ASSIGNMENTS=84 CHECKS=14706	? (exit code) TT=27.739	SAT TT=11.147 ASSIGNMENTS=61 CHECKS=14025	SAT TT=12.077 ASSIGNMENTS=84 CHECKS=14093	SAT TT=53.751	SAT TT=34.263 ASSIGNMENTS=84 CHECKS=436939	? (MO) TT=25.881	? (MO) TT=27.097
csp/lard/ normalized-lard-85-85.xml	SAT TT=11.518	SAT TT=16.662 CHECKS=671476 NODES=85	SAT TT=16.891 CHECKS=655479 NODES=0	? (problem) TT=325.392	? TT=26.619	? TT=30.397	SAT TT=16.562 ASSIGNMENTS=86	SAT TT=16.287 ASSIGNMENTS=86	SAT TT=58.273 CHECKS=319416 NODES=85	SAT TT=54.862 CHECKS=641534 NODES=4	SAT TT=58.984 CHECKS=652287 NODES=4	SAT TT=12.516 ASSIGNMENTS=85 CHECKS=14456	SAT TT=12.479 ASSIGNMENTS=85 CHECKS=14456	? (problem) TT=299.59	? (problem) TT=280.807	SAT TT=12.13 ASSIGNMENTS=85 CHECKS=14456	SAT TT=11.725 ASSIGNMENTS=85 CHECKS=14842	? (exit code) TT=30.806	SAT TT=11.518 ASSIGNMENTS=85 CHECKS=21086	SAT TT=12.839 ASSIGNMENTS=85 CHECKS=14456	SAT TT=59.26	SAT TT=33.244 ASSIGNMENTS=85 CHECKS=589557	? (MO) TT=26.741	? (MO) TT=26.135
csp/lard/ normalized-lard-86-86.xml	SAT TT=12.162	SAT TT=18.713 CHECKS=640681 NODES=86	SAT TT=17.579 CHECKS=599048 NODES=0	? (problem) TT=351.267	? TT=28.277	? TT=27.203	SAT TT=17.375 ASSIGNMENTS=87	SAT TT=17.191 ASSIGNMENTS=87	SAT TT=59.538 CHECKS=327592 NODES=86	SAT TT=56.426 CHECKS=643685 NODES=0	SAT TT=60.952 CHECKS=650920 NODES=1	SAT TT=12.25 ASSIGNMENTS=86 CHECKS=14846	SAT TT=13.362 ASSIGNMENTS=86 CHECKS=14846	? (problem) TT=314.993	? (problem) TT=316.768	SAT TT=13.188 ASSIGNMENTS=86 CHECKS=14846	SAT TT=12.3 ASSIGNMENTS=86 CHECKS=15512	? (exit code) TT=30.537	SAT TT=12.785 ASSIGNMENTS=56 CHECKS=14703	SAT TT=12.162 ASSIGNMENTS=86 CHECKS=14846	SAT TT=60.622	SAT TT=34.721 ASSIGNMENTS=86 CHECKS=470679	? (MO) TT=26.17	? (MO) TT=28.9
csp/lard/ normalized-lard-87-87.xml	SAT TT=12.728	SAT TT=18.288 CHECKS=725372 NODES=87	SAT TT=20.009 CHECKS=706304 NODES=0	? (problem) TT=363.089	? (TO) TT=24.566	Signal TT=25.396	SAT TT=22.495 ASSIGNMENTS=88	SAT TT=21.307 ASSIGNMENTS=88	SAT TT=67.48 CHECKS=342220 NODES=87	SAT TT=58.472 CHECKS=672515 NODES=0	SAT TT=59.423 CHECKS=672458 NODES=0	SAT TT=13.384 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.451 ASSIGNMENTS=87 CHECKS=15174	? (problem) TT=289.819	? (problem) TT=301.382	SAT TT=12.728 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.484 ASSIGNMENTS=87 CHECKS=15464	? (exit code) TT=31.218	SAT TT=13.774 ASSIGNMENTS=87 CHECKS=22104	SAT TT=13.504 ASSIGNMENTS=87 CHECKS=15174	SAT TT=61.736	SAT TT=36.457 ASSIGNMENTS=87 CHECKS=632744	? (MO) TT=27.135	? (MO) TT=28.132
csp/lard/ normalized-lard-88-88.xml	SAT TT=13.17	SAT TT=20.038 CHECKS=670262 NODES=88	SAT TT=20.452 CHECKS=627361 NODES=0	? (problem) TT=367.094	Signal TT=23.602	Signal TT=22.94	SAT TT=26.012 ASSIGNMENTS=89	SAT TT=24.133 ASSIGNMENTS=89	SAT TT=66.564 CHECKS=349356 NODES=88	SAT TT=64.168 CHECKS=687981 NODES=0	SAT TT=62.006 CHECKS=687981 NODES=0	SAT TT=13.299 ASSIGNMENTS=88 CHECKS=15562	SAT TT=13.17 ASSIGNMENTS=88 CHECKS=15562	? (problem) TT=571.502	? (problem) TT=633.913	SAT TT=13.184 ASSIGNMENTS=88 CHECKS=15562	SAT TT=14.142 ASSIGNMENTS=88 CHECKS=16235	? (exit code) TT=50.31	SAT TT=14.175 ASSIGNMENTS=50 CHECKS=15397	SAT TT=14.101 ASSIGNMENTS=88 CHECKS=15562	SAT TT=63.815	SAT TT=38.139 ASSIGNMENTS=88 CHECKS=646732	? (MO) TT=31.88	? (MO) TT=30.05
csp/lard/ normalized-lard-89-89.xml	SAT TT=13.695	SAT TT=19.59 CHECKS=775225 NODES=89	SAT TT=21.185 CHECKS=747565 NODES=0	? (problem) TT=388.757	Signal TT=118.981	Signal TT=20.862	SAT TT=40.868 ASSIGNMENTS=90	SAT TT=38.386 ASSIGNMENTS=90	SAT TT=73.607 CHECKS=366451 NODES=89	SAT TT=66.924 CHECKS=720327 NODES=0	SAT TT=65.288 CHECKS=735912 NODES=2	SAT TT=14.679 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.695 ASSIGNMENTS=89 CHECKS=15958	? (problem) TT=400.038	? (problem) TT=339.473	SAT TT=14.659 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.753 ASSIGNMENTS=89 CHECKS=16680	? (exit code) TT=48.914	SAT TT=14.864 ASSIGNMENTS=89 CHECKS=23146	SAT TT=14.354 ASSIGNMENTS=89 CHECKS=15958	SAT TT=68.565	SAT TT=44.124 ASSIGNMENTS=89 CHECKS=533554	? (MO) TT=30.274	? (MO) TT=31.06
csp/lard/ normalized-lard-90-90.xml	SAT TT=14.5	SAT TT=21.226 CHECKS=780902 NODES=90	SAT TT=20.989 CHECKS=748192 NODES=0	? (problem) TT=406.213	Signal TT=20.87	Signal TT=21.99	? (problem) TT=43.908	? (problem) TT=44.657	SAT TT=73.008 CHECKS=375270 NODES=90	SAT TT=70.671 CHECKS=737295 NODES=0	SAT TT=71.24 CHECKS=737265 NODES=0	SAT TT=16.186 ASSIGNMENTS=90 CHECKS=16212	SAT TT=16.174 ASSIGNMENTS=90 CHECKS=16212	? (problem) TT=333.485	? (problem) TT=359.541	SAT TT=15.742 ASSIGNMENTS=90 CHECKS=16212	SAT TT=14.983 ASSIGNMENTS=90 CHECKS=16676	? (exit code) TT=76.738	SAT TT=15.814 ASSIGNMENTS=54 CHECKS=16107	SAT TT=14.5 ASSIGNMENTS=90 CHECKS=16212	SAT TT=74.997	SAT TT=42.119 ASSIGNMENTS=90 CHECKS=546118	? TT=125.776	? (MO) TT=29.433
csp/lard/ normalized-lard-91-91.xml	SAT TT=15.352	SAT TT=23.42 CHECKS=829260 NODES=91	SAT TT=21.496 CHECKS=805112 NODES=0	? (problem) TT=425.316	? TT=13.181	? TT=12.196	? (problem) TT=48.88	? (problem) TT=51.644	SAT TT=77.897 CHECKS=391143 NODES=91	SAT TT=69.713 CHECKS=769107 NODES=0	SAT TT=71.294 CHECKS=769107 NODES=0	SAT TT=15.352 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.702 ASSIGNMENTS=91 CHECKS=16615	? (problem) TT=345.317	? (problem) TT=370.751	SAT TT=15.489 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.587 ASSIGNMENTS=91 CHECKS=17157	? (exit code) TT=44.852	SAT TT=16.54 ASSIGNMENTS=91 CHECKS=24212	SAT TT=16.6 ASSIGNMENTS=91 CHECKS=16615	? TT=133.401	SAT TT=44.893 ASSIGNMENTS=91 CHECKS=725354	? (MO) TT=30.84	? (MO) TT=32.53
csp/lard/ normalized-lard-92-92.xml	SAT TT=16.101	SAT TT=24.186 CHECKS=752761 NODES=92	SAT TT=22.337 CHECKS=695792 NODES=0	? (problem) TT=438.335	? TT=12.767	? TT=13.947	? (problem) TT=43.914	? (problem) TT=48.391	SAT TT=77.563 CHECKS=400632 NODES=92	SAT TT=78.28 CHECKS=787960 NODES=0	SAT TT=73.802 CHECKS=796293 NODES=1	SAT TT=16.359 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.107 ASSIGNMENTS=92 CHECKS=17048	? (problem) TT=290.549	? (problem) TT=298.832	SAT TT=17.147 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.444 ASSIGNMENTS=92 CHECKS=18138	? (exit code) TT=58.912	SAT TT=16.101 ASSIGNMENTS=53 CHECKS=16833	SAT TT=16.936 ASSIGNMENTS=92 CHECKS=17048	? TT=131.126	SAT TT=48.858 ASSIGNMENTS=92 CHECKS=575005	? (MO) TT=34.66	? (MO) TT=33.33
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/marc/ normalized-large-80-sat_ext.xml	SAT TT=9.085	SAT TT=11.884 CHECKS=34612 NODES=80	SAT TT=12.754 CHECKS=34612 NODES=0	? (problem) TT=276.855	SAT TT=16.323 CHECKS=4953	SAT TT=16.346 CHECKS=4953	SAT TT=13.289 ASSIGNMENTS=1	SAT TT=13.658 ASSIGNMENTS=1	SAT TT=49.399 CHECKS=35136 NODES=80	SAT TT=45.328 CHECKS=51592 NODES=0	SAT TT=46.868 CHECKS=51592 NODES=0	SAT TT=9.711 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.86 ASSIGNMENTS=0 CHECKS=9401	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=9.735 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.708 ASSIGNMENTS=0 CHECKS=9401	? (exit code) TT=69.884	SAT TT=9.085 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.568 ASSIGNMENTS=0 CHECKS=9401	SAT TT=45.187	SAT TT=26.696 ASSIGNMENTS=80 CHECKS=31232	? (MO) TT=24.37	? (MO) TT=23.46
csp/marc/ normalized-large-80-unsat_ext.xml	UNSAT TT=7.233	UNSAT TT=10.136 CHECKS=1146780 NODES=79	UNSAT TT=10.2 CHECKS=1181720 NODES=0	? (problem) TT=213.208	UNSAT TT=72.162 CHECKS=60976	UNSAT TT=51.007 CHECKS=40620	UNSAT TT=13.099 ASSIGNMENTS=1	UNSAT TT=12.609 ASSIGNMENTS=1	UNSAT TT=39.552 CHECKS=1281460 NODES=128	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=7.784 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=7.831 ASSIGNMENTS=123 CHECKS=22876	? (TO) TT=1800.06	UNSAT TT=317.066	UNSAT TT=7.233 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=8.737 ASSIGNMENTS=3028 CHECKS=486042	? (exit code) TT=30.115	UNSAT TT=7.637 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=7.699 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=37.149	UNSAT TT=22.689 ASSIGNMENTS=80 CHECKS=910185	? (MO) TT=21.34	? (MO) TT=20.36
csp/marc/ normalized-large-84-sat_ext.xml	SAT TT=11.008	SAT TT=15.023 CHECKS=49944 NODES=84	SAT TT=15.211 CHECKS=49944 NODES=0	? (problem) TT=329.025	SAT TT=16.189 CHECKS=5532	SAT TT=16.754 CHECKS=5532	SAT TT=15.886 ASSIGNMENTS=1	SAT TT=15.036 ASSIGNMENTS=1	SAT TT=55.895 CHECKS=87803 NODES=84	SAT TT=55.453 CHECKS=109463 NODES=0	SAT TT=50.726 CHECKS=109463 NODES=0	SAT TT=11.008 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.797 ASSIGNMENTS=0 CHECKS=10375	? (problem) TT=185.134	? (problem) TT=177.841	SAT TT=11.858 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.798 ASSIGNMENTS=0 CHECKS=10375	? (exit code) TT=29.635	SAT TT=11.841 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.67 ASSIGNMENTS=0 CHECKS=10375	SAT TT=50.11	SAT TT=35.453 ASSIGNMENTS=85 CHECKS=35028	? (MO) TT=26.8	? (MO) TT=26.84
csp/marc/ normalized-large-84-unsat_ext.xml	UNSAT TT=8.963	UNSAT TT=13.002 CHECKS=1239080 NODES=82	UNSAT TT=13.188 CHECKS=1413230 NODES=0	? (problem) TT=253.355	UNSAT TT=100.677 CHECKS=73853	UNSAT TT=59.284 CHECKS=41942	UNSAT TT=14.614 ASSIGNMENTS=1	UNSAT TT=16.017 ASSIGNMENTS=1	UNSAT TT=50.34 CHECKS=1375600 NODES=123	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=8.963 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=9.176 ASSIGNMENTS=130 CHECKS=25612	? (problem) TT=130.743	? (problem) TT=129.726	UNSAT TT=9.53 ASSIGNMENTS=83 CHECKS=17431	UNSAT TT=10.376 ASSIGNMENTS=3034 CHECKS=512771	? (exit code) TT=32.224	UNSAT TT=9.585 ASSIGNMENTS=83 CHECKS=17680	UNSAT TT=9.564 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=47.734	UNSAT TT=28.634 ASSIGNMENTS=84 CHECKS=1041690	? (MO) TT=22.545	? (MO) TT=22.72
csp/marc/ normalized-large-88-sat_ext.xml	SAT TT=13.162	SAT TT=18.295 CHECKS=41489 NODES=88	SAT TT=16.523 CHECKS=41489 NODES=0	? (problem) TT=369.383	SAT TT=18.862 CHECKS=5939	SAT TT=16.931 CHECKS=5939	SAT TT=26.639 ASSIGNMENTS=1	SAT TT=27.684 ASSIGNMENTS=1	SAT TT=69.672 CHECKS=79561 NODES=88	SAT TT=66.237 CHECKS=99998 NODES=0	SAT TT=66.47 CHECKS=99998 NODES=0	SAT TT=14.165 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.211 ASSIGNMENTS=0 CHECKS=11397	? (problem) TT=296.501	? (problem) TT=322.321	SAT TT=14.173 ASSIGNMENTS=0 CHECKS=11397	SAT TT=13.162 ASSIGNMENTS=0 CHECKS=11397	? (exit code) TT=109.609	SAT TT=14.912 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.06 ASSIGNMENTS=0 CHECKS=11397	SAT TT=58.956	SAT TT=41.011 ASSIGNMENTS=88 CHECKS=34037	? (MO) TT=28.16	? (MO) TT=30.202
csp/marc/ normalized-large-88-unsat_ext.xml	UNSAT TT=10.484	UNSAT TT=13.885 CHECKS=1349870 NODES=81	UNSAT TT=14.046 CHECKS=1645020 NODES=0	? (problem) TT=297.964	Signal TT=18.626	Signal TT=19.431	UNSAT TT=18.222 ASSIGNMENTS=1	UNSAT TT=17.078 ASSIGNMENTS=1	UNSAT TT=57.322 CHECKS=1716860 NODES=141	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=11.379 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=11.282 ASSIGNMENTS=136 CHECKS=27629	? (problem) TT=114.674	? (problem) TT=115.175	UNSAT TT=10.554 ASSIGNMENTS=87 CHECKS=19402	UNSAT TT=13.092 ASSIGNMENTS=3041 CHECKS=538448	? (exit code) TT=27.745	UNSAT TT=10.484 ASSIGNMENTS=87 CHECKS=19315	UNSAT TT=11.159 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=52.226	UNSAT TT=32.681 ASSIGNMENTS=88 CHECKS=1220360	? TT=161.374	? (MO) TT=25.038
csp/marc/ normalized-large-92-sat_ext.xml	SAT TT=15.846	SAT TT=19.524 CHECKS=51620 NODES=92	SAT TT=21.425 CHECKS=51620 NODES=0	? (problem) TT=468.339	? TT=13.722	? TT=12.909	? (problem) TT=40.885	? (problem) TT=40.01	SAT TT=84.206 CHECKS=56908 NODES=92	SAT TT=79.75 CHECKS=79336 NODES=0	SAT TT=77.373 CHECKS=79336 NODES=0	SAT TT=17.712 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.23 ASSIGNMENTS=0 CHECKS=12467	? (problem) TT=314.918	? (problem) TT=307.074	SAT TT=16.034 ASSIGNMENTS=0 CHECKS=12467	SAT TT=16.092 ASSIGNMENTS=0 CHECKS=12467	? (exit code) TT=37.853	SAT TT=15.846 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.156 ASSIGNMENTS=0 CHECKS=12467	SAT TT=70.487	SAT TT=49.051 ASSIGNMENTS=92 CHECKS=58017	? (MO) TT=34.28	? (MO) TT=34.32
csp/marc/ normalized-large-92-unsat_ext.xml	UNSAT TT=12.586	UNSAT TT=16.578 CHECKS=1691770 NODES=91	UNSAT TT=16.317 CHECKS=1909970 NODES=0	? (problem) TT=348.758	Signal TT=21.23	Signal TT=21.084	UNSAT TT=22.33 ASSIGNMENTS=1	UNSAT TT=24.072 ASSIGNMENTS=1	UNSAT TT=62.843 CHECKS=1952880 NODES=147	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=13.831 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=13.655 ASSIGNMENTS=142 CHECKS=30355	? (problem) TT=319.299	? (problem) TT=318.085	UNSAT TT=12.797 ASSIGNMENTS=91 CHECKS=21022	UNSAT TT=15.677 ASSIGNMENTS=3042 CHECKS=561984	? (exit code) TT=34.357	UNSAT TT=12.586 ASSIGNMENTS=91 CHECKS=20840	UNSAT TT=13.624 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=63.759	UNSAT TT=38.773 ASSIGNMENTS=92 CHECKS=1376540	? (MO) TT=28.36	? (MO) TT=26.926
csp/marc/ normalized-large-96-sat_ext.xml	SAT TT=18.77	SAT TT=25.172 CHECKS=62678 NODES=96	SAT TT=22.67 CHECKS=62678 NODES=0	? (problem) TT=543.195	? TT=15.68	? TT=15.561	? (problem) TT=38.47	? (problem) TT=40.999	SAT TT=103.741 CHECKS=48181 NODES=96	SAT TT=94.933 CHECKS=72297 NODES=0	SAT TT=97.055 CHECKS=72297 NODES=0	SAT TT=20.426 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	? (problem) TT=298.973	? (problem) TT=301.079	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.455 ASSIGNMENTS=0 CHECKS=13585	? (exit code) TT=115.378	SAT TT=21.135 ASSIGNMENTS=0 CHECKS=13585	SAT TT=18.77 ASSIGNMENTS=0 CHECKS=13585	SAT TT=113.776	SAT TT=54.726 ASSIGNMENTS=103 CHECKS=67904	? (MO) TT=39.3	? (MO) TT=36.89
csp/marc/ normalized-large-96-unsat_ext.xml	UNSAT TT=15.143	UNSAT TT=20.664 CHECKS=1934710 NODES=95	UNSAT TT=20.578 CHECKS=2215540 NODES=0	? (problem) TT=426.432	? TT=12.262	? TT=13.04	? (problem) TT=42.723	? (problem) TT=43.281	UNSAT TT=82.913 CHECKS=2209300 NODES=153	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=16.876 ASSIGNMENTS=149 CHECKS=33400	UNSAT TT=16.488 ASSIGNMENTS=149 CHECKS=33400	? (problem) TT=308.015	? (problem) TT=325.828	UNSAT TT=15.889 ASSIGNMENTS=95 CHECKS=23086	UNSAT TT=17.307 ASSIGNMENTS=3052 CHECKS=587597	? (exit code) TT=44.863	UNSAT TT=16.057 ASSIGNMENTS=95 CHECKS=22991	UNSAT TT=15.143 ASSIGNMENTS=149 CHECKS=33400	? TT=119.82	UNSAT TT=46.805 ASSIGNMENTS=95 CHECKS=1561180	? TT=183.309	? (MO) TT=32.531
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-0_ext.xml	SAT TT=0.022	SAT TT=0.958 CHECKS=7709 NODES=100	SAT TT=0.964 CHECKS=14349 NODES=100	SAT TT=0.108	SAT TT=0.063 CHECKS=17902	SAT TT=0.043 CHECKS=3991	SAT TT=0.978 ASSIGNMENTS=26	SAT TT=0.993 ASSIGNMENTS=21	SAT TT=0.632 CHECKS=5307 NODES=105	SAT TT=0.672 CHECKS=18803 NODES=77	SAT TT=0.815 CHECKS=120657 NODES=310	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.589	SAT TT=1.817	SAT TT=0.025 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.029 ASSIGNMENTS=167 CHECKS=19795	SAT TT=1.092	SAT TT=0.03 ASSIGNMENTS=226 CHECKS=24850	SAT TT=0.022 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.252	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44647	SAT TT=1.096	SAT TT=1.043
csp/QCP-10/ normalized-qcp-10-67-10_ext.xml	UNSAT TT=0.037	UNSAT TT=1.002 CHECKS=21618 NODES=288	UNSAT TT=0.929 CHECKS=7971 NODES=0	UNSAT TT=91.664	UNSAT TT=0.152 CHECKS=91803	UNSAT TT=0.074 CHECKS=28058	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.838 ASSIGNMENTS=0	UNSAT TT=0.736 CHECKS=14126 NODES=480	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=8.065 ASSIGNMENTS=0	UNSAT TT=14.353 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.013	UNSAT TT=1.125	UNSAT TT=0.037 ASSIGNMENTS=495 CHECKS=50804	UNSAT TT=0.166 ASSIGNMENTS=4988 CHECKS=539894	UNSAT TT=0.8	UNSAT TT=0.047 ASSIGNMENTS=851 CHECKS=92584	UNSAT TT=6.781 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.574	UNSAT TT=0.314 ASSIGNMENTS=1562 CHECKS=722588	UNSAT TT=1.143	UNSAT TT=1.355
csp/QCP-10/ normalized-qcp-10-67-11_ext.xml	UNSAT TT=0.042	UNSAT TT=1.068 CHECKS=82024 NODES=963	UNSAT TT=1.104 CHECKS=76300 NODES=767	UNSAT TT=109.178	UNSAT TT=0.076 CHECKS=25866	UNSAT TT=0.048 CHECKS=6571	UNSAT TT=0.604 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=0.694 CHECKS=6518 NODES=114	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.075 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=0.076 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.235	UNSAT TT=1.134	UNSAT TT=0.051 ASSIGNMENTS=1016 CHECKS=116613	UNSAT TT=0.165 ASSIGNMENTS=5200 CHECKS=481072	UNSAT TT=0.693	UNSAT TT=0.042 ASSIGNMENTS=732 CHECKS=72292	UNSAT TT=0.061 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.431	UNSAT TT=0.569 ASSIGNMENTS=2806 CHECKS=1125400	UNSAT TT=0.987	UNSAT TT=1.331
csp/QCP-10/ normalized-qcp-10-67-12_ext.xml	UNSAT TT=0.025	UNSAT TT=0.887 CHECKS=3245 NODES=0	UNSAT TT=0.882 CHECKS=3245 NODES=0	UNSAT TT=46.229	UNSAT TT=0.098 CHECKS=45697	UNSAT TT=0.05 CHECKS=11019	UNSAT TT=0.834 ASSIGNMENTS=0	UNSAT TT=0.702 ASSIGNMENTS=0	UNSAT TT=0.636 CHECKS=4630 NODES=40	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.041 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.038 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.979	UNSAT TT=0.907	UNSAT TT=0.025 ASSIGNMENTS=150 CHECKS=14109	UNSAT TT=0.147 ASSIGNMENTS=4484 CHECKS=474271	UNSAT TT=0.808	UNSAT TT=0.032 ASSIGNMENTS=315 CHECKS=32076	UNSAT TT=0.028 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=1.796	UNSAT TT=0.08 ASSIGNMENTS=98 CHECKS=56023	UNSAT TT=0.916	UNSAT TT=1.006
csp/QCP-10/ normalized-qcp-10-67-13_ext.xml	UNSAT TT=0.022	UNSAT TT=1.005 CHECKS=3248 NODES=0	UNSAT TT=0.906 CHECKS=3248 NODES=0	UNSAT TT=0.101	UNSAT TT=0.057 CHECKS=12384	UNSAT TT=0.042 CHECKS=6609	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.622 ASSIGNMENTS=0	UNSAT TT=0.632 CHECKS=5626 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.977	UNSAT TT=0.996	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.675	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.307	UNSAT TT=0.059 ASSIGNMENTS=47 CHECKS=41092	UNSAT TT=1.089	UNSAT TT=1.201
csp/QCP-10/ normalized-qcp-10-67-14_ext.xml	UNSAT TT=0.022	UNSAT TT=0.867 CHECKS=3258 NODES=0	UNSAT TT=1.036 CHECKS=3258 NODES=0	UNSAT TT=2.759	UNSAT TT=0.072 CHECKS=24253	UNSAT TT=0.045 CHECKS=5870	UNSAT TT=0.609 ASSIGNMENTS=0	UNSAT TT=0.66 ASSIGNMENTS=0	UNSAT TT=0.617 CHECKS=4349 NODES=28	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.036 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.999	UNSAT TT=1.131	UNSAT TT=0.024 ASSIGNMENTS=27 CHECKS=3048	UNSAT TT=0.144 ASSIGNMENTS=4599 CHECKS=407591	UNSAT TT=0.674	UNSAT TT=0.029 ASSIGNMENTS=276 CHECKS=26418	UNSAT TT=0.022 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=1.395	UNSAT TT=0.061 ASSIGNMENTS=62 CHECKS=46069	UNSAT TT=0.938	UNSAT TT=1.027
csp/QCP-10/ normalized-qcp-10-67-1_ext.xml	SAT TT=0.024	SAT TT=0.962 CHECKS=7966 NODES=102	SAT TT=0.915 CHECKS=7867 NODES=0	SAT TT=0.11	SAT TT=0.061 CHECKS=14587	SAT TT=0.041 CHECKS=3386	SAT TT=1.095 ASSIGNMENTS=25	SAT TT=1.038 ASSIGNMENTS=19	SAT TT=0.665 CHECKS=5261 NODES=103	SAT TT=0.687 CHECKS=23009 NODES=140	SAT TT=0.677 CHECKS=77767 NODES=135	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.598	SAT TT=1.71	SAT TT=0.025 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.028 ASSIGNMENTS=105 CHECKS=12586	SAT TT=0.667	SAT TT=0.027 ASSIGNMENTS=72 CHECKS=7360	SAT TT=0.024 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.247	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44400	SAT TT=1.14	SAT TT=1.481
csp/QCP-10/ normalized-qcp-10-67-2_ext.xml	SAT TT=0.023	SAT TT=0.963 CHECKS=7583 NODES=100	SAT TT=0.914 CHECKS=7702 NODES=0	SAT TT=0.109	SAT TT=0.06 CHECKS=14122	SAT TT=0.039 CHECKS=3327	SAT TT=1.065 ASSIGNMENTS=18	SAT TT=1.17 ASSIGNMENTS=16	SAT TT=0.777 CHECKS=5314 NODES=106	SAT TT=0.683 CHECKS=31100 NODES=288	SAT TT=0.686 CHECKS=105791 NODES=233	SAT TT=0.037 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.035 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.581	SAT TT=1.62	SAT TT=0.023 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=11280	SAT TT=0.707	SAT TT=0.025 ASSIGNMENTS=49 CHECKS=4932	SAT TT=0.025 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.322	SAT TT=0.064 ASSIGNMENTS=101 CHECKS=45899	SAT TT=1.285	SAT TT=1.162
csp/QCP-10/ normalized-qcp-10-67-3_ext.xml	SAT TT=0.025	SAT TT=0.967 CHECKS=7774 NODES=102	SAT TT=1.002 CHECKS=14811 NODES=113	SAT TT=0.106	SAT TT=0.06 CHECKS=15199	SAT TT=0.041 CHECKS=3064	SAT TT=0.988 ASSIGNMENTS=23	SAT TT=1.052 ASSIGNMENTS=22	SAT TT=0.63 CHECKS=5453 NODES=109	SAT TT=0.799 CHECKS=27085 NODES=224	SAT TT=0.682 CHECKS=120121 NODES=252	SAT TT=0.037 ASSIGNMENTS=118 CHECKS=12066	SAT TT=0.038 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.581	SAT TT=1.619	SAT TT=0.025 ASSIGNMENTS=68 CHECKS=7250	SAT TT=0.032 ASSIGNMENTS=294 CHECKS=30048	SAT TT=0.873	SAT TT=0.028 ASSIGNMENTS=172 CHECKS=18039	SAT TT=0.026 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.407	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44652	SAT TT=1.108	SAT TT=1.033
csp/QCP-10/ normalized-qcp-10-67-4_ext.xml	SAT TT=0.027	SAT TT=0.962 CHECKS=8036 NODES=103	SAT TT=0.951 CHECKS=9535 NODES=0	SAT TT=0.099	SAT TT=0.058 CHECKS=16410	SAT TT=0.042 CHECKS=4222	SAT TT=1.011 ASSIGNMENTS=27	SAT TT=1.112 ASSIGNMENTS=25	SAT TT=0.675 CHECKS=5597 NODES=107	SAT TT=0.658 CHECKS=25340 NODES=181	SAT TT=0.634 CHECKS=104232 NODES=248	SAT TT=0.096 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=0.097 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.631	SAT TT=1.588	SAT TT=0.073 ASSIGNMENTS=2009 CHECKS=181849	SAT TT=0.027 ASSIGNMENTS=108 CHECKS=14869	SAT TT=0.82	SAT TT=0.027 ASSIGNMENTS=49 CHECKS=5219	SAT TT=0.081 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.241	SAT TT=0.058 ASSIGNMENTS=102 CHECKS=45139	SAT TT=1.152	SAT TT=1.336
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-5_ext.xml	SAT TT=0.024	SAT TT=0.936 CHECKS=7669 NODES=101	SAT TT=0.93 CHECKS=9196 NODES=0	SAT TT=0.106	SAT TT=0.058 CHECKS=13480	SAT TT=0.04 CHECKS=3494	SAT TT=0.966 ASSIGNMENTS=17	SAT TT=0.987 ASSIGNMENTS=23	SAT TT=0.652 CHECKS=5330 NODES=107	SAT TT=0.668 CHECKS=24709 NODES=184	SAT TT=0.703 CHECKS=158421 NODES=374	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=2639	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.803	SAT TT=1.776	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=2748	SAT TT=0.027 ASSIGNMENTS=73 CHECKS=9987	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=253 CHECKS=26126	SAT TT=0.025 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.309	SAT TT=0.057 ASSIGNMENTS=101 CHECKS=45072	SAT TT=1.025	SAT TT=1.227
csp/QCP-10/ normalized-qcp-10-67-6_ext.xml	SAT TT=0.024	SAT TT=1.007 CHECKS=21395 NODES=318	SAT TT=1.059 CHECKS=22775 NODES=203	SAT TT=0.101	SAT TT=0.062 CHECKS=17693	SAT TT=0.042 CHECKS=3780	SAT TT=0.999 ASSIGNMENTS=25	SAT TT=1.029 ASSIGNMENTS=28	SAT TT=0.67 CHECKS=6232 NODES=130	SAT TT=0.792 CHECKS=38727 NODES=380	SAT TT=0.682 CHECKS=65245 NODES=109	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.713	SAT TT=1.48	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.026 ASSIGNMENTS=60 CHECKS=8529	SAT TT=0.681	SAT TT=0.027 ASSIGNMENTS=143 CHECKS=14283	SAT TT=0.026 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.251	SAT TT=0.063 ASSIGNMENTS=101 CHECKS=44975	SAT TT=1.165	SAT TT=1.138
csp/QCP-10/ normalized-qcp-10-67-7_ext.xml	SAT TT=0.024	SAT TT=0.973 CHECKS=8333 NODES=113	SAT TT=0.962 CHECKS=17078 NODES=100	SAT TT=0.119	SAT TT=0.072 CHECKS=26224	SAT TT=0.043 CHECKS=5693	SAT TT=1.09 ASSIGNMENTS=27	SAT TT=0.997 ASSIGNMENTS=20	SAT TT=0.612 CHECKS=5490 NODES=107	SAT TT=0.664 CHECKS=38060 NODES=395	SAT TT=0.689 CHECKS=104691 NODES=202	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.485	SAT TT=1.734	SAT TT=0.025 ASSIGNMENTS=84 CHECKS=7542	SAT TT=0.026 ASSIGNMENTS=16 CHECKS=2073	SAT TT=0.843	SAT TT=0.028 ASSIGNMENTS=151 CHECKS=16169	SAT TT=0.024 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.329	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=44742	SAT TT=1.175	SAT TT=0.977
csp/QCP-10/ normalized-qcp-10-67-8_ext.xml	SAT TT=0.023	SAT TT=0.956 CHECKS=7755 NODES=100	SAT TT=1.133 CHECKS=16331 NODES=108	SAT TT=0.11	SAT TT=0.07 CHECKS=23734	SAT TT=0.043 CHECKS=6398	SAT TT=1.023 ASSIGNMENTS=28	SAT TT=1.15 ASSIGNMENTS=18	SAT TT=0.631 CHECKS=5897 NODES=129	SAT TT=0.688 CHECKS=27572 NODES=208	SAT TT=0.674 CHECKS=70595 NODES=132	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.489	SAT TT=1.677	SAT TT=0.024 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.032 ASSIGNMENTS=166 CHECKS=20046	SAT TT=0.847	SAT TT=0.026 ASSIGNMENTS=120 CHECKS=11940	SAT TT=0.023 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.322	SAT TT=0.063 ASSIGNMENTS=100 CHECKS=45030	SAT TT=1.161	SAT TT=1.023
csp/QCP-10/ normalized-qcp-10-67-9_ext.xml	SAT TT=0.026	SAT TT=0.973 CHECKS=7768 NODES=100	SAT TT=1.008 CHECKS=17363 NODES=108	SAT TT=0.107	SAT TT=0.081 CHECKS=34024	SAT TT=0.049 CHECKS=10292	SAT TT=1.036 ASSIGNMENTS=19	SAT TT=1.17 ASSIGNMENTS=17	SAT TT=0.659 CHECKS=9469 NODES=229	SAT TT=0.675 CHECKS=29872 NODES=247	SAT TT=0.69 CHECKS=72531 NODES=124	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.504	SAT TT=1.638	SAT TT=0.026 ASSIGNMENTS=35 CHECKS=3212	SAT TT=0.026 ASSIGNMENTS=117 CHECKS=11343	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=228 CHECKS=22666	SAT TT=0.026 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.407	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=45020	SAT TT=0.994	SAT TT=0.982
csp/QCP-15/ normalized-qcp-15-120-0_ext.xml	SAT TT=0.164	SAT TT=1.485 CHECKS=189507 NODES=2100	SAT TT=1.398 CHECKS=148143 NODES=1429	SAT TT=0.487	SAT TT=0.942 CHECKS=566342	SAT TT=0.164 CHECKS=49748	SAT TT=2.562 ASSIGNMENTS=27	SAT TT=2.405 ASSIGNMENTS=22	SAT TT=2.509 CHECKS=65931 NODES=1181	SAT TT=1.753 CHECKS=604792 NODES=7337	SAT TT=1.791 CHECKS=1944370 NODES=2601	SAT TT=9.372 ASSIGNMENTS=27	SAT TT=9.33 ASSIGNMENTS=2100 CHECKS=189507	SAT TT=2.561	SAT TT=2.503	SAT TT=2.053 ASSIGNMENTS=27436 CHECKS=8057580	SAT TT=0.29 ASSIGNMENTS=6077 CHECKS=920873	SAT TT=6.021	SAT TT=0.598 ASSIGNMENTS=7159 CHECKS=2204480	SAT TT=1.543 ASSIGNMENTS=20153 CHECKS=6217020	SAT TT=3.191	SAT TT=1.729 ASSIGNMENTS=5002 CHECKS=1406630	SAT TT=1.37	SAT TT=1.526
csp/QCP-15/ normalized-qcp-15-120-10_ext.xml	UNSAT TT=0.855	UNSAT TT=68.126 CHECKS=68894600 NODES=422203	UNSAT TT=81.098 CHECKS=75128700 NODES=444833	UNSAT TT=196.516	UNSAT TT=927.338 CHECKS=764965000	UNSAT TT=246.16 CHECKS=227269000	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=689.474 CHECKS=36151400 NODES=820062	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=8.754 ASSIGNMENTS=0	UNSAT TT=77.366 ASSIGNMENTS=422203 CHECKS=68894600	UNSAT TT=1.8	UNSAT TT=1.917	UNSAT TT=6.233 ASSIGNMENTS=114695 CHECKS=25015600	UNSAT TT=2.846 ASSIGNMENTS=51484 CHECKS=11391500	UNSAT TT=57.083	UNSAT TT=2.844 ASSIGNMENTS=51074 CHECKS=11412000	UNSAT TT=22.171 ASSIGNMENTS=295614 CHECKS=87749900	UNSAT TT=3.067	UNSAT TT=978.191 ASSIGNMENTS=4124300 CHECKS=1017790000	UNSAT TT=1.314	UNSAT TT=1.798
csp/QCP-15/ normalized-qcp-15-120-11_ext.xml	UNSAT TT=0.069	UNSAT TT=1.263 CHECKS=54673 NODES=497	UNSAT TT=1.321 CHECKS=81068 NODES=539	UNSAT TT=18.225	UNSAT TT=0.336 CHECKS=120858	UNSAT TT=0.177 CHECKS=36111	UNSAT TT=0.868 ASSIGNMENTS=0	UNSAT TT=0.872 ASSIGNMENTS=0	UNSAT TT=1.53 CHECKS=18914 NODES=36	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=8.401 ASSIGNMENTS=0	UNSAT TT=8.934 ASSIGNMENTS=497 CHECKS=54673	UNSAT TT=1.705	UNSAT TT=1.671	UNSAT TT=0.069 ASSIGNMENTS=193 CHECKS=30906	UNSAT TT=0.265 ASSIGNMENTS=4750 CHECKS=805375	UNSAT TT=1.644	UNSAT TT=0.074 ASSIGNMENTS=431 CHECKS=71014	UNSAT TT=66.288 ASSIGNMENTS=808430 CHECKS=280336000	UNSAT TT=2.605	UNSAT TT=0.256 ASSIGNMENTS=180 CHECKS=235109	UNSAT TT=1.361	UNSAT TT=1.477
csp/QCP-15/ normalized-qcp-15-120-12_ext.xml	UNSAT TT=0.065	UNSAT TT=1.082 CHECKS=15538 NODES=0	UNSAT TT=1.153 CHECKS=15538 NODES=0	UNSAT TT=269.804	UNSAT TT=0.306 CHECKS=118616	UNSAT TT=0.2 CHECKS=37815	UNSAT TT=0.858 ASSIGNMENTS=0	UNSAT TT=0.848 ASSIGNMENTS=0	UNSAT TT=1.556 CHECKS=18113 NODES=65	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.071 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=0.079 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=1.693	UNSAT TT=1.637	UNSAT TT=0.065 ASSIGNMENTS=179 CHECKS=20669	UNSAT TT=0.244 ASSIGNMENTS=5392 CHECKS=791596	UNSAT TT=1.667	UNSAT TT=0.085 ASSIGNMENTS=893 CHECKS=116867	UNSAT TT=0.068 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=2.63	UNSAT TT=0.335 ASSIGNMENTS=369 CHECKS=384177	UNSAT TT=1.316	UNSAT TT=1.422
csp/QCP-15/ normalized-qcp-15-120-13_ext.xml	UNSAT TT=1.671	UNSAT TT=29.813 CHECKS=30937800 NODES=165801	UNSAT TT=17.16 CHECKS=16417600 NODES=92199	UNSAT TT=98.304	UNSAT TT=338.257 CHECKS=281322000	UNSAT TT=88.296 CHECKS=80225600	UNSAT TT=2.125 ASSIGNMENTS=0	UNSAT TT=2.182 ASSIGNMENTS=0	UNSAT TT=150.956 CHECKS=8564360 NODES=176439	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=9.718 ASSIGNMENTS=0	UNSAT TT=38.444 ASSIGNMENTS=165801 CHECKS=30937800	UNSAT TT=2.003	UNSAT TT=1.816	UNSAT TT=6.288 ASSIGNMENTS=72751 CHECKS=25324200	UNSAT TT=12.449 ASSIGNMENTS=150850 CHECKS=50530200	UNSAT TT=156.892	UNSAT TT=18.691 ASSIGNMENTS=237628 CHECKS=79574600	UNSAT TT=8.021 ASSIGNMENTS=97193 CHECKS=32937500	UNSAT TT=3.186	UNSAT TT=173.665 ASSIGNMENTS=869150 CHECKS=312800000	UNSAT TT=1.746	UNSAT TT=1.671
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-15/ normalized-qcp-15-120-14_ext.xml	UNSAT TT=0.066	UNSAT TT=1.333 CHECKS=80695 NODES=803	UNSAT TT=1.441 CHECKS=79108 NODES=517	UNSAT TT=64.267	UNSAT TT=0.392 CHECKS=143943	UNSAT TT=0.575 CHECKS=336466	UNSAT TT=0.975 ASSIGNMENTS=0	UNSAT TT=0.867 ASSIGNMENTS=0	UNSAT TT=1.643 CHECKS=22826 NODES=116	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=0.078 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=1.751	UNSAT TT=1.625	UNSAT TT=0.066 ASSIGNMENTS=178 CHECKS=26271	UNSAT TT=0.249 ASSIGNMENTS=5044 CHECKS=734442	UNSAT TT=1.942	UNSAT TT=0.082 ASSIGNMENTS=571 CHECKS=84924	UNSAT TT=0.066 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=2.492	UNSAT TT=0.241 ASSIGNMENTS=192 CHECKS=235794	UNSAT TT=1.373	UNSAT TT=1.497
csp/QCP-15/ normalized-qcp-15-120-1_ext.xml	SAT TT=0.096	SAT TT=1.518 CHECKS=222886 NODES=2456	SAT TT=1.553 CHECKS=211142 NODES=1960	SAT TT=8.076	SAT TT=1.426 CHECKS=838157	SAT TT=0.299 CHECKS=176181	SAT TT=2.821 ASSIGNMENTS=87	SAT TT=2.671 ASSIGNMENTS=40	SAT TT=4.585 CHECKS=184388 NODES=3400	SAT TT=1.617 CHECKS=282696 NODES=3280	SAT TT=2.108 CHECKS=2556870 NODES=3189	SAT TT=0.116 ASSIGNMENTS=437 CHECKS=139504	SAT TT=0.111 ASSIGNMENTS=437 CHECKS=139504	SAT TT=2.605	SAT TT=2.565	SAT TT=0.11 ASSIGNMENTS=602 CHECKS=201213	SAT TT=0.292 ASSIGNMENTS=5020 CHECKS=893730	SAT TT=124.507	SAT TT=0.109 ASSIGNMENTS=761 CHECKS=194113	SAT TT=0.096 ASSIGNMENTS=437 CHECKS=139504	SAT TT=3.123	SAT TT=0.69 ASSIGNMENTS=2577 CHECKS=627411	SAT TT=1.483	SAT TT=1.51
csp/QCP-15/ normalized-qcp-15-120-2_ext.xml	SAT TT=0.298	SAT TT=1.785 CHECKS=395998 NODES=3709	SAT TT=10.585 CHECKS=9043460 NODES=64907	SAT TT=0.617	SAT TT=33.879 CHECKS=24148300	SAT TT=0.613 CHECKS=359549	SAT TT=2.523 ASSIGNMENTS=17	SAT TT=2.621 ASSIGNMENTS=19	SAT TT=3.167 CHECKS=100270 NODES=1856	SAT TT=1.88 CHECKS=1005300 NODES=12785	SAT TT=3.166 CHECKS=9988960 NODES=9645	SAT TT=10.572 ASSIGNMENTS=17	SAT TT=11.98 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.61	SAT TT=2.554	SAT TT=2.924 ASSIGNMENTS=52118 CHECKS=11976600	SAT TT=0.298 ASSIGNMENTS=5898 CHECKS=982607	SAT TT=20.78	SAT TT=3.571 ASSIGNMENTS=67370 CHECKS=13278400	SAT TT=4.692 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.827	SAT TT=2.299 ASSIGNMENTS=14225 CHECKS=3243460	SAT TT=1.357	SAT TT=1.749
csp/QCP-15/ normalized-qcp-15-120-3_ext.xml	SAT TT=0.089	SAT TT=4.12 CHECKS=2768200 NODES=18180	SAT TT=1.869 CHECKS=377772 NODES=3508	SAT TT=25.651	SAT TT=0.265 CHECKS=98287	SAT TT=0.158 CHECKS=30306	SAT TT=2.658 ASSIGNMENTS=22	SAT TT=2.617 ASSIGNMENTS=26	SAT TT=13.745 CHECKS=762223 NODES=16089	SAT TT=2.106 CHECKS=984197 NODES=12860	SAT TT=2.064 CHECKS=3632730 NODES=4371	SAT TT=0.106 ASSIGNMENTS=351 CHECKS=120599	SAT TT=0.107 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.758	SAT TT=2.439	SAT TT=0.167 ASSIGNMENTS=1224 CHECKS=429617	SAT TT=8.377 ASSIGNMENTS=132785 CHECKS=33829300	SAT TT=11.585	SAT TT=0.937 ASSIGNMENTS=10250 CHECKS=3412800	SAT TT=0.089 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.843	SAT TT=0.261 ASSIGNMENTS=411 CHECKS=253294	SAT TT=1.502	SAT TT=1.884
csp/QCP-15/ normalized-qcp-15-120-4_ext.xml	SAT TT=0.066	SAT TT=1.824 CHECKS=457461 NODES=4186	SAT TT=1.693 CHECKS=365624 NODES=2757	SAT TT=85.144	SAT TT=0.817 CHECKS=502288	SAT TT=1.022 CHECKS=706131	SAT TT=3.191 ASSIGNMENTS=167	SAT TT=2.291 ASSIGNMENTS=18	SAT TT=2.827 CHECKS=86780 NODES=1563	SAT TT=3.794 CHECKS=6303240 NODES=84151	? (TO) TT=1800.08	SAT TT=0.076 ASSIGNMENTS=165 CHECKS=31018	SAT TT=0.081 ASSIGNMENTS=165 CHECKS=31018	SAT TT=2.506	SAT TT=2.547	SAT TT=0.394 ASSIGNMENTS=4066 CHECKS=1298560	SAT TT=0.393 ASSIGNMENTS=6544 CHECKS=1430490	SAT TT=5.526	SAT TT=1.423 ASSIGNMENTS=15871 CHECKS=5448940	SAT TT=0.066 ASSIGNMENTS=165 CHECKS=31018	SAT TT=3.019	SAT TT=2.776 ASSIGNMENTS=9219 CHECKS=3201800	SAT TT=1.405	SAT TT=1.782
csp/QCP-15/ normalized-qcp-15-120-5_ext.xml	SAT TT=0.367	SAT TT=2.204 CHECKS=810869 NODES=5495	SAT TT=10.015 CHECKS=8119460 NODES=50490	SAT TT=0.367	SAT TT=14.96 CHECKS=10200600	SAT TT=8.273 CHECKS=7781820	SAT TT=3.451 ASSIGNMENTS=62	SAT TT=3.083 ASSIGNMENTS=26	SAT TT=30.152 CHECKS=1758240 NODES=33141	SAT TT=8.387 CHECKS=17303400 NODES=244991	SAT TT=1.661 CHECKS=588870 NODES=1002	SAT TT=10.394 ASSIGNMENTS=62	SAT TT=9.892 ASSIGNMENTS=5495 CHECKS=810869	SAT TT=2.598	SAT TT=2.963	SAT TT=11.554 ASSIGNMENTS=140271 CHECKS=50270700	SAT TT=1.229 ASSIGNMENTS=15737 CHECKS=4843560	SAT TT=1315.66	SAT TT=5.147 ASSIGNMENTS=55178 CHECKS=20607700	SAT TT=9.578 ASSIGNMENTS=116993 CHECKS=42085400	SAT TT=3.454	SAT TT=69.82 ASSIGNMENTS=338940 CHECKS=94993700	SAT TT=1.611	SAT TT=2.111
csp/QCP-15/ normalized-qcp-15-120-6_ext.xml	SAT TT=0.465	SAT TT=1.776 CHECKS=417725 NODES=3570	SAT TT=1.886 CHECKS=383716 NODES=3193	SAT TT=19.578	SAT TT=2.197 CHECKS=1401790	SAT TT=0.465 CHECKS=307968	SAT TT=2.689 ASSIGNMENTS=67	SAT TT=2.606 ASSIGNMENTS=32	SAT TT=2.841 CHECKS=86326 NODES=1794	SAT TT=1.915 CHECKS=1086130 NODES=14291	SAT TT=2.794 CHECKS=8723290 NODES=9058	SAT TT=1.374 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=1.514 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.458	SAT TT=2.579	SAT TT=1.957 ASSIGNMENTS=23710 CHECKS=8258540	SAT TT=0.632 ASSIGNMENTS=9160 CHECKS=2191040	SAT TT=1.811	SAT TT=2.117 ASSIGNMENTS=26306 CHECKS=8026020	SAT TT=1.335 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.666	SAT TT=7.983 ASSIGNMENTS=31231 CHECKS=7469300	SAT TT=1.441	SAT TT=1.624
csp/QCP-15/ normalized-qcp-15-120-7_ext.xml	SAT TT=0.384	SAT TT=1.568 CHECKS=263854 NODES=2427	SAT TT=1.446 CHECKS=172508 NODES=1414	SAT TT=0.97	SAT TT=9.276 CHECKS=6340330	SAT TT=1.158 CHECKS=908072	SAT TT=2.781 ASSIGNMENTS=40	SAT TT=2.809 ASSIGNMENTS=44	SAT TT=1.804 CHECKS=31917 NODES=458	SAT TT=1.755 CHECKS=173516 NODES=1788	SAT TT=1.969 CHECKS=3075520 NODES=4321	SAT TT=1.26 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=1.258 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.709	SAT TT=2.582	SAT TT=0.813 ASSIGNMENTS=10788 CHECKS=3171960	SAT TT=0.684 ASSIGNMENTS=9831 CHECKS=2373610	SAT TT=53.567	SAT TT=1.411 ASSIGNMENTS=15828 CHECKS=5164040	SAT TT=1.203 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.922	SAT TT=9.665 ASSIGNMENTS=54258 CHECKS=13817100	SAT TT=1.435	SAT TT=1.482
csp/QCP-15/ normalized-qcp-15-120-8_ext.xml	SAT TT=0.255	SAT TT=2.542 CHECKS=1295610 NODES=9088	SAT TT=1.868 CHECKS=560127 NODES=4085	SAT TT=15.666	SAT TT=2.318 CHECKS=1538240	SAT TT=1.049 CHECKS=881616	SAT TT=2.606 ASSIGNMENTS=42	SAT TT=2.498 ASSIGNMENTS=26	SAT TT=2.125 CHECKS=45436 NODES=834	SAT TT=2.055 CHECKS=1241460 NODES=16130	SAT TT=2.332 CHECKS=5588600 NODES=5826	SAT TT=0.259 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=0.258 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=2.624	SAT TT=2.629	SAT TT=0.297 ASSIGNMENTS=2359 CHECKS=958233	SAT TT=0.522 ASSIGNMENTS=7929 CHECKS=1814400	SAT TT=33.836	SAT TT=2.2 ASSIGNMENTS=26530 CHECKS=8919850	SAT TT=0.255 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=3.191	SAT TT=0.711 ASSIGNMENTS=1749 CHECKS=499081	SAT TT=1.45	SAT TT=1.535
csp/QCP-15/ normalized-qcp-15-120-9_ext.xml	SAT TT=1.303	SAT TT=12.64 CHECKS=11213100 NODES=71894	SAT TT=6.327 CHECKS=4588480 NODES=24366	SAT TT=108.657	SAT TT=4.641 CHECKS=2966030	SAT TT=15.418 CHECKS=13318100	SAT TT=2.754 ASSIGNMENTS=29	SAT TT=2.718 ASSIGNMENTS=6	SAT TT=2.997 CHECKS=99776 NODES=1809	SAT TT=26.488 CHECKS=65705000 NODES=903393	? (TO) TT=1800	SAT TT=10.403 ASSIGNMENTS=29	SAT TT=19.644 ASSIGNMENTS=71894 CHECKS=11213100	SAT TT=2.617	SAT TT=2.568	SAT TT=58.625 ASSIGNMENTS=808661 CHECKS=227102000	SAT TT=1.303 ASSIGNMENTS=16405 CHECKS=5035400	? (TO) TT=1800.11	SAT TT=9.282 ASSIGNMENTS=108559 CHECKS=35135000	SAT TT=83.526 ASSIGNMENTS=1146480 CHECKS=356217000	SAT TT=3.457	SAT TT=716.602 ASSIGNMENTS=1850280 CHECKS=459937000	SAT TT=1.531	SAT TT=1.638
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-0_ext.xml	SAT TT=3.689	SAT TT=86.178 CHECKS=71044700 NODES=296824	SAT TT=68.355 CHECKS=59193100 NODES=267618	? (TO) TT=1800.04	SAT TT=1559.42 CHECKS=750580000	? (TO) TT=1800.07	SAT TT=12.586 ASSIGNMENTS=308	SAT TT=7.945 ASSIGNMENTS=88	? (TO) TT=1800.08	SAT TT=35.998 CHECKS=63552400 NODES=661720	? (TO) TT=1800.06	SAT TT=15.179 ASSIGNMENTS=308	SAT TT=87.566 ASSIGNMENTS=296824 CHECKS=71044700	SAT TT=4.737	SAT TT=5.139	SAT TT=371.034 ASSIGNMENTS=3413270 CHECKS=1544380000	SAT TT=3.689 ASSIGNMENTS=34612 CHECKS=15672000	? (TO) TT=1800.07	SAT TT=549.796 ASSIGNMENTS=5052710 CHECKS=2389460000	SAT TT=294.592 ASSIGNMENTS=2884700 CHECKS=1306400000	SAT TT=7.722	? (TO) TT=1800.1	SAT TT=4.273	SAT TT=7.71
csp/QCP-20/ normalized-qcp-20-187-10_ext.xml	UNSAT TT=5.808	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=196.177 ASSIGNMENTS=8438	UNSAT TT=88.792 ASSIGNMENTS=2468	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=67.933 ASSIGNMENTS=2434	UNSAT TT=734.904 ASSIGNMENTS=2434	UNSAT TT=5.808	UNSAT TT=20.349	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=13.604	? (TO) TT=1800.1	UNSAT TT=9.165	UNSAT TT=9.768
csp/QCP-20/ normalized-qcp-20-187-11_ext.xml	UNSAT TT=0.201	UNSAT TT=4.086 CHECKS=1821240 NODES=9837	UNSAT TT=2.87 CHECKS=543852 NODES=3228	? (TO) TT=1800.1	UNSAT TT=3.116 CHECKS=1294710	UNSAT TT=1.484 CHECKS=240400	UNSAT TT=1.011 ASSIGNMENTS=0	UNSAT TT=1.213 ASSIGNMENTS=0	UNSAT TT=10.067 CHECKS=145949 NODES=2142	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.222 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=0.223 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=2.882	UNSAT TT=3.03	UNSAT TT=0.224 ASSIGNMENTS=2069 CHECKS=390152	UNSAT TT=0.48 ASSIGNMENTS=7313 CHECKS=1482210	UNSAT TT=11.104	UNSAT TT=0.201 ASSIGNMENTS=1518 CHECKS=288165	UNSAT TT=0.216 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=4.041	UNSAT TT=2.509 ASSIGNMENTS=1786 CHECKS=2862110	UNSAT TT=1.991	UNSAT TT=2.657
csp/QCP-20/ normalized-qcp-20-187-12_ext.xml	UNSAT TT=5.556	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=8.817 ASSIGNMENTS=3	UNSAT TT=8.318 ASSIGNMENTS=22	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=13.111 ASSIGNMENTS=170	UNSAT TT=679.857 ASSIGNMENTS=170	UNSAT TT=5.731	UNSAT TT=5.556	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=10.037	? (TO) TT=1800.11	UNSAT TT=17.393	UNSAT TT=5.659
csp/QCP-20/ normalized-qcp-20-187-13_ext.xml	UNSAT TT=3.918	UNSAT TT=1004.12 CHECKS=850273000 NODES=3819070	UNSAT TT=1109.52 CHECKS=901767000 NODES=3912150	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=61.909 ASSIGNMENTS=2738	UNSAT TT=20.154 ASSIGNMENTS=364	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=73.849 ASSIGNMENTS=2808	UNSAT TT=737.606 ASSIGNMENTS=2808	UNSAT TT=4.708	UNSAT TT=3.918	UNSAT TT=687.067 ASSIGNMENTS=6765400 CHECKS=2829090000	UNSAT TT=657.699 ASSIGNMENTS=6901810 CHECKS=2918940000	? (TO) TT=1800.08	UNSAT TT=389.174 ASSIGNMENTS=3747130 CHECKS=1573070000	UNSAT TT=749.406 ASSIGNMENTS=7567830 CHECKS=3147200000	UNSAT TT=6.871	? (TO) TT=1800.08	UNSAT TT=4.907	UNSAT TT=5.638
csp/QCP-20/ normalized-qcp-20-187-14_ext.xml	UNSAT TT=3.586	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=4.106 ASSIGNMENTS=0	UNSAT TT=4.118 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=11.324 ASSIGNMENTS=110	UNSAT TT=679.022 ASSIGNMENTS=110	UNSAT TT=5.341	UNSAT TT=3.625	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=5.31	? (TO) TT=1800.03	UNSAT TT=4.069	UNSAT TT=3.586
csp/QCP-20/ normalized-qcp-20-187-1_ext.xml	SAT TT=1.284	SAT TT=247.054 CHECKS=194819000 NODES=894042	SAT TT=106.901 CHECKS=86207800 NODES=361496	? (TO) TT=1800.09	SAT TT=1772.73 CHECKS=889563000	SAT TT=185.742 CHECKS=74609700	SAT TT=7.571 ASSIGNMENTS=30	SAT TT=7.366 ASSIGNMENTS=26	? (TO) TT=1800.09	SAT TT=98.953 CHECKS=191936000 NODES=1974040	? (TO) TT=1800.07	SAT TT=1.3 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=1.323 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=8.255	SAT TT=4.236	SAT TT=3.046 ASSIGNMENTS=28113 CHECKS=11572400	SAT TT=31.858 ASSIGNMENTS=352100 CHECKS=134727000	? (TO) TT=1800.05	SAT TT=7.487 ASSIGNMENTS=85564 CHECKS=31309100	SAT TT=1.284 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=4.123	? (TO) TT=1800.08	SAT TT=2.718	SAT TT=2.805
csp/QCP-20/ normalized-qcp-20-187-2_ext.xml	SAT TT=4.617	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1354.15 CHECKS=504683000	SAT TT=15.658 ASSIGNMENTS=351	SAT TT=13.643 ASSIGNMENTS=213	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=30.475 ASSIGNMENTS=1028	SAT TT=699.321 ASSIGNMENTS=1028	SAT TT=6.022	SAT TT=7.225	? (TO) TT=1800.06	SAT TT=735.499 ASSIGNMENTS=7282480 CHECKS=3353870000	? (TO) TT=1800.05	SAT TT=1371.13 ASSIGNMENTS=13209900 CHECKS=1456490000	SAT TT=997.939 ASSIGNMENTS=9104530 CHECKS=100722000	SAT TT=10.076	? (TO) TT=1800.1	SAT TT=8.19	SAT TT=4.617
csp/QCP-20/ normalized-qcp-20-187-3_ext.xml	SAT TT=4.797	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=10.955 ASSIGNMENTS=82	SAT TT=9.772 ASSIGNMENTS=34	? (TO) TT=1800.06	SAT TT=270.7 CHECKS=553253000 NODES=5810500	? (TO) TT=1800.08	SAT TT=32.802 ASSIGNMENTS=1154	SAT TT=702.01 ASSIGNMENTS=1154	SAT TT=5.648	SAT TT=4.965	SAT TT=1087.8 ASSIGNMENTS=10250300 CHECKS=426425000	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=869.756 ASSIGNMENTS=7511240 CHECKS=3554840000	? (TO) TT=1800.04	SAT TT=7.375	? (TO) TT=1800.07	SAT TT=5.945	SAT TT=4.797
csp/QCP-20/ normalized-qcp-20-187-4_ext.xml	SAT TT=5.092	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=27.782 ASSIGNMENTS=1026	SAT TT=11.569 ASSIGNMENTS=172	? (TO) TT=1800.03	SAT TT=20.191 CHECKS=34876100 NODES=372428	? (TO) TT=1800.09	SAT TT=99.815 ASSIGNMENTS=4017	SAT TT=758.606 ASSIGNMENTS=4017	SAT TT=5.092	SAT TT=6.342	? (TO) TT=1800.09	SAT TT=1495.3 ASSIGNMENTS=14166800 CHECKS=2472280000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.3	? (TO) TT=1800.1	SAT TT=16.893	SAT TT=5.912
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-5_ext.xml	SAT TT=2.514	SAT TT=136.215 CHECKS=107969000 NODES=460722	SAT TT=611.783 CHECKS=534493000 NODES=2470600	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=6.896 CHECKS=1833940	SAT TT=10.422 ASSIGNMENTS=120	SAT TT=7.483 ASSIGNMENTS=24	? (TO) TT=1800.01	SAT TT=11.417 CHECKS=13794900 NODES=140757	? (TO) TT=1800.06	SAT TT=20.132 ASSIGNMENTS=521	SAT TT=129.725 ASSIGNMENTS=460722 CHECKS=107969000	SAT TT=4.403	SAT TT=4.24	? (TO) TT=1800.07	SAT TT=50.736 ASSIGNMENTS=538921 CHECKS=208806000	? (TO) TT=1800.06	SAT TT=56.666 ASSIGNMENTS=582246 CHECKS=253759000	? (TO) TT=1800.02	SAT TT=4.905	? (TO) TT=1800.11	SAT TT=2.514	SAT TT=4.292
csp/QCP-20/ normalized-qcp-20-187-6_ext.xml	SAT TT=4.988	? (TO) TT=1800.1	SAT TT=1384.09 CHECKS=1230110000 NODES=4741160	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1147.44 CHECKS=488402000	SAT TT=27.2 ASSIGNMENTS=1090	SAT TT=7.793 ASSIGNMENTS=63	? (TO) TT=1800.05	SAT TT=13.019 CHECKS=16341800 NODES=170729	? (TO) TT=1800.05	SAT TT=23.137 ASSIGNMENTS=807	SAT TT=691.743 ASSIGNMENTS=807	SAT TT=5.841	SAT TT=4.988	SAT TT=37.453 ASSIGNMENTS=354247 CHECKS=167088000	SAT TT=956.689 ASSIGNMENTS=8572940 CHECKS=3994410000	? (TO) TT=1800.05	SAT TT=1425.12 ASSIGNMENTS=12144500 CHECKS=1324030000	SAT TT=135.171 ASSIGNMENTS=1126510 CHECKS=549540000	SAT TT=6.375	SAT TT=722.274 ASSIGNMENTS=2291300 CHECKS=709389000	SAT TT=7.797	SAT TT=10.33
csp/QCP-20/ normalized-qcp-20-187-7_ext.xml	SAT TT=3.473	SAT TT=1125.21 CHECKS=997941000 NODES=4322420	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.991 ASSIGNMENTS=131	SAT TT=8.906 ASSIGNMENTS=100	? (TO) TT=1800.03	SAT TT=31.612 CHECKS=53466000 NODES=564896	? (TO) TT=1800.01	SAT TT=11.663 ASSIGNMENTS=131	SAT TT=678.678 ASSIGNMENTS=131	SAT TT=6.406	SAT TT=6.537	SAT TT=1511.79 ASSIGNMENTS=14831300 CHECKS=2128970000	SAT TT=138.199 ASSIGNMENTS=1300120 CHECKS=621673000	? (TO) TT=1800.08	SAT TT=1760.55 ASSIGNMENTS=16280500 CHECKS=3237210000	? (TO) TT=1800.04	SAT TT=4.966	SAT TT=1386.64 ASSIGNMENTS=5868380 CHECKS=1619470000	SAT TT=3.473	SAT TT=13.434
csp/QCP-20/ normalized-qcp-20-187-8_ext.xml	SAT TT=3.369	SAT TT=103.779 CHECKS=85623200 NODES=369967	SAT TT=3.97 CHECKS=1805770 NODES=10365	? (TO) TT=1800.02	SAT TT=148.427 CHECKS=77597100	SAT TT=1376.39 CHECKS=1311560000	SAT TT=8.46 ASSIGNMENTS=53	SAT TT=13.154 ASSIGNMENTS=228	SAT TT=396.684 CHECKS=11067600 NODES=192251	SAT TT=51.755 CHECKS=100310000 NODES=1038730	? (TO) TT=1800.04	SAT TT=13.966 ASSIGNMENTS=206	SAT TT=112.52 ASSIGNMENTS=369967 CHECKS=85623200	SAT TT=5.835	SAT TT=4.605	SAT TT=301.348 ASSIGNMENTS=3260060 CHECKS=1260420000	SAT TT=7.867 ASSIGNMENTS=79487 CHECKS=32450600	? (TO) TT=1800.11	SAT TT=432.599 ASSIGNMENTS=3830550 CHECKS=1769440000	SAT TT=278.883 ASSIGNMENTS=2931480 CHECKS=1155290000	SAT TT=4.524	? (TO) TT=1800.04	SAT TT=3.712	SAT TT=3.369
csp/QCP-20/ normalized-qcp-20-187-9_ext.xml	SAT TT=1.527	SAT TT=771.553 CHECKS=643145000 NODES=2667110	SAT TT=5.795 CHECKS=3102290 NODES=15098	? (TO) TT=1800.04	SAT TT=18.857 CHECKS=8505560	SAT TT=788.028 CHECKS=260390000	SAT TT=7.727 ASSIGNMENTS=78	SAT TT=8.76 ASSIGNMENTS=153	? (TO) TT=1800.03	SAT TT=7.235 CHECKS=4154440 NODES=42970	? (TO) TT=1800	SAT TT=17.289 ASSIGNMENTS=408	SAT TT=684.963 ASSIGNMENTS=408	SAT TT=4.688	SAT TT=4.577	SAT TT=193.378 ASSIGNMENTS=2148000 CHECKS=864870000	SAT TT=150.446 ASSIGNMENTS=1164980 CHECKS=631978000	? (TO) TT=1800.03	SAT TT=1.527 ASSIGNMENTS=11480 CHECKS=5951810	SAT TT=207.332 ASSIGNMENTS=2193810 CHECKS=876188000	SAT TT=5.019	? (TO) TT=1800.07	SAT TT=3.738	SAT TT=3.993
csp/QCP-25/ normalized-qcp-25-264-0_ext.xml	SAT TT=31.548	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=489.462 ASSIGNMENTS=10433	SAT TT=94.367 ASSIGNMENTS=1329	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=482.805 ASSIGNMENTS=10433	SAT TT=1177.74 ASSIGNMENTS=10433	SAT TT=43.353	SAT TT=34.017	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=31.548	? (TO) TT=1800.12	SAT TT=273.693	SAT TT=107.804
csp/QCP-25/ normalized-qcp-25-264-10_ext.xml	UNSAT TT=19.47	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=148.3 ASSIGNMENTS=2369	UNSAT TT=129.935 ASSIGNMENTS=1263	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=132.104 ASSIGNMENTS=2369	UNSAT TT=797.306 ASSIGNMENTS=2369	UNSAT TT=42.075	UNSAT TT=19.47	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=86.44	? (TO) TT=1800.09	UNSAT TT=255.43	UNSAT TT=129.58
csp/QCP-25/ normalized-qcp-25-264-11_ext.xml	UNSAT TT=0.356	UNSAT TT=1.828 CHECKS=102046 NODES=0	UNSAT TT=1.836 CHECKS=102046 NODES=0	? (TO) TT=1800.04	UNSAT TT=4.012 CHECKS=728022	UNSAT TT=5.96 CHECKS=342599	UNSAT TT=1.163 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=18.254 CHECKS=115324 NODES=244	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=0.383 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=0.384 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=5.264	UNSAT TT=6.896	UNSAT TT=0.402 ASSIGNMENTS=2888 CHECKS=673016	UNSAT TT=0.615 ASSIGNMENTS=8328 CHECKS=1813620	UNSAT TT=44.034	UNSAT TT=0.711 ASSIGNMENTS=7921 CHECKS=1887400	UNSAT TT=0.356 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=4.87	UNSAT TT=2.95 ASSIGNMENTS=1617 CHECKS=2890660	UNSAT TT=3.13	UNSAT TT=3.384
csp/QCP-25/ normalized-qcp-25-264-12_ext.xml	UNSAT TT=1.469	UNSAT TT=1465.74 CHECKS=1217050000 NODES=4495920	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=1.469 ASSIGNMENTS=0	UNSAT TT=1.483 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=9.137 ASSIGNMENTS=0	UNSAT TT=676.066 ASSIGNMENTS=0	UNSAT TT=5.694	UNSAT TT=5.498	? (TO) TT=1800.08	UNSAT TT=793.615 ASSIGNMENTS=11236600 CHECKS=3780190000	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=5.014	? (TO) TT=1800.15	UNSAT TT=3.181	UNSAT TT=3.889
csp/QCP-25/ normalized-qcp-25-264-13_ext.xml	UNSAT TT=1.4	? (TO) TT=1800.1	UNSAT TT=32.759 CHECKS=19295600 NODES=78577	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.4 ASSIGNMENTS=0	UNSAT TT=1.413 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.332 ASSIGNMENTS=0	UNSAT TT=675.912 ASSIGNMENTS=0	UNSAT TT=5.766	UNSAT TT=5.977	? (TO) TT=1800.07	UNSAT TT=191.924 ASSIGNMENTS=3029480 CHECKS=840137000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=5.366	? (TO) TT=1800.14	UNSAT TT=3.26	UNSAT TT=4.098
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-25/ normalized-qcp-25-264-14_ext.xml	UNSAT TT=32.393	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=187.054 ASSIGNMENTS=2650	UNSAT TT=111.985 ASSIGNMENTS=1014	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=148.726 ASSIGNMENTS=2487	UNSAT TT=800.345 ASSIGNMENTS=2487	UNSAT TT=32.474	UNSAT TT=32.393	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=70.472	? (TO) TT=1800.15	UNSAT TT=65.879	UNSAT TT=105.436
csp/QCP-25/ normalized-qcp-25-264-1_ext.xml	SAT TT=137.596	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=656.988	SAT TT=137.596	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=371.733	? (TO) TT=1800.11	SAT TT=654.826	SAT TT=1696.08
csp/QCP-25/ normalized-qcp-25-264-2_ext.xml	SAT TT=10.57	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=30.048 ASSIGNMENTS=160	SAT TT=94.941 ASSIGNMENTS=1221	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=158.12 ASSIGNMENTS=2681	SAT TT=831.742 ASSIGNMENTS=2681	SAT TT=17.961	SAT TT=21.711	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=10.57	? (TO) TT=1800.12	SAT TT=38.422	SAT TT=37.986
csp/QCP-25/ normalized-qcp-25-264-3_ext.xml	SAT TT=47.242	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1391.47 ASSIGNMENTS=28060	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1419.53 ASSIGNMENTS=28060	? (TO) TT=1800.01	SAT TT=204.922	SAT TT=47.242	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=299.072	? (TO) TT=1800.09	SAT TT=1169.24	SAT TT=93.987
csp/QCP-25/ normalized-qcp-25-264-4_ext.xml	SAT TT=27.328	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1477.49 ASSIGNMENTS=26778	SAT TT=221.842 ASSIGNMENTS=2446	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=27.328	SAT TT=98.283	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=166.727	? (TO) TT=1800.09	SAT TT=342.65	SAT TT=71.447
csp/QCP-25/ normalized-qcp-25-264-5_ext.xml	SAT TT=35.778	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=962.125 ASSIGNMENTS=11219	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=35.778	SAT TT=116.864	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=285.904	? (TO) TT=1800.13	SAT TT=230.37	SAT TT=97.073
csp/QCP-25/ normalized-qcp-25-264-6_ext.xml	SAT TT=57.228	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=57.228 ASSIGNMENTS=737	SAT TT=1151.55 ASSIGNMENTS=15852	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=119.394 ASSIGNMENTS=2319	SAT TT=786.463 ASSIGNMENTS=2319	SAT TT=366.619	SAT TT=141.766	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=654.663	? (TO) TT=1800.07	SAT TT=166.843	SAT TT=166.095
csp/QCP-25/ normalized-qcp-25-264-7_ext.xml	SAT TT=43.883	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=943.746 ASSIGNMENTS=22317	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1453.41 CHECKS=2264150000 NODES=19452500	? (TO) TT=1800.06	SAT TT=252.841 ASSIGNMENTS=5745	SAT TT=918.357 ASSIGNMENTS=5745	SAT TT=70.143	SAT TT=43.883	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=64.991	? (TO) TT=1800.14	SAT TT=53.629	SAT TT=228.492
csp/QCP-25/ normalized-qcp-25-264-8_ext.xml	SAT TT=25.145	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=727.454 ASSIGNMENTS=15922	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=130.551 ASSIGNMENTS=2149	SAT TT=797.46 ASSIGNMENTS=2149	SAT TT=73.27	SAT TT=25.145	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=61.858	? (TO) TT=1800.16	SAT TT=125.736	SAT TT=89.797
csp/QCP-25/ normalized-qcp-25-264-9_ext.xml	SAT TT=26.164	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=46.516 ASSIGNMENTS=447	SAT TT=1775.36 ASSIGNMENTS=21093	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=26.164	SAT TT=37.713	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=380.529	? (TO) TT=1800.16	SAT TT=264.981	SAT TT=96.707
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-10/ normalized-qwh-10-57-0_ext.xml	SAT TT=0.021	SAT TT=0.938 CHECKS=7497 NODES=101	SAT TT=1.016 CHECKS=24710 NODES=0	SAT TT=0.102	SAT TT=0.114 CHECKS=109640	SAT TT=0.04 CHECKS=14117	SAT TT=1.227 ASSIGNMENTS=4	SAT TT=0.937 ASSIGNMENTS=9	SAT TT=0.587 CHECKS=5245 NODES=108	SAT TT=0.646 CHECKS=25298 NODES=379	SAT TT=0.662 CHECKS=282044 NODES=745	SAT TT=0.034 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.033 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.49	SAT TT=1.438	SAT TT=0.024 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=3202	SAT TT=0.62	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=3579	SAT TT=0.021 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.301	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=34312	SAT TT=0.956	SAT TT=1.144
csp/QWH-10/ normalized-qwh-10-57-1_ext.xml	SAT TT=0.022	SAT TT=0.953 CHECKS=9265 NODES=145	SAT TT=1.02 CHECKS=19847 NODES=0	SAT TT=0.106	SAT TT=0.121 CHECKS=112630	SAT TT=0.049 CHECKS=33631	SAT TT=0.833 ASSIGNMENTS=5	SAT TT=1.051 ASSIGNMENTS=4	SAT TT=0.624 CHECKS=6626 NODES=153	SAT TT=0.621 CHECKS=61113 NODES=1221	SAT TT=0.867 CHECKS=84676 NODES=280	SAT TT=0.029 ASSIGNMENTS=32 CHECKS=4937	SAT TT=0.033 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.529	SAT TT=1.593	SAT TT=0.022 ASSIGNMENTS=35 CHECKS=5718	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=10042	SAT TT=0.824	SAT TT=0.026 ASSIGNMENTS=137 CHECKS=13855	SAT TT=0.023 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.301	SAT TT=0.055 ASSIGNMENTS=133 CHECKS=36754	SAT TT=0.992	SAT TT=1.001
csp/QWH-10/ normalized-qwh-10-57-2_ext.xml	SAT TT=0.022	SAT TT=0.906 CHECKS=6664 NODES=100	SAT TT=0.934 CHECKS=7844 NODES=0	SAT TT=0.103	SAT TT=0.057 CHECKS=23137	SAT TT=0.04 CHECKS=24242	SAT TT=1.065 ASSIGNMENTS=5	SAT TT=1.029 ASSIGNMENTS=6	SAT TT=0.624 CHECKS=5485 NODES=116	SAT TT=0.644 CHECKS=43398 NODES=807	SAT TT=0.659 CHECKS=52021 NODES=148	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.609	SAT TT=1.56	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=2064	SAT TT=0.022 ASSIGNMENTS=38 CHECKS=4669	SAT TT=0.662	SAT TT=0.023 ASSIGNMENTS=111 CHECKS=12201	SAT TT=0.023 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.191	SAT TT=0.055 ASSIGNMENTS=139 CHECKS=38982	SAT TT=0.956	SAT TT=0.983
csp/QWH-10/ normalized-qwh-10-57-3_ext.xml	SAT TT=0.021	SAT TT=0.992 CHECKS=12727 NODES=204	SAT TT=0.938 CHECKS=17818 NODES=127	SAT TT=0.104	SAT TT=0.049 CHECKS=15467	SAT TT=0.036 CHECKS=4447	SAT TT=1.009 ASSIGNMENTS=5	SAT TT=1.184 ASSIGNMENTS=9	SAT TT=0.628 CHECKS=4820 NODES=104	SAT TT=0.622 CHECKS=20416 NODES=245	SAT TT=0.747 CHECKS=598645 NODES=1499	SAT TT=0.034 ASSIGNMENTS=36 CHECKS=3598	SAT TT=0.033 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.681	SAT TT=1.526	SAT TT=0.023 ASSIGNMENTS=42 CHECKS=4846	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=2112	SAT TT=0.652	SAT TT=0.023 ASSIGNMENTS=38 CHECKS=4571	SAT TT=0.021 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.279	SAT TT=0.053 ASSIGNMENTS=118 CHECKS=35943	SAT TT=1.127	SAT TT=1.175
csp/QWH-10/ normalized-qwh-10-57-4_ext.xml	SAT TT=0.02	SAT TT=0.936 CHECKS=7332 NODES=106	SAT TT=0.985 CHECKS=31345 NODES=237	SAT TT=0.105	SAT TT=0.098 CHECKS=81484	SAT TT=0.044 CHECKS=18791	SAT TT=1.015 ASSIGNMENTS=9	SAT TT=0.959 ASSIGNMENTS=8	SAT TT=0.588 CHECKS=4900 NODES=105	SAT TT=0.62 CHECKS=18288 NODES=181	SAT TT=0.654 CHECKS=72467 NODES=172	SAT TT=0.034 ASSIGNMENTS=20 CHECKS=2512	SAT TT=0.033 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.593	SAT TT=1.434	SAT TT=0.023 ASSIGNMENTS=20 CHECKS=2518	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=2033	SAT TT=0.647	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=6051	SAT TT=0.02 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.32	SAT TT=0.057 ASSIGNMENTS=139 CHECKS=38338	SAT TT=0.976	SAT TT=1.016
csp/QWH-10/ normalized-qwh-10-57-5_ext.xml	SAT TT=0.022	SAT TT=1.001 CHECKS=18178 NODES=384	SAT TT=0.984 CHECKS=20199 NODES=119	SAT TT=0.107	SAT TT=0.112 CHECKS=102120	SAT TT=0.035 CHECKS=3311	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=0.953 ASSIGNMENTS=9	SAT TT=0.864 CHECKS=5122 NODES=112	SAT TT=0.62 CHECKS=31715 NODES=513	SAT TT=0.613 CHECKS=56968 NODES=137	SAT TT=0.035 ASSIGNMENTS=29 CHECKS=4622	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.448	SAT TT=1.678	SAT TT=0.024 ASSIGNMENTS=30 CHECKS=5180	SAT TT=0.023 ASSIGNMENTS=14 CHECKS=1509	SAT TT=0.624	SAT TT=0.022 ASSIGNMENTS=25 CHECKS=2885	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.212	SAT TT=0.058 ASSIGNMENTS=109 CHECKS=35529	SAT TT=1.22	SAT TT=1.004
csp/QWH-10/ normalized-qwh-10-57-6_ext.xml	SAT TT=0.02	SAT TT=0.944 CHECKS=6803 NODES=101	SAT TT=0.869 CHECKS=6741 NODES=0	SAT TT=0.103	SAT TT=0.05 CHECKS=12703	SAT TT=0.032 CHECKS=3291	SAT TT=1.184 ASSIGNMENTS=12	SAT TT=0.961 ASSIGNMENTS=10	SAT TT=0.67 CHECKS=5941 NODES=126	SAT TT=0.653 CHECKS=27398 NODES=387	SAT TT=0.668 CHECKS=130105 NODES=368	SAT TT=0.033 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.69	SAT TT=1.608	SAT TT=0.02 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.024 ASSIGNMENTS=19 CHECKS=2538	SAT TT=0.642	SAT TT=0.023 ASSIGNMENTS=60 CHECKS=6026	SAT TT=0.022 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.275	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=34102	SAT TT=1.084	SAT TT=1.387
csp/QWH-10/ normalized-qwh-10-57-7_ext.xml	SAT TT=0.022	SAT TT=0.947 CHECKS=9127 NODES=139	SAT TT=1.096 CHECKS=29504 NODES=372	SAT TT=0.103	SAT TT=0.052 CHECKS=23299	SAT TT=0.043 CHECKS=16318	SAT TT=1.243 ASSIGNMENTS=13	SAT TT=1.104 ASSIGNMENTS=7	SAT TT=0.727 CHECKS=5340 NODES=114	SAT TT=0.643 CHECKS=24139 NODES=349	SAT TT=0.654 CHECKS=63343 NODES=156	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.581	SAT TT=1.524	SAT TT=0.022 ASSIGNMENTS=8 CHECKS=2252	SAT TT=0.022 ASSIGNMENTS=6 CHECKS=1168	SAT TT=0.661	SAT TT=0.026 ASSIGNMENTS=113 CHECKS=14245	SAT TT=0.022 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.275	SAT TT=0.058 ASSIGNMENTS=175 CHECKS=40589	SAT TT=1.061	SAT TT=1.212
csp/QWH-10/ normalized-qwh-10-57-8_ext.xml	SAT TT=0.022	SAT TT=0.926 CHECKS=7294 NODES=106	SAT TT=0.931 CHECKS=15074 NODES=101	SAT TT=0.102	SAT TT=0.052 CHECKS=20077	SAT TT=0.037 CHECKS=7559	SAT TT=0.969 ASSIGNMENTS=11	SAT TT=0.988 ASSIGNMENTS=8	SAT TT=0.643 CHECKS=5458 NODES=114	SAT TT=0.638 CHECKS=24212 NODES=303	SAT TT=0.665 CHECKS=219994 NODES=597	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.468	SAT TT=1.531	SAT TT=0.023 ASSIGNMENTS=19 CHECKS=2347	SAT TT=0.023 ASSIGNMENTS=30 CHECKS=3099	SAT TT=0.685	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=2645	SAT TT=0.022 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.282	SAT TT=0.058 ASSIGNMENTS=172 CHECKS=41573	SAT TT=1.05	SAT TT=0.992
csp/QWH-10/ normalized-qwh-10-57-9_ext.xml	SAT TT=0.024	SAT TT=0.982 CHECKS=7193 NODES=103	SAT TT=0.904 CHECKS=7161 NODES=0	SAT TT=0.102	SAT TT=0.045 CHECKS=12762	SAT TT=0.036 CHECKS=2847	SAT TT=0.992 ASSIGNMENTS=14	SAT TT=0.991 ASSIGNMENTS=14	SAT TT=0.712 CHECKS=8291 NODES=226	SAT TT=0.616 CHECKS=27488 NODES=350	SAT TT=0.661 CHECKS=97250 NODES=237	SAT TT=0.048 ASSIGNMENTS=320 CHECKS=41940	SAT TT=0.047 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.84	SAT TT=1.591	SAT TT=0.033 ASSIGNMENTS=267 CHECKS=35614	SAT TT=0.038 ASSIGNMENTS=708 CHECKS=51125	SAT TT=0.642	SAT TT=0.024 ASSIGNMENTS=132 CHECKS=11342	SAT TT=0.034 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.283	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=33514	SAT TT=0.962	SAT TT=0.99
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-15/ normalized-qwh-15-106-0_ext.xml	SAT TT=0.061	SAT TT=1.437 CHECKS=215823 NODES=1788	SAT TT=1.433 CHECKS=132580 NODES=1141	SAT TT=0.259	SAT TT=0.339 CHECKS=165410	SAT TT=0.249 CHECKS=138364	SAT TT=2.583 ASSIGNMENTS=20	SAT TT=2.382 ASSIGNMENTS=13	SAT TT=2.169 CHECKS=46802 NODES=775	SAT TT=1.547 CHECKS=235335 NODES=3316	SAT TT=1.807 CHECKS=858933 NODES=1279	SAT TT=0.072 ASSIGNMENTS=88 CHECKS=22046	SAT TT=0.074 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.5	SAT TT=2.525	SAT TT=0.061 ASSIGNMENTS=103 CHECKS=20156	SAT TT=0.259 ASSIGNMENTS=4056 CHECKS=711439	SAT TT=1.98	SAT TT=0.098 ASSIGNMENTS=603 CHECKS=150810	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.651	SAT TT=2.485 ASSIGNMENTS=7855 CHECKS=1647510	SAT TT=1.558	SAT TT=1.881
csp/QWH-15/ normalized-qwh-15-106-1_ext.xml	SAT TT=0.21	SAT TT=2.429 CHECKS=1128980 NODES=8034	SAT TT=2.79 CHECKS=1260490 NODES=8323	SAT TT=0.323	SAT TT=13.252 CHECKS=10335300	SAT TT=9.845 CHECKS=8684920	SAT TT=1.741 ASSIGNMENTS=10	SAT TT=1.914 ASSIGNMENTS=7	SAT TT=12.09 CHECKS=551278 NODES=12658	SAT TT=1.673 CHECKS=534970 NODES=7873	? (TO) TT=1800.06	SAT TT=0.309 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=0.305 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.515	SAT TT=2.508	SAT TT=0.21 ASSIGNMENTS=2257 CHECKS=602641	SAT TT=0.329 ASSIGNMENTS=5757 CHECKS=1014420	SAT TT=1.994	SAT TT=0.227 ASSIGNMENTS=2486 CHECKS=688388	SAT TT=0.292 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.573	SAT TT=27.914 ASSIGNMENTS=130558 CHECKS=31653400	SAT TT=1.474	SAT TT=1.486
csp/QWH-15/ normalized-qwh-15-106-2_ext.xml	SAT TT=0.076	SAT TT=1.374 CHECKS=104267 NODES=1223	SAT TT=1.611 CHECKS=266546 NODES=1937	SAT TT=0.283	SAT TT=3.981 CHECKS=2968070	SAT TT=1.324 CHECKS=1294420	SAT TT=2.455 ASSIGNMENTS=8	SAT TT=2.469 ASSIGNMENTS=17	SAT TT=2.125 CHECKS=42223 NODES=696	SAT TT=1.876 CHECKS=1008410 NODES=16561	SAT TT=1.414 CHECKS=261884 NODES=375	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.59	SAT TT=2.43	SAT TT=0.078 ASSIGNMENTS=321 CHECKS=79702	SAT TT=0.3 ASSIGNMENTS=4428 CHECKS=884034	SAT TT=2.402	SAT TT=0.193 ASSIGNMENTS=1570 CHECKS=485926	SAT TT=0.076 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.442	SAT TT=10.249 ASSIGNMENTS=32104 CHECKS=17725100	SAT TT=1.322	SAT TT=1.629
csp/QWH-15/ normalized-qwh-15-106-3_ext.xml	SAT TT=0.068	SAT TT=1.453 CHECKS=58343 NODES=714	SAT TT=1.531 CHECKS=119389 NODES=1094	SAT TT=0.258	SAT TT=0.413 CHECKS=236147	SAT TT=0.238 CHECKS=143199	SAT TT=2.902 ASSIGNMENTS=22	SAT TT=2.791 ASSIGNMENTS=15	SAT TT=2.346 CHECKS=61010 NODES=1136	SAT TT=1.663 CHECKS=223561 NODES=2882	SAT TT=1.709 CHECKS=2403780 NODES=3030	SAT TT=0.129 ASSIGNMENTS=808 CHECKS=221305	SAT TT=0.128 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.484	SAT TT=2.525	SAT TT=0.068 ASSIGNMENTS=127 CHECKS=28913	SAT TT=0.131 ASSIGNMENTS=1891 CHECKS=258609	SAT TT=1.667	SAT TT=0.088 ASSIGNMENTS=639 CHECKS=109322	SAT TT=0.119 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.576	SAT TT=0.406 ASSIGNMENTS=1238 CHECKS=305943	SAT TT=1.527	SAT TT=1.721
csp/QWH-15/ normalized-qwh-15-106-4_ext.xml	SAT TT=0.072	SAT TT=1.37 CHECKS=102231 NODES=1229	SAT TT=2.156 CHECKS=800977 NODES=5196	SAT TT=0.263	SAT TT=0.207 CHECKS=85489	SAT TT=0.125 CHECKS=31497	SAT TT=2.739 ASSIGNMENTS=20	SAT TT=2.551 ASSIGNMENTS=12	SAT TT=1.921 CHECKS=38606 NODES=585	SAT TT=1.862 CHECKS=959963 NODES=15578	SAT TT=3.161 CHECKS=11806900 NODES=11813	SAT TT=0.148 ASSIGNMENTS=827 CHECKS=315173	SAT TT=0.15 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.52	SAT TT=2.653	SAT TT=0.072 ASSIGNMENTS=263 CHECKS=87698	SAT TT=0.171 ASSIGNMENTS=2596 CHECKS=469073	SAT TT=2.742	SAT TT=0.088 ASSIGNMENTS=570 CHECKS=152598	SAT TT=0.131 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.793	SAT TT=3.472 ASSIGNMENTS=17878 CHECKS=4092040	SAT TT=1.243	SAT TT=1.446
csp/QWH-15/ normalized-qwh-15-106-5_ext.xml	SAT TT=0.362	SAT TT=1.304 CHECKS=88361 NODES=1089	SAT TT=1.637 CHECKS=148427 NODES=1478	SAT TT=0.564	SAT TT=0.785 CHECKS=533850	SAT TT=1.519 CHECKS=1389770	SAT TT=2.517 ASSIGNMENTS=4	SAT TT=2.64 ASSIGNMENTS=9	SAT TT=2.217 CHECKS=52372 NODES=969	SAT TT=1.744 CHECKS=1007920 NODES=15831	? (TO) TT=1800.04	SAT TT=0.709 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=0.665 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=2.369	SAT TT=2.499	SAT TT=0.362 ASSIGNMENTS=4473 CHECKS=1280560	SAT TT=0.415 ASSIGNMENTS=6466 CHECKS=1321430	SAT TT=4.412	SAT TT=0.378 ASSIGNMENTS=4031 CHECKS=1163710	SAT TT=0.693 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=3.096	SAT TT=1.435 ASSIGNMENTS=1271 CHECKS=391064	SAT TT=1.338	SAT TT=1.78
csp/QWH-15/ normalized-qwh-15-106-6_ext.xml	SAT TT=0.057	SAT TT=1.333 CHECKS=60314 NODES=803	SAT TT=1.319 CHECKS=61997 NODES=437	SAT TT=0.485	SAT TT=0.31 CHECKS=156435	SAT TT=0.213 CHECKS=108153	SAT TT=2.565 ASSIGNMENTS=17	SAT TT=2.38 ASSIGNMENTS=15	SAT TT=1.643 CHECKS=26207 NODES=392	SAT TT=1.499 CHECKS=117565 NODES=1256	SAT TT=1.622 CHECKS=1189680 NODES=1487	SAT TT=0.07 ASSIGNMENTS=57 CHECKS=8104	SAT TT=0.072 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.381	SAT TT=2.55	SAT TT=0.063 ASSIGNMENTS=83 CHECKS=15568	SAT TT=0.223 ASSIGNMENTS=3906 CHECKS=600434	SAT TT=1.897	SAT TT=0.073 ASSIGNMENTS=391 CHECKS=60088	SAT TT=0.057 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.624	SAT TT=3.12 ASSIGNMENTS=15534 CHECKS=3419420	SAT TT=1.343	SAT TT=1.426
csp/QWH-15/ normalized-qwh-15-106-7_ext.xml	SAT TT=0.139	SAT TT=2.566 CHECKS=1279100 NODES=7906	SAT TT=1.802 CHECKS=431497 NODES=3295	SAT TT=0.508	SAT TT=8.292 CHECKS=6505890	SAT TT=0.619 CHECKS=511293	SAT TT=2.866 ASSIGNMENTS=33	SAT TT=2.779 ASSIGNMENTS=27	SAT TT=4.766 CHECKS=200271 NODES=3884	SAT TT=1.81 CHECKS=782172 NODES=12169	SAT TT=1.903 CHECKS=2910910 NODES=3825	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=0.201 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=2.515	SAT TT=2.675	SAT TT=0.139 ASSIGNMENTS=1017 CHECKS=298371	SAT TT=0.166 ASSIGNMENTS=2230 CHECKS=379518	SAT TT=1.631	SAT TT=0.239 ASSIGNMENTS=2564 CHECKS=642280	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=3.168	SAT TT=3.538 ASSIGNMENTS=14925 CHECKS=2825110	SAT TT=1.406	SAT TT=1.685
csp/QWH-15/ normalized-qwh-15-106-8_ext.xml	SAT TT=0.107	SAT TT=1.873 CHECKS=451515 NODES=3199	SAT TT=1.66 CHECKS=325371 NODES=2130	SAT TT=0.309	SAT TT=2.036 CHECKS=1459400	SAT TT=0.671 CHECKS=547997	SAT TT=1.645 ASSIGNMENTS=2	SAT TT=1.565 ASSIGNMENTS=2	SAT TT=3.954 CHECKS=157607 NODES=2629	SAT TT=4.079 CHECKS=5663200 NODES=97312	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=761 CHECKS=266823	SAT TT=0.138 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.539	SAT TT=2.528	SAT TT=0.107 ASSIGNMENTS=562 CHECKS=197270	SAT TT=0.249 ASSIGNMENTS=4030 CHECKS=713042	SAT TT=3.065	SAT TT=0.112 ASSIGNMENTS=800 CHECKS=196145	SAT TT=0.13 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.659	SAT TT=2.398 ASSIGNMENTS=14266 CHECKS=3197610	SAT TT=1.337	SAT TT=1.449
csp/QWH-15/ normalized-qwh-15-106-9_ext.xml	SAT TT=0.058	SAT TT=1.429 CHECKS=182791 NODES=1754	SAT TT=1.42 CHECKS=89898 NODES=878	SAT TT=0.56	SAT TT=0.318 CHECKS=171747	SAT TT=0.241 CHECKS=139235	SAT TT=2.572 ASSIGNMENTS=38	SAT TT=2.367 ASSIGNMENTS=12	SAT TT=1.852 CHECKS=41959 NODES=734	SAT TT=1.545 CHECKS=259056 NODES=3564	SAT TT=1.71 CHECKS=1643710 NODES=2386	SAT TT=0.069 ASSIGNMENTS=54 CHECKS=9570	SAT TT=0.07 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.665	SAT TT=2.825	SAT TT=0.062 ASSIGNMENTS=60 CHECKS=9931	SAT TT=0.177 ASSIGNMENTS=2798 CHECKS=433332	SAT TT=1.814	SAT TT=0.127 ASSIGNMENTS=1050 CHECKS=245841	SAT TT=0.058 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.655	SAT TT=5.304 ASSIGNMENTS=20708 CHECKS=3564490	SAT TT=1.427	SAT TT=1.528
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-20/ normalized-qwh-20-166-0_ext.xml	SAT TT=2.236	SAT TT=15.508 CHECKS=11517500 NODES=50375	SAT TT=33.152 CHECKS=26904800 NODES=107063	SAT TT=89.149	SAT TT=243.652 CHECKS=174070000	SAT TT=90.837 CHECKS=60911100	SAT TT=6.908 ASSIGNMENTS=35	SAT TT=7.862 ASSIGNMENTS=72	SAT TT=63.922 CHECKS=1662390 NODES=27289	SAT TT=5.767 CHECKS=3769410 NODES=45728	? (TO) TT=1800.01	SAT TT=16.96 ASSIGNMENTS=529	SAT TT=21.421 ASSIGNMENTS=50375 CHECKS=11517500	SAT TT=3.999	SAT TT=3.936	SAT TT=17.473 ASSIGNMENTS=169822 CHECKS=68856000	SAT TT=4.476 ASSIGNMENTS=42006 CHECKS=17449900	SAT TT=347.054	SAT TT=3.084 ASSIGNMENTS=28377 CHECKS=12348400	SAT TT=17.799 ASSIGNMENTS=170479 CHECKS=69731100	SAT TT=4.25	SAT TT=514.774 ASSIGNMENTS=2591790 CHECKS=545638000	SAT TT=2.236	SAT TT=2.563
csp/QWH-20/ normalized-qwh-20-166-1_ext.xml	SAT TT=1.716	SAT TT=8.83 CHECKS=5725340 NODES=25633	SAT TT=27.383 CHECKS=22496500 NODES=89605	SAT TT=1.716	SAT TT=150.916 CHECKS=96048600	SAT TT=18.888 CHECKS=8932730	SAT TT=8.995 ASSIGNMENTS=73	SAT TT=8.14 ASSIGNMENTS=10	SAT TT=24.986 CHECKS=618756 NODES=8848	SAT TT=27.535 CHECKS=51015800 NODES=638419	? (TO) TT=1800.03	SAT TT=9.819 ASSIGNMENTS=38	SAT TT=15.634 ASSIGNMENTS=25633 CHECKS=5725340	SAT TT=4.326	SAT TT=4.232	SAT TT=3.883 ASSIGNMENTS=32061 CHECKS=14751700	SAT TT=4.154 ASSIGNMENTS=38437 CHECKS=16557200	SAT TT=174.528	SAT TT=3.513 ASSIGNMENTS=27702 CHECKS=13280200	SAT TT=5.499 ASSIGNMENTS=46586 CHECKS=21202900	SAT TT=4.941	? (TO) TT=1800.11	SAT TT=2.547	SAT TT=2.619
csp/QWH-20/ normalized-qwh-20-166-2_ext.xml	SAT TT=2.183	SAT TT=83.832 CHECKS=70261400 NODES=306910	SAT TT=56.864 CHECKS=46400900 NODES=200566	SAT TT=122.216	? (TO) TT=1800.05	SAT TT=939.622 CHECKS=883736000	SAT TT=8.085 ASSIGNMENTS=17	SAT TT=9.044 ASSIGNMENTS=19	SAT TT=241.482 CHECKS=5534910 NODES=103299	SAT TT=51.245 CHECKS=98857800 NODES=1174550	? (TO) TT=1800	SAT TT=11.542 ASSIGNMENTS=132	SAT TT=97.886 ASSIGNMENTS=306910 CHECKS=70261400	SAT TT=4.186	SAT TT=4.251	SAT TT=40.889 ASSIGNMENTS=425229 CHECKS=164033000	SAT TT=11.921 ASSIGNMENTS=126256 CHECKS=48426500	SAT TT=491.933	SAT TT=11.821 ASSIGNMENTS=116001 CHECKS=46881500	SAT TT=34.723 ASSIGNMENTS=353975 CHECKS=138431000	SAT TT=4.787	? (TO) TT=1800.05	SAT TT=2.183	SAT TT=2.407
csp/QWH-20/ normalized-qwh-20-166-3_ext.xml	SAT TT=2.38	SAT TT=62.008 CHECKS=50666800 NODES=209532	SAT TT=93.066 CHECKS=76454500 NODES=310267	SAT TT=15.367	SAT TT=90.834 CHECKS=60274500	SAT TT=25.778 CHECKS=11638200	SAT TT=7.173 ASSIGNMENTS=19	SAT TT=6.863 ASSIGNMENTS=29	SAT TT=24.426 CHECKS=534323 NODES=8388	SAT TT=5.774 CHECKS=3844450 NODES=47110	? (TO) TT=1800.03	SAT TT=10.404 ASSIGNMENTS=66	SAT TT=64.659 ASSIGNMENTS=209532 CHECKS=50666800	SAT TT=4.412	SAT TT=4.094	SAT TT=8.938 ASSIGNMENTS=78624 CHECKS=34123200	SAT TT=11.541 ASSIGNMENTS=99621 CHECKS=46252900	SAT TT=881.654	SAT TT=3.465 ASSIGNMENTS=28585 CHECKS=13053700	SAT TT=13.355 ASSIGNMENTS=109728 CHECKS=51367400	SAT TT=5.251	? (TO) TT=1800.11	SAT TT=2.38	SAT TT=2.509
csp/QWH-20/ normalized-qwh-20-166-4_ext.xml	SAT TT=1.187	SAT TT=12.823 CHECKS=8778950 NODES=39697	SAT TT=4.969 CHECKS=2796380 NODES=13196	SAT TT=1.526	SAT TT=11.202 CHECKS=6001560	SAT TT=4.64 CHECKS=1976180	SAT TT=6.64 ASSIGNMENTS=16	SAT TT=6.771 ASSIGNMENTS=14	SAT TT=6.86 CHECKS=105061 NODES=1322	SAT TT=5.26 CHECKS=2580650 NODES=31537	? (TO) TT=1800.09	SAT TT=9.195 ASSIGNMENTS=31	SAT TT=19.445 ASSIGNMENTS=39697 CHECKS=8778950	SAT TT=4.032	SAT TT=4.122	SAT TT=2.256 ASSIGNMENTS=20693 CHECKS=8539040	SAT TT=3.589 ASSIGNMENTS=34287 CHECKS=13839200	SAT TT=199.061	SAT TT=1.187 ASSIGNMENTS=9389 CHECKS=4318250	SAT TT=1.814 ASSIGNMENTS=15648 CHECKS=6886240	SAT TT=4.486	SAT TT=169.447 ASSIGNMENTS=653808 CHECKS=191929000	SAT TT=2.085	SAT TT=2.726
csp/QWH-20/ normalized-qwh-20-166-5_ext.xml	SAT TT=1.941	SAT TT=13.167 CHECKS=9460090 NODES=45533	SAT TT=5.874 CHECKS=3123370 NODES=15218	SAT TT=1.941	SAT TT=6.84 CHECKS=3567520	SAT TT=23.014 CHECKS=11522400	SAT TT=8.518 ASSIGNMENTS=208	SAT TT=6.192 ASSIGNMENTS=10	SAT TT=141.922 CHECKS=3499360 NODES=62078	SAT TT=6.608 CHECKS=4091910 NODES=50111	? (TO) TT=1800.09	SAT TT=9.495 ASSIGNMENTS=32	SAT TT=20.402 ASSIGNMENTS=45533 CHECKS=9460090	SAT TT=4.246	SAT TT=4.243	SAT TT=3.746 ASSIGNMENTS=35579 CHECKS=14496900	SAT TT=12.308 ASSIGNMENTS=110498 CHECKS=48128900	SAT TT=114.592	SAT TT=7.746 ASSIGNMENTS=71292 CHECKS=30423800	SAT TT=15.366 ASSIGNMENTS=135868 CHECKS=60617800	SAT TT=4.596	SAT TT=316.2 ASSIGNMENTS=1555780 CHECKS=348153000	SAT TT=1.983	SAT TT=2.179
csp/QWH-20/ normalized-qwh-20-166-6_ext.xml	SAT TT=2.093	SAT TT=678.38 CHECKS=578453000 NODES=2289160	SAT TT=733.98 CHECKS=617480000 NODES=2449220	SAT TT=26.211	SAT TT=630.792 CHECKS=426506000	SAT TT=743.975 CHECKS=686394000	SAT TT=13.455 ASSIGNMENTS=355	SAT TT=7.137 ASSIGNMENTS=35	SAT TT=1023.6 CHECKS=30148200 NODES=484442	SAT TT=19.064 CHECKS=31813800 NODES=396025	? (TO) TT=1800	SAT TT=14.513 ASSIGNMENTS=344	SAT TT=627.073 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4	SAT TT=4.761	SAT TT=72.722 ASSIGNMENTS=647024 CHECKS=282775000	SAT TT=95.031 ASSIGNMENTS=1011610 CHECKS=402841000	SAT TT=780.898	SAT TT=184.517 ASSIGNMENTS=1777640 CHECKS=709264000	SAT TT=75.137 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4.22	? (TO) TT=1800.05	SAT TT=2.093	SAT TT=3.218
csp/QWH-20/ normalized-qwh-20-166-7_ext.xml	SAT TT=0.958	SAT TT=41.942 CHECKS=33707000 NODES=127619	SAT TT=11.904 CHECKS=9003780 NODES=38014	SAT TT=0.958	SAT TT=100.448 CHECKS=72003400	SAT TT=112.313 CHECKS=89976700	SAT TT=8.087 ASSIGNMENTS=51	SAT TT=7.975 ASSIGNMENTS=27	SAT TT=205.782 CHECKS=5035250 NODES=87964	SAT TT=12.327 CHECKS=18455200 NODES=226394	? (TO) TT=1800.1	SAT TT=15.568 ASSIGNMENTS=51	SAT TT=44.722 ASSIGNMENTS=127619 CHECKS=33707000	SAT TT=3.735	SAT TT=4.041	SAT TT=3.465 ASSIGNMENTS=28393 CHECKS=13047700	SAT TT=11.602 ASSIGNMENTS=116825 CHECKS=49517700	SAT TT=441.75	SAT TT=6.603 ASSIGNMENTS=58019 CHECKS=24849900	SAT TT=3.53 ASSIGNMENTS=31841 CHECKS=14313600	SAT TT=4.18	? (TO) TT=1800.04	SAT TT=2.229	SAT TT=2.585
csp/QWH-20/ normalized-qwh-20-166-8_ext.xml	SAT TT=2.007	SAT TT=84.218 CHECKS=71402200 NODES=272925	SAT TT=21.75 CHECKS=16821300 NODES=69120	SAT TT=71.257	SAT TT=896.464 CHECKS=647662000	SAT TT=20.241 CHECKS=10284500	SAT TT=8.278 ASSIGNMENTS=120	SAT TT=6.99 ASSIGNMENTS=39	SAT TT=83.253 CHECKS=2131390 NODES=38238	SAT TT=5.235 CHECKS=2514800 NODES=29043	? (TO) TT=1800.08	SAT TT=10.001 ASSIGNMENTS=70	SAT TT=83.624 ASSIGNMENTS=272925 CHECKS=71402200	SAT TT=3.843	SAT TT=3.811	SAT TT=8.494 ASSIGNMENTS=80871 CHECKS=33500100	SAT TT=7.827 ASSIGNMENTS=80558 CHECKS=33414100	SAT TT=306.823	SAT TT=4.492 ASSIGNMENTS=40807 CHECKS=19010900	SAT TT=8.109 ASSIGNMENTS=77692 CHECKS=31563100	SAT TT=4.437	SAT TT=229.047 ASSIGNMENTS=480934 CHECKS=134917000	SAT TT=2.007	SAT TT=2.519
csp/QWH-20/ normalized-qwh-20-166-9_ext.xml	SAT TT=0.841	SAT TT=21.36 CHECKS=16379600 NODES=73618	SAT TT=11.699 CHECKS=7600770 NODES=35262	SAT TT=0.846	SAT TT=428.237 CHECKS=317784000	SAT TT=2.296 CHECKS=665759	SAT TT=7.477 ASSIGNMENTS=80	SAT TT=6.889 ASSIGNMENTS=30	SAT TT=8.993 CHECKS=175160 NODES=2514	SAT TT=6.216 CHECKS=4654520 NODES=58992	? (TO) TT=1800	SAT TT=10.124 ASSIGNMENTS=96	SAT TT=27.502 ASSIGNMENTS=73618 CHECKS=16379600	SAT TT=3.943	SAT TT=4.088	SAT TT=3.675 ASSIGNMENTS=29011 CHECKS=14404000	SAT TT=0.841 ASSIGNMENTS=8644 CHECKS=2821260	SAT TT=63.026	SAT TT=3.088 ASSIGNMENTS=27411 CHECKS=13017300	SAT TT=2.932 ASSIGNMENTS=24655 CHECKS=12165800	SAT TT=4.431	? (TO) TT=1800.08	SAT TT=2.212	SAT TT=2.494
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-25/ normalized-qwh-25-235-0_ext.xml	SAT TT=19.9	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=399.005 ASSIGNMENTS=9494	SAT TT=335.483 ASSIGNMENTS=5457	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.013 ASSIGNMENTS=7890	SAT TT=991.238 ASSIGNMENTS=7890	SAT TT=48.226	SAT TT=22.389	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=32.764	? (TO) TT=1800.12	SAT TT=86.579	SAT TT=19.9
csp/QWH-25/ normalized-qwh-25-235-1_ext.xml	SAT TT=7.361	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=23.131 ASSIGNMENTS=198	SAT TT=65.014 ASSIGNMENTS=960	? (TO) TT=1800	SAT TT=963.326 CHECKS=1345400000 NODES=13734500	? (TO) TT=1800.05	SAT TT=23.459 ASSIGNMENTS=334	SAT TT=690.394 ASSIGNMENTS=334	SAT TT=8.505	SAT TT=7.361	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=640.229 ASSIGNMENTS=4632240 CHECKS=2618280000	? (TO) TT=1800.06	SAT TT=9.069	? (TO) TT=1