CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in extension (2-ARY-EXT)

This page displays the results of the different solvers for each benchmark for category binary constraints in extension (2-ARY-EXT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-13/ normalized-BlackHole-4-13-e-0_ext.xml	UNSAT TT=0.179	UNSAT TT=1.315 CHECKS=59584 NODES=0	UNSAT TT=1.301 CHECKS=59584 NODES=0	UNSAT TT=0.632	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=1.527 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	? (MO) TT=1501.33	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.06	UNSAT TT=0.179 ASSIGNMENTS=0 CHECKS=13846	UNSAT TT=0.181 ASSIGNMENTS=0 CHECKS=13846	? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-e-1_ext.xml	UNSAT TT=0.186	UNSAT TT=1.277 CHECKS=59585 NODES=0	UNSAT TT=1.406 CHECKS=59585 NODES=0	UNSAT TT=0.625	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=1.833 ASSIGNMENTS=0	UNSAT TT=1.86 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.04	? (MO) TT=1771.6	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.08	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=13950	UNSAT TT=0.201 ASSIGNMENTS=0 CHECKS=13950	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/BH-4-13/ normalized-BlackHole-4-13-e-2_ext.xml	UNSAT TT=0.185	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=1.272 CHECKS=59488 NODES=0	UNSAT TT=0.635	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.551 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.195 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.08	? (MO) TT=1454.74	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.05	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14006	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14006	? (TO) TT=1800.21	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/BH-4-13/ normalized-BlackHole-4-13-e-3_ext.xml	UNSAT TT=0.184	UNSAT TT=1.368 CHECKS=59488 NODES=0	UNSAT TT=1.357 CHECKS=59488 NODES=0	UNSAT TT=0.591	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=1.579 ASSIGNMENTS=0	UNSAT TT=1.722 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.19 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.1	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=13900	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=13900	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/BH-4-13/ normalized-BlackHole-4-13-m-0_ext.xml	UNSAT TT=0.185	UNSAT TT=1.395 CHECKS=59488 NODES=0	UNSAT TT=1.281 CHECKS=59488 NODES=0	UNSAT TT=1341.56	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.933 ASSIGNMENTS=0	UNSAT TT=1.66 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.08	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=13847	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=13847	? (TO) TT=1800.27	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/BH-4-13/ normalized-BlackHole-4-13-m-1_ext.xml	UNSAT TT=0.184	UNSAT TT=1.277 CHECKS=59488 NODES=0	UNSAT TT=1.313 CHECKS=59488 NODES=0	UNSAT TT=1339.46	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=1.601 ASSIGNMENTS=0	UNSAT TT=1.568 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.202 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.197 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.06	? (MO) TT=1543.57	UNSAT TT=0.184 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.185 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	UNSAT TT=0.192 ASSIGNMENTS=0 CHECKS=14005	? (TO) TT=1800.23	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.14
csp/BH-4-13/ normalized-BlackHole-4-13-m-2_ext.xml	UNSAT TT=0.186	UNSAT TT=1.393 CHECKS=59489 NODES=0	UNSAT TT=1.271 CHECKS=59489 NODES=0	UNSAT TT=0.63	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=1.638 ASSIGNMENTS=0	UNSAT TT=1.857 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.1	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.186 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.07	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=14108	UNSAT TT=0.189 ASSIGNMENTS=0 CHECKS=14108	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/BH-4-4/ normalized-BlackHole-4-4-e-0_ext.xml	UNSAT TT=0.016	UNSAT TT=0.777 CHECKS=5952 NODES=0	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.102 CHECKS=3152700	UNSAT TT=2.781 CHECKS=2102480	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=1.718 CHECKS=81673 NODES=5880	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.235	UNSAT TT=1.4	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=2.527	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1722	UNSAT TT=1.94	UNSAT TT=420.986 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.057	UNSAT TT=1.311
csp/BH-4-4/ normalized-BlackHole-4-4-e-1_ext.xml	UNSAT TT=0.016	UNSAT TT=0.843 CHECKS=5952 NODES=0	UNSAT TT=0.827 CHECKS=5952 NODES=0	UNSAT TT=0.077	UNSAT TT=5.426 CHECKS=3127470	UNSAT TT=2.546 CHECKS=2112960	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=1.788 CHECKS=79133 NODES=5623	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=1.532	UNSAT TT=1.361	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.537	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1673	UNSAT TT=2.012	UNSAT TT=429.179 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.978	UNSAT TT=1.041
csp/BH-4-4/ normalized-BlackHole-4-4-e-2_ext.xml	UNSAT TT=0.015	UNSAT TT=0.84 CHECKS=5952 NODES=0	UNSAT TT=0.829 CHECKS=5952 NODES=0	UNSAT TT=0.073	UNSAT TT=4.623 CHECKS=2635430	UNSAT TT=2.742 CHECKS=2122950	UNSAT TT=0.594 ASSIGNMENTS=0	UNSAT TT=0.574 ASSIGNMENTS=0	UNSAT TT=1.703 CHECKS=80971 NODES=5841	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.275	UNSAT TT=1.33	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=2.542	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1772	UNSAT TT=1.934	UNSAT TT=419.059 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.075	UNSAT TT=1.088
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-4/ normalized-BlackHole-4-4-e-3_ext.xml	UNSAT TT=0.015	UNSAT TT=0.926 CHECKS=5952 NODES=0	UNSAT TT=0.857 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.107 CHECKS=3119390	UNSAT TT=2.793 CHECKS=2122970	UNSAT TT=0.555 ASSIGNMENTS=0	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=1.905 CHECKS=80874 NODES=5840	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=1.524	UNSAT TT=1.508	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.472	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1706	UNSAT TT=2.037	UNSAT TT=450.57 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.97	UNSAT TT=1.281
csp/BH-4-4/ normalized-BlackHole-4-4-e-4_ext.xml	UNSAT TT=0.016	UNSAT TT=0.828 CHECKS=5952 NODES=0	UNSAT TT=0.801 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.433 CHECKS=3141050	UNSAT TT=2.79 CHECKS=2122930	UNSAT TT=0.69 ASSIGNMENTS=0	UNSAT TT=0.558 ASSIGNMENTS=0	UNSAT TT=1.715 CHECKS=81605 NODES=5880	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.641	UNSAT TT=1.336	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.505	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.798	UNSAT TT=450.615 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=1.061	UNSAT TT=0.982
csp/BH-4-4/ normalized-BlackHole-4-4-e-5_ext.xml	UNSAT TT=0.016	UNSAT TT=0.795 CHECKS=5952 NODES=0	UNSAT TT=0.778 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.431 CHECKS=3130040	UNSAT TT=2.769 CHECKS=2114300	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.578 ASSIGNMENTS=0	UNSAT TT=1.863 CHECKS=81626 NODES=5880	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.671	UNSAT TT=1.263	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.552	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.778	UNSAT TT=448.105 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=0.975	UNSAT TT=0.976
csp/BH-4-4/ normalized-BlackHole-4-4-e-6_ext.xml	UNSAT TT=0.016	UNSAT TT=0.823 CHECKS=5952 NODES=0	UNSAT TT=0.79 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.077 CHECKS=3183010	UNSAT TT=2.768 CHECKS=2140010	UNSAT TT=0.557 ASSIGNMENTS=0	UNSAT TT=0.562 ASSIGNMENTS=0	UNSAT TT=1.976 CHECKS=80410 NODES=5889	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=1.691	UNSAT TT=1.54	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.653	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1689	UNSAT TT=2.085	UNSAT TT=453.138 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.104	UNSAT TT=1.327
csp/BH-4-4/ normalized-BlackHole-4-4-e-7_ext.xml	UNSAT TT=0.017	UNSAT TT=0.833 CHECKS=5952 NODES=0	UNSAT TT=0.788 CHECKS=5952 NODES=0	UNSAT TT=0.075	UNSAT TT=5.441 CHECKS=3081900	UNSAT TT=2.591 CHECKS=2153790	UNSAT TT=0.591 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=1.828 CHECKS=79569 NODES=5836	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.393	UNSAT TT=1.406	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=2.536	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1705	UNSAT TT=1.803	UNSAT TT=418.115 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.309	UNSAT TT=1.047
csp/BH-4-4/ normalized-BlackHole-4-4-e-8_ext.xml	UNSAT TT=0.016	UNSAT TT=0.826 CHECKS=5952 NODES=0	UNSAT TT=0.924 CHECKS=5952 NODES=0	UNSAT TT=0.07	UNSAT TT=5.004 CHECKS=3080150	UNSAT TT=2.767 CHECKS=2122160	UNSAT TT=0.556 ASSIGNMENTS=0	UNSAT TT=0.561 ASSIGNMENTS=0	UNSAT TT=1.707 CHECKS=80400 NODES=5890	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=1.511	UNSAT TT=1.385	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.508	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1739	UNSAT TT=2.066	UNSAT TT=448.144 ASSIGNMENTS=1231830 CHECKS=890536000	UNSAT TT=1.197	UNSAT TT=1.029
csp/BH-4-4/ normalized-BlackHole-4-4-e-9_ext.xml	UNSAT TT=0.016	UNSAT TT=0.817 CHECKS=5952 NODES=0	UNSAT TT=0.86 CHECKS=5952 NODES=0	UNSAT TT=0.076	UNSAT TT=5.096 CHECKS=3096090	UNSAT TT=2.734 CHECKS=2132950	UNSAT TT=0.565 ASSIGNMENTS=0	UNSAT TT=0.73 ASSIGNMENTS=0	UNSAT TT=1.845 CHECKS=81620 NODES=5882	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.404	UNSAT TT=1.28	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=2.366	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1755	UNSAT TT=1.978	UNSAT TT=437.595 ASSIGNMENTS=1231830 CHECKS=890535000	UNSAT TT=0.978	UNSAT TT=1.025
csp/BH-4-7/ normalized-BlackHole-4-7-e-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.957 CHECKS=10265 NODES=0	UNSAT TT=0.924 CHECKS=10265 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.718 ASSIGNMENTS=0	UNSAT TT=0.749 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.11	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.2	? (TO) TT=1800.02	UNSAT TT=792.95	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-1_ext.xml	UNSAT TT=0.041	UNSAT TT=0.979 CHECKS=10265 NODES=0	UNSAT TT=0.923 CHECKS=10265 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.739 ASSIGNMENTS=0	UNSAT TT=0.723 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=894.724	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-e-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.936 CHECKS=10313 NODES=0	UNSAT TT=1.002 CHECKS=10313 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.736 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4043	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4043	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1359.03	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-e-3_ext.xml	UNSAT TT=0.042	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=1 CHECKS=10264 NODES=0	UNSAT TT=74.257	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.732 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.22	? (TO) TT=1800.06	UNSAT TT=842.823	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-e-4_ext.xml	UNSAT TT=0.045	UNSAT TT=1.094 CHECKS=10312 NODES=0	UNSAT TT=0.91 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.815 ASSIGNMENTS=0	UNSAT TT=0.941 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=797.83	? (TO) TT=1800.09
csp/BH-4-7/ normalized-BlackHole-4-7-e-5_ext.xml	UNSAT TT=0.043	UNSAT TT=0.952 CHECKS=10264 NODES=0	UNSAT TT=0.92 CHECKS=10264 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=0.768 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4042	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1190.02	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-6_ext.xml	UNSAT TT=0.043	UNSAT TT=0.992 CHECKS=10264 NODES=0	UNSAT TT=0.971 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.717 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.13	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4015	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=4015	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1571.33	? (TO) TT=1800.08
csp/BH-4-7/ normalized-BlackHole-4-7-e-7_ext.xml	UNSAT TT=0.041	UNSAT TT=0.91 CHECKS=10265 NODES=0	UNSAT TT=0.933 CHECKS=10265 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.943 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.14	? (TO) TT=1800.05	UNSAT TT=820.818	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-e-8_ext.xml	UNSAT TT=0.04	UNSAT TT=0.967 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.165	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.75 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.14	? (TO) TT=1800.03	UNSAT TT=827.602	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-e-9_ext.xml	UNSAT TT=0.041	UNSAT TT=1.004 CHECKS=10312 NODES=0	UNSAT TT=0.912 CHECKS=10312 NODES=0	UNSAT TT=0.174	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.931 ASSIGNMENTS=0	UNSAT TT=0.939 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.03	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3985	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3985	? (TO) TT=1800.19	? (TO) TT=1800.03	UNSAT TT=883.361	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-0_ext.xml	UNSAT TT=0.042	UNSAT TT=0.929 CHECKS=10264 NODES=0	UNSAT TT=0.923 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=0.71 ASSIGNMENTS=0	UNSAT TT=0.781 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=1692.7	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-1_ext.xml	UNSAT TT=0.042	UNSAT TT=1.081 CHECKS=10264 NODES=0	UNSAT TT=0.925 CHECKS=10264 NODES=0	UNSAT TT=68.847	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.982 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.14	? (TO) TT=1800.08	UNSAT TT=690.887	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-2_ext.xml	UNSAT TT=0.044	UNSAT TT=0.963 CHECKS=10265 NODES=0	UNSAT TT=1.002 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=0.95 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4014	? (TO) TT=1800.17	? (TO) TT=1800.02	UNSAT TT=887.297	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/BH-4-7/ normalized-BlackHole-4-7-h-3_ext.xml	UNSAT TT=0.04	UNSAT TT=0.976 CHECKS=10265 NODES=0	UNSAT TT=1.078 CHECKS=10265 NODES=0	UNSAT TT=0.176	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.774 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.05	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3957	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3957	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=960.49	? (TO) TT=1800.05
csp/BH-4-7/ normalized-BlackHole-4-7-h-4_ext.xml	UNSAT TT=0.042	UNSAT TT=0.976 CHECKS=10312 NODES=0	UNSAT TT=0.959 CHECKS=10312 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.708 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.12	? (TO) TT=1800.06	UNSAT TT=763.982	? (TO) TT=1800.14
csp/BH-4-7/ normalized-BlackHole-4-7-h-5_ext.xml	UNSAT TT=0.045	UNSAT TT=1.003 CHECKS=10264 NODES=0	UNSAT TT=0.917 CHECKS=10264 NODES=0	UNSAT TT=0.177	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.935 ASSIGNMENTS=0	UNSAT TT=0.946 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.1	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3900	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3900	? (TO) TT=1800.17	? (TO) TT=1800.08	UNSAT TT=996.538	? (TO) TT=1800.1
csp/BH-4-7/ normalized-BlackHole-4-7-h-6_ext.xml	UNSAT TT=0.041	UNSAT TT=1.065 CHECKS=10313 NODES=0	UNSAT TT=0.913 CHECKS=10313 NODES=0	UNSAT TT=0.178	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.08	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=3984	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3984	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=831.31	? (TO) TT=1800.11
csp/BH-4-7/ normalized-BlackHole-4-7-h-7_ext.xml	UNSAT TT=0.046	UNSAT TT=1.012 CHECKS=10312 NODES=0	UNSAT TT=1.022 CHECKS=10312 NODES=0	UNSAT TT=0.164	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.707 ASSIGNMENTS=0	UNSAT TT=0.952 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.07	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=3928	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=3928	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1374.78	? (TO) TT=1800.07
csp/BH-4-7/ normalized-BlackHole-4-7-h-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.982 CHECKS=10313 NODES=0	UNSAT TT=0.918 CHECKS=10313 NODES=0	UNSAT TT=0.175	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.924 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.08	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=4013	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=4013	? (TO) TT=1800.13	? (TO) TT=1800.05	UNSAT TT=556.01	? (TO) TT=1800.06
csp/BH-4-7/ normalized-BlackHole-4-7-h-9_ext.xml	UNSAT TT=0.043	UNSAT TT=1.108 CHECKS=10264 NODES=0	UNSAT TT=0.914 CHECKS=10264 NODES=0	UNSAT TT=74.22	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.92 ASSIGNMENTS=0	UNSAT TT=0.783 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.07	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=3929	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=3929	? (TO) TT=1800.19	? (TO) TT=1800.09	UNSAT TT=794.336	? (TO) TT=1800.1
csp/bqwh-15-106/ normalized-bqwh-15-106-24_ext.xml	SAT TT=0.039	SAT TT=1.145 CHECKS=100396 NODES=1144	SAT TT=1.191 CHECKS=109962 NODES=1098	SAT TT=0.234	SAT TT=0.142 CHECKS=128871	SAT TT=0.666 CHECKS=888959	SAT TT=1.102 ASSIGNMENTS=10	SAT TT=1.113 ASSIGNMENTS=11	SAT TT=0.852 CHECKS=22442 NODES=535	SAT TT=0.799 CHECKS=792967 NODES=18806	SAT TT=1.334 CHECKS=4545710 NODES=15610	SAT TT=0.195 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=0.183 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.702	SAT TT=1.416	SAT TT=0.226 ASSIGNMENTS=2460 CHECKS=665843	SAT TT=0.322 ASSIGNMENTS=5654 CHECKS=957091	SAT TT=0.787	SAT TT=0.039 ASSIGNMENTS=316 CHECKS=44265	SAT TT=0.18 ASSIGNMENTS=2010 CHECKS=473556	SAT TT=1.619	SAT TT=0.875 ASSIGNMENTS=532 CHECKS=71428	SAT TT=1.061	SAT TT=1.026
csp/bqwh-15-106/ normalized-bqwh-15-106-26_ext.xml	SAT TT=0.048	SAT TT=1.179 CHECKS=158828 NODES=1486	SAT TT=1.222 CHECKS=123121 NODES=1168	SAT TT=0.212	SAT TT=0.048 CHECKS=27155	SAT TT=0.048 CHECKS=31076	SAT TT=1.084 ASSIGNMENTS=43	SAT TT=1.138 ASSIGNMENTS=16	SAT TT=0.978 CHECKS=84995 NODES=1514	SAT TT=0.816 CHECKS=840414 NODES=19834	? (TO) TT=1800.05	SAT TT=0.097 ASSIGNMENTS=659 CHECKS=172553	SAT TT=0.09 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.464	SAT TT=1.669	SAT TT=0.063 ASSIGNMENTS=449 CHECKS=110598	SAT TT=0.229 ASSIGNMENTS=4031 CHECKS=608822	SAT TT=0.821	SAT TT=0.146 ASSIGNMENTS=1347 CHECKS=356917	SAT TT=0.083 ASSIGNMENTS=659 CHECKS=172553	SAT TT=1.442	SAT TT=0.136 ASSIGNMENTS=521 CHECKS=57840	SAT TT=1.008	SAT TT=1.373
csp/bqwh-15-106/ normalized-bqwh-15-106-28_ext.xml	SAT TT=0.037	SAT TT=1.101 CHECKS=55628 NODES=707	SAT TT=1.076 CHECKS=22366 NODES=0	SAT TT=0.233	SAT TT=0.211 CHECKS=224297	SAT TT=0.078 CHECKS=74568	SAT TT=0.845 ASSIGNMENTS=5	SAT TT=0.916 ASSIGNMENTS=5	SAT TT=0.914 CHECKS=50617 NODES=1173	SAT TT=0.68 CHECKS=124533 NODES=2734	SAT TT=0.79 CHECKS=758569 NODES=3923	SAT TT=0.053 ASSIGNMENTS=209 CHECKS=51803	SAT TT=0.054 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.507	SAT TT=1.717	SAT TT=0.04 ASSIGNMENTS=206 CHECKS=45369	SAT TT=0.233 ASSIGNMENTS=4320 CHECKS=617494	SAT TT=0.605	SAT TT=0.051 ASSIGNMENTS=485 CHECKS=75484	SAT TT=0.037 ASSIGNMENTS=209 CHECKS=51803	SAT TT=1.535	SAT TT=0.157 ASSIGNMENTS=1046 CHECKS=135716	SAT TT=1.062	SAT TT=1.068
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-15-106/ normalized-bqwh-15-106-2_ext.xml	SAT TT=0.029	SAT TT=1.401 CHECKS=298547 NODES=2964	SAT TT=1.095 CHECKS=65050 NODES=687	SAT TT=0.134	SAT TT=0.083 CHECKS=68061	SAT TT=0.042 CHECKS=24112	SAT TT=1.028 ASSIGNMENTS=14	SAT TT=1.084 ASSIGNMENTS=20	SAT TT=1.879 CHECKS=234609 NODES=5231	SAT TT=0.785 CHECKS=708557 NODES=16990	SAT TT=0.668 CHECKS=413156 NODES=2022	SAT TT=0.044 ASSIGNMENTS=80 CHECKS=16593	SAT TT=0.042 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.444	SAT TT=1.593	SAT TT=0.029 ASSIGNMENTS=69 CHECKS=15647	SAT TT=0.303 ASSIGNMENTS=5637 CHECKS=890572	SAT TT=0.655	SAT TT=0.051 ASSIGNMENTS=441 CHECKS=76168	SAT TT=0.029 ASSIGNMENTS=80 CHECKS=16593	SAT TT=1.714	SAT TT=1.465 ASSIGNMENTS=11890 CHECKS=2074690	SAT TT=1.025	SAT TT=1.054
csp/bqwh-15-106/ normalized-bqwh-15-106-51_ext.xml	SAT TT=0.036	SAT TT=1.106 CHECKS=73534 NODES=876	SAT TT=1.102 CHECKS=54740 NODES=431	SAT TT=0.288	SAT TT=0.171 CHECKS=155758	SAT TT=0.125 CHECKS=125583	SAT TT=1.147 ASSIGNMENTS=9	SAT TT=1.081 ASSIGNMENTS=9	SAT TT=0.665 CHECKS=8118 NODES=219	SAT TT=0.708 CHECKS=225571 NODES=5089	SAT TT=1.004 CHECKS=1551240 NODES=5649	SAT TT=0.067 ASSIGNMENTS=398 CHECKS=94326	SAT TT=0.068 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.468	SAT TT=1.662	SAT TT=0.036 ASSIGNMENTS=140 CHECKS=33205	SAT TT=0.231 ASSIGNMENTS=4413 CHECKS=648137	SAT TT=0.624	SAT TT=0.041 ASSIGNMENTS=346 CHECKS=57116	SAT TT=0.052 ASSIGNMENTS=398 CHECKS=94326	SAT TT=1.528	SAT TT=0.059 ASSIGNMENTS=227 CHECKS=21228	SAT TT=1.242	SAT TT=1.067
csp/bqwh-15-106/ normalized-bqwh-15-106-52_ext.xml	SAT TT=0.03	SAT TT=1.411 CHECKS=319800 NODES=3226	SAT TT=1.074 CHECKS=35172 NODES=392	SAT TT=0.243	SAT TT=0.07 CHECKS=50343	SAT TT=0.146 CHECKS=181531	SAT TT=1.044 ASSIGNMENTS=11	SAT TT=1.059 ASSIGNMENTS=7	SAT TT=0.925 CHECKS=53239 NODES=1180	SAT TT=1.018 CHECKS=973881 NODES=22892	SAT TT=0.64 CHECKS=247236 NODES=1304	SAT TT=0.037 ASSIGNMENTS=27 CHECKS=7318	SAT TT=0.036 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.599	SAT TT=1.689	SAT TT=0.03 ASSIGNMENTS=70 CHECKS=17163	SAT TT=0.306 ASSIGNMENTS=4963 CHECKS=841076	SAT TT=0.614	SAT TT=0.109 ASSIGNMENTS=1109 CHECKS=266851	SAT TT=0.03 ASSIGNMENTS=27 CHECKS=7318	SAT TT=1.66	SAT TT=0.098 ASSIGNMENTS=796 CHECKS=77988	SAT TT=1.149	SAT TT=1.022
csp/bqwh-15-106/ normalized-bqwh-15-106-7_ext.xml	SAT TT=0.049	SAT TT=1.37 CHECKS=251056 NODES=2553	SAT TT=1.211 CHECKS=78254 NODES=855	SAT TT=0.185	SAT TT=0.488 CHECKS=518036	SAT TT=0.5 CHECKS=667494	SAT TT=1.079 ASSIGNMENTS=48	SAT TT=1.311 ASSIGNMENTS=8	SAT TT=0.985 CHECKS=75899 NODES=1793	SAT TT=1.147 CHECKS=1828330 NODES=43827	? (TO) TT=1800.09	SAT TT=0.061 ASSIGNMENTS=372 CHECKS=85935	SAT TT=0.066 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.436	SAT TT=1.73	SAT TT=0.049 ASSIGNMENTS=336 CHECKS=69647	SAT TT=0.4 ASSIGNMENTS=6446 CHECKS=1181050	SAT TT=0.685	SAT TT=0.142 ASSIGNMENTS=1752 CHECKS=354930	SAT TT=0.053 ASSIGNMENTS=372 CHECKS=85935	SAT TT=1.685	SAT TT=0.211 ASSIGNMENTS=830 CHECKS=93256	SAT TT=1.073	SAT TT=1.068
csp/bqwh-15-106/ normalized-bqwh-15-106-81_ext.xml	SAT TT=0.038	SAT TT=1.228 CHECKS=135966 NODES=1415	SAT TT=1.096 CHECKS=45539 NODES=433	SAT TT=0.202	SAT TT=0.669 CHECKS=765030	SAT TT=0.103 CHECKS=93482	SAT TT=1.164 ASSIGNMENTS=5	SAT TT=1.121 ASSIGNMENTS=7	SAT TT=1.304 CHECKS=124758 NODES=2649	SAT TT=0.683 CHECKS=138637 NODES=3093	SAT TT=0.789 CHECKS=857106 NODES=3798	SAT TT=0.109 ASSIGNMENTS=917 CHECKS=212840	SAT TT=0.102 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.799	SAT TT=1.551	SAT TT=0.038 ASSIGNMENTS=175 CHECKS=37852	SAT TT=0.322 ASSIGNMENTS=5296 CHECKS=900062	SAT TT=1.08	SAT TT=0.071 ASSIGNMENTS=730 CHECKS=152727	SAT TT=0.09 ASSIGNMENTS=917 CHECKS=212840	SAT TT=1.662	SAT TT=0.978 ASSIGNMENTS=4431 CHECKS=812661	SAT TT=1.181	SAT TT=1.077
csp/bqwh-15-106/ normalized-bqwh-15-106-85_ext.xml	SAT TT=0.065	SAT TT=1.043 CHECKS=21842 NODES=330	SAT TT=1.012 CHECKS=19434 NODES=227	SAT TT=0.468	SAT TT=0.479 CHECKS=518289	SAT TT=0.185 CHECKS=206141	SAT TT=1.068 ASSIGNMENTS=2	SAT TT=1.101 ASSIGNMENTS=8	SAT TT=1.478 CHECKS=135956 NODES=2913	SAT TT=0.684 CHECKS=155310 NODES=3528	? (TO) TT=1800.04	SAT TT=0.091 ASSIGNMENTS=702 CHECKS=167198	SAT TT=0.095 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.451	SAT TT=1.535	SAT TT=0.065 ASSIGNMENTS=531 CHECKS=116375	SAT TT=0.271 ASSIGNMENTS=4244 CHECKS=723496	SAT TT=0.636	SAT TT=0.107 ASSIGNMENTS=992 CHECKS=256985	SAT TT=0.077 ASSIGNMENTS=702 CHECKS=167198	SAT TT=1.846	SAT TT=0.508 ASSIGNMENTS=1470 CHECKS=253802	SAT TT=1.053	SAT TT=1.267
csp/bqwh-15-106/ normalized-bqwh-15-106-97_ext.xml	SAT TT=0.051	SAT TT=1.184 CHECKS=99563 NODES=1227	SAT TT=1.224 CHECKS=45180 NODES=526	SAT TT=0.154	SAT TT=0.175 CHECKS=169337	SAT TT=0.158 CHECKS=179270	SAT TT=1.033 ASSIGNMENTS=8	SAT TT=1.061 ASSIGNMENTS=6	SAT TT=0.657 CHECKS=13421 NODES=335	SAT TT=0.854 CHECKS=363920 NODES=8658	? (TO) TT=1800.07	SAT TT=0.081 ASSIGNMENTS=500 CHECKS=124762	SAT TT=0.078 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.693	SAT TT=1.549	SAT TT=0.051 ASSIGNMENTS=332 CHECKS=73138	SAT TT=0.21 ASSIGNMENTS=4065 CHECKS=601033	SAT TT=0.655	SAT TT=0.088 ASSIGNMENTS=905 CHECKS=175586	SAT TT=0.063 ASSIGNMENTS=500 CHECKS=124762	SAT TT=1.598	SAT TT=0.094 ASSIGNMENTS=553 CHECKS=65832	SAT TT=1.022	SAT TT=1.048
csp/bqwh-18-141/ normalized-bqwh-18-141-11_ext.xml	SAT TT=0.054	SAT TT=1.506 CHECKS=284208 NODES=2838	SAT TT=1.138 CHECKS=29756 NODES=316	SAT TT=0.173	SAT TT=0.138 CHECKS=115672	SAT TT=0.062 CHECKS=36064	SAT TT=1.265 ASSIGNMENTS=28	SAT TT=1.337 ASSIGNMENTS=23	SAT TT=2.269 CHECKS=239529 NODES=4254	SAT TT=1.183 CHECKS=1116660 NODES=22495	SAT TT=0.871 CHECKS=376575 NODES=1723	SAT TT=0.071 ASSIGNMENTS=230 CHECKS=77161	SAT TT=0.072 ASSIGNMENTS=230 CHECKS=77161	SAT TT=1.929	SAT TT=1.81	SAT TT=0.054 ASSIGNMENTS=195 CHECKS=57662	SAT TT=0.334 ASSIGNMENTS=4912 CHECKS=845070	SAT TT=1.11	SAT TT=0.092 ASSIGNMENTS=733 CHECKS=156330	SAT TT=0.059 ASSIGNMENTS=230 CHECKS=77161	SAT TT=2.26	SAT TT=0.259 ASSIGNMENTS=1391 CHECKS=223636	SAT TT=1.189	SAT TT=1.477
csp/bqwh-18-141/ normalized-bqwh-18-141-19_ext.xml	SAT TT=0.223	SAT TT=2.523 CHECKS=1408250 NODES=10026	SAT TT=1.568 CHECKS=357886 NODES=3075	SAT TT=0.389	SAT TT=1.739 CHECKS=1804600	SAT TT=0.241 CHECKS=241010	SAT TT=1.369 ASSIGNMENTS=7	SAT TT=1.464 ASSIGNMENTS=6	SAT TT=1.215 CHECKS=90831 NODES=1502	SAT TT=0.905 CHECKS=482275 NODES=9192	? (TO) TT=1800.09	SAT TT=0.247 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=0.25 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.765	SAT TT=1.769	SAT TT=0.343 ASSIGNMENTS=3253 CHECKS=1004950	SAT TT=0.408 ASSIGNMENTS=5494 CHECKS=1321650	SAT TT=1.26	SAT TT=0.223 ASSIGNMENTS=1674 CHECKS=623176	SAT TT=0.232 ASSIGNMENTS=2055 CHECKS=718290	SAT TT=1.91	SAT TT=0.846 ASSIGNMENTS=1785 CHECKS=384816	SAT TT=1.132	SAT TT=1.615
csp/bqwh-18-141/ normalized-bqwh-18-141-21_ext.xml	SAT TT=0.046	SAT TT=1.565 CHECKS=448647 NODES=4069	SAT TT=2.257 CHECKS=1073330 NODES=8263	SAT TT=0.182	SAT TT=0.086 CHECKS=50960	SAT TT=0.046 CHECKS=14102	SAT TT=1.37 ASSIGNMENTS=4	SAT TT=1.558 ASSIGNMENTS=6	SAT TT=0.916 CHECKS=25933 NODES=575	SAT TT=1.032 CHECKS=1208490 NODES=24522	SAT TT=1.132 CHECKS=2215980 NODES=8030	SAT TT=0.443 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=0.444 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=1.754	SAT TT=1.678	SAT TT=0.414 ASSIGNMENTS=3871 CHECKS=1147500	SAT TT=0.299 ASSIGNMENTS=4678 CHECKS=786868	SAT TT=1.314	SAT TT=0.219 ASSIGNMENTS=1947 CHECKS=546992	SAT TT=0.42 ASSIGNMENTS=3999 CHECKS=1190110	SAT TT=2.314	SAT TT=2.064 ASSIGNMENTS=8440 CHECKS=2015210	SAT TT=1.376	SAT TT=1.409
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/bqwh-18-141/ normalized-bqwh-18-141-3_ext.xml	SAT TT=0.258	SAT TT=16.573 CHECKS=16551100 NODES=129906	SAT TT=13.396 CHECKS=13254000 NODES=107724	SAT TT=2.999	SAT TT=2.862 CHECKS=3074660	SAT TT=0.258 CHECKS=280755	SAT TT=1.504 ASSIGNMENTS=71	SAT TT=1.592 ASSIGNMENTS=69	SAT TT=3.039 CHECKS=351226 NODES=6716	SAT TT=1.718 CHECKS=3412370 NODES=68716	? (TO) TT=1800.06	SAT TT=0.319 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=0.317 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=1.882	SAT TT=1.859	SAT TT=0.747 ASSIGNMENTS=7458 CHECKS=2197000	SAT TT=0.406 ASSIGNMENTS=6142 CHECKS=1143690	SAT TT=1.705	SAT TT=6.23 ASSIGNMENTS=63495 CHECKS=19093000	SAT TT=0.305 ASSIGNMENTS=2775 CHECKS=853391	SAT TT=2.096	SAT TT=1.936 ASSIGNMENTS=9626 CHECKS=1770000	SAT TT=1.451	SAT TT=1.43
csp/bqwh-18-141/ normalized-bqwh-18-141-42_ext.xml	SAT TT=0.243	SAT TT=7.257 CHECKS=6569900 NODES=44702	SAT TT=6.586 CHECKS=5771170 NODES=40818	SAT TT=2.277	SAT TT=2.144 CHECKS=2304000	SAT TT=0.552 CHECKS=611698	SAT TT=1.616 ASSIGNMENTS=73	SAT TT=1.759 ASSIGNMENTS=85	SAT TT=8.51 CHECKS=1425510 NODES=24447	SAT TT=5.161 CHECKS=17067300 NODES=348295	? (TO) TT=1800.02	SAT TT=0.288 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=0.289 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=1.75	SAT TT=1.862	SAT TT=0.243 ASSIGNMENTS=1947 CHECKS=634476	SAT TT=1.427 ASSIGNMENTS=15919 CHECKS=4122020	SAT TT=5.59	SAT TT=0.427 ASSIGNMENTS=3876 CHECKS=1142500	SAT TT=0.272 ASSIGNMENTS=2245 CHECKS=724251	SAT TT=2.585	SAT TT=2.47 ASSIGNMENTS=275 CHECKS=43049	SAT TT=1.468	SAT TT=1.165
csp/bqwh-18-141/ normalized-bqwh-18-141-72_ext.xml	SAT TT=0.106	SAT TT=2.14 CHECKS=1143180 NODES=8627	SAT TT=1.37 CHECKS=224404 NODES=1812	SAT TT=0.334	SAT TT=0.303 CHECKS=330761	SAT TT=0.42 CHECKS=469573	SAT TT=1.449 ASSIGNMENTS=8	SAT TT=1.344 ASSIGNMENTS=7	SAT TT=1.022 CHECKS=45793 NODES=880	SAT TT=0.739 CHECKS=146737 NODES=2993	? (TO) TT=1800.06	SAT TT=0.334 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=0.311 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=1.782	SAT TT=1.693	SAT TT=0.184 ASSIGNMENTS=1486 CHECKS=458969	SAT TT=0.34 ASSIGNMENTS=5100 CHECKS=976793	SAT TT=1.088	SAT TT=0.106 ASSIGNMENTS=779 CHECKS=213187	SAT TT=0.319 ASSIGNMENTS=2781 CHECKS=883301	SAT TT=2.357	SAT TT=0.523 ASSIGNMENTS=2242 CHECKS=537472	SAT TT=1.246	SAT TT=1.266
csp/bqwh-18-141/ normalized-bqwh-18-141-73_ext.xml	SAT TT=0.098	SAT TT=1.981 CHECKS=739890 NODES=6134	SAT TT=2.168 CHECKS=881477 NODES=6902	SAT TT=0.999	SAT TT=0.429 CHECKS=425415	SAT TT=0.098 CHECKS=75655	SAT TT=1.388 ASSIGNMENTS=58	SAT TT=1.435 ASSIGNMENTS=52	SAT TT=9.209 CHECKS=1288590 NODES=25863	SAT TT=1.214 CHECKS=1145820 NODES=22455	? (TO) TT=1800.07	SAT TT=8.28 ASSIGNMENTS=58	SAT TT=9.242 ASSIGNMENTS=58	SAT TT=1.945	SAT TT=1.851	SAT TT=0.668 ASSIGNMENTS=5872 CHECKS=1952910	SAT TT=2.723 ASSIGNMENTS=28945 CHECKS=8429730	SAT TT=25.672	SAT TT=2.064 ASSIGNMENTS=21270 CHECKS=6577230	SAT TT=2.887 ASSIGNMENTS=34143 CHECKS=9395700	SAT TT=2.431	SAT TT=0.839 ASSIGNMENTS=5161 CHECKS=851609	SAT TT=1.18	SAT TT=1.154
csp/bqwh-18-141/ normalized-bqwh-18-141-78_ext.xml	SAT TT=0.129	SAT TT=1.545 CHECKS=361033 NODES=3455	SAT TT=1.494 CHECKS=224455 NODES=1778	SAT TT=0.523	SAT TT=0.359 CHECKS=397093	SAT TT=0.172 CHECKS=180165	SAT TT=1.182 ASSIGNMENTS=4	SAT TT=1.212 ASSIGNMENTS=3	SAT TT=0.96 CHECKS=43239 NODES=861	SAT TT=1.471 CHECKS=2511080 NODES=53055	? (TO) TT=1800.06	SAT TT=0.179 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=0.181 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=1.919	SAT TT=1.753	SAT TT=0.138 ASSIGNMENTS=1137 CHECKS=359250	SAT TT=0.43 ASSIGNMENTS=5476 CHECKS=1151360	SAT TT=1.035	SAT TT=0.143 ASSIGNMENTS=1329 CHECKS=346124	SAT TT=0.168 ASSIGNMENTS=1498 CHECKS=449369	SAT TT=2.002	SAT TT=0.129 ASSIGNMENTS=551 CHECKS=56083	SAT TT=1.38	SAT TT=1.188
csp/bqwh-18-141/ normalized-bqwh-18-141-83_ext.xml	SAT TT=0.042	SAT TT=2.013 CHECKS=910266 NODES=7763	SAT TT=2.071 CHECKS=880500 NODES=7704	SAT TT=0.696	SAT TT=0.323 CHECKS=342669	SAT TT=0.63 CHECKS=832846	SAT TT=1.503 ASSIGNMENTS=5	SAT TT=1.291 ASSIGNMENTS=10	SAT TT=0.961 CHECKS=36427 NODES=766	SAT TT=0.832 CHECKS=338050 NODES=7083	SAT TT=0.873 CHECKS=741497 NODES=2607	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=35089	SAT TT=0.057 ASSIGNMENTS=116 CHECKS=35089	SAT TT=1.749	SAT TT=1.758	SAT TT=0.046 ASSIGNMENTS=128 CHECKS=40030	SAT TT=0.293 ASSIGNMENTS=4745 CHECKS=742269	SAT TT=0.779	SAT TT=0.094 ASSIGNMENTS=819 CHECKS=178013	SAT TT=0.042 ASSIGNMENTS=116 CHECKS=35089	SAT TT=2.061	SAT TT=0.1 ASSIGNMENTS=513 CHECKS=57747	SAT TT=1.546	SAT TT=1.363
csp/bqwh-18-141/ normalized-bqwh-18-141-8_ext.xml	SAT TT=0.056	SAT TT=1.156 CHECKS=72926 NODES=868	SAT TT=1.28 CHECKS=61774 NODES=685	SAT TT=0.189	SAT TT=0.104 CHECKS=69526	SAT TT=0.056 CHECKS=21517	SAT TT=1.496 ASSIGNMENTS=90	SAT TT=1.382 ASSIGNMENTS=12	SAT TT=0.917 CHECKS=26245 NODES=602	SAT TT=1.355 CHECKS=2566000 NODES=49976	? (TO) TT=1800.01	SAT TT=0.086 ASSIGNMENTS=473 CHECKS=120522	SAT TT=0.09 ASSIGNMENTS=473 CHECKS=120522	SAT TT=1.94	SAT TT=1.831	SAT TT=0.339 ASSIGNMENTS=2985 CHECKS=915924	SAT TT=0.362 ASSIGNMENTS=5209 CHECKS=969287	SAT TT=0.83	SAT TT=0.09 ASSIGNMENTS=673 CHECKS=158725	SAT TT=0.078 ASSIGNMENTS=473 CHECKS=120522	SAT TT=2.395	SAT TT=0.138 ASSIGNMENTS=797 CHECKS=87718	SAT TT=1.371	SAT TT=1.178
csp/coloring/ normalized-dsjc-125-1-4-ext.xml	UNSAT TT=0.025	UNSAT TT=1.029 CHECKS=44992 NODES=217	UNSAT TT=0.963 CHECKS=39816 NODES=142	UNSAT TT=0.125	UNSAT TT=0.082 CHECKS=39193	UNSAT TT=0.041 CHECKS=6524	UNSAT TT=0.64 ASSIGNMENTS=0	UNSAT TT=0.631 ASSIGNMENTS=0	UNSAT TT=0.602 CHECKS=6527 NODES=97	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.037 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=0.826	UNSAT TT=0.862	UNSAT TT=0.025 ASSIGNMENTS=21 CHECKS=14815	UNSAT TT=0.183 ASSIGNMENTS=4192 CHECKS=1013730	UNSAT TT=0.58	UNSAT TT=0.036 ASSIGNMENTS=390 CHECKS=90966	UNSAT TT=0.026 ASSIGNMENTS=27 CHECKS=16146	UNSAT TT=1.345	UNSAT TT=0.053 ASSIGNMENTS=50 CHECKS=37896	UNSAT TT=0.921	UNSAT TT=1.269
csp/coloring/ normalized-dsjc-125-1-5-ext.xml	SAT TT=0.045	SAT TT=1.178 CHECKS=247766 NODES=1812	SAT TT=1.125 CHECKS=159392 NODES=1149	SAT TT=0.13	SAT TT=0.12 CHECKS=61069	SAT TT=0.048 CHECKS=16747	SAT TT=1.014 ASSIGNMENTS=62	SAT TT=0.839 ASSIGNMENTS=85	SAT TT=1.005 CHECKS=51367 NODES=800	SAT TT=0.906 CHECKS=1480500 NODES=23086	SAT TT=0.853 CHECKS=1565040 NODES=4099	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=0.082 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.557	SAT TT=1.643	SAT TT=0.077 ASSIGNMENTS=746 CHECKS=296500	SAT TT=0.181 ASSIGNMENTS=6405 CHECKS=762341	SAT TT=5.737	SAT TT=0.045 ASSIGNMENTS=647 CHECKS=117453	SAT TT=0.064 ASSIGNMENTS=612 CHECKS=244964	SAT TT=1.503	SAT TT=0.208 ASSIGNMENTS=449 CHECKS=89541	SAT TT=0.962	SAT TT=1.03
csp/coloring/ normalized-geom-30a-3-ext.xml	UNSAT TT=0.007	UNSAT TT=0.807 CHECKS=6 NODES=0	UNSAT TT=0.701 CHECKS=6 NODES=0	UNSAT TT=0.032	UNSAT TT=0.01 CHECKS=740	UNSAT TT=0.009 CHECKS=398	UNSAT TT=0.387 ASSIGNMENTS=0	UNSAT TT=0.373 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=288 NODES=16	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.507	UNSAT TT=0.475	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.323	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.758	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=870	UNSAT TT=0.559	UNSAT TT=0.598
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-geom-30a-4-ext.xml	UNSAT TT=0.006	UNSAT TT=0.686 CHECKS=8 NODES=0	UNSAT TT=0.68 CHECKS=8 NODES=0	UNSAT TT=0.033	UNSAT TT=0.017 CHECKS=5418	UNSAT TT=0.011 CHECKS=821	UNSAT TT=0.362 ASSIGNMENTS=0	UNSAT TT=0.395 ASSIGNMENTS=0	UNSAT TT=0.341 CHECKS=723 NODES=41	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.651	UNSAT TT=0.677	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.32	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.726	UNSAT TT=0.013 ASSIGNMENTS=28 CHECKS=4094	UNSAT TT=0.63	UNSAT TT=0.544
csp/coloring/ normalized-geom-30a-5-ext.xml	UNSAT TT=0.007	UNSAT TT=0.745 CHECKS=10 NODES=0	UNSAT TT=0.703 CHECKS=10 NODES=0	UNSAT TT=0.034	UNSAT TT=0.035 CHECKS=19850	UNSAT TT=0.013 CHECKS=3378	UNSAT TT=0.388 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.363 CHECKS=2141 NODES=168	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.567	UNSAT TT=0.694	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.313	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.944	UNSAT TT=0.02 ASSIGNMENTS=145 CHECKS=18345	UNSAT TT=0.583	UNSAT TT=0.613
csp/coloring/ normalized-geom-30a-6-ext.xml	SAT TT=0.006	SAT TT=0.737 CHECKS=533 NODES=30	SAT TT=0.719 CHECKS=523 NODES=0	SAT TT=0.032	SAT TT=0.015 CHECKS=2193	SAT TT=0.012 CHECKS=502	SAT TT=0.444 ASSIGNMENTS=24	SAT TT=0.453 ASSIGNMENTS=25	SAT TT=0.357 CHECKS=374 NODES=30	SAT TT=0.335 CHECKS=2448 NODES=10	SAT TT=0.339 CHECKS=3237 NODES=11	SAT TT=0.02 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.021 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.918	SAT TT=0.882	SAT TT=0.006 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.008 ASSIGNMENTS=27 CHECKS=443	SAT TT=0.302	SAT TT=0.009 ASSIGNMENTS=26 CHECKS=451	SAT TT=0.008 ASSIGNMENTS=29 CHECKS=450	SAT TT=0.744	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1742	SAT TT=0.592	SAT TT=0.566
csp/coloring/ normalized-geom-40-2-ext.xml	UNSAT TT=0.006	UNSAT TT=0.679 CHECKS=0 NODES=0	UNSAT TT=0.688 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.01 CHECKS=95	UNSAT TT=0.372 ASSIGNMENTS=0	UNSAT TT=0.436 ASSIGNMENTS=0	UNSAT TT=0.337 CHECKS=30 NODES=1	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.484	UNSAT TT=0.477	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.299	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.718	UNSAT TT=0.011 ASSIGNMENTS=1 CHECKS=26	UNSAT TT=0.564	UNSAT TT=0.545
csp/coloring/ normalized-geom-40-3-ext.xml	UNSAT TT=0.006	UNSAT TT=0.674 CHECKS=0 NODES=0	UNSAT TT=0.676 CHECKS=0 NODES=0	UNSAT TT=0.031	UNSAT TT=0.012 CHECKS=256	UNSAT TT=0.009 CHECKS=155	UNSAT TT=0.384 ASSIGNMENTS=0	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.332 CHECKS=117 NODES=7	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.512	UNSAT TT=0.642	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.289	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.711	UNSAT TT=0.01 ASSIGNMENTS=6 CHECKS=383	UNSAT TT=0.561	UNSAT TT=0.581
csp/coloring/ normalized-geom-40-4-ext.xml	UNSAT TT=0.008	UNSAT TT=0.693 CHECKS=8 NODES=0	UNSAT TT=0.778 CHECKS=8 NODES=0	UNSAT TT=0.035	UNSAT TT=0.012 CHECKS=311	UNSAT TT=0.009 CHECKS=200	UNSAT TT=0.367 ASSIGNMENTS=0	UNSAT TT=0.411 ASSIGNMENTS=0	UNSAT TT=0.35 CHECKS=431 NODES=46	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.526	UNSAT TT=0.678	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.308	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.72	UNSAT TT=0.012 ASSIGNMENTS=28 CHECKS=1635	UNSAT TT=0.599	UNSAT TT=0.607
csp/coloring/ normalized-geom-40-5-ext.xml	UNSAT TT=0.005	UNSAT TT=0.746 CHECKS=10 NODES=0	UNSAT TT=0.676 CHECKS=10 NODES=0	UNSAT TT=0.032	UNSAT TT=0.013 CHECKS=2625	UNSAT TT=0.012 CHECKS=480	UNSAT TT=0.406 ASSIGNMENTS=0	UNSAT TT=0.371 ASSIGNMENTS=0	UNSAT TT=0.364 CHECKS=1122 NODES=169	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.755	UNSAT TT=0.532	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.313	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.819	UNSAT TT=0.015 ASSIGNMENTS=149 CHECKS=5135	UNSAT TT=0.576	UNSAT TT=0.614
csp/coloring/ normalized-geom-40-6-ext.xml	SAT TT=0.006	SAT TT=0.712 CHECKS=504 NODES=40	SAT TT=0.73 CHECKS=518 NODES=0	SAT TT=0.034	SAT TT=0.022 CHECKS=6041	SAT TT=0.012 CHECKS=1072	SAT TT=0.546 ASSIGNMENTS=35	SAT TT=0.476 ASSIGNMENTS=35	SAT TT=0.34 CHECKS=386 NODES=40	SAT TT=0.341 CHECKS=2340 NODES=11	SAT TT=0.322 CHECKS=2820 NODES=10	SAT TT=0.019 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.02 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.872	SAT TT=1.053	SAT TT=0.006 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.009 ASSIGNMENTS=39 CHECKS=333	SAT TT=0.339	SAT TT=0.008 ASSIGNMENTS=37 CHECKS=336	SAT TT=0.008 ASSIGNMENTS=39 CHECKS=317	SAT TT=0.726	SAT TT=0.011 ASSIGNMENTS=40 CHECKS=1358	SAT TT=0.545	SAT TT=0.613
csp/coloring/ normalized-le-450-5a-2-ext.xml	UNSAT TT=0.149	UNSAT TT=1.577 CHECKS=0 NODES=0	UNSAT TT=1.556 CHECKS=0 NODES=0	UNSAT TT=0.586	UNSAT TT=0.205 CHECKS=5770	UNSAT TT=0.188 CHECKS=5778	UNSAT TT=1.237 ASSIGNMENTS=0	UNSAT TT=1.257 ASSIGNMENTS=0	UNSAT TT=6.052 CHECKS=134 NODES=1	? (TO) TT=1800.08	Wrong Cert. TT=1714 CHECKS=6999240000 NODES=641436	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.162 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.369	UNSAT TT=2.115	UNSAT TT=0.149 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.171	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.722	UNSAT TT=0.528 ASSIGNMENTS=1 CHECKS=198	UNSAT TT=1.577	UNSAT TT=1.67
csp/coloring/ normalized-le-450-5a-3-ext.xml	UNSAT TT=0.154	UNSAT TT=1.378 CHECKS=0 NODES=0	UNSAT TT=1.452 CHECKS=0 NODES=0	UNSAT TT=0.664	UNSAT TT=0.729 CHECKS=300996	UNSAT TT=0.237 CHECKS=18117	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=1.216 ASSIGNMENTS=0	UNSAT TT=5.803 CHECKS=1855 NODES=16	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.286	UNSAT TT=1.863	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.736	UNSAT TT=0.155 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.684	UNSAT TT=0.53 ASSIGNMENTS=6 CHECKS=14253	UNSAT TT=1.656	UNSAT TT=1.789
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/coloring/ normalized-le-450-5a-4-ext.xml	UNSAT TT=0.15	UNSAT TT=1.553 CHECKS=0 NODES=0	UNSAT TT=1.528 CHECKS=0 NODES=0	UNSAT TT=0.624	UNSAT TT=1.018 CHECKS=352263	UNSAT TT=0.431 CHECKS=31362	UNSAT TT=1.102 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=6.672 CHECKS=12651 NODES=111	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.173 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.168 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.287	UNSAT TT=2.148	UNSAT TT=0.166 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.167 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.608	UNSAT TT=0.15 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.165 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=3.686	UNSAT TT=0.631 ASSIGNMENTS=115 CHECKS=291880	UNSAT TT=1.887	UNSAT TT=2.085
csp/coloring/ normalized-le-450-5a-5-ext.xml	SAT TT=0.553	SAT TT=1.771 CHECKS=110856 NODES=595	SAT TT=2.033 CHECKS=184794 NODES=581	SAT TT=1.105	SAT TT=6.867 CHECKS=2289410	SAT TT=3.262 CHECKS=474073	SAT TT=5.541 ASSIGNMENTS=13	SAT TT=5.664 ASSIGNMENTS=18	SAT TT=8.744 CHECKS=190382 NODES=1194	? (TO) TT=1800.01	SAT TT=26.852 CHECKS=116016000 NODES=45720	SAT TT=0.587 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=0.602 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.176	SAT TT=4.24	SAT TT=0.714 ASSIGNMENTS=540 CHECKS=2813410	SAT TT=4.285 ASSIGNMENTS=4474 CHECKS=18796100	SAT TT=24.058	SAT TT=0.595 ASSIGNMENTS=1778 CHECKS=1926740	SAT TT=0.553 ASSIGNMENTS=483 CHECKS=2323620	SAT TT=4.518	SAT TT=1.792 ASSIGNMENTS=1035 CHECKS=1236950	SAT TT=2.15	SAT TT=2.306
csp/coloring/ normalized-myciel-5g-3-ext.xml	UNSAT TT=0.012	UNSAT TT=0.776 CHECKS=2004 NODES=8	UNSAT TT=0.796 CHECKS=4330 NODES=0	UNSAT TT=0.05	UNSAT TT=0.025 CHECKS=8502	UNSAT TT=0.019 CHECKS=3832	UNSAT TT=0.47 ASSIGNMENTS=0	UNSAT TT=0.485 ASSIGNMENTS=0	UNSAT TT=0.419 CHECKS=3076 NODES=38	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.643	UNSAT TT=0.767	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4640	UNSAT TT=0.018 ASSIGNMENTS=175 CHECKS=27510	UNSAT TT=0.366	UNSAT TT=0.015 ASSIGNMENTS=99 CHECKS=13796	UNSAT TT=0.012 ASSIGNMENTS=19 CHECKS=4816	UNSAT TT=0.892	UNSAT TT=0.019 ASSIGNMENTS=26 CHECKS=10566	UNSAT TT=0.76	UNSAT TT=0.734
csp/coloring/ normalized-myciel-5g-4-ext.xml	UNSAT TT=0.049	UNSAT TT=0.925 CHECKS=53921 NODES=442	UNSAT TT=0.934 CHECKS=64809 NODES=527	UNSAT TT=0.104	UNSAT TT=0.125 CHECKS=98352	UNSAT TT=0.065 CHECKS=66999	UNSAT TT=0.579 ASSIGNMENTS=122	UNSAT TT=0.564 ASSIGNMENTS=122	UNSAT TT=0.773 CHECKS=90367 NODES=2704	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=0.063 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.064 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=0.712	UNSAT TT=0.728	UNSAT TT=0.052 ASSIGNMENTS=1295 CHECKS=235294	UNSAT TT=0.122 ASSIGNMENTS=5278 CHECKS=544267	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=1259 CHECKS=207545	UNSAT TT=0.054 ASSIGNMENTS=1387 CHECKS=246604	UNSAT TT=2.095	UNSAT TT=0.577 ASSIGNMENTS=4317 CHECKS=879438	UNSAT TT=0.759	UNSAT TT=0.81
csp/coloring/ normalized-myciel-5g-5-ext.xml	UNSAT TT=22.193	UNSAT TT=27.413 CHECKS=34788100 NODES=397254	UNSAT TT=30.607 CHECKS=39853800 NODES=458975	UNSAT TT=666.797	UNSAT TT=110.814 CHECKS=116359000	UNSAT TT=89.79 CHECKS=125270000	UNSAT TT=47.285 ASSIGNMENTS=574723	UNSAT TT=51.432 ASSIGNMENTS=574723	UNSAT TT=422.62 CHECKS=96524000 NODES=4328700	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=49.341 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=49.679 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=181.241	UNSAT TT=211.144	UNSAT TT=39.629 ASSIGNMENTS=2237490 CHECKS=197792000	UNSAT TT=37.626 ASSIGNMENTS=1982710 CHECKS=176954000	UNSAT TT=346.871	UNSAT TT=52.163 ASSIGNMENTS=2631860 CHECKS=235108000	UNSAT TT=40.565 ASSIGNMENTS=2177120 CHECKS=192910000	UNSAT TT=1634.05	UNSAT TT=1076.15 ASSIGNMENTS=14289000 CHECKS=1449620000	UNSAT TT=22.193	UNSAT TT=163.314
csp/coloring/ normalized-myciel-5g-6-ext.xml	SAT TT=0.011	SAT TT=0.847 CHECKS=1356 NODES=47	SAT TT=0.79 CHECKS=1353 NODES=0	SAT TT=0.049	SAT TT=0.038 CHECKS=10217	SAT TT=0.025 CHECKS=6875	SAT TT=0.663 ASSIGNMENTS=45	SAT TT=0.549 ASSIGNMENTS=45	SAT TT=0.416 CHECKS=1047 NODES=47	SAT TT=0.478 CHECKS=7462 NODES=21	SAT TT=0.417 CHECKS=11352 NODES=22	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.023 ASSIGNMENTS=46 CHECKS=1168	SAT TT=1.317	SAT TT=1.223	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.013 ASSIGNMENTS=44 CHECKS=1262	SAT TT=0.483	SAT TT=0.012 ASSIGNMENTS=46 CHECKS=1280	SAT TT=0.011 ASSIGNMENTS=46 CHECKS=1168	SAT TT=0.879	SAT TT=0.017 ASSIGNMENTS=47 CHECKS=5185	SAT TT=0.722	SAT TT=0.792
csp/coloring/ normalized-queens-5-5-3-ext.xml	UNSAT TT=0.01	UNSAT TT=0.715 CHECKS=6 NODES=0	UNSAT TT=0.747 CHECKS=6 NODES=0	UNSAT TT=0.039	UNSAT TT=0.017 CHECKS=4354	UNSAT TT=0.015 CHECKS=434	UNSAT TT=0.417 ASSIGNMENTS=0	UNSAT TT=0.394 ASSIGNMENTS=0	UNSAT TT=0.348 CHECKS=325 NODES=5	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.576	UNSAT TT=0.547	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.328	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.786	UNSAT TT=0.014 ASSIGNMENTS=6 CHECKS=2410	UNSAT TT=0.638	UNSAT TT=0.634
csp/coloring/ normalized-queens-5-5-4-ext.xml	UNSAT TT=0.01	UNSAT TT=0.752 CHECKS=8 NODES=0	UNSAT TT=0.809 CHECKS=8 NODES=0	UNSAT TT=0.04	UNSAT TT=0.038 CHECKS=18958	UNSAT TT=0.015 CHECKS=1623	UNSAT TT=0.397 ASSIGNMENTS=0	UNSAT TT=0.404 ASSIGNMENTS=0	UNSAT TT=0.393 CHECKS=1113 NODES=26	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.608	UNSAT TT=0.613	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.352	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.787	UNSAT TT=0.016 ASSIGNMENTS=28 CHECKS=12272	UNSAT TT=0.71	UNSAT TT=0.672
csp/coloring/ normalized-queens-5-5-5-ext.xml	SAT TT=0.009	SAT TT=0.779 CHECKS=800 NODES=25	SAT TT=0.762 CHECKS=821 NODES=0	SAT TT=0.041	SAT TT=0.034 CHECKS=13724	SAT TT=0.015 CHECKS=1328	SAT TT=0.552 ASSIGNMENTS=2	SAT TT=0.531 ASSIGNMENTS=2	SAT TT=0.355 CHECKS=524 NODES=25	SAT TT=0.465 CHECKS=7590 NODES=63	SAT TT=0.384 CHECKS=7570 NODES=23	SAT TT=0.022 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.021 ASSIGNMENTS=5 CHECKS=1199	SAT TT=1.02	SAT TT=1.226	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.009 ASSIGNMENTS=6 CHECKS=1460	SAT TT=0.334	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1255	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=1199	SAT TT=0.768	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=3251	SAT TT=0.621	SAT TT=0.727
csp/composed-25-10-20/ normalized-composed-25-10-20-2_ext.xml	SAT TT=0.052	SAT TT=1.044 CHECKS=94780 NODES=527	SAT TT=1.108 CHECKS=243885 NODES=110	SAT TT=0.637	SAT TT=1.486 CHECKS=568907	SAT TT=0.614 CHECKS=131936	SAT TT=1.062 ASSIGNMENTS=48	SAT TT=0.844 ASSIGNMENTS=48	SAT TT=0.724 CHECKS=9029 NODES=150	SAT TT=0.788 CHECKS=125432 NODES=831	SAT TT=0.758 CHECKS=201238 NODES=446	SAT TT=0.068 ASSIGNMENTS=468 CHECKS=30191	SAT TT=0.065 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.419	SAT TT=2.33	SAT TT=0.058 ASSIGNMENTS=489 CHECKS=31777	SAT TT=0.084 ASSIGNMENTS=1669 CHECKS=175712	SAT TT=0.786	SAT TT=0.062 ASSIGNMENTS=822 CHECKS=105285	SAT TT=0.052 ASSIGNMENTS=468 CHECKS=30191	SAT TT=2.774	SAT TT=0.121 ASSIGNMENTS=135 CHECKS=31404	SAT TT=1.186	SAT TT=1.338
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-10-20/ normalized-composed-25-10-20-3_ext.xml	SAT TT=0.053	SAT TT=1.096 CHECKS=32520 NODES=262	SAT TT=1.228 CHECKS=385480 NODES=165	? (TO) TT=1800.1	SAT TT=1.825 CHECKS=728350	SAT TT=0.617 CHECKS=153413	SAT TT=1.048 ASSIGNMENTS=43	SAT TT=0.843 ASSIGNMENTS=43	SAT TT=0.781 CHECKS=15485 NODES=277	SAT TT=0.906 CHECKS=179215 NODES=1644	SAT TT=0.838 CHECKS=420946 NODES=897	SAT TT=0.066 ASSIGNMENTS=412 CHECKS=28502	SAT TT=0.065 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.663	SAT TT=2.394	SAT TT=0.054 ASSIGNMENTS=543 CHECKS=40277	SAT TT=0.07 ASSIGNMENTS=1074 CHECKS=127336	SAT TT=0.73	SAT TT=0.069 ASSIGNMENTS=815 CHECKS=103798	SAT TT=0.053 ASSIGNMENTS=412 CHECKS=28502	SAT TT=2.911	SAT TT=0.148 ASSIGNMENTS=143 CHECKS=33084	SAT TT=1.451	SAT TT=1.365
csp/composed-25-10-20/ normalized-composed-25-10-20-4_ext.xml	SAT TT=0.045	SAT TT=1.047 CHECKS=65176 NODES=364	SAT TT=1.208 CHECKS=351310 NODES=464	SAT TT=79.985	SAT TT=0.508 CHECKS=145094	SAT TT=0.791 CHECKS=174398	SAT TT=0.862 ASSIGNMENTS=37	SAT TT=0.905 ASSIGNMENTS=37	SAT TT=0.789 CHECKS=17839 NODES=350	SAT TT=0.92 CHECKS=215186 NODES=2245	SAT TT=0.77 CHECKS=538053 NODES=795	SAT TT=0.055 ASSIGNMENTS=64 CHECKS=5497	SAT TT=0.059 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.28	SAT TT=2.24	SAT TT=0.045 ASSIGNMENTS=66 CHECKS=5656	SAT TT=0.163 ASSIGNMENTS=4954 CHECKS=614678	SAT TT=0.779	SAT TT=0.069 ASSIGNMENTS=801 CHECKS=103671	SAT TT=0.048 ASSIGNMENTS=64 CHECKS=5497	SAT TT=2.945	SAT TT=0.105 ASSIGNMENTS=138 CHECKS=31096	SAT TT=1.285	SAT TT=1.729
csp/composed-25-10-20/ normalized-composed-25-10-20-5_ext.xml	SAT TT=0.048	SAT TT=0.983 CHECKS=11695 NODES=115	SAT TT=1.131 CHECKS=224939 NODES=195	SAT TT=1.59	SAT TT=1.936 CHECKS=755036	SAT TT=0.641 CHECKS=144125	SAT TT=0.896 ASSIGNMENTS=51	SAT TT=0.853 ASSIGNMENTS=51	SAT TT=0.744 CHECKS=14762 NODES=258	SAT TT=0.794 CHECKS=115440 NODES=1004	SAT TT=0.752 CHECKS=168979 NODES=297	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=0.063 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.499	SAT TT=2.308	SAT TT=0.051 ASSIGNMENTS=224 CHECKS=15923	SAT TT=0.053 ASSIGNMENTS=262 CHECKS=28343	SAT TT=0.765	SAT TT=0.064 ASSIGNMENTS=822 CHECKS=108352	SAT TT=0.048 ASSIGNMENTS=212 CHECKS=14881	SAT TT=2.992	SAT TT=0.12 ASSIGNMENTS=129 CHECKS=29630	SAT TT=1.567	SAT TT=1.346
csp/composed-25-10-20/ normalized-composed-25-10-20-7_ext.xml	SAT TT=0.048	SAT TT=1.029 CHECKS=11266 NODES=110	SAT TT=1.103 CHECKS=173954 NODES=112	SAT TT=0.55	SAT TT=1.987 CHECKS=726918	SAT TT=0.754 CHECKS=166666	SAT TT=0.846 ASSIGNMENTS=70	SAT TT=1.078 ASSIGNMENTS=70	SAT TT=0.788 CHECKS=14580 NODES=256	SAT TT=0.771 CHECKS=50804 NODES=248	SAT TT=0.798 CHECKS=128888 NODES=192	SAT TT=0.057 ASSIGNMENTS=96 CHECKS=7209	SAT TT=0.061 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.279	SAT TT=2.449	SAT TT=0.052 ASSIGNMENTS=84 CHECKS=6524	SAT TT=0.135 ASSIGNMENTS=3846 CHECKS=440807	SAT TT=0.755	SAT TT=0.067 ASSIGNMENTS=812 CHECKS=105662	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=7209	SAT TT=2.997	SAT TT=0.108 ASSIGNMENTS=128 CHECKS=30298	SAT TT=1.275	SAT TT=1.733
csp/composed-25-1-25/ normalized-composed-25-1-25-1_ext.xml	UNSAT TT=0.02	UNSAT TT=0.809 CHECKS=1788 NODES=3	UNSAT TT=0.839 CHECKS=1745 NODES=0	UNSAT TT=0.168	UNSAT TT=0.046 CHECKS=6637	UNSAT TT=0.033 CHECKS=1217	UNSAT TT=0.693 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.572 CHECKS=3036 NODES=32	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.033 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.034 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=0.989	UNSAT TT=1.094	UNSAT TT=0.022 ASSIGNMENTS=99 CHECKS=12791	UNSAT TT=0.033 ASSIGNMENTS=594 CHECKS=63961	UNSAT TT=0.641	UNSAT TT=0.025 ASSIGNMENTS=217 CHECKS=32567	UNSAT TT=0.02 ASSIGNMENTS=54 CHECKS=6935	UNSAT TT=1.769	UNSAT TT=0.038 ASSIGNMENTS=4 CHECKS=2573	UNSAT TT=1.09	UNSAT TT=1.016
csp/composed-25-1-25/ normalized-composed-25-1-25-2_ext.xml	UNSAT TT=0.021	UNSAT TT=0.891 CHECKS=2824 NODES=6	UNSAT TT=0.953 CHECKS=6638 NODES=0	UNSAT TT=0.174	UNSAT TT=0.076 CHECKS=18119	UNSAT TT=0.034 CHECKS=2600	UNSAT TT=0.806 ASSIGNMENTS=0	UNSAT TT=0.687 ASSIGNMENTS=0	UNSAT TT=0.581 CHECKS=3233 NODES=28	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=0.033 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.229	UNSAT TT=0.996	UNSAT TT=0.023 ASSIGNMENTS=150 CHECKS=12416	UNSAT TT=0.046 ASSIGNMENTS=978 CHECKS=123605	UNSAT TT=0.518	UNSAT TT=0.024 ASSIGNMENTS=196 CHECKS=26831	UNSAT TT=0.021 ASSIGNMENTS=109 CHECKS=8911	UNSAT TT=1.857	UNSAT TT=0.044 ASSIGNMENTS=5 CHECKS=2503	UNSAT TT=0.992	UNSAT TT=1.021
csp/composed-25-1-25/ normalized-composed-25-1-25-3_ext.xml	UNSAT TT=0.023	UNSAT TT=0.861 CHECKS=2121 NODES=5	UNSAT TT=0.846 CHECKS=5064 NODES=0	UNSAT TT=0.173	UNSAT TT=0.072 CHECKS=16749	UNSAT TT=0.032 CHECKS=2282	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.713 ASSIGNMENTS=0	UNSAT TT=0.542 CHECKS=2346 NODES=20	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.033 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=0.988	UNSAT TT=1.17	UNSAT TT=0.023 ASSIGNMENTS=149 CHECKS=15056	UNSAT TT=0.034 ASSIGNMENTS=531 CHECKS=67496	UNSAT TT=0.508	UNSAT TT=0.024 ASSIGNMENTS=100 CHECKS=18174	UNSAT TT=0.023 ASSIGNMENTS=69 CHECKS=7780	UNSAT TT=1.777	UNSAT TT=0.041 ASSIGNMENTS=3 CHECKS=1736	UNSAT TT=0.96	UNSAT TT=0.99
csp/composed-25-1-25/ normalized-composed-25-1-25-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.808 CHECKS=2689 NODES=7	UNSAT TT=1.066 CHECKS=6045 NODES=0	UNSAT TT=0.159	UNSAT TT=0.079 CHECKS=19810	UNSAT TT=0.033 CHECKS=2714	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.664 ASSIGNMENTS=0	UNSAT TT=0.539 CHECKS=2921 NODES=31	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=0.034 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.109	UNSAT TT=0.908	UNSAT TT=0.022 ASSIGNMENTS=147 CHECKS=14236	UNSAT TT=0.049 ASSIGNMENTS=1239 CHECKS=145284	UNSAT TT=0.66	UNSAT TT=0.023 ASSIGNMENTS=198 CHECKS=26473	UNSAT TT=0.022 ASSIGNMENTS=85 CHECKS=7885	UNSAT TT=1.838	UNSAT TT=0.038 ASSIGNMENTS=6 CHECKS=3126	UNSAT TT=1.095	UNSAT TT=0.993
csp/composed-25-1-25/ normalized-composed-25-1-25-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.873 CHECKS=1996 NODES=4	UNSAT TT=0.868 CHECKS=4024 NODES=0	UNSAT TT=0.169	UNSAT TT=0.042 CHECKS=4883	UNSAT TT=0.034 CHECKS=2711	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3132 NODES=25	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=0.034 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.116	UNSAT TT=0.97	UNSAT TT=0.022 ASSIGNMENTS=87 CHECKS=9974	UNSAT TT=0.054 ASSIGNMENTS=1440 CHECKS=175058	UNSAT TT=0.648	UNSAT TT=0.021 ASSIGNMENTS=157 CHECKS=21820	UNSAT TT=0.022 ASSIGNMENTS=61 CHECKS=6411	UNSAT TT=1.662	UNSAT TT=0.039 ASSIGNMENTS=5 CHECKS=2729	UNSAT TT=1.04	UNSAT TT=0.989
csp/composed-25-1-2/ normalized-composed-25-1-2-0_ext.xml	UNSAT TT=0.02	UNSAT TT=0.802 CHECKS=1657 NODES=4	UNSAT TT=0.834 CHECKS=4458 NODES=0	UNSAT TT=0.164	UNSAT TT=0.041 CHECKS=5707	UNSAT TT=0.03 CHECKS=1478	UNSAT TT=0.606 ASSIGNMENTS=0	UNSAT TT=0.695 ASSIGNMENTS=0	UNSAT TT=0.568 CHECKS=2741 NODES=31	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.033 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=0.965	UNSAT TT=0.918	UNSAT TT=0.021 ASSIGNMENTS=166 CHECKS=9909	UNSAT TT=0.05 ASSIGNMENTS=2015 CHECKS=142789	UNSAT TT=0.507	UNSAT TT=0.022 ASSIGNMENTS=207 CHECKS=23608	UNSAT TT=0.02 ASSIGNMENTS=117 CHECKS=7189	UNSAT TT=1.636	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=949	UNSAT TT=0.945	UNSAT TT=1.122
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-2/ normalized-composed-25-1-2-6_ext.xml	UNSAT TT=0.022	UNSAT TT=0.81 CHECKS=2153 NODES=7	UNSAT TT=0.82 CHECKS=6829 NODES=0	UNSAT TT=0.155	UNSAT TT=0.058 CHECKS=12965	UNSAT TT=0.031 CHECKS=1806	UNSAT TT=0.638 ASSIGNMENTS=0	UNSAT TT=0.624 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=2697 NODES=31	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.033 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=0.967	UNSAT TT=0.912	UNSAT TT=0.023 ASSIGNMENTS=185 CHECKS=12365	UNSAT TT=0.035 ASSIGNMENTS=1100 CHECKS=77179	UNSAT TT=0.734	UNSAT TT=0.022 ASSIGNMENTS=193 CHECKS=21883	UNSAT TT=0.022 ASSIGNMENTS=140 CHECKS=9379	UNSAT TT=1.668	UNSAT TT=0.036 ASSIGNMENTS=8 CHECKS=1106	UNSAT TT=1.007	UNSAT TT=0.965
csp/composed-25-1-2/ normalized-composed-25-1-2-7_ext.xml	UNSAT TT=0.02	UNSAT TT=0.785 CHECKS=1807 NODES=5	UNSAT TT=0.94 CHECKS=7699 NODES=0	UNSAT TT=0.152	UNSAT TT=0.067 CHECKS=15940	UNSAT TT=0.031 CHECKS=1763	UNSAT TT=0.602 ASSIGNMENTS=0	UNSAT TT=0.616 ASSIGNMENTS=0	UNSAT TT=0.529 CHECKS=2808 NODES=34	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.032 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.034 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=0.939	UNSAT TT=1.2	UNSAT TT=0.02 ASSIGNMENTS=183 CHECKS=10858	UNSAT TT=0.035 ASSIGNMENTS=1230 CHECKS=86619	UNSAT TT=0.481	UNSAT TT=0.021 ASSIGNMENTS=215 CHECKS=23310	UNSAT TT=0.021 ASSIGNMENTS=140 CHECKS=8252	UNSAT TT=1.667	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=977	UNSAT TT=0.934	UNSAT TT=0.949
csp/composed-25-1-2/ normalized-composed-25-1-2-8_ext.xml	UNSAT TT=0.021	UNSAT TT=0.946 CHECKS=1977 NODES=4	UNSAT TT=0.959 CHECKS=6449 NODES=0	UNSAT TT=0.164	UNSAT TT=0.063 CHECKS=11893	UNSAT TT=0.029 CHECKS=1034	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.62 ASSIGNMENTS=0	UNSAT TT=0.6 CHECKS=2665 NODES=30	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=0.033 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.168	UNSAT TT=1.11	UNSAT TT=0.021 ASSIGNMENTS=181 CHECKS=11012	UNSAT TT=0.032 ASSIGNMENTS=824 CHECKS=59481	UNSAT TT=0.517	UNSAT TT=0.021 ASSIGNMENTS=204 CHECKS=22768	UNSAT TT=0.023 ASSIGNMENTS=124 CHECKS=7439	UNSAT TT=1.78	UNSAT TT=0.037 ASSIGNMENTS=5 CHECKS=891	UNSAT TT=1.053	UNSAT TT=0.975
csp/composed-25-1-2/ normalized-composed-25-1-2-9_ext.xml	UNSAT TT=0.02	UNSAT TT=0.84 CHECKS=1957 NODES=7	UNSAT TT=0.819 CHECKS=7145 NODES=0	UNSAT TT=0.162	UNSAT TT=0.066 CHECKS=13700	UNSAT TT=0.032 CHECKS=1825	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.617 ASSIGNMENTS=0	UNSAT TT=0.532 CHECKS=2842 NODES=31	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.033 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=0.936	UNSAT TT=0.953	UNSAT TT=0.021 ASSIGNMENTS=230 CHECKS=12987	UNSAT TT=0.03 ASSIGNMENTS=668 CHECKS=44608	UNSAT TT=0.611	UNSAT TT=0.021 ASSIGNMENTS=220 CHECKS=24330	UNSAT TT=0.02 ASSIGNMENTS=138 CHECKS=7748	UNSAT TT=1.651	UNSAT TT=0.043 ASSIGNMENTS=6 CHECKS=868	UNSAT TT=0.925	UNSAT TT=0.963
csp/composed-25-1-40/ normalized-composed-25-1-40-0_ext.xml	UNSAT TT=0.022	UNSAT TT=0.852 CHECKS=2608 NODES=4	UNSAT TT=0.809 CHECKS=2919 NODES=0	UNSAT TT=0.163	UNSAT TT=0.074 CHECKS=20999	UNSAT TT=0.036 CHECKS=2693	UNSAT TT=0.761 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.54 CHECKS=3284 NODES=23	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=0.034 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.009	UNSAT TT=0.93	UNSAT TT=0.023 ASSIGNMENTS=109 CHECKS=14171	UNSAT TT=0.052 ASSIGNMENTS=1322 CHECKS=186886	UNSAT TT=0.519	UNSAT TT=0.022 ASSIGNMENTS=152 CHECKS=25789	UNSAT TT=0.022 ASSIGNMENTS=69 CHECKS=8300	UNSAT TT=1.665	UNSAT TT=0.038 ASSIGNMENTS=7 CHECKS=5120	UNSAT TT=1.259	UNSAT TT=1.004
csp/composed-25-1-40/ normalized-composed-25-1-40-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.805 CHECKS=3096 NODES=6	UNSAT TT=0.826 CHECKS=6925 NODES=0	UNSAT TT=0.173	UNSAT TT=0.081 CHECKS=20289	UNSAT TT=0.034 CHECKS=1323	UNSAT TT=0.618 ASSIGNMENTS=0	UNSAT TT=0.629 ASSIGNMENTS=0	UNSAT TT=0.538 CHECKS=3314 NODES=29	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.033 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=0.034 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.183	UNSAT TT=0.919	UNSAT TT=0.025 ASSIGNMENTS=129 CHECKS=15763	UNSAT TT=0.037 ASSIGNMENTS=785 CHECKS=103843	UNSAT TT=0.517	UNSAT TT=0.024 ASSIGNMENTS=150 CHECKS=22448	UNSAT TT=0.023 ASSIGNMENTS=87 CHECKS=9314	UNSAT TT=1.798	UNSAT TT=0.037 ASSIGNMENTS=7 CHECKS=4114	UNSAT TT=0.982	UNSAT TT=1.296
csp/composed-25-1-40/ normalized-composed-25-1-40-3_ext.xml	UNSAT TT=0.022	UNSAT TT=0.811 CHECKS=2561 NODES=5	UNSAT TT=0.816 CHECKS=3829 NODES=0	UNSAT TT=0.176	UNSAT TT=0.044 CHECKS=6256	UNSAT TT=0.033 CHECKS=1609	UNSAT TT=0.809 ASSIGNMENTS=0	UNSAT TT=0.642 ASSIGNMENTS=0	UNSAT TT=0.789 CHECKS=2307 NODES=18	? (TO) TT=1800.1	? (TO) TT=1800	UNSAT TT=0.035 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.033 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=0.931	UNSAT TT=0.922	UNSAT TT=0.024 ASSIGNMENTS=127 CHECKS=22099	UNSAT TT=0.052 ASSIGNMENTS=1071 CHECKS=170496	UNSAT TT=0.478	UNSAT TT=0.022 ASSIGNMENTS=77 CHECKS=14575	UNSAT TT=0.023 ASSIGNMENTS=60 CHECKS=8959	UNSAT TT=1.69	UNSAT TT=0.048 ASSIGNMENTS=4 CHECKS=3161	UNSAT TT=1.12	UNSAT TT=1.003
csp/composed-25-1-40/ normalized-composed-25-1-40-4_ext.xml	UNSAT TT=0.021	UNSAT TT=0.81 CHECKS=2413 NODES=5	UNSAT TT=0.825 CHECKS=6054 NODES=0	UNSAT TT=0.176	UNSAT TT=0.047 CHECKS=7088	UNSAT TT=0.035 CHECKS=3082	UNSAT TT=0.798 ASSIGNMENTS=0	UNSAT TT=0.633 ASSIGNMENTS=0	UNSAT TT=0.552 CHECKS=3458 NODES=25	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.034 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=0.999	UNSAT TT=1.06	UNSAT TT=0.021 ASSIGNMENTS=108 CHECKS=14464	UNSAT TT=0.042 ASSIGNMENTS=960 CHECKS=130925	UNSAT TT=0.484	UNSAT TT=0.024 ASSIGNMENTS=136 CHECKS=23277	UNSAT TT=0.021 ASSIGNMENTS=63 CHECKS=9430	UNSAT TT=1.669	UNSAT TT=0.041 ASSIGNMENTS=7 CHECKS=4591	UNSAT TT=1.087	UNSAT TT=0.997
csp/composed-25-1-40/ normalized-composed-25-1-40-5_ext.xml	UNSAT TT=0.02	UNSAT TT=0.805 CHECKS=2585 NODES=6	UNSAT TT=0.859 CHECKS=2758 NODES=0	UNSAT TT=0.164	UNSAT TT=0.047 CHECKS=7304	UNSAT TT=0.031 CHECKS=1056	UNSAT TT=0.625 ASSIGNMENTS=0	UNSAT TT=0.662 ASSIGNMENTS=0	UNSAT TT=0.541 CHECKS=3038 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.034 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.032 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=0.997	UNSAT TT=1.057	UNSAT TT=0.022 ASSIGNMENTS=68 CHECKS=12604	UNSAT TT=0.039 ASSIGNMENTS=637 CHECKS=97538	UNSAT TT=0.626	UNSAT TT=0.024 ASSIGNMENTS=78 CHECKS=14356	UNSAT TT=0.02 ASSIGNMENTS=39 CHECKS=6423	UNSAT TT=1.797	UNSAT TT=0.041 ASSIGNMENTS=6 CHECKS=3717	UNSAT TT=0.974	UNSAT TT=1.222
csp/composed-25-1-80/ normalized-composed-25-1-80-0_ext.xml	UNSAT TT=0.023	UNSAT TT=0.813 CHECKS=3403 NODES=4	UNSAT TT=0.827 CHECKS=3737 NODES=0	UNSAT TT=0.189	UNSAT TT=0.05 CHECKS=8570	UNSAT TT=0.037 CHECKS=1865	UNSAT TT=0.823 ASSIGNMENTS=0	UNSAT TT=0.686 ASSIGNMENTS=0	UNSAT TT=0.595 CHECKS=3507 NODES=21	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=0.036 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.253	UNSAT TT=0.995	UNSAT TT=0.028 ASSIGNMENTS=92 CHECKS=20520	UNSAT TT=0.043 ASSIGNMENTS=638 CHECKS=119040	UNSAT TT=0.528	UNSAT TT=0.025 ASSIGNMENTS=82 CHECKS=18397	UNSAT TT=0.023 ASSIGNMENTS=56 CHECKS=11778	UNSAT TT=1.728	UNSAT TT=0.048 ASSIGNMENTS=5 CHECKS=5819	UNSAT TT=1.168	UNSAT TT=1.081
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-25-1-80/ normalized-composed-25-1-80-2_ext.xml	UNSAT TT=0.023	UNSAT TT=0.873 CHECKS=3909 NODES=6	UNSAT TT=0.828 CHECKS=8069 NODES=0	UNSAT TT=0.174	UNSAT TT=0.048 CHECKS=9236	UNSAT TT=0.036 CHECKS=3520	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.644 ASSIGNMENTS=0	UNSAT TT=0.556 CHECKS=4210 NODES=24	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.033 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=0.035 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.019	UNSAT TT=0.989	UNSAT TT=0.025 ASSIGNMENTS=123 CHECKS=23941	UNSAT TT=0.05 ASSIGNMENTS=869 CHECKS=163457	UNSAT TT=0.563	UNSAT TT=0.026 ASSIGNMENTS=131 CHECKS=28954	UNSAT TT=0.023 ASSIGNMENTS=57 CHECKS=10966	UNSAT TT=1.733	UNSAT TT=0.049 ASSIGNMENTS=5 CHECKS=5913	UNSAT TT=1.15	UNSAT TT=1.183
csp/composed-25-1-80/ normalized-composed-25-1-80-7_ext.xml	UNSAT TT=0.026	UNSAT TT=0.834 CHECKS=4073 NODES=6	UNSAT TT=0.806 CHECKS=3584 NODES=0	UNSAT TT=0.183	UNSAT TT=0.091 CHECKS=26444	UNSAT TT=0.04 CHECKS=3681	UNSAT TT=0.821 ASSIGNMENTS=0	UNSAT TT=0.733 ASSIGNMENTS=0	UNSAT TT=0.564 CHECKS=3680 NODES=23	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=0.038 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.037 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=0.948	UNSAT TT=1.149	UNSAT TT=0.027 ASSIGNMENTS=151 CHECKS=25908	UNSAT TT=0.056 ASSIGNMENTS=1161 CHECKS=232847	UNSAT TT=0.541	UNSAT TT=0.028 ASSIGNMENTS=135 CHECKS=29871	UNSAT TT=0.026 ASSIGNMENTS=77 CHECKS=12718	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=6327	UNSAT TT=1.015	UNSAT TT=0.982
csp/composed-25-1-80/ normalized-composed-25-1-80-8_ext.xml	UNSAT TT=0.022	UNSAT TT=0.848 CHECKS=3064 NODES=4	UNSAT TT=0.834 CHECKS=4175 NODES=0	UNSAT TT=0.177	UNSAT TT=0.099 CHECKS=30903	UNSAT TT=0.033 CHECKS=1358	UNSAT TT=0.645 ASSIGNMENTS=0	UNSAT TT=0.663 ASSIGNMENTS=0	UNSAT TT=0.574 CHECKS=3587 NODES=23	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.034 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.035 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.009	UNSAT TT=0.967	UNSAT TT=0.022 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=0.064 ASSIGNMENTS=1216 CHECKS=247400	UNSAT TT=0.574	UNSAT TT=0.025 ASSIGNMENTS=52 CHECKS=10486	UNSAT TT=0.024 ASSIGNMENTS=6 CHECKS=1192	UNSAT TT=1.886	UNSAT TT=0.048 ASSIGNMENTS=7 CHECKS=7658	UNSAT TT=1.311	UNSAT TT=1.007
csp/composed-25-1-80/ normalized-composed-25-1-80-9_ext.xml	UNSAT TT=0.024	UNSAT TT=0.81 CHECKS=4729 NODES=8	UNSAT TT=0.852 CHECKS=6657 NODES=0	UNSAT TT=0.189	UNSAT TT=0.062 CHECKS=14835	UNSAT TT=0.04 CHECKS=4278	UNSAT TT=0.632 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.571 CHECKS=3417 NODES=24	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.038 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=0.037 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.171	UNSAT TT=1.016	UNSAT TT=0.029 ASSIGNMENTS=179 CHECKS=41164	UNSAT TT=0.064 ASSIGNMENTS=1230 CHECKS=252489	UNSAT TT=0.5	UNSAT TT=0.024 ASSIGNMENTS=75 CHECKS=16749	UNSAT TT=0.026 ASSIGNMENTS=75 CHECKS=13828	UNSAT TT=1.738	UNSAT TT=0.046 ASSIGNMENTS=6 CHECKS=5725	UNSAT TT=0.951	UNSAT TT=1.06
csp/composed-75-1-25/ normalized-composed-75-1-25-2_ext.xml	UNSAT TT=0.051	UNSAT TT=0.946 CHECKS=2223 NODES=6	UNSAT TT=0.95 CHECKS=12138 NODES=0	UNSAT TT=0.399	UNSAT TT=0.215 CHECKS=54998	UNSAT TT=0.08 CHECKS=5385	UNSAT TT=0.748 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.748 CHECKS=6488 NODES=50	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.064 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=0.063 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=1.406	UNSAT TT=1.38	UNSAT TT=0.051 ASSIGNMENTS=304 CHECKS=31909	UNSAT TT=0.152 ASSIGNMENTS=4853 CHECKS=586337	UNSAT TT=0.653	UNSAT TT=0.056 ASSIGNMENTS=470 CHECKS=68700	UNSAT TT=0.052 ASSIGNMENTS=248 CHECKS=26215	UNSAT TT=2.512	UNSAT TT=0.099 ASSIGNMENTS=6 CHECKS=3286	UNSAT TT=1.536	UNSAT TT=1.259
csp/composed-75-1-25/ normalized-composed-75-1-25-4_ext.xml	UNSAT TT=0.047	UNSAT TT=0.993 CHECKS=2300 NODES=6	UNSAT TT=1.1 CHECKS=1981 NODES=0	UNSAT TT=0.405	UNSAT TT=0.122 CHECKS=16988	UNSAT TT=0.077 CHECKS=5168	UNSAT TT=0.775 ASSIGNMENTS=0	UNSAT TT=0.788 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=6264 NODES=54	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.063 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=0.062 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=1.435	UNSAT TT=1.378	UNSAT TT=0.051 ASSIGNMENTS=214 CHECKS=19167	UNSAT TT=0.154 ASSIGNMENTS=5113 CHECKS=582357	UNSAT TT=0.655	UNSAT TT=0.06 ASSIGNMENTS=553 CHECKS=79081	UNSAT TT=0.047 ASSIGNMENTS=212 CHECKS=17958	UNSAT TT=2.518	UNSAT TT=0.096 ASSIGNMENTS=6 CHECKS=3075	UNSAT TT=1.319	UNSAT TT=1.466
csp/composed-75-1-25/ normalized-composed-75-1-25-5_ext.xml	UNSAT TT=0.048	UNSAT TT=0.976 CHECKS=2104 NODES=5	UNSAT TT=0.987 CHECKS=20212 NODES=0	UNSAT TT=0.401	UNSAT TT=0.211 CHECKS=53887	UNSAT TT=0.076 CHECKS=2534	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.867 CHECKS=6594 NODES=48	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.063 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=0.059 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=1.641	UNSAT TT=1.403	UNSAT TT=0.054 ASSIGNMENTS=272 CHECKS=24806	UNSAT TT=0.175 ASSIGNMENTS=6252 CHECKS=692225	UNSAT TT=0.659	UNSAT TT=0.056 ASSIGNMENTS=532 CHECKS=80384	UNSAT TT=0.048 ASSIGNMENTS=204 CHECKS=19561	UNSAT TT=2.369	UNSAT TT=0.098 ASSIGNMENTS=7 CHECKS=2357	UNSAT TT=1.388	UNSAT TT=1.442
csp/composed-75-1-25/ normalized-composed-75-1-25-6_ext.xml	UNSAT TT=0.049	UNSAT TT=0.983 CHECKS=1998 NODES=4	UNSAT TT=1 CHECKS=19651 NODES=0	UNSAT TT=0.401	UNSAT TT=0.214 CHECKS=55945	UNSAT TT=0.075 CHECKS=5312	UNSAT TT=0.772 ASSIGNMENTS=0	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.754 CHECKS=6411 NODES=40	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.061 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=0.064 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=1.433	UNSAT TT=1.394	UNSAT TT=0.049 ASSIGNMENTS=344 CHECKS=24991	UNSAT TT=0.166 ASSIGNMENTS=6230 CHECKS=691261	UNSAT TT=0.66	UNSAT TT=0.053 ASSIGNMENTS=514 CHECKS=68300	UNSAT TT=0.049 ASSIGNMENTS=345 CHECKS=24299	UNSAT TT=2.308	UNSAT TT=0.095 ASSIGNMENTS=8 CHECKS=3043	UNSAT TT=1.382	UNSAT TT=1.394
csp/composed-75-1-25/ normalized-composed-75-1-25-9_ext.xml	UNSAT TT=0.049	UNSAT TT=1.079 CHECKS=2301 NODES=5	UNSAT TT=1.003 CHECKS=13015 NODES=0	UNSAT TT=0.402	UNSAT TT=0.198 CHECKS=51657	UNSAT TT=0.082 CHECKS=11771	UNSAT TT=0.753 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=0.743 CHECKS=6760 NODES=63	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.065 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=0.06 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=1.413	UNSAT TT=1.409	UNSAT TT=0.051 ASSIGNMENTS=329 CHECKS=25050	UNSAT TT=0.176 ASSIGNMENTS=6351 CHECKS=691833	UNSAT TT=0.825	UNSAT TT=0.055 ASSIGNMENTS=537 CHECKS=82350	UNSAT TT=0.049 ASSIGNMENTS=257 CHECKS=19768	UNSAT TT=2.328	UNSAT TT=0.092 ASSIGNMENTS=7 CHECKS=3052	UNSAT TT=1.174	UNSAT TT=1.347
csp/composed-75-1-2/ normalized-composed-75-1-2-0_ext.xml	UNSAT TT=0.047	UNSAT TT=0.942 CHECKS=1852 NODES=5	UNSAT TT=1.127 CHECKS=17117 NODES=0	UNSAT TT=0.399	UNSAT TT=0.199 CHECKS=49100	UNSAT TT=0.075 CHECKS=4898	UNSAT TT=0.802 ASSIGNMENTS=0	UNSAT TT=0.997 ASSIGNMENTS=0	UNSAT TT=0.705 CHECKS=8367 NODES=94	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.059 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=0.061 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=1.68	UNSAT TT=1.575	UNSAT TT=0.05 ASSIGNMENTS=279 CHECKS=19618	UNSAT TT=0.107 ASSIGNMENTS=3874 CHECKS=355491	UNSAT TT=0.6	UNSAT TT=0.052 ASSIGNMENTS=555 CHECKS=66796	UNSAT TT=0.047 ASSIGNMENTS=258 CHECKS=17659	UNSAT TT=2.457	UNSAT TT=0.098 ASSIGNMENTS=5 CHECKS=957	UNSAT TT=1.182	UNSAT TT=1.472
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-2/ normalized-composed-75-1-2-1_ext.xml	UNSAT TT=0.047	UNSAT TT=0.94 CHECKS=1801 NODES=5	UNSAT TT=1.011 CHECKS=17108 NODES=0	UNSAT TT=0.396	UNSAT TT=0.192 CHECKS=45987	UNSAT TT=0.078 CHECKS=4860	UNSAT TT=0.87 ASSIGNMENTS=0	UNSAT TT=0.752 ASSIGNMENTS=0	UNSAT TT=0.947 CHECKS=6473 NODES=56	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.062 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=0.061 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=1.538	UNSAT TT=1.361	UNSAT TT=0.049 ASSIGNMENTS=413 CHECKS=23658	UNSAT TT=0.151 ASSIGNMENTS=6633 CHECKS=584150	UNSAT TT=0.65	UNSAT TT=0.054 ASSIGNMENTS=527 CHECKS=72323	UNSAT TT=0.047 ASSIGNMENTS=402 CHECKS=23171	UNSAT TT=2.307	UNSAT TT=0.091 ASSIGNMENTS=8 CHECKS=1063	UNSAT TT=1.39	UNSAT TT=1.431
csp/composed-75-1-2/ normalized-composed-75-1-2-2_ext.xml	UNSAT TT=0.047	UNSAT TT=0.974 CHECKS=1888 NODES=6	UNSAT TT=1.147 CHECKS=19142 NODES=0	UNSAT TT=0.393	UNSAT TT=0.198 CHECKS=47297	UNSAT TT=0.079 CHECKS=4813	UNSAT TT=0.824 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.953 CHECKS=6242 NODES=62	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=0.061 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=1.404	UNSAT TT=1.499	UNSAT TT=0.05 ASSIGNMENTS=364 CHECKS=23340	UNSAT TT=0.109 ASSIGNMENTS=4024 CHECKS=358778	UNSAT TT=0.716	UNSAT TT=0.056 ASSIGNMENTS=579 CHECKS=77807	UNSAT TT=0.047 ASSIGNMENTS=335 CHECKS=21110	UNSAT TT=2.483	UNSAT TT=0.097 ASSIGNMENTS=6 CHECKS=977	UNSAT TT=1.226	UNSAT TT=1.434
csp/composed-75-1-2/ normalized-composed-75-1-2-5_ext.xml	UNSAT TT=0.047	UNSAT TT=0.943 CHECKS=1528 NODES=5	UNSAT TT=0.99 CHECKS=17462 NODES=0	UNSAT TT=0.394	UNSAT TT=0.114 CHECKS=14512	UNSAT TT=0.074 CHECKS=4787	UNSAT TT=0.819 ASSIGNMENTS=0	UNSAT TT=0.812 ASSIGNMENTS=0	UNSAT TT=0.738 CHECKS=6352 NODES=51	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.06 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=0.062 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=1.402	UNSAT TT=1.483	UNSAT TT=0.047 ASSIGNMENTS=388 CHECKS=23947	UNSAT TT=0.144 ASSIGNMENTS=6082 CHECKS=529241	UNSAT TT=0.639	UNSAT TT=0.055 ASSIGNMENTS=562 CHECKS=73130	UNSAT TT=0.05 ASSIGNMENTS=387 CHECKS=24082	UNSAT TT=2.484	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1019	UNSAT TT=1.361	UNSAT TT=1.43
csp/composed-75-1-2/ normalized-composed-75-1-2-7_ext.xml	UNSAT TT=0.047	UNSAT TT=0.998 CHECKS=1673 NODES=4	UNSAT TT=1.102 CHECKS=17171 NODES=0	UNSAT TT=0.399	UNSAT TT=0.218 CHECKS=57838	UNSAT TT=0.071 CHECKS=2268	UNSAT TT=0.958 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=0.904 CHECKS=6066 NODES=68	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.061 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=0.062 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=1.321	UNSAT TT=1.381	UNSAT TT=0.047 ASSIGNMENTS=389 CHECKS=22732	UNSAT TT=0.155 ASSIGNMENTS=6524 CHECKS=593423	UNSAT TT=0.641	UNSAT TT=0.054 ASSIGNMENTS=590 CHECKS=79866	UNSAT TT=0.048 ASSIGNMENTS=366 CHECKS=21831	UNSAT TT=2.476	UNSAT TT=0.093 ASSIGNMENTS=7 CHECKS=1051	UNSAT TT=1.201	UNSAT TT=1.353
csp/composed-75-1-40/ normalized-composed-75-1-40-1_ext.xml	UNSAT TT=0.049	UNSAT TT=0.978 CHECKS=2367 NODES=5	UNSAT TT=0.963 CHECKS=18242 NODES=0	UNSAT TT=0.404	UNSAT TT=0.227 CHECKS=59123	UNSAT TT=0.072 CHECKS=2486	UNSAT TT=0.987 ASSIGNMENTS=0	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=6854 NODES=39	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.065 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=0.059 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=1.426	UNSAT TT=1.512	UNSAT TT=0.052 ASSIGNMENTS=307 CHECKS=26165	UNSAT TT=0.184 ASSIGNMENTS=6210 CHECKS=748357	UNSAT TT=0.675	UNSAT TT=0.058 ASSIGNMENTS=500 CHECKS=83243	UNSAT TT=0.049 ASSIGNMENTS=292 CHECKS=24789	UNSAT TT=2.331	UNSAT TT=0.101 ASSIGNMENTS=8 CHECKS=4165	UNSAT TT=1.129	UNSAT TT=1.264
csp/composed-75-1-40/ normalized-composed-75-1-40-2_ext.xml	UNSAT TT=0.05	UNSAT TT=0.938 CHECKS=2453 NODES=6	UNSAT TT=1.029 CHECKS=11787 NODES=0	UNSAT TT=0.407	UNSAT TT=0.129 CHECKS=20089	UNSAT TT=0.081 CHECKS=5532	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=1.001 ASSIGNMENTS=0	UNSAT TT=0.799 CHECKS=6663 NODES=40	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.062 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=0.066 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=1.459	UNSAT TT=1.369	UNSAT TT=0.052 ASSIGNMENTS=259 CHECKS=27119	UNSAT TT=0.205 ASSIGNMENTS=5936 CHECKS=878926	UNSAT TT=0.659	UNSAT TT=0.053 ASSIGNMENTS=359 CHECKS=58059	UNSAT TT=0.05 ASSIGNMENTS=227 CHECKS=23545	UNSAT TT=2.496	UNSAT TT=0.1 ASSIGNMENTS=6 CHECKS=4554	UNSAT TT=1.206	UNSAT TT=1.372
csp/composed-75-1-40/ normalized-composed-75-1-40-5_ext.xml	UNSAT TT=0.049	UNSAT TT=0.946 CHECKS=2565 NODES=5	UNSAT TT=1.111 CHECKS=8496 NODES=0	UNSAT TT=0.379	UNSAT TT=0.129 CHECKS=20493	UNSAT TT=0.079 CHECKS=5540	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.907 ASSIGNMENTS=0	UNSAT TT=0.758 CHECKS=7403 NODES=40	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.06 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=0.058 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=1.422	UNSAT TT=1.396	UNSAT TT=0.05 ASSIGNMENTS=206 CHECKS=24405	UNSAT TT=0.204 ASSIGNMENTS=5940 CHECKS=826891	UNSAT TT=0.815	UNSAT TT=0.059 ASSIGNMENTS=564 CHECKS=95606	UNSAT TT=0.049 ASSIGNMENTS=192 CHECKS=20622	UNSAT TT=2.356	UNSAT TT=0.101 ASSIGNMENTS=7 CHECKS=4342	UNSAT TT=1.16	UNSAT TT=1.456
csp/composed-75-1-40/ normalized-composed-75-1-40-6_ext.xml	UNSAT TT=0.048	UNSAT TT=0.945 CHECKS=2961 NODES=6	UNSAT TT=1.027 CHECKS=13797 NODES=0	UNSAT TT=0.402	UNSAT TT=0.223 CHECKS=59180	UNSAT TT=0.076 CHECKS=3007	UNSAT TT=0.754 ASSIGNMENTS=0	UNSAT TT=0.831 ASSIGNMENTS=0	UNSAT TT=0.759 CHECKS=6946 NODES=41	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=0.061 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=1.577	UNSAT TT=1.386	UNSAT TT=0.048 ASSIGNMENTS=238 CHECKS=28730	UNSAT TT=0.133 ASSIGNMENTS=3361 CHECKS=469964	UNSAT TT=0.661	UNSAT TT=0.06 ASSIGNMENTS=590 CHECKS=86812	UNSAT TT=0.05 ASSIGNMENTS=179 CHECKS=19905	UNSAT TT=2.514	UNSAT TT=0.091 ASSIGNMENTS=6 CHECKS=3968	UNSAT TT=1.397	UNSAT TT=1.261
csp/composed-75-1-40/ normalized-composed-75-1-40-9_ext.xml	UNSAT TT=0.05	UNSAT TT=0.963 CHECKS=2778 NODES=5	UNSAT TT=0.968 CHECKS=14100 NODES=0	UNSAT TT=0.409	UNSAT TT=0.135 CHECKS=23434	UNSAT TT=0.082 CHECKS=5660	UNSAT TT=0.76 ASSIGNMENTS=0	UNSAT TT=0.99 ASSIGNMENTS=0	UNSAT TT=0.77 CHECKS=6978 NODES=63	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.064 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=0.063 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=1.431	UNSAT TT=1.374	UNSAT TT=0.052 ASSIGNMENTS=272 CHECKS=27389	UNSAT TT=0.194 ASSIGNMENTS=6127 CHECKS=787308	UNSAT TT=0.656	UNSAT TT=0.053 ASSIGNMENTS=353 CHECKS=59456	UNSAT TT=0.05 ASSIGNMENTS=254 CHECKS=23092	UNSAT TT=2.446	UNSAT TT=0.099 ASSIGNMENTS=8 CHECKS=3659	UNSAT TT=1.184	UNSAT TT=1.446
csp/composed-75-1-80/ normalized-composed-75-1-80-1_ext.xml	UNSAT TT=0.049	UNSAT TT=1.109 CHECKS=3548 NODES=6	UNSAT TT=1.023 CHECKS=12036 NODES=0	UNSAT TT=0.417	UNSAT TT=0.232 CHECKS=61937	UNSAT TT=0.084 CHECKS=6114	UNSAT TT=0.826 ASSIGNMENTS=0	UNSAT TT=0.791 ASSIGNMENTS=0	UNSAT TT=0.776 CHECKS=5267 NODES=30	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.065 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=0.06 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=1.588	UNSAT TT=1.306	UNSAT TT=0.053 ASSIGNMENTS=215 CHECKS=34722	UNSAT TT=0.155 ASSIGNMENTS=3438 CHECKS=598000	UNSAT TT=0.669	UNSAT TT=0.049 ASSIGNMENTS=173 CHECKS=32381	UNSAT TT=0.051 ASSIGNMENTS=181 CHECKS=25346	UNSAT TT=2.672	UNSAT TT=0.104 ASSIGNMENTS=8 CHECKS=7474	UNSAT TT=1.386	UNSAT TT=1.235
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/composed-75-1-80/ normalized-composed-75-1-80-3_ext.xml	UNSAT TT=0.047	UNSAT TT=0.944 CHECKS=3487 NODES=6	UNSAT TT=1.104 CHECKS=6399 NODES=0	UNSAT TT=0.416	UNSAT TT=0.247 CHECKS=69188	UNSAT TT=0.09 CHECKS=8103	UNSAT TT=0.774 ASSIGNMENTS=0	UNSAT TT=0.816 ASSIGNMENTS=0	UNSAT TT=0.722 CHECKS=4469 NODES=31	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.056 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=0.06 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=1.363	UNSAT TT=1.524	UNSAT TT=0.047 ASSIGNMENTS=122 CHECKS=25767	UNSAT TT=0.069 ASSIGNMENTS=815 CHECKS=157633	UNSAT TT=0.63	UNSAT TT=0.049 ASSIGNMENTS=158 CHECKS=29975	UNSAT TT=0.048 ASSIGNMENTS=114 CHECKS=19207	UNSAT TT=2.486	UNSAT TT=0.104 ASSIGNMENTS=5 CHECKS=7797	UNSAT TT=1.359	UNSAT TT=1.228
csp/composed-75-1-80/ normalized-composed-75-1-80-6_ext.xml	UNSAT TT=0.05	UNSAT TT=0.981 CHECKS=3918 NODES=6	UNSAT TT=0.962 CHECKS=8245 NODES=0	UNSAT TT=0.39	UNSAT TT=0.216 CHECKS=64176	UNSAT TT=0.078 CHECKS=6342	UNSAT TT=0.776 ASSIGNMENTS=0	UNSAT TT=0.948 ASSIGNMENTS=0	UNSAT TT=0.843 CHECKS=5346 NODES=28	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.058 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=0.057 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=1.385	UNSAT TT=1.404	UNSAT TT=0.052 ASSIGNMENTS=172 CHECKS=26930	UNSAT TT=0.161 ASSIGNMENTS=3825 CHECKS=727874	UNSAT TT=0.629	UNSAT TT=0.053 ASSIGNMENTS=203 CHECKS=39726	UNSAT TT=0.05 ASSIGNMENTS=137 CHECKS=22217	UNSAT TT=2.702	UNSAT TT=0.105 ASSIGNMENTS=7 CHECKS=7103	UNSAT TT=1.392	UNSAT TT=1.305
csp/composed-75-1-80/ normalized-composed-75-1-80-8_ext.xml	UNSAT TT=0.045	UNSAT TT=0.956 CHECKS=2943 NODES=3	UNSAT TT=1.015 CHECKS=8962 NODES=0	UNSAT TT=0.392	UNSAT TT=0.241 CHECKS=74686	UNSAT TT=0.086 CHECKS=7160	UNSAT TT=0.767 ASSIGNMENTS=0	UNSAT TT=0.813 ASSIGNMENTS=0	UNSAT TT=0.779 CHECKS=5973 NODES=32	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.059 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=0.06 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=1.452	UNSAT TT=1.347	UNSAT TT=0.05 ASSIGNMENTS=101 CHECKS=27615	UNSAT TT=0.171 ASSIGNMENTS=3589 CHECKS=710950	UNSAT TT=0.834	UNSAT TT=0.045 ASSIGNMENTS=118 CHECKS=24676	UNSAT TT=0.047 ASSIGNMENTS=80 CHECKS=18864	UNSAT TT=2.691	UNSAT TT=0.115 ASSIGNMENTS=8 CHECKS=8407	UNSAT TT=1.315	UNSAT TT=1.385
csp/composed-75-1-80/ normalized-composed-75-1-80-9_ext.xml	UNSAT TT=0.046	UNSAT TT=0.973 CHECKS=3562 NODES=5	UNSAT TT=0.944 CHECKS=10216 NODES=0	UNSAT TT=0.415	UNSAT TT=0.223 CHECKS=59283	UNSAT TT=0.075 CHECKS=3521	UNSAT TT=0.773 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=0.783 CHECKS=4457 NODES=24	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.063 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=0.061 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=1.337	UNSAT TT=1.398	UNSAT TT=0.052 ASSIGNMENTS=232 CHECKS=34355	UNSAT TT=0.199 ASSIGNMENTS=5068 CHECKS=949522	UNSAT TT=0.668	UNSAT TT=0.046 ASSIGNMENTS=115 CHECKS=22510	UNSAT TT=0.051 ASSIGNMENTS=150 CHECKS=23040	UNSAT TT=2.685	UNSAT TT=0.096 ASSIGNMENTS=8 CHECKS=7375	UNSAT TT=1.144	UNSAT TT=1.285
csp/driver/ normalized-driverlogw-01c-sat_ext.xml	SAT TT=0.01	SAT TT=0.771 CHECKS=1271 NODES=71	SAT TT=0.736 CHECKS=1242 NODES=0	SAT TT=0.047	SAT TT=0.018 CHECKS=4665	SAT TT=0.016 CHECKS=3190	SAT TT=0.509 ASSIGNMENTS=24	SAT TT=0.518 ASSIGNMENTS=24	SAT TT=0.378 CHECKS=733 NODES=71	SAT TT=0.412 CHECKS=3422 NODES=31	SAT TT=0.389 CHECKS=6207 NODES=19	SAT TT=0.023 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.023 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.998	SAT TT=1.01	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.011 ASSIGNMENTS=20 CHECKS=512	SAT TT=0.386	SAT TT=0.01 ASSIGNMENTS=23 CHECKS=460	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=535	SAT TT=0.844	SAT TT=0.019 ASSIGNMENTS=71 CHECKS=1442	SAT TT=0.699	SAT TT=0.688
csp/driver/ normalized-driverlogw-02c-sat_ext.xml	SAT TT=0.136	SAT TT=2.307 CHECKS=1742190 NODES=4000	SAT TT=3.196 CHECKS=2504230 NODES=4111	SAT TT=0.477	SAT TT=4.127 CHECKS=3171710	SAT TT=1.333 CHECKS=1153110	SAT TT=1.573 ASSIGNMENTS=65	SAT TT=1.774 ASSIGNMENTS=65	SAT TT=3.114 CHECKS=35400 NODES=423	SAT TT=5.566 CHECKS=9618040 NODES=59971	SAT TT=4.35 CHECKS=7845390 NODES=3763	SAT TT=0.139 ASSIGNMENTS=180 CHECKS=117043	SAT TT=0.142 ASSIGNMENTS=180 CHECKS=117043	SAT TT=2.919	SAT TT=3.028	SAT TT=0.143 ASSIGNMENTS=201 CHECKS=150798	SAT TT=0.781 ASSIGNMENTS=9610 CHECKS=2701420	SAT TT=1.352	SAT TT=0.447 ASSIGNMENTS=1308 CHECKS=1602120	SAT TT=0.136 ASSIGNMENTS=180 CHECKS=117043	SAT TT=3.679	SAT TT=0.897 ASSIGNMENTS=1248 CHECKS=609322	SAT TT=1.567	SAT TT=1.728
csp/driver/ normalized-driverlogw-04c-sat_ext.xml	SAT TT=0.118	SAT TT=1.635 CHECKS=420610 NODES=884	SAT TT=1.865 CHECKS=563609 NODES=627	SAT TT=0.52	? (TO) TT=1800.05	SAT TT=1.208 CHECKS=1017290	SAT TT=1.173 ASSIGNMENTS=31	SAT TT=1.18 ASSIGNMENTS=31	SAT TT=2.69 CHECKS=24260 NODES=292	SAT TT=2.716 CHECKS=479876 NODES=2435	SAT TT=2.669 CHECKS=851220 NODES=355	SAT TT=0.129 ASSIGNMENTS=95 CHECKS=64460	SAT TT=0.131 ASSIGNMENTS=95 CHECKS=64460	SAT TT=2.928	SAT TT=2.808	SAT TT=0.124 ASSIGNMENTS=97 CHECKS=66005	SAT TT=0.145 ASSIGNMENTS=458 CHECKS=150402	SAT TT=1.136	SAT TT=0.285 ASSIGNMENTS=591 CHECKS=754943	SAT TT=0.118 ASSIGNMENTS=95 CHECKS=64460	SAT TT=4.484	SAT TT=0.415 ASSIGNMENTS=539 CHECKS=390557	SAT TT=1.495	SAT TT=1.625
csp/driver/ normalized-driverlogw-05c-sat_ext.xml	SAT TT=0.174	SAT TT=1.939 CHECKS=517412 NODES=1333	SAT TT=1.71 CHECKS=216933 NODES=0	SAT TT=0.733	SAT TT=18.462 CHECKS=10742900	SAT TT=3.754 CHECKS=2207510	SAT TT=3.474 ASSIGNMENTS=95	SAT TT=3.633 ASSIGNMENTS=95	SAT TT=5.845 CHECKS=38628 NODES=378	SAT TT=8.709 CHECKS=10323200 NODES=41956	SAT TT=6 CHECKS=1051790 NODES=289	SAT TT=0.183 ASSIGNMENTS=74 CHECKS=59750	SAT TT=0.179 ASSIGNMENTS=74 CHECKS=59750	SAT TT=3.677	SAT TT=3.603	SAT TT=0.196 ASSIGNMENTS=117 CHECKS=133099	SAT TT=0.736 ASSIGNMENTS=5825 CHECKS=2512870	SAT TT=1.874	SAT TT=0.603 ASSIGNMENTS=873 CHECKS=1787770	SAT TT=0.174 ASSIGNMENTS=74 CHECKS=59750	SAT TT=4.455	SAT TT=0.927 ASSIGNMENTS=1279 CHECKS=418105	SAT TT=2.115	SAT TT=1.861
csp/driver/ normalized-driverlogw-08cc-sat_ext.xml	SAT TT=0.359	SAT TT=2.762 CHECKS=2027910 NODES=2613	SAT TT=3.832 CHECKS=4430730 NODES=2706	SAT TT=1.308	SAT TT=30.815 CHECKS=15004800	SAT TT=6.917 CHECKS=2820000	SAT TT=6.203 ASSIGNMENTS=76	SAT TT=6.139 ASSIGNMENTS=76	SAT TT=13.984 CHECKS=76029 NODES=489	SAT TT=17.597 CHECKS=13907500 NODES=47630	SAT TT=20.227 CHECKS=20735900 NODES=5463	SAT TT=0.365 ASSIGNMENTS=174 CHECKS=476259	SAT TT=0.367 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.484	SAT TT=4.615	SAT TT=0.53 ASSIGNMENTS=470 CHECKS=1122820	SAT TT=2.093 ASSIGNMENTS=9657 CHECKS=6612560	SAT TT=3.392	SAT TT=1.383 ASSIGNMENTS=1191 CHECKS=4009560	SAT TT=0.359 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.288	SAT TT=2.164 ASSIGNMENTS=1141 CHECKS=648302	SAT TT=2.208	SAT TT=2.282
csp/driver/ normalized-driverlogw-08c-sat_ext.xml	SAT TT=0.351	SAT TT=3.349 CHECKS=3976790 NODES=3591	SAT TT=4.645 CHECKS=5487000 NODES=3194	SAT TT=1.269	SAT TT=31.053 CHECKS=17547300	SAT TT=5.419 CHECKS=2209600	SAT TT=6.107 ASSIGNMENTS=76	SAT TT=6.154 ASSIGNMENTS=76	SAT TT=14.138 CHECKS=76056 NODES=489	SAT TT=57.988 CHECKS=134653000 NODES=490165	SAT TT=15.427 CHECKS=6441340 NODES=2234	SAT TT=0.366 ASSIGNMENTS=174 CHECKS=476259	SAT TT=0.363 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.097	SAT TT=4.959	SAT TT=0.516 ASSIGNMENTS=470 CHECKS=1122820	SAT TT=2.111 ASSIGNMENTS=9682 CHECKS=6424930	SAT TT=3.491	SAT TT=1.407 ASSIGNMENTS=1191 CHECKS=4009560	SAT TT=0.351 ASSIGNMENTS=174 CHECKS=476259	SAT TT=5.217	SAT TT=2.209 ASSIGNMENTS=1141 CHECKS=648251	SAT TT=2.264	SAT TT=2.23
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/driver/ normalized-driverlogw-09-sat_ext.xml	SAT TT=2.291	SAT TT=152.666 CHECKS=35571000 NODES=27204	SAT TT=143.575 CHECKS=33533600 NODES=23806	SAT TT=42.351	SAT TT=80.622 CHECKS=34515400	SAT TT=93.872 CHECKS=41022300	SAT TT=15.952 ASSIGNMENTS=345	SAT TT=17.887 ASSIGNMENTS=345	SAT TT=141.088 CHECKS=1964450 NODES=6371	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=34.14 ASSIGNMENTS=28499 CHECKS=36491500	SAT TT=37.224 ASSIGNMENTS=28499 CHECKS=36491500	SAT TT=10.527	SAT TT=9.623	SAT TT=2.291 ASSIGNMENTS=1581 CHECKS=5209070	SAT TT=7.406 ASSIGNMENTS=14916 CHECKS=17398700	SAT TT=8.216	SAT TT=6.433 ASSIGNMENTS=2328 CHECKS=14564800	SAT TT=2.975 ASSIGNMENTS=2280 CHECKS=6973980	SAT TT=6.641	SAT TT=39.181 ASSIGNMENTS=22420 CHECKS=20207800	SAT TT=3.539	SAT TT=3.934
csp/ehi-85/ normalized-ehi-85-297-27_ext.xml	UNSAT TT=0.117	UNSAT TT=2.884 CHECKS=3285910 NODES=3193	UNSAT TT=1.264 CHECKS=36905 NODES=0	UNSAT TT=0.476	UNSAT TT=2.05 CHECKS=266353	UNSAT TT=0.565 CHECKS=6912	UNSAT TT=1.141 ASSIGNMENTS=0	UNSAT TT=0.97 ASSIGNMENTS=0	UNSAT TT=3.067 CHECKS=7188 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.139 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=0.126 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.837	UNSAT TT=4.281	UNSAT TT=0.267 ASSIGNMENTS=275 CHECKS=649240	UNSAT TT=1.299 ASSIGNMENTS=2191 CHECKS=4715440	UNSAT TT=1.645	UNSAT TT=0.117 ASSIGNMENTS=5 CHECKS=9371	UNSAT TT=0.124 ASSIGNMENTS=40 CHECKS=53540	UNSAT TT=4.059	UNSAT TT=2.306 ASSIGNMENTS=3 CHECKS=6698	UNSAT TT=2.043	UNSAT TT=2.695
csp/ehi-85/ normalized-ehi-85-297-30_ext.xml	UNSAT TT=0.117	UNSAT TT=1.694 CHECKS=869721 NODES=638	UNSAT TT=1.386 CHECKS=89206 NODES=0	UNSAT TT=113.315	UNSAT TT=0.641 CHECKS=16582	UNSAT TT=0.568 CHECKS=9590	UNSAT TT=1.164 ASSIGNMENTS=0	UNSAT TT=1.176 ASSIGNMENTS=0	UNSAT TT=3.156 CHECKS=12777 NODES=6	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.159 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=0.172 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.979	UNSAT TT=3.92	UNSAT TT=0.321 ASSIGNMENTS=413 CHECKS=983353	UNSAT TT=0.984 ASSIGNMENTS=1687 CHECKS=3505690	UNSAT TT=1.519	UNSAT TT=0.117 ASSIGNMENTS=15 CHECKS=17557	UNSAT TT=0.155 ASSIGNMENTS=71 CHECKS=185987	UNSAT TT=4.023	UNSAT TT=1.506 ASSIGNMENTS=4 CHECKS=23638	UNSAT TT=2.236	UNSAT TT=2.24
csp/ehi-85/ normalized-ehi-85-297-55_ext.xml	UNSAT TT=0.113	UNSAT TT=2.441 CHECKS=2418180 NODES=2647	UNSAT TT=1.397 CHECKS=123287 NODES=0	UNSAT TT=174.964	UNSAT TT=1.756 CHECKS=218889	UNSAT TT=0.607 CHECKS=9329	UNSAT TT=1.167 ASSIGNMENTS=0	UNSAT TT=1.165 ASSIGNMENTS=0	UNSAT TT=2.813 CHECKS=6773 NODES=4	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.199 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=0.202 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.401	UNSAT TT=4.392	UNSAT TT=0.28 ASSIGNMENTS=361 CHECKS=712175	UNSAT TT=1.803 ASSIGNMENTS=3270 CHECKS=6926100	UNSAT TT=1.713	UNSAT TT=0.113 ASSIGNMENTS=8 CHECKS=13223	UNSAT TT=0.189 ASSIGNMENTS=149 CHECKS=319842	UNSAT TT=4.315	UNSAT TT=1.203 ASSIGNMENTS=4 CHECKS=13836	UNSAT TT=2.319	UNSAT TT=2.653
csp/ehi-85/ normalized-ehi-85-297-78_ext.xml	UNSAT TT=0.116	UNSAT TT=1.785 CHECKS=1322880 NODES=951	UNSAT TT=1.278 CHECKS=25156 NODES=0	UNSAT TT=0.481	UNSAT TT=0.684 CHECKS=20921	UNSAT TT=0.532 CHECKS=7925	UNSAT TT=0.916 ASSIGNMENTS=0	UNSAT TT=0.909 ASSIGNMENTS=0	UNSAT TT=2.747 CHECKS=9420 NODES=9	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.169 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=0.163 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=4.797	UNSAT TT=4.208	UNSAT TT=0.354 ASSIGNMENTS=357 CHECKS=998078	UNSAT TT=1.799 ASSIGNMENTS=3047 CHECKS=6753030	UNSAT TT=1.596	UNSAT TT=0.116 ASSIGNMENTS=5 CHECKS=10548	UNSAT TT=0.15 ASSIGNMENTS=99 CHECKS=168372	UNSAT TT=3.915	UNSAT TT=0.509 ASSIGNMENTS=4 CHECKS=13540	UNSAT TT=2.081	UNSAT TT=2.476
csp/ehi-85/ normalized-ehi-85-297-96_ext.xml	UNSAT TT=0.114	UNSAT TT=1.774 CHECKS=1016450 NODES=987	UNSAT TT=1.272 CHECKS=13771 NODES=0	UNSAT TT=0.488	UNSAT TT=0.655 CHECKS=15148	UNSAT TT=0.619 CHECKS=10155	UNSAT TT=1.06 ASSIGNMENTS=0	UNSAT TT=0.969 ASSIGNMENTS=0	UNSAT TT=2.785 CHECKS=7433 NODES=4	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.13 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=0.129 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=4.858	UNSAT TT=3.981	UNSAT TT=0.119 ASSIGNMENTS=4 CHECKS=8925	UNSAT TT=1.935 ASSIGNMENTS=3569 CHECKS=7550430	UNSAT TT=1.628	UNSAT TT=0.115 ASSIGNMENTS=9 CHECKS=14698	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=8886	UNSAT TT=3.896	UNSAT TT=0.8 ASSIGNMENTS=3 CHECKS=17099	UNSAT TT=2.054	UNSAT TT=2.501
csp/ehi-90/ normalized-ehi-90-315-51_ext.xml	UNSAT TT=0.121	UNSAT TT=2.365 CHECKS=2305600 NODES=2598	UNSAT TT=1.267 CHECKS=13957 NODES=0	UNSAT TT=0.477	UNSAT TT=0.657 CHECKS=15653	UNSAT TT=0.606 CHECKS=9327	UNSAT TT=0.904 ASSIGNMENTS=0	UNSAT TT=0.923 ASSIGNMENTS=0	UNSAT TT=3.124 CHECKS=8151 NODES=8	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.204 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=0.199 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.572	UNSAT TT=4.557	UNSAT TT=0.247 ASSIGNMENTS=298 CHECKS=607334	UNSAT TT=2.26 ASSIGNMENTS=3655 CHECKS=8660490	UNSAT TT=1.638	UNSAT TT=0.121 ASSIGNMENTS=4 CHECKS=10599	UNSAT TT=0.177 ASSIGNMENTS=136 CHECKS=288941	UNSAT TT=4.065	UNSAT TT=1.051 ASSIGNMENTS=5 CHECKS=14051	UNSAT TT=2.456	UNSAT TT=2.286
csp/ehi-90/ normalized-ehi-90-315-54_ext.xml	UNSAT TT=0.12	UNSAT TT=1.718 CHECKS=1007030 NODES=764	UNSAT TT=1.325 CHECKS=8062 NODES=0	UNSAT TT=0.506	UNSAT TT=0.647 CHECKS=15589	UNSAT TT=0.594 CHECKS=11232	UNSAT TT=0.947 ASSIGNMENTS=0	UNSAT TT=0.908 ASSIGNMENTS=0	UNSAT TT=3.004 CHECKS=5566 NODES=6	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.192 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=0.193 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=4.621	UNSAT TT=4.449	UNSAT TT=0.444 ASSIGNMENTS=534 CHECKS=1286630	UNSAT TT=1.884 ASSIGNMENTS=3315 CHECKS=7238890	UNSAT TT=1.466	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=9936	UNSAT TT=0.184 ASSIGNMENTS=136 CHECKS=317649	UNSAT TT=3.824	UNSAT TT=1.363 ASSIGNMENTS=17 CHECKS=40585	UNSAT TT=2.183	UNSAT TT=2.731
csp/ehi-90/ normalized-ehi-90-315-65_ext.xml	UNSAT TT=0.12	UNSAT TT=1.987 CHECKS=1482220 NODES=1255	UNSAT TT=1.306 CHECKS=16111 NODES=0	UNSAT TT=0.505	UNSAT TT=0.643 CHECKS=10958	UNSAT TT=0.564 CHECKS=8441	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=0.957 ASSIGNMENTS=0	UNSAT TT=3.205 CHECKS=7211 NODES=4	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.134 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=0.136 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=4.571	UNSAT TT=4.284	UNSAT TT=0.272 ASSIGNMENTS=277 CHECKS=622360	UNSAT TT=0.686 ASSIGNMENTS=1149 CHECKS=2491840	UNSAT TT=1.646	UNSAT TT=0.12 ASSIGNMENTS=5 CHECKS=10432	UNSAT TT=0.122 ASSIGNMENTS=4 CHECKS=10425	UNSAT TT=3.994	UNSAT TT=1.589 ASSIGNMENTS=4 CHECKS=15331	UNSAT TT=2.144	UNSAT TT=2.437
csp/ehi-90/ normalized-ehi-90-315-71_ext.xml	UNSAT TT=0.121	UNSAT TT=2.521 CHECKS=2640420 NODES=2648	UNSAT TT=1.259 CHECKS=11438 NODES=0	UNSAT TT=0.502	UNSAT TT=0.65 CHECKS=18297	UNSAT TT=0.552 CHECKS=8734	UNSAT TT=0.883 ASSIGNMENTS=0	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=3.071 CHECKS=5925 NODES=5	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.159 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=0.156 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.592	UNSAT TT=4.417	UNSAT TT=0.325 ASSIGNMENTS=327 CHECKS=913000	UNSAT TT=1.124 ASSIGNMENTS=1792 CHECKS=4009430	UNSAT TT=1.59	UNSAT TT=0.121 ASSIGNMENTS=5 CHECKS=10324	UNSAT TT=0.139 ASSIGNMENTS=53 CHECKS=108868	UNSAT TT=4.203	UNSAT TT=1.619 ASSIGNMENTS=5 CHECKS=16829	UNSAT TT=2.24	UNSAT TT=2.611
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ehi-90/ normalized-ehi-90-315-95_ext.xml	UNSAT TT=0.114	UNSAT TT=1.996 CHECKS=877654 NODES=1509	UNSAT TT=1.37 CHECKS=66886 NODES=0	UNSAT TT=34.105	UNSAT TT=0.61 CHECKS=15631	UNSAT TT=0.556 CHECKS=6983	UNSAT TT=0.879 ASSIGNMENTS=0	UNSAT TT=0.953 ASSIGNMENTS=0	UNSAT TT=3.118 CHECKS=6624 NODES=4	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.134 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=0.13 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=4.547	UNSAT TT=4.613	UNSAT TT=0.129 ASSIGNMENTS=71 CHECKS=41844	UNSAT TT=1.017 ASSIGNMENTS=1621 CHECKS=3669060	UNSAT TT=1.511	UNSAT TT=0.114 ASSIGNMENTS=4 CHECKS=9430	UNSAT TT=0.125 ASSIGNMENTS=23 CHECKS=18243	UNSAT TT=3.853	UNSAT TT=2.05 ASSIGNMENTS=3 CHECKS=8570	UNSAT TT=2.159	UNSAT TT=2.525
csp/frb30-15/ normalized-frb30-15-2_ext.xml	SAT TT=0.48	SAT TT=1.176 CHECKS=1297170 NODES=1277	SAT TT=1.227 CHECKS=1322770 NODES=1268	SAT TT=1.118	SAT TT=4.227 CHECKS=1528470	SAT TT=12.847 CHECKS=5075230	SAT TT=3.55 ASSIGNMENTS=4256	SAT TT=6.611 ASSIGNMENTS=4256	SAT TT=3.175 CHECKS=730474 NODES=9587	SAT TT=0.746 CHECKS=1117400 NODES=3869	? (TO) TT=1800.01	SAT TT=0.772 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=0.767 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=3.906	SAT TT=8.538	SAT TT=0.48 ASSIGNMENTS=5794 CHECKS=2176340	SAT TT=0.791 ASSIGNMENTS=10173 CHECKS=3325610	SAT TT=7.818	SAT TT=0.759 ASSIGNMENTS=8492 CHECKS=3243040	SAT TT=0.742 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=7.679	SAT TT=6.992 ASSIGNMENTS=3908 CHECKS=5281080	SAT TT=2.372	SAT TT=4.91
csp/frb30-15/ normalized-frb30-15-3_ext.xml	SAT TT=0.232	SAT TT=1.436 CHECKS=2200670 NODES=2076	SAT TT=1.374 CHECKS=2245180 NODES=2116	SAT TT=0.873	SAT TT=8.603 CHECKS=2986530	SAT TT=1.246 CHECKS=447432	SAT TT=3.11 ASSIGNMENTS=3205	SAT TT=2.925 ASSIGNMENTS=3205	SAT TT=1.391 CHECKS=255344 NODES=3153	SAT TT=0.847 CHECKS=1484340 NODES=5241	? (TO) TT=1800.01	SAT TT=0.618 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=0.611 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=3.224	SAT TT=3.781	SAT TT=0.251 ASSIGNMENTS=2502 CHECKS=981803	SAT TT=0.232 ASSIGNMENTS=3601 CHECKS=870854	SAT TT=2.914	SAT TT=0.564 ASSIGNMENTS=6040 CHECKS=2325810	SAT TT=0.55 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=10.667	SAT TT=1.787 ASSIGNMENTS=902 CHECKS=1402030	SAT TT=3.212	SAT TT=2.107
csp/frb30-15/ normalized-frb30-15-3-mgd_ext.xml	SAT TT=0.104	SAT TT=1.485 CHECKS=2050380 NODES=1974	SAT TT=1.56 CHECKS=2357120 NODES=2190	SAT TT=0.844	SAT TT=7.032 CHECKS=2593850	SAT TT=0.756 CHECKS=239356	SAT TT=2.013 ASSIGNMENTS=1872	SAT TT=2.193 ASSIGNMENTS=1872	SAT TT=0.625 CHECKS=20868 NODES=190	SAT TT=1.414 CHECKS=4458570 NODES=20899	? (TO) TT=1800.03	SAT TT=0.117 ASSIGNMENTS=946 CHECKS=358327	SAT TT=0.124 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.446	SAT TT=3.781	SAT TT=0.104 ASSIGNMENTS=829 CHECKS=311856	SAT TT=0.225 ASSIGNMENTS=3494 CHECKS=796360	SAT TT=1.298	SAT TT=0.124 ASSIGNMENTS=1188 CHECKS=412758	SAT TT=0.114 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.645	SAT TT=4.139 ASSIGNMENTS=2754 CHECKS=4194390	SAT TT=1.174	SAT TT=1.375
csp/frb30-15/ normalized-frb30-15-4_ext.xml	SAT TT=0.535	SAT TT=1.471 CHECKS=2149640 NODES=2044	SAT TT=1.476 CHECKS=2001490 NODES=1873	SAT TT=0.569	SAT TT=13.818 CHECKS=4880750	SAT TT=7.603 CHECKS=3098850	SAT TT=2.69 ASSIGNMENTS=3280	SAT TT=2.671 ASSIGNMENTS=3280	SAT TT=1.934 CHECKS=385312 NODES=4958	SAT TT=0.795 CHECKS=1387120 NODES=4912	SAT TT=1.094 CHECKS=2253980 NODES=4524	SAT TT=0.563 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=0.549 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=3.375	SAT TT=5.238	SAT TT=0.569 ASSIGNMENTS=6310 CHECKS=2346240	SAT TT=0.626 ASSIGNMENTS=8407 CHECKS=2575520	SAT TT=5.152	SAT TT=0.538 ASSIGNMENTS=6574 CHECKS=2432320	SAT TT=0.535 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=5.162	SAT TT=3.59 ASSIGNMENTS=1245 CHECKS=1766670	SAT TT=2.1	SAT TT=1.962
csp/frb30-15/ normalized-frb30-15-5-mgd_ext.xml	SAT TT=0.076	SAT TT=1.641 CHECKS=3631220 NODES=3306	SAT TT=1.642 CHECKS=3560470 NODES=3191	SAT TT=0.575	SAT TT=23.173 CHECKS=8382770	SAT TT=1.881 CHECKS=583739	SAT TT=1.315 ASSIGNMENTS=867	SAT TT=1.311 ASSIGNMENTS=867	SAT TT=1.028 CHECKS=159171 NODES=1547	SAT TT=0.951 CHECKS=2146380 NODES=10447	? (TO) TT=1800.03	SAT TT=0.086 ASSIGNMENTS=515 CHECKS=198122	SAT TT=0.087 ASSIGNMENTS=515 CHECKS=198122	SAT TT=2.669	SAT TT=2.176	SAT TT=0.167 ASSIGNMENTS=1652 CHECKS=656748	SAT TT=0.33 ASSIGNMENTS=4633 CHECKS=1235290	SAT TT=2.201	SAT TT=0.161 ASSIGNMENTS=1668 CHECKS=610834	SAT TT=0.076 ASSIGNMENTS=515 CHECKS=198122	SAT TT=4.008	SAT TT=1.455 ASSIGNMENTS=1473 CHECKS=2469010	SAT TT=1.161	SAT TT=1.591
csp/frb35-17/ normalized-frb35-17-1_ext.xml	SAT TT=1.414	SAT TT=4.267 CHECKS=17982000 NODES=13236	SAT TT=4.222 CHECKS=17404500 NODES=12846	SAT TT=1.711	SAT TT=20.617 CHECKS=6364460	SAT TT=10.276 CHECKS=3036390	SAT TT=5.716 ASSIGNMENTS=6144	SAT TT=5.852 ASSIGNMENTS=6144	SAT TT=5.297 CHECKS=1370210 NODES=14470	SAT TT=2.361 CHECKS=13076700 NODES=38829	? (TO) TT=1800.04	SAT TT=1.505 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=9.1 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=12.389	SAT TT=77.162	SAT TT=1.414 ASSIGNMENTS=13166 CHECKS=5972560	SAT TT=1.427 ASSIGNMENTS=14626 CHECKS=5926340	SAT TT=26.611	SAT TT=1.445 ASSIGNMENTS=13301 CHECKS=6010240	SAT TT=1.583 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=56.176	SAT TT=14.269 ASSIGNMENTS=7192 CHECKS=13335200	SAT TT=14.802	SAT TT=15.327
csp/frb35-17/ normalized-frb35-17-1-mgd_ext.xml	SAT TT=0.455	SAT TT=4.074 CHECKS=16945800 NODES=12506	SAT TT=4.231 CHECKS=17529200 NODES=12965	SAT TT=2.011	SAT TT=13.679 CHECKS=4191500	SAT TT=14.89 CHECKS=3985110	SAT TT=8.823 ASSIGNMENTS=9389	SAT TT=8.923 ASSIGNMENTS=9389	SAT TT=2.899 CHECKS=925837 NODES=7788	SAT TT=6.556 CHECKS=43404000 NODES=171674	? (TO) TT=1800.02	SAT TT=1.436 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=1.435 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=14.304	SAT TT=47.528	SAT TT=1.032 ASSIGNMENTS=9529 CHECKS=4391920	SAT TT=1.053 ASSIGNMENTS=10522 CHECKS=4107470	SAT TT=19.22	SAT TT=0.455 ASSIGNMENTS=3877 CHECKS=1665750	SAT TT=1.422 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=24.086	SAT TT=15.484 ASSIGNMENTS=12733 CHECKS=24512300	SAT TT=10.009	SAT TT=19.222
csp/frb35-17/ normalized-frb35-17-2_ext.xml	SAT TT=1.292	SAT TT=6.764 CHECKS=32619000 NODES=26172	SAT TT=7.012 CHECKS=30940000 NODES=24648	SAT TT=1.292	SAT TT=109.451 CHECKS=34546600	SAT TT=71.819 CHECKS=23712600	SAT TT=23.19 ASSIGNMENTS=30811	SAT TT=21.731 ASSIGNMENTS=30811	SAT TT=16.052 CHECKS=4642070 NODES=53894	SAT TT=32.967 CHECKS=239608000 NODES=719505	? (TO) TT=1800.08	SAT TT=9.625 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.263 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.045	SAT TT=122.021	SAT TT=6.453 ASSIGNMENTS=63528 CHECKS=27836600	SAT TT=1.626 ASSIGNMENTS=18543 CHECKS=7393470	SAT TT=119.057	SAT TT=1.646 ASSIGNMENTS=15967 CHECKS=6859800	SAT TT=2.796 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=217.797	SAT TT=41.848 ASSIGNMENTS=28391 CHECKS=45506800	SAT TT=22.863	SAT TT=4.26
csp/frb35-17/ normalized-frb35-17-2-mgd_ext.xml	SAT TT=1.04	SAT TT=7.054 CHECKS=31423100 NODES=25353	SAT TT=7.378 CHECKS=33449100 NODES=26916	SAT TT=1.206	SAT TT=144.091 CHECKS=44230300	SAT TT=95.396 CHECKS=24573400	SAT TT=14.69 ASSIGNMENTS=19103	SAT TT=14.864 ASSIGNMENTS=19103	SAT TT=12.415 CHECKS=4583950 NODES=43269	SAT TT=11.06 CHECKS=73984900 NODES=294981	? (TO) TT=1800.02	SAT TT=1.424 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=1.404 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=146.405	SAT TT=33.868	SAT TT=1.66 ASSIGNMENTS=15533 CHECKS=6716900	SAT TT=1.407 ASSIGNMENTS=15433 CHECKS=6100480	SAT TT=37.496	SAT TT=1.04 ASSIGNMENTS=9896 CHECKS=4141940	SAT TT=1.507 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=170.818	SAT TT=12.521 ASSIGNMENTS=10627 CHECKS=17243600	SAT TT=71.743	SAT TT=41.51
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb35-17/ normalized-frb35-17-5_ext.xml	SAT TT=0.369	SAT TT=17.705 CHECKS=89886200 NODES=68293	SAT TT=16.402 CHECKS=89154700 NODES=67925	SAT TT=5.24	SAT TT=22.799 CHECKS=7397240	SAT TT=107.386 CHECKS=35261300	SAT TT=22.693 ASSIGNMENTS=29214	SAT TT=23.09 ASSIGNMENTS=29214	SAT TT=12.484 CHECKS=3462450 NODES=38369	SAT TT=3.645 CHECKS=20069400 NODES=60271	? (TO) TT=1800.06	SAT TT=9.848 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=9.46 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=34.783	SAT TT=194.048	SAT TT=3.725 ASSIGNMENTS=35072 CHECKS=16211400	SAT TT=0.465 ASSIGNMENTS=5323 CHECKS=1795740	SAT TT=35.136	SAT TT=2.086 ASSIGNMENTS=19113 CHECKS=8798110	SAT TT=2.434 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=393.296	SAT TT=0.369 ASSIGNMENTS=224 CHECKS=269523	SAT TT=56.455	SAT TT=76.906
csp/frb40-19/ normalized-frb40-19-1_ext.xml	SAT TT=1.284	SAT TT=1.473 CHECKS=1486350 NODES=1112	SAT TT=1.284 CHECKS=1395190 NODES=997	SAT TT=9.429	SAT TT=444.893 CHECKS=113052000	SAT TT=476.993 CHECKS=135474000	SAT TT=28.796 ASSIGNMENTS=31770	SAT TT=29.867 ASSIGNMENTS=31770	SAT TT=29.909 CHECKS=8685270 NODES=81694	SAT TT=2.871 CHECKS=16974000 NODES=44106	? (TO) TT=1800.06	SAT TT=17.506 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=8.907 ASSIGNMENTS=1112 CHECKS=1486350	SAT TT=32.975	SAT TT=4.168	SAT TT=10.181 ASSIGNMENTS=81156 CHECKS=41923900	SAT TT=10.059 ASSIGNMENTS=81824 CHECKS=41651600	SAT TT=73.093	SAT TT=9.4 ASSIGNMENTS=78925 CHECKS=40697200	SAT TT=9.914 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=276.901	SAT TT=116.309 ASSIGNMENTS=50335 CHECKS=104712000	SAT TT=46.349	SAT TT=40.14
csp/frb40-19/ normalized-frb40-19-1-mgd_ext.xml	SAT TT=1.265	SAT TT=1.462 CHECKS=2543180 NODES=1893	SAT TT=1.265 CHECKS=1047030 NODES=744	SAT TT=9.971	SAT TT=703.803 CHECKS=189262000	SAT TT=29.645 CHECKS=5676960	SAT TT=29.123 ASSIGNMENTS=30271	SAT TT=29.503 ASSIGNMENTS=30271	SAT TT=15.225 CHECKS=5281000 NODES=40765	SAT TT=2.509 CHECKS=13794700 NODES=45990	? (TO) TT=1800.03	SAT TT=12.722 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=8.661 ASSIGNMENTS=1893 CHECKS=2543180	SAT TT=56.419	SAT TT=132.725	SAT TT=5.454 ASSIGNMENTS=43261 CHECKS=23091600	SAT TT=5.362 ASSIGNMENTS=41197 CHECKS=21070800	SAT TT=53.618	SAT TT=5.451 ASSIGNMENTS=43164 CHECKS=23027900	SAT TT=6.021 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=68.325	SAT TT=79.653 ASSIGNMENTS=49268 CHECKS=103013000	SAT TT=8.493	SAT TT=35.889
csp/frb40-19/ normalized-frb40-19-2_ext.xml	SAT TT=1.401	SAT TT=1.401 CHECKS=1968880 NODES=1491	SAT TT=1.492 CHECKS=2250610 NODES=1749	SAT TT=35.332	SAT TT=412.852 CHECKS=109540000	SAT TT=139.972 CHECKS=36091400	SAT TT=51.201 ASSIGNMENTS=62844	SAT TT=54.55 ASSIGNMENTS=62844	SAT TT=29.252 CHECKS=7789540 NODES=73522	SAT TT=51.095 CHECKS=365420000 NODES=951552	? (TO) TT=1800.04	SAT TT=22.778 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=9.219 ASSIGNMENTS=1491 CHECKS=1968880	SAT TT=67.686	SAT TT=383.43	SAT TT=14.262 ASSIGNMENTS=123409 CHECKS=63059400	SAT TT=8.142 ASSIGNMENTS=66182 CHECKS=33546700	SAT TT=108.797	SAT TT=9.856 ASSIGNMENTS=78210 CHECKS=40268900	SAT TT=15.19 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=333.918	SAT TT=168.113 ASSIGNMENTS=137602 CHECKS=273439000	SAT TT=80.349	SAT TT=194.22
csp/frb40-19/ normalized-frb40-19-2-mgd_ext.xml	SAT TT=1.833	SAT TT=2.053 CHECKS=4801120 NODES=3785	SAT TT=1.908 CHECKS=3823490 NODES=2909	SAT TT=11.158	SAT TT=344.771 CHECKS=88365000	SAT TT=161.67 CHECKS=32992300	SAT TT=16.038 ASSIGNMENTS=17329	SAT TT=17.402 ASSIGNMENTS=17329	SAT TT=24.206 CHECKS=8871590 NODES=69356	SAT TT=27.059 CHECKS=184894000 NODES=610905	? (TO) TT=1800	SAT TT=18.743 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=9.836 ASSIGNMENTS=3785 CHECKS=4801120	SAT TT=97.854	SAT TT=226.271	SAT TT=11.777 ASSIGNMENTS=88457 CHECKS=46753900	SAT TT=10.891 ASSIGNMENTS=89318 CHECKS=46667200	SAT TT=37.788	SAT TT=1.833 ASSIGNMENTS=14154 CHECKS=6941560	SAT TT=11.657 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=485.443	SAT TT=122.091 ASSIGNMENTS=48051 CHECKS=95391700	SAT TT=113.424	SAT TT=118.982
csp/frb40-19/ normalized-frb40-19-4-mgd_ext.xml	SAT TT=11.577	SAT TT=77.087 CHECKS=461083000 NODES=305197	SAT TT=80.622 CHECKS=451112000 NODES=297888	SAT TT=11.577	SAT TT=553.672 CHECKS=156444000	SAT TT=548.543 CHECKS=118406000	SAT TT=23.744 ASSIGNMENTS=24644	SAT TT=23.428 ASSIGNMENTS=24644	SAT TT=28.12 CHECKS=9476980 NODES=76187	SAT TT=21.197 CHECKS=152218000 NODES=494901	? (TO) TT=1800.01	SAT TT=33.728 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=84.116 ASSIGNMENTS=305197 CHECKS=461083000	SAT TT=1688.18	SAT TT=204.461	SAT TT=27.784 ASSIGNMENTS=213490 CHECKS=110685000	SAT TT=26.586 ASSIGNMENTS=201173 CHECKS=103774000	SAT TT=163.345	SAT TT=25.784 ASSIGNMENTS=196827 CHECKS=102505000	SAT TT=25.79 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=1395.18	SAT TT=306.9 ASSIGNMENTS=221577 CHECKS=455603000	SAT TT=183.355	SAT TT=192.929
csp/frb45-21/ normalized-frb45-21-1-mgd_ext.xml	SAT TT=6.494	SAT TT=6.494 CHECKS=30155700 NODES=19236	SAT TT=11.591 CHECKS=59132800 NODES=36674	SAT TT=850.839	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1393.89 ASSIGNMENTS=1528250	SAT TT=1419.21 ASSIGNMENTS=1528250	SAT TT=1445.67 CHECKS=453893000 NODES=3615300	SAT TT=76.666 CHECKS=591535000 NODES=1628720	? (TO) TT=1800.1	SAT TT=13.345 ASSIGNMENTS=19236 CHECKS=30155700	SAT TT=13.666 ASSIGNMENTS=19236 CHECKS=30155700	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=343.817 ASSIGNMENTS=2424200 CHECKS=1408590000	SAT TT=545.998 ASSIGNMENTS=3944080 CHECKS=2290690000	? (TO) TT=1800.12	SAT TT=732.982 ASSIGNMENTS=5262120 CHECKS=3087180000	SAT TT=726.1 ASSIGNMENTS=5272420 CHECKS=3090050000	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/frb45-21/ normalized-frb45-21-2_ext.xml	SAT TT=56.465	SAT TT=281.714 CHECKS=1630410000 NODES=992992	SAT TT=267.357 CHECKS=1643270000 NODES=1001220	SAT TT=162.023	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=364.334 ASSIGNMENTS=415146	SAT TT=370.812 ASSIGNMENTS=415146	SAT TT=62.15 CHECKS=15563400 NODES=143904	SAT TT=93.128 CHECKS=734694000 NODES=1675070	? (TO) TT=1800.05	SAT TT=287.579 ASSIGNMENTS=992992 CHECKS=1630410000	SAT TT=266.698 ASSIGNMENTS=992992 CHECKS=1630410000	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=157.098 ASSIGNMENTS=1136460 CHECKS=634265000	SAT TT=74.146 ASSIGNMENTS=539450 CHECKS=299255000	? (TO) TT=1800.11	SAT TT=175.98 ASSIGNMENTS=1258950 CHECKS=701831000	SAT TT=171.932 ASSIGNMENTS=1255070 CHECKS=699122000	? (TO) TT=1800.13	SAT TT=1622.18 ASSIGNMENTS=1446710 CHECKS=2843190000	SAT TT=56.465	SAT TT=754.475
csp/frb45-21/ normalized-frb45-21-3_ext.xml	SAT TT=148.506	SAT TT=181.416 CHECKS=1051930000 NODES=646600	SAT TT=174.114 CHECKS=1006020000 NODES=617234	SAT TT=148.506	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=487.654 ASSIGNMENTS=540035	SAT TT=491.026 ASSIGNMENTS=540035	SAT TT=1029.22 CHECKS=276126000 NODES=2527100	SAT TT=544.747 CHECKS=3873220000 NODES=8840730	? (TO) TT=1800.06	SAT TT=175.484 ASSIGNMENTS=646600 CHECKS=1051930000	SAT TT=175.45 ASSIGNMENTS=646600 CHECKS=1051930000	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=323.165 ASSIGNMENTS=2494740 CHECKS=1396940000	SAT TT=350.881 ASSIGNMENTS=2492820 CHECKS=1395820000	? (TO) TT=1800.1	SAT TT=371.761 ASSIGNMENTS=2688050 CHECKS=1496940000	SAT TT=306.679 ASSIGNMENTS=2298810 CHECKS=1279990000	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.04
csp/frb45-21/ normalized-frb45-21-4-mgd_ext.xml	SAT TT=33.995	SAT TT=464.625 CHECKS=2713320000 NODES=1581910	SAT TT=475.64 CHECKS=2712720000 NODES=1581220	SAT TT=212.315	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=468.567 ASSIGNMENTS=457995	SAT TT=456.294 ASSIGNMENTS=457995	SAT TT=258.271 CHECKS=86349900 NODES=637252	SAT TT=33.995 CHECKS=254471000 NODES=729987	? (TO) TT=1800.07	SAT TT=510.08 ASSIGNMENTS=740055 CHECKS=432669000	SAT TT=533.522 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=116.442 ASSIGNMENTS=813570 CHECKS=476930000	SAT TT=115.028 ASSIGNMENTS=809045 CHECKS=471841000	SAT TT=594.335	SAT TT=100.864 ASSIGNMENTS=703434 CHECKS=410663000	SAT TT=111.353 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.16	SAT TT=1410.35 ASSIGNMENTS=771186 CHECKS=1766350000	? (TO) TT=1800.14	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb45-21/ normalized-frb45-21-5_ext.xml	SAT TT=51.605	SAT TT=1205.42 CHECKS=7698180000 NODES=4608170	SAT TT=1192.99 CHECKS=7596680000 NODES=4566800	SAT TT=310.574	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=1417.99 ASSIGNMENTS=1634200	SAT TT=1379.45 ASSIGNMENTS=1634200	SAT TT=1715.49 CHECKS=447491000 NODES=4066110	SAT TT=1439.2 CHECKS=11194400000 NODES=25467000	? (TO) TT=1800.09	SAT TT=1217.77 ASSIGNMENTS=4608170 CHECKS=7698180000	SAT TT=616.419 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=146.384 ASSIGNMENTS=1131400 CHECKS=639110000	SAT TT=51.605 ASSIGNMENTS=395471 CHECKS=221508000	? (TO) TT=1800.06	SAT TT=228.028 ASSIGNMENTS=1635840 CHECKS=922834000	SAT TT=211.723 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	SAT TT=303.121 ASSIGNMENTS=134246 CHECKS=285696000	SAT TT=1169.44	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-1_ext.xml	SAT TT=146.492	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=146.492 CHECKS=1173860000 NODES=2373200	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=695.497 ASSIGNMENTS=4795790 CHECKS=2908190000	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/frb50-23/ normalized-frb50-23-2_ext.xml	SAT TT=723.997	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=723.997 CHECKS=5766420000 NODES=11594900	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/frb50-23/ normalized-frb50-23-3-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/frb50-23/ normalized-frb50-23-4_ext.xml	SAT TT=31.085	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.01	SAT TT=31.085 CHECKS=244381000 NODES=496298	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1092.62 ASSIGNMENTS=7048760 CHECKS=4249560000	SAT TT=1217.49 ASSIGNMENTS=8344290 CHECKS=837528000	? (TO) TT=1800.12	SAT TT=53.65 ASSIGNMENTS=352179 CHECKS=210349000	SAT TT=1013.87 ASSIGNMENTS=7063340 CHECKS=4262920000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-5-mgd_ext.xml	SAT TT=114.342	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=114.342 CHECKS=827626000 NODES=2125900	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=873.609 ASSIGNMENTS=5087140 CHECKS=3257300000	SAT TT=857.956 ASSIGNMENTS=5080320 CHECKS=3251550000	? (TO) TT=1800.09	SAT TT=497.023 ASSIGNMENTS=3112150 CHECKS=1970790000	SAT TT=892.124 ASSIGNMENTS=5637970 CHECKS=3604650000	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/frb53-24/ normalized-frb53-24-1_ext.xml	SAT TT=321.702	SAT TT=342.275 CHECKS=2177490000 NODES=1127960	SAT TT=321.702 CHECKS=2106410000 NODES=1085060	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=359.785 ASSIGNMENTS=1127960 CHECKS=2177490000	SAT TT=347.514 ASSIGNMENTS=1127960 CHECKS=2177490000	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/frb53-24/ normalized-frb53-24-2-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/frb53-24/ normalized-frb53-24-3-mgd_ext.xml	SAT TT=166.74	SAT TT=1232.69 CHECKS=7918130000 NODES=4090410	SAT TT=166.74 CHECKS=970369000 NODES=524253	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=483.531 CHECKS=3459900000 NODES=8210420	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/frb53-24/ normalized-frb53-24-5_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb53-24/ normalized-frb53-24-5-mgd_ext.xml	SAT TT=357.979	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=357.979 CHECKS=2528940000 NODES=5884320	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/frb56-25/ normalized-frb56-25-2_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-2-mgd_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/frb56-25/ normalized-frb56-25-4_ext.xml	SAT TT=1708.24	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT TT=1708.24 CHECKS=13675700000 NODES=24792100	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/frb56-25/ normalized-frb56-25-4-mgd_ext.xml	SAT TT=799.497	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=799.497 CHECKS=6301600000 NODES=13590800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-5-mgd_ext.xml	SAT TT=198.782	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=198.782 CHECKS=1553000000 NODES=3433000	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/frb59-26/ normalized-frb59-26-2_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/frb59-26/ normalized-frb59-26-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/frb59-26/ normalized-frb59-26-3-mgd_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15
csp/frb59-26/ normalized-frb59-26-4-mgd_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb59-26/ normalized-frb59-26-5-mgd_ext.xml	SAT TT=60.642	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=60.642 CHECKS=442901000 NODES=937734	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/geom/ normalized-geo50-20-d4-75-18_ext.xml	SAT TT=0.081	SAT TT=1.266 CHECKS=68641 NODES=97	SAT TT=0.991 CHECKS=89174 NODES=58	SAT TT=1.231	SAT TT=0.483 CHECKS=48545	SAT TT=0.278 CHECKS=17437	SAT TT=1.107 ASSIGNMENTS=62	SAT TT=1.113 ASSIGNMENTS=62	SAT TT=0.913 CHECKS=36939 NODES=234	SAT TT=0.782 CHECKS=218585 NODES=474	SAT TT=1.368 CHECKS=4832670 NODES=7293	SAT TT=0.094 ASSIGNMENTS=110 CHECKS=53835	SAT TT=0.095 ASSIGNMENTS=110 CHECKS=53835	SAT TT=4.098	SAT TT=3.394	SAT TT=0.081 ASSIGNMENTS=103 CHECKS=48110	SAT TT=0.435 ASSIGNMENTS=4975 CHECKS=1398780	SAT TT=2.128	SAT TT=0.148 ASSIGNMENTS=1125 CHECKS=357505	SAT TT=0.081 ASSIGNMENTS=110 CHECKS=53835	SAT TT=3.515	SAT TT=0.257 ASSIGNMENTS=62 CHECKS=80140	SAT TT=1.734	SAT TT=1.899
csp/geom/ normalized-geo50-20-d4-75-40_ext.xml	SAT TT=0.057	SAT TT=0.963 CHECKS=17947 NODES=54	SAT TT=0.99 CHECKS=53787 NODES=52	SAT TT=1.025	SAT TT=0.274 CHECKS=12365	SAT TT=0.184 CHECKS=2024	SAT TT=0.831 ASSIGNMENTS=31	SAT TT=0.807 ASSIGNMENTS=31	SAT TT=0.746 CHECKS=10454 NODES=69	SAT TT=0.737 CHECKS=65689 NODES=100	SAT TT=0.929 CHECKS=114498 NODES=138	SAT TT=0.073 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.072 ASSIGNMENTS=33 CHECKS=4305	SAT TT=3.298	SAT TT=3.113	SAT TT=0.057 ASSIGNMENTS=33 CHECKS=4305	SAT TT=0.061 ASSIGNMENTS=21 CHECKS=3718	SAT TT=0.989	SAT TT=0.066 ASSIGNMENTS=104 CHECKS=26390	SAT TT=0.061 ASSIGNMENTS=33 CHECKS=4305	SAT TT=2.387	SAT TT=0.15 ASSIGNMENTS=50 CHECKS=44682	SAT TT=1.542	SAT TT=1.782
csp/geom/ normalized-geo50-20-d4-75-42_ext.xml	SAT TT=0.067	SAT TT=0.937 CHECKS=18396 NODES=50	SAT TT=1.045 CHECKS=63541 NODES=50	SAT TT=1.196	SAT TT=0.313 CHECKS=21426	SAT TT=0.21 CHECKS=5152	SAT TT=1.038 ASSIGNMENTS=31	SAT TT=0.885 ASSIGNMENTS=31	SAT TT=0.964 CHECKS=15810 NODES=99	SAT TT=0.812 CHECKS=95424 NODES=183	SAT TT=0.806 CHECKS=95470 NODES=99	SAT TT=0.079 ASSIGNMENTS=42 CHECKS=9017	SAT TT=0.074 ASSIGNMENTS=42 CHECKS=9017	SAT TT=3.75	SAT TT=2.91	SAT TT=0.069 ASSIGNMENTS=42 CHECKS=9434	SAT TT=0.268 ASSIGNMENTS=4339 CHECKS=874003	SAT TT=0.852	SAT TT=0.126 ASSIGNMENTS=1144 CHECKS=281803	SAT TT=0.067 ASSIGNMENTS=42 CHECKS=9017	SAT TT=2.667	SAT TT=0.16 ASSIGNMENTS=100 CHECKS=72018	SAT TT=1.825	SAT TT=1.819
csp/geom/ normalized-geo50-20-d4-75-45_ext.xml	SAT TT=0.069	SAT TT=1.077 CHECKS=628215 NODES=487	SAT TT=1.173 CHECKS=108918 NODES=81	SAT TT=1.185	SAT TT=1.094 CHECKS=191078	SAT TT=0.331 CHECKS=29852	SAT TT=0.943 ASSIGNMENTS=185	SAT TT=1.024 ASSIGNMENTS=185	SAT TT=1.002 CHECKS=65734 NODES=557	SAT TT=0.788 CHECKS=359377 NODES=822	SAT TT=0.808 CHECKS=185624 NODES=287	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=0.083 ASSIGNMENTS=106 CHECKS=32570	SAT TT=3.53	SAT TT=7.458	SAT TT=0.079 ASSIGNMENTS=222 CHECKS=79863	SAT TT=0.315 ASSIGNMENTS=4708 CHECKS=1024100	SAT TT=1.187	SAT TT=0.16 ASSIGNMENTS=1395 CHECKS=421629	SAT TT=0.069 ASSIGNMENTS=106 CHECKS=32570	SAT TT=4.51	SAT TT=0.233 ASSIGNMENTS=82 CHECKS=126800	SAT TT=1.655	SAT TT=2.206
csp/geom/ normalized-geo50-20-d4-75-49_ext.xml	SAT TT=0.07	SAT TT=0.963 CHECKS=56150 NODES=83	SAT TT=1.049 CHECKS=124721 NODES=91	SAT TT=1.269	SAT TT=0.389 CHECKS=28976	SAT TT=0.225 CHECKS=5981	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.85 ASSIGNMENTS=54	SAT TT=0.865 CHECKS=37777 NODES=338	SAT TT=1.193 CHECKS=3438000 NODES=9335	SAT TT=0.802 CHECKS=347199 NODES=553	SAT TT=0.082 ASSIGNMENTS=69 CHECKS=21485	SAT TT=0.086 ASSIGNMENTS=69 CHECKS=21485	SAT TT=3.919	SAT TT=3.486	SAT TT=0.07 ASSIGNMENTS=64 CHECKS=18153	SAT TT=0.325 ASSIGNMENTS=4391 CHECKS=1032260	SAT TT=1.383	SAT TT=0.13 ASSIGNMENTS=1125 CHECKS=308038	SAT TT=0.075 ASSIGNMENTS=69 CHECKS=21485	SAT TT=2.886	SAT TT=0.283 ASSIGNMENTS=55 CHECKS=54416	SAT TT=1.879	SAT TT=1.897
csp/geom/ normalized-geo50-20-d4-75-5_ext.xml	SAT TT=0.065	SAT TT=0.966 CHECKS=21864 NODES=57	SAT TT=0.972 CHECKS=93282 NODES=72	SAT TT=1.096	SAT TT=0.37 CHECKS=37136	SAT TT=0.218 CHECKS=10452	SAT TT=0.883 ASSIGNMENTS=75	SAT TT=1.109 ASSIGNMENTS=75	SAT TT=0.759 CHECKS=13455 NODES=98	SAT TT=0.76 CHECKS=391035 NODES=1032	SAT TT=0.724 CHECKS=92963 NODES=114	SAT TT=0.081 ASSIGNMENTS=117 CHECKS=29885	SAT TT=0.079 ASSIGNMENTS=117 CHECKS=29885	SAT TT=3.19	SAT TT=3.185	SAT TT=0.065 ASSIGNMENTS=99 CHECKS=23863	SAT TT=0.181 ASSIGNMENTS=2871 CHECKS=457140	SAT TT=0.996	SAT TT=0.117 ASSIGNMENTS=1133 CHECKS=240310	SAT TT=0.066 ASSIGNMENTS=117 CHECKS=29885	SAT TT=2.937	SAT TT=0.197 ASSIGNMENTS=88 CHECKS=83049	SAT TT=1.821	SAT TT=1.739
csp/geom/ normalized-geo50-20-d4-75-61_ext.xml	SAT TT=0.061	SAT TT=0.954 CHECKS=38010 NODES=91	SAT TT=1.03 CHECKS=97739 NODES=92	SAT TT=1.047	SAT TT=0.324 CHECKS=26359	SAT TT=0.202 CHECKS=5972	SAT TT=1.039 ASSIGNMENTS=44	SAT TT=0.865 ASSIGNMENTS=44	SAT TT=0.789 CHECKS=11221 NODES=76	SAT TT=0.784 CHECKS=176540 NODES=412	SAT TT=0.778 CHECKS=345412 NODES=608	SAT TT=0.075 ASSIGNMENTS=47 CHECKS=11763	SAT TT=0.074 ASSIGNMENTS=47 CHECKS=11763	SAT TT=3.453	SAT TT=2.81	SAT TT=0.066 ASSIGNMENTS=47 CHECKS=12102	SAT TT=0.216 ASSIGNMENTS=3897 CHECKS=652392	SAT TT=1.02	SAT TT=0.075 ASSIGNMENTS=374 CHECKS=97387	SAT TT=0.061 ASSIGNMENTS=47 CHECKS=11763	SAT TT=2.625	SAT TT=0.169 ASSIGNMENTS=87 CHECKS=98809	SAT TT=1.852	SAT TT=2.043
csp/geom/ normalized-geo50-20-d4-75-76_ext.xml	SAT TT=0.055	SAT TT=0.955 CHECKS=15975 NODES=50	SAT TT=0.927 CHECKS=50973 NODES=50	SAT TT=1.057	SAT TT=0.274 CHECKS=13171	SAT TT=0.18 CHECKS=2113	SAT TT=0.831 ASSIGNMENTS=35	SAT TT=0.841 ASSIGNMENTS=35	SAT TT=0.889 CHECKS=10428 NODES=79	SAT TT=0.722 CHECKS=73141 NODES=138	SAT TT=0.773 CHECKS=67642 NODES=73	SAT TT=0.072 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.071 ASSIGNMENTS=32 CHECKS=3782	SAT TT=3.385	SAT TT=2.817	SAT TT=0.061 ASSIGNMENTS=32 CHECKS=3782	SAT TT=0.061 ASSIGNMENTS=29 CHECKS=4008	SAT TT=0.797	SAT TT=0.062 ASSIGNMENTS=183 CHECKS=29602	SAT TT=0.055 ASSIGNMENTS=32 CHECKS=3782	SAT TT=2.373	SAT TT=0.151 ASSIGNMENTS=53 CHECKS=46198	SAT TT=1.599	SAT TT=1.922
csp/geom/ normalized-geo50-20-d4-75-94_ext.xml	UNSAT TT=33.347	UNSAT TT=117.775 CHECKS=760436000 NODES=317038	UNSAT TT=117.55 CHECKS=758397000 NODES=316376	UNSAT TT=207.383	UNSAT TT=931.035 CHECKS=182508000	UNSAT TT=396.495 CHECKS=77508800	UNSAT TT=125.408 ASSIGNMENTS=100194	UNSAT TT=125.617 ASSIGNMENTS=100194	UNSAT TT=98.615 CHECKS=27324700 NODES=201897	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=118.475 ASSIGNMENTS=317038 CHECKS=760436000	UNSAT TT=116.389 ASSIGNMENTS=317038 CHECKS=760436000	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=33.347 ASSIGNMENTS=196882 CHECKS=133720000	UNSAT TT=33.477 ASSIGNMENTS=198475 CHECKS=134262000	UNSAT TT=1354.74	UNSAT TT=33.612 ASSIGNMENTS=197273 CHECKS=133647000	UNSAT TT=33.943 ASSIGNMENTS=200233 CHECKS=136053000	? (TO) TT=1800.2	UNSAT TT=573.984 ASSIGNMENTS=210104 CHECKS=748427000	? (TO) TT=1800.05	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/geom/ normalized-geo50-20-d4-75-9_ext.xml	SAT TT=0.299	SAT TT=1.17 CHECKS=302609 NODES=244	SAT TT=1.26 CHECKS=432669 NODES=267	SAT TT=3.934	SAT TT=13.154 CHECKS=2891450	SAT TT=6.423 CHECKS=1253930	SAT TT=7.53 ASSIGNMENTS=6872	SAT TT=8.305 ASSIGNMENTS=6872	SAT TT=2.806 CHECKS=634910 NODES=4999	SAT TT=1.545 CHECKS=5144880 NODES=13132	? (TO) TT=1800.07	SAT TT=0.773 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=0.822 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=10.023	SAT TT=20.472	SAT TT=1.008 ASSIGNMENTS=7007 CHECKS=3885630	SAT TT=1.772 ASSIGNMENTS=14132 CHECKS=6607620	SAT TT=20.917	SAT TT=0.299 ASSIGNMENTS=2109 CHECKS=947107	SAT TT=0.811 ASSIGNMENTS=5119 CHECKS=2820590	SAT TT=3.138	SAT TT=0.672 ASSIGNMENTS=58 CHECKS=82264	SAT TT=1.897	SAT TT=6.247
csp/hanoi/ normalized-hanoi-3_ext.xml	SAT TT=0.006	SAT TT=0.611 CHECKS=164 NODES=6	SAT TT=0.593 CHECKS=164 NODES=0	SAT TT=0.027	SAT TT=0.006 CHECKS=17	SAT TT=0.009 CHECKS=17	SAT TT=0.327 ASSIGNMENTS=1	SAT TT=0.338 ASSIGNMENTS=1	SAT TT=0.284 CHECKS=145 NODES=6	SAT TT=0.273 CHECKS=165 NODES=0	SAT TT=0.275 CHECKS=165 NODES=0	SAT TT=0.02 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.017 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.962	SAT TT=0.837	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.269	SAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.006 ASSIGNMENTS=0 CHECKS=16	SAT TT=0.702	SAT TT=0.01 ASSIGNMENTS=7 CHECKS=835	SAT TT=0.462	SAT TT=0.482
csp/hanoi/ normalized-hanoi-4_ext.xml	SAT TT=0.007	SAT TT=0.619 CHECKS=2211 NODES=14	SAT TT=0.618 CHECKS=2210 NODES=0	SAT TT=0.032	SAT TT=0.018 CHECKS=49	SAT TT=0.019 CHECKS=49	SAT TT=0.37 ASSIGNMENTS=1	SAT TT=0.365 ASSIGNMENTS=1	SAT TT=0.329 CHECKS=2970 NODES=14	SAT TT=0.305 CHECKS=3157 NODES=0	SAT TT=0.305 CHECKS=3157 NODES=0	SAT TT=0.021 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.018 ASSIGNMENTS=0 CHECKS=48	SAT TT=1.742	SAT TT=1.673	SAT TT=0.008 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.301	SAT TT=0.007 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.008 ASSIGNMENTS=0 CHECKS=48	SAT TT=0.973	SAT TT=0.009 ASSIGNMENTS=14 CHECKS=13167	SAT TT=0.733	SAT TT=0.618
csp/hanoi/ normalized-hanoi-5_ext.xml	SAT TT=0.009	SAT TT=0.673 CHECKS=30105 NODES=30	SAT TT=1.231 CHECKS=30105 NODES=0	SAT TT=0.066	SAT TT=0.208 CHECKS=113	SAT TT=0.215 CHECKS=113	SAT TT=0.578 ASSIGNMENTS=1	SAT TT=0.571 ASSIGNMENTS=1	SAT TT=0.754 CHECKS=55621 NODES=30	SAT TT=0.372 CHECKS=58513 NODES=0	SAT TT=0.39 CHECKS=58513 NODES=0	SAT TT=0.021 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.019 ASSIGNMENTS=0 CHECKS=112	SAT TT=19.202	SAT TT=14.622	SAT TT=0.01 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.011 ASSIGNMENTS=0 CHECKS=112	? (problem) TT=0.443	SAT TT=0.009 ASSIGNMENTS=0 CHECKS=112	SAT TT=0.009 ASSIGNMENTS=0 CHECKS=112	SAT TT=1.543	SAT TT=0.101 ASSIGNMENTS=31 CHECKS=528638	SAT TT=1.397	SAT TT=1.684
csp/hanoi/ normalized-hanoi-6_ext.xml	SAT TT=0.041	SAT TT=0.868 CHECKS=570583 NODES=62	SAT TT=0.732 CHECKS=570583 NODES=0	SAT TT=0.356	SAT TT=5.463 CHECKS=241	SAT TT=5.519 CHECKS=241	SAT TT=3.422 ASSIGNMENTS=1	SAT TT=3.392 ASSIGNMENTS=1	SAT TT=5.704 CHECKS=1045260 NODES=62	SAT TT=0.533 CHECKS=1096760 NODES=0	SAT TT=0.55 CHECKS=1096760 NODES=0	SAT TT=0.062 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.058 ASSIGNMENTS=0 CHECKS=240	SAT TT=274.011	SAT TT=271.254	SAT TT=0.046 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.041 ASSIGNMENTS=0 CHECKS=240	? (problem) TT=1.33	SAT TT=0.048 ASSIGNMENTS=0 CHECKS=240	SAT TT=0.044 ASSIGNMENTS=0 CHECKS=240	SAT TT=4.14	SAT TT=0.925 ASSIGNMENTS=62 CHECKS=5075380	SAT TT=17.11	SAT TT=16.641
csp/hanoi/ normalized-hanoi-7_ext.xml	SAT TT=0.391	SAT TT=1.042 CHECKS=10427700 NODES=126	SAT TT=1.09 CHECKS=10427700 NODES=126	SAT TT=5.435	SAT TT=203.012 CHECKS=497	SAT TT=203.165 CHECKS=497	SAT TT=55.823 ASSIGNMENTS=1	SAT TT=55.218 ASSIGNMENTS=1	SAT TT=60.605 CHECKS=19969000 NODES=126	SAT TT=1.075 CHECKS=20567700 NODES=0	SAT TT=1.117 CHECKS=20567700 NODES=0	SAT TT=0.409 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.442 ASSIGNMENTS=0 CHECKS=496	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.425 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.391 ASSIGNMENTS=0 CHECKS=496	? (problem) TT=5.34	SAT TT=0.407 ASSIGNMENTS=0 CHECKS=496	SAT TT=0.425 ASSIGNMENTS=0 CHECKS=496	SAT TT=28.386	SAT TT=30.896 ASSIGNMENTS=127 CHECKS=185321000	SAT TT=475.201	SAT TT=368.853
csp/langford/ normalized-langford-2-4-ext.xml	SAT TT=0.005	SAT TT=0.669 CHECKS=242 NODES=8	SAT TT=0.704 CHECKS=242 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=3422	SAT TT=0.011 CHECKS=2609	SAT TT=0.395 ASSIGNMENTS=2	SAT TT=0.412 ASSIGNMENTS=2	SAT TT=0.315 CHECKS=270 NODES=10	SAT TT=0.324 CHECKS=2762 NODES=55	SAT TT=0.325 CHECKS=32159 NODES=349	SAT TT=0.017 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.809	SAT TT=0.812	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=192	SAT TT=0.274	SAT TT=0.005 ASSIGNMENTS=2 CHECKS=226	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=200	SAT TT=0.715	SAT TT=0.009 ASSIGNMENTS=10 CHECKS=1024	SAT TT=0.503	SAT TT=0.499
csp/langford/ normalized-langford-3-11-ext.xml	UNSAT TT=1.162	UNSAT TT=7.291 CHECKS=10053800 NODES=34361	UNSAT TT=7.19 CHECKS=10075500 NODES=34337	UNSAT TT=2.278	UNSAT TT=77.72 CHECKS=38638200	UNSAT TT=83.566 CHECKS=60527400	UNSAT TT=2.831 ASSIGNMENTS=4009	UNSAT TT=5.009 ASSIGNMENTS=7542	UNSAT TT=9.355 CHECKS=3182420 NODES=19411	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=1.203 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=1.214 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=13.894	UNSAT TT=11.687	UNSAT TT=1.174 ASSIGNMENTS=8211 CHECKS=7306140	UNSAT TT=1.602 ASSIGNMENTS=11454 CHECKS=10053200	UNSAT TT=128.27	UNSAT TT=1.162 ASSIGNMENTS=8504 CHECKS=7670600	UNSAT TT=1.168 ASSIGNMENTS=8266 CHECKS=7322500	UNSAT TT=38.073	UNSAT TT=37.46 ASSIGNMENTS=38939 CHECKS=51069000	UNSAT TT=10.274	UNSAT TT=12.742
csp/langford/ normalized-langford-3-9-ext.xml	SAT TT=0.019	SAT TT=0.954 CHECKS=123859 NODES=438	SAT TT=0.977 CHECKS=140446 NODES=432	SAT TT=0.088	SAT TT=1.919 CHECKS=1011290	SAT TT=0.121 CHECKS=61258	SAT TT=0.808 ASSIGNMENTS=47	SAT TT=0.815 ASSIGNMENTS=93	SAT TT=0.555 CHECKS=5001 NODES=32	SAT TT=0.784 CHECKS=1932420 NODES=4662	? (TO) TT=1800.03	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=81976	SAT TT=0.039 ASSIGNMENTS=110 CHECKS=81976	SAT TT=1.94	SAT TT=1.838	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=81548	SAT TT=0.019 ASSIGNMENTS=21 CHECKS=14078	SAT TT=0.61	SAT TT=0.048 ASSIGNMENTS=249 CHECKS=236445	SAT TT=0.028 ASSIGNMENTS=110 CHECKS=81976	SAT TT=1.696	SAT TT=0.144 ASSIGNMENTS=47 CHECKS=59638	SAT TT=1.102	SAT TT=1.25
csp/langford/ normalized-slangford-3-11-ext.xml	UNSAT TT=1.246	UNSAT TT=7.164 CHECKS=10089200 NODES=34311	UNSAT TT=7.188 CHECKS=10107900 NODES=34344	UNSAT TT=2.366	UNSAT TT=291.228 CHECKS=132919000	UNSAT TT=89.689 CHECKS=48258100	UNSAT TT=3.31 ASSIGNMENTS=4019	UNSAT TT=6.048 ASSIGNMENTS=7542	UNSAT TT=9.424 CHECKS=3191300 NODES=19411	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=1.36 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=1.246 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=13.656	UNSAT TT=19.671	UNSAT TT=1.345 ASSIGNMENTS=8273 CHECKS=7820000	UNSAT TT=1.852 ASSIGNMENTS=11450 CHECKS=10681500	UNSAT TT=145.631	UNSAT TT=1.397 ASSIGNMENTS=8465 CHECKS=8144540	UNSAT TT=1.31 ASSIGNMENTS=8213 CHECKS=7771110	UNSAT TT=37.618	UNSAT TT=41.949 ASSIGNMENTS=50339 CHECKS=65965600	UNSAT TT=11.155	UNSAT TT=14.969
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/lard/ normalized-lard-83-83.xml	SAT TT=10.523	SAT TT=15.563 CHECKS=628603 NODES=83	SAT TT=16.663 CHECKS=609336 NODES=0	? (problem) TT=295.569	? TT=25.698	? TT=23.439	SAT TT=16.305 ASSIGNMENTS=84	SAT TT=16.005 ASSIGNMENTS=84	SAT TT=53.668 CHECKS=297801 NODES=83	SAT TT=49.869 CHECKS=598266 NODES=4	SAT TT=52.744 CHECKS=615327 NODES=5	SAT TT=11.635 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.774 ASSIGNMENTS=83 CHECKS=13842	? (problem) TT=133.439	? (problem) TT=133.725	SAT TT=11.564 ASSIGNMENTS=83 CHECKS=13842	SAT TT=11.227 ASSIGNMENTS=83 CHECKS=14089	? (exit code) TT=29.978	SAT TT=11.446 ASSIGNMENTS=83 CHECKS=20092	SAT TT=10.523 ASSIGNMENTS=83 CHECKS=13842	SAT TT=56.082	SAT TT=32.246 ASSIGNMENTS=83 CHECKS=432750	? (MO) TT=25.38	? (MO) TT=24.65
csp/lard/ normalized-lard-84-84.xml	SAT TT=11.147	SAT TT=16.266 CHECKS=642809 NODES=84	SAT TT=16.113 CHECKS=609986 NODES=0	? (problem) TT=309.616	? TT=24.217	? TT=27.203	SAT TT=15.315 ASSIGNMENTS=85	SAT TT=15.726 ASSIGNMENTS=85	SAT TT=56.9 CHECKS=305592 NODES=84	SAT TT=51.775 CHECKS=599734 NODES=0	SAT TT=51.145 CHECKS=599734 NODES=0	SAT TT=12.337 ASSIGNMENTS=84 CHECKS=14093	SAT TT=12.203 ASSIGNMENTS=84 CHECKS=14093	? (problem) TT=172.57	? (problem) TT=196.036	SAT TT=12.085 ASSIGNMENTS=84 CHECKS=14093	SAT TT=11.985 ASSIGNMENTS=84 CHECKS=14706	? (exit code) TT=27.739	SAT TT=11.147 ASSIGNMENTS=61 CHECKS=14025	SAT TT=12.077 ASSIGNMENTS=84 CHECKS=14093	SAT TT=53.751	SAT TT=34.263 ASSIGNMENTS=84 CHECKS=436939	? (MO) TT=25.881	? (MO) TT=27.097
csp/lard/ normalized-lard-85-85.xml	SAT TT=11.518	SAT TT=16.662 CHECKS=671476 NODES=85	SAT TT=16.891 CHECKS=655479 NODES=0	? (problem) TT=325.392	? TT=26.619	? TT=30.397	SAT TT=16.562 ASSIGNMENTS=86	SAT TT=16.287 ASSIGNMENTS=86	SAT TT=58.273 CHECKS=319416 NODES=85	SAT TT=54.862 CHECKS=641534 NODES=4	SAT TT=58.984 CHECKS=652287 NODES=4	SAT TT=12.516 ASSIGNMENTS=85 CHECKS=14456	SAT TT=12.479 ASSIGNMENTS=85 CHECKS=14456	? (problem) TT=299.59	? (problem) TT=280.807	SAT TT=12.13 ASSIGNMENTS=85 CHECKS=14456	SAT TT=11.725 ASSIGNMENTS=85 CHECKS=14842	? (exit code) TT=30.806	SAT TT=11.518 ASSIGNMENTS=85 CHECKS=21086	SAT TT=12.839 ASSIGNMENTS=85 CHECKS=14456	SAT TT=59.26	SAT TT=33.244 ASSIGNMENTS=85 CHECKS=589557	? (MO) TT=26.741	? (MO) TT=26.135
csp/lard/ normalized-lard-86-86.xml	SAT TT=12.162	SAT TT=18.713 CHECKS=640681 NODES=86	SAT TT=17.579 CHECKS=599048 NODES=0	? (problem) TT=351.267	? TT=28.277	? TT=27.203	SAT TT=17.375 ASSIGNMENTS=87	SAT TT=17.191 ASSIGNMENTS=87	SAT TT=59.538 CHECKS=327592 NODES=86	SAT TT=56.426 CHECKS=643685 NODES=0	SAT TT=60.952 CHECKS=650920 NODES=1	SAT TT=12.25 ASSIGNMENTS=86 CHECKS=14846	SAT TT=13.362 ASSIGNMENTS=86 CHECKS=14846	? (problem) TT=314.993	? (problem) TT=316.768	SAT TT=13.188 ASSIGNMENTS=86 CHECKS=14846	SAT TT=12.3 ASSIGNMENTS=86 CHECKS=15512	? (exit code) TT=30.537	SAT TT=12.785 ASSIGNMENTS=56 CHECKS=14703	SAT TT=12.162 ASSIGNMENTS=86 CHECKS=14846	SAT TT=60.622	SAT TT=34.721 ASSIGNMENTS=86 CHECKS=470679	? (MO) TT=26.17	? (MO) TT=28.9
csp/lard/ normalized-lard-87-87.xml	SAT TT=12.728	SAT TT=18.288 CHECKS=725372 NODES=87	SAT TT=20.009 CHECKS=706304 NODES=0	? (problem) TT=363.089	? (TO) TT=24.566	Signal TT=25.396	SAT TT=22.495 ASSIGNMENTS=88	SAT TT=21.307 ASSIGNMENTS=88	SAT TT=67.48 CHECKS=342220 NODES=87	SAT TT=58.472 CHECKS=672515 NODES=0	SAT TT=59.423 CHECKS=672458 NODES=0	SAT TT=13.384 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.451 ASSIGNMENTS=87 CHECKS=15174	? (problem) TT=289.819	? (problem) TT=301.382	SAT TT=12.728 ASSIGNMENTS=87 CHECKS=15174	SAT TT=13.484 ASSIGNMENTS=87 CHECKS=15464	? (exit code) TT=31.218	SAT TT=13.774 ASSIGNMENTS=87 CHECKS=22104	SAT TT=13.504 ASSIGNMENTS=87 CHECKS=15174	SAT TT=61.736	SAT TT=36.457 ASSIGNMENTS=87 CHECKS=632744	? (MO) TT=27.135	? (MO) TT=28.132
csp/lard/ normalized-lard-88-88.xml	SAT TT=13.17	SAT TT=20.038 CHECKS=670262 NODES=88	SAT TT=20.452 CHECKS=627361 NODES=0	? (problem) TT=367.094	Signal TT=23.602	Signal TT=22.94	SAT TT=26.012 ASSIGNMENTS=89	SAT TT=24.133 ASSIGNMENTS=89	SAT TT=66.564 CHECKS=349356 NODES=88	SAT TT=64.168 CHECKS=687981 NODES=0	SAT TT=62.006 CHECKS=687981 NODES=0	SAT TT=13.299 ASSIGNMENTS=88 CHECKS=15562	SAT TT=13.17 ASSIGNMENTS=88 CHECKS=15562	? (problem) TT=571.502	? (problem) TT=633.913	SAT TT=13.184 ASSIGNMENTS=88 CHECKS=15562	SAT TT=14.142 ASSIGNMENTS=88 CHECKS=16235	? (exit code) TT=50.31	SAT TT=14.175 ASSIGNMENTS=50 CHECKS=15397	SAT TT=14.101 ASSIGNMENTS=88 CHECKS=15562	SAT TT=63.815	SAT TT=38.139 ASSIGNMENTS=88 CHECKS=646732	? (MO) TT=31.88	? (MO) TT=30.05
csp/lard/ normalized-lard-89-89.xml	SAT TT=13.695	SAT TT=19.59 CHECKS=775225 NODES=89	SAT TT=21.185 CHECKS=747565 NODES=0	? (problem) TT=388.757	Signal TT=118.981	Signal TT=20.862	SAT TT=40.868 ASSIGNMENTS=90	SAT TT=38.386 ASSIGNMENTS=90	SAT TT=73.607 CHECKS=366451 NODES=89	SAT TT=66.924 CHECKS=720327 NODES=0	SAT TT=65.288 CHECKS=735912 NODES=2	SAT TT=14.679 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.695 ASSIGNMENTS=89 CHECKS=15958	? (problem) TT=400.038	? (problem) TT=339.473	SAT TT=14.659 ASSIGNMENTS=89 CHECKS=15958	SAT TT=13.753 ASSIGNMENTS=89 CHECKS=16680	? (exit code) TT=48.914	SAT TT=14.864 ASSIGNMENTS=89 CHECKS=23146	SAT TT=14.354 ASSIGNMENTS=89 CHECKS=15958	SAT TT=68.565	SAT TT=44.124 ASSIGNMENTS=89 CHECKS=533554	? (MO) TT=30.274	? (MO) TT=31.06
csp/lard/ normalized-lard-90-90.xml	SAT TT=14.5	SAT TT=21.226 CHECKS=780902 NODES=90	SAT TT=20.989 CHECKS=748192 NODES=0	? (problem) TT=406.213	Signal TT=20.87	Signal TT=21.99	? (problem) TT=43.908	? (problem) TT=44.657	SAT TT=73.008 CHECKS=375270 NODES=90	SAT TT=70.671 CHECKS=737295 NODES=0	SAT TT=71.24 CHECKS=737265 NODES=0	SAT TT=16.186 ASSIGNMENTS=90 CHECKS=16212	SAT TT=16.174 ASSIGNMENTS=90 CHECKS=16212	? (problem) TT=333.485	? (problem) TT=359.541	SAT TT=15.742 ASSIGNMENTS=90 CHECKS=16212	SAT TT=14.983 ASSIGNMENTS=90 CHECKS=16676	? (exit code) TT=76.738	SAT TT=15.814 ASSIGNMENTS=54 CHECKS=16107	SAT TT=14.5 ASSIGNMENTS=90 CHECKS=16212	SAT TT=74.997	SAT TT=42.119 ASSIGNMENTS=90 CHECKS=546118	? TT=125.776	? (MO) TT=29.433
csp/lard/ normalized-lard-91-91.xml	SAT TT=15.352	SAT TT=23.42 CHECKS=829260 NODES=91	SAT TT=21.496 CHECKS=805112 NODES=0	? (problem) TT=425.316	? TT=13.181	? TT=12.196	? (problem) TT=48.88	? (problem) TT=51.644	SAT TT=77.897 CHECKS=391143 NODES=91	SAT TT=69.713 CHECKS=769107 NODES=0	SAT TT=71.294 CHECKS=769107 NODES=0	SAT TT=15.352 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.702 ASSIGNMENTS=91 CHECKS=16615	? (problem) TT=345.317	? (problem) TT=370.751	SAT TT=15.489 ASSIGNMENTS=91 CHECKS=16615	SAT TT=16.587 ASSIGNMENTS=91 CHECKS=17157	? (exit code) TT=44.852	SAT TT=16.54 ASSIGNMENTS=91 CHECKS=24212	SAT TT=16.6 ASSIGNMENTS=91 CHECKS=16615	? TT=133.401	SAT TT=44.893 ASSIGNMENTS=91 CHECKS=725354	? (MO) TT=30.84	? (MO) TT=32.53
csp/lard/ normalized-lard-92-92.xml	SAT TT=16.101	SAT TT=24.186 CHECKS=752761 NODES=92	SAT TT=22.337 CHECKS=695792 NODES=0	? (problem) TT=438.335	? TT=12.767	? TT=13.947	? (problem) TT=43.914	? (problem) TT=48.391	SAT TT=77.563 CHECKS=400632 NODES=92	SAT TT=78.28 CHECKS=787960 NODES=0	SAT TT=73.802 CHECKS=796293 NODES=1	SAT TT=16.359 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.107 ASSIGNMENTS=92 CHECKS=17048	? (problem) TT=290.549	? (problem) TT=298.832	SAT TT=17.147 ASSIGNMENTS=92 CHECKS=17048	SAT TT=17.444 ASSIGNMENTS=92 CHECKS=18138	? (exit code) TT=58.912	SAT TT=16.101 ASSIGNMENTS=53 CHECKS=16833	SAT TT=16.936 ASSIGNMENTS=92 CHECKS=17048	? TT=131.126	SAT TT=48.858 ASSIGNMENTS=92 CHECKS=575005	? (MO) TT=34.66	? (MO) TT=33.33
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/marc/ normalized-large-80-sat_ext.xml	SAT TT=9.085	SAT TT=11.884 CHECKS=34612 NODES=80	SAT TT=12.754 CHECKS=34612 NODES=0	? (problem) TT=276.855	SAT TT=16.323 CHECKS=4953	SAT TT=16.346 CHECKS=4953	SAT TT=13.289 ASSIGNMENTS=1	SAT TT=13.658 ASSIGNMENTS=1	SAT TT=49.399 CHECKS=35136 NODES=80	SAT TT=45.328 CHECKS=51592 NODES=0	SAT TT=46.868 CHECKS=51592 NODES=0	SAT TT=9.711 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.86 ASSIGNMENTS=0 CHECKS=9401	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=9.735 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.708 ASSIGNMENTS=0 CHECKS=9401	? (exit code) TT=69.884	SAT TT=9.085 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.568 ASSIGNMENTS=0 CHECKS=9401	SAT TT=45.187	SAT TT=26.696 ASSIGNMENTS=80 CHECKS=31232	? (MO) TT=24.37	? (MO) TT=23.46
csp/marc/ normalized-large-80-unsat_ext.xml	UNSAT TT=7.233	UNSAT TT=10.136 CHECKS=1146780 NODES=79	UNSAT TT=10.2 CHECKS=1181720 NODES=0	? (problem) TT=213.208	UNSAT TT=72.162 CHECKS=60976	UNSAT TT=51.007 CHECKS=40620	UNSAT TT=13.099 ASSIGNMENTS=1	UNSAT TT=12.609 ASSIGNMENTS=1	UNSAT TT=39.552 CHECKS=1281460 NODES=128	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=7.784 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=7.831 ASSIGNMENTS=123 CHECKS=22876	? (TO) TT=1800.06	UNSAT TT=317.066	UNSAT TT=7.233 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=8.737 ASSIGNMENTS=3028 CHECKS=486042	? (exit code) TT=30.115	UNSAT TT=7.637 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=7.699 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=37.149	UNSAT TT=22.689 ASSIGNMENTS=80 CHECKS=910185	? (MO) TT=21.34	? (MO) TT=20.36
csp/marc/ normalized-large-84-sat_ext.xml	SAT TT=11.008	SAT TT=15.023 CHECKS=49944 NODES=84	SAT TT=15.211 CHECKS=49944 NODES=0	? (problem) TT=329.025	SAT TT=16.189 CHECKS=5532	SAT TT=16.754 CHECKS=5532	SAT TT=15.886 ASSIGNMENTS=1	SAT TT=15.036 ASSIGNMENTS=1	SAT TT=55.895 CHECKS=87803 NODES=84	SAT TT=55.453 CHECKS=109463 NODES=0	SAT TT=50.726 CHECKS=109463 NODES=0	SAT TT=11.008 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.797 ASSIGNMENTS=0 CHECKS=10375	? (problem) TT=185.134	? (problem) TT=177.841	SAT TT=11.858 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.798 ASSIGNMENTS=0 CHECKS=10375	? (exit code) TT=29.635	SAT TT=11.841 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.67 ASSIGNMENTS=0 CHECKS=10375	SAT TT=50.11	SAT TT=35.453 ASSIGNMENTS=85 CHECKS=35028	? (MO) TT=26.8	? (MO) TT=26.84
csp/marc/ normalized-large-84-unsat_ext.xml	UNSAT TT=8.963	UNSAT TT=13.002 CHECKS=1239080 NODES=82	UNSAT TT=13.188 CHECKS=1413230 NODES=0	? (problem) TT=253.355	UNSAT TT=100.677 CHECKS=73853	UNSAT TT=59.284 CHECKS=41942	UNSAT TT=14.614 ASSIGNMENTS=1	UNSAT TT=16.017 ASSIGNMENTS=1	UNSAT TT=50.34 CHECKS=1375600 NODES=123	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=8.963 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=9.176 ASSIGNMENTS=130 CHECKS=25612	? (problem) TT=130.743	? (problem) TT=129.726	UNSAT TT=9.53 ASSIGNMENTS=83 CHECKS=17431	UNSAT TT=10.376 ASSIGNMENTS=3034 CHECKS=512771	? (exit code) TT=32.224	UNSAT TT=9.585 ASSIGNMENTS=83 CHECKS=17680	UNSAT TT=9.564 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=47.734	UNSAT TT=28.634 ASSIGNMENTS=84 CHECKS=1041690	? (MO) TT=22.545	? (MO) TT=22.72
csp/marc/ normalized-large-88-sat_ext.xml	SAT TT=13.162	SAT TT=18.295 CHECKS=41489 NODES=88	SAT TT=16.523 CHECKS=41489 NODES=0	? (problem) TT=369.383	SAT TT=18.862 CHECKS=5939	SAT TT=16.931 CHECKS=5939	SAT TT=26.639 ASSIGNMENTS=1	SAT TT=27.684 ASSIGNMENTS=1	SAT TT=69.672 CHECKS=79561 NODES=88	SAT TT=66.237 CHECKS=99998 NODES=0	SAT TT=66.47 CHECKS=99998 NODES=0	SAT TT=14.165 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.211 ASSIGNMENTS=0 CHECKS=11397	? (problem) TT=296.501	? (problem) TT=322.321	SAT TT=14.173 ASSIGNMENTS=0 CHECKS=11397	SAT TT=13.162 ASSIGNMENTS=0 CHECKS=11397	? (exit code) TT=109.609	SAT TT=14.912 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.06 ASSIGNMENTS=0 CHECKS=11397	SAT TT=58.956	SAT TT=41.011 ASSIGNMENTS=88 CHECKS=34037	? (MO) TT=28.16	? (MO) TT=30.202
csp/marc/ normalized-large-88-unsat_ext.xml	UNSAT TT=10.484	UNSAT TT=13.885 CHECKS=1349870 NODES=81	UNSAT TT=14.046 CHECKS=1645020 NODES=0	? (problem) TT=297.964	Signal TT=18.626	Signal TT=19.431	UNSAT TT=18.222 ASSIGNMENTS=1	UNSAT TT=17.078 ASSIGNMENTS=1	UNSAT TT=57.322 CHECKS=1716860 NODES=141	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=11.379 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=11.282 ASSIGNMENTS=136 CHECKS=27629	? (problem) TT=114.674	? (problem) TT=115.175	UNSAT TT=10.554 ASSIGNMENTS=87 CHECKS=19402	UNSAT TT=13.092 ASSIGNMENTS=3041 CHECKS=538448	? (exit code) TT=27.745	UNSAT TT=10.484 ASSIGNMENTS=87 CHECKS=19315	UNSAT TT=11.159 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=52.226	UNSAT TT=32.681 ASSIGNMENTS=88 CHECKS=1220360	? TT=161.374	? (MO) TT=25.038
csp/marc/ normalized-large-92-sat_ext.xml	SAT TT=15.846	SAT TT=19.524 CHECKS=51620 NODES=92	SAT TT=21.425 CHECKS=51620 NODES=0	? (problem) TT=468.339	? TT=13.722	? TT=12.909	? (problem) TT=40.885	? (problem) TT=40.01	SAT TT=84.206 CHECKS=56908 NODES=92	SAT TT=79.75 CHECKS=79336 NODES=0	SAT TT=77.373 CHECKS=79336 NODES=0	SAT TT=17.712 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.23 ASSIGNMENTS=0 CHECKS=12467	? (problem) TT=314.918	? (problem) TT=307.074	SAT TT=16.034 ASSIGNMENTS=0 CHECKS=12467	SAT TT=16.092 ASSIGNMENTS=0 CHECKS=12467	? (exit code) TT=37.853	SAT TT=15.846 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.156 ASSIGNMENTS=0 CHECKS=12467	SAT TT=70.487	SAT TT=49.051 ASSIGNMENTS=92 CHECKS=58017	? (MO) TT=34.28	? (MO) TT=34.32
csp/marc/ normalized-large-92-unsat_ext.xml	UNSAT TT=12.586	UNSAT TT=16.578 CHECKS=1691770 NODES=91	UNSAT TT=16.317 CHECKS=1909970 NODES=0	? (problem) TT=348.758	Signal TT=21.23	Signal TT=21.084	UNSAT TT=22.33 ASSIGNMENTS=1	UNSAT TT=24.072 ASSIGNMENTS=1	UNSAT TT=62.843 CHECKS=1952880 NODES=147	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=13.831 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=13.655 ASSIGNMENTS=142 CHECKS=30355	? (problem) TT=319.299	? (problem) TT=318.085	UNSAT TT=12.797 ASSIGNMENTS=91 CHECKS=21022	UNSAT TT=15.677 ASSIGNMENTS=3042 CHECKS=561984	? (exit code) TT=34.357	UNSAT TT=12.586 ASSIGNMENTS=91 CHECKS=20840	UNSAT TT=13.624 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=63.759	UNSAT TT=38.773 ASSIGNMENTS=92 CHECKS=1376540	? (MO) TT=28.36	? (MO) TT=26.926
csp/marc/ normalized-large-96-sat_ext.xml	SAT TT=18.77	SAT TT=25.172 CHECKS=62678 NODES=96	SAT TT=22.67 CHECKS=62678 NODES=0	? (problem) TT=543.195	? TT=15.68	? TT=15.561	? (problem) TT=38.47	? (problem) TT=40.999	SAT TT=103.741 CHECKS=48181 NODES=96	SAT TT=94.933 CHECKS=72297 NODES=0	SAT TT=97.055 CHECKS=72297 NODES=0	SAT TT=20.426 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	? (problem) TT=298.973	? (problem) TT=301.079	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.455 ASSIGNMENTS=0 CHECKS=13585	? (exit code) TT=115.378	SAT TT=21.135 ASSIGNMENTS=0 CHECKS=13585	SAT TT=18.77 ASSIGNMENTS=0 CHECKS=13585	SAT TT=113.776	SAT TT=54.726 ASSIGNMENTS=103 CHECKS=67904	? (MO) TT=39.3	? (MO) TT=36.89
csp/marc/ normalized-large-96-unsat_ext.xml	UNSAT TT=15.143	UNSAT TT=20.664 CHECKS=1934710 NODES=95	UNSAT TT=20.578 CHECKS=2215540 NODES=0	? (problem) TT=426.432	? TT=12.262	? TT=13.04	? (problem) TT=42.723	? (problem) TT=43.281	UNSAT TT=82.913 CHECKS=2209300 NODES=153	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=16.876 ASSIGNMENTS=149 CHECKS=33400	UNSAT TT=16.488 ASSIGNMENTS=149 CHECKS=33400	? (problem) TT=308.015	? (problem) TT=325.828	UNSAT TT=15.889 ASSIGNMENTS=95 CHECKS=23086	UNSAT TT=17.307 ASSIGNMENTS=3052 CHECKS=587597	? (exit code) TT=44.863	UNSAT TT=16.057 ASSIGNMENTS=95 CHECKS=22991	UNSAT TT=15.143 ASSIGNMENTS=149 CHECKS=33400	? TT=119.82	UNSAT TT=46.805 ASSIGNMENTS=95 CHECKS=1561180	? TT=183.309	? (MO) TT=32.531
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-0_ext.xml	SAT TT=0.022	SAT TT=0.958 CHECKS=7709 NODES=100	SAT TT=0.964 CHECKS=14349 NODES=100	SAT TT=0.108	SAT TT=0.063 CHECKS=17902	SAT TT=0.043 CHECKS=3991	SAT TT=0.978 ASSIGNMENTS=26	SAT TT=0.993 ASSIGNMENTS=21	SAT TT=0.632 CHECKS=5307 NODES=105	SAT TT=0.672 CHECKS=18803 NODES=77	SAT TT=0.815 CHECKS=120657 NODES=310	SAT TT=0.036 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.589	SAT TT=1.817	SAT TT=0.025 ASSIGNMENTS=29 CHECKS=2452	SAT TT=0.029 ASSIGNMENTS=167 CHECKS=19795	SAT TT=1.092	SAT TT=0.03 ASSIGNMENTS=226 CHECKS=24850	SAT TT=0.022 ASSIGNMENTS=29 CHECKS=2452	SAT TT=1.252	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44647	SAT TT=1.096	SAT TT=1.043
csp/QCP-10/ normalized-qcp-10-67-10_ext.xml	UNSAT TT=0.037	UNSAT TT=1.002 CHECKS=21618 NODES=288	UNSAT TT=0.929 CHECKS=7971 NODES=0	UNSAT TT=91.664	UNSAT TT=0.152 CHECKS=91803	UNSAT TT=0.074 CHECKS=28058	UNSAT TT=0.621 ASSIGNMENTS=0	UNSAT TT=0.838 ASSIGNMENTS=0	UNSAT TT=0.736 CHECKS=14126 NODES=480	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=8.065 ASSIGNMENTS=0	UNSAT TT=14.353 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.013	UNSAT TT=1.125	UNSAT TT=0.037 ASSIGNMENTS=495 CHECKS=50804	UNSAT TT=0.166 ASSIGNMENTS=4988 CHECKS=539894	UNSAT TT=0.8	UNSAT TT=0.047 ASSIGNMENTS=851 CHECKS=92584	UNSAT TT=6.781 ASSIGNMENTS=211005 CHECKS=24446600	UNSAT TT=1.574	UNSAT TT=0.314 ASSIGNMENTS=1562 CHECKS=722588	UNSAT TT=1.143	UNSAT TT=1.355
csp/QCP-10/ normalized-qcp-10-67-11_ext.xml	UNSAT TT=0.042	UNSAT TT=1.068 CHECKS=82024 NODES=963	UNSAT TT=1.104 CHECKS=76300 NODES=767	UNSAT TT=109.178	UNSAT TT=0.076 CHECKS=25866	UNSAT TT=0.048 CHECKS=6571	UNSAT TT=0.604 ASSIGNMENTS=0	UNSAT TT=0.615 ASSIGNMENTS=0	UNSAT TT=0.694 CHECKS=6518 NODES=114	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.075 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=0.076 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.235	UNSAT TT=1.134	UNSAT TT=0.051 ASSIGNMENTS=1016 CHECKS=116613	UNSAT TT=0.165 ASSIGNMENTS=5200 CHECKS=481072	UNSAT TT=0.693	UNSAT TT=0.042 ASSIGNMENTS=732 CHECKS=72292	UNSAT TT=0.061 ASSIGNMENTS=1280 CHECKS=144558	UNSAT TT=1.431	UNSAT TT=0.569 ASSIGNMENTS=2806 CHECKS=1125400	UNSAT TT=0.987	UNSAT TT=1.331
csp/QCP-10/ normalized-qcp-10-67-12_ext.xml	UNSAT TT=0.025	UNSAT TT=0.887 CHECKS=3245 NODES=0	UNSAT TT=0.882 CHECKS=3245 NODES=0	UNSAT TT=46.229	UNSAT TT=0.098 CHECKS=45697	UNSAT TT=0.05 CHECKS=11019	UNSAT TT=0.834 ASSIGNMENTS=0	UNSAT TT=0.702 ASSIGNMENTS=0	UNSAT TT=0.636 CHECKS=4630 NODES=40	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.041 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.038 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=0.979	UNSAT TT=0.907	UNSAT TT=0.025 ASSIGNMENTS=150 CHECKS=14109	UNSAT TT=0.147 ASSIGNMENTS=4484 CHECKS=474271	UNSAT TT=0.808	UNSAT TT=0.032 ASSIGNMENTS=315 CHECKS=32076	UNSAT TT=0.028 ASSIGNMENTS=147 CHECKS=14002	UNSAT TT=1.796	UNSAT TT=0.08 ASSIGNMENTS=98 CHECKS=56023	UNSAT TT=0.916	UNSAT TT=1.006
csp/QCP-10/ normalized-qcp-10-67-13_ext.xml	UNSAT TT=0.022	UNSAT TT=1.005 CHECKS=3248 NODES=0	UNSAT TT=0.906 CHECKS=3248 NODES=0	UNSAT TT=0.101	UNSAT TT=0.057 CHECKS=12384	UNSAT TT=0.042 CHECKS=6609	UNSAT TT=0.81 ASSIGNMENTS=0	UNSAT TT=0.622 ASSIGNMENTS=0	UNSAT TT=0.632 CHECKS=5626 NODES=60	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.977	UNSAT TT=0.996	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.675	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.307	UNSAT TT=0.059 ASSIGNMENTS=47 CHECKS=41092	UNSAT TT=1.089	UNSAT TT=1.201
csp/QCP-10/ normalized-qcp-10-67-14_ext.xml	UNSAT TT=0.022	UNSAT TT=0.867 CHECKS=3258 NODES=0	UNSAT TT=1.036 CHECKS=3258 NODES=0	UNSAT TT=2.759	UNSAT TT=0.072 CHECKS=24253	UNSAT TT=0.045 CHECKS=5870	UNSAT TT=0.609 ASSIGNMENTS=0	UNSAT TT=0.66 ASSIGNMENTS=0	UNSAT TT=0.617 CHECKS=4349 NODES=28	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.036 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.035 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=0.999	UNSAT TT=1.131	UNSAT TT=0.024 ASSIGNMENTS=27 CHECKS=3048	UNSAT TT=0.144 ASSIGNMENTS=4599 CHECKS=407591	UNSAT TT=0.674	UNSAT TT=0.029 ASSIGNMENTS=276 CHECKS=26418	UNSAT TT=0.022 ASSIGNMENTS=21 CHECKS=2508	UNSAT TT=1.395	UNSAT TT=0.061 ASSIGNMENTS=62 CHECKS=46069	UNSAT TT=0.938	UNSAT TT=1.027
csp/QCP-10/ normalized-qcp-10-67-1_ext.xml	SAT TT=0.024	SAT TT=0.962 CHECKS=7966 NODES=102	SAT TT=0.915 CHECKS=7867 NODES=0	SAT TT=0.11	SAT TT=0.061 CHECKS=14587	SAT TT=0.041 CHECKS=3386	SAT TT=1.095 ASSIGNMENTS=25	SAT TT=1.038 ASSIGNMENTS=19	SAT TT=0.665 CHECKS=5261 NODES=103	SAT TT=0.687 CHECKS=23009 NODES=140	SAT TT=0.677 CHECKS=77767 NODES=135	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.036 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.598	SAT TT=1.71	SAT TT=0.025 ASSIGNMENTS=24 CHECKS=2354	SAT TT=0.028 ASSIGNMENTS=105 CHECKS=12586	SAT TT=0.667	SAT TT=0.027 ASSIGNMENTS=72 CHECKS=7360	SAT TT=0.024 ASSIGNMENTS=24 CHECKS=2354	SAT TT=1.247	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44400	SAT TT=1.14	SAT TT=1.481
csp/QCP-10/ normalized-qcp-10-67-2_ext.xml	SAT TT=0.023	SAT TT=0.963 CHECKS=7583 NODES=100	SAT TT=0.914 CHECKS=7702 NODES=0	SAT TT=0.109	SAT TT=0.06 CHECKS=14122	SAT TT=0.039 CHECKS=3327	SAT TT=1.065 ASSIGNMENTS=18	SAT TT=1.17 ASSIGNMENTS=16	SAT TT=0.777 CHECKS=5314 NODES=106	SAT TT=0.683 CHECKS=31100 NODES=288	SAT TT=0.686 CHECKS=105791 NODES=233	SAT TT=0.037 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.035 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.581	SAT TT=1.62	SAT TT=0.023 ASSIGNMENTS=25 CHECKS=2237	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=11280	SAT TT=0.707	SAT TT=0.025 ASSIGNMENTS=49 CHECKS=4932	SAT TT=0.025 ASSIGNMENTS=25 CHECKS=2237	SAT TT=1.322	SAT TT=0.064 ASSIGNMENTS=101 CHECKS=45899	SAT TT=1.285	SAT TT=1.162
csp/QCP-10/ normalized-qcp-10-67-3_ext.xml	SAT TT=0.025	SAT TT=0.967 CHECKS=7774 NODES=102	SAT TT=1.002 CHECKS=14811 NODES=113	SAT TT=0.106	SAT TT=0.06 CHECKS=15199	SAT TT=0.041 CHECKS=3064	SAT TT=0.988 ASSIGNMENTS=23	SAT TT=1.052 ASSIGNMENTS=22	SAT TT=0.63 CHECKS=5453 NODES=109	SAT TT=0.799 CHECKS=27085 NODES=224	SAT TT=0.682 CHECKS=120121 NODES=252	SAT TT=0.037 ASSIGNMENTS=118 CHECKS=12066	SAT TT=0.038 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.581	SAT TT=1.619	SAT TT=0.025 ASSIGNMENTS=68 CHECKS=7250	SAT TT=0.032 ASSIGNMENTS=294 CHECKS=30048	SAT TT=0.873	SAT TT=0.028 ASSIGNMENTS=172 CHECKS=18039	SAT TT=0.026 ASSIGNMENTS=118 CHECKS=12066	SAT TT=1.407	SAT TT=0.062 ASSIGNMENTS=100 CHECKS=44652	SAT TT=1.108	SAT TT=1.033
csp/QCP-10/ normalized-qcp-10-67-4_ext.xml	SAT TT=0.027	SAT TT=0.962 CHECKS=8036 NODES=103	SAT TT=0.951 CHECKS=9535 NODES=0	SAT TT=0.099	SAT TT=0.058 CHECKS=16410	SAT TT=0.042 CHECKS=4222	SAT TT=1.011 ASSIGNMENTS=27	SAT TT=1.112 ASSIGNMENTS=25	SAT TT=0.675 CHECKS=5597 NODES=107	SAT TT=0.658 CHECKS=25340 NODES=181	SAT TT=0.634 CHECKS=104232 NODES=248	SAT TT=0.096 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=0.097 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.631	SAT TT=1.588	SAT TT=0.073 ASSIGNMENTS=2009 CHECKS=181849	SAT TT=0.027 ASSIGNMENTS=108 CHECKS=14869	SAT TT=0.82	SAT TT=0.027 ASSIGNMENTS=49 CHECKS=5219	SAT TT=0.081 ASSIGNMENTS=2094 CHECKS=201460	SAT TT=1.241	SAT TT=0.058 ASSIGNMENTS=102 CHECKS=45139	SAT TT=1.152	SAT TT=1.336
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-10/ normalized-qcp-10-67-5_ext.xml	SAT TT=0.024	SAT TT=0.936 CHECKS=7669 NODES=101	SAT TT=0.93 CHECKS=9196 NODES=0	SAT TT=0.106	SAT TT=0.058 CHECKS=13480	SAT TT=0.04 CHECKS=3494	SAT TT=0.966 ASSIGNMENTS=17	SAT TT=0.987 ASSIGNMENTS=23	SAT TT=0.652 CHECKS=5330 NODES=107	SAT TT=0.668 CHECKS=24709 NODES=184	SAT TT=0.703 CHECKS=158421 NODES=374	SAT TT=0.036 ASSIGNMENTS=26 CHECKS=2639	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.803	SAT TT=1.776	SAT TT=0.024 ASSIGNMENTS=29 CHECKS=2748	SAT TT=0.027 ASSIGNMENTS=73 CHECKS=9987	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=253 CHECKS=26126	SAT TT=0.025 ASSIGNMENTS=26 CHECKS=2639	SAT TT=1.309	SAT TT=0.057 ASSIGNMENTS=101 CHECKS=45072	SAT TT=1.025	SAT TT=1.227
csp/QCP-10/ normalized-qcp-10-67-6_ext.xml	SAT TT=0.024	SAT TT=1.007 CHECKS=21395 NODES=318	SAT TT=1.059 CHECKS=22775 NODES=203	SAT TT=0.101	SAT TT=0.062 CHECKS=17693	SAT TT=0.042 CHECKS=3780	SAT TT=0.999 ASSIGNMENTS=25	SAT TT=1.029 ASSIGNMENTS=28	SAT TT=0.67 CHECKS=6232 NODES=130	SAT TT=0.792 CHECKS=38727 NODES=380	SAT TT=0.682 CHECKS=65245 NODES=109	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.036 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.713	SAT TT=1.48	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=2506	SAT TT=0.026 ASSIGNMENTS=60 CHECKS=8529	SAT TT=0.681	SAT TT=0.027 ASSIGNMENTS=143 CHECKS=14283	SAT TT=0.026 ASSIGNMENTS=33 CHECKS=2506	SAT TT=1.251	SAT TT=0.063 ASSIGNMENTS=101 CHECKS=44975	SAT TT=1.165	SAT TT=1.138
csp/QCP-10/ normalized-qcp-10-67-7_ext.xml	SAT TT=0.024	SAT TT=0.973 CHECKS=8333 NODES=113	SAT TT=0.962 CHECKS=17078 NODES=100	SAT TT=0.119	SAT TT=0.072 CHECKS=26224	SAT TT=0.043 CHECKS=5693	SAT TT=1.09 ASSIGNMENTS=27	SAT TT=0.997 ASSIGNMENTS=20	SAT TT=0.612 CHECKS=5490 NODES=107	SAT TT=0.664 CHECKS=38060 NODES=395	SAT TT=0.689 CHECKS=104691 NODES=202	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=0.037 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.485	SAT TT=1.734	SAT TT=0.025 ASSIGNMENTS=84 CHECKS=7542	SAT TT=0.026 ASSIGNMENTS=16 CHECKS=2073	SAT TT=0.843	SAT TT=0.028 ASSIGNMENTS=151 CHECKS=16169	SAT TT=0.024 ASSIGNMENTS=45 CHECKS=4501	SAT TT=1.329	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=44742	SAT TT=1.175	SAT TT=0.977
csp/QCP-10/ normalized-qcp-10-67-8_ext.xml	SAT TT=0.023	SAT TT=0.956 CHECKS=7755 NODES=100	SAT TT=1.133 CHECKS=16331 NODES=108	SAT TT=0.11	SAT TT=0.07 CHECKS=23734	SAT TT=0.043 CHECKS=6398	SAT TT=1.023 ASSIGNMENTS=28	SAT TT=1.15 ASSIGNMENTS=18	SAT TT=0.631 CHECKS=5897 NODES=129	SAT TT=0.688 CHECKS=27572 NODES=208	SAT TT=0.674 CHECKS=70595 NODES=132	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.036 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.489	SAT TT=1.677	SAT TT=0.024 ASSIGNMENTS=28 CHECKS=2551	SAT TT=0.032 ASSIGNMENTS=166 CHECKS=20046	SAT TT=0.847	SAT TT=0.026 ASSIGNMENTS=120 CHECKS=11940	SAT TT=0.023 ASSIGNMENTS=28 CHECKS=2551	SAT TT=1.322	SAT TT=0.063 ASSIGNMENTS=100 CHECKS=45030	SAT TT=1.161	SAT TT=1.023
csp/QCP-10/ normalized-qcp-10-67-9_ext.xml	SAT TT=0.026	SAT TT=0.973 CHECKS=7768 NODES=100	SAT TT=1.008 CHECKS=17363 NODES=108	SAT TT=0.107	SAT TT=0.081 CHECKS=34024	SAT TT=0.049 CHECKS=10292	SAT TT=1.036 ASSIGNMENTS=19	SAT TT=1.17 ASSIGNMENTS=17	SAT TT=0.659 CHECKS=9469 NODES=229	SAT TT=0.675 CHECKS=29872 NODES=247	SAT TT=0.69 CHECKS=72531 NODES=124	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=0.037 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.504	SAT TT=1.638	SAT TT=0.026 ASSIGNMENTS=35 CHECKS=3212	SAT TT=0.026 ASSIGNMENTS=117 CHECKS=11343	SAT TT=0.693	SAT TT=0.03 ASSIGNMENTS=228 CHECKS=22666	SAT TT=0.026 ASSIGNMENTS=36 CHECKS=3355	SAT TT=1.407	SAT TT=0.061 ASSIGNMENTS=100 CHECKS=45020	SAT TT=0.994	SAT TT=0.982
csp/QCP-15/ normalized-qcp-15-120-0_ext.xml	SAT TT=0.164	SAT TT=1.485 CHECKS=189507 NODES=2100	SAT TT=1.398 CHECKS=148143 NODES=1429	SAT TT=0.487	SAT TT=0.942 CHECKS=566342	SAT TT=0.164 CHECKS=49748	SAT TT=2.562 ASSIGNMENTS=27	SAT TT=2.405 ASSIGNMENTS=22	SAT TT=2.509 CHECKS=65931 NODES=1181	SAT TT=1.753 CHECKS=604792 NODES=7337	SAT TT=1.791 CHECKS=1944370 NODES=2601	SAT TT=9.372 ASSIGNMENTS=27	SAT TT=9.33 ASSIGNMENTS=2100 CHECKS=189507	SAT TT=2.561	SAT TT=2.503	SAT TT=2.053 ASSIGNMENTS=27436 CHECKS=8057580	SAT TT=0.29 ASSIGNMENTS=6077 CHECKS=920873	SAT TT=6.021	SAT TT=0.598 ASSIGNMENTS=7159 CHECKS=2204480	SAT TT=1.543 ASSIGNMENTS=20153 CHECKS=6217020	SAT TT=3.191	SAT TT=1.729 ASSIGNMENTS=5002 CHECKS=1406630	SAT TT=1.37	SAT TT=1.526
csp/QCP-15/ normalized-qcp-15-120-10_ext.xml	UNSAT TT=0.855	UNSAT TT=68.126 CHECKS=68894600 NODES=422203	UNSAT TT=81.098 CHECKS=75128700 NODES=444833	UNSAT TT=196.516	UNSAT TT=927.338 CHECKS=764965000	UNSAT TT=246.16 CHECKS=227269000	UNSAT TT=0.855 ASSIGNMENTS=0	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=689.474 CHECKS=36151400 NODES=820062	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=8.754 ASSIGNMENTS=0	UNSAT TT=77.366 ASSIGNMENTS=422203 CHECKS=68894600	UNSAT TT=1.8	UNSAT TT=1.917	UNSAT TT=6.233 ASSIGNMENTS=114695 CHECKS=25015600	UNSAT TT=2.846 ASSIGNMENTS=51484 CHECKS=11391500	UNSAT TT=57.083	UNSAT TT=2.844 ASSIGNMENTS=51074 CHECKS=11412000	UNSAT TT=22.171 ASSIGNMENTS=295614 CHECKS=87749900	UNSAT TT=3.067	UNSAT TT=978.191 ASSIGNMENTS=4124300 CHECKS=1017790000	UNSAT TT=1.314	UNSAT TT=1.798
csp/QCP-15/ normalized-qcp-15-120-11_ext.xml	UNSAT TT=0.069	UNSAT TT=1.263 CHECKS=54673 NODES=497	UNSAT TT=1.321 CHECKS=81068 NODES=539	UNSAT TT=18.225	UNSAT TT=0.336 CHECKS=120858	UNSAT TT=0.177 CHECKS=36111	UNSAT TT=0.868 ASSIGNMENTS=0	UNSAT TT=0.872 ASSIGNMENTS=0	UNSAT TT=1.53 CHECKS=18914 NODES=36	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=8.401 ASSIGNMENTS=0	UNSAT TT=8.934 ASSIGNMENTS=497 CHECKS=54673	UNSAT TT=1.705	UNSAT TT=1.671	UNSAT TT=0.069 ASSIGNMENTS=193 CHECKS=30906	UNSAT TT=0.265 ASSIGNMENTS=4750 CHECKS=805375	UNSAT TT=1.644	UNSAT TT=0.074 ASSIGNMENTS=431 CHECKS=71014	UNSAT TT=66.288 ASSIGNMENTS=808430 CHECKS=280336000	UNSAT TT=2.605	UNSAT TT=0.256 ASSIGNMENTS=180 CHECKS=235109	UNSAT TT=1.361	UNSAT TT=1.477
csp/QCP-15/ normalized-qcp-15-120-12_ext.xml	UNSAT TT=0.065	UNSAT TT=1.082 CHECKS=15538 NODES=0	UNSAT TT=1.153 CHECKS=15538 NODES=0	UNSAT TT=269.804	UNSAT TT=0.306 CHECKS=118616	UNSAT TT=0.2 CHECKS=37815	UNSAT TT=0.858 ASSIGNMENTS=0	UNSAT TT=0.848 ASSIGNMENTS=0	UNSAT TT=1.556 CHECKS=18113 NODES=65	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.071 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=0.079 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=1.693	UNSAT TT=1.637	UNSAT TT=0.065 ASSIGNMENTS=179 CHECKS=20669	UNSAT TT=0.244 ASSIGNMENTS=5392 CHECKS=791596	UNSAT TT=1.667	UNSAT TT=0.085 ASSIGNMENTS=893 CHECKS=116867	UNSAT TT=0.068 ASSIGNMENTS=139 CHECKS=16485	UNSAT TT=2.63	UNSAT TT=0.335 ASSIGNMENTS=369 CHECKS=384177	UNSAT TT=1.316	UNSAT TT=1.422
csp/QCP-15/ normalized-qcp-15-120-13_ext.xml	UNSAT TT=1.671	UNSAT TT=29.813 CHECKS=30937800 NODES=165801	UNSAT TT=17.16 CHECKS=16417600 NODES=92199	UNSAT TT=98.304	UNSAT TT=338.257 CHECKS=281322000	UNSAT TT=88.296 CHECKS=80225600	UNSAT TT=2.125 ASSIGNMENTS=0	UNSAT TT=2.182 ASSIGNMENTS=0	UNSAT TT=150.956 CHECKS=8564360 NODES=176439	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=9.718 ASSIGNMENTS=0	UNSAT TT=38.444 ASSIGNMENTS=165801 CHECKS=30937800	UNSAT TT=2.003	UNSAT TT=1.816	UNSAT TT=6.288 ASSIGNMENTS=72751 CHECKS=25324200	UNSAT TT=12.449 ASSIGNMENTS=150850 CHECKS=50530200	UNSAT TT=156.892	UNSAT TT=18.691 ASSIGNMENTS=237628 CHECKS=79574600	UNSAT TT=8.021 ASSIGNMENTS=97193 CHECKS=32937500	UNSAT TT=3.186	UNSAT TT=173.665 ASSIGNMENTS=869150 CHECKS=312800000	UNSAT TT=1.746	UNSAT TT=1.671
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-15/ normalized-qcp-15-120-14_ext.xml	UNSAT TT=0.066	UNSAT TT=1.333 CHECKS=80695 NODES=803	UNSAT TT=1.441 CHECKS=79108 NODES=517	UNSAT TT=64.267	UNSAT TT=0.392 CHECKS=143943	UNSAT TT=0.575 CHECKS=336466	UNSAT TT=0.975 ASSIGNMENTS=0	UNSAT TT=0.867 ASSIGNMENTS=0	UNSAT TT=1.643 CHECKS=22826 NODES=116	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=0.078 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=1.751	UNSAT TT=1.625	UNSAT TT=0.066 ASSIGNMENTS=178 CHECKS=26271	UNSAT TT=0.249 ASSIGNMENTS=5044 CHECKS=734442	UNSAT TT=1.942	UNSAT TT=0.082 ASSIGNMENTS=571 CHECKS=84924	UNSAT TT=0.066 ASSIGNMENTS=175 CHECKS=24725	UNSAT TT=2.492	UNSAT TT=0.241 ASSIGNMENTS=192 CHECKS=235794	UNSAT TT=1.373	UNSAT TT=1.497
csp/QCP-15/ normalized-qcp-15-120-1_ext.xml	SAT TT=0.096	SAT TT=1.518 CHECKS=222886 NODES=2456	SAT TT=1.553 CHECKS=211142 NODES=1960	SAT TT=8.076	SAT TT=1.426 CHECKS=838157	SAT TT=0.299 CHECKS=176181	SAT TT=2.821 ASSIGNMENTS=87	SAT TT=2.671 ASSIGNMENTS=40	SAT TT=4.585 CHECKS=184388 NODES=3400	SAT TT=1.617 CHECKS=282696 NODES=3280	SAT TT=2.108 CHECKS=2556870 NODES=3189	SAT TT=0.116 ASSIGNMENTS=437 CHECKS=139504	SAT TT=0.111 ASSIGNMENTS=437 CHECKS=139504	SAT TT=2.605	SAT TT=2.565	SAT TT=0.11 ASSIGNMENTS=602 CHECKS=201213	SAT TT=0.292 ASSIGNMENTS=5020 CHECKS=893730	SAT TT=124.507	SAT TT=0.109 ASSIGNMENTS=761 CHECKS=194113	SAT TT=0.096 ASSIGNMENTS=437 CHECKS=139504	SAT TT=3.123	SAT TT=0.69 ASSIGNMENTS=2577 CHECKS=627411	SAT TT=1.483	SAT TT=1.51
csp/QCP-15/ normalized-qcp-15-120-2_ext.xml	SAT TT=0.298	SAT TT=1.785 CHECKS=395998 NODES=3709	SAT TT=10.585 CHECKS=9043460 NODES=64907	SAT TT=0.617	SAT TT=33.879 CHECKS=24148300	SAT TT=0.613 CHECKS=359549	SAT TT=2.523 ASSIGNMENTS=17	SAT TT=2.621 ASSIGNMENTS=19	SAT TT=3.167 CHECKS=100270 NODES=1856	SAT TT=1.88 CHECKS=1005300 NODES=12785	SAT TT=3.166 CHECKS=9988960 NODES=9645	SAT TT=10.572 ASSIGNMENTS=17	SAT TT=11.98 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.61	SAT TT=2.554	SAT TT=2.924 ASSIGNMENTS=52118 CHECKS=11976600	SAT TT=0.298 ASSIGNMENTS=5898 CHECKS=982607	SAT TT=20.78	SAT TT=3.571 ASSIGNMENTS=67370 CHECKS=13278400	SAT TT=4.692 ASSIGNMENTS=87418 CHECKS=19454300	SAT TT=2.827	SAT TT=2.299 ASSIGNMENTS=14225 CHECKS=3243460	SAT TT=1.357	SAT TT=1.749
csp/QCP-15/ normalized-qcp-15-120-3_ext.xml	SAT TT=0.089	SAT TT=4.12 CHECKS=2768200 NODES=18180	SAT TT=1.869 CHECKS=377772 NODES=3508	SAT TT=25.651	SAT TT=0.265 CHECKS=98287	SAT TT=0.158 CHECKS=30306	SAT TT=2.658 ASSIGNMENTS=22	SAT TT=2.617 ASSIGNMENTS=26	SAT TT=13.745 CHECKS=762223 NODES=16089	SAT TT=2.106 CHECKS=984197 NODES=12860	SAT TT=2.064 CHECKS=3632730 NODES=4371	SAT TT=0.106 ASSIGNMENTS=351 CHECKS=120599	SAT TT=0.107 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.758	SAT TT=2.439	SAT TT=0.167 ASSIGNMENTS=1224 CHECKS=429617	SAT TT=8.377 ASSIGNMENTS=132785 CHECKS=33829300	SAT TT=11.585	SAT TT=0.937 ASSIGNMENTS=10250 CHECKS=3412800	SAT TT=0.089 ASSIGNMENTS=351 CHECKS=120599	SAT TT=2.843	SAT TT=0.261 ASSIGNMENTS=411 CHECKS=253294	SAT TT=1.502	SAT TT=1.884
csp/QCP-15/ normalized-qcp-15-120-4_ext.xml	SAT TT=0.066	SAT TT=1.824 CHECKS=457461 NODES=4186	SAT TT=1.693 CHECKS=365624 NODES=2757	SAT TT=85.144	SAT TT=0.817 CHECKS=502288	SAT TT=1.022 CHECKS=706131	SAT TT=3.191 ASSIGNMENTS=167	SAT TT=2.291 ASSIGNMENTS=18	SAT TT=2.827 CHECKS=86780 NODES=1563	SAT TT=3.794 CHECKS=6303240 NODES=84151	? (TO) TT=1800.08	SAT TT=0.076 ASSIGNMENTS=165 CHECKS=31018	SAT TT=0.081 ASSIGNMENTS=165 CHECKS=31018	SAT TT=2.506	SAT TT=2.547	SAT TT=0.394 ASSIGNMENTS=4066 CHECKS=1298560	SAT TT=0.393 ASSIGNMENTS=6544 CHECKS=1430490	SAT TT=5.526	SAT TT=1.423 ASSIGNMENTS=15871 CHECKS=5448940	SAT TT=0.066 ASSIGNMENTS=165 CHECKS=31018	SAT TT=3.019	SAT TT=2.776 ASSIGNMENTS=9219 CHECKS=3201800	SAT TT=1.405	SAT TT=1.782
csp/QCP-15/ normalized-qcp-15-120-5_ext.xml	SAT TT=0.367	SAT TT=2.204 CHECKS=810869 NODES=5495	SAT TT=10.015 CHECKS=8119460 NODES=50490	SAT TT=0.367	SAT TT=14.96 CHECKS=10200600	SAT TT=8.273 CHECKS=7781820	SAT TT=3.451 ASSIGNMENTS=62	SAT TT=3.083 ASSIGNMENTS=26	SAT TT=30.152 CHECKS=1758240 NODES=33141	SAT TT=8.387 CHECKS=17303400 NODES=244991	SAT TT=1.661 CHECKS=588870 NODES=1002	SAT TT=10.394 ASSIGNMENTS=62	SAT TT=9.892 ASSIGNMENTS=5495 CHECKS=810869	SAT TT=2.598	SAT TT=2.963	SAT TT=11.554 ASSIGNMENTS=140271 CHECKS=50270700	SAT TT=1.229 ASSIGNMENTS=15737 CHECKS=4843560	SAT TT=1315.66	SAT TT=5.147 ASSIGNMENTS=55178 CHECKS=20607700	SAT TT=9.578 ASSIGNMENTS=116993 CHECKS=42085400	SAT TT=3.454	SAT TT=69.82 ASSIGNMENTS=338940 CHECKS=94993700	SAT TT=1.611	SAT TT=2.111
csp/QCP-15/ normalized-qcp-15-120-6_ext.xml	SAT TT=0.465	SAT TT=1.776 CHECKS=417725 NODES=3570	SAT TT=1.886 CHECKS=383716 NODES=3193	SAT TT=19.578	SAT TT=2.197 CHECKS=1401790	SAT TT=0.465 CHECKS=307968	SAT TT=2.689 ASSIGNMENTS=67	SAT TT=2.606 ASSIGNMENTS=32	SAT TT=2.841 CHECKS=86326 NODES=1794	SAT TT=1.915 CHECKS=1086130 NODES=14291	SAT TT=2.794 CHECKS=8723290 NODES=9058	SAT TT=1.374 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=1.514 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.458	SAT TT=2.579	SAT TT=1.957 ASSIGNMENTS=23710 CHECKS=8258540	SAT TT=0.632 ASSIGNMENTS=9160 CHECKS=2191040	SAT TT=1.811	SAT TT=2.117 ASSIGNMENTS=26306 CHECKS=8026020	SAT TT=1.335 ASSIGNMENTS=18111 CHECKS=5384810	SAT TT=2.666	SAT TT=7.983 ASSIGNMENTS=31231 CHECKS=7469300	SAT TT=1.441	SAT TT=1.624
csp/QCP-15/ normalized-qcp-15-120-7_ext.xml	SAT TT=0.384	SAT TT=1.568 CHECKS=263854 NODES=2427	SAT TT=1.446 CHECKS=172508 NODES=1414	SAT TT=0.97	SAT TT=9.276 CHECKS=6340330	SAT TT=1.158 CHECKS=908072	SAT TT=2.781 ASSIGNMENTS=40	SAT TT=2.809 ASSIGNMENTS=44	SAT TT=1.804 CHECKS=31917 NODES=458	SAT TT=1.755 CHECKS=173516 NODES=1788	SAT TT=1.969 CHECKS=3075520 NODES=4321	SAT TT=1.26 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=1.258 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.709	SAT TT=2.582	SAT TT=0.813 ASSIGNMENTS=10788 CHECKS=3171960	SAT TT=0.684 ASSIGNMENTS=9831 CHECKS=2373610	SAT TT=53.567	SAT TT=1.411 ASSIGNMENTS=15828 CHECKS=5164040	SAT TT=1.203 ASSIGNMENTS=13200 CHECKS=4459210	SAT TT=2.922	SAT TT=9.665 ASSIGNMENTS=54258 CHECKS=13817100	SAT TT=1.435	SAT TT=1.482
csp/QCP-15/ normalized-qcp-15-120-8_ext.xml	SAT TT=0.255	SAT TT=2.542 CHECKS=1295610 NODES=9088	SAT TT=1.868 CHECKS=560127 NODES=4085	SAT TT=15.666	SAT TT=2.318 CHECKS=1538240	SAT TT=1.049 CHECKS=881616	SAT TT=2.606 ASSIGNMENTS=42	SAT TT=2.498 ASSIGNMENTS=26	SAT TT=2.125 CHECKS=45436 NODES=834	SAT TT=2.055 CHECKS=1241460 NODES=16130	SAT TT=2.332 CHECKS=5588600 NODES=5826	SAT TT=0.259 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=0.258 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=2.624	SAT TT=2.629	SAT TT=0.297 ASSIGNMENTS=2359 CHECKS=958233	SAT TT=0.522 ASSIGNMENTS=7929 CHECKS=1814400	SAT TT=33.836	SAT TT=2.2 ASSIGNMENTS=26530 CHECKS=8919850	SAT TT=0.255 ASSIGNMENTS=2060 CHECKS=804545	SAT TT=3.191	SAT TT=0.711 ASSIGNMENTS=1749 CHECKS=499081	SAT TT=1.45	SAT TT=1.535
csp/QCP-15/ normalized-qcp-15-120-9_ext.xml	SAT TT=1.303	SAT TT=12.64 CHECKS=11213100 NODES=71894	SAT TT=6.327 CHECKS=4588480 NODES=24366	SAT TT=108.657	SAT TT=4.641 CHECKS=2966030	SAT TT=15.418 CHECKS=13318100	SAT TT=2.754 ASSIGNMENTS=29	SAT TT=2.718 ASSIGNMENTS=6	SAT TT=2.997 CHECKS=99776 NODES=1809	SAT TT=26.488 CHECKS=65705000 NODES=903393	? (TO) TT=1800	SAT TT=10.403 ASSIGNMENTS=29	SAT TT=19.644 ASSIGNMENTS=71894 CHECKS=11213100	SAT TT=2.617	SAT TT=2.568	SAT TT=58.625 ASSIGNMENTS=808661 CHECKS=227102000	SAT TT=1.303 ASSIGNMENTS=16405 CHECKS=5035400	? (TO) TT=1800.11	SAT TT=9.282 ASSIGNMENTS=108559 CHECKS=35135000	SAT TT=83.526 ASSIGNMENTS=1146480 CHECKS=356217000	SAT TT=3.457	SAT TT=716.602 ASSIGNMENTS=1850280 CHECKS=459937000	SAT TT=1.531	SAT TT=1.638
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-0_ext.xml	SAT TT=3.689	SAT TT=86.178 CHECKS=71044700 NODES=296824	SAT TT=68.355 CHECKS=59193100 NODES=267618	? (TO) TT=1800.04	SAT TT=1559.42 CHECKS=750580000	? (TO) TT=1800.07	SAT TT=12.586 ASSIGNMENTS=308	SAT TT=7.945 ASSIGNMENTS=88	? (TO) TT=1800.08	SAT TT=35.998 CHECKS=63552400 NODES=661720	? (TO) TT=1800.06	SAT TT=15.179 ASSIGNMENTS=308	SAT TT=87.566 ASSIGNMENTS=296824 CHECKS=71044700	SAT TT=4.737	SAT TT=5.139	SAT TT=371.034 ASSIGNMENTS=3413270 CHECKS=1544380000	SAT TT=3.689 ASSIGNMENTS=34612 CHECKS=15672000	? (TO) TT=1800.07	SAT TT=549.796 ASSIGNMENTS=5052710 CHECKS=2389460000	SAT TT=294.592 ASSIGNMENTS=2884700 CHECKS=1306400000	SAT TT=7.722	? (TO) TT=1800.1	SAT TT=4.273	SAT TT=7.71
csp/QCP-20/ normalized-qcp-20-187-10_ext.xml	UNSAT TT=5.808	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=196.177 ASSIGNMENTS=8438	UNSAT TT=88.792 ASSIGNMENTS=2468	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=67.933 ASSIGNMENTS=2434	UNSAT TT=734.904 ASSIGNMENTS=2434	UNSAT TT=5.808	UNSAT TT=20.349	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=13.604	? (TO) TT=1800.1	UNSAT TT=9.165	UNSAT TT=9.768
csp/QCP-20/ normalized-qcp-20-187-11_ext.xml	UNSAT TT=0.201	UNSAT TT=4.086 CHECKS=1821240 NODES=9837	UNSAT TT=2.87 CHECKS=543852 NODES=3228	? (TO) TT=1800.1	UNSAT TT=3.116 CHECKS=1294710	UNSAT TT=1.484 CHECKS=240400	UNSAT TT=1.011 ASSIGNMENTS=0	UNSAT TT=1.213 ASSIGNMENTS=0	UNSAT TT=10.067 CHECKS=145949 NODES=2142	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.222 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=0.223 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=2.882	UNSAT TT=3.03	UNSAT TT=0.224 ASSIGNMENTS=2069 CHECKS=390152	UNSAT TT=0.48 ASSIGNMENTS=7313 CHECKS=1482210	UNSAT TT=11.104	UNSAT TT=0.201 ASSIGNMENTS=1518 CHECKS=288165	UNSAT TT=0.216 ASSIGNMENTS=2012 CHECKS=360868	UNSAT TT=4.041	UNSAT TT=2.509 ASSIGNMENTS=1786 CHECKS=2862110	UNSAT TT=1.991	UNSAT TT=2.657
csp/QCP-20/ normalized-qcp-20-187-12_ext.xml	UNSAT TT=5.556	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=8.817 ASSIGNMENTS=3	UNSAT TT=8.318 ASSIGNMENTS=22	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=13.111 ASSIGNMENTS=170	UNSAT TT=679.857 ASSIGNMENTS=170	UNSAT TT=5.731	UNSAT TT=5.556	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=10.037	? (TO) TT=1800.11	UNSAT TT=17.393	UNSAT TT=5.659
csp/QCP-20/ normalized-qcp-20-187-13_ext.xml	UNSAT TT=3.918	UNSAT TT=1004.12 CHECKS=850273000 NODES=3819070	UNSAT TT=1109.52 CHECKS=901767000 NODES=3912150	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=61.909 ASSIGNMENTS=2738	UNSAT TT=20.154 ASSIGNMENTS=364	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=73.849 ASSIGNMENTS=2808	UNSAT TT=737.606 ASSIGNMENTS=2808	UNSAT TT=4.708	UNSAT TT=3.918	UNSAT TT=687.067 ASSIGNMENTS=6765400 CHECKS=2829090000	UNSAT TT=657.699 ASSIGNMENTS=6901810 CHECKS=2918940000	? (TO) TT=1800.08	UNSAT TT=389.174 ASSIGNMENTS=3747130 CHECKS=1573070000	UNSAT TT=749.406 ASSIGNMENTS=7567830 CHECKS=3147200000	UNSAT TT=6.871	? (TO) TT=1800.08	UNSAT TT=4.907	UNSAT TT=5.638
csp/QCP-20/ normalized-qcp-20-187-14_ext.xml	UNSAT TT=3.586	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=4.106 ASSIGNMENTS=0	UNSAT TT=4.118 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=11.324 ASSIGNMENTS=110	UNSAT TT=679.022 ASSIGNMENTS=110	UNSAT TT=5.341	UNSAT TT=3.625	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=5.31	? (TO) TT=1800.03	UNSAT TT=4.069	UNSAT TT=3.586
csp/QCP-20/ normalized-qcp-20-187-1_ext.xml	SAT TT=1.284	SAT TT=247.054 CHECKS=194819000 NODES=894042	SAT TT=106.901 CHECKS=86207800 NODES=361496	? (TO) TT=1800.09	SAT TT=1772.73 CHECKS=889563000	SAT TT=185.742 CHECKS=74609700	SAT TT=7.571 ASSIGNMENTS=30	SAT TT=7.366 ASSIGNMENTS=26	? (TO) TT=1800.09	SAT TT=98.953 CHECKS=191936000 NODES=1974040	? (TO) TT=1800.07	SAT TT=1.3 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=1.323 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=8.255	SAT TT=4.236	SAT TT=3.046 ASSIGNMENTS=28113 CHECKS=11572400	SAT TT=31.858 ASSIGNMENTS=352100 CHECKS=134727000	? (TO) TT=1800.05	SAT TT=7.487 ASSIGNMENTS=85564 CHECKS=31309100	SAT TT=1.284 ASSIGNMENTS=12921 CHECKS=4654360	SAT TT=4.123	? (TO) TT=1800.08	SAT TT=2.718	SAT TT=2.805
csp/QCP-20/ normalized-qcp-20-187-2_ext.xml	SAT TT=4.617	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=1354.15 CHECKS=504683000	SAT TT=15.658 ASSIGNMENTS=351	SAT TT=13.643 ASSIGNMENTS=213	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=30.475 ASSIGNMENTS=1028	SAT TT=699.321 ASSIGNMENTS=1028	SAT TT=6.022	SAT TT=7.225	? (TO) TT=1800.06	SAT TT=735.499 ASSIGNMENTS=7282480 CHECKS=3353870000	? (TO) TT=1800.05	SAT TT=1371.13 ASSIGNMENTS=13209900 CHECKS=1456490000	SAT TT=997.939 ASSIGNMENTS=9104530 CHECKS=100722000	SAT TT=10.076	? (TO) TT=1800.1	SAT TT=8.19	SAT TT=4.617
csp/QCP-20/ normalized-qcp-20-187-3_ext.xml	SAT TT=4.797	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=10.955 ASSIGNMENTS=82	SAT TT=9.772 ASSIGNMENTS=34	? (TO) TT=1800.06	SAT TT=270.7 CHECKS=553253000 NODES=5810500	? (TO) TT=1800.08	SAT TT=32.802 ASSIGNMENTS=1154	SAT TT=702.01 ASSIGNMENTS=1154	SAT TT=5.648	SAT TT=4.965	SAT TT=1087.8 ASSIGNMENTS=10250300 CHECKS=426425000	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=869.756 ASSIGNMENTS=7511240 CHECKS=3554840000	? (TO) TT=1800.04	SAT TT=7.375	? (TO) TT=1800.07	SAT TT=5.945	SAT TT=4.797
csp/QCP-20/ normalized-qcp-20-187-4_ext.xml	SAT TT=5.092	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=27.782 ASSIGNMENTS=1026	SAT TT=11.569 ASSIGNMENTS=172	? (TO) TT=1800.03	SAT TT=20.191 CHECKS=34876100 NODES=372428	? (TO) TT=1800.09	SAT TT=99.815 ASSIGNMENTS=4017	SAT TT=758.606 ASSIGNMENTS=4017	SAT TT=5.092	SAT TT=6.342	? (TO) TT=1800.09	SAT TT=1495.3 ASSIGNMENTS=14166800 CHECKS=2472280000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.3	? (TO) TT=1800.1	SAT TT=16.893	SAT TT=5.912
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-20/ normalized-qcp-20-187-5_ext.xml	SAT TT=2.514	SAT TT=136.215 CHECKS=107969000 NODES=460722	SAT TT=611.783 CHECKS=534493000 NODES=2470600	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=6.896 CHECKS=1833940	SAT TT=10.422 ASSIGNMENTS=120	SAT TT=7.483 ASSIGNMENTS=24	? (TO) TT=1800.01	SAT TT=11.417 CHECKS=13794900 NODES=140757	? (TO) TT=1800.06	SAT TT=20.132 ASSIGNMENTS=521	SAT TT=129.725 ASSIGNMENTS=460722 CHECKS=107969000	SAT TT=4.403	SAT TT=4.24	? (TO) TT=1800.07	SAT TT=50.736 ASSIGNMENTS=538921 CHECKS=208806000	? (TO) TT=1800.06	SAT TT=56.666 ASSIGNMENTS=582246 CHECKS=253759000	? (TO) TT=1800.02	SAT TT=4.905	? (TO) TT=1800.11	SAT TT=2.514	SAT TT=4.292
csp/QCP-20/ normalized-qcp-20-187-6_ext.xml	SAT TT=4.988	? (TO) TT=1800.1	SAT TT=1384.09 CHECKS=1230110000 NODES=4741160	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=1147.44 CHECKS=488402000	SAT TT=27.2 ASSIGNMENTS=1090	SAT TT=7.793 ASSIGNMENTS=63	? (TO) TT=1800.05	SAT TT=13.019 CHECKS=16341800 NODES=170729	? (TO) TT=1800.05	SAT TT=23.137 ASSIGNMENTS=807	SAT TT=691.743 ASSIGNMENTS=807	SAT TT=5.841	SAT TT=4.988	SAT TT=37.453 ASSIGNMENTS=354247 CHECKS=167088000	SAT TT=956.689 ASSIGNMENTS=8572940 CHECKS=3994410000	? (TO) TT=1800.05	SAT TT=1425.12 ASSIGNMENTS=12144500 CHECKS=1324030000	SAT TT=135.171 ASSIGNMENTS=1126510 CHECKS=549540000	SAT TT=6.375	SAT TT=722.274 ASSIGNMENTS=2291300 CHECKS=709389000	SAT TT=7.797	SAT TT=10.33
csp/QCP-20/ normalized-qcp-20-187-7_ext.xml	SAT TT=3.473	SAT TT=1125.21 CHECKS=997941000 NODES=4322420	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.991 ASSIGNMENTS=131	SAT TT=8.906 ASSIGNMENTS=100	? (TO) TT=1800.03	SAT TT=31.612 CHECKS=53466000 NODES=564896	? (TO) TT=1800.01	SAT TT=11.663 ASSIGNMENTS=131	SAT TT=678.678 ASSIGNMENTS=131	SAT TT=6.406	SAT TT=6.537	SAT TT=1511.79 ASSIGNMENTS=14831300 CHECKS=2128970000	SAT TT=138.199 ASSIGNMENTS=1300120 CHECKS=621673000	? (TO) TT=1800.08	SAT TT=1760.55 ASSIGNMENTS=16280500 CHECKS=3237210000	? (TO) TT=1800.04	SAT TT=4.966	SAT TT=1386.64 ASSIGNMENTS=5868380 CHECKS=1619470000	SAT TT=3.473	SAT TT=13.434
csp/QCP-20/ normalized-qcp-20-187-8_ext.xml	SAT TT=3.369	SAT TT=103.779 CHECKS=85623200 NODES=369967	SAT TT=3.97 CHECKS=1805770 NODES=10365	? (TO) TT=1800.02	SAT TT=148.427 CHECKS=77597100	SAT TT=1376.39 CHECKS=1311560000	SAT TT=8.46 ASSIGNMENTS=53	SAT TT=13.154 ASSIGNMENTS=228	SAT TT=396.684 CHECKS=11067600 NODES=192251	SAT TT=51.755 CHECKS=100310000 NODES=1038730	? (TO) TT=1800.04	SAT TT=13.966 ASSIGNMENTS=206	SAT TT=112.52 ASSIGNMENTS=369967 CHECKS=85623200	SAT TT=5.835	SAT TT=4.605	SAT TT=301.348 ASSIGNMENTS=3260060 CHECKS=1260420000	SAT TT=7.867 ASSIGNMENTS=79487 CHECKS=32450600	? (TO) TT=1800.11	SAT TT=432.599 ASSIGNMENTS=3830550 CHECKS=1769440000	SAT TT=278.883 ASSIGNMENTS=2931480 CHECKS=1155290000	SAT TT=4.524	? (TO) TT=1800.04	SAT TT=3.712	SAT TT=3.369
csp/QCP-20/ normalized-qcp-20-187-9_ext.xml	SAT TT=1.527	SAT TT=771.553 CHECKS=643145000 NODES=2667110	SAT TT=5.795 CHECKS=3102290 NODES=15098	? (TO) TT=1800.04	SAT TT=18.857 CHECKS=8505560	SAT TT=788.028 CHECKS=260390000	SAT TT=7.727 ASSIGNMENTS=78	SAT TT=8.76 ASSIGNMENTS=153	? (TO) TT=1800.03	SAT TT=7.235 CHECKS=4154440 NODES=42970	? (TO) TT=1800	SAT TT=17.289 ASSIGNMENTS=408	SAT TT=684.963 ASSIGNMENTS=408	SAT TT=4.688	SAT TT=4.577	SAT TT=193.378 ASSIGNMENTS=2148000 CHECKS=864870000	SAT TT=150.446 ASSIGNMENTS=1164980 CHECKS=631978000	? (TO) TT=1800.03	SAT TT=1.527 ASSIGNMENTS=11480 CHECKS=5951810	SAT TT=207.332 ASSIGNMENTS=2193810 CHECKS=876188000	SAT TT=5.019	? (TO) TT=1800.07	SAT TT=3.738	SAT TT=3.993
csp/QCP-25/ normalized-qcp-25-264-0_ext.xml	SAT TT=31.548	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=489.462 ASSIGNMENTS=10433	SAT TT=94.367 ASSIGNMENTS=1329	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=482.805 ASSIGNMENTS=10433	SAT TT=1177.74 ASSIGNMENTS=10433	SAT TT=43.353	SAT TT=34.017	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=31.548	? (TO) TT=1800.12	SAT TT=273.693	SAT TT=107.804
csp/QCP-25/ normalized-qcp-25-264-10_ext.xml	UNSAT TT=19.47	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=148.3 ASSIGNMENTS=2369	UNSAT TT=129.935 ASSIGNMENTS=1263	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=132.104 ASSIGNMENTS=2369	UNSAT TT=797.306 ASSIGNMENTS=2369	UNSAT TT=42.075	UNSAT TT=19.47	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=86.44	? (TO) TT=1800.09	UNSAT TT=255.43	UNSAT TT=129.58
csp/QCP-25/ normalized-qcp-25-264-11_ext.xml	UNSAT TT=0.356	UNSAT TT=1.828 CHECKS=102046 NODES=0	UNSAT TT=1.836 CHECKS=102046 NODES=0	? (TO) TT=1800.04	UNSAT TT=4.012 CHECKS=728022	UNSAT TT=5.96 CHECKS=342599	UNSAT TT=1.163 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=18.254 CHECKS=115324 NODES=244	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=0.383 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=0.384 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=5.264	UNSAT TT=6.896	UNSAT TT=0.402 ASSIGNMENTS=2888 CHECKS=673016	UNSAT TT=0.615 ASSIGNMENTS=8328 CHECKS=1813620	UNSAT TT=44.034	UNSAT TT=0.711 ASSIGNMENTS=7921 CHECKS=1887400	UNSAT TT=0.356 ASSIGNMENTS=2674 CHECKS=613406	UNSAT TT=4.87	UNSAT TT=2.95 ASSIGNMENTS=1617 CHECKS=2890660	UNSAT TT=3.13	UNSAT TT=3.384
csp/QCP-25/ normalized-qcp-25-264-12_ext.xml	UNSAT TT=1.469	UNSAT TT=1465.74 CHECKS=1217050000 NODES=4495920	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=1.469 ASSIGNMENTS=0	UNSAT TT=1.483 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=9.137 ASSIGNMENTS=0	UNSAT TT=676.066 ASSIGNMENTS=0	UNSAT TT=5.694	UNSAT TT=5.498	? (TO) TT=1800.08	UNSAT TT=793.615 ASSIGNMENTS=11236600 CHECKS=3780190000	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=5.014	? (TO) TT=1800.15	UNSAT TT=3.181	UNSAT TT=3.889
csp/QCP-25/ normalized-qcp-25-264-13_ext.xml	UNSAT TT=1.4	? (TO) TT=1800.1	UNSAT TT=32.759 CHECKS=19295600 NODES=78577	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.4 ASSIGNMENTS=0	UNSAT TT=1.413 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=9.332 ASSIGNMENTS=0	UNSAT TT=675.912 ASSIGNMENTS=0	UNSAT TT=5.766	UNSAT TT=5.977	? (TO) TT=1800.07	UNSAT TT=191.924 ASSIGNMENTS=3029480 CHECKS=840137000	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=5.366	? (TO) TT=1800.14	UNSAT TT=3.26	UNSAT TT=4.098
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QCP-25/ normalized-qcp-25-264-14_ext.xml	UNSAT TT=32.393	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=187.054 ASSIGNMENTS=2650	UNSAT TT=111.985 ASSIGNMENTS=1014	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=148.726 ASSIGNMENTS=2487	UNSAT TT=800.345 ASSIGNMENTS=2487	UNSAT TT=32.474	UNSAT TT=32.393	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=70.472	? (TO) TT=1800.15	UNSAT TT=65.879	UNSAT TT=105.436
csp/QCP-25/ normalized-qcp-25-264-1_ext.xml	SAT TT=137.596	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=656.988	SAT TT=137.596	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=371.733	? (TO) TT=1800.11	SAT TT=654.826	SAT TT=1696.08
csp/QCP-25/ normalized-qcp-25-264-2_ext.xml	SAT TT=10.57	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=30.048 ASSIGNMENTS=160	SAT TT=94.941 ASSIGNMENTS=1221	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=158.12 ASSIGNMENTS=2681	SAT TT=831.742 ASSIGNMENTS=2681	SAT TT=17.961	SAT TT=21.711	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=10.57	? (TO) TT=1800.12	SAT TT=38.422	SAT TT=37.986
csp/QCP-25/ normalized-qcp-25-264-3_ext.xml	SAT TT=47.242	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1391.47 ASSIGNMENTS=28060	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1419.53 ASSIGNMENTS=28060	? (TO) TT=1800.01	SAT TT=204.922	SAT TT=47.242	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=299.072	? (TO) TT=1800.09	SAT TT=1169.24	SAT TT=93.987
csp/QCP-25/ normalized-qcp-25-264-4_ext.xml	SAT TT=27.328	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1477.49 ASSIGNMENTS=26778	SAT TT=221.842 ASSIGNMENTS=2446	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=27.328	SAT TT=98.283	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=166.727	? (TO) TT=1800.09	SAT TT=342.65	SAT TT=71.447
csp/QCP-25/ normalized-qcp-25-264-5_ext.xml	SAT TT=35.778	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=962.125 ASSIGNMENTS=11219	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=35.778	SAT TT=116.864	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=285.904	? (TO) TT=1800.13	SAT TT=230.37	SAT TT=97.073
csp/QCP-25/ normalized-qcp-25-264-6_ext.xml	SAT TT=57.228	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=57.228 ASSIGNMENTS=737	SAT TT=1151.55 ASSIGNMENTS=15852	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=119.394 ASSIGNMENTS=2319	SAT TT=786.463 ASSIGNMENTS=2319	SAT TT=366.619	SAT TT=141.766	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=654.663	? (TO) TT=1800.07	SAT TT=166.843	SAT TT=166.095
csp/QCP-25/ normalized-qcp-25-264-7_ext.xml	SAT TT=43.883	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=943.746 ASSIGNMENTS=22317	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1453.41 CHECKS=2264150000 NODES=19452500	? (TO) TT=1800.06	SAT TT=252.841 ASSIGNMENTS=5745	SAT TT=918.357 ASSIGNMENTS=5745	SAT TT=70.143	SAT TT=43.883	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=64.991	? (TO) TT=1800.14	SAT TT=53.629	SAT TT=228.492
csp/QCP-25/ normalized-qcp-25-264-8_ext.xml	SAT TT=25.145	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=727.454 ASSIGNMENTS=15922	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=130.551 ASSIGNMENTS=2149	SAT TT=797.46 ASSIGNMENTS=2149	SAT TT=73.27	SAT TT=25.145	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=61.858	? (TO) TT=1800.16	SAT TT=125.736	SAT TT=89.797
csp/QCP-25/ normalized-qcp-25-264-9_ext.xml	SAT TT=26.164	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=46.516 ASSIGNMENTS=447	SAT TT=1775.36 ASSIGNMENTS=21093	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=26.164	SAT TT=37.713	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=380.529	? (TO) TT=1800.16	SAT TT=264.981	SAT TT=96.707
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-10/ normalized-qwh-10-57-0_ext.xml	SAT TT=0.021	SAT TT=0.938 CHECKS=7497 NODES=101	SAT TT=1.016 CHECKS=24710 NODES=0	SAT TT=0.102	SAT TT=0.114 CHECKS=109640	SAT TT=0.04 CHECKS=14117	SAT TT=1.227 ASSIGNMENTS=4	SAT TT=0.937 ASSIGNMENTS=9	SAT TT=0.587 CHECKS=5245 NODES=108	SAT TT=0.646 CHECKS=25298 NODES=379	SAT TT=0.662 CHECKS=282044 NODES=745	SAT TT=0.034 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.033 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.49	SAT TT=1.438	SAT TT=0.024 ASSIGNMENTS=6 CHECKS=1067	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=3202	SAT TT=0.62	SAT TT=0.024 ASSIGNMENTS=33 CHECKS=3579	SAT TT=0.021 ASSIGNMENTS=6 CHECKS=1067	SAT TT=1.301	SAT TT=0.054 ASSIGNMENTS=103 CHECKS=34312	SAT TT=0.956	SAT TT=1.144
csp/QWH-10/ normalized-qwh-10-57-1_ext.xml	SAT TT=0.022	SAT TT=0.953 CHECKS=9265 NODES=145	SAT TT=1.02 CHECKS=19847 NODES=0	SAT TT=0.106	SAT TT=0.121 CHECKS=112630	SAT TT=0.049 CHECKS=33631	SAT TT=0.833 ASSIGNMENTS=5	SAT TT=1.051 ASSIGNMENTS=4	SAT TT=0.624 CHECKS=6626 NODES=153	SAT TT=0.621 CHECKS=61113 NODES=1221	SAT TT=0.867 CHECKS=84676 NODES=280	SAT TT=0.029 ASSIGNMENTS=32 CHECKS=4937	SAT TT=0.033 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.529	SAT TT=1.593	SAT TT=0.022 ASSIGNMENTS=35 CHECKS=5718	SAT TT=0.024 ASSIGNMENTS=76 CHECKS=10042	SAT TT=0.824	SAT TT=0.026 ASSIGNMENTS=137 CHECKS=13855	SAT TT=0.023 ASSIGNMENTS=32 CHECKS=4937	SAT TT=1.301	SAT TT=0.055 ASSIGNMENTS=133 CHECKS=36754	SAT TT=0.992	SAT TT=1.001
csp/QWH-10/ normalized-qwh-10-57-2_ext.xml	SAT TT=0.022	SAT TT=0.906 CHECKS=6664 NODES=100	SAT TT=0.934 CHECKS=7844 NODES=0	SAT TT=0.103	SAT TT=0.057 CHECKS=23137	SAT TT=0.04 CHECKS=24242	SAT TT=1.065 ASSIGNMENTS=5	SAT TT=1.029 ASSIGNMENTS=6	SAT TT=0.624 CHECKS=5485 NODES=116	SAT TT=0.644 CHECKS=43398 NODES=807	SAT TT=0.659 CHECKS=52021 NODES=148	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=0.036 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.609	SAT TT=1.56	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=2064	SAT TT=0.022 ASSIGNMENTS=38 CHECKS=4669	SAT TT=0.662	SAT TT=0.023 ASSIGNMENTS=111 CHECKS=12201	SAT TT=0.023 ASSIGNMENTS=16 CHECKS=2059	SAT TT=1.191	SAT TT=0.055 ASSIGNMENTS=139 CHECKS=38982	SAT TT=0.956	SAT TT=0.983
csp/QWH-10/ normalized-qwh-10-57-3_ext.xml	SAT TT=0.021	SAT TT=0.992 CHECKS=12727 NODES=204	SAT TT=0.938 CHECKS=17818 NODES=127	SAT TT=0.104	SAT TT=0.049 CHECKS=15467	SAT TT=0.036 CHECKS=4447	SAT TT=1.009 ASSIGNMENTS=5	SAT TT=1.184 ASSIGNMENTS=9	SAT TT=0.628 CHECKS=4820 NODES=104	SAT TT=0.622 CHECKS=20416 NODES=245	SAT TT=0.747 CHECKS=598645 NODES=1499	SAT TT=0.034 ASSIGNMENTS=36 CHECKS=3598	SAT TT=0.033 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.681	SAT TT=1.526	SAT TT=0.023 ASSIGNMENTS=42 CHECKS=4846	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=2112	SAT TT=0.652	SAT TT=0.023 ASSIGNMENTS=38 CHECKS=4571	SAT TT=0.021 ASSIGNMENTS=36 CHECKS=3598	SAT TT=1.279	SAT TT=0.053 ASSIGNMENTS=118 CHECKS=35943	SAT TT=1.127	SAT TT=1.175
csp/QWH-10/ normalized-qwh-10-57-4_ext.xml	SAT TT=0.02	SAT TT=0.936 CHECKS=7332 NODES=106	SAT TT=0.985 CHECKS=31345 NODES=237	SAT TT=0.105	SAT TT=0.098 CHECKS=81484	SAT TT=0.044 CHECKS=18791	SAT TT=1.015 ASSIGNMENTS=9	SAT TT=0.959 ASSIGNMENTS=8	SAT TT=0.588 CHECKS=4900 NODES=105	SAT TT=0.62 CHECKS=18288 NODES=181	SAT TT=0.654 CHECKS=72467 NODES=172	SAT TT=0.034 ASSIGNMENTS=20 CHECKS=2512	SAT TT=0.033 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.593	SAT TT=1.434	SAT TT=0.023 ASSIGNMENTS=20 CHECKS=2518	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=2033	SAT TT=0.647	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=6051	SAT TT=0.02 ASSIGNMENTS=20 CHECKS=2512	SAT TT=1.32	SAT TT=0.057 ASSIGNMENTS=139 CHECKS=38338	SAT TT=0.976	SAT TT=1.016
csp/QWH-10/ normalized-qwh-10-57-5_ext.xml	SAT TT=0.022	SAT TT=1.001 CHECKS=18178 NODES=384	SAT TT=0.984 CHECKS=20199 NODES=119	SAT TT=0.107	SAT TT=0.112 CHECKS=102120	SAT TT=0.035 CHECKS=3311	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=0.953 ASSIGNMENTS=9	SAT TT=0.864 CHECKS=5122 NODES=112	SAT TT=0.62 CHECKS=31715 NODES=513	SAT TT=0.613 CHECKS=56968 NODES=137	SAT TT=0.035 ASSIGNMENTS=29 CHECKS=4622	SAT TT=0.037 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.448	SAT TT=1.678	SAT TT=0.024 ASSIGNMENTS=30 CHECKS=5180	SAT TT=0.023 ASSIGNMENTS=14 CHECKS=1509	SAT TT=0.624	SAT TT=0.022 ASSIGNMENTS=25 CHECKS=2885	SAT TT=0.023 ASSIGNMENTS=29 CHECKS=4622	SAT TT=1.212	SAT TT=0.058 ASSIGNMENTS=109 CHECKS=35529	SAT TT=1.22	SAT TT=1.004
csp/QWH-10/ normalized-qwh-10-57-6_ext.xml	SAT TT=0.02	SAT TT=0.944 CHECKS=6803 NODES=101	SAT TT=0.869 CHECKS=6741 NODES=0	SAT TT=0.103	SAT TT=0.05 CHECKS=12703	SAT TT=0.032 CHECKS=3291	SAT TT=1.184 ASSIGNMENTS=12	SAT TT=0.961 ASSIGNMENTS=10	SAT TT=0.67 CHECKS=5941 NODES=126	SAT TT=0.653 CHECKS=27398 NODES=387	SAT TT=0.668 CHECKS=130105 NODES=368	SAT TT=0.033 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.69	SAT TT=1.608	SAT TT=0.02 ASSIGNMENTS=21 CHECKS=1267	SAT TT=0.024 ASSIGNMENTS=19 CHECKS=2538	SAT TT=0.642	SAT TT=0.023 ASSIGNMENTS=60 CHECKS=6026	SAT TT=0.022 ASSIGNMENTS=21 CHECKS=1267	SAT TT=1.275	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=34102	SAT TT=1.084	SAT TT=1.387
csp/QWH-10/ normalized-qwh-10-57-7_ext.xml	SAT TT=0.022	SAT TT=0.947 CHECKS=9127 NODES=139	SAT TT=1.096 CHECKS=29504 NODES=372	SAT TT=0.103	SAT TT=0.052 CHECKS=23299	SAT TT=0.043 CHECKS=16318	SAT TT=1.243 ASSIGNMENTS=13	SAT TT=1.104 ASSIGNMENTS=7	SAT TT=0.727 CHECKS=5340 NODES=114	SAT TT=0.643 CHECKS=24139 NODES=349	SAT TT=0.654 CHECKS=63343 NODES=156	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=0.033 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.581	SAT TT=1.524	SAT TT=0.022 ASSIGNMENTS=8 CHECKS=2252	SAT TT=0.022 ASSIGNMENTS=6 CHECKS=1168	SAT TT=0.661	SAT TT=0.026 ASSIGNMENTS=113 CHECKS=14245	SAT TT=0.022 ASSIGNMENTS=7 CHECKS=2240	SAT TT=1.275	SAT TT=0.058 ASSIGNMENTS=175 CHECKS=40589	SAT TT=1.061	SAT TT=1.212
csp/QWH-10/ normalized-qwh-10-57-8_ext.xml	SAT TT=0.022	SAT TT=0.926 CHECKS=7294 NODES=106	SAT TT=0.931 CHECKS=15074 NODES=101	SAT TT=0.102	SAT TT=0.052 CHECKS=20077	SAT TT=0.037 CHECKS=7559	SAT TT=0.969 ASSIGNMENTS=11	SAT TT=0.988 ASSIGNMENTS=8	SAT TT=0.643 CHECKS=5458 NODES=114	SAT TT=0.638 CHECKS=24212 NODES=303	SAT TT=0.665 CHECKS=219994 NODES=597	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=0.035 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.468	SAT TT=1.531	SAT TT=0.023 ASSIGNMENTS=19 CHECKS=2347	SAT TT=0.023 ASSIGNMENTS=30 CHECKS=3099	SAT TT=0.685	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=2645	SAT TT=0.022 ASSIGNMENTS=26 CHECKS=2839	SAT TT=1.282	SAT TT=0.058 ASSIGNMENTS=172 CHECKS=41573	SAT TT=1.05	SAT TT=0.992
csp/QWH-10/ normalized-qwh-10-57-9_ext.xml	SAT TT=0.024	SAT TT=0.982 CHECKS=7193 NODES=103	SAT TT=0.904 CHECKS=7161 NODES=0	SAT TT=0.102	SAT TT=0.045 CHECKS=12762	SAT TT=0.036 CHECKS=2847	SAT TT=0.992 ASSIGNMENTS=14	SAT TT=0.991 ASSIGNMENTS=14	SAT TT=0.712 CHECKS=8291 NODES=226	SAT TT=0.616 CHECKS=27488 NODES=350	SAT TT=0.661 CHECKS=97250 NODES=237	SAT TT=0.048 ASSIGNMENTS=320 CHECKS=41940	SAT TT=0.047 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.84	SAT TT=1.591	SAT TT=0.033 ASSIGNMENTS=267 CHECKS=35614	SAT TT=0.038 ASSIGNMENTS=708 CHECKS=51125	SAT TT=0.642	SAT TT=0.024 ASSIGNMENTS=132 CHECKS=11342	SAT TT=0.034 ASSIGNMENTS=320 CHECKS=41940	SAT TT=1.283	SAT TT=0.068 ASSIGNMENTS=101 CHECKS=33514	SAT TT=0.962	SAT TT=0.99
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-15/ normalized-qwh-15-106-0_ext.xml	SAT TT=0.061	SAT TT=1.437 CHECKS=215823 NODES=1788	SAT TT=1.433 CHECKS=132580 NODES=1141	SAT TT=0.259	SAT TT=0.339 CHECKS=165410	SAT TT=0.249 CHECKS=138364	SAT TT=2.583 ASSIGNMENTS=20	SAT TT=2.382 ASSIGNMENTS=13	SAT TT=2.169 CHECKS=46802 NODES=775	SAT TT=1.547 CHECKS=235335 NODES=3316	SAT TT=1.807 CHECKS=858933 NODES=1279	SAT TT=0.072 ASSIGNMENTS=88 CHECKS=22046	SAT TT=0.074 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.5	SAT TT=2.525	SAT TT=0.061 ASSIGNMENTS=103 CHECKS=20156	SAT TT=0.259 ASSIGNMENTS=4056 CHECKS=711439	SAT TT=1.98	SAT TT=0.098 ASSIGNMENTS=603 CHECKS=150810	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=22046	SAT TT=2.651	SAT TT=2.485 ASSIGNMENTS=7855 CHECKS=1647510	SAT TT=1.558	SAT TT=1.881
csp/QWH-15/ normalized-qwh-15-106-1_ext.xml	SAT TT=0.21	SAT TT=2.429 CHECKS=1128980 NODES=8034	SAT TT=2.79 CHECKS=1260490 NODES=8323	SAT TT=0.323	SAT TT=13.252 CHECKS=10335300	SAT TT=9.845 CHECKS=8684920	SAT TT=1.741 ASSIGNMENTS=10	SAT TT=1.914 ASSIGNMENTS=7	SAT TT=12.09 CHECKS=551278 NODES=12658	SAT TT=1.673 CHECKS=534970 NODES=7873	? (TO) TT=1800.06	SAT TT=0.309 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=0.305 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.515	SAT TT=2.508	SAT TT=0.21 ASSIGNMENTS=2257 CHECKS=602641	SAT TT=0.329 ASSIGNMENTS=5757 CHECKS=1014420	SAT TT=1.994	SAT TT=0.227 ASSIGNMENTS=2486 CHECKS=688388	SAT TT=0.292 ASSIGNMENTS=3341 CHECKS=917609	SAT TT=2.573	SAT TT=27.914 ASSIGNMENTS=130558 CHECKS=31653400	SAT TT=1.474	SAT TT=1.486
csp/QWH-15/ normalized-qwh-15-106-2_ext.xml	SAT TT=0.076	SAT TT=1.374 CHECKS=104267 NODES=1223	SAT TT=1.611 CHECKS=266546 NODES=1937	SAT TT=0.283	SAT TT=3.981 CHECKS=2968070	SAT TT=1.324 CHECKS=1294420	SAT TT=2.455 ASSIGNMENTS=8	SAT TT=2.469 ASSIGNMENTS=17	SAT TT=2.125 CHECKS=42223 NODES=696	SAT TT=1.876 CHECKS=1008410 NODES=16561	SAT TT=1.414 CHECKS=261884 NODES=375	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=0.088 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.59	SAT TT=2.43	SAT TT=0.078 ASSIGNMENTS=321 CHECKS=79702	SAT TT=0.3 ASSIGNMENTS=4428 CHECKS=884034	SAT TT=2.402	SAT TT=0.193 ASSIGNMENTS=1570 CHECKS=485926	SAT TT=0.076 ASSIGNMENTS=258 CHECKS=79056	SAT TT=2.442	SAT TT=10.249 ASSIGNMENTS=32104 CHECKS=17725100	SAT TT=1.322	SAT TT=1.629
csp/QWH-15/ normalized-qwh-15-106-3_ext.xml	SAT TT=0.068	SAT TT=1.453 CHECKS=58343 NODES=714	SAT TT=1.531 CHECKS=119389 NODES=1094	SAT TT=0.258	SAT TT=0.413 CHECKS=236147	SAT TT=0.238 CHECKS=143199	SAT TT=2.902 ASSIGNMENTS=22	SAT TT=2.791 ASSIGNMENTS=15	SAT TT=2.346 CHECKS=61010 NODES=1136	SAT TT=1.663 CHECKS=223561 NODES=2882	SAT TT=1.709 CHECKS=2403780 NODES=3030	SAT TT=0.129 ASSIGNMENTS=808 CHECKS=221305	SAT TT=0.128 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.484	SAT TT=2.525	SAT TT=0.068 ASSIGNMENTS=127 CHECKS=28913	SAT TT=0.131 ASSIGNMENTS=1891 CHECKS=258609	SAT TT=1.667	SAT TT=0.088 ASSIGNMENTS=639 CHECKS=109322	SAT TT=0.119 ASSIGNMENTS=808 CHECKS=221305	SAT TT=2.576	SAT TT=0.406 ASSIGNMENTS=1238 CHECKS=305943	SAT TT=1.527	SAT TT=1.721
csp/QWH-15/ normalized-qwh-15-106-4_ext.xml	SAT TT=0.072	SAT TT=1.37 CHECKS=102231 NODES=1229	SAT TT=2.156 CHECKS=800977 NODES=5196	SAT TT=0.263	SAT TT=0.207 CHECKS=85489	SAT TT=0.125 CHECKS=31497	SAT TT=2.739 ASSIGNMENTS=20	SAT TT=2.551 ASSIGNMENTS=12	SAT TT=1.921 CHECKS=38606 NODES=585	SAT TT=1.862 CHECKS=959963 NODES=15578	SAT TT=3.161 CHECKS=11806900 NODES=11813	SAT TT=0.148 ASSIGNMENTS=827 CHECKS=315173	SAT TT=0.15 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.52	SAT TT=2.653	SAT TT=0.072 ASSIGNMENTS=263 CHECKS=87698	SAT TT=0.171 ASSIGNMENTS=2596 CHECKS=469073	SAT TT=2.742	SAT TT=0.088 ASSIGNMENTS=570 CHECKS=152598	SAT TT=0.131 ASSIGNMENTS=827 CHECKS=315173	SAT TT=2.793	SAT TT=3.472 ASSIGNMENTS=17878 CHECKS=4092040	SAT TT=1.243	SAT TT=1.446
csp/QWH-15/ normalized-qwh-15-106-5_ext.xml	SAT TT=0.362	SAT TT=1.304 CHECKS=88361 NODES=1089	SAT TT=1.637 CHECKS=148427 NODES=1478	SAT TT=0.564	SAT TT=0.785 CHECKS=533850	SAT TT=1.519 CHECKS=1389770	SAT TT=2.517 ASSIGNMENTS=4	SAT TT=2.64 ASSIGNMENTS=9	SAT TT=2.217 CHECKS=52372 NODES=969	SAT TT=1.744 CHECKS=1007920 NODES=15831	? (TO) TT=1800.04	SAT TT=0.709 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=0.665 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=2.369	SAT TT=2.499	SAT TT=0.362 ASSIGNMENTS=4473 CHECKS=1280560	SAT TT=0.415 ASSIGNMENTS=6466 CHECKS=1321430	SAT TT=4.412	SAT TT=0.378 ASSIGNMENTS=4031 CHECKS=1163710	SAT TT=0.693 ASSIGNMENTS=8428 CHECKS=2414670	SAT TT=3.096	SAT TT=1.435 ASSIGNMENTS=1271 CHECKS=391064	SAT TT=1.338	SAT TT=1.78
csp/QWH-15/ normalized-qwh-15-106-6_ext.xml	SAT TT=0.057	SAT TT=1.333 CHECKS=60314 NODES=803	SAT TT=1.319 CHECKS=61997 NODES=437	SAT TT=0.485	SAT TT=0.31 CHECKS=156435	SAT TT=0.213 CHECKS=108153	SAT TT=2.565 ASSIGNMENTS=17	SAT TT=2.38 ASSIGNMENTS=15	SAT TT=1.643 CHECKS=26207 NODES=392	SAT TT=1.499 CHECKS=117565 NODES=1256	SAT TT=1.622 CHECKS=1189680 NODES=1487	SAT TT=0.07 ASSIGNMENTS=57 CHECKS=8104	SAT TT=0.072 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.381	SAT TT=2.55	SAT TT=0.063 ASSIGNMENTS=83 CHECKS=15568	SAT TT=0.223 ASSIGNMENTS=3906 CHECKS=600434	SAT TT=1.897	SAT TT=0.073 ASSIGNMENTS=391 CHECKS=60088	SAT TT=0.057 ASSIGNMENTS=57 CHECKS=8104	SAT TT=2.624	SAT TT=3.12 ASSIGNMENTS=15534 CHECKS=3419420	SAT TT=1.343	SAT TT=1.426
csp/QWH-15/ normalized-qwh-15-106-7_ext.xml	SAT TT=0.139	SAT TT=2.566 CHECKS=1279100 NODES=7906	SAT TT=1.802 CHECKS=431497 NODES=3295	SAT TT=0.508	SAT TT=8.292 CHECKS=6505890	SAT TT=0.619 CHECKS=511293	SAT TT=2.866 ASSIGNMENTS=33	SAT TT=2.779 ASSIGNMENTS=27	SAT TT=4.766 CHECKS=200271 NODES=3884	SAT TT=1.81 CHECKS=782172 NODES=12169	SAT TT=1.903 CHECKS=2910910 NODES=3825	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=0.201 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=2.515	SAT TT=2.675	SAT TT=0.139 ASSIGNMENTS=1017 CHECKS=298371	SAT TT=0.166 ASSIGNMENTS=2230 CHECKS=379518	SAT TT=1.631	SAT TT=0.239 ASSIGNMENTS=2564 CHECKS=642280	SAT TT=0.187 ASSIGNMENTS=1641 CHECKS=471301	SAT TT=3.168	SAT TT=3.538 ASSIGNMENTS=14925 CHECKS=2825110	SAT TT=1.406	SAT TT=1.685
csp/QWH-15/ normalized-qwh-15-106-8_ext.xml	SAT TT=0.107	SAT TT=1.873 CHECKS=451515 NODES=3199	SAT TT=1.66 CHECKS=325371 NODES=2130	SAT TT=0.309	SAT TT=2.036 CHECKS=1459400	SAT TT=0.671 CHECKS=547997	SAT TT=1.645 ASSIGNMENTS=2	SAT TT=1.565 ASSIGNMENTS=2	SAT TT=3.954 CHECKS=157607 NODES=2629	SAT TT=4.079 CHECKS=5663200 NODES=97312	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=761 CHECKS=266823	SAT TT=0.138 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.539	SAT TT=2.528	SAT TT=0.107 ASSIGNMENTS=562 CHECKS=197270	SAT TT=0.249 ASSIGNMENTS=4030 CHECKS=713042	SAT TT=3.065	SAT TT=0.112 ASSIGNMENTS=800 CHECKS=196145	SAT TT=0.13 ASSIGNMENTS=761 CHECKS=266823	SAT TT=2.659	SAT TT=2.398 ASSIGNMENTS=14266 CHECKS=3197610	SAT TT=1.337	SAT TT=1.449
csp/QWH-15/ normalized-qwh-15-106-9_ext.xml	SAT TT=0.058	SAT TT=1.429 CHECKS=182791 NODES=1754	SAT TT=1.42 CHECKS=89898 NODES=878	SAT TT=0.56	SAT TT=0.318 CHECKS=171747	SAT TT=0.241 CHECKS=139235	SAT TT=2.572 ASSIGNMENTS=38	SAT TT=2.367 ASSIGNMENTS=12	SAT TT=1.852 CHECKS=41959 NODES=734	SAT TT=1.545 CHECKS=259056 NODES=3564	SAT TT=1.71 CHECKS=1643710 NODES=2386	SAT TT=0.069 ASSIGNMENTS=54 CHECKS=9570	SAT TT=0.07 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.665	SAT TT=2.825	SAT TT=0.062 ASSIGNMENTS=60 CHECKS=9931	SAT TT=0.177 ASSIGNMENTS=2798 CHECKS=433332	SAT TT=1.814	SAT TT=0.127 ASSIGNMENTS=1050 CHECKS=245841	SAT TT=0.058 ASSIGNMENTS=54 CHECKS=9570	SAT TT=2.655	SAT TT=5.304 ASSIGNMENTS=20708 CHECKS=3564490	SAT TT=1.427	SAT TT=1.528
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-20/ normalized-qwh-20-166-0_ext.xml	SAT TT=2.236	SAT TT=15.508 CHECKS=11517500 NODES=50375	SAT TT=33.152 CHECKS=26904800 NODES=107063	SAT TT=89.149	SAT TT=243.652 CHECKS=174070000	SAT TT=90.837 CHECKS=60911100	SAT TT=6.908 ASSIGNMENTS=35	SAT TT=7.862 ASSIGNMENTS=72	SAT TT=63.922 CHECKS=1662390 NODES=27289	SAT TT=5.767 CHECKS=3769410 NODES=45728	? (TO) TT=1800.01	SAT TT=16.96 ASSIGNMENTS=529	SAT TT=21.421 ASSIGNMENTS=50375 CHECKS=11517500	SAT TT=3.999	SAT TT=3.936	SAT TT=17.473 ASSIGNMENTS=169822 CHECKS=68856000	SAT TT=4.476 ASSIGNMENTS=42006 CHECKS=17449900	SAT TT=347.054	SAT TT=3.084 ASSIGNMENTS=28377 CHECKS=12348400	SAT TT=17.799 ASSIGNMENTS=170479 CHECKS=69731100	SAT TT=4.25	SAT TT=514.774 ASSIGNMENTS=2591790 CHECKS=545638000	SAT TT=2.236	SAT TT=2.563
csp/QWH-20/ normalized-qwh-20-166-1_ext.xml	SAT TT=1.716	SAT TT=8.83 CHECKS=5725340 NODES=25633	SAT TT=27.383 CHECKS=22496500 NODES=89605	SAT TT=1.716	SAT TT=150.916 CHECKS=96048600	SAT TT=18.888 CHECKS=8932730	SAT TT=8.995 ASSIGNMENTS=73	SAT TT=8.14 ASSIGNMENTS=10	SAT TT=24.986 CHECKS=618756 NODES=8848	SAT TT=27.535 CHECKS=51015800 NODES=638419	? (TO) TT=1800.03	SAT TT=9.819 ASSIGNMENTS=38	SAT TT=15.634 ASSIGNMENTS=25633 CHECKS=5725340	SAT TT=4.326	SAT TT=4.232	SAT TT=3.883 ASSIGNMENTS=32061 CHECKS=14751700	SAT TT=4.154 ASSIGNMENTS=38437 CHECKS=16557200	SAT TT=174.528	SAT TT=3.513 ASSIGNMENTS=27702 CHECKS=13280200	SAT TT=5.499 ASSIGNMENTS=46586 CHECKS=21202900	SAT TT=4.941	? (TO) TT=1800.11	SAT TT=2.547	SAT TT=2.619
csp/QWH-20/ normalized-qwh-20-166-2_ext.xml	SAT TT=2.183	SAT TT=83.832 CHECKS=70261400 NODES=306910	SAT TT=56.864 CHECKS=46400900 NODES=200566	SAT TT=122.216	? (TO) TT=1800.05	SAT TT=939.622 CHECKS=883736000	SAT TT=8.085 ASSIGNMENTS=17	SAT TT=9.044 ASSIGNMENTS=19	SAT TT=241.482 CHECKS=5534910 NODES=103299	SAT TT=51.245 CHECKS=98857800 NODES=1174550	? (TO) TT=1800	SAT TT=11.542 ASSIGNMENTS=132	SAT TT=97.886 ASSIGNMENTS=306910 CHECKS=70261400	SAT TT=4.186	SAT TT=4.251	SAT TT=40.889 ASSIGNMENTS=425229 CHECKS=164033000	SAT TT=11.921 ASSIGNMENTS=126256 CHECKS=48426500	SAT TT=491.933	SAT TT=11.821 ASSIGNMENTS=116001 CHECKS=46881500	SAT TT=34.723 ASSIGNMENTS=353975 CHECKS=138431000	SAT TT=4.787	? (TO) TT=1800.05	SAT TT=2.183	SAT TT=2.407
csp/QWH-20/ normalized-qwh-20-166-3_ext.xml	SAT TT=2.38	SAT TT=62.008 CHECKS=50666800 NODES=209532	SAT TT=93.066 CHECKS=76454500 NODES=310267	SAT TT=15.367	SAT TT=90.834 CHECKS=60274500	SAT TT=25.778 CHECKS=11638200	SAT TT=7.173 ASSIGNMENTS=19	SAT TT=6.863 ASSIGNMENTS=29	SAT TT=24.426 CHECKS=534323 NODES=8388	SAT TT=5.774 CHECKS=3844450 NODES=47110	? (TO) TT=1800.03	SAT TT=10.404 ASSIGNMENTS=66	SAT TT=64.659 ASSIGNMENTS=209532 CHECKS=50666800	SAT TT=4.412	SAT TT=4.094	SAT TT=8.938 ASSIGNMENTS=78624 CHECKS=34123200	SAT TT=11.541 ASSIGNMENTS=99621 CHECKS=46252900	SAT TT=881.654	SAT TT=3.465 ASSIGNMENTS=28585 CHECKS=13053700	SAT TT=13.355 ASSIGNMENTS=109728 CHECKS=51367400	SAT TT=5.251	? (TO) TT=1800.11	SAT TT=2.38	SAT TT=2.509
csp/QWH-20/ normalized-qwh-20-166-4_ext.xml	SAT TT=1.187	SAT TT=12.823 CHECKS=8778950 NODES=39697	SAT TT=4.969 CHECKS=2796380 NODES=13196	SAT TT=1.526	SAT TT=11.202 CHECKS=6001560	SAT TT=4.64 CHECKS=1976180	SAT TT=6.64 ASSIGNMENTS=16	SAT TT=6.771 ASSIGNMENTS=14	SAT TT=6.86 CHECKS=105061 NODES=1322	SAT TT=5.26 CHECKS=2580650 NODES=31537	? (TO) TT=1800.09	SAT TT=9.195 ASSIGNMENTS=31	SAT TT=19.445 ASSIGNMENTS=39697 CHECKS=8778950	SAT TT=4.032	SAT TT=4.122	SAT TT=2.256 ASSIGNMENTS=20693 CHECKS=8539040	SAT TT=3.589 ASSIGNMENTS=34287 CHECKS=13839200	SAT TT=199.061	SAT TT=1.187 ASSIGNMENTS=9389 CHECKS=4318250	SAT TT=1.814 ASSIGNMENTS=15648 CHECKS=6886240	SAT TT=4.486	SAT TT=169.447 ASSIGNMENTS=653808 CHECKS=191929000	SAT TT=2.085	SAT TT=2.726
csp/QWH-20/ normalized-qwh-20-166-5_ext.xml	SAT TT=1.941	SAT TT=13.167 CHECKS=9460090 NODES=45533	SAT TT=5.874 CHECKS=3123370 NODES=15218	SAT TT=1.941	SAT TT=6.84 CHECKS=3567520	SAT TT=23.014 CHECKS=11522400	SAT TT=8.518 ASSIGNMENTS=208	SAT TT=6.192 ASSIGNMENTS=10	SAT TT=141.922 CHECKS=3499360 NODES=62078	SAT TT=6.608 CHECKS=4091910 NODES=50111	? (TO) TT=1800.09	SAT TT=9.495 ASSIGNMENTS=32	SAT TT=20.402 ASSIGNMENTS=45533 CHECKS=9460090	SAT TT=4.246	SAT TT=4.243	SAT TT=3.746 ASSIGNMENTS=35579 CHECKS=14496900	SAT TT=12.308 ASSIGNMENTS=110498 CHECKS=48128900	SAT TT=114.592	SAT TT=7.746 ASSIGNMENTS=71292 CHECKS=30423800	SAT TT=15.366 ASSIGNMENTS=135868 CHECKS=60617800	SAT TT=4.596	SAT TT=316.2 ASSIGNMENTS=1555780 CHECKS=348153000	SAT TT=1.983	SAT TT=2.179
csp/QWH-20/ normalized-qwh-20-166-6_ext.xml	SAT TT=2.093	SAT TT=678.38 CHECKS=578453000 NODES=2289160	SAT TT=733.98 CHECKS=617480000 NODES=2449220	SAT TT=26.211	SAT TT=630.792 CHECKS=426506000	SAT TT=743.975 CHECKS=686394000	SAT TT=13.455 ASSIGNMENTS=355	SAT TT=7.137 ASSIGNMENTS=35	SAT TT=1023.6 CHECKS=30148200 NODES=484442	SAT TT=19.064 CHECKS=31813800 NODES=396025	? (TO) TT=1800	SAT TT=14.513 ASSIGNMENTS=344	SAT TT=627.073 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4	SAT TT=4.761	SAT TT=72.722 ASSIGNMENTS=647024 CHECKS=282775000	SAT TT=95.031 ASSIGNMENTS=1011610 CHECKS=402841000	SAT TT=780.898	SAT TT=184.517 ASSIGNMENTS=1777640 CHECKS=709264000	SAT TT=75.137 ASSIGNMENTS=780693 CHECKS=308737000	SAT TT=4.22	? (TO) TT=1800.05	SAT TT=2.093	SAT TT=3.218
csp/QWH-20/ normalized-qwh-20-166-7_ext.xml	SAT TT=0.958	SAT TT=41.942 CHECKS=33707000 NODES=127619	SAT TT=11.904 CHECKS=9003780 NODES=38014	SAT TT=0.958	SAT TT=100.448 CHECKS=72003400	SAT TT=112.313 CHECKS=89976700	SAT TT=8.087 ASSIGNMENTS=51	SAT TT=7.975 ASSIGNMENTS=27	SAT TT=205.782 CHECKS=5035250 NODES=87964	SAT TT=12.327 CHECKS=18455200 NODES=226394	? (TO) TT=1800.1	SAT TT=15.568 ASSIGNMENTS=51	SAT TT=44.722 ASSIGNMENTS=127619 CHECKS=33707000	SAT TT=3.735	SAT TT=4.041	SAT TT=3.465 ASSIGNMENTS=28393 CHECKS=13047700	SAT TT=11.602 ASSIGNMENTS=116825 CHECKS=49517700	SAT TT=441.75	SAT TT=6.603 ASSIGNMENTS=58019 CHECKS=24849900	SAT TT=3.53 ASSIGNMENTS=31841 CHECKS=14313600	SAT TT=4.18	? (TO) TT=1800.04	SAT TT=2.229	SAT TT=2.585
csp/QWH-20/ normalized-qwh-20-166-8_ext.xml	SAT TT=2.007	SAT TT=84.218 CHECKS=71402200 NODES=272925	SAT TT=21.75 CHECKS=16821300 NODES=69120	SAT TT=71.257	SAT TT=896.464 CHECKS=647662000	SAT TT=20.241 CHECKS=10284500	SAT TT=8.278 ASSIGNMENTS=120	SAT TT=6.99 ASSIGNMENTS=39	SAT TT=83.253 CHECKS=2131390 NODES=38238	SAT TT=5.235 CHECKS=2514800 NODES=29043	? (TO) TT=1800.08	SAT TT=10.001 ASSIGNMENTS=70	SAT TT=83.624 ASSIGNMENTS=272925 CHECKS=71402200	SAT TT=3.843	SAT TT=3.811	SAT TT=8.494 ASSIGNMENTS=80871 CHECKS=33500100	SAT TT=7.827 ASSIGNMENTS=80558 CHECKS=33414100	SAT TT=306.823	SAT TT=4.492 ASSIGNMENTS=40807 CHECKS=19010900	SAT TT=8.109 ASSIGNMENTS=77692 CHECKS=31563100	SAT TT=4.437	SAT TT=229.047 ASSIGNMENTS=480934 CHECKS=134917000	SAT TT=2.007	SAT TT=2.519
csp/QWH-20/ normalized-qwh-20-166-9_ext.xml	SAT TT=0.841	SAT TT=21.36 CHECKS=16379600 NODES=73618	SAT TT=11.699 CHECKS=7600770 NODES=35262	SAT TT=0.846	SAT TT=428.237 CHECKS=317784000	SAT TT=2.296 CHECKS=665759	SAT TT=7.477 ASSIGNMENTS=80	SAT TT=6.889 ASSIGNMENTS=30	SAT TT=8.993 CHECKS=175160 NODES=2514	SAT TT=6.216 CHECKS=4654520 NODES=58992	? (TO) TT=1800	SAT TT=10.124 ASSIGNMENTS=96	SAT TT=27.502 ASSIGNMENTS=73618 CHECKS=16379600	SAT TT=3.943	SAT TT=4.088	SAT TT=3.675 ASSIGNMENTS=29011 CHECKS=14404000	SAT TT=0.841 ASSIGNMENTS=8644 CHECKS=2821260	SAT TT=63.026	SAT TT=3.088 ASSIGNMENTS=27411 CHECKS=13017300	SAT TT=2.932 ASSIGNMENTS=24655 CHECKS=12165800	SAT TT=4.431	? (TO) TT=1800.08	SAT TT=2.212	SAT TT=2.494
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/QWH-25/ normalized-qwh-25-235-0_ext.xml	SAT TT=19.9	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=399.005 ASSIGNMENTS=9494	SAT TT=335.483 ASSIGNMENTS=5457	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=343.013 ASSIGNMENTS=7890	SAT TT=991.238 ASSIGNMENTS=7890	SAT TT=48.226	SAT TT=22.389	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=32.764	? (TO) TT=1800.12	SAT TT=86.579	SAT TT=19.9
csp/QWH-25/ normalized-qwh-25-235-1_ext.xml	SAT TT=7.361	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=23.131 ASSIGNMENTS=198	SAT TT=65.014 ASSIGNMENTS=960	? (TO) TT=1800	SAT TT=963.326 CHECKS=1345400000 NODES=13734500	? (TO) TT=1800.05	SAT TT=23.459 ASSIGNMENTS=334	SAT TT=690.394 ASSIGNMENTS=334	SAT TT=8.505	SAT TT=7.361	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	SAT TT=640.229 ASSIGNMENTS=4632240 CHECKS=2618280000	? (TO) TT=1800.06	SAT TT=9.069	? (TO) TT=1800.15	SAT TT=9.755	SAT TT=7.458
csp/QWH-25/ normalized-qwh-25-235-2_ext.xml	SAT TT=5.692	? (TO) TT=1800.14	SAT TT=1532.01 CHECKS=1246070000 NODES=4261460	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=22.389 ASSIGNMENTS=195	SAT TT=27.407 ASSIGNMENTS=206	? (TO) TT=1800.02	SAT TT=140.889 CHECKS=193682000 NODES=1935340	? (TO) TT=1800	SAT TT=124.7 ASSIGNMENTS=2703	SAT TT=772.638 ASSIGNMENTS=2703	SAT TT=9.178	SAT TT=8.742	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=179.871 ASSIGNMENTS=1445520 CHECKS=711821000	? (TO) TT=1800.02	SAT TT=10.874	? (TO) TT=1800.14	SAT TT=5.692	SAT TT=8.045
csp/QWH-25/ normalized-qwh-25-235-3_ext.xml	SAT TT=6.393	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=63.268 ASSIGNMENTS=1043	SAT TT=29.985 ASSIGNMENTS=163	? (TO) TT=1800.09	SAT TT=95.901 CHECKS=131244000 NODES=1347400	? (TO) TT=1800.09	SAT TT=59.641 ASSIGNMENTS=1055	SAT TT=726.237 ASSIGNMENTS=1055	SAT TT=7.524	SAT TT=9.301	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=8.943	? (TO) TT=1800.14	SAT TT=7.895	SAT TT=6.393
csp/QWH-25/ normalized-qwh-25-235-4_ext.xml	SAT TT=5.744	SAT TT=851.102 CHECKS=691923000 NODES=2374620	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=98.695 ASSIGNMENTS=2144	SAT TT=24.8 ASSIGNMENTS=201	? (TO) TT=1800.07	SAT TT=277.508 CHECKS=419937000 NODES=4227880	? (TO) TT=1800.05	SAT TT=199.635 ASSIGNMENTS=4963	SAT TT=845.541 ASSIGNMENTS=4963	SAT TT=14.262	SAT TT=8.012	? (TO) TT=1800.03	SAT TT=54.891 ASSIGNMENTS=407004 CHECKS=226938000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=6.335	? (TO) TT=1800.14	SAT TT=9.52	SAT TT=5.744
csp/QWH-25/ normalized-qwh-25-235-5_ext.xml	SAT TT=2.685	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=43.613 ASSIGNMENTS=542	SAT TT=20.195 ASSIGNMENTS=87	? (TO) TT=1800.06	SAT TT=984.404 CHECKS=1513140000 NODES=15523500	? (TO) TT=1800.06	SAT TT=97.5 ASSIGNMENTS=1745	SAT TT=757.572 ASSIGNMENTS=1745	SAT TT=7.827	SAT TT=8.491	? (TO) TT=1800.1	SAT TT=826.678 ASSIGNMENTS=6686550 CHECKS=3398580000	? (TO) TT=1800.06	SAT TT=238.706 ASSIGNMENTS=1894360 CHECKS=946654000	? (TO) TT=1800.08	SAT TT=10.604	? (TO) TT=1800.08	SAT TT=2.685	SAT TT=8.27
csp/QWH-25/ normalized-qwh-25-235-6_ext.xml	SAT TT=5.536	SAT TT=416.661 CHECKS=367598000 NODES=1287530	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=26.723 ASSIGNMENTS=267	SAT TT=24.777 ASSIGNMENTS=197	? (TO) TT=1800.01	SAT TT=1118.34 CHECKS=1752430000 NODES=17638400	? (TO) TT=1800.08	SAT TT=63.076 ASSIGNMENTS=1413	SAT TT=466.091 ASSIGNMENTS=1287530 CHECKS=367598000	SAT TT=9.066	SAT TT=9.045	SAT TT=1338.31 ASSIGNMENTS=11559000 CHECKS=1437760000	? (TO) TT=1800.02	SAT TT=1275.86	SAT TT=1610.55 ASSIGNMENTS=13712000 CHECKS=2365100000	? (TO) TT=1800.11	SAT TT=5.74	? (TO) TT=1800.14	SAT TT=5.774	SAT TT=5.536
csp/QWH-25/ normalized-qwh-25-235-7_ext.xml	SAT TT=9.976	? (TO) TT=1800.15	SAT TT=1012.88 CHECKS=891983000 NODES=3159650	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=1078.93 ASSIGNMENTS=28993	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=34.93 CHECKS=34652100 NODES=353146	? (TO) TT=1800.02	SAT TT=94.405 ASSIGNMENTS=2075	SAT TT=736.61 ASSIGNMENTS=2075	SAT TT=16.464	SAT TT=9.976	SAT TT=1439.83 ASSIGNMENTS=12193300 CHECKS=1970930000	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=53.854	? (TO) TT=1800.06	SAT TT=83.951	SAT TT=25.78
csp/QWH-25/ normalized-qwh-25-235-8_ext.xml	SAT TT=6.162	? (TO) TT=1800.16	SAT TT=1328.48 CHECKS=1127200000 NODES=3879170	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=389.248 ASSIGNMENTS=8273	SAT TT=34.871 ASSIGNMENTS=381	? (TO) TT=1800.03	SAT TT=75.15 CHECKS=86619000 NODES=872996	? (TO) TT=1800.04	SAT TT=17.73 ASSIGNMENTS=208	SAT TT=684.913 ASSIGNMENTS=208	SAT TT=7.592	SAT TT=9.335	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=17.327	? (TO) TT=1800.15	SAT TT=6.162	SAT TT=10.321
csp/QWH-25/ normalized-qwh-25-235-9_ext.xml	SAT TT=7.719	SAT TT=1123.08 CHECKS=890204000 NODES=3172820	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=376.323 ASSIGNMENTS=8346	SAT TT=19.661 ASSIGNMENTS=90	? (TO) TT=1800.01	SAT TT=147.261 CHECKS=195806000 NODES=2003980	? (TO) TT=1800.06	SAT TT=374.027 ASSIGNMENTS=8346	SAT TT=1066.64 ASSIGNMENTS=8346	SAT TT=8.724	SAT TT=7.719	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=723.251 ASSIGNMENTS=5604060 CHECKS=2888380000	? (TO) TT=1800.07	SAT TT=23.533	? (TO) TT=1800.13	SAT TT=17.934	SAT TT=8.402
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-23/ normalized-rand-23-23-253-131-46021_ext.xml	UNSAT TT=22.416	UNSAT TT=96.493 CHECKS=533169000 NODES=398553	UNSAT TT=94.597 CHECKS=532351000 NODES=398015	UNSAT TT=22.416	UNSAT TT=735.712 CHECKS=218785000	UNSAT TT=500.384 CHECKS=92168600	UNSAT TT=142.58 ASSIGNMENTS=188574	UNSAT TT=150.896 ASSIGNMENTS=188574	UNSAT TT=117.499 CHECKS=29226500 NODES=439459	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=44.885 ASSIGNMENTS=384589 CHECKS=157639000	UNSAT TT=96.014 ASSIGNMENTS=398553 CHECKS=533169000	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=34.325 ASSIGNMENTS=388764 CHECKS=159740000	UNSAT TT=39.227 ASSIGNMENTS=407900 CHECKS=166703000	? (TO) TT=1800.12	UNSAT TT=36.352 ASSIGNMENTS=412299 CHECKS=169003000	UNSAT TT=34.284 ASSIGNMENTS=384589 CHECKS=157639000	? (TO) TT=1800.08	UNSAT TT=493.428 ASSIGNMENTS=409929 CHECKS=622859000	? (TO) TT=1800.09	? (TO) TT=1800.04
csp/rand-2-23/ normalized-rand-23-23-253-131-47021_ext.xml	UNSAT TT=19.782	UNSAT TT=89.888 CHECKS=539958000 NODES=401195	UNSAT TT=91.112 CHECKS=543707000 NODES=404017	UNSAT TT=19.782	UNSAT TT=889.333 CHECKS=255497000	UNSAT TT=508.22 CHECKS=89201600	UNSAT TT=133.043 ASSIGNMENTS=181934	UNSAT TT=148.274 ASSIGNMENTS=181934	UNSAT TT=124.334 CHECKS=29145300 NODES=434935	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=45.147 ASSIGNMENTS=395034 CHECKS=163451000	UNSAT TT=98.222 ASSIGNMENTS=401195 CHECKS=539958000	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=38.148 ASSIGNMENTS=402640 CHECKS=165885000	UNSAT TT=37.567 ASSIGNMENTS=390675 CHECKS=160940000	? (TO) TT=1800.09	UNSAT TT=36.141 ASSIGNMENTS=394360 CHECKS=162732000	UNSAT TT=37.55 ASSIGNMENTS=395034 CHECKS=163451000	? (TO) TT=1800.15	UNSAT TT=518.774 ASSIGNMENTS=396010 CHECKS=604015000	? (TO) TT=1800.09	? (TO) TT=1800.06
csp/rand-2-23/ normalized-rand-23-23-253-131-48021_ext.xml	SAT TT=5.175	SAT TT=39.719 CHECKS=217622000 NODES=162155	SAT TT=38.687 CHECKS=212054000 NODES=158138	SAT TT=5.175	SAT TT=290.696 CHECKS=87249600	SAT TT=160.976 CHECKS=30004200	SAT TT=105.624 ASSIGNMENTS=132336	SAT TT=117.735 ASSIGNMENTS=132336	SAT TT=43.979 CHECKS=10069800 NODES=150437	SAT TT=8.491 CHECKS=59319000 NODES=117182	SAT TT=1566.28 CHECKS=10502000000 NODES=5155690	SAT TT=20.47 ASSIGNMENTS=129255 CHECKS=52884500	SAT TT=44.253 ASSIGNMENTS=162155 CHECKS=217622000	SAT TT=169.142	? (TO) TT=1800.03	SAT TT=22.376 ASSIGNMENTS=251997 CHECKS=103514000	SAT TT=11.072 ASSIGNMENTS=126740 CHECKS=51486200	SAT TT=1514.25	SAT TT=6.221 ASSIGNMENTS=64139 CHECKS=26278600	SAT TT=12.395 ASSIGNMENTS=129255 CHECKS=52884500	? (TO) TT=1800.16	SAT TT=116.133 ASSIGNMENTS=64131 CHECKS=97844800	SAT TT=1198.47	? (TO) TT=1800.05
csp/rand-2-23/ normalized-rand-23-23-253-131-49021_ext.xml	SAT TT=3.386	SAT TT=14.107 CHECKS=72465500 NODES=54631	SAT TT=13.762 CHECKS=70516800 NODES=53062	SAT TT=15.875	SAT TT=801.051 CHECKS=229143000	SAT TT=351.196 CHECKS=66421000	SAT TT=12.638 ASSIGNMENTS=14425	SAT TT=13.829 ASSIGNMENTS=14425	SAT TT=76.191 CHECKS=17410300 NODES=259781	SAT TT=54.062 CHECKS=409586000 NODES=809278	? (TO) TT=1800.07	SAT TT=12.42 ASSIGNMENTS=49308 CHECKS=20104800	SAT TT=21.444 ASSIGNMENTS=54631 CHECKS=72465500	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=3.386 ASSIGNMENTS=35898 CHECKS=14618900	SAT TT=15.201 ASSIGNMENTS=161070 CHECKS=65825400	SAT TT=1310.13	SAT TT=19.182 ASSIGNMENTS=200759 CHECKS=82712000	SAT TT=4.684 ASSIGNMENTS=49308 CHECKS=20104800	? (TO) TT=1800.17	SAT TT=153.363 ASSIGNMENTS=144913 CHECKS=224387000	SAT TT=288.602	? (TO) TT=1800.09
csp/rand-2-23/ normalized-rand-23-23-253-131-50021_ext.xml	SAT TT=3.707	SAT TT=68.224 CHECKS=372168000 NODES=283408	SAT TT=68.054 CHECKS=372414000 NODES=283348	SAT TT=18.381	SAT TT=249.154 CHECKS=69532500	SAT TT=68.779 CHECKS=12632900	SAT TT=142.248 ASSIGNMENTS=198953	SAT TT=170.758 ASSIGNMENTS=198953	SAT TT=106.136 CHECKS=24283500 NODES=369051	SAT TT=3.764 CHECKS=25738400 NODES=50817	? (TO) TT=1800.02	SAT TT=19.124 ASSIGNMENTS=120701 CHECKS=48578800	SAT TT=71.246 ASSIGNMENTS=283408 CHECKS=372168000	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=30.627 ASSIGNMENTS=353961 CHECKS=143629000	SAT TT=18.403 ASSIGNMENTS=197022 CHECKS=79727800	SAT TT=1521.66	SAT TT=3.707 ASSIGNMENTS=42496 CHECKS=16971700	SAT TT=11.383 ASSIGNMENTS=120701 CHECKS=48578800	? (TO) TT=1800.14	SAT TT=89.904 ASSIGNMENTS=24708 CHECKS=35504300	SAT TT=1316.77	SAT TT=34.992
csp/rand-2-23/ normalized-rand-23-23-253-131-51021_ext.xml	UNSAT TT=23.169	UNSAT TT=101.144 CHECKS=562904000 NODES=422183	UNSAT TT=101.69 CHECKS=561518000 NODES=421807	UNSAT TT=23.169	UNSAT TT=950.811 CHECKS=261326000	UNSAT TT=502.703 CHECKS=94820100	UNSAT TT=161.519 ASSIGNMENTS=206864	UNSAT TT=166.036 ASSIGNMENTS=206864	UNSAT TT=132.303 CHECKS=30132700 NODES=453877	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=49.526 ASSIGNMENTS=441309 CHECKS=180994000	UNSAT TT=47.019 ASSIGNMENTS=441309 CHECKS=180994000	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=39.7 ASSIGNMENTS=449184 CHECKS=183500000	UNSAT TT=41.123 ASSIGNMENTS=431923 CHECKS=176336000	? (TO) TT=1800.1	UNSAT TT=39.02 ASSIGNMENTS=439242 CHECKS=179912000	UNSAT TT=39.179 ASSIGNMENTS=441309 CHECKS=180994000	? (TO) TT=1800.2	UNSAT TT=505.358 ASSIGNMENTS=419396 CHECKS=637345000	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/rand-2-23/ normalized-rand-23-23-253-131-52021_ext.xml	UNSAT TT=21.389	UNSAT TT=91.948 CHECKS=512578000 NODES=378497	UNSAT TT=91.224 CHECKS=511852000 NODES=377631	UNSAT TT=21.389	UNSAT TT=843.612 CHECKS=249713000	UNSAT TT=618.456 CHECKS=112021000	UNSAT TT=131.312 ASSIGNMENTS=178927	UNSAT TT=156.532 ASSIGNMENTS=178927	UNSAT TT=120.828 CHECKS=27564700 NODES=411870	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=42.802 ASSIGNMENTS=397901 CHECKS=164363000	UNSAT TT=92.549 ASSIGNMENTS=378497 CHECKS=512578000	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=35.046 ASSIGNMENTS=380924 CHECKS=157006000	UNSAT TT=37.316 ASSIGNMENTS=388200 CHECKS=159503000	? (TO) TT=1800.1	UNSAT TT=36.122 ASSIGNMENTS=378555 CHECKS=156225000	UNSAT TT=37.981 ASSIGNMENTS=397901 CHECKS=164363000	? (TO) TT=1800.11	UNSAT TT=320.485 ASSIGNMENTS=370652 CHECKS=568510000	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/rand-2-23/ normalized-rand-23-23-253-131-53021_ext.xml	SAT TT=2.822	SAT TT=75.704 CHECKS=443801000 NODES=329021	SAT TT=74.313 CHECKS=440558000 NODES=326414	SAT TT=11.146	SAT TT=103.316 CHECKS=26967500	SAT TT=337.099 CHECKS=63798300	SAT TT=80.592 ASSIGNMENTS=103260	SAT TT=85.174 ASSIGNMENTS=103260	SAT TT=67.004 CHECKS=16882700 NODES=251429	SAT TT=122.304 CHECKS=1009520000 NODES=1994700	? (TO) TT=1800.09	SAT TT=35.733 ASSIGNMENTS=302971 CHECKS=125038000	SAT TT=36.774 ASSIGNMENTS=302971 CHECKS=125038000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=2.822 ASSIGNMENTS=29404 CHECKS=11982400	SAT TT=21.406 ASSIGNMENTS=227447 CHECKS=93031600	SAT TT=1077.57	SAT TT=4.695 ASSIGNMENTS=48401 CHECKS=19792500	SAT TT=27.815 ASSIGNMENTS=302971 CHECKS=125038000	? (TO) TT=1800.12	SAT TT=71.49 ASSIGNMENTS=62038 CHECKS=95682100	SAT TT=418.232	? (TO) TT=1800.06
csp/rand-2-23/ normalized-rand-23-23-253-131-54021_ext.xml	SAT TT=0.811	SAT TT=19.193 CHECKS=100834000 NODES=76678	SAT TT=18.42 CHECKS=96406500 NODES=73599	SAT TT=12.762	SAT TT=231.606 CHECKS=65259300	SAT TT=2.26 CHECKS=364396	SAT TT=88.625 ASSIGNMENTS=121725	SAT TT=105.304 ASSIGNMENTS=121725	SAT TT=0.811 CHECKS=27399 NODES=272	SAT TT=5.59 CHECKS=38974300 NODES=76975	SAT TT=260.178 CHECKS=1877970000 NODES=949100	SAT TT=9.187 ASSIGNMENTS=15951 CHECKS=6633180	SAT TT=26.56 ASSIGNMENTS=76678 CHECKS=100834000	? (TO) TT=1800.08	SAT TT=1381.35	SAT TT=16.48 ASSIGNMENTS=184923 CHECKS=75986800	SAT TT=5.593 ASSIGNMENTS=65172 CHECKS=25897900	SAT TT=281.58	SAT TT=21.12 ASSIGNMENTS=219847 CHECKS=89707600	SAT TT=1.465 ASSIGNMENTS=15951 CHECKS=6633180	? (TO) TT=1800.09	SAT TT=290.165 ASSIGNMENTS=304000 CHECKS=460191000	SAT TT=188.53	SAT TT=805.344
csp/rand-2-23/ normalized-rand-23-23-253-131-55021_ext.xml	UNSAT TT=22.347	UNSAT TT=95.572 CHECKS=530105000 NODES=396088	UNSAT TT=96.247 CHECKS=527259000 NODES=393986	UNSAT TT=22.347	UNSAT TT=933.805 CHECKS=259278000	UNSAT TT=463.729 CHECKS=90367800	UNSAT TT=137.084 ASSIGNMENTS=185544	UNSAT TT=160.234 ASSIGNMENTS=185544	UNSAT TT=111.782 CHECKS=28241200 NODES=425598	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=45.841 ASSIGNMENTS=404123 CHECKS=165423000	UNSAT TT=97.106 ASSIGNMENTS=396088 CHECKS=530105000	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=38.627 ASSIGNMENTS=434730 CHECKS=178183000	UNSAT TT=40.934 ASSIGNMENTS=434318 CHECKS=177530000	? (TO) TT=1800.08	UNSAT TT=39.203 ASSIGNMENTS=412282 CHECKS=169276000	UNSAT TT=38.137 ASSIGNMENTS=404123 CHECKS=165423000	? (TO) TT=1800.11	UNSAT TT=498.465 ASSIGNMENTS=416351 CHECKS=630602000	? (TO) TT=1800.1	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-24/ normalized-rand-24-24-276-139-48021_ext.xml	SAT TT=2.009	SAT TT=66.229 CHECKS=360552000 NODES=257174	SAT TT=60.053 CHECKS=361825000 NODES=257652	SAT TT=3.286	SAT TT=1762.96 CHECKS=499084000	SAT TT=4.766 CHECKS=771811	SAT TT=59.735 ASSIGNMENTS=68090	SAT TT=58.085 ASSIGNMENTS=68090	SAT TT=211.674 CHECKS=46403600 NODES=686833	SAT TT=5.98 CHECKS=40404300 NODES=73145	? (TO) TT=1800.08	SAT TT=27.173 ASSIGNMENTS=204412 CHECKS=88954500	SAT TT=68.279 ASSIGNMENTS=257174 CHECKS=360552000	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=20.824 ASSIGNMENTS=217758 CHECKS=94882100	SAT TT=10.508 ASSIGNMENTS=103299 CHECKS=44579700	SAT TT=372.304	SAT TT=77.232 ASSIGNMENTS=736516 CHECKS=322795000	SAT TT=21.255 ASSIGNMENTS=204412 CHECKS=88954500	? (TO) TT=1800.14	SAT TT=2.009 ASSIGNMENTS=748 CHECKS=1172300	? (TO) TT=1800.04	SAT TT=479.011
csp/rand-2-24/ normalized-rand-24-24-276-139-49021_ext.xml	UNSAT TT=48.246	UNSAT TT=200.805 CHECKS=1207730000 NODES=839841	UNSAT TT=213.756 CHECKS=1204170000 NODES=836873	UNSAT TT=48.246	? (TO) TT=1800.1	UNSAT TT=918.495 CHECKS=167487000	UNSAT TT=329.217 ASSIGNMENTS=392312	UNSAT TT=315.412 ASSIGNMENTS=392312	UNSAT TT=269.181 CHECKS=62349900 NODES=910012	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=93.34 ASSIGNMENTS=838067 CHECKS=368644000	UNSAT TT=217.264 ASSIGNMENTS=839841 CHECKS=1207730000	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=80.941 ASSIGNMENTS=778136 CHECKS=341993000	UNSAT TT=81.344 ASSIGNMENTS=790847 CHECKS=346880000	? (TO) TT=1800.11	UNSAT TT=90.882 ASSIGNMENTS=850339 CHECKS=375601000	UNSAT TT=84.487 ASSIGNMENTS=838067 CHECKS=368644000	? (TO) TT=1800.14	UNSAT TT=1105.38 ASSIGNMENTS=871473 CHECKS=1405020000	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/rand-2-24/ normalized-rand-24-24-276-139-50021_ext.xml	SAT TT=2.804	SAT TT=42.513 CHECKS=234733000 NODES=166976	SAT TT=42.506 CHECKS=232604000 NODES=165664	SAT TT=2.804	SAT TT=579.726 CHECKS=159937000	SAT TT=817.497 CHECKS=146342000	SAT TT=36.697 ASSIGNMENTS=45411	SAT TT=35.744 ASSIGNMENTS=45411	SAT TT=235.284 CHECKS=54520000 NODES=797412	SAT TT=123.522 CHECKS=1011160000 NODES=1831430	? (TO) TT=1800.1	SAT TT=19.345 ASSIGNMENTS=110625 CHECKS=48262300	SAT TT=46.762 ASSIGNMENTS=166976 CHECKS=234733000	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=14.32 ASSIGNMENTS=139336 CHECKS=60754900	SAT TT=25.502 ASSIGNMENTS=268504 CHECKS=116794000	? (TO) TT=1800.06	SAT TT=31.738 ASSIGNMENTS=303968 CHECKS=133453000	SAT TT=11.258 ASSIGNMENTS=110625 CHECKS=48262300	? (TO) TT=1800.13	SAT TT=695.136 ASSIGNMENTS=737258 CHECKS=1178840000	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/rand-2-24/ normalized-rand-24-24-276-139-51021_ext.xml	UNSAT TT=46.547	UNSAT TT=218.029 CHECKS=1222180000 NODES=852867	UNSAT TT=216.31 CHECKS=1217920000 NODES=850241	UNSAT TT=46.547	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=337.686 ASSIGNMENTS=425255	UNSAT TT=327.705 ASSIGNMENTS=425255	UNSAT TT=265.896 CHECKS=61855700 NODES=905038	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=96.026 ASSIGNMENTS=861857 CHECKS=378822000	UNSAT TT=206.505 ASSIGNMENTS=852867 CHECKS=1222180000	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=86.541 ASSIGNMENTS=905083 CHECKS=397446000	UNSAT TT=91.684 ASSIGNMENTS=888562 CHECKS=390640000	? (TO) TT=1800.03	UNSAT TT=92.812 ASSIGNMENTS=881478 CHECKS=386924000	UNSAT TT=83.047 ASSIGNMENTS=861857 CHECKS=378822000	? (TO) TT=1800.16	UNSAT TT=1110.85 ASSIGNMENTS=867784 CHECKS=1401450000	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/rand-2-24/ normalized-rand-24-24-276-139-52021_ext.xml	UNSAT TT=44.878	UNSAT TT=217.321 CHECKS=1218930000 NODES=852772	UNSAT TT=199.89 CHECKS=1218640000 NODES=852052	UNSAT TT=44.878	? (TO) TT=1800.06	UNSAT TT=1059.09 CHECKS=187121000	UNSAT TT=352.075 ASSIGNMENTS=420028	UNSAT TT=334.663 ASSIGNMENTS=420028	UNSAT TT=281.997 CHECKS=63028100 NODES=923341	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=100.143 ASSIGNMENTS=905639 CHECKS=399422000	UNSAT TT=206.725 ASSIGNMENTS=852772 CHECKS=1218930000	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=93.267 ASSIGNMENTS=899872 CHECKS=396029000	UNSAT TT=88.872 ASSIGNMENTS=863148 CHECKS=378583000	? (TO) TT=1800.1	UNSAT TT=92.304 ASSIGNMENTS=908414 CHECKS=399648000	UNSAT TT=89.111 ASSIGNMENTS=905639 CHECKS=399422000	? (TO) TT=1800.12	UNSAT TT=1116.72 ASSIGNMENTS=902362 CHECKS=1451190000	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/rand-2-24/ normalized-rand-24-24-276-139-53021_ext.xml	UNSAT TT=46.142	UNSAT TT=214.137 CHECKS=1210830000 NODES=851845	UNSAT TT=201.499 CHECKS=1211730000 NODES=851864	UNSAT TT=46.142	? (TO) TT=1800.07	UNSAT TT=1166.89 CHECKS=195716000	UNSAT TT=332.761 ASSIGNMENTS=430003	UNSAT TT=348.889 ASSIGNMENTS=430003	UNSAT TT=266.498 CHECKS=64694700 NODES=955553	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=103.359 ASSIGNMENTS=928184 CHECKS=406476000	UNSAT TT=218.641 ASSIGNMENTS=851845 CHECKS=1210830000	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=93.821 ASSIGNMENTS=914250 CHECKS=400421000	UNSAT TT=88.189 ASSIGNMENTS=920321 CHECKS=400980000	? (TO) TT=1800.05	UNSAT TT=87.83 ASSIGNMENTS=908358 CHECKS=396845000	UNSAT TT=88.593 ASSIGNMENTS=928184 CHECKS=406476000	? (TO) TT=1800.13	UNSAT TT=1217.72 ASSIGNMENTS=912563 CHECKS=1455430000	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/rand-2-24/ normalized-rand-24-24-276-139-54021_ext.xml	UNSAT TT=49.472	UNSAT TT=214.288 CHECKS=1204420000 NODES=846312	UNSAT TT=199.539 CHECKS=1200230000 NODES=843554	UNSAT TT=49.472	? (TO) TT=1800.04	UNSAT TT=1133.42 CHECKS=189550000	UNSAT TT=344.414 ASSIGNMENTS=434118	UNSAT TT=332.651 ASSIGNMENTS=434118	UNSAT TT=270.818 CHECKS=61137300 NODES=900623	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=93.599 ASSIGNMENTS=869144 CHECKS=381059000	UNSAT TT=205.783 ASSIGNMENTS=846312 CHECKS=1204420000	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=86.576 ASSIGNMENTS=900992 CHECKS=395121000	UNSAT TT=88.477 ASSIGNMENTS=870026 CHECKS=379656000	? (TO) TT=1800.13	UNSAT TT=95.299 ASSIGNMENTS=921877 CHECKS=403835000	UNSAT TT=85.981 ASSIGNMENTS=869144 CHECKS=381059000	? (TO) TT=1800.07	UNSAT TT=1165.45 ASSIGNMENTS=945633 CHECKS=1506710000	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/rand-2-24/ normalized-rand-24-24-276-139-55021_ext.xml	SAT TT=5.384	SAT TT=32.603 CHECKS=178266000 NODES=128737	SAT TT=33.605 CHECKS=183296000 NODES=131329	SAT TT=28.537	SAT TT=1711.12 CHECKS=483083000	SAT TT=159.546 CHECKS=26500800	SAT TT=100.983 ASSIGNMENTS=119555	SAT TT=90.555 ASSIGNMENTS=119555	SAT TT=21.172 CHECKS=4902390 NODES=72453	SAT TT=18.34 CHECKS=136050000 NODES=246388	? (TO) TT=1800.05	SAT TT=12.682 ASSIGNMENTS=52551 CHECKS=22982100	SAT TT=39.941 ASSIGNMENTS=128737 CHECKS=178266000	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=8.887 ASSIGNMENTS=88388 CHECKS=38533000	SAT TT=7.382 ASSIGNMENTS=75106 CHECKS=32069300	SAT TT=1243.58	SAT TT=68.077 ASSIGNMENTS=682438 CHECKS=298830000	SAT TT=5.384 ASSIGNMENTS=52551 CHECKS=22982100	? (TO) TT=1800.15	SAT TT=656.205 ASSIGNMENTS=565566 CHECKS=902690000	? (TO) TT=1800.09	SAT TT=950.93
csp/rand-2-24/ normalized-rand-24-24-276-139-56021_ext.xml	UNSAT TT=50.615	UNSAT TT=231.273 CHECKS=1295510000 NODES=911013	UNSAT TT=228.584 CHECKS=1284920000 NODES=903188	UNSAT TT=50.615	? (TO) TT=1800.05	UNSAT TT=1129.39 CHECKS=200974000	UNSAT TT=355.753 ASSIGNMENTS=421992	UNSAT TT=317.022 ASSIGNMENTS=421992	UNSAT TT=275.537 CHECKS=62452200 NODES=918422	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=91.551 ASSIGNMENTS=885203 CHECKS=387148000	UNSAT TT=234.239 ASSIGNMENTS=911013 CHECKS=1295510000	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=95.459 ASSIGNMENTS=926372 CHECKS=407350000	UNSAT TT=91.75 ASSIGNMENTS=884249 CHECKS=385926000	? (TO) TT=1800.08	UNSAT TT=92.815 ASSIGNMENTS=909281 CHECKS=398017000	UNSAT TT=85.541 ASSIGNMENTS=885203 CHECKS=387148000	? (TO) TT=1800.14	UNSAT TT=1122.94 ASSIGNMENTS=911702 CHECKS=1455850000	? (TO) TT=1800.14	? (TO) TT=1800.13
csp/rand-2-24/ normalized-rand-24-24-276-139-57021_ext.xml	UNSAT TT=44.685	UNSAT TT=211.813 CHECKS=1196000000 NODES=829442	UNSAT TT=212.291 CHECKS=1192500000 NODES=827363	UNSAT TT=44.685	? (TO) TT=1800.01	UNSAT TT=1044.16 CHECKS=184058000	UNSAT TT=345.125 ASSIGNMENTS=404257	UNSAT TT=312.063 ASSIGNMENTS=404257	UNSAT TT=255.279 CHECKS=60754500 NODES=890236	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=89.592 ASSIGNMENTS=860974 CHECKS=378566000	UNSAT TT=200.69 ASSIGNMENTS=829442 CHECKS=1196000000	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=88.971 ASSIGNMENTS=863505 CHECKS=380008000	UNSAT TT=81.44 ASSIGNMENTS=843684 CHECKS=371025000	? (TO) TT=1800.08	UNSAT TT=85.941 ASSIGNMENTS=872867 CHECKS=383250000	UNSAT TT=89.935 ASSIGNMENTS=860974 CHECKS=378566000	? (TO) TT=1800.13	UNSAT TT=1186.8 ASSIGNMENTS=854171 CHECKS=1379490000	? (TO) TT=1800.14	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-25/ normalized-rand-25-25-300-147-50021_ext.xml	UNSAT TT=107.632	UNSAT TT=475.116 CHECKS=2885910000 NODES=1905630	UNSAT TT=504.538 CHECKS=2880290000 NODES=1902140	UNSAT TT=107.632	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=736.701 ASSIGNMENTS=911836	UNSAT TT=737.083 ASSIGNMENTS=911836	UNSAT TT=660.541 CHECKS=139345000 NODES=2002670	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=218.472 ASSIGNMENTS=1940510 CHECKS=908851000	UNSAT TT=473.647 ASSIGNMENTS=1905630 CHECKS=2885910000	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=200.463 ASSIGNMENTS=1901870 CHECKS=887916000	UNSAT TT=191.953 ASSIGNMENTS=1911460 CHECKS=892444000	? (TO) TT=1800.09	UNSAT TT=209.038 ASSIGNMENTS=1914350 CHECKS=893124000	UNSAT TT=213.334 ASSIGNMENTS=1940510 CHECKS=908851000	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.1
csp/rand-2-25/ normalized-rand-25-25-300-147-51021_ext.xml	SAT TT=17.791	SAT TT=52.412 CHECKS=307690000 NODES=207574	SAT TT=55.088 CHECKS=310305000 NODES=209187	SAT TT=23.269	? (TO) TT=1800.08	SAT TT=520.187 CHECKS=74229300	SAT TT=68.199 ASSIGNMENTS=77028	SAT TT=68.259 ASSIGNMENTS=77028	SAT TT=299.554 CHECKS=63340000 NODES=912077	SAT TT=17.791 CHECKS=144361000 NODES=240519	? (TO) TT=1800.1	SAT TT=74.975 ASSIGNMENTS=625344 CHECKS=290008000	SAT TT=58.848 ASSIGNMENTS=207574 CHECKS=307690000	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=78.735 ASSIGNMENTS=724347 CHECKS=336973000	SAT TT=60.014 ASSIGNMENTS=600179 CHECKS=279308000	? (TO) TT=1800.06	SAT TT=108.137 ASSIGNMENTS=1062880 CHECKS=496400000	SAT TT=62.988 ASSIGNMENTS=625344 CHECKS=290008000	? (TO) TT=1800.14	SAT TT=512.991 ASSIGNMENTS=258446 CHECKS=435965000	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/rand-2-25/ normalized-rand-25-25-300-147-52021_ext.xml	SAT TT=1.945	SAT TT=458.282 CHECKS=2586830000 NODES=1715120	SAT TT=453.551 CHECKS=2587730000 NODES=1715780	SAT TT=1.945	? (TO) TT=1800.02	SAT TT=1387.74 CHECKS=209473000	SAT TT=180.692 ASSIGNMENTS=224939	SAT TT=180.304 ASSIGNMENTS=224939	SAT TT=530.123 CHECKS=111184000 NODES=1608380	SAT TT=59.063 CHECKS=450848000 NODES=751218	? (TO) TT=1800.08	SAT TT=104.994 ASSIGNMENTS=893445 CHECKS=413503000	SAT TT=434.267 ASSIGNMENTS=1715120 CHECKS=2586830000	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=106.398 ASSIGNMENTS=979408 CHECKS=454881000	SAT TT=205.113 ASSIGNMENTS=1882190 CHECKS=877792000	? (TO) TT=1800.04	SAT TT=42.875 ASSIGNMENTS=396564 CHECKS=183213000	SAT TT=98.363 ASSIGNMENTS=893445 CHECKS=413503000	? (TO) TT=1800.15	SAT TT=218.331 ASSIGNMENTS=14984 CHECKS=25106700	? (TO) TT=1800.12	? (TO) TT=1800.12
csp/rand-2-25/ normalized-rand-25-25-300-147-53021_ext.xml	SAT TT=0.808	SAT TT=8.435 CHECKS=41161500 NODES=29309	SAT TT=29.266 CHECKS=160045000 NODES=111802	SAT TT=76.005	SAT TT=531.592 CHECKS=132452000	? (TO) TT=1800.11	SAT TT=410.653 ASSIGNMENTS=509564	SAT TT=446.888 ASSIGNMENTS=509564	SAT TT=236.877 CHECKS=54288800 NODES=784456	SAT TT=0.808 CHECKS=733485 NODES=1169	? (TO) TT=1800.06	SAT TT=22.195 ASSIGNMENTS=145935 CHECKS=68306800	SAT TT=15.388 ASSIGNMENTS=29309 CHECKS=41161500	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=145.7 ASSIGNMENTS=1329110 CHECKS=620534000	SAT TT=9.631 ASSIGNMENTS=90009 CHECKS=41667800	? (TO) TT=1800.1	SAT TT=13.709 ASSIGNMENTS=121876 CHECKS=57102900	SAT TT=14.815 ASSIGNMENTS=145935 CHECKS=68306800	? (TO) TT=1800.13	SAT TT=10.117 ASSIGNMENTS=6713 CHECKS=11024500	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/rand-2-25/ normalized-rand-25-25-300-147-54021_ext.xml	SAT TT=9.298	SAT TT=82.066 CHECKS=488488000 NODES=328170	SAT TT=86.065 CHECKS=486602000 NODES=327133	SAT TT=40.194	SAT TT=332.742 CHECKS=76467000	SAT TT=72.896 CHECKS=12113100	SAT TT=149.252 ASSIGNMENTS=184166	SAT TT=161.361 ASSIGNMENTS=184166	SAT TT=140.172 CHECKS=32345200 NODES=467642	SAT TT=11.041 CHECKS=81865500 NODES=136389	? (TO) TT=1800.09	SAT TT=175.89 ASSIGNMENTS=1519940 CHECKS=709718000	SAT TT=87.524 ASSIGNMENTS=328170 CHECKS=488488000	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=9.298 ASSIGNMENTS=93083 CHECKS=43269000	SAT TT=53.548 ASSIGNMENTS=497193 CHECKS=228423000	? (TO) TT=1800.03	SAT TT=30.917 ASSIGNMENTS=286600 CHECKS=131996000	SAT TT=153.099 ASSIGNMENTS=1519940 CHECKS=709718000	? (TO) TT=1800.13	SAT TT=1299.23 ASSIGNMENTS=1076830 CHECKS=1792660000	? (TO) TT=1800.04	SAT TT=407.837
csp/rand-2-25/ normalized-rand-25-25-300-147-55021_ext.xml	UNSAT TT=112.041	UNSAT TT=505.506 CHECKS=2852920000 NODES=1873800	UNSAT TT=461.901 CHECKS=2856310000 NODES=1876330	UNSAT TT=112.041	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=761.465 ASSIGNMENTS=877517	UNSAT TT=768.537 ASSIGNMENTS=877517	UNSAT TT=602.561 CHECKS=140116000 NODES=2005510	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=198.822 ASSIGNMENTS=1902060 CHECKS=891558000	UNSAT TT=466.362 ASSIGNMENTS=1873800 CHECKS=2852920000	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=201.022 ASSIGNMENTS=1940120 CHECKS=910663000	UNSAT TT=195.007 ASSIGNMENTS=1915310 CHECKS=896406000	? (TO) TT=1800.07	UNSAT TT=203.747 ASSIGNMENTS=1989780 CHECKS=933378000	UNSAT TT=200.336 ASSIGNMENTS=1902060 CHECKS=891558000	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-25/ normalized-rand-25-25-300-147-56021_ext.xml	SAT TT=8.105	SAT TT=186.57 CHECKS=1047070000 NODES=705773	SAT TT=186.691 CHECKS=1051570000 NODES=708660	SAT TT=93.978	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=770.293 ASSIGNMENTS=961905	SAT TT=770.442 ASSIGNMENTS=961905	SAT TT=241.124 CHECKS=55914500 NODES=806636	SAT TT=193.74 CHECKS=1488880000 NODES=2480960	? (TO) TT=1800.04	SAT TT=187.931 ASSIGNMENTS=1771150 CHECKS=825986000	SAT TT=181.608 ASSIGNMENTS=705773 CHECKS=1047070000	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=43.481 ASSIGNMENTS=401774 CHECKS=185582000	SAT TT=8.105 ASSIGNMENTS=77259 CHECKS=34829600	? (TO) TT=1800.06	SAT TT=214.402 ASSIGNMENTS=1983530 CHECKS=926695000	SAT TT=190.782 ASSIGNMENTS=1771150 CHECKS=825986000	? (TO) TT=1800.13	SAT TT=138.478 ASSIGNMENTS=66959 CHECKS=111979000	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/rand-2-25/ normalized-rand-25-25-300-147-57021_ext.xml	UNSAT TT=113.236	UNSAT TT=488.431 CHECKS=2779210000 NODES=1825840	UNSAT TT=484.278 CHECKS=2768240000 NODES=1818530	UNSAT TT=113.236	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=773.522 ASSIGNMENTS=889479	UNSAT TT=743.812 ASSIGNMENTS=889479	UNSAT TT=623.192 CHECKS=138627000 NODES=1982050	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=210.312 ASSIGNMENTS=1864800 CHECKS=874483000	UNSAT TT=457.631 ASSIGNMENTS=1825840 CHECKS=2779210000	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=195.354 ASSIGNMENTS=1815280 CHECKS=851000000	UNSAT TT=214.945 ASSIGNMENTS=1978450 CHECKS=931513000	? (TO) TT=1800.11	UNSAT TT=204.641 ASSIGNMENTS=1873070 CHECKS=877892000	UNSAT TT=188.661 ASSIGNMENTS=1864800 CHECKS=874483000	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-25/ normalized-rand-25-25-300-147-58021_ext.xml	UNSAT TT=113.305	UNSAT TT=487.535 CHECKS=2928760000 NODES=1928720	UNSAT TT=511.134 CHECKS=2929430000 NODES=1929820	UNSAT TT=113.305	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=745.477 ASSIGNMENTS=936209	UNSAT TT=798.805 ASSIGNMENTS=936209	UNSAT TT=684.323 CHECKS=144570000 NODES=2077810	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=208.517 ASSIGNMENTS=1959470 CHECKS=918238000	UNSAT TT=505.997 ASSIGNMENTS=1928720 CHECKS=2928760000	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=207.493 ASSIGNMENTS=1893430 CHECKS=884805000	UNSAT TT=206.537 ASSIGNMENTS=1911280 CHECKS=895419000	? (TO) TT=1800.09	UNSAT TT=202.641 ASSIGNMENTS=1853260 CHECKS=867974000	UNSAT TT=215.928 ASSIGNMENTS=1959470 CHECKS=918238000	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/rand-2-25/ normalized-rand-25-25-300-147-59021_ext.xml	SAT TT=8.352	SAT TT=275.926 CHECKS=1561550000 NODES=1041490	SAT TT=272.582 CHECKS=1566140000 NODES=1043550	SAT TT=43.033	? (TO) TT=1800.07	SAT TT=284.53 CHECKS=44992700	SAT TT=357.848 ASSIGNMENTS=448165	SAT TT=360.876 ASSIGNMENTS=448165	SAT TT=485.607 CHECKS=109600000 NODES=1580140	SAT TT=8.352 CHECKS=64124100 NODES=106820	? (TO) TT=1800.08	SAT TT=58.476 ASSIGNMENTS=514183 CHECKS=238797000	SAT TT=275.704 ASSIGNMENTS=1041490 CHECKS=1561550000	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=204.027 ASSIGNMENTS=1893770 CHECKS=886052000	SAT TT=155.581 ASSIGNMENTS=1562480 CHECKS=729007000	? (TO) TT=1800.05	SAT TT=227.144 ASSIGNMENTS=2036920 CHECKS=953861000	SAT TT=51.367 ASSIGNMENTS=514183 CHECKS=238797000	? (TO) TT=1800.12	SAT TT=799.268 ASSIGNMENTS=41685 CHECKS=68361400	? (TO) TT=1800.11	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-26/ normalized-rand-26-26-325-155-52021_ext.xml	UNSAT TT=291.567	UNSAT TT=1170 CHECKS=7246210000 NODES=4551170	UNSAT TT=1234.79 CHECKS=7278110000 NODES=4570440	UNSAT TT=291.567	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1610.96 CHECKS=344139000 NODES=4879860	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=500.702 ASSIGNMENTS=4501490 CHECKS=2220650000	UNSAT TT=1189.57 ASSIGNMENTS=4551170 CHECKS=7246210000	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=491.253 ASSIGNMENTS=4482190 CHECKS=2211450000	UNSAT TT=504.795 ASSIGNMENTS=4332340 CHECKS=2140570000	? (TO) TT=1800.1	UNSAT TT=508.273 ASSIGNMENTS=4392540 CHECKS=2171510000	UNSAT TT=514.461 ASSIGNMENTS=4501490 CHECKS=2220650000	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-53021_ext.xml	SAT TT=74.507	SAT TT=488.582 CHECKS=2747490000 NODES=1738760	SAT TT=471.451 CHECKS=2705540000 NODES=1712600	SAT TT=130.733	? (TO) TT=1800.07	SAT TT=532.609 CHECKS=76451600	SAT TT=622.727 ASSIGNMENTS=732319	SAT TT=669.775 ASSIGNMENTS=732319	SAT TT=419.335 CHECKS=86304400 NODES=1226660	SAT TT=74.507 CHECKS=572688000 NODES=880856	? (TO) TT=1800.08	SAT TT=319.084 ASSIGNMENTS=2879850 CHECKS=1426670000	SAT TT=463.399 ASSIGNMENTS=1738760 CHECKS=2747490000	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=280.189 ASSIGNMENTS=2557020 CHECKS=1266670000	SAT TT=96.283 ASSIGNMENTS=830431 CHECKS=405480000	? (TO) TT=1800.12	SAT TT=146.669 ASSIGNMENTS=1256800 CHECKS=617760000	SAT TT=336.227 ASSIGNMENTS=2879850 CHECKS=1426670000	? (TO) TT=1800.18	SAT TT=1763.23 ASSIGNMENTS=1352370 CHECKS=2366150000	? (TO) TT=1800.05	SAT TT=634.817
csp/rand-2-26/ normalized-rand-26-26-325-155-54021_ext.xml	SAT TT=11.206	SAT TT=371.826 CHECKS=2101470000 NODES=1345220	SAT TT=345.023 CHECKS=2104180000 NODES=1346860	SAT TT=66.845	SAT TT=1644.68 CHECKS=392962000	? (TO) TT=1800.06	SAT TT=725.201 ASSIGNMENTS=808546	SAT TT=718.961 ASSIGNMENTS=808546	SAT TT=772.192 CHECKS=166532000 NODES=2368080	SAT TT=11.206 CHECKS=88974300 NODES=136828	SAT TT=1.492 CHECKS=5018890 NODES=5043	SAT TT=37.71 ASSIGNMENTS=258777 CHECKS=127833000	SAT TT=352.147 ASSIGNMENTS=1345220 CHECKS=2101470000	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=29.207 ASSIGNMENTS=252115 CHECKS=124265000	SAT TT=98.756 ASSIGNMENTS=908394 CHECKS=444034000	? (TO) TT=1800.07	SAT TT=140.284 ASSIGNMENTS=1199900 CHECKS=590341000	SAT TT=29.77 ASSIGNMENTS=258777 CHECKS=127833000	? (TO) TT=1800.19	SAT TT=63.431 ASSIGNMENTS=2717 CHECKS=4734370	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/rand-2-26/ normalized-rand-26-26-325-155-55021_ext.xml	SAT TT=33.314	SAT TT=334.003 CHECKS=1901920000 NODES=1202430	SAT TT=307.624 CHECKS=1869650000 NODES=1182580	SAT TT=89.045	? (TO) TT=1800.09	SAT TT=1650.78 CHECKS=231360000	SAT TT=1687.57 ASSIGNMENTS=1994820	SAT TT=1765.19 ASSIGNMENTS=1994820	SAT TT=1291.14 CHECKS=286550000 NODES=4043770	SAT TT=234.007 CHECKS=1981320000 NODES=3047540	? (TO) TT=1800.01	SAT TT=515.776 ASSIGNMENTS=4348020 CHECKS=2158560000	SAT TT=313.938 ASSIGNMENTS=1202430 CHECKS=1901920000	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=33.314 ASSIGNMENTS=280727 CHECKS=139531000	SAT TT=39.77 ASSIGNMENTS=367542 CHECKS=181709000	? (TO) TT=1800.1	SAT TT=59.763 ASSIGNMENTS=518455 CHECKS=255702000	SAT TT=466.157 ASSIGNMENTS=4348020 CHECKS=2158560000	? (TO) TT=1800.17	SAT TT=79.261 ASSIGNMENTS=28569 CHECKS=50370800	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-56021_ext.xml	UNSAT TT=264.937	UNSAT TT=1266.04 CHECKS=7252870000 NODES=4545840	UNSAT TT=1235.74 CHECKS=7256540000 NODES=4546850	UNSAT TT=264.937	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=1722.76 CHECKS=352037000 NODES=4974840	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=507.377 ASSIGNMENTS=4579750 CHECKS=2269450000	UNSAT TT=1177.76 ASSIGNMENTS=4545840 CHECKS=7252870000	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=505.879 ASSIGNMENTS=4620170 CHECKS=2289230000	UNSAT TT=493.841 ASSIGNMENTS=4505960 CHECKS=2226490000	? (TO) TT=1800.11	UNSAT TT=499.229 ASSIGNMENTS=4620530 CHECKS=2288230000	UNSAT TT=524.308 ASSIGNMENTS=4579750 CHECKS=2269450000	? (TO) TT=1800.61	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/rand-2-26/ normalized-rand-26-26-325-155-57021_ext.xml	UNSAT TT=276.757	UNSAT TT=1210.09 CHECKS=7015920000 NODES=4417690	UNSAT TT=1175.99 CHECKS=7021850000 NODES=4420660	UNSAT TT=276.757	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1640.61 CHECKS=341969000 NODES=4843420	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=556.501 ASSIGNMENTS=4733860 CHECKS=2341110000	UNSAT TT=1152.36 ASSIGNMENTS=4417690 CHECKS=7015920000	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=515.35 ASSIGNMENTS=4501240 CHECKS=2221670000	UNSAT TT=512.557 ASSIGNMENTS=4544040 CHECKS=2243480000	? (TO) TT=1800.09	UNSAT TT=537.484 ASSIGNMENTS=4658280 CHECKS=2307440000	UNSAT TT=546.6 ASSIGNMENTS=4733860 CHECKS=2341110000	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.15
csp/rand-2-26/ normalized-rand-26-26-325-155-58021_ext.xml	UNSAT TT=260.419	UNSAT TT=1215.36 CHECKS=7107960000 NODES=4462970	UNSAT TT=1166.22 CHECKS=7088050000 NODES=4451760	UNSAT TT=260.419	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=1473.88 CHECKS=328956000 NODES=4662900	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=551.869 ASSIGNMENTS=4691570 CHECKS=2319110000	UNSAT TT=1164.5 ASSIGNMENTS=4462970 CHECKS=7107960000	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=502.395 ASSIGNMENTS=4588640 CHECKS=2267240000	UNSAT TT=546.146 ASSIGNMENTS=4652680 CHECKS=2297180000	? (TO) TT=1800.04	UNSAT TT=552.202 ASSIGNMENTS=4744880 CHECKS=2340850000	UNSAT TT=507.811 ASSIGNMENTS=4691570 CHECKS=2319110000	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/rand-2-26/ normalized-rand-26-26-325-155-59021_ext.xml	SAT TT=75.046	SAT TT=1133.78 CHECKS=6596790000 NODES=4173600	SAT TT=1120.35 CHECKS=6638820000 NODES=4200470	SAT TT=275.969	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=700.225 ASSIGNMENTS=771510	SAT TT=653.567 ASSIGNMENTS=771510	SAT TT=835.961 CHECKS=182203000 NODES=2597540	SAT TT=75.046 CHECKS=632105000 NODES=972237	? (TO) TT=1800	SAT TT=291.402 ASSIGNMENTS=2621480 CHECKS=1292590000	SAT TT=1084.17 ASSIGNMENTS=4173600 CHECKS=6596790000	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=288.294 ASSIGNMENTS=2507820 CHECKS=1235730000	SAT TT=185.282 ASSIGNMENTS=1613280 CHECKS=791390000	? (TO) TT=1800.1	SAT TT=399.79 ASSIGNMENTS=3517910 CHECKS=1734290000	SAT TT=297.813 ASSIGNMENTS=2621480 CHECKS=1292590000	? (TO) TT=1800.13	SAT TT=350.877 ASSIGNMENTS=221126 CHECKS=386187000	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-60021_ext.xml	UNSAT TT=280.708	UNSAT TT=1186.75 CHECKS=6859850000 NODES=4289250	UNSAT TT=1155.75 CHECKS=6855260000 NODES=4288530	UNSAT TT=280.708	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1592.19 CHECKS=348946000 NODES=4904260	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=488.397 ASSIGNMENTS=4398790 CHECKS=2187410000	UNSAT TT=1168.55 ASSIGNMENTS=4289250 CHECKS=6859850000	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=474.532 ASSIGNMENTS=4169820 CHECKS=2068820000	UNSAT TT=521.623 ASSIGNMENTS=4416350 CHECKS=2192040000	? (TO) TT=1800.13	UNSAT TT=533.293 ASSIGNMENTS=4524370 CHECKS=2243320000	UNSAT TT=481.591 ASSIGNMENTS=4398790 CHECKS=2187410000	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13
csp/rand-2-26/ normalized-rand-26-26-325-155-61021_ext.xml	SAT TT=16.186	SAT TT=412.164 CHECKS=2339320000 NODES=1481240	SAT TT=379.326 CHECKS=2346210000 NODES=1483280	SAT TT=231.294	? (TO) TT=1800.1	SAT TT=461.776 CHECKS=63994800	SAT TT=1488.84 ASSIGNMENTS=1770830	SAT TT=1558.72 ASSIGNMENTS=1770830	SAT TT=285.284 CHECKS=62336100 NODES=884898	SAT TT=99.692 CHECKS=778346000 NODES=1197190	? (TO) TT=1800.02	SAT TT=182.003 ASSIGNMENTS=1497890 CHECKS=733251000	SAT TT=385.659 ASSIGNMENTS=1481240 CHECKS=2339320000	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=48.109 ASSIGNMENTS=414410 CHECKS=204939000	SAT TT=56.578 ASSIGNMENTS=491283 CHECKS=242013000	? (TO) TT=1800.12	SAT TT=71.098 ASSIGNMENTS=621766 CHECKS=302977000	SAT TT=174.244 ASSIGNMENTS=1497890 CHECKS=733251000	? (TO) TT=1800.15	SAT TT=935.911 ASSIGNMENTS=18721 CHECKS=31862700	? (TO) TT=1800.14	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-27/ normalized-rand-27-27-351-163-54021_ext.xml	SAT TT=39.221	SAT TT=518.283 CHECKS=2913850000 NODES=1764170	SAT TT=466.648 CHECKS=2862790000 NODES=1735170	SAT TT=302.673	SAT TT=1535.8 CHECKS=337842000	? (TO) TT=1800.07	SAT TT=1666.03 ASSIGNMENTS=1908750	SAT TT=1751.86 ASSIGNMENTS=1908750	SAT TT=205.152 CHECKS=41736300 NODES=581981	SAT TT=39.221 CHECKS=305679000 NODES=435322	? (TO) TT=1800.05	SAT TT=98.531 ASSIGNMENTS=762452 CHECKS=393017000	SAT TT=512.89 ASSIGNMENTS=1764170 CHECKS=2913850000	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=93.115 ASSIGNMENTS=760768 CHECKS=392144000	SAT TT=84.779 ASSIGNMENTS=689647 CHECKS=356895000	? (TO) TT=1800.1	SAT TT=88.889 ASSIGNMENTS=766059 CHECKS=402327000	SAT TT=91.905 ASSIGNMENTS=762452 CHECKS=393017000	? (TO) TT=1800.14	SAT TT=194.178 ASSIGNMENTS=133156 CHECKS=237466000	? (TO) TT=1800.14	? (TO) TT=1800.05
csp/rand-2-27/ normalized-rand-27-27-351-163-55021_ext.xml	UNSAT TT=649.53	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=649.53	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1184.66 ASSIGNMENTS=10067500 CHECKS=997937000	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1186.95 ASSIGNMENTS=10088000 CHECKS=1016310000	UNSAT TT=1133.93 ASSIGNMENTS=9815660 CHECKS=869883000	? (TO) TT=1800.04	UNSAT TT=1117.28 ASSIGNMENTS=9695890 CHECKS=797752000	UNSAT TT=1266.26 ASSIGNMENTS=10067500 CHECKS=997937000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/rand-2-27/ normalized-rand-27-27-351-163-56021_ext.xml	SAT TT=11.551	SAT TT=1129.72 CHECKS=6568260000 NODES=3938380	SAT TT=1066.43 CHECKS=6578250000 NODES=3943740	SAT TT=11.551	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=800.557 ASSIGNMENTS=876331	SAT TT=789.133 ASSIGNMENTS=876331	? (TO) TT=1800.04	SAT TT=77.193 CHECKS=656088000 NODES=934358	? (TO) TT=1800	SAT TT=245.316 ASSIGNMENTS=1975550 CHECKS=1029770000	SAT TT=1100.84 ASSIGNMENTS=3938380 CHECKS=6568260000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=244.34 ASSIGNMENTS=1975850 CHECKS=1029590000	SAT TT=125.508 ASSIGNMENTS=1033040 CHECKS=538907000	? (TO) TT=1800.05	SAT TT=304.722 ASSIGNMENTS=2484060 CHECKS=1299260000	SAT TT=243.473 ASSIGNMENTS=1975550 CHECKS=1029770000	? (TO) TT=1800.09	SAT TT=1761.44 ASSIGNMENTS=1500920 CHECKS=2780240000	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/rand-2-27/ normalized-rand-27-27-351-163-57021_ext.xml	UNSAT TT=637.335	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=637.335	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1243.23 ASSIGNMENTS=10398400 CHECKS=1129510000	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1226.39 ASSIGNMENTS=10369100 CHECKS=1115610000	UNSAT TT=1221.11 ASSIGNMENTS=10707400 CHECKS=1308980000	? (TO) TT=1800.04	UNSAT TT=1308.1 ASSIGNMENTS=10618600 CHECKS=1251130000	UNSAT TT=1186.19 ASSIGNMENTS=10398400 CHECKS=1129510000	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-27/ normalized-rand-27-27-351-163-58021_ext.xml	UNSAT TT=614.741	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=614.741	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1205.17 ASSIGNMENTS=10546800 CHECKS=1241420000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=1318.48 ASSIGNMENTS=10825600 CHECKS=1388210000	UNSAT TT=1118.51 ASSIGNMENTS=9871870 CHECKS=876236000	? (TO) TT=1800.06	UNSAT TT=1280.71 ASSIGNMENTS=10626800 CHECKS=1290840000	UNSAT TT=1220.17 ASSIGNMENTS=10546800 CHECKS=1241420000	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/rand-2-27/ normalized-rand-27-27-351-163-59021_ext.xml	UNSAT TT=640.244	? (TO) TT=1800.09	? (TO) TT=1800.17	UNSAT TT=640.244	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=1211.17 ASSIGNMENTS=10415200 CHECKS=1148830000	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=1243.58 ASSIGNMENTS=10776200 CHECKS=1344300000	UNSAT TT=1192.9 ASSIGNMENTS=10404700 CHECKS=1149450000	? (TO) TT=1800.09	UNSAT TT=1249.19 ASSIGNMENTS=10576600 CHECKS=1241860000	UNSAT TT=1192.76 ASSIGNMENTS=10415200 CHECKS=1148830000	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/rand-2-27/ normalized-rand-27-27-351-163-60021_ext.xml	SAT TT=154.041	SAT TT=159.193 CHECKS=973939000 NODES=576192	SAT TT=154.041 CHECKS=954643000 NODES=563382	SAT TT=534.268	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=1583.98 CHECKS=314194000 NODES=4335760	SAT TT=354.708 CHECKS=2812040000 NODES=4004900	? (TO) TT=1800.01	SAT TT=714.927 ASSIGNMENTS=6162560 CHECKS=3235710000	SAT TT=165.254 ASSIGNMENTS=576192 CHECKS=973939000	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=648.661 ASSIGNMENTS=5642300 CHECKS=2962640000	SAT TT=425.577 ASSIGNMENTS=3491900 CHECKS=1834060000	? (TO) TT=1800.04	SAT TT=350.568 ASSIGNMENTS=3047410 CHECKS=1592920000	SAT TT=722.034 ASSIGNMENTS=6162560 CHECKS=3235710000	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-2-27/ normalized-rand-27-27-351-163-61021_ext.xml	UNSAT TT=710.261	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=710.261	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1293.36 ASSIGNMENTS=11299800 CHECKS=1581930000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=1411.74 ASSIGNMENTS=11501200 CHECKS=1696040000	UNSAT TT=1314.26 ASSIGNMENTS=11369800 CHECKS=1613550000	? (TO) TT=1800.04	UNSAT TT=1339.52 ASSIGNMENTS=11141000 CHECKS=1504690000	UNSAT TT=1333.76 ASSIGNMENTS=11299800 CHECKS=1581930000	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/rand-2-27/ normalized-rand-27-27-351-163-62021_ext.xml	UNSAT TT=614.566	? (TO) TT=1800.14	? (TO) TT=1800.12	UNSAT TT=614.566	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1243.82 ASSIGNMENTS=10145100 CHECKS=1029940000	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1243.01 ASSIGNMENTS=10143700 CHECKS=1029480000	UNSAT TT=1258.31 ASSIGNMENTS=10064200 CHECKS=989803000	? (TO) TT=1800.03	UNSAT TT=1161.25 ASSIGNMENTS=10115600 CHECKS=1010630000	UNSAT TT=1166.09 ASSIGNMENTS=10145100 CHECKS=1029940000	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12
csp/rand-2-27/ normalized-rand-27-27-351-163-63021_ext.xml	SAT TT=101.245	SAT TT=391.378 CHECKS=2236910000 NODES=1345970	SAT TT=364.665 CHECKS=2237000000 NODES=1346900	SAT TT=603.986	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1230.45 ASSIGNMENTS=1373910	SAT TT=1304.28 ASSIGNMENTS=1373910	? (TO) TT=1800.03	SAT TT=101.245 CHECKS=788549000 NODES=1123020	? (TO) TT=1800.01	SAT TT=1001.75 ASSIGNMENTS=8796990 CHECKS=320063000	SAT TT=370.103 ASSIGNMENTS=1345970 CHECKS=2236910000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1055.26 ASSIGNMENTS=8640940 CHECKS=236682000	SAT TT=423.283 ASSIGNMENTS=3479330 CHECKS=1816440000	? (TO) TT=1800.1	SAT TT=633.102 ASSIGNMENTS=5046240 CHECKS=2645030000	SAT TT=1011.48 ASSIGNMENTS=8796990 CHECKS=320063000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-15_ext.xml	SAT TT=0.178	SAT TT=0.908 CHECKS=123920 NODES=197	SAT TT=0.92 CHECKS=195296 NODES=224	SAT TT=0.603	SAT TT=0.558 CHECKS=179373	SAT TT=0.497 CHECKS=142905	SAT TT=1.212 ASSIGNMENTS=606	SAT TT=1.139 ASSIGNMENTS=606	SAT TT=1.007 CHECKS=124898 NODES=1420	SAT TT=1.429 CHECKS=6274190 NODES=28221	SAT TT=1.344 CHECKS=4857740 NODES=10477	SAT TT=0.196 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=0.192 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=2.627	SAT TT=2.246	SAT TT=0.181 ASSIGNMENTS=1870 CHECKS=651701	SAT TT=0.233 ASSIGNMENTS=3774 CHECKS=905310	SAT TT=2.647	SAT TT=0.219 ASSIGNMENTS=2378 CHECKS=805830	SAT TT=0.178 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=4.637	SAT TT=0.365 ASSIGNMENTS=463 CHECKS=501836	SAT TT=1.679	SAT TT=2.994
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-16_ext.xml	SAT TT=0.516	SAT TT=2.622 CHECKS=8899850 NODES=9067	SAT TT=2.808 CHECKS=8924320 NODES=9107	SAT TT=1.087	SAT TT=67.68 CHECKS=23165500	SAT TT=25.727 CHECKS=8882320	SAT TT=2.144 ASSIGNMENTS=2298	SAT TT=2.432 ASSIGNMENTS=2298	SAT TT=2.556 CHECKS=704330 NODES=8309	SAT TT=0.808 CHECKS=1381640 NODES=6061	? (TO) TT=1800.01	SAT TT=0.535 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=0.536 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=13.231	SAT TT=13.58	SAT TT=1.125 ASSIGNMENTS=12254 CHECKS=4674600	SAT TT=0.708 ASSIGNMENTS=8839 CHECKS=2833900	SAT TT=22.647	SAT TT=1.035 ASSIGNMENTS=11532 CHECKS=4320670	SAT TT=0.516 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=51.594	SAT TT=9.443 ASSIGNMENTS=10308 CHECKS=13471800	SAT TT=6.533	SAT TT=22.32
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-19_ext.xml	SAT TT=0.062	SAT TT=1.21 CHECKS=528260 NODES=617	SAT TT=0.955 CHECKS=297234 NODES=317	SAT TT=0.486	SAT TT=5.615 CHECKS=2167280	SAT TT=0.453 CHECKS=135967	SAT TT=1.044 ASSIGNMENTS=196	SAT TT=0.942 ASSIGNMENTS=196	SAT TT=0.941 CHECKS=104884 NODES=1185	SAT TT=1.769 CHECKS=6791430 NODES=30588	? (TO) TT=1800.01	SAT TT=0.081 ASSIGNMENTS=474 CHECKS=166230	SAT TT=0.082 ASSIGNMENTS=474 CHECKS=166230	SAT TT=2.683	SAT TT=11.561	SAT TT=0.062 ASSIGNMENTS=420 CHECKS=140892	SAT TT=0.269 ASSIGNMENTS=4053 CHECKS=992457	SAT TT=4.248	SAT TT=0.303 ASSIGNMENTS=3302 CHECKS=1172650	SAT TT=0.069 ASSIGNMENTS=474 CHECKS=166230	SAT TT=6.881	SAT TT=0.372 ASSIGNMENTS=430 CHECKS=557670	SAT TT=4.771	SAT TT=1.315
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-1_ext.xml	SAT TT=0.284	SAT TT=1.877 CHECKS=4603140 NODES=4608	SAT TT=1.889 CHECKS=4885520 NODES=4933	SAT TT=1.169	SAT TT=14.887 CHECKS=5290830	SAT TT=13.67 CHECKS=4554690	SAT TT=1.377 ASSIGNMENTS=986	SAT TT=1.513 ASSIGNMENTS=986	SAT TT=2.008 CHECKS=556289 NODES=5984	SAT TT=1.08 CHECKS=3605040 NODES=15953	? (TO) TT=1800.01	SAT TT=0.624 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=0.618 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=2.456	SAT TT=6.212	SAT TT=0.584 ASSIGNMENTS=6139 CHECKS=2421360	SAT TT=0.284 ASSIGNMENTS=4198 CHECKS=1086540	SAT TT=6.951	SAT TT=0.591 ASSIGNMENTS=6122 CHECKS=2368420	SAT TT=0.602 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=8.829	SAT TT=5.261 ASSIGNMENTS=6154 CHECKS=8875920	SAT TT=2.608	SAT TT=2.926
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-22_ext.xml	SAT TT=0.129	SAT TT=0.984 CHECKS=343064 NODES=376	SAT TT=1.176 CHECKS=369477 NODES=377	SAT TT=0.502	SAT TT=1.681 CHECKS=620642	SAT TT=0.716 CHECKS=227760	SAT TT=1.126 ASSIGNMENTS=673	SAT TT=1.142 ASSIGNMENTS=673	SAT TT=1.104 CHECKS=193318 NODES=2133	SAT TT=0.648 CHECKS=565747 NODES=2453	SAT TT=0.634 CHECKS=79050 NODES=186	SAT TT=0.147 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=0.135 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=2.349	SAT TT=2.198	SAT TT=0.189 ASSIGNMENTS=2039 CHECKS=758625	SAT TT=0.353 ASSIGNMENTS=5417 CHECKS=1501960	SAT TT=2.219	SAT TT=0.129 ASSIGNMENTS=1403 CHECKS=470730	SAT TT=0.131 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=3.242	SAT TT=0.296 ASSIGNMENTS=233 CHECKS=290945	SAT TT=1.547	SAT TT=1.919
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-24_ext.xml	SAT TT=0.082	SAT TT=2.561 CHECKS=8115810 NODES=8584	SAT TT=2.623 CHECKS=8080930 NODES=8594	SAT TT=0.899	SAT TT=4.897 CHECKS=1783080	SAT TT=2.395 CHECKS=729140	SAT TT=1.079 ASSIGNMENTS=575	SAT TT=1.063 ASSIGNMENTS=575	SAT TT=1.562 CHECKS=384909 NODES=4187	SAT TT=3.037 CHECKS=17907200 NODES=87235	SAT TT=1078.74 CHECKS=7972670000 NODES=2303600	SAT TT=0.096 ASSIGNMENTS=642 CHECKS=226644	SAT TT=0.093 ASSIGNMENTS=642 CHECKS=226644	SAT TT=2.818	SAT TT=3.413	SAT TT=0.379 ASSIGNMENTS=4136 CHECKS=1481580	SAT TT=0.284 ASSIGNMENTS=4288 CHECKS=1040480	SAT TT=1.531	SAT TT=0.148 ASSIGNMENTS=1562 CHECKS=513736	SAT TT=0.082 ASSIGNMENTS=642 CHECKS=226644	SAT TT=7.776	SAT TT=0.825 ASSIGNMENTS=493 CHECKS=658842	SAT TT=3.013	SAT TT=2.073
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-26_ext.xml	SAT TT=0.123	SAT TT=0.823 CHECKS=18687 NODES=43	SAT TT=0.896 CHECKS=52354 NODES=42	SAT TT=1.279	SAT TT=9.187 CHECKS=3607620	SAT TT=6.619 CHECKS=2103710	SAT TT=4.249 ASSIGNMENTS=5829	SAT TT=3.79 ASSIGNMENTS=5829	SAT TT=2.471 CHECKS=589963 NODES=7146	SAT TT=1.479 CHECKS=5818670 NODES=26339	SAT TT=0.711 CHECKS=621543 NODES=1634	SAT TT=1.028 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=1.102 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=5.228	SAT TT=8.812	SAT TT=1.33 ASSIGNMENTS=16927 CHECKS=6105880	SAT TT=0.123 ASSIGNMENTS=1657 CHECKS=380613	SAT TT=15.52	SAT TT=0.375 ASSIGNMENTS=4585 CHECKS=1634280	SAT TT=1.072 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=9.148	SAT TT=5.501 ASSIGNMENTS=2572 CHECKS=2752160	SAT TT=4.113	SAT TT=7.822
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-28_ext.xml	SAT TT=0.075	SAT TT=3.162 CHECKS=11088300 NODES=11039	SAT TT=2.865 CHECKS=10331800 NODES=10275	SAT TT=0.721	SAT TT=4.258 CHECKS=1564640	SAT TT=0.792 CHECKS=227608	SAT TT=2.119 ASSIGNMENTS=1881	SAT TT=2.189 ASSIGNMENTS=1881	SAT TT=0.782 CHECKS=66421 NODES=717	SAT TT=0.896 CHECKS=1905360 NODES=9003	SAT TT=0.724 CHECKS=1075430 NODES=2965	SAT TT=0.087 ASSIGNMENTS=543 CHECKS=194398	SAT TT=0.087 ASSIGNMENTS=543 CHECKS=194398	SAT TT=2.477	SAT TT=3.545	SAT TT=0.271 ASSIGNMENTS=2824 CHECKS=1045100	SAT TT=0.091 ASSIGNMENTS=1118 CHECKS=254359	SAT TT=1.18	SAT TT=0.287 ASSIGNMENTS=3399 CHECKS=1186760	SAT TT=0.075 ASSIGNMENTS=543 CHECKS=194398	SAT TT=5.549	SAT TT=1.843 ASSIGNMENTS=976 CHECKS=1358060	SAT TT=1.496	SAT TT=1.345
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-29_ext.xml	SAT TT=0.288	SAT TT=0.902 CHECKS=80200 NODES=120	SAT TT=0.869 CHECKS=58293 NODES=50	SAT TT=1.221	SAT TT=5.763 CHECKS=2308350	SAT TT=4.354 CHECKS=1475450	SAT TT=2.498 ASSIGNMENTS=2280	SAT TT=2.366 ASSIGNMENTS=2280	SAT TT=1.175 CHECKS=195747 NODES=2166	SAT TT=2.127 CHECKS=11270100 NODES=50937	? (TO) TT=1800.08	SAT TT=0.402 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=0.404 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=2.413	SAT TT=5.022	SAT TT=0.328 ASSIGNMENTS=3307 CHECKS=1279910	SAT TT=0.751 ASSIGNMENTS=9560 CHECKS=3083300	SAT TT=8.667	SAT TT=0.288 ASSIGNMENTS=3308 CHECKS=1219400	SAT TT=0.387 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=11.107	SAT TT=4.843 ASSIGNMENTS=6125 CHECKS=7902050	SAT TT=1.86	SAT TT=4.496
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-2_ext.xml	SAT TT=0.093	SAT TT=1.527 CHECKS=1844270 NODES=1875	SAT TT=1.295 CHECKS=1833360 NODES=1823	SAT TT=0.914	SAT TT=6.045 CHECKS=2193290	SAT TT=0.561 CHECKS=174289	SAT TT=1.106 ASSIGNMENTS=538	SAT TT=1.045 ASSIGNMENTS=538	SAT TT=2.01 CHECKS=573376 NODES=6096	SAT TT=1.24 CHECKS=4163880 NODES=18829	? (TO) TT=1800.03	SAT TT=0.233 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=0.23 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=3.07	SAT TT=3.243	SAT TT=0.093 ASSIGNMENTS=706 CHECKS=269398	SAT TT=0.267 ASSIGNMENTS=4139 CHECKS=1069770	SAT TT=2.137	SAT TT=0.096 ASSIGNMENTS=986 CHECKS=322095	SAT TT=0.199 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=2.583	SAT TT=0.529 ASSIGNMENTS=276 CHECKS=409849	SAT TT=2.986	SAT TT=1.881
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-31_ext.xml	SAT TT=0.099	SAT TT=3.05 CHECKS=10505700 NODES=10043	SAT TT=3.203 CHECKS=10682600 NODES=10203	SAT TT=1.143	SAT TT=1.384 CHECKS=461644	SAT TT=0.704 CHECKS=212230	SAT TT=2.972 ASSIGNMENTS=3612	SAT TT=3.312 ASSIGNMENTS=3612	SAT TT=0.859 CHECKS=38314 NODES=413	SAT TT=5.231 CHECKS=30226300 NODES=136652	? (TO) TT=1800.09	SAT TT=0.617 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=0.576 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=3.51	SAT TT=4.982	SAT TT=0.137 ASSIGNMENTS=1323 CHECKS=467497	SAT TT=0.653 ASSIGNMENTS=9110 CHECKS=2867310	SAT TT=4.257	SAT TT=0.108 ASSIGNMENTS=1043 CHECKS=340257	SAT TT=0.609 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=3.474	SAT TT=0.099 ASSIGNMENTS=95 CHECKS=100550	SAT TT=3.659	SAT TT=4.011
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-34_ext.xml	SAT TT=0.03	SAT TT=0.82 CHECKS=8165 NODES=31	SAT TT=0.885 CHECKS=39025 NODES=31	SAT TT=0.404	SAT TT=0.132 CHECKS=21669	SAT TT=0.091 CHECKS=7359	SAT TT=0.755 ASSIGNMENTS=29	SAT TT=0.76 ASSIGNMENTS=29	SAT TT=0.827 CHECKS=32326 NODES=340	SAT TT=0.711 CHECKS=724091 NODES=3283	SAT TT=409.035 CHECKS=2851290000 NODES=1224660	SAT TT=0.042 ASSIGNMENTS=30 CHECKS=8910	SAT TT=0.042 ASSIGNMENTS=30 CHECKS=8910	SAT TT=2.109	SAT TT=3.139	SAT TT=0.032 ASSIGNMENTS=33 CHECKS=9607	SAT TT=0.233 ASSIGNMENTS=3748 CHECKS=907229	SAT TT=0.883	SAT TT=0.075 ASSIGNMENTS=732 CHECKS=228862	SAT TT=0.03 ASSIGNMENTS=30 CHECKS=8910	SAT TT=2.808	SAT TT=0.288 ASSIGNMENTS=306 CHECKS=340019	SAT TT=1.641	SAT TT=1.511
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-38_ext.xml	SAT TT=0.739	SAT TT=0.885 CHECKS=110060 NODES=154	SAT TT=1.497 CHECKS=2310440 NODES=2632	SAT TT=1.763	SAT TT=12.569 CHECKS=5020860	SAT TT=14.787 CHECKS=4863520	SAT TT=5.165 ASSIGNMENTS=8165	SAT TT=5.679 ASSIGNMENTS=8165	SAT TT=2.941 CHECKS=778456 NODES=9626	SAT TT=0.739 CHECKS=870495 NODES=3840	? (TO) TT=1800.07	SAT TT=1.021 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=1.021 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=6.954	SAT TT=3.42	SAT TT=1.076 ASSIGNMENTS=12692 CHECKS=4559080	SAT TT=0.979 ASSIGNMENTS=12496 CHECKS=4031100	SAT TT=6.166	SAT TT=0.978 ASSIGNMENTS=12305 CHECKS=4375400	SAT TT=0.992 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=14.599	SAT TT=9.024 ASSIGNMENTS=11674 CHECKS=13410600	SAT TT=5.048	SAT TT=1.712
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-41_ext.xml	SAT TT=0.183	SAT TT=2.95 CHECKS=10094900 NODES=11354	SAT TT=3.155 CHECKS=10383100 NODES=11702	SAT TT=0.879	SAT TT=5.826 CHECKS=2395940	SAT TT=4.723 CHECKS=1588920	SAT TT=3.269 ASSIGNMENTS=4830	SAT TT=3.559 ASSIGNMENTS=4830	SAT TT=3.502 CHECKS=975984 NODES=11017	SAT TT=0.977 CHECKS=1925540 NODES=8613	SAT TT=0.631 CHECKS=147112 NODES=423	SAT TT=0.29 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=0.286 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=5.351	SAT TT=3.409	SAT TT=0.183 ASSIGNMENTS=1815 CHECKS=668429	SAT TT=0.791 ASSIGNMENTS=10418 CHECKS=3263410	SAT TT=4.15	SAT TT=0.2 ASSIGNMENTS=2104 CHECKS=746236	SAT TT=0.27 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=11.863	SAT TT=8.476 ASSIGNMENTS=7482 CHECKS=10006300	SAT TT=1.175	SAT TT=2.167
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-42_ext.xml	SAT TT=0.204	SAT TT=0.886 CHECKS=78877 NODES=109	SAT TT=1.014 CHECKS=510458 NODES=514	SAT TT=1.215	SAT TT=78.517 CHECKS=25106000	SAT TT=10.012 CHECKS=3338060	SAT TT=3 ASSIGNMENTS=3251	SAT TT=3.156 ASSIGNMENTS=3251	SAT TT=1.844 CHECKS=436037 NODES=4689	SAT TT=1.069 CHECKS=3029090 NODES=14030	? (TO) TT=1800.08	SAT TT=0.41 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=0.41 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=3.927	SAT TT=10.014	SAT TT=0.383 ASSIGNMENTS=4020 CHECKS=1508420	SAT TT=0.614 ASSIGNMENTS=7980 CHECKS=2457460	SAT TT=7.338	SAT TT=0.204 ASSIGNMENTS=2184 CHECKS=757805	SAT TT=0.399 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=8.326	SAT TT=4.471 ASSIGNMENTS=4508 CHECKS=6251840	SAT TT=1.719	SAT TT=2.785
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-45_ext.xml	SAT TT=0.06	SAT TT=0.838 CHECKS=23815 NODES=47	SAT TT=0.935 CHECKS=56847 NODES=41	SAT TT=0.503	SAT TT=19.04 CHECKS=7299270	SAT TT=3.249 CHECKS=1058720	SAT TT=1.318 ASSIGNMENTS=858	SAT TT=1.399 ASSIGNMENTS=858	SAT TT=1.155 CHECKS=219664 NODES=2232	SAT TT=0.673 CHECKS=435371 NODES=1911	SAT TT=0.91 CHECKS=1052620 NODES=2621	SAT TT=0.159 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=0.16 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=2.153	SAT TT=2.542	SAT TT=0.06 ASSIGNMENTS=365 CHECKS=134158	SAT TT=0.262 ASSIGNMENTS=4145 CHECKS=1039480	SAT TT=2.265	SAT TT=0.115 ASSIGNMENTS=1181 CHECKS=412423	SAT TT=0.145 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=3.875	SAT TT=0.91 ASSIGNMENTS=344 CHECKS=464126	SAT TT=1.798	SAT TT=1.305
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-49_ext.xml	SAT TT=0.159	SAT TT=1.706 CHECKS=3865680 NODES=4179	SAT TT=1.842 CHECKS=3966590 NODES=4123	SAT TT=0.553	SAT TT=9.746 CHECKS=3611280	SAT TT=0.413 CHECKS=112440	SAT TT=1.148 ASSIGNMENTS=704	SAT TT=1.238 ASSIGNMENTS=704	SAT TT=0.966 CHECKS=123562 NODES=1327	SAT TT=0.644 CHECKS=514704 NODES=2223	? (TO) TT=1800.04	SAT TT=0.174 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=0.181 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=5.898	SAT TT=2.633	SAT TT=0.304 ASSIGNMENTS=3169 CHECKS=1186160	SAT TT=0.35 ASSIGNMENTS=4865 CHECKS=1345960	SAT TT=5.213	SAT TT=0.243 ASSIGNMENTS=2582 CHECKS=924587	SAT TT=0.159 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=2.421	SAT TT=2.042 ASSIGNMENTS=1534 CHECKS=2127940	SAT TT=3.584	SAT TT=2.966
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-4_ext.xml	SAT TT=0.204	SAT TT=1.597 CHECKS=3069070 NODES=3077	SAT TT=1.618 CHECKS=2897420 NODES=2862	SAT TT=0.566	SAT TT=5.399 CHECKS=2042990	SAT TT=1.191 CHECKS=355126	SAT TT=0.973 ASSIGNMENTS=379	SAT TT=0.983 ASSIGNMENTS=379	SAT TT=1.317 CHECKS=198986 NODES=2225	SAT TT=0.871 CHECKS=134232 NODES=529	SAT TT=1135.01 CHECKS=7972940000 NODES=3165090	SAT TT=0.233 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=0.217 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=2.574	SAT TT=4.331	SAT TT=0.204 ASSIGNMENTS=1989 CHECKS=754100	SAT TT=0.346 ASSIGNMENTS=4993 CHECKS=1363930	SAT TT=6.434	SAT TT=0.42 ASSIGNMENTS=4632 CHECKS=1689700	SAT TT=0.22 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=2.877	SAT TT=6.283 ASSIGNMENTS=1331 CHECKS=1740390	SAT TT=1.429	SAT TT=2.577
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-50_ext.xml	SAT TT=0.078	SAT TT=1.275 CHECKS=1505390 NODES=1379	SAT TT=1.242 CHECKS=1517630 NODES=1383	SAT TT=0.632	SAT TT=11.231 CHECKS=3916130	SAT TT=0.766 CHECKS=242636	SAT TT=0.852 ASSIGNMENTS=181	SAT TT=0.952 ASSIGNMENTS=181	SAT TT=0.953 CHECKS=121376 NODES=1167	SAT TT=2.883 CHECKS=15381900 NODES=68875	? (TO) TT=1800.06	SAT TT=0.117 ASSIGNMENTS=768 CHECKS=311977	SAT TT=0.114 ASSIGNMENTS=768 CHECKS=311977	SAT TT=2.662	SAT TT=2.64	SAT TT=0.083 ASSIGNMENTS=581 CHECKS=232394	SAT TT=0.307 ASSIGNMENTS=4221 CHECKS=1151660	SAT TT=1.946	SAT TT=0.078 ASSIGNMENTS=664 CHECKS=213952	SAT TT=0.103 ASSIGNMENTS=768 CHECKS=311977	SAT TT=4.587	SAT TT=1.18 ASSIGNMENTS=672 CHECKS=1045770	SAT TT=2.126	SAT TT=1.642
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-7_ext.xml	SAT TT=0.257	SAT TT=1.322 CHECKS=2046260 NODES=2134	SAT TT=1.342 CHECKS=1884960 NODES=1955	SAT TT=0.464	SAT TT=9.143 CHECKS=3390600	SAT TT=3.416 CHECKS=1188570	SAT TT=0.98 ASSIGNMENTS=326	SAT TT=0.935 ASSIGNMENTS=326	SAT TT=1.167 CHECKS=179975 NODES=2035	SAT TT=0.59 CHECKS=74817 NODES=277	SAT TT=878.244 CHECKS=6258150000 NODES=1624220	SAT TT=0.355 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=0.385 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=4.702	SAT TT=15.589	SAT TT=0.341 ASSIGNMENTS=3614 CHECKS=1348380	SAT TT=0.257 ASSIGNMENTS=3843 CHECKS=936548	SAT TT=4.409	SAT TT=0.3 ASSIGNMENTS=3489 CHECKS=1267220	SAT TT=0.363 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=10.221	SAT TT=4.024 ASSIGNMENTS=3346 CHECKS=4519890	SAT TT=1.664	SAT TT=1.467
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-10_ext.xml	SAT TT=0.086	SAT TT=1.444 CHECKS=2363930 NODES=2305	SAT TT=1.108 CHECKS=771887 NODES=736	SAT TT=0.691	SAT TT=20.328 CHECKS=7468090	SAT TT=1.471 CHECKS=441265	SAT TT=2.054 ASSIGNMENTS=1817	SAT TT=2.209 ASSIGNMENTS=1817	SAT TT=1.192 CHECKS=152323 NODES=1626	SAT TT=0.924 CHECKS=2432960 NODES=10851	? (TO) TT=1800	SAT TT=0.181 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=0.181 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=2.635	SAT TT=2.896	SAT TT=0.086 ASSIGNMENTS=653 CHECKS=254173	SAT TT=0.271 ASSIGNMENTS=3982 CHECKS=1011340	SAT TT=4.071	SAT TT=0.12 ASSIGNMENTS=1203 CHECKS=404883	SAT TT=0.165 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=2.885	SAT TT=1.898 ASSIGNMENTS=712 CHECKS=898756	SAT TT=2.306	SAT TT=3.622
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-17_ext.xml	SAT TT=0.116	SAT TT=1.899 CHECKS=4372710 NODES=4283	SAT TT=1.843 CHECKS=4266450 NODES=4114	SAT TT=0.564	SAT TT=9.437 CHECKS=3512470	SAT TT=3.825 CHECKS=1285540	SAT TT=1.257 ASSIGNMENTS=816	SAT TT=1.366 ASSIGNMENTS=816	SAT TT=0.907 CHECKS=132008 NODES=1336	SAT TT=0.722 CHECKS=886974 NODES=3969	? (TO) TT=1800.01	SAT TT=0.125 ASSIGNMENTS=874 CHECKS=362571	SAT TT=0.127 ASSIGNMENTS=874 CHECKS=362571	SAT TT=3.503	SAT TT=2.235	SAT TT=0.272 ASSIGNMENTS=2737 CHECKS=1049100	SAT TT=0.383 ASSIGNMENTS=5296 CHECKS=1525300	SAT TT=1.813	SAT TT=0.333 ASSIGNMENTS=3401 CHECKS=1276100	SAT TT=0.116 ASSIGNMENTS=874 CHECKS=362571	SAT TT=5.37	SAT TT=2.241 ASSIGNMENTS=1542 CHECKS=2337050	SAT TT=1.282	SAT TT=1.911
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-18_ext.xml	SAT TT=0.214	SAT TT=1.169 CHECKS=1023240 NODES=1065	SAT TT=1.422 CHECKS=2275320 NODES=2310	SAT TT=0.557	SAT TT=3.424 CHECKS=1284680	SAT TT=1.88 CHECKS=578291	SAT TT=1.479 ASSIGNMENTS=1092	SAT TT=1.697 ASSIGNMENTS=1092	SAT TT=1.545 CHECKS=375474 NODES=4055	SAT TT=2.759 CHECKS=14912600 NODES=68991	? (TO) TT=1800.01	SAT TT=0.275 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=0.28 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=2.948	SAT TT=4.678	SAT TT=0.214 ASSIGNMENTS=2161 CHECKS=803322	SAT TT=0.293 ASSIGNMENTS=4350 CHECKS=1088150	SAT TT=3.846	SAT TT=0.388 ASSIGNMENTS=4337 CHECKS=1544100	SAT TT=0.263 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=2.943	SAT TT=2.308 ASSIGNMENTS=2682 CHECKS=3669730	SAT TT=1.459	SAT TT=1.615
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-19_ext.xml	UNSAT TT=0.69	UNSAT TT=5.2 CHECKS=20354000 NODES=19520	UNSAT TT=5.272 CHECKS=20939400 NODES=20055	UNSAT TT=1.323	UNSAT TT=88.925 CHECKS=30628400	UNSAT TT=72.693 CHECKS=25807700	UNSAT TT=3.745 ASSIGNMENTS=4458	UNSAT TT=3.74 ASSIGNMENTS=4458	UNSAT TT=2.968 CHECKS=832185 NODES=9152	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.903 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=0.83 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=7.14	UNSAT TT=16.353	UNSAT TT=0.861 ASSIGNMENTS=9542 CHECKS=3601020	UNSAT TT=0.69 ASSIGNMENTS=9428 CHECKS=3021180	UNSAT TT=14.126	UNSAT TT=0.757 ASSIGNMENTS=8400 CHECKS=3127840	UNSAT TT=0.866 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=21.971	UNSAT TT=9.501 ASSIGNMENTS=8982 CHECKS=12219500	UNSAT TT=6.352	UNSAT TT=7.18
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-23_ext.xml	SAT TT=0.761	SAT TT=3.334 CHECKS=10355600 NODES=10741	SAT TT=3.147 CHECKS=10485800 NODES=10974	SAT TT=1.293	SAT TT=22.163 CHECKS=9079140	SAT TT=4.076 CHECKS=1270130	SAT TT=3.437 ASSIGNMENTS=4857	SAT TT=3.662 ASSIGNMENTS=4857	SAT TT=3.133 CHECKS=892670 NODES=10315	SAT TT=6.556 CHECKS=43347300 NODES=197254	? (TO) TT=1800.03	SAT TT=1.2 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=1.213 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=10.314	SAT TT=3.756	SAT TT=1.2 ASSIGNMENTS=14028 CHECKS=5135010	SAT TT=0.761 ASSIGNMENTS=9908 CHECKS=3174880	SAT TT=13.779	SAT TT=1.193 ASSIGNMENTS=13908 CHECKS=5063530	SAT TT=1.272 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=23.752	SAT TT=13.961 ASSIGNMENTS=10565 CHECKS=13242400	SAT TT=7.143	SAT TT=6.501
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-24_ext.xml	SAT TT=0.035	SAT TT=2.27 CHECKS=6309920 NODES=6715	SAT TT=2.202 CHECKS=5719260 NODES=6170	SAT TT=0.407	SAT TT=2.912 CHECKS=1056630	SAT TT=0.126 CHECKS=17744	SAT TT=0.789 ASSIGNMENTS=74	SAT TT=0.931 ASSIGNMENTS=74	SAT TT=0.684 CHECKS=43926 NODES=462	SAT TT=0.888 CHECKS=1068410 NODES=5122	SAT TT=0.63 CHECKS=224216 NODES=695	SAT TT=0.049 ASSIGNMENTS=124 CHECKS=39015	SAT TT=0.049 ASSIGNMENTS=124 CHECKS=39015	SAT TT=2.993	SAT TT=6.224	SAT TT=0.035 ASSIGNMENTS=96 CHECKS=32139	SAT TT=0.227 ASSIGNMENTS=3842 CHECKS=879586	SAT TT=0.932	SAT TT=0.382 ASSIGNMENTS=4450 CHECKS=1511040	SAT TT=0.039 ASSIGNMENTS=124 CHECKS=39015	SAT TT=3.585	SAT TT=0.248 ASSIGNMENTS=171 CHECKS=159889	SAT TT=4.133	SAT TT=1.487
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-29_ext.xml	UNSAT TT=0.729	UNSAT TT=4.258 CHECKS=16335400 NODES=15881	UNSAT TT=4.267 CHECKS=16016900 NODES=15412	UNSAT TT=1.349	UNSAT TT=89.581 CHECKS=33558600	UNSAT TT=77.487 CHECKS=27151500	UNSAT TT=4.839 ASSIGNMENTS=6121	UNSAT TT=4.756 ASSIGNMENTS=6121	UNSAT TT=2.891 CHECKS=865097 NODES=9606	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.817 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=0.815 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=5.708	UNSAT TT=11.737	UNSAT TT=0.786 ASSIGNMENTS=8631 CHECKS=3294570	UNSAT TT=0.839 ASSIGNMENTS=10534 CHECKS=3395900	UNSAT TT=12.992	UNSAT TT=0.745 ASSIGNMENTS=8549 CHECKS=3288930	UNSAT TT=0.729 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=15.716	UNSAT TT=11.138 ASSIGNMENTS=14965 CHECKS=19271200	UNSAT TT=5.72	UNSAT TT=6.647
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-31_ext.xml	UNSAT TT=0.792	UNSAT TT=4.513 CHECKS=16844800 NODES=16342	UNSAT TT=4.031 CHECKS=16871100 NODES=16421	UNSAT TT=1.355	UNSAT TT=82.687 CHECKS=29733200	UNSAT TT=73.414 CHECKS=24969500	UNSAT TT=4.071 ASSIGNMENTS=4869	UNSAT TT=3.723 ASSIGNMENTS=4869	UNSAT TT=3.029 CHECKS=867251 NODES=9517	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=0.827 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=0.839 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=10.052	UNSAT TT=14.928	UNSAT TT=0.834 ASSIGNMENTS=9163 CHECKS=3454770	UNSAT TT=0.889 ASSIGNMENTS=10952 CHECKS=3582430	UNSAT TT=14.027	UNSAT TT=0.891 ASSIGNMENTS=10001 CHECKS=3698750	UNSAT TT=0.792 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=32.212	UNSAT TT=11.139 ASSIGNMENTS=13083 CHECKS=18754100	UNSAT TT=10.361	UNSAT TT=11.628
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-34_ext.xml	SAT TT=0.09	SAT TT=2.619 CHECKS=8353750 NODES=8200	SAT TT=2.741 CHECKS=9474020 NODES=9181	SAT TT=0.612	SAT TT=24.617 CHECKS=8782210	SAT TT=2.905 CHECKS=957759	SAT TT=1.395 ASSIGNMENTS=1091	SAT TT=1.492 ASSIGNMENTS=1091	SAT TT=0.916 CHECKS=124958 NODES=1366	SAT TT=1.314 CHECKS=5417480 NODES=24971	? (TO) TT=1800.08	SAT TT=0.108 ASSIGNMENTS=904 CHECKS=313146	SAT TT=0.117 ASSIGNMENTS=904 CHECKS=313146	SAT TT=2.405	SAT TT=5.321	SAT TT=0.09 ASSIGNMENTS=782 CHECKS=267404	SAT TT=0.32 ASSIGNMENTS=4949 CHECKS=1320520	SAT TT=5.511	SAT TT=0.096 ASSIGNMENTS=957 CHECKS=298994	SAT TT=0.1 ASSIGNMENTS=904 CHECKS=313146	SAT TT=5.198	SAT TT=0.97 ASSIGNMENTS=795 CHECKS=980972	SAT TT=1.956	SAT TT=1.602
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-38_ext.xml	SAT TT=0.16	SAT TT=1.285 CHECKS=1473740 NODES=1727	SAT TT=1.312 CHECKS=1641130 NODES=1891	SAT TT=0.897	SAT TT=30.911 CHECKS=11637400	SAT TT=2.39 CHECKS=750857	SAT TT=2.595 ASSIGNMENTS=2774	SAT TT=2.404 ASSIGNMENTS=2774	SAT TT=1.991 CHECKS=517369 NODES=6226	SAT TT=7.39 CHECKS=46071700 NODES=207327	? (TO) TT=1800.07	SAT TT=0.236 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=0.254 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=3.937	SAT TT=6.559	SAT TT=0.218 ASSIGNMENTS=2392 CHECKS=852916	SAT TT=0.41 ASSIGNMENTS=6019 CHECKS=1748240	SAT TT=13.848	SAT TT=0.16 ASSIGNMENTS=1668 CHECKS=553068	SAT TT=0.242 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=20.822	SAT TT=2.585 ASSIGNMENTS=3208 CHECKS=4021310	SAT TT=10.02	SAT TT=9.577
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-39_ext.xml	SAT TT=0.152	SAT TT=1.369 CHECKS=1334410 NODES=1465	SAT TT=1.26 CHECKS=1383000 NODES=1512	SAT TT=0.446	SAT TT=7.249 CHECKS=2676550	SAT TT=5.094 CHECKS=1648420	SAT TT=1.486 ASSIGNMENTS=1183	SAT TT=1.543 ASSIGNMENTS=1183	SAT TT=1.84 CHECKS=361013 NODES=4130	SAT TT=2.09 CHECKS=10907000 NODES=50047	? (TO) TT=1800.03	SAT TT=0.169 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=0.168 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=2.263	SAT TT=8.512	SAT TT=0.229 ASSIGNMENTS=2505 CHECKS=920648	SAT TT=0.228 ASSIGNMENTS=3696 CHECKS=876232	SAT TT=4.484	SAT TT=0.226 ASSIGNMENTS=2446 CHECKS=827809	SAT TT=0.152 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=3.996	SAT TT=1.568 ASSIGNMENTS=778 CHECKS=1071310	SAT TT=4.419	SAT TT=1.758
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-40_ext.xml	UNSAT TT=0.912	UNSAT TT=4.135 CHECKS=15509500 NODES=15149	UNSAT TT=4.225 CHECKS=15126500 NODES=14762	UNSAT TT=2.178	UNSAT TT=88.869 CHECKS=30634600	UNSAT TT=74.938 CHECKS=26163100	UNSAT TT=4.499 ASSIGNMENTS=6322	UNSAT TT=5.045 ASSIGNMENTS=6322	UNSAT TT=3.548 CHECKS=1014540 NODES=11409	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.993 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=0.981 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=12.821	UNSAT TT=18.786	UNSAT TT=0.956 ASSIGNMENTS=10723 CHECKS=4016950	UNSAT TT=0.973 ASSIGNMENTS=12150 CHECKS=4035030	UNSAT TT=20.217	UNSAT TT=0.912 ASSIGNMENTS=10142 CHECKS=3773960	UNSAT TT=0.947 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=50.096	UNSAT TT=10.688 ASSIGNMENTS=13404 CHECKS=18154900	UNSAT TT=9.387	UNSAT TT=13.226
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-43_ext.xml	SAT TT=0.122	SAT TT=2.03 CHECKS=4914060 NODES=5334	SAT TT=2.057 CHECKS=5267510 NODES=5840	SAT TT=1.869	SAT TT=1.177 CHECKS=414091	SAT TT=4.866 CHECKS=1755200	SAT TT=1.205 ASSIGNMENTS=602	SAT TT=1.149 ASSIGNMENTS=602	SAT TT=0.957 CHECKS=69156 NODES=713	SAT TT=1.355 CHECKS=5030810 NODES=22323	SAT TT=412.766 CHECKS=3036610000 NODES=1199480	SAT TT=0.316 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=0.293 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=3.808	SAT TT=2.448	SAT TT=0.361 ASSIGNMENTS=3895 CHECKS=1441880	SAT TT=0.328 ASSIGNMENTS=4690 CHECKS=1262680	SAT TT=1.589	SAT TT=0.122 ASSIGNMENTS=1186 CHECKS=416120	SAT TT=0.29 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=4.5	SAT TT=1.193 ASSIGNMENTS=1405 CHECKS=1724600	SAT TT=1.499	SAT TT=3.643
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-45_ext.xml	SAT TT=0.096	SAT TT=0.999 CHECKS=288169 NODES=333	SAT TT=0.935 CHECKS=276807 NODES=283	SAT TT=0.452	SAT TT=3.1 CHECKS=1144210	SAT TT=1.863 CHECKS=604195	SAT TT=1.337 ASSIGNMENTS=737	SAT TT=1.308 ASSIGNMENTS=737	SAT TT=1.316 CHECKS=272352 NODES=2859	SAT TT=1.086 CHECKS=2049230 NODES=9128	SAT TT=7.718 CHECKS=54507700 NODES=74657	SAT TT=0.11 ASSIGNMENTS=771 CHECKS=299021	SAT TT=0.11 ASSIGNMENTS=771 CHECKS=299021	SAT TT=2.339	SAT TT=2.449	SAT TT=0.147 ASSIGNMENTS=1446 CHECKS=555271	SAT TT=0.293 ASSIGNMENTS=4201 CHECKS=1082430	SAT TT=1.573	SAT TT=0.197 ASSIGNMENTS=2120 CHECKS=742463	SAT TT=0.096 ASSIGNMENTS=771 CHECKS=299021	SAT TT=3.208	SAT TT=0.979 ASSIGNMENTS=483 CHECKS=639260	SAT TT=2.19	SAT TT=1.761
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-46_ext.xml	SAT TT=0.047	SAT TT=1.496 CHECKS=2583770 NODES=2699	SAT TT=1.652 CHECKS=2636970 NODES=2661	SAT TT=0.628	SAT TT=0.579 CHECKS=173019	SAT TT=5.162 CHECKS=1847480	SAT TT=1.578 ASSIGNMENTS=1258	SAT TT=1.599 ASSIGNMENTS=1258	SAT TT=0.801 CHECKS=85711 NODES=865	SAT TT=6.883 CHECKS=42830400 NODES=184570	SAT TT=1358.96 CHECKS=10092000000 NODES=4394940	SAT TT=0.056 ASSIGNMENTS=173 CHECKS=71353	SAT TT=0.061 ASSIGNMENTS=173 CHECKS=71353	SAT TT=2.843	SAT TT=3.665	SAT TT=0.269 ASSIGNMENTS=2584 CHECKS=1006350	SAT TT=0.355 ASSIGNMENTS=4857 CHECKS=1364780	SAT TT=3.585	SAT TT=0.331 ASSIGNMENTS=3643 CHECKS=1430800	SAT TT=0.047 ASSIGNMENTS=173 CHECKS=71353	SAT TT=3.429	SAT TT=1.89 ASSIGNMENTS=1116 CHECKS=1597920	SAT TT=3.056	SAT TT=1.455
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-48_ext.xml	SAT TT=0.069	SAT TT=2.707 CHECKS=8625390 NODES=8418	SAT TT=2.957 CHECKS=9779390 NODES=9376	SAT TT=0.929	SAT TT=6.812 CHECKS=2500850	SAT TT=3.019 CHECKS=972194	SAT TT=2.027 ASSIGNMENTS=1697	SAT TT=2.189 ASSIGNMENTS=1697	SAT TT=1.267 CHECKS=180128 NODES=1898	SAT TT=5.396 CHECKS=33958000 NODES=153002	? (TO) TT=1800.08	SAT TT=0.228 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=0.225 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=2.788	SAT TT=7.618	SAT TT=0.141 ASSIGNMENTS=1234 CHECKS=468716	SAT TT=0.235 ASSIGNMENTS=3648 CHECKS=846974	SAT TT=6.554	SAT TT=0.069 ASSIGNMENTS=611 CHECKS=176391	SAT TT=0.198 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=7.838	SAT TT=0.363 ASSIGNMENTS=318 CHECKS=468899	SAT TT=2.511	SAT TT=2.495
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-49_ext.xml	UNSAT TT=0.816	UNSAT TT=12.72 CHECKS=57045400 NODES=57653	UNSAT TT=12.746 CHECKS=57813400 NODES=58485	UNSAT TT=1.519	UNSAT TT=35.903 CHECKS=13410800	UNSAT TT=78.248 CHECKS=28047800	UNSAT TT=4.58 ASSIGNMENTS=6540	UNSAT TT=5.058 ASSIGNMENTS=6540	UNSAT TT=3.345 CHECKS=981323 NODES=10843	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.913 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=0.908 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=7.704	UNSAT TT=12.87	UNSAT TT=0.823 ASSIGNMENTS=9155 CHECKS=3453100	UNSAT TT=0.863 ASSIGNMENTS=11177 CHECKS=3578580	UNSAT TT=15.92	UNSAT TT=0.816 ASSIGNMENTS=9303 CHECKS=3446200	UNSAT TT=0.881 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=19.077	UNSAT TT=9.575 ASSIGNMENTS=10706 CHECKS=13625700	UNSAT TT=7.02	UNSAT TT=9.717
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-5_ext.xml	SAT TT=0.064	SAT TT=3.765 CHECKS=14772900 NODES=15122	SAT TT=4.277 CHECKS=15875500 NODES=16141	SAT TT=0.692	SAT TT=3.836 CHECKS=1360890	SAT TT=0.318 CHECKS=84613	SAT TT=2.473 ASSIGNMENTS=2440	SAT TT=2.317 ASSIGNMENTS=2440	SAT TT=1.15 CHECKS=184557 NODES=2088	SAT TT=1.32 CHECKS=3949220 NODES=18115	SAT TT=1016.61 CHECKS=6948680000 NODES=1480610	SAT TT=0.357 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=0.356 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=3.367	SAT TT=4.192	SAT TT=0.453 ASSIGNMENTS=5364 CHECKS=1976140	SAT TT=0.249 ASSIGNMENTS=3655 CHECKS=907535	SAT TT=2.255	SAT TT=0.064 ASSIGNMENTS=615 CHECKS=183207	SAT TT=0.316 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=10.411	SAT TT=0.883 ASSIGNMENTS=378 CHECKS=532084	SAT TT=2.761	SAT TT=4.061
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-6_ext.xml	UNSAT TT=0.427	UNSAT TT=3.635 CHECKS=13208300 NODES=12342	UNSAT TT=3.589 CHECKS=13315800 NODES=12415	UNSAT TT=0.887	UNSAT TT=85.38 CHECKS=29975600	UNSAT TT=13.458 CHECKS=4325160	UNSAT TT=2.63 ASSIGNMENTS=2599	UNSAT TT=2.339 ASSIGNMENTS=2599	UNSAT TT=2.039 CHECKS=533132 NODES=5400	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.466 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=0.471 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=3.426	UNSAT TT=5.79	UNSAT TT=0.427 ASSIGNMENTS=4379 CHECKS=1715350	UNSAT TT=0.565 ASSIGNMENTS=7251 CHECKS=2250930	UNSAT TT=6.139	UNSAT TT=0.45 ASSIGNMENTS=4687 CHECKS=1779280	UNSAT TT=0.441 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=8.508	UNSAT TT=6.36 ASSIGNMENTS=7478 CHECKS=11698900	UNSAT TT=3.473	UNSAT TT=3.604
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-9_ext.xml	SAT TT=0.275	SAT TT=1.927 CHECKS=4366730 NODES=4737	SAT TT=1.841 CHECKS=3918240 NODES=4220	SAT TT=1.151	SAT TT=0.981 CHECKS=341156	SAT TT=3.1 CHECKS=1026450	SAT TT=3.04 ASSIGNMENTS=3241	SAT TT=2.765 ASSIGNMENTS=3241	SAT TT=1.765 CHECKS=365261 NODES=4542	SAT TT=1.539 CHECKS=6239530 NODES=27681	? (TO) TT=1800.04	SAT TT=0.381 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=0.386 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=2.543	SAT TT=12.879	SAT TT=0.406 ASSIGNMENTS=4422 CHECKS=1627760	SAT TT=0.275 ASSIGNMENTS=4068 CHECKS=1018070	SAT TT=15.902	SAT TT=0.384 ASSIGNMENTS=4276 CHECKS=1511090	SAT TT=0.372 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=5.531	SAT TT=2.219 ASSIGNMENTS=2144 CHECKS=2836740	SAT TT=1.295	SAT TT=4.473
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-11_ext.xml	SAT TT=2.111	SAT TT=113.436 CHECKS=608190000 NODES=438246	SAT TT=113.041 CHECKS=608060000 NODES=437565	SAT TT=73.256	SAT TT=283.924 CHECKS=75019200	SAT TT=531.775 CHECKS=107383000	SAT TT=141.211 ASSIGNMENTS=165111	SAT TT=142.137 ASSIGNMENTS=165111	SAT TT=86.509 CHECKS=26862700 NODES=240225	SAT TT=2.111 CHECKS=9550740 NODES=29954	? (TO) TT=1800.01	SAT TT=74.82 ASSIGNMENTS=568203 CHECKS=291652000	SAT TT=110.808 ASSIGNMENTS=438246 CHECKS=608190000	SAT TT=979.749	? (TO) TT=1800.02	SAT TT=72.761 ASSIGNMENTS=569910 CHECKS=292607000	SAT TT=59.975 ASSIGNMENTS=468155 CHECKS=239694000	? (TO) TT=1800.03	SAT TT=32.369 ASSIGNMENTS=252544 CHECKS=128950000	SAT TT=72.766 ASSIGNMENTS=568203 CHECKS=291652000	? (TO) TT=1800.1	SAT TT=466.863 ASSIGNMENTS=218077 CHECKS=389968000	SAT TT=1472.25	? (TO) TT=1800.11
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-12_ext.xml	SAT TT=21.033	SAT TT=35.785 CHECKS=202069000 NODES=153181	SAT TT=37.811 CHECKS=197436000 NODES=150291	SAT TT=49.544	SAT TT=784.138 CHECKS=225710000	SAT TT=1432.41 CHECKS=343163000	SAT TT=126.353 ASSIGNMENTS=164715	SAT TT=131.174 ASSIGNMENTS=164715	SAT TT=125.091 CHECKS=38009900 NODES=340105	SAT TT=21.033 CHECKS=141425000 NODES=453040	? (TO) TT=1800.04	SAT TT=40.135 ASSIGNMENTS=265420 CHECKS=131549000	SAT TT=40.47 ASSIGNMENTS=265420 CHECKS=131549000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=38.66 ASSIGNMENTS=313951 CHECKS=155929000	SAT TT=38.786 ASSIGNMENTS=319600 CHECKS=157960000	SAT TT=1297.18	SAT TT=36.217 ASSIGNMENTS=314683 CHECKS=156184000	SAT TT=32.507 ASSIGNMENTS=265420 CHECKS=131549000	? (TO) TT=1800.16	SAT TT=266.547 ASSIGNMENTS=211162 CHECKS=367710000	SAT TT=1079.55	SAT TT=1044.31
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-17_ext.xml	SAT TT=20.832	SAT TT=34.907 CHECKS=198350000 NODES=142535	SAT TT=21.345 CHECKS=107951000 NODES=79011	SAT TT=25.627	? (TO) TT=1800.03	SAT TT=874.948 CHECKS=184436000	SAT TT=267.066 ASSIGNMENTS=343550	SAT TT=266.651 ASSIGNMENTS=343550	SAT TT=174.826 CHECKS=54945600 NODES=503670	SAT TT=20.832 CHECKS=154237000 NODES=470471	? (TO) TT=1800.05	SAT TT=77.558 ASSIGNMENTS=556670 CHECKS=288296000	SAT TT=41.782 ASSIGNMENTS=142535 CHECKS=198350000	SAT TT=731.92	SAT TT=77.645	SAT TT=57.97 ASSIGNMENTS=458994 CHECKS=239601000	SAT TT=57.483 ASSIGNMENTS=453641 CHECKS=233938000	SAT TT=1086.34	SAT TT=26.782 ASSIGNMENTS=227959 CHECKS=117490000	SAT TT=66.469 ASSIGNMENTS=556670 CHECKS=288296000	? (TO) TT=1800.08	SAT TT=611.393 ASSIGNMENTS=573815 CHECKS=1062390000	? (TO) TT=1800.08	SAT TT=1547.81
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-18_ext.xml	SAT TT=2.292	SAT TT=60.563 CHECKS=322143000 NODES=221723	SAT TT=56.51 CHECKS=305814000 NODES=211512	SAT TT=20.671	SAT TT=20.673 CHECKS=5603280	SAT TT=86.982 CHECKS=18316100	SAT TT=61.563 ASSIGNMENTS=74128	SAT TT=60.25 ASSIGNMENTS=74128	SAT TT=57.967 CHECKS=18730200 NODES=163345	SAT TT=2.292 CHECKS=11100800 NODES=34277	? (TO) TT=1800.06	SAT TT=18.144 ASSIGNMENTS=83732 CHECKS=43215100	SAT TT=62.228 ASSIGNMENTS=221723 CHECKS=322143000	? (TO) TT=1800.05	SAT TT=1701.58	SAT TT=17.918 ASSIGNMENTS=138357 CHECKS=72031400	SAT TT=13.199 ASSIGNMENTS=112102 CHECKS=58113600	SAT TT=126.381	SAT TT=16.64 ASSIGNMENTS=128546 CHECKS=66078900	SAT TT=10.586 ASSIGNMENTS=83732 CHECKS=43215100	? (TO) TT=1800.17	SAT TT=137.018 ASSIGNMENTS=109103 CHECKS=198174000	SAT TT=136.773	SAT TT=63.174
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-19_ext.xml	SAT TT=3.448	SAT TT=74.323 CHECKS=399078000 NODES=282181	SAT TT=69.497 CHECKS=399592000 NODES=282606	SAT TT=33.156	SAT TT=836.026 CHECKS=229575000	SAT TT=804.12 CHECKS=185189000	SAT TT=58.521 ASSIGNMENTS=67125	SAT TT=58.356 ASSIGNMENTS=67125	SAT TT=91.476 CHECKS=28767000 NODES=245985	SAT TT=187.752 CHECKS=1396980000 NODES=4442790	? (TO) TT=1800.02	SAT TT=38.469 ASSIGNMENTS=233901 CHECKS=122615000	SAT TT=36.497 ASSIGNMENTS=233901 CHECKS=122615000	SAT TT=347.535	? (TO) TT=1800.06	SAT TT=28.129 ASSIGNMENTS=234569 CHECKS=123026000	SAT TT=3.448 ASSIGNMENTS=29837 CHECKS=14834700	SAT TT=320.491	SAT TT=3.56 ASSIGNMENTS=29229 CHECKS=15117100	SAT TT=28.653 ASSIGNMENTS=233901 CHECKS=122615000	? (TO) TT=1800.14	SAT TT=114.18 ASSIGNMENTS=43723 CHECKS=81565900	SAT TT=120.577	SAT TT=734.511
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-1_ext.xml	SAT TT=1.093	SAT TT=1.12 CHECKS=828664 NODES=665	SAT TT=1.093 CHECKS=661944 NODES=479	SAT TT=11.347	SAT TT=715.383 CHECKS=207735000	SAT TT=45.441 CHECKS=10470400	SAT TT=16.337 ASSIGNMENTS=16215	SAT TT=16.164 ASSIGNMENTS=16215	SAT TT=38.438 CHECKS=12199500 NODES=103200	SAT TT=25.875 CHECKS=194215000 NODES=593020	? (TO) TT=1800	SAT TT=16.47 ASSIGNMENTS=67711 CHECKS=36055900	SAT TT=8.751 ASSIGNMENTS=665 CHECKS=828664	SAT TT=1604.56	? (TO) TT=1800	SAT TT=7.856 ASSIGNMENTS=58991 CHECKS=31448800	SAT TT=25.003 ASSIGNMENTS=188515 CHECKS=100879000	SAT TT=632.393	SAT TT=14.615 ASSIGNMENTS=109979 CHECKS=58509100	SAT TT=8.985 ASSIGNMENTS=67711 CHECKS=36055900	? (TO) TT=1800.12	SAT TT=79.531 ASSIGNMENTS=52159 CHECKS=103375000	SAT TT=37.936	SAT TT=532.042
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-20_ext.xml	SAT TT=5.763	SAT TT=7.451 CHECKS=33186800 NODES=25969	SAT TT=41.11 CHECKS=213570000 NODES=161019	SAT TT=5.763	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=327.116 ASSIGNMENTS=403922	SAT TT=310.271 ASSIGNMENTS=403922	SAT TT=115.538 CHECKS=35348200 NODES=317507	SAT TT=50.741 CHECKS=352251000 NODES=1156420	? (TO) TT=1800.04	SAT TT=53.358 ASSIGNMENTS=372279 CHECKS=185493000	SAT TT=14.309 ASSIGNMENTS=25969 CHECKS=33186800	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=35.905 ASSIGNMENTS=287978 CHECKS=143668000	SAT TT=89.694 ASSIGNMENTS=721511 CHECKS=359210000	SAT TT=1495.7	SAT TT=50.553 ASSIGNMENTS=400085 CHECKS=198853000	SAT TT=46.281 ASSIGNMENTS=372279 CHECKS=185493000	? (TO) TT=1800.11	SAT TT=579.216 ASSIGNMENTS=465773 CHECKS=814409000	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-22_ext.xml	SAT TT=0.835	SAT TT=24.379 CHECKS=132298000 NODES=99710	SAT TT=16.855 CHECKS=83483300 NODES=63195	SAT TT=248.633	? (TO) TT=1800.09	SAT TT=1352.74 CHECKS=325111000	SAT TT=82.834 ASSIGNMENTS=103234	SAT TT=80.795 ASSIGNMENTS=103234	SAT TT=6.862 CHECKS=1932110 NODES=18388	SAT TT=3.993 CHECKS=25333800 NODES=78967	? (TO) TT=1800.09	SAT TT=30.996 ASSIGNMENTS=180652 CHECKS=91127700	SAT TT=31.286 ASSIGNMENTS=99710 CHECKS=132298000	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=9.223 ASSIGNMENTS=72313 CHECKS=37086900	SAT TT=0.835 ASSIGNMENTS=7658 CHECKS=3114620	SAT TT=124.757	SAT TT=21.981 ASSIGNMENTS=172266 CHECKS=86594800	SAT TT=22.406 ASSIGNMENTS=180652 CHECKS=91127700	SAT TT=696.188	SAT TT=79.198 ASSIGNMENTS=70996 CHECKS=120339000	SAT TT=1112	SAT TT=219.342
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-23_ext.xml	SAT TT=2.763	SAT TT=9.294 CHECKS=43676300 NODES=32744	SAT TT=8.962 CHECKS=41721000 NODES=31260	SAT TT=40.997	SAT TT=502.617 CHECKS=139874000	SAT TT=1445.16 CHECKS=355157000	SAT TT=23.109 ASSIGNMENTS=23709	SAT TT=23.224 ASSIGNMENTS=23709	SAT TT=15.743 CHECKS=4706950 NODES=41649	SAT TT=16.331 CHECKS=117731000 NODES=375508	? (TO) TT=1800.07	SAT TT=10.212 ASSIGNMENTS=21319 CHECKS=10876400	SAT TT=16.613 ASSIGNMENTS=32744 CHECKS=43676300	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=3.391 ASSIGNMENTS=26248 CHECKS=13449200	SAT TT=6.988 ASSIGNMENTS=56470 CHECKS=28232000	SAT TT=6.004	SAT TT=7.295 ASSIGNMENTS=55317 CHECKS=29172700	SAT TT=2.763 ASSIGNMENTS=21319 CHECKS=10876400	? (TO) TT=1800.11	SAT TT=102.582 ASSIGNMENTS=24934 CHECKS=44453900	SAT TT=347.277	SAT TT=72.183
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-25_ext.xml	SAT TT=7.184	SAT TT=82.56 CHECKS=474895000 NODES=326374	SAT TT=83.874 CHECKS=458625000 NODES=315180	SAT TT=40.92	SAT TT=798.066 CHECKS=228916000	? (TO) TT=1800.02	SAT TT=69.211 ASSIGNMENTS=81891	SAT TT=72.475 ASSIGNMENTS=81891	SAT TT=38.071 CHECKS=12345500 NODES=107867	SAT TT=7.184 CHECKS=43722400 NODES=137169	? (TO) TT=1800	SAT TT=20.607 ASSIGNMENTS=96496 CHECKS=50354700	SAT TT=87.856 ASSIGNMENTS=326374 CHECKS=474895000	SAT TT=326.631	SAT TT=923.714	SAT TT=35.89 ASSIGNMENTS=272584 CHECKS=142914000	SAT TT=12.671 ASSIGNMENTS=98113 CHECKS=50622300	SAT TT=414.267	SAT TT=12.985 ASSIGNMENTS=99424 CHECKS=51949800	SAT TT=12.478 ASSIGNMENTS=96496 CHECKS=50354700	? (TO) TT=1800.14	SAT TT=208.996 ASSIGNMENTS=97878 CHECKS=168275000	SAT TT=788.647	SAT TT=32.422
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-27_ext.xml	SAT TT=3.314	SAT TT=43.443 CHECKS=235043000 NODES=151929	SAT TT=47.376 CHECKS=260325000 NODES=169311	SAT TT=58.937	SAT TT=613.242 CHECKS=173711000	SAT TT=380.035 CHECKS=76911000	SAT TT=116.813 ASSIGNMENTS=124912	SAT TT=116.868 ASSIGNMENTS=124912	SAT TT=37.515 CHECKS=12064400 NODES=108430	SAT TT=3.314 CHECKS=18123800 NODES=58859	? (TO) TT=1800.02	SAT TT=36.835 ASSIGNMENTS=230282 CHECKS=120453000	SAT TT=46.984 ASSIGNMENTS=151929 CHECKS=235043000	SAT TT=1547.48	? (TO) TT=1800.1	SAT TT=29.459 ASSIGNMENTS=230077 CHECKS=120769000	SAT TT=27.821 ASSIGNMENTS=218643 CHECKS=113551000	SAT TT=130.069	SAT TT=29.081 ASSIGNMENTS=226860 CHECKS=118497000	SAT TT=27.452 ASSIGNMENTS=230282 CHECKS=120453000	? (TO) TT=1800.11	SAT TT=339.007 ASSIGNMENTS=279392 CHECKS=538842000	SAT TT=603.511	SAT TT=835.53
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-28_ext.xml	SAT TT=0.233	SAT TT=9.097 CHECKS=44797300 NODES=29654	SAT TT=9.86 CHECKS=53978900 NODES=35582	SAT TT=31.745	SAT TT=11.531 CHECKS=3013110	SAT TT=163.602 CHECKS=33623900	SAT TT=1.535 ASSIGNMENTS=563	SAT TT=1.447 ASSIGNMENTS=563	SAT TT=17.655 CHECKS=5924950 NODES=49036	SAT TT=7.674 CHECKS=48088000 NODES=151766	? (TO) TT=1800.01	SAT TT=0.263 ASSIGNMENTS=1493 CHECKS=785748	SAT TT=0.253 ASSIGNMENTS=1493 CHECKS=785748	? (TO) TT=1800.04	SAT TT=229.694	SAT TT=0.233 ASSIGNMENTS=1289 CHECKS=699504	SAT TT=1.651 ASSIGNMENTS=13179 CHECKS=6396530	SAT TT=15.634	SAT TT=1.138 ASSIGNMENTS=8905 CHECKS=4643320	SAT TT=0.246 ASSIGNMENTS=1493 CHECKS=785748	? (TO) TT=1800.09	SAT TT=52.143 ASSIGNMENTS=7192 CHECKS=14022500	SAT TT=383.061	SAT TT=466.948
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-33_ext.xml	SAT TT=6.794	SAT TT=128.027 CHECKS=671453000 NODES=519406	SAT TT=121.146 CHECKS=640932000 NODES=498622	SAT TT=173.808	SAT TT=754.349 CHECKS=204736000	SAT TT=171.885 CHECKS=34628500	SAT TT=333.071 ASSIGNMENTS=438888	SAT TT=336.449 ASSIGNMENTS=438888	SAT TT=269.358 CHECKS=78724100 NODES=742371	SAT TT=29.754 CHECKS=203229000 NODES=644521	? (TO) TT=1800.04	SAT TT=32.274 ASSIGNMENTS=200153 CHECKS=100239000	SAT TT=125.938 ASSIGNMENTS=519406 CHECKS=671453000	? (TO) TT=1800.05	SAT TT=316.184	SAT TT=24.614 ASSIGNMENTS=196070 CHECKS=98311500	SAT TT=8.773 ASSIGNMENTS=76445 CHECKS=37867500	? (TO) TT=1800.08	SAT TT=6.794 ASSIGNMENTS=52609 CHECKS=26711600	SAT TT=22.98 ASSIGNMENTS=200153 CHECKS=100239000	? (TO) TT=1800.18	SAT TT=362.272 ASSIGNMENTS=65372 CHECKS=108406000	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-38_ext.xml	SAT TT=16.426	SAT TT=27.162 CHECKS=142937000 NODES=99464	SAT TT=30.083 CHECKS=157289000 NODES=108479	SAT TT=23.859	SAT TT=355.613 CHECKS=96906200	SAT TT=572.381 CHECKS=136704000	SAT TT=36.752 ASSIGNMENTS=41502	SAT TT=36.906 ASSIGNMENTS=41502	SAT TT=48.278 CHECKS=14517500 NODES=128345	SAT TT=28.102 CHECKS=209186000 NODES=653985	? (TO) TT=1800.08	SAT TT=30.504 ASSIGNMENTS=175705 CHECKS=91852100	SAT TT=32.652 ASSIGNMENTS=99464 CHECKS=142937000	? (TO) TT=1800	SAT TT=490.65	SAT TT=20.656 ASSIGNMENTS=159666 CHECKS=82486400	SAT TT=16.426 ASSIGNMENTS=140248 CHECKS=71853900	SAT TT=277.231	SAT TT=23.136 ASSIGNMENTS=176904 CHECKS=92512200	SAT TT=22.469 ASSIGNMENTS=175705 CHECKS=91852100	SAT TT=528.434	SAT TT=283.787 ASSIGNMENTS=235286 CHECKS=434715000	SAT TT=209.817	SAT TT=103.887
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-39_ext.xml	SAT TT=4.806	SAT TT=64.486 CHECKS=358305000 NODES=229869	SAT TT=72.702 CHECKS=405221000 NODES=258826	SAT TT=13.765	SAT TT=1129.94 CHECKS=300972000	SAT TT=661.742 CHECKS=160561000	SAT TT=51.721 ASSIGNMENTS=53928	SAT TT=51.444 ASSIGNMENTS=53928	SAT TT=15.289 CHECKS=4987840 NODES=39493	SAT TT=4.806 CHECKS=30098000 NODES=91108	? (TO) TT=1800.04	SAT TT=21.239 ASSIGNMENTS=101575 CHECKS=55893400	SAT TT=66.42 ASSIGNMENTS=229869 CHECKS=358305000	SAT TT=222.362	SAT TT=128.995	SAT TT=13.836 ASSIGNMENTS=101751 CHECKS=55915800	SAT TT=13.708 ASSIGNMENTS=102664 CHECKS=55865500	SAT TT=247.291	SAT TT=7.433 ASSIGNMENTS=54058 CHECKS=29895200	SAT TT=12.729 ASSIGNMENTS=101575 CHECKS=55893400	SAT TT=948.763	SAT TT=66.336 ASSIGNMENTS=25933 CHECKS=52244000	SAT TT=66.591	SAT TT=191.417
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-3_ext.xml	SAT TT=4.581	SAT TT=118.662 CHECKS=705927000 NODES=481550	SAT TT=124.111 CHECKS=684149000 NODES=468122	SAT TT=4.581	SAT TT=915.284 CHECKS=244726000	SAT TT=425.701 CHECKS=99288900	SAT TT=44.788 ASSIGNMENTS=49021	SAT TT=45.573 ASSIGNMENTS=49021	SAT TT=125.374 CHECKS=41169900 NODES=350418	SAT TT=26.157 CHECKS=187690000 NODES=587375	? (TO) TT=1800.08	SAT TT=26.409 ASSIGNMENTS=142556 CHECKS=74883700	SAT TT=125.661 ASSIGNMENTS=481550 CHECKS=705927000	SAT TT=367.672	SAT TT=389.431	SAT TT=17.541 ASSIGNMENTS=142751 CHECKS=75036700	SAT TT=22.783 ASSIGNMENTS=179556 CHECKS=91929500	SAT TT=591.093	SAT TT=47.231 ASSIGNMENTS=354054 CHECKS=185830000	SAT TT=18.694 ASSIGNMENTS=142556 CHECKS=74883700	? (TO) TT=1800.13	SAT TT=280.068 ASSIGNMENTS=175241 CHECKS=351829000	SAT TT=703.824	SAT TT=1419.48
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-40_ext.xml	SAT TT=6.719	SAT TT=122.867 CHECKS=720062000 NODES=493848	SAT TT=121.714 CHECKS=725215000 NODES=497344	SAT TT=6.719	SAT TT=183.497 CHECKS=46841800	SAT TT=108.02 CHECKS=24372100	SAT TT=28.266 ASSIGNMENTS=30334	SAT TT=27.689 ASSIGNMENTS=30334	SAT TT=104.431 CHECKS=33562600 NODES=290578	SAT TT=119.172 CHECKS=903064000 NODES=2742740	? (TO) TT=1800.1	SAT TT=24.379 ASSIGNMENTS=128199 CHECKS=68466100	SAT TT=130.116 ASSIGNMENTS=493848 CHECKS=720062000	SAT TT=182.752	SAT TT=252.116	SAT TT=16.444 ASSIGNMENTS=136390 CHECKS=72315800	SAT TT=35.232 ASSIGNMENTS=283509 CHECKS=153011000	SAT TT=422.404	SAT TT=34.697 ASSIGNMENTS=281985 CHECKS=152243000	SAT TT=16.727 ASSIGNMENTS=128199 CHECKS=68466100	SAT TT=1664.31	SAT TT=229.107 ASSIGNMENTS=74859 CHECKS=138195000	SAT TT=664.729	SAT TT=22.574
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-41_ext.xml	SAT TT=2.378	SAT TT=333.902 CHECKS=1838650000 NODES=1219540	SAT TT=337.293 CHECKS=1853890000 NODES=1227720	SAT TT=48.401	SAT TT=1071.52 CHECKS=297719000	SAT TT=192.044 CHECKS=42372300	SAT TT=149.08 ASSIGNMENTS=166967	SAT TT=135.817 ASSIGNMENTS=166967	SAT TT=63.54 CHECKS=20631700 NODES=174065	SAT TT=40.813 CHECKS=282924000 NODES=891626	? (TO) TT=1800.05	SAT TT=10.01 ASSIGNMENTS=17126 CHECKS=9335190	SAT TT=316.589 ASSIGNMENTS=1219540 CHECKS=1838650000	SAT TT=1123.3	? (TO) TT=1800.09	SAT TT=2.409 ASSIGNMENTS=17683 CHECKS=9647800	SAT TT=14.694 ASSIGNMENTS=110101 CHECKS=59222200	SAT TT=806.929	SAT TT=31.76 ASSIGNMENTS=234481 CHECKS=127040000	SAT TT=2.378 ASSIGNMENTS=17126 CHECKS=9335190	? (TO) TT=1800.1	SAT TT=210.881 ASSIGNMENTS=33786 CHECKS=71497200	SAT TT=498.924	SAT TT=1795.52
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-42_ext.xml	SAT TT=2.398	SAT TT=83.068 CHECKS=448155000 NODES=311580	SAT TT=80.227 CHECKS=467003000 NODES=324668	SAT TT=3.298	SAT TT=606.928 CHECKS=167501000	SAT TT=201.709 CHECKS=39560600	SAT TT=8.581 ASSIGNMENTS=8840	SAT TT=8.605 ASSIGNMENTS=8840	SAT TT=58.321 CHECKS=17892800 NODES=159050	SAT TT=3.379 CHECKS=20154500 NODES=63277	? (TO) TT=1800.03	SAT TT=10.06 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=9.546 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=1220.22	? (TO) TT=1800.03	SAT TT=3.659 ASSIGNMENTS=29323 CHECKS=14727300	SAT TT=2.398 ASSIGNMENTS=21205 CHECKS=10076800	SAT TT=101.256	SAT TT=22.305 ASSIGNMENTS=169781 CHECKS=87397400	SAT TT=2.445 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=229.959	SAT TT=157.097 ASSIGNMENTS=131390 CHECKS=233757000	SAT TT=800.856	SAT TT=23.379
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-44_ext.xml	SAT TT=11.489	SAT TT=34.111 CHECKS=181257000 NODES=128365	SAT TT=32.002 CHECKS=180737000 NODES=128483	SAT TT=45.423	SAT TT=803.378 CHECKS=217282000	SAT TT=439.541 CHECKS=96908600	SAT TT=95.395 ASSIGNMENTS=121544	SAT TT=101.942 ASSIGNMENTS=121544	SAT TT=219.225 CHECKS=72173200 NODES=656001	SAT TT=11.489 CHECKS=82511100 NODES=258089	? (TO) TT=1800.03	SAT TT=48.193 ASSIGNMENTS=355220 CHECKS=179501000	SAT TT=39.556 ASSIGNMENTS=128365 CHECKS=181257000	SAT TT=292.29	SAT TT=698.385	SAT TT=44.1 ASSIGNMENTS=354039 CHECKS=178786000	SAT TT=49.691 ASSIGNMENTS=430235 CHECKS=216829000	SAT TT=1085.41	SAT TT=42.942 ASSIGNMENTS=361111 CHECKS=181395000	SAT TT=43.634 ASSIGNMENTS=355220 CHECKS=179501000	? (TO) TT=1800.2	SAT TT=559.245 ASSIGNMENTS=436501 CHECKS=746116000	SAT TT=415.567	SAT TT=684.203
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-49_ext.xml	SAT TT=2.727	SAT TT=64.525 CHECKS=337963000 NODES=248994	SAT TT=72.965 CHECKS=384733000 NODES=281667	SAT TT=3.777	SAT TT=1447.18 CHECKS=433538000	SAT TT=149.868 CHECKS=32189900	SAT TT=10.456 ASSIGNMENTS=12307	SAT TT=11.339 ASSIGNMENTS=12307	SAT TT=57.832 CHECKS=18725600 NODES=168365	SAT TT=8.485 CHECKS=53471900 NODES=164255	? (TO) TT=1800.05	SAT TT=10.869 ASSIGNMENTS=26732 CHECKS=13288400	SAT TT=67.154 ASSIGNMENTS=248994 CHECKS=337963000	? (TO) TT=1800	? (TO) TT=1800.02	SAT TT=3.091 ASSIGNMENTS=24682 CHECKS=12326200	SAT TT=2.727 ASSIGNMENTS=25137 CHECKS=11848300	SAT TT=112.498	SAT TT=3.044 ASSIGNMENTS=26730 CHECKS=13237000	SAT TT=3.04 ASSIGNMENTS=26732 CHECKS=13288400	? (TO) TT=1800.15	SAT TT=208.495 ASSIGNMENTS=93586 CHECKS=167814000	SAT TT=779.068	SAT TT=58.189
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-50_ext.xml	SAT TT=2.522	SAT TT=266.839 CHECKS=1542810000 NODES=1143930	SAT TT=282.252 CHECKS=1519570000 NODES=1121160	SAT TT=2.522	? (TO) TT=1800.02	SAT TT=1664.5 CHECKS=366205000	SAT TT=805.909 ASSIGNMENTS=1028690	SAT TT=838.41 ASSIGNMENTS=1028690	SAT TT=346.193 CHECKS=105625000 NODES=1010360	SAT TT=418.677 CHECKS=3132570000 NODES=9607250	? (TO) TT=1800.05	SAT TT=157.883 ASSIGNMENTS=1282050 CHECKS=658419000	SAT TT=275.592 ASSIGNMENTS=1143930 CHECKS=1542810000	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=143.846 ASSIGNMENTS=1238390 CHECKS=636029000	SAT TT=11.256 ASSIGNMENTS=91760 CHECKS=45682500	? (TO) TT=1800.11	SAT TT=99.802 ASSIGNMENTS=851275 CHECKS=431767000	SAT TT=152.351 ASSIGNMENTS=1282050 CHECKS=658419000	? (TO) TT=1800.16	SAT TT=1061.32 ASSIGNMENTS=828230 CHECKS=1377490000	SAT TT=730.415	? (TO) TT=1800.07
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-6_ext.xml	SAT TT=3.652	SAT TT=34.509 CHECKS=202743000 NODES=134223	SAT TT=27.328 CHECKS=147131000 NODES=96639	SAT TT=17.572	? (TO) TT=1800.07	SAT TT=1412.21 CHECKS=333073000	SAT TT=116.03 ASSIGNMENTS=139103	SAT TT=114.249 ASSIGNMENTS=139103	SAT TT=130.219 CHECKS=43985300 NODES=378105	SAT TT=3.652 CHECKS=20113500 NODES=64441	? (TO) TT=1800.1	SAT TT=36.504 ASSIGNMENTS=219918 CHECKS=114636000	SAT TT=41.882 ASSIGNMENTS=134223 CHECKS=202743000	? (TO) TT=1800.06	SAT TT=680.515	SAT TT=29.546 ASSIGNMENTS=227762 CHECKS=118854000	SAT TT=42.766 ASSIGNMENTS=322088 CHECKS=168914000	SAT TT=307.531	SAT TT=37.678 ASSIGNMENTS=286323 CHECKS=149686000	SAT TT=26.613 ASSIGNMENTS=219918 CHECKS=114636000	SAT TT=439.539	SAT TT=302.528 ASSIGNMENTS=274261 CHECKS=510173000	SAT TT=1033.88	SAT TT=32.288
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-7_ext.xml	SAT TT=10.441	SAT TT=15.979 CHECKS=78452400 NODES=60331	SAT TT=24.706 CHECKS=125463000 NODES=96715	SAT TT=96.255	SAT TT=1389.59 CHECKS=382281000	? (TO) TT=1800.06	SAT TT=316.132 ASSIGNMENTS=400563	SAT TT=317.465 ASSIGNMENTS=400563	SAT TT=179.968 CHECKS=53901100 NODES=496611	SAT TT=13.676 CHECKS=90881100 NODES=289476	? (TO) TT=1800.04	SAT TT=110.374 ASSIGNMENTS=832174 CHECKS=415395000	SAT TT=22.903 ASSIGNMENTS=60331 CHECKS=78452400	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=10.471 ASSIGNMENTS=86327 CHECKS=42462700	SAT TT=10.441 ASSIGNMENTS=87148 CHECKS=42254400	SAT TT=350.258	SAT TT=33.271 ASSIGNMENTS=268835 CHECKS=133530000	SAT TT=106.609 ASSIGNMENTS=832174 CHECKS=415395000	? (TO) TT=1800.16	SAT TT=1053.69 ASSIGNMENTS=799360 CHECKS=1301740000	? (TO) TT=1800.06	SAT TT=1062.08
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-8_ext.xml	SAT TT=6.669	SAT TT=79.698 CHECKS=450018000 NODES=287009	SAT TT=84.474 CHECKS=471067000 NODES=299430	SAT TT=20.504	SAT TT=528.157 CHECKS=132372000	SAT TT=279.613 CHECKS=56463700	SAT TT=49.434 ASSIGNMENTS=49890	SAT TT=45.982 ASSIGNMENTS=49890	SAT TT=63.784 CHECKS=20747700 NODES=176953	SAT TT=16.594 CHECKS=122544000 NODES=381471	? (TO) TT=1800	SAT TT=13.585 ASSIGNMENTS=49057 CHECKS=26140500	SAT TT=81.44 ASSIGNMENTS=287009 CHECKS=450018000	SAT TT=623.722	SAT TT=1069.08	SAT TT=23.187 ASSIGNMENTS=173702 CHECKS=93003800	SAT TT=13.053 ASSIGNMENTS=105777 CHECKS=56239500	SAT TT=181.596	SAT TT=13.011 ASSIGNMENTS=95388 CHECKS=50727600	SAT TT=6.669 ASSIGNMENTS=49057 CHECKS=26140500	SAT TT=531.048	SAT TT=116.781 ASSIGNMENTS=32773 CHECKS=62278100	SAT TT=341.871	SAT TT=285.02
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-10_ext.xml	SAT TT=28.202	SAT TT=69.028 CHECKS=364894000 NODES=276758	SAT TT=68.909 CHECKS=363721000 NODES=274769	SAT TT=135.418	? (TO) TT=1800.02	SAT TT=1640.55 CHECKS=331296000	SAT TT=285.145 ASSIGNMENTS=347458	SAT TT=292.405 ASSIGNMENTS=347458	SAT TT=178.039 CHECKS=51072200 NODES=467696	SAT TT=28.202 CHECKS=210717000 NODES=652673	? (TO) TT=1800.02	SAT TT=97.421 ASSIGNMENTS=713151 CHECKS=368278000	SAT TT=71.141 ASSIGNMENTS=276758 CHECKS=364894000	SAT TT=276.09	SAT TT=286.809	SAT TT=68.867 ASSIGNMENTS=556038 CHECKS=283010000	SAT TT=68.424 ASSIGNMENTS=557184 CHECKS=282784000	? (TO) TT=1800.07	SAT TT=68.353 ASSIGNMENTS=545002 CHECKS=277779000	SAT TT=83.94 ASSIGNMENTS=713151 CHECKS=368278000	SAT TT=1510.92	SAT TT=1265.07 ASSIGNMENTS=1206190 CHECKS=2031530000	SAT TT=194.285	SAT TT=1626.45
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-11_ext.xml	UNSAT TT=104.571	UNSAT TT=358.316 CHECKS=1946750000 NODES=1374860	UNSAT TT=336.795 CHECKS=1957920000 NODES=1379980	UNSAT TT=170.921	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=492.315 ASSIGNMENTS=594198	UNSAT TT=485.189 ASSIGNMENTS=594198	UNSAT TT=386.367 CHECKS=119229000 NODES=1084310	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=119.161 ASSIGNMENTS=868010 CHECKS=446714000	UNSAT TT=335.462 ASSIGNMENTS=1374860 CHECKS=1946750000	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=115.569 ASSIGNMENTS=973805 CHECKS=497934000	UNSAT TT=115.448 ASSIGNMENTS=905233 CHECKS=464851000	? (TO) TT=1800.04	UNSAT TT=104.571 ASSIGNMENTS=876258 CHECKS=450591000	UNSAT TT=109.238 ASSIGNMENTS=868010 CHECKS=446714000	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-13_ext.xml	UNSAT TT=27.619	UNSAT TT=138.109 CHECKS=768417000 NODES=501800	UNSAT TT=140.051 CHECKS=790862000 NODES=514776	UNSAT TT=48.975	? (TO) TT=1800.04	? (TO) TT=1800.11	UNSAT TT=116.039 ASSIGNMENTS=134012	UNSAT TT=126.27 ASSIGNMENTS=134012	UNSAT TT=85.347 CHECKS=28846000 NODES=242672	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=39.87 ASSIGNMENTS=237191 CHECKS=128647000	UNSAT TT=133.468 ASSIGNMENTS=501800 CHECKS=768417000	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=30.647 ASSIGNMENTS=227826 CHECKS=122972000	UNSAT TT=27.619 ASSIGNMENTS=222006 CHECKS=118911000	UNSAT TT=648.706	UNSAT TT=29.82 ASSIGNMENTS=220528 CHECKS=119027000	UNSAT TT=31.545 ASSIGNMENTS=237191 CHECKS=128647000	? (TO) TT=1800.14	UNSAT TT=604.761 ASSIGNMENTS=412849 CHECKS=813209000	UNSAT TT=469.602	UNSAT TT=1377.33
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-15_ext.xml	SAT TT=2.342	SAT TT=30.274 CHECKS=169255000 NODES=107442	SAT TT=26.301 CHECKS=158617000 NODES=102361	SAT TT=2.342	? (TO) TT=1800.09	SAT TT=301.586 CHECKS=62924800	SAT TT=60.219 ASSIGNMENTS=64944	SAT TT=60.972 ASSIGNMENTS=64944	SAT TT=37.921 CHECKS=13629400 NODES=106775	SAT TT=20.378 CHECKS=138851000 NODES=439135	? (TO) TT=1800.07	SAT TT=23.201 ASSIGNMENTS=114729 CHECKS=61629100	SAT TT=35.188 ASSIGNMENTS=107442 CHECKS=169255000	SAT TT=85.066	SAT TT=766.207	SAT TT=7.241 ASSIGNMENTS=52911 CHECKS=28605500	SAT TT=13.69 ASSIGNMENTS=111537 CHECKS=59179800	SAT TT=134.819	SAT TT=15.526 ASSIGNMENTS=114489 CHECKS=61204400	SAT TT=15.699 ASSIGNMENTS=114729 CHECKS=61629100	SAT TT=1343.23	SAT TT=87.79 ASSIGNMENTS=57383 CHECKS=126015000	SAT TT=4.433	SAT TT=6.382
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-16_ext.xml	UNSAT TT=99.686	UNSAT TT=224.628 CHECKS=1314660000 NODES=1002760	UNSAT TT=227.358 CHECKS=1306120000 NODES=997863	UNSAT TT=131.696	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=372.422 ASSIGNMENTS=503703	UNSAT TT=400.221 ASSIGNMENTS=503703	UNSAT TT=307.555 CHECKS=92418000 NODES=865385	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=110.213 ASSIGNMENTS=818408 CHECKS=414846000	UNSAT TT=232.156 ASSIGNMENTS=1002760 CHECKS=1314660000	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=100.91 ASSIGNMENTS=820446 CHECKS=415822000	UNSAT TT=99.686 ASSIGNMENTS=818978 CHECKS=414396000	? (TO) TT=1800.02	UNSAT TT=104.873 ASSIGNMENTS=829731 CHECKS=422683000	UNSAT TT=102.707 ASSIGNMENTS=818408 CHECKS=414846000	? (TO) TT=1800.17	UNSAT TT=1120.61 ASSIGNMENTS=1095710 CHECKS=1824950000	? (TO) TT=1800.11	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-19_ext.xml	UNSAT TT=43.001	UNSAT TT=126.294 CHECKS=735696000 NODES=510919	UNSAT TT=125.754 CHECKS=729967000 NODES=506283	UNSAT TT=109.154	? (TO) TT=1800.09	UNSAT TT=786.588 CHECKS=165167000	UNSAT TT=179.661 ASSIGNMENTS=211865	UNSAT TT=194.144 ASSIGNMENTS=211865	UNSAT TT=143.757 CHECKS=48902200 NODES=418900	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=58.447 ASSIGNMENTS=391312 CHECKS=203760000	UNSAT TT=134.054 ASSIGNMENTS=510919 CHECKS=735696000	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=51.348 ASSIGNMENTS=399906 CHECKS=207899000	UNSAT TT=43.001 ASSIGNMENTS=363298 CHECKS=187928000	UNSAT TT=1270.51	UNSAT TT=47.255 ASSIGNMENTS=364689 CHECKS=189601000	UNSAT TT=51.201 ASSIGNMENTS=391312 CHECKS=203760000	? (TO) TT=1800.13	UNSAT TT=675.025 ASSIGNMENTS=586166 CHECKS=1102780000	UNSAT TT=899.862	? (TO) TT=1800.07
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-21_ext.xml	SAT TT=15.481	SAT TT=206.115 CHECKS=1120530000 NODES=821150	SAT TT=191.297 CHECKS=1119030000 NODES=820530	SAT TT=113.192	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=226.526 ASSIGNMENTS=279457	SAT TT=222.905 ASSIGNMENTS=279457	SAT TT=109.735 CHECKS=33419000 NODES=306080	SAT TT=44.257 CHECKS=331528000 NODES=1057260	? (TO) TT=1800.03	SAT TT=22.715 ASSIGNMENTS=137343 CHECKS=67687600	SAT TT=199.589 ASSIGNMENTS=821150 CHECKS=1120530000	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=17.138 ASSIGNMENTS=138497 CHECKS=68301300	SAT TT=56.114 ASSIGNMENTS=454319 CHECKS=226718000	SAT TT=1041.64	SAT TT=36.177 ASSIGNMENTS=289290 CHECKS=143070000	SAT TT=15.481 ASSIGNMENTS=137343 CHECKS=67687600	? (TO) TT=1800.12	SAT TT=30.05 ASSIGNMENTS=21079 CHECKS=33645500	SAT TT=122.853	SAT TT=233.456
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-23_ext.xml	SAT TT=8.544	SAT TT=110.511 CHECKS=612481000 NODES=422681	SAT TT=112.046 CHECKS=607753000 NODES=419473	SAT TT=26.14	SAT TT=669.139 CHECKS=195389000	SAT TT=1415.52 CHECKS=364294000	SAT TT=176.465 ASSIGNMENTS=188229	SAT TT=164.443 ASSIGNMENTS=188229	SAT TT=83.469 CHECKS=26351600 NODES=221603	SAT TT=347.882 CHECKS=2655550000 NODES=8456400	? (TO) TT=1800.03	SAT TT=19.662 ASSIGNMENTS=102133 CHECKS=54478800	SAT TT=111.287 ASSIGNMENTS=422681 CHECKS=612481000	SAT TT=8.544	SAT TT=573.67	SAT TT=26.012 ASSIGNMENTS=198337 CHECKS=104047000	SAT TT=23.904 ASSIGNMENTS=183041 CHECKS=95836500	SAT TT=688.662	SAT TT=22.051 ASSIGNMENTS=178867 CHECKS=94465800	SAT TT=13.547 ASSIGNMENTS=102133 CHECKS=54478800	SAT TT=47.654	SAT TT=334.719 ASSIGNMENTS=273356 CHECKS=514280000	SAT TT=607.605	SAT TT=186.015
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-24_ext.xml	UNSAT TT=53.868	UNSAT TT=140.245 CHECKS=760093000 NODES=537383	UNSAT TT=138.119 CHECKS=740737000 NODES=522900	UNSAT TT=152.715	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=277.333 ASSIGNMENTS=303800	UNSAT TT=273.978 ASSIGNMENTS=303800	UNSAT TT=201.479 CHECKS=60180600 NODES=525053	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.072 ASSIGNMENTS=447356 CHECKS=236430000	UNSAT TT=138.21 ASSIGNMENTS=537383 CHECKS=760093000	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=64.211 ASSIGNMENTS=491123 CHECKS=261250000	UNSAT TT=57.387 ASSIGNMENTS=446119 CHECKS=234743000	UNSAT TT=1388.4	UNSAT TT=53.868 ASSIGNMENTS=442748 CHECKS=233632000	UNSAT TT=57.717 ASSIGNMENTS=447356 CHECKS=236430000	? (TO) TT=1800.16	UNSAT TT=1012.63 ASSIGNMENTS=657348 CHECKS=1239070000	UNSAT TT=1608.04	? (TO) TT=1800.06
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-25_ext.xml	UNSAT TT=53.415	UNSAT TT=203.88 CHECKS=1138680000 NODES=764698	UNSAT TT=205.487 CHECKS=1145510000 NODES=769644	UNSAT TT=118.915	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=211.132 ASSIGNMENTS=258629	UNSAT TT=228.985 ASSIGNMENTS=258629	UNSAT TT=181.807 CHECKS=58387400 NODES=498075	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=67.071 ASSIGNMENTS=440854 CHECKS=236197000	UNSAT TT=197.187 ASSIGNMENTS=764698 CHECKS=1138680000	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=53.415 ASSIGNMENTS=427107 CHECKS=229072000	UNSAT TT=56.959 ASSIGNMENTS=428140 CHECKS=228003000	UNSAT TT=1366.28	UNSAT TT=55.731 ASSIGNMENTS=449335 CHECKS=237713000	UNSAT TT=58.39 ASSIGNMENTS=440854 CHECKS=236197000	? (TO) TT=1800.14	UNSAT TT=689.401 ASSIGNMENTS=585184 CHECKS=1113690000	UNSAT TT=1012.34	? (TO) TT=1800.14
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-28_ext.xml	UNSAT TT=46.747	UNSAT TT=329.119 CHECKS=1840180000 NODES=1241810	UNSAT TT=319.799 CHECKS=1818330000 NODES=1230180	UNSAT TT=60.374	UNSAT TT=1667.09 CHECKS=491474000	? (TO) TT=1800.02	UNSAT TT=197.35 ASSIGNMENTS=241267	UNSAT TT=205.26 ASSIGNMENTS=241267	UNSAT TT=149.772 CHECKS=47600700 NODES=407725	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=53.909 ASSIGNMENTS=390210 CHECKS=204598000	UNSAT TT=336.891 ASSIGNMENTS=1241810 CHECKS=1840180000	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=50.772 ASSIGNMENTS=392109 CHECKS=205698000	UNSAT TT=50.012 ASSIGNMENTS=388048 CHECKS=203128000	UNSAT TT=1470.76	UNSAT TT=51.717 ASSIGNMENTS=396311 CHECKS=206639000	UNSAT TT=46.747 ASSIGNMENTS=390210 CHECKS=204598000	? (TO) TT=1800.16	UNSAT TT=706.624 ASSIGNMENTS=638200 CHECKS=1189110000	UNSAT TT=1131.9	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-29_ext.xml	UNSAT TT=18.324	UNSAT TT=42.578 CHECKS=234743000 NODES=156589	UNSAT TT=42.481 CHECKS=236131000 NODES=157630	UNSAT TT=44.918	UNSAT TT=1057.54 CHECKS=268851000	UNSAT TT=369.463 CHECKS=74603200	UNSAT TT=72.082 ASSIGNMENTS=79731	UNSAT TT=75.891 ASSIGNMENTS=79731	UNSAT TT=56.71 CHECKS=19304700 NODES=154409	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=26.113 ASSIGNMENTS=137878 CHECKS=73745500	UNSAT TT=46.845 ASSIGNMENTS=156589 CHECKS=234743000	UNSAT TT=1416.62	UNSAT TT=945.147	UNSAT TT=18.956 ASSIGNMENTS=141065 CHECKS=76048000	UNSAT TT=19.529 ASSIGNMENTS=147148 CHECKS=78504800	UNSAT TT=472.159	UNSAT TT=19.243 ASSIGNMENTS=142862 CHECKS=76495100	UNSAT TT=18.324 ASSIGNMENTS=137878 CHECKS=73745500	? (TO) TT=1800.12	UNSAT TT=316.486 ASSIGNMENTS=206712 CHECKS=428672000	UNSAT TT=398.478	UNSAT TT=832.773
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-2_ext.xml	UNSAT TT=87.705	UNSAT TT=216.601 CHECKS=1221890000 NODES=871538	UNSAT TT=225.284 CHECKS=1227120000 NODES=874571	UNSAT TT=112.184	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=385.617 ASSIGNMENTS=486744	UNSAT TT=420.058 ASSIGNMENTS=486744	UNSAT TT=264.354 CHECKS=89984100 NODES=782251	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=100.157 ASSIGNMENTS=728500 CHECKS=375463000	UNSAT TT=212.49 ASSIGNMENTS=871538 CHECKS=1221890000	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=93.115 ASSIGNMENTS=728648 CHECKS=375642000	UNSAT TT=93.493 ASSIGNMENTS=736590 CHECKS=380314000	? (TO) TT=1800.12	UNSAT TT=87.705 ASSIGNMENTS=737286 CHECKS=381430000	UNSAT TT=87.719 ASSIGNMENTS=728500 CHECKS=375463000	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-30_ext.xml	UNSAT TT=116.132	UNSAT TT=558.705 CHECKS=3301530000 NODES=2276680	UNSAT TT=578.806 CHECKS=3415650000 NODES=2353330	UNSAT TT=207.431	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=574.557 ASSIGNMENTS=691962	UNSAT TT=536.196 ASSIGNMENTS=691962	UNSAT TT=428.092 CHECKS=132678000 NODES=1176460	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=138.393 ASSIGNMENTS=1030830 CHECKS=530982000	UNSAT TT=534.906 ASSIGNMENTS=1030830 CHECKS=530982000	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=137.296 ASSIGNMENTS=1090820 CHECKS=561084000	UNSAT TT=125.95 ASSIGNMENTS=996864 CHECKS=512723000	? (TO) TT=1800.11	UNSAT TT=116.132 ASSIGNMENTS=956225 CHECKS=489579000	UNSAT TT=130.914 ASSIGNMENTS=1030830 CHECKS=530982000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-31_ext.xml	SAT TT=1.208	SAT TT=71.96 CHECKS=422272000 NODES=293133	SAT TT=75.728 CHECKS=415903000 NODES=289318	SAT TT=1.208	SAT TT=667.337 CHECKS=187444000	SAT TT=148.511 CHECKS=31962300	SAT TT=46.427 ASSIGNMENTS=55787	SAT TT=45.707 ASSIGNMENTS=55787	SAT TT=11.482 CHECKS=3735960 NODES=32691	SAT TT=1.584 CHECKS=6616610 NODES=21403	? (TO) TT=1800.07	SAT TT=19.977 ASSIGNMENTS=99024 CHECKS=49844100	SAT TT=78.464 ASSIGNMENTS=293133 CHECKS=422272000	SAT TT=236.174	SAT TT=257.71	SAT TT=24.721 ASSIGNMENTS=205274 CHECKS=104987000	SAT TT=3.931 ASSIGNMENTS=32264 CHECKS=15816500	SAT TT=272.901	SAT TT=3.757 ASSIGNMENTS=29063 CHECKS=14709400	SAT TT=12.281 ASSIGNMENTS=99024 CHECKS=49844100	? (TO) TT=1800.08	SAT TT=287.401 ASSIGNMENTS=266612 CHECKS=475770000	SAT TT=65.331	SAT TT=34.406
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-32_ext.xml	UNSAT TT=69.694	UNSAT TT=272.218 CHECKS=1497120000 NODES=1066320	UNSAT TT=270.402 CHECKS=1497250000 NODES=1066530	UNSAT TT=182.803	? (TO) TT=1800.07	UNSAT TT=1599.47 CHECKS=344219000	UNSAT TT=287.807 ASSIGNMENTS=379148	UNSAT TT=297.746 ASSIGNMENTS=379148	UNSAT TT=332.115 CHECKS=108564000 NODES=933721	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=83.66 ASSIGNMENTS=588225 CHECKS=302278000	UNSAT TT=77.337 ASSIGNMENTS=588225 CHECKS=302278000	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=69.694 ASSIGNMENTS=590537 CHECKS=303223000	UNSAT TT=77.415 ASSIGNMENTS=609524 CHECKS=312243000	? (TO) TT=1800.07	UNSAT TT=88.592 ASSIGNMENTS=687413 CHECKS=356005000	UNSAT TT=74.526 ASSIGNMENTS=588225 CHECKS=302278000	? (TO) TT=1800.14	UNSAT TT=1173.61 ASSIGNMENTS=1050180 CHECKS=1921540000	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-33_ext.xml	UNSAT TT=175.257	UNSAT TT=861.173 CHECKS=4635010000 NODES=3407270	UNSAT TT=794.987 CHECKS=4632330000 NODES=3406010	UNSAT TT=208.595	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=844.08 ASSIGNMENTS=1011330	UNSAT TT=767.953 ASSIGNMENTS=1011330	UNSAT TT=648.531 CHECKS=190411000 NODES=1771030	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=197.858 ASSIGNMENTS=1524370 CHECKS=768333000	UNSAT TT=596.025 ASSIGNMENTS=1524370 CHECKS=768333000	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=176.87 ASSIGNMENTS=1531150 CHECKS=771871000	UNSAT TT=199.956 ASSIGNMENTS=1605240 CHECKS=811978000	? (TO) TT=1800.11	UNSAT TT=193.024 ASSIGNMENTS=1535300 CHECKS=779664000	UNSAT TT=175.257 ASSIGNMENTS=1524370 CHECKS=768333000	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-35_ext.xml	SAT TT=10.911	SAT TT=143.318 CHECKS=764937000 NODES=582454	SAT TT=143.216 CHECKS=768106000 NODES=584693	SAT TT=289.731	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=105.413 ASSIGNMENTS=142938	SAT TT=115.303 ASSIGNMENTS=142938	SAT TT=389.881 CHECKS=114830000 NODES=1079660	SAT TT=27.622 CHECKS=189040000 NODES=583466	? (TO) TT=1800.09	SAT TT=81.757 ASSIGNMENTS=597435 CHECKS=304648000	SAT TT=140.492 ASSIGNMENTS=582454 CHECKS=764937000	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=51.54 ASSIGNMENTS=450228 CHECKS=227825000	SAT TT=126.02 ASSIGNMENTS=1024190 CHECKS=521673000	? (TO) TT=1800.06	SAT TT=52.121 ASSIGNMENTS=453224 CHECKS=228849000	SAT TT=74.584 ASSIGNMENTS=597435 CHECKS=304648000	? (TO) TT=1800.07	SAT TT=1749.77 ASSIGNMENTS=993786 CHECKS=1716950000	? (TO) TT=1800.08	SAT TT=10.911
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-36_ext.xml	SAT TT=10.221	SAT TT=201.537 CHECKS=1086150000 NODES=782463	SAT TT=178.523 CHECKS=1037890000 NODES=754564	SAT TT=16.299	SAT TT=1676.08 CHECKS=491545000	? (TO) TT=1800.02	SAT TT=247.759 ASSIGNMENTS=312940	SAT TT=248.953 ASSIGNMENTS=312940	SAT TT=109.573 CHECKS=33378800 NODES=301932	SAT TT=28.126 CHECKS=193437000 NODES=598790	? (TO) TT=1800.03	SAT TT=113.463 ASSIGNMENTS=837075 CHECKS=432774000	SAT TT=193.416 ASSIGNMENTS=782463 CHECKS=1086150000	? (TO) TT=1800.06	SAT TT=544.623	SAT TT=99.643 ASSIGNMENTS=803317 CHECKS=416893000	SAT TT=94.494 ASSIGNMENTS=806993 CHECKS=418006000	? (TO) TT=1800.08	SAT TT=10.221 ASSIGNMENTS=88615 CHECKS=43716800	SAT TT=106.699 ASSIGNMENTS=837075 CHECKS=432774000	SAT TT=744.649	SAT TT=996.022 ASSIGNMENTS=750462 CHECKS=1315180000	? (TO) TT=1800.1	? (TO) TT=1800.1
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-39_ext.xml	SAT TT=2.212	SAT TT=109.54 CHECKS=621663000 NODES=387323	SAT TT=109.578 CHECKS=621980000 NODES=387581	SAT TT=11.452	SAT TT=376.023 CHECKS=93482500	SAT TT=157.611 CHECKS=33164600	SAT TT=48.788 ASSIGNMENTS=49000	SAT TT=48.191 ASSIGNMENTS=49000	SAT TT=23.585 CHECKS=8219540 NODES=64957	SAT TT=42.488 CHECKS=321196000 NODES=973624	? (TO) TT=1800.07	SAT TT=20.662 ASSIGNMENTS=91217 CHECKS=50763000	SAT TT=109.772 ASSIGNMENTS=387323 CHECKS=621663000	SAT TT=82.48	SAT TT=173.025	SAT TT=12.52 ASSIGNMENTS=90466 CHECKS=50380900	SAT TT=5.657 ASSIGNMENTS=45098 CHECKS=24700200	SAT TT=335.15	SAT TT=12.854 ASSIGNMENTS=92546 CHECKS=51358800	SAT TT=12.497 ASSIGNMENTS=91217 CHECKS=50763000	SAT TT=560.15	SAT TT=96.54 ASSIGNMENTS=71398 CHECKS=161091000	SAT TT=10.285	SAT TT=2.212
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-41_ext.xml	UNSAT TT=40.626	UNSAT TT=436.765 CHECKS=2654060000 NODES=1700740	UNSAT TT=442.951 CHECKS=2656100000 NODES=1703180	UNSAT TT=57.094	? (TO) TT=1800.02	UNSAT TT=733.814 CHECKS=156934000	UNSAT TT=169.68 ASSIGNMENTS=184459	UNSAT TT=166.228 ASSIGNMENTS=184459	UNSAT TT=133.085 CHECKS=43252500 NODES=365570	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=52.015 ASSIGNMENTS=333371 CHECKS=181085000	UNSAT TT=444.73 ASSIGNMENTS=333371 CHECKS=181085000	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=42.537 ASSIGNMENTS=315252 CHECKS=170078000	UNSAT TT=43.808 ASSIGNMENTS=321785 CHECKS=175248000	UNSAT TT=1300.08	UNSAT TT=40.626 ASSIGNMENTS=324931 CHECKS=177530000	UNSAT TT=44.286 ASSIGNMENTS=333371 CHECKS=181085000	? (TO) TT=1800.15	UNSAT TT=763.889 ASSIGNMENTS=639098 CHECKS=1322820000	UNSAT TT=619.154	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-43_ext.xml	UNSAT TT=133.496	UNSAT TT=322.912 CHECKS=1771390000 NODES=1272930	UNSAT TT=306.211 CHECKS=1759810000 NODES=1265280	UNSAT TT=247.638	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=446.486 ASSIGNMENTS=573516	UNSAT TT=449.15 ASSIGNMENTS=573516	UNSAT TT=498.069 CHECKS=148577000 NODES=1361080	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=150.157 ASSIGNMENTS=1128720 CHECKS=579402000	UNSAT TT=307.115 ASSIGNMENTS=1272930 CHECKS=1771390000	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=140.535 ASSIGNMENTS=1100590 CHECKS=562597000	UNSAT TT=133.496 ASSIGNMENTS=1118490 CHECKS=573200000	? (TO) TT=1800.07	UNSAT TT=135.477 ASSIGNMENTS=1145620 CHECKS=591854000	UNSAT TT=141.483 ASSIGNMENTS=1128720 CHECKS=579402000	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-48_ext.xml	UNSAT TT=27.72	UNSAT TT=101.835 CHECKS=560349000 NODES=375736	UNSAT TT=101.232 CHECKS=558021000 NODES=374569	UNSAT TT=42.603	? (TO) TT=1800.1	UNSAT TT=564.008 CHECKS=114524000	UNSAT TT=100.341 ASSIGNMENTS=116358	UNSAT TT=91.775 ASSIGNMENTS=116358	UNSAT TT=97.65 CHECKS=31774400 NODES=258073	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=36.176 ASSIGNMENTS=219132 CHECKS=116830000	UNSAT TT=105.415 ASSIGNMENTS=375736 CHECKS=560349000	? (TO) TT=1800.02	UNSAT TT=1748.22	UNSAT TT=30.355 ASSIGNMENTS=229269 CHECKS=122945000	UNSAT TT=27.72 ASSIGNMENTS=212127 CHECKS=112116000	UNSAT TT=599.42	UNSAT TT=29.863 ASSIGNMENTS=223642 CHECKS=119459000	UNSAT TT=29.522 ASSIGNMENTS=219132 CHECKS=116830000	? (TO) TT=1800.12	UNSAT TT=635.448 ASSIGNMENTS=443929 CHECKS=866901000	UNSAT TT=321.489	UNSAT TT=1093.04
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-49_ext.xml	SAT TT=22.83	SAT TT=484.633 CHECKS=2602500000 NODES=1827620	SAT TT=449.963 CHECKS=2607160000 NODES=1827600	SAT TT=61.172	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=199.437 ASSIGNMENTS=270962	SAT TT=212.559 ASSIGNMENTS=270962	SAT TT=82.312 CHECKS=25816900 NODES=240030	SAT TT=521.268 CHECKS=4018360000 NODES=12308900	? (TO) TT=1800.03	SAT TT=28.79 ASSIGNMENTS=185571 CHECKS=94084500	SAT TT=425.179 ASSIGNMENTS=185571 CHECKS=94084500	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=79.388 ASSIGNMENTS=635279 CHECKS=324781000	SAT TT=79.227 ASSIGNMENTS=635102 CHECKS=324030000	SAT TT=612.509	SAT TT=79.99 ASSIGNMENTS=637152 CHECKS=325593000	SAT TT=22.83 ASSIGNMENTS=185571 CHECKS=94084500	? (TO) TT=1800.17	SAT TT=1065.15 ASSIGNMENTS=911803 CHECKS=1575110000	SAT TT=819.584	SAT TT=1022.94
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-50_ext.xml	SAT TT=7.312	SAT TT=888.714 CHECKS=5163200000 NODES=3808050	SAT TT=956.667 CHECKS=5150720000 NODES=3797950	SAT TT=71.21	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=871.58 ASSIGNMENTS=1068690	SAT TT=836.456 ASSIGNMENTS=1068690	SAT TT=436.884 CHECKS=128141000 NODES=1226630	SAT TT=71.164 CHECKS=496490000 NODES=1526620	? (TO) TT=1800	SAT TT=148.417 ASSIGNMENTS=1104030 CHECKS=565880000	SAT TT=543.421 ASSIGNMENTS=1104030 CHECKS=565880000	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=147.377 ASSIGNMENTS=1254260 CHECKS=643813000	SAT TT=72.657 ASSIGNMENTS=578125 CHECKS=295126000	? (TO) TT=1800.09	SAT TT=7.312 ASSIGNMENTS=58222 CHECKS=29239000	SAT TT=139.327 ASSIGNMENTS=1104030 CHECKS=565880000	? (TO) TT=1800.16	SAT TT=388.084 ASSIGNMENTS=121201 CHECKS=214940000	SAT TT=1071.79	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-10_ext.xml	SAT TT=98.581	? (TO) TT=1800.11	SAT TT=1597.81 CHECKS=9438360000 NODES=5625970	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.01	SAT TT=98.581 CHECKS=699321000 NODES=1650830	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=851.779 ASSIGNMENTS=5701800 CHECKS=3398380000	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-14_ext.xml	SAT TT=200.759	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800	SAT TT=200.759 CHECKS=1552980000 NODES=3625110	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-15_ext.xml	SAT TT=22.577	SAT TT=154.336 CHECKS=928995000 NODES=559115	SAT TT=224.013 CHECKS=1264170000 NODES=762696	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=159.413 CHECKS=1227630000 NODES=2885800	? (TO) TT=1800.08	SAT TT=159.919 ASSIGNMENTS=559115 CHECKS=928995000	SAT TT=160.608 ASSIGNMENTS=559115 CHECKS=928995000	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=1116.28 ASSIGNMENTS=7319120 CHECKS=370393000	SAT TT=1192.84 ASSIGNMENTS=7300660 CHECKS=357800000	? (TO) TT=1800.1	SAT TT=22.577 ASSIGNMENTS=152327 CHECKS=92851800	SAT TT=1155.73 ASSIGNMENTS=7496360 CHECKS=488090000	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-17_ext.xml	SAT TT=200.667	SAT TT=210.961 CHECKS=1175350000 NODES=728272	SAT TT=200.906 CHECKS=1135320000 NODES=701559	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.12	SAT TT=276.869 CHECKS=71341200 NODES=544941	SAT TT=340.734 CHECKS=2713320000 NODES=6464880	? (TO) TT=1800.02	SAT TT=200.667 ASSIGNMENTS=728272 CHECKS=1175350000	SAT TT=200.816 ASSIGNMENTS=728272 CHECKS=1175350000	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1784.06 ASSIGNMENTS=11150900 CHECKS=2722220000	SAT TT=1766.04 ASSIGNMENTS=11053600 CHECKS=2654150000	? (TO) TT=1800.11	SAT TT=390.599 ASSIGNMENTS=2484470 CHECKS=1524580000	SAT TT=1658.14 ASSIGNMENTS=10968000 CHECKS=2603940000	? (TO) TT=1800.13	SAT TT=1544.05 ASSIGNMENTS=812288 CHECKS=1681240000	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-18_ext.xml	SAT TT=173.837	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=173.837 CHECKS=1259990000 NODES=2859210	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1795.37 ASSIGNMENTS=12275000 CHECKS=3267060000	SAT TT=333.819 ASSIGNMENTS=2191820 CHECKS=1353190000	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-1_ext.xml	SAT TT=37.306	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=37.306 CHECKS=262546000 NODES=621625	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=653.22 ASSIGNMENTS=4081480 CHECKS=2552980000	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-20_ext.xml	SAT TT=6.408	SAT TT=250.098 CHECKS=1487760000 NODES=846695	SAT TT=31.053 CHECKS=178398000 NODES=99390	SAT TT=493.989	SAT TT=919.788 CHECKS=186742000	? (TO) TT=1800.03	SAT TT=773.775 ASSIGNMENTS=739594	SAT TT=772.62 ASSIGNMENTS=739594	SAT TT=468.237 CHECKS=135434000 NODES=984092	SAT TT=139.718 CHECKS=1108330000 NODES=2674630	? (TO) TT=1800.02	SAT TT=254.595 ASSIGNMENTS=846695 CHECKS=1487760000	SAT TT=238.198 ASSIGNMENTS=846695 CHECKS=1487760000	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=399.285 ASSIGNMENTS=2348420 CHECKS=1527270000	SAT TT=373.556 ASSIGNMENTS=2209080 CHECKS=1440260000	? (TO) TT=1800.04	SAT TT=6.408 ASSIGNMENTS=37539 CHECKS=23928900	SAT TT=352.853 ASSIGNMENTS=2242440 CHECKS=1463380000	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-22_ext.xml	SAT TT=209.235	SAT TT=1216.02 CHECKS=7489920000 NODES=4467590	SAT TT=618.702 CHECKS=3809160000 NODES=2299560	SAT TT=653.448	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=853.497 ASSIGNMENTS=859644	SAT TT=836.053 ASSIGNMENTS=859644	SAT TT=1017.83 CHECKS=282886000 NODES=2179520	SAT TT=582.538 CHECKS=4551390000 NODES=10716100	? (TO) TT=1800.08	SAT TT=597.419 ASSIGNMENTS=1283940 CHECKS=813954000	SAT TT=617.2 ASSIGNMENTS=1283940 CHECKS=813954000	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=330.267 ASSIGNMENTS=2201490 CHECKS=1393890000	SAT TT=357.246 ASSIGNMENTS=2199500 CHECKS=1390480000	? (TO) TT=1800.12	SAT TT=356.783 ASSIGNMENTS=2193330 CHECKS=1386740000	SAT TT=209.235 ASSIGNMENTS=1283940 CHECKS=813954000	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-24_ext.xml	SAT TT=10.139	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=842.196 ASSIGNMENTS=803077	SAT TT=844.527 ASSIGNMENTS=803077	? (TO) TT=1800.01	SAT TT=10.139 CHECKS=64161000 NODES=149591	? (TO) TT=1800.1	SAT TT=697.378 ASSIGNMENTS=1719790 CHECKS=1110710000	SAT TT=711.726 ASSIGNMENTS=1719790 CHECKS=1110710000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=289.243 ASSIGNMENTS=1724640 CHECKS=1114250000	SAT TT=135.139 ASSIGNMENTS=809452 CHECKS=524530000	? (TO) TT=1800.12	SAT TT=797.381 ASSIGNMENTS=4781560 CHECKS=3067750000	SAT TT=281.804 ASSIGNMENTS=1719790 CHECKS=1110710000	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-25_ext.xml	SAT TT=408.171	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=408.171 CHECKS=3152150000 NODES=7361730	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-29_ext.xml	SAT TT=140.391	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=565.531 CHECKS=149621000 NODES=1184740	SAT TT=140.391 CHECKS=1009950000 NODES=2388160	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=1102.43 ASSIGNMENTS=7082680 CHECKS=68728200	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-30_ext.xml	SAT TT=43.68	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=43.68 CHECKS=335257000 NODES=782987	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=1406.02 ASSIGNMENTS=9592680 CHECKS=1677110000	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-31_ext.xml	SAT TT=11.463	SAT TT=11.463 CHECKS=61828700 NODES=35983	SAT TT=26.02 CHECKS=158301000 NODES=90424	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1173.78 ASSIGNMENTS=1185560	SAT TT=1262.26 ASSIGNMENTS=1185560	? (TO) TT=1800.02	SAT TT=48.42 CHECKS=371346000 NODES=859549	? (TO) TT=1800.02	SAT TT=17.749 ASSIGNMENTS=35983 CHECKS=61828700	SAT TT=18.261 ASSIGNMENTS=35983 CHECKS=61828700	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=296.172 ASSIGNMENTS=1802580 CHECKS=1168620000	SAT TT=285.988 ASSIGNMENTS=1736640 CHECKS=1123890000	? (TO) TT=1800.04	SAT TT=298.756 ASSIGNMENTS=1807700 CHECKS=1171720000	SAT TT=285.072 ASSIGNMENTS=1735910 CHECKS=1125460000	? (TO) TT=1800.89	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-32_ext.xml	SAT TT=245.394	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=245.394 CHECKS=1738400000 NODES=4061960	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-37_ext.xml	SAT TT=44.604	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=44.604 CHECKS=339712000 NODES=768130	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-38_ext.xml	SAT TT=160.303	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=879.556 CHECKS=6747010000 NODES=15985000	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-40_ext.xml	SAT TT=101.396	SAT TT=1085.03 CHECKS=6378480000 NODES=3636110	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT TT=101.396 CHECKS=739540000 NODES=1755150	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1415.23 ASSIGNMENTS=8788760 CHECKS=1208610000	SAT TT=161.99 ASSIGNMENTS=1016920 CHECKS=618775000	? (TO) TT=1800.06	SAT TT=182.135 ASSIGNMENTS=1128990 CHECKS=694237000	SAT TT=1355.64 ASSIGNMENTS=8773730 CHECKS=1198770000	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-41_ext.xml	SAT TT=250.205	? (TO) TT=1800.17	? (TO) TT=1800.07	SAT TT=375.241	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=942.138 ASSIGNMENTS=1019870	SAT TT=936.617 ASSIGNMENTS=1019870	? (TO) TT=1800.01	SAT TT=779.495 CHECKS=6034310000 NODES=14448300	? (TO) TT=1800.07	SAT TT=649.687 ASSIGNMENTS=1566560 CHECKS=954342000	SAT TT=652.892 ASSIGNMENTS=1566560 CHECKS=954342000	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=274.883 ASSIGNMENTS=1848430 CHECKS=1128530000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=250.205 ASSIGNMENTS=1566560 CHECKS=954342000	? (TO) TT=1800.63	? (TO) TT=1800.06	SAT TT=360.106	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-42_ext.xml	SAT TT=6.273	SAT TT=247.095 CHECKS=1491670000 NODES=861345	SAT TT=6.273 CHECKS=31014700 NODES=18741	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=728.943 ASSIGNMENTS=710176	SAT TT=733.417 ASSIGNMENTS=710176	? (TO) TT=1800.05	SAT TT=272.788 CHECKS=1970470000 NODES=4687070	? (TO) TT=1800.05	SAT TT=246.933 ASSIGNMENTS=861345 CHECKS=1491670000	SAT TT=258.321 ASSIGNMENTS=861345 CHECKS=1491670000	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=174.068 ASSIGNMENTS=1038020 CHECKS=665244000	SAT TT=1234.12 ASSIGNMENTS=8095000 CHECKS=786497000	SAT TT=1195.5	SAT TT=1299.67 ASSIGNMENTS=8067700 CHECKS=763485000	SAT TT=173.553 ASSIGNMENTS=1024030 CHECKS=657058000	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-43_ext.xml	SAT TT=170.779	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=170.779 CHECKS=1332520000 NODES=3057080	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-44_ext.xml	SAT TT=42.149	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=42.149 CHECKS=322577000 NODES=740400	? (TO) TT=1800.03	SAT TT=636.581 ASSIGNMENTS=1458530 CHECKS=910314000	SAT TT=636.433 ASSIGNMENTS=1458530 CHECKS=910314000	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=237.293 ASSIGNMENTS=1486870 CHECKS=930255000	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=236.431 ASSIGNMENTS=1474630 CHECKS=919857000	SAT TT=218.817 ASSIGNMENTS=1458530 CHECKS=910314000	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-47_ext.xml	SAT TT=1691.98	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=1691.98 CHECKS=12403100000 NODES=29592300	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-7_ext.xml	SAT TT=148.844	SAT TT=1756.55 CHECKS=10821600000 NODES=5839610	SAT TT=1787.99 CHECKS=11369000000 NODES=6114040	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=148.844 CHECKS=1144550000 NODES=2698700	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-8_ext.xml	SAT TT=219.913	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=219.913 CHECKS=1726360000 NODES=4109370	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=642.238 ASSIGNMENTS=4037110 CHECKS=2474580000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=615.929 ASSIGNMENTS=3911900 CHECKS=2391800000	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-9_ext.xml	SAT TT=138.991	SAT TT=580.073 CHECKS=3353890000 NODES=2055440	SAT TT=138.991 CHECKS=829415000 NODES=515531	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.06	SAT TT=319.325 CHECKS=2525020000 NODES=6040810	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1161.67 ASSIGNMENTS=7371760 CHECKS=236856000	SAT TT=1068.86 ASSIGNMENTS=7371810 CHECKS=226862000	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=1085.34 ASSIGNMENTS=7366520 CHECKS=231098000	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-10_ext.xml	SAT TT=576.094	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=848.544	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	SAT TT=576.094 CHECKS=4428530000 NODES=10460900	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-1_ext.xml	SAT TT=148.397	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=148.397 CHECKS=1068960000 NODES=2533800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-20_ext.xml	SAT TT=155.136	? (TO) TT=1800.1	? (TO) TT=1800.17	SAT TT=849.825	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=1754.95 ASSIGNMENTS=1688690	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=198.919 CHECKS=1463070000 NODES=3527900	? (TO) TT=1800.07	SAT TT=172.685 ASSIGNMENTS=993263 CHECKS=633305000	SAT TT=576.45 ASSIGNMENTS=993263 CHECKS=633305000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=164.148 ASSIGNMENTS=993834 CHECKS=633064000	SAT TT=248.693 ASSIGNMENTS=1491090 CHECKS=959874000	? (TO) TT=1800.11	SAT TT=1776.9 ASSIGNMENTS=10453200 CHECKS=2449180000	SAT TT=155.136 ASSIGNMENTS=993263 CHECKS=633305000	? (TO) TT=1800.12	SAT TT=874.99 ASSIGNMENTS=435913 CHECKS=965554000	? (TO) TT=1800.14	? (TO) TT=1800.11
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-21_ext.xml	SAT TT=157.878	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.14	SAT TT=727.168 CHECKS=193897000 NODES=1471850	SAT TT=157.878 CHECKS=1214530000 NODES=2788120	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-24_ext.xml	SAT TT=590.139	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=590.139 CHECKS=4367570000 NODES=10240800	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-25_ext.xml	SAT TT=1682.54	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=1682.54 CHECKS=13009700000 NODES=30381800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-27_ext.xml	SAT TT=137.858	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.04	SAT TT=137.858 CHECKS=972194000 NODES=2276630	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.81	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-29_ext.xml	SAT TT=30.595	SAT TT=30.595 CHECKS=164163000 NODES=101562	SAT TT=351.299 CHECKS=2103520000 NODES=1253230	SAT TT=316.911	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=844.453 ASSIGNMENTS=785973	SAT TT=844.735 ASSIGNMENTS=785973	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=35.706 ASSIGNMENTS=101562 CHECKS=164163000	SAT TT=35.844 ASSIGNMENTS=101562 CHECKS=164163000	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=249.277 ASSIGNMENTS=1534150 CHECKS=987591000	SAT TT=250.112 ASSIGNMENTS=1511460 CHECKS=972959000	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=209.518 ASSIGNMENTS=1253730 CHECKS=805907000	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-2_ext.xml	SAT TT=380.688	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=663.018 CHECKS=4769910000 NODES=11192700	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=863.068 ASSIGNMENTS=4975910 CHECKS=3295370000	SAT TT=380.688 ASSIGNMENTS=2221600 CHECKS=1451650000	? (TO) TT=1800.05	SAT TT=610.995 ASSIGNMENTS=3580070 CHECKS=2348730000	SAT TT=833.996 ASSIGNMENTS=4953280 CHECKS=3279720000	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-30_ext.xml	SAT TT=1166.35	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=1166.35 CHECKS=8434440000 NODES=19697200	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-35_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-36_ext.xml	SAT TT=966.597	SAT TT=1183.09 CHECKS=6657870000 NODES=4007890	SAT TT=1059.5 CHECKS=6509120000 NODES=3931210	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=993.307 ASSIGNMENTS=6371730 CHECKS=4033130000	SAT TT=966.597 ASSIGNMENTS=6330560 CHECKS=4002570000	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=1026.39 ASSIGNMENTS=6367460 CHECKS=4029880000	SAT TT=1126.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.15
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-37_ext.xml	SAT TT=680.963	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.01	SAT TT=680.963 CHECKS=5330020000 NODES=12061000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-40_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.07
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-41_ext.xml	SAT TT=129.195	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=129.195 CHECKS=925751000 NODES=2213500	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-42_ext.xml	SAT TT=431.763	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=431.763 CHECKS=3143970000 NODES=7468140	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-44_ext.xml	SAT TT=147.156	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=147.156 ASSIGNMENTS=931286 CHECKS=585770000	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-46_ext.xml	SAT TT=391.069	SAT TT=391.069 CHECKS=2356840000 NODES=1494170	SAT TT=395.917 CHECKS=2226390000 NODES=1424280	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=579.218 CHECKS=4158490000 NODES=9860180	? (TO) TT=1800.06	SAT TT=394.26 ASSIGNMENTS=1494170 CHECKS=2356840000	SAT TT=406.541 ASSIGNMENTS=1494170 CHECKS=2356840000	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-47_ext.xml	SAT TT=424.404	SAT TT=424.404 CHECKS=2525550000 NODES=1617500	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=581.928 CHECKS=4199430000 NODES=10005900	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-48_ext.xml	SAT TT=439.352	? (TO) TT=1800.16	? (TO) TT=1800.09	SAT TT=439.352	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1036.45 ASSIGNMENTS=923032	SAT TT=1066.77 ASSIGNMENTS=923032	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=690.108 ASSIGNMENTS=4212240 CHECKS=2799820000	SAT TT=675.242 ASSIGNMENTS=4213310 CHECKS=2798470000	? (TO) TT=1800.06	SAT TT=688.195 ASSIGNMENTS=4199920 CHECKS=2789750000	SAT TT=680.218 ASSIGNMENTS=4192870 CHECKS=2786010000	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-49_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-4_ext.xml	SAT TT=84.871	? (TO) TT=1800.08	SAT TT=1299.88 CHECKS=8001200000 NODES=4584710	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=84.871 CHECKS=654610000 NODES=1533330	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=774.016 ASSIGNMENTS=4655450 CHECKS=3008550000	SAT TT=459.784 ASSIGNMENTS=2773580 CHECKS=1777890000	? (TO) TT=1800.1	SAT TT=366.197 ASSIGNMENTS=2209780 CHECKS=1422430000	SAT TT=739.971 ASSIGNMENTS=4625840 CHECKS=2988170000	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-50_ext.xml	SAT TT=1198.98	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	SAT TT=1198.98 CHECKS=9264470000 NODES=21958100	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-6_ext.xml	SAT TT=13.416	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=13.416 CHECKS=89089400 NODES=206634	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-7_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1795.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.1/ normalized-rand-2-40-8-753-100-0_ext.xml	SAT TT=1.975	SAT TT=2.019 CHECKS=2311260 NODES=3421	SAT TT=1.975 CHECKS=2123650 NODES=3208	SAT TT=6.008	SAT TT=85.343 CHECKS=71408100	SAT TT=15.617 CHECKS=15465800	SAT TT=11.295 ASSIGNMENTS=24029	SAT TT=12.278 ASSIGNMENTS=24029	SAT TT=6.905 CHECKS=709429 NODES=12491	SAT TT=2.535 CHECKS=8835820 NODES=29237	? (TO) TT=1800.09	SAT TT=10.591 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=11.211 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=5.783	SAT TT=4.016	SAT TT=3.822 ASSIGNMENTS=32395 CHECKS=27389400	SAT TT=2.28 ASSIGNMENTS=19712 CHECKS=15147100	SAT TT=26.709	SAT TT=3.918 ASSIGNMENTS=31115 CHECKS=25700400	SAT TT=3.409 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=194.043	SAT TT=16.487 ASSIGNMENTS=9878 CHECKS=13289600	SAT TT=12.65	SAT TT=29.234
csp/tightness0.1/ normalized-rand-2-40-8-753-100-11_ext.xml	SAT TT=0.814	SAT TT=5.842 CHECKS=12934300 NODES=17802	SAT TT=4.962 CHECKS=11697900 NODES=16180	SAT TT=4.087	SAT TT=112.161 CHECKS=92454000	SAT TT=11.814 CHECKS=11446500	SAT TT=12.553 ASSIGNMENTS=26230	SAT TT=13.185 ASSIGNMENTS=26230	SAT TT=23.898 CHECKS=2770180 NODES=48955	SAT TT=1.067 CHECKS=1651080 NODES=5406	SAT TT=1.294 CHECKS=3602980 NODES=4697	SAT TT=11.068 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=11.397 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=10.71	SAT TT=4.658	SAT TT=2.016 ASSIGNMENTS=16002 CHECKS=13240600	SAT TT=0.814 ASSIGNMENTS=7324 CHECKS=5146170	SAT TT=28.078	SAT TT=3.34 ASSIGNMENTS=28726 CHECKS=24076300	SAT TT=3.722 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=54.113	SAT TT=25.153 ASSIGNMENTS=32690 CHECKS=45766700	SAT TT=5.972	SAT TT=2.077
csp/tightness0.1/ normalized-rand-2-40-8-753-100-32_ext.xml	SAT TT=0.421	SAT TT=1.826 CHECKS=1797270 NODES=2687	SAT TT=2.17 CHECKS=2687810 NODES=4077	SAT TT=0.421	SAT TT=96.107 CHECKS=87280600	SAT TT=1.18 CHECKS=1054370	SAT TT=10.134 ASSIGNMENTS=22262	SAT TT=10.135 ASSIGNMENTS=22262	SAT TT=2.361 CHECKS=190970 NODES=3253	SAT TT=1.579 CHECKS=4809030 NODES=15962	SAT TT=1.136 CHECKS=3003320 NODES=4105	SAT TT=9.391 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=9.634 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=9.574	SAT TT=3.307	SAT TT=2.064 ASSIGNMENTS=17950 CHECKS=14573100	SAT TT=0.969 ASSIGNMENTS=8804 CHECKS=6255620	SAT TT=76.867	SAT TT=0.933 ASSIGNMENTS=7976 CHECKS=6388720	SAT TT=1.679 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=72.917	SAT TT=2.794 ASSIGNMENTS=3734 CHECKS=4988570	SAT TT=6.412	SAT TT=3.199
csp/tightness0.1/ normalized-rand-2-40-8-753-100-41_ext.xml	SAT TT=0.134	SAT TT=5.728 CHECKS=12381300 NODES=18439	SAT TT=4.958 CHECKS=11441600 NODES=17104	SAT TT=12.334	SAT TT=2.367 CHECKS=2025950	SAT TT=3.148 CHECKS=3055130	SAT TT=1.562 ASSIGNMENTS=1094	SAT TT=1.261 ASSIGNMENTS=1094	SAT TT=7.202 CHECKS=760665 NODES=13738	SAT TT=7.757 CHECKS=40660700 NODES=135032	? (TO) TT=1800.01	SAT TT=0.148 ASSIGNMENTS=786 CHECKS=625484	SAT TT=0.147 ASSIGNMENTS=786 CHECKS=625484	SAT TT=36.349	SAT TT=56.771	SAT TT=0.166 ASSIGNMENTS=1060 CHECKS=830357	SAT TT=0.484 ASSIGNMENTS=4912 CHECKS=2932930	SAT TT=6.949	SAT TT=2.756 ASSIGNMENTS=24295 CHECKS=19603800	SAT TT=0.134 ASSIGNMENTS=786 CHECKS=625484	SAT TT=13.684	SAT TT=3.054 ASSIGNMENTS=4365 CHECKS=5369940	SAT TT=6.202	SAT TT=21.241
csp/tightness0.1/ normalized-rand-2-40-8-753-100-48_ext.xml	SAT TT=0.972	SAT TT=2.351 CHECKS=2985560 NODES=4205	SAT TT=2.904 CHECKS=4720170 NODES=6769	SAT TT=5.734	SAT TT=5.027 CHECKS=3930650	SAT TT=11.861 CHECKS=10663000	SAT TT=11.137 ASSIGNMENTS=22220	SAT TT=10.308 ASSIGNMENTS=22220	SAT TT=19.916 CHECKS=2250870 NODES=40216	SAT TT=2.225 CHECKS=8462850 NODES=28055	? (TO) TT=1800.05	SAT TT=8.701 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=9.176 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=23.646	SAT TT=14.971	SAT TT=1.63 ASSIGNMENTS=13322 CHECKS=10800500	SAT TT=0.972 ASSIGNMENTS=8745 CHECKS=6255490	SAT TT=86.993	SAT TT=6.131 ASSIGNMENTS=52750 CHECKS=43372200	SAT TT=1.673 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=500.845	SAT TT=5.827 ASSIGNMENTS=7614 CHECKS=9941790	SAT TT=12.289	SAT TT=5.043
csp/tightness0.1/ normalized-rand-2-40-8-753-100-56_ext.xml	SAT TT=0.605	SAT TT=1.401 CHECKS=770964 NODES=1087	SAT TT=2.319 CHECKS=3416050 NODES=4831	SAT TT=0.605	SAT TT=2.444 CHECKS=1978430	SAT TT=1.287 CHECKS=1136140	SAT TT=12.865 ASSIGNMENTS=27434	SAT TT=12.988 ASSIGNMENTS=27434	SAT TT=1.036 CHECKS=52278 NODES=742	SAT TT=6.4 CHECKS=30039200 NODES=99562	SAT TT=5.181 CHECKS=33388100 NODES=27497	SAT TT=9.402 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=9.747 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=5.52	SAT TT=19.198	SAT TT=0.914 ASSIGNMENTS=7402 CHECKS=6586340	SAT TT=1 ASSIGNMENTS=8926 CHECKS=6561500	SAT TT=43.619	SAT TT=1.008 ASSIGNMENTS=7601 CHECKS=6589330	SAT TT=2.238 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=107.597	SAT TT=3.641 ASSIGNMENTS=725 CHECKS=898353	SAT TT=13.51	SAT TT=2.318
csp/tightness0.1/ normalized-rand-2-40-8-753-100-64_ext.xml	UNSAT TT=4.48	UNSAT TT=19.451 CHECKS=51706200 NODES=68370	UNSAT TT=18.988 CHECKS=50529900 NODES=66988	UNSAT TT=7.565	UNSAT TT=126.586 CHECKS=106877000	UNSAT TT=78.884 CHECKS=85934200	UNSAT TT=18.814 ASSIGNMENTS=38061	UNSAT TT=18.194 ASSIGNMENTS=38061	UNSAT TT=21.411 CHECKS=2679380 NODES=46312	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=11.255 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=12.012 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=35.707	UNSAT TT=87.765	UNSAT TT=4.599 ASSIGNMENTS=36610 CHECKS=31199000	UNSAT TT=5.137 ASSIGNMENTS=41856 CHECKS=34839500	UNSAT TT=140.927	UNSAT TT=5.262 ASSIGNMENTS=40996 CHECKS=35306700	UNSAT TT=4.48 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=405.616	UNSAT TT=49.267 ASSIGNMENTS=61846 CHECKS=87881200	UNSAT TT=20.084	UNSAT TT=100.848
csp/tightness0.1/ normalized-rand-2-40-8-753-100-65_ext.xml	UNSAT TT=5.441	UNSAT TT=21.26 CHECKS=61447000 NODES=82502	UNSAT TT=19.554 CHECKS=56734600 NODES=75877	UNSAT TT=7.517	UNSAT TT=133.324 CHECKS=112496000	UNSAT TT=88.527 CHECKS=88418700	UNSAT TT=22.128 ASSIGNMENTS=46716	UNSAT TT=22.081 ASSIGNMENTS=46716	UNSAT TT=30.498 CHECKS=3360850 NODES=58208	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=13.201 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=13.966 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=91.123	UNSAT TT=117.818	UNSAT TT=5.441 ASSIGNMENTS=47660 CHECKS=39920100	UNSAT TT=5.759 ASSIGNMENTS=51545 CHECKS=42585900	UNSAT TT=209.192	UNSAT TT=6.171 ASSIGNMENTS=49973 CHECKS=41936200	UNSAT TT=6.17 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=864.002	UNSAT TT=49.351 ASSIGNMENTS=73994 CHECKS=104987000	UNSAT TT=47.75	UNSAT TT=154.142
csp/tightness0.1/ normalized-rand-2-40-8-753-100-6_ext.xml	UNSAT TT=4.675	UNSAT TT=17.77 CHECKS=46673500 NODES=61059	UNSAT TT=17.752 CHECKS=47518000 NODES=62059	UNSAT TT=6.9	UNSAT TT=131.167 CHECKS=107708000	UNSAT TT=86.789 CHECKS=85574600	UNSAT TT=14.56 ASSIGNMENTS=31054	UNSAT TT=14.156 ASSIGNMENTS=31054	UNSAT TT=21.537 CHECKS=2608290 NODES=43881	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=11.181 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=12.437 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=41.172	UNSAT TT=46.928	UNSAT TT=4.738 ASSIGNMENTS=39760 CHECKS=35004900	UNSAT TT=4.719 ASSIGNMENTS=41711 CHECKS=35276600	UNSAT TT=158.921	UNSAT TT=4.74 ASSIGNMENTS=39150 CHECKS=34291800	UNSAT TT=4.675 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=690.018	UNSAT TT=43.938 ASSIGNMENTS=49511 CHECKS=72785900	UNSAT TT=38.89	UNSAT TT=110.877
csp/tightness0.1/ normalized-rand-2-40-8-753-100-72_ext.xml	UNSAT TT=4.469	UNSAT TT=15.341 CHECKS=39670200 NODES=51808	UNSAT TT=13.756 CHECKS=38692800 NODES=50397	UNSAT TT=5.36	UNSAT TT=117.425 CHECKS=107844000	UNSAT TT=78.843 CHECKS=80736100	UNSAT TT=14.671 ASSIGNMENTS=31763	UNSAT TT=15.962 ASSIGNMENTS=31763	UNSAT TT=20.894 CHECKS=2599930 NODES=43924	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=12.616 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=11.975 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=49.533	UNSAT TT=51.694	UNSAT TT=4.478 ASSIGNMENTS=34835 CHECKS=30400600	UNSAT TT=5.199 ASSIGNMENTS=41457 CHECKS=35167400	UNSAT TT=118.188	UNSAT TT=4.469 ASSIGNMENTS=36754 CHECKS=32177000	UNSAT TT=5.105 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=507.101	UNSAT TT=45.862 ASSIGNMENTS=47769 CHECKS=70588300	UNSAT TT=22.01	UNSAT TT=69.967
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.1/ normalized-rand-2-40-8-753-100-77_ext.xml	SAT TT=0.326	SAT TT=1.37 CHECKS=933727 NODES=1421	SAT TT=1.234 CHECKS=261015 NODES=411	SAT TT=1.22	SAT TT=1.636 CHECKS=1344400	SAT TT=2.324 CHECKS=2179850	SAT TT=3.943 ASSIGNMENTS=7339	SAT TT=4.201 ASSIGNMENTS=7339	SAT TT=4.818 CHECKS=485414 NODES=8507	SAT TT=0.831 CHECKS=311614 NODES=961	SAT TT=1.852 CHECKS=8604390 NODES=9604	SAT TT=8.789 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=9.461 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=11.544	SAT TT=3.224	SAT TT=0.857 ASSIGNMENTS=7262 CHECKS=5971150	SAT TT=2.232 ASSIGNMENTS=20682 CHECKS=15887400	SAT TT=60.654	SAT TT=0.326 ASSIGNMENTS=2625 CHECKS=2122540	SAT TT=1.789 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=152.334	SAT TT=1.09 ASSIGNMENTS=521 CHECKS=620777	SAT TT=3.231	SAT TT=3.196
csp/tightness0.1/ normalized-rand-2-40-8-753-100-78_ext.xml	UNSAT TT=3.519	UNSAT TT=12.203 CHECKS=31217900 NODES=39710	UNSAT TT=11.193 CHECKS=30959200 NODES=39265	UNSAT TT=4.527	UNSAT TT=108.685 CHECKS=96040300	UNSAT TT=77.302 CHECKS=77403000	UNSAT TT=10.635 ASSIGNMENTS=20651	UNSAT TT=10.937 ASSIGNMENTS=20651	UNSAT TT=17.5 CHECKS=2278370 NODES=37137	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=11.187 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=11.9 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=45.903	UNSAT TT=55.682	UNSAT TT=3.556 ASSIGNMENTS=29732 CHECKS=26427600	UNSAT TT=3.519 ASSIGNMENTS=28381 CHECKS=24033800	UNSAT TT=113.643	UNSAT TT=3.744 ASSIGNMENTS=28573 CHECKS=25395000	UNSAT TT=3.848 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=261.12	UNSAT TT=30.507 ASSIGNMENTS=39976 CHECKS=62490300	UNSAT TT=19.124	UNSAT TT=76.231
csp/tightness0.1/ normalized-rand-2-40-8-753-100-82_ext.xml	UNSAT TT=5.271	UNSAT TT=22.45 CHECKS=59935200 NODES=80448	UNSAT TT=22.964 CHECKS=61231200 NODES=81900	UNSAT TT=9.224	UNSAT TT=138.177 CHECKS=112322000	UNSAT TT=85.508 CHECKS=84703500	UNSAT TT=23.225 ASSIGNMENTS=48513	UNSAT TT=22.56 ASSIGNMENTS=48513	UNSAT TT=30.76 CHECKS=3579240 NODES=62128	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=13.821 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=12.778 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=65.562	UNSAT TT=70.233	UNSAT TT=5.502 ASSIGNMENTS=44332 CHECKS=37272200	UNSAT TT=5.271 ASSIGNMENTS=46952 CHECKS=38587800	UNSAT TT=167.027	UNSAT TT=6 ASSIGNMENTS=48371 CHECKS=40602600	UNSAT TT=6.124 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=580.146	UNSAT TT=48.007 ASSIGNMENTS=66809 CHECKS=94248800	UNSAT TT=30.82	UNSAT TT=109.196
csp/tightness0.1/ normalized-rand-2-40-8-753-100-83_ext.xml	UNSAT TT=4.554	UNSAT TT=19.951 CHECKS=52732400 NODES=70053	UNSAT TT=19.225 CHECKS=55640900 NODES=73980	UNSAT TT=8.129	UNSAT TT=113.918 CHECKS=97439700	UNSAT TT=83.874 CHECKS=84936100	UNSAT TT=14.588 ASSIGNMENTS=32501	UNSAT TT=14.488 ASSIGNMENTS=32501	UNSAT TT=21.246 CHECKS=2529280 NODES=43372	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=13.151 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=12.327 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=55.66	UNSAT TT=57.261	UNSAT TT=5.079 ASSIGNMENTS=40509 CHECKS=34873300	UNSAT TT=5.045 ASSIGNMENTS=41348 CHECKS=34602300	UNSAT TT=134.149	UNSAT TT=4.554 ASSIGNMENTS=38989 CHECKS=33407100	UNSAT TT=5.36 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=689.342	UNSAT TT=49.034 ASSIGNMENTS=58575 CHECKS=84318300	UNSAT TT=21.573	UNSAT TT=99.914
csp/tightness0.1/ normalized-rand-2-40-8-753-100-94_ext.xml	UNSAT TT=4.067	UNSAT TT=17.128 CHECKS=44537200 NODES=59512	UNSAT TT=15.942 CHECKS=45046000 NODES=60088	UNSAT TT=6.9	UNSAT TT=113.346 CHECKS=95060500	UNSAT TT=82.367 CHECKS=84345000	UNSAT TT=13.942 ASSIGNMENTS=30585	UNSAT TT=13.803 ASSIGNMENTS=30585	UNSAT TT=18.947 CHECKS=2434540 NODES=41103	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=11.249 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=12.603 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=49.324	UNSAT TT=67.783	UNSAT TT=4.582 ASSIGNMENTS=36068 CHECKS=31049700	UNSAT TT=4.067 ASSIGNMENTS=35704 CHECKS=29618900	UNSAT TT=145.651	UNSAT TT=4.42 ASSIGNMENTS=34341 CHECKS=29580500	UNSAT TT=4.782 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=424.975	UNSAT TT=43.931 ASSIGNMENTS=52106 CHECKS=75092500	UNSAT TT=17.927	UNSAT TT=50.488
csp/tightness0.2/ normalized-rand-2-40-11-414-200-10_ext.xml	SAT TT=1.335	SAT TT=12.673 CHECKS=45884900 NODES=55001	SAT TT=12.941 CHECKS=46025500 NODES=55435	SAT TT=5.08	SAT TT=199.117 CHECKS=106847000	SAT TT=85.589 CHECKS=52501200	SAT TT=7.204 ASSIGNMENTS=13374	SAT TT=7.969 ASSIGNMENTS=13374	SAT TT=38.118 CHECKS=8037150 NODES=111501	SAT TT=1.335 CHECKS=4236290 NODES=18514	? (TO) TT=1800.08	SAT TT=9.883 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=10.14 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=8.786	SAT TT=33.544	SAT TT=11.204 ASSIGNMENTS=109013 CHECKS=56988000	SAT TT=8.099 ASSIGNMENTS=77915 CHECKS=39905900	SAT TT=128.786	SAT TT=9.97 ASSIGNMENTS=94750 CHECKS=49665500	SAT TT=3.289 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=366.018	SAT TT=79.024 ASSIGNMENTS=86445 CHECKS=98478400	SAT TT=47.2	SAT TT=87.588
csp/tightness0.2/ normalized-rand-2-40-11-414-200-11_ext.xml	UNSAT TT=5.81	UNSAT TT=21.161 CHECKS=82398100 NODES=87241	UNSAT TT=20.306 CHECKS=83544300 NODES=88515	UNSAT TT=6.489	UNSAT TT=189.943 CHECKS=90907500	UNSAT TT=96.817 CHECKS=61060500	UNSAT TT=22.571 ASSIGNMENTS=41032	UNSAT TT=23.47 ASSIGNMENTS=41032	UNSAT TT=24.333 CHECKS=5460600 NODES=69751	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=13.813 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=13.136 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=89.777	UNSAT TT=164.961	UNSAT TT=5.826 ASSIGNMENTS=57045 CHECKS=31577300	UNSAT TT=5.81 ASSIGNMENTS=58119 CHECKS=31399700	UNSAT TT=123.322	UNSAT TT=6.259 ASSIGNMENTS=56784 CHECKS=31331100	UNSAT TT=6.121 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=576.598	UNSAT TT=84.763 ASSIGNMENTS=88016 CHECKS=117872000	UNSAT TT=42.781	UNSAT TT=132.127
csp/tightness0.2/ normalized-rand-2-40-11-414-200-15_ext.xml	SAT TT=1.357	SAT TT=13.573 CHECKS=54300600 NODES=62324	SAT TT=15.051 CHECKS=55907600 NODES=63510	SAT TT=2.846	SAT TT=139.175 CHECKS=67663900	SAT TT=70.99 CHECKS=44138000	SAT TT=10.21 ASSIGNMENTS=18190	SAT TT=10.022 ASSIGNMENTS=18190	SAT TT=21.987 CHECKS=4615940 NODES=62433	SAT TT=2.397 CHECKS=12245800 NODES=53966	? (TO) TT=1800.08	SAT TT=13.635 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=13.737 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=80.32	SAT TT=6.383	SAT TT=5.056 ASSIGNMENTS=51361 CHECKS=27660100	SAT TT=1.357 ASSIGNMENTS=13805 CHECKS=6693430	SAT TT=20.457	SAT TT=7.145 ASSIGNMENTS=65963 CHECKS=35584100	SAT TT=6.151 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=101.758	SAT TT=16.573 ASSIGNMENTS=12467 CHECKS=16102800	SAT TT=79.317	SAT TT=130.384
csp/tightness0.2/ normalized-rand-2-40-11-414-200-20_ext.xml	SAT TT=0.826	SAT TT=17.47 CHECKS=66234400 NODES=70882	SAT TT=16.764 CHECKS=68671800 NODES=72887	SAT TT=2.317	SAT TT=93.852 CHECKS=44421600	SAT TT=24.665 CHECKS=15656300	SAT TT=8.924 ASSIGNMENTS=15468	SAT TT=9.461 ASSIGNMENTS=15468	SAT TT=17.94 CHECKS=4165740 NODES=54381	SAT TT=10.95 CHECKS=70629000 NODES=310749	SAT TT=0.996 CHECKS=1303460 NODES=2918	SAT TT=11.414 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=11.278 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=37.067	SAT TT=56.59	SAT TT=0.826 ASSIGNMENTS=7812 CHECKS=4366210	SAT TT=3.363 ASSIGNMENTS=30934 CHECKS=16263400	SAT TT=109.226	SAT TT=4.372 ASSIGNMENTS=43356 CHECKS=23857100	SAT TT=3.802 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=112.755	SAT TT=48.682 ASSIGNMENTS=50485 CHECKS=65520400	SAT TT=11.558	SAT TT=2.991
csp/tightness0.2/ normalized-rand-2-40-11-414-200-23_ext.xml	SAT TT=0.515	SAT TT=1.292 CHECKS=697289 NODES=951	SAT TT=1.503 CHECKS=1943940 NODES=2422	SAT TT=0.751	SAT TT=97.075 CHECKS=50286100	SAT TT=11.879 CHECKS=7494820	SAT TT=2.45 ASSIGNMENTS=3259	SAT TT=2.4 ASSIGNMENTS=3259	SAT TT=5.776 CHECKS=1116240 NODES=15028	SAT TT=1.166 CHECKS=3736110 NODES=16333	SAT TT=1.108 CHECKS=3663330 NODES=6647	SAT TT=0.55 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=0.515 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=7.794	SAT TT=3.77	SAT TT=0.523 ASSIGNMENTS=4787 CHECKS=2474680	SAT TT=0.815 ASSIGNMENTS=8688 CHECKS=3895810	SAT TT=2.903	SAT TT=0.663 ASSIGNMENTS=6233 CHECKS=3193240	SAT TT=0.531 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=310.957	SAT TT=68.463 ASSIGNMENTS=46465 CHECKS=55873900	SAT TT=54.831	SAT TT=18.608
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.2/ normalized-rand-2-40-11-414-200-27_ext.xml	SAT TT=0.706	SAT TT=1.077 CHECKS=575397 NODES=705	SAT TT=0.973 CHECKS=202579 NODES=231	SAT TT=2.331	SAT TT=113.902 CHECKS=53754300	SAT TT=21.675 CHECKS=12933200	SAT TT=7.217 ASSIGNMENTS=12072	SAT TT=7.237 ASSIGNMENTS=12072	SAT TT=8.959 CHECKS=1844420 NODES=23571	SAT TT=1.68 CHECKS=6396050 NODES=27814	? (TO) TT=1800	SAT TT=11.267 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=11.796 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=5.598	SAT TT=16.196	SAT TT=3.364 ASSIGNMENTS=30426 CHECKS=16717900	SAT TT=0.706 ASSIGNMENTS=8097 CHECKS=3654930	SAT TT=36.43	SAT TT=2.205 ASSIGNMENTS=21463 CHECKS=11744700	SAT TT=4 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=15.486	SAT TT=40.645 ASSIGNMENTS=41373 CHECKS=54075500	SAT TT=5.765	SAT TT=2.785
csp/tightness0.2/ normalized-rand-2-40-11-414-200-30_ext.xml	SAT TT=0.779	SAT TT=8.947 CHECKS=33146200 NODES=37515	SAT TT=9.612 CHECKS=33935300 NODES=38900	SAT TT=2.627	SAT TT=3.762 CHECKS=1990720	SAT TT=2.969 CHECKS=1866630	SAT TT=20.001 ASSIGNMENTS=38835	SAT TT=22.339 ASSIGNMENTS=38835	SAT TT=25.802 CHECKS=5520610 NODES=72829	SAT TT=0.779 CHECKS=808131 NODES=3448	? (TO) TT=1800.08	SAT TT=12.772 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=13.781 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=133.818	SAT TT=98.712	SAT TT=6.45 ASSIGNMENTS=64578 CHECKS=35185200	SAT TT=2.18 ASSIGNMENTS=22063 CHECKS=11012100	SAT TT=126.248	SAT TT=7.255 ASSIGNMENTS=66234 CHECKS=35993800	SAT TT=6.339 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=235.204	SAT TT=46.589 ASSIGNMENTS=59445 CHECKS=71267200	SAT TT=47.482	SAT TT=108.88
csp/tightness0.2/ normalized-rand-2-40-11-414-200-32_ext.xml	SAT TT=1.552	SAT TT=16.122 CHECKS=63555600 NODES=76481	SAT TT=17.825 CHECKS=66778900 NODES=79808	SAT TT=6.252	SAT TT=16.958 CHECKS=8667890	SAT TT=17.036 CHECKS=10526600	SAT TT=19.908 ASSIGNMENTS=40744	SAT TT=21.665 ASSIGNMENTS=40744	SAT TT=17.024 CHECKS=3454960 NODES=47888	SAT TT=2.26 CHECKS=10021700 NODES=43838	? (TO) TT=1800.08	SAT TT=13.251 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=12.613 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=3.075	SAT TT=7.973	SAT TT=5.396 ASSIGNMENTS=51682 CHECKS=26987700	SAT TT=1.552 ASSIGNMENTS=15627 CHECKS=7348760	SAT TT=44.834	SAT TT=4.627 ASSIGNMENTS=44613 CHECKS=22981600	SAT TT=5.565 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=105.554	SAT TT=22.231 ASSIGNMENTS=29265 CHECKS=32971500	SAT TT=3.712	SAT TT=11.935
csp/tightness0.2/ normalized-rand-2-40-11-414-200-54_ext.xml	SAT TT=4.077	SAT TT=19.597 CHECKS=79415700 NODES=88625	SAT TT=21.073 CHECKS=79353100 NODES=88900	SAT TT=7.702	SAT TT=200.04 CHECKS=98505800	SAT TT=75.883 CHECKS=46209600	SAT TT=30.094 ASSIGNMENTS=56237	SAT TT=30.031 ASSIGNMENTS=56237	SAT TT=31.078 CHECKS=6501710 NODES=87470	SAT TT=4.077 CHECKS=20559200 NODES=90495	? (TO) TT=1800.07	SAT TT=16.071 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=16.147 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=85.88	SAT TT=133.72	SAT TT=9.026 ASSIGNMENTS=84632 CHECKS=45520700	SAT TT=8.803 ASSIGNMENTS=84446 CHECKS=44620000	SAT TT=222.283	SAT TT=8.811 ASSIGNMENTS=82253 CHECKS=44056100	SAT TT=8.721 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=439.944	SAT TT=93.709 ASSIGNMENTS=139766 CHECKS=176841000	SAT TT=64.083	SAT TT=116.789
csp/tightness0.2/ normalized-rand-2-40-11-414-200-57_ext.xml	SAT TT=0.649	SAT TT=17.468 CHECKS=63830500 NODES=72951	SAT TT=17.125 CHECKS=63390400 NODES=72268	SAT TT=0.808	SAT TT=141.101 CHECKS=69825800	SAT TT=74.759 CHECKS=48406800	SAT TT=3.004 ASSIGNMENTS=3662	SAT TT=2.604 ASSIGNMENTS=3662	SAT TT=37.598 CHECKS=8692410 NODES=118036	SAT TT=9.392 CHECKS=59987100 NODES=262731	? (TO) TT=1800.08	SAT TT=0.691 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=0.673 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=11.144	SAT TT=12.056	SAT TT=0.734 ASSIGNMENTS=6637 CHECKS=3533550	SAT TT=3.804 ASSIGNMENTS=37212 CHECKS=19194800	SAT TT=13.446	SAT TT=9.381 ASSIGNMENTS=88965 CHECKS=47037100	SAT TT=0.649 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=126.891	SAT TT=19.332 ASSIGNMENTS=17512 CHECKS=21261500	SAT TT=5.733	SAT TT=49.283
csp/tightness0.2/ normalized-rand-2-40-11-414-200-6_ext.xml	SAT TT=1.019	SAT TT=23.722 CHECKS=98831400 NODES=104001	SAT TT=24.725 CHECKS=95058400 NODES=100263	SAT TT=4.92	SAT TT=162.858 CHECKS=74463900	SAT TT=25.275 CHECKS=14577800	SAT TT=18.459 ASSIGNMENTS=35711	SAT TT=20.256 ASSIGNMENTS=35711	SAT TT=17.245 CHECKS=3665850 NODES=46911	SAT TT=1.019 CHECKS=2601270 NODES=11412	? (TO) TT=1800.08	SAT TT=11.087 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=11.207 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=45.045	SAT TT=123.682	SAT TT=6.096 ASSIGNMENTS=56615 CHECKS=31136500	SAT TT=3.81 ASSIGNMENTS=39211 CHECKS=20730400	SAT TT=113.115	SAT TT=2.134 ASSIGNMENTS=18678 CHECKS=10334500	SAT TT=3.66 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=489.865	SAT TT=33.257 ASSIGNMENTS=10728 CHECKS=14347700	SAT TT=3.199	SAT TT=9.352
csp/tightness0.2/ normalized-rand-2-40-11-414-200-71_ext.xml	SAT TT=2.33	SAT TT=12.254 CHECKS=44541800 NODES=50801	SAT TT=12.645 CHECKS=45699500 NODES=52008	SAT TT=5.991	SAT TT=96.899 CHECKS=45866000	SAT TT=75.768 CHECKS=48993900	SAT TT=20.01 ASSIGNMENTS=39269	SAT TT=22.129 ASSIGNMENTS=39269	SAT TT=34.012 CHECKS=7566420 NODES=100509	SAT TT=18.387 CHECKS=113190000 NODES=496730	? (TO) TT=1800.09	SAT TT=13.254 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=14.239 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=90.921	SAT TT=22.505	SAT TT=6.554 ASSIGNMENTS=60847 CHECKS=33209100	SAT TT=2.33 ASSIGNMENTS=24753 CHECKS=12501400	SAT TT=252.57	SAT TT=8.374 ASSIGNMENTS=83006 CHECKS=44991400	SAT TT=6.779 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=614.04	SAT TT=52.851 ASSIGNMENTS=72360 CHECKS=88328500	SAT TT=50.045	SAT TT=26.859
csp/tightness0.2/ normalized-rand-2-40-11-414-200-76_ext.xml	UNSAT TT=7.452	UNSAT TT=31.281 CHECKS=121877000 NODES=132526	UNSAT TT=29.346 CHECKS=123009000 NODES=133243	UNSAT TT=8.456	UNSAT TT=212.981 CHECKS=100342000	UNSAT TT=119.067 CHECKS=69161000	UNSAT TT=29.351 ASSIGNMENTS=53891	UNSAT TT=26.943 ASSIGNMENTS=53891	UNSAT TT=35.126 CHECKS=7541860 NODES=96257	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=16.065 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=15.618 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=131.321	UNSAT TT=172.36	UNSAT TT=8.189 ASSIGNMENTS=79674 CHECKS=44272500	UNSAT TT=7.452 ASSIGNMENTS=69214 CHECKS=37410600	UNSAT TT=161.757	UNSAT TT=8.367 ASSIGNMENTS=74830 CHECKS=41480300	UNSAT TT=7.594 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=998.02	UNSAT TT=98.186 ASSIGNMENTS=113396 CHECKS=148447000	UNSAT TT=64.731	UNSAT TT=194.528
csp/tightness0.2/ normalized-rand-2-40-11-414-200-84_ext.xml	SAT TT=1.359	SAT TT=9.968 CHECKS=38396900 NODES=43025	SAT TT=10.643 CHECKS=37562100 NODES=42184	SAT TT=2.262	SAT TT=19.525 CHECKS=9756160	SAT TT=18.785 CHECKS=11608700	SAT TT=7.508 ASSIGNMENTS=13093	SAT TT=7.015 ASSIGNMENTS=13093	SAT TT=21.338 CHECKS=4514630 NODES=60257	SAT TT=1.359 CHECKS=4991240 NODES=21967	? (TO) TT=1800.02	SAT TT=14.222 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=14.181 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=18.474	SAT TT=2.126	SAT TT=5.191 ASSIGNMENTS=47439 CHECKS=24895900	SAT TT=3.674 ASSIGNMENTS=36213 CHECKS=18263800	SAT TT=88.899	SAT TT=1.909 ASSIGNMENTS=18415 CHECKS=9441660	SAT TT=6.745 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=125.734	SAT TT=21.204 ASSIGNMENTS=25142 CHECKS=27969000	SAT TT=2.21	SAT TT=5.315
csp/tightness0.2/ normalized-rand-2-40-11-414-200-85_ext.xml	SAT TT=0.664	SAT TT=7.344 CHECKS=26939700 NODES=30464	SAT TT=6.187 CHECKS=19317700 NODES=21896	SAT TT=4.307	SAT TT=37.061 CHECKS=18986000	SAT TT=6.071 CHECKS=3522100	SAT TT=17.423 ASSIGNMENTS=31800	SAT TT=17.559 ASSIGNMENTS=31800	SAT TT=5.23 CHECKS=1088760 NODES=14344	SAT TT=0.701 CHECKS=608275 NODES=2606	? (TO) TT=1800.06	SAT TT=0.674 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=0.664 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=4.367	SAT TT=20.946	SAT TT=0.84 ASSIGNMENTS=7548 CHECKS=4187880	SAT TT=1.232 ASSIGNMENTS=12631 CHECKS=6112840	SAT TT=11.531	SAT TT=1.03 ASSIGNMENTS=9376 CHECKS=4900020	SAT TT=0.731 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=20.324	SAT TT=32.748 ASSIGNMENTS=19091 CHECKS=22519600	SAT TT=22.161	SAT TT=41.214
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.35/ normalized-rand-2-40-16-250-350-10_ext.xml	UNSAT TT=4.926	UNSAT TT=19.814 CHECKS=98960300 NODES=83547	UNSAT TT=19.252 CHECKS=96822600 NODES=82085	UNSAT TT=7.138	UNSAT TT=232.077 CHECKS=71037500	UNSAT TT=126.121 CHECKS=34182600	UNSAT TT=20.291 ASSIGNMENTS=28284	UNSAT TT=22.259 ASSIGNMENTS=28284	UNSAT TT=17.478 CHECKS=6773150 NODES=57331	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=13.098 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=12.801 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=56.429	UNSAT TT=278.284	UNSAT TT=6.115 ASSIGNMENTS=57163 CHECKS=23350900	UNSAT TT=4.926 ASSIGNMENTS=51354 CHECKS=20282900	UNSAT TT=92.341	UNSAT TT=5.58 ASSIGNMENTS=52746 CHECKS=21185500	UNSAT TT=5.029 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=465.955	UNSAT TT=71.29 ASSIGNMENTS=81679 CHECKS=137294000	UNSAT TT=52.511	UNSAT TT=89.069
csp/tightness0.35/ normalized-rand-2-40-16-250-350-11_ext.xml	UNSAT TT=8.84	UNSAT TT=23.514 CHECKS=116782000 NODES=106386	UNSAT TT=22.892 CHECKS=115100000 NODES=104583	UNSAT TT=15.202	UNSAT TT=492.308 CHECKS=145087000	UNSAT TT=178.588 CHECKS=51171600	UNSAT TT=36.949 ASSIGNMENTS=52952	UNSAT TT=34.343 ASSIGNMENTS=52952	UNSAT TT=28.159 CHECKS=11845100 NODES=102097	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=16.869 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=16.686 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=179.181	UNSAT TT=459.885	UNSAT TT=9.478 ASSIGNMENTS=92081 CHECKS=37428300	UNSAT TT=8.84 ASSIGNMENTS=86664 CHECKS=34724300	UNSAT TT=177.288	UNSAT TT=9.629 ASSIGNMENTS=91937 CHECKS=37159200	UNSAT TT=9.142 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=1384.29	UNSAT TT=129.149 ASSIGNMENTS=126745 CHECKS=201868000	UNSAT TT=122.224	UNSAT TT=332.342
csp/tightness0.35/ normalized-rand-2-40-16-250-350-22_ext.xml	SAT TT=0.185	SAT TT=1.158 CHECKS=1230090 NODES=1226	SAT TT=1.519 CHECKS=2462380 NODES=2464	SAT TT=4.975	SAT TT=261.846 CHECKS=89181800	SAT TT=85.042 CHECKS=24187800	SAT TT=5.618 ASSIGNMENTS=6914	SAT TT=5.241 ASSIGNMENTS=6914	SAT TT=3.802 CHECKS=1281850 NODES=12180	SAT TT=1.492 CHECKS=6031510 NODES=30365	? (TO) TT=1800	SAT TT=10.892 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=10.856 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=88.548	SAT TT=54.26	SAT TT=1.689 ASSIGNMENTS=17124 CHECKS=6451090	SAT TT=3.658 ASSIGNMENTS=41609 CHECKS=15195200	SAT TT=171.872	SAT TT=0.185 ASSIGNMENTS=1770 CHECKS=576901	SAT TT=4.067 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=239.7	SAT TT=14.2 ASSIGNMENTS=16827 CHECKS=23380900	SAT TT=7.371	SAT TT=3.334
csp/tightness0.35/ normalized-rand-2-40-16-250-350-27_ext.xml	UNSAT TT=9.558	UNSAT TT=49.733 CHECKS=247559000 NODES=227760	UNSAT TT=44.68 CHECKS=239644000 NODES=221850	UNSAT TT=16.211	UNSAT TT=261.555 CHECKS=79730200	UNSAT TT=200.025 CHECKS=55288200	UNSAT TT=42.467 ASSIGNMENTS=60279	UNSAT TT=41.842 ASSIGNMENTS=60279	UNSAT TT=32.235 CHECKS=11991600 NODES=107919	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=17.201 ASSIGNMENTS=107884 CHECKS=42576600	UNSAT TT=18.878 ASSIGNMENTS=107884 CHECKS=42576600	UNSAT TT=221.736	UNSAT TT=496.352	UNSAT TT=10.391 ASSIGNMENTS=108207 CHECKS=43101900	UNSAT TT=9.875 ASSIGNMENTS=98479 CHECKS=38283700	UNSAT TT=170.603	UNSAT TT=9.558 ASSIGNMENTS=94678 CHECKS=37169200	UNSAT TT=10.225 ASSIGNMENTS=107884 CHECKS=42576600	? (TO) TT=1800.15	UNSAT TT=131.073 ASSIGNMENTS=143832 CHECKS=217699000	UNSAT TT=107.513	UNSAT TT=352.225
csp/tightness0.35/ normalized-rand-2-40-16-250-350-2_ext.xml	UNSAT TT=10.17	UNSAT TT=28.436 CHECKS=150810000 NODES=141390	UNSAT TT=29.739 CHECKS=147848000 NODES=138677	UNSAT TT=16.932	UNSAT TT=276.787 CHECKS=82391400	UNSAT TT=191.468 CHECKS=56244400	UNSAT TT=44.411 ASSIGNMENTS=63359	UNSAT TT=44.221 ASSIGNMENTS=63359	UNSAT TT=33.779 CHECKS=14026900 NODES=124331	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=18.401 ASSIGNMENTS=105816 CHECKS=41683600	UNSAT TT=18.635 ASSIGNMENTS=105816 CHECKS=41683600	UNSAT TT=438.57	UNSAT TT=731.47	UNSAT TT=11.896 ASSIGNMENTS=114937 CHECKS=45715700	UNSAT TT=11.572 ASSIGNMENTS=115255 CHECKS=44457100	UNSAT TT=261.35	UNSAT TT=10.816 ASSIGNMENTS=112877 CHECKS=44096700	UNSAT TT=10.17 ASSIGNMENTS=105816 CHECKS=41683600	? (TO) TT=1800.14	UNSAT TT=130.079 ASSIGNMENTS=157392 CHECKS=245774000	UNSAT TT=165.608	UNSAT TT=452.974
csp/tightness0.35/ normalized-rand-2-40-16-250-350-32_ext.xml	SAT TT=1.724	SAT TT=8.759 CHECKS=40779100 NODES=38798	SAT TT=10.425 CHECKS=50713100 NODES=49552	SAT TT=3.97	SAT TT=590.888 CHECKS=200298000	SAT TT=87.084 CHECKS=25666000	SAT TT=15.179 ASSIGNMENTS=20970	SAT TT=14.306 ASSIGNMENTS=20970	SAT TT=7.025 CHECKS=2678480 NODES=24647	SAT TT=2.417 CHECKS=11457600 NODES=57860	? (TO) TT=1800.05	SAT TT=13.378 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=13.239 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=9.099	SAT TT=84.621	SAT TT=3.66 ASSIGNMENTS=39241 CHECKS=15158700	SAT TT=1.995 ASSIGNMENTS=21671 CHECKS=7673360	SAT TT=12.952	SAT TT=1.724 ASSIGNMENTS=18450 CHECKS=6834510	SAT TT=5.449 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=183.109	SAT TT=14.013 ASSIGNMENTS=15345 CHECKS=20080000	SAT TT=14.895	SAT TT=40.845
csp/tightness0.35/ normalized-rand-2-40-16-250-350-40_ext.xml	UNSAT TT=7.285	UNSAT TT=32.884 CHECKS=148983000 NODES=132460	UNSAT TT=29.6 CHECKS=148105000 NODES=131334	UNSAT TT=15.448	UNSAT TT=240.54 CHECKS=75354400	UNSAT TT=184.649 CHECKS=50218900	UNSAT TT=35.963 ASSIGNMENTS=54703	UNSAT TT=35.641 ASSIGNMENTS=54703	UNSAT TT=24.159 CHECKS=10151500 NODES=89268	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=16.279 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=17.949 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=205.608	UNSAT TT=581.185	UNSAT TT=9.375 ASSIGNMENTS=97140 CHECKS=38665900	UNSAT TT=9.792 ASSIGNMENTS=95720 CHECKS=37609600	UNSAT TT=155.985	UNSAT TT=7.285 ASSIGNMENTS=76113 CHECKS=30098400	UNSAT TT=10.003 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=1293.86	UNSAT TT=126.999 ASSIGNMENTS=124000 CHECKS=194207000	UNSAT TT=136.817	UNSAT TT=330.196
csp/tightness0.35/ normalized-rand-2-40-16-250-350-53_ext.xml	UNSAT TT=16.006	UNSAT TT=69.716 CHECKS=373919000 NODES=354527	UNSAT TT=75.712 CHECKS=378104000 NODES=358747	UNSAT TT=22.365	UNSAT TT=1036.61 CHECKS=342167000	UNSAT TT=296.073 CHECKS=84568500	UNSAT TT=70.417 ASSIGNMENTS=109780	UNSAT TT=64.392 ASSIGNMENTS=109780	UNSAT TT=52.834 CHECKS=20499100 NODES=186797	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=23.795 ASSIGNMENTS=172849 CHECKS=68487600	UNSAT TT=25.105 ASSIGNMENTS=172849 CHECKS=68487600	UNSAT TT=622.143	UNSAT TT=1238.71	UNSAT TT=18.579 ASSIGNMENTS=182024 CHECKS=72550500	UNSAT TT=16.535 ASSIGNMENTS=162947 CHECKS=64006100	UNSAT TT=374.462	UNSAT TT=16.006 ASSIGNMENTS=156891 CHECKS=61725800	UNSAT TT=17.598 ASSIGNMENTS=172849 CHECKS=68487600	? (TO) TT=1800.16	UNSAT TT=232.708 ASSIGNMENTS=247548 CHECKS=353321000	UNSAT TT=221.912	UNSAT TT=761.304
csp/tightness0.35/ normalized-rand-2-40-16-250-350-55_ext.xml	UNSAT TT=6.08	UNSAT TT=21.062 CHECKS=112365000 NODES=99419	UNSAT TT=22.39 CHECKS=112169000 NODES=99445	UNSAT TT=9.092	UNSAT TT=210.022 CHECKS=61191100	UNSAT TT=334.239 CHECKS=94736900	UNSAT TT=25.521 ASSIGNMENTS=36866	UNSAT TT=24.873 ASSIGNMENTS=36866	UNSAT TT=19.726 CHECKS=7595620 NODES=67522	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=13.327 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=14.607 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=83.332	UNSAT TT=252.883	UNSAT TT=6.336 ASSIGNMENTS=61060 CHECKS=24315500	UNSAT TT=6.082 ASSIGNMENTS=63774 CHECKS=24601700	UNSAT TT=103.546	UNSAT TT=6.08 ASSIGNMENTS=61979 CHECKS=24707000	UNSAT TT=6.742 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=838.688	UNSAT TT=121.013 ASSIGNMENTS=110865 CHECKS=175180000	UNSAT TT=72.001	UNSAT TT=156.595
csp/tightness0.35/ normalized-rand-2-40-16-250-350-64_ext.xml	SAT TT=3.135	SAT TT=14.875 CHECKS=71699600 NODES=63505	SAT TT=14.341 CHECKS=74925500 NODES=65404	SAT TT=3.135	SAT TT=104.793 CHECKS=29578700	SAT TT=99.121 CHECKS=26818100	SAT TT=8.765 ASSIGNMENTS=10046	SAT TT=8.646 ASSIGNMENTS=10046	SAT TT=10.695 CHECKS=4367420 NODES=36422	SAT TT=6.723 CHECKS=42584000 NODES=215270	? (TO) TT=1800.08	SAT TT=11.032 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=11.422 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=44.122	SAT TT=156.017	SAT TT=3.192 ASSIGNMENTS=32395 CHECKS=13039100	SAT TT=4.212 ASSIGNMENTS=40363 CHECKS=15709600	SAT TT=18.865	SAT TT=3.866 ASSIGNMENTS=38548 CHECKS=15488800	SAT TT=3.394 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=70.148	SAT TT=47.813 ASSIGNMENTS=30534 CHECKS=51608300	SAT TT=30.288	SAT TT=61.678
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.35/ normalized-rand-2-40-16-250-350-72_ext.xml	SAT TT=0.596	SAT TT=10.944 CHECKS=50366800 NODES=47006	SAT TT=10.363 CHECKS=52387200 NODES=48941	SAT TT=3.887	SAT TT=10.592 CHECKS=3399620	SAT TT=11.77 CHECKS=3365360	SAT TT=3.677 ASSIGNMENTS=3711	SAT TT=3.366 ASSIGNMENTS=3711	SAT TT=10.531 CHECKS=4085900 NODES=36646	SAT TT=4.547 CHECKS=25798600 NODES=129759	? (TO) TT=1800.03	SAT TT=1.45 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=1.465 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=23.131	SAT TT=64.916	SAT TT=1.435 ASSIGNMENTS=13749 CHECKS=5421910	SAT TT=0.596 ASSIGNMENTS=6893 CHECKS=2095540	SAT TT=56.706	SAT TT=3.573 ASSIGNMENTS=34780 CHECKS=13547900	SAT TT=1.416 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=36.306	SAT TT=75.32 ASSIGNMENTS=9598 CHECKS=14305800	SAT TT=63.687	SAT TT=23.107
csp/tightness0.35/ normalized-rand-2-40-16-250-350-7_ext.xml	UNSAT TT=10.151	UNSAT TT=61.579 CHECKS=308670000 NODES=278461	UNSAT TT=61.402 CHECKS=308969000 NODES=278608	UNSAT TT=18.466	UNSAT TT=783.628 CHECKS=263363000	UNSAT TT=198.473 CHECKS=54370500	UNSAT TT=37.523 ASSIGNMENTS=61281	UNSAT TT=37.354 ASSIGNMENTS=61281	UNSAT TT=31.102 CHECKS=12559400 NODES=114028	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=19.671 ASSIGNMENTS=118389 CHECKS=47383100	UNSAT TT=19.815 ASSIGNMENTS=118389 CHECKS=47383100	UNSAT TT=323.94	UNSAT TT=799.014	UNSAT TT=10.151 ASSIGNMENTS=100350 CHECKS=39256200	UNSAT TT=10.781 ASSIGNMENTS=107636 CHECKS=42318600	UNSAT TT=197.672	UNSAT TT=11.409 ASSIGNMENTS=112405 CHECKS=44698600	UNSAT TT=12.111 ASSIGNMENTS=118389 CHECKS=47383100	? (TO) TT=1800.12	UNSAT TT=216.347 ASSIGNMENTS=180304 CHECKS=268260000	UNSAT TT=132.065	UNSAT TT=448.671
csp/tightness0.35/ normalized-rand-2-40-16-250-350-8_ext.xml	UNSAT TT=2.986	UNSAT TT=25.784 CHECKS=143612000 NODES=116336	UNSAT TT=25.582 CHECKS=142687000 NODES=115500	UNSAT TT=7.598	UNSAT TT=124.193 CHECKS=37011200	UNSAT TT=97.773 CHECKS=28356700	UNSAT TT=15.101 ASSIGNMENTS=17364	UNSAT TT=15.025 ASSIGNMENTS=17364	UNSAT TT=10.786 CHECKS=4256100 NODES=34949	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=10.856 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=10.787 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=40.118	UNSAT TT=114.572	UNSAT TT=3.431 ASSIGNMENTS=31716 CHECKS=13333900	UNSAT TT=2.986 ASSIGNMENTS=29014 CHECKS=11379600	UNSAT TT=58.282	UNSAT TT=3.501 ASSIGNMENTS=31888 CHECKS=13181800	UNSAT TT=2.997 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=369.26	UNSAT TT=59.311 ASSIGNMENTS=42164 CHECKS=71985000	UNSAT TT=30.448	UNSAT TT=69.309
csp/tightness0.35/ normalized-rand-2-40-16-250-350-90_ext.xml	UNSAT TT=7.626	UNSAT TT=30.275 CHECKS=164079000 NODES=145182	UNSAT TT=31.928 CHECKS=162421000 NODES=143626	UNSAT TT=10.327	UNSAT TT=448.827 CHECKS=142209000	UNSAT TT=185.717 CHECKS=51488300	UNSAT TT=29.748 ASSIGNMENTS=46323	UNSAT TT=29.73 ASSIGNMENTS=46323	UNSAT TT=26.6 CHECKS=10113400 NODES=90778	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=15.704 ASSIGNMENTS=82408 CHECKS=32375100	UNSAT TT=16.077 ASSIGNMENTS=82408 CHECKS=32375100	UNSAT TT=197.255	UNSAT TT=459.957	UNSAT TT=7.626 ASSIGNMENTS=81213 CHECKS=31679600	UNSAT TT=7.919 ASSIGNMENTS=81747 CHECKS=31132800	UNSAT TT=218.422	UNSAT TT=8.178 ASSIGNMENTS=80447 CHECKS=31336300	UNSAT TT=8.214 ASSIGNMENTS=82408 CHECKS=32375100	? (TO) TT=1800.13	UNSAT TT=125.827 ASSIGNMENTS=123425 CHECKS=201909000	UNSAT TT=139.367	UNSAT TT=319.362
csp/tightness0.35/ normalized-rand-2-40-16-250-350-95_ext.xml	UNSAT TT=14.854	UNSAT TT=58.926 CHECKS=249233000 NODES=239111	UNSAT TT=46.265 CHECKS=247402000 NODES=237855	UNSAT TT=21.467	UNSAT TT=424.102 CHECKS=131550000	UNSAT TT=318.027 CHECKS=92312600	UNSAT TT=63.959 ASSIGNMENTS=96838	UNSAT TT=59.048 ASSIGNMENTS=96838	UNSAT TT=51.448 CHECKS=20931800 NODES=196433	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=21.602 ASSIGNMENTS=161097 CHECKS=61825500	UNSAT TT=23.387 ASSIGNMENTS=161097 CHECKS=61825500	UNSAT TT=572.646	UNSAT TT=1283.16	UNSAT TT=14.854 ASSIGNMENTS=161924 CHECKS=62137500	UNSAT TT=15.257 ASSIGNMENTS=157108 CHECKS=59524700	UNSAT TT=396.441	UNSAT TT=17.654 ASSIGNMENTS=176286 CHECKS=67568700	UNSAT TT=15.733 ASSIGNMENTS=161097 CHECKS=61825500	? (TO) TT=1800.15	UNSAT TT=230.722 ASSIGNMENTS=235446 CHECKS=341990000	UNSAT TT=319.801	UNSAT TT=780.711
csp/tightness0.5/ normalized-rand-2-40-25-180-500-11_ext.xml	UNSAT TT=6.063	UNSAT TT=14.883 CHECKS=98706700 NODES=68220	UNSAT TT=15.256 CHECKS=101317000 NODES=69309	UNSAT TT=64.031	UNSAT TT=399.464 CHECKS=45344500	UNSAT TT=377.411 CHECKS=31813500	UNSAT TT=42.585 ASSIGNMENTS=36874	UNSAT TT=38.954 ASSIGNMENTS=36874	UNSAT TT=16.063 CHECKS=9837400 NODES=50990	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=14.656 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=13.571 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=361.479	UNSAT TT=343.182	UNSAT TT=6.877 ASSIGNMENTS=56795 CHECKS=20320500	UNSAT TT=6.33 ASSIGNMENTS=54649 CHECKS=18834400	UNSAT TT=99.061	UNSAT TT=6.063 ASSIGNMENTS=53690 CHECKS=18965100	UNSAT TT=6.323 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=567.168	UNSAT TT=80.69 ASSIGNMENTS=69879 CHECKS=99886500	UNSAT TT=84.855	UNSAT TT=198.27
csp/tightness0.5/ normalized-rand-2-40-25-180-500-12_ext.xml	UNSAT TT=12.856	UNSAT TT=265.058 CHECKS=1704590000 NODES=1188700	UNSAT TT=267.851 CHECKS=1705090000 NODES=1188620	UNSAT TT=162.069	? (TO) TT=1800.09	UNSAT TT=784.198 CHECKS=64887600	UNSAT TT=69.521 ASSIGNMENTS=62598	UNSAT TT=63.895 ASSIGNMENTS=62598	UNSAT TT=38.41 CHECKS=24308000 NODES=139559	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=20.973 ASSIGNMENTS=118525 CHECKS=40774400	UNSAT TT=21.112 ASSIGNMENTS=118525 CHECKS=40774400	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=12.856 ASSIGNMENTS=123123 CHECKS=42677100	UNSAT TT=12.857 ASSIGNMENTS=116626 CHECKS=39448600	UNSAT TT=538.328	UNSAT TT=13.196 ASSIGNMENTS=117144 CHECKS=39884500	UNSAT TT=13.541 ASSIGNMENTS=118525 CHECKS=40774400	? (TO) TT=1800.07	UNSAT TT=170.056 ASSIGNMENTS=148691 CHECKS=226208000	UNSAT TT=482.879	? (TO) TT=1800.05
csp/tightness0.5/ normalized-rand-2-40-25-180-500-16_ext.xml	UNSAT TT=5.862	UNSAT TT=13.09 CHECKS=84442600 NODES=56760	UNSAT TT=13.92 CHECKS=84756500 NODES=56981	UNSAT TT=120.075	UNSAT TT=991.295 CHECKS=134136000	UNSAT TT=1135.57 CHECKS=92165100	UNSAT TT=29.779 ASSIGNMENTS=25740	UNSAT TT=29.268 ASSIGNMENTS=25740	UNSAT TT=15.373 CHECKS=9902800 NODES=54772	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=13.477 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=13.417 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=349.297	UNSAT TT=375.948	UNSAT TT=5.897 ASSIGNMENTS=50694 CHECKS=17704700	UNSAT TT=5.971 ASSIGNMENTS=52296 CHECKS=17579100	UNSAT TT=164.188	UNSAT TT=6.051 ASSIGNMENTS=51518 CHECKS=17816300	UNSAT TT=5.862 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=746.399	UNSAT TT=81.469 ASSIGNMENTS=73003 CHECKS=118625000	UNSAT TT=112.943	UNSAT TT=197.742
csp/tightness0.5/ normalized-rand-2-40-25-180-500-18_ext.xml	UNSAT TT=6.126	UNSAT TT=22.292 CHECKS=138580000 NODES=89378	UNSAT TT=22.879 CHECKS=140973000 NODES=90547	UNSAT TT=52.561	UNSAT TT=946.917 CHECKS=145930000	UNSAT TT=332.666 CHECKS=29344700	UNSAT TT=27.812 ASSIGNMENTS=25540	UNSAT TT=27.916 ASSIGNMENTS=25540	UNSAT TT=20.118 CHECKS=12241200 NODES=63901	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=15.275 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=14.814 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=541.562	UNSAT TT=591.22	UNSAT TT=7.049 ASSIGNMENTS=58781 CHECKS=21121500	UNSAT TT=7.007 ASSIGNMENTS=57207 CHECKS=19962200	UNSAT TT=184.877	UNSAT TT=6.126 ASSIGNMENTS=54971 CHECKS=19534200	UNSAT TT=6.946 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=1249.56	UNSAT TT=139.697 ASSIGNMENTS=66908 CHECKS=112362000	UNSAT TT=176.847	UNSAT TT=304.714
csp/tightness0.5/ normalized-rand-2-40-25-180-500-19_ext.xml	SAT TT=0.274	SAT TT=1.932 CHECKS=6959850 NODES=4410	SAT TT=2.272 CHECKS=7330000 NODES=4539	SAT TT=22.814	SAT TT=13.347 CHECKS=1357640	SAT TT=62.418 CHECKS=4371710	SAT TT=3.338 ASSIGNMENTS=1886	SAT TT=3.731 ASSIGNMENTS=1886	SAT TT=1.209 CHECKS=358321 NODES=1660	SAT TT=8.926 CHECKS=55693200 NODES=253812	? (TO) TT=1800.06	SAT TT=0.382 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=0.382 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=5.893	SAT TT=30.06	SAT TT=0.274 ASSIGNMENTS=1942 CHECKS=666487	SAT TT=0.431 ASSIGNMENTS=4843 CHECKS=1124880	SAT TT=3.949	SAT TT=0.295 ASSIGNMENTS=2163 CHECKS=619689	SAT TT=0.366 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=13.116	SAT TT=1.847 ASSIGNMENTS=339 CHECKS=520707	SAT TT=2.732	SAT TT=4.709
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.5/ normalized-rand-2-40-25-180-500-24_ext.xml	UNSAT TT=22.399	UNSAT TT=68.523 CHECKS=420758000 NODES=301210	UNSAT TT=68.151 CHECKS=422330000 NODES=302320	UNSAT TT=208.771	? (TO) TT=1800.1	UNSAT TT=1696.83 CHECKS=149834000	UNSAT TT=98.98 ASSIGNMENTS=106081	UNSAT TT=107.64 ASSIGNMENTS=106081	UNSAT TT=74.724 CHECKS=42436900 NODES=260538	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=30.141 ASSIGNMENTS=211146 CHECKS=69777100	UNSAT TT=30.801 ASSIGNMENTS=211146 CHECKS=69777100	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=22.698 ASSIGNMENTS=209825 CHECKS=69354000	UNSAT TT=26.677 ASSIGNMENTS=252219 CHECKS=82275800	UNSAT TT=666.443	UNSAT TT=22.399 ASSIGNMENTS=208230 CHECKS=68551700	UNSAT TT=22.679 ASSIGNMENTS=211146 CHECKS=69777100	? (TO) TT=1800.16	UNSAT TT=509.071 ASSIGNMENTS=365949 CHECKS=495527000	UNSAT TT=926.28	? (TO) TT=1800.1
csp/tightness0.5/ normalized-rand-2-40-25-180-500-35_ext.xml	SAT TT=2.163	SAT TT=14.077 CHECKS=89695100 NODES=65793	SAT TT=15.121 CHECKS=90333700 NODES=65910	SAT TT=2.762	SAT TT=177.733 CHECKS=21269900	SAT TT=494.751 CHECKS=42136300	SAT TT=14.634 ASSIGNMENTS=13267	SAT TT=14.423 ASSIGNMENTS=13267	SAT TT=11.497 CHECKS=6439490 NODES=36400	SAT TT=50.159 CHECKS=363498000 NODES=1656770	? (TO) TT=1800.02	SAT TT=9.571 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=9.818 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=1508.34	SAT TT=355.002	SAT TT=7.157 ASSIGNMENTS=63026 CHECKS=21400200	SAT TT=3.914 ASSIGNMENTS=36077 CHECKS=11681200	SAT TT=31.476	SAT TT=6.672 ASSIGNMENTS=59468 CHECKS=19918400	SAT TT=2.163 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=347.621	SAT TT=47.41 ASSIGNMENTS=24689 CHECKS=32454100	SAT TT=60.751	SAT TT=27.804
csp/tightness0.5/ normalized-rand-2-40-25-180-500-37_ext.xml	UNSAT TT=25.124	UNSAT TT=97.268 CHECKS=620314000 NODES=470657	UNSAT TT=101.141 CHECKS=620452000 NODES=469967	UNSAT TT=250.405	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=119.044 ASSIGNMENTS=125338	UNSAT TT=116.841 ASSIGNMENTS=125338	UNSAT TT=78.06 CHECKS=44545300 NODES=278710	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=32.028 ASSIGNMENTS=252577 CHECKS=82983100	UNSAT TT=36.068 ASSIGNMENTS=252577 CHECKS=82983100	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=26.114 ASSIGNMENTS=249460 CHECKS=81567300	UNSAT TT=25.792 ASSIGNMENTS=247250 CHECKS=80635800	UNSAT TT=922.387	UNSAT TT=25.134 ASSIGNMENTS=255902 CHECKS=83131700	UNSAT TT=25.124 ASSIGNMENTS=252577 CHECKS=82983100	? (TO) TT=1800.11	UNSAT TT=466.743 ASSIGNMENTS=348303 CHECKS=507433000	UNSAT TT=1588.52	? (TO) TT=1800.11
csp/tightness0.5/ normalized-rand-2-40-25-180-500-46_ext.xml	SAT TT=0.563	SAT TT=1.144 CHECKS=1444140 NODES=1043	SAT TT=2.779 CHECKS=12221200 NODES=8171	SAT TT=5.113	SAT TT=317.01 CHECKS=37658100	SAT TT=51.243 CHECKS=3698310	SAT TT=5.198 ASSIGNMENTS=3659	SAT TT=5.022 ASSIGNMENTS=3659	SAT TT=6.365 CHECKS=3584060 NODES=20101	SAT TT=11.589 CHECKS=79594500 NODES=367188	SAT TT=0.986 CHECKS=1125610 NODES=3583	SAT TT=8.876 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=9.51 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=31.272	SAT TT=367.949	SAT TT=0.902 ASSIGNMENTS=7375 CHECKS=2532160	SAT TT=0.563 ASSIGNMENTS=6345 CHECKS=1470540	SAT TT=18.55	SAT TT=0.966 ASSIGNMENTS=8383 CHECKS=2684700	SAT TT=1.805 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=17.486	SAT TT=2.068 ASSIGNMENTS=1003 CHECKS=1672430	SAT TT=68.686	SAT TT=21.216
csp/tightness0.5/ normalized-rand-2-40-25-180-500-51_ext.xml	SAT TT=4.494	SAT TT=62.174 CHECKS=373763000 NODES=301978	SAT TT=62.594 CHECKS=374849000 NODES=302821	SAT TT=126.557	SAT TT=361.085 CHECKS=51528900	SAT TT=567.93 CHECKS=47366100	SAT TT=9.092 ASSIGNMENTS=8431	SAT TT=9.519 ASSIGNMENTS=8431	SAT TT=13.556 CHECKS=7406600 NODES=46690	SAT TT=212.951 CHECKS=1441960000 NODES=6520200	? (TO) TT=1800.01	SAT TT=12.584 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=12.515 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=203.471	SAT TT=677.931	SAT TT=4.596 ASSIGNMENTS=44403 CHECKS=13867000	SAT TT=4.494 ASSIGNMENTS=44528 CHECKS=13465000	SAT TT=197.629	SAT TT=6.948 ASSIGNMENTS=66763 CHECKS=20966200	SAT TT=4.691 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=1123.72	SAT TT=44.295 ASSIGNMENTS=13249 CHECKS=17500900	SAT TT=32.049	SAT TT=24.758
csp/tightness0.5/ normalized-rand-2-40-25-180-500-68_ext.xml	SAT TT=0.109	SAT TT=1.039 CHECKS=32389 NODES=60	SAT TT=0.914 CHECKS=107526 NODES=59	SAT TT=2.875	SAT TT=19.883 CHECKS=2353380	SAT TT=4.624 CHECKS=278301	SAT TT=4.267 ASSIGNMENTS=2618	SAT TT=4.625 ASSIGNMENTS=2618	SAT TT=1.129 CHECKS=232302 NODES=1059	SAT TT=2.249 CHECKS=8428070 NODES=38438	? (TO) TT=1800.02	SAT TT=0.324 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=0.317 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=8.552	SAT TT=38	SAT TT=0.109 ASSIGNMENTS=359 CHECKS=128978	SAT TT=0.787 ASSIGNMENTS=7606 CHECKS=2057380	SAT TT=9.887	SAT TT=0.601 ASSIGNMENTS=4660 CHECKS=1507310	SAT TT=0.301 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=3.311	SAT TT=1.172 ASSIGNMENTS=417 CHECKS=710609	SAT TT=2.898	SAT TT=2.748
csp/tightness0.5/ normalized-rand-2-40-25-180-500-75_ext.xml	SAT TT=2.714	SAT TT=38.102 CHECKS=234881000 NODES=160583	SAT TT=39.777 CHECKS=242843000 NODES=166105	SAT TT=73.935	SAT TT=1530 CHECKS=230947000	SAT TT=56.519 CHECKS=4514980	SAT TT=16.025 ASSIGNMENTS=14021	SAT TT=16.112 ASSIGNMENTS=14021	SAT TT=8.583 CHECKS=4781990 NODES=25866	SAT TT=90.814 CHECKS=668740000 NODES=3068630	? (TO) TT=1800.08	SAT TT=11.434 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=11.581 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=8.655	SAT TT=21.393	SAT TT=4.719 ASSIGNMENTS=40253 CHECKS=14127900	SAT TT=2.714 ASSIGNMENTS=24250 CHECKS=7982500	SAT TT=128.118	SAT TT=4.003 ASSIGNMENTS=34543 CHECKS=11832700	SAT TT=3.99 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=1771.56	SAT TT=34.027 ASSIGNMENTS=18002 CHECKS=28835200	SAT TT=78.668	SAT TT=117.269
csp/tightness0.5/ normalized-rand-2-40-25-180-500-79_ext.xml	SAT TT=0.692	SAT TT=45.27 CHECKS=272556000 NODES=212904	SAT TT=43.12 CHECKS=272684000 NODES=212887	SAT TT=484.618	SAT TT=37.773 CHECKS=4414900	SAT TT=42.083 CHECKS=3212420	SAT TT=4.234 ASSIGNMENTS=3113	SAT TT=4.273 ASSIGNMENTS=3113	SAT TT=4.559 CHECKS=2191790 NODES=13059	SAT TT=212.025 CHECKS=1553370000 NODES=7014260	? (TO) TT=1800.04	SAT TT=0.744 ASSIGNMENTS=5978 CHECKS=1989610	SAT TT=0.726 ASSIGNMENTS=5978 CHECKS=1989610	SAT TT=148.478	? (TO) TT=1800.01	SAT TT=0.692 ASSIGNMENTS=5836 CHECKS=1951410	SAT TT=28.649 ASSIGNMENTS=285148 CHECKS=95037500	SAT TT=4.914	SAT TT=1.4 ASSIGNMENTS=12466 CHECKS=4027310	SAT TT=0.711 ASSIGNMENTS=5978 CHECKS=1989610	? (TO) TT=1800.18	SAT TT=281.572 ASSIGNMENTS=5005 CHECKS=4815540	SAT TT=991.88	SAT TT=150.535
csp/tightness0.5/ normalized-rand-2-40-25-180-500-93_ext.xml	UNSAT TT=2.502	UNSAT TT=13.673 CHECKS=86255100 NODES=53734	UNSAT TT=13.946 CHECKS=86884400 NODES=54138	UNSAT TT=51.359	UNSAT TT=372.187 CHECKS=46751100	UNSAT TT=183.685 CHECKS=13938600	UNSAT TT=12.334 ASSIGNMENTS=10075	UNSAT TT=12.294 ASSIGNMENTS=10075	UNSAT TT=8.234 CHECKS=4699730 NODES=24654	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=9.757 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=10.611 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=74.062	UNSAT TT=133.234	UNSAT TT=3.259 ASSIGNMENTS=26661 CHECKS=9514670	UNSAT TT=2.502 ASSIGNMENTS=21665 CHECKS=7242970	UNSAT TT=58.166	UNSAT TT=3.109 ASSIGNMENTS=25452 CHECKS=8963550	UNSAT TT=3.026 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=142.049	UNSAT TT=44.763 ASSIGNMENTS=34598 CHECKS=67619600	UNSAT TT=40.441	UNSAT TT=46.568
csp/tightness0.5/ normalized-rand-2-40-25-180-500-9_ext.xml	SAT TT=0.707	SAT TT=33.367 CHECKS=226193000 NODES=158281	SAT TT=33.751 CHECKS=227224000 NODES=158643	SAT TT=57.696	SAT TT=312.954 CHECKS=44424200	SAT TT=457.101 CHECKS=40430200	SAT TT=5.939 ASSIGNMENTS=3518	SAT TT=6.022 ASSIGNMENTS=3518	SAT TT=8.63 CHECKS=5085470 NODES=28383	SAT TT=6.034 CHECKS=38566600 NODES=173758	? (TO) TT=1800.07	SAT TT=1.25 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=1.251 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=31.501	SAT TT=169.653	SAT TT=0.707 ASSIGNMENTS=6124 CHECKS=2065640	SAT TT=1.3 ASSIGNMENTS=13015 CHECKS=3931700	SAT TT=76.996	SAT TT=2.298 ASSIGNMENTS=21397 CHECKS=7220860	SAT TT=1.143 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=534.796	SAT TT=4.933 ASSIGNMENTS=4667 CHECKS=7128370	SAT TT=3.871	SAT TT=3.878
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.65/ normalized-rand-2-40-40-135-650-11_ext.xml	SAT TT=2.336	SAT TT=5.206 CHECKS=33986000 NODES=16590	SAT TT=4.896 CHECKS=34362800 NODES=16822	SAT TT=36.593	SAT TT=237.673 CHECKS=6858870	SAT TT=26.232 CHECKS=827668	SAT TT=3.325 ASSIGNMENTS=1126	SAT TT=3.645 ASSIGNMENTS=1126	SAT TT=5.845 CHECKS=11713300 NODES=16352	SAT TT=6.508 CHECKS=39915000 NODES=146660	? (TO) TT=1800.06	SAT TT=12.981 ASSIGNMENTS=16590 CHECKS=33986000	SAT TT=12.175 ASSIGNMENTS=16590 CHECKS=33986000	SAT TT=5.868	SAT TT=25.879	SAT TT=2.336 ASSIGNMENTS=15328 CHECKS=4472980	SAT TT=2.921 ASSIGNMENTS=19372 CHECKS=5056520	SAT TT=66.764	SAT TT=2.57 ASSIGNMENTS=17235 CHECKS=4776940	SAT TT=2.466 ASSIGNMENTS=15144 CHECKS=4403040	SAT TT=18.198	SAT TT=19.674 ASSIGNMENTS=16448 CHECKS=19267100	SAT TT=22.296	SAT TT=101.563
csp/tightness0.65/ normalized-rand-2-40-40-135-650-13_ext.xml	UNSAT TT=4.091	UNSAT TT=7.346 CHECKS=47834200 NODES=25888	UNSAT TT=7.554 CHECKS=48020400 NODES=25906	UNSAT TT=154.653	UNSAT TT=775.698 CHECKS=24210200	UNSAT TT=971.086 CHECKS=32139800	UNSAT TT=31.33 ASSIGNMENTS=16603	UNSAT TT=31.533 ASSIGNMENTS=16603	UNSAT TT=9.431 CHECKS=19503400 NODES=26824	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=14.707 ASSIGNMENTS=25888 CHECKS=47834200	UNSAT TT=11.15 ASSIGNMENTS=26607 CHECKS=8067130	UNSAT TT=123.939	UNSAT TT=265.701	UNSAT TT=4.412 ASSIGNMENTS=27223 CHECKS=8288010	UNSAT TT=4.216 ASSIGNMENTS=28019 CHECKS=7908720	UNSAT TT=162.305	UNSAT TT=4.226 ASSIGNMENTS=26471 CHECKS=7742010	UNSAT TT=4.091 ASSIGNMENTS=26607 CHECKS=8067130	UNSAT TT=321.811	UNSAT TT=39.393 ASSIGNMENTS=36099 CHECKS=38989400	UNSAT TT=145.376	UNSAT TT=169.924
csp/tightness0.65/ normalized-rand-2-40-40-135-650-14_ext.xml	UNSAT TT=2.326	UNSAT TT=57.361 CHECKS=455172000 NODES=204711	UNSAT TT=59.345 CHECKS=461114000 NODES=208029	UNSAT TT=60.148	UNSAT TT=400.334 CHECKS=12351300	UNSAT TT=316.693 CHECKS=10400300	UNSAT TT=16.831 ASSIGNMENTS=8446	UNSAT TT=15.103 ASSIGNMENTS=8446	UNSAT TT=6.859 CHECKS=13732400 NODES=17954	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=62.388 ASSIGNMENTS=204711 CHECKS=455172000	UNSAT TT=62.15 ASSIGNMENTS=204711 CHECKS=455172000	UNSAT TT=61.268	UNSAT TT=144.597	UNSAT TT=2.79 ASSIGNMENTS=15895 CHECKS=5075580	UNSAT TT=2.326 ASSIGNMENTS=15873 CHECKS=4608090	UNSAT TT=130.146	UNSAT TT=2.873 ASSIGNMENTS=16756 CHECKS=5135360	UNSAT TT=2.952 ASSIGNMENTS=17126 CHECKS=5428820	UNSAT TT=118.832	UNSAT TT=34.774 ASSIGNMENTS=17709 CHECKS=20911300	UNSAT TT=131.838	UNSAT TT=125.052
csp/tightness0.65/ normalized-rand-2-40-40-135-650-26_ext.xml	SAT TT=0.471	SAT TT=1.891 CHECKS=6285740 NODES=3627	SAT TT=1.864 CHECKS=6299260 NODES=3572	SAT TT=109.292	SAT TT=122.408 CHECKS=3143080	SAT TT=81.04 CHECKS=2242070	SAT TT=12.51 ASSIGNMENTS=6600	SAT TT=13.988 ASSIGNMENTS=6600	SAT TT=2.185 CHECKS=3132170 NODES=4261	SAT TT=20.946 CHECKS=152410000 NODES=577060	? (TO) TT=1800	SAT TT=0.526 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=0.518 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=15.707	SAT TT=174.94	SAT TT=0.552 ASSIGNMENTS=2857 CHECKS=877817	SAT TT=0.779 ASSIGNMENTS=6149 CHECKS=1353750	SAT TT=17.714	SAT TT=0.471 ASSIGNMENTS=2889 CHECKS=674050	SAT TT=0.514 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=4.544	SAT TT=3.408 ASSIGNMENTS=495 CHECKS=558026	SAT TT=21.598	SAT TT=24.047
csp/tightness0.65/ normalized-rand-2-40-40-135-650-32_ext.xml	SAT TT=1.907	SAT TT=5.902 CHECKS=38170800 NODES=21251	SAT TT=5.875 CHECKS=34559400 NODES=19257	SAT TT=18.598	SAT TT=5.113 CHECKS=182242	SAT TT=301.085 CHECKS=10191700	SAT TT=4.871 ASSIGNMENTS=1854	SAT TT=4.251 ASSIGNMENTS=1854	SAT TT=4.06 CHECKS=7158330 NODES=10873	SAT TT=35.406 CHECKS=262726000 NODES=1053630	? (TO) TT=1800.07	SAT TT=13.377 ASSIGNMENTS=21251 CHECKS=38170800	SAT TT=13.473 ASSIGNMENTS=21251 CHECKS=38170800	SAT TT=24.002	SAT TT=109.969	SAT TT=2.013 ASSIGNMENTS=12987 CHECKS=3860290	SAT TT=1.907 ASSIGNMENTS=13277 CHECKS=3482840	SAT TT=68.312	SAT TT=2.855 ASSIGNMENTS=18211 CHECKS=5353010	SAT TT=2.168 ASSIGNMENTS=13586 CHECKS=4042520	SAT TT=33.642	SAT TT=41.134 ASSIGNMENTS=36535 CHECKS=38335200	SAT TT=6.694	SAT TT=115.074
csp/tightness0.65/ normalized-rand-2-40-40-135-650-37_ext.xml	UNSAT TT=8.018	UNSAT TT=33.779 CHECKS=249485000 NODES=128725	UNSAT TT=34.525 CHECKS=253644000 NODES=131022	UNSAT TT=161.833	UNSAT TT=703.948 CHECKS=26614600	? (TO) TT=1800.02	UNSAT TT=54.525 ASSIGNMENTS=29038	UNSAT TT=49.666 ASSIGNMENTS=29038	UNSAT TT=17.742 CHECKS=36735900 NODES=55354	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=39.25 ASSIGNMENTS=128725 CHECKS=249485000	UNSAT TT=15.742 ASSIGNMENTS=53553 CHECKS=15553200	UNSAT TT=639.895	UNSAT TT=845.957	UNSAT TT=8.098 ASSIGNMENTS=52115 CHECKS=15230700	UNSAT TT=8.128 ASSIGNMENTS=54442 CHECKS=15308100	UNSAT TT=232.065	UNSAT TT=8.018 ASSIGNMENTS=53348 CHECKS=15242600	UNSAT TT=8.199 ASSIGNMENTS=53553 CHECKS=15553200	UNSAT TT=1373.27	UNSAT TT=124.017 ASSIGNMENTS=112779 CHECKS=97947700	UNSAT TT=524.605	UNSAT TT=744.873
csp/tightness0.65/ normalized-rand-2-40-40-135-650-48_ext.xml	SAT TT=4.948	SAT TT=18.056 CHECKS=121208000 NODES=63108	SAT TT=17.89 CHECKS=121568000 NODES=63286	SAT TT=71.99	SAT TT=123.765 CHECKS=3448400	SAT TT=711.318 CHECKS=28558400	SAT TT=11.572 ASSIGNMENTS=5841	SAT TT=11.21 ASSIGNMENTS=5841	SAT TT=11.238 CHECKS=21011900 NODES=30321	SAT TT=1116.76 CHECKS=8563720000 NODES=34146400	? (TO) TT=1800.05	SAT TT=23.717 ASSIGNMENTS=63108 CHECKS=121208000	SAT TT=24.247 ASSIGNMENTS=63108 CHECKS=121208000	SAT TT=309.114	SAT TT=192.249	SAT TT=5.193 ASSIGNMENTS=32597 CHECKS=10330700	SAT TT=4.948 ASSIGNMENTS=32771 CHECKS=9811360	SAT TT=183.765	SAT TT=6.289 ASSIGNMENTS=38944 CHECKS=12198300	SAT TT=5.041 ASSIGNMENTS=31428 CHECKS=9979300	SAT TT=12.316	SAT TT=44.733 ASSIGNMENTS=37699 CHECKS=40459100	SAT TT=604.339	SAT TT=33.317
csp/tightness0.65/ normalized-rand-2-40-40-135-650-51_ext.xml	SAT TT=1.786	SAT TT=3.816 CHECKS=20231200 NODES=11461	SAT TT=2.973 CHECKS=16095400 NODES=9210	SAT TT=72.34	SAT TT=19.832 CHECKS=717690	SAT TT=225.051 CHECKS=7278590	SAT TT=6.366 ASSIGNMENTS=2820	SAT TT=6.4 ASSIGNMENTS=2820	SAT TT=12.905 CHECKS=23520100 NODES=35499	SAT TT=28.861 CHECKS=211326000 NODES=811907	? (TO) TT=1800.08	SAT TT=10.471 ASSIGNMENTS=11461 CHECKS=20231200	SAT TT=11.386 ASSIGNMENTS=23622 CHECKS=6839540	SAT TT=23.543	SAT TT=74.06	SAT TT=1.786 ASSIGNMENTS=11225 CHECKS=3254760	SAT TT=3.473 ASSIGNMENTS=23352 CHECKS=6419500	SAT TT=108.076	SAT TT=4.373 ASSIGNMENTS=28841 CHECKS=8239800	SAT TT=3.371 ASSIGNMENTS=23622 CHECKS=6839540	SAT TT=63.548	SAT TT=27.804 ASSIGNMENTS=18548 CHECKS=17170200	SAT TT=24.637	SAT TT=16.975
csp/tightness0.65/ normalized-rand-2-40-40-135-650-63_ext.xml	SAT TT=3.281	SAT TT=9.188 CHECKS=61473200 NODES=32338	SAT TT=8.502 CHECKS=61155800 NODES=32217	SAT TT=84.094	SAT TT=365.296 CHECKS=11611100	SAT TT=319.76 CHECKS=10401000	SAT TT=15.907 ASSIGNMENTS=7082	SAT TT=14.832 ASSIGNMENTS=7082	SAT TT=8.279 CHECKS=15091400 NODES=23104	SAT TT=4.377 CHECKS=25078500 NODES=95745	? (TO) TT=1800.02	SAT TT=15.699 ASSIGNMENTS=32338 CHECKS=61473200	SAT TT=16.203 ASSIGNMENTS=32338 CHECKS=61473200	SAT TT=248.752	SAT TT=246.927	SAT TT=5.045 ASSIGNMENTS=34916 CHECKS=10375600	SAT TT=3.281 ASSIGNMENTS=24500 CHECKS=6610420	SAT TT=135.082	SAT TT=3.946 ASSIGNMENTS=26269 CHECKS=7526300	SAT TT=3.705 ASSIGNMENTS=26497 CHECKS=7651220	SAT TT=48.135	SAT TT=35.96 ASSIGNMENTS=35013 CHECKS=32176400	SAT TT=90.365	SAT TT=16.569
csp/tightness0.65/ normalized-rand-2-40-40-135-650-66_ext.xml	UNSAT TT=12.395	UNSAT TT=97.593 CHECKS=818955000 NODES=426501	UNSAT TT=105.006 CHECKS=820469000 NODES=427056	UNSAT TT=272.438	UNSAT TT=1776.62 CHECKS=60706600	? (TO) TT=1800.09	UNSAT TT=66.692 ASSIGNMENTS=39404	UNSAT TT=71.548 ASSIGNMENTS=39404	UNSAT TT=28.161 CHECKS=54912200 NODES=83867	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=103.933 ASSIGNMENTS=426501 CHECKS=818955000	UNSAT TT=104.667 ASSIGNMENTS=426501 CHECKS=818955000	UNSAT TT=938.641	UNSAT TT=1187.07	UNSAT TT=13.106 ASSIGNMENTS=85887 CHECKS=25612200	UNSAT TT=12.395 ASSIGNMENTS=82771 CHECKS=23925600	UNSAT TT=510.318	UNSAT TT=13.013 ASSIGNMENTS=85044 CHECKS=25288600	UNSAT TT=12.656 ASSIGNMENTS=83604 CHECKS=24830500	? (TO) TT=1800.15	UNSAT TT=166.349 ASSIGNMENTS=153320 CHECKS=155492000	UNSAT TT=780.584	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.65/ normalized-rand-2-40-40-135-650-70_ext.xml	SAT TT=3.74	SAT TT=6.515 CHECKS=39004600 NODES=20092	SAT TT=6.443 CHECKS=38539200 NODES=19833	SAT TT=75.686	SAT TT=522.009 CHECKS=21610700	SAT TT=316.111 CHECKS=13090600	SAT TT=21.138 ASSIGNMENTS=11662	SAT TT=21.962 ASSIGNMENTS=11662	SAT TT=12.433 CHECKS=25601600 NODES=34965	SAT TT=901.116 CHECKS=6821140000 NODES=26857200	? (TO) TT=1800	SAT TT=13.481 ASSIGNMENTS=20092 CHECKS=39004600	SAT TT=13.747 ASSIGNMENTS=20092 CHECKS=39004600	SAT TT=367.683	SAT TT=1041.18	SAT TT=3.773 ASSIGNMENTS=24636 CHECKS=7938720	SAT TT=3.74 ASSIGNMENTS=26188 CHECKS=7914870	SAT TT=101.726	SAT TT=3.925 ASSIGNMENTS=23981 CHECKS=7582210	SAT TT=5.622 ASSIGNMENTS=34980 CHECKS=11249900	SAT TT=1060.28	SAT TT=23.759 ASSIGNMENTS=19657 CHECKS=23620900	SAT TT=703.209	SAT TT=393.754
csp/tightness0.65/ normalized-rand-2-40-40-135-650-74_ext.xml	SAT TT=0.696	SAT TT=4.763 CHECKS=30214000 NODES=16828	SAT TT=5.377 CHECKS=31867700 NODES=17500	SAT TT=135.664	SAT TT=152.482 CHECKS=4473940	SAT TT=256.67 CHECKS=10904300	SAT TT=8.117 ASSIGNMENTS=4070	SAT TT=7.993 ASSIGNMENTS=4070	SAT TT=6.192 CHECKS=12181900 NODES=17281	SAT TT=126.41 CHECKS=949446000 NODES=3706440	? (TO) TT=1800	SAT TT=12.828 ASSIGNMENTS=16828 CHECKS=30214000	SAT TT=11.892 ASSIGNMENTS=31349 CHECKS=9701100	SAT TT=20.882	SAT TT=79.775	SAT TT=0.696 ASSIGNMENTS=3793 CHECKS=1182370	SAT TT=3.048 ASSIGNMENTS=22028 CHECKS=6228520	SAT TT=79.84	SAT TT=4.063 ASSIGNMENTS=25123 CHECKS=7521110	SAT TT=5.082 ASSIGNMENTS=31349 CHECKS=9701100	SAT TT=4.806	SAT TT=54.093 ASSIGNMENTS=20066 CHECKS=19911900	SAT TT=77.156	SAT TT=51.743
csp/tightness0.65/ normalized-rand-2-40-40-135-650-79_ext.xml	UNSAT TT=10.703	UNSAT TT=62.675 CHECKS=476677000 NODES=235388	UNSAT TT=62.105 CHECKS=479262000 NODES=236206	? (TO) TT=1800.02	UNSAT TT=916.91 CHECKS=37439700	UNSAT TT=922.389 CHECKS=37548600	UNSAT TT=100.317 ASSIGNMENTS=54949	UNSAT TT=98.776 ASSIGNMENTS=54949	UNSAT TT=26.598 CHECKS=52485700 NODES=73526	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=65.003 ASSIGNMENTS=235388 CHECKS=476677000	UNSAT TT=17.318 ASSIGNMENTS=66688 CHECKS=21093200	UNSAT TT=994.242	UNSAT TT=909.427	UNSAT TT=12.316 ASSIGNMENTS=75907 CHECKS=23917500	UNSAT TT=11.34 ASSIGNMENTS=72722 CHECKS=22285200	UNSAT TT=257.749	UNSAT TT=11.479 ASSIGNMENTS=71955 CHECKS=22535800	UNSAT TT=10.703 ASSIGNMENTS=66688 CHECKS=21093200	? (TO) TT=1800.21	UNSAT TT=168.054 ASSIGNMENTS=135627 CHECKS=142091000	UNSAT TT=530.657	UNSAT TT=921.963
csp/tightness0.65/ normalized-rand-2-40-40-135-650-91_ext.xml	SAT TT=0.613	SAT TT=29.855 CHECKS=203585000 NODES=124695	SAT TT=30.049 CHECKS=208693000 NODES=127313	SAT TT=80.451	SAT TT=1353.56 CHECKS=54716600	SAT TT=185.962 CHECKS=7941450	SAT TT=33.515 ASSIGNMENTS=22963	SAT TT=34.139 ASSIGNMENTS=22963	SAT TT=1.888 CHECKS=2189170 NODES=3682	SAT TT=32.003 CHECKS=236824000 NODES=895244	? (TO) TT=1800.09	SAT TT=0.76 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=0.765 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=318.486	SAT TT=231.433	SAT TT=0.794 ASSIGNMENTS=4315 CHECKS=1352920	SAT TT=0.788 ASSIGNMENTS=6099 CHECKS=1330250	SAT TT=378.385	SAT TT=0.613 ASSIGNMENTS=4027 CHECKS=982401	SAT TT=0.736 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=300.726	SAT TT=1.254 ASSIGNMENTS=1144 CHECKS=937602	SAT TT=72.01	SAT TT=94.016
csp/tightness0.65/ normalized-rand-2-40-40-135-650-96_ext.xml	SAT TT=9.229	SAT TT=63.102 CHECKS=496417000 NODES=255095	SAT TT=67.049 CHECKS=485863000 NODES=250474	SAT TT=625.636	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=88.08 ASSIGNMENTS=50516	SAT TT=81.93 ASSIGNMENTS=50516	SAT TT=9.229 CHECKS=16352000 NODES=23994	? (TO) TT=1800	? (TO) TT=1800.1	SAT TT=70.293 ASSIGNMENTS=255095 CHECKS=496417000	SAT TT=70.185 ASSIGNMENTS=255095 CHECKS=496417000	SAT TT=845.006	SAT TT=1377.13	SAT TT=11.513 ASSIGNMENTS=71651 CHECKS=22762300	SAT TT=11.155 ASSIGNMENTS=72144 CHECKS=22296400	SAT TT=149.001	SAT TT=10.705 ASSIGNMENTS=71976 CHECKS=22626900	SAT TT=10.765 ASSIGNMENTS=71919 CHECKS=22833100	SAT TT=482.87	SAT TT=91.417 ASSIGNMENTS=80426 CHECKS=87527900	SAT TT=1030.9	SAT TT=635.025
csp/tightness0.8/ normalized-rand-2-40-80-103-800-10_ext.xml	SAT TT=1.146	SAT TT=1.454 CHECKS=4874340 NODES=1134	SAT TT=1.649 CHECKS=5154220 NODES=1145	SAT TT=1624.05	SAT TT=12.724 CHECKS=104431	SAT TT=99.945 CHECKS=943372	SAT TT=8.022 ASSIGNMENTS=740	SAT TT=8.286 ASSIGNMENTS=740	SAT TT=3.668 CHECKS=11632000 NODES=4498	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=1.444 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=1.452 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=18.332	SAT TT=16.918	SAT TT=1.146 ASSIGNMENTS=3627 CHECKS=1015140	SAT TT=1.2 ASSIGNMENTS=5164 CHECKS=1017510	SAT TT=18.2	SAT TT=1.249 ASSIGNMENTS=4537 CHECKS=988663	SAT TT=1.523 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=25.081	SAT TT=13.819 ASSIGNMENTS=3518 CHECKS=12785700	SAT TT=115.677	SAT TT=5.493
csp/tightness0.8/ normalized-rand-2-40-80-103-800-12_ext.xml	SAT TT=0.632	SAT TT=3.749 CHECKS=26443800 NODES=8535	SAT TT=3.74 CHECKS=27829900 NODES=8691	SAT TT=225.054	SAT TT=55.047 CHECKS=724692	SAT TT=19.924 CHECKS=237718	SAT TT=13.147 ASSIGNMENTS=2655	SAT TT=14.357 ASSIGNMENTS=2655	SAT TT=2.4 CHECKS=3766740 NODES=1865	SAT TT=986.632 CHECKS=7995830000 NODES=21285700	? (TO) TT=1800.09	SAT TT=1.125 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=1.139 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=20.202	SAT TT=13.827	SAT TT=1.74 ASSIGNMENTS=6361 CHECKS=1653570	SAT TT=0.955 ASSIGNMENTS=4872 CHECKS=827361	SAT TT=9.335	SAT TT=0.632 ASSIGNMENTS=2838 CHECKS=417431	SAT TT=1.09 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=49.561	SAT TT=6.971 ASSIGNMENTS=1198 CHECKS=2685680	SAT TT=8.953	SAT TT=36.125
csp/tightness0.8/ normalized-rand-2-40-80-103-800-18_ext.xml	UNSAT TT=1.166	UNSAT TT=5.681 CHECKS=57554800 NODES=9479	UNSAT TT=5.767 CHECKS=57966200 NODES=9540	UNSAT TT=27.667	UNSAT TT=176.381 CHECKS=1585820	UNSAT TT=278.889 CHECKS=2393190	UNSAT TT=10.748 ASSIGNMENTS=758	UNSAT TT=10.661 ASSIGNMENTS=758	UNSAT TT=3.384 CHECKS=11292700 NODES=3483	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=1.217 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=1.314 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=31.448	UNSAT TT=51.246	UNSAT TT=1.166 ASSIGNMENTS=3307 CHECKS=1019580	UNSAT TT=1.554 ASSIGNMENTS=6204 CHECKS=1252680	UNSAT TT=32.229	UNSAT TT=1.639 ASSIGNMENTS=5950 CHECKS=1272600	UNSAT TT=1.293 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=17.493	UNSAT TT=19.58 ASSIGNMENTS=4203 CHECKS=21444900	UNSAT TT=38.356	UNSAT TT=31.352
csp/tightness0.8/ normalized-rand-2-40-80-103-800-19_ext.xml	SAT TT=0.579	SAT TT=7.868 CHECKS=65418300 NODES=25820	SAT TT=6.669 CHECKS=53814500 NODES=21977	SAT TT=359.621	SAT TT=142.541 CHECKS=2427760	SAT TT=494.927 CHECKS=7863260	SAT TT=50.317 ASSIGNMENTS=17111	SAT TT=54.889 ASSIGNMENTS=17111	SAT TT=2.578 CHECKS=5062190 NODES=3579	SAT TT=596.273 CHECKS=4333570000 NODES=12240400	? (TO) TT=1800.03	SAT TT=14.698 ASSIGNMENTS=25820 CHECKS=65418300	SAT TT=15.691 ASSIGNMENTS=25820 CHECKS=65418300	SAT TT=96.09	SAT TT=198.966	SAT TT=13.093 ASSIGNMENTS=69911 CHECKS=15692300	SAT TT=0.7 ASSIGNMENTS=4140 CHECKS=585903	SAT TT=672.434	SAT TT=0.579 ASSIGNMENTS=2755 CHECKS=366023	SAT TT=12.321 ASSIGNMENTS=65810 CHECKS=14936000	SAT TT=169.375	SAT TT=7.484 ASSIGNMENTS=4786 CHECKS=7025300	SAT TT=44.396	SAT TT=996.379
csp/tightness0.8/ normalized-rand-2-40-80-103-800-20_ext.xml	UNSAT TT=1.8	UNSAT TT=95.942 CHECKS=1149600000 NODES=223778	UNSAT TT=99.626 CHECKS=1150850000 NODES=223828	UNSAT TT=258.453	UNSAT TT=241.889 CHECKS=2778470	UNSAT TT=310.059 CHECKS=3387450	UNSAT TT=15.127 ASSIGNMENTS=2263	UNSAT TT=15.076 ASSIGNMENTS=2263	UNSAT TT=4.07 CHECKS=12861600 NODES=5303	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=99.864 ASSIGNMENTS=223778 CHECKS=1149600000	UNSAT TT=98.887 ASSIGNMENTS=223778 CHECKS=1149600000	UNSAT TT=38.541	UNSAT TT=46.939	UNSAT TT=2.041 ASSIGNMENTS=6814 CHECKS=1852940	UNSAT TT=1.806 ASSIGNMENTS=8158 CHECKS=1687420	UNSAT TT=38.219	UNSAT TT=1.921 ASSIGNMENTS=7844 CHECKS=1711760	UNSAT TT=1.8 ASSIGNMENTS=6142 CHECKS=1648580	UNSAT TT=61.572	UNSAT TT=22.197 ASSIGNMENTS=9621 CHECKS=21726000	UNSAT TT=152.468	UNSAT TT=117.865
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.8/ normalized-rand-2-40-80-103-800-25_ext.xml	UNSAT TT=1.317	UNSAT TT=11.54 CHECKS=121831000 NODES=27326	UNSAT TT=10.697 CHECKS=122205000 NODES=27385	UNSAT TT=426.383	UNSAT TT=376.495 CHECKS=3937530	UNSAT TT=349.865 CHECKS=3891640	UNSAT TT=19.663 ASSIGNMENTS=1932	UNSAT TT=18.331 ASSIGNMENTS=1932	UNSAT TT=3.477 CHECKS=10055600 NODES=4638	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=1.43 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=1.445 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=33.749	UNSAT TT=87.546	UNSAT TT=1.326 ASSIGNMENTS=4888 CHECKS=1307410	UNSAT TT=1.511 ASSIGNMENTS=6650 CHECKS=1353690	UNSAT TT=52.635	UNSAT TT=1.524 ASSIGNMENTS=6028 CHECKS=1314430	UNSAT TT=1.317 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=58.156	UNSAT TT=29.435 ASSIGNMENTS=9386 CHECKS=39122100	UNSAT TT=103.931	UNSAT TT=74.42
csp/tightness0.8/ normalized-rand-2-40-80-103-800-27_ext.xml	SAT TT=53.015	SAT TT=753.249 CHECKS=7411610000 NODES=2310980	SAT TT=684.183 CHECKS=7399070000 NODES=2309980	SAT TT=199.058	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=258.663 ASSIGNMENTS=86106	SAT TT=247.694 ASSIGNMENTS=86106	SAT TT=143.474 CHECKS=583305000 NODES=349119	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=701.114 ASSIGNMENTS=2310980 CHECKS=7411610000	SAT TT=698.427 ASSIGNMENTS=2310980 CHECKS=7411610000	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=53.107 ASSIGNMENTS=239584 CHECKS=65832600	SAT TT=53.015 ASSIGNMENTS=240981 CHECKS=65903200	? (TO) TT=1800.02	SAT TT=59.6 ASSIGNMENTS=287615 CHECKS=78290500	SAT TT=97.933 ASSIGNMENTS=443912 CHECKS=122034000	? (TO) TT=1800.22	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/tightness0.8/ normalized-rand-2-40-80-103-800-29_ext.xml	UNSAT TT=3.491	UNSAT TT=24.463 CHECKS=271245000 NODES=59596	UNSAT TT=22.623 CHECKS=269729000 NODES=59403	? (TO) TT=1800.1	UNSAT TT=712.549 CHECKS=7372400	UNSAT TT=728.915 CHECKS=7904310	UNSAT TT=21.199 ASSIGNMENTS=3739	UNSAT TT=22.999 ASSIGNMENTS=3739	UNSAT TT=7.579 CHECKS=29516100 NODES=11771	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=32.33 ASSIGNMENTS=59596 CHECKS=271245000	UNSAT TT=30.218 ASSIGNMENTS=59596 CHECKS=271245000	UNSAT TT=104.756	UNSAT TT=179.973	UNSAT TT=3.565 ASSIGNMENTS=11781 CHECKS=3283790	UNSAT TT=3.607 ASSIGNMENTS=14055 CHECKS=3394220	UNSAT TT=93.999	UNSAT TT=3.63 ASSIGNMENTS=13087 CHECKS=3203870	UNSAT TT=3.491 ASSIGNMENTS=11702 CHECKS=3164870	UNSAT TT=102.674	UNSAT TT=54.718 ASSIGNMENTS=17705 CHECKS=58329700	UNSAT TT=208.743	UNSAT TT=174.39
csp/tightness0.8/ normalized-rand-2-40-80-103-800-3_ext.xml	UNSAT TT=0.871	UNSAT TT=13.132 CHECKS=159175000 NODES=27439	UNSAT TT=13.713 CHECKS=158359000 NODES=27260	UNSAT TT=45.246	UNSAT TT=151.976 CHECKS=1182950	UNSAT TT=82.537 CHECKS=643111	UNSAT TT=8.219 ASSIGNMENTS=318	UNSAT TT=8.562 ASSIGNMENTS=318	UNSAT TT=2.57 CHECKS=6415660 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.13	UNSAT TT=0.943 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=0.913 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=20.617	UNSAT TT=25.829	UNSAT TT=0.871 ASSIGNMENTS=2020 CHECKS=614218	UNSAT TT=1.083 ASSIGNMENTS=4834 CHECKS=859058	UNSAT TT=21.187	UNSAT TT=1.067 ASSIGNMENTS=4216 CHECKS=824827	UNSAT TT=0.911 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=13.711	UNSAT TT=9.385 ASSIGNMENTS=1851 CHECKS=9116350	UNSAT TT=18.253	UNSAT TT=20.455
csp/tightness0.8/ normalized-rand-2-40-80-103-800-40_ext.xml	UNSAT TT=9.371	UNSAT TT=23.222 CHECKS=267717000 NODES=65285	UNSAT TT=22.544 CHECKS=266338000 NODES=64920	UNSAT TT=644.979	UNSAT TT=1684.12 CHECKS=21260100	? (TO) TT=1800.06	UNSAT TT=56.784 ASSIGNMENTS=12517	UNSAT TT=61.112 ASSIGNMENTS=12517	UNSAT TT=22.304 CHECKS=88047300 NODES=40863	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=29.91 ASSIGNMENTS=65285 CHECKS=267717000	UNSAT TT=32.273 ASSIGNMENTS=65285 CHECKS=267717000	UNSAT TT=884.866	? (TO) TT=1800.03	UNSAT TT=9.371 ASSIGNMENTS=36321 CHECKS=10607500	UNSAT TT=9.851 ASSIGNMENTS=37616 CHECKS=10424200	UNSAT TT=459.854	UNSAT TT=10.381 ASSIGNMENTS=38770 CHECKS=10887900	UNSAT TT=9.446 ASSIGNMENTS=36885 CHECKS=10762600	UNSAT TT=1497.71	UNSAT TT=161.527 ASSIGNMENTS=32038 CHECKS=122084000	UNSAT TT=1160.94	UNSAT TT=1170.43
csp/tightness0.8/ normalized-rand-2-40-80-103-800-52_ext.xml	SAT TT=0.908	SAT TT=288.358 CHECKS=3221640000 NODES=893290	SAT TT=292.547 CHECKS=3221280000 NODES=894611	SAT TT=221.402	SAT TT=555.245 CHECKS=6972770	SAT TT=366.001 CHECKS=4633450	SAT TT=21.765 ASSIGNMENTS=4453	SAT TT=21.479 ASSIGNMENTS=4453	SAT TT=18.013 CHECKS=69757100 NODES=36853	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.908 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=0.968 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=1079.45	SAT TT=880.097	SAT TT=4.372 ASSIGNMENTS=17966 CHECKS=4825380	SAT TT=5.284 ASSIGNMENTS=21906 CHECKS=5309910	SAT TT=32.207	SAT TT=6.903 ASSIGNMENTS=28075 CHECKS=6991600	SAT TT=0.961 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=101.803	SAT TT=82.97 ASSIGNMENTS=28044 CHECKS=75189300	SAT TT=909.583	SAT TT=31.723
csp/tightness0.8/ normalized-rand-2-40-80-103-800-53_ext.xml	UNSAT TT=1.919	UNSAT TT=251.634 CHECKS=2805370000 NODES=731824	UNSAT TT=255.015 CHECKS=2814340000 NODES=733594	? (TO) TT=1800.06	UNSAT TT=346.306 CHECKS=3687060	UNSAT TT=366.982 CHECKS=3619030	UNSAT TT=15.43 ASSIGNMENTS=2365	UNSAT TT=14.958 ASSIGNMENTS=2365	UNSAT TT=5.811 CHECKS=19986200 NODES=8501	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=260.642 ASSIGNMENTS=731824 CHECKS=2805370000	UNSAT TT=241.211 ASSIGNMENTS=731824 CHECKS=2805370000	UNSAT TT=43.695	UNSAT TT=125.161	UNSAT TT=2.357 ASSIGNMENTS=7571 CHECKS=2142820	UNSAT TT=1.919 ASSIGNMENTS=9343 CHECKS=1892160	UNSAT TT=51.992	UNSAT TT=2.177 ASSIGNMENTS=9059 CHECKS=1957520	UNSAT TT=2.258 ASSIGNMENTS=7491 CHECKS=2098610	UNSAT TT=53.171	UNSAT TT=46.388 ASSIGNMENTS=14584 CHECKS=44735700	UNSAT TT=156.995	UNSAT TT=121.437
csp/tightness0.8/ normalized-rand-2-40-80-103-800-59_ext.xml	UNSAT TT=5.223	UNSAT TT=58.415 CHECKS=681008000 NODES=153620	UNSAT TT=54.271 CHECKS=681275000 NODES=153910	UNSAT TT=226.366	UNSAT TT=1785.43 CHECKS=19105800	UNSAT TT=1473.4 CHECKS=16245700	UNSAT TT=33.179 ASSIGNMENTS=6675	UNSAT TT=34.042 ASSIGNMENTS=6675	UNSAT TT=13.342 CHECKS=59120300 NODES=25371	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=65.12 ASSIGNMENTS=153620 CHECKS=681008000	UNSAT TT=61.11 ASSIGNMENTS=153620 CHECKS=681008000	UNSAT TT=198.332	UNSAT TT=1139.76	UNSAT TT=7.453 ASSIGNMENTS=24534 CHECKS=7276250	UNSAT TT=5.223 ASSIGNMENTS=19037 CHECKS=5144750	UNSAT TT=324.005	UNSAT TT=5.33 ASSIGNMENTS=18992 CHECKS=5243020	UNSAT TT=7.374 ASSIGNMENTS=24701 CHECKS=7274790	UNSAT TT=500.733	UNSAT TT=92.639 ASSIGNMENTS=29153 CHECKS=94093500	UNSAT TT=497.565	UNSAT TT=594.634
csp/tightness0.8/ normalized-rand-2-40-80-103-800-64_ext.xml	UNSAT TT=6.442	UNSAT TT=19.133 CHECKS=226752000 NODES=51577	UNSAT TT=20.521 CHECKS=225287000 NODES=51225	UNSAT TT=387.306	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=38.735 ASSIGNMENTS=9201	UNSAT TT=39.814 ASSIGNMENTS=9201	UNSAT TT=13.345 CHECKS=54514400 NODES=25027	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=26.856 ASSIGNMENTS=51577 CHECKS=226752000	UNSAT TT=27.309 ASSIGNMENTS=51577 CHECKS=226752000	UNSAT TT=335.394	UNSAT TT=843.317	UNSAT TT=7.112 ASSIGNMENTS=24913 CHECKS=6958560	UNSAT TT=6.442 ASSIGNMENTS=25440 CHECKS=6418090	UNSAT TT=190.947	UNSAT TT=7.336 ASSIGNMENTS=26156 CHECKS=7088920	UNSAT TT=6.764 ASSIGNMENTS=25282 CHECKS=7039350	UNSAT TT=402.326	UNSAT TT=170.184 ASSIGNMENTS=54511 CHECKS=168153000	UNSAT TT=867.416	UNSAT TT=622.721
csp/tightness0.8/ normalized-rand-2-40-80-103-800-66_ext.xml	SAT TT=0.558	SAT TT=48.956 CHECKS=539963000 NODES=136217	SAT TT=46.05 CHECKS=546583000 NODES=137854	SAT TT=38.315	SAT TT=78.075 CHECKS=957819	SAT TT=946.881 CHECKS=12143600	SAT TT=10.335 ASSIGNMENTS=1439	SAT TT=10.225 ASSIGNMENTS=1439	SAT TT=17.74 CHECKS=75495000 NODES=38955	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=0.558 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=0.564 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=175.549	SAT TT=17.067	SAT TT=11.156 ASSIGNMENTS=45498 CHECKS=11444300	SAT TT=1.462 ASSIGNMENTS=6574 CHECKS=1346520	SAT TT=41.222	SAT TT=11.248 ASSIGNMENTS=47337 CHECKS=11358300	SAT TT=0.584 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=39.002	SAT TT=186.139 ASSIGNMENTS=76568 CHECKS=199646000	SAT TT=1018.84	SAT TT=271.827
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.8/ normalized-rand-2-40-80-103-800-68_ext.xml	SAT TT=1.651	SAT TT=13.594 CHECKS=133753000 NODES=36844	SAT TT=12.069 CHECKS=116202000 NODES=32038	? (TO) TT=1800.02	SAT TT=142.163 CHECKS=1795390	SAT TT=258.926 CHECKS=3346700	SAT TT=63.689 ASSIGNMENTS=14635	SAT TT=64.311 ASSIGNMENTS=14635	SAT TT=8.435 CHECKS=33391500 NODES=17639	SAT TT=216.329 CHECKS=1580670000 NODES=4304140	? (TO) TT=1800.1	SAT TT=20.055 ASSIGNMENTS=36844 CHECKS=133753000	SAT TT=20.235 ASSIGNMENTS=36844 CHECKS=133753000	SAT TT=16.896	SAT TT=1186.11	SAT TT=3.315 ASSIGNMENTS=13474 CHECKS=3449860	SAT TT=3.282 ASSIGNMENTS=14946 CHECKS=3398240	SAT TT=55.504	SAT TT=1.651 ASSIGNMENTS=7344 CHECKS=1509120	SAT TT=1.84 ASSIGNMENTS=7115 CHECKS=1879690	SAT TT=47.105	SAT TT=35.969 ASSIGNMENTS=12551 CHECKS=29937500	? (TO) TT=1800.08	SAT TT=432.978
csp/tightness0.8/ normalized-rand-2-40-80-103-800-70_ext.xml	SAT TT=5.446	SAT TT=5.497 CHECKS=47310000 NODES=10314	SAT TT=5.446 CHECKS=48343100 NODES=10706	SAT TT=759.024	SAT TT=168.453 CHECKS=1910140	SAT TT=924.751 CHECKS=11638200	SAT TT=53.5 ASSIGNMENTS=14390	SAT TT=58.867 ASSIGNMENTS=14390	SAT TT=12.098 CHECKS=53588700 NODES=21311	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=12.431 ASSIGNMENTS=10314 CHECKS=47310000	SAT TT=12.692 ASSIGNMENTS=10314 CHECKS=47310000	SAT TT=367.634	? (TO) TT=1800.03	SAT TT=6.161 ASSIGNMENTS=21204 CHECKS=6191930	SAT TT=7.832 ASSIGNMENTS=27678 CHECKS=7652880	SAT TT=113.699	SAT TT=7.276 ASSIGNMENTS=25917 CHECKS=7158860	SAT TT=6.871 ASSIGNMENTS=23723 CHECKS=6831240	SAT TT=334.531	SAT TT=96.811 ASSIGNMENTS=24276 CHECKS=81580200	SAT TT=553.174	SAT TT=1233.58
csp/tightness0.8/ normalized-rand-2-40-80-103-800-78_ext.xml	UNSAT TT=68.507	UNSAT TT=244.678 CHECKS=2586760000 NODES=642417	UNSAT TT=221.776 CHECKS=2525690000 NODES=628790	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=319.451 ASSIGNMENTS=88116	UNSAT TT=317.459 ASSIGNMENTS=88116	UNSAT TT=159.874 CHECKS=719246000 NODES=390325	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=232.83 ASSIGNMENTS=642417 CHECKS=2586760000	UNSAT TT=243.115 ASSIGNMENTS=642417 CHECKS=2586760000	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=70.617 ASSIGNMENTS=334380 CHECKS=85242100	UNSAT TT=68.507 ASSIGNMENTS=333199 CHECKS=84437500	? (TO) TT=1800.1	UNSAT TT=74.303 ASSIGNMENTS=333391 CHECKS=84617700	UNSAT TT=77.286 ASSIGNMENTS=347332 CHECKS=88263500	? (TO) TT=1800.19	UNSAT TT=1601.43 ASSIGNMENTS=611665 CHECKS=1771870000	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/tightness0.8/ normalized-rand-2-40-80-103-800-7_ext.xml	SAT TT=0.4	SAT TT=19.068 CHECKS=219500000 NODES=51888	SAT TT=19.029 CHECKS=221003000 NODES=51920	SAT TT=1521.05	SAT TT=161.565 CHECKS=1281270	SAT TT=67.749 CHECKS=520826	SAT TT=5.414 ASSIGNMENTS=57	SAT TT=5.237 ASSIGNMENTS=57	SAT TT=1.966 CHECKS=1699440 NODES=766	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.403 ASSIGNMENTS=924 CHECKS=240012	SAT TT=0.4 ASSIGNMENTS=924 CHECKS=240012	SAT TT=19.702	SAT TT=16.205	SAT TT=0.563 ASSIGNMENTS=1395 CHECKS=358778	SAT TT=0.666 ASSIGNMENTS=3678 CHECKS=494878	SAT TT=2.412	SAT TT=0.67 ASSIGNMENTS=2936 CHECKS=439463	SAT TT=0.417 ASSIGNMENTS=924 CHECKS=240012	SAT TT=12.416	SAT TT=0.592 ASSIGNMENTS=77 CHECKS=203125	SAT TT=21.938	SAT TT=5.854
csp/tightness0.8/ normalized-rand-2-40-80-103-800-80_ext.xml	SAT TT=0.836	SAT TT=18.899 CHECKS=216847000 NODES=40895	SAT TT=19.062 CHECKS=216831000 NODES=40836	? (TO) TT=1800.07	SAT TT=133.197 CHECKS=1214460	SAT TT=350.397 CHECKS=3398660	SAT TT=8.793 ASSIGNMENTS=765	SAT TT=8.804 ASSIGNMENTS=765	SAT TT=2.93 CHECKS=6699580 NODES=2511	SAT TT=383.186 CHECKS=3086380000 NODES=7851690	? (TO) TT=1800.06	SAT TT=0.915 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=0.918 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=16.273	SAT TT=13.71	SAT TT=0.893 ASSIGNMENTS=2317 CHECKS=687610	SAT TT=1.241 ASSIGNMENTS=5300 CHECKS=1008780	SAT TT=34.429	SAT TT=1.304 ASSIGNMENTS=4827 CHECKS=973814	SAT TT=0.836 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=15.737	SAT TT=7.765 ASSIGNMENTS=2090 CHECKS=8890990	SAT TT=35.724	SAT TT=14.168
csp/tightness0.8/ normalized-rand-2-40-80-103-800-83_ext.xml	UNSAT TT=2.005	UNSAT TT=98.035 CHECKS=1147030000 NODES=218148	UNSAT TT=98.474 CHECKS=1152310000 NODES=218967	UNSAT TT=173.602	UNSAT TT=412.799 CHECKS=3886780	UNSAT TT=390.665 CHECKS=3534430	UNSAT TT=14.906 ASSIGNMENTS=2435	UNSAT TT=14.732 ASSIGNMENTS=2435	UNSAT TT=5.716 CHECKS=20167300 NODES=6804	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=97.312 ASSIGNMENTS=218148 CHECKS=1147030000	UNSAT TT=96.857 ASSIGNMENTS=218148 CHECKS=1147030000	UNSAT TT=41.519	UNSAT TT=125.422	UNSAT TT=2.398 ASSIGNMENTS=7018 CHECKS=2083480	UNSAT TT=2.02 ASSIGNMENTS=7823 CHECKS=1846380	UNSAT TT=107.039	UNSAT TT=2.13 ASSIGNMENTS=7418 CHECKS=1870410	UNSAT TT=2.005 ASSIGNMENTS=5798 CHECKS=1757310	UNSAT TT=38.151	UNSAT TT=44.278 ASSIGNMENTS=7185 CHECKS=27893000	UNSAT TT=137.177	UNSAT TT=103.519
csp/tightness0.8/ normalized-rand-2-40-80-103-800-87_ext.xml	UNSAT TT=4.94	UNSAT TT=39.63 CHECKS=455654000 NODES=96048	UNSAT TT=39.689 CHECKS=456290000 NODES=96252	UNSAT TT=438.328	UNSAT TT=903.515 CHECKS=9473270	UNSAT TT=874.617 CHECKS=9017280	UNSAT TT=31.577 ASSIGNMENTS=6763	UNSAT TT=31.794 ASSIGNMENTS=6763	UNSAT TT=12.045 CHECKS=47368800 NODES=20418	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=44.211 ASSIGNMENTS=96048 CHECKS=455654000	UNSAT TT=44.06 ASSIGNMENTS=96048 CHECKS=455654000	UNSAT TT=164.245	UNSAT TT=507.189	UNSAT TT=5.922 ASSIGNMENTS=18377 CHECKS=5483730	UNSAT TT=4.94 ASSIGNMENTS=18055 CHECKS=4749080	UNSAT TT=207.054	UNSAT TT=5.042 ASSIGNMENTS=17755 CHECKS=4857890	UNSAT TT=5.91 ASSIGNMENTS=18870 CHECKS=5574300	UNSAT TT=220.212	UNSAT TT=94.299 ASSIGNMENTS=29704 CHECKS=92039000	UNSAT TT=527.342	UNSAT TT=452.813
csp/tightness0.8/ normalized-rand-2-40-80-103-800-88_ext.xml	SAT TT=1.215	SAT TT=2.115 CHECKS=9927840 NODES=2142	SAT TT=2.002 CHECKS=10181300 NODES=2168	SAT TT=90.808	SAT TT=355.853 CHECKS=3631400	SAT TT=107.778 CHECKS=1136260	SAT TT=14.753 ASSIGNMENTS=2380	SAT TT=15.752 ASSIGNMENTS=2380	SAT TT=2.515 CHECKS=5173550 NODES=2197	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=1.221 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=1.219 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=17.947	SAT TT=540.703	SAT TT=1.54 ASSIGNMENTS=4894 CHECKS=1364860	SAT TT=3.406 ASSIGNMENTS=13606 CHECKS=3401380	SAT TT=24.003	SAT TT=1.816 ASSIGNMENTS=6876 CHECKS=1593080	SAT TT=1.215 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=6.72	SAT TT=27.834 ASSIGNMENTS=9806 CHECKS=28851300	SAT TT=56.885	SAT TT=278.711
csp/tightness0.8/ normalized-rand-2-40-80-103-800-8_ext.xml	SAT TT=1.009	SAT TT=1.048 CHECKS=753216 NODES=250	SAT TT=1.009 CHECKS=584462 NODES=152	SAT TT=34.411	SAT TT=36.706 CHECKS=369244	SAT TT=298.831 CHECKS=3308940	SAT TT=7.947 ASSIGNMENTS=788	SAT TT=7.884 ASSIGNMENTS=788	SAT TT=5.769 CHECKS=22785700 NODES=9653	SAT TT=1751.89 CHECKS=13871100000 NODES=37552300	? (TO) TT=1800.07	SAT TT=8.821 ASSIGNMENTS=250 CHECKS=753216	SAT TT=8.678 ASSIGNMENTS=250 CHECKS=753216	SAT TT=41.765	SAT TT=150.065	SAT TT=2.755 ASSIGNMENTS=9249 CHECKS=2553310	SAT TT=1.863 ASSIGNMENTS=8691 CHECKS=1864680	SAT TT=70.249	SAT TT=1.458 ASSIGNMENTS=6330 CHECKS=1343550	SAT TT=2.764 ASSIGNMENTS=9092 CHECKS=2511920	SAT TT=22.932	SAT TT=46.07 ASSIGNMENTS=14735 CHECKS=45048000	SAT TT=226.085	SAT TT=70.015
csp/tightness0.8/ normalized-rand-2-40-80-103-800-94_ext.xml	UNSAT TT=8.811	UNSAT TT=93.702 CHECKS=1050230000 NODES=262059	UNSAT TT=93.381 CHECKS=1053410000 NODES=263638	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1482.3 CHECKS=17996400	UNSAT TT=72.66 ASSIGNMENTS=15672	UNSAT TT=79.213 ASSIGNMENTS=15672	UNSAT TT=20.341 CHECKS=88322200 NODES=36860	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=93.998 ASSIGNMENTS=262059 CHECKS=1050230000	UNSAT TT=94.293 ASSIGNMENTS=262059 CHECKS=1050230000	UNSAT TT=477.199	UNSAT TT=971.779	UNSAT TT=10.09 ASSIGNMENTS=34045 CHECKS=9981010	UNSAT TT=8.811 ASSIGNMENTS=30998 CHECKS=8737280	UNSAT TT=1094.44	UNSAT TT=10.849 ASSIGNMENTS=38542 CHECKS=10769000	UNSAT TT=10.735 ASSIGNMENTS=37561 CHECKS=10823600	UNSAT TT=1281.88	UNSAT TT=611.056 ASSIGNMENTS=241844 CHECKS=625266000	UNSAT TT=980.026	UNSAT TT=1083.25
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-11_ext.xml	UNSAT TT=0.713	UNSAT TT=314.839 CHECKS=5692960000 NODES=569937	UNSAT TT=319.869 CHECKS=5698370000 NODES=570251	UNSAT TT=157.045	UNSAT TT=212.516 CHECKS=346816	UNSAT TT=229.288 CHECKS=352287	UNSAT TT=45.233 ASSIGNMENTS=147	UNSAT TT=41.633 ASSIGNMENTS=147	UNSAT TT=3.099 CHECKS=8634910 NODES=737	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=0.779 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=0.781 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=44.15	UNSAT TT=29.717	UNSAT TT=0.713 ASSIGNMENTS=674 CHECKS=160694	UNSAT TT=1.743 ASSIGNMENTS=4121 CHECKS=534783	UNSAT TT=18.716	UNSAT TT=3.409 ASSIGNMENTS=6857 CHECKS=888524	UNSAT TT=0.718 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=49.536	UNSAT TT=9.715 ASSIGNMENTS=850 CHECKS=9762720	UNSAT TT=39.192	UNSAT TT=41.942
csp/tightness0.9/ normalized-rand-2-40-180-84-900-16_ext.xml	UNSAT TT=15.493	UNSAT TT=22.24 CHECKS=347445000 NODES=38062	UNSAT TT=22.931 CHECKS=347449000 NODES=37997	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1090.27 ASSIGNMENTS=84368	UNSAT TT=1066.78 ASSIGNMENTS=84368	UNSAT TT=34.892 CHECKS=309271000 NODES=33383	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=30.659 ASSIGNMENTS=38062 CHECKS=347445000	UNSAT TT=30.261 ASSIGNMENTS=38062 CHECKS=347445000	UNSAT TT=985.753	? (TO) TT=1800.04	UNSAT TT=15.493 ASSIGNMENTS=27713 CHECKS=7006960	UNSAT TT=16.299 ASSIGNMENTS=28940 CHECKS=6902440	UNSAT TT=1225.68	UNSAT TT=17.783 ASSIGNMENTS=31433 CHECKS=7074910	UNSAT TT=16.474 ASSIGNMENTS=27873 CHECKS=7039320	UNSAT TT=741.981	UNSAT TT=286.411 ASSIGNMENTS=35144 CHECKS=337401000	? (TO) TT=1800	? (TO) TT=1800.06
csp/tightness0.9/ normalized-rand-2-40-180-84-900-24_ext.xml	SAT TT=0.326	SAT TT=1.336 CHECKS=1575340 NODES=202	SAT TT=1.272 CHECKS=1250840 NODES=117	SAT TT=7.067	SAT TT=15.941 CHECKS=34752	SAT TT=13.055 CHECKS=19037	SAT TT=39.847 ASSIGNMENTS=61	SAT TT=39.902 ASSIGNMENTS=61	SAT TT=2.804 CHECKS=1516680 NODES=186	SAT TT=1119.69 CHECKS=8586650000 NODES=14299700	? (TO) TT=1800.09	SAT TT=0.41 ASSIGNMENTS=194 CHECKS=44555	SAT TT=0.425 ASSIGNMENTS=194 CHECKS=44555	SAT TT=36.543	SAT TT=26.082	SAT TT=0.326 ASSIGNMENTS=94 CHECKS=22573	SAT TT=1.292 ASSIGNMENTS=3544 CHECKS=435880	SAT TT=3.958	SAT TT=2.818 ASSIGNMENTS=5894 CHECKS=737160	SAT TT=0.394 ASSIGNMENTS=194 CHECKS=44555	SAT TT=5.505	SAT TT=1.251 ASSIGNMENTS=91 CHECKS=602695	SAT TT=7.636	SAT TT=15.062
csp/tightness0.9/ normalized-rand-2-40-180-84-900-25_ext.xml	UNSAT TT=0.996	UNSAT TT=54.297 CHECKS=876965000 NODES=69088	UNSAT TT=52.369 CHECKS=871186000 NODES=68673	UNSAT TT=26.083	UNSAT TT=284.368 CHECKS=414123	UNSAT TT=259.056 CHECKS=415823	UNSAT TT=51.592 ASSIGNMENTS=170	UNSAT TT=51.518 ASSIGNMENTS=170	UNSAT TT=3.473 CHECKS=11491100 NODES=809	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=1.01 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=1.02 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=39.219	UNSAT TT=27.804	UNSAT TT=0.996 ASSIGNMENTS=911 CHECKS=230559	UNSAT TT=1.837 ASSIGNMENTS=4234 CHECKS=562320	UNSAT TT=85.185	UNSAT TT=4.278 ASSIGNMENTS=7305 CHECKS=1021140	UNSAT TT=1.027 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=15.622	UNSAT TT=14.995 ASSIGNMENTS=890 CHECKS=16814900	UNSAT TT=38.381	UNSAT TT=32.106
csp/tightness0.9/ normalized-rand-2-40-180-84-900-27_ext.xml	UNSAT TT=199.617	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=890.75 ASSIGNMENTS=82091	UNSAT TT=960.478 ASSIGNMENTS=82091	UNSAT TT=376.677 CHECKS=3741860000 NODES=456619	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=1242.23 ASSIGNMENTS=82091	UNSAT TT=461.099 ASSIGNMENTS=479097 CHECKS=113392000	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=200.722 ASSIGNMENTS=473910 CHECKS=112119000	UNSAT TT=207.352 ASSIGNMENTS=471236 CHECKS=111065000	? (TO) TT=1800.07	UNSAT TT=199.617 ASSIGNMENTS=475776 CHECKS=112089000	UNSAT TT=215.45 ASSIGNMENTS=479097 CHECKS=113392000	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.14
csp/tightness0.9/ normalized-rand-2-40-180-84-900-28_ext.xml	UNSAT TT=1.071	UNSAT TT=14.549 CHECKS=252327000 NODES=19994	UNSAT TT=14.628 CHECKS=252618000 NODES=19936	UNSAT TT=253.088	UNSAT TT=278.296 CHECKS=469348	UNSAT TT=261.22 CHECKS=457203	UNSAT TT=51.318 ASSIGNMENTS=181	UNSAT TT=51.121 ASSIGNMENTS=181	UNSAT TT=3.856 CHECKS=15065300 NODES=1432	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=1.184 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=1.186 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=46.09	UNSAT TT=31.621	UNSAT TT=1.16 ASSIGNMENTS=1362 CHECKS=279786	UNSAT TT=2.128 ASSIGNMENTS=5150 CHECKS=649988	UNSAT TT=43.668	UNSAT TT=4.103 ASSIGNMENTS=7468 CHECKS=1057510	UNSAT TT=1.071 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=12.843	UNSAT TT=20.057 ASSIGNMENTS=1089 CHECKS=17372500	UNSAT TT=23.759	UNSAT TT=23.286
csp/tightness0.9/ normalized-rand-2-40-180-84-900-29_ext.xml	UNSAT TT=2.001	UNSAT TT=32.047 CHECKS=514884000 NODES=36721	UNSAT TT=32.547 CHECKS=514481000 NODES=36652	? (TO) TT=1800.08	UNSAT TT=740.909 CHECKS=1230620	UNSAT TT=727.301 CHECKS=1259520	UNSAT TT=54.996 ASSIGNMENTS=593	UNSAT TT=60.189 ASSIGNMENTS=593	UNSAT TT=5.309 CHECKS=25826800 NODES=2013	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=39.666 ASSIGNMENTS=36721 CHECKS=514884000	UNSAT TT=39.841 ASSIGNMENTS=36721 CHECKS=514884000	UNSAT TT=65.949	UNSAT TT=63.471	UNSAT TT=2.353 ASSIGNMENTS=2583 CHECKS=665644	UNSAT TT=3.002 ASSIGNMENTS=5371 CHECKS=956554	UNSAT TT=162.191	UNSAT TT=4.84 ASSIGNMENTS=8102 CHECKS=1368110	UNSAT TT=2.001 ASSIGNMENTS=2242 CHECKS=606160	UNSAT TT=47.241	UNSAT TT=30.279 ASSIGNMENTS=2322 CHECKS=33801000	UNSAT TT=86.016	UNSAT TT=72.974
csp/tightness0.9/ normalized-rand-2-40-180-84-900-2_ext.xml	UNSAT TT=3.9	UNSAT TT=6.649 CHECKS=88737400 NODES=7321	UNSAT TT=6.808 CHECKS=89505200 NODES=7333	? (TO) TT=1800.08	UNSAT TT=1291.26 CHECKS=2535860	UNSAT TT=1303.36 CHECKS=2575010	UNSAT TT=79.635 ASSIGNMENTS=2210	UNSAT TT=74.105 ASSIGNMENTS=2210	UNSAT TT=8.667 CHECKS=61847900 NODES=5601	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=14.974 ASSIGNMENTS=7321 CHECKS=88737400	UNSAT TT=14.932 ASSIGNMENTS=7321 CHECKS=88737400	UNSAT TT=125.894	UNSAT TT=311.435	UNSAT TT=4.39 ASSIGNMENTS=5748 CHECKS=1528310	UNSAT TT=4.276 ASSIGNMENTS=7811 CHECKS=1634790	UNSAT TT=183.602	UNSAT TT=6.105 ASSIGNMENTS=10383 CHECKS=1913870	UNSAT TT=3.9 ASSIGNMENTS=5700 CHECKS=1504240	UNSAT TT=97.362	UNSAT TT=92.649 ASSIGNMENTS=7483 CHECKS=91032400	UNSAT TT=211.8	UNSAT TT=260.523
csp/tightness0.9/ normalized-rand-2-40-180-84-900-35_ext.xml	UNSAT TT=3.057	UNSAT TT=6.593 CHECKS=89679500 NODES=6945	UNSAT TT=6.011 CHECKS=87833600 NODES=6714	? (TO) TT=1800.05	UNSAT TT=793.705 CHECKS=1467660	UNSAT TT=860.92 CHECKS=1513900	UNSAT TT=121.755 ASSIGNMENTS=4428	UNSAT TT=121.594 ASSIGNMENTS=4428	UNSAT TT=6.795 CHECKS=42666000 NODES=3628	? (TO) TT=1800	? (TO) TT=1800.03	UNSAT TT=14.438 ASSIGNMENTS=6945 CHECKS=89679500	UNSAT TT=14.268 ASSIGNMENTS=6945 CHECKS=89679500	UNSAT TT=145.775	UNSAT TT=103.776	UNSAT TT=3.227 ASSIGNMENTS=4171 CHECKS=1132900	UNSAT TT=3.304 ASSIGNMENTS=6742 CHECKS=1310730	UNSAT TT=165.312	UNSAT TT=6.596 ASSIGNMENTS=11590 CHECKS=2143320	UNSAT TT=3.057 ASSIGNMENTS=3734 CHECKS=1020140	UNSAT TT=84.306	UNSAT TT=47.046 ASSIGNMENTS=2790 CHECKS=47208000	UNSAT TT=293.578	UNSAT TT=271.67
csp/tightness0.9/ normalized-rand-2-40-180-84-900-40_ext.xml	UNSAT TT=5.525	UNSAT TT=160.064 CHECKS=2791510000 NODES=266315	UNSAT TT=158.754 CHECKS=2789250000 NODES=266048	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=126.404 ASSIGNMENTS=4700	UNSAT TT=137.608 ASSIGNMENTS=4700	UNSAT TT=12.278 CHECKS=89963400 NODES=10033	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=181.952 ASSIGNMENTS=266315 CHECKS=2791510000	UNSAT TT=181.968 ASSIGNMENTS=266315 CHECKS=2791510000	UNSAT TT=425.151	? (TO) TT=1800	UNSAT TT=5.951 ASSIGNMENTS=10796 CHECKS=2662890	UNSAT TT=6.488 ASSIGNMENTS=12684 CHECKS=2930820	UNSAT TT=285.834	UNSAT TT=9.108 ASSIGNMENTS=16552 CHECKS=3657740	UNSAT TT=5.525 ASSIGNMENTS=10005 CHECKS=2462960	UNSAT TT=731.147	UNSAT TT=156.628 ASSIGNMENTS=16819 CHECKS=170627000	UNSAT TT=750.8	UNSAT TT=732.718
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-43_ext.xml	UNSAT TT=1.04	UNSAT TT=14.761 CHECKS=247485000 NODES=28820	UNSAT TT=16.025 CHECKS=247949000 NODES=28793	? (TO) TT=1800.07	UNSAT TT=281.022 CHECKS=488973	UNSAT TT=267.509 CHECKS=465787	UNSAT TT=48.464 ASSIGNMENTS=371	UNSAT TT=46.684 ASSIGNMENTS=371	UNSAT TT=4.411 CHECKS=18868200 NODES=1777	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=1.057 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=1.056 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=59.397	UNSAT TT=103.072	UNSAT TT=1.04 ASSIGNMENTS=1288 CHECKS=286777	UNSAT TT=3.655 ASSIGNMENTS=7071 CHECKS=1324390	UNSAT TT=37.204	UNSAT TT=4.469 ASSIGNMENTS=8585 CHECKS=1306120	UNSAT TT=1.113 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=61.861	UNSAT TT=17.428 ASSIGNMENTS=1771 CHECKS=20229100	UNSAT TT=64.999	UNSAT TT=105.468
csp/tightness0.9/ normalized-rand-2-40-180-84-900-45_ext.xml	UNSAT TT=1.308	UNSAT TT=14.456 CHECKS=240873000 NODES=19683	UNSAT TT=14.844 CHECKS=241481000 NODES=19674	UNSAT TT=32.307	UNSAT TT=580.318 CHECKS=895959	UNSAT TT=570.998 CHECKS=900796	UNSAT TT=53.207 ASSIGNMENTS=382	UNSAT TT=53.528 ASSIGNMENTS=382	UNSAT TT=4.51 CHECKS=19088300 NODES=1825	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=1.326 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=1.368 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=43.328	UNSAT TT=45.47	UNSAT TT=1.313 ASSIGNMENTS=1708 CHECKS=346988	UNSAT TT=2.03 ASSIGNMENTS=4664 CHECKS=656212	UNSAT TT=67.801	UNSAT TT=4.005 ASSIGNMENTS=7620 CHECKS=1026180	UNSAT TT=1.308 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=15.798	UNSAT TT=26.418 ASSIGNMENTS=2425 CHECKS=33811600	UNSAT TT=59.625	UNSAT TT=69.758
csp/tightness0.9/ normalized-rand-2-40-180-84-900-48_ext.xml	SAT TT=3.998	SAT TT=4.367 CHECKS=44720500 NODES=4482	SAT TT=3.998 CHECKS=44511400 NODES=4388	SAT TT=481.941	SAT TT=520.058 CHECKS=1457680	SAT TT=782.003 CHECKS=2345850	SAT TT=69.813 ASSIGNMENTS=2969	SAT TT=76.804 ASSIGNMENTS=2969	SAT TT=28.827 CHECKS=261271000 NODES=30520	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=11.679 ASSIGNMENTS=4482 CHECKS=44720500	SAT TT=12.242 ASSIGNMENTS=4482 CHECKS=44720500	SAT TT=61.862	SAT TT=233.298	SAT TT=10.519 ASSIGNMENTS=19423 CHECKS=4915870	SAT TT=11.838 ASSIGNMENTS=23821 CHECKS=5535890	SAT TT=1280.42	SAT TT=14.221 ASSIGNMENTS=29699 CHECKS=6553980	SAT TT=10.029 ASSIGNMENTS=19702 CHECKS=4979920	SAT TT=59.558	SAT TT=273.369 ASSIGNMENTS=36542 CHECKS=285848000	? (TO) TT=1800.1	SAT TT=888.547
csp/tightness0.9/ normalized-rand-2-40-180-84-900-4_ext.xml	UNSAT TT=1.393	UNSAT TT=13.2 CHECKS=204730000 NODES=14449	UNSAT TT=13.116 CHECKS=205855000 NODES=14504	UNSAT TT=34.805	UNSAT TT=691.106 CHECKS=1234650	UNSAT TT=659.929 CHECKS=1273540	UNSAT TT=51.595 ASSIGNMENTS=229	UNSAT TT=53.438 ASSIGNMENTS=229	UNSAT TT=5.075 CHECKS=29691800 NODES=2227	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=1.53 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=1.393 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=48.598	UNSAT TT=38.56	UNSAT TT=1.516 ASSIGNMENTS=1699 CHECKS=420606	UNSAT TT=2.159 ASSIGNMENTS=4676 CHECKS=670650	UNSAT TT=96.244	UNSAT TT=4.347 ASSIGNMENTS=7964 CHECKS=1155450	UNSAT TT=1.535 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=17.478	UNSAT TT=42.39 ASSIGNMENTS=1920 CHECKS=30550800	UNSAT TT=40.096	UNSAT TT=45.56
csp/tightness0.9/ normalized-rand-2-40-180-84-900-52_ext.xml	SAT TT=11.041	SAT TT=63.535 CHECKS=1089030000 NODES=121710	SAT TT=61.532 CHECKS=1077700000 NODES=120544	? (TO) TT=1800.05	SAT TT=733.03 CHECKS=1918180	SAT TT=434.212 CHECKS=1024550	SAT TT=64.205 ASSIGNMENTS=1539	SAT TT=64.053 ASSIGNMENTS=1539	SAT TT=59.69 CHECKS=524471000 NODES=62436	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=74.484 ASSIGNMENTS=121710 CHECKS=1089030000	SAT TT=74.87 ASSIGNMENTS=121710 CHECKS=1089030000	SAT TT=559.358	SAT TT=67.269	SAT TT=35.432 ASSIGNMENTS=56139 CHECKS=14694900	SAT TT=26.885 ASSIGNMENTS=51035 CHECKS=13159800	SAT TT=254.319	SAT TT=11.041 ASSIGNMENTS=21592 CHECKS=4791240	SAT TT=20.59 ASSIGNMENTS=33033 CHECKS=8814930	? (TO) TT=1800.15	SAT TT=140.837 ASSIGNMENTS=17931 CHECKS=169497000	? (TO) TT=1800.09	SAT TT=1282.3
csp/tightness0.9/ normalized-rand-2-40-180-84-900-61_ext.xml	SAT TT=0.428	SAT TT=1.385 CHECKS=1432800 NODES=228	SAT TT=1.311 CHECKS=1862570 NODES=222	SAT TT=9.958	SAT TT=65.868 CHECKS=228275	SAT TT=64.751 CHECKS=255476	SAT TT=40.839 ASSIGNMENTS=58	SAT TT=40.894 ASSIGNMENTS=58	SAT TT=3.701 CHECKS=11636900 NODES=1930	SAT TT=591.486 CHECKS=5014820000 NODES=7217080	? (TO) TT=1800.06	SAT TT=0.47 ASSIGNMENTS=417 CHECKS=73682	SAT TT=0.457 ASSIGNMENTS=417 CHECKS=73682	SAT TT=41.312	SAT TT=26.016	SAT TT=0.428 ASSIGNMENTS=318 CHECKS=67120	SAT TT=0.565 ASSIGNMENTS=903 CHECKS=109088	SAT TT=8.404	SAT TT=2.887 ASSIGNMENTS=5944 CHECKS=731140	SAT TT=0.449 ASSIGNMENTS=417 CHECKS=73682	SAT TT=9.007	SAT TT=9.284 ASSIGNMENTS=1677 CHECKS=8812940	SAT TT=28.34	SAT TT=48.979
csp/tightness0.9/ normalized-rand-2-40-180-84-900-63_ext.xml	UNSAT TT=4.392	UNSAT TT=81.2 CHECKS=1398200000 NODES=109127	UNSAT TT=84.978 CHECKS=1398830000 NODES=108982	UNSAT TT=323.842	UNSAT TT=1407.72 CHECKS=3464190	UNSAT TT=1407.51 CHECKS=3484660	UNSAT TT=93.031 ASSIGNMENTS=3296	UNSAT TT=92.924 ASSIGNMENTS=3296	UNSAT TT=11.036 CHECKS=84012700 NODES=8668	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=101.574 ASSIGNMENTS=109127 CHECKS=1398200000	UNSAT TT=100.076 ASSIGNMENTS=109127 CHECKS=1398200000	UNSAT TT=171.335	UNSAT TT=609.669	UNSAT TT=4.392 ASSIGNMENTS=7724 CHECKS=1884140	UNSAT TT=5.016 ASSIGNMENTS=9954 CHECKS=2067740	UNSAT TT=204.886	UNSAT TT=7.128 ASSIGNMENTS=12640 CHECKS=2432900	UNSAT TT=5.024 ASSIGNMENTS=7957 CHECKS=1941630	UNSAT TT=577.875	UNSAT TT=165.574 ASSIGNMENTS=11964 CHECKS=149260000	UNSAT TT=446.259	UNSAT TT=495.818
csp/tightness0.9/ normalized-rand-2-40-180-84-900-68_ext.xml	SAT TT=0.488	SAT TT=1.356 CHECKS=2532180 NODES=327	SAT TT=1.634 CHECKS=3662060 NODES=394	SAT TT=10.686	SAT TT=393.989 CHECKS=1378710	SAT TT=126.078 CHECKS=406777	SAT TT=39.588 ASSIGNMENTS=95	SAT TT=37.704 ASSIGNMENTS=95	SAT TT=3.424 CHECKS=6915540 NODES=1002	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.598 ASSIGNMENTS=632 CHECKS=159340	SAT TT=0.602 ASSIGNMENTS=632 CHECKS=159340	SAT TT=43.909	SAT TT=78.16	SAT TT=0.488 ASSIGNMENTS=444 CHECKS=104833	SAT TT=1.727 ASSIGNMENTS=4785 CHECKS=686225	SAT TT=12.641	SAT TT=2.997 ASSIGNMENTS=6328 CHECKS=796250	SAT TT=0.591 ASSIGNMENTS=632 CHECKS=159340	SAT TT=14.659	SAT TT=10.146 ASSIGNMENTS=851 CHECKS=4037240	SAT TT=405.921	SAT TT=144.812
csp/tightness0.9/ normalized-rand-2-40-180-84-900-72_ext.xml	SAT TT=0.831	SAT TT=10.651 CHECKS=149932000 NODES=17291	SAT TT=10.945 CHECKS=151028000 NODES=17347	SAT TT=21.182	SAT TT=21.831 CHECKS=40528	SAT TT=104.832 CHECKS=336216	SAT TT=44.318 ASSIGNMENTS=586	SAT TT=44.663 ASSIGNMENTS=586	SAT TT=4.668 CHECKS=17744400 NODES=2456	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=18.339 ASSIGNMENTS=17291 CHECKS=149932000	SAT TT=18.504 ASSIGNMENTS=17291 CHECKS=149932000	SAT TT=44.847	SAT TT=209.094	SAT TT=2.113 ASSIGNMENTS=3974 CHECKS=912340	SAT TT=1.565 ASSIGNMENTS=4135 CHECKS=567728	SAT TT=472.672	SAT TT=0.831 ASSIGNMENTS=1225 CHECKS=153476	SAT TT=2.238 ASSIGNMENTS=4312 CHECKS=988044	SAT TT=149.296	SAT TT=11.994 ASSIGNMENTS=1149 CHECKS=6836740	SAT TT=456.133	SAT TT=106.891
csp/tightness0.9/ normalized-rand-2-40-180-84-900-76_ext.xml	UNSAT TT=4.922	UNSAT TT=45.369 CHECKS=732269000 NODES=66287	UNSAT TT=45.16 CHECKS=730616000 NODES=66040	? (TO) TT=1800.06	UNSAT TT=1785.46 CHECKS=3900550	UNSAT TT=1571.03 CHECKS=3573340	UNSAT TT=71.816 ASSIGNMENTS=1970	UNSAT TT=71.431 ASSIGNMENTS=1970	UNSAT TT=10.096 CHECKS=72080000 NODES=5987	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=52.58 ASSIGNMENTS=66287 CHECKS=732269000	UNSAT TT=52.547 ASSIGNMENTS=66287 CHECKS=732269000	UNSAT TT=166.332	UNSAT TT=971.285	UNSAT TT=5.579 ASSIGNMENTS=6935 CHECKS=2066750	UNSAT TT=4.922 ASSIGNMENTS=9838 CHECKS=2101120	UNSAT TT=202.769	UNSAT TT=6.384 ASSIGNMENTS=11976 CHECKS=2275050	UNSAT TT=6.034 ASSIGNMENTS=8098 CHECKS=2430060	UNSAT TT=331.78	UNSAT TT=112.657 ASSIGNMENTS=8444 CHECKS=127594000	UNSAT TT=1426.5	UNSAT TT=1114.87
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-79_ext.xml	UNSAT TT=2.754	UNSAT TT=159.681 CHECKS=2659890000 NODES=182861	UNSAT TT=146.574 CHECKS=2640610000 NODES=181325	UNSAT TT=65.079	UNSAT TT=1291.62 CHECKS=2549020	UNSAT TT=648.633 CHECKS=1461950	UNSAT TT=58.123 ASSIGNMENTS=676	UNSAT TT=57.528 ASSIGNMENTS=676	UNSAT TT=9.505 CHECKS=72990000 NODES=5722	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=172.08 ASSIGNMENTS=182861 CHECKS=2659890000	UNSAT TT=167.602 ASSIGNMENTS=182861 CHECKS=2659890000	UNSAT TT=72.321	UNSAT TT=68.279	UNSAT TT=2.901 ASSIGNMENTS=3557 CHECKS=1078670	UNSAT TT=3.145 ASSIGNMENTS=5835 CHECKS=1153620	UNSAT TT=183.526	UNSAT TT=4.618 ASSIGNMENTS=8796 CHECKS=1497970	UNSAT TT=2.754 ASSIGNMENTS=3740 CHECKS=1108640	UNSAT TT=36.423	UNSAT TT=96.746 ASSIGNMENTS=6289 CHECKS=99246700	UNSAT TT=517.985	UNSAT TT=307.51
csp/tightness0.9/ normalized-rand-2-40-180-84-900-80_ext.xml	UNSAT TT=3.974	UNSAT TT=50.224 CHECKS=855439000 NODES=69668	UNSAT TT=49.92 CHECKS=857833000 NODES=69877	UNSAT TT=574.272	UNSAT TT=1271.64 CHECKS=2729500	UNSAT TT=1284.72 CHECKS=2932790	UNSAT TT=58.206 ASSIGNMENTS=1354	UNSAT TT=63.269 ASSIGNMENTS=1354	UNSAT TT=9.476 CHECKS=68278100 NODES=6301	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=57.172 ASSIGNMENTS=69668 CHECKS=855439000	UNSAT TT=59.386 ASSIGNMENTS=69668 CHECKS=855439000	UNSAT TT=96.681	UNSAT TT=377.746	UNSAT TT=4.328 ASSIGNMENTS=6009 CHECKS=1733950	UNSAT TT=3.974 ASSIGNMENTS=7598 CHECKS=1575290	UNSAT TT=110.914	UNSAT TT=5.734 ASSIGNMENTS=10520 CHECKS=1903800	UNSAT TT=4.951 ASSIGNMENTS=6148 CHECKS=1777340	UNSAT TT=58.56	UNSAT TT=103.494 ASSIGNMENTS=7768 CHECKS=102430000	UNSAT TT=374.199	UNSAT TT=430.285
csp/tightness0.9/ normalized-rand-2-40-180-84-900-8_ext.xml	SAT TT=0.737	SAT TT=1.159 CHECKS=338410 NODES=81	SAT TT=1.203 CHECKS=815258 NODES=77	SAT TT=8.941	SAT TT=32.047 CHECKS=73738	SAT TT=423.407 CHECKS=1367890	SAT TT=37.778 ASSIGNMENTS=68	SAT TT=40.417 ASSIGNMENTS=68	SAT TT=3.321 CHECKS=6476090 NODES=964	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=0.754 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=0.737 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=41.482	SAT TT=40.945	SAT TT=0.771 ASSIGNMENTS=1172 CHECKS=236580	SAT TT=1.306 ASSIGNMENTS=3797 CHECKS=484710	SAT TT=79.696	SAT TT=3.405 ASSIGNMENTS=7602 CHECKS=1052690	SAT TT=0.785 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=35.639	SAT TT=6.735 ASSIGNMENTS=910 CHECKS=6642070	SAT TT=12.157	SAT TT=304.633
csp/tightness0.9/ normalized-rand-2-40-180-84-900-91_ext.xml	SAT TT=0.354	SAT TT=2.726 CHECKS=26497700 NODES=2486	SAT TT=2.908 CHECKS=26916900 NODES=2459	SAT TT=16.584	SAT TT=13.865 CHECKS=19349	SAT TT=18.032 CHECKS=22827	SAT TT=41.069 ASSIGNMENTS=90	SAT TT=38.181 ASSIGNMENTS=90	SAT TT=2.587 CHECKS=284009 NODES=63	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.363 ASSIGNMENTS=163 CHECKS=34597	SAT TT=0.403 ASSIGNMENTS=163 CHECKS=34597	SAT TT=36.486	SAT TT=25.449	SAT TT=1.818 ASSIGNMENTS=3015 CHECKS=690912	SAT TT=1.856 ASSIGNMENTS=4887 CHECKS=747376	SAT TT=34.495	SAT TT=3.774 ASSIGNMENTS=7696 CHECKS=1126120	SAT TT=0.354 ASSIGNMENTS=163 CHECKS=34597	SAT TT=54.833	SAT TT=2.462 ASSIGNMENTS=254 CHECKS=1353100	SAT TT=13.283	SAT TT=276.205
csp/tightness0.9/ normalized-rand-2-40-180-84-900-93_ext.xml	UNSAT TT=0.849	UNSAT TT=15.801 CHECKS=255638000 NODES=23545	UNSAT TT=15.903 CHECKS=257350000 NODES=23599	UNSAT TT=540.106	UNSAT TT=296.629 CHECKS=424731	UNSAT TT=274.433 CHECKS=422385	UNSAT TT=47.431 ASSIGNMENTS=116	UNSAT TT=47.369 ASSIGNMENTS=116	UNSAT TT=3.686 CHECKS=10178300 NODES=957	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.955 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=0.982 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=42.265	UNSAT TT=26.639	UNSAT TT=0.849 ASSIGNMENTS=1028 CHECKS=203804	UNSAT TT=1.779 ASSIGNMENTS=4400 CHECKS=541788	UNSAT TT=20.28	UNSAT TT=3.883 ASSIGNMENTS=7445 CHECKS=962060	UNSAT TT=0.945 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=16.068	UNSAT TT=13.337 ASSIGNMENTS=837 CHECKS=13493000	UNSAT TT=20.84	UNSAT TT=26.419

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	546	546	495	415	433	554	550	498	348	574	567	425	422	558	561	414	559	556	426	472	470	443
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	546	546	495	415	433	554	550	498	348	574	567	425	422	558	561	414	559	556	426	472	470	443
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	6	12	48	2	7	4	0	2	63	6	8	6	12	113	85	0	109	136	2	4	12	11
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0