CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in intension (2-ARY-INT)

This page displays the results of the different solvers for each benchmark for category binary constraints in intension (2-ARY-INT)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/domino/ normalized-domino-1000-100.xml	SAT TT=0.052	? (MO) TT=0.897	SAT TT=1.999 CHECKS=8219800 NODES=1000	SAT TT=0.247	SAT TT=2.452 CHECKS=396013	SAT TT=0.188 CHECKS=362367	SAT TT=1.486 ASSIGNMENTS=1	SAT TT=1.33 ASSIGNMENTS=1	SAT TT=4.175 CHECKS=607204 NODES=1000	SAT TT=2.623 CHECKS=813003 NODES=0	SAT TT=2.503 CHECKS=813003 NODES=0	SAT TT=0.067 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.065 ASSIGNMENTS=1 CHECKS=14	SAT TT=102	SAT TT=99.986	SAT TT=0.052 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.057 ASSIGNMENTS=4 CHECKS=254	SAT TT=1.003	SAT TT=0.057 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.056 ASSIGNMENTS=1 CHECKS=14	SAT TT=10.788	SAT TT=2.613	SAT TT=4.09
csp/domino/ normalized-domino-1000-300.xml	SAT TT=0.051	SAT TT=4.121 CHECKS=165489000 NODES=1000	SAT TT=4.216 CHECKS=165489000 NODES=1000	SAT TT=0.283	SAT TT=3.251 CHECKS=1678790	SAT TT=0.786 CHECKS=1572070	SAT TT=1.528 ASSIGNMENTS=1	SAT TT=1.24 ASSIGNMENTS=1	SAT TT=21.158 CHECKS=4560550 NODES=1000	SAT TT=5.881 CHECKS=6111000 NODES=0	SAT TT=5.853 CHECKS=6111000 NODES=0	SAT TT=0.068 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.067 ASSIGNMENTS=1 CHECKS=622	? (MO) TT=788.1	? (MO) TT=819.22	SAT TT=0.051 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.051 ASSIGNMENTS=2 CHECKS=632	SAT TT=0.964	SAT TT=0.057 ASSIGNMENTS=299 CHECKS=3895	SAT TT=0.054 ASSIGNMENTS=1 CHECKS=14	SAT TT=63.341	SAT TT=3.985	SAT TT=9.66
csp/domino/ normalized-domino-1000-800.xml	SAT TT=0.052	SAT TT=10.148 CHECKS=21070700 NODES=1000	SAT TT=11.117 CHECKS=21070700 NODES=1000	SAT TT=0.414	SAT TT=4.678 CHECKS=4245970	SAT TT=2.275 CHECKS=4216470	SAT TT=1.22 ASSIGNMENTS=1	SAT TT=1.568 ASSIGNMENTS=1	SAT TT=82.357 CHECKS=34870200 NODES=1000	SAT TT=22.054 CHECKS=40776000 NODES=0	SAT TT=23.046 CHECKS=40776000 NODES=0	SAT TT=0.067 ASSIGNMENTS=1 CHECKS=1622	SAT TT=0.068 ASSIGNMENTS=1 CHECKS=1622	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=0.056 ASSIGNMENTS=1 CHECKS=1622	SAT TT=0.057 ASSIGNMENTS=1 CHECKS=1617	SAT TT=1.05	SAT TT=0.056 ASSIGNMENTS=799 CHECKS=10395	SAT TT=0.052 ASSIGNMENTS=1 CHECKS=14	SAT TT=417.584	SAT TT=9.211	SAT TT=23.433
csp/domino/ normalized-domino-100-100.xml	SAT TT=0.009	SAT TT=0.94 CHECKS=821805 NODES=100	SAT TT=0.899 CHECKS=821805 NODES=0	SAT TT=0.045	SAT TT=0.265 CHECKS=46790	SAT TT=0.042 CHECKS=50761	SAT TT=0.885 ASSIGNMENTS=1	SAT TT=0.689 ASSIGNMENTS=1	SAT TT=0.928 CHECKS=60904 NODES=100	SAT TT=0.775 CHECKS=81303 NODES=0	SAT TT=0.699 CHECKS=81303 NODES=0	SAT TT=0.021 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.022 ASSIGNMENTS=1 CHECKS=14	SAT TT=11.538	SAT TT=10.498	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.01 ASSIGNMENTS=2 CHECKS=234	SAT TT=0.383	SAT TT=0.013 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.01 ASSIGNMENTS=1 CHECKS=14	SAT TT=3.444	SAT TT=0.828	SAT TT=1.094
csp/domino/ normalized-domino-100-300.xml	SAT TT=0.009	SAT TT=1.066 CHECKS=16547500 NODES=100	SAT TT=1.056 CHECKS=16547500 NODES=0	SAT TT=0.051	SAT TT=0.356 CHECKS=148256	SAT TT=0.119 CHECKS=146065	SAT TT=0.677 ASSIGNMENTS=1	SAT TT=0.665 ASSIGNMENTS=1	SAT TT=2.498 CHECKS=457450 NODES=100	SAT TT=1.035 CHECKS=611103 NODES=0	SAT TT=1.041 CHECKS=611103 NODES=0	SAT TT=0.021 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.021 ASSIGNMENTS=1 CHECKS=622	SAT TT=73.72	SAT TT=79.692	SAT TT=0.01 ASSIGNMENTS=1 CHECKS=622	SAT TT=0.011 ASSIGNMENTS=2 CHECKS=27	SAT TT=0.383	SAT TT=0.009 ASSIGNMENTS=299 CHECKS=3895	SAT TT=0.009 ASSIGNMENTS=1 CHECKS=14	SAT TT=8.27	SAT TT=1.053	SAT TT=1.646
csp/domino/ normalized-domino-2000-2000.xml	SAT TT=0.127	SAT TT=95.796 CHECKS=256674000 NODES=2000	SAT TT=101.963 CHECKS=256674000 NODES=2000	SAT TT=1.312	SAT TT=19.056 CHECKS=24541300	SAT TT=9.623 CHECKS=13508000	SAT TT=2.063 ASSIGNMENTS=1	SAT TT=2.297 ASSIGNMENTS=1	SAT TT=309.85 CHECKS=500240000 NODES=2000	SAT TT=227.705 CHECKS=505892000 NODES=0	SAT TT=238.123 CHECKS=505892000 NODES=0	SAT TT=0.135 ASSIGNMENTS=1 CHECKS=4022	SAT TT=0.133 ASSIGNMENTS=1 CHECKS=4022	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.136 ASSIGNMENTS=1 CHECKS=4022	SAT TT=0.132 ASSIGNMENTS=1 CHECKS=4017	SAT TT=1.587	SAT TT=0.142 ASSIGNMENTS=1999 CHECKS=25995	SAT TT=0.127 ASSIGNMENTS=1 CHECKS=14	? TT=69.951	SAT TT=45.803	SAT TT=120.777
csp/domino/ normalized-domino-500-100.xml	SAT TT=0.025	SAT TT=1.276 CHECKS=4109800 NODES=500	SAT TT=1.324 CHECKS=4109800 NODES=0	SAT TT=0.143	SAT TT=1.307 CHECKS=226885	SAT TT=0.121 CHECKS=218536	SAT TT=1.345 ASSIGNMENTS=1	SAT TT=1.212 ASSIGNMENTS=1	SAT TT=2.319 CHECKS=303704 NODES=500	SAT TT=1.649 CHECKS=406503 NODES=0	SAT TT=1.614 CHECKS=406503 NODES=0	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=14	SAT TT=51.756	SAT TT=48.275	SAT TT=0.027 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.025 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.769	SAT TT=0.028 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.025 ASSIGNMENTS=1 CHECKS=14	SAT TT=6.918	SAT TT=1.568	SAT TT=2.602
csp/domino/ normalized-domino-500-200.xml	SAT TT=0.026	SAT TT=1.683 CHECKS=26167200 NODES=500	SAT TT=1.717 CHECKS=26167200 NODES=500	SAT TT=0.132	SAT TT=1.398 CHECKS=498405	SAT TT=0.254 CHECKS=493533	SAT TT=0.956 ASSIGNMENTS=1	SAT TT=1.088 ASSIGNMENTS=1	SAT TT=5.524 CHECKS=1064220 NODES=500	SAT TT=2.247 CHECKS=1425000 NODES=0	SAT TT=2.235 CHECKS=1425000 NODES=0	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=422	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=422	SAT TT=187.595	SAT TT=182.769	SAT TT=0.028 ASSIGNMENTS=1 CHECKS=422	SAT TT=0.031 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.893	SAT TT=0.028 ASSIGNMENTS=199 CHECKS=2595	SAT TT=0.026 ASSIGNMENTS=1 CHECKS=14	SAT TT=16.147	SAT TT=2.235	SAT TT=3.959
csp/domino/ normalized-domino-500-500.xml	SAT TT=0.027	SAT TT=3.314 CHECKS=4138360 NODES=500	SAT TT=3.355 CHECKS=4138360 NODES=500	SAT TT=0.186	SAT TT=1.926 CHECKS=1348840	SAT TT=0.755 CHECKS=1320220	SAT TT=1.197 ASSIGNMENTS=1	SAT TT=1.04 ASSIGNMENTS=1	SAT TT=26.181 CHECKS=6083640 NODES=500	SAT TT=5.727 CHECKS=8152500 NODES=0	SAT TT=5.784 CHECKS=8152500 NODES=0	SAT TT=0.04 ASSIGNMENTS=1 CHECKS=1022	SAT TT=0.039 ASSIGNMENTS=1 CHECKS=1022	? (MO) TT=1055.97	? (MO) TT=1046.51	SAT TT=0.027 ASSIGNMENTS=1 CHECKS=1022	SAT TT=0.029 ASSIGNMENTS=1 CHECKS=1022	SAT TT=0.757	SAT TT=0.03 ASSIGNMENTS=499 CHECKS=6495	SAT TT=0.027 ASSIGNMENTS=1 CHECKS=14	SAT TT=86.609	SAT TT=3.373	SAT TT=7.977
csp/domino/ normalized-domino-800-100.xml	SAT TT=0.042	SAT TT=1.679 CHECKS=6575800 NODES=800	SAT TT=1.681 CHECKS=6575800 NODES=800	SAT TT=0.203	SAT TT=2.099 CHECKS=337227	SAT TT=0.15 CHECKS=306659	SAT TT=1.329 ASSIGNMENTS=1	SAT TT=1.33 ASSIGNMENTS=1	SAT TT=3.538 CHECKS=485804 NODES=800	SAT TT=2.145 CHECKS=650403 NODES=0	SAT TT=2.228 CHECKS=650403 NODES=0	SAT TT=0.056 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.055 ASSIGNMENTS=1 CHECKS=14	SAT TT=79.289	SAT TT=78.386	SAT TT=0.044 ASSIGNMENTS=1 CHECKS=14	SAT TT=0.042 ASSIGNMENTS=1 CHECKS=222	SAT TT=1.106	SAT TT=0.044 ASSIGNMENTS=99 CHECKS=1295	SAT TT=0.044 ASSIGNMENTS=1 CHECKS=14	SAT TT=9.478	SAT TT=2.183	SAT TT=3.658
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp01/ normalized-fapp01-0200-10.xml	SAT TT=2.432	SAT TT=10.236 CHECKS=509828 NODES=200	SAT TT=10.31 CHECKS=603822 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=5.863 ASSIGNMENTS=155	SAT TT=5.807 ASSIGNMENTS=155	SAT TT=18.154 CHECKS=1045660 NODES=427	SAT TT=14.224 CHECKS=23030900 NODES=6856	SAT TT=12.099 CHECKS=3334850 NODES=591	SAT TT=16.817 ASSIGNMENTS=200 CHECKS=509828	SAT TT=17.103 ASSIGNMENTS=200 CHECKS=509828	? (problem) TT=0.577	? (problem) TT=0.579	SAT TT=2.461 ASSIGNMENTS=418 CHECKS=35520	SAT TT=91.132 ASSIGNMENTS=7543 CHECKS=1512450	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.432 ASSIGNMENTS=288 CHECKS=31525	SAT TT=137.591	SAT TT=149.969	SAT TT=75.418
csp/fapp/fapp01/ normalized-fapp01-0200-2.xml	UNSAT TT=9.95	UNSAT TT=10.453 CHECKS=153025 NODES=0	UNSAT TT=9.95 CHECKS=153025 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.19	? (TO) TT=1800.17	UNSAT TT=22.344 CHECKS=9956950 NODES=2675	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=17.535 ASSIGNMENTS=0 CHECKS=153025	UNSAT TT=17.658 ASSIGNMENTS=0 CHECKS=153025	? (problem) TT=0.439	? (problem) TT=0.454	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=160.765	UNSAT TT=26.677	UNSAT TT=54.013
csp/fapp/fapp01/ normalized-fapp01-0200-8.xml	SAT TT=6.562	SAT TT=10.894 CHECKS=616036 NODES=200	SAT TT=10.701 CHECKS=1003130 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=6.788 ASSIGNMENTS=243	SAT TT=6.654 ASSIGNMENTS=243	SAT TT=20.63 CHECKS=5118480 NODES=2183	? (TO) TT=1800.01	SAT TT=11.962 CHECKS=3760060 NODES=693	SAT TT=17.05 ASSIGNMENTS=200 CHECKS=616036	SAT TT=18.338 ASSIGNMENTS=200 CHECKS=616036	? (problem) TT=0.492	SAT TT=608.366	SAT TT=13.894 ASSIGNMENTS=1904 CHECKS=286789	SAT TT=90.181 ASSIGNMENTS=6362 CHECKS=1572420	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=6.562 ASSIGNMENTS=885 CHECKS=116262	SAT TT=141.143	SAT TT=145.2	SAT TT=90.3
csp/fapp/fapp02/ normalized-fapp02-0250-0.xml	UNSAT TT=1.994	UNSAT TT=17.88 CHECKS=28617 NODES=0	UNSAT TT=17.834 CHECKS=28617 NODES=0	UNSAT TT=1.994	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=16.566 ASSIGNMENTS=157	UNSAT TT=17.745 ASSIGNMENTS=157	UNSAT TT=30.681 CHECKS=1811210 NODES=249	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=23.9 ASSIGNMENTS=0 CHECKS=28617	UNSAT TT=24.438 ASSIGNMENTS=0 CHECKS=28617	? (problem) TT=0.45	? (problem) TT=0.577	UNSAT TT=14.794 ASSIGNMENTS=169 CHECKS=100956	UNSAT TT=122.36 ASSIGNMENTS=4369 CHECKS=1408090	UNSAT TT=136.821	UNSAT TT=486.704 ASSIGNMENTS=5748 CHECKS=4531650	UNSAT TT=7.873 ASSIGNMENTS=86 CHECKS=37881	UNSAT TT=247.085	UNSAT TT=38.859	UNSAT TT=79.722
csp/fapp/fapp02/ normalized-fapp02-0250-3.xml	SAT TT=17.484	SAT TT=18.558 CHECKS=5487510 NODES=660	SAT TT=17.484 CHECKS=1608080 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=25.176 ASSIGNMENTS=660 CHECKS=5487510	SAT TT=25.57 ASSIGNMENTS=660 CHECKS=5487510	? (problem) TT=0.575	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=474.405	SAT TT=341.373	SAT TT=220.05
csp/fapp/fapp02/ normalized-fapp02-0250-9.xml	SAT TT=13.973	SAT TT=17.875 CHECKS=1020020 NODES=252	SAT TT=19.367 CHECKS=3970030 NODES=252	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=15.183 ASSIGNMENTS=666	SAT TT=16.591 ASSIGNMENTS=666	SAT TT=33.716 CHECKS=6619340 NODES=1638	? (TO) TT=1800	SAT TT=30.103 CHECKS=48793800 NODES=8922	SAT TT=24.477 ASSIGNMENTS=252 CHECKS=1020020	SAT TT=25.014 ASSIGNMENTS=252 CHECKS=1020020	? (problem) TT=0.44	? (problem) TT=0.582	SAT TT=42.657 ASSIGNMENTS=5513 CHECKS=1443140	SAT TT=217.393 ASSIGNMENTS=11874 CHECKS=3201240	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=13.973 ASSIGNMENTS=1335 CHECKS=233024	SAT TT=260.497	SAT TT=403.726	SAT TT=156.903
csp/fapp/fapp03/ normalized-fapp03-0300-0.xml	UNSAT TT=1.197	UNSAT TT=22.338 CHECKS=16362 NODES=0	UNSAT TT=21.979 CHECKS=11673 NODES=0	UNSAT TT=1.197	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=15.438 ASSIGNMENTS=3	UNSAT TT=15.055 ASSIGNMENTS=3	UNSAT TT=56.661 CHECKS=1059530 NODES=47	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=31.826 ASSIGNMENTS=0 CHECKS=11673	UNSAT TT=31.821 ASSIGNMENTS=0 CHECKS=11673	? (problem) TT=0.595	? (problem) TT=0.479	UNSAT TT=8.472 ASSIGNMENTS=23 CHECKS=33873	UNSAT TT=229.247 ASSIGNMENTS=3885 CHECKS=1940160	UNSAT TT=817.88	UNSAT TT=829.438 ASSIGNMENTS=6060 CHECKS=5641460	UNSAT TT=5.371 ASSIGNMENTS=27 CHECKS=10404	? TT=380.23	UNSAT TT=51.131	UNSAT TT=135.899
csp/fapp/fapp03/ normalized-fapp03-0300-4.xml	UNSAT TT=11.852	UNSAT TT=22.239 CHECKS=45927 NODES=0	UNSAT TT=22.287 CHECKS=56387 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=11.852 ASSIGNMENTS=11	UNSAT TT=12.14 ASSIGNMENTS=11	UNSAT TT=50.136 CHECKS=839687 NODES=65	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=31.182 ASSIGNMENTS=0 CHECKS=41775	UNSAT TT=30.007 ASSIGNMENTS=0 CHECKS=41775	? (problem) TT=0.448	? (problem) TT=0.447	UNSAT TT=80.313 ASSIGNMENTS=971 CHECKS=1150040	UNSAT TT=243.623 ASSIGNMENTS=4652 CHECKS=2271150	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=12.056 ASSIGNMENTS=138 CHECKS=69678	? TT=335.06	UNSAT TT=52.068	UNSAT TT=128.538
csp/fapp/fapp03/ normalized-fapp03-0300-7.xml	SAT TT=27.393	SAT TT=27.393 CHECKS=27150600 NODES=2571	SAT TT=30.406 CHECKS=27304700 NODES=2494	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=111.536 ASSIGNMENTS=5276	SAT TT=110.592 ASSIGNMENTS=5276	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=35.432 ASSIGNMENTS=2475 CHECKS=26092700	SAT TT=35.326 ASSIGNMENTS=2475 CHECKS=26080000	? (problem) TT=0.596	? (TO) TT=1800.08	SAT TT=363.381 ASSIGNMENTS=52421 CHECKS=21609700	SAT TT=329.065 ASSIGNMENTS=10171 CHECKS=4564700	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=744.49	SAT TT=964.751	SAT TT=385.458
csp/fapp/fapp04/ normalized-fapp04-0300-0.xml	UNSAT TT=6.461	UNSAT TT=21.836 CHECKS=130470 NODES=0	UNSAT TT=21.945 CHECKS=136039 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=12.871 ASSIGNMENTS=13	UNSAT TT=12.866 ASSIGNMENTS=13	UNSAT TT=51.153 CHECKS=1743780 NODES=223	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=30.801 ASSIGNMENTS=0 CHECKS=114257	UNSAT TT=30.949 ASSIGNMENTS=0 CHECKS=114257	? (problem) TT=0.449	? (problem) TT=563.846	UNSAT TT=7.907 ASSIGNMENTS=117 CHECKS=21951	UNSAT TT=202.067 ASSIGNMENTS=4576 CHECKS=1303920	? (TO) TT=1800.11	? (TO) TT=1800.06	UNSAT TT=6.461 ASSIGNMENTS=54 CHECKS=15256	? TT=972.788	UNSAT TT=49.811	UNSAT TT=120.045
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp04/ normalized-fapp04-0300-5.xml	SAT TT=24.214	SAT TT=24.681 CHECKS=7018200 NODES=303	SAT TT=24.214 CHECKS=6630470 NODES=303	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=155.869 CHECKS=353973000 NODES=33652	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=32.051 ASSIGNMENTS=301 CHECKS=6292900	SAT TT=32.802 ASSIGNMENTS=301 CHECKS=6291610	? (problem) TT=0.449	? (problem) TT=0.45	SAT TT=1231.85 ASSIGNMENTS=114597 CHECKS=24795100	SAT TT=1261.2 ASSIGNMENTS=53012 CHECKS=18772100	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=610.226 ASSIGNMENTS=37496 CHECKS=8916950	? TT=711.431	SAT TT=1099.34	SAT TT=300.795
csp/fapp/fapp04/ normalized-fapp04-0300-6.xml	SAT TT=25.935	SAT TT=25.935 CHECKS=14061100 NODES=688	SAT TT=26.226 CHECKS=12592000 NODES=571	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=227.979 CHECKS=543836000 NODES=85583	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=33.1 ASSIGNMENTS=384 CHECKS=7942480	SAT TT=33.052 ASSIGNMENTS=384 CHECKS=7956210	? (problem) TT=0.574	? (problem) TT=0.453	SAT TT=1684.01 ASSIGNMENTS=195372 CHECKS=34426900	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=335.873 ASSIGNMENTS=19743 CHECKS=4100000	? TT=555.881	SAT TT=1282.26	SAT TT=319.265
csp/fapp/fapp05/ normalized-fapp05-0350-1.xml	UNSAT TT=22.35	UNSAT TT=22.533 CHECKS=317504 NODES=0	UNSAT TT=22.35 CHECKS=316272 NODES=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.22	UNSAT TT=107.749 CHECKS=109373000 NODES=9781	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=33.452 ASSIGNMENTS=0 CHECKS=295425	UNSAT TT=33.784 ASSIGNMENTS=0 CHECKS=295425	? (problem) TT=0.451	? (problem) TT=0.426	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=60.562	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=682.429	UNSAT TT=81.134	UNSAT TT=202.479
csp/fapp/fapp05/ normalized-fapp05-0350-5.xml	UNSAT TT=22.549	UNSAT TT=22.549 CHECKS=600118 NODES=0	UNSAT TT=22.79 CHECKS=623131 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=33.426 ASSIGNMENTS=0 CHECKS=578297	UNSAT TT=33.844 ASSIGNMENTS=0 CHECKS=599784	? (problem) TT=0.592	? (problem) TT=0.582	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=53.71	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=341.936	UNSAT TT=89.211	UNSAT TT=196.394
csp/fapp/fapp05/ normalized-fapp05-0350-6.xml	UNSAT TT=22.557	UNSAT TT=22.693 CHECKS=635661 NODES=0	UNSAT TT=22.557 CHECKS=614079 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=33.041 ASSIGNMENTS=0 CHECKS=593533	UNSAT TT=32.864 ASSIGNMENTS=0 CHECKS=614079	? (problem) TT=0.417	? (problem) TT=0.417	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=52.152	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=361.521	UNSAT TT=121.544	UNSAT TT=188.846
csp/fapp/fapp06/ normalized-fapp06-0500-0.xml	UNSAT TT=15.646	UNSAT TT=23.35 CHECKS=68156 NODES=0	UNSAT TT=23.322 CHECKS=68156 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=22.752 ASSIGNMENTS=47	UNSAT TT=22.765 ASSIGNMENTS=47	UNSAT TT=108.225 CHECKS=2546970 NODES=185	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=37.967 ASSIGNMENTS=0 CHECKS=68156	UNSAT TT=38.232 ASSIGNMENTS=0 CHECKS=68156	? (problem) TT=0.448	? (problem) TT=0.594	UNSAT TT=53.138 ASSIGNMENTS=314 CHECKS=366433	UNSAT TT=374.933 ASSIGNMENTS=4827 CHECKS=2086840	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=15.646 ASSIGNMENTS=32 CHECKS=26024	? TT=411.282	UNSAT TT=99.112	UNSAT TT=249.105
csp/fapp/fapp06/ normalized-fapp06-0500-4.xml	UNSAT TT=23.433	UNSAT TT=23.654 CHECKS=499244 NODES=0	UNSAT TT=23.433 CHECKS=492091 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.14	UNSAT TT=104.4 CHECKS=7144040 NODES=1644	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=35.828 ASSIGNMENTS=0 CHECKS=491742	UNSAT TT=36.06 ASSIGNMENTS=0 CHECKS=491742	? (problem) TT=0.448	? (problem) TT=0.586	UNSAT TT=382.551 ASSIGNMENTS=30706 CHECKS=2600560	UNSAT TT=740.305 ASSIGNMENTS=33848 CHECKS=5772890	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=53.323 ASSIGNMENTS=1834 CHECKS=274363	? TT=426.333	UNSAT TT=102.18	UNSAT TT=251.959
csp/fapp/fapp06/ normalized-fapp06-0500-9.xml	SAT TT=32.804	SAT TT=33.79 CHECKS=24646300 NODES=892	SAT TT=32.804 CHECKS=24645600 NODES=890	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.19	SAT TT=289.119 CHECKS=343325000 NODES=38162	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=45.115 ASSIGNMENTS=1174 CHECKS=27142700	SAT TT=47.136 ASSIGNMENTS=1727 CHECKS=33099500	? (problem) TT=0.481	? (problem) TT=0.595	SAT TT=509.265 ASSIGNMENTS=35955 CHECKS=6778100	SAT TT=557.666 ASSIGNMENTS=15353 CHECKS=4523690	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=1592.48	? (MO) TT=99.772	SAT TT=809.405
csp/fapp/fapp07/ normalized-fapp07-0600-6.xml	UNSAT TT=17.54	UNSAT TT=25.06 CHECKS=741026 NODES=0	UNSAT TT=25.553 CHECKS=748825 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=24.679 ASSIGNMENTS=99	UNSAT TT=24.716 ASSIGNMENTS=99	UNSAT TT=130.667 CHECKS=8361780 NODES=863	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=36.518 ASSIGNMENTS=0 CHECKS=737757	UNSAT TT=37.834 ASSIGNMENTS=0 CHECKS=737415	? (problem) TT=0.577	? (problem) TT=0.582	UNSAT TT=28.124 ASSIGNMENTS=270 CHECKS=90835	UNSAT TT=399.943 ASSIGNMENTS=5979 CHECKS=3486390	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=17.54 ASSIGNMENTS=181 CHECKS=55218	? TT=355.284	? (MO) TT=102.38	UNSAT TT=272.64
csp/fapp/fapp07/ normalized-fapp07-0600-7.xml	UNSAT TT=15.721	UNSAT TT=25.471 CHECKS=698967 NODES=0	UNSAT TT=25.135 CHECKS=696525 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=31.606 ASSIGNMENTS=151	UNSAT TT=32.742 ASSIGNMENTS=151	UNSAT TT=136.277 CHECKS=9689550 NODES=816	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=36.86 ASSIGNMENTS=0 CHECKS=691651	UNSAT TT=38.221 ASSIGNMENTS=0 CHECKS=705735	? (problem) TT=0.43	? (problem) TT=0.441	UNSAT TT=30.296 ASSIGNMENTS=402 CHECKS=110474	UNSAT TT=436.946 ASSIGNMENTS=6170 CHECKS=3611270	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=15.721 ASSIGNMENTS=294 CHECKS=54575	? TT=332.67	? (MO) TT=104.1	UNSAT TT=283.226
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp07/ normalized-fapp07-0600-8.xml	UNSAT TT=22.167	UNSAT TT=24.924 CHECKS=656562 NODES=0	UNSAT TT=25.294 CHECKS=657079 NODES=0	UNSAT TT=204.229	? (TO) TT=1800.14	? (TO) TT=1800.1	UNSAT TT=30.607 ASSIGNMENTS=159	UNSAT TT=28.805 ASSIGNMENTS=159	UNSAT TT=122.792 CHECKS=2948410 NODES=1378	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=36.212 ASSIGNMENTS=0 CHECKS=651455	UNSAT TT=36.292 ASSIGNMENTS=0 CHECKS=656381	? (problem) TT=0.426	? (problem) TT=0.762	UNSAT TT=32.833 ASSIGNMENTS=543 CHECKS=128330	UNSAT TT=496.402 ASSIGNMENTS=12047 CHECKS=4689790	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=22.167 ASSIGNMENTS=342 CHECKS=81711	? TT=312.55	? (MO) TT=102.23	UNSAT TT=273.56
csp/fapp/fapp08/ normalized-fapp08-0700-0.xml	UNSAT TT=17.553	UNSAT TT=24.495 CHECKS=29426 NODES=0	UNSAT TT=24.189 CHECKS=29478 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=596.502 CHECKS=3300580	UNSAT TT=19.691 ASSIGNMENTS=9	UNSAT TT=19.638 ASSIGNMENTS=9	UNSAT TT=113.178 CHECKS=11002700 NODES=2723	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=38.89 ASSIGNMENTS=0 CHECKS=29478	UNSAT TT=38.591 ASSIGNMENTS=0 CHECKS=29478	? (problem) TT=0.437	? (problem) TT=0.664	UNSAT TT=71.447 ASSIGNMENTS=1142 CHECKS=275001	UNSAT TT=302.917 ASSIGNMENTS=5728 CHECKS=1677000	? (TO) TT=1800.09	? (TO) TT=1800.12	UNSAT TT=17.553 ASSIGNMENTS=132 CHECKS=44225	? TT=1325.6	UNSAT TT=100.996	UNSAT TT=229.632
csp/fapp/fapp08/ normalized-fapp08-0700-10.xml	SAT TT=23.692	SAT TT=32.441 CHECKS=20025900 NODES=703	SAT TT=32.484 CHECKS=20025000 NODES=703	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=372.206 ASSIGNMENTS=27703	SAT TT=383.751 ASSIGNMENTS=27703	SAT TT=125.081 CHECKS=46338500 NODES=7813	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=42.518 ASSIGNMENTS=703 CHECKS=19766800	SAT TT=41.478 ASSIGNMENTS=700 CHECKS=18990500	? (problem) TT=0.439	? (problem) TT=0.453	SAT TT=23.692 ASSIGNMENTS=1604 CHECKS=196576	SAT TT=490.187 ASSIGNMENTS=19704 CHECKS=4094470	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=70.675 ASSIGNMENTS=5427 CHECKS=696634	? TT=792.959	? (MO) TT=103.752	SAT TT=760.074
csp/fapp/fapp08/ normalized-fapp08-0700-4.xml	UNSAT TT=24.203	UNSAT TT=24.203 CHECKS=588429 NODES=0	UNSAT TT=24.272 CHECKS=588429 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.13	UNSAT TT=100.83 CHECKS=6031720 NODES=2625	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=37.012 ASSIGNMENTS=0 CHECKS=588429	UNSAT TT=35.402 ASSIGNMENTS=0 CHECKS=578287	? (problem) TT=0.464	? (problem) TT=0.469	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=959.946 ASSIGNMENTS=142742 CHECKS=7471780	? TT=789.127	UNSAT TT=95.394	UNSAT TT=230.149
csp/fapp/fapp09/ normalized-fapp09-0800-0.xml	UNSAT TT=17.343	UNSAT TT=26.583 CHECKS=190575 NODES=0	UNSAT TT=25.775 CHECKS=185955 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=554.413 ASSIGNMENTS=12976	UNSAT TT=556.74 ASSIGNMENTS=12976	UNSAT TT=120.03 CHECKS=4552890 NODES=548	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=39.85 ASSIGNMENTS=0 CHECKS=184450	UNSAT TT=41.474 ASSIGNMENTS=0 CHECKS=186519	? (problem) TT=0.427	? (problem) TT=1195.52	UNSAT TT=23.406 ASSIGNMENTS=438 CHECKS=104475	UNSAT TT=651.388 ASSIGNMENTS=20150 CHECKS=6178930	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=17.343 ASSIGNMENTS=301 CHECKS=62649	? TT=450.694	UNSAT TT=83.881	UNSAT TT=177.812
csp/fapp/fapp09/ normalized-fapp09-0800-4.xml	SAT TT=32.3	SAT TT=39.155 CHECKS=18880800 NODES=2522	SAT TT=32.3 CHECKS=10874800 NODES=812	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=48.938 ASSIGNMENTS=1859 CHECKS=15146600	SAT TT=42.654 ASSIGNMENTS=812 CHECKS=10874000	? (problem) TT=0.445	? (problem) TT=0.589	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? TT=1064.49	? (TO) TT=1800.19	SAT TT=792.038
csp/fapp/fapp09/ normalized-fapp09-0800-8.xml	SAT TT=13.936	SAT TT=31.464 CHECKS=12277900 NODES=801	SAT TT=31.45 CHECKS=12300700 NODES=801	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=167.178 CHECKS=64794500 NODES=12009	? (TO) TT=1800.07	SAT TT=78.316 CHECKS=21014000 NODES=1674	SAT TT=41.465 ASSIGNMENTS=802 CHECKS=12157700	SAT TT=42.804 ASSIGNMENTS=801 CHECKS=12220200	? (problem) TT=0.435	? (problem) TT=0.567	SAT TT=15.64 ASSIGNMENTS=752 CHECKS=101234	SAT TT=364.242 ASSIGNMENTS=11623 CHECKS=2938500	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=13.936 ASSIGNMENTS=963 CHECKS=109366	? TT=397.012	? (TO) TT=1800.15	SAT TT=586.213
csp/fapp/fapp10/ normalized-fapp10-0900-0.xml	UNSAT TT=3.304	UNSAT TT=26.735 CHECKS=294809 NODES=0	UNSAT TT=26.627 CHECKS=294809 NODES=0	UNSAT TT=3.304	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=150.167 ASSIGNMENTS=651	UNSAT TT=149.17 ASSIGNMENTS=651	UNSAT TT=152.839 CHECKS=32144200 NODES=440	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=52.773 ASSIGNMENTS=0 CHECKS=293330	UNSAT TT=51.171 ASSIGNMENTS=0 CHECKS=256410	? (problem) TT=0.439	? (problem) TT=0.451	UNSAT TT=177.557 ASSIGNMENTS=2088 CHECKS=491684	UNSAT TT=592.054 ASSIGNMENTS=5422 CHECKS=2627870	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=29.405 ASSIGNMENTS=389 CHECKS=54642	? TT=433.024	? (MO) TT=150.14	? (MO) TT=310.886
csp/fapp/fapp10/ normalized-fapp10-0900-10.xml	SAT TT=52.5	SAT TT=53.307 CHECKS=60265700 NODES=1904	SAT TT=52.5 CHECKS=59856800 NODES=1904	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.23	? (TO) TT=1800.19	SAT TT=477.382 CHECKS=485069000 NODES=26005	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=58.673 ASSIGNMENTS=905 CHECKS=45853600	SAT TT=58.811 ASSIGNMENTS=905 CHECKS=45848900	? (problem) TT=0.44	? (problem) TT=0.442	SAT TT=181.421 ASSIGNMENTS=12056 CHECKS=5200560	SAT TT=722.269 ASSIGNMENTS=10349 CHECKS=4836620	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=102.871 ASSIGNMENTS=4669 CHECKS=919358	? TT=683.331	? (MO) TT=153.11	? (MO) TT=339.84
csp/fapp/fapp10/ normalized-fapp10-0900-9.xml	SAT TT=55.309	SAT TT=67.679 CHECKS=81188700 NODES=3513	SAT TT=55.309 CHECKS=60989000 NODES=2141	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=559.3 CHECKS=572095000 NODES=40805	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=66.599 ASSIGNMENTS=1872 CHECKS=59243300	SAT TT=66.925 ASSIGNMENTS=1872 CHECKS=59243300	? (problem) TT=0.446	? (problem) TT=0.647	SAT TT=152.956 ASSIGNMENTS=5165 CHECKS=2201010	SAT TT=1690.6 ASSIGNMENTS=128532 CHECKS=13676100	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=127.789 ASSIGNMENTS=7094 CHECKS=1087640	? TT=350.002	? (MO) TT=143.192	? (MO) TT=314.53
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp11/ normalized-fapp11-1000-1.xml	UNSAT TT=27.31	UNSAT TT=27.31 CHECKS=1849040 NODES=0	UNSAT TT=28.086 CHECKS=1849560 NODES=0	UNSAT TT=73.245	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.17	UNSAT TT=166.361 CHECKS=51643400 NODES=40	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=62.724 ASSIGNMENTS=0 CHECKS=1848430	UNSAT TT=61.75 ASSIGNMENTS=0 CHECKS=1848430	? (problem) TT=0.465	? (problem) TT=0.617	UNSAT TT=972.802 ASSIGNMENTS=3080 CHECKS=2271950	UNSAT TT=673.593 ASSIGNMENTS=3412 CHECKS=2628560	UNSAT TT=1307.2	? (TO) TT=1800.1	UNSAT TT=400.487 ASSIGNMENTS=1603 CHECKS=985145	? TT=419.901	? (MO) TT=241.249	? (MO) TT=403.283
csp/fapp/fapp11/ normalized-fapp11-1000-3.xml	UNSAT TT=27.02	UNSAT TT=27.02 CHECKS=1575160 NODES=0	UNSAT TT=27.57 CHECKS=1575160 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=335.728 ASSIGNMENTS=2471	UNSAT TT=326.354 ASSIGNMENTS=2471	UNSAT TT=170.873 CHECKS=62435200 NODES=193	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=59.565 ASSIGNMENTS=0 CHECKS=1575160	UNSAT TT=57.745 ASSIGNMENTS=0 CHECKS=1574610	? (problem) TT=0.477	? (problem) TT=0.478	UNSAT TT=1074.92 ASSIGNMENTS=11869 CHECKS=4164580	UNSAT TT=713.418 ASSIGNMENTS=6147 CHECKS=2932610	UNSAT TT=1519.42	? (TO) TT=1800.06	UNSAT TT=172.649 ASSIGNMENTS=1228 CHECKS=580159	? TT=582.376	? (MO) TT=252.804	? (MO) TT=398.339
csp/fapp/fapp11/ normalized-fapp11-1000-6.xml	UNSAT TT=27.246	UNSAT TT=27.955 CHECKS=1405800 NODES=0	UNSAT TT=27.246 CHECKS=1405800 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.23	? (TO) TT=1800.22	UNSAT TT=176.255 CHECKS=59339800 NODES=165	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=57.188 ASSIGNMENTS=0 CHECKS=1405100	UNSAT TT=57.511 ASSIGNMENTS=0 CHECKS=1405100	? (problem) TT=0.443	? (problem) TT=0.478	UNSAT TT=278.058 ASSIGNMENTS=7753 CHECKS=989157	? (TO) TT=1800.06	UNSAT TT=1211.06	? (TO) TT=1800.03	UNSAT TT=82.321 ASSIGNMENTS=1322 CHECKS=224872	? TT=381.496	? (MO) TT=239.755	? (MO) TT=404.74
csp/fapp/fapp12/ normalized-fapp12-1500-0.xml	UNSAT TT=29.357	UNSAT TT=30.203 CHECKS=874658 NODES=0	UNSAT TT=29.357 CHECKS=874658 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.24	UNSAT TT=231.914 CHECKS=16679400 NODES=0	UNSAT TT=240.434 CHECKS=17651900 NODES=0	UNSAT TT=278.989 CHECKS=17655400 NODES=0	UNSAT TT=85.645 ASSIGNMENTS=0 CHECKS=874658	UNSAT TT=90.468 ASSIGNMENTS=0 CHECKS=874658	? (problem) TT=0.44	? (problem) TT=0.58	UNSAT TT=64.884 ASSIGNMENTS=12 CHECKS=37670	UNSAT TT=605.386 ASSIGNMENTS=1774 CHECKS=2147160	UNSAT TT=1779.97	? (TO) TT=1800.08	UNSAT TT=65.95 ASSIGNMENTS=12 CHECKS=37631	? TT=709.369	? TT=392.266	? TT=417.99
csp/fapp/fapp12/ normalized-fapp12-1500-10.xml	SAT TT=1072.47	SAT TT=1072.47 CHECKS=2710230000 NODES=16896	SAT TT=1157.62 CHECKS=2712340000 NODES=16896	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1259.39 ASSIGNMENTS=18052 CHECKS=3099210000	SAT TT=1275.33 ASSIGNMENTS=18799 CHECKS=3106840000	? (problem) TT=0.594	? (problem) TT=0.574	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=543.885	? TT=422.086	? TT=419.488
csp/fapp/fapp12/ normalized-fapp12-1500-9.xml	SAT TT=203.296	SAT TT=285.524 CHECKS=561995000 NODES=9933	SAT TT=267.255 CHECKS=561970000 NODES=9933	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=317.161 ASSIGNMENTS=12620 CHECKS=576084000	SAT TT=312.075 ASSIGNMENTS=12620 CHECKS=576079000	? (problem) TT=0.454	? (problem) TT=0.445	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=733.303	? TT=422.452	? TT=420.96
csp/fapp/fapp13/ normalized-fapp13-2000-4.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.23	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (problem) TT=0.474	? (problem) TT=0.6	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=310.908	? TT=366.346	? TT=378.384
csp/fapp/fapp13/ normalized-fapp13-2000-6.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1831.68	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.24	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (problem) TT=0.468	? (problem) TT=0.422	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=1239.51	? TT=368.87	? TT=376.978
csp/fapp/fapp13/ normalized-fapp13-2000-9.xml	SAT TT=53.788	SAT TT=59.144 CHECKS=61518000 NODES=3329	SAT TT=53.788 CHECKS=48414900 NODES=2020	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1775.88	? (TO) TT=1800.02	SAT TT=75.251 ASSIGNMENTS=3331 CHECKS=61480900	SAT TT=65.478 ASSIGNMENTS=2024 CHECKS=47763000	? (problem) TT=0.436	? (problem) TT=0.762	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=1213.35	? TT=362.158	? TT=381.569
csp/fapp/fapp14/ normalized-fapp14-2500-0.xml	UNSAT TT=35.704	UNSAT TT=36.02 CHECKS=404591 NODES=0	UNSAT TT=35.704 CHECKS=404591 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.22	UNSAT TT=395.794 CHECKS=606433 NODES=0	UNSAT TT=519.522 CHECKS=1637490 NODES=0	UNSAT TT=484.704 CHECKS=1560980 NODES=0	UNSAT TT=139.001 ASSIGNMENTS=0 CHECKS=395664	UNSAT TT=142.868 ASSIGNMENTS=0 CHECKS=404591	? (problem) TT=0.419	? (problem) TT=0.413	UNSAT TT=326.024 ASSIGNMENTS=598 CHECKS=421741	UNSAT TT=711.483 ASSIGNMENTS=1682 CHECKS=1890210	UNSAT TT=43.461	? (TO) TT=1800.08	UNSAT TT=210.401 ASSIGNMENTS=335 CHECKS=208866	? TT=420.712	? TT=527.789	? TT=528.564
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp14/ normalized-fapp14-2500-2.xml	UNSAT TT=36.864	UNSAT TT=36.864 CHECKS=2491180 NODES=0	UNSAT TT=37.132 CHECKS=2491180 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.23	UNSAT TT=412.396 CHECKS=9720230 NODES=0	UNSAT TT=490.118 CHECKS=10197700 NODES=0	UNSAT TT=508.549 CHECKS=10193900 NODES=0	UNSAT TT=123.261 ASSIGNMENTS=0 CHECKS=2482640	UNSAT TT=117.641 ASSIGNMENTS=0 CHECKS=2491180	? (problem) TT=0.457	? (problem) TT=0.582	? (TO) TT=1800.03	UNSAT TT=692.919 ASSIGNMENTS=2523 CHECKS=1881240	UNSAT TT=50.14	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=396.977	? TT=550.442	? TT=489.221
csp/fapp/fapp14/ normalized-fapp14-2500-9.xml	SAT TT=415.716	SAT TT=511.534 CHECKS=1141320000 NODES=22541	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1010.77 ASSIGNMENTS=47660 CHECKS=1953880000	SAT TT=415.716 ASSIGNMENTS=14255 CHECKS=721391000	? (problem) TT=0.453	? (problem) TT=0.45	? (TO) TT=1800.02	? (TO) TT=1800.08	Wrong UNSAT TT=47.336	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=372.957	? TT=503.614	? TT=493.271
csp/fapp/fapp15/ normalized-fapp15-3000-0.xml	UNSAT TT=30.699	UNSAT TT=31.476 CHECKS=213034 NODES=0	UNSAT TT=30.699 CHECKS=212940 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=48.158 ASSIGNMENTS=1008	UNSAT TT=51.503 ASSIGNMENTS=1008	UNSAT TT=320.189 CHECKS=12299900 NODES=179	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=66.712 ASSIGNMENTS=0 CHECKS=212940	UNSAT TT=68.555 ASSIGNMENTS=0 CHECKS=212940	? (problem) TT=0.442	? (problem) TT=0.446	UNSAT TT=31.577 ASSIGNMENTS=8 CHECKS=66823	UNSAT TT=608.69 ASSIGNMENTS=6569 CHECKS=4567700	UNSAT TT=34.071	? (TO) TT=1800.14	UNSAT TT=36.603 ASSIGNMENTS=8 CHECKS=66823	? TT=309.894	? TT=346.959	? TT=335.57
csp/fapp/fapp15/ normalized-fapp15-3000-2.xml	UNSAT TT=31.212	UNSAT TT=31.212 CHECKS=1107370 NODES=0	UNSAT TT=31.309 CHECKS=1107370 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=85.662 ASSIGNMENTS=2612	UNSAT TT=85.119 ASSIGNMENTS=2612	UNSAT TT=441.841 CHECKS=22740100 NODES=3343	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=57.954 ASSIGNMENTS=0 CHECKS=1107370	UNSAT TT=56.087 ASSIGNMENTS=0 CHECKS=1107370	? (problem) TT=0.576	? (problem) TT=0.576	UNSAT TT=454.018 ASSIGNMENTS=10523 CHECKS=2428640	UNSAT TT=889.156 ASSIGNMENTS=22811 CHECKS=7818960	UNSAT TT=33.958	? (TO) TT=1800.07	UNSAT TT=712.028 ASSIGNMENTS=12845 CHECKS=3537120	? TT=1214.88	? TT=572.235	? TT=333.034
csp/fapp/fapp15/ normalized-fapp15-3000-8.xml	SAT TT=68.918	SAT TT=181.505 CHECKS=322191000 NODES=10241	SAT TT=68.918 CHECKS=88376000 NODES=3497	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.21	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=91.724 ASSIGNMENTS=3497 CHECKS=88172100	SAT TT=93.619 ASSIGNMENTS=3497 CHECKS=88237200	? (problem) TT=0.569	? (problem) TT=0.428	? (TO) TT=1800.04	? (TO) TT=1800.02	Wrong UNSAT TT=34.22	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=1404.61	? TT=347.811	? TT=361.929
csp/fapp/fapp16/ normalized-fapp16-0260-10.xml	UNSAT TT=1.069	UNSAT TT=21.563 CHECKS=51072 NODES=0	UNSAT TT=21.594 CHECKS=51072 NODES=0	UNSAT TT=1.069	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=15.949 ASSIGNMENTS=65	UNSAT TT=15.837 ASSIGNMENTS=65	UNSAT TT=55.52 CHECKS=2165850 NODES=59	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=32.488 ASSIGNMENTS=0 CHECKS=47493	UNSAT TT=32.58 ASSIGNMENTS=0 CHECKS=47493	? (problem) TT=0.587	? (problem) TT=0.576	UNSAT TT=11.632 ASSIGNMENTS=99 CHECKS=93134	UNSAT TT=114.758 ASSIGNMENTS=3962 CHECKS=1359710	? (TO) TT=1800.09	UNSAT TT=1241.66 ASSIGNMENTS=10476 CHECKS=5170210	UNSAT TT=14.349 ASSIGNMENTS=384 CHECKS=119497	? TT=422.768	UNSAT TT=41.63	UNSAT TT=93.829
csp/fapp/fapp16/ normalized-fapp16-0260-7.xml	UNSAT TT=1.006	UNSAT TT=21.359 CHECKS=49074 NODES=0	UNSAT TT=21.528 CHECKS=50858 NODES=0	UNSAT TT=1.006	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=14.998 ASSIGNMENTS=69	UNSAT TT=16.024 ASSIGNMENTS=69	UNSAT TT=54.658 CHECKS=2355760 NODES=69	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=33.038 ASSIGNMENTS=0 CHECKS=50849	UNSAT TT=33.117 ASSIGNMENTS=0 CHECKS=49074	? (problem) TT=0.584	? (problem) TT=0.59	UNSAT TT=23.197 ASSIGNMENTS=470 CHECKS=326090	UNSAT TT=123.051 ASSIGNMENTS=4071 CHECKS=1365400	? (TO) TT=1800.05	UNSAT TT=1097.03 ASSIGNMENTS=9960 CHECKS=4920140	UNSAT TT=12.284 ASSIGNMENTS=176 CHECKS=90470	? TT=404.459	UNSAT TT=42.087	UNSAT TT=92.441
csp/fapp/fapp16/ normalized-fapp16-0260-8.xml	UNSAT TT=1.081	UNSAT TT=21.559 CHECKS=53030 NODES=0	UNSAT TT=21.701 CHECKS=53636 NODES=0	UNSAT TT=1.081	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=15.848 ASSIGNMENTS=65	UNSAT TT=14.684 ASSIGNMENTS=65	UNSAT TT=53.528 CHECKS=2358290 NODES=69	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=32.279 ASSIGNMENTS=0 CHECKS=49070	UNSAT TT=33.866 ASSIGNMENTS=0 CHECKS=49067	? (problem) TT=0.415	? (problem) TT=0.463	UNSAT TT=20.728 ASSIGNMENTS=352 CHECKS=274473	UNSAT TT=139.603 ASSIGNMENTS=3972 CHECKS=1572330	? (TO) TT=1800.07	UNSAT TT=1092.67 ASSIGNMENTS=9960 CHECKS=4947720	UNSAT TT=10.399 ASSIGNMENTS=96 CHECKS=76869	? (TO) TT=1802.2	UNSAT TT=43.937	UNSAT TT=82.112
csp/fapp/fapp17/ normalized-fapp17-0300-0.xml	UNSAT TT=1.011	UNSAT TT=20.755 CHECKS=91335 NODES=0	UNSAT TT=20.838 CHECKS=91335 NODES=0	UNSAT TT=1.011	? (TO) TT=1800.12	? (TO) TT=1800.03	UNSAT TT=21.103 ASSIGNMENTS=95	UNSAT TT=19.571 ASSIGNMENTS=95	UNSAT TT=59.031 CHECKS=4995480 NODES=398	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=31.769 ASSIGNMENTS=0 CHECKS=91335	UNSAT TT=31.654 ASSIGNMENTS=0 CHECKS=91335	? (problem) TT=0.423	? (problem) TT=0.439	UNSAT TT=12.363 ASSIGNMENTS=77 CHECKS=23445	UNSAT TT=183.765 ASSIGNMENTS=4732 CHECKS=1105530	UNSAT TT=898.862	? (TO) TT=1800.04	UNSAT TT=24.167 ASSIGNMENTS=338 CHECKS=94211	? TT=419.923	UNSAT TT=58.927	UNSAT TT=142.304
csp/fapp/fapp17/ normalized-fapp17-0300-1.xml	UNSAT TT=1.013	UNSAT TT=19.249 CHECKS=91331 NODES=0	UNSAT TT=20.811 CHECKS=91331 NODES=0	UNSAT TT=1.013	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=21.398 ASSIGNMENTS=95	UNSAT TT=19.652 ASSIGNMENTS=95	UNSAT TT=57.554 CHECKS=4994020 NODES=398	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=32.007 ASSIGNMENTS=0 CHECKS=91331	UNSAT TT=34.141 ASSIGNMENTS=0 CHECKS=91331	? (problem) TT=0.455	? (problem) TT=0.456	UNSAT TT=12.145 ASSIGNMENTS=77 CHECKS=23445	UNSAT TT=160.65 ASSIGNMENTS=4547 CHECKS=1040410	UNSAT TT=917.655	? (TO) TT=1800.1	UNSAT TT=23.858 ASSIGNMENTS=338 CHECKS=94211	? TT=920.708	UNSAT TT=55.407	UNSAT TT=143.989
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp17/ normalized-fapp17-0300-4.xml	SAT TT=1.134	SAT TT=22.126 CHECKS=302678 NODES=300	SAT TT=21.971 CHECKS=305981 NODES=300	SAT TT=1.134	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=18.151 ASSIGNMENTS=272	SAT TT=16.797 ASSIGNMENTS=272	SAT TT=68.009 CHECKS=16731500 NODES=1799	SAT TT=35.236 CHECKS=15266600 NODES=1357	SAT TT=38.107 CHECKS=10937800 NODES=583	SAT TT=34.539 ASSIGNMENTS=300 CHECKS=315911	SAT TT=34.927 ASSIGNMENTS=300 CHECKS=315956	? (problem) TT=0.405	? (problem) TT=0.555	SAT TT=12.661 ASSIGNMENTS=286 CHECKS=38159	SAT TT=171.907 ASSIGNMENTS=4747 CHECKS=1035010	Wrong UNSAT TT=853.934	? (TO) TT=1800.07	SAT TT=10.313 ASSIGNMENTS=271 CHECKS=31361	? TT=461.054	SAT TT=167.822	SAT TT=204.387
csp/fapp/fapp18/ normalized-fapp18-0350-4.xml	UNSAT TT=0.973	UNSAT TT=21.283 CHECKS=65039 NODES=0	UNSAT TT=21.308 CHECKS=65039 NODES=0	UNSAT TT=0.973	UNSAT TT=38.737 CHECKS=9957	UNSAT TT=0.373 CHECKS=9957	UNSAT TT=11.97 ASSIGNMENTS=0	UNSAT TT=12.87 ASSIGNMENTS=0	UNSAT TT=58.963 CHECKS=259247 NODES=0	UNSAT TT=30.011 CHECKS=679649 NODES=0	UNSAT TT=27.881 CHECKS=679649 NODES=0	UNSAT TT=6.408 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.556 ASSIGNMENTS=0 CHECKS=6154	? (problem) TT=0.455	? (problem) TT=0.421	UNSAT TT=7.062 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.194 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=22.812	UNSAT TT=6.421 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.244 ASSIGNMENTS=0 CHECKS=6154	? TT=411.35	UNSAT TT=56.572	UNSAT TT=140.927
csp/fapp/fapp18/ normalized-fapp18-0350-5.xml	UNSAT TT=0.988	UNSAT TT=21.48 CHECKS=63301 NODES=0	UNSAT TT=21.488 CHECKS=63150 NODES=0	UNSAT TT=0.988	UNSAT TT=39.185 CHECKS=9957	UNSAT TT=0.369 CHECKS=9957	UNSAT TT=13.172 ASSIGNMENTS=0	UNSAT TT=13.502 ASSIGNMENTS=0	UNSAT TT=55.159 CHECKS=259245 NODES=0	UNSAT TT=30.882 CHECKS=679643 NODES=0	UNSAT TT=31.433 CHECKS=679643 NODES=0	UNSAT TT=5.966 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.34 ASSIGNMENTS=0 CHECKS=6154	? (problem) TT=0.585	? (problem) TT=0.581	UNSAT TT=6.363 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.133 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=23.456	UNSAT TT=6.597 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=5.691 ASSIGNMENTS=0 CHECKS=6154	? TT=470.907	UNSAT TT=55.806	UNSAT TT=140.446
csp/fapp/fapp18/ normalized-fapp18-0350-6.xml	UNSAT TT=0.971	UNSAT TT=21.418 CHECKS=134009 NODES=0	UNSAT TT=21.594 CHECKS=132621 NODES=0	UNSAT TT=0.971	UNSAT TT=36.352 CHECKS=10711	UNSAT TT=0.343 CHECKS=10711	UNSAT TT=12.978 ASSIGNMENTS=0	UNSAT TT=13.065 ASSIGNMENTS=0	UNSAT TT=58.935 CHECKS=683027 NODES=0	UNSAT TT=29.804 CHECKS=1075860 NODES=0	UNSAT TT=29.589 CHECKS=1075860 NODES=0	UNSAT TT=6.256 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.273 ASSIGNMENTS=0 CHECKS=6137	? (problem) TT=0.581	? (problem) TT=0.585	UNSAT TT=5.668 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.991 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=23.185	UNSAT TT=6.193 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.413 ASSIGNMENTS=0 CHECKS=6137	? TT=1383.54	UNSAT TT=64.856	UNSAT TT=145.995
csp/fapp/fapp19/ normalized-fapp19-0350-2.xml	UNSAT TT=1.689	UNSAT TT=22.885 CHECKS=248605 NODES=0	UNSAT TT=23.244 CHECKS=248605 NODES=0	UNSAT TT=1.689	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=108.259 ASSIGNMENTS=583	UNSAT TT=106.51 ASSIGNMENTS=583	UNSAT TT=128.879 CHECKS=795836 NODES=0	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=97.596 ASSIGNMENTS=0 CHECKS=152696	UNSAT TT=95.646 ASSIGNMENTS=0 CHECKS=254715	? (problem) TT=0.441	? (problem) TT=0.438	UNSAT TT=324.262 ASSIGNMENTS=4437 CHECKS=707543	UNSAT TT=684.497 ASSIGNMENTS=1893 CHECKS=869014	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=222.408 ASSIGNMENTS=549 CHECKS=274864	? TT=0.954	? (MO) TT=197.15	? (MO) TT=386.272
csp/fapp/fapp19/ normalized-fapp19-0350-3.xml	UNSAT TT=1.862	UNSAT TT=23.073 CHECKS=293799 NODES=0	UNSAT TT=23.18 CHECKS=293799 NODES=0	UNSAT TT=1.862	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=279.07 ASSIGNMENTS=2633	UNSAT TT=280.456 ASSIGNMENTS=2633	UNSAT TT=128.579 CHECKS=1096120 NODES=0	UNSAT TT=243.057 CHECKS=1606350 NODES=0	UNSAT TT=247.093 CHECKS=1606350 NODES=0	UNSAT TT=87.679 ASSIGNMENTS=0 CHECKS=188151	UNSAT TT=94.098 ASSIGNMENTS=0 CHECKS=188151	? (problem) TT=0.424	? (problem) TT=0.605	UNSAT TT=286.537 ASSIGNMENTS=839 CHECKS=621954	UNSAT TT=1302.46 ASSIGNMENTS=5329 CHECKS=2748710	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=222.171 ASSIGNMENTS=547 CHECKS=351327	? TT=0.935	? (MO) TT=212.96	? (MO) TT=381.058
csp/fapp/fapp19/ normalized-fapp19-0350-5.xml	UNSAT TT=1.728	UNSAT TT=23.213 CHECKS=386572 NODES=0	UNSAT TT=23.148 CHECKS=386572 NODES=0	UNSAT TT=1.728	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=94.51 ASSIGNMENTS=298	UNSAT TT=94.861 ASSIGNMENTS=298	UNSAT TT=150.343 CHECKS=73714100 NODES=252	UNSAT TT=241.099 CHECKS=4041050 NODES=0	UNSAT TT=244.381 CHECKS=4041050 NODES=0	UNSAT TT=96.684 ASSIGNMENTS=0 CHECKS=249898	UNSAT TT=91.105 ASSIGNMENTS=0 CHECKS=249898	? (problem) TT=0.584	? (problem) TT=0.448	UNSAT TT=87.336 ASSIGNMENTS=108 CHECKS=27049	UNSAT TT=893.216 ASSIGNMENTS=2372 CHECKS=1473200	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=134.572 ASSIGNMENTS=334 CHECKS=106947	? TT=0.971	? (MO) TT=210.35	? (MO) TT=385.14
csp/fapp/fapp20/ normalized-fapp20-0420-2.xml	UNSAT TT=1.369	UNSAT TT=21.615 CHECKS=60344 NODES=0	UNSAT TT=21.527 CHECKS=59798 NODES=0	UNSAT TT=1.369	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=44.071 ASSIGNMENTS=1829	UNSAT TT=44.008 ASSIGNMENTS=1829	UNSAT TT=69.526 CHECKS=4254880 NODES=663	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=35.9 ASSIGNMENTS=0 CHECKS=54328	UNSAT TT=35.991 ASSIGNMENTS=0 CHECKS=54328	? (problem) TT=0.432	? (problem) TT=0.435	UNSAT TT=107.867 ASSIGNMENTS=1987 CHECKS=581188	UNSAT TT=193.11 ASSIGNMENTS=5371 CHECKS=1008910	UNSAT TT=203.473	? (TO) TT=1800.04	UNSAT TT=28.35 ASSIGNMENTS=550 CHECKS=111797	? TT=721.253	UNSAT TT=62.43	UNSAT TT=146.504
csp/fapp/fapp20/ normalized-fapp20-0420-5.xml	UNSAT TT=1.393	UNSAT TT=22.038 CHECKS=67595 NODES=0	UNSAT TT=22.232 CHECKS=65881 NODES=0	UNSAT TT=1.393	? (TO) TT=1800.12	? (TO) TT=1800.03	UNSAT TT=27.558 ASSIGNMENTS=505	UNSAT TT=28.19 ASSIGNMENTS=505	UNSAT TT=118.597 CHECKS=125876000 NODES=13745	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=37.455 ASSIGNMENTS=0 CHECKS=67596	UNSAT TT=36.997 ASSIGNMENTS=0 CHECKS=67596	? (problem) TT=0.449	? (problem) TT=0.446	UNSAT TT=39.581 ASSIGNMENTS=950 CHECKS=223724	UNSAT TT=194.094 ASSIGNMENTS=5360 CHECKS=1012520	UNSAT TT=189.766	? (TO) TT=1800.03	UNSAT TT=30.332 ASSIGNMENTS=550 CHECKS=112545	? TT=1618.41	UNSAT TT=70.78	UNSAT TT=147.679
csp/fapp/fapp20/ normalized-fapp20-0420-7.xml	UNSAT TT=1.381	UNSAT TT=22.103 CHECKS=65375 NODES=0	UNSAT TT=22.282 CHECKS=65456 NODES=0	UNSAT TT=1.381	? (TO) TT=1800.13	? (TO) TT=1800.08	UNSAT TT=27.652 ASSIGNMENTS=505	UNSAT TT=27.448 ASSIGNMENTS=505	UNSAT TT=153.205 CHECKS=160636000 NODES=29569	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=35.674 ASSIGNMENTS=0 CHECKS=65375	UNSAT TT=35.325 ASSIGNMENTS=0 CHECKS=65375	? (problem) TT=0.577	? (problem) TT=570.706	UNSAT TT=38.386 ASSIGNMENTS=950 CHECKS=224836	UNSAT TT=197.162 ASSIGNMENTS=5452 CHECKS=1036320	UNSAT TT=201.245	? (TO) TT=1800.05	UNSAT TT=28.013 ASSIGNMENTS=550 CHECKS=112829	? TT=397.754	UNSAT TT=69.452	UNSAT TT=159.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp21/ normalized-fapp21-0500-5.xml	SAT TT=21.768	SAT TT=21.768 CHECKS=823489 NODES=500	SAT TT=21.81 CHECKS=869253 NODES=500	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=31.783 ASSIGNMENTS=500 CHECKS=766860	SAT TT=32.239 ASSIGNMENTS=500 CHECKS=766860	? (problem) TT=0.567	? (problem) TT=0.578	SAT TT=691.923 ASSIGNMENTS=61905 CHECKS=2821430	SAT TT=281.516 ASSIGNMENTS=29345 CHECKS=1340370	Wrong UNSAT TT=120.356	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=810.244	SAT TT=288.792	SAT TT=261.691
csp/fapp/fapp21/ normalized-fapp21-0500-6.xml	SAT TT=21.607	SAT TT=21.783 CHECKS=942290 NODES=500	SAT TT=21.607 CHECKS=784456 NODES=500	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1001.56 ASSIGNMENTS=140929	SAT TT=1078.84 ASSIGNMENTS=140929	SAT TT=1177.32 CHECKS=2774580000 NODES=751487	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=33.342 ASSIGNMENTS=500 CHECKS=874935	SAT TT=33.801 ASSIGNMENTS=500 CHECKS=990034	? (problem) TT=0.495	? (problem) TT=0.424	SAT TT=1256.21 ASSIGNMENTS=207460 CHECKS=8804110	? (TO) TT=1800.06	Wrong UNSAT TT=119.565	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=976.221	SAT TT=246.303	SAT TT=265.678
csp/fapp/fapp21/ normalized-fapp21-0500-7.xml	SAT TT=21.749	SAT TT=21.792 CHECKS=921553 NODES=500	SAT TT=21.749 CHECKS=919013 NODES=500	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1414.1 CHECKS=4269480000 NODES=902415	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=33.464 ASSIGNMENTS=500 CHECKS=963800	SAT TT=32.737 ASSIGNMENTS=500 CHECKS=936460	? (problem) TT=0.436	? (problem) TT=0.442	? (TO) TT=1800.04	? (TO) TT=1800.06	Wrong UNSAT TT=111.471	? (TO) TT=1800.05	SAT TT=504.034 ASSIGNMENTS=58130 CHECKS=2347850	? TT=363.875	SAT TT=288.646	SAT TT=278.277
csp/fapp/fapp22/ normalized-fapp22-1750-0.xml	UNSAT TT=8.748	UNSAT TT=30.706 CHECKS=338746 NODES=0	UNSAT TT=30.098 CHECKS=363035 NODES=0	UNSAT TT=8.748	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=125.171 ASSIGNMENTS=369	UNSAT TT=115.127 ASSIGNMENTS=369	UNSAT TT=277.861 CHECKS=641601 NODES=0	UNSAT TT=452.141 CHECKS=810381 NODES=0	UNSAT TT=482.188 CHECKS=820657 NODES=0	UNSAT TT=400.568 ASSIGNMENTS=0 CHECKS=358632	UNSAT TT=427.376 ASSIGNMENTS=0 CHECKS=358632	? (problem) TT=0.438	? (problem) TT=0.61	UNSAT TT=539.767 ASSIGNMENTS=227 CHECKS=196084	UNSAT TT=724.406 ASSIGNMENTS=705 CHECKS=382894	UNSAT TT=32.519	? (TO) TT=1800.03	UNSAT TT=537.68 ASSIGNMENTS=2831 CHECKS=464931	? TT=0.766	? TT=742.814	? TT=743.495
csp/fapp/fapp22/ normalized-fapp22-1750-10.xml	SAT TT=36.294	SAT TT=36.294 CHECKS=9267580 NODES=1750	SAT TT=37.143 CHECKS=9269920 NODES=1750	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=284.899 CHECKS=9578020 NODES=1750	SAT TT=547.877 CHECKS=10370900 NODES=648	SAT TT=566.175 CHECKS=16506800 NODES=637	SAT TT=435.138 ASSIGNMENTS=1750 CHECKS=9260380	SAT TT=428.45 ASSIGNMENTS=1750 CHECKS=9278020	? (problem) TT=0.616	? (problem) TT=0.464	? (TO) TT=1800.1	SAT TT=1473.8 ASSIGNMENTS=191233 CHECKS=8365990	Wrong UNSAT TT=32.969	? (TO) TT=1800.05	? (TO) TT=1800.03	? TT=0.837	? TT=774.726	? TT=763.005
csp/fapp/fapp22/ normalized-fapp22-1750-6.xml	UNSAT TT=8.738	UNSAT TT=31.483 CHECKS=59746 NODES=0	UNSAT TT=30.624 CHECKS=59746 NODES=0	UNSAT TT=8.738	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=213.607 ASSIGNMENTS=2209	UNSAT TT=214.049 ASSIGNMENTS=2209	UNSAT TT=277.725 CHECKS=500339 NODES=0	UNSAT TT=466.028 CHECKS=514137 NODES=0	UNSAT TT=471.184 CHECKS=514653 NODES=0	UNSAT TT=426.269 ASSIGNMENTS=0 CHECKS=41031	UNSAT TT=427.928 ASSIGNMENTS=0 CHECKS=41543	? (problem) TT=0.45	? (problem) TT=0.58	UNSAT TT=779.036 ASSIGNMENTS=2489 CHECKS=1156160	UNSAT TT=907.015 ASSIGNMENTS=2291 CHECKS=686609	UNSAT TT=30.794	? (TO) TT=1800.07	UNSAT TT=486.689 ASSIGNMENTS=722 CHECKS=322011	? TT=0.811	? TT=773.311	? TT=808.599
csp/fapp/fapp23/ normalized-fapp23-1800-2.xml	UNSAT TT=17.562	UNSAT TT=35.173 CHECKS=786088 NODES=0	UNSAT TT=34.952 CHECKS=786103 NODES=0	UNSAT TT=17.562	UNSAT TT=73.771 CHECKS=7518540	UNSAT TT=36.681 CHECKS=927696	UNSAT TT=55.691 ASSIGNMENTS=0	UNSAT TT=58.451 ASSIGNMENTS=0	UNSAT TT=754.128 CHECKS=474485 NODES=0	UNSAT TT=906.285 CHECKS=552627 NODES=0	UNSAT TT=832.556 CHECKS=552627 NODES=0	UNSAT TT=132.27 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=138.349 ASSIGNMENTS=0 CHECKS=190727	? (problem) TT=0.581	? (problem) TT=0.46	UNSAT TT=129.965 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=136.312 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=66.606	UNSAT TT=125.19 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=130.063 ASSIGNMENTS=0 CHECKS=190727	? (TO) TT=1802.17	? TT=509.517	? TT=477.864
csp/fapp/fapp23/ normalized-fapp23-1800-4.xml	UNSAT TT=17.811	UNSAT TT=36.028 CHECKS=789237 NODES=0	UNSAT TT=36.778 CHECKS=785308 NODES=0	UNSAT TT=17.811	UNSAT TT=70.821 CHECKS=5701440	? (TO) TT=1800.08	UNSAT TT=56.033 ASSIGNMENTS=0	UNSAT TT=51.334 ASSIGNMENTS=0	UNSAT TT=730.741 CHECKS=473717 NODES=0	? (TO) TT=875	? (TO) TT=882.95	UNSAT TT=140.563 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=130.487 ASSIGNMENTS=0 CHECKS=324708	? (problem) TT=0.474	? (problem) TT=0.608	UNSAT TT=139.764 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=137.658 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=66.293	UNSAT TT=134.018 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=140.555 ASSIGNMENTS=0 CHECKS=324708	? TT=416.965	? TT=529.713	? TT=512.545
csp/fapp/fapp23/ normalized-fapp23-1800-9.xml	SAT TT=37.915	SAT TT=37.915 CHECKS=2321360 NODES=1800	SAT TT=38.618 CHECKS=2329420 NODES=1800	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	SAT TT=59.94 ASSIGNMENTS=1340	SAT TT=59.89 ASSIGNMENTS=1340	SAT TT=761.868 CHECKS=2372230 NODES=1800	? (TO) TT=980.3	? (TO) TT=952.74	SAT TT=191.556 ASSIGNMENTS=1800 CHECKS=2326670	SAT TT=179.606 ASSIGNMENTS=1800 CHECKS=2336430	? (problem) TT=0.595	? (problem) TT=0.451	SAT TT=144.161 ASSIGNMENTS=905 CHECKS=621531	SAT TT=145.513 ASSIGNMENTS=13058 CHECKS=2142790	Wrong UNSAT TT=65.625	SAT TT=169.489 ASSIGNMENTS=60573 CHECKS=13090500	SAT TT=144.34 ASSIGNMENTS=940 CHECKS=623561	? TT=451.994	? TT=505.105	? TT=531.543
csp/fapp/fapp24/ normalized-fapp24-2000-1.xml	UNSAT TT=8.112	UNSAT TT=24.96 CHECKS=94159 NODES=0	UNSAT TT=25.152 CHECKS=103650 NODES=0	UNSAT TT=8.112	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=47.33 ASSIGNMENTS=671	UNSAT TT=42.964 ASSIGNMENTS=671	UNSAT TT=343.002 CHECKS=54381600 NODES=250	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=93.669 ASSIGNMENTS=0 CHECKS=82101	UNSAT TT=91.937 ASSIGNMENTS=0 CHECKS=82101	? (problem) TT=0.459	? (problem) TT=0.458	UNSAT TT=354.321 ASSIGNMENTS=846 CHECKS=598265	UNSAT TT=754.375 ASSIGNMENTS=4873 CHECKS=2510490	UNSAT TT=1679.91	? (TO) TT=1800.1	UNSAT TT=134.205 ASSIGNMENTS=217 CHECKS=167969	? TT=417.218	? TT=495.533	? TT=467.545
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp24/ normalized-fapp24-2000-2.xml	UNSAT TT=8.719	UNSAT TT=25.9 CHECKS=111735 NODES=0	UNSAT TT=25.73 CHECKS=111735 NODES=0	UNSAT TT=8.719	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=47.472 ASSIGNMENTS=671	UNSAT TT=43.067 ASSIGNMENTS=671	UNSAT TT=286.592 CHECKS=32991100 NODES=52	UNSAT TT=212.19 CHECKS=3103200 NODES=0	UNSAT TT=210.045 CHECKS=3103200 NODES=0	UNSAT TT=94.077 ASSIGNMENTS=0 CHECKS=111735	UNSAT TT=102.138 ASSIGNMENTS=0 CHECKS=111735	? (problem) TT=0.425	? (problem) TT=0.585	UNSAT TT=368.102 ASSIGNMENTS=846 CHECKS=598265	UNSAT TT=747.201 ASSIGNMENTS=5147 CHECKS=2615680	UNSAT TT=1714.11	? (TO) TT=1800.08	UNSAT TT=138.172 ASSIGNMENTS=217 CHECKS=167969	? TT=1467.21	? TT=445.024	? TT=465.473
csp/fapp/fapp24/ normalized-fapp24-2000-7.xml	SAT TT=28.33	SAT TT=29.043 CHECKS=2575070 NODES=2000	SAT TT=28.33 CHECKS=2558380 NODES=2000	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	SAT TT=49.554 ASSIGNMENTS=4053	SAT TT=46.636 ASSIGNMENTS=4053	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=104.063 ASSIGNMENTS=2000 CHECKS=2561810	SAT TT=101.984 ASSIGNMENTS=2000 CHECKS=2560820	? (problem) TT=0.57	? (problem) TT=0.585	SAT TT=101.11 ASSIGNMENTS=2556 CHECKS=258446	SAT TT=631.069 ASSIGNMENTS=8488 CHECKS=2431550	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=107.598 ASSIGNMENTS=1823 CHECKS=246767	? TT=402.076	? TT=466.298	? TT=478.093
csp/fapp/fapp25/ normalized-fapp25-2230-0.xml	UNSAT TT=5.062	UNSAT TT=24.543 CHECKS=165883 NODES=0	UNSAT TT=24.544 CHECKS=165883 NODES=0	UNSAT TT=5.062	UNSAT TT=45.292 CHECKS=2047800	UNSAT TT=5.273 CHECKS=630863	UNSAT TT=34.78 ASSIGNMENTS=1	UNSAT TT=34.055 ASSIGNMENTS=1	UNSAT TT=167.68 CHECKS=8547990 NODES=0	UNSAT TT=107.745 CHECKS=9708830 NODES=0	UNSAT TT=114.509 CHECKS=9708830 NODES=0	UNSAT TT=56.577 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=53.984 ASSIGNMENTS=0 CHECKS=54523	? (problem) TT=0.583	? (problem) TT=593.591	UNSAT TT=54.314 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=51.959 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=20.957	UNSAT TT=54.751 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=54.638 ASSIGNMENTS=0 CHECKS=54523	? TT=366.207	? TT=463.682	? TT=466.788
csp/fapp/fapp25/ normalized-fapp25-2230-2.xml	UNSAT TT=4.998	UNSAT TT=25.224 CHECKS=2052920 NODES=0	UNSAT TT=25.621 CHECKS=2110580 NODES=0	UNSAT TT=4.998	UNSAT TT=44.331 CHECKS=216868	? (TO) TT=1800.1	UNSAT TT=35.136 ASSIGNMENTS=48	UNSAT TT=35.05 ASSIGNMENTS=48	UNSAT TT=177.675 CHECKS=8665700 NODES=0	UNSAT TT=126.137 CHECKS=9660360 NODES=0	UNSAT TT=125.132 CHECKS=9660360 NODES=0	UNSAT TT=54.665 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=57.469 ASSIGNMENTS=0 CHECKS=54202	? (problem) TT=0.579	? (problem) TT=0.471	UNSAT TT=54.537 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=51.008 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=20.847	UNSAT TT=51.091 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=54.301 ASSIGNMENTS=0 CHECKS=54202	? TT=349.054	? TT=457.193	? TT=433.716
csp/fapp/fapp25/ normalized-fapp25-2230-4.xml	SAT TT=28.939	SAT TT=29.277 CHECKS=7810920 NODES=2230	SAT TT=28.939 CHECKS=7802130 NODES=2230	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.21	SAT TT=235.441 CHECKS=25144900 NODES=4618	SAT TT=134.668 CHECKS=25797700 NODES=4914	SAT TT=140.858 CHECKS=34505200 NODES=855	SAT TT=95.523 ASSIGNMENTS=2230 CHECKS=7810180	SAT TT=95.437 ASSIGNMENTS=2230 CHECKS=7805720	? (problem) TT=0.413	? (problem) TT=0.555	SAT TT=55.985 ASSIGNMENTS=3545 CHECKS=275397	SAT TT=71.274 ASSIGNMENTS=26109 CHECKS=1488000	Wrong UNSAT TT=20.904	SAT TT=465.272 ASSIGNMENTS=694510 CHECKS=45718700	SAT TT=55.854 ASSIGNMENTS=2346 CHECKS=243533	? TT=366.45	? TT=466.208	? TT=455.422
csp/fapp/fapp26/ normalized-fapp26-2300-10.xml	SAT TT=29.892	SAT TT=30.414 CHECKS=3766720 NODES=2300	SAT TT=29.892 CHECKS=3769220 NODES=2300	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.23	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=94.759 ASSIGNMENTS=2300 CHECKS=3768070	SAT TT=90.139 ASSIGNMENTS=2300 CHECKS=3765790	? (problem) TT=0.601	? (problem) TT=0.455	? (TO) TT=1800.06	? (TO) TT=1800.04	Wrong UNSAT TT=26.594	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=393.935	? TT=496.837	? TT=468.886
csp/fapp/fapp26/ normalized-fapp26-2300-4.xml	UNSAT TT=7.495	UNSAT TT=26.587 CHECKS=937741 NODES=0	UNSAT TT=26.638 CHECKS=937741 NODES=0	UNSAT TT=7.495	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.18	UNSAT TT=261.956 CHECKS=91372200 NODES=429	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=91.773 ASSIGNMENTS=0 CHECKS=942312	UNSAT TT=87.006 ASSIGNMENTS=0 CHECKS=939296	? (problem) TT=0.448	? (problem) TT=0.583	? (TO) TT=1800.09	UNSAT TT=965.585 ASSIGNMENTS=15568 CHECKS=3699280	UNSAT TT=28.322	? (TO) TT=1800.11	UNSAT TT=1398.76 ASSIGNMENTS=27298 CHECKS=4234850	? TT=408.171	? TT=486.433	? TT=510.094
csp/fapp/fapp26/ normalized-fapp26-2300-8.xml	SAT TT=29.51	SAT TT=29.51 CHECKS=3539790 NODES=2300	SAT TT=29.718 CHECKS=3539380 NODES=2300	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.25	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=93.375 ASSIGNMENTS=2300 CHECKS=3538920	SAT TT=97.408 ASSIGNMENTS=2300 CHECKS=3535360	? (problem) TT=0.479	? (problem) TT=0.445	? (TO) TT=1800.04	? (TO) TT=1800.04	Wrong UNSAT TT=24.802	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=977.753	? TT=479.309	? TT=492.849
csp/fapp/fapp27/ normalized-fapp27-2550-10.xml	SAT TT=31.712	SAT TT=33.639 CHECKS=22271500 NODES=2550	SAT TT=31.712 CHECKS=21932400 NODES=2550	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.23	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=60.143 ASSIGNMENTS=2550 CHECKS=22253300	SAT TT=60.227 ASSIGNMENTS=2550 CHECKS=21987800	? (problem) TT=461.33	? (problem) TT=0.429	? (TO) TT=1800.03	? (TO) TT=1800.05	Wrong UNSAT TT=11.57	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=390.855	? TT=420.66	? TT=416.07
csp/fapp/fapp27/ normalized-fapp27-2550-3.xml	UNSAT TT=22.787	UNSAT TT=22.787 CHECKS=535609 NODES=0	UNSAT TT=22.953 CHECKS=555096 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.24	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=49.999 ASSIGNMENTS=0 CHECKS=535609	UNSAT TT=49.305 ASSIGNMENTS=0 CHECKS=535609	? (problem) TT=0.593	? (problem) TT=0.424	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=10.636	? (TO) TT=1800.07	UNSAT TT=229.25 ASSIGNMENTS=30980 CHECKS=1036290	? TT=408.839	? TT=429.206	? TT=417.567
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp27/ normalized-fapp27-2550-7.xml	SAT TT=32	SAT TT=32.065 CHECKS=20475000 NODES=2551	SAT TT=32 CHECKS=20473500 NODES=2551	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=55.632 ASSIGNMENTS=2551 CHECKS=20035700	SAT TT=57.052 ASSIGNMENTS=2551 CHECKS=20009300	? (problem) TT=0.469	? (problem) TT=0.644	? (TO) TT=1800.02	? (TO) TT=1800.07	Wrong UNSAT TT=11.269	? (TO) TT=1800.14	? (TO) TT=1800.08	? TT=1039.28	? TT=444.608	? TT=402.845
csp/fapp/fapp28/ normalized-fapp28-2800-10.xml	SAT TT=48.941	SAT TT=50.723 CHECKS=43944400 NODES=2802	SAT TT=48.941 CHECKS=43941100 NODES=2802	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.24	SAT TT=286.491 CHECKS=50975500 NODES=2801	SAT TT=460.014 CHECKS=80877800 NODES=153231	SAT TT=436.837 CHECKS=58829700 NODES=1070	SAT TT=518.374 ASSIGNMENTS=2802 CHECKS=43958800	SAT TT=485.414 ASSIGNMENTS=2802 CHECKS=43953300	? (problem) TT=0.598	? (problem) TT=0.441	? (TO) TT=1800.05	? (TO) TT=1800.05	Wrong UNSAT TT=29.337	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=0.886	? TT=1131.99	? TT=1040.2
csp/fapp/fapp28/ normalized-fapp28-2800-5.xml	SAT TT=44.85	SAT TT=44.85 CHECKS=35049200 NODES=2800	SAT TT=47.72 CHECKS=35048600 NODES=2800	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.27	SAT TT=297.094 CHECKS=38833600 NODES=2800	SAT TT=1410.51 CHECKS=1211510000 NODES=1803300	SAT TT=430.371 CHECKS=45067000 NODES=691	SAT TT=544.549 ASSIGNMENTS=2800 CHECKS=35062900	SAT TT=527.457 ASSIGNMENTS=2800 CHECKS=35049200	? (problem) TT=0.432	? (problem) TT=0.568	? (TO) TT=1800.1	? (TO) TT=1800.02	Wrong UNSAT TT=30.927	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=0.854	? TT=1046.79	? TT=1044
csp/fapp/fapp28/ normalized-fapp28-2800-6.xml	SAT TT=45.953	SAT TT=45.953 CHECKS=36212400 NODES=2800	SAT TT=48.489 CHECKS=36217300 NODES=2800	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.24	? (TO) TT=1800.24	SAT TT=293.697 CHECKS=39743100 NODES=2801	SAT TT=613.664 CHECKS=264288000 NODES=302500	SAT TT=427.841 CHECKS=45241900 NODES=659	SAT TT=482.583 ASSIGNMENTS=2800 CHECKS=36222800	SAT TT=483.318 ASSIGNMENTS=2800 CHECKS=36231600	? (problem) TT=0.443	? (problem) TT=0.444	? (TO) TT=1800.08	? (TO) TT=1800.1	Wrong UNSAT TT=25.145	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=0.932	? TT=1028.1	? TT=1115.1
csp/fapp/fapp29/ normalized-fapp29-2900-1.xml	UNSAT TT=16.226	UNSAT TT=39.921 CHECKS=1188900 NODES=0	UNSAT TT=37.981 CHECKS=1190080 NODES=0	UNSAT TT=16.226	UNSAT TT=76.26 CHECKS=117301	UNSAT TT=42.512 CHECKS=117301	UNSAT TT=93.607 ASSIGNMENTS=0	UNSAT TT=90.935 ASSIGNMENTS=0	? TT=714.378	? (TO) TT=952.83	? (TO) TT=1010.3	UNSAT TT=221.877 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=244.713 ASSIGNMENTS=0 CHECKS=26170	? (problem) TT=0.428	? (problem) TT=0.421	UNSAT TT=226.761 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=239.994 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=325.531	UNSAT TT=239.708 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=223.055 ASSIGNMENTS=0 CHECKS=26170	? TT=0.912	? TT=911.879	? TT=795.601
csp/fapp/fapp29/ normalized-fapp29-2900-3.xml	UNSAT TT=17.532	UNSAT TT=40.638 CHECKS=2048040 NODES=0	UNSAT TT=40.168 CHECKS=2048040 NODES=0	UNSAT TT=17.532	UNSAT TT=72.784 CHECKS=117297	UNSAT TT=42.846 CHECKS=117297	UNSAT TT=87.982 ASSIGNMENTS=0	UNSAT TT=94.417 ASSIGNMENTS=0	? TT=768.348	? (TO) TT=920.09	? (TO) TT=946.14	UNSAT TT=293.2 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=319.38 ASSIGNMENTS=0 CHECKS=38032	? (problem) TT=0.603	? (problem) TT=0.444	UNSAT TT=323.441 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=315.465 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=304.592	UNSAT TT=323.136 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=311.213 ASSIGNMENTS=0 CHECKS=38032	? TT=0.929	? TT=788.517	? TT=820.753
csp/fapp/fapp29/ normalized-fapp29-2900-6.xml	SAT TT=21.955	SAT TT=50.606 CHECKS=6359000 NODES=2900	SAT TT=44.593 CHECKS=6358640 NODES=2900	SAT TT=21.955	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=132.748 ASSIGNMENTS=2827	SAT TT=132.813 ASSIGNMENTS=2827	? TT=754.325	? (TO) TT=951.79	? (TO) TT=992.92	SAT TT=498.622 ASSIGNMENTS=2900 CHECKS=6357900	SAT TT=521.161 ASSIGNMENTS=2900 CHECKS=6362330	? (problem) TT=0.445	? (problem) TT=0.614	SAT TT=452.93 ASSIGNMENTS=155 CHECKS=222572	SAT TT=449.827 ASSIGNMENTS=154 CHECKS=219120	Wrong UNSAT TT=285.232	SAT TT=425.697 ASSIGNMENTS=157 CHECKS=222872	SAT TT=446.85 ASSIGNMENTS=155 CHECKS=222444	? TT=0.922	? TT=837.81	? TT=807.714
csp/fapp/fapp30/ normalized-fapp30-3000-10.xml	SAT TT=91.177	SAT TT=91.177 CHECKS=104858000 NODES=3000	SAT TT=98.724 CHECKS=105023000 NODES=3000	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.28	? TT=987.488	? (TO) TT=1163.41	? (TO) TT=1238.81	SAT TT=1180.74 ASSIGNMENTS=3000 CHECKS=104798000	SAT TT=1091.79 ASSIGNMENTS=3000 CHECKS=104799000	? (problem) TT=0.572	? (problem) TT=0.593	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=0.776	? TT=910.013	? TT=843.061
csp/fapp/fapp30/ normalized-fapp30-3000-1.xml	UNSAT TT=18.269	UNSAT TT=40.692 CHECKS=47789 NODES=0	UNSAT TT=39.769 CHECKS=47789 NODES=0	UNSAT TT=18.269	? (TO) TT=1800.08	? (TO) TT=1800.15	UNSAT TT=177.905 ASSIGNMENTS=4363	UNSAT TT=191.342 ASSIGNMENTS=4363	? TT=877.318	? (TO) TT=1140.86	? (TO) TT=1138.28	UNSAT TT=1100.95 ASSIGNMENTS=0 CHECKS=47789	UNSAT TT=1113.73 ASSIGNMENTS=0 CHECKS=47789	? (problem) TT=0.453	? (problem) TT=0.56	UNSAT TT=1431.04 ASSIGNMENTS=8780 CHECKS=747186	UNSAT TT=1692.08 ASSIGNMENTS=7497 CHECKS=823907	? (TO) TT=1800.07	? (TO) TT=1800.14	UNSAT TT=1120.55 ASSIGNMENTS=377 CHECKS=92375	? TT=0.832	? TT=818.266	? TT=869.335
csp/fapp/fapp30/ normalized-fapp30-3000-5.xml	UNSAT TT=17.117	UNSAT TT=41.005 CHECKS=48778 NODES=0	UNSAT TT=38.854 CHECKS=48778 NODES=0	UNSAT TT=17.117	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.17	? TT=976.085	? (TO) TT=1163.6	? (TO) TT=1174.72	UNSAT TT=1049.16 ASSIGNMENTS=0 CHECKS=48778	UNSAT TT=1010.52 ASSIGNMENTS=0 CHECKS=48778	? (problem) TT=0.419	? (problem) TT=0.422	UNSAT TT=1080.59 ASSIGNMENTS=3948 CHECKS=263741	UNSAT TT=1377.81 ASSIGNMENTS=3571 CHECKS=417217	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=1502.04 ASSIGNMENTS=16829 CHECKS=625821	? TT=0.808	? TT=818.379	? TT=827.101
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp31/ normalized-fapp31-0400-6.xml	SAT TT=114.448	SAT TT=114.448 CHECKS=229439000 NODES=579	SAT TT=127.651 CHECKS=230468000 NODES=579	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=161.351 ASSIGNMENTS=579 CHECKS=228646000	SAT TT=179.55 ASSIGNMENTS=579 CHECKS=229454000	? (problem) TT=0.58	? (problem) TT=0.613	? (TO) TT=1800.09	? (TO) TT=1800.04	Wrong UNSAT TT=4.134	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=0.797	SAT TT=617.477	SAT TT=409.6
csp/fapp/fapp31/ normalized-fapp31-0400-7.xml	SAT TT=152.754	SAT TT=156.682 CHECKS=302419000 NODES=575	SAT TT=152.754 CHECKS=302419000 NODES=575	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.18	SAT TT=904.917 CHECKS=2185220000 NODES=65763	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=192.196 ASSIGNMENTS=575 CHECKS=300834000	SAT TT=194.882 ASSIGNMENTS=575 CHECKS=301073000	? (problem) TT=0.624	? (problem) TT=0.577	? (TO) TT=1800.1	? (TO) TT=1800.06	Wrong UNSAT TT=4.479	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=0.805	SAT TT=579.433	SAT TT=398.674
csp/fapp/fapp31/ normalized-fapp31-0400-9.xml	SAT TT=144.181	SAT TT=144.181 CHECKS=306631000 NODES=568	SAT TT=152.23 CHECKS=307282000 NODES=568	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.19	SAT TT=1421.48 CHECKS=3851390000 NODES=70800	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=204.111 ASSIGNMENTS=568 CHECKS=306239000	SAT TT=207.736 ASSIGNMENTS=568 CHECKS=306633000	? (problem) TT=0.445	? (problem) TT=0.44	? (TO) TT=1800.07	? (TO) TT=1800.11	Wrong UNSAT TT=4.162	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=0.828	SAT TT=741.89	SAT TT=381.123
csp/fapp/fapp32/ normalized-fapp32-0550-1.xml	UNSAT TT=26.171	UNSAT TT=26.171 CHECKS=1919080 NODES=0	UNSAT TT=26.53 CHECKS=1919080 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=1195.83 ASSIGNMENTS=1390	UNSAT TT=1217.44 ASSIGNMENTS=1390	UNSAT TT=142.982 CHECKS=3078800 NODES=0	UNSAT TT=375.427 CHECKS=2556630 NODES=0	UNSAT TT=363.848 CHECKS=3513850 NODES=0	UNSAT TT=265.908 ASSIGNMENTS=0 CHECKS=1919080	UNSAT TT=255.441 ASSIGNMENTS=0 CHECKS=1919080	? (problem) TT=0.573	? (problem) TT=0.448	? (TO) TT=1800.08	UNSAT TT=1730 ASSIGNMENTS=5424 CHECKS=2205760	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=0.824	? (MO) TT=562.416	? (MO) TT=692.399
csp/fapp/fapp32/ normalized-fapp32-0550-5.xml	UNSAT TT=26.545	? (MO) TT=23.035	UNSAT TT=26.545 CHECKS=1883380 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.25	? (TO) TT=1800.19	UNSAT TT=144.292 CHECKS=4251520 NODES=0	UNSAT TT=363.068 CHECKS=4236640 NODES=0	UNSAT TT=354.252 CHECKS=3600670 NODES=0	UNSAT TT=242.32 ASSIGNMENTS=0 CHECKS=1883380	UNSAT TT=258.359 ASSIGNMENTS=0 CHECKS=1883380	? (problem) TT=0.439	? (problem) TT=0.579	? (TO) TT=1800.08	UNSAT TT=1289.1 ASSIGNMENTS=4527 CHECKS=1489190	? (TO) TT=1800.03	? (TO) TT=1800.12	UNSAT TT=1036.62 ASSIGNMENTS=2140 CHECKS=1134710	? TT=0.793	? (MO) TT=531.079	? (MO) TT=690.526
csp/fapp/fapp32/ normalized-fapp32-0550-8.xml	SAT TT=35.15	SAT TT=36.019 CHECKS=12106500 NODES=551	SAT TT=35.15 CHECKS=12112700 NODES=551	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.21	SAT TT=151.439 CHECKS=17679100 NODES=554	SAT TT=457.722 CHECKS=152098000 NODES=150918	SAT TT=388.623 CHECKS=22713700 NODES=668	SAT TT=277.661 ASSIGNMENTS=551 CHECKS=12112700	SAT TT=268.753 ASSIGNMENTS=551 CHECKS=12114300	? (problem) TT=0.445	? (problem) TT=0.436	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=1514.18 ASSIGNMENTS=2362 CHECKS=5683680	? TT=0.783	? (MO) TT=527.318	? (MO) TT=694.381
csp/fapp/fapp33/ normalized-fapp33-0650-10.xml	SAT TT=29.653	SAT TT=30.027 CHECKS=6981000 NODES=654	SAT TT=29.653 CHECKS=6981430 NODES=654	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=70.342 ASSIGNMENTS=654 CHECKS=6946900	SAT TT=71.3 ASSIGNMENTS=654 CHECKS=6946900	? (problem) TT=0.592	? (problem) TT=0.609	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? TT=550.293	? (MO) TT=200.797	? (MO) TT=357.3
csp/fapp/fapp33/ normalized-fapp33-0650-1.xml	UNSAT TT=24.591	UNSAT TT=24.591 CHECKS=220301 NODES=0	UNSAT TT=24.872 CHECKS=220301 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.03	UNSAT TT=34.845 ASSIGNMENTS=5	UNSAT TT=35.138 ASSIGNMENTS=5	UNSAT TT=136.03 CHECKS=8149610 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=69.722 ASSIGNMENTS=0 CHECKS=213883	UNSAT TT=68.755 ASSIGNMENTS=0 CHECKS=220301	? (problem) TT=0.418	? (problem) TT=0.451	UNSAT TT=45.868 ASSIGNMENTS=18 CHECKS=26979	UNSAT TT=608.018 ASSIGNMENTS=3194 CHECKS=1274760	? (TO) TT=1800.06	UNSAT TT=1084.05 ASSIGNMENTS=3983 CHECKS=1627930	UNSAT TT=44.133 ASSIGNMENTS=16 CHECKS=20734	? TT=460.955	? (MO) TT=200.734	? (MO) TT=383.63
csp/fapp/fapp33/ normalized-fapp33-0650-3.xml	UNSAT TT=24.612	UNSAT TT=24.612 CHECKS=248366 NODES=0	UNSAT TT=24.813 CHECKS=248366 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=37.213 ASSIGNMENTS=7	UNSAT TT=38.212 ASSIGNMENTS=7	UNSAT TT=133.771 CHECKS=387255 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=67.906 ASSIGNMENTS=0 CHECKS=241982	UNSAT TT=69.713 ASSIGNMENTS=0 CHECKS=241982	? (problem) TT=0.451	? (problem) TT=0.444	UNSAT TT=45.508 ASSIGNMENTS=15 CHECKS=22813	UNSAT TT=617.786 ASSIGNMENTS=3388 CHECKS=1405470	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=49.646 ASSIGNMENTS=19 CHECKS=26436	? TT=491.717	? (MO) TT=202.436	? (MO) TT=366.05
csp/fapp/fapp34/ normalized-fapp34-0750-0.xml	UNSAT TT=25.167	UNSAT TT=25.25 CHECKS=1302480 NODES=0	UNSAT TT=25.167 CHECKS=1302480 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.24	? (TO) TT=1800.18	UNSAT TT=134.837 CHECKS=3003690 NODES=0	UNSAT TT=279.219 CHECKS=6352610 NODES=0	UNSAT TT=264.31 CHECKS=7989820 NODES=0	UNSAT TT=80.426 ASSIGNMENTS=0 CHECKS=1302730	UNSAT TT=80.94 ASSIGNMENTS=0 CHECKS=1302730	? (problem) TT=0.411	? (problem) TT=0.417	? (TO) TT=1800.12	UNSAT TT=1564.58 ASSIGNMENTS=8694 CHECKS=2552100	UNSAT TT=348.781	? (TO) TT=1800.07	UNSAT TT=667.905 ASSIGNMENTS=3105 CHECKS=793840	? TT=0.882	? (MO) TT=241.225	? (MO) TT=440.5
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp34/ normalized-fapp34-0750-4.xml	SAT TT=28.645	SAT TT=28.645 CHECKS=6429710 NODES=750	SAT TT=28.742 CHECKS=6438840 NODES=750	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.17	SAT TT=165.003 CHECKS=29706100 NODES=3962	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=87.985 ASSIGNMENTS=750 CHECKS=6428720	SAT TT=85.857 ASSIGNMENTS=750 CHECKS=6436050	? (problem) TT=0.602	? (problem) TT=0.615	? (TO) TT=1800.05	? (TO) TT=1800.08	Wrong UNSAT TT=260.887	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=0.889	? (MO) TT=221.313	? (MO) TT=401.417
csp/fapp/fapp34/ normalized-fapp34-0750-9.xml	SAT TT=29.225	SAT TT=29.225 CHECKS=8902030 NODES=750	SAT TT=29.551 CHECKS=8895260 NODES=750	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.23	SAT TT=186.057 CHECKS=32468800 NODES=6256	? (TO) TT=1800.1	SAT TT=278.749 CHECKS=43815600 NODES=1687	SAT TT=85.078 ASSIGNMENTS=750 CHECKS=8889800	SAT TT=85.356 ASSIGNMENTS=750 CHECKS=8889800	? (problem) TT=0.446	? (problem) TT=0.438	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=0.964	? (MO) TT=239.79	? (MO) TT=456.4
csp/fapp/fapp35/ normalized-fapp35-1500-3.xml	UNSAT TT=30.412	UNSAT TT=30.412 CHECKS=2478420 NODES=0	UNSAT TT=30.712 CHECKS=2478420 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.22	UNSAT TT=203.113 CHECKS=1200720 NODES=0	UNSAT TT=412.047 CHECKS=1186700 NODES=0	UNSAT TT=391.828 CHECKS=1161650 NODES=0	UNSAT TT=259.656 ASSIGNMENTS=0 CHECKS=2478420	UNSAT TT=255.162 ASSIGNMENTS=0 CHECKS=2478420	? (problem) TT=0.608	? (problem) TT=0.459	UNSAT TT=343.365 ASSIGNMENTS=229 CHECKS=87697	UNSAT TT=677.568 ASSIGNMENTS=616 CHECKS=421825	UNSAT TT=21.632	? (TO) TT=1800.03	UNSAT TT=302.701 ASSIGNMENTS=195 CHECKS=66144	? TT=0.805	? TT=735.109	? TT=733.884
csp/fapp/fapp35/ normalized-fapp35-1500-4.xml	UNSAT TT=31.037	UNSAT TT=31.037 CHECKS=2524260 NODES=0	UNSAT TT=31.715 CHECKS=2524260 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=211.536 CHECKS=1316600 NODES=0	UNSAT TT=413.796 CHECKS=1304870 NODES=0	UNSAT TT=399.291 CHECKS=1304870 NODES=0	UNSAT TT=264.383 ASSIGNMENTS=0 CHECKS=2524260	UNSAT TT=266.303 ASSIGNMENTS=0 CHECKS=2524260	? (problem) TT=0.451	? (problem) TT=0.584	UNSAT TT=347.358 ASSIGNMENTS=240 CHECKS=88267	UNSAT TT=681.319 ASSIGNMENTS=661 CHECKS=428201	UNSAT TT=25.526	? (TO) TT=1800.07	UNSAT TT=287.93 ASSIGNMENTS=191 CHECKS=64053	? TT=0.802	? TT=784.025	? TT=730.874
csp/fapp/fapp35/ normalized-fapp35-1500-9.xml	SAT TT=57.031	SAT TT=57.031 CHECKS=24395000 NODES=1501	SAT TT=60.335 CHECKS=24392600 NODES=1501	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=231.84 CHECKS=33922200 NODES=1876	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=286.862 ASSIGNMENTS=1501 CHECKS=24395300	SAT TT=273.515 ASSIGNMENTS=1501 CHECKS=24395000	? (problem) TT=0.446	? (problem) TT=0.615	? (TO) TT=1800.11	? (TO) TT=1800.05	Wrong UNSAT TT=21.426	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=0.794	? TT=764.841	? TT=684.25
csp/fapp/fapp36/ normalized-fapp36-2000-10.xml	SAT TT=37.094	SAT TT=37.564 CHECKS=17354000 NODES=2000	SAT TT=37.094 CHECKS=17360800 NODES=2000	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=120.927 ASSIGNMENTS=2000 CHECKS=17345800	SAT TT=124.545 ASSIGNMENTS=2000 CHECKS=17345300	? (problem) TT=0.418	? (problem) TT=0.425	? (TO) TT=1800.05	? (TO) TT=1800.03	Wrong UNSAT TT=19.576	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=375.224	? TT=614.382	? TT=585.416
csp/fapp/fapp36/ normalized-fapp36-2000-3.xml	UNSAT TT=28.107	UNSAT TT=28.447 CHECKS=207354 NODES=0	UNSAT TT=28.107 CHECKS=207354 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=37.464 ASSIGNMENTS=5	UNSAT TT=36.65 ASSIGNMENTS=5	UNSAT TT=174.756 CHECKS=4089450 NODES=0	UNSAT TT=291.136 CHECKS=17144300 NODES=0	? (TO) TT=1800.06	UNSAT TT=108.585 ASSIGNMENTS=0 CHECKS=207354	UNSAT TT=119.976 ASSIGNMENTS=0 CHECKS=207354	? (problem) TT=0.435	? (problem) TT=0.496	UNSAT TT=89.366 ASSIGNMENTS=17 CHECKS=30812	UNSAT TT=630.425 ASSIGNMENTS=3383 CHECKS=928660	UNSAT TT=19.133	? (TO) TT=1800.1	UNSAT TT=94.624 ASSIGNMENTS=32 CHECKS=37244	? TT=956.804	? TT=585.986	? TT=573.289
csp/fapp/fapp36/ normalized-fapp36-2000-6.xml	UNSAT TT=27.624	UNSAT TT=27.624 CHECKS=238659 NODES=0	UNSAT TT=28.216 CHECKS=238659 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.33	? (TO) TT=1800.24	UNSAT TT=174.048 CHECKS=562760 NODES=0	UNSAT TT=328.866 CHECKS=22787100 NODES=0	? (TO) TT=1800.02	UNSAT TT=117.808 ASSIGNMENTS=0 CHECKS=238659	UNSAT TT=112.278 ASSIGNMENTS=0 CHECKS=238659	? (problem) TT=0.46	? (problem) TT=0.608	UNSAT TT=443.232 ASSIGNMENTS=2958 CHECKS=577185	UNSAT TT=844.615 ASSIGNMENTS=6423 CHECKS=1531920	UNSAT TT=18.756	? (TO) TT=1800.05	UNSAT TT=300.343 ASSIGNMENTS=1979 CHECKS=333547	? TT=663.424	? TT=588.021	? TT=564.982
csp/fapp/fapp37/ normalized-fapp37-2250-1.xml	UNSAT TT=41.15	UNSAT TT=41.15 CHECKS=786436 NODES=0	UNSAT TT=41.313 CHECKS=786436 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.14	? (problem) TT=112.465	? (problem) TT=113.737	? TT=367.849	? (TO) TT=627.61	? (TO) TT=633.44	UNSAT TT=757.197 ASSIGNMENTS=0 CHECKS=786436	UNSAT TT=812.561 ASSIGNMENTS=0 CHECKS=786436	? (problem) TT=0.582	? (problem) TT=0.571	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=57.955	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=0.877	? TT=1149.87	? TT=1032.15
csp/fapp/fapp37/ normalized-fapp37-2250-2.xml	UNSAT TT=40.887	UNSAT TT=40.887 CHECKS=2118760 NODES=0	UNSAT TT=42.066 CHECKS=2118760 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	? (problem) TT=106.672	? (problem) TT=112.78	? TT=354.792	? (TO) TT=623.6	? (TO) TT=623.68	UNSAT TT=810.812 ASSIGNMENTS=0 CHECKS=2118760	UNSAT TT=848.84 ASSIGNMENTS=0 CHECKS=2118760	? (problem) TT=0.612	? (problem) TT=0.452	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=69.247	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=0.893	? TT=1030.02	? TT=1008.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp37/ normalized-fapp37-2250-5.xml	SAT TT=55.601	SAT TT=56.291 CHECKS=25166200 NODES=2250	SAT TT=55.601 CHECKS=25166200 NODES=2250	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? (problem) TT=105.752	? (problem) TT=112.517	? TT=356.214	? (TO) TT=639.96	? (TO) TT=620.82	SAT TT=749.923 ASSIGNMENTS=2250 CHECKS=25166900	SAT TT=823.952 ASSIGNMENTS=2250 CHECKS=25166900	? (problem) TT=0.444	? (problem) TT=0.626	? (TO) TT=1800.11	? (TO) TT=1800.03	Wrong UNSAT TT=68.303	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=0.873	? TT=1078.06	? TT=1005.04
csp/fapp/fapp38/ normalized-fapp38-2500-3.xml	SAT TT=66.206	SAT TT=66.206 CHECKS=38549700 NODES=2501	SAT TT=71.951 CHECKS=38554200 NODES=2501	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (problem) TT=92.479	? (problem) TT=91.332	? TT=790.689	? (TO) TT=1065.71	? (TO) TT=1029.53	SAT TT=711.004 ASSIGNMENTS=2501 CHECKS=38540000	SAT TT=753.005 ASSIGNMENTS=2501 CHECKS=38541700	? (problem) TT=0.572	? (problem) TT=0.624	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=0.82	? TT=658.63	? TT=747.462
csp/fapp/fapp38/ normalized-fapp38-2500-6.xml	SAT TT=70.038	SAT TT=70.038 CHECKS=45327900 NODES=2505	? (MO) TT=34.824	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (problem) TT=86.399	? (problem) TT=89.067	? TT=797.293	? (TO) TT=1080.63	? (TO) TT=1046.45	SAT TT=709.557 ASSIGNMENTS=2505 CHECKS=45314300	SAT TT=694.741 ASSIGNMENTS=2505 CHECKS=45302200	? (problem) TT=0.585	? (problem) TT=0.602	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	? TT=0.794	? TT=701.589	? TT=717.556
csp/fapp/fapp38/ normalized-fapp38-2500-9.xml	SAT TT=75.16	SAT TT=78.65 CHECKS=60950000 NODES=4587	SAT TT=75.16 CHECKS=60940400 NODES=4587	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (problem) TT=85.237	? (problem) TT=89.252	? TT=878.564	? (TO) TT=1047.53	? (TO) TT=1051.27	SAT TT=671.41 ASSIGNMENTS=4587 CHECKS=60942100	SAT TT=679.306 ASSIGNMENTS=4587 CHECKS=60942100	? (problem) TT=0.448	? (problem) TT=0.624	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=0.768	? TT=715.233	? TT=672.465
csp/fapp/fapp39/ normalized-fapp39-2750-5.xml	SAT TT=1265	SAT TT=1355.76 CHECKS=2545130000 NODES=3810	SAT TT=1426.19 CHECKS=2544800000 NODES=3810	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.22	? (TO) TT=1800.19	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=1295.94 ASSIGNMENTS=3810 CHECKS=2540110000	SAT TT=1265 ASSIGNMENTS=3810 CHECKS=2540100000	? (problem) TT=0.428	? (problem) TT=0.421	? (TO) TT=1800.03	? (TO) TT=1800.09	Wrong UNSAT TT=25.894	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=0.776	? TT=664.648	? TT=647.761
csp/fapp/fapp39/ normalized-fapp39-2750-6.xml	SAT TT=1499.85	SAT TT=1661.98 CHECKS=3090810000 NODES=4101	SAT TT=1738.17 CHECKS=3090650000 NODES=4101	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.28	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=1499.85 ASSIGNMENTS=4101 CHECKS=3080200000	SAT TT=1579.99 ASSIGNMENTS=4101 CHECKS=3080430000	? (problem) TT=0.47	? (problem) TT=0.601	? (TO) TT=1800.09	? (TO) TT=1800.09	Wrong UNSAT TT=24.912	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.816	? TT=643.626	? TT=650.326
csp/fapp/fapp39/ normalized-fapp39-2750-9.xml		? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (problem) TT=0.552	? (problem) TT=0.45	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=24.914	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=0.803	? TT=622.692	? TT=646.443
csp/fapp/fapp40/ normalized-fapp40-3000-2.xml	UNSAT TT=43.006	UNSAT TT=44.349 CHECKS=4768650 NODES=0	UNSAT TT=43.006 CHECKS=4768650 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (problem) TT=83.419	? (problem) TT=77.724	? TT=664.799	? (TO) TT=843.74	? (TO) TT=844.28	UNSAT TT=692.994 ASSIGNMENTS=0 CHECKS=4768650	UNSAT TT=686.689 ASSIGNMENTS=0 CHECKS=4768650	? (problem) TT=0.458	? (problem) TT=0.451	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=56.632	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=0.812	? TT=650.389	? TT=655.208
csp/fapp/fapp40/ normalized-fapp40-3000-3.xml	UNSAT TT=44.642	UNSAT TT=44.642 CHECKS=4570620 NODES=0	UNSAT TT=44.88 CHECKS=4570620 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (problem) TT=89.69	? (problem) TT=84.367	? TT=572.058	? (TO) TT=866.23	? (TO) TT=854.51	UNSAT TT=645.201 ASSIGNMENTS=0 CHECKS=4570620	UNSAT TT=625.197 ASSIGNMENTS=0 CHECKS=4570620	? (problem) TT=0.422	? (problem) TT=0.422	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=60.008	? (TO) TT=1800.17	? (TO) TT=1800.12	? TT=0.815	? TT=640.526	? TT=611.91
csp/fapp/fapp40/ normalized-fapp40-3000-7.xml	SAT TT=72.287	SAT TT=78.214 CHECKS=61172000 NODES=3004	SAT TT=72.287 CHECKS=61181600 NODES=3004	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.05	? (problem) TT=83.158	? (problem) TT=76.663	? TT=587.281	? (TO) TT=887.26	? (TO) TT=825.86	SAT TT=651.993 ASSIGNMENTS=3004 CHECKS=61192800	SAT TT=684.029 ASSIGNMENTS=3004 CHECKS=61181600	? (problem) TT=0.451	? (problem) TT=0.458	? (TO) TT=1800.12	? (TO) TT=1800.05	Wrong UNSAT TT=56.881	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=0.839	? TT=694.72	? TT=612.659
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ hos/ normalized-abb313GPIA-10.xml	SAT TT=2.59	SAT TT=25.714 CHECKS=3719600 NODES=10698	SAT TT=31.269 CHECKS=3809820 NODES=9861	SAT TT=10.871	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.19	SAT TT=136.865 ASSIGNMENTS=1508	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=2.59 ASSIGNMENTS=1575 CHECKS=331753	SAT TT=2.752 ASSIGNMENTS=1575 CHECKS=331753	SAT TT=68.61	SAT TT=59.885	SAT TT=2.636 ASSIGNMENTS=1279 CHECKS=163978	SAT TT=6.002 ASSIGNMENTS=45060 CHECKS=4140570	SAT TT=24.594	SAT TT=4.22 ASSIGNMENTS=13694 CHECKS=1809400	SAT TT=2.811 ASSIGNMENTS=3634 CHECKS=876273	SAT TT=27.322	SAT TT=22.223	SAT TT=27.426
csp/graphColoring/ hos/ normalized-abb313GPIA-5.xml	UNSAT TT=2.494	UNSAT TT=20.153 CHECKS=20 NODES=0	UNSAT TT=20.854 CHECKS=20 NODES=0	UNSAT TT=11.089	UNSAT TT=58.284 CHECKS=56794500	UNSAT TT=67.999 CHECKS=64664100	UNSAT TT=30.083 ASSIGNMENTS=0	UNSAT TT=27.748 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=2.568 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=2.494 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=36.349	UNSAT TT=34.794	UNSAT TT=2.704 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=2.67 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=12.79	UNSAT TT=2.667 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=2.704 ASSIGNMENTS=0 CHECKS=131	UNSAT TT=12.359	UNSAT TT=13.946	UNSAT TT=19.494
csp/graphColoring/ hos/ normalized-abb313GPIA-9.xml	SAT TT=10.017	SAT TT=175.8 CHECKS=131529000 NODES=118319	SAT TT=87.897 CHECKS=50651400 NODES=50781	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=18.536 ASSIGNMENTS=24318 CHECKS=21062600	SAT TT=423.965 ASSIGNMENTS=281036 CHECKS=357749000	SAT TT=60.529	SAT TT=63.612	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=24.958 ASSIGNMENTS=43593 CHECKS=36664200	SAT TT=10.017 ASSIGNMENTS=24318 CHECKS=21062600	SAT TT=140.23	SAT TT=63.989	SAT TT=41.402
csp/graphColoring/ hos/ normalized-ash331GPIA-3.xml	UNSAT TT=0.168	UNSAT TT=1.886 CHECKS=23837 NODES=55	UNSAT TT=2.396 CHECKS=112493 NODES=55	UNSAT TT=0.704	UNSAT TT=0.351 CHECKS=195694	UNSAT TT=0.196 CHECKS=182727	UNSAT TT=2.621 ASSIGNMENTS=0	UNSAT TT=2.874 ASSIGNMENTS=0	UNSAT TT=6.212 CHECKS=25457 NODES=152	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.184 ASSIGNMENTS=11 CHECKS=6101	UNSAT TT=0.195 ASSIGNMENTS=11 CHECKS=6101	UNSAT TT=2.606	UNSAT TT=2.386	UNSAT TT=0.168 ASSIGNMENTS=11 CHECKS=7299	UNSAT TT=0.307 ASSIGNMENTS=5497 CHECKS=340507	UNSAT TT=1.277	UNSAT TT=0.226 ASSIGNMENTS=1047 CHECKS=44765	UNSAT TT=0.182 ASSIGNMENTS=11 CHECKS=6096	UNSAT TT=4.913	UNSAT TT=1.774	UNSAT TT=2.006
csp/graphColoring/ hos/ normalized-ash608GPIA-3.xml	UNSAT TT=0.351	UNSAT TT=3.071 CHECKS=19241 NODES=79	UNSAT TT=3.432 CHECKS=165182 NODES=61	UNSAT TT=1.402	UNSAT TT=0.74 CHECKS=366537	UNSAT TT=0.423 CHECKS=357806	UNSAT TT=4.149 ASSIGNMENTS=0	UNSAT TT=4.408 ASSIGNMENTS=0	UNSAT TT=18.02 CHECKS=3894 NODES=39	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.363 ASSIGNMENTS=16 CHECKS=10188	UNSAT TT=0.379 ASSIGNMENTS=16 CHECKS=10188	UNSAT TT=4.872	UNSAT TT=4.258	UNSAT TT=0.366 ASSIGNMENTS=23 CHECKS=13269	UNSAT TT=0.573 ASSIGNMENTS=7132 CHECKS=412913	UNSAT TT=2.056	UNSAT TT=0.476 ASSIGNMENTS=1790 CHECKS=86445	UNSAT TT=0.351 ASSIGNMENTS=13 CHECKS=9814	UNSAT TT=6.12	UNSAT TT=2.743	UNSAT TT=2.862
csp/graphColoring/ hos/ normalized-ash608GPIA-4.xml	SAT TT=0.376	SAT TT=3.889 CHECKS=86128 NODES=2026	SAT TT=4.374 CHECKS=165943 NODES=2539	SAT TT=1.513	SAT TT=14.787 CHECKS=6234660	SAT TT=31.851 CHECKS=11470200	SAT TT=4.741 ASSIGNMENTS=587	SAT TT=4.17 ASSIGNMENTS=587	SAT TT=19 CHECKS=35340 NODES=1817	SAT TT=23.143 CHECKS=8627770 NODES=151282	SAT TT=18.218 CHECKS=5191100 NODES=1021	SAT TT=0.399 ASSIGNMENTS=643 CHECKS=26934	SAT TT=0.393 ASSIGNMENTS=643 CHECKS=26934	SAT TT=7.271	SAT TT=7.807	SAT TT=0.392 ASSIGNMENTS=815 CHECKS=42341	SAT TT=0.773 ASSIGNMENTS=25001 CHECKS=846190	SAT TT=2.588	SAT TT=0.572 ASSIGNMENTS=3930 CHECKS=84551	SAT TT=0.376 ASSIGNMENTS=516 CHECKS=18434	SAT TT=6.079	SAT TT=3.105	SAT TT=3.275
csp/graphColoring/ hos/ normalized-ash958GPIA-3.xml	UNSAT TT=0.626	UNSAT TT=4.202 CHECKS=33075 NODES=83	UNSAT TT=5.528 CHECKS=271921 NODES=81	UNSAT TT=2.873	UNSAT TT=1.234 CHECKS=553776	UNSAT TT=0.649 CHECKS=550158	UNSAT TT=6.536 ASSIGNMENTS=0	UNSAT TT=6.556 ASSIGNMENTS=0	UNSAT TT=48.619 CHECKS=3639 NODES=39	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.655 ASSIGNMENTS=12 CHECKS=14563	UNSAT TT=0.643 ASSIGNMENTS=12 CHECKS=14563	UNSAT TT=7.421	UNSAT TT=7.322	UNSAT TT=0.634 ASSIGNMENTS=14 CHECKS=17227	UNSAT TT=0.961 ASSIGNMENTS=8696 CHECKS=448022	UNSAT TT=2.845	UNSAT TT=0.864 ASSIGNMENTS=2831 CHECKS=132361	UNSAT TT=0.626 ASSIGNMENTS=11 CHECKS=14581	UNSAT TT=6.034	UNSAT TT=3.614	UNSAT TT=4.069
csp/graphColoring/ hos/ normalized-ash958GPIA-4.xml	SAT TT=0.627	SAT TT=5.186 CHECKS=102365 NODES=2610	SAT TT=6.432 CHECKS=254765 NODES=4400	? (TO) TT=1800.06	SAT TT=37.361 CHECKS=27292400	SAT TT=63.878 CHECKS=46472800	SAT TT=6.372 ASSIGNMENTS=912	SAT TT=6.647 ASSIGNMENTS=912	SAT TT=58.957 CHECKS=87107 NODES=4737	? (TO) TT=1800.03	SAT TT=51.293 CHECKS=12322300 NODES=1486	SAT TT=0.702 ASSIGNMENTS=847 CHECKS=28923	SAT TT=0.69 ASSIGNMENTS=847 CHECKS=28923	SAT TT=13.111	SAT TT=13.71	SAT TT=0.627 ASSIGNMENTS=844 CHECKS=28921	SAT TT=1.381 ASSIGNMENTS=33488 CHECKS=1018380	SAT TT=3.204	SAT TT=1.244 ASSIGNMENTS=6202 CHECKS=151569	SAT TT=0.696 ASSIGNMENTS=1173 CHECKS=50276	SAT TT=6.805	SAT TT=4.206	SAT TT=4.249
csp/graphColoring/ hos/ normalized-will199GPIA-6.xml	UNSAT TT=0.759	UNSAT TT=4.044 CHECKS=1956360 NODES=2165	UNSAT TT=3.956 CHECKS=1986750 NODES=2194	UNSAT TT=1.074	UNSAT TT=340.343 CHECKS=1333920000	UNSAT TT=236.395 CHECKS=951878000	UNSAT TT=41.737 ASSIGNMENTS=4286	UNSAT TT=890.97 ASSIGNMENTS=126781	UNSAT TT=22.412 CHECKS=167965 NODES=2642	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=0.935 ASSIGNMENTS=2051 CHECKS=868277	UNSAT TT=0.889 ASSIGNMENTS=2051 CHECKS=868277	UNSAT TT=4.429	UNSAT TT=4.574	UNSAT TT=0.766 ASSIGNMENTS=1929 CHECKS=790256	UNSAT TT=2.158 ASSIGNMENTS=18133 CHECKS=2532790	UNSAT TT=2.119	UNSAT TT=1.535 ASSIGNMENTS=5588 CHECKS=906046	UNSAT TT=0.759 ASSIGNMENTS=1705 CHECKS=685214	UNSAT TT=7.462	UNSAT TT=2.486	UNSAT TT=3.35
csp/graphColoring/ hos/ normalized-will199GPIA-7.xml	SAT TT=0.312	SAT TT=2.974 CHECKS=40402 NODES=701	SAT TT=2.672 CHECKS=40625 NODES=0	SAT TT=1.118	SAT TT=2.574 CHECKS=487215	SAT TT=2.989 CHECKS=588728	SAT TT=12.674 ASSIGNMENTS=984	SAT TT=14.375 ASSIGNMENTS=976	SAT TT=22.206 CHECKS=126263 NODES=4895	SAT TT=13.838 CHECKS=340498 NODES=780	SAT TT=13.45 CHECKS=2725440 NODES=522	SAT TT=0.321 ASSIGNMENTS=683 CHECKS=14345	SAT TT=0.322 ASSIGNMENTS=683 CHECKS=14345	SAT TT=7.02	SAT TT=6.417	SAT TT=0.312 ASSIGNMENTS=684 CHECKS=14345	SAT TT=0.639 ASSIGNMENTS=33788 CHECKS=713417	SAT TT=1.957	SAT TT=0.514 ASSIGNMENTS=5269 CHECKS=108421	SAT TT=0.312 ASSIGNMENTS=713 CHECKS=15018	SAT TT=6.026	SAT TT=2.873	SAT TT=3.781
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-3-3.xml	UNSAT TT=0.007	UNSAT TT=0.745 CHECKS=833 NODES=16	UNSAT TT=0.763 CHECKS=1268 NODES=0	UNSAT TT=0.035	UNSAT TT=0.016 CHECKS=1110	UNSAT TT=0.011 CHECKS=1147	UNSAT TT=0.589 ASSIGNMENTS=0	UNSAT TT=0.587 ASSIGNMENTS=0	UNSAT TT=0.776 CHECKS=1317 NODES=35	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.022 ASSIGNMENTS=13 CHECKS=643	UNSAT TT=0.02 ASSIGNMENTS=13 CHECKS=643	UNSAT TT=0.828	UNSAT TT=0.643	UNSAT TT=0.007 ASSIGNMENTS=21 CHECKS=869	UNSAT TT=0.012 ASSIGNMENTS=138 CHECKS=4665	UNSAT TT=0.342	UNSAT TT=0.008 ASSIGNMENTS=85 CHECKS=1677	UNSAT TT=0.01 ASSIGNMENTS=13 CHECKS=589	UNSAT TT=1.07	UNSAT TT=0.647	UNSAT TT=0.616
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-4-4.xml	UNSAT TT=0.04	UNSAT TT=1.316 CHECKS=120965 NODES=633	UNSAT TT=1.371 CHECKS=116994 NODES=592	? (TO) TT=1800.05	UNSAT TT=23.019 CHECKS=92881000	UNSAT TT=32.259 CHECKS=137883000	UNSAT TT=2.069 ASSIGNMENTS=5230	UNSAT TT=2.066 ASSIGNMENTS=5230	UNSAT TT=1.297 CHECKS=22568 NODES=288	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=576 CHECKS=61201	UNSAT TT=0.06 ASSIGNMENTS=576 CHECKS=61201	UNSAT TT=1.249	UNSAT TT=1.158	UNSAT TT=0.051 ASSIGNMENTS=708 CHECKS=73647	UNSAT TT=0.161 ASSIGNMENTS=6348 CHECKS=377846	UNSAT TT=0.645	UNSAT TT=0.047 ASSIGNMENTS=663 CHECKS=46423	UNSAT TT=0.04 ASSIGNMENTS=408 CHECKS=41512	UNSAT TT=2.507	UNSAT TT=1.127	UNSAT TT=1.267
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-4-5.xml	SAT TT=0.026	SAT TT=1.03 CHECKS=2507 NODES=93	SAT TT=1.083 CHECKS=2888 NODES=0	SAT TT=0.097	SAT TT=0.056 CHECKS=25112	SAT TT=0.032 CHECKS=24990	SAT TT=1.354 ASSIGNMENTS=85	SAT TT=1.222 ASSIGNMENTS=85	SAT TT=1.22 CHECKS=2304 NODES=93	SAT TT=1.234 CHECKS=17191 NODES=55	SAT TT=1.131 CHECKS=39673 NODES=50	SAT TT=0.04 ASSIGNMENTS=89 CHECKS=1186	SAT TT=0.038 ASSIGNMENTS=89 CHECKS=1186	SAT TT=1.818	SAT TT=1.653	SAT TT=0.026 ASSIGNMENTS=89 CHECKS=1186	SAT TT=0.03 ASSIGNMENTS=289 CHECKS=5983	SAT TT=0.683	SAT TT=0.028 ASSIGNMENTS=425 CHECKS=5837	SAT TT=0.027 ASSIGNMENTS=89 CHECKS=1186	SAT TT=2.073	SAT TT=1.313	SAT TT=1.287
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-5-4.xml	UNSAT TT=0.216	UNSAT TT=2.747 CHECKS=637358 NODES=905	UNSAT TT=2.748 CHECKS=636092 NODES=855	UNSAT TT=1791.97	UNSAT TT=24.376 CHECKS=73561400	UNSAT TT=35.185 CHECKS=101037000	UNSAT TT=7.8 ASSIGNMENTS=13367	UNSAT TT=8.265 ASSIGNMENTS=13367	UNSAT TT=4.175 CHECKS=81811 NODES=374	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.244 ASSIGNMENTS=698 CHECKS=303026	UNSAT TT=0.22 ASSIGNMENTS=698 CHECKS=303026	UNSAT TT=2.432	UNSAT TT=2.217	UNSAT TT=0.249 ASSIGNMENTS=831 CHECKS=390146	UNSAT TT=0.738 ASSIGNMENTS=8514 CHECKS=1846020	UNSAT TT=1.401	UNSAT TT=0.216 ASSIGNMENTS=1280 CHECKS=171305	UNSAT TT=0.216 ASSIGNMENTS=534 CHECKS=255367	UNSAT TT=4.695	UNSAT TT=2.048	UNSAT TT=2.412
csp/graphColoring/insertion/ full-insertion/ normalized-1-fullins-5-5.xml	UNSAT TT=6.824	UNSAT TT=50.374 CHECKS=68552800 NODES=101774	UNSAT TT=49.262 CHECKS=67665600 NODES=97543	? (TO) TT=1800.12	UNSAT TT=109.699 CHECKS=560659000	UNSAT TT=170.522 CHECKS=846559000	? (TO) TT=1800.07	? (TO) TT=1800.12	UNSAT TT=99.27 CHECKS=10204700 NODES=58405	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=15.732 ASSIGNMENTS=82916 CHECKS=26386700	UNSAT TT=125.776 ASSIGNMENTS=288001 CHECKS=193361000	UNSAT TT=6.223	UNSAT TT=83.274	UNSAT TT=10.079 ASSIGNMENTS=88990 CHECKS=29536200	UNSAT TT=8.186 ASSIGNMENTS=91597 CHECKS=25891800	UNSAT TT=8.008	UNSAT TT=20.177 ASSIGNMENTS=150361 CHECKS=48389500	UNSAT TT=9.216 ASSIGNMENTS=82916 CHECKS=26386700	UNSAT TT=44.507	UNSAT TT=6.824	UNSAT TT=11.715
csp/graphColoring/insertion/ full-insertion/ normalized-2-fullins-3-4.xml	UNSAT TT=0.014	UNSAT TT=0.86 CHECKS=11365 NODES=142	UNSAT TT=0.872 CHECKS=12245 NODES=103	UNSAT TT=0.05	UNSAT TT=3.434 CHECKS=10505200	UNSAT TT=5.035 CHECKS=15135900	UNSAT TT=0.785 ASSIGNMENTS=0	UNSAT TT=0.737 ASSIGNMENTS=0	UNSAT TT=0.802 CHECKS=2970 NODES=85	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.025 ASSIGNMENTS=94 CHECKS=3392	UNSAT TT=0.023 ASSIGNMENTS=94 CHECKS=3392	UNSAT TT=0.801	UNSAT TT=0.822	UNSAT TT=0.014 ASSIGNMENTS=85 CHECKS=3182	UNSAT TT=0.05 ASSIGNMENTS=4980 CHECKS=83092	UNSAT TT=0.437	UNSAT TT=0.014 ASSIGNMENTS=243 CHECKS=3343	UNSAT TT=0.015 ASSIGNMENTS=80 CHECKS=2673	UNSAT TT=1.528	UNSAT TT=0.77	UNSAT TT=0.809
csp/graphColoring/insertion/ full-insertion/ normalized-2-fullins-3-5.xml	SAT TT=0.012	SAT TT=0.815 CHECKS=1040 NODES=52	SAT TT=0.804 CHECKS=1108 NODES=0	SAT TT=0.048	SAT TT=0.023 CHECKS=6001	SAT TT=0.017 CHECKS=7174	SAT TT=0.824 ASSIGNMENTS=47	SAT TT=0.832 ASSIGNMENTS=45	SAT TT=0.834 CHECKS=997 NODES=60	SAT TT=0.834 CHECKS=5587 NODES=31	SAT TT=0.794 CHECKS=12237 NODES=39	SAT TT=0.024 ASSIGNMENTS=51 CHECKS=421	SAT TT=0.024 ASSIGNMENTS=51 CHECKS=421	SAT TT=1.446	SAT TT=1.351	SAT TT=0.014 ASSIGNMENTS=51 CHECKS=421	SAT TT=0.014 ASSIGNMENTS=114 CHECKS=1000	SAT TT=0.464	SAT TT=0.012 ASSIGNMENTS=173 CHECKS=1221	SAT TT=0.013 ASSIGNMENTS=51 CHECKS=422	SAT TT=1.54	SAT TT=0.779	SAT TT=0.814
csp/graphColoring/insertion/ full-insertion/ normalized-2-fullins-4-5.xml	UNSAT TT=0.2	UNSAT TT=2.439 CHECKS=1432930 NODES=4870	UNSAT TT=2.625 CHECKS=1401560 NODES=4849	UNSAT TT=1675.38	UNSAT TT=23.474 CHECKS=46417100	UNSAT TT=36.25 CHECKS=79762200	UNSAT TT=1.827 ASSIGNMENTS=0	UNSAT TT=1.701 ASSIGNMENTS=0	UNSAT TT=3.578 CHECKS=253936 NODES=2987	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=0.41 ASSIGNMENTS=6332 CHECKS=647669	UNSAT TT=0.38 ASSIGNMENTS=6332 CHECKS=647669	UNSAT TT=1.665	UNSAT TT=1.745	UNSAT TT=0.407 ASSIGNMENTS=6496 CHECKS=712633	UNSAT TT=0.357 ASSIGNMENTS=13926 CHECKS=678825	UNSAT TT=1.227	UNSAT TT=0.429 ASSIGNMENTS=5476 CHECKS=496036	UNSAT TT=0.2 ASSIGNMENTS=2843 CHECKS=293774	UNSAT TT=3.963	UNSAT TT=1.4	UNSAT TT=1.69
csp/graphColoring/insertion/ full-insertion/ normalized-3-fullins-4-6.xml	UNSAT TT=1.512	UNSAT TT=18.457 CHECKS=23804800 NODES=57810	UNSAT TT=17.731 CHECKS=22803600 NODES=52291	? (TO) TT=1800.08	UNSAT TT=47.194 CHECKS=142004000	UNSAT TT=79.496 CHECKS=268827000	UNSAT TT=2.467 ASSIGNMENTS=0	UNSAT TT=2.703 ASSIGNMENTS=0	UNSAT TT=32.908 CHECKS=2419870 NODES=22627	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=9.439 ASSIGNMENTS=20560 CHECKS=2792950	UNSAT TT=46.106 ASSIGNMENTS=143192 CHECKS=59155700	UNSAT TT=4.065	UNSAT TT=4.979	UNSAT TT=5.532 ASSIGNMENTS=81976 CHECKS=10659600	UNSAT TT=1.512 ASSIGNMENTS=39242 CHECKS=2873570	UNSAT TT=5.154	UNSAT TT=5.364 ASSIGNMENTS=29349 CHECKS=3659660	UNSAT TT=1.658 ASSIGNMENTS=20560 CHECKS=2792950	UNSAT TT=13.518	UNSAT TT=2.924	UNSAT TT=4.541
csp/graphColoring/insertion/ full-insertion/ normalized-4-fullins-4-7.xml	UNSAT TT=3.805	UNSAT TT=265.184 CHECKS=381224000 NODES=673036	UNSAT TT=271.061 CHECKS=359940000 NODES=689260	? (TO) TT=1800.08	UNSAT TT=381.117 CHECKS=1634120000	UNSAT TT=108.711 CHECKS=487468000	UNSAT TT=3.805 ASSIGNMENTS=0	UNSAT TT=4.37 ASSIGNMENTS=0	UNSAT TT=946.645 CHECKS=38503000 NODES=315133	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=33.018 ASSIGNMENTS=238621 CHECKS=40566800	UNSAT TT=626.875 ASSIGNMENTS=1765370 CHECKS=949945000	UNSAT TT=39.539	UNSAT TT=129.559	UNSAT TT=76.564 ASSIGNMENTS=815476 CHECKS=125775000	UNSAT TT=16.575 ASSIGNMENTS=203362 CHECKS=27257600	UNSAT TT=46.306	UNSAT TT=67.578 ASSIGNMENTS=377943 CHECKS=52401600	UNSAT TT=24.974 ASSIGNMENTS=238621 CHECKS=40566800	UNSAT TT=254.554	UNSAT TT=13.969	UNSAT TT=13.908
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/insertion/ full-insertion/ normalized-4-fullins-5-6.xml	UNSAT TT=5.557	UNSAT TT=124.83 CHECKS=54092900 NODES=13286	UNSAT TT=139.001 CHECKS=46355600 NODES=11129	UNSAT TT=27.117	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=36.623 ASSIGNMENTS=0	UNSAT TT=37.152 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=140.339 ASSIGNMENTS=16723 CHECKS=77108300	UNSAT TT=141.5 ASSIGNMENTS=16723 CHECKS=77108300	UNSAT TT=82.186	UNSAT TT=72.036	UNSAT TT=14.866 ASSIGNMENTS=9625 CHECKS=6792920	UNSAT TT=21.256 ASSIGNMENTS=71836 CHECKS=11812700	UNSAT TT=18.597	UNSAT TT=59.843 ASSIGNMENTS=56528 CHECKS=23803100	UNSAT TT=5.557 ASSIGNMENTS=3376 CHECKS=2320690	UNSAT TT=20.321	UNSAT TT=16.369	UNSAT TT=24.646
csp/graphColoring/insertion/ full-insertion/ normalized-5-fullins-3-6.xml	UNSAT TT=0.034	UNSAT TT=1.07 CHECKS=24 NODES=0	UNSAT TT=1.06 CHECKS=24 NODES=0	UNSAT TT=0.131	UNSAT TT=0.117 CHECKS=203031	UNSAT TT=0.087 CHECKS=204281	UNSAT TT=1.209 ASSIGNMENTS=0	UNSAT TT=1.15 ASSIGNMENTS=0	UNSAT TT=1.817 CHECKS=26653 NODES=856	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.309	UNSAT TT=1.355	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.729	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.767	UNSAT TT=1.194	UNSAT TT=1.279
csp/graphColoring/insertion/ full-insertion/ normalized-5-fullins-4-8.xml	UNSAT TT=5.788	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	UNSAT TT=5.788 ASSIGNMENTS=0	UNSAT TT=6.777 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=293.366 ASSIGNMENTS=1991740 CHECKS=444586000	UNSAT TT=1040.29 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=498.749 ASSIGNMENTS=3694330 CHECKS=777646000	UNSAT TT=224.536 ASSIGNMENTS=1639780 CHECKS=313210000	UNSAT TT=792.3	UNSAT TT=836.233 ASSIGNMENTS=2870200 CHECKS=571275000	UNSAT TT=293.091 ASSIGNMENTS=1991740 CHECKS=444586000	? (TO) TT=1800.09	UNSAT TT=119.27	UNSAT TT=101.963
csp/graphColoring/insertion/ k-insertion/ normalized-1-insertions-4-3.xml	UNSAT TT=0.019	UNSAT TT=1.007 CHECKS=16660 NODES=185	UNSAT TT=0.936 CHECKS=16999 NODES=152	UNSAT TT=0.057	UNSAT TT=0.041 CHECKS=64110	UNSAT TT=0.028 CHECKS=66031	UNSAT TT=0.937 ASSIGNMENTS=43	UNSAT TT=0.973 ASSIGNMENTS=43	UNSAT TT=0.915 CHECKS=21151 NODES=464	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=0.031 ASSIGNMENTS=189 CHECKS=14993	UNSAT TT=0.029 ASSIGNMENTS=189 CHECKS=14993	UNSAT TT=1.045	UNSAT TT=0.863	UNSAT TT=0.019 ASSIGNMENTS=162 CHECKS=11959	UNSAT TT=0.118 ASSIGNMENTS=3908 CHECKS=276704	UNSAT TT=0.481	UNSAT TT=0.022 ASSIGNMENTS=366 CHECKS=23758	UNSAT TT=0.021 ASSIGNMENTS=191 CHECKS=15173	UNSAT TT=1.627	UNSAT TT=0.884	UNSAT TT=0.834
csp/graphColoring/insertion/ k-insertion/ normalized-1-insertions-6-6.xml		? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.01
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-3-3.xml	UNSAT TT=0.062	UNSAT TT=1.063 CHECKS=153378 NODES=3478	UNSAT TT=1.093 CHECKS=141439 NODES=3400	UNSAT TT=0.09	UNSAT TT=0.113 CHECKS=390216	UNSAT TT=0.107 CHECKS=390321	UNSAT TT=1.079 ASSIGNMENTS=6116	UNSAT TT=1.152 ASSIGNMENTS=6116	UNSAT TT=1.171 CHECKS=233902 NODES=16015	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.104 ASSIGNMENTS=9381 CHECKS=172090	UNSAT TT=0.103 ASSIGNMENTS=9381 CHECKS=172090	UNSAT TT=0.806	UNSAT TT=0.668	UNSAT TT=0.062 ASSIGNMENTS=7042 CHECKS=130640	UNSAT TT=0.097 ASSIGNMENTS=12401 CHECKS=211332	UNSAT TT=0.379	UNSAT TT=0.139 ASSIGNMENTS=14313 CHECKS=256554	UNSAT TT=0.183 ASSIGNMENTS=23130 CHECKS=415299	UNSAT TT=1.434	UNSAT TT=0.663	UNSAT TT=0.649
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-4-4.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.04
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-5-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.05
csp/graphColoring/insertion/ k-insertion/ normalized-2-insertions-5-5.xml		? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-4-3.xml	UNSAT TT=2.162	UNSAT TT=87.828 CHECKS=80326800 NODES=491185	UNSAT TT=97.186 CHECKS=87911800 NODES=555376	? (TO) TT=1800.02	UNSAT TT=97.167 CHECKS=325546000	UNSAT TT=70.778 CHECKS=267595000	UNSAT TT=397.974 ASSIGNMENTS=2829360	UNSAT TT=410.596 ASSIGNMENTS=2829360	UNSAT TT=826.3 CHECKS=131907000 NODES=2167910	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=47.645 ASSIGNMENTS=903274 CHECKS=89515700	UNSAT TT=72.74 ASSIGNMENTS=568854 CHECKS=70144600	UNSAT TT=1.885	UNSAT TT=1.838	UNSAT TT=24.399 ASSIGNMENTS=561669 CHECKS=61886200	UNSAT TT=38.392 ASSIGNMENTS=878133 CHECKS=94444800	UNSAT TT=16.92	UNSAT TT=110.263 ASSIGNMENTS=1686090 CHECKS=183161000	UNSAT TT=37.246 ASSIGNMENTS=903274 CHECKS=89515700	UNSAT TT=5.316	UNSAT TT=2.226	UNSAT TT=2.162
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-3.xml	UNSAT TT=7.584	UNSAT TT=680.088 CHECKS=514149000 NODES=489423	UNSAT TT=674.555 CHECKS=531502000 NODES=519565	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	UNSAT TT=1515.67 ASSIGNMENTS=1842280	UNSAT TT=1563.25 ASSIGNMENTS=1842280	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=390.65 ASSIGNMENTS=373453 CHECKS=372979000	UNSAT TT=392.338 ASSIGNMENTS=373453 CHECKS=372979000	UNSAT TT=7.727	UNSAT TT=6.055	UNSAT TT=334.641 ASSIGNMENTS=1071840 CHECKS=920981000	UNSAT TT=303.571 ASSIGNMENTS=977387 CHECKS=860103000	UNSAT TT=28.217	UNSAT TT=724.315 ASSIGNMENTS=1667420 CHECKS=1141660000	UNSAT TT=1016.9 ASSIGNMENTS=3460460 CHECKS=2626730000	UNSAT TT=15.055	UNSAT TT=7.764	UNSAT TT=7.584
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.14
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-5.xml		? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/graphColoring/insertion/ k-insertion/ normalized-3-insertions-5-6.xml	SAT TT=0.496	SAT TT=463.239 CHECKS=55154 NODES=1406	SAT TT=4.389 CHECKS=56232 NODES=0	SAT TT=2.001	SAT TT=2.612 CHECKS=414394	SAT TT=2.182 CHECKS=433124	SAT TT=5.583 ASSIGNMENTS=1402	SAT TT=5.852 ASSIGNMENTS=1402	SAT TT=29.981 CHECKS=45834 NODES=1406	SAT TT=30.187 CHECKS=315370 NODES=632	SAT TT=30.574 CHECKS=4967900 NODES=641	SAT TT=0.515 ASSIGNMENTS=1401 CHECKS=19390	SAT TT=0.541 ASSIGNMENTS=1401 CHECKS=19390	SAT TT=10.443	SAT TT=10.317	SAT TT=0.512 ASSIGNMENTS=1401 CHECKS=19390	SAT TT=0.496 ASSIGNMENTS=1294 CHECKS=19493	SAT TT=2.508	SAT TT=0.517 ASSIGNMENTS=1405 CHECKS=19390	SAT TT=0.509 ASSIGNMENTS=1403 CHECKS=19390	SAT TT=6.348	SAT TT=3.222	SAT TT=4.248
csp/graphColoring/insertion/ k-insertion/ normalized-4-insertions-3-4.xml	SAT TT=0.011	SAT TT=0.949 CHECKS=704 NODES=79	SAT TT=0.835 CHECKS=709 NODES=0	SAT TT=0.05	SAT TT=0.02 CHECKS=3814	SAT TT=0.013 CHECKS=3578	SAT TT=0.866 ASSIGNMENTS=77	SAT TT=0.872 ASSIGNMENTS=77	SAT TT=0.797 CHECKS=535 NODES=79	SAT TT=0.909 CHECKS=3248 NODES=26	SAT TT=0.807 CHECKS=6420 NODES=29	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=312	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=312	SAT TT=1.308	SAT TT=1.348	SAT TT=0.012 ASSIGNMENTS=78 CHECKS=312	SAT TT=0.014 ASSIGNMENTS=71 CHECKS=312	SAT TT=0.5	SAT TT=0.011 ASSIGNMENTS=78 CHECKS=312	SAT TT=0.011 ASSIGNMENTS=74 CHECKS=312	SAT TT=1.349	SAT TT=0.887	SAT TT=0.798
csp/graphColoring/insertion/ k-insertion/ normalized-4-insertions-4-3.xml	UNSAT TT=6.636	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=1225.24 CHECKS=3594070000	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=4.231	UNSAT TT=5.595	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=23.951	UNSAT TT=8.632	UNSAT TT=6.636
csp/graphColoring/insertion/ k-insertion/ normalized-4-insertions-4-4.xml		? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.19	? (TO) TT=1800.08
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15a-05.xml	UNSAT TT=0.314	UNSAT TT=2.661 CHECKS=0 NODES=0	UNSAT TT=2.555 CHECKS=0 NODES=0	UNSAT TT=1.134	UNSAT TT=25.918 CHECKS=34156500	UNSAT TT=36.788 CHECKS=39259800	UNSAT TT=3.934 ASSIGNMENTS=0	UNSAT TT=3.614 ASSIGNMENTS=0	UNSAT TT=21.035 CHECKS=21708 NODES=211	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=0.332 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=4.2	UNSAT TT=3.956	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=0.315 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=2.169	UNSAT TT=0.321 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=0.32 ASSIGNMENTS=0 CHECKS=10	UNSAT TT=6.612	UNSAT TT=2.819	UNSAT TT=3.834
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15a-08.xml	UNSAT TT=0.312	UNSAT TT=2.553 CHECKS=0 NODES=0	UNSAT TT=2.542 CHECKS=0 NODES=0	UNSAT TT=1.049	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=4.143 ASSIGNMENTS=0	UNSAT TT=3.868 ASSIGNMENTS=0	UNSAT TT=236.73 CHECKS=4130360 NODES=46131	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.328 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.327 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=17.977	UNSAT TT=6.557	UNSAT TT=0.315 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=7.704	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.312 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=24.809	UNSAT TT=3.298	UNSAT TT=5.357
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15a-12.xml	UNSAT TT=0.306	UNSAT TT=2.727 CHECKS=0 NODES=0	UNSAT TT=2.656 CHECKS=0 NODES=0	UNSAT TT=1.119	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=4.238 ASSIGNMENTS=0	UNSAT TT=4.089 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.328 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.306 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=0.32 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=145.005	UNSAT TT=567.476
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-08.xml	UNSAT TT=0.308	UNSAT TT=2.697 CHECKS=0 NODES=0	UNSAT TT=2.676 CHECKS=0 NODES=0	UNSAT TT=1.112	UNSAT TT=194.313 CHECKS=684387000	UNSAT TT=240.242 CHECKS=828221000	UNSAT TT=3.876 ASSIGNMENTS=0	UNSAT TT=3.765 ASSIGNMENTS=0	UNSAT TT=226.578 CHECKS=4117500 NODES=45844	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.333 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.327 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=11.872	UNSAT TT=8.851	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=6.177	UNSAT TT=0.319 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=25.096	UNSAT TT=3.372	UNSAT TT=6.764
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-10.xml	UNSAT TT=0.297	UNSAT TT=2.779 CHECKS=0 NODES=0	UNSAT TT=2.735 CHECKS=0 NODES=0	UNSAT TT=1.123	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=3.902 ASSIGNMENTS=0	UNSAT TT=3.9 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.333 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.04	UNSAT TT=1620.39	UNSAT TT=0.312 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=649.968	UNSAT TT=0.297 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.16	UNSAT TT=5.457	UNSAT TT=20.72
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-13.xml	UNSAT TT=0.311	UNSAT TT=2.782 CHECKS=0 NODES=0	UNSAT TT=2.714 CHECKS=0 NODES=0	UNSAT TT=1.13	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=3.626 ASSIGNMENTS=0	UNSAT TT=3.876 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.312 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	UNSAT TT=1142.45	UNSAT TT=774.114
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15b-15.xml	SAT TT=0.403	SAT TT=5.126 CHECKS=2084990 NODES=5524	SAT TT=5.954 CHECKS=2210610 NODES=5524	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=750.06 ASSIGNMENTS=205124	SAT TT=44.738 ASSIGNMENTS=444	SAT TT=348.445 CHECKS=10833300 NODES=78081	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=8.158 ASSIGNMENTS=1566 CHECKS=96860	SAT TT=13.156 ASSIGNMENTS=5524 CHECKS=2084990	SAT TT=9.806	SAT TT=10.1	SAT TT=381.306 ASSIGNMENTS=6254950 CHECKS=496383000	SAT TT=3.351 ASSIGNMENTS=38652 CHECKS=4879250	? (TO) TT=1800.06	SAT TT=1.206 ASSIGNMENTS=9851 CHECKS=593617	SAT TT=0.403 ASSIGNMENTS=1566 CHECKS=96860	SAT TT=48.452	SAT TT=5.724	SAT TT=8.717
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15c-13.xml	UNSAT TT=0.66	UNSAT TT=4.476 CHECKS=0 NODES=0	UNSAT TT=4.393 CHECKS=0 NODES=0	UNSAT TT=2.25	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=7.255 ASSIGNMENTS=0	UNSAT TT=7.439 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.683 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.686 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.666 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.667 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.662 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.66 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.19	UNSAT TT=791.751	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15c-14.xml	UNSAT TT=0.619	UNSAT TT=4.554 CHECKS=0 NODES=0	UNSAT TT=4.635 CHECKS=0 NODES=0	UNSAT TT=2.274	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=7.237 ASSIGNMENTS=0	UNSAT TT=7.467 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=0.681 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.702 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=0.679 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.677 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.619 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.619 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-05.xml	UNSAT TT=0.672	UNSAT TT=3.99 CHECKS=0 NODES=0	UNSAT TT=4.235 CHECKS=0 NODES=0	UNSAT TT=2.108	UNSAT TT=39.808 CHECKS=47279600	UNSAT TT=57.519 CHECKS=67760200	UNSAT TT=6.55 ASSIGNMENTS=0	UNSAT TT=6.54 ASSIGNMENTS=0	UNSAT TT=105.925 CHECKS=39518 NODES=188	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.688 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.706 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=7.664	UNSAT TT=6.78	UNSAT TT=0.672 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.686 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=3.196	UNSAT TT=0.689 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=0.686 ASSIGNMENTS=0 CHECKS=22	UNSAT TT=7.909	UNSAT TT=4.464	UNSAT TT=5.946
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-08.xml	UNSAT TT=0.621	UNSAT TT=4.157 CHECKS=0 NODES=0	UNSAT TT=4.386 CHECKS=0 NODES=0	UNSAT TT=2.296	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=6.821 ASSIGNMENTS=0	UNSAT TT=6.653 ASSIGNMENTS=0	UNSAT TT=739.144 CHECKS=9879990 NODES=46934	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.689 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.694 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=16.076	UNSAT TT=9.211	UNSAT TT=0.669 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.621 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=10.99	UNSAT TT=0.639 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.633 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=40.663	UNSAT TT=4.343	UNSAT TT=6.672
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-10.xml	UNSAT TT=0.617	UNSAT TT=4.086 CHECKS=0 NODES=0	UNSAT TT=4.082 CHECKS=0 NODES=0	UNSAT TT=2.303	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=6.583 ASSIGNMENTS=0	UNSAT TT=7.7 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.636 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.693 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.649 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.65 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=512.533	UNSAT TT=0.617 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.657 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.15	UNSAT TT=9.328	UNSAT TT=36.006
csp/graphColoring/leighton/ leighton-15/ normalized-lei450-15d-12.xml	UNSAT TT=0.669	UNSAT TT=4.115 CHECKS=0 NODES=0	UNSAT TT=4.499 CHECKS=0 NODES=0	UNSAT TT=2.291	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=7.442 ASSIGNMENTS=0	UNSAT TT=7.199 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.674 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.674 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.669 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.67 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=0.675 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.67 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=224.067	UNSAT TT=943.358
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25a-15.xml	UNSAT TT=0.313	UNSAT TT=2.851 CHECKS=0 NODES=0	UNSAT TT=2.806 CHECKS=0 NODES=0	UNSAT TT=1.048	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=3.666 ASSIGNMENTS=0	UNSAT TT=3.771 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.313 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25a-23.xml	UNSAT TT=0.295	UNSAT TT=2.79 CHECKS=0 NODES=0	UNSAT TT=2.78 CHECKS=0 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=3.893 ASSIGNMENTS=0	UNSAT TT=4.148 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.331 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.295 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.302 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.322 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.32 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25a-25.xml	SAT TT=0.301	SAT TT=2.936 CHECKS=144881 NODES=450	SAT TT=2.918 CHECKS=143472 NODES=0	SAT TT=1.168	SAT TT=1.016 CHECKS=439497	SAT TT=0.668 CHECKS=393052	SAT TT=65.242 ASSIGNMENTS=414	SAT TT=70.142 ASSIGNMENTS=3071	SAT TT=26.373 CHECKS=199116 NODES=2299	SAT TT=20.855 CHECKS=1775620 NODES=648	SAT TT=20.295 CHECKS=2703950 NODES=307	SAT TT=0.314 ASSIGNMENTS=435 CHECKS=17098	SAT TT=0.337 ASSIGNMENTS=435 CHECKS=17098	SAT TT=16.282	SAT TT=12.075	SAT TT=0.301 ASSIGNMENTS=435 CHECKS=17098	SAT TT=0.327 ASSIGNMENTS=1622 CHECKS=47395	SAT TT=1.877	SAT TT=0.752 ASSIGNMENTS=11160 CHECKS=367967	SAT TT=0.302 ASSIGNMENTS=435 CHECKS=17105	SAT TT=16.202	SAT TT=3.907	SAT TT=7.944
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25b-15.xml	UNSAT TT=0.286	UNSAT TT=2.568 CHECKS=0 NODES=0	UNSAT TT=2.562 CHECKS=0 NODES=0	UNSAT TT=1.142	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=4.006 ASSIGNMENTS=0	UNSAT TT=3.993 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.331 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.29 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.286 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.314 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25b-24.xml	UNSAT TT=0.299	UNSAT TT=2.928 CHECKS=0 NODES=0	UNSAT TT=2.621 CHECKS=0 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=4.027 ASSIGNMENTS=0	UNSAT TT=4.084 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.326 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.319 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25c-05.xml	UNSAT TT=0.642	UNSAT TT=4.111 CHECKS=0 NODES=0	UNSAT TT=4.299 CHECKS=0 NODES=0	UNSAT TT=2.204	UNSAT TT=49.492 CHECKS=54184900	UNSAT TT=73.163 CHECKS=78958400	UNSAT TT=6.673 ASSIGNMENTS=0	UNSAT TT=7.203 ASSIGNMENTS=0	UNSAT TT=111.814 CHECKS=39907 NODES=182	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.711 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.704 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=7.976	UNSAT TT=6.396	UNSAT TT=0.644 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.645 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.234	UNSAT TT=0.702 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.642 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=7.79	UNSAT TT=4.608	UNSAT TT=5.675
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25c-25.xml		? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=553.3	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25d-05.xml	UNSAT TT=0.684	UNSAT TT=4.397 CHECKS=0 NODES=0	UNSAT TT=4.477 CHECKS=0 NODES=0	UNSAT TT=2.329	UNSAT TT=32.525 CHECKS=43789100	UNSAT TT=44.602 CHECKS=60098000	UNSAT TT=7.099 ASSIGNMENTS=0	UNSAT TT=7.732 ASSIGNMENTS=0	UNSAT TT=126.812 CHECKS=37803 NODES=163	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.684 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.716 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=8.137	UNSAT TT=6.422	UNSAT TT=0.708 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.703 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=3.277	UNSAT TT=0.706 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.695 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=7.244	UNSAT TT=4.24	UNSAT TT=5.884
csp/graphColoring/leighton/ leighton-25/ normalized-lei450-25d-20.xml	UNSAT TT=0.65	UNSAT TT=4.481 CHECKS=0 NODES=0	UNSAT TT=4.53 CHECKS=0 NODES=0	UNSAT TT=2.363	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=7.736 ASSIGNMENTS=0	UNSAT TT=7.234 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.702 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.699 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.65 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.658 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.682 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.68 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.22	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/graphColoring/leighton/ leighton-5/ normalized-lei450-05a-04.xml	UNSAT TT=0.215	UNSAT TT=2.078 CHECKS=0 NODES=0	UNSAT TT=2.159 CHECKS=0 NODES=0	UNSAT TT=0.806	UNSAT TT=1.542 CHECKS=1569850	UNSAT TT=1.758 CHECKS=2139220	UNSAT TT=2.953 ASSIGNMENTS=0	UNSAT TT=2.923 ASSIGNMENTS=0	UNSAT TT=9.337 CHECKS=12651 NODES=111	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.223 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.236 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.884	UNSAT TT=3.09	UNSAT TT=0.226 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.223 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.416	UNSAT TT=0.215 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.222 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=5.772	UNSAT TT=2.115	UNSAT TT=2.665
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/leighton/ leighton-5/ normalized-lei450-05a-05.xml	SAT TT=0.422	SAT TT=2.526 CHECKS=110856 NODES=595	SAT TT=2.792 CHECKS=184794 NODES=581	SAT TT=1.277	SAT TT=447.955 CHECKS=1509280000	SAT TT=289.562 CHECKS=519536000	SAT TT=6.731 ASSIGNMENTS=13	SAT TT=7.595 ASSIGNMENTS=18	SAT TT=11.364 CHECKS=190382 NODES=1194	? (TO) TT=1800.08	SAT TT=42.839 CHECKS=148395000 NODES=56525	SAT TT=0.45 ASSIGNMENTS=483 CHECKS=294439	SAT TT=0.439 ASSIGNMENTS=483 CHECKS=294439	SAT TT=4.922	SAT TT=5.029	SAT TT=0.453 ASSIGNMENTS=540 CHECKS=364576	SAT TT=2.018 ASSIGNMENTS=4532 CHECKS=2867310	SAT TT=1.912	SAT TT=0.818 ASSIGNMENTS=2417 CHECKS=743654	SAT TT=0.422 ASSIGNMENTS=511 CHECKS=303715	SAT TT=7.226	SAT TT=2.756	SAT TT=3.099
csp/graphColoring/leighton/ leighton-5/ normalized-lei450-05b-05.xml	SAT TT=0.292	SAT TT=4.458 CHECKS=1869350 NODES=4044	SAT TT=3.606 CHECKS=1023800 NODES=2253	SAT TT=0.823	SAT TT=318.981 CHECKS=1181030000	SAT TT=99.2 CHECKS=230641000	SAT TT=9.09 ASSIGNMENTS=332	SAT TT=9.79 ASSIGNMENTS=279	SAT TT=13.024 CHECKS=220506 NODES=1414	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.342 ASSIGNMENTS=207 CHECKS=180188	SAT TT=0.36 ASSIGNMENTS=207 CHECKS=180188	SAT TT=4.695	SAT TT=4.644	SAT TT=0.292 ASSIGNMENTS=219 CHECKS=139115	SAT TT=3.416 ASSIGNMENTS=7971 CHECKS=5214960	SAT TT=1.988	SAT TT=0.509 ASSIGNMENTS=1843 CHECKS=360458	SAT TT=0.303 ASSIGNMENTS=170 CHECKS=130299	SAT TT=7.76	SAT TT=2.439	SAT TT=3.498
csp/graphColoring/ mug/ normalized-mug100-1-3.xml	UNSAT TT=0.784	UNSAT TT=1.851 CHECKS=425372 NODES=17420	UNSAT TT=1.361 CHECKS=191679 NODES=8068	? (TO) TT=1800.09	UNSAT TT=105.087 CHECKS=227798000	UNSAT TT=98.215 CHECKS=250633000	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=16.455 ASSIGNMENTS=189705 CHECKS=4917310	UNSAT TT=16.802 ASSIGNMENTS=189705 CHECKS=4917310	UNSAT TT=1.157	UNSAT TT=0.83	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	UNSAT TT=1.505	UNSAT TT=0.784	UNSAT TT=0.8
csp/graphColoring/ mug/ normalized-mug100-1-4.xml	SAT TT=0.012	SAT TT=0.84 CHECKS=853 NODES=100	SAT TT=0.867 CHECKS=904 NODES=0	SAT TT=0.049	SAT TT=0.021 CHECKS=4024	SAT TT=0.015 CHECKS=3890	SAT TT=0.816 ASSIGNMENTS=87	SAT TT=0.783 ASSIGNMENTS=87	SAT TT=0.764 CHECKS=577 NODES=100	SAT TT=0.795 CHECKS=3448 NODES=34	SAT TT=0.796 CHECKS=7804 NODES=38	SAT TT=0.025 ASSIGNMENTS=88 CHECKS=332	SAT TT=0.024 ASSIGNMENTS=88 CHECKS=332	SAT TT=1.325	SAT TT=1.661	SAT TT=0.014 ASSIGNMENTS=88 CHECKS=332	SAT TT=0.013 ASSIGNMENTS=92 CHECKS=332	SAT TT=0.456	SAT TT=0.012 ASSIGNMENTS=87 CHECKS=332	SAT TT=0.013 ASSIGNMENTS=92 CHECKS=332	SAT TT=1.453	SAT TT=0.795	SAT TT=0.801
csp/graphColoring/ mug/ normalized-mug100-25-3.xml	UNSAT TT=0.853	UNSAT TT=1.169 CHECKS=123868 NODES=5383	UNSAT TT=1.601 CHECKS=370077 NODES=14905	? (TO) TT=1800.08	UNSAT TT=83.273 CHECKS=194949000	UNSAT TT=82.412 CHECKS=222694000	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=8.717 ASSIGNMENTS=17178 CHECKS=361474	UNSAT TT=8.683 ASSIGNMENTS=17178 CHECKS=361474	UNSAT TT=0.824	UNSAT TT=0.959	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=1.573	UNSAT TT=0.853	UNSAT TT=0.88
csp/graphColoring/ mug/ normalized-mug100-25-4.xml	SAT TT=0.011	SAT TT=0.886 CHECKS=857 NODES=100	SAT TT=0.816 CHECKS=916 NODES=0	SAT TT=0.052	SAT TT=0.023 CHECKS=4026	SAT TT=0.015 CHECKS=3821	SAT TT=0.821 ASSIGNMENTS=90	SAT TT=0.786 ASSIGNMENTS=90	SAT TT=0.763 CHECKS=577 NODES=100	SAT TT=0.801 CHECKS=3516 NODES=39	SAT TT=0.821 CHECKS=7800 NODES=37	SAT TT=0.024 ASSIGNMENTS=95 CHECKS=332	SAT TT=0.024 ASSIGNMENTS=95 CHECKS=332	SAT TT=1.319	SAT TT=1.316	SAT TT=0.011 ASSIGNMENTS=95 CHECKS=332	SAT TT=0.012 ASSIGNMENTS=88 CHECKS=332	SAT TT=0.452	SAT TT=0.012 ASSIGNMENTS=93 CHECKS=332	SAT TT=0.011 ASSIGNMENTS=87 CHECKS=332	SAT TT=1.454	SAT TT=0.903	SAT TT=0.848
csp/graphColoring/ mug/ normalized-mug88-1-3.xml	UNSAT TT=0.717	UNSAT TT=1.35 CHECKS=238723 NODES=10640	UNSAT TT=1.484 CHECKS=214798 NODES=9870	UNSAT TT=1539.12	UNSAT TT=82.676 CHECKS=199592000	UNSAT TT=89.994 CHECKS=238785000	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=10.836 ASSIGNMENTS=77382 CHECKS=1850830	UNSAT TT=11.644 ASSIGNMENTS=77382 CHECKS=1850830	UNSAT TT=0.796	UNSAT TT=0.97	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=1.545	UNSAT TT=0.717	UNSAT TT=0.784
csp/graphColoring/ mug/ normalized-mug88-1-4.xml	SAT TT=0.009	SAT TT=0.835 CHECKS=743 NODES=88	SAT TT=0.896 CHECKS=784 NODES=0	SAT TT=0.045	SAT TT=0.019 CHECKS=3285	SAT TT=0.013 CHECKS=3366	SAT TT=0.727 ASSIGNMENTS=77	SAT TT=0.739 ASSIGNMENTS=77	SAT TT=0.712 CHECKS=508 NODES=88	SAT TT=0.714 CHECKS=2984 NODES=27	SAT TT=0.718 CHECKS=6118 NODES=31	SAT TT=0.024 ASSIGNMENTS=77 CHECKS=292	SAT TT=0.023 ASSIGNMENTS=77 CHECKS=292	SAT TT=1.192	SAT TT=1.201	SAT TT=0.009 ASSIGNMENTS=77 CHECKS=292	SAT TT=0.012 ASSIGNMENTS=80 CHECKS=292	SAT TT=0.421	SAT TT=0.012 ASSIGNMENTS=77 CHECKS=292	SAT TT=0.01 ASSIGNMENTS=80 CHECKS=292	SAT TT=1.35	SAT TT=0.721	SAT TT=0.716
csp/graphColoring/ mug/ normalized-mug88-25-3.xml	UNSAT TT=0.855	UNSAT TT=1.149 CHECKS=64756 NODES=2934	UNSAT TT=1.283 CHECKS=180888 NODES=7119	? (TO) TT=1800.06	UNSAT TT=7.906 CHECKS=27554400	UNSAT TT=11.032 CHECKS=37505600	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=9.63 ASSIGNMENTS=34731 CHECKS=780235	UNSAT TT=10.2 ASSIGNMENTS=34731 CHECKS=780235	UNSAT TT=0.803	UNSAT TT=0.938	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1.481	UNSAT TT=0.857	UNSAT TT=0.855
csp/graphColoring/ mug/ normalized-mug88-25-4.xml	SAT TT=0.01	SAT TT=0.857 CHECKS=763 NODES=88	SAT TT=0.804 CHECKS=816 NODES=0	SAT TT=0.049	SAT TT=0.019 CHECKS=3304	SAT TT=0.014 CHECKS=3414	SAT TT=0.724 ASSIGNMENTS=74	SAT TT=0.787 ASSIGNMENTS=74	SAT TT=0.735 CHECKS=501 NODES=88	SAT TT=0.757 CHECKS=3068 NODES=33	SAT TT=0.755 CHECKS=7102 NODES=39	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=292	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=292	SAT TT=1.431	SAT TT=1.94	SAT TT=0.012 ASSIGNMENTS=78 CHECKS=292	SAT TT=0.012 ASSIGNMENTS=75 CHECKS=292	SAT TT=0.417	SAT TT=0.011 ASSIGNMENTS=76 CHECKS=292	SAT TT=0.01 ASSIGNMENTS=81 CHECKS=292	SAT TT=1.425	SAT TT=0.777	SAT TT=0.732
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ myciel/ normalized-myciel3-3.xml	UNSAT TT=0.007	UNSAT TT=0.69 CHECKS=276 NODES=9	UNSAT TT=0.664 CHECKS=721 NODES=0	UNSAT TT=0.027	UNSAT TT=0.01 CHECKS=660	UNSAT TT=0.007 CHECKS=1052	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.479 ASSIGNMENTS=0	UNSAT TT=0.469 CHECKS=422 NODES=35	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.019 ASSIGNMENTS=20 CHECKS=265	UNSAT TT=0.02 ASSIGNMENTS=20 CHECKS=265	UNSAT TT=0.737	UNSAT TT=0.542	UNSAT TT=0.007 ASSIGNMENTS=18 CHECKS=255	UNSAT TT=0.007 ASSIGNMENTS=34 CHECKS=488	UNSAT TT=0.289	UNSAT TT=0.008 ASSIGNMENTS=48 CHECKS=487	UNSAT TT=0.007 ASSIGNMENTS=30 CHECKS=392	UNSAT TT=0.854	UNSAT TT=0.496	UNSAT TT=0.506
csp/graphColoring/ myciel/ normalized-myciel3-4.xml	SAT TT=0.006	SAT TT=0.736 CHECKS=104 NODES=11	SAT TT=0.675 CHECKS=101 NODES=0	SAT TT=0.027	SAT TT=0.008 CHECKS=656	SAT TT=0.008 CHECKS=600	SAT TT=0.476 ASSIGNMENTS=9	SAT TT=0.52 ASSIGNMENTS=9	SAT TT=0.461 CHECKS=67 NODES=11	SAT TT=0.469 CHECKS=412 NODES=3	SAT TT=0.448 CHECKS=476 NODES=4	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.872	SAT TT=0.881	SAT TT=0.006 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.282	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=40	SAT TT=0.911	SAT TT=0.507	SAT TT=0.504
csp/graphColoring/ myciel/ normalized-myciel4-4.xml	UNSAT TT=0.026	UNSAT TT=0.872 CHECKS=29912 NODES=544	UNSAT TT=0.859 CHECKS=30322 NODES=578	UNSAT TT=0.053	UNSAT TT=0.028 CHECKS=70057	UNSAT TT=0.026 CHECKS=69976	UNSAT TT=0.636 ASSIGNMENTS=149	UNSAT TT=0.644 ASSIGNMENTS=149	UNSAT TT=0.753 CHECKS=39010 NODES=2638	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.038 ASSIGNMENTS=1918 CHECKS=44836	UNSAT TT=0.036 ASSIGNMENTS=1918 CHECKS=44836	UNSAT TT=0.695	UNSAT TT=0.703	UNSAT TT=0.026 ASSIGNMENTS=1998 CHECKS=46161	UNSAT TT=0.044 ASSIGNMENTS=5397 CHECKS=99440	UNSAT TT=0.363	UNSAT TT=0.038 ASSIGNMENTS=3187 CHECKS=71019	UNSAT TT=0.04 ASSIGNMENTS=3792 CHECKS=85111	UNSAT TT=1.523	UNSAT TT=0.704	UNSAT TT=0.68
csp/graphColoring/ myciel/ normalized-myciel4-5.xml	SAT TT=0.007	SAT TT=0.747 CHECKS=390 NODES=23	SAT TT=0.715 CHECKS=380 NODES=0	SAT TT=0.035	SAT TT=0.014 CHECKS=2261	SAT TT=0.009 CHECKS=1850	SAT TT=0.626 ASSIGNMENTS=21	SAT TT=0.571 ASSIGNMENTS=21	SAT TT=0.688 CHECKS=276 NODES=23	SAT TT=0.601 CHECKS=1757 NODES=6	SAT TT=0.609 CHECKS=2142 NODES=7	SAT TT=0.02 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.021 ASSIGNMENTS=22 CHECKS=142	SAT TT=1.166	SAT TT=1.019	SAT TT=0.007 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.008 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.35	SAT TT=0.007 ASSIGNMENTS=22 CHECKS=142	SAT TT=0.009 ASSIGNMENTS=22 CHECKS=142	SAT TT=1.063	SAT TT=0.614	SAT TT=0.659
csp/graphColoring/ myciel/ normalized-myciel5-4.xml	UNSAT TT=0.046	UNSAT TT=0.942 CHECKS=53921 NODES=442	UNSAT TT=0.993 CHECKS=64809 NODES=527	UNSAT TT=0.102	UNSAT TT=0.079 CHECKS=274748	UNSAT TT=0.074 CHECKS=271591	UNSAT TT=0.844 ASSIGNMENTS=122	UNSAT TT=1.108 ASSIGNMENTS=122	UNSAT TT=1.143 CHECKS=90367 NODES=2704	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.061 ASSIGNMENTS=1387 CHECKS=92249	UNSAT TT=0.059 ASSIGNMENTS=1387 CHECKS=92249	UNSAT TT=0.933	UNSAT TT=0.907	UNSAT TT=0.046 ASSIGNMENTS=1295 CHECKS=88720	UNSAT TT=0.102 ASSIGNMENTS=5225 CHECKS=238316	UNSAT TT=0.485	UNSAT TT=0.099 ASSIGNMENTS=3305 CHECKS=208915	UNSAT TT=0.059 ASSIGNMENTS=2208 CHECKS=143390	UNSAT TT=2.211	UNSAT TT=0.944	UNSAT TT=0.989
csp/graphColoring/ myciel/ normalized-myciel5-5.xml	UNSAT TT=25.039	UNSAT TT=25.039 CHECKS=34788100 NODES=397254	UNSAT TT=29.904 CHECKS=39853800 NODES=458975	UNSAT TT=655.767	UNSAT TT=99.347 CHECKS=454619000	UNSAT TT=96.833 CHECKS=451476000	UNSAT TT=46.066 ASSIGNMENTS=574723	UNSAT TT=46.541 ASSIGNMENTS=574723	UNSAT TT=387.389 CHECKS=96524000 NODES=4328700	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=102.481 ASSIGNMENTS=1786190 CHECKS=163939000	UNSAT TT=102.791 ASSIGNMENTS=1786190 CHECKS=163939000	UNSAT TT=186.452	UNSAT TT=216.136	UNSAT TT=33.677 ASSIGNMENTS=2237490 CHECKS=96805700	UNSAT TT=31 ASSIGNMENTS=2014660 CHECKS=88679500	UNSAT TT=99.477	UNSAT TT=31.59 ASSIGNMENTS=1908840 CHECKS=72511500	UNSAT TT=67.804 ASSIGNMENTS=4817280 CHECKS=213097000	? (TO) TT=1800.11	UNSAT TT=56.015	UNSAT TT=232.688
csp/graphColoring/ myciel/ normalized-myciel5-6.xml	SAT TT=0.012	SAT TT=0.85 CHECKS=1356 NODES=47	SAT TT=0.9 CHECKS=1353 NODES=0	SAT TT=0.053	SAT TT=0.029 CHECKS=7632	SAT TT=0.017 CHECKS=7809	SAT TT=0.806 ASSIGNMENTS=45	SAT TT=0.812 ASSIGNMENTS=45	SAT TT=1.075 CHECKS=1047 NODES=47	SAT TT=0.84 CHECKS=7480 NODES=21	SAT TT=0.879 CHECKS=10296 NODES=17	SAT TT=0.025 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.028 ASSIGNMENTS=46 CHECKS=472	SAT TT=1.417	SAT TT=1.31	SAT TT=0.012 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.014 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.461	SAT TT=0.014 ASSIGNMENTS=46 CHECKS=472	SAT TT=0.014 ASSIGNMENTS=46 CHECKS=472	SAT TT=1.656	SAT TT=0.818	SAT TT=0.826
csp/graphColoring/ myciel/ normalized-myciel6-4.xml	UNSAT TT=0.097	UNSAT TT=1.291 CHECKS=161372 NODES=583	UNSAT TT=1.353 CHECKS=179166 NODES=606	UNSAT TT=0.42	UNSAT TT=0.836 CHECKS=3349740	UNSAT TT=1.169 CHECKS=5272040	UNSAT TT=1.341 ASSIGNMENTS=384	UNSAT TT=1.34 ASSIGNMENTS=384	UNSAT TT=2.764 CHECKS=248880 NODES=3412	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.116 ASSIGNMENTS=1152 CHECKS=193635	UNSAT TT=0.112 ASSIGNMENTS=1152 CHECKS=193635	UNSAT TT=1.367	UNSAT TT=1.518	UNSAT TT=0.097 ASSIGNMENTS=1318 CHECKS=214314	UNSAT TT=0.264 ASSIGNMENTS=5872 CHECKS=641014	UNSAT TT=1.107	UNSAT TT=0.214 ASSIGNMENTS=2838 CHECKS=443103	UNSAT TT=0.126 ASSIGNMENTS=1767 CHECKS=286561	UNSAT TT=6	UNSAT TT=1.46	UNSAT TT=1.812
csp/graphColoring/ myciel/ normalized-myciel6-5.xml	UNSAT TT=26.269	UNSAT TT=38.679 CHECKS=54230100 NODES=219820	UNSAT TT=40.458 CHECKS=56468200 NODES=229679	? (TO) TT=1800.1	UNSAT TT=454.804 CHECKS=2164930000	UNSAT TT=471.947 CHECKS=2071190000	UNSAT TT=48.066 ASSIGNMENTS=242956	UNSAT TT=45.642 ASSIGNMENTS=242956	UNSAT TT=972.593 CHECKS=160487000 NODES=3047840	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=72.602 ASSIGNMENTS=1410710 CHECKS=193561000	UNSAT TT=140.936 ASSIGNMENTS=934415 CHECKS=222544000	UNSAT TT=679.873	UNSAT TT=538.734	UNSAT TT=28.471 ASSIGNMENTS=633487 CHECKS=84302100	UNSAT TT=26.269 ASSIGNMENTS=591023 CHECKS=77526400	UNSAT TT=76.085	UNSAT TT=77.7 ASSIGNMENTS=1631870 CHECKS=196656000	UNSAT TT=65.203 ASSIGNMENTS=1410710 CHECKS=193561000	? (TO) TT=1800.16	UNSAT TT=139.635	UNSAT TT=425.14
csp/graphColoring/ myciel/ normalized-myciel6-6.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ myciel/ normalized-myciel7-4.xml	UNSAT TT=0.252	UNSAT TT=2.233 CHECKS=495812 NODES=804	UNSAT TT=2.072 CHECKS=425206 NODES=703	UNSAT TT=1.654	UNSAT TT=5.612 CHECKS=20398800	UNSAT TT=8.906 CHECKS=31411900	UNSAT TT=2.396 ASSIGNMENTS=607	UNSAT TT=2.597 ASSIGNMENTS=607	UNSAT TT=7.046 CHECKS=434406 NODES=2951	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.295 ASSIGNMENTS=1428 CHECKS=647886	UNSAT TT=0.314 ASSIGNMENTS=1428 CHECKS=647886	UNSAT TT=1.861	UNSAT TT=2.063	UNSAT TT=0.252 ASSIGNMENTS=1281 CHECKS=559705	UNSAT TT=0.759 ASSIGNMENTS=7199 CHECKS=2187140	UNSAT TT=1.129	UNSAT TT=0.517 ASSIGNMENTS=3050 CHECKS=1268800	UNSAT TT=0.299 ASSIGNMENTS=1475 CHECKS=632049	UNSAT TT=5.266	UNSAT TT=2.033	UNSAT TT=2.43
csp/graphColoring/ myciel/ normalized-myciel7-5.xml	UNSAT TT=41.969	UNSAT TT=69.367 CHECKS=96661500 NODES=163338	UNSAT TT=80.057 CHECKS=99896700 NODES=172079	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=130.077 ASSIGNMENTS=290172	UNSAT TT=143.436 ASSIGNMENTS=290172	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=95.503 ASSIGNMENTS=803507 CHECKS=276100000	UNSAT TT=289.205 ASSIGNMENTS=780141 CHECKS=405808000	? (TO) TT=1800.07	UNSAT TT=1120.16	UNSAT TT=41.969 ASSIGNMENTS=383099 CHECKS=130085000	UNSAT TT=43.306 ASSIGNMENTS=404567 CHECKS=134256000	UNSAT TT=166.228	UNSAT TT=228.431 ASSIGNMENTS=1847260 CHECKS=620943000	UNSAT TT=83.017 ASSIGNMENTS=803507 CHECKS=276100000	? (TO) TT=1800.17	UNSAT TT=365.613	UNSAT TT=811.677
csp/graphColoring/ myciel/ normalized-myciel7-6.xml		? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.14
csp/graphColoring/ myciel/ normalized-myciel7-7.xml		? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/graphColoring/ myciel/ normalized-myciel7-8.xml	SAT TT=0.087	SAT TT=1.825 CHECKS=15124 NODES=191	SAT TT=1.483 CHECKS=15654 NODES=0	SAT TT=0.317	SAT TT=0.228 CHECKS=154093	SAT TT=0.116 CHECKS=148235	SAT TT=2.032 ASSIGNMENTS=186	SAT TT=2.121 ASSIGNMENTS=186	SAT TT=2.843 CHECKS=13175 NODES=191	SAT TT=2.791 CHECKS=115048 NODES=130	SAT TT=2.822 CHECKS=327112 NODES=116	SAT TT=0.103 ASSIGNMENTS=187 CHECKS=4720	SAT TT=0.097 ASSIGNMENTS=187 CHECKS=4720	SAT TT=3.148	SAT TT=3.042	SAT TT=0.087 ASSIGNMENTS=187 CHECKS=4720	SAT TT=0.092 ASSIGNMENTS=187 CHECKS=4720	SAT TT=1.041	SAT TT=0.091 ASSIGNMENTS=190 CHECKS=4720	SAT TT=0.087 ASSIGNMENTS=187 CHECKS=4720	SAT TT=3.9	SAT TT=1.77	SAT TT=1.796
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-1-55.xml	UNSAT TT=0.404	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=1.536	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=5.182 ASSIGNMENTS=0	UNSAT TT=5.113 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.462 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.434 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.05	? (MO) TT=1013.88	UNSAT TT=0.404 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.442 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	UNSAT TT=0.436 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.436 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-2-10.xml	UNSAT TT=0.311	UNSAT TT=3.945 CHECKS=20 NODES=0	UNSAT TT=3.931 CHECKS=20 NODES=0	UNSAT TT=1.198	UNSAT TT=12.426 CHECKS=27253100	UNSAT TT=18.294 CHECKS=36397800	UNSAT TT=3.972 ASSIGNMENTS=0	UNSAT TT=3.738 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.35 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.33 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1262.95	UNSAT TT=0.311 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.317 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	UNSAT TT=6.531	UNSAT TT=26.194
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-2-15.xml	UNSAT TT=0.329	UNSAT TT=4.184 CHECKS=60 NODES=0	UNSAT TT=4.049 CHECKS=60 NODES=0	UNSAT TT=1.199	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=4.092 ASSIGNMENTS=0	UNSAT TT=4.273 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.347 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=0.34 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.333 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.07	UNSAT TT=0.332 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.13
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-2-27.xml	UNSAT TT=0.31	? (TO) TT=1800.12	UNSAT TT=4.328 CHECKS=541039 NODES=0	UNSAT TT=1.209	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=3.759 ASSIGNMENTS=0	UNSAT TT=4.29 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.342 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.345 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.334 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.332 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.08	UNSAT TT=0.31 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.313 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800
csp/graphColoring/ register/fpsol/ normalized-fpsol2-i-3-27.xml	UNSAT TT=0.308	? (TO) TT=1800.15	UNSAT TT=4.455 CHECKS=540007 NODES=0	UNSAT TT=1.199	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=3.828 ASSIGNMENTS=0	UNSAT TT=4.329 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=0.35 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.349 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.09	UNSAT TT=0.309 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.308 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ register/inithx/ normalized-inithx-i-1-10.xml	UNSAT TT=0.67	UNSAT TT=11.482 CHECKS=20 NODES=0	UNSAT TT=11.032 CHECKS=20 NODES=0	UNSAT TT=2.585	UNSAT TT=2.767 CHECKS=55250	UNSAT TT=1.984 CHECKS=55250	UNSAT TT=6.89 ASSIGNMENTS=0	UNSAT TT=7.658 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=0.749 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.753 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.67 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.672 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=795.334	UNSAT TT=0.729 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.679 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.15	UNSAT TT=10.421	UNSAT TT=38.23
csp/graphColoring/ register/inithx/ normalized-inithx-i-1-45.xml	UNSAT TT=0.722	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=7.126 ASSIGNMENTS=0	UNSAT TT=7.129 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800	UNSAT TT=0.734 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.734 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.06	? (MO) TT=1719.15	UNSAT TT=0.733 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.732 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.1	UNSAT TT=0.722 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.752 ASSIGNMENTS=0 CHECKS=3	? TT=481.099	? (TO) TT=1800.01	? (TO) TT=1800.06
csp/graphColoring/ register/inithx/ normalized-inithx-i-2-15.xml	UNSAT TT=0.5	UNSAT TT=8.297 CHECKS=30 NODES=0	UNSAT TT=7.754 CHECKS=30 NODES=0	UNSAT TT=1.811	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=5.388 ASSIGNMENTS=0	UNSAT TT=5.389 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.565 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.566 ASSIGNMENTS=0 CHECKS=14	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.5 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=14	? (TO) TT=1800.04	UNSAT TT=0.545 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.567 ASSIGNMENTS=0 CHECKS=14	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/graphColoring/ register/inithx/ normalized-inithx-i-2-20.xml	UNSAT TT=0.511	UNSAT TT=8.287 CHECKS=40 NODES=0	UNSAT TT=7.589 CHECKS=40 NODES=0	UNSAT TT=1.845	? (TO) TT=1800.02	? (TO) TT=1800.11	UNSAT TT=5.451 ASSIGNMENTS=0	UNSAT TT=5.72 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.521 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.521 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.535 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.537 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.08	UNSAT TT=0.53 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.511 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.03
csp/graphColoring/ register/inithx/ normalized-inithx-i-2-31.xml	SAT TT=0.547	SAT TT=9.356 CHECKS=373091 NODES=645	SAT TT=8.148 CHECKS=365150 NODES=0	SAT TT=2.015	SAT TT=3.001 CHECKS=1773630	SAT TT=2.428 CHECKS=1740680	SAT TT=10.84 ASSIGNMENTS=615	SAT TT=12.82 ASSIGNMENTS=615	SAT TT=66.4 CHECKS=280233 NODES=645	? (TO) TT=1800.06	SAT TT=74.178 CHECKS=68345400 NODES=5466	SAT TT=0.564 ASSIGNMENTS=644 CHECKS=28196	SAT TT=0.569 ASSIGNMENTS=644 CHECKS=28196	SAT TT=33.08	SAT TT=22.615	SAT TT=0.565 ASSIGNMENTS=644 CHECKS=28196	SAT TT=0.562 ASSIGNMENTS=644 CHECKS=28289	SAT TT=3.121	SAT TT=0.642 ASSIGNMENTS=1356 CHECKS=145724	SAT TT=0.547 ASSIGNMENTS=644 CHECKS=28196	SAT TT=23.921	SAT TT=6.249	SAT TT=14.673
csp/graphColoring/ register/inithx/ normalized-inithx-i-3-20.xml	UNSAT TT=0.513	UNSAT TT=7.517 CHECKS=40 NODES=0	UNSAT TT=7.516 CHECKS=40 NODES=0	UNSAT TT=1.945	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=5.755 ASSIGNMENTS=0	UNSAT TT=5.46 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=0.553 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.551 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.548 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.552 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.04	UNSAT TT=0.513 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.537 ASSIGNMENTS=0 CHECKS=4	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05
csp/graphColoring/ register/inithx/ normalized-inithx-i-3-28.xml	UNSAT TT=0.5	UNSAT TT=151.806 CHECKS=198485000 NODES=9861	UNSAT TT=164.989 CHECKS=198894000 NODES=9861	UNSAT TT=1.959	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=5.721 ASSIGNMENTS=0	UNSAT TT=5.994 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.555 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.555 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.542 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.534 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.05	UNSAT TT=0.502 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.5 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.2	? (TO) TT=1800.01	? (TO) TT=1800.04
csp/graphColoring/ register/inithx/ normalized-inithx-i-3-30.xml	UNSAT TT=0.499	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=5.585 ASSIGNMENTS=0	UNSAT TT=5.499 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.526 ASSIGNMENTS=0 CHECKS=19	UNSAT TT=0.525 ASSIGNMENTS=0 CHECKS=19	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.536 ASSIGNMENTS=0 CHECKS=19	UNSAT TT=0.499 ASSIGNMENTS=0 CHECKS=19	? (TO) TT=1800.1	UNSAT TT=0.551 ASSIGNMENTS=0 CHECKS=19	UNSAT TT=0.553 ASSIGNMENTS=0 CHECKS=19	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-1-05.xml	UNSAT TT=0.142	UNSAT TT=1.983 CHECKS=10 NODES=0	UNSAT TT=2.063 CHECKS=10 NODES=0	UNSAT TT=0.51	UNSAT TT=0.362 CHECKS=3998	UNSAT TT=0.194 CHECKS=3998	UNSAT TT=2.4 ASSIGNMENTS=0	UNSAT TT=2.441 ASSIGNMENTS=0	UNSAT TT=4.962 CHECKS=23870 NODES=144	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.157 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.406	UNSAT TT=2.25	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.142 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.463	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.228	UNSAT TT=2.05	UNSAT TT=2.155
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-1-25.xml	UNSAT TT=0.133	UNSAT TT=2.185 CHECKS=50 NODES=0	UNSAT TT=2.065 CHECKS=50 NODES=0	UNSAT TT=0.517	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=2.503 ASSIGNMENTS=0	UNSAT TT=2.492 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.153 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=0.141 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=0.133 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.134 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-1-49.xml	SAT TT=0.148	SAT TT=2.258 CHECKS=176336 NODES=197	SAT TT=2.294 CHECKS=156715 NODES=0	SAT TT=0.491	SAT TT=0.464 CHECKS=350054	SAT TT=0.299 CHECKS=395865	SAT TT=3.601 ASSIGNMENTS=147	SAT TT=3.581 ASSIGNMENTS=147	SAT TT=7.226 CHECKS=139292 NODES=197	SAT TT=945.29 CHECKS=6929180000 NODES=1961250	SAT TT=6.673 CHECKS=10990800 NODES=1366	SAT TT=0.159 ASSIGNMENTS=194 CHECKS=8147	SAT TT=0.16 ASSIGNMENTS=194 CHECKS=8147	SAT TT=17.127	SAT TT=12.083	SAT TT=0.149 ASSIGNMENTS=194 CHECKS=8147	SAT TT=0.148 ASSIGNMENTS=194 CHECKS=8172	SAT TT=1.445	SAT TT=0.149 ASSIGNMENTS=193 CHECKS=8174	SAT TT=0.149 ASSIGNMENTS=194 CHECKS=8147	SAT TT=16.898	SAT TT=3.45	SAT TT=6.75
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-2-05.xml	UNSAT TT=0.143	UNSAT TT=1.918 CHECKS=10 NODES=0	UNSAT TT=2.08 CHECKS=10 NODES=0	UNSAT TT=0.513	UNSAT TT=0.358 CHECKS=3914	UNSAT TT=0.194 CHECKS=3914	UNSAT TT=2.433 ASSIGNMENTS=0	UNSAT TT=2.591 ASSIGNMENTS=0	UNSAT TT=5.325 CHECKS=24912 NODES=144	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.371	UNSAT TT=2.397	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.264	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=5.25	UNSAT TT=1.803	UNSAT TT=2.513
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-2-20.xml	UNSAT TT=0.142	UNSAT TT=1.916 CHECKS=40 NODES=0	UNSAT TT=1.918 CHECKS=40 NODES=0	UNSAT TT=0.516	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=2.258 ASSIGNMENTS=0	UNSAT TT=2.645 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.06	UNSAT TT=0.142 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-3-30.xml	UNSAT TT=0.132	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=2.414 ASSIGNMENTS=0	UNSAT TT=2.695 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.147 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.147 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.132 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.02	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.142 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.24	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-4-29.xml	UNSAT TT=0.131	UNSAT TT=1.957 CHECKS=58 NODES=0	UNSAT TT=1.953 CHECKS=58 NODES=0	UNSAT TT=0.514	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.406 ASSIGNMENTS=0	UNSAT TT=2.58 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.154 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=9	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.147 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.148 ASSIGNMENTS=0 CHECKS=9	? (TO) TT=1800.13	UNSAT TT=0.131 ASSIGNMENTS=0 CHECKS=9	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=9	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-4-30.xml	UNSAT TT=0.144	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=2.286 ASSIGNMENTS=0	UNSAT TT=2.642 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.156 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.05	UNSAT TT=0.144 ASSIGNMENTS=0 CHECKS=7	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=7	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.15
csp/graphColoring/ register/mulsol/ normalized-mulsol-i-5-10.xml	UNSAT TT=0.137	UNSAT TT=1.962 CHECKS=20 NODES=0	UNSAT TT=2.154 CHECKS=20 NODES=0	UNSAT TT=0.525	UNSAT TT=1.197 CHECKS=2915630	UNSAT TT=1.406 CHECKS=4182160	UNSAT TT=2.576 ASSIGNMENTS=0	UNSAT TT=2.247 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.158 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.08	UNSAT TT=599.726	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=584.386	UNSAT TT=0.137 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.12	UNSAT TT=7.199	UNSAT TT=11.879
csp/graphColoring/ register/zeroin/ normalized-zeroin-i-1-45.xml	UNSAT TT=0.151	UNSAT TT=2.111 CHECKS=90 NODES=0	UNSAT TT=2.234 CHECKS=90 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=2.465 ASSIGNMENTS=0	UNSAT TT=2.703 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.163 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.163 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (MO) TT=1491.88	UNSAT TT=0.151 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.151 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	UNSAT TT=0.153 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.151 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.08
csp/graphColoring/ register/zeroin/ normalized-zeroin-i-2-28.xml	UNSAT TT=0.129	UNSAT TT=2.018 CHECKS=56 NODES=0	UNSAT TT=2.057 CHECKS=56 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=2.073 ASSIGNMENTS=0	UNSAT TT=2.302 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.143 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.145 ASSIGNMENTS=0 CHECKS=12	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.129 ASSIGNMENTS=0 CHECKS=12	? (TO) TT=1800.03	UNSAT TT=0.131 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=12	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/graphColoring/ register/zeroin/ normalized-zeroin-i-2-30.xml	SAT TT=0.134	SAT TT=2.1 CHECKS=88469 NODES=211	SAT TT=2.184 CHECKS=80672 NODES=0	SAT TT=0.442	SAT TT=0.418 CHECKS=342900	SAT TT=0.266 CHECKS=364654	SAT TT=3.089 ASSIGNMENTS=180	SAT TT=3.405 ASSIGNMENTS=181	SAT TT=5.408 CHECKS=66237 NODES=211	? (TO) TT=1800	SAT TT=5.947 CHECKS=8384530 NODES=1681	SAT TT=0.145 ASSIGNMENTS=209 CHECKS=7365	SAT TT=0.145 ASSIGNMENTS=209 CHECKS=7365	SAT TT=8.523	SAT TT=7.132	SAT TT=0.136 ASSIGNMENTS=209 CHECKS=7365	SAT TT=0.137 ASSIGNMENTS=208 CHECKS=7440	SAT TT=1.237	SAT TT=0.166 ASSIGNMENTS=1478 CHECKS=42809	SAT TT=0.134 ASSIGNMENTS=209 CHECKS=7365	SAT TT=12.88	SAT TT=2.639	SAT TT=4.418
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ school/ normalized-school1-13.xml	UNSAT TT=0.862	UNSAT TT=4.596 CHECKS=98 NODES=0	UNSAT TT=4.963 CHECKS=98 NODES=0	UNSAT TT=2.543	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=9.372 ASSIGNMENTS=0	UNSAT TT=9.631 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.91 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.916 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.88 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.879 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.05	UNSAT TT=0.867 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.862 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.16	? (TO) TT=1800.01	UNSAT TT=770.38
csp/graphColoring/ school/ normalized-school1-14.xml	SAT TT=1.275	SAT TT=5.576 CHECKS=135370 NODES=394	SAT TT=6.366 CHECKS=240254 NODES=0	SAT TT=2.546	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=13.139 ASSIGNMENTS=42	SAT TT=60.937 ASSIGNMENTS=36	SAT TT=213.252 CHECKS=1252360 NODES=4342	SAT TT=213.082 CHECKS=250656000 NODES=154749	SAT TT=162.371 CHECKS=11939600 NODES=770	SAT TT=1.322 ASSIGNMENTS=49 CHECKS=162052	SAT TT=1.322 ASSIGNMENTS=49 CHECKS=162052	SAT TT=20.137	SAT TT=14.993	SAT TT=1.349 ASSIGNMENTS=49 CHECKS=162052	SAT TT=54.496 ASSIGNMENTS=6839 CHECKS=19371800	? (TO) TT=1800.05	SAT TT=12.362 ASSIGNMENTS=2412 CHECKS=4713990	SAT TT=1.275 ASSIGNMENTS=49 CHECKS=162052	SAT TT=14.605	SAT TT=5.897	SAT TT=11.224
csp/graphColoring/ school/ normalized-school1-15.xml	SAT TT=1.291	SAT TT=5.604 CHECKS=151940 NODES=392	SAT TT=5.734 CHECKS=192716 NODES=0	SAT TT=2.573	SAT TT=18.06 CHECKS=19456000	SAT TT=24.727 CHECKS=30608900	SAT TT=401.352 ASSIGNMENTS=1288	? (TO) TT=1800.12	SAT TT=161.971 CHECKS=375977 NODES=1210	SAT TT=141.767 CHECKS=2547270 NODES=861	SAT TT=145.389 CHECKS=12491400 NODES=854	SAT TT=1.35 ASSIGNMENTS=82 CHECKS=176794	SAT TT=1.348 ASSIGNMENTS=82 CHECKS=176794	SAT TT=22.093	SAT TT=15.605	SAT TT=1.291 ASSIGNMENTS=82 CHECKS=176794	SAT TT=52.895 ASSIGNMENTS=8627 CHECKS=18924100	? (TO) TT=1800.07	SAT TT=21.335 ASSIGNMENTS=5858 CHECKS=8747820	SAT TT=1.322 ASSIGNMENTS=82 CHECKS=176794	SAT TT=22.34	SAT TT=6.388	SAT TT=9.828
csp/graphColoring/ school/ normalized-school1-16.xml	SAT TT=0.81	SAT TT=5.447 CHECKS=167334 NODES=388	SAT TT=8.327 CHECKS=585034 NODES=388	SAT TT=2.593	SAT TT=19.81 CHECKS=24507200	SAT TT=21.7 CHECKS=27787400	SAT TT=1688.24 ASSIGNMENTS=3800	? (TO) TT=1800.09	SAT TT=453.869 CHECKS=5659770 NODES=14077	SAT TT=159.304 CHECKS=2599340 NODES=803	SAT TT=148.596 CHECKS=12386700 NODES=947	SAT TT=0.824 ASSIGNMENTS=88 CHECKS=39026	SAT TT=0.831 ASSIGNMENTS=88 CHECKS=39026	SAT TT=23.469	SAT TT=15.134	SAT TT=0.817 ASSIGNMENTS=88 CHECKS=39026	SAT TT=64.986 ASSIGNMENTS=603120 CHECKS=111908000	? (TO) TT=1800.09	SAT TT=1.26 ASSIGNMENTS=6362 CHECKS=749587	SAT TT=0.81 ASSIGNMENTS=87 CHECKS=39026	SAT TT=15.865	SAT TT=6.581	SAT TT=10.344
csp/graphColoring/ school/ normalized-school1-nsh-12.xml	UNSAT TT=0.728	UNSAT TT=4.054 CHECKS=24 NODES=0	UNSAT TT=3.947 CHECKS=24 NODES=0	UNSAT TT=1.938	? (TO) TT=1800.04	? (TO) TT=1800.12	UNSAT TT=7.467 ASSIGNMENTS=0	UNSAT TT=7.556 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=0.741 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.754 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.735 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.728 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=0.749 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.744 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.87	UNSAT TT=322.882	UNSAT TT=250.583
csp/graphColoring/ school/ normalized-school1-nsh-13.xml	UNSAT TT=0.695	UNSAT TT=4.025 CHECKS=26 NODES=0	UNSAT TT=3.765 CHECKS=26 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=7.536 ASSIGNMENTS=0	UNSAT TT=6.726 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.751 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.744 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.695 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.742 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	UNSAT TT=0.743 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.737 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	UNSAT TT=453.034	? (TO) TT=1800.06
csp/graphColoring/ school/ normalized-school1-nsh-14.xml	SAT TT=1.011	SAT TT=15.463 CHECKS=10629900 NODES=3196	SAT TT=5.142 CHECKS=211503 NODES=0	SAT TT=1793.84	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=18.083 ASSIGNMENTS=60	SAT TT=67.647 ASSIGNMENTS=39	SAT TT=91.319 CHECKS=639822 NODES=2013	SAT TT=1322.25 CHECKS=5553030000 NODES=4202190	SAT TT=73.332 CHECKS=8221210 NODES=794	SAT TT=1.059 ASSIGNMENTS=50 CHECKS=129183	SAT TT=1.068 ASSIGNMENTS=50 CHECKS=129183	SAT TT=15.706	SAT TT=12.538	SAT TT=1.011 ASSIGNMENTS=50 CHECKS=129183	SAT TT=42.58 ASSIGNMENTS=6251 CHECKS=14470000	? (TO) TT=1800.11	SAT TT=12.777 ASSIGNMENTS=4754 CHECKS=5415860	SAT TT=1.07 ASSIGNMENTS=50 CHECKS=129183	SAT TT=13.176	SAT TT=6.238	SAT TT=8.39
csp/graphColoring/ school/ normalized-school1-nsh-15.xml	SAT TT=1.072	SAT TT=5.302 CHECKS=451754 NODES=510	SAT TT=6.984 CHECKS=816486 NODES=510	SAT TT=27.003	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=396.32 ASSIGNMENTS=1489	? (TO) TT=1800.13	SAT TT=92.386 CHECKS=571967 NODES=2306	SAT TT=120.719 CHECKS=225342000 NODES=153214	SAT TT=73.808 CHECKS=8942680 NODES=963	SAT TT=1.11 ASSIGNMENTS=97 CHECKS=157057	SAT TT=1.095 ASSIGNMENTS=97 CHECKS=157057	SAT TT=16.923	SAT TT=12.815	SAT TT=1.086 ASSIGNMENTS=97 CHECKS=157057	SAT TT=36.852 ASSIGNMENTS=8745 CHECKS=13517100	? (TO) TT=1800.08	SAT TT=14.345 ASSIGNMENTS=5358 CHECKS=5432380	SAT TT=1.072 ASSIGNMENTS=98 CHECKS=156767	SAT TT=16.38	SAT TT=5.118	SAT TT=8.881
csp/graphColoring/ sgb/book/ normalized-anna-5.xml	UNSAT TT=0.023	UNSAT TT=0.985 CHECKS=0 NODES=0	UNSAT TT=1.012 CHECKS=0 NODES=0	UNSAT TT=0.094	UNSAT TT=0.058 CHECKS=77211	UNSAT TT=0.04 CHECKS=78412	UNSAT TT=1.149 ASSIGNMENTS=0	UNSAT TT=1.163 ASSIGNMENTS=0	UNSAT TT=1.22 CHECKS=10700 NODES=207	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=1.121	UNSAT TT=1.097	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.676	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=14	UNSAT TT=2.372	UNSAT TT=1.243	UNSAT TT=1.245
csp/graphColoring/ sgb/book/ normalized-anna-9.xml	UNSAT TT=0.023	UNSAT TT=1.065 CHECKS=0 NODES=0	UNSAT TT=0.975 CHECKS=0 NODES=0	UNSAT TT=1500.87	UNSAT TT=471.789 CHECKS=1719900000	UNSAT TT=463.632 CHECKS=1704970000	UNSAT TT=1.015 ASSIGNMENTS=0	UNSAT TT=1.038 ASSIGNMENTS=0	UNSAT TT=145.856 CHECKS=22651200 NODES=402628	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=291.473	UNSAT TT=21.715	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=7.534	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=74.711	UNSAT TT=1.879	UNSAT TT=3.555
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ sgb/book/ normalized-david-5.xml	UNSAT TT=0.019	UNSAT TT=0.924 CHECKS=0 NODES=0	UNSAT TT=0.989 CHECKS=0 NODES=0	UNSAT TT=0.079	UNSAT TT=0.039 CHECKS=420	UNSAT TT=0.02 CHECKS=420	UNSAT TT=0.897 ASSIGNMENTS=0	UNSAT TT=0.921 ASSIGNMENTS=0	UNSAT TT=1.162 CHECKS=11038 NODES=170	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=1.092	UNSAT TT=1.005	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.627	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=2.129	UNSAT TT=1.141	UNSAT TT=1.303
csp/graphColoring/ sgb/book/ normalized-david-8.xml	UNSAT TT=0.019	UNSAT TT=0.9 CHECKS=0 NODES=0	UNSAT TT=0.977 CHECKS=0 NODES=0	UNSAT TT=0.748	UNSAT TT=0.045 CHECKS=49829	UNSAT TT=0.029 CHECKS=50665	UNSAT TT=1 ASSIGNMENTS=0	UNSAT TT=0.956 ASSIGNMENTS=0	UNSAT TT=12.187 CHECKS=2285510 NODES=46404	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=5.919	UNSAT TT=2.483	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=1.425	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=6.303	UNSAT TT=1.293	UNSAT TT=1.647
csp/graphColoring/ sgb/book/ normalized-homer-12.xml	UNSAT TT=0.074	UNSAT TT=1310.15 CHECKS=2489650000 NODES=4037900	UNSAT TT=1279.2 CHECKS=2489670000 NODES=4037900	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=1.916 ASSIGNMENTS=0	UNSAT TT=1.628 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.094 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.06	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	UNSAT TT=89.42	UNSAT TT=165.118
csp/graphColoring/ sgb/book/ normalized-huck-10.xml	UNSAT TT=0.015	UNSAT TT=0.966 CHECKS=40043 NODES=94	UNSAT TT=0.918 CHECKS=8025 NODES=0	UNSAT TT=1796.74	UNSAT TT=0.038 CHECKS=38942	UNSAT TT=0.026 CHECKS=38733	UNSAT TT=0.816 ASSIGNMENTS=0	UNSAT TT=0.822 ASSIGNMENTS=0	UNSAT TT=491.328 CHECKS=87762900 NODES=3973090	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.027 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.09	UNSAT TT=56.95	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=61.378	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=525.532	UNSAT TT=2.532	UNSAT TT=11.818
csp/graphColoring/ sgb/book/ normalized-jean-5.xml	UNSAT TT=0.015	UNSAT TT=0.902 CHECKS=10 NODES=0	UNSAT TT=0.824 CHECKS=10 NODES=0	UNSAT TT=0.053	UNSAT TT=0.026 CHECKS=265	UNSAT TT=0.015 CHECKS=265	UNSAT TT=0.748 ASSIGNMENTS=0	UNSAT TT=0.757 ASSIGNMENTS=0	UNSAT TT=0.873 CHECKS=3864 NODES=175	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=1.112	UNSAT TT=0.836	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.509	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=1.771	UNSAT TT=0.818	UNSAT TT=0.84
csp/graphColoring/sgb/games/ normalized-games120-8.xml	UNSAT TT=0.026	UNSAT TT=0.989 CHECKS=0 NODES=0	UNSAT TT=1.022 CHECKS=0 NODES=0	UNSAT TT=0.107	UNSAT TT=71.205 CHECKS=217260000	UNSAT TT=79.359 CHECKS=255602000	UNSAT TT=1.024 ASSIGNMENTS=0	UNSAT TT=1.072 ASSIGNMENTS=0	UNSAT TT=8.988 CHECKS=525431 NODES=46397	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=0.039 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=5.874	UNSAT TT=3.856	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=4.243	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=4	UNSAT TT=4.486	UNSAT TT=1.605	UNSAT TT=1.563
csp/graphColoring/ sgb/miles/ normalized-miles1000-40.xml	UNSAT TT=0.112	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=2.229 ASSIGNMENTS=0	UNSAT TT=2.407 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.133 ASSIGNMENTS=0 CHECKS=3	? (MO) TT=1612.27	? (TO) TT=1800.05	UNSAT TT=0.112 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.113 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.11	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.127 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/graphColoring/ sgb/miles/ normalized-miles1500-30.xml	UNSAT TT=0.198	UNSAT TT=2.214 CHECKS=0 NODES=0	UNSAT TT=2.112 CHECKS=0 NODES=0	UNSAT TT=0.653	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=3.01 ASSIGNMENTS=0	UNSAT TT=2.697 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.215 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.211 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.2 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.21	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/graphColoring/ sgb/miles/ normalized-miles1500-72.xml	UNSAT TT=0.182	UNSAT TT=2.128 CHECKS=0 NODES=0	UNSAT TT=2.135 CHECKS=0 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=2.993 ASSIGNMENTS=0	UNSAT TT=3.104 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.204 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=5	? (MO) TT=956.69	? (MO) TT=488.64	UNSAT TT=0.182 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.187 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.03	UNSAT TT=0.199 ASSIGNMENTS=0 CHECKS=5	UNSAT TT=0.198 ASSIGNMENTS=0 CHECKS=5	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.1
csp/graphColoring/ sgb/miles/ normalized-miles1500-73.xml	SAT TT=0.189	SAT TT=2.357 CHECKS=350364 NODES=128	SAT TT=2.31 CHECKS=335666 NODES=0	SAT TT=0.622	SAT TT=0.626 CHECKS=682749	SAT TT=0.47 CHECKS=742486	SAT TT=4.018 ASSIGNMENTS=56	SAT TT=3.911 ASSIGNMENTS=56	SAT TT=15.513 CHECKS=502271 NODES=848	SAT TT=8.563 CHECKS=3523770 NODES=288	SAT TT=11.322 CHECKS=12696400 NODES=955	SAT TT=0.222 ASSIGNMENTS=127 CHECKS=10476	SAT TT=0.217 ASSIGNMENTS=127 CHECKS=10476	SAT TT=46.209	SAT TT=17.949	SAT TT=0.203 ASSIGNMENTS=127 CHECKS=10476	SAT TT=0.202 ASSIGNMENTS=126 CHECKS=10476	SAT TT=1.401	SAT TT=0.695 ASSIGNMENTS=12194 CHECKS=685702	SAT TT=0.189 ASSIGNMENTS=127 CHECKS=10475	SAT TT=72.818	SAT TT=4.551	SAT TT=11.586
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ sgb/miles/ normalized-miles500-10.xml	UNSAT TT=0.046	UNSAT TT=1.182 CHECKS=0 NODES=0	UNSAT TT=1.19 CHECKS=0 NODES=0	UNSAT TT=0.171	? (TO) TT=1800.08	UNSAT TT=1708.98 CHECKS=8019910000	UNSAT TT=1.539 ASSIGNMENTS=0	UNSAT TT=1.284 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=11	? (TO) TT=1800.08	UNSAT TT=179.749	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=103.186	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=11	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=11	? (TO) TT=1800.13	UNSAT TT=6.868	UNSAT TT=7.457
csp/graphColoring/ sgb/miles/ normalized-miles500-15.xml	UNSAT TT=0.045	UNSAT TT=1.204 CHECKS=0 NODES=0	UNSAT TT=1.209 CHECKS=0 NODES=0	UNSAT TT=0.172	? (TO) TT=1800.02	? (TO) TT=1800.11	UNSAT TT=1.354 ASSIGNMENTS=0	UNSAT TT=1.529 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.15
csp/graphColoring/ sgb/miles/ normalized-miles500-19.xml	UNSAT TT=0.044	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=1.284 ASSIGNMENTS=0	UNSAT TT=1.292 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=6	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=6	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.044 ASSIGNMENTS=0 CHECKS=6	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=6	? (TO) TT=1800.04	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=6	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=6	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.06
csp/graphColoring/ sgb/miles/ normalized-miles750-15.xml	UNSAT TT=0.075	UNSAT TT=1.336 CHECKS=0 NODES=0	UNSAT TT=1.358 CHECKS=0 NODES=0	UNSAT TT=0.285	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=1.651 ASSIGNMENTS=0	UNSAT TT=1.966 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=0.086 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.085 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.08 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.06	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=3	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05
csp/graphColoring/ sgb/miles/ normalized-miles750-29.xml	UNSAT TT=0.074	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=1.913 ASSIGNMENTS=0	UNSAT TT=1.715 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.092 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.091 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.11	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=2	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=2	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.07
csp/graphColoring/ sgb/miles/ normalized-miles750-31.xml	SAT TT=0.08	SAT TT=1.615 CHECKS=49632 NODES=128	SAT TT=1.496 CHECKS=49299 NODES=0	SAT TT=0.294	SAT TT=11.6 CHECKS=56627200	SAT TT=17.111 CHECKS=86464500	SAT TT=2.289 ASSIGNMENTS=93	SAT TT=2.143 ASSIGNMENTS=93	SAT TT=3.571 CHECKS=71743 NODES=761	SAT TT=3.162 CHECKS=2529390 NODES=1525	SAT TT=2.74 CHECKS=1839400 NODES=449	SAT TT=0.097 ASSIGNMENTS=122 CHECKS=4443	SAT TT=0.095 ASSIGNMENTS=122 CHECKS=4443	SAT TT=6.362	SAT TT=5.398	SAT TT=0.081 ASSIGNMENTS=122 CHECKS=4443	SAT TT=0.096 ASSIGNMENTS=986 CHECKS=20827	? (TO) TT=1800.07	SAT TT=0.195 ASSIGNMENTS=4572 CHECKS=122022	SAT TT=0.08 ASSIGNMENTS=122 CHECKS=4443	SAT TT=13.487	SAT TT=2.029	SAT TT=3.2
csp/graphColoring/sgb/miles/ normalized-miles750-5.xml	UNSAT TT=0.079	UNSAT TT=1.422 CHECKS=0 NODES=0	UNSAT TT=1.388 CHECKS=0 NODES=0	UNSAT TT=0.288	UNSAT TT=0.187 CHECKS=165603	UNSAT TT=0.119 CHECKS=321911	UNSAT TT=1.824 ASSIGNMENTS=0	UNSAT TT=1.774 ASSIGNMENTS=0	UNSAT TT=2.531 CHECKS=6650 NODES=177	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.093 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.092 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.821	UNSAT TT=1.695	UNSAT TT=0.079 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.08 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.999	UNSAT TT=0.08 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.079 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=4.055	UNSAT TT=1.859	UNSAT TT=2.036
csp/graphColoring/ sgb/queen/ normalized-queen12-12-11.xml	UNSAT TT=0.095	UNSAT TT=1.487 CHECKS=22 NODES=0	UNSAT TT=1.501 CHECKS=22 NODES=0	UNSAT TT=0.349	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=1.993 ASSIGNMENTS=0	UNSAT TT=1.995 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.108 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.106 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=0.097 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.095 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=0.098 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.095 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	UNSAT TT=14.58	UNSAT TT=11.473
csp/graphColoring/ sgb/queen/ normalized-queen12-12-14.xml	SAT TT=0.933	SAT TT=11.095 CHECKS=11316300 NODES=57864	SAT TT=3.649 CHECKS=2120150 NODES=10938	SAT TT=55.645	SAT TT=154.714 CHECKS=773226000	? (TO) TT=1800.09	SAT TT=110.288 ASSIGNMENTS=44105	SAT TT=58.191 ASSIGNMENTS=19702	SAT TT=205.791 CHECKS=14143100 NODES=235468	SAT TT=3.249 CHECKS=354296 NODES=402	SAT TT=3.097 CHECKS=1304330 NODES=723	SAT TT=8.236 ASSIGNMENTS=18697 CHECKS=2180330	SAT TT=170.448 ASSIGNMENTS=1183720 CHECKS=229036000	SAT TT=13.117	SAT TT=104.096	SAT TT=9.722 ASSIGNMENTS=224516 CHECKS=28313200	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=8.248 ASSIGNMENTS=134597 CHECKS=20559400	SAT TT=0.933 ASSIGNMENTS=18697 CHECKS=2180330	SAT TT=318.771	SAT TT=4.296	SAT TT=18.875
csp/graphColoring/ sgb/queen/ normalized-queen15-15-15.xml		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/graphColoring/ sgb/queen/ normalized-queen8-12-10.xml	UNSAT TT=0.051	UNSAT TT=1.183 CHECKS=39 NODES=0	UNSAT TT=1.187 CHECKS=39 NODES=0	UNSAT TT=0.195	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=1.366 ASSIGNMENTS=0	UNSAT TT=1.667 ASSIGNMENTS=0	UNSAT TT=1723.99 CHECKS=208480000 NODES=3957090	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=105.644	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=169.906	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.051 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.14	UNSAT TT=6.037	UNSAT TT=6.162
csp/graphColoring/ sgb/queen/ normalized-queen8-12-12.xml	SAT TT=0.055	SAT TT=1.633 CHECKS=137462 NODES=1126	SAT TT=1.517 CHECKS=60950 NODES=381	SAT TT=0.199	SAT TT=12.677 CHECKS=59749000	SAT TT=17.781 CHECKS=86672000	SAT TT=4.378 ASSIGNMENTS=442	SAT TT=3.867 ASSIGNMENTS=216	SAT TT=3.927 CHECKS=210328 NODES=4735	SAT TT=2.047 CHECKS=168024 NODES=294	SAT TT=1.885 CHECKS=235212 NODES=159	SAT TT=0.068 ASSIGNMENTS=142 CHECKS=11878	SAT TT=0.07 ASSIGNMENTS=142 CHECKS=11878	SAT TT=3.126	SAT TT=2.829	SAT TT=0.055 ASSIGNMENTS=109 CHECKS=8748	SAT TT=0.217 ASSIGNMENTS=8173 CHECKS=284561	? (TO) TT=1800.1	SAT TT=0.097 ASSIGNMENTS=1686 CHECKS=64223	SAT TT=0.076 ASSIGNMENTS=644 CHECKS=54793	SAT TT=4.109	SAT TT=1.566	SAT TT=1.665
csp/graphColoring/sgb/queen/ normalized-queen8-8-9.xml	SAT TT=0.945	SAT TT=6.942 CHECKS=7271100 NODES=47953	SAT TT=19.133 CHECKS=23097800 NODES=153835	SAT TT=1.142	SAT TT=18.018 CHECKS=87082500	SAT TT=17.548 CHECKS=84234100	SAT TT=43.731 ASSIGNMENTS=29099	SAT TT=2.509 ASSIGNMENTS=366	SAT TT=20.799 CHECKS=3301950 NODES=75147	SAT TT=1.394 CHECKS=265219 NODES=1167	SAT TT=2 CHECKS=6091950 NODES=8222	SAT TT=13.614 ASSIGNMENTS=47433 CHECKS=7006570	SAT TT=13.746 ASSIGNMENTS=47433 CHECKS=7006570	SAT TT=23.637	SAT TT=43.667	SAT TT=364.165 ASSIGNMENTS=7729060 CHECKS=774419000	SAT TT=1.778 ASSIGNMENTS=36783 CHECKS=3795950	? (TO) TT=1800.06	SAT TT=3.717 ASSIGNMENTS=72578 CHECKS=7359090	SAT TT=0.945 ASSIGNMENTS=19063 CHECKS=1970120	SAT TT=57.955	SAT TT=92.648	SAT TT=3.746
csp/haystacks/ normalized-haystacks-05.xml	UNSAT TT=0.008	UNSAT TT=0.726 CHECKS=643 NODES=22	UNSAT TT=0.75 CHECKS=599 NODES=0	UNSAT TT=0.034	UNSAT TT=2.443 CHECKS=3959920	UNSAT TT=5.118 CHECKS=10436200	UNSAT TT=0.755 ASSIGNMENTS=0	UNSAT TT=0.734 ASSIGNMENTS=0	UNSAT TT=8.26 CHECKS=4136230 NODES=291029	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=116 CHECKS=3395	UNSAT TT=0.023 ASSIGNMENTS=116 CHECKS=3395	UNSAT TT=0.946	UNSAT TT=0.727	UNSAT TT=0.008 ASSIGNMENTS=25 CHECKS=992	UNSAT TT=0.018 ASSIGNMENTS=593 CHECKS=13494	UNSAT TT=40.869	UNSAT TT=0.012 ASSIGNMENTS=168 CHECKS=4148	UNSAT TT=0.009 ASSIGNMENTS=67 CHECKS=2098	UNSAT TT=1.174	UNSAT TT=0.626	UNSAT TT=0.626
csp/haystacks/ normalized-haystacks-08.xml	UNSAT TT=0.068	UNSAT TT=1.152 CHECKS=14842 NODES=228	UNSAT TT=1.073 CHECKS=11920 NODES=0	UNSAT TT=0.2	? (TO) TT=1800.06	? (TO) TT=1800.11	UNSAT TT=1.265 ASSIGNMENTS=0	UNSAT TT=1.47 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=0.707 ASSIGNMENTS=8136 CHECKS=979305	UNSAT TT=0.7 ASSIGNMENTS=8136 CHECKS=979305	UNSAT TT=1.479	UNSAT TT=1.238	UNSAT TT=0.171 ASSIGNMENTS=1864 CHECKS=226773	UNSAT TT=0.359 ASSIGNMENTS=7467 CHECKS=490913	? (TO) TT=1800.09	UNSAT TT=0.462 ASSIGNMENTS=4265 CHECKS=520719	UNSAT TT=0.068 ASSIGNMENTS=641 CHECKS=77490	UNSAT TT=3.267	UNSAT TT=1.532	UNSAT TT=1.595
csp/haystacks/ normalized-haystacks-10.xml	UNSAT TT=0.236	UNSAT TT=1.425 CHECKS=264202 NODES=2381	UNSAT TT=1.085 CHECKS=13661 NODES=0	UNSAT TT=8.325	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=1.791 ASSIGNMENTS=0	UNSAT TT=1.861 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=8.616 ASSIGNMENTS=0	UNSAT TT=7.408 ASSIGNMENTS=1965 CHECKS=309611	UNSAT TT=85.589	UNSAT TT=162.938	UNSAT TT=5.558 ASSIGNMENTS=44199 CHECKS=7929500	UNSAT TT=5.771 ASSIGNMENTS=53286 CHECKS=8357500	? (TO) TT=1800.03	UNSAT TT=61.827 ASSIGNMENTS=294993 CHECKS=66933400	UNSAT TT=0.236 ASSIGNMENTS=1965 CHECKS=309611	UNSAT TT=70.84	UNSAT TT=3.075	UNSAT TT=13.409
csp/haystacks/ normalized-haystacks-11.xml	UNSAT TT=1.221	UNSAT TT=2.868 CHECKS=1423860 NODES=10110	UNSAT TT=1.221 CHECKS=15578 NODES=0	UNSAT TT=82.683	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=2.006 ASSIGNMENTS=0	UNSAT TT=2.326 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=9.417 ASSIGNMENTS=0	UNSAT TT=8.657 ASSIGNMENTS=10883 CHECKS=2129330	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=52.487 ASSIGNMENTS=357213 CHECKS=74332800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=1.601 ASSIGNMENTS=10883 CHECKS=2129330	UNSAT TT=1722.22	UNSAT TT=11.672	UNSAT TT=81.18
csp/haystacks/ normalized-haystacks-12.xml	UNSAT TT=1.399	UNSAT TT=5.091 CHECKS=3259090 NODES=21500	UNSAT TT=1.399 CHECKS=21535 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=2.193 ASSIGNMENTS=0	UNSAT TT=2.355 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=9.377 ASSIGNMENTS=0	UNSAT TT=11.22 ASSIGNMENTS=18116 CHECKS=4177240	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=607.708 ASSIGNMENTS=3351570 CHECKS=779363000	UNSAT TT=491.989 ASSIGNMENTS=2758640 CHECKS=641731000	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=3.512 ASSIGNMENTS=18116 CHECKS=4177240	? (TO) TT=1800.14	UNSAT TT=48.373	UNSAT TT=271.214
csp/haystacks/ normalized-haystacks-15.xml	UNSAT TT=1.935	UNSAT TT=1428.17 CHECKS=1485810000 NODES=6657340	UNSAT TT=1.935 CHECKS=66002 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=3.568 ASSIGNMENTS=0	UNSAT TT=4.414 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=11.092 ASSIGNMENTS=0	UNSAT TT=15.438 ASSIGNMENTS=28686 CHECKS=8513550	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=7.82 ASSIGNMENTS=28686 CHECKS=8513550	? (TO) TT=1801.09	? (TO) TT=1800.16	? (TO) TT=1800.13
csp/haystacks/ normalized-haystacks-16.xml	UNSAT TT=2.343	? (TO) TT=1800.13	UNSAT TT=2.343 CHECKS=114052 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=4.181 ASSIGNMENTS=0	UNSAT TT=6.574 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=11.73 ASSIGNMENTS=0	UNSAT TT=25.783 ASSIGNMENTS=58043 CHECKS=18972200	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=18.253 ASSIGNMENTS=58043 CHECKS=18972200	? (TO) TT=1800.17	? (TO) TT=1800	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/haystacks/ normalized-haystacks-20.xml	UNSAT TT=5.291	? (TO) TT=1800.12	UNSAT TT=5.291 CHECKS=533629 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=8.396 ASSIGNMENTS=0	UNSAT TT=8.179 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=16.988 ASSIGNMENTS=0	UNSAT TT=1246.92 ASSIGNMENTS=1612090 CHECKS=927161000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=59.336 ASSIGNMENTS=106711 CHECKS=36221900	UNSAT TT=1129.61 ASSIGNMENTS=1612090 CHECKS=927161000	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.02
csp/haystacks/ normalized-haystacks-29.xml	UNSAT TT=32.486	? (TO) TT=1800.13	UNSAT TT=33.389 CHECKS=2444860 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=32.486 ASSIGNMENTS=0	UNSAT TT=33.811 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (MO) TT=1637.31	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/haystacks/ normalized-haystacks-30.xml	UNSAT TT=33.602	? (TO) TT=1800.11	UNSAT TT=33.602 CHECKS=2076730 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=37.308 ASSIGNMENTS=0	UNSAT TT=33.771 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? (MO) TT=1297.68	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/haystacks/ normalized-haystacks-35.xml	UNSAT TT=64.511	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=68.248 ASSIGNMENTS=0	UNSAT TT=64.511 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (MO) TT=1200.16	? (MO) TT=821.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.01	? (TO) TT=1800.07
csp/haystacks/ normalized-haystacks-36.xml	UNSAT TT=54.709	? (TO) TT=1800.14	UNSAT TT=54.709 CHECKS=3017070 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=71.09 ASSIGNMENTS=0	UNSAT TT=78.083 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (MO) TT=1200.06	? (MO) TT=1150.21	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.1	? (exit code) TT=1125.36	? (TO) TT=1800.05	? (TO) TT=1800.11
csp/haystacks/ normalized-haystacks-43.xml	UNSAT TT=145.621	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=145.621 ASSIGNMENTS=0	UNSAT TT=181.6 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (MO) TT=1399.32	? (MO) TT=1143.88	? (TO) TT=1800.04	? (TO) TT=1800.11	? (exit code) TT=157.168	? (TO) TT=1800.03	? (TO) TT=1800.08	? TT=216.778	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/haystacks/ normalized-haystacks-45.xml	UNSAT TT=346.213	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=346.213 ASSIGNMENTS=0	UNSAT TT=361.143 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800	? (MO) TT=1373.71	? (MO) TT=1049.22	? (TO) TT=1800.05	? (TO) TT=1800.04	? (exit code) TT=205.771	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=787.547	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/haystacks/ normalized-haystacks-48.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (MO) TT=1436.19	? (MO) TT=1025.43	? (TO) TT=1800.09	? (TO) TT=1800.04	? (exit code) TT=363.877	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=586.121	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/haystacks/ normalized-haystacks-54.xml		? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (MO) TT=1489.49	? (MO) TT=409.51	? (TO) TT=1800.1	? (TO) TT=1800.06	? (exit code) TT=621.692	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=205.855	? (TO) TT=1800.13	? (TO) TT=1800.01
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-10.xml	SAT TT=0.071	SAT TT=2.13 CHECKS=2161970 NODES=1472	SAT TT=2.016 CHECKS=1071380 NODES=523	SAT TT=0.09	SAT TT=23.583 CHECKS=54863000	SAT TT=34.537 CHECKS=75404300	SAT TT=1.368 ASSIGNMENTS=80	SAT TT=1.724 ASSIGNMENTS=80	SAT TT=1.394 CHECKS=0 NODES=51	SAT TT=17.175 CHECKS=192326000 NODES=157539	SAT TT=1.637 CHECKS=9190790 NODES=5254	SAT TT=0.256 ASSIGNMENTS=1109 CHECKS=1808670	SAT TT=0.257 ASSIGNMENTS=1109 CHECKS=1808670	SAT TT=480.631	SAT TT=33.895	SAT TT=0.345 ASSIGNMENTS=1770 CHECKS=2556840	SAT TT=0.073 ASSIGNMENTS=858 CHECKS=388319	SAT TT=0.735	SAT TT=0.199 ASSIGNMENTS=1629 CHECKS=1166960	SAT TT=0.071 ASSIGNMENTS=405 CHECKS=364951	SAT TT=33.062	SAT TT=1.056	SAT TT=1.548
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-1.xml	SAT TT=0.04	SAT TT=1.916 CHECKS=800721 NODES=537	SAT TT=1.922 CHECKS=308967 NODES=84	SAT TT=0.089	SAT TT=17.473 CHECKS=40952800	SAT TT=18.261 CHECKS=47069000	SAT TT=1.361 ASSIGNMENTS=71	SAT TT=1.451 ASSIGNMENTS=71	SAT TT=1.283 CHECKS=0 NODES=224	SAT TT=50.803 CHECKS=572198000 NODES=482337	SAT TT=1.123 CHECKS=368461 NODES=76	SAT TT=0.117 ASSIGNMENTS=592 CHECKS=656739	SAT TT=0.116 ASSIGNMENTS=592 CHECKS=656739	SAT TT=397.674	SAT TT=23.088	SAT TT=0.107 ASSIGNMENTS=768 CHECKS=642394	SAT TT=0.111 ASSIGNMENTS=1512 CHECKS=667826	SAT TT=0.729	SAT TT=0.062 ASSIGNMENTS=574 CHECKS=254308	SAT TT=0.04 ASSIGNMENTS=109 CHECKS=136278	SAT TT=13.89	SAT TT=1.102	SAT TT=1.428
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-2.xml	SAT TT=0.022	SAT TT=1.954 CHECKS=214299 NODES=122	SAT TT=1.775 CHECKS=149112 NODES=0	SAT TT=0.085	SAT TT=18.561 CHECKS=50904200	SAT TT=17.468 CHECKS=49716500	SAT TT=1.406 ASSIGNMENTS=94	SAT TT=1.335 ASSIGNMENTS=94	SAT TT=1.295 CHECKS=0 NODES=93	SAT TT=16.01 CHECKS=183593000 NODES=152233	SAT TT=0.966 CHECKS=415127 NODES=76	SAT TT=0.05 ASSIGNMENTS=278 CHECKS=103472	SAT TT=0.048 ASSIGNMENTS=278 CHECKS=103472	SAT TT=460.467	SAT TT=24.576	SAT TT=0.048 ASSIGNMENTS=602 CHECKS=213659	SAT TT=0.04 ASSIGNMENTS=315 CHECKS=147814	SAT TT=0.733	SAT TT=0.022 ASSIGNMENTS=68 CHECKS=18956	SAT TT=0.023 ASSIGNMENTS=102 CHECKS=33530	SAT TT=11.033	SAT TT=1.094	SAT TT=1.362
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-3.xml	SAT TT=0.048	? (TO) TT=1800.11	? (TO) TT=1800.15	SAT TT=0.085	SAT TT=46.991 CHECKS=104102000	? (TO) TT=1800.08	SAT TT=1.661 ASSIGNMENTS=78	SAT TT=1.44 ASSIGNMENTS=78	SAT TT=7.664 CHECKS=0 NODES=46978	SAT TT=16.75 CHECKS=198037000 NODES=166163	SAT TT=3.645 CHECKS=36341900 NODES=21036	SAT TT=8.89 ASSIGNMENTS=78	SAT TT=7.154 ASSIGNMENTS=243 CHECKS=256362	SAT TT=511.733	SAT TT=43.776	SAT TT=26.031 ASSIGNMENTS=162078 CHECKS=205884000	SAT TT=0.048 ASSIGNMENTS=533 CHECKS=187006	? (TO) TT=1800.03	SAT TT=0.058 ASSIGNMENTS=603 CHECKS=202779	SAT TT=0.054 ASSIGNMENTS=243 CHECKS=256362	SAT TT=101.047	SAT TT=1.012	SAT TT=1.4
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-4.xml	SAT TT=0.021	SAT TT=1.81 CHECKS=370352 NODES=215	SAT TT=1.719 CHECKS=60534 NODES=0	SAT TT=0.086	SAT TT=11.555 CHECKS=33484100	SAT TT=23.971 CHECKS=62311600	SAT TT=1.531 ASSIGNMENTS=84	SAT TT=1.565 ASSIGNMENTS=84	SAT TT=1.287 CHECKS=0 NODES=144	SAT TT=6.551 CHECKS=64047300 NODES=53959	SAT TT=1.004 CHECKS=959150 NODES=478	SAT TT=0.294 ASSIGNMENTS=1124 CHECKS=2269000	SAT TT=0.295 ASSIGNMENTS=1124 CHECKS=2269000	SAT TT=361.781	SAT TT=25.582	SAT TT=0.339 ASSIGNMENTS=1562 CHECKS=2748610	SAT TT=0.068 ASSIGNMENTS=808 CHECKS=381872	SAT TT=278.94	SAT TT=0.034 ASSIGNMENTS=241 CHECKS=76621	SAT TT=0.021 ASSIGNMENTS=47 CHECKS=13160	SAT TT=9.996	SAT TT=0.981	SAT TT=1.564
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-5.xml	SAT TT=0.022	SAT TT=1.873 CHECKS=217212 NODES=131	SAT TT=1.779 CHECKS=59168 NODES=0	SAT TT=0.089	SAT TT=12.363 CHECKS=28161500	SAT TT=18.061 CHECKS=42792800	SAT TT=1.331 ASSIGNMENTS=90	SAT TT=1.441 ASSIGNMENTS=90	SAT TT=1.376 CHECKS=0 NODES=50	SAT TT=1.494 CHECKS=6252450 NODES=4874	SAT TT=0.948 CHECKS=498468 NODES=165	SAT TT=0.034 ASSIGNMENTS=82 CHECKS=24868	SAT TT=0.035 ASSIGNMENTS=82 CHECKS=24868	SAT TT=369.898	SAT TT=25.411	SAT TT=0.022 ASSIGNMENTS=84 CHECKS=29880	SAT TT=0.023 ASSIGNMENTS=134 CHECKS=38333	SAT TT=0.867	SAT TT=0.035 ASSIGNMENTS=257 CHECKS=78520	SAT TT=0.023 ASSIGNMENTS=69 CHECKS=23514	SAT TT=10.634	SAT TT=1.096	SAT TT=1.534
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-6.xml	SAT TT=0.024	SAT TT=1.854 CHECKS=74689 NODES=50	SAT TT=1.882 CHECKS=67056 NODES=0	SAT TT=0.093	SAT TT=0.411 CHECKS=9948	SAT TT=0.025 CHECKS=11088	SAT TT=1.402 ASSIGNMENTS=97	SAT TT=1.311 ASSIGNMENTS=97	SAT TT=1.574 CHECKS=0 NODES=50	SAT TT=1.324 CHECKS=2893570 NODES=2065	SAT TT=1.014 CHECKS=379891 NODES=53	SAT TT=0.04 ASSIGNMENTS=107 CHECKS=46400	SAT TT=0.037 ASSIGNMENTS=107 CHECKS=46400	SAT TT=326.105	SAT TT=24.763	SAT TT=0.026 ASSIGNMENTS=106 CHECKS=45160	SAT TT=0.024 ASSIGNMENTS=60 CHECKS=17712	SAT TT=0.869	SAT TT=0.034 ASSIGNMENTS=312 CHECKS=77931	SAT TT=0.033 ASSIGNMENTS=151 CHECKS=66370	SAT TT=11.252	SAT TT=1.026	SAT TT=1.507
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-7.xml	SAT TT=0.036	SAT TT=1.856 CHECKS=221884 NODES=134	SAT TT=1.764 CHECKS=90807 NODES=0	SAT TT=892.633	SAT TT=0.432 CHECKS=11521	SAT TT=0.025 CHECKS=11490	SAT TT=1.364 ASSIGNMENTS=78	SAT TT=1.455 ASSIGNMENTS=78	SAT TT=1.306 CHECKS=0 NODES=50	SAT TT=1.227 CHECKS=2732830 NODES=2015	SAT TT=1.14 CHECKS=2733380 NODES=1552	SAT TT=1.102 ASSIGNMENTS=5457 CHECKS=8306140	SAT TT=1.012 ASSIGNMENTS=5457 CHECKS=8306140	SAT TT=507.081	SAT TT=23.812	SAT TT=1.069 ASSIGNMENTS=5449 CHECKS=8336000	SAT TT=0.055 ASSIGNMENTS=591 CHECKS=247544	SAT TT=0.736	SAT TT=0.036 ASSIGNMENTS=267 CHECKS=86154	SAT TT=0.066 ASSIGNMENTS=405 CHECKS=335762	SAT TT=11.036	SAT TT=1.149	SAT TT=1.627
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-8.xml	SAT TT=0.042	SAT TT=2.11 CHECKS=911704 NODES=524	SAT TT=1.941 CHECKS=526002 NODES=167	SAT TT=0.083	SAT TT=23.731 CHECKS=50989800	SAT TT=34.618 CHECKS=77524700	SAT TT=1.347 ASSIGNMENTS=75	SAT TT=1.359 ASSIGNMENTS=75	SAT TT=1.273 CHECKS=0 NODES=98	SAT TT=14.155 CHECKS=171275000 NODES=144154	SAT TT=1.363 CHECKS=5646380 NODES=3338	SAT TT=0.213 ASSIGNMENTS=968 CHECKS=1408010	SAT TT=0.214 ASSIGNMENTS=968 CHECKS=1408010	SAT TT=391.208	SAT TT=23.506	SAT TT=0.119 ASSIGNMENTS=1165 CHECKS=826614	SAT TT=0.151 ASSIGNMENTS=2191 CHECKS=1059170	? (TO) TT=1800.1	SAT TT=0.043 ASSIGNMENTS=386 CHECKS=118237	SAT TT=0.042 ASSIGNMENTS=196 CHECKS=169534	SAT TT=22.407	SAT TT=1.142	SAT TT=1.37
csp/jobShop-e0ddr1/ normalized-e0ddr1-10-by-5-9.xml	SAT TT=0.024	SAT TT=1.963 CHECKS=68293 NODES=50	SAT TT=1.826 CHECKS=100238 NODES=0	SAT TT=0.088	SAT TT=0.43 CHECKS=9015	SAT TT=0.027 CHECKS=15480	SAT TT=1.474 ASSIGNMENTS=82	SAT TT=1.366 ASSIGNMENTS=82	SAT TT=1.371 CHECKS=0 NODES=50	SAT TT=1.047 CHECKS=503160 NODES=155	SAT TT=1.015 CHECKS=357657 NODES=28	SAT TT=0.037 ASSIGNMENTS=80 CHECKS=29728	SAT TT=0.037 ASSIGNMENTS=80 CHECKS=29728	SAT TT=376.645	SAT TT=24.355	SAT TT=0.027 ASSIGNMENTS=88 CHECKS=34690	SAT TT=0.027 ASSIGNMENTS=114 CHECKS=44617	SAT TT=0.728	SAT TT=0.042 ASSIGNMENTS=465 CHECKS=113488	SAT TT=0.024 ASSIGNMENTS=74 CHECKS=21156	SAT TT=12.301	SAT TT=1.07	SAT TT=1.527
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-10.xml	SAT TT=0.03	SAT TT=1.988 CHECKS=80049 NODES=50	SAT TT=1.962 CHECKS=78774 NODES=0	SAT TT=0.087	SAT TT=0.448 CHECKS=123601	SAT TT=0.072 CHECKS=123347	SAT TT=1.402 ASSIGNMENTS=119	SAT TT=1.319 ASSIGNMENTS=119	SAT TT=1.507 CHECKS=0 NODES=50	SAT TT=2.369 CHECKS=16008800 NODES=11365	SAT TT=1.101 CHECKS=1401440 NODES=632	SAT TT=0.042 ASSIGNMENTS=131 CHECKS=60017	SAT TT=0.041 ASSIGNMENTS=131 CHECKS=60017	SAT TT=606.856	SAT TT=33.463	SAT TT=0.03 ASSIGNMENTS=131 CHECKS=60017	SAT TT=0.065 ASSIGNMENTS=664 CHECKS=324080	SAT TT=0.696	SAT TT=0.038 ASSIGNMENTS=447 CHECKS=102740	SAT TT=0.104 ASSIGNMENTS=598 CHECKS=729398	SAT TT=12.943	SAT TT=1.051	SAT TT=1.605
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-1.xml	SAT TT=0.042	SAT TT=2.258 CHECKS=383132 NODES=157	SAT TT=2.056 CHECKS=393670 NODES=74	SAT TT=581.235	SAT TT=25.607 CHECKS=53621400	SAT TT=35.523 CHECKS=78798500	SAT TT=1.445 ASSIGNMENTS=79	SAT TT=1.456 ASSIGNMENTS=79	SAT TT=1.518 CHECKS=0 NODES=147	SAT TT=649.692 CHECKS=8266180000 NODES=6301700	? (TO) TT=1800.07	SAT TT=0.057 ASSIGNMENTS=333 CHECKS=180816	SAT TT=0.058 ASSIGNMENTS=333 CHECKS=180816	SAT TT=588.304	SAT TT=79.168	SAT TT=0.05 ASSIGNMENTS=455 CHECKS=225497	SAT TT=0.549 ASSIGNMENTS=7576 CHECKS=4406720	SAT TT=1207.63	SAT TT=1.876 ASSIGNMENTS=9623 CHECKS=14270000	SAT TT=0.042 ASSIGNMENTS=194 CHECKS=161857	SAT TT=12.14	SAT TT=1.145	SAT TT=1.618
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-2.xml	SAT TT=0.531	SAT TT=2.324 CHECKS=1225870 NODES=510	SAT TT=2.073 CHECKS=912247 NODES=213	SAT TT=913.923	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=1.564 ASSIGNMENTS=124	SAT TT=1.568 ASSIGNMENTS=124	SAT TT=2.338 CHECKS=0 NODES=7566	SAT TT=470.696 CHECKS=5821060000 NODES=4477470	? (TO) TT=1800.06	SAT TT=0.964 ASSIGNMENTS=4676 CHECKS=7693550	SAT TT=0.902 ASSIGNMENTS=4676 CHECKS=7693550	SAT TT=760.781	SAT TT=143.742	SAT TT=0.855 ASSIGNMENTS=4481 CHECKS=7567780	SAT TT=9.294 ASSIGNMENTS=46248 CHECKS=75939100	SAT TT=969.822	SAT TT=4.511 ASSIGNMENTS=21955 CHECKS=34145900	SAT TT=0.531 ASSIGNMENTS=2658 CHECKS=4139960	SAT TT=462.925	SAT TT=1.14	SAT TT=1.53
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-3.xml	SAT TT=0.027	SAT TT=2.151 CHECKS=376894 NODES=132	SAT TT=2.231 CHECKS=502465 NODES=119	SAT TT=0.09	SAT TT=36.938 CHECKS=85497800	SAT TT=41.013 CHECKS=102981000	SAT TT=1.312 ASSIGNMENTS=106	SAT TT=1.531 ASSIGNMENTS=106	SAT TT=1.642 CHECKS=0 NODES=50	SAT TT=278.599 CHECKS=3618530000 NODES=2705990	SAT TT=1.21 CHECKS=834162 NODES=306	SAT TT=0.037 ASSIGNMENTS=116 CHECKS=43828	SAT TT=0.039 ASSIGNMENTS=116 CHECKS=43828	SAT TT=657.615	SAT TT=43.189	SAT TT=0.027 ASSIGNMENTS=116 CHECKS=43828	SAT TT=0.254 ASSIGNMENTS=3457 CHECKS=1757560	SAT TT=0.741	SAT TT=0.049 ASSIGNMENTS=535 CHECKS=162875	SAT TT=0.192 ASSIGNMENTS=867 CHECKS=1412520	SAT TT=12.439	SAT TT=1.118	SAT TT=1.538
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-4.xml	SAT TT=0.039	SAT TT=2.045 CHECKS=93785 NODES=59	SAT TT=2.05 CHECKS=213236 NODES=0	SAT TT=917.112	SAT TT=11.89 CHECKS=27986800	SAT TT=17.53 CHECKS=43080200	SAT TT=1.315 ASSIGNMENTS=96	SAT TT=1.316 ASSIGNMENTS=96	SAT TT=1.581 CHECKS=0 NODES=50	SAT TT=1.382 CHECKS=4480230 NODES=3042	SAT TT=0.988 CHECKS=716294 NODES=240	SAT TT=0.041 ASSIGNMENTS=157 CHECKS=61183	SAT TT=0.044 ASSIGNMENTS=157 CHECKS=61183	SAT TT=654.893	SAT TT=56.34	SAT TT=0.062 ASSIGNMENTS=271 CHECKS=301022	SAT TT=0.049 ASSIGNMENTS=441 CHECKS=226645	SAT TT=0.795	SAT TT=0.039 ASSIGNMENTS=430 CHECKS=85956	SAT TT=0.053 ASSIGNMENTS=356 CHECKS=223583	SAT TT=13.18	SAT TT=1.35	SAT TT=1.75
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-5.xml	SAT TT=0.027	SAT TT=2.132 CHECKS=93659 NODES=55	SAT TT=2.113 CHECKS=158355 NODES=0	SAT TT=0.09	SAT TT=5.305 CHECKS=12314800	SAT TT=6.83 CHECKS=16518700	SAT TT=1.431 ASSIGNMENTS=126	SAT TT=1.574 ASSIGNMENTS=126	SAT TT=1.666 CHECKS=0 NODES=50	SAT TT=18.288 CHECKS=211533000 NODES=154694	SAT TT=0.961 CHECKS=623887 NODES=133	SAT TT=0.041 ASSIGNMENTS=129 CHECKS=47583	SAT TT=0.037 ASSIGNMENTS=129 CHECKS=47583	SAT TT=621.616	SAT TT=32.056	SAT TT=0.027 ASSIGNMENTS=140 CHECKS=52025	SAT TT=0.101 ASSIGNMENTS=1481 CHECKS=649009	SAT TT=0.804	SAT TT=0.058 ASSIGNMENTS=770 CHECKS=206938	SAT TT=0.214 ASSIGNMENTS=1135 CHECKS=1526920	SAT TT=13.228	SAT TT=1.133	SAT TT=1.632
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-6.xml	SAT TT=0.024	SAT TT=2.148 CHECKS=77662 NODES=50	SAT TT=1.983 CHECKS=83706 NODES=0	SAT TT=6.963	SAT TT=0.439 CHECKS=11661	SAT TT=0.026 CHECKS=11820	SAT TT=1.666 ASSIGNMENTS=116	SAT TT=1.473 ASSIGNMENTS=116	SAT TT=1.495 CHECKS=0 NODES=50	SAT TT=81.684 CHECKS=1032650000 NODES=752558	SAT TT=0.983 CHECKS=817493 NODES=285	SAT TT=0.037 ASSIGNMENTS=98 CHECKS=28390	SAT TT=0.037 ASSIGNMENTS=98 CHECKS=28390	SAT TT=527.972	SAT TT=44.227	SAT TT=0.024 ASSIGNMENTS=101 CHECKS=28205	SAT TT=0.027 ASSIGNMENTS=132 CHECKS=49420	SAT TT=0.737	SAT TT=0.041 ASSIGNMENTS=453 CHECKS=104408	SAT TT=0.106 ASSIGNMENTS=580 CHECKS=666959	SAT TT=14.06	SAT TT=1.048	SAT TT=1.611
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-7.xml	SAT TT=0.033	SAT TT=2.192 CHECKS=164227 NODES=78	SAT TT=2.105 CHECKS=131660 NODES=0	SAT TT=0.088	SAT TT=22.191 CHECKS=50858900	SAT TT=34.553 CHECKS=78611000	SAT TT=1.416 ASSIGNMENTS=94	SAT TT=1.424 ASSIGNMENTS=94	SAT TT=1.461 CHECKS=0 NODES=50	SAT TT=31.752 CHECKS=408507000 NODES=303278	SAT TT=1.261 CHECKS=1448290 NODES=765	SAT TT=0.044 ASSIGNMENTS=123 CHECKS=67668	SAT TT=0.043 ASSIGNMENTS=123 CHECKS=67668	SAT TT=562.881	SAT TT=33.077	SAT TT=0.033 ASSIGNMENTS=136 CHECKS=92360	SAT TT=0.09 ASSIGNMENTS=989 CHECKS=524401	SAT TT=0.886	SAT TT=0.035 ASSIGNMENTS=356 CHECKS=79279	SAT TT=0.068 ASSIGNMENTS=396 CHECKS=405967	SAT TT=17.694	SAT TT=1.052	SAT TT=1.891
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-8.xml	SAT TT=0.031	SAT TT=2.048 CHECKS=76584 NODES=50	SAT TT=2.03 CHECKS=275722 NODES=50	SAT TT=0.091	SAT TT=23.927 CHECKS=55631500	SAT TT=22.552 CHECKS=55360200	SAT TT=1.342 ASSIGNMENTS=105	SAT TT=1.357 ASSIGNMENTS=105	SAT TT=1.66 CHECKS=0 NODES=50	SAT TT=427.733 CHECKS=5018690000 NODES=3748410	SAT TT=1.902 CHECKS=12604700 NODES=7104	SAT TT=0.038 ASSIGNMENTS=105 CHECKS=47856	SAT TT=0.038 ASSIGNMENTS=105 CHECKS=47856	SAT TT=582.756	SAT TT=57	SAT TT=0.031 ASSIGNMENTS=132 CHECKS=63974	SAT TT=0.246 ASSIGNMENTS=3354 CHECKS=1722590	SAT TT=0.86	SAT TT=0.06 ASSIGNMENTS=677 CHECKS=224229	SAT TT=0.154 ASSIGNMENTS=933 CHECKS=1045000	SAT TT=13.504	SAT TT=1.093	SAT TT=1.574
csp/jobShop-e0ddr2/ normalized-e0ddr2-10-by-5-9.xml	SAT TT=0.067	SAT TT=2.438 CHECKS=1733440 NODES=721	SAT TT=41.146 CHECKS=482244000 NODES=177039	? (TO) TT=1800.02	SAT TT=0.54 CHECKS=236579	SAT TT=0.137 CHECKS=253143	SAT TT=1.457 ASSIGNMENTS=78	SAT TT=1.482 ASSIGNMENTS=78	SAT TT=1.467 CHECKS=0 NODES=345	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.122 ASSIGNMENTS=632 CHECKS=699534	SAT TT=0.124 ASSIGNMENTS=632 CHECKS=699534	SAT TT=709.368	SAT TT=713.885	SAT TT=0.121 ASSIGNMENTS=823 CHECKS=744498	SAT TT=0.838 ASSIGNMENTS=9003 CHECKS=6963660	? (TO) TT=1800.08	SAT TT=0.529 ASSIGNMENTS=3595 CHECKS=3765360	SAT TT=0.067 ASSIGNMENTS=391 CHECKS=357091	SAT TT=25.635	SAT TT=1.05	SAT TT=1.594
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-10.xml	SAT TT=0.024	SAT TT=2.147 CHECKS=679272 NODES=414	SAT TT=1.894 CHECKS=93882 NODES=0	SAT TT=0.089	SAT TT=14.493 CHECKS=36727600	SAT TT=17.543 CHECKS=48194800	SAT TT=1.319 ASSIGNMENTS=100	SAT TT=1.303 ASSIGNMENTS=100	SAT TT=1.426 CHECKS=0 NODES=50	SAT TT=18.483 CHECKS=232760000 NODES=182333	SAT TT=1.027 CHECKS=350650 NODES=34	SAT TT=0.042 ASSIGNMENTS=167 CHECKS=59974	SAT TT=0.042 ASSIGNMENTS=167 CHECKS=59974	SAT TT=603.964	SAT TT=26.163	SAT TT=0.032 ASSIGNMENTS=219 CHECKS=71708	SAT TT=0.034 ASSIGNMENTS=191 CHECKS=100464	SAT TT=0.691	SAT TT=0.034 ASSIGNMENTS=280 CHECKS=74362	SAT TT=0.024 ASSIGNMENTS=90 CHECKS=24993	SAT TT=13.711	SAT TT=1.111	SAT TT=1.539
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-1.xml	SAT TT=0.03	SAT TT=1.825 CHECKS=144023 NODES=87	SAT TT=1.928 CHECKS=68382 NODES=0	SAT TT=0.084	SAT TT=0.437 CHECKS=8796	SAT TT=0.022 CHECKS=9422	SAT TT=1.372 ASSIGNMENTS=77	SAT TT=1.283 ASSIGNMENTS=77	SAT TT=1.314 CHECKS=0 NODES=50	SAT TT=1.105 CHECKS=1503470 NODES=1002	SAT TT=1.085 CHECKS=481897 NODES=111	SAT TT=0.054 ASSIGNMENTS=166 CHECKS=179465	SAT TT=0.058 ASSIGNMENTS=166 CHECKS=179465	SAT TT=377.76	SAT TT=25.298	SAT TT=0.054 ASSIGNMENTS=220 CHECKS=243769	SAT TT=0.037 ASSIGNMENTS=298 CHECKS=123190	SAT TT=0.869	SAT TT=0.037 ASSIGNMENTS=263 CHECKS=83667	SAT TT=0.03 ASSIGNMENTS=149 CHECKS=82904	SAT TT=11.971	SAT TT=1.127	SAT TT=1.452
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-2.xml	SAT TT=0	SAT TT=1.881 CHECKS=131380 NODES=84	SAT TT=2.008 CHECKS=62890 NODES=0	SAT TT=0	SAT TT=0.437 CHECKS=10791	SAT TT=0.026 CHECKS=10601	SAT TT=1.274 ASSIGNMENTS=95	SAT TT=1.273 ASSIGNMENTS=95	SAT TT=1.43 CHECKS=0 NODES=94	SAT TT=1.175 CHECKS=1810900 NODES=1182	SAT TT=1.024 CHECKS=326576 NODES=27	SAT TT=0.037 ASSIGNMENTS=108 CHECKS=28882	SAT TT=0.038 ASSIGNMENTS=108 CHECKS=28882	SAT TT=411.026	SAT TT=25.559	SAT TT=0.028 ASSIGNMENTS=199 CHECKS=48432	SAT TT=0.024 ASSIGNMENTS=43 CHECKS=16466	SAT TT=0.73	SAT TT=0.032 ASSIGNMENTS=184 CHECKS=52105	SAT TT=0.023 ASSIGNMENTS=53 CHECKS=16474	SAT TT=12.816	SAT TT=1.102	SAT TT=1.662
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-3.xml	SAT TT=0.031	? (TO) TT=1800.11	SAT TT=1.806 CHECKS=66359 NODES=0	SAT TT=0.09	SAT TT=0.434 CHECKS=11141	SAT TT=0.026 CHECKS=12881	SAT TT=1.444 ASSIGNMENTS=87	SAT TT=1.311 ASSIGNMENTS=87	SAT TT=1.321 CHECKS=0 NODES=97	SAT TT=1.773 CHECKS=9037550 NODES=7058	SAT TT=0.973 CHECKS=686835 NODES=259	SAT TT=8.259 ASSIGNMENTS=87	SAT TT=7.81 ASSIGNMENTS=164 CHECKS=86177	SAT TT=483.819	SAT TT=25.174	SAT TT=1.71 ASSIGNMENTS=8523 CHECKS=13610000	SAT TT=0.088 ASSIGNMENTS=962 CHECKS=506449	SAT TT=35.638	SAT TT=0.031 ASSIGNMENTS=186 CHECKS=54720	SAT TT=0.031 ASSIGNMENTS=164 CHECKS=86177	SAT TT=11.333	SAT TT=1.153	SAT TT=1.501
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-4.xml	SAT TT=0.027	SAT TT=1.965 CHECKS=85445 NODES=57	SAT TT=1.8 CHECKS=64707 NODES=0	SAT TT=0.092	SAT TT=0.443 CHECKS=10703	SAT TT=0.027 CHECKS=12864	SAT TT=1.338 ASSIGNMENTS=81	SAT TT=1.557 ASSIGNMENTS=81	SAT TT=1.481 CHECKS=0 NODES=50	SAT TT=15.838 CHECKS=186854000 NODES=152096	SAT TT=1.046 CHECKS=389426 NODES=72	SAT TT=0.206 ASSIGNMENTS=955 CHECKS=1515000	SAT TT=0.221 ASSIGNMENTS=955 CHECKS=1515000	SAT TT=388.541	SAT TT=26.866	SAT TT=0.165 ASSIGNMENTS=650 CHECKS=1129810	SAT TT=0.041 ASSIGNMENTS=322 CHECKS=142474	SAT TT=0.729	SAT TT=0.038 ASSIGNMENTS=340 CHECKS=87647	SAT TT=0.027 ASSIGNMENTS=150 CHECKS=41618	SAT TT=10.735	SAT TT=1.115	SAT TT=1.614
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-5.xml	SAT TT=0.024	SAT TT=1.906 CHECKS=79234 NODES=51	SAT TT=1.876 CHECKS=59842 NODES=0	SAT TT=0.09	SAT TT=0.441 CHECKS=9769	SAT TT=0.024 CHECKS=9900	SAT TT=1.348 ASSIGNMENTS=94	SAT TT=1.423 ASSIGNMENTS=94	SAT TT=1.443 CHECKS=0 NODES=50	SAT TT=1.766 CHECKS=10323700 NODES=7713	SAT TT=0.949 CHECKS=423380 NODES=39	SAT TT=0.039 ASSIGNMENTS=86 CHECKS=33633	SAT TT=0.037 ASSIGNMENTS=86 CHECKS=33633	SAT TT=440.105	SAT TT=26.97	SAT TT=0.027 ASSIGNMENTS=94 CHECKS=41578	SAT TT=0.03 ASSIGNMENTS=146 CHECKS=67156	SAT TT=0.855	SAT TT=0.03 ASSIGNMENTS=201 CHECKS=50793	SAT TT=0.024 ASSIGNMENTS=75 CHECKS=22087	SAT TT=11.456	SAT TT=1.221	SAT TT=1.517
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-6.xml	SAT TT=0.022	SAT TT=1.961 CHECKS=77545 NODES=50	SAT TT=1.949 CHECKS=68813 NODES=0	SAT TT=0.083	SAT TT=0.431 CHECKS=10968	SAT TT=0.023 CHECKS=10193	SAT TT=1.289 ASSIGNMENTS=116	SAT TT=1.281 ASSIGNMENTS=116	SAT TT=1.362 CHECKS=0 NODES=50	SAT TT=70.947 CHECKS=797549000 NODES=600199	SAT TT=0.945 CHECKS=384802 NODES=44	SAT TT=0.036 ASSIGNMENTS=97 CHECKS=27194	SAT TT=0.038 ASSIGNMENTS=97 CHECKS=27194	SAT TT=421.396	SAT TT=26.967	SAT TT=0.022 ASSIGNMENTS=97 CHECKS=27194	SAT TT=0.031 ASSIGNMENTS=148 CHECKS=63930	SAT TT=0.858	SAT TT=0.029 ASSIGNMENTS=152 CHECKS=42558	SAT TT=0.023 ASSIGNMENTS=61 CHECKS=17397	SAT TT=13.231	SAT TT=0.994	SAT TT=1.723
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-7.xml	SAT TT=0.028	SAT TT=2.034 CHECKS=152019 NODES=90	SAT TT=1.876 CHECKS=63656 NODES=0	SAT TT=0.092	SAT TT=0.407 CHECKS=12158	SAT TT=0.026 CHECKS=12443	SAT TT=1.456 ASSIGNMENTS=77	SAT TT=1.328 ASSIGNMENTS=77	SAT TT=1.568 CHECKS=0 NODES=50	SAT TT=1.05 CHECKS=1580390 NODES=967	SAT TT=1.2 CHECKS=375343 NODES=49	SAT TT=6.973 ASSIGNMENTS=99 CHECKS=52744	SAT TT=7.271 ASSIGNMENTS=99 CHECKS=52744	SAT TT=558.023	SAT TT=26.516	SAT TT=3.264 ASSIGNMENTS=16349 CHECKS=26298700	SAT TT=0.033 ASSIGNMENTS=185 CHECKS=77480	SAT TT=0.679	SAT TT=0.036 ASSIGNMENTS=325 CHECKS=95015	SAT TT=0.028 ASSIGNMENTS=99 CHECKS=52744	SAT TT=11.566	SAT TT=1.086	SAT TT=1.48
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-8.xml	SAT TT=0.024	SAT TT=1.882 CHECKS=204209 NODES=118	SAT TT=1.938 CHECKS=104052 NODES=0	SAT TT=0.09	SAT TT=0.405 CHECKS=10999	SAT TT=0.023 CHECKS=10863	SAT TT=1.303 ASSIGNMENTS=85	SAT TT=1.307 ASSIGNMENTS=85	SAT TT=1.329 CHECKS=0 NODES=50	SAT TT=1.178 CHECKS=2214530 NODES=1505	SAT TT=1.063 CHECKS=593851 NODES=208	SAT TT=0.035 ASSIGNMENTS=78 CHECKS=33618	SAT TT=0.036 ASSIGNMENTS=78 CHECKS=33618	SAT TT=270.916	SAT TT=28.701	SAT TT=0.024 ASSIGNMENTS=78 CHECKS=33618	SAT TT=0.029 ASSIGNMENTS=118 CHECKS=62743	SAT TT=0.743	SAT TT=0.041 ASSIGNMENTS=473 CHECKS=124309	SAT TT=0.042 ASSIGNMENTS=162 CHECKS=179824	SAT TT=12.762	SAT TT=1.085	SAT TT=1.882
csp/jobShop-enddr1/ normalized-enddr1-10-by-5-9.xml	SAT TT=0.024	SAT TT=1.989 CHECKS=81706 NODES=50	SAT TT=1.917 CHECKS=64427 NODES=0	SAT TT=0.083	SAT TT=0.437 CHECKS=10299	SAT TT=0.026 CHECKS=9902	SAT TT=1.278 ASSIGNMENTS=92	SAT TT=1.355 ASSIGNMENTS=92	SAT TT=1.456 CHECKS=0 NODES=50	SAT TT=16.433 CHECKS=200890000 NODES=150046	SAT TT=1.014 CHECKS=458713 NODES=68	SAT TT=0.039 ASSIGNMENTS=84 CHECKS=27265	SAT TT=0.037 ASSIGNMENTS=84 CHECKS=27265	SAT TT=423.176	SAT TT=27.056	SAT TT=0.026 ASSIGNMENTS=84 CHECKS=27265	SAT TT=0.027 ASSIGNMENTS=128 CHECKS=46576	SAT TT=0.74	SAT TT=0.033 ASSIGNMENTS=214 CHECKS=53725	SAT TT=0.024 ASSIGNMENTS=53 CHECKS=18305	SAT TT=12.967	SAT TT=0.989	SAT TT=1.551
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-10.xml	SAT TT=0.039	SAT TT=2.273 CHECKS=100807 NODES=50	SAT TT=2.176 CHECKS=82498 NODES=0	SAT TT=0.085	SAT TT=0.445 CHECKS=10310	SAT TT=0.028 CHECKS=14589	SAT TT=1.45 ASSIGNMENTS=115	SAT TT=1.423 ASSIGNMENTS=115	SAT TT=1.482 CHECKS=0 NODES=50	SAT TT=1.092 CHECKS=2158980 NODES=1194	SAT TT=1.064 CHECKS=615114 NODES=134	SAT TT=0.049 ASSIGNMENTS=234 CHECKS=137475	SAT TT=0.055 ASSIGNMENTS=234 CHECKS=137475	SAT TT=633.551	SAT TT=34.979	SAT TT=0.059 ASSIGNMENTS=392 CHECKS=271692	SAT TT=0.064 ASSIGNMENTS=928 CHECKS=358946	SAT TT=0.69	SAT TT=0.039 ASSIGNMENTS=495 CHECKS=91888	SAT TT=0.044 ASSIGNMENTS=172 CHECKS=164309	SAT TT=15.575	SAT TT=1.01	SAT TT=1.706
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-1.xml	SAT TT=0.03	SAT TT=2.224 CHECKS=95363 NODES=50	SAT TT=2.183 CHECKS=140590 NODES=0	SAT TT=0.09	SAT TT=8.42 CHECKS=19342100	SAT TT=13.657 CHECKS=33436400	SAT TT=1.483 ASSIGNMENTS=93	SAT TT=1.695 ASSIGNMENTS=93	SAT TT=1.605 CHECKS=0 NODES=50	SAT TT=9.687 CHECKS=113123000 NODES=82225	SAT TT=1.104 CHECKS=1307380 NODES=626	SAT TT=0.038 ASSIGNMENTS=93 CHECKS=36141	SAT TT=0.037 ASSIGNMENTS=93 CHECKS=36141	SAT TT=737.009	SAT TT=44.035	SAT TT=0.03 ASSIGNMENTS=110 CHECKS=54206	SAT TT=0.206 ASSIGNMENTS=2876 CHECKS=1426260	SAT TT=0.8	SAT TT=0.105 ASSIGNMENTS=1075 CHECKS=543240	SAT TT=0.039 ASSIGNMENTS=164 CHECKS=140498	SAT TT=13.359	SAT TT=1.296	SAT TT=1.574
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-2.xml	SAT TT=0.023	SAT TT=2.346 CHECKS=798936 NODES=240	SAT TT=2.226 CHECKS=728669 NODES=156	SAT TT=0.096	SAT TT=22.321 CHECKS=49229000	SAT TT=34.63 CHECKS=72253000	SAT TT=1.431 ASSIGNMENTS=72	SAT TT=1.356 ASSIGNMENTS=72	SAT TT=1.464 CHECKS=0 NODES=144	SAT TT=184.002 CHECKS=2251530000 NODES=1653180	SAT TT=1.254 CHECKS=4357310 NODES=2469	SAT TT=0.038 ASSIGNMENTS=124 CHECKS=28824	SAT TT=0.037 ASSIGNMENTS=124 CHECKS=28824	SAT TT=671.782	SAT TT=35.436	SAT TT=0.023 ASSIGNMENTS=124 CHECKS=28824	SAT TT=0.17 ASSIGNMENTS=2297 CHECKS=1281430	SAT TT=0.71	SAT TT=0.342 ASSIGNMENTS=2620 CHECKS=2245800	SAT TT=0.043 ASSIGNMENTS=187 CHECKS=167385	SAT TT=25.344	SAT TT=1.113	SAT TT=1.675
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-3.xml	SAT TT=0.029	SAT TT=2.219 CHECKS=89982 NODES=50	SAT TT=2.154 CHECKS=395901 NODES=80	SAT TT=0.093	SAT TT=11.925 CHECKS=27448300	SAT TT=20.47 CHECKS=48462300	SAT TT=1.334 ASSIGNMENTS=120	SAT TT=1.339 ASSIGNMENTS=120	SAT TT=1.537 CHECKS=0 NODES=50	SAT TT=80.993 CHECKS=1072350000 NODES=760045	SAT TT=1.017 CHECKS=1245070 NODES=526	SAT TT=0.042 ASSIGNMENTS=131 CHECKS=61207	SAT TT=0.043 ASSIGNMENTS=131 CHECKS=61207	SAT TT=632.646	SAT TT=34.879	SAT TT=0.029 ASSIGNMENTS=140 CHECKS=65870	SAT TT=0.056 ASSIGNMENTS=446 CHECKS=263949	SAT TT=0.747	SAT TT=0.038 ASSIGNMENTS=360 CHECKS=90437	SAT TT=0.042 ASSIGNMENTS=170 CHECKS=175452	SAT TT=15.11	SAT TT=1.062	SAT TT=1.703
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-4.xml	SAT TT=0.024	SAT TT=2.146 CHECKS=93451 NODES=51	SAT TT=2.159 CHECKS=82534 NODES=0	SAT TT=0.09	SAT TT=0.449 CHECKS=12461	SAT TT=0.025 CHECKS=12742	SAT TT=1.297 ASSIGNMENTS=112	SAT TT=1.421 ASSIGNMENTS=112	SAT TT=1.73 CHECKS=0 NODES=50	SAT TT=3.939 CHECKS=40174100 NODES=28376	SAT TT=1.015 CHECKS=494330 NODES=91	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=31966	SAT TT=0.036 ASSIGNMENTS=117 CHECKS=31966	SAT TT=699.853	SAT TT=34.419	SAT TT=0.024 ASSIGNMENTS=117 CHECKS=31966	SAT TT=0.027 ASSIGNMENTS=125 CHECKS=40061	SAT TT=0.785	SAT TT=0.033 ASSIGNMENTS=269 CHECKS=51686	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=28193	SAT TT=14.635	SAT TT=1.276	SAT TT=1.728
csp/jobShop-enddr2/ normalized-enddr2-10-by-5-5.xml	SAT TT=0.029	SAT TT=2.263 CHECKS=90914 NODES=50	SAT TT=2.529 CHECKS=83784 NODES=0	SAT TT=0.091	SAT TT=0.436 CHECKS=11537	SAT TT=0.024 CHECKS=12428	SAT TT=1.335 ASSIGNMENTS=119	SAT TT=1.467 ASSIGNMENTS=119	SAT TT=1.568 CHECKS=0 NODES=50	SAT TT=1.051 CHECKS=1553080 NODES=795	SAT TT=0.997 CHECKS=616552 NODES=114	SAT TT=0.04 ASSIGNMENTS=131 CHECKS=50569	SAT TT=0.037 ASSIGNMENTS=131 CHECKS=50569	SAT TT=848.889	SAT TT=35.682	SAT TT=0.029 ASSIGNMENTS=136 CHECKS=52257	SAT TT=0.054 ASSIGNMENTS=533 CHECKS=257896	SAT TT=0.737	SAT TT=0.031 ASSIGNMENTS=274 CHECKS=51676	SAT TT=0.032 ASSIGNMENTS=133 CHECKS=81058	SAT TT=14.093	SAT TT=1.094	SAT TT=1.6
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-10.xml	SAT TT=0.024	SAT TT=2.284 CHECKS=94847 NODES=50	SAT TT=2.21 CHECKS=86949 NODES=0	SAT TT=0.091	SAT TT=0.442 CHECKS=8350	SAT TT=0.025 CHECKS=12213	SAT TT=1.427 ASSIGNMENTS=111	SAT TT=1.329 ASSIGNMENTS=111	SAT TT=1.511 CHECKS=0 NODES=50	SAT TT=17.227 CHECKS=212752000 NODES=150035	SAT TT=0.978 CHECKS=594420 NODES=47	SAT TT=0.044 ASSIGNMENTS=169 CHECKS=62594	SAT TT=0.042 ASSIGNMENTS=169 CHECKS=62594	SAT TT=731.896	SAT TT=35.951	SAT TT=0.028 ASSIGNMENTS=198 CHECKS=72856	SAT TT=0.027 ASSIGNMENTS=166 CHECKS=44820	SAT TT=0.674	SAT TT=0.024 ASSIGNMENTS=117 CHECKS=28418	SAT TT=0.025 ASSIGNMENTS=112 CHECKS=43785	SAT TT=14.985	SAT TT=1.122	SAT TT=1.589
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-1.xml	SAT TT=0.027	SAT TT=2.202 CHECKS=106942 NODES=50	SAT TT=2.168 CHECKS=158061 NODES=0	SAT TT=0.084	SAT TT=0.436 CHECKS=12768	SAT TT=0.026 CHECKS=11873	SAT TT=1.313 ASSIGNMENTS=107	SAT TT=1.549 ASSIGNMENTS=107	SAT TT=1.477 CHECKS=0 NODES=50	SAT TT=1.16 CHECKS=2003870 NODES=1056	SAT TT=1.069 CHECKS=1629790 NODES=746	SAT TT=0.037 ASSIGNMENTS=100 CHECKS=32817	SAT TT=0.038 ASSIGNMENTS=100 CHECKS=32817	SAT TT=999.851	SAT TT=37.766	SAT TT=0.027 ASSIGNMENTS=126 CHECKS=43158	SAT TT=0.035 ASSIGNMENTS=244 CHECKS=107883	SAT TT=0.679	SAT TT=0.037 ASSIGNMENTS=414 CHECKS=89668	SAT TT=0.038 ASSIGNMENTS=150 CHECKS=138506	SAT TT=15.839	SAT TT=1.133	SAT TT=1.59
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-2.xml	SAT TT=0.024	SAT TT=2.203 CHECKS=92868 NODES=50	SAT TT=2.145 CHECKS=79179 NODES=0	SAT TT=0.085	SAT TT=0.448 CHECKS=16800	SAT TT=0.028 CHECKS=17879	SAT TT=1.371 ASSIGNMENTS=109	SAT TT=1.45 ASSIGNMENTS=109	SAT TT=1.444 CHECKS=0 NODES=51	SAT TT=55.831 CHECKS=667799000 NODES=471122	SAT TT=1.154 CHECKS=1730920 NODES=846	SAT TT=0.037 ASSIGNMENTS=129 CHECKS=26301	SAT TT=0.038 ASSIGNMENTS=129 CHECKS=26301	SAT TT=694.12	SAT TT=34.608	SAT TT=0.024 ASSIGNMENTS=129 CHECKS=26301	SAT TT=0.183 ASSIGNMENTS=2323 CHECKS=1212270	SAT TT=0.686	SAT TT=0.027 ASSIGNMENTS=129 CHECKS=28861	SAT TT=0.092 ASSIGNMENTS=456 CHECKS=564012	SAT TT=15.203	SAT TT=1.126	SAT TT=1.596
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-3.xml	SAT TT=0.031	SAT TT=2.322 CHECKS=227152 NODES=91	SAT TT=2.277 CHECKS=163750 NODES=0	SAT TT=0.091	SAT TT=0.446 CHECKS=12876	SAT TT=0.025 CHECKS=10434	SAT TT=1.329 ASSIGNMENTS=106	SAT TT=1.508 ASSIGNMENTS=106	SAT TT=1.579 CHECKS=0 NODES=50	SAT TT=50.815 CHECKS=670794000 NODES=452615	SAT TT=1.129 CHECKS=807608 NODES=203	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=43053	SAT TT=0.04 ASSIGNMENTS=110 CHECKS=43053	SAT TT=598.005	SAT TT=36.441	SAT TT=0.031 ASSIGNMENTS=138 CHECKS=62676	SAT TT=0.05 ASSIGNMENTS=486 CHECKS=232501	SAT TT=0.682	SAT TT=0.039 ASSIGNMENTS=355 CHECKS=83487	SAT TT=0.038 ASSIGNMENTS=159 CHECKS=113302	SAT TT=16.647	SAT TT=1.143	SAT TT=1.631
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-4.xml	SAT TT=0.03	SAT TT=2.398 CHECKS=104644 NODES=50	SAT TT=2.197 CHECKS=84219 NODES=0	SAT TT=0.083	SAT TT=11.144 CHECKS=32294300	SAT TT=17.083 CHECKS=47864200	SAT TT=1.292 ASSIGNMENTS=113	SAT TT=1.529 ASSIGNMENTS=113	SAT TT=1.486 CHECKS=0 NODES=50	SAT TT=1.568 CHECKS=7073320 NODES=4558	SAT TT=1.185 CHECKS=551277 NODES=63	SAT TT=0.04 ASSIGNMENTS=139 CHECKS=64069	SAT TT=0.044 ASSIGNMENTS=139 CHECKS=64069	SAT TT=893.772	SAT TT=33.08	SAT TT=0.03 ASSIGNMENTS=139 CHECKS=65956	SAT TT=0.031 ASSIGNMENTS=204 CHECKS=70908	SAT TT=0.677	SAT TT=0.031 ASSIGNMENTS=283 CHECKS=53377	SAT TT=0.035 ASSIGNMENTS=149 CHECKS=103651	SAT TT=16.119	SAT TT=1.04	SAT TT=1.779
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-5.xml	SAT TT=0.028	SAT TT=2.308 CHECKS=104129 NODES=50	SAT TT=2.434 CHECKS=86199 NODES=0	SAT TT=0.091	SAT TT=0.417 CHECKS=9800	SAT TT=0.025 CHECKS=9865	SAT TT=1.354 ASSIGNMENTS=117	SAT TT=1.351 ASSIGNMENTS=117	SAT TT=1.612 CHECKS=0 NODES=50	SAT TT=60.532 CHECKS=686326000 NODES=451552	SAT TT=1.035 CHECKS=688333 NODES=124	SAT TT=0.041 ASSIGNMENTS=161 CHECKS=62989	SAT TT=0.041 ASSIGNMENTS=161 CHECKS=62989	SAT TT=786.66	SAT TT=35.134	SAT TT=0.033 ASSIGNMENTS=259 CHECKS=91512	SAT TT=0.028 ASSIGNMENTS=144 CHECKS=52459	SAT TT=0.686	SAT TT=0.059 ASSIGNMENTS=755 CHECKS=243102	SAT TT=0.029 ASSIGNMENTS=114 CHECKS=71044	SAT TT=16.326	SAT TT=1.204	SAT TT=1.826
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-6.xml	SAT TT=0.025	SAT TT=2.292 CHECKS=103619 NODES=50	SAT TT=2.604 CHECKS=86530 NODES=0	SAT TT=0.09	SAT TT=0.446 CHECKS=9730	SAT TT=0.024 CHECKS=11623	SAT TT=1.39 ASSIGNMENTS=116	SAT TT=1.327 ASSIGNMENTS=116	SAT TT=1.674 CHECKS=0 NODES=50	SAT TT=1.2 CHECKS=2339320 NODES=1250	SAT TT=1.028 CHECKS=533311 NODES=88	SAT TT=0.038 ASSIGNMENTS=138 CHECKS=31707	SAT TT=0.038 ASSIGNMENTS=138 CHECKS=31707	SAT TT=879.766	SAT TT=37.712	SAT TT=0.025 ASSIGNMENTS=140 CHECKS=31816	SAT TT=0.058 ASSIGNMENTS=783 CHECKS=265931	SAT TT=0.686	SAT TT=0.048 ASSIGNMENTS=574 CHECKS=128469	SAT TT=0.033 ASSIGNMENTS=180 CHECKS=84614	SAT TT=16.496	SAT TT=1.127	SAT TT=1.704
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-7.xml	SAT TT=0.025	SAT TT=2.222 CHECKS=91572 NODES=50	SAT TT=2.137 CHECKS=80628 NODES=0	SAT TT=0.092	SAT TT=0.41 CHECKS=9702	SAT TT=0.023 CHECKS=10346	SAT TT=1.426 ASSIGNMENTS=125	SAT TT=1.324 ASSIGNMENTS=125	SAT TT=1.594 CHECKS=0 NODES=50	SAT TT=1.892 CHECKS=12112400 NODES=7954	SAT TT=0.998 CHECKS=713443 NODES=185	SAT TT=0.037 ASSIGNMENTS=98 CHECKS=27706	SAT TT=0.038 ASSIGNMENTS=98 CHECKS=27706	SAT TT=716.538	SAT TT=34.638	SAT TT=0.025 ASSIGNMENTS=98 CHECKS=27706	SAT TT=0.029 ASSIGNMENTS=132 CHECKS=48777	SAT TT=0.684	SAT TT=0.036 ASSIGNMENTS=436 CHECKS=77954	SAT TT=0.061 ASSIGNMENTS=232 CHECKS=299607	SAT TT=14.498	SAT TT=1.039	SAT TT=1.64
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-8.xml	SAT TT=0.023	SAT TT=2.291 CHECKS=94109 NODES=50	SAT TT=2.446 CHECKS=192745 NODES=0	SAT TT=0.091	SAT TT=11.21 CHECKS=27905800	SAT TT=12.764 CHECKS=36861800	SAT TT=1.481 ASSIGNMENTS=121	SAT TT=1.356 ASSIGNMENTS=121	SAT TT=1.536 CHECKS=0 NODES=50	SAT TT=21.668 CHECKS=240006000 NODES=160378	SAT TT=1.012 CHECKS=929282 NODES=259	SAT TT=0.036 ASSIGNMENTS=79 CHECKS=20925	SAT TT=0.034 ASSIGNMENTS=79 CHECKS=20925	SAT TT=851.612	SAT TT=38.727	SAT TT=0.023 ASSIGNMENTS=79 CHECKS=20925	SAT TT=0.064 ASSIGNMENTS=823 CHECKS=347122	SAT TT=0.685	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=26069	SAT TT=0.039 ASSIGNMENTS=161 CHECKS=152208	SAT TT=15.321	SAT TT=1.051	SAT TT=1.55
csp/jobShop-ewddr2/ normalized-ewddr2-10-by-5-9.xml	SAT TT=0.024	SAT TT=2.319 CHECKS=86437 NODES=50	SAT TT=2.123 CHECKS=84361 NODES=0	SAT TT=0.089	SAT TT=0.44 CHECKS=11974	SAT TT=0.027 CHECKS=9711	SAT TT=1.301 ASSIGNMENTS=104	SAT TT=1.349 ASSIGNMENTS=104	SAT TT=1.476 CHECKS=0 NODES=50	SAT TT=76.039 CHECKS=880660000 NODES=606307	SAT TT=0.995 CHECKS=884159 NODES=296	SAT TT=0.035 ASSIGNMENTS=110 CHECKS=29061	SAT TT=0.038 ASSIGNMENTS=110 CHECKS=29061	SAT TT=1078.4	SAT TT=37.327	SAT TT=0.024 ASSIGNMENTS=110 CHECKS=29061	SAT TT=0.06 ASSIGNMENTS=700 CHECKS=319023	SAT TT=0.693	SAT TT=0.027 ASSIGNMENTS=102 CHECKS=24513	SAT TT=0.084 ASSIGNMENTS=403 CHECKS=504997	SAT TT=14.353	SAT TT=1.1	SAT TT=1.61
csp/js-taillard-15/ normalized-js-taillard-15-100-0.xml	SAT TT=23.706	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1764.46	SAT TT=81.497 ASSIGNMENTS=6212	SAT TT=83.964 ASSIGNMENTS=6212	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=88.241 ASSIGNMENTS=6212	SAT TT=781.014 ASSIGNMENTS=6212	? (problem) TT=60.864	? (problem) TT=65.987	SAT TT=1088.96 ASSIGNMENTS=1108130 CHECKS=396330000	SAT TT=681.411 ASSIGNMENTS=281602 CHECKS=2369390000	? (TO) TT=1800.11	SAT TT=1321.97 ASSIGNMENTS=627550 CHECKS=255820000	SAT TT=759.101 ASSIGNMENTS=337438 CHECKS=2671270000	? TT=283.421	SAT TT=23.706	SAT TT=46.647
csp/js-taillard-15/ normalized-js-taillard-15-100-3.xml	SAT TT=116.43	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=208.878 ASSIGNMENTS=16117	SAT TT=206.424 ASSIGNMENTS=16117	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=295.683 ASSIGNMENTS=16117	SAT TT=901.68 ASSIGNMENTS=16117	? (problem) TT=70.165	? (problem) TT=66.129	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (exit code) TT=294.01	SAT TT=186.73	SAT TT=116.43
csp/js-taillard-15/ normalized-js-taillard-15-100-6.xml	SAT TT=126.636	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=1388.8 ASSIGNMENTS=116745	SAT TT=1491.67 ASSIGNMENTS=116745	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=1597.57 ASSIGNMENTS=116745	? (TO) TT=1800.1	? (problem) TT=73.782	? (problem) TT=70.892	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? TT=258.971	SAT TT=126.636	SAT TT=128.633
csp/js-taillard-15/ normalized-js-taillard-15-100-8.xml	SAT TT=36.214	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=1699.66 ASSIGNMENTS=130210	SAT TT=1680.81 ASSIGNMENTS=130210	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=1724.29 ASSIGNMENTS=130210	? (TO) TT=1800.02	? (problem) TT=61.317	? (problem) TT=60.547	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.02	? (exit code) TT=274.065	SAT TT=36.214	SAT TT=221.671
csp/js-taillard-15/ normalized-js-taillard-15-105-3.xml	SAT TT=6.687	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=50.846 ASSIGNMENTS=3509	SAT TT=49.494 ASSIGNMENTS=3509	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=148.228 ASSIGNMENTS=3509	SAT TT=743.836 ASSIGNMENTS=3509	? (problem) TT=81.956	? (problem) TT=77.578	SAT TT=1012.29 ASSIGNMENTS=519822 CHECKS=3839240000	SAT TT=49.852 ASSIGNMENTS=19422 CHECKS=170973000	? (TO) TT=1800.07	SAT TT=71.947 ASSIGNMENTS=28242 CHECKS=236235000	SAT TT=203.149 ASSIGNMENTS=99355 CHECKS=750792000	? TT=278.642	SAT TT=6.687	SAT TT=15.493
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/js-taillard-15/ normalized-js-taillard-15-105-4.xml	SAT TT=9.595	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=11.6 ASSIGNMENTS=445	SAT TT=11.997 ASSIGNMENTS=445	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=109.204 ASSIGNMENTS=445	SAT TT=705.143 ASSIGNMENTS=445	? (problem) TT=73.902	? (problem) TT=78.841	SAT TT=81.37 ASSIGNMENTS=20906 CHECKS=272568000	SAT TT=1364.6 ASSIGNMENTS=628729 CHECKS=491718000	? (TO) TT=1800.05	SAT TT=209.074 ASSIGNMENTS=95613 CHECKS=715911000	SAT TT=619.721 ASSIGNMENTS=285664 CHECKS=2212420000	? (exit code) TT=285.306	SAT TT=9.595	SAT TT=18.29
csp/js-taillard-15/ normalized-js-taillard-15-105-7.xml	SAT TT=14.287	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=23.979 ASSIGNMENTS=1479	SAT TT=25.593 ASSIGNMENTS=1479	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=122.66 ASSIGNMENTS=1479	SAT TT=718.812 ASSIGNMENTS=1479	? (problem) TT=70.608	? (problem) TT=67.301	? (TO) TT=1800.04	SAT TT=67.602 ASSIGNMENTS=80824 CHECKS=264689000	? (TO) TT=1800.1	SAT TT=42.5 ASSIGNMENTS=17310 CHECKS=143199000	? (TO) TT=1800.03	? (exit code) TT=281.677	SAT TT=14.744	SAT TT=14.287
csp/js-taillard-15/ normalized-js-taillard-15-105-8.xml	SAT TT=5.516	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=15.396 ASSIGNMENTS=863	SAT TT=16.597 ASSIGNMENTS=863	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=114.269 ASSIGNMENTS=863	SAT TT=113.957 ASSIGNMENTS=863	? (problem) TT=59.821	? (problem) TT=63.997	? (TO) TT=1800.04	SAT TT=34.263 ASSIGNMENTS=18310 CHECKS=124796000	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? TT=284.138	SAT TT=5.516	SAT TT=15.214
csp/js-taillard-15/ normalized-js-taillard-15-95-2.xml	UNSAT TT=9.068	? (TO) TT=1800.21	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=9.732 ASSIGNMENTS=29	UNSAT TT=9.068 ASSIGNMENTS=29	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=107.298 ASSIGNMENTS=29	UNSAT TT=702.789 ASSIGNMENTS=29	? (problem) TT=58.291	? (problem) TT=58.491	UNSAT TT=18.64 ASSIGNMENTS=5663 CHECKS=62663000	UNSAT TT=28.44 ASSIGNMENTS=13892 CHECKS=97417300	? (TO) TT=1800.1	UNSAT TT=56.93 ASSIGNMENTS=20869 CHECKS=189534000	UNSAT TT=134.55 ASSIGNMENTS=47205 CHECKS=465216000	? TT=334.319	UNSAT TT=10.577	UNSAT TT=14.693
csp/js-taillard-15/ normalized-js-taillard-15-95-4.xml	UNSAT TT=11.481	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=29.17 ASSIGNMENTS=1715	UNSAT TT=30.349 ASSIGNMENTS=1715	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=34.116 ASSIGNMENTS=1715	UNSAT TT=722.703 ASSIGNMENTS=1715	? (problem) TT=69.175	? (problem) TT=69.648	UNSAT TT=89.801 ASSIGNMENTS=31069 CHECKS=316158000	UNSAT TT=66.705 ASSIGNMENTS=27985 CHECKS=238038000	? (TO) TT=1800.07	UNSAT TT=182.519 ASSIGNMENTS=63185 CHECKS=622488000	UNSAT TT=127.113 ASSIGNMENTS=40397 CHECKS=416820000	? (exit code) TT=319.838	UNSAT TT=11.481	UNSAT TT=17.881
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-0.xml		? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (problem) TT=61.491	? (problem) TT=62.145	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (exit code) TT=275.512	? (TO) TT=1800.01	? (TO) TT=1800.01
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-2.xml		? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (problem) TT=75.817	? (problem) TT=78.657	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? TT=270.313	? (TO) TT=1800.08	? (TO) TT=1800.03
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-4.xml		? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (problem) TT=63.341	? (problem) TT=65.018	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=271.117	? (TO) TT=1800.03	? (TO) TT=1800.07
csp/js-taillard-20-15/ normalized-js-taillard-20-15-100-8.xml		? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (problem) TT=71.055	? (problem) TT=71.779	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=284.126	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/js-taillard-20-15/ normalized-js-taillard-20-15-105-3.xml	SAT TT=18.894	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=39.096 ASSIGNMENTS=1394	SAT TT=44.243 ASSIGNMENTS=1394	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=46.225 ASSIGNMENTS=1394	SAT TT=574.535 ASSIGNMENTS=1394	? (problem) TT=72.087	? (problem) TT=73.945	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=276.949	SAT TT=18.894	SAT TT=46.635
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/js-taillard-20-15/ normalized-js-taillard-20-15-105-4.xml	SAT TT=40.559	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=40.559 ASSIGNMENTS=1455	SAT TT=44.684 ASSIGNMENTS=1455	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=49.944 ASSIGNMENTS=1455	SAT TT=575.703 ASSIGNMENTS=1455	? (problem) TT=72.384	? (problem) TT=76.317	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=278.543	SAT TT=182.669	SAT TT=64.086
csp/js-taillard-20-15/ normalized-js-taillard-20-15-105-9.xml	SAT TT=22.005	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=22.005 ASSIGNMENTS=498	SAT TT=22.928 ASSIGNMENTS=498	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=29.537 ASSIGNMENTS=498	SAT TT=553.194 ASSIGNMENTS=498	? (problem) TT=70.87	? (problem) TT=77.582	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=287.418	SAT TT=34.39	SAT TT=42.635
csp/js-taillard-20-15/ normalized-js-taillard-20-15-95-0.xml		? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (problem) TT=66.715	? (problem) TT=67.009	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=274.922	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/js-taillard-20-15/ normalized-js-taillard-20-15-95-2.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (problem) TT=80.621	? (problem) TT=86.364	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? (exit code) TT=277.464	? (TO) TT=1800	? (TO) TT=1800.05
csp/js-taillard-20-15/ normalized-js-taillard-20-15-95-9.xml		? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	? (problem) TT=59.587	? (problem) TT=59.691	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=287.704	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/js-taillard-20/ normalized-js-taillard-20-100-0.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800	? (problem) TT=77.332	? (problem) TT=73.083	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=221.418	? (TO) TT=1800.04	? (TO) TT=1800.02
csp/js-taillard-20/ normalized-js-taillard-20-100-3.xml		? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (problem) TT=62.498	? (problem) TT=71.759	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (exit code) TT=230.702	? (TO) TT=1800.04	? (TO) TT=1800.02
csp/js-taillard-20/ normalized-js-taillard-20-100-5.xml		? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (problem) TT=76.096	? (problem) TT=75.735	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=255.671	? (TO) TT=1800.04	? (TO) TT=1800.05
csp/js-taillard-20/ normalized-js-taillard-20-105-3.xml	SAT TT=54.071	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=65.329 ASSIGNMENTS=1704	SAT TT=66.952 ASSIGNMENTS=1704	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=82.569 ASSIGNMENTS=1704	SAT TT=763.635 ASSIGNMENTS=1704	? (problem) TT=72.613	? (problem) TT=72.931	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=226.006	SAT TT=54.071	SAT TT=71.274
csp/js-taillard-20/ normalized-js-taillard-20-105-5.xml	SAT TT=49.897	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=250.279 ASSIGNMENTS=8096	SAT TT=275.595 ASSIGNMENTS=8096	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=272.904 ASSIGNMENTS=8096	SAT TT=983.94 ASSIGNMENTS=8096	? (problem) TT=71.877	? (problem) TT=71.802	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=216.385	SAT TT=82.794	SAT TT=49.897
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/js-taillard-20/ normalized-js-taillard-20-105-6.xml	SAT TT=65.503	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1123.89 ASSIGNMENTS=37727	SAT TT=1140.16 ASSIGNMENTS=37727	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1247.68 ASSIGNMENTS=37727	SAT TT=1748.12 ASSIGNMENTS=37727	? (problem) TT=70.991	? (problem) TT=76.849	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=215.813	SAT TT=65.503	SAT TT=108.985
csp/js-taillard-20/ normalized-js-taillard-20-105-7.xml	SAT TT=18.977	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=46.449 ASSIGNMENTS=899	SAT TT=54.698 ASSIGNMENTS=899	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=72.834 ASSIGNMENTS=899	SAT TT=748.631 ASSIGNMENTS=899	? (problem) TT=68.554	? (problem) TT=74.855	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=220.666	SAT TT=18.977	SAT TT=38.444
csp/js-taillard-20/ normalized-js-taillard-20-105-8.xml	SAT TT=13.385	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=815.952 ASSIGNMENTS=29994	SAT TT=881.513 ASSIGNMENTS=29994	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=1002.01 ASSIGNMENTS=29994	SAT TT=1618.86 ASSIGNMENTS=29994	? (problem) TT=63.508	? (problem) TT=67.104	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=214.286	SAT TT=13.385	SAT TT=53.228
csp/js-taillard-20/ normalized-js-taillard-20-95-1.xml		? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (problem) TT=70.073	? (problem) TT=68.395	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=264.221	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/js-taillard-20/ normalized-js-taillard-20-95-7.xml	UNSAT TT=3.468	? (TO) TT=1800.09	? (TO) TT=1800.22	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=3.468 ASSIGNMENTS=0	UNSAT TT=3.574 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=46.661 ASSIGNMENTS=0	UNSAT TT=699.046 ASSIGNMENTS=0	? (problem) TT=73.258	? (problem) TT=73.489	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=253.883	UNSAT TT=195.777	UNSAT TT=238.584
csp/knights/ normalized-knights-100-25.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=1199.4	? (TO) TT=1800.12	? (TO) TT=1800.01
csp/knights/ normalized-knights-12-5.xml	UNSAT TT=0.075	UNSAT TT=0.815 CHECKS=232842 NODES=128	UNSAT TT=0.883 CHECKS=355092 NODES=0	UNSAT TT=0.075	UNSAT TT=2.229 CHECKS=66548	UNSAT TT=0.237 CHECKS=67390	UNSAT TT=0.838 ASSIGNMENTS=0	UNSAT TT=0.789 ASSIGNMENTS=0	UNSAT TT=0.648 CHECKS=435922 NODES=215	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=8.414 ASSIGNMENTS=140 CHECKS=349494	UNSAT TT=8.292 ASSIGNMENTS=140 CHECKS=349494	UNSAT TT=2.351	UNSAT TT=1.997	UNSAT TT=2.488 ASSIGNMENTS=213 CHECKS=3285	UNSAT TT=3.115 ASSIGNMENTS=638 CHECKS=7558	UNSAT TT=4.103	UNSAT TT=2.575 ASSIGNMENTS=143 CHECKS=2758	UNSAT TT=2.483 ASSIGNMENTS=214 CHECKS=3508	UNSAT TT=4.308	UNSAT TT=0.644	UNSAT TT=1.038
csp/knights/ normalized-knights-12-9.xml	UNSAT TT=0.184	UNSAT TT=0.887 CHECKS=586217 NODES=128	UNSAT TT=0.882 CHECKS=757398 NODES=0	UNSAT TT=0.184	UNSAT TT=3.6 CHECKS=116971	UNSAT TT=0.366 CHECKS=179528	UNSAT TT=1.856 ASSIGNMENTS=0	UNSAT TT=2 ASSIGNMENTS=0	UNSAT TT=0.81 CHECKS=899040 NODES=230	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=8.62 ASSIGNMENTS=143 CHECKS=733962	UNSAT TT=8.114 ASSIGNMENTS=143 CHECKS=733962	UNSAT TT=3.752	UNSAT TT=2.776	UNSAT TT=9.02 ASSIGNMENTS=211 CHECKS=7975	UNSAT TT=19.281 ASSIGNMENTS=1160 CHECKS=32779	? (TO) TT=1800.09	UNSAT TT=8.93 ASSIGNMENTS=143 CHECKS=5984	UNSAT TT=10.606 ASSIGNMENTS=214 CHECKS=8089	UNSAT TT=6.936	UNSAT TT=55.213	UNSAT TT=179.107
csp/knights/ normalized-knights-15-9.xml	UNSAT TT=0.548	UNSAT TT=1.07 CHECKS=1911490 NODES=206	UNSAT TT=1.076 CHECKS=2497140 NODES=0	UNSAT TT=0.548	UNSAT TT=10.306 CHECKS=355527	UNSAT TT=1.146 CHECKS=541157	UNSAT TT=4.343 ASSIGNMENTS=0	UNSAT TT=4.254 ASSIGNMENTS=0	UNSAT TT=1.182 CHECKS=3263140 NODES=323	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=8.772 ASSIGNMENTS=221 CHECKS=2399880	UNSAT TT=8.693 ASSIGNMENTS=221 CHECKS=2399880	UNSAT TT=9.313	UNSAT TT=5.422	UNSAT TT=35.351 ASSIGNMENTS=332 CHECKS=12778	UNSAT TT=65.411 ASSIGNMENTS=1842 CHECKS=51955	? (TO) TT=1800.11	UNSAT TT=31.187 ASSIGNMENTS=224 CHECKS=9674	UNSAT TT=35.137 ASSIGNMENTS=335 CHECKS=12893	UNSAT TT=12.105	UNSAT TT=141.26	UNSAT TT=404.132
csp/knights/ normalized-knights-25-5.xml	UNSAT TT=0.826	UNSAT TT=1.808 CHECKS=6742540 NODES=596	UNSAT TT=2.236 CHECKS=10878900 NODES=0	UNSAT TT=0.898	UNSAT TT=52.552 CHECKS=325771	UNSAT TT=5.436 CHECKS=1980860	UNSAT TT=1694.94 ASSIGNMENTS=678385	UNSAT TT=1614.63 ASSIGNMENTS=678385	UNSAT TT=2.647 CHECKS=30628900 NODES=936	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=9.108 ASSIGNMENTS=621 CHECKS=11640700	UNSAT TT=9.284 ASSIGNMENTS=621 CHECKS=11640700	UNSAT TT=57.029	UNSAT TT=18.795	UNSAT TT=198.457 ASSIGNMENTS=934 CHECKS=15114	UNSAT TT=220.292 ASSIGNMENTS=3011 CHECKS=35606	UNSAT TT=25.84	UNSAT TT=211.27 ASSIGNMENTS=624 CHECKS=12872	UNSAT TT=193.105 ASSIGNMENTS=935 CHECKS=16058	UNSAT TT=36.581	UNSAT TT=0.826	UNSAT TT=1.246
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/knights/ normalized-knights-25-9.xml	UNSAT TT=2.453	UNSAT TT=2.453 CHECKS=16875000 NODES=596	UNSAT TT=2.79 CHECKS=23068500 NODES=0	UNSAT TT=6.765	UNSAT TT=94.589 CHECKS=1187040	UNSAT TT=6.369 CHECKS=3397030	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=5.968 CHECKS=66977300 NODES=969	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=9.928 ASSIGNMENTS=621 CHECKS=25531000	UNSAT TT=9.413 ASSIGNMENTS=621 CHECKS=25531000	UNSAT TT=115.98	UNSAT TT=33.158	UNSAT TT=654.639 ASSIGNMENTS=932 CHECKS=37204	UNSAT TT=884.118 ASSIGNMENTS=1765 CHECKS=57225	? (TO) TT=1800.11	UNSAT TT=604.695 ASSIGNMENTS=624 CHECKS=28474	UNSAT TT=619.106 ASSIGNMENTS=935 CHECKS=37388	UNSAT TT=85.684	UNSAT TT=575.577	? (TO) TT=1800.13
csp/knights/ normalized-knights-50-9.xml	UNSAT TT=27.038	UNSAT TT=27.038 CHECKS=1005120000 NODES=2446	UNSAT TT=36.346 CHECKS=1408930000 NODES=0	UNSAT TT=106.089	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.06	UNSAT TT=190.691 CHECKS=4506580000 NODES=4307	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=63.244 ASSIGNMENTS=2494 CHECKS=1440480000	UNSAT TT=63.37 ASSIGNMENTS=2494 CHECKS=1440480000	? (MO) TT=404.03	? (MO) TT=408.5	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=314.444	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/knights/ normalized-knights-80-25.xml		? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? TT=494.963	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/knights/ normalized-knights-80-9.xml		? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.02	? TT=541.08	? (TO) TT=1800.07	? (TO) TT=1800.04
csp/knights/ normalized-knights-8-5.xml	UNSAT TT=0.036	UNSAT TT=0.763 CHECKS=24208 NODES=52	UNSAT TT=0.762 CHECKS=33573 NODES=0	UNSAT TT=0.036	UNSAT TT=0.42 CHECKS=13194	UNSAT TT=2.587 CHECKS=923473	UNSAT TT=0.841 ASSIGNMENTS=0	UNSAT TT=0.844 ASSIGNMENTS=0	UNSAT TT=0.567 CHECKS=35956 NODES=95	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=0.276 ASSIGNMENTS=94 CHECKS=1396	UNSAT TT=0.271 ASSIGNMENTS=94 CHECKS=1396	UNSAT TT=1.069	UNSAT TT=1.182	UNSAT TT=0.261 ASSIGNMENTS=93 CHECKS=1385	UNSAT TT=0.344 ASSIGNMENTS=265 CHECKS=3127	UNSAT TT=1.403	UNSAT TT=0.27 ASSIGNMENTS=63 CHECKS=1142	UNSAT TT=0.265 ASSIGNMENTS=94 CHECKS=1488	UNSAT TT=3.355	UNSAT TT=0.75	UNSAT TT=0.64
csp/langford2/ normalized-langford-2-10.xml	UNSAT TT=1.192	UNSAT TT=7.253 CHECKS=8302060 NODES=95782	UNSAT TT=7.393 CHECKS=8309230 NODES=95666	UNSAT TT=1.192	UNSAT TT=82.834 CHECKS=490285000	UNSAT TT=83.114 CHECKS=475605000	UNSAT TT=14.365 ASSIGNMENTS=112954	UNSAT TT=11.686 ASSIGNMENTS=67618	UNSAT TT=7.855 CHECKS=1446730 NODES=61492	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=1.39 ASSIGNMENTS=36820 CHECKS=2299550	UNSAT TT=1.404 ASSIGNMENTS=36820 CHECKS=2299550	UNSAT TT=68.53	UNSAT TT=17.098	UNSAT TT=1.247 ASSIGNMENTS=37026 CHECKS=2342630	UNSAT TT=1.338 ASSIGNMENTS=40020 CHECKS=2480990	UNSAT TT=6.199	UNSAT TT=2.498 ASSIGNMENTS=73647 CHECKS=4600430	UNSAT TT=2.141 ASSIGNMENTS=61169 CHECKS=3777720	UNSAT TT=364.274	UNSAT TT=11.273	UNSAT TT=19.705
csp/langford2/ normalized-langford-2-11.xml	SAT TT=0.013	SAT TT=0.867 CHECKS=6587 NODES=41	SAT TT=0.943 CHECKS=16536 NODES=41	SAT TT=0.055	SAT TT=0.04 CHECKS=29414	SAT TT=0.018 CHECKS=27499	SAT TT=0.966 ASSIGNMENTS=14	SAT TT=1.001 ASSIGNMENTS=29	SAT TT=0.956 CHECKS=6975 NODES=68	SAT TT=1.222 CHECKS=49450 NODES=99	SAT TT=0.959 CHECKS=627046 NODES=788	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=1342	SAT TT=0.024 ASSIGNMENTS=16 CHECKS=1342	SAT TT=1.899	SAT TT=2.082	SAT TT=0.013 ASSIGNMENTS=13 CHECKS=1082	SAT TT=0.016 ASSIGNMENTS=41 CHECKS=3199	SAT TT=0.499	SAT TT=0.016 ASSIGNMENTS=14 CHECKS=1091	SAT TT=0.013 ASSIGNMENTS=16 CHECKS=1351	SAT TT=3.739	SAT TT=0.856	SAT TT=0.917
csp/langford2/ normalized-langford-2-13.xml	UNSAT TT=364.714	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=364.714	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=1082.78 ASSIGNMENTS=15456400 CHECKS=1072250000	UNSAT TT=1084.54 ASSIGNMENTS=15456400 CHECKS=1072250000	? (TO) TT=1800	? (TO) TT=1800.11	UNSAT TT=433.005 ASSIGNMENTS=10878000 CHECKS=756156000	UNSAT TT=393.132 ASSIGNMENTS=10682900 CHECKS=736722000	UNSAT TT=1152.95	UNSAT TT=928.323 ASSIGNMENTS=22184000 CHECKS=1616560000	UNSAT TT=582.537 ASSIGNMENTS=15456400 CHECKS=1072250000	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/langford2/ normalized-langford-2-14.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/langford2/ normalized-langford-2-17.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford2/ normalized-langford-2-19.xml	SAT TT=0.031	SAT TT=1.169 CHECKS=47249 NODES=122	SAT TT=1.139 CHECKS=86218 NODES=121	SAT TT=0.119	SAT TT=1.099 CHECKS=6400640	SAT TT=1.152 CHECKS=6094220	SAT TT=1.502 ASSIGNMENTS=28	SAT TT=3.062 ASSIGNMENTS=7880	SAT TT=1.563 CHECKS=34374 NODES=86	SAT TT=1.61 CHECKS=1244670 NODES=1126	SAT TT=1.469 CHECKS=349415 NODES=184	SAT TT=0.043 ASSIGNMENTS=34 CHECKS=3346	SAT TT=0.044 ASSIGNMENTS=34 CHECKS=3346	SAT TT=3.806	SAT TT=3.677	SAT TT=0.031 ASSIGNMENTS=36 CHECKS=3650	SAT TT=0.032 ASSIGNMENTS=15 CHECKS=2143	SAT TT=9.495	SAT TT=0.098 ASSIGNMENTS=521 CHECKS=54440	SAT TT=0.039 ASSIGNMENTS=193 CHECKS=16430	SAT TT=5.648	SAT TT=1.384	SAT TT=1.464
csp/langford2/ normalized-langford-2-20.xml	SAT TT=0.035	SAT TT=1.233 CHECKS=92424 NODES=252	SAT TT=1.321 CHECKS=137728 NODES=252	SAT TT=0.122	SAT TT=2.203 CHECKS=13292700	SAT TT=2.538 CHECKS=13317300	SAT TT=1.557 ASSIGNMENTS=55	SAT TT=2.37 ASSIGNMENTS=2721	SAT TT=1.849 CHECKS=49899 NODES=135	SAT TT=1.895 CHECKS=2458250 NODES=2065	SAT TT=1.61 CHECKS=457625 NODES=230	SAT TT=0.047 ASSIGNMENTS=40 CHECKS=4384	SAT TT=0.049 ASSIGNMENTS=40 CHECKS=4384	SAT TT=4.323	SAT TT=4.355	SAT TT=0.036 ASSIGNMENTS=40 CHECKS=4384	SAT TT=0.035 ASSIGNMENTS=23 CHECKS=2870	SAT TT=17.167	SAT TT=0.134 ASSIGNMENTS=713 CHECKS=76941	SAT TT=0.038 ASSIGNMENTS=76 CHECKS=7851	SAT TT=6.8	SAT TT=1.261	SAT TT=1.551
csp/langford2/ normalized-langford-2-25.xml		? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/langford2/ normalized-langford-2-2.xml	UNSAT TT=0.006	UNSAT TT=0.676 CHECKS=25 NODES=0	UNSAT TT=0.68 CHECKS=25 NODES=0	UNSAT TT=0.025	UNSAT TT=0.008 CHECKS=21	UNSAT TT=0.008 CHECKS=21	UNSAT TT=0.45 ASSIGNMENTS=0	UNSAT TT=0.481 ASSIGNMENTS=0	UNSAT TT=0.421 CHECKS=26 NODES=0	UNSAT TT=0.407 CHECKS=34 NODES=0	UNSAT TT=0.424 CHECKS=34 NODES=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.975	UNSAT TT=0.692	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.285	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=17	UNSAT TT=0.883	UNSAT TT=0.453	UNSAT TT=0.452
csp/langford2/ normalized-langford-2-30.xml		? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/langford2/ normalized-langford-2-4.xml	SAT TT=0.007	SAT TT=0.714 CHECKS=240 NODES=8	SAT TT=0.694 CHECKS=240 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=1735	SAT TT=0.008 CHECKS=7133	SAT TT=0.529 ASSIGNMENTS=2	SAT TT=1.153 ASSIGNMENTS=2	SAT TT=0.482 CHECKS=263 NODES=10	SAT TT=0.509 CHECKS=4535 NODES=105	SAT TT=0.54 CHECKS=217772 NODES=2381	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=96	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=96	SAT TT=1.207	SAT TT=1.058	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=96	SAT TT=0.008 ASSIGNMENTS=1 CHECKS=95	SAT TT=0.309	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=133	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=96	SAT TT=0.976	SAT TT=0.518	SAT TT=0.506
csp/langford2/ normalized-langford-2-50.xml		? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (MO) TT=1483.11	? (MO) TT=1064.28	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.24	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/langford2/ normalized-langford-2-5.xml	UNSAT TT=0.006	UNSAT TT=0.732 CHECKS=2511 NODES=36	UNSAT TT=0.716 CHECKS=3275 NODES=36	UNSAT TT=0.03	UNSAT TT=0.016 CHECKS=7536	UNSAT TT=0.009 CHECKS=6652	UNSAT TT=0.617 ASSIGNMENTS=8	UNSAT TT=0.642 ASSIGNMENTS=9	UNSAT TT=0.675 CHECKS=1307 NODES=35	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=17 CHECKS=836	UNSAT TT=0.02 ASSIGNMENTS=17 CHECKS=836	UNSAT TT=0.884	UNSAT TT=0.897	UNSAT TT=0.006 ASSIGNMENTS=15 CHECKS=779	UNSAT TT=0.007 ASSIGNMENTS=16 CHECKS=852	UNSAT TT=0.334	UNSAT TT=0.009 ASSIGNMENTS=46 CHECKS=1755	UNSAT TT=0.008 ASSIGNMENTS=20 CHECKS=980	UNSAT TT=1.437	UNSAT TT=0.592	UNSAT TT=0.533
csp/langford2/ normalized-langford-2-7.xml	SAT TT=0.008	SAT TT=0.807 CHECKS=1221 NODES=15	SAT TT=0.754 CHECKS=2687 NODES=0	SAT TT=0.036	SAT TT=0.02 CHECKS=7154	SAT TT=0.011 CHECKS=4875	SAT TT=0.792 ASSIGNMENTS=4	SAT TT=0.711 ASSIGNMENTS=8	SAT TT=0.671 CHECKS=1172 NODES=19	SAT TT=0.67 CHECKS=32731 NODES=226	SAT TT=1.069 CHECKS=2759890 NODES=6201	SAT TT=0.021 ASSIGNMENTS=3 CHECKS=284	SAT TT=0.021 ASSIGNMENTS=3 CHECKS=284	SAT TT=1.543	SAT TT=1.283	SAT TT=0.008 ASSIGNMENTS=3 CHECKS=284	SAT TT=0.01 ASSIGNMENTS=8 CHECKS=503	SAT TT=0.356	SAT TT=0.012 ASSIGNMENTS=30 CHECKS=1484	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=374	SAT TT=1.624	SAT TT=0.619	SAT TT=0.661
csp/langford2/ normalized-langford-2-8.xml	SAT TT=0.01	SAT TT=0.787 CHECKS=5268 NODES=63	SAT TT=0.868 CHECKS=8832 NODES=63	SAT TT=0.039	SAT TT=0.026 CHECKS=15286	SAT TT=0.013 CHECKS=14851	SAT TT=0.742 ASSIGNMENTS=13	SAT TT=0.788 ASSIGNMENTS=8	SAT TT=0.799 CHECKS=2225 NODES=30	SAT TT=0.781 CHECKS=53755 NODES=282	SAT TT=0.864 CHECKS=12710 NODES=27	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=918	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=918	SAT TT=1.84	SAT TT=1.511	SAT TT=0.011 ASSIGNMENTS=13 CHECKS=946	SAT TT=0.01 ASSIGNMENTS=5 CHECKS=396	SAT TT=0.393	SAT TT=0.012 ASSIGNMENTS=67 CHECKS=3406	SAT TT=0.011 ASSIGNMENTS=13 CHECKS=914	SAT TT=2.131	SAT TT=0.673	SAT TT=0.681
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford3/ normalized-langford-3-10.xml	SAT TT=0.026	SAT TT=1.327 CHECKS=430675 NODES=1480	SAT TT=1.355 CHECKS=455334 NODES=1508	SAT TT=0.109	SAT TT=0.959 CHECKS=5165700	SAT TT=0.7 CHECKS=4143060	SAT TT=1.32 ASSIGNMENTS=378	SAT TT=1.248 ASSIGNMENTS=105	SAT TT=1.172 CHECKS=21923 NODES=146	SAT TT=5.262 CHECKS=29411500 NODES=57184	? (TO) TT=1800.09	SAT TT=0.067 ASSIGNMENTS=336 CHECKS=63773	SAT TT=0.066 ASSIGNMENTS=336 CHECKS=63773	SAT TT=2.654	SAT TT=2.763	SAT TT=0.053 ASSIGNMENTS=335 CHECKS=62877	SAT TT=0.026 ASSIGNMENTS=56 CHECKS=11058	SAT TT=0.808	SAT TT=0.078 ASSIGNMENTS=491 CHECKS=89677	SAT TT=0.143 ASSIGNMENTS=1245 CHECKS=237305	SAT TT=5.346	SAT TT=1.208	SAT TT=1.46
csp/langford3/ normalized-langford-3-11.xml	UNSAT TT=0.88	UNSAT TT=7.225 CHECKS=9951240 NODES=34279	UNSAT TT=7.398 CHECKS=9985230 NODES=34349	UNSAT TT=0.945	UNSAT TT=92.396 CHECKS=525283000	UNSAT TT=102.815 CHECKS=567343000	UNSAT TT=7.949 ASSIGNMENTS=23027	UNSAT TT=8.918 ASSIGNMENTS=23267	UNSAT TT=9.446 CHECKS=3169520 NODES=19411	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.88 ASSIGNMENTS=8186 CHECKS=1577810	UNSAT TT=0.888 ASSIGNMENTS=8186 CHECKS=1577810	UNSAT TT=13.608	UNSAT TT=13.103	UNSAT TT=0.925 ASSIGNMENTS=8218 CHECKS=1587330	UNSAT TT=1.289 ASSIGNMENTS=11503 CHECKS=2184580	UNSAT TT=3.984	UNSAT TT=2.99 ASSIGNMENTS=27411 CHECKS=5212290	UNSAT TT=1.534 ASSIGNMENTS=13775 CHECKS=2652040	UNSAT TT=155.457	UNSAT TT=11.445	UNSAT TT=12.662
csp/langford3/ normalized-langford-3-12.xml	UNSAT TT=3.945	UNSAT TT=31.016 CHECKS=46124200 NODES=153737	UNSAT TT=30.531 CHECKS=46169400 NODES=153762	UNSAT TT=3.945	UNSAT TT=375.462 CHECKS=2321330000	UNSAT TT=407.061 CHECKS=2245260000	UNSAT TT=26.657 ASSIGNMENTS=90137	UNSAT TT=28.396 ASSIGNMENTS=74336	UNSAT TT=66.393 CHECKS=20081000 NODES=81778	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=35.393 ASSIGNMENTS=153737 CHECKS=46124200	UNSAT TT=35.031 ASSIGNMENTS=153737 CHECKS=46124200	UNSAT TT=209.475	UNSAT TT=92.37	UNSAT TT=4.134 ASSIGNMENTS=34675 CHECKS=7114670	UNSAT TT=4.471 ASSIGNMENTS=38052 CHECKS=7767450	UNSAT TT=18.353	UNSAT TT=13.007 ASSIGNMENTS=105689 CHECKS=22446300	UNSAT TT=6.199 ASSIGNMENTS=51872 CHECKS=10659200	UNSAT TT=1502.82	UNSAT TT=85.49	UNSAT TT=82.731
csp/langford3/ normalized-langford-3-13.xml	UNSAT TT=18.507	UNSAT TT=156.822 CHECKS=237252000 NODES=750737	UNSAT TT=153.211 CHECKS=237232000 NODES=750563	UNSAT TT=18.507	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=117.058 ASSIGNMENTS=400170	UNSAT TT=146.249 ASSIGNMENTS=360818	UNSAT TT=209.299 CHECKS=119771000 NODES=382480	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=149.085 ASSIGNMENTS=750737 CHECKS=237252000	UNSAT TT=149.671 ASSIGNMENTS=750737 CHECKS=237252000	? (TO) TT=1800.08	UNSAT TT=827.471	UNSAT TT=20.403 ASSIGNMENTS=164322 CHECKS=35437500	UNSAT TT=20.677 ASSIGNMENTS=167158 CHECKS=36001200	UNSAT TT=95.162	UNSAT TT=77.834 ASSIGNMENTS=623437 CHECKS=135623000	UNSAT TT=30.852 ASSIGNMENTS=250177 CHECKS=53971200	? (TO) TT=1800.11	UNSAT TT=788.596	UNSAT TT=1059.88
csp/langford3/ normalized-langford-3-16.xml		? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.11
csp/langford3/ normalized-langford-3-18.xml	SAT TT=0.52	SAT TT=28.567 CHECKS=40139700 NODES=86840	SAT TT=26.4 CHECKS=40176700 NODES=86651	SAT TT=3.72	SAT TT=10.542 CHECKS=65004100	SAT TT=51.46 CHECKS=272826000	SAT TT=11.796 ASSIGNMENTS=27332	SAT TT=74.74 ASSIGNMENTS=130122	SAT TT=45.722 CHECKS=19529500 NODES=36825	SAT TT=701.332 CHECKS=5319120000 NODES=2973570	? (TO) TT=1800.04	SAT TT=33.607 ASSIGNMENTS=86840 CHECKS=40139700	SAT TT=33.548 ASSIGNMENTS=86840 CHECKS=40139700	SAT TT=7.946	SAT TT=25.245	SAT TT=4.882 ASSIGNMENTS=30291 CHECKS=8635890	SAT TT=0.52 ASSIGNMENTS=2237 CHECKS=598521	SAT TT=13.07	SAT TT=0.76 ASSIGNMENTS=3630 CHECKS=997705	SAT TT=2.589 ASSIGNMENTS=17428 CHECKS=4831400	SAT TT=300.078	SAT TT=12.513	SAT TT=4.98
csp/langford3/ normalized-langford-3-20.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.38	? (TO) TT=1800.09	? (TO) TT=1800.16
csp/langford3/ normalized-langford-3-21.xml		? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/langford3/ normalized-langford-3-2.xml	UNSAT TT=0.006	UNSAT TT=0.649 CHECKS=44 NODES=0	UNSAT TT=0.726 CHECKS=44 NODES=0	UNSAT TT=0.028	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.008 CHECKS=18	UNSAT TT=0.488 ASSIGNMENTS=0	UNSAT TT=0.48 ASSIGNMENTS=0	UNSAT TT=0.427 CHECKS=15 NODES=0	UNSAT TT=0.444 CHECKS=78 NODES=0	UNSAT TT=0.418 CHECKS=78 NODES=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=1.027	UNSAT TT=0.76	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.288	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=12	UNSAT TT=0.925	UNSAT TT=0.48	UNSAT TT=0.499
csp/langford3/ normalized-langford-3-3.xml	UNSAT TT=0.006	UNSAT TT=0.676 CHECKS=189 NODES=0	UNSAT TT=0.721 CHECKS=189 NODES=0	UNSAT TT=0.029	UNSAT TT=0.012 CHECKS=203	UNSAT TT=0.007 CHECKS=203	UNSAT TT=0.518 ASSIGNMENTS=0	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.522 CHECKS=200 NODES=0	UNSAT TT=0.515 CHECKS=358 NODES=0	UNSAT TT=0.542 CHECKS=358 NODES=0	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=1.082	UNSAT TT=0.919	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.31	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=82	UNSAT TT=1.275	UNSAT TT=0.564	UNSAT TT=0.531
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford3/ normalized-langford-3-40.xml		? (TO) TT=1800.2	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.01	? (MO) TT=1182.78	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=561.598	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/langford3/ normalized-langford-3-5.xml	UNSAT TT=0.009	UNSAT TT=0.768 CHECKS=3135 NODES=12	UNSAT TT=0.863 CHECKS=7462 NODES=0	UNSAT TT=0.038	UNSAT TT=0.025 CHECKS=9334	UNSAT TT=0.011 CHECKS=12337	UNSAT TT=0.669 ASSIGNMENTS=0	UNSAT TT=0.72 ASSIGNMENTS=0	UNSAT TT=0.746 CHECKS=1927 NODES=10	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.021 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=0.023 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=1.142	UNSAT TT=0.975	UNSAT TT=0.009 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=0.012 ASSIGNMENTS=6 CHECKS=920	UNSAT TT=0.413	UNSAT TT=0.009 ASSIGNMENTS=18 CHECKS=1802	UNSAT TT=0.01 ASSIGNMENTS=5 CHECKS=804	UNSAT TT=1.718	UNSAT TT=0.693	UNSAT TT=0.687
csp/langford3/ normalized-langford-3-6.xml	UNSAT TT=0.012	UNSAT TT=0.854 CHECKS=10812 NODES=43	UNSAT TT=0.877 CHECKS=16154 NODES=43	UNSAT TT=0.044	UNSAT TT=0.038 CHECKS=37526	UNSAT TT=0.02 CHECKS=42296	UNSAT TT=0.901 ASSIGNMENTS=0	UNSAT TT=0.804 ASSIGNMENTS=0	UNSAT TT=0.966 CHECKS=4712 NODES=35	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=0.024 ASSIGNMENTS=15 CHECKS=2190	UNSAT TT=0.024 ASSIGNMENTS=15 CHECKS=2190	UNSAT TT=1.228	UNSAT TT=1.241	UNSAT TT=0.012 ASSIGNMENTS=15 CHECKS=2257	UNSAT TT=0.012 ASSIGNMENTS=17 CHECKS=2629	UNSAT TT=0.406	UNSAT TT=0.015 ASSIGNMENTS=72 CHECKS=8304	UNSAT TT=0.013 ASSIGNMENTS=15 CHECKS=2190	UNSAT TT=2.042	UNSAT TT=0.909	UNSAT TT=0.77
csp/langford3/ normalized-langford-3-9.xml	SAT TT=0.029	SAT TT=1.116 CHECKS=122460 NODES=439	SAT TT=1.188 CHECKS=145475 NODES=464	SAT TT=0.082	SAT TT=0.273 CHECKS=1254320	SAT TT=0.239 CHECKS=1231570	SAT TT=1.27 ASSIGNMENTS=47	SAT TT=1.204 ASSIGNMENTS=148	SAT TT=1.112 CHECKS=4944 NODES=32	SAT TT=8.558 CHECKS=50477600 NODES=123551	? (TO) TT=1800.01	SAT TT=0.042 ASSIGNMENTS=110 CHECKS=19284	SAT TT=0.039 ASSIGNMENTS=110 CHECKS=19284	SAT TT=2.425	SAT TT=2.392	SAT TT=0.029 ASSIGNMENTS=110 CHECKS=18737	SAT TT=0.033 ASSIGNMENTS=157 CHECKS=24694	SAT TT=0.773	SAT TT=0.044 ASSIGNMENTS=247 CHECKS=39094	SAT TT=0.051 ASSIGNMENTS=329 CHECKS=56553	SAT TT=3.996	SAT TT=1.167	SAT TT=1.043
csp/langford4/ normalized-langford-4-11.xml	UNSAT TT=0.287	UNSAT TT=3.274 CHECKS=3540950 NODES=4874	UNSAT TT=3.273 CHECKS=3608040 NODES=4824	UNSAT TT=0.42	UNSAT TT=76.405 CHECKS=438714000	UNSAT TT=74.117 CHECKS=439312000	UNSAT TT=3.329 ASSIGNMENTS=1997	UNSAT TT=3.849 ASSIGNMENTS=2297	UNSAT TT=4.388 CHECKS=1797160 NODES=2660	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=0.308 ASSIGNMENTS=1085 CHECKS=421132	UNSAT TT=0.321 ASSIGNMENTS=1085 CHECKS=421132	UNSAT TT=4.763	UNSAT TT=5.556	UNSAT TT=0.287 ASSIGNMENTS=1085 CHECKS=420374	UNSAT TT=1.045 ASSIGNMENTS=4370 CHECKS=1610720	UNSAT TT=1.614	UNSAT TT=0.687 ASSIGNMENTS=2547 CHECKS=927686	UNSAT TT=0.457 ASSIGNMENTS=1694 CHECKS=653829	UNSAT TT=50.933	UNSAT TT=3.633	UNSAT TT=3.885
csp/langford4/ normalized-langford-4-12.xml	UNSAT TT=0.924	UNSAT TT=8.389 CHECKS=12397300 NODES=17043	UNSAT TT=8.346 CHECKS=12474400 NODES=17039	UNSAT TT=1.056	UNSAT TT=111.334 CHECKS=644339000	UNSAT TT=107.688 CHECKS=594234000	UNSAT TT=6.429 ASSIGNMENTS=6711	UNSAT TT=12.201 ASSIGNMENTS=11501	UNSAT TT=12.282 CHECKS=6315260 NODES=7914	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.939 ASSIGNMENTS=3231 CHECKS=1339270	UNSAT TT=0.934 ASSIGNMENTS=3231 CHECKS=1339270	UNSAT TT=11.216	UNSAT TT=10.849	UNSAT TT=0.924 ASSIGNMENTS=3269 CHECKS=1353120	UNSAT TT=1.823 ASSIGNMENTS=6462 CHECKS=2611750	UNSAT TT=3.891	UNSAT TT=2.996 ASSIGNMENTS=10575 CHECKS=4253700	UNSAT TT=1.487 ASSIGNMENTS=5190 CHECKS=2134220	UNSAT TT=188.915	UNSAT TT=11.746	UNSAT TT=10.733
csp/langford4/ normalized-langford-4-14.xml	UNSAT TT=11.54	UNSAT TT=104.153 CHECKS=180272000 NODES=225947	UNSAT TT=102.354 CHECKS=180438000 NODES=226034	UNSAT TT=11.54	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=60.717 ASSIGNMENTS=86778	UNSAT TT=113.189 ASSIGNMENTS=127155	UNSAT TT=184.683 CHECKS=99379800 NODES=101231	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=110.935 ASSIGNMENTS=225947 CHECKS=180272000	UNSAT TT=110.463 ASSIGNMENTS=225947 CHECKS=180272000	UNSAT TT=502.476	UNSAT TT=523.083	UNSAT TT=12.444 ASSIGNMENTS=41400 CHECKS=19024500	UNSAT TT=13.608 ASSIGNMENTS=44886 CHECKS=20579500	UNSAT TT=61.888	UNSAT TT=55.108 ASSIGNMENTS=204109 CHECKS=87042100	UNSAT TT=19.061 ASSIGNMENTS=64780 CHECKS=29731500	? (TO) TT=1800.15	UNSAT TT=499.393	UNSAT TT=377.969
csp/langford4/ normalized-langford-4-17.xml	UNSAT TT=759.747	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=759.747	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=985.394 ASSIGNMENTS=2930680 CHECKS=1539890000	UNSAT TT=981.587 ASSIGNMENTS=2934720 CHECKS=1542030000	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=1259.87 ASSIGNMENTS=4010500 CHECKS=2108980000	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.11
csp/langford4/ normalized-langford-4-18.xml		? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/langford4/ normalized-langford-4-19.xml		? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.2	? (TO) TT=1800.04	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/langford4/ normalized-langford-4-20.xml		? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.2	? (TO) TT=1800	? (TO) TT=1800.09
csp/langford4/ normalized-langford-4-2.xml	UNSAT TT=0.007	UNSAT TT=0.671 CHECKS=89 NODES=0	UNSAT TT=0.7 CHECKS=89 NODES=0	UNSAT TT=0.028	UNSAT TT=0.011 CHECKS=33	UNSAT TT=0.008 CHECKS=33	UNSAT TT=0.59 ASSIGNMENTS=0	UNSAT TT=0.514 ASSIGNMENTS=0	UNSAT TT=0.477 CHECKS=34 NODES=0	UNSAT TT=0.472 CHECKS=215 NODES=0	UNSAT TT=0.527 CHECKS=215 NODES=0	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.931	UNSAT TT=0.823	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.308	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=25	UNSAT TT=1.044	UNSAT TT=0.497	UNSAT TT=0.517
csp/langford4/ normalized-langford-4-30.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.04	? TT=349.357	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/langford4/ normalized-langford-4-3.xml	UNSAT TT=0.006	UNSAT TT=0.737 CHECKS=218 NODES=0	UNSAT TT=0.742 CHECKS=218 NODES=0	UNSAT TT=0.032	UNSAT TT=0.02 CHECKS=72	UNSAT TT=0.011 CHECKS=72	UNSAT TT=0.607 ASSIGNMENTS=0	UNSAT TT=0.666 ASSIGNMENTS=0	UNSAT TT=0.593 CHECKS=52 NODES=0	UNSAT TT=0.625 CHECKS=540 NODES=0	UNSAT TT=0.62 CHECKS=540 NODES=0	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=1.169	UNSAT TT=0.829	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.362	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=50	UNSAT TT=1.657	UNSAT TT=0.597	UNSAT TT=0.66
csp/langford4/ normalized-langford-4-40.xml		? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (MO) TT=1262.45	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=118.917	? (TO) TT=1800.08	? (TO) TT=1800
csp/langford4/ normalized-langford-4-4.xml	UNSAT TT=0.01	UNSAT TT=0.753 CHECKS=875 NODES=0	UNSAT TT=0.775 CHECKS=875 NODES=0	UNSAT TT=0.04	UNSAT TT=0.027 CHECKS=815	UNSAT TT=0.01 CHECKS=815	UNSAT TT=0.771 ASSIGNMENTS=0	UNSAT TT=0.731 ASSIGNMENTS=0	UNSAT TT=0.756 CHECKS=857 NODES=0	UNSAT TT=0.833 CHECKS=1773 NODES=0	UNSAT TT=0.706 CHECKS=1773 NODES=0	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=1.569	UNSAT TT=1.006	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.438	UNSAT TT=0.01 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=224	UNSAT TT=1.968	UNSAT TT=0.688	UNSAT TT=0.694
csp/langford4/ normalized-langford-4-5.xml	UNSAT TT=0.011	UNSAT TT=0.831 CHECKS=3255 NODES=1	UNSAT TT=0.816 CHECKS=3285 NODES=0	UNSAT TT=0.05	UNSAT TT=0.035 CHECKS=6858	UNSAT TT=0.014 CHECKS=6934	UNSAT TT=0.784 ASSIGNMENTS=0	UNSAT TT=0.88 ASSIGNMENTS=0	UNSAT TT=0.88 CHECKS=3147 NODES=4	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.024 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=0.025 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=1.191	UNSAT TT=1.175	UNSAT TT=0.012 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=0.013 ASSIGNMENTS=2 CHECKS=891	UNSAT TT=0.528	UNSAT TT=0.011 ASSIGNMENTS=12 CHECKS=2217	UNSAT TT=0.014 ASSIGNMENTS=1 CHECKS=806	UNSAT TT=2.085	UNSAT TT=0.776	UNSAT TT=0.809
csp/langford4/ normalized-langford-4-8.xml	UNSAT TT=0.029	UNSAT TT=1.144 CHECKS=107341 NODES=172	UNSAT TT=1.149 CHECKS=139296 NODES=172	UNSAT TT=0.096	UNSAT TT=0.147 CHECKS=469450	UNSAT TT=0.1 CHECKS=456513	UNSAT TT=1.355 ASSIGNMENTS=19	UNSAT TT=1.276 ASSIGNMENTS=22	UNSAT TT=1.283 CHECKS=28080 NODES=113	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=0.042 ASSIGNMENTS=38 CHECKS=12609	UNSAT TT=0.041 ASSIGNMENTS=38 CHECKS=12609	UNSAT TT=1.974	UNSAT TT=2.272	UNSAT TT=0.029 ASSIGNMENTS=38 CHECKS=12605	UNSAT TT=0.038 ASSIGNMENTS=107 CHECKS=29706	UNSAT TT=0.633	UNSAT TT=0.055 ASSIGNMENTS=176 CHECKS=44518	UNSAT TT=0.032 ASSIGNMENTS=38 CHECKS=12642	UNSAT TT=4.686	UNSAT TT=1.131	UNSAT TT=1.164
csp/langford4/ normalized-langford-4-9.xml	UNSAT TT=0.048	UNSAT TT=1.36 CHECKS=310918 NODES=384	UNSAT TT=1.292 CHECKS=350777 NODES=396	UNSAT TT=0.119	UNSAT TT=0.741 CHECKS=4143060	UNSAT TT=0.802 CHECKS=4812750	UNSAT TT=1.383 ASSIGNMENTS=40	UNSAT TT=1.595 ASSIGNMENTS=205	UNSAT TT=1.51 CHECKS=116307 NODES=194	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.063 ASSIGNMENTS=107 CHECKS=38109	UNSAT TT=0.061 ASSIGNMENTS=107 CHECKS=38109	UNSAT TT=2.5	UNSAT TT=2.281	UNSAT TT=0.048 ASSIGNMENTS=90 CHECKS=33757	UNSAT TT=0.077 ASSIGNMENTS=247 CHECKS=78361	UNSAT TT=0.728	UNSAT TT=0.103 ASSIGNMENTS=360 CHECKS=109655	UNSAT TT=0.052 ASSIGNMENTS=128 CHECKS=45891	UNSAT TT=6.969	UNSAT TT=1.173	UNSAT TT=1.277
csp/largeQueens/ normalized-queens-1000.xml		? (MO) TT=195.063	? (MO) TT=190.497	? (problem) TT=114.741	? TT=41.426	? TT=1408.4	? (TO) TT=1802.18	? (TO) TT=1802.18	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (problem) TT=1651.78	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.09	? (exit code) TT=879.604	? (TO) TT=1800.16	? (TO) TT=1800.16	? TT=214.851	? TT=329.86	? TT=349.209
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/largeQueens/ normalized-queens-300.xml	SAT TT=10.921	SAT TT=47.667 CHECKS=60271000 NODES=764	SAT TT=48.538 CHECKS=60271000 NODES=764	SAT TT=10.921	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.14	? TT=1094.35	? (TO) TT=1078.44	? (TO) TT=1095.6	? (TO) TT=1800.04	SAT TT=96.78 ASSIGNMENTS=3857 CHECKS=192532000	? (MO) TT=1293.4	? (MO) TT=1278.05	? (TO) TT=1800.09	SAT TT=381.094 ASSIGNMENTS=283 CHECKS=8146680	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=538.817	? (MO) TT=148.413	? (MO) TT=335.366
csp/largeQueens/ normalized-queens-400.xml	SAT TT=20.094	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=20.094	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.25	? (TO) TT=1800.25	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1163.14 ASSIGNMENTS=386 CHECKS=19469000	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=217.91	? TT=198.9	? TT=182.026
csp/largeQueens/ normalized-queens-500.xml	SAT TT=47.463	? (TO) TT=1800.18	? (TO) TT=1800.17	SAT TT=47.463	? TT=798.022	? (TO) TT=1800.13	? (MO) TT=147.012	? (MO) TT=168.129	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? TT=217.806	? TT=211.551	? TT=197.264
csp/largeQueens/ normalized-queens-800.xml		? (MO) TT=58.382	? (MO) TT=57.752	? (TO) TT=1800.15	Signal TT=44.892	? TT=568.455	? (TO) TT=1802.22	? (TO) TT=1802.19	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (exit code) TT=207.864	? (TO) TT=1800.14	? (TO) TT=1800.06	? TT=243.976	? (MO) TT=6.299	? TT=139.476
csp/nengfa/ normalized-color.xml	UNSAT TT=1.574	UNSAT TT=30.112 CHECKS=16358100 NODES=15419	UNSAT TT=20.121 CHECKS=8515120 NODES=8855	UNSAT TT=56.097	UNSAT TT=1038.52 CHECKS=2277000000	? (TO) TT=1800.04	UNSAT TT=18.273 ASSIGNMENTS=471	UNSAT TT=14.323 ASSIGNMENTS=91	UNSAT TT=124.562 CHECKS=2886830 NODES=7605	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=1.594 ASSIGNMENTS=1460 CHECKS=1007930	UNSAT TT=1.574 ASSIGNMENTS=1460 CHECKS=1007930	UNSAT TT=1525.69	UNSAT TT=1428.69	UNSAT TT=1.575 ASSIGNMENTS=1500 CHECKS=967643	UNSAT TT=12.455 ASSIGNMENTS=20302 CHECKS=15248200	UNSAT TT=3.252	UNSAT TT=2.427 ASSIGNMENTS=4242 CHECKS=1827390	UNSAT TT=1.761 ASSIGNMENTS=1993 CHECKS=1329870	UNSAT TT=174.167	UNSAT TT=8.212	UNSAT TT=8.352
csp/nengfa/ normalized-queens1.xml	SAT TT=2.198	SAT TT=4.196 CHECKS=734619 NODES=171	SAT TT=4.677 CHECKS=1226290 NODES=171	SAT TT=64.045	SAT TT=24.803 CHECKS=50564700	SAT TT=51.429 CHECKS=119303000	SAT TT=57.435 ASSIGNMENTS=538	SAT TT=56.573 ASSIGNMENTS=179	SAT TT=53.104 CHECKS=4287610 NODES=872	SAT TT=21.312 CHECKS=7264080 NODES=72	SAT TT=22.38 CHECKS=8987760 NODES=100	SAT TT=51.329 ASSIGNMENTS=538	SAT TT=12.959 ASSIGNMENTS=192 CHECKS=752993	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=249.191 ASSIGNMENTS=50386 CHECKS=222703000	SAT TT=133.192 ASSIGNMENTS=10209 CHECKS=103484000	? (TO) TT=1800.08	SAT TT=141.931 ASSIGNMENTS=7459 CHECKS=99992400	SAT TT=2.198 ASSIGNMENTS=103 CHECKS=965177	? TT=605.589	SAT TT=12.047	SAT TT=35.547
csp/nengfa/ normalized-route.xml	SAT TT=4.692	SAT TT=7.963 CHECKS=75471 NODES=81	SAT TT=8.606 CHECKS=202929 NODES=0	SAT TT=257.539	SAT TT=21.234 CHECKS=20942800	SAT TT=17.992 CHECKS=14367400	SAT TT=17.059 ASSIGNMENTS=33	SAT TT=16.142 ASSIGNMENTS=36	SAT TT=21.759 CHECKS=115846 NODES=117	SAT TT=138.084 CHECKS=49755100 NODES=9057	SAT TT=28.152 CHECKS=8875040 NODES=437	SAT TT=14.706 ASSIGNMENTS=115 CHECKS=3601910	SAT TT=16.973 ASSIGNMENTS=81 CHECKS=75471	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=4.692 ASSIGNMENTS=116 CHECKS=3594490	SAT TT=6.223 ASSIGNMENTS=389 CHECKS=4617750	SAT TT=6.323	SAT TT=8.757 ASSIGNMENTS=271 CHECKS=7017180	SAT TT=5.609 ASSIGNMENTS=115 CHECKS=3601910	? (exit code) TT=98.927	SAT TT=6.839	SAT TT=7.342
csp/os-gp/ normalized-gp10-01-1092.xml	UNSAT TT=5.173	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=5.173 ASSIGNMENTS=347	UNSAT TT=5.934 ASSIGNMENTS=347	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=12.597 ASSIGNMENTS=347	UNSAT TT=675.9 ASSIGNMENTS=39181 CHECKS=127633000	? (problem) TT=76.094	? (problem) TT=79.934	UNSAT TT=35.8 ASSIGNMENTS=67362 CHECKS=248398000	UNSAT TT=9.817 ASSIGNMENTS=25555 CHECKS=62539300	? (TO) TT=1800.08	UNSAT TT=20.022 ASSIGNMENTS=36660 CHECKS=116574000	UNSAT TT=19.071 ASSIGNMENTS=39181 CHECKS=127633000	? TT=255.48	UNSAT TT=8.635	UNSAT TT=21.501
csp/os-gp/ normalized-gp10-01-1093.xml	SAT TT=1.102	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=3.25 ASSIGNMENTS=209	SAT TT=3.265 ASSIGNMENTS=209	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=1.102 ASSIGNMENTS=2254 CHECKS=6862360	SAT TT=1.174 ASSIGNMENTS=2254 CHECKS=6862360	? (problem) TT=61.038	? (problem) TT=65.502	SAT TT=5.227 ASSIGNMENTS=11972 CHECKS=36794800	SAT TT=2.918 ASSIGNMENTS=14728 CHECKS=17167600	? (TO) TT=1800.1	SAT TT=3.971 ASSIGNMENTS=10119 CHECKS=20648200	SAT TT=2.078 ASSIGNMENTS=3852 CHECKS=13075200	? (exit code) TT=276.013	SAT TT=8.047	SAT TT=20.718
csp/os-gp/ normalized-gp10-02-1096.xml	UNSAT TT=0.201	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=28.335 CHECKS=36597000	? (TO) TT=1800.03	UNSAT TT=3.045 ASSIGNMENTS=5	UNSAT TT=3.203 ASSIGNMENTS=5	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=0.315 ASSIGNMENTS=279 CHECKS=1605400	UNSAT TT=0.313 ASSIGNMENTS=279 CHECKS=1605400	? (problem) TT=81.685	? (problem) TT=75.287	UNSAT TT=0.642 ASSIGNMENTS=892 CHECKS=3603820	UNSAT TT=2.397 ASSIGNMENTS=13535 CHECKS=14139000	UNSAT TT=1.743	UNSAT TT=0.664 ASSIGNMENTS=2614 CHECKS=2365430	UNSAT TT=0.201 ASSIGNMENTS=141 CHECKS=835396	? (exit code) TT=254.391	UNSAT TT=5.977	UNSAT TT=18.883
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-gp/ normalized-gp10-02-1097.xml	SAT TT=0.096	SAT TT=171.617 CHECKS=4897280 NODES=31311	SAT TT=169.826 CHECKS=4897280 NODES=31311	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=2.633 ASSIGNMENTS=116	SAT TT=2.912 ASSIGNMENTS=116	SAT TT=66.226 CHECKS=0 NODES=299	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.112 ASSIGNMENTS=180 CHECKS=209382	SAT TT=0.113 ASSIGNMENTS=180 CHECKS=209382	? (problem) TT=71.199	? (problem) TT=71.596	SAT TT=0.096 ASSIGNMENTS=164 CHECKS=190354	SAT TT=2.19 ASSIGNMENTS=12929 CHECKS=12543900	SAT TT=2.797	SAT TT=0.523 ASSIGNMENTS=2841 CHECKS=1960780	SAT TT=0.176 ASSIGNMENTS=271 CHECKS=734485	? (exit code) TT=258.375	SAT TT=6.348	SAT TT=20.311
csp/os-gp/ normalized-gp10-03-1080.xml	UNSAT TT=11.632	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=17.771 ASSIGNMENTS=1923	UNSAT TT=16.688 ASSIGNMENTS=1923	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=23.426 ASSIGNMENTS=1923	UNSAT TT=763.728 ASSIGNMENTS=1923	? (problem) TT=71.506	? (problem) TT=66.276	? (TO) TT=1800.06	UNSAT TT=13.912 ASSIGNMENTS=37371 CHECKS=88851700	? (TO) TT=1800.1	? (TO) TT=1800.03	UNSAT TT=288.533 ASSIGNMENTS=657346 CHECKS=1989810000	? TT=270.107	UNSAT TT=11.632	UNSAT TT=22.864
csp/os-gp/ normalized-gp10-03-1081.xml	SAT TT=1.539	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=2.995 ASSIGNMENTS=212	SAT TT=3.068 ASSIGNMENTS=212	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=10.242 ASSIGNMENTS=212	SAT TT=656.965 ASSIGNMENTS=3206 CHECKS=9356440	? (problem) TT=59.556	? (problem) TT=58.827	SAT TT=32.546 ASSIGNMENTS=73141 CHECKS=212434000	SAT TT=6.963 ASSIGNMENTS=23230 CHECKS=46674100	? (TO) TT=1800.09	SAT TT=17.207 ASSIGNMENTS=36157 CHECKS=108550000	SAT TT=1.539 ASSIGNMENTS=3206 CHECKS=9356440	? TT=267.183	SAT TT=10.647	SAT TT=20.434
csp/os-gp/ normalized-gp10-04-1076.xml	UNSAT TT=0.33	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=4.085 ASSIGNMENTS=93	UNSAT TT=4.299 ASSIGNMENTS=93	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=1.199 ASSIGNMENTS=1999 CHECKS=7726470	UNSAT TT=1.231 ASSIGNMENTS=1999 CHECKS=7726470	? (problem) TT=61.298	? (problem) TT=61.043	UNSAT TT=3.146 ASSIGNMENTS=6727 CHECKS=21610200	UNSAT TT=2.254 ASSIGNMENTS=13138 CHECKS=13444800	? (TO) TT=1800.11	UNSAT TT=3.845 ASSIGNMENTS=8820 CHECKS=21605200	UNSAT TT=0.33 ASSIGNMENTS=616 CHECKS=1785850	? TT=298.061	UNSAT TT=7.013	UNSAT TT=20.371
csp/os-gp/ normalized-gp10-04-1077.xml	SAT TT=0.173	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=85.556 CHECKS=163990000	? (TO) TT=1800.02	SAT TT=3.591 ASSIGNMENTS=136	SAT TT=3.771 ASSIGNMENTS=136	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.433 ASSIGNMENTS=741 CHECKS=2620460	SAT TT=0.487 ASSIGNMENTS=741 CHECKS=2620460	? (problem) TT=70.913	? (problem) TT=70.933	SAT TT=0.965 ASSIGNMENTS=1796 CHECKS=6627750	SAT TT=2.46 ASSIGNMENTS=13046 CHECKS=13457100	SAT TT=1135.75	SAT TT=0.339 ASSIGNMENTS=1317 CHECKS=1229190	SAT TT=0.173 ASSIGNMENTS=302 CHECKS=732991	? (exit code) TT=302.78	SAT TT=6.545	SAT TT=18.396
csp/os-gp/ normalized-gp10-05-1070.xml	UNSAT TT=17.295	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=42.579 ASSIGNMENTS=5156	UNSAT TT=40.603 ASSIGNMENTS=5156	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.1	UNSAT TT=95.359 ASSIGNMENTS=331668 CHECKS=545762000	UNSAT TT=743.098 ASSIGNMENTS=331668 CHECKS=545762000	? (problem) TT=67.071	? (problem) TT=65.173	UNSAT TT=584.71 ASSIGNMENTS=1230390 CHECKS=3520620000	UNSAT TT=17.295 ASSIGNMENTS=47234 CHECKS=109996000	? (TO) TT=1800.12	UNSAT TT=20.123 ASSIGNMENTS=37199 CHECKS=124768000	UNSAT TT=90.362 ASSIGNMENTS=331668 CHECKS=545762000	? TT=290.541	UNSAT TT=19.394	UNSAT TT=25.654
csp/os-gp/ normalized-gp10-05-1071.xml	SAT TT=0.605	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=5.893 ASSIGNMENTS=471	SAT TT=5.8 ASSIGNMENTS=471	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=8.202 ASSIGNMENTS=652 CHECKS=1886440	SAT TT=655.782 ASSIGNMENTS=652 CHECKS=1886440	? (problem) TT=70.176	? (problem) TT=69.998	SAT TT=59.837 ASSIGNMENTS=203547 CHECKS=373835000	SAT TT=5.422 ASSIGNMENTS=19247 CHECKS=33929200	? (TO) TT=1800.04	SAT TT=10.116 ASSIGNMENTS=20730 CHECKS=49524300	SAT TT=0.605 ASSIGNMENTS=652 CHECKS=1886440	? (exit code) TT=293.967	SAT TT=12.416	SAT TT=22.934
csp/os-gp/ normalized-gp10-06-1070.xml	UNSAT TT=0.394	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=3.854 ASSIGNMENTS=73	UNSAT TT=4.074 ASSIGNMENTS=73	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=11.425 ASSIGNMENTS=73	UNSAT TT=656.349 ASSIGNMENTS=634 CHECKS=2239020	? (problem) TT=63.825	? (problem) TT=68.307	UNSAT TT=14.637 ASSIGNMENTS=27653 CHECKS=102594000	UNSAT TT=2.447 ASSIGNMENTS=12981 CHECKS=15020600	? (TO) TT=1800.03	UNSAT TT=2.155 ASSIGNMENTS=5551 CHECKS=11392600	UNSAT TT=0.394 ASSIGNMENTS=634 CHECKS=2239020	? (exit code) TT=272.581	UNSAT TT=6.839	UNSAT TT=20.13
csp/os-gp/ normalized-gp10-06-1071.xml	SAT TT=0.243	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=165.097 CHECKS=314611000	SAT TT=51.227 CHECKS=58584400	SAT TT=3.45 ASSIGNMENTS=116	SAT TT=3.426 ASSIGNMENTS=116	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.632 ASSIGNMENTS=767 CHECKS=3275020	SAT TT=0.499 ASSIGNMENTS=767 CHECKS=3275020	? (problem) TT=61.66	? (problem) TT=64.584	SAT TT=1.431 ASSIGNMENTS=2260 CHECKS=8900000	SAT TT=2.346 ASSIGNMENTS=12636 CHECKS=12395000	? (TO) TT=1800.09	SAT TT=0.474 ASSIGNMENTS=1475 CHECKS=2192830	SAT TT=0.243 ASSIGNMENTS=391 CHECKS=1096440	? (exit code) TT=288.058	SAT TT=6.418	SAT TT=20.033
csp/os-gp/ normalized-gp10-07-1078.xml	UNSAT TT=3.46	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=3.46 ASSIGNMENTS=70	UNSAT TT=3.631 ASSIGNMENTS=70	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=10.204 ASSIGNMENTS=70	UNSAT TT=664.527 ASSIGNMENTS=14319 CHECKS=51167300	? (problem) TT=69.476	? (problem) TT=64.411	UNSAT TT=8.832 ASSIGNMENTS=17279 CHECKS=58630000	UNSAT TT=14.676 ASSIGNMENTS=32691 CHECKS=90181000	? (TO) TT=1800.03	UNSAT TT=16.633 ASSIGNMENTS=30460 CHECKS=94220800	UNSAT TT=7.721 ASSIGNMENTS=14319 CHECKS=51167300	? (exit code) TT=310.235	UNSAT TT=6.352	UNSAT TT=19.133
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-gp/ normalized-gp10-07-1079.xml	SAT TT=0.23	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=3.615 ASSIGNMENTS=576	SAT TT=3.743 ASSIGNMENTS=576	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.238 ASSIGNMENTS=335 CHECKS=906372	SAT TT=0.23 ASSIGNMENTS=335 CHECKS=906372	? (problem) TT=66.156	? (problem) TT=75.003	SAT TT=0.467 ASSIGNMENTS=871 CHECKS=2743980	SAT TT=11.38 ASSIGNMENTS=32423 CHECKS=77182500	? (TO) TT=1800.1	SAT TT=2.351 ASSIGNMENTS=5954 CHECKS=12822500	SAT TT=1.643 ASSIGNMENTS=3326 CHECKS=10782000	? TT=293.237	SAT TT=6.552	SAT TT=18.828
csp/os-gp/ normalized-gp10-08-1092.xml	UNSAT TT=0.314	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=3.16 ASSIGNMENTS=53	UNSAT TT=3.293 ASSIGNMENTS=53	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=1.133 ASSIGNMENTS=1990 CHECKS=7309100	UNSAT TT=1.216 ASSIGNMENTS=1990 CHECKS=7309100	? (problem) TT=68.039	? (problem) TT=70.899	UNSAT TT=1.22 ASSIGNMENTS=2076 CHECKS=7583210	UNSAT TT=3.047 ASSIGNMENTS=14183 CHECKS=17246700	? (TO) TT=1800.04	UNSAT TT=1.854 ASSIGNMENTS=5350 CHECKS=9383550	UNSAT TT=0.314 ASSIGNMENTS=483 CHECKS=1683600	? (exit code) TT=304.579	UNSAT TT=7.649	UNSAT TT=20.299
csp/os-gp/ normalized-gp10-08-1093.xml	SAT TT=0.138	SAT TT=310.177 CHECKS=11710100 NODES=66736	SAT TT=307.06 CHECKS=11710100 NODES=66736	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=55.794 CHECKS=59145400	SAT TT=2.98 ASSIGNMENTS=156	SAT TT=3.069 ASSIGNMENTS=156	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=1.395 ASSIGNMENTS=2376 CHECKS=8543890	SAT TT=1.378 ASSIGNMENTS=2376 CHECKS=8543890	? (problem) TT=66.704	? (problem) TT=63.837	SAT TT=1.506 ASSIGNMENTS=2797 CHECKS=9739760	SAT TT=2.718 ASSIGNMENTS=13530 CHECKS=15351400	SAT TT=492.35	SAT TT=6.739 ASSIGNMENTS=12861 CHECKS=40364000	SAT TT=0.138 ASSIGNMENTS=253 CHECKS=523575	? (exit code) TT=307.156	SAT TT=6.88	SAT TT=20.518
csp/os-gp/ normalized-gp10-09-1111.xml	UNSAT TT=0.363	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=2.491 ASSIGNMENTS=37	UNSAT TT=2.529 ASSIGNMENTS=37	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=1.025 ASSIGNMENTS=2089 CHECKS=6345840	UNSAT TT=1.048 ASSIGNMENTS=2089 CHECKS=6345840	? (problem) TT=67.377	? (problem) TT=66.722	UNSAT TT=1.083 ASSIGNMENTS=2138 CHECKS=6688150	UNSAT TT=2.428 ASSIGNMENTS=13237 CHECKS=13193800	? (TO) TT=1800.11	UNSAT TT=2.801 ASSIGNMENTS=7427 CHECKS=16108400	UNSAT TT=0.363 ASSIGNMENTS=845 CHECKS=2074510	? TT=313.644	UNSAT TT=6.502	UNSAT TT=18.976
csp/os-gp/ normalized-gp10-09-1112.xml	SAT TT=0.203	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1063.06 CHECKS=2866400000	SAT TT=2.519 ASSIGNMENTS=172	SAT TT=2.851 ASSIGNMENTS=172	SAT TT=1019.69 CHECKS=0 NODES=87913	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.344 ASSIGNMENTS=577 CHECKS=1690330	SAT TT=0.342 ASSIGNMENTS=577 CHECKS=1690330	? (problem) TT=70.455	? (problem) TT=65.845	SAT TT=0.417 ASSIGNMENTS=829 CHECKS=2416800	SAT TT=2.27 ASSIGNMENTS=13667 CHECKS=13091400	SAT TT=410.207	SAT TT=0.475 ASSIGNMENTS=2919 CHECKS=1217390	SAT TT=0.203 ASSIGNMENTS=350 CHECKS=810834	? TT=315.403	SAT TT=6.703	SAT TT=19.54
csp/os-gp/ normalized-gp10-10-1091.xml	UNSAT TT=0.23	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=3.389 ASSIGNMENTS=52	UNSAT TT=3.486 ASSIGNMENTS=52	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=1.354 ASSIGNMENTS=1919 CHECKS=9407800	UNSAT TT=1.502 ASSIGNMENTS=1919 CHECKS=9407800	? (problem) TT=64.337	? (problem) TT=68.017	UNSAT TT=2.416 ASSIGNMENTS=3444 CHECKS=15847600	UNSAT TT=2.583 ASSIGNMENTS=12416 CHECKS=15443600	? (TO) TT=1800.04	UNSAT TT=1.337 ASSIGNMENTS=4105 CHECKS=6537740	UNSAT TT=0.23 ASSIGNMENTS=327 CHECKS=1105480	? (exit code) TT=283.005	UNSAT TT=7.439	UNSAT TT=20.641
csp/os-gp/ normalized-gp10-10-1092.xml	SAT TT=0.212	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=110.227 CHECKS=191167000	? (TO) TT=1800.09	SAT TT=3.194 ASSIGNMENTS=144	SAT TT=3.265 ASSIGNMENTS=144	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=1.085 ASSIGNMENTS=1494 CHECKS=6586080	SAT TT=1.067 ASSIGNMENTS=1494 CHECKS=6586080	? (problem) TT=56.199	? (problem) TT=56.439	SAT TT=1.308 ASSIGNMENTS=2154 CHECKS=8153460	SAT TT=2.422 ASSIGNMENTS=12610 CHECKS=14181200	SAT TT=105.056	SAT TT=1.342 ASSIGNMENTS=4028 CHECKS=6237990	SAT TT=0.212 ASSIGNMENTS=319 CHECKS=870263	? (exit code) TT=320.986	SAT TT=7.441	SAT TT=20.448
csp/os-taillard-10/ normalized-os-taillard-10-100-4.xml	SAT TT=2.527	SAT TT=102.265 CHECKS=44084200 NODES=161677	SAT TT=102.492 CHECKS=44084200 NODES=161677	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=2.822 ASSIGNMENTS=177	SAT TT=2.527 ASSIGNMENTS=177	SAT TT=869.05 CHECKS=0 NODES=671798	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=10.324 ASSIGNMENTS=177	SAT TT=10.281 ASSIGNMENTS=177	? (problem) TT=56.31	? (problem) TT=58.139	SAT TT=83.821 ASSIGNMENTS=417586 CHECKS=576066000	SAT TT=3.825 ASSIGNMENTS=23751 CHECKS=23636300	? (TO) TT=1800.14	SAT TT=5.942 ASSIGNMENTS=23397 CHECKS=27704600	SAT TT=4.208 ASSIGNMENTS=17606 CHECKS=26473300	? TT=273.531	SAT TT=4.465	SAT TT=11.802
csp/os-taillard-10/ normalized-os-taillard-10-100-8.xml	SAT TT=2.05	SAT TT=658.829 CHECKS=590505000 NODES=861694	SAT TT=616.411 CHECKS=590505000 NODES=861694	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=2.465 ASSIGNMENTS=139	SAT TT=2.626 ASSIGNMENTS=139	SAT TT=1025.07 CHECKS=0 NODES=956725	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=9.887 ASSIGNMENTS=139	SAT TT=9.177 ASSIGNMENTS=139	? (problem) TT=58.911	? (problem) TT=59.434	? (TO) TT=1800.04	SAT TT=4.423 ASSIGNMENTS=27705 CHECKS=26522500	? (TO) TT=1800.08	SAT TT=10.187 ASSIGNMENTS=29253 CHECKS=61206800	SAT TT=2.05 ASSIGNMENTS=7110 CHECKS=12811500	? TT=313.277	SAT TT=4.941	SAT TT=11.88
csp/os-taillard-10/ normalized-os-taillard-10-105-0.xml	SAT TT=0.348	SAT TT=5.945 CHECKS=127144 NODES=6850	SAT TT=5.636 CHECKS=127144 NODES=6850	? (TO) TT=1800.07	SAT TT=28.209 CHECKS=55170900	SAT TT=17.846 CHECKS=45809300	SAT TT=2.276 ASSIGNMENTS=170	SAT TT=2.68 ASSIGNMENTS=170	SAT TT=49.453 CHECKS=0 NODES=8036	? (TO) TT=1800.03	SAT TT=3.941 CHECKS=36907700 NODES=2089	SAT TT=9.739 ASSIGNMENTS=170	SAT TT=9.766 ASSIGNMENTS=170	? (problem) TT=61.614	? (problem) TT=58.503	SAT TT=219.158 ASSIGNMENTS=1069140 CHECKS=1394430000	SAT TT=2.103 ASSIGNMENTS=17353 CHECKS=11965000	SAT TT=14.657	SAT TT=1.462 ASSIGNMENTS=5656 CHECKS=6493310	SAT TT=0.348 ASSIGNMENTS=1095 CHECKS=1929740	? TT=329.92	SAT TT=4.772	SAT TT=13.463
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-10/ normalized-os-taillard-10-105-2.xml	SAT TT=0.262	SAT TT=1.59 CHECKS=910 NODES=247	SAT TT=1.633 CHECKS=910 NODES=247	SAT TT=0.262	SAT TT=27.3 CHECKS=51096800	SAT TT=29.857 CHECKS=69203400	SAT TT=2.355 ASSIGNMENTS=164	SAT TT=2.636 ASSIGNMENTS=164	SAT TT=43.108 CHECKS=0 NODES=4335	? (TO) TT=1800.04	SAT TT=3.059 CHECKS=20514300 NODES=1354	SAT TT=9.168 ASSIGNMENTS=164	SAT TT=10.099 ASSIGNMENTS=164	? (problem) TT=60.215	? (problem) TT=55.445	SAT TT=26.243 ASSIGNMENTS=145766 CHECKS=193609000	SAT TT=2.181 ASSIGNMENTS=18192 CHECKS=12715500	SAT TT=1.682	SAT TT=1.051 ASSIGNMENTS=5285 CHECKS=4091320	SAT TT=0.456 ASSIGNMENTS=1012 CHECKS=2295380	? TT=331.989	SAT TT=4.385	SAT TT=12.859
csp/os-taillard-10/ normalized-os-taillard-10-105-6.xml	SAT TT=0.251	SAT TT=1.647 CHECKS=2721 NODES=236	SAT TT=1.646 CHECKS=2721 NODES=236	SAT TT=0.251	SAT TT=25.663 CHECKS=55001700	SAT TT=36.869 CHECKS=81541400	SAT TT=2.273 ASSIGNMENTS=176	SAT TT=2.621 ASSIGNMENTS=176	SAT TT=39.814 CHECKS=0 NODES=761	? (TO) TT=1800	SAT TT=4.863 CHECKS=40192200 NODES=2533	SAT TT=0.43 ASSIGNMENTS=1692 CHECKS=2345010	SAT TT=0.425 ASSIGNMENTS=1692 CHECKS=2345010	? (problem) TT=58.402	? (problem) TT=54.615	SAT TT=0.813 ASSIGNMENTS=2869 CHECKS=4968730	SAT TT=2.123 ASSIGNMENTS=17261 CHECKS=11694400	? (TO) TT=1800.12	SAT TT=0.989 ASSIGNMENTS=4360 CHECKS=3936780	SAT TT=0.391 ASSIGNMENTS=1131 CHECKS=2068030	? TT=282.241	SAT TT=3.859	SAT TT=12.943
csp/os-taillard-10/ normalized-os-taillard-10-105-8.xml	SAT TT=0.249	SAT TT=1.937 CHECKS=1228 NODES=557	SAT TT=2.125 CHECKS=1228 NODES=557	SAT TT=0.249	SAT TT=27.478 CHECKS=56607300	SAT TT=34.511 CHECKS=76723800	SAT TT=2.272 ASSIGNMENTS=152	SAT TT=2.647 ASSIGNMENTS=152	SAT TT=38.081 CHECKS=0 NODES=2274	? (TO) TT=1800.01	SAT TT=4.04 CHECKS=37282200 NODES=2388	SAT TT=9.823 ASSIGNMENTS=152	SAT TT=9.627 ASSIGNMENTS=152	? (problem) TT=55.849	? (problem) TT=59.838	SAT TT=7.156 ASSIGNMENTS=36215 CHECKS=42635600	SAT TT=2.181 ASSIGNMENTS=17729 CHECKS=12646300	? (TO) TT=1800.11	SAT TT=1.018 ASSIGNMENTS=5613 CHECKS=3967380	SAT TT=0.395 ASSIGNMENTS=1466 CHECKS=1908790	? TT=284.451	SAT TT=4.225	SAT TT=11.769
csp/os-taillard-10/ normalized-os-taillard-10-105-9.xml	SAT TT=0.197	SAT TT=1.609 CHECKS=910 NODES=100	SAT TT=1.534 CHECKS=910 NODES=100	SAT TT=0.265	SAT TT=26.266 CHECKS=46206100	SAT TT=37.273 CHECKS=79308900	SAT TT=2.413 ASSIGNMENTS=171	SAT TT=2.489 ASSIGNMENTS=171	SAT TT=36.732 CHECKS=0 NODES=2502	? (TO) TT=1800.04	SAT TT=2.547 CHECKS=12785000 NODES=662	SAT TT=0.197 ASSIGNMENTS=625 CHECKS=782920	SAT TT=0.201 ASSIGNMENTS=625 CHECKS=782920	? (problem) TT=56.841	? (problem) TT=54.311	SAT TT=1.231 ASSIGNMENTS=5046 CHECKS=7980500	SAT TT=2.349 ASSIGNMENTS=18584 CHECKS=14131800	? (TO) TT=1800.04	SAT TT=0.752 ASSIGNMENTS=4306 CHECKS=2615270	SAT TT=0.241 ASSIGNMENTS=1057 CHECKS=1001830	? TT=266.157	SAT TT=4.268	SAT TT=12.416
csp/os-taillard-10/ normalized-os-taillard-10-95-1.xml	UNSAT TT=0.251	? (TO) TT=1800.12	? (TO) TT=1800.15	UNSAT TT=0.251	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=1.678 ASSIGNMENTS=0	UNSAT TT=1.33 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=8.975 ASSIGNMENTS=0	UNSAT TT=8.764 ASSIGNMENTS=0	? (problem) TT=49.979	? (problem) TT=49.669	UNSAT TT=160.419 ASSIGNMENTS=900456 CHECKS=1053550000	UNSAT TT=77.044 ASSIGNMENTS=399912 CHECKS=528994000	? (TO) TT=1800.08	UNSAT TT=91.835 ASSIGNMENTS=369324 CHECKS=412705000	UNSAT TT=67.547 ASSIGNMENTS=367805 CHECKS=422673000	? TT=338.225	UNSAT TT=26.457	UNSAT TT=43.63
csp/os-taillard-10/ normalized-os-taillard-10-95-3.xml	UNSAT TT=0.254	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=0.254	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=1.442 ASSIGNMENTS=0	UNSAT TT=1.342 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=8.947 ASSIGNMENTS=0	UNSAT TT=8.505 ASSIGNMENTS=0	? (problem) TT=59.738	? (problem) TT=63.102	UNSAT TT=138.352 ASSIGNMENTS=785783 CHECKS=879738000	UNSAT TT=282.799 ASSIGNMENTS=1399820 CHECKS=1813040000	? (TO) TT=1800.08	UNSAT TT=11.242 ASSIGNMENTS=49898 CHECKS=46681400	? (TO) TT=1800.08	? TT=466.293	UNSAT TT=282.771	UNSAT TT=580.252
csp/os-taillard-10/ normalized-os-taillard-10-95-8.xml	UNSAT TT=0.249	? (TO) TT=1800.09	? (TO) TT=1800.16	UNSAT TT=0.249	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=1.521 ASSIGNMENTS=0	UNSAT TT=1.371 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=8.967 ASSIGNMENTS=0	UNSAT TT=9.145 ASSIGNMENTS=0	? (problem) TT=59.555	? (problem) TT=60	UNSAT TT=211.535 ASSIGNMENTS=1209200 CHECKS=1357360000	UNSAT TT=14.121 ASSIGNMENTS=88882 CHECKS=85158900	? (TO) TT=1800.1	UNSAT TT=91.224 ASSIGNMENTS=369557 CHECKS=451299000	UNSAT TT=61.559 ASSIGNMENTS=368038 CHECKS=421863000	? TT=279.905	UNSAT TT=27.043	UNSAT TT=14.255
csp/os-taillard-15/ normalized-os-taillard-15-100-1.xml	SAT TT=1.013	SAT TT=9.878 CHECKS=238832 NODES=5945	SAT TT=9.145 CHECKS=238832 NODES=5945	SAT TT=1350.84	SAT TT=865.705 CHECKS=1638840000	? (TO) TT=1800.07	SAT TT=6.807 ASSIGNMENTS=440	SAT TT=6.729 ASSIGNMENTS=440	SAT TT=188.112 CHECKS=0 NODES=41057	? (TO) TT=1800.05	SAT TT=18.051 CHECKS=204785000 NODES=5024	SAT TT=8.835 ASSIGNMENTS=1502 CHECKS=6100250	SAT TT=14.296 ASSIGNMENTS=440	? (problem) TT=72.211	? (problem) TT=72.538	? (TO) TT=1800.1	SAT TT=23.536 ASSIGNMENTS=50353 CHECKS=165637000	? (TO) TT=1800.12	SAT TT=3.801 ASSIGNMENTS=18358 CHECKS=24257400	SAT TT=1.013 ASSIGNMENTS=1502 CHECKS=6100250	? (exit code) TT=258.187	SAT TT=18.515	SAT TT=59.396
csp/os-taillard-15/ normalized-os-taillard-15-100-4.xml	SAT TT=0.822	SAT TT=3.463 CHECKS=3165 NODES=232	SAT TT=3.397 CHECKS=3165 NODES=232	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=6.435 ASSIGNMENTS=402	SAT TT=6.257 ASSIGNMENTS=402	SAT TT=69.902 CHECKS=0 NODES=1539	? (TO) TT=1800.07	SAT TT=19.985 CHECKS=215834000 NODES=5088	SAT TT=8.321 ASSIGNMENTS=1843 CHECKS=4591710	SAT TT=8.769 ASSIGNMENTS=1843 CHECKS=4591710	? (problem) TT=64.364	? (problem) TT=68.267	? (TO) TT=1800.02	SAT TT=8.637 ASSIGNMENTS=25909 CHECKS=37804500	? (TO) TT=1800.02	SAT TT=1.268 ASSIGNMENTS=8823 CHECKS=7298030	SAT TT=0.822 ASSIGNMENTS=1843 CHECKS=4591710	? TT=250.386	SAT TT=19.964	SAT TT=67.26
csp/os-taillard-15/ normalized-os-taillard-15-105-0.xml	SAT TT=0.564	SAT TT=3.701 CHECKS=3165 NODES=343	SAT TT=3.592 CHECKS=3165 NODES=343	SAT TT=1349.35	SAT TT=45.803 CHECKS=52587800	SAT TT=134.84 CHECKS=236413000	SAT TT=5.975 ASSIGNMENTS=433	SAT TT=6.043 ASSIGNMENTS=433	SAT TT=76.396 CHECKS=0 NODES=3233	? (TO) TT=1800.05	SAT TT=7.809 CHECKS=44598800 NODES=714	SAT TT=7.836 ASSIGNMENTS=1214 CHECKS=2371710	SAT TT=8.579 ASSIGNMENTS=1214 CHECKS=2371710	? (problem) TT=80.142	? (problem) TT=76.157	SAT TT=19.177 ASSIGNMENTS=31512 CHECKS=155484000	SAT TT=6.312 ASSIGNMENTS=22074 CHECKS=18505900	? (TO) TT=1800.08	SAT TT=2.6 ASSIGNMENTS=13403 CHECKS=16987000	SAT TT=0.564 ASSIGNMENTS=1214 CHECKS=2371710	? TT=279.434	SAT TT=18.804	SAT TT=67.515
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-15/ normalized-os-taillard-15-105-3.xml	SAT TT=0.351	SAT TT=3.513 CHECKS=3165 NODES=339	SAT TT=3.801 CHECKS=3165 NODES=339	SAT TT=1.148	SAT TT=45.695 CHECKS=48627400	SAT TT=46.898 CHECKS=68921500	SAT TT=6.073 ASSIGNMENTS=466	SAT TT=6.364 ASSIGNMENTS=466	SAT TT=79.333 CHECKS=0 NODES=4331	? (TO) TT=1800.09	SAT TT=8.536 CHECKS=47806800 NODES=855	SAT TT=0.351 ASSIGNMENTS=692 CHECKS=827922	SAT TT=0.372 ASSIGNMENTS=692 CHECKS=827922	? (problem) TT=70.869	? (problem) TT=66.536	SAT TT=1.079 ASSIGNMENTS=5390 CHECKS=7167420	SAT TT=6.389 ASSIGNMENTS=21885 CHECKS=18438900	? (TO) TT=1800.11	SAT TT=1.235 ASSIGNMENTS=7850 CHECKS=6925900	SAT TT=1.766 ASSIGNMENTS=3652 CHECKS=11954200	? (exit code) TT=265.702	SAT TT=16.9	SAT TT=67.899
csp/os-taillard-15/ normalized-os-taillard-15-105-5.xml	SAT TT=1.143	SAT TT=3.845 CHECKS=3165 NODES=327	SAT TT=3.631 CHECKS=3165 NODES=327	SAT TT=1.143	? (TO) TT=1800.01	SAT TT=21.931 CHECKS=18843200	SAT TT=22.631 ASSIGNMENTS=7376	SAT TT=23.595 ASSIGNMENTS=7376	SAT TT=71.963 CHECKS=0 NODES=2282	? (TO) TT=1800.08	SAT TT=9.628 CHECKS=63928200 NODES=1430	SAT TT=9.702 ASSIGNMENTS=4632 CHECKS=12516600	SAT TT=10.006 ASSIGNMENTS=4632 CHECKS=12516600	? (problem) TT=84.672	? (problem) TT=84.986	SAT TT=7.094 ASSIGNMENTS=9840 CHECKS=58401500	SAT TT=6.364 ASSIGNMENTS=21764 CHECKS=18242600	? (TO) TT=1800.08	SAT TT=4.204 ASSIGNMENTS=16994 CHECKS=31042700	SAT TT=1.927 ASSIGNMENTS=4632 CHECKS=12516600	? (exit code) TT=235.751	SAT TT=17.717	SAT TT=68.025
csp/os-taillard-15/ normalized-os-taillard-15-105-7.xml	SAT TT=0.902	SAT TT=4.286 CHECKS=3273 NODES=691	SAT TT=4.376 CHECKS=3273 NODES=691	SAT TT=1.132	? (TO) TT=1800.05	SAT TT=49.77 CHECKS=77840100	SAT TT=6.711 ASSIGNMENTS=449	SAT TT=6.678 ASSIGNMENTS=449	SAT TT=67.816 CHECKS=0 NODES=926	? (TO) TT=1800.07	SAT TT=8.19 CHECKS=51084500 NODES=1039	SAT TT=8.665 ASSIGNMENTS=1476 CHECKS=4985100	SAT TT=8.86 ASSIGNMENTS=1476 CHECKS=4985100	? (problem) TT=75.717	? (problem) TT=72.022	SAT TT=13.855 ASSIGNMENTS=16298 CHECKS=119758000	SAT TT=6.329 ASSIGNMENTS=21873 CHECKS=18461600	SAT TT=3.652	SAT TT=2.079 ASSIGNMENTS=10629 CHECKS=13356300	SAT TT=0.902 ASSIGNMENTS=1476 CHECKS=4985100	? TT=271.867	SAT TT=18.451	SAT TT=60.48
csp/os-taillard-15/ normalized-os-taillard-15-105-8.xml	SAT TT=0.826	SAT TT=3.424 CHECKS=3165 NODES=228	SAT TT=3.451 CHECKS=3165 NODES=228	SAT TT=1.127	SAT TT=108.917 CHECKS=128364000	SAT TT=0.322 CHECKS=111950	SAT TT=14.225 ASSIGNMENTS=3733	SAT TT=13.652 ASSIGNMENTS=3733	SAT TT=68.952 CHECKS=0 NODES=1107	? (TO) TT=1800.03	SAT TT=7.711 CHECKS=34632800 NODES=349	SAT TT=0.862 ASSIGNMENTS=1596 CHECKS=4496810	SAT TT=0.826 ASSIGNMENTS=1596 CHECKS=4496810	? (problem) TT=73.891	? (problem) TT=73.952	SAT TT=2.121 ASSIGNMENTS=4890 CHECKS=15273600	SAT TT=5.342 ASSIGNMENTS=15986 CHECKS=13489100	? (TO) TT=1800.07	SAT TT=1.045 ASSIGNMENTS=6181 CHECKS=5117250	SAT TT=0.845 ASSIGNMENTS=1225 CHECKS=4560390	? TT=300.466	SAT TT=17.578	SAT TT=67.509
csp/os-taillard-15/ normalized-os-taillard-15-105-9.xml	SAT TT=0.503	SAT TT=3.37 CHECKS=3165 NODES=225	SAT TT=3.24 CHECKS=3165 NODES=225	? (TO) TT=1800.06	SAT TT=45.543 CHECKS=58808700	SAT TT=50.116 CHECKS=84239700	SAT TT=6.501 ASSIGNMENTS=399	SAT TT=6.169 ASSIGNMENTS=399	SAT TT=68.584 CHECKS=0 NODES=1100	? (TO) TT=1800	SAT TT=8.093 CHECKS=52126300 NODES=1040	SAT TT=9.528 ASSIGNMENTS=4606 CHECKS=12651100	SAT TT=8.96 ASSIGNMENTS=4606 CHECKS=12651100	? (problem) TT=60.283	? (problem) TT=64.93	? (TO) TT=1800.03	SAT TT=6.89 ASSIGNMENTS=21428 CHECKS=18645700	? (TO) TT=1800.05	SAT TT=0.503 ASSIGNMENTS=3070 CHECKS=1527580	SAT TT=1.897 ASSIGNMENTS=4606 CHECKS=12651100	? TT=262.684	SAT TT=17.244	SAT TT=66.117
csp/os-taillard-15/ normalized-os-taillard-15-95-2.xml	UNSAT TT=2.591	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=2.591 ASSIGNMENTS=0	UNSAT TT=2.618 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=9.433 ASSIGNMENTS=0	? (problem) TT=68.659	? (problem) TT=68.825	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=289.97	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/os-taillard-15/ normalized-os-taillard-15-95-9.xml	UNSAT TT=1.118	? (TO) TT=1800.06	? (TO) TT=1800.11	UNSAT TT=1.118	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=2.759 ASSIGNMENTS=0	UNSAT TT=2.631 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.06	UNSAT TT=9.527 ASSIGNMENTS=0	? (problem) TT=66.226	? (problem) TT=66.188	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (exit code) TT=253.809	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/os-taillard-20/ normalized-os-taillard-20-100-0.xml	SAT TT=9.302	SAT TT=11.836 CHECKS=15015 NODES=1867	SAT TT=11.829 CHECKS=15015 NODES=1867	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=18.113 ASSIGNMENTS=797	SAT TT=18.831 ASSIGNMENTS=797	SAT TT=165.019 CHECKS=0 NODES=12123	? (TO) TT=1800.03	SAT TT=56.984 CHECKS=576783000 NODES=7029	SAT TT=19.203 ASSIGNMENTS=11354 CHECKS=82609900	SAT TT=19.755 ASSIGNMENTS=11354 CHECKS=82609900	? (problem) TT=69.378	? (problem) TT=64.299	? (TO) TT=1800.05	SAT TT=21.659 ASSIGNMENTS=35617 CHECKS=52615200	? (TO) TT=1800.08	SAT TT=9.302 ASSIGNMENTS=22497 CHECKS=53892600	SAT TT=11.691 ASSIGNMENTS=11354 CHECKS=82609900	? (exit code) TT=256.739	SAT TT=52.922	SAT TT=199.745
csp/os-taillard-20/ normalized-os-taillard-20-100-1.xml	SAT TT=7.927	SAT TT=15.968 CHECKS=34403 NODES=3277	SAT TT=16.345 CHECKS=34403 NODES=3277	SAT TT=896.509	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=27.56 ASSIGNMENTS=2805	SAT TT=29.337 ASSIGNMENTS=2805	SAT TT=1020.15 CHECKS=0 NODES=119795	? (TO) TT=1800.08	SAT TT=50.989 CHECKS=475069000 NODES=5123	SAT TT=50.522 ASSIGNMENTS=53056 CHECKS=343605000	SAT TT=23.155 ASSIGNMENTS=3277 CHECKS=34403	? (problem) TT=74.671	? (problem) TT=69.414	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.11	SAT TT=7.927 ASSIGNMENTS=16864 CHECKS=45170300	SAT TT=44.709 ASSIGNMENTS=53056 CHECKS=343605000	? TT=259.103	SAT TT=58.282	SAT TT=215.867
csp/os-taillard-20/ normalized-os-taillard-20-100-3.xml	SAT TT=8.192	SAT TT=9.868 CHECKS=7620 NODES=918	SAT TT=9.702 CHECKS=7620 NODES=918	SAT TT=8.192	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=17.512 ASSIGNMENTS=832	SAT TT=17.22 ASSIGNMENTS=832	SAT TT=678.579 CHECKS=0 NODES=85198	? (TO) TT=1800.04	SAT TT=42.801 CHECKS=314078000 NODES=3486	SAT TT=31.432 ASSIGNMENTS=20908 CHECKS=172018000	SAT TT=16.787 ASSIGNMENTS=918 CHECKS=7620	? (problem) TT=71.664	? (problem) TT=75.831	? (TO) TT=1800.1	SAT TT=27.158 ASSIGNMENTS=42703 CHECKS=97463600	? (TO) TT=1800.1	SAT TT=80.22 ASSIGNMENTS=68939 CHECKS=540412000	SAT TT=24.29 ASSIGNMENTS=20908 CHECKS=172018000	? (exit code) TT=245.032	SAT TT=51.879	SAT TT=201.615
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-20/ normalized-os-taillard-20-105-8.xml	SAT TT=2.417	SAT TT=8.756 CHECKS=9565 NODES=677	SAT TT=9.039 CHECKS=9565 NODES=677	SAT TT=897.038	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=18.349 ASSIGNMENTS=866	SAT TT=17.242 ASSIGNMENTS=866	SAT TT=228.494 CHECKS=0 NODES=20043	? (TO) TT=1800.01	SAT TT=25.219 CHECKS=128908000 NODES=1060	SAT TT=10.021 ASSIGNMENTS=2049 CHECKS=11565300	SAT TT=16.366 ASSIGNMENTS=677 CHECKS=9565	? (problem) TT=71.801	? (problem) TT=76.38	? (TO) TT=1800.1	SAT TT=22.546 ASSIGNMENTS=38589 CHECKS=53671200	? (TO) TT=1800.1	SAT TT=3.161 ASSIGNMENTS=11943 CHECKS=14751800	SAT TT=2.417 ASSIGNMENTS=2049 CHECKS=11565300	? TT=249.72	SAT TT=57.02	SAT TT=265.495
csp/os-taillard-20/ normalized-os-taillard-20-105-9.xml	SAT TT=2.517	SAT TT=8.107 CHECKS=7620 NODES=400	SAT TT=8.046 CHECKS=7620 NODES=400	SAT TT=3.98	? (TO) TT=1800.12	? (TO) TT=1800.03	SAT TT=19.164 ASSIGNMENTS=912	SAT TT=18.669 ASSIGNMENTS=912	SAT TT=175.363 CHECKS=0 NODES=15059	? (TO) TT=1800.08	SAT TT=25.026 CHECKS=127940000 NODES=1099	SAT TT=17.199 ASSIGNMENTS=10431 CHECKS=65366600	SAT TT=15.747 ASSIGNMENTS=400 CHECKS=7620	? (problem) TT=79.088	? (problem) TT=77.522	? (TO) TT=1800.1	SAT TT=4.823 ASSIGNMENTS=7234 CHECKS=9954680	? (TO) TT=1800.05	SAT TT=2.517 ASSIGNMENTS=8256 CHECKS=11208300	SAT TT=9.56 ASSIGNMENTS=10431 CHECKS=65366600	? TT=271.95	SAT TT=55.569	SAT TT=220.775
csp/os-taillard-20/ normalized-os-taillard-20-95-0.xml	UNSAT TT=4.278	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	UNSAT TT=4.782 ASSIGNMENTS=0	UNSAT TT=4.278 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=11.787 ASSIGNMENTS=0	UNSAT TT=606.362 ASSIGNMENTS=0	? (problem) TT=69.555	? (problem) TT=69.457	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (exit code) TT=259.369	? (TO) TT=1800.26	? (TO) TT=1800.04
csp/os-taillard-20/ normalized-os-taillard-20-95-1.xml	SAT TT=55.621	SAT TT=696.552 CHECKS=333048000 NODES=539041	SAT TT=697.197 CHECKS=333048000 NODES=539041	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=107.755 ASSIGNMENTS=20533	SAT TT=114.46 ASSIGNMENTS=20533	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=270.498 ASSIGNMENTS=20533	SAT TT=143.26 ASSIGNMENTS=20533	? (problem) TT=74.375	? (problem) TT=74.718	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=539.653 ASSIGNMENTS=1434050 CHECKS=3479430000	SAT TT=175.541 ASSIGNMENTS=190502 CHECKS=1316840000	? TT=255.006	SAT TT=55.621	SAT TT=207.848
csp/os-taillard-20/ normalized-os-taillard-20-95-2.xml	UNSAT TT=3.869	? (TO) TT=1800.19	? (TO) TT=1800.17	UNSAT TT=3.869	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=4.662 ASSIGNMENTS=0	UNSAT TT=4.44 ASSIGNMENTS=0	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=174.191 ASSIGNMENTS=0	UNSAT TT=174.387 ASSIGNMENTS=0	? (problem) TT=70.487	? (problem) TT=73.522	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=269.454	? (TO) TT=1800.35	? (TO) TT=1800.05
csp/os-taillard-20/ normalized-os-taillard-20-95-6.xml	UNSAT TT=4.212	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=4.212 ASSIGNMENTS=0	UNSAT TT=4.724 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=173.929 ASSIGNMENTS=0	UNSAT TT=760.817 ASSIGNMENTS=0	? (problem) TT=64.185	? (problem) TT=64.024	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? TT=265.131	? (MO) TT=979.3	? (TO) TT=1800.19
csp/os-taillard-20/ normalized-os-taillard-20-95-7.xml	SAT TT=17.523	SAT TT=59.433 CHECKS=16443800 NODES=35026	SAT TT=55.514 CHECKS=16443800 NODES=35026	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=17.523 ASSIGNMENTS=766	SAT TT=19.493 ASSIGNMENTS=766	SAT TT=1013.58 CHECKS=0 NODES=109491	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=24.506 ASSIGNMENTS=766	SAT TT=35.539 ASSIGNMENTS=35901 CHECKS=188922000	? (problem) TT=62.922	? (problem) TT=67.375	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=177.625 ASSIGNMENTS=246393 CHECKS=1276400000	SAT TT=25.732 ASSIGNMENTS=35901 CHECKS=188922000	? TT=258.665	SAT TT=53.288	SAT TT=197.09
csp/os-taillard-4/ normalized-os-taillard-4-100-3.xml	SAT TT=0.009	SAT TT=4.367 CHECKS=50618200 NODES=6909	SAT TT=4.434 CHECKS=53417300 NODES=6970	SAT TT=1.122	SAT TT=1.066 CHECKS=1969490	SAT TT=1.12 CHECKS=2385630	SAT TT=0.834 ASSIGNMENTS=17	SAT TT=0.81 ASSIGNMENTS=17	SAT TT=0.982 CHECKS=0 NODES=182	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=0.028 ASSIGNMENTS=67 CHECKS=29212	SAT TT=0.026 ASSIGNMENTS=67 CHECKS=29212	SAT TT=985.846	SAT TT=38.016	SAT TT=0.011 ASSIGNMENTS=55 CHECKS=24531	SAT TT=0.017 ASSIGNMENTS=143 CHECKS=55565	SAT TT=0.443	SAT TT=0.01 ASSIGNMENTS=140 CHECKS=16741	SAT TT=0.009 ASSIGNMENTS=50 CHECKS=16580	SAT TT=18.129	SAT TT=0.656	SAT TT=0.813
csp/os-taillard-4/ normalized-os-taillard-4-100-4.xml	SAT TT=0.01	SAT TT=1.546 CHECKS=47380 NODES=16	SAT TT=1.953 CHECKS=7527830 NODES=635	SAT TT=2.967	SAT TT=5.397 CHECKS=11843500	SAT TT=8.722 CHECKS=18548700	SAT TT=0.784 ASSIGNMENTS=16	SAT TT=0.794 ASSIGNMENTS=16	SAT TT=1.111 CHECKS=0 NODES=364	SAT TT=1480.74 CHECKS=16600000000 NODES=11888700	? (TO) TT=1800.03	SAT TT=0.022 ASSIGNMENTS=23 CHECKS=8549	SAT TT=0.022 ASSIGNMENTS=23 CHECKS=8549	SAT TT=1590.38	SAT TT=44.59	SAT TT=0.011 ASSIGNMENTS=29 CHECKS=11484	SAT TT=0.019 ASSIGNMENTS=222 CHECKS=73432	SAT TT=0.396	SAT TT=0.013 ASSIGNMENTS=147 CHECKS=26690	SAT TT=0.01 ASSIGNMENTS=44 CHECKS=12293	SAT TT=10.538	SAT TT=0.939	SAT TT=1.103
csp/os-taillard-4/ normalized-os-taillard-4-100-7.xml	SAT TT=0.009	SAT TT=1.234 CHECKS=885039 NODES=153	SAT TT=1.127 CHECKS=28514 NODES=0	SAT TT=0.036	SAT TT=0.309 CHECKS=369244	SAT TT=0.208 CHECKS=366549	SAT TT=0.782 ASSIGNMENTS=13	SAT TT=0.913 ASSIGNMENTS=13	SAT TT=0.873 CHECKS=0 NODES=17	SAT TT=410.256 CHECKS=4511390000 NODES=4964600	SAT TT=412.401 CHECKS=1561880000 NODES=835560	SAT TT=0.021 ASSIGNMENTS=20 CHECKS=6524	SAT TT=0.023 ASSIGNMENTS=20 CHECKS=6524	SAT TT=149.9	SAT TT=19.812	SAT TT=0.011 ASSIGNMENTS=29 CHECKS=11629	SAT TT=0.012 ASSIGNMENTS=35 CHECKS=15220	SAT TT=0.367	SAT TT=0.011 ASSIGNMENTS=50 CHECKS=7093	SAT TT=0.009 ASSIGNMENTS=26 CHECKS=9996	SAT TT=6.331	SAT TT=0.661	SAT TT=1.045
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-4/ normalized-os-taillard-4-100-8.xml	SAT TT=0.007	SAT TT=1.547 CHECKS=3416470 NODES=684	SAT TT=1.553 CHECKS=1203720 NODES=219	SAT TT=0.041	SAT TT=0.416 CHECKS=604334	SAT TT=0.275 CHECKS=602413	SAT TT=0.732 ASSIGNMENTS=15	SAT TT=0.946 ASSIGNMENTS=15	SAT TT=0.863 CHECKS=0 NODES=18	SAT TT=714.566 CHECKS=7854130000 NODES=6451930	SAT TT=1027.83 CHECKS=4859790000 NODES=1803470	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=2271	SAT TT=0.022 ASSIGNMENTS=16 CHECKS=2271	SAT TT=267.161	SAT TT=38.669	SAT TT=0.007 ASSIGNMENTS=16 CHECKS=2271	SAT TT=0.008 ASSIGNMENTS=14 CHECKS=2170	SAT TT=0.429	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=1986	SAT TT=0.01 ASSIGNMENTS=29 CHECKS=9340	SAT TT=8.859	SAT TT=0.668	SAT TT=0.82
csp/os-taillard-4/ normalized-os-taillard-4-105-0.xml	SAT TT=0.009	SAT TT=1.23 CHECKS=25457 NODES=16	SAT TT=1.113 CHECKS=30127 NODES=0	SAT TT=0.037	SAT TT=32.025 CHECKS=78016000	SAT TT=3.19 CHECKS=7966860	SAT TT=0.734 ASSIGNMENTS=22	SAT TT=0.757 ASSIGNMENTS=22	SAT TT=0.835 CHECKS=0 NODES=16	SAT TT=100.456 CHECKS=1133330000 NODES=1245740	SAT TT=0.673 CHECKS=581336 NODES=478	SAT TT=0.023 ASSIGNMENTS=33 CHECKS=10882	SAT TT=0.021 ASSIGNMENTS=33 CHECKS=10882	SAT TT=136.364	SAT TT=18.633	SAT TT=0.009 ASSIGNMENTS=30 CHECKS=9383	SAT TT=0.011 ASSIGNMENTS=16 CHECKS=2415	SAT TT=0.382	SAT TT=0.009 ASSIGNMENTS=46 CHECKS=5993	SAT TT=0.009 ASSIGNMENTS=32 CHECKS=6096	SAT TT=5.323	SAT TT=0.924	SAT TT=0.791
csp/os-taillard-4/ normalized-os-taillard-4-105-2.xml	SAT TT=0.009	SAT TT=1.572 CHECKS=48881 NODES=17	SAT TT=1.573 CHECKS=41643 NODES=0	SAT TT=0.036	SAT TT=0.112 CHECKS=7507	SAT TT=0.012 CHECKS=6756	SAT TT=0.829 ASSIGNMENTS=20	SAT TT=0.79 ASSIGNMENTS=20	SAT TT=0.875 CHECKS=0 NODES=50	SAT TT=0.867 CHECKS=496671 NODES=160	SAT TT=0.591 CHECKS=321437 NODES=41	SAT TT=0.021 ASSIGNMENTS=22 CHECKS=2441	SAT TT=0.02 ASSIGNMENTS=22 CHECKS=2441	SAT TT=1313.43	SAT TT=38.411	SAT TT=0.01 ASSIGNMENTS=22 CHECKS=2441	SAT TT=0.009 ASSIGNMENTS=39 CHECKS=8043	SAT TT=0.422	SAT TT=0.011 ASSIGNMENTS=20 CHECKS=2272	SAT TT=0.009 ASSIGNMENTS=35 CHECKS=6064	SAT TT=9.342	SAT TT=0.663	SAT TT=0.953
csp/os-taillard-4/ normalized-os-taillard-4-105-4.xml	SAT TT=0.009	SAT TT=1.716 CHECKS=320010 NODES=47	SAT TT=1.665 CHECKS=46495 NODES=0	SAT TT=0.037	SAT TT=0.112 CHECKS=7087	SAT TT=0.011 CHECKS=5893	SAT TT=0.742 ASSIGNMENTS=21	SAT TT=0.749 ASSIGNMENTS=21	SAT TT=0.985 CHECKS=0 NODES=17	SAT TT=0.87 CHECKS=2629930 NODES=1538	SAT TT=0.657 CHECKS=515313 NODES=114	SAT TT=0.021 ASSIGNMENTS=24 CHECKS=2278	SAT TT=0.02 ASSIGNMENTS=24 CHECKS=2278	? (TO) TT=1800.03	SAT TT=50.049	SAT TT=0.01 ASSIGNMENTS=24 CHECKS=2278	SAT TT=0.009 ASSIGNMENTS=11 CHECKS=2434	SAT TT=0.36	SAT TT=0.01 ASSIGNMENTS=22 CHECKS=2202	SAT TT=0.009 ASSIGNMENTS=27 CHECKS=3666	SAT TT=11.152	SAT TT=0.76	SAT TT=0.861
csp/os-taillard-4/ normalized-os-taillard-4-95-4.xml	UNSAT TT=0.01	UNSAT TT=5.138 CHECKS=75154200 NODES=8892	UNSAT TT=5.628 CHECKS=76786800 NODES=8795	UNSAT TT=0.036	UNSAT TT=0.353 CHECKS=465955	UNSAT TT=0.225 CHECKS=465423	UNSAT TT=0.664 ASSIGNMENTS=0	UNSAT TT=0.576 ASSIGNMENTS=0	UNSAT TT=2.816 CHECKS=0 NODES=7003	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.021 ASSIGNMENTS=19 CHECKS=6501	UNSAT TT=0.023 ASSIGNMENTS=19 CHECKS=6501	UNSAT TT=816.617	UNSAT TT=53.969	UNSAT TT=0.011 ASSIGNMENTS=21 CHECKS=6156	UNSAT TT=0.142 ASSIGNMENTS=3570 CHECKS=1014970	UNSAT TT=0.533	UNSAT TT=0.012 ASSIGNMENTS=71 CHECKS=9756	UNSAT TT=0.01 ASSIGNMENTS=25 CHECKS=6183	UNSAT TT=38.21	UNSAT TT=0.626	UNSAT TT=0.85
csp/os-taillard-4/ normalized-os-taillard-4-95-5.xml	UNSAT TT=0.008	UNSAT TT=1.149 CHECKS=241065 NODES=79	UNSAT TT=1.061 CHECKS=159848 NODES=0	UNSAT TT=0.037	UNSAT TT=0.141 CHECKS=52580	UNSAT TT=0.049 CHECKS=51452	UNSAT TT=0.678 ASSIGNMENTS=0	UNSAT TT=0.583 ASSIGNMENTS=0	UNSAT TT=0.752 CHECKS=0 NODES=43	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=0.021 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=0.02 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=22.869	UNSAT TT=13.537	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=0.01 ASSIGNMENTS=32 CHECKS=13066	UNSAT TT=0.366	UNSAT TT=0.01 ASSIGNMENTS=1 CHECKS=1594	UNSAT TT=0.008 ASSIGNMENTS=1 CHECKS=1173	UNSAT TT=4.88	UNSAT TT=0.606	UNSAT TT=0.875
csp/os-taillard-4/ normalized-os-taillard-4-95-8.xml	UNSAT TT=0.008	UNSAT TT=1.355 CHECKS=1276160 NODES=150	UNSAT TT=1.38 CHECKS=677895 NODES=0	UNSAT TT=0.036	UNSAT TT=0.188 CHECKS=143809	UNSAT TT=0.097 CHECKS=126831	UNSAT TT=0.613 ASSIGNMENTS=0	UNSAT TT=0.616 ASSIGNMENTS=0	UNSAT TT=0.926 CHECKS=0 NODES=258	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=0.02 ASSIGNMENTS=21 CHECKS=5633	UNSAT TT=0.022 ASSIGNMENTS=21 CHECKS=5633	UNSAT TT=202.022	UNSAT TT=28.013	UNSAT TT=0.01 ASSIGNMENTS=23 CHECKS=7360	UNSAT TT=0.022 ASSIGNMENTS=338 CHECKS=104122	UNSAT TT=0.363	UNSAT TT=0.011 ASSIGNMENTS=87 CHECKS=8686	UNSAT TT=0.008 ASSIGNMENTS=19 CHECKS=4673	UNSAT TT=8.002	UNSAT TT=0.637	UNSAT TT=0.761
csp/os-taillard-5/ normalized-os-taillard-5-100-0.xml	SAT TT=0.042	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.07	SAT TT=35.631 CHECKS=80873500	SAT TT=99.588 CHECKS=258619000	SAT TT=1.093 ASSIGNMENTS=67	SAT TT=1.088 ASSIGNMENTS=67	SAT TT=9.647 CHECKS=0 NODES=21070	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.222 ASSIGNMENTS=2290 CHECKS=1561070	SAT TT=0.225 ASSIGNMENTS=2290 CHECKS=1561070	? (TO) TT=1800.01	? (MO) TT=664.92	SAT TT=0.219 ASSIGNMENTS=2376 CHECKS=1656230	SAT TT=0.254 ASSIGNMENTS=4744 CHECKS=1905990	SAT TT=8.041	SAT TT=0.05 ASSIGNMENTS=707 CHECKS=282865	SAT TT=0.042 ASSIGNMENTS=397 CHECKS=248312	? (TO) TT=1800.16	SAT TT=0.889	SAT TT=1.164
csp/os-taillard-5/ normalized-os-taillard-5-100-8.xml	SAT TT=0.138	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.07	SAT TT=664.98 CHECKS=1569030000	SAT TT=110.966 CHECKS=274134000	SAT TT=1.256 ASSIGNMENTS=160	SAT TT=1.382 ASSIGNMENTS=160	SAT TT=83.078 CHECKS=0 NODES=211404	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=0.14 ASSIGNMENTS=1329 CHECKS=901828	SAT TT=0.138 ASSIGNMENTS=1329 CHECKS=901828	? (TO) TT=1800.05	? (MO) TT=509.19	SAT TT=0.189 ASSIGNMENTS=2480 CHECKS=1398840	SAT TT=0.267 ASSIGNMENTS=4851 CHECKS=1999450	SAT TT=47.314	SAT TT=0.189 ASSIGNMENTS=2424 CHECKS=1318180	SAT TT=0.243 ASSIGNMENTS=3087 CHECKS=1846830	? (TO) TT=1800.42	SAT TT=0.995	SAT TT=1.345
csp/os-taillard-5/ normalized-os-taillard-5-100-9.xml	SAT TT=0.049	SAT TT=50.401 CHECKS=981581000 NODES=114351	SAT TT=5.532 CHECKS=67338400 NODES=9455	? (TO) TT=1800.1	SAT TT=23.528 CHECKS=47979800	SAT TT=49.469 CHECKS=126683000	SAT TT=1.085 ASSIGNMENTS=87	SAT TT=1.086 ASSIGNMENTS=87	SAT TT=1.648 CHECKS=0 NODES=132	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=0.325 ASSIGNMENTS=3325 CHECKS=2597610	SAT TT=0.327 ASSIGNMENTS=3325 CHECKS=2597610	? (TO) TT=1800.03	? (MO) TT=775.99	SAT TT=0.184 ASSIGNMENTS=2013 CHECKS=1482050	SAT TT=0.332 ASSIGNMENTS=5852 CHECKS=2715080	SAT TT=1.282	SAT TT=0.172 ASSIGNMENTS=2103 CHECKS=1188600	SAT TT=0.049 ASSIGNMENTS=459 CHECKS=323601	SAT TT=26.851	SAT TT=0.793	SAT TT=1.235
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-5/ normalized-os-taillard-5-105-0.xml	SAT TT=0.014	SAT TT=1.8 CHECKS=61280 NODES=25	SAT TT=1.878 CHECKS=679820 NODES=83	SAT TT=535.622	SAT TT=10.923 CHECKS=25696400	SAT TT=18.714 CHECKS=43430100	SAT TT=0.853 ASSIGNMENTS=26	SAT TT=0.851 ASSIGNMENTS=26	SAT TT=1.499 CHECKS=0 NODES=65	SAT TT=1739.96 CHECKS=22827100000 NODES=10740500	SAT TT=0.869 CHECKS=1054260 NODES=249	SAT TT=0.027 ASSIGNMENTS=105 CHECKS=37629	SAT TT=0.028 ASSIGNMENTS=105 CHECKS=37629	? (TO) TT=1800.02	SAT TT=99.33	SAT TT=0.015 ASSIGNMENTS=65 CHECKS=22293	SAT TT=0.027 ASSIGNMENTS=297 CHECKS=115249	SAT TT=0.563	SAT TT=0.02 ASSIGNMENTS=260 CHECKS=53787	SAT TT=0.014 ASSIGNMENTS=58 CHECKS=18592	SAT TT=35.195	SAT TT=0.779	SAT TT=1.461
csp/os-taillard-5/ normalized-os-taillard-5-105-1.xml	SAT TT=0.014	SAT TT=2.238 CHECKS=78451 NODES=25	SAT TT=2.231 CHECKS=154397 NODES=0	SAT TT=47.109	SAT TT=10.533 CHECKS=27157900	SAT TT=15.567 CHECKS=42643700	SAT TT=0.849 ASSIGNMENTS=32	SAT TT=0.866 ASSIGNMENTS=32	SAT TT=1.48 CHECKS=0 NODES=58	SAT TT=1084.52 CHECKS=14306900000 NODES=7653110	SAT TT=1.053 CHECKS=3751520 NODES=1495	SAT TT=0.024 ASSIGNMENTS=40 CHECKS=7015	SAT TT=0.025 ASSIGNMENTS=40 CHECKS=7015	? (TO) TT=1800.07	SAT TT=77.019	SAT TT=0.014 ASSIGNMENTS=40 CHECKS=7015	SAT TT=0.039 ASSIGNMENTS=471 CHECKS=215120	SAT TT=0.5	SAT TT=0.018 ASSIGNMENTS=268 CHECKS=40656	SAT TT=0.016 ASSIGNMENTS=92 CHECKS=35411	SAT TT=20.175	SAT TT=0.759	SAT TT=1.158
csp/os-taillard-5/ normalized-os-taillard-5-105-4.xml	SAT TT=0.012	SAT TT=2.632 CHECKS=8121650 NODES=1307	SAT TT=2.305 CHECKS=2715700 NODES=313	? (TO) TT=1800.07	SAT TT=23.294 CHECKS=55403600	SAT TT=17.312 CHECKS=42170200	SAT TT=0.862 ASSIGNMENTS=29	SAT TT=0.887 ASSIGNMENTS=29	SAT TT=1.702 CHECKS=0 NODES=143	SAT TT=765.162 CHECKS=9984110000 NODES=4354700	? (TO) TT=1800.03	SAT TT=0.024 ASSIGNMENTS=49 CHECKS=14569	SAT TT=0.024 ASSIGNMENTS=49 CHECKS=14569	? (TO) TT=1800.03	SAT TT=410.21	SAT TT=0.014 ASSIGNMENTS=48 CHECKS=14569	SAT TT=0.05 ASSIGNMENTS=800 CHECKS=336142	SAT TT=0.772	SAT TT=0.024 ASSIGNMENTS=414 CHECKS=80736	SAT TT=0.012 ASSIGNMENTS=27 CHECKS=6009	SAT TT=433.326	SAT TT=0.799	SAT TT=1.262
csp/os-taillard-5/ normalized-os-taillard-5-105-8.xml	SAT TT=0.015	SAT TT=1.243 CHECKS=206145 NODES=93	SAT TT=1.151 CHECKS=75560 NODES=0	SAT TT=1.783	SAT TT=23.277 CHECKS=56319700	SAT TT=34.379 CHECKS=87559900	SAT TT=0.876 ASSIGNMENTS=24	SAT TT=1.065 ASSIGNMENTS=24	SAT TT=1.992 CHECKS=0 NODES=168	SAT TT=723.81 CHECKS=8920540000 NODES=3600350	SAT TT=1.764 CHECKS=12556000 NODES=3760	SAT TT=0.026 ASSIGNMENTS=81 CHECKS=44204	SAT TT=0.028 ASSIGNMENTS=81 CHECKS=44204	SAT TT=133.574	? (MO) TT=468.14	SAT TT=0.016 ASSIGNMENTS=60 CHECKS=26477	SAT TT=0.015 ASSIGNMENTS=78 CHECKS=23292	SAT TT=3.903	SAT TT=0.023 ASSIGNMENTS=332 CHECKS=88587	SAT TT=0.018 ASSIGNMENTS=101 CHECKS=51713	SAT TT=28.482	SAT TT=0.81	SAT TT=1.286
csp/os-taillard-5/ normalized-os-taillard-5-95-5.xml	UNSAT TT=0.017	UNSAT TT=15.9 CHECKS=343119000 NODES=32073	UNSAT TT=15.89 CHECKS=353282000 NODES=32333	UNSAT TT=0.049	UNSAT TT=24.117 CHECKS=47005700	UNSAT TT=0.871 CHECKS=1915550	UNSAT TT=0.645 ASSIGNMENTS=0	UNSAT TT=0.78 ASSIGNMENTS=0	UNSAT TT=4.233 CHECKS=0 NODES=7528	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.026 ASSIGNMENTS=93 CHECKS=31611	UNSAT TT=0.029 ASSIGNMENTS=93 CHECKS=31611	? (TO) TT=1800.06	UNSAT TT=311.992	UNSAT TT=0.017 ASSIGNMENTS=90 CHECKS=30811	UNSAT TT=0.234 ASSIGNMENTS=4442 CHECKS=1776690	UNSAT TT=2.455	UNSAT TT=0.023 ASSIGNMENTS=374 CHECKS=100986	UNSAT TT=0.02 ASSIGNMENTS=126 CHECKS=57386	UNSAT TT=123.08	UNSAT TT=0.78	UNSAT TT=1.192
csp/os-taillard-5/ normalized-os-taillard-5-95-8.xml	UNSAT TT=0.015	UNSAT TT=11.159 CHECKS=162096000 NODES=17302	UNSAT TT=11.508 CHECKS=162770000 NODES=17334	UNSAT TT=0.047	UNSAT TT=3.197 CHECKS=6644730	? (TO) TT=1800.06	UNSAT TT=0.65 ASSIGNMENTS=0	UNSAT TT=0.661 ASSIGNMENTS=0	UNSAT TT=18.326 CHECKS=0 NODES=36414	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.031 ASSIGNMENTS=87 CHECKS=33386	UNSAT TT=0.027 ASSIGNMENTS=87 CHECKS=33386	? (TO) TT=1800.02	UNSAT TT=573.976	UNSAT TT=0.016 ASSIGNMENTS=87 CHECKS=32400	UNSAT TT=0.236 ASSIGNMENTS=4682 CHECKS=1759630	UNSAT TT=2.979	UNSAT TT=0.024 ASSIGNMENTS=416 CHECKS=79615	UNSAT TT=0.015 ASSIGNMENTS=83 CHECKS=26600	UNSAT TT=61.921	UNSAT TT=0.769	UNSAT TT=1.144
csp/os-taillard-5/ normalized-os-taillard-5-95-9.xml	UNSAT TT=0.015	UNSAT TT=6.663 CHECKS=93545500 NODES=7874	UNSAT TT=12.415 CHECKS=229519000 NODES=17960	UNSAT TT=0.046	UNSAT TT=88.94 CHECKS=189970000	UNSAT TT=58.374 CHECKS=140387000	UNSAT TT=0.651 ASSIGNMENTS=0	UNSAT TT=0.652 ASSIGNMENTS=0	UNSAT TT=5.785 CHECKS=0 NODES=11647	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.03 ASSIGNMENTS=83 CHECKS=29498	UNSAT TT=0.025 ASSIGNMENTS=83 CHECKS=29498	? (TO) TT=1800.01	UNSAT TT=297.555	UNSAT TT=0.015 ASSIGNMENTS=85 CHECKS=30735	UNSAT TT=0.228 ASSIGNMENTS=4464 CHECKS=1733830	UNSAT TT=0.897	UNSAT TT=0.029 ASSIGNMENTS=377 CHECKS=100584	UNSAT TT=0.015 ASSIGNMENTS=88 CHECKS=30737	UNSAT TT=48.271	UNSAT TT=0.744	UNSAT TT=1.08
csp/os-taillard-7/ normalized-os-taillard-7-100-0.xml	SAT TT=0.09	SAT TT=137.753 CHECKS=62558000 NODES=339667	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=1.433 ASSIGNMENTS=67	SAT TT=1.562 ASSIGNMENTS=67	SAT TT=122.533 CHECKS=0 NODES=224758	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.41 ASSIGNMENTS=2084 CHECKS=2862510	SAT TT=0.409 ASSIGNMENTS=2084 CHECKS=2862510	? (MO) TT=771.55	? (MO) TT=543.46	SAT TT=0.758 ASSIGNMENTS=4080 CHECKS=5432050	SAT TT=1.625 ASSIGNMENTS=19970 CHECKS=11556700	SAT TT=283.699	SAT TT=7.786 ASSIGNMENTS=53727 CHECKS=56758500	SAT TT=0.09 ASSIGNMENTS=613 CHECKS=527848	? (TO) TT=1800.16	SAT TT=1.985	SAT TT=3.994
csp/os-taillard-7/ normalized-os-taillard-7-100-6.xml	SAT TT=2.231	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=2.231 ASSIGNMENTS=283	SAT TT=2.439 ASSIGNMENTS=283	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=9.375 ASSIGNMENTS=283	SAT TT=9.712 ASSIGNMENTS=283	? (MO) TT=780.17	? (MO) TT=664.19	SAT TT=10.326 ASSIGNMENTS=52724 CHECKS=78796000	SAT TT=7.424 ASSIGNMENTS=50586 CHECKS=57021900	? (TO) TT=1800.04	SAT TT=44.994 ASSIGNMENTS=250092 CHECKS=314365000	SAT TT=51.103 ASSIGNMENTS=318099 CHECKS=388087000	? (TO) TT=1800.19	SAT TT=5.021	SAT TT=8.825
csp/os-taillard-7/ normalized-os-taillard-7-105-3.xml	SAT TT=0.055	SAT TT=1.647 CHECKS=5128 NODES=1000	SAT TT=1.367 CHECKS=865 NODES=387	? (TO) TT=1800.1	SAT TT=24.598 CHECKS=54342800	SAT TT=35.269 CHECKS=84617000	SAT TT=1.265 ASSIGNMENTS=59	SAT TT=1.255 ASSIGNMENTS=59	SAT TT=7.539 CHECKS=0 NODES=119	? (TO) TT=1800.01	SAT TT=1.592 CHECKS=9119310 NODES=1355	SAT TT=0.07 ASSIGNMENTS=443 CHECKS=234885	SAT TT=0.069 ASSIGNMENTS=443 CHECKS=234885	? (problem) TT=63.494	? (problem) TT=59.637	SAT TT=0.055 ASSIGNMENTS=457 CHECKS=258575	SAT TT=0.565 ASSIGNMENTS=9000 CHECKS=4483120	SAT TT=0.839	SAT TT=0.2 ASSIGNMENTS=2204 CHECKS=1023710	SAT TT=0.193 ASSIGNMENTS=1071 CHECKS=1279030	SAT TT=458.925	SAT TT=1.576	SAT TT=3.395
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/os-taillard-7/ normalized-os-taillard-7-105-4.xml	SAT TT=0.051	SAT TT=1.42 CHECKS=11408 NODES=620	SAT TT=1.588 CHECKS=5910 NODES=986	? (TO) TT=1800.09	SAT TT=25.426 CHECKS=55707300	SAT TT=35.498 CHECKS=84798000	SAT TT=1.245 ASSIGNMENTS=69	SAT TT=1.247 ASSIGNMENTS=69	SAT TT=6.733 CHECKS=0 NODES=707	? (TO) TT=1800.09	SAT TT=1.785 CHECKS=7284010 NODES=1167	SAT TT=0.051 ASSIGNMENTS=160 CHECKS=110240	SAT TT=0.051 ASSIGNMENTS=160 CHECKS=110240	? (MO) TT=621.29	? (MO) TT=444.55	SAT TT=0.098 ASSIGNMENTS=1064 CHECKS=526960	SAT TT=0.299 ASSIGNMENTS=4220 CHECKS=2140390	SAT TT=3.666	SAT TT=0.188 ASSIGNMENTS=1703 CHECKS=1047570	SAT TT=0.109 ASSIGNMENTS=514 CHECKS=656753	? (TO) TT=1800.15	SAT TT=1.497	SAT TT=3.569
csp/os-taillard-7/ normalized-os-taillard-7-105-8.xml	SAT TT=0.032	SAT TT=1.394 CHECKS=26986 NODES=722	SAT TT=1.386 CHECKS=8985 NODES=565	? (TO) TT=1800.02	SAT TT=24.336 CHECKS=55815200	SAT TT=16.655 CHECKS=47367600	SAT TT=1.43 ASSIGNMENTS=68	SAT TT=1.491 ASSIGNMENTS=68	SAT TT=8.658 CHECKS=0 NODES=2281	? (TO) TT=1800.1	SAT TT=1.447 CHECKS=3247290 NODES=242	SAT TT=0.045 ASSIGNMENTS=113 CHECKS=62199	SAT TT=0.043 ASSIGNMENTS=113 CHECKS=62199	? (TO) TT=1800	? (TO) TT=1800	SAT TT=0.032 ASSIGNMENTS=113 CHECKS=62810	SAT TT=0.068 ASSIGNMENTS=745 CHECKS=361595	SAT TT=19.363	SAT TT=0.098 ASSIGNMENTS=1081 CHECKS=363370	SAT TT=0.088 ASSIGNMENTS=486 CHECKS=472074	SAT TT=143.835	SAT TT=1.551	SAT TT=3.703
csp/os-taillard-7/ normalized-os-taillard-7-105-9.xml	SAT TT=0.045	SAT TT=1.206 CHECKS=926 NODES=216	SAT TT=1.329 CHECKS=301 NODES=302	SAT TT=1340.14	SAT TT=20.022 CHECKS=45066000	SAT TT=25.783 CHECKS=61926000	SAT TT=1.372 ASSIGNMENTS=54	SAT TT=1.243 ASSIGNMENTS=54	SAT TT=6.036 CHECKS=0 NODES=293	? (TO) TT=1800.09	SAT TT=1.634 CHECKS=5720640 NODES=901	SAT TT=0.072 ASSIGNMENTS=251 CHECKS=270200	SAT TT=0.073 ASSIGNMENTS=251 CHECKS=270200	? (MO) TT=739.69	? (MO) TT=461.33	SAT TT=0.062 ASSIGNMENTS=321 CHECKS=293001	SAT TT=0.258 ASSIGNMENTS=3493 CHECKS=1844590	SAT TT=4.164	SAT TT=0.052 ASSIGNMENTS=610 CHECKS=124342	SAT TT=0.045 ASSIGNMENTS=159 CHECKS=143903	SAT TT=172.135	SAT TT=1.548	SAT TT=3.463
csp/os-taillard-7/ normalized-os-taillard-7-95-4.xml	UNSAT TT=0.067	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.094	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=0.885 ASSIGNMENTS=0	UNSAT TT=1.041 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=8.266 ASSIGNMENTS=0	UNSAT TT=8.502 ASSIGNMENTS=0	? (MO) TT=862.36	? (MO) TT=719.13	UNSAT TT=0.514 ASSIGNMENTS=6758 CHECKS=3552680	UNSAT TT=0.585 ASSIGNMENTS=8312 CHECKS=4367690	UNSAT TT=1384.4	UNSAT TT=0.159 ASSIGNMENTS=1793 CHECKS=706405	UNSAT TT=0.067 ASSIGNMENTS=654 CHECKS=326889	? (TO) TT=1800.15	UNSAT TT=1.568	UNSAT TT=3.317
csp/os-taillard-7/ normalized-os-taillard-7-95-7.xml	UNSAT TT=0.096	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=0.096	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1.059 ASSIGNMENTS=0	UNSAT TT=0.944 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.383 ASSIGNMENTS=4370 CHECKS=2760300	UNSAT TT=0.381 ASSIGNMENTS=4370 CHECKS=2760300	? (MO) TT=960.31	? (MO) TT=699.69	UNSAT TT=0.395 ASSIGNMENTS=4328 CHECKS=2770680	UNSAT TT=0.737 ASSIGNMENTS=10727 CHECKS=5398150	? (TO) TT=1800.1	UNSAT TT=0.294 ASSIGNMENTS=3160 CHECKS=1410230	UNSAT TT=0.511 ASSIGNMENTS=5588 CHECKS=3503160	? (TO) TT=1800.16	UNSAT TT=1.738	UNSAT TT=3.335
csp/os-taillard-7/ normalized-os-taillard-7-95-8.xml	UNSAT TT=0.078	? (TO) TT=1800.04	? (TO) TT=1800.11	UNSAT TT=0.093	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=1.04 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=0.41 ASSIGNMENTS=4300 CHECKS=2714340	UNSAT TT=0.391 ASSIGNMENTS=4300 CHECKS=2714340	? (MO) TT=723.93	? (MO) TT=793.92	UNSAT TT=0.361 ASSIGNMENTS=4275 CHECKS=2739740	UNSAT TT=0.565 ASSIGNMENTS=8465 CHECKS=4214870	UNSAT TT=1251.76	UNSAT TT=0.627 ASSIGNMENTS=6345 CHECKS=3500590	UNSAT TT=0.078 ASSIGNMENTS=667 CHECKS=384681	? (TO) TT=1800.16	UNSAT TT=2.12	UNSAT TT=3.691
csp/os-taillard-7/ normalized-os-taillard-7-95-9.xml	UNSAT TT=0.073	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=0.093	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.918 ASSIGNMENTS=0	UNSAT TT=0.89 ASSIGNMENTS=0	UNSAT TT=543.774 CHECKS=0 NODES=1071400	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=0.214 ASSIGNMENTS=1869 CHECKS=1303690	UNSAT TT=0.215 ASSIGNMENTS=1869 CHECKS=1303690	? (MO) TT=1036.59	? (MO) TT=992.17	UNSAT TT=0.395 ASSIGNMENTS=4281 CHECKS=2778100	UNSAT TT=0.579 ASSIGNMENTS=8328 CHECKS=4291180	UNSAT TT=80.854	UNSAT TT=0.241 ASSIGNMENTS=2794 CHECKS=1245030	UNSAT TT=0.073 ASSIGNMENTS=679 CHECKS=371084	? (TO) TT=1800.16	UNSAT TT=1.607	UNSAT TT=3.14
csp/pigeons/ normalized-pigeons-11.xml	UNSAT TT=0.005	UNSAT TT=0.68 CHECKS=20 NODES=0	UNSAT TT=0.72 CHECKS=20 NODES=0	UNSAT TT=0.031	UNSAT TT=0.011 CHECKS=65	UNSAT TT=0.011 CHECKS=65	UNSAT TT=0.598 ASSIGNMENTS=0	UNSAT TT=0.564 ASSIGNMENTS=0	UNSAT TT=75.331 CHECKS=21797200 NODES=3977560	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=59.16	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=23.999	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.005 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=580.843	UNSAT TT=3.213	UNSAT TT=9.989
csp/pigeons/ normalized-pigeons-13.xml	UNSAT TT=0.006	UNSAT TT=0.78 CHECKS=24 NODES=0	UNSAT TT=0.792 CHECKS=24 NODES=0	UNSAT TT=0.033	UNSAT TT=0.012 CHECKS=90	UNSAT TT=0.008 CHECKS=90	UNSAT TT=0.734 ASSIGNMENTS=0	UNSAT TT=0.634 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.01	? (TO) TT=1800.07	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.05	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=127.239	UNSAT TT=421.563
csp/pigeons/ normalized-pigeons-14.xml	UNSAT TT=0.008	UNSAT TT=0.806 CHECKS=26 NODES=0	UNSAT TT=0.716 CHECKS=26 NODES=0	UNSAT TT=0.035	UNSAT TT=0.013 CHECKS=104	UNSAT TT=0.009 CHECKS=104	UNSAT TT=0.589 ASSIGNMENTS=0	UNSAT TT=0.623 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.04	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.17	UNSAT TT=721.198	? (TO) TT=1800.05
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pigeons/ normalized-pigeons-16.xml	UNSAT TT=0.007	UNSAT TT=0.816 CHECKS=30 NODES=0	UNSAT TT=0.768 CHECKS=30 NODES=0	UNSAT TT=0.039	UNSAT TT=0.016 CHECKS=135	UNSAT TT=0.012 CHECKS=135	UNSAT TT=0.589 ASSIGNMENTS=0	UNSAT TT=0.59 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.008 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.06
csp/pigeons/ normalized-pigeons-20.xml	UNSAT TT=0.011	UNSAT TT=0.827 CHECKS=38 NODES=0	UNSAT TT=0.838 CHECKS=38 NODES=0	UNSAT TT=0.044	UNSAT TT=0.021 CHECKS=209	UNSAT TT=0.015 CHECKS=209	UNSAT TT=0.671 ASSIGNMENTS=0	UNSAT TT=0.758 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/pigeons/ normalized-pigeons-30-ord.xml	UNSAT TT=0.032	UNSAT TT=1.049 CHECKS=1654 NODES=0	UNSAT TT=1.077 CHECKS=1654 NODES=0	UNSAT TT=0.128	UNSAT TT=0.292 CHECKS=1363450	UNSAT TT=0.27 CHECKS=1468320	UNSAT TT=1.225 ASSIGNMENTS=0	UNSAT TT=1.358 ASSIGNMENTS=0	UNSAT TT=2.289 CHECKS=96750 NODES=1234	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=14.976	UNSAT TT=5.758	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.712	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=4.861	UNSAT TT=1.912	UNSAT TT=1.611
csp/pigeons/ normalized-pigeons-30.xml	UNSAT TT=0.018	UNSAT TT=1.033 CHECKS=58 NODES=0	UNSAT TT=0.947 CHECKS=58 NODES=0	UNSAT TT=0.076	UNSAT TT=0.043 CHECKS=464	UNSAT TT=0.024 CHECKS=464	UNSAT TT=0.938 ASSIGNMENTS=0	UNSAT TT=1.058 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.031 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=0.02 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	UNSAT TT=0.019 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pigeons/ normalized-pigeons-35.xml	UNSAT TT=0.024	UNSAT TT=1.015 CHECKS=68 NODES=0	UNSAT TT=1.062 CHECKS=68 NODES=0	UNSAT TT=0.096	UNSAT TT=0.054 CHECKS=629	UNSAT TT=0.034 CHECKS=629	UNSAT TT=1.194 ASSIGNMENTS=0	UNSAT TT=1.087 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.11	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/pigeons/ normalized-pigeons-40.xml	UNSAT TT=0.029	UNSAT TT=1.224 CHECKS=78 NODES=0	UNSAT TT=1.216 CHECKS=78 NODES=0	UNSAT TT=0.117	UNSAT TT=0.076 CHECKS=819	UNSAT TT=0.043 CHECKS=819	UNSAT TT=1.389 ASSIGNMENTS=0	UNSAT TT=1.102 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.09	UNSAT TT=0.029 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.03 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.12
csp/pigeons/ normalized-pigeons-45.xml	UNSAT TT=0.035	UNSAT TT=1.168 CHECKS=88 NODES=0	UNSAT TT=1.219 CHECKS=88 NODES=0	UNSAT TT=0.142	UNSAT TT=0.095 CHECKS=1034	UNSAT TT=0.055 CHECKS=1034	UNSAT TT=1.19 ASSIGNMENTS=0	UNSAT TT=1.425 ASSIGNMENTS=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/pigeons/ normalized-pigeons-50.xml	UNSAT TT=0.04	UNSAT TT=1.25 CHECKS=98 NODES=0	UNSAT TT=1.246 CHECKS=98 NODES=0	UNSAT TT=0.159	UNSAT TT=0.115 CHECKS=1274	UNSAT TT=0.063 CHECKS=1274	UNSAT TT=1.244 ASSIGNMENTS=0	UNSAT TT=1.442 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=0.056 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=1629.72	? (TO) TT=1800.07	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.043 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.33	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/pigeons/ normalized-pigeons-8.xml	UNSAT TT=0.006	UNSAT TT=0.643 CHECKS=14 NODES=0	UNSAT TT=0.663 CHECKS=14 NODES=0	UNSAT TT=0.025	UNSAT TT=0.008 CHECKS=35	UNSAT TT=0.008 CHECKS=35	UNSAT TT=0.559 ASSIGNMENTS=0	UNSAT TT=0.513 ASSIGNMENTS=0	UNSAT TT=0.607 CHECKS=33553 NODES=5913	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.838	UNSAT TT=0.65	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.303	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.598	UNSAT TT=0.56	UNSAT TT=0.555
csp/pseudo/mps/ normalized-mps-diamond.xml	UNSAT TT=0.005	UNSAT TT=0.708 CHECKS=2 NODES=0	UNSAT TT=0.665 CHECKS=2 NODES=0	UNSAT TT=0.023	UNSAT TT=0.008 CHECKS=14	UNSAT TT=0.006 CHECKS=14	UNSAT TT=0.427 ASSIGNMENTS=0	UNSAT TT=0.469 ASSIGNMENTS=0	UNSAT TT=0.41 CHECKS=10 NODES=1	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=0.017 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.017 ASSIGNMENTS=1 CHECKS=11	Wrong Cert. TT=0.842	Wrong Cert. TT=1.03	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.007 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.278	UNSAT TT=0.005 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.005 ASSIGNMENTS=1 CHECKS=11	UNSAT TT=0.828	UNSAT TT=0.437	UNSAT TT=0.437
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/queenAttacking/ normalized-queenAttacking-10.xml		? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=61.888 CHECKS=73816900	UNSAT TT=63.604 CHECKS=99104600	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=898.494	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/queenAttacking/ normalized-queenAttacking-11.xml	UNSAT TT=368.848	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=82.413 CHECKS=83432700	UNSAT TT=71.69 CHECKS=117741000	? (TO) TT=1800.13	UNSAT TT=368.848 ASSIGNMENTS=66	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=150.712	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/queenAttacking/ normalized-queenAttacking-12.xml	UNSAT TT=748.425	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=142.411 CHECKS=141295000	UNSAT TT=78.293 CHECKS=105624000	UNSAT TT=1539.86 ASSIGNMENTS=1520	UNSAT TT=748.425 ASSIGNMENTS=22	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.06	? (MO) TT=842.09	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=256.536	? (TO) TT=1800.1	? (TO) TT=1800.07
csp/queenAttacking/ normalized-queenAttacking-3.xml	UNSAT TT=0.009	UNSAT TT=0.679 CHECKS=137 NODES=0	UNSAT TT=0.74 CHECKS=137 NODES=0	UNSAT TT=0.034	UNSAT TT=0.024 CHECKS=1239	UNSAT TT=0.011 CHECKS=1377	UNSAT TT=0.704 ASSIGNMENTS=0	UNSAT TT=0.701 ASSIGNMENTS=0	UNSAT TT=0.583 CHECKS=1406 NODES=30	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=0.022 ASSIGNMENTS=31 CHECKS=1205	UNSAT TT=0.021 ASSIGNMENTS=31 CHECKS=1205	UNSAT TT=0.779	UNSAT TT=0.772	UNSAT TT=0.009 ASSIGNMENTS=31 CHECKS=1133	UNSAT TT=0.012 ASSIGNMENTS=28 CHECKS=1338	UNSAT TT=2.968	UNSAT TT=0.016 ASSIGNMENTS=89 CHECKS=3000	UNSAT TT=0.011 ASSIGNMENTS=24 CHECKS=1243	UNSAT TT=1.754	UNSAT TT=0.661	UNSAT TT=0.646
csp/queenAttacking/ normalized-queenAttacking-4.xml	UNSAT TT=0.05	UNSAT TT=1.099 CHECKS=271816 NODES=1889	UNSAT TT=1.066 CHECKS=278200 NODES=1885	UNSAT TT=0.076	UNSAT TT=21.554 CHECKS=17419400	UNSAT TT=32.073 CHECKS=26245100	UNSAT TT=1.435 ASSIGNMENTS=388	UNSAT TT=1.413 ASSIGNMENTS=343	UNSAT TT=0.858 CHECKS=20669 NODES=440	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=0.071 ASSIGNMENTS=335 CHECKS=23413	UNSAT TT=0.071 ASSIGNMENTS=335 CHECKS=23413	UNSAT TT=1.01	UNSAT TT=1.173	UNSAT TT=0.05 ASSIGNMENTS=298 CHECKS=21117	UNSAT TT=0.286 ASSIGNMENTS=3326 CHECKS=188227	? (TO) TT=1800.11	UNSAT TT=0.156 ASSIGNMENTS=928 CHECKS=57155	UNSAT TT=0.058 ASSIGNMENTS=380 CHECKS=25928	UNSAT TT=3.275	UNSAT TT=1.278	UNSAT TT=1.483
csp/queenAttacking/ normalized-queenAttacking-5.xml	SAT TT=0.049	SAT TT=1.417 CHECKS=796459 NODES=3289	SAT TT=1.531 CHECKS=811169 NODES=3289	SAT TT=5.81	Wrong UNSAT TT=24.873 CHECKS=27090400	Wrong UNSAT TT=40.65 CHECKS=44647500	SAT TT=20.396 ASSIGNMENTS=38676	SAT TT=4.237 ASSIGNMENTS=2481	SAT TT=2.359 CHECKS=259545 NODES=5730	SAT TT=2.389 CHECKS=9788200 NODES=16496	SAT TT=178.158 CHECKS=1345730000 NODES=495407	SAT TT=0.986 ASSIGNMENTS=7096 CHECKS=644160	SAT TT=0.987 ASSIGNMENTS=7096 CHECKS=644160	SAT TT=2.224	SAT TT=2.275	SAT TT=1.658 ASSIGNMENTS=12809 CHECKS=1104960	SAT TT=0.049 ASSIGNMENTS=130 CHECKS=10334	? (TO) TT=1800.07	SAT TT=1.2 ASSIGNMENTS=5299 CHECKS=511608	SAT TT=0.108 ASSIGNMENTS=533 CHECKS=48236	SAT TT=7.266	SAT TT=1.629	SAT TT=61.253
csp/queenAttacking/ normalized-queenAttacking-6.xml	SAT TT=4.23	? (TO) TT=1800.09	? (TO) TT=1800.17	SAT TT=285.777	Wrong UNSAT TT=23.896 CHECKS=31886300	Wrong UNSAT TT=32.401 CHECKS=48609900	SAT TT=9.904 ASSIGNMENTS=647	SAT TT=94.433 ASSIGNMENTS=114209	SAT TT=4.23 CHECKS=1503520 NODES=7137	SAT TT=19.538 CHECKS=152673000 NODES=124555	? (TO) TT=1800.07	SAT TT=29.634 ASSIGNMENTS=34451 CHECKS=3923430	SAT TT=299.917 ASSIGNMENTS=34451 CHECKS=3923430	SAT TT=15.85	SAT TT=11.322	SAT TT=54.742 ASSIGNMENTS=97561 CHECKS=11313400	SAT TT=21.415 ASSIGNMENTS=26424 CHECKS=3197780	? (TO) TT=1800.1	SAT TT=58.59 ASSIGNMENTS=89665 CHECKS=13315300	SAT TT=22.209 ASSIGNMENTS=34451 CHECKS=3923430	SAT TT=103.475	? (TO) TT=1800.1	SAT TT=154.158
csp/queenAttacking/ normalized-queenAttacking-7.xml	SAT TT=450.699	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.07	Wrong UNSAT TT=37.204 CHECKS=58035700	Wrong UNSAT TT=52.559 CHECKS=87594000	SAT TT=491.793 ASSIGNMENTS=597366	SAT TT=450.699 ASSIGNMENTS=328995	SAT TT=511.645 CHECKS=337241000 NODES=792499	SAT TT=624.23 CHECKS=5777620000 NODES=2511800	? (TO) TT=1800.07	SAT TT=1059.03 ASSIGNMENTS=1727560 CHECKS=212930000	SAT TT=1619.54 ASSIGNMENTS=597366	? (TO) TT=1800.04	SAT TT=909.859	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1212.58 ASSIGNMENTS=1780320 CHECKS=320460000	SAT TT=1091.67 ASSIGNMENTS=1727560 CHECKS=212930000	? (TO) TT=1800.09	SAT TT=1010.82	? (TO) TT=1800.13
csp/queenAttacking/ normalized-queenAttacking-8.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	Wrong UNSAT TT=30.106 CHECKS=41352500	Wrong UNSAT TT=37.672 CHECKS=60161000	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1090.66	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.1
csp/queenAttacking/ normalized-queenAttacking-9.xml		? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.09	UNSAT TT=35.756 CHECKS=40447900	UNSAT TT=35.827 CHECKS=55227200	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.1	? (MO) TT=1261.81	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/queensKnights/ normalized-queensKnights-100-5-add.xml	UNSAT TT=21.342	UNSAT TT=1252.2 CHECKS=1355730000 NODES=9898	UNSAT TT=1282.62 CHECKS=1355730000 NODES=9898	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=1216.81	UNSAT TT=21.342	UNSAT TT=43.567
csp/queensKnights/ normalized-queensKnights-100-5-mul.xml	UNSAT TT=30.76	? (TO) TT=1800.1	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.12	? TT=292.326	UNSAT TT=30.76	UNSAT TT=45.023
csp/queensKnights/ normalized-queensKnights-10-5-mul.xml	UNSAT TT=0.864	UNSAT TT=0.864 CHECKS=101151 NODES=85	UNSAT TT=0.87 CHECKS=141037 NODES=0	UNSAT TT=16.858	UNSAT TT=24.47 CHECKS=11796600	UNSAT TT=34.952 CHECKS=15679800	UNSAT TT=1.429 ASSIGNMENTS=0	UNSAT TT=1.442 ASSIGNMENTS=0	UNSAT TT=0.93 CHECKS=369064 NODES=326	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=8.243 ASSIGNMENTS=0	UNSAT TT=7.933 ASSIGNMENTS=99 CHECKS=141102	UNSAT TT=2.205	UNSAT TT=2.038	UNSAT TT=13.386 ASSIGNMENTS=1681 CHECKS=78255	UNSAT TT=287.272 ASSIGNMENTS=37844 CHECKS=1590670	? (TO) TT=1800.06	UNSAT TT=4.387 ASSIGNMENTS=700 CHECKS=103869	UNSAT TT=3.463 ASSIGNMENTS=441 CHECKS=25257	UNSAT TT=4.628	UNSAT TT=0.882	UNSAT TT=0.979
csp/queensKnights/ normalized-queensKnights-12-5-mul.xml	UNSAT TT=1.005	UNSAT TT=1.191 CHECKS=272609 NODES=128	UNSAT TT=1.005 CHECKS=403318 NODES=0	UNSAT TT=762.433	UNSAT TT=27.736 CHECKS=13912600	UNSAT TT=35.239 CHECKS=22822700	UNSAT TT=1.371 ASSIGNMENTS=0	UNSAT TT=1.519 ASSIGNMENTS=0	UNSAT TT=1.203 CHECKS=783353 NODES=366	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=19.973 ASSIGNMENTS=765 CHECKS=44331	UNSAT TT=8.745 ASSIGNMENTS=140 CHECKS=383522	UNSAT TT=3.232	UNSAT TT=2.828	UNSAT TT=85.812 ASSIGNMENTS=5339 CHECKS=323229	UNSAT TT=495.219 ASSIGNMENTS=35037 CHECKS=1501340	? (TO) TT=1800.05	UNSAT TT=9.68 ASSIGNMENTS=1326 CHECKS=250870	UNSAT TT=11.284 ASSIGNMENTS=765 CHECKS=44331	UNSAT TT=5.108	UNSAT TT=1.362	UNSAT TT=1.368
csp/queensKnights/ normalized-queensKnights-20-5-mul.xml	UNSAT TT=1.338	UNSAT TT=1.637 CHECKS=4575410 NODES=376	UNSAT TT=1.661 CHECKS=6397900 NODES=0	? (TO) TT=1800.02	UNSAT TT=56.733 CHECKS=45808700	UNSAT TT=49.01 CHECKS=62842700	? (TO) TT=1800.15	? (TO) TT=1800.08	UNSAT TT=3.511 CHECKS=18966100 NODES=1384	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=9.031 ASSIGNMENTS=396 CHECKS=6534760	UNSAT TT=9.07 ASSIGNMENTS=396 CHECKS=6534760	UNSAT TT=24.121	UNSAT TT=10.496	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=417.029 ASSIGNMENTS=4077 CHECKS=2007810	UNSAT TT=235.402 ASSIGNMENTS=2469 CHECKS=199335	UNSAT TT=18.619	UNSAT TT=1.338	UNSAT TT=1.73
csp/queensKnights/ normalized-queensKnights-50-5-add.xml	UNSAT TT=4.381	UNSAT TT=20.094 CHECKS=406092000 NODES=2446	UNSAT TT=21.751 CHECKS=516515000 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=721.046 CHECKS=2919320000	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=257.721 CHECKS=5736140000 NODES=10946	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=38.47 ASSIGNMENTS=2491 CHECKS=649643000	UNSAT TT=38.218 ASSIGNMENTS=2491 CHECKS=649643000	UNSAT TT=386.723	UNSAT TT=305.295	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=697.537	UNSAT TT=4.381	UNSAT TT=9.212
csp/queensKnights/ normalized-queensKnights-80-5-add.xml	UNSAT TT=11.313	UNSAT TT=436.192 CHECKS=555846000 NODES=6318	UNSAT TT=480.142 CHECKS=575061000 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=661.188 ASSIGNMENTS=6399 CHECKS=788057000	UNSAT TT=662.202 ASSIGNMENTS=6399 CHECKS=788057000	? (MO) TT=1604.53	? (MO) TT=1625.51	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=1505.07	UNSAT TT=11.313	UNSAT TT=25.91
csp/queensKnights/ normalized-queensKnights-80-5-mul.xml	UNSAT TT=13.082	UNSAT TT=452.789 CHECKS=636801000 NODES=6318	UNSAT TT=632.74 CHECKS=665022000 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=698.007 ASSIGNMENTS=6399 CHECKS=821018000	UNSAT TT=668.806 ASSIGNMENTS=6399 CHECKS=821018000	? (TO) TT=1800.03	? (MO) TT=1692.69	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=347.817	UNSAT TT=13.082	UNSAT TT=26.406
csp/queensKnights/ normalized-queensKnights-8-5-add.xml	UNSAT TT=0.273	UNSAT TT=0.849 CHECKS=24172 NODES=52	UNSAT TT=0.82 CHECKS=29251 NODES=0	UNSAT TT=0.682	UNSAT TT=0.547 CHECKS=62972	UNSAT TT=8.467 CHECKS=3006820	UNSAT TT=1.059 ASSIGNMENTS=0	UNSAT TT=1.259 ASSIGNMENTS=0	UNSAT TT=0.678 CHECKS=60111 NODES=151	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=8.238 ASSIGNMENTS=62 CHECKS=33864	UNSAT TT=8.575 ASSIGNMENTS=302 CHECKS=6823	UNSAT TT=1.443	UNSAT TT=1.28	UNSAT TT=3.23 ASSIGNMENTS=925 CHECKS=24534	UNSAT TT=22.899 ASSIGNMENTS=9175 CHECKS=294156	UNSAT TT=151.053	UNSAT TT=0.273 ASSIGNMENTS=369 CHECKS=22897	UNSAT TT=0.946 ASSIGNMENTS=302 CHECKS=6823	UNSAT TT=3.126	UNSAT TT=0.689	UNSAT TT=0.739
csp/queensKnights/ normalized-queensKnights-8-5-mul.xml	UNSAT TT=0.757	UNSAT TT=0.845 CHECKS=28925 NODES=52	UNSAT TT=0.834 CHECKS=42313 NODES=0	UNSAT TT=0.776	UNSAT TT=0.711 CHECKS=118455	UNSAT TT=34.149 CHECKS=14475700	UNSAT TT=1.151 ASSIGNMENTS=0	UNSAT TT=1.366 ASSIGNMENTS=0	UNSAT TT=0.801 CHECKS=64541 NODES=159	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=8.666 ASSIGNMENTS=0	UNSAT TT=8.497 ASSIGNMENTS=62 CHECKS=37832	UNSAT TT=1.816	UNSAT TT=1.701	UNSAT TT=2.879 ASSIGNMENTS=821 CHECKS=34332	UNSAT TT=21.81 ASSIGNMENTS=8568 CHECKS=378893	UNSAT TT=199.287	UNSAT TT=1.017 ASSIGNMENTS=437 CHECKS=42121	UNSAT TT=0.934 ASSIGNMENTS=273 CHECKS=13609	UNSAT TT=4.608	UNSAT TT=0.757	UNSAT TT=0.822
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/queens/ normalized-queens-100.xml	SAT TT=3.19	SAT TT=3.356 CHECKS=837102 NODES=179	SAT TT=3.19 CHECKS=551867 NODES=0	SAT TT=11.176	SAT TT=48.216 CHECKS=78137000	SAT TT=47.671 CHECKS=113701000	SAT TT=295.168 ASSIGNMENTS=4904	SAT TT=316.581 ASSIGNMENTS=4904	SAT TT=18.631 CHECKS=1501120 NODES=601	SAT TT=9.146 CHECKS=3004650 NODES=99	SAT TT=8.634 CHECKS=2965050 NODES=69	SAT TT=23.115 ASSIGNMENTS=92 CHECKS=1143800	SAT TT=10.575 ASSIGNMENTS=188 CHECKS=841630	SAT TT=258.006	SAT TT=45.711	SAT TT=81.429 ASSIGNMENTS=6467 CHECKS=27832200	SAT TT=614.944 ASSIGNMENTS=22425 CHECKS=38872600	? (TO) TT=1800	? (TO) TT=1800.11	SAT TT=14.489 ASSIGNMENTS=92 CHECKS=1143800	SAT TT=202.366	SAT TT=16.345	SAT TT=30.622
csp/queens/ normalized-queens-120.xml	SAT TT=4.492	SAT TT=4.492 CHECKS=1410660 NODES=214	SAT TT=5.379 CHECKS=2384650 NODES=214	SAT TT=8.252	SAT TT=110.367 CHECKS=216012000	SAT TT=22.086 CHECKS=44000700	SAT TT=505.86 ASSIGNMENTS=4210	SAT TT=556.302 ASSIGNMENTS=4210	SAT TT=38.366 CHECKS=2715810 NODES=691	SAT TT=17.191 CHECKS=4419660 NODES=65	SAT TT=17.37 CHECKS=5383560 NODES=99	SAT TT=13.286 ASSIGNMENTS=231 CHECKS=1468090	SAT TT=12.532 ASSIGNMENTS=231 CHECKS=1468090	SAT TT=608.25	SAT TT=74.058	SAT TT=26.46 ASSIGNMENTS=112 CHECKS=1758840	SAT TT=91.796 ASSIGNMENTS=372 CHECKS=5970600	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=96.061 ASSIGNMENTS=634 CHECKS=7477280	? TT=609.795	SAT TT=24.088	SAT TT=52.465
csp/queens/ normalized-queens-12.xml	SAT TT=0.012	SAT TT=0.758 CHECKS=2093 NODES=26	SAT TT=0.775 CHECKS=3733 NODES=26	SAT TT=0.037	SAT TT=0.104 CHECKS=9682	SAT TT=0.018 CHECKS=33946	SAT TT=1.086 ASSIGNMENTS=22	SAT TT=1.165 ASSIGNMENTS=15	SAT TT=0.671 CHECKS=1273 NODES=28	SAT TT=0.676 CHECKS=7326 NODES=30	SAT TT=0.655 CHECKS=7656 NODES=22	SAT TT=0.023 ASSIGNMENTS=7 CHECKS=2131	SAT TT=0.023 ASSIGNMENTS=7 CHECKS=2131	SAT TT=1.455	SAT TT=1.449	SAT TT=0.012 ASSIGNMENTS=7 CHECKS=2131	SAT TT=0.027 ASSIGNMENTS=134 CHECKS=19038	SAT TT=0.439	SAT TT=0.174 ASSIGNMENTS=868 CHECKS=131036	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=2362	SAT TT=1.755	SAT TT=0.684	SAT TT=0.844
csp/queens/ normalized-queens-150.xml	SAT TT=2.322	SAT TT=8.572 CHECKS=5298730 NODES=459	SAT TT=10.79 CHECKS=7248470 NODES=458	SAT TT=2.322	? (TO) TT=1800.12	SAT TT=96.065 CHECKS=187828000	SAT TT=1798.36 ASSIGNMENTS=29374	? (TO) TT=1800.08	SAT TT=101.628 CHECKS=8904790 NODES=1314	SAT TT=41.586 CHECKS=8906480 NODES=93	SAT TT=42.046 CHECKS=9565800 NODES=89	SAT TT=163.466 ASSIGNMENTS=440 CHECKS=8583920	SAT TT=17.033 ASSIGNMENTS=416 CHECKS=5075110	SAT TT=149.563	SAT TT=156.854	SAT TT=71.854 ASSIGNMENTS=142 CHECKS=3434780	SAT TT=162.182 ASSIGNMENTS=302 CHECKS=7704080	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=162.049 ASSIGNMENTS=440 CHECKS=8583920	? TT=650.379	SAT TT=28.431	SAT TT=106.835
csp/queens/ normalized-queens-180.xml	SAT TT=10.492	SAT TT=12.593 CHECKS=9178230 NODES=479	SAT TT=10.492 CHECKS=3764840 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=103.073 CHECKS=192000000	? (TO) TT=1800.18	? (TO) TT=1800.14	SAT TT=213.927 CHECKS=24891500 NODES=1642	SAT TT=92.91 CHECKS=16029400 NODES=131	SAT TT=92.254 CHECKS=16915500 NODES=116	SAT TT=198.963 ASSIGNMENTS=179 CHECKS=6618400	SAT TT=26.43 ASSIGNMENTS=668 CHECKS=12254900	SAT TT=278.703	SAT TT=266.598	? (TO) TT=1800.06	SAT TT=364.084 ASSIGNMENTS=361 CHECKS=13342200	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=180.927 ASSIGNMENTS=179 CHECKS=6618400	? TT=536.207	SAT TT=62.149	SAT TT=171.105
csp/queens/ normalized-queens-200.xml	SAT TT=4.379	SAT TT=15.969 CHECKS=13451000 NODES=528	SAT TT=19.605 CHECKS=18804900 NODES=528	SAT TT=4.379	SAT TT=218.419 CHECKS=367484000	SAT TT=39.141 CHECKS=39135100	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=376.822 CHECKS=48927100 NODES=1826	SAT TT=157.937 CHECKS=21591500 NODES=135	SAT TT=155.093 CHECKS=24278000 NODES=146	SAT TT=313.411 ASSIGNMENTS=223 CHECKS=8980140	SAT TT=29.586 ASSIGNMENTS=534 CHECKS=13549300	SAT TT=390.46	SAT TT=378.24	SAT TT=268.442 ASSIGNMENTS=211 CHECKS=8081850	SAT TT=301.51 ASSIGNMENTS=186 CHECKS=8961030	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=293.91 ASSIGNMENTS=223 CHECKS=8980140	? TT=220.443	SAT TT=132.042	SAT TT=214.313
csp/queens/ normalized-queens-30.xml	SAT TT=0.113	SAT TT=1.041 CHECKS=21234 NODES=72	SAT TT=1.072 CHECKS=36094 NODES=72	SAT TT=0.113	SAT TT=12.038 CHECKS=39991700	SAT TT=17.102 CHECKS=58695600	SAT TT=7.44 ASSIGNMENTS=328	SAT TT=740.767 ASSIGNMENTS=278790	SAT TT=1.281 CHECKS=12399 NODES=60	SAT TT=1.231 CHECKS=75255 NODES=25	SAT TT=1.222 CHECKS=75255 NODES=18	SAT TT=0.208 ASSIGNMENTS=132 CHECKS=130103	SAT TT=0.21 ASSIGNMENTS=132 CHECKS=130103	SAT TT=4.372	SAT TT=3.776	SAT TT=0.147 ASSIGNMENTS=54 CHECKS=63529	SAT TT=2.283 ASSIGNMENTS=1633 CHECKS=1002980	? (TO) TT=1800.05	SAT TT=1.236 ASSIGNMENTS=347 CHECKS=416733	SAT TT=0.129 ASSIGNMENTS=31 CHECKS=37038	SAT TT=4.172	SAT TT=1.468	SAT TT=1.935
csp/queens/ normalized-queens-4.xml	SAT TT=0.005	SAT TT=0.744 CHECKS=90 NODES=5	SAT TT=0.638 CHECKS=95 NODES=0	SAT TT=0.024	SAT TT=0.009 CHECKS=299	SAT TT=0.008 CHECKS=390	SAT TT=0.518 ASSIGNMENTS=2	SAT TT=0.589 ASSIGNMENTS=4	SAT TT=0.391 CHECKS=42 NODES=5	SAT TT=0.397 CHECKS=150 NODES=3	SAT TT=0.392 CHECKS=150 NODES=2	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.865	SAT TT=0.865	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.261	SAT TT=0.008 ASSIGNMENTS=2 CHECKS=33	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=19	SAT TT=0.844	SAT TT=0.451	SAT TT=0.444
csp/queens/ normalized-queens-80.xml	SAT TT=0.691	SAT TT=2.353 CHECKS=618851 NODES=246	SAT TT=2.543 CHECKS=895075 NODES=246	SAT TT=0.691	SAT TT=35.251 CHECKS=75887800	SAT TT=31.869 CHECKS=85717600	SAT TT=161.24 ASSIGNMENTS=4968	SAT TT=162.086 ASSIGNMENTS=4968	SAT TT=9.814 CHECKS=854665 NODES=593	SAT TT=5.014 CHECKS=1494680 NODES=73	SAT TT=4.922 CHECKS=1646360 NODES=71	SAT TT=24.143 ASSIGNMENTS=392 CHECKS=2348980	SAT TT=10.249 ASSIGNMENTS=263 CHECKS=640082	SAT TT=109.284	SAT TT=25.122	SAT TT=101.104 ASSIGNMENTS=12252 CHECKS=43934300	SAT TT=335.144 ASSIGNMENTS=25931 CHECKS=27388000	? (TO) TT=1800.11	SAT TT=577.353 ASSIGNMENTS=23058 CHECKS=49633000	SAT TT=16.772 ASSIGNMENTS=392 CHECKS=2348980	SAT TT=97.318	SAT TT=7.301	SAT TT=15.316
csp/queens/ normalized-queens-8.xml	SAT TT=0.009	SAT TT=0.694 CHECKS=1044 NODES=18	SAT TT=0.729 CHECKS=558 NODES=0	SAT TT=0.028	SAT TT=0.047 CHECKS=4337	SAT TT=0.012 CHECKS=9304	SAT TT=0.882 ASSIGNMENTS=24	SAT TT=0.802 ASSIGNMENTS=9	SAT TT=0.529 CHECKS=324 NODES=12	SAT TT=0.527 CHECKS=2156 NODES=21	SAT TT=0.507 CHECKS=4956 NODES=48	SAT TT=0.021 ASSIGNMENTS=8 CHECKS=1268	SAT TT=0.021 ASSIGNMENTS=8 CHECKS=1268	SAT TT=1.196	SAT TT=1.173	SAT TT=0.011 ASSIGNMENTS=19 CHECKS=2489	SAT TT=0.009 ASSIGNMENTS=15 CHECKS=1286	SAT TT=0.321	SAT TT=0.023 ASSIGNMENTS=204 CHECKS=14571	SAT TT=0.009 ASSIGNMENTS=11 CHECKS=1309	SAT TT=1.431	SAT TT=0.556	SAT TT=0.548
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapGraphsMod/ normalized-graph12-w0.xml	SAT TT=0.085	SAT TT=2.169 CHECKS=26373 NODES=680	SAT TT=2.086 CHECKS=30060 NODES=0	SAT TT=0.156	SAT TT=36.379 CHECKS=6510070	SAT TT=4.444 CHECKS=2211930	SAT TT=1.253 ASSIGNMENTS=341	SAT TT=1.342 ASSIGNMENTS=341	SAT TT=1.166 CHECKS=24408 NODES=680	SAT TT=1.209 CHECKS=93540 NODES=324	SAT TT=1.198 CHECKS=148620 NODES=324	SAT TT=0.11 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.104 ASSIGNMENTS=340 CHECKS=680	SAT TT=15.206	SAT TT=12.616	SAT TT=0.094 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.085 ASSIGNMENTS=340 CHECKS=680	SAT TT=1.218	SAT TT=0.111 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.096 ASSIGNMENTS=340 CHECKS=680	SAT TT=3.647	SAT TT=2.959	SAT TT=2.99
csp/rlfapGraphsMod/ normalized-graph12-w1.xml	UNSAT TT=0.209	UNSAT TT=2.067 CHECKS=372790 NODES=437	UNSAT TT=1.711 CHECKS=49562 NODES=0	? (TO) TT=1800.04	UNSAT TT=2.559 CHECKS=158798	UNSAT TT=0.325 CHECKS=164912	UNSAT TT=1.956 ASSIGNMENTS=0	UNSAT TT=2.061 ASSIGNMENTS=0	UNSAT TT=3.628 CHECKS=42831 NODES=25	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.209 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=0.218 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=68.461	UNSAT TT=69.315	UNSAT TT=0.295 ASSIGNMENTS=85 CHECKS=10554	UNSAT TT=5.782 ASSIGNMENTS=11341 CHECKS=451559	UNSAT TT=101.81	UNSAT TT=0.74 ASSIGNMENTS=828 CHECKS=39462	UNSAT TT=0.219 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=7.507	UNSAT TT=4.064	UNSAT TT=4.794
csp/rlfapGraphsMod/ normalized-graph13-w0.xml	SAT TT=0.123	SAT TT=3.768 CHECKS=36495 NODES=916	SAT TT=3.265 CHECKS=41113 NODES=0	SAT TT=0.211	SAT TT=36.996 CHECKS=5732920	SAT TT=5.189 CHECKS=1954350	SAT TT=1.548 ASSIGNMENTS=459	SAT TT=1.566 ASSIGNMENTS=459	SAT TT=1.442 CHECKS=34046 NODES=916	SAT TT=1.767 CHECKS=129438 NODES=445	SAT TT=1.494 CHECKS=231572 NODES=445	SAT TT=0.134 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.139 ASSIGNMENTS=458 CHECKS=916	SAT TT=18.098	SAT TT=16.244	SAT TT=0.128 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.123 ASSIGNMENTS=458 CHECKS=916	SAT TT=1.529	SAT TT=0.143 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.125 ASSIGNMENTS=458 CHECKS=916	SAT TT=4.252	SAT TT=3.669	SAT TT=4.186
csp/rlfapGraphsMod/ normalized-graph13-w1.xml	UNSAT TT=0.265	UNSAT TT=2.352 CHECKS=430640 NODES=416	UNSAT TT=2.058 CHECKS=40924 NODES=0	UNSAT TT=1340.48	UNSAT TT=3.858 CHECKS=263217	UNSAT TT=0.528 CHECKS=275302	UNSAT TT=1.872 ASSIGNMENTS=0	UNSAT TT=1.772 ASSIGNMENTS=0	UNSAT TT=4.186 CHECKS=37250 NODES=13	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.265 ASSIGNMENTS=11 CHECKS=5004	UNSAT TT=0.268 ASSIGNMENTS=11 CHECKS=5004	UNSAT TT=98.236	UNSAT TT=86.968	UNSAT TT=0.416 ASSIGNMENTS=58 CHECKS=15543	UNSAT TT=7.787 ASSIGNMENTS=12379 CHECKS=566067	UNSAT TT=1.596	UNSAT TT=15.46 ASSIGNMENTS=21782 CHECKS=1003740	UNSAT TT=0.302 ASSIGNMENTS=13 CHECKS=5726	UNSAT TT=9.225	UNSAT TT=5.109	UNSAT TT=6.026
csp/rlfapGraphsMod/ normalized-graph14-f28.xml	UNSAT TT=0.611	UNSAT TT=5.572 CHECKS=2827300 NODES=11553	UNSAT TT=29.257 CHECKS=11764300 NODES=756	? (TO) TT=1800.08	UNSAT TT=319.439 CHECKS=16788100	? (TO) TT=1800.04	UNSAT TT=4.903 ASSIGNMENTS=60	UNSAT TT=4.573 ASSIGNMENTS=60	UNSAT TT=7.166 CHECKS=28784 NODES=98	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.854 ASSIGNMENTS=2630 CHECKS=338944	UNSAT TT=0.839 ASSIGNMENTS=2630 CHECKS=338944	UNSAT TT=34.784	UNSAT TT=32.943	UNSAT TT=0.611 ASSIGNMENTS=1496 CHECKS=208181	UNSAT TT=4.358 ASSIGNMENTS=13026 CHECKS=2078880	? (TO) TT=1800.12	UNSAT TT=59.33 ASSIGNMENTS=124843 CHECKS=27501900	UNSAT TT=2.632 ASSIGNMENTS=8813 CHECKS=1298650	UNSAT TT=9.531	UNSAT TT=4.468	UNSAT TT=6.345
csp/rlfapGraphsMod/ normalized-graph2-f24.xml	SAT TT=0.16	SAT TT=2.277 CHECKS=180188 NODES=836	SAT TT=6.047 CHECKS=7611710 NODES=1040	SAT TT=0.379	SAT TT=3.342 CHECKS=1586100	? (TO) TT=1800.08	SAT TT=3.014 ASSIGNMENTS=179	SAT TT=3.039 ASSIGNMENTS=179	SAT TT=3.937 CHECKS=88922 NODES=1122	SAT TT=11.886 CHECKS=45641200 NODES=169800	? (TO) TT=1800.07	SAT TT=0.186 ASSIGNMENTS=215 CHECKS=24475	SAT TT=0.185 ASSIGNMENTS=215 CHECKS=24475	SAT TT=31.219	SAT TT=34.229	SAT TT=0.16 ASSIGNMENTS=210 CHECKS=24312	SAT TT=3.699 ASSIGNMENTS=12817 CHECKS=1565760	? (TO) TT=1800.1	SAT TT=2.503 ASSIGNMENTS=3892 CHECKS=759946	SAT TT=0.191 ASSIGNMENTS=228 CHECKS=27009	SAT TT=7.046	SAT TT=3.594	SAT TT=3.65
csp/rlfapGraphsMod/ normalized-graph8-f10.xml	SAT TT=1.474	SAT TT=4.051 CHECKS=1454430 NODES=3640	SAT TT=4.361 CHECKS=1292430 NODES=2704	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=5.769 ASSIGNMENTS=1434	SAT TT=5.859 ASSIGNMENTS=1434	SAT TT=9.546 CHECKS=404794 NODES=2815	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.281 ASSIGNMENTS=2351 CHECKS=521685	SAT TT=11.216 ASSIGNMENTS=3640 CHECKS=1454430	SAT TT=79.854	SAT TT=83.725	SAT TT=1.821 ASSIGNMENTS=2697 CHECKS=692904	SAT TT=8.12 ASSIGNMENTS=17992 CHECKS=2813080	? (TO) TT=1800.1	SAT TT=15.045 ASSIGNMENTS=19962 CHECKS=4487820	SAT TT=1.474 ASSIGNMENTS=2351 CHECKS=521685	SAT TT=13.333	SAT TT=17.837	SAT TT=8.754
csp/rlfapGraphsMod/ normalized-graph8-f11.xml	UNSAT TT=0.536	UNSAT TT=4.9 CHECKS=4604290 NODES=5841	UNSAT TT=5.331 CHECKS=4097270 NODES=2898	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=4.788 ASSIGNMENTS=44	UNSAT TT=4.888 ASSIGNMENTS=44	UNSAT TT=6.871 CHECKS=45530 NODES=89	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=11.852 ASSIGNMENTS=5841 CHECKS=4604290	UNSAT TT=13.005 ASSIGNMENTS=5841 CHECKS=4604290	UNSAT TT=78.09	UNSAT TT=77.649	UNSAT TT=2.628 ASSIGNMENTS=4420 CHECKS=1276860	UNSAT TT=6.813 ASSIGNMENTS=13018 CHECKS=2408860	? (TO) TT=1800.06	UNSAT TT=2.868 ASSIGNMENTS=3515 CHECKS=824129	UNSAT TT=0.536 ASSIGNMENTS=477 CHECKS=128676	UNSAT TT=11.885	UNSAT TT=6.302	UNSAT TT=8.057
csp/rlfapGraphsMod/ normalized-graph9-f10.xml	UNSAT TT=0.969	UNSAT TT=6.925 CHECKS=6824400 NODES=8649	UNSAT TT=7.674 CHECKS=8142880 NODES=9257	? (TO) TT=1800.11	UNSAT TT=217.241 CHECKS=13085300	? (TO) TT=1800.03	UNSAT TT=6.302 ASSIGNMENTS=8	UNSAT TT=7.134 ASSIGNMENTS=8	UNSAT TT=14.874 CHECKS=511133 NODES=2336	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=1.314 ASSIGNMENTS=1042 CHECKS=393813	UNSAT TT=1.161 ASSIGNMENTS=1042 CHECKS=393813	UNSAT TT=64.761	UNSAT TT=65.829	UNSAT TT=0.969 ASSIGNMENTS=753 CHECKS=284684	UNSAT TT=11.126 ASSIGNMENTS=17622 CHECKS=3880640	? (TO) TT=1800.07	UNSAT TT=3.706 ASSIGNMENTS=4385 CHECKS=956685	UNSAT TT=6.393 ASSIGNMENTS=8708 CHECKS=3007850	UNSAT TT=17.519	UNSAT TT=8.281	UNSAT TT=10.442
csp/rlfapGraphsMod/ normalized-graph9-f9.xml	SAT TT=0.95	SAT TT=6.054 CHECKS=4193910 NODES=6974	SAT TT=6.367 CHECKS=4379440 NODES=6847	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=9.731 ASSIGNMENTS=4869	SAT TT=9.814 ASSIGNMENTS=4869	SAT TT=46.158 CHECKS=2924930 NODES=18042	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=12.577 ASSIGNMENTS=6974 CHECKS=4193910	SAT TT=13.059 ASSIGNMENTS=6974 CHECKS=4193910	SAT TT=73.708	SAT TT=69.983	SAT TT=1.118 ASSIGNMENTS=1702 CHECKS=347961	SAT TT=14.289 ASSIGNMENTS=28695 CHECKS=5020480	? (TO) TT=1800.12	SAT TT=46.577 ASSIGNMENTS=72521 CHECKS=19087000	SAT TT=0.95 ASSIGNMENTS=1379 CHECKS=276578	SAT TT=22.848	SAT TT=36.627	SAT TT=13.029
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapGraphs/ normalized-graph10.xml	SAT TT=1.015	SAT TT=4.103 CHECKS=741372 NODES=932	SAT TT=4.428 CHECKS=3635170 NODES=683	SAT TT=1342.64	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=36.267 ASSIGNMENTS=241	SAT TT=36.59 ASSIGNMENTS=241	SAT TT=8.381 CHECKS=208650 NODES=687	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.015 ASSIGNMENTS=215 CHECKS=116751	SAT TT=1.038 ASSIGNMENTS=215 CHECKS=116751	SAT TT=219.55	SAT TT=190.876	SAT TT=1.336 ASSIGNMENTS=342 CHECKS=204388	SAT TT=5.693 ASSIGNMENTS=630 CHECKS=793963	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1.027 ASSIGNMENTS=212 CHECKS=116453	SAT TT=17.812	SAT TT=9.686	SAT TT=11.603
csp/rlfapGraphs/ normalized-graph11.xml	UNSAT TT=0.271	UNSAT TT=3.038 CHECKS=4088 NODES=0	UNSAT TT=3.278 CHECKS=4088 NODES=0	UNSAT TT=0.644	UNSAT TT=2.894 CHECKS=512465	UNSAT TT=0.494 CHECKS=443375	UNSAT TT=2.996 ASSIGNMENTS=0	UNSAT TT=3.082 ASSIGNMENTS=0	UNSAT TT=9.013 CHECKS=5027 NODES=0	UNSAT TT=8.963 CHECKS=6090 NODES=0	UNSAT TT=8.54 CHECKS=6090 NODES=0	UNSAT TT=0.271 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.295 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=361.391	UNSAT TT=354.656	UNSAT TT=0.283 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.275 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=2.53	UNSAT TT=0.278 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.286 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=14.934	UNSAT TT=7.274	UNSAT TT=9.674
csp/rlfapGraphs/ normalized-graph14.xml	SAT TT=0.563	SAT TT=5.07 CHECKS=280166 NODES=916	SAT TT=3.841 CHECKS=293518 NODES=0	SAT TT=0.852	SAT TT=6.898 CHECKS=103037	SAT TT=21.538 CHECKS=198701	SAT TT=7.304 ASSIGNMENTS=459	SAT TT=6.907 ASSIGNMENTS=459	SAT TT=8.493 CHECKS=204857 NODES=916	SAT TT=7.475 CHECKS=1125240 NODES=734	SAT TT=7.973 CHECKS=3209380 NODES=721	SAT TT=0.644 ASSIGNMENTS=458 CHECKS=27646	SAT TT=0.617 ASSIGNMENTS=458 CHECKS=27646	SAT TT=55.396	SAT TT=50.221	SAT TT=0.563 ASSIGNMENTS=458 CHECKS=27646	SAT TT=0.601 ASSIGNMENTS=458 CHECKS=29773	? (TO) TT=1800.03	SAT TT=1.191 ASSIGNMENTS=457 CHECKS=35749	SAT TT=0.657 ASSIGNMENTS=458 CHECKS=27280	SAT TT=19.277	SAT TT=11.096	SAT TT=14.108
csp/rlfapGraphs/ normalized-graph1.xml	SAT TT=0.136	SAT TT=1.588 CHECKS=62401 NODES=200	SAT TT=1.574 CHECKS=65702 NODES=0	SAT TT=0.218	SAT TT=0.607 CHECKS=20520	SAT TT=0.115 CHECKS=22738	SAT TT=2.659 ASSIGNMENTS=101	SAT TT=2.523 ASSIGNMENTS=101	SAT TT=2.987 CHECKS=42183 NODES=200	SAT TT=3.037 CHECKS=240144 NODES=159	SAT TT=3.06 CHECKS=389011 NODES=172	SAT TT=0.169 ASSIGNMENTS=100 CHECKS=9591	SAT TT=0.167 ASSIGNMENTS=100 CHECKS=9591	SAT TT=33.63	SAT TT=33.827	SAT TT=0.152 ASSIGNMENTS=100 CHECKS=9591	SAT TT=0.136 ASSIGNMENTS=96 CHECKS=8256	SAT TT=39.11	SAT TT=0.138 ASSIGNMENTS=99 CHECKS=10298	SAT TT=0.149 ASSIGNMENTS=100 CHECKS=9512	SAT TT=7.187	SAT TT=3.186	SAT TT=3.66
csp/rlfapGraphs/ normalized-graph2.xml	SAT TT=0.298	SAT TT=2.327 CHECKS=133861 NODES=400	SAT TT=2.332 CHECKS=140191 NODES=0	SAT TT=0.414	SAT TT=1.676 CHECKS=64619	SAT TT=1.299 CHECKS=111303	SAT TT=3.726 ASSIGNMENTS=201	SAT TT=3.771 ASSIGNMENTS=201	SAT TT=4.654 CHECKS=88161 NODES=401	SAT TT=4.321 CHECKS=506348 NODES=317	SAT TT=4.439 CHECKS=908426 NODES=289	SAT TT=0.317 ASSIGNMENTS=200 CHECKS=16863	SAT TT=0.303 ASSIGNMENTS=200 CHECKS=16863	SAT TT=42.592	SAT TT=44.046	SAT TT=0.326 ASSIGNMENTS=200 CHECKS=16863	SAT TT=0.308 ASSIGNMENTS=200 CHECKS=16138	? (TO) TT=1800.03	SAT TT=0.298 ASSIGNMENTS=199 CHECKS=18762	SAT TT=0.304 ASSIGNMENTS=200 CHECKS=17038	SAT TT=10.487	SAT TT=5.161	SAT TT=6.768
csp/rlfapGraphs/ normalized-graph4.xml	SAT TT=0.351	SAT TT=2.807 CHECKS=398868 NODES=565	SAT TT=2.478 CHECKS=706300 NODES=0	SAT TT=0.424	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=20.236 ASSIGNMENTS=180	SAT TT=17.841 ASSIGNMENTS=180	SAT TT=5.838 CHECKS=209481 NODES=478	? (TO) TT=1800	SAT TT=5.653 CHECKS=1986800 NODES=1402	SAT TT=0.395 ASSIGNMENTS=170 CHECKS=23928	SAT TT=0.378 ASSIGNMENTS=170 CHECKS=23928	SAT TT=129.377	SAT TT=116.961	SAT TT=0.351 ASSIGNMENTS=170 CHECKS=23928	SAT TT=0.553 ASSIGNMENTS=159 CHECKS=62098	? (TO) TT=1800.14	SAT TT=156.993 ASSIGNMENTS=19704 CHECKS=18022300	SAT TT=0.359 ASSIGNMENTS=181 CHECKS=22642	SAT TT=12.411	SAT TT=5.423	SAT TT=7.058
csp/rlfapGraphs/ normalized-graph6.xml	UNSAT TT=0.13	UNSAT TT=2.146 CHECKS=4115 NODES=0	UNSAT TT=2.148 CHECKS=4115 NODES=0	UNSAT TT=0.366	UNSAT TT=1.438 CHECKS=197452	UNSAT TT=0.265 CHECKS=223120	UNSAT TT=2.079 ASSIGNMENTS=0	UNSAT TT=2.462 ASSIGNMENTS=0	UNSAT TT=5.601 CHECKS=6036 NODES=0	UNSAT TT=5.028 CHECKS=9331 NODES=0	UNSAT TT=5.421 CHECKS=9331 NODES=0	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=151.306	UNSAT TT=176.41	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.134 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=1.764	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.135 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=9.66	UNSAT TT=5.191	UNSAT TT=6.528
csp/rlfapGraphs/ normalized-graph7.xml	UNSAT TT=0.124	UNSAT TT=2.114 CHECKS=3567 NODES=0	UNSAT TT=2.149 CHECKS=3567 NODES=0	UNSAT TT=0.39	UNSAT TT=1.388 CHECKS=131592	UNSAT TT=0.143 CHECKS=37561	UNSAT TT=2.396 ASSIGNMENTS=0	UNSAT TT=2.227 ASSIGNMENTS=0	UNSAT TT=6.159 CHECKS=4870 NODES=0	UNSAT TT=5.906 CHECKS=8544 NODES=0	UNSAT TT=5.75 CHECKS=8544 NODES=0	UNSAT TT=0.138 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.138 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=179.881	UNSAT TT=195.481	UNSAT TT=0.127 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.124 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=1.998	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=9.216	UNSAT TT=5.132	UNSAT TT=6.089
csp/rlfapGraphs/ normalized-graph8.xml	SAT TT=0.492	SAT TT=3.872 CHECKS=209983 NODES=680	SAT TT=3.165 CHECKS=369394 NODES=0	SAT TT=0.639	SAT TT=5.74 CHECKS=178952	SAT TT=14.526 CHECKS=455575	SAT TT=12.037 ASSIGNMENTS=340	SAT TT=6.094 ASSIGNMENTS=340	SAT TT=8.096 CHECKS=153423 NODES=681	SAT TT=6.702 CHECKS=1059770 NODES=877	SAT TT=7.503 CHECKS=2480420 NODES=714	SAT TT=0.541 ASSIGNMENTS=339 CHECKS=31071	SAT TT=0.575 ASSIGNMENTS=339 CHECKS=31071	SAT TT=89.176	SAT TT=96.058	SAT TT=0.508 ASSIGNMENTS=339 CHECKS=31071	SAT TT=0.492 ASSIGNMENTS=331 CHECKS=29033	? (TO) TT=1800.03	SAT TT=3.418 ASSIGNMENTS=2720 CHECKS=363800	SAT TT=0.509 ASSIGNMENTS=340 CHECKS=31900	SAT TT=16.368	SAT TT=9.518	SAT TT=10.772
csp/rlfapGraphs/ normalized-graph9.xml	SAT TT=0.644	SAT TT=4.705 CHECKS=283755 NODES=916	SAT TT=3.917 CHECKS=296646 NODES=0	SAT TT=0.96	SAT TT=61.296 CHECKS=746374	SAT TT=145.043 CHECKS=1383040	SAT TT=9.167 ASSIGNMENTS=458	SAT TT=8.541 ASSIGNMENTS=458	SAT TT=11.144 CHECKS=268141 NODES=1362	SAT TT=9.549 CHECKS=1605020 NODES=1185	SAT TT=9.92 CHECKS=4217320 NODES=926	SAT TT=0.79 ASSIGNMENTS=456 CHECKS=43681	SAT TT=0.72 ASSIGNMENTS=456 CHECKS=43681	SAT TT=82.869	SAT TT=76.261	SAT TT=0.644 ASSIGNMENTS=456 CHECKS=43681	SAT TT=0.686 ASSIGNMENTS=455 CHECKS=43623	? (TO) TT=1800.03	SAT TT=4.255 ASSIGNMENTS=3652 CHECKS=534973	SAT TT=0.727 ASSIGNMENTS=458 CHECKS=44150	SAT TT=21.03	SAT TT=15.525	SAT TT=15.608
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens11/ normalized-scen11-f10.xml	UNSAT TT=0.722	UNSAT TT=2.696 CHECKS=440330 NODES=253	UNSAT TT=2.724 CHECKS=65045 NODES=0	? (TO) TT=1800.07	UNSAT TT=2.184 CHECKS=699353	UNSAT TT=1.016 CHECKS=1301930	UNSAT TT=6.058 ASSIGNMENTS=1091	UNSAT TT=6.604 ASSIGNMENTS=1091	UNSAT TT=6.286 CHECKS=76733 NODES=221	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.796 ASSIGNMENTS=670 CHECKS=205926	UNSAT TT=0.816 ASSIGNMENTS=670 CHECKS=205926	UNSAT TT=27.202	UNSAT TT=25.308	UNSAT TT=0.759 ASSIGNMENTS=661 CHECKS=204618	UNSAT TT=7.548 ASSIGNMENTS=19771 CHECKS=2888340	? (TO) TT=1800.1	UNSAT TT=6.373 ASSIGNMENTS=7751 CHECKS=1985340	UNSAT TT=0.722 ASSIGNMENTS=495 CHECKS=165159	UNSAT TT=12.726	UNSAT TT=7.214	UNSAT TT=9.202
csp/rlfapScens11/ normalized-scen11-f12.xml	UNSAT TT=0.649	UNSAT TT=2.554 CHECKS=15780 NODES=0	UNSAT TT=2.484 CHECKS=15780 NODES=0	? (TO) TT=1800.11	UNSAT TT=1.744 CHECKS=324105	UNSAT TT=0.904 CHECKS=1067550	UNSAT TT=5.957 ASSIGNMENTS=845	UNSAT TT=6.446 ASSIGNMENTS=845	UNSAT TT=6.042 CHECKS=55192 NODES=144	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.702 ASSIGNMENTS=468 CHECKS=162266	UNSAT TT=0.671 ASSIGNMENTS=468 CHECKS=162266	UNSAT TT=24.03	UNSAT TT=24.23	UNSAT TT=0.699 ASSIGNMENTS=464 CHECKS=169037	UNSAT TT=6.494 ASSIGNMENTS=17387 CHECKS=2561700	UNSAT TT=1538.39	UNSAT TT=23.231 ASSIGNMENTS=24760 CHECKS=7633420	UNSAT TT=0.649 ASSIGNMENTS=470 CHECKS=162458	UNSAT TT=12.164	UNSAT TT=8.109	UNSAT TT=8.875
csp/rlfapScens11/ normalized-scen11-f1.xml	UNSAT TT=14.377	UNSAT TT=30.993 CHECKS=131930000 NODES=66963	UNSAT TT=30.52 CHECKS=138782000 NODES=70985	? (TO) TT=1800.07	UNSAT TT=631.624 CHECKS=64180300	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=14.377	UNSAT TT=17.761
csp/rlfapScens11/ normalized-scen11-f2.xml	UNSAT TT=12.614	UNSAT TT=12.614 CHECKS=47183500 NODES=25784	UNSAT TT=13.999 CHECKS=49401700 NODES=25606	? (TO) TT=1800.08	UNSAT TT=571.218 CHECKS=37298800	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=13.72	UNSAT TT=17.555
csp/rlfapScens11/ normalized-scen11-f3.xml	UNSAT TT=5.851	UNSAT TT=5.851 CHECKS=13528400 NODES=6753	UNSAT TT=6.292 CHECKS=14707200 NODES=7440	? (TO) TT=1800.05	UNSAT TT=164.453 CHECKS=19031900	UNSAT TT=448.332 CHECKS=25253900	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=1621.81 CHECKS=273269000 NODES=758734	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=438.425	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=533.09 ASSIGNMENTS=744794 CHECKS=201986000	? (TO) TT=1800.09	UNSAT TT=656.602 ASSIGNMENTS=812217 CHECKS=230211000	UNSAT TT=664.886 ASSIGNMENTS=819349 CHECKS=235452000	? (TO) TT=1800.17	UNSAT TT=10.161	UNSAT TT=13.951
csp/rlfapScens11/ normalized-scen11-f4.xml	UNSAT TT=3.566	UNSAT TT=4.21 CHECKS=5082700 NODES=2340	UNSAT TT=3.566 CHECKS=1974780 NODES=1093	? (TO) TT=1800.07	UNSAT TT=12.172 CHECKS=5250390	UNSAT TT=112.373 CHECKS=14684000	? (TO) TT=1800.08	? (TO) TT=1800.12	UNSAT TT=477.351 CHECKS=78497300 NODES=215384	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=182.534	UNSAT TT=238.347	UNSAT TT=1260.05 ASSIGNMENTS=1702530 CHECKS=507298000	UNSAT TT=165.312 ASSIGNMENTS=235699 CHECKS=62847800	? (TO) TT=1800.11	UNSAT TT=207.419 ASSIGNMENTS=253131 CHECKS=76492100	UNSAT TT=198.959 ASSIGNMENTS=251780 CHECKS=74216300	UNSAT TT=372.474	UNSAT TT=9.079	UNSAT TT=12.395
csp/rlfapScens11/ normalized-scen11-f5.xml	UNSAT TT=2.724	UNSAT TT=3.431 CHECKS=2132660 NODES=927	UNSAT TT=2.724 CHECKS=132780 NODES=0	? (TO) TT=1800.07	UNSAT TT=10.117 CHECKS=7068680	UNSAT TT=4.801 CHECKS=6659070	UNSAT TT=664.781 ASSIGNMENTS=923708	UNSAT TT=604.668 ASSIGNMENTS=923708	UNSAT TT=113.569 CHECKS=18503400 NODES=45894	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=713.381 ASSIGNMENTS=2208820 CHECKS=2613080000	UNSAT TT=661.042 ASSIGNMENTS=2208820 CHECKS=2613080000	UNSAT TT=41.806	UNSAT TT=73.23	UNSAT TT=390.947 ASSIGNMENTS=500970 CHECKS=160232000	UNSAT TT=55.746 ASSIGNMENTS=84226 CHECKS=18836900	? (TO) TT=1800.12	UNSAT TT=57.576 ASSIGNMENTS=65817 CHECKS=19491000	UNSAT TT=52.015 ASSIGNMENTS=60738 CHECKS=18224900	UNSAT TT=65.271	UNSAT TT=8.054	UNSAT TT=10.475
csp/rlfapScens11/ normalized-scen11-f6.xml	UNSAT TT=2.923	UNSAT TT=3.238 CHECKS=1194890 NODES=540	UNSAT TT=2.923 CHECKS=78540 NODES=0	? (TO) TT=1800.03	UNSAT TT=3.739 CHECKS=1830160	UNSAT TT=1.753 CHECKS=2779450	UNSAT TT=108.029 ASSIGNMENTS=110191	UNSAT TT=112.737 ASSIGNMENTS=110191	UNSAT TT=30.43 CHECKS=3979890 NODES=10690	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=112.12 ASSIGNMENTS=341772 CHECKS=423566000	UNSAT TT=112.167 ASSIGNMENTS=341772 CHECKS=423566000	UNSAT TT=29.694	UNSAT TT=26.788	UNSAT TT=108.591 ASSIGNMENTS=134685 CHECKS=40136400	UNSAT TT=20.84 ASSIGNMENTS=42235 CHECKS=6207020	? (TO) TT=1800.12	UNSAT TT=27.469 ASSIGNMENTS=34822 CHECKS=9403820	UNSAT TT=11.051 ASSIGNMENTS=12800 CHECKS=3850270	UNSAT TT=25.647	UNSAT TT=7.81	UNSAT TT=10.653
csp/rlfapScens11/ normalized-scen11-f7.xml	UNSAT TT=2.78	UNSAT TT=2.858 CHECKS=981683 NODES=456	UNSAT TT=2.78 CHECKS=60873 NODES=0	? (TO) TT=1800.08	UNSAT TT=2.902 CHECKS=1398620	UNSAT TT=1.513 CHECKS=2328230	UNSAT TT=40.677 ASSIGNMENTS=47519	UNSAT TT=43.896 ASSIGNMENTS=47519	UNSAT TT=19.027 CHECKS=2230100 NODES=5749	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=47.638 ASSIGNMENTS=124244 CHECKS=149291000	UNSAT TT=47.729 ASSIGNMENTS=124244 CHECKS=149291000	UNSAT TT=29.588	UNSAT TT=29.172	UNSAT TT=62.705 ASSIGNMENTS=77568 CHECKS=24159400	UNSAT TT=30.54 ASSIGNMENTS=52458 CHECKS=10581500	? (TO) TT=1800.07	UNSAT TT=26.926 ASSIGNMENTS=33275 CHECKS=9370010	UNSAT TT=6.543 ASSIGNMENTS=7489 CHECKS=2316300	UNSAT TT=19.429	UNSAT TT=7.611	UNSAT TT=10.509
csp/rlfapScens11/ normalized-scen11-f8.xml	UNSAT TT=1.421	UNSAT TT=2.92 CHECKS=569369 NODES=230	UNSAT TT=2.573 CHECKS=54753 NODES=0	? (TO) TT=1800.06	UNSAT TT=3.226 CHECKS=1659280	UNSAT TT=1.171 CHECKS=1603920	UNSAT TT=13.907 ASSIGNMENTS=6305	UNSAT TT=12.964 ASSIGNMENTS=6305	UNSAT TT=7.457 CHECKS=402055 NODES=671	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=15.076 ASSIGNMENTS=13827 CHECKS=17383000	UNSAT TT=14.567 ASSIGNMENTS=13827 CHECKS=17383000	UNSAT TT=38.406	UNSAT TT=48.459	UNSAT TT=9.743 ASSIGNMENTS=11373 CHECKS=3502050	UNSAT TT=13.938 ASSIGNMENTS=31462 CHECKS=4210700	? (TO) TT=1800.03	UNSAT TT=13.359 ASSIGNMENTS=15815 CHECKS=4021800	UNSAT TT=1.421 ASSIGNMENTS=1200 CHECKS=397406	UNSAT TT=13.544	UNSAT TT=7.764	UNSAT TT=9.662
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens11/ normalized-scen11-f9.xml	UNSAT TT=1.963	UNSAT TT=3.016 CHECKS=518692 NODES=266	UNSAT TT=2.631 CHECKS=51021 NODES=0	? (TO) TT=1800.1	UNSAT TT=2.203 CHECKS=864547	UNSAT TT=1.132 CHECKS=1555510	UNSAT TT=9.242 ASSIGNMENTS=3540	UNSAT TT=10.079 ASSIGNMENTS=3540	UNSAT TT=7.55 CHECKS=258832 NODES=407	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=12.846 ASSIGNMENTS=7920 CHECKS=9831370	UNSAT TT=13.461 ASSIGNMENTS=7920 CHECKS=9831370	UNSAT TT=27.741	UNSAT TT=28.904	UNSAT TT=7.452 ASSIGNMENTS=8666 CHECKS=2798290	UNSAT TT=10.231 ASSIGNMENTS=27126 CHECKS=3851640	? (TO) TT=1800.07	UNSAT TT=10.155 ASSIGNMENTS=12355 CHECKS=3184770	UNSAT TT=1.963 ASSIGNMENTS=1892 CHECKS=628991	UNSAT TT=13.95	UNSAT TT=6.973	UNSAT TT=9.644
csp/rlfapScensMod/ normalized-scen10-w1-f3.xml	UNSAT TT=0.229	UNSAT TT=1.578 CHECKS=35049 NODES=0	UNSAT TT=1.556 CHECKS=35049 NODES=0	UNSAT TT=0.276	UNSAT TT=3.764 CHECKS=642167	UNSAT TT=1.053 CHECKS=762694	UNSAT TT=1.947 ASSIGNMENTS=0	UNSAT TT=1.94 ASSIGNMENTS=0	UNSAT TT=2.754 CHECKS=63484 NODES=52	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.255 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=0.229 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=31.691	UNSAT TT=29.052	UNSAT TT=0.243 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=4.815 ASSIGNMENTS=17867 CHECKS=628729	? (TO) TT=1800.08	UNSAT TT=5.816 ASSIGNMENTS=11290 CHECKS=671534	UNSAT TT=0.236 ASSIGNMENTS=117 CHECKS=8548	UNSAT TT=6.761	UNSAT TT=3.584	UNSAT TT=4.635
csp/rlfapScensMod/ normalized-scen1-f9.xml	UNSAT TT=0.906	UNSAT TT=5.248 CHECKS=5581360 NODES=4466	UNSAT TT=5.448 CHECKS=5947820 NODES=4414	? (TO) TT=1800.05	UNSAT TT=9.058 CHECKS=4755950	UNSAT TT=108.054 CHECKS=7408920	UNSAT TT=7.491 ASSIGNMENTS=822	UNSAT TT=7.732 ASSIGNMENTS=822	UNSAT TT=9.961 CHECKS=73845 NODES=150	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.958 ASSIGNMENTS=475 CHECKS=206905	UNSAT TT=0.994 ASSIGNMENTS=475 CHECKS=206905	UNSAT TT=35.458	UNSAT TT=37.202	UNSAT TT=1.105 ASSIGNMENTS=728 CHECKS=290577	UNSAT TT=11.269 ASSIGNMENTS=32470 CHECKS=3819250	? (TO) TT=1800.1	UNSAT TT=11.786 ASSIGNMENTS=14133 CHECKS=3375760	UNSAT TT=0.906 ASSIGNMENTS=361 CHECKS=166635	UNSAT TT=16.527	UNSAT TT=9.886	UNSAT TT=12.46
csp/rlfapScensMod/ normalized-scen2-f24.xml	SAT TT=0.091	SAT TT=1.493 CHECKS=217815 NODES=408	SAT TT=1.617 CHECKS=391341 NODES=487	SAT TT=0.232	SAT TT=0.4 CHECKS=34824	SAT TT=1.45 CHECKS=549179	SAT TT=2.257 ASSIGNMENTS=132	SAT TT=2.422 ASSIGNMENTS=132	SAT TT=2.051 CHECKS=29251 NODES=322	SAT TT=2.043 CHECKS=400136 NODES=599	SAT TT=2.007 CHECKS=475172 NODES=284	SAT TT=0.102 ASSIGNMENTS=115 CHECKS=9590	SAT TT=0.104 ASSIGNMENTS=115 CHECKS=9590	SAT TT=8.21	SAT TT=7.945	SAT TT=0.091 ASSIGNMENTS=151 CHECKS=13024	SAT TT=0.36 ASSIGNMENTS=1451 CHECKS=131239	SAT TT=853.331	SAT TT=0.471 ASSIGNMENTS=730 CHECKS=167091	SAT TT=0.092 ASSIGNMENTS=124 CHECKS=10657	SAT TT=5.691	SAT TT=2.564	SAT TT=2.965
csp/rlfapScensMod/ normalized-scen2-f25.xml	UNSAT TT=0.518	UNSAT TT=4.314 CHECKS=13711300 NODES=10010	UNSAT TT=4.466 CHECKS=13887500 NODES=10048	? (TO) TT=1800.05	UNSAT TT=4.204 CHECKS=2472890	UNSAT TT=15.578 CHECKS=7390980	UNSAT TT=3.652 ASSIGNMENTS=1771	UNSAT TT=3.802 ASSIGNMENTS=1771	UNSAT TT=2.256 CHECKS=77534 NODES=404	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.67 ASSIGNMENTS=830 CHECKS=307138	UNSAT TT=0.663 ASSIGNMENTS=830 CHECKS=307138	UNSAT TT=7.734	UNSAT TT=7.444	UNSAT TT=0.667 ASSIGNMENTS=911 CHECKS=343901	UNSAT TT=2.44 ASSIGNMENTS=9894 CHECKS=1130520	UNSAT TT=969.642	UNSAT TT=1.446 ASSIGNMENTS=2668 CHECKS=625943	UNSAT TT=0.518 ASSIGNMENTS=569 CHECKS=227423	UNSAT TT=5.597	UNSAT TT=2.342	UNSAT TT=2.812
csp/rlfapScensMod/ normalized-scen3-f10.xml	SAT TT=0.359	SAT TT=2.393 CHECKS=281340 NODES=711	SAT TT=2.441 CHECKS=347563 NODES=541	SAT TT=0.46	SAT TT=4.54 CHECKS=2141050	SAT TT=7.27 CHECKS=2287680	SAT TT=3.859 ASSIGNMENTS=329	SAT TT=4.017 ASSIGNMENTS=329	SAT TT=4.073 CHECKS=75605 NODES=471	SAT TT=3.912 CHECKS=1253960 NODES=2018	SAT TT=3.768 CHECKS=1610590 NODES=638	SAT TT=0.375 ASSIGNMENTS=369 CHECKS=70090	SAT TT=0.388 ASSIGNMENTS=369 CHECKS=70090	SAT TT=19.201	SAT TT=18.616	SAT TT=0.392 ASSIGNMENTS=446 CHECKS=86223	SAT TT=5.661 ASSIGNMENTS=16394 CHECKS=2269480	? (TO) TT=1800.05	SAT TT=7.261 ASSIGNMENTS=7940 CHECKS=2449160	SAT TT=0.359 ASSIGNMENTS=362 CHECKS=74214	SAT TT=10.41	SAT TT=6.502	SAT TT=6.896
csp/rlfapScensMod/ normalized-scen3-f11.xml	UNSAT TT=0.584	UNSAT TT=3.624 CHECKS=3827460 NODES=4480	UNSAT TT=3.519 CHECKS=3931970 NODES=4441	? (TO) TT=1800.05	UNSAT TT=12.688 CHECKS=3019860	? (TO) TT=1800.04	UNSAT TT=5.305 ASSIGNMENTS=1292	UNSAT TT=4.913 ASSIGNMENTS=1292	UNSAT TT=4.344 CHECKS=55901 NODES=166	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.584 ASSIGNMENTS=467 CHECKS=167970	UNSAT TT=0.592 ASSIGNMENTS=467 CHECKS=167970	UNSAT TT=18.57	UNSAT TT=16.22	UNSAT TT=0.597 ASSIGNMENTS=561 CHECKS=196978	UNSAT TT=5.523 ASSIGNMENTS=13821 CHECKS=2191410	? (TO) TT=1800.06	UNSAT TT=4.515 ASSIGNMENTS=4627 CHECKS=1461440	UNSAT TT=0.646 ASSIGNMENTS=511 CHECKS=195117	UNSAT TT=10.815	UNSAT TT=5.77	UNSAT TT=7.001
csp/rlfapScensMod/ normalized-scen6-w1-f2.xml	UNSAT TT=0.164	UNSAT TT=1.277 CHECKS=134420 NODES=249	UNSAT TT=1.033 CHECKS=20080 NODES=0	? (TO) TT=1800.06	UNSAT TT=2.216 CHECKS=573508	UNSAT TT=0.721 CHECKS=463712	UNSAT TT=2.093 ASSIGNMENTS=2721	UNSAT TT=2.142 ASSIGNMENTS=2721	UNSAT TT=1.557 CHECKS=62166 NODES=259	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=1.304 ASSIGNMENTS=5245 CHECKS=205264	UNSAT TT=1.348 ASSIGNMENTS=5245 CHECKS=205264	UNSAT TT=10.05	UNSAT TT=8.767	UNSAT TT=1.214 ASSIGNMENTS=5120 CHECKS=198249	UNSAT TT=1.601 ASSIGNMENTS=11428 CHECKS=224727	? (TO) TT=1800.09	UNSAT TT=1.15 ASSIGNMENTS=3647 CHECKS=133019	UNSAT TT=0.164 ASSIGNMENTS=427 CHECKS=17176	UNSAT TT=3.863	UNSAT TT=1.83	UNSAT TT=2.249
csp/rlfapScensMod/ normalized-scen6-w1.xml	SAT TT=0.068	SAT TT=1.123 CHECKS=27542 NODES=202	SAT TT=1.306 CHECKS=54790 NODES=202	SAT TT=0.099	SAT TT=4.693 CHECKS=990773	SAT TT=2.042 CHECKS=778794	SAT TT=1.805 ASSIGNMENTS=97	SAT TT=1.734 ASSIGNMENTS=97	SAT TT=1.404 CHECKS=26716 NODES=206	SAT TT=7.12 CHECKS=37952500 NODES=150661	SAT TT=1.479 CHECKS=144206 NODES=256	SAT TT=0.084 ASSIGNMENTS=99 CHECKS=1998	SAT TT=0.085 ASSIGNMENTS=99 CHECKS=1998	SAT TT=11.032	SAT TT=9.726	SAT TT=0.07 ASSIGNMENTS=98 CHECKS=2004	SAT TT=0.072 ASSIGNMENTS=101 CHECKS=2402	? (TO) TT=1800.12	SAT TT=0.098 ASSIGNMENTS=166 CHECKS=3491	SAT TT=0.068 ASSIGNMENTS=98 CHECKS=2019	SAT TT=3.849	SAT TT=1.836	SAT TT=2.44
csp/rlfapScensMod/ normalized-scen7-w1-f4.xml	SAT TT=0.144	SAT TT=1.462 CHECKS=66006 NODES=407	SAT TT=1.8 CHECKS=436612 NODES=409	SAT TT=0.161	SAT TT=14.923 CHECKS=2457350	SAT TT=11 CHECKS=2665900	SAT TT=1.857 ASSIGNMENTS=186	SAT TT=2.02 ASSIGNMENTS=186	SAT TT=1.996 CHECKS=68515 NODES=508	SAT TT=605.951 CHECKS=2042370000 NODES=16652200	SAT TT=2.176 CHECKS=470614 NODES=999	SAT TT=0.152 ASSIGNMENTS=201 CHECKS=5799	SAT TT=0.159 ASSIGNMENTS=201 CHECKS=5799	SAT TT=19.503	SAT TT=17.753	SAT TT=0.144 ASSIGNMENTS=201 CHECKS=5799	SAT TT=0.249 ASSIGNMENTS=634 CHECKS=19158	? (TO) TT=1800.06	SAT TT=3.241 ASSIGNMENTS=12857 CHECKS=421598	SAT TT=0.153 ASSIGNMENTS=235 CHECKS=8522	SAT TT=5.403	SAT TT=3.002	SAT TT=3.42
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScensMod/ normalized-scen9-w1-f3.xml	UNSAT TT=0.239	UNSAT TT=1.499 CHECKS=35049 NODES=0	UNSAT TT=1.515 CHECKS=35049 NODES=0	UNSAT TT=0.278	UNSAT TT=3.754 CHECKS=637999	UNSAT TT=0.931 CHECKS=660858	UNSAT TT=2.098 ASSIGNMENTS=0	UNSAT TT=2.072 ASSIGNMENTS=0	UNSAT TT=2.725 CHECKS=63484 NODES=52	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=0.283 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=0.26 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=32.643	UNSAT TT=29.867	UNSAT TT=0.239 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=4.821 ASSIGNMENTS=17961 CHECKS=618193	? (TO) TT=1800.12	UNSAT TT=5.597 ASSIGNMENTS=11290 CHECKS=671534	UNSAT TT=0.239 ASSIGNMENTS=117 CHECKS=8548	UNSAT TT=7.339	UNSAT TT=3.722	UNSAT TT=4.757
csp/rlfapScens/ normalized-scen10.xml	UNSAT TT=0.325	UNSAT TT=2.965 CHECKS=28372 NODES=0	UNSAT TT=3.051 CHECKS=28372 NODES=0	UNSAT TT=0.704	UNSAT TT=3.032 CHECKS=895102	UNSAT TT=0.799 CHECKS=838645	UNSAT TT=3.044 ASSIGNMENTS=0	UNSAT TT=3.216 ASSIGNMENTS=0	UNSAT TT=8.779 CHECKS=20253 NODES=0	UNSAT TT=7.079 CHECKS=32670 NODES=0	UNSAT TT=7.853 CHECKS=32670 NODES=0	UNSAT TT=0.352 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.34 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=182.647	UNSAT TT=187.181	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.338 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=4.319	UNSAT TT=0.342 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=16.58	UNSAT TT=8.147	UNSAT TT=11.121
csp/rlfapScens/ normalized-scen11.xml	SAT TT=0.618	SAT TT=3.225 CHECKS=304730 NODES=724	SAT TT=3.215 CHECKS=245948 NODES=0	SAT TT=93.826	SAT TT=13.146 CHECKS=6564380	SAT TT=9.779 CHECKS=5004100	SAT TT=7.189 ASSIGNMENTS=582	SAT TT=6.836 ASSIGNMENTS=582	SAT TT=6.761 CHECKS=215011 NODES=847	SAT TT=5.601 CHECKS=1756210 NODES=1097	SAT TT=6.133 CHECKS=2907350 NODES=577	SAT TT=0.629 ASSIGNMENTS=525 CHECKS=65628	SAT TT=0.67 ASSIGNMENTS=525 CHECKS=65628	SAT TT=39.855	SAT TT=34.27	SAT TT=0.71 ASSIGNMENTS=528 CHECKS=71078	SAT TT=5.92 ASSIGNMENTS=9932 CHECKS=818679	? (TO) TT=1800.07	SAT TT=22.236 ASSIGNMENTS=16126 CHECKS=3251060	SAT TT=0.618 ASSIGNMENTS=524 CHECKS=65719	SAT TT=19.404	SAT TT=9.373	SAT TT=11.258
csp/rlfapScens/ normalized-scen1.xml	SAT TT=0.685	SAT TT=4.59 CHECKS=321671 NODES=917	SAT TT=3.737 CHECKS=334060 NODES=0	SAT TT=1.011	SAT TT=14.877 CHECKS=5516800	SAT TT=22.801 CHECKS=5400330	SAT TT=8.064 ASSIGNMENTS=459	SAT TT=8.285 ASSIGNMENTS=459	SAT TT=10.251 CHECKS=223669 NODES=916	SAT TT=9.178 CHECKS=1349020 NODES=715	SAT TT=9.198 CHECKS=3796710 NODES=622	SAT TT=0.807 ASSIGNMENTS=457 CHECKS=42321	SAT TT=0.82 ASSIGNMENTS=457 CHECKS=42321	SAT TT=54.716	SAT TT=49.031	SAT TT=0.719 ASSIGNMENTS=457 CHECKS=42321	SAT TT=0.685 ASSIGNMENTS=456 CHECKS=42809	SAT TT=151.76	SAT TT=0.86 ASSIGNMENTS=526 CHECKS=66352	SAT TT=0.739 ASSIGNMENTS=457 CHECKS=41807	SAT TT=22.661	SAT TT=12.009	SAT TT=16.086
csp/rlfapScens/ normalized-scen3.xml	SAT TT=0.328	SAT TT=2.553 CHECKS=158741 NODES=400	SAT TT=2.478 CHECKS=164098 NODES=0	SAT TT=0.493	SAT TT=5.554 CHECKS=2641720	SAT TT=1.715 CHECKS=141144	SAT TT=5.391 ASSIGNMENTS=201	SAT TT=5.411 ASSIGNMENTS=201	SAT TT=4.653 CHECKS=108830 NODES=400	SAT TT=4.068 CHECKS=708765 NODES=344	SAT TT=4.038 CHECKS=1205100 NODES=266	SAT TT=0.384 ASSIGNMENTS=200 CHECKS=20979	SAT TT=0.376 ASSIGNMENTS=200 CHECKS=20979	SAT TT=26.611	SAT TT=23.264	SAT TT=0.353 ASSIGNMENTS=200 CHECKS=20979	SAT TT=0.328 ASSIGNMENTS=200 CHECKS=23152	SAT TT=10.65	SAT TT=0.375 ASSIGNMENTS=199 CHECKS=25953	SAT TT=0.356 ASSIGNMENTS=200 CHECKS=20646	SAT TT=12.974	SAT TT=6.763	SAT TT=8.466
csp/rlfapScens/ normalized-scen4.xml	SAT TT=0.518	SAT TT=4.313 CHECKS=339251 NODES=1697	SAT TT=4.78 CHECKS=1050340 NODES=0	SAT TT=0.705	SAT TT=6.633 CHECKS=4889670	SAT TT=3.536 CHECKS=5519880	SAT TT=3.504 ASSIGNMENTS=236	SAT TT=3.337 ASSIGNMENTS=236	SAT TT=9.547 CHECKS=186478 NODES=803	? (TO) TT=1800.04	SAT TT=13.21 CHECKS=14677200 NODES=7509	SAT TT=0.521 ASSIGNMENTS=276 CHECKS=41543	SAT TT=0.558 ASSIGNMENTS=276 CHECKS=41543	SAT TT=204.748	SAT TT=190.034	SAT TT=0.518 ASSIGNMENTS=276 CHECKS=41543	SAT TT=0.574 ASSIGNMENTS=252 CHECKS=41824	? (TO) TT=1800.05	SAT TT=1.839 ASSIGNMENTS=13208 CHECKS=772461	SAT TT=0.558 ASSIGNMENTS=288 CHECKS=41739	SAT TT=15.695	SAT TT=8.995	SAT TT=10.817
csp/rlfapScens/ normalized-scen5.xml	SAT TT=0.293	SAT TT=2.855 CHECKS=143699 NODES=687	SAT TT=2.762 CHECKS=291420 NODES=0	SAT TT=0.464	SAT TT=3.336 CHECKS=2318510	SAT TT=2.103 CHECKS=2928560	SAT TT=3.252 ASSIGNMENTS=118	SAT TT=2.795 ASSIGNMENTS=118	SAT TT=6.309 CHECKS=82740 NODES=408	SAT TT=37.325 CHECKS=149608000 NODES=751036	SAT TT=6.586 CHECKS=7092170 NODES=2876	SAT TT=0.338 ASSIGNMENTS=123 CHECKS=22528	SAT TT=0.333 ASSIGNMENTS=123 CHECKS=22528	SAT TT=120.14	SAT TT=109.926	SAT TT=0.331 ASSIGNMENTS=123 CHECKS=22528	SAT TT=0.293 ASSIGNMENTS=248 CHECKS=26775	? (TO) TT=1800.05	SAT TT=1.257 ASSIGNMENTS=3641 CHECKS=416351	SAT TT=0.314 ASSIGNMENTS=136 CHECKS=24585	SAT TT=11.685	SAT TT=6.076	SAT TT=6.77
csp/rlfapScens/ normalized-scen6.xml	UNSAT TT=0.159	UNSAT TT=1.644 CHECKS=29270 NODES=0	UNSAT TT=1.609 CHECKS=29270 NODES=0	UNSAT TT=0.245	UNSAT TT=0.938 CHECKS=239807	UNSAT TT=0.223 CHECKS=245160	UNSAT TT=1.674 ASSIGNMENTS=0	UNSAT TT=1.922 ASSIGNMENTS=0	UNSAT TT=3.342 CHECKS=30700 NODES=0	UNSAT TT=3.03 CHECKS=36119 NODES=0	UNSAT TT=3.08 CHECKS=36119 NODES=0	UNSAT TT=0.183 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=49.908	UNSAT TT=48.228	UNSAT TT=0.172 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=3.392	UNSAT TT=0.171 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.171 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=7.211	UNSAT TT=3.987	UNSAT TT=4.456
csp/rlfapScens/ normalized-scen7.xml	UNSAT TT=0.266	UNSAT TT=2.633 CHECKS=15349 NODES=0	UNSAT TT=2.55 CHECKS=15349 NODES=0	UNSAT TT=0.494	UNSAT TT=1.967 CHECKS=555364	UNSAT TT=0.439 CHECKS=530226	UNSAT TT=2.55 ASSIGNMENTS=0	UNSAT TT=2.595 ASSIGNMENTS=0	UNSAT TT=6.044 CHECKS=4964 NODES=0	UNSAT TT=5.854 CHECKS=6142 NODES=0	UNSAT TT=5.528 CHECKS=6142 NODES=0	UNSAT TT=0.266 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.283 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=123.077	UNSAT TT=126.03	UNSAT TT=0.281 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=2.871	UNSAT TT=0.305 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.268 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=13.32	UNSAT TT=6.506	UNSAT TT=7.928
csp/rlfapScens/ normalized-scen8.xml	UNSAT TT=0.548	UNSAT TT=3.757 CHECKS=12529 NODES=0	UNSAT TT=3.87 CHECKS=12529 NODES=0	UNSAT TT=0.898	UNSAT TT=3.757 CHECKS=465144	UNSAT TT=1.01 CHECKS=837000	UNSAT TT=3.987 ASSIGNMENTS=0	UNSAT TT=3.749 ASSIGNMENTS=0	UNSAT TT=12.054 CHECKS=11399 NODES=0	UNSAT TT=11.229 CHECKS=16090 NODES=0	UNSAT TT=10.635 CHECKS=16090 NODES=0	UNSAT TT=0.557 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.614 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=292.112	UNSAT TT=271.184	UNSAT TT=0.548 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.588 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=4.28	UNSAT TT=0.6 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.598 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=20.31	UNSAT TT=11.467	UNSAT TT=14.774
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens/ normalized-scen9.xml	UNSAT TT=0.316	UNSAT TT=2.982 CHECKS=28372 NODES=0	UNSAT TT=2.938 CHECKS=28372 NODES=0	UNSAT TT=0.692	UNSAT TT=3.293 CHECKS=875923	UNSAT TT=0.795 CHECKS=854538	UNSAT TT=2.963 ASSIGNMENTS=0	UNSAT TT=3.217 ASSIGNMENTS=0	UNSAT TT=8.071 CHECKS=20253 NODES=0	UNSAT TT=7.793 CHECKS=32670 NODES=0	UNSAT TT=7.093 CHECKS=32670 NODES=0	UNSAT TT=0.343 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=183.173	UNSAT TT=176.257	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=4.613	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=16.673	UNSAT TT=9.058	UNSAT TT=11.096
csp/subs/ normalized-scen06-sub0.xml	UNSAT TT=0.064	UNSAT TT=1 CHECKS=63301 NODES=23	UNSAT TT=1.006 CHECKS=57173 NODES=0	UNSAT TT=0.064	UNSAT TT=0.205 CHECKS=114675	UNSAT TT=0.062 CHECKS=86617	UNSAT TT=1.023 ASSIGNMENTS=0	UNSAT TT=0.926 ASSIGNMENTS=0	UNSAT TT=1.259 CHECKS=27374 NODES=16	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.087 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=8.208	UNSAT TT=8.086	UNSAT TT=0.07 ASSIGNMENTS=21 CHECKS=10211	UNSAT TT=0.228 ASSIGNMENTS=257 CHECKS=58745	UNSAT TT=19.898	UNSAT TT=0.091 ASSIGNMENTS=30 CHECKS=9070	UNSAT TT=0.077 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=3.444	UNSAT TT=1.301	UNSAT TT=1.421
csp/subs/ normalized-scen06-sub1.xml	UNSAT TT=0.077	UNSAT TT=1.028 CHECKS=6951 NODES=0	UNSAT TT=0.965 CHECKS=6951 NODES=0	UNSAT TT=0.077	UNSAT TT=0.171 CHECKS=62414	UNSAT TT=0.056 CHECKS=67162	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.316 CHECKS=29015 NODES=18	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.1 ASSIGNMENTS=15 CHECKS=7678	UNSAT TT=0.089 ASSIGNMENTS=15 CHECKS=7678	UNSAT TT=8.822	UNSAT TT=8.495	UNSAT TT=0.081 ASSIGNMENTS=11 CHECKS=7456	UNSAT TT=0.111 ASSIGNMENTS=91 CHECKS=15516	UNSAT TT=2.616	UNSAT TT=0.083 ASSIGNMENTS=12 CHECKS=5297	UNSAT TT=0.09 ASSIGNMENTS=17 CHECKS=8443	UNSAT TT=3.582	UNSAT TT=1.649	UNSAT TT=1.915
csp/subs/ normalized-scen06-sub2.xml	UNSAT TT=0.077	UNSAT TT=1.055 CHECKS=5863 NODES=0	UNSAT TT=1.009 CHECKS=5863 NODES=0	UNSAT TT=0.087	UNSAT TT=0.187 CHECKS=72563	UNSAT TT=0.063 CHECKS=75191	UNSAT TT=1.193 ASSIGNMENTS=0	UNSAT TT=1.056 ASSIGNMENTS=0	UNSAT TT=1.491 CHECKS=26952 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.106 ASSIGNMENTS=15 CHECKS=7742	UNSAT TT=0.108 ASSIGNMENTS=15 CHECKS=7742	UNSAT TT=11.111	UNSAT TT=9.081	UNSAT TT=0.088 ASSIGNMENTS=11 CHECKS=7053	UNSAT TT=0.104 ASSIGNMENTS=67 CHECKS=14395	UNSAT TT=2.819	UNSAT TT=0.077 ASSIGNMENTS=12 CHECKS=5201	UNSAT TT=0.096 ASSIGNMENTS=13 CHECKS=7462	UNSAT TT=4.04	UNSAT TT=1.622	UNSAT TT=1.92
csp/subs/ normalized-scen06-sub3.xml	UNSAT TT=0.081	UNSAT TT=1.103 CHECKS=7245 NODES=0	UNSAT TT=1.052 CHECKS=7245 NODES=0	UNSAT TT=0.1	UNSAT TT=0.199 CHECKS=79645	UNSAT TT=0.073 CHECKS=96196	UNSAT TT=1.249 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=1.633 CHECKS=30514 NODES=17	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.113 ASSIGNMENTS=15 CHECKS=8548	UNSAT TT=0.111 ASSIGNMENTS=15 CHECKS=8548	UNSAT TT=12.75	UNSAT TT=11.147	UNSAT TT=0.096 ASSIGNMENTS=11 CHECKS=7767	UNSAT TT=0.106 ASSIGNMENTS=70 CHECKS=15601	UNSAT TT=3.349	UNSAT TT=0.081 ASSIGNMENTS=12 CHECKS=5731	UNSAT TT=0.095 ASSIGNMENTS=16 CHECKS=8526	UNSAT TT=4.051	UNSAT TT=1.919	UNSAT TT=2.153
csp/subs/ normalized-scen06-sub4.xml	UNSAT TT=0.064	UNSAT TT=1.102 CHECKS=13106 NODES=0	UNSAT TT=1.098 CHECKS=13106 NODES=0	UNSAT TT=0.106	UNSAT TT=0.241 CHECKS=98533	UNSAT TT=0.083 CHECKS=107620	UNSAT TT=1.101 ASSIGNMENTS=0	UNSAT TT=1.215 ASSIGNMENTS=0	UNSAT TT=1.798 CHECKS=28773 NODES=12	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.085 ASSIGNMENTS=14 CHECKS=7262	UNSAT TT=0.086 ASSIGNMENTS=14 CHECKS=7262	UNSAT TT=14.114	UNSAT TT=13.714	UNSAT TT=0.066 ASSIGNMENTS=8 CHECKS=5762	UNSAT TT=0.134 ASSIGNMENTS=149 CHECKS=29517	UNSAT TT=6.191	UNSAT TT=0.064 ASSIGNMENTS=9 CHECKS=4718	UNSAT TT=0.075 ASSIGNMENTS=14 CHECKS=7185	UNSAT TT=4.656	UNSAT TT=1.963	UNSAT TT=2.399
csp/subs/ normalized-scen07-sub1.xml	UNSAT TT=0.075	UNSAT TT=0.981 CHECKS=12174 NODES=0	UNSAT TT=0.973 CHECKS=12174 NODES=0	UNSAT TT=0.077	UNSAT TT=0.161 CHECKS=53487	UNSAT TT=0.059 CHECKS=74799	UNSAT TT=1.123 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=1.355 CHECKS=30726 NODES=19	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.107 ASSIGNMENTS=14 CHECKS=9567	UNSAT TT=0.11 ASSIGNMENTS=14 CHECKS=9567	UNSAT TT=9.561	UNSAT TT=7.687	UNSAT TT=0.086 ASSIGNMENTS=11 CHECKS=7658	UNSAT TT=0.11 ASSIGNMENTS=49 CHECKS=12431	UNSAT TT=4.026	UNSAT TT=0.075 ASSIGNMENTS=14 CHECKS=6421	UNSAT TT=0.089 ASSIGNMENTS=23 CHECKS=7330	UNSAT TT=3.753	UNSAT TT=1.466	UNSAT TT=1.757
csp/subs/ normalized-scen07-sub2.xml	UNSAT TT=0.091	UNSAT TT=1.132 CHECKS=14323 NODES=0	UNSAT TT=1.047 CHECKS=14323 NODES=0	UNSAT TT=0.095	UNSAT TT=0.196 CHECKS=83701	UNSAT TT=0.063 CHECKS=79951	UNSAT TT=1.004 ASSIGNMENTS=0	UNSAT TT=1.202 ASSIGNMENTS=0	UNSAT TT=1.437 CHECKS=33885 NODES=19	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.12 ASSIGNMENTS=16 CHECKS=10707	UNSAT TT=0.122 ASSIGNMENTS=16 CHECKS=10707	UNSAT TT=11.75	UNSAT TT=9.294	UNSAT TT=0.101 ASSIGNMENTS=11 CHECKS=8482	UNSAT TT=0.133 ASSIGNMENTS=88 CHECKS=20259	UNSAT TT=4.171	UNSAT TT=0.091 ASSIGNMENTS=14 CHECKS=7029	UNSAT TT=0.103 ASSIGNMENTS=23 CHECKS=8057	UNSAT TT=3.933	UNSAT TT=1.723	UNSAT TT=1.912
csp/subs/ normalized-scen07-sub3.xml	UNSAT TT=0.104	UNSAT TT=1.177 CHECKS=15905 NODES=0	UNSAT TT=1.148 CHECKS=15905 NODES=0	UNSAT TT=0.108	UNSAT TT=0.23 CHECKS=111740	UNSAT TT=0.076 CHECKS=108735	UNSAT TT=1.053 ASSIGNMENTS=0	UNSAT TT=1.058 ASSIGNMENTS=0	UNSAT TT=1.532 CHECKS=35995 NODES=19	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.125 ASSIGNMENTS=16 CHECKS=11751	UNSAT TT=0.138 ASSIGNMENTS=16 CHECKS=11751	UNSAT TT=12.182	UNSAT TT=11.021	UNSAT TT=0.107 ASSIGNMENTS=15 CHECKS=11011	UNSAT TT=0.151 ASSIGNMENTS=74 CHECKS=20943	UNSAT TT=4.838	UNSAT TT=0.104 ASSIGNMENTS=14 CHECKS=7707	UNSAT TT=0.119 ASSIGNMENTS=24 CHECKS=10936	UNSAT TT=4.304	UNSAT TT=1.828	UNSAT TT=1.964
csp/subs/ normalized-scen07-sub4.xml	UNSAT TT=0.098	UNSAT TT=1.186 CHECKS=12750 NODES=0	UNSAT TT=1.108 CHECKS=12750 NODES=0	UNSAT TT=0.121	UNSAT TT=0.275 CHECKS=126370	UNSAT TT=0.085 CHECKS=124172	UNSAT TT=1.182 ASSIGNMENTS=0	UNSAT TT=1.333 ASSIGNMENTS=0	UNSAT TT=1.771 CHECKS=43802 NODES=14	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.126 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=0.123 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=14.813	UNSAT TT=12.681	UNSAT TT=0.113 ASSIGNMENTS=13 CHECKS=8889	UNSAT TT=0.298 ASSIGNMENTS=132 CHECKS=48835	UNSAT TT=68.902	UNSAT TT=0.098 ASSIGNMENTS=14 CHECKS=6249	UNSAT TT=0.112 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=4.241	UNSAT TT=1.994	UNSAT TT=2.29
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-10.xml	SAT TT=0.283	SAT TT=20.607 CHECKS=267882000 NODES=55680	SAT TT=11.118 CHECKS=115247000 NODES=23924	? (TO) TT=1800.08	SAT TT=35.397 CHECKS=76139800	SAT TT=21.436 CHECKS=46763200	SAT TT=6.499 ASSIGNMENTS=128	SAT TT=7.368 ASSIGNMENTS=128	SAT TT=2.935 CHECKS=4511 NODES=100	SAT TT=137.73 CHECKS=1603380000 NODES=750357	SAT TT=1.811 CHECKS=1618170 NODES=353	SAT TT=7.685 ASSIGNMENTS=780 CHECKS=1497920	SAT TT=28.152 ASSIGNMENTS=55680 CHECKS=267882000	SAT TT=800.939	SAT TT=58.257	SAT TT=1.92 ASSIGNMENTS=4589 CHECKS=12450100	SAT TT=1.679 ASSIGNMENTS=8984 CHECKS=10087900	SAT TT=7.341	SAT TT=198.685 ASSIGNMENTS=535608 CHECKS=1031680000	SAT TT=0.283 ASSIGNMENTS=780 CHECKS=1497920	SAT TT=37.937	SAT TT=2.069	SAT TT=2.918
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-2.xml	UNSAT TT=821.609	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1781.51	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.19	UNSAT TT=821.609	UNSAT TT=1308.6
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-7.xml	SAT TT=0.754	SAT TT=5.315 CHECKS=34648800 NODES=8567	SAT TT=3.34 CHECKS=10192700 NODES=225	SAT TT=1341.4	SAT TT=35.335 CHECKS=82554700	SAT TT=21.409 CHECKS=46889500	SAT TT=10.185 ASSIGNMENTS=634	SAT TT=11.23 ASSIGNMENTS=634	SAT TT=2.845 CHECKS=4898 NODES=100	? (TO) TT=1800.08	SAT TT=2.069 CHECKS=2243350 NODES=586	SAT TT=0.864 ASSIGNMENTS=1957 CHECKS=5189110	SAT TT=0.859 ASSIGNMENTS=1957 CHECKS=5189110	SAT TT=779.519	SAT TT=59.409	SAT TT=2.174 ASSIGNMENTS=5363 CHECKS=13944700	SAT TT=1.782 ASSIGNMENTS=9395 CHECKS=11243500	SAT TT=1605.1	SAT TT=94.747 ASSIGNMENTS=345635 CHECKS=455119000	SAT TT=0.754 ASSIGNMENTS=1468 CHECKS=4374000	SAT TT=26.577	SAT TT=2.11	SAT TT=3.473
csp/super-jobShop/ super-jobShop-e0ddr1/ normalized-super-jobShop-e0ddr1-9.xml	UNSAT TT=429.282	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.14	UNSAT TT=429.282	UNSAT TT=534.219
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-10.xml	SAT TT=118.889	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.06	? (MO) TT=1359.49	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=1382.99 ASSIGNMENTS=1977630 CHECKS=146639000	? (TO) TT=1800.11	SAT TT=276.724	SAT TT=118.889
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-2.xml	SAT TT=0.791	SAT TT=2.803 CHECKS=1849980 NODES=304	SAT TT=18.999 CHECKS=262021000 NODES=35860	? (TO) TT=1800.04	SAT TT=41.359 CHECKS=88240800	SAT TT=57.734 CHECKS=125929000	SAT TT=29.018 ASSIGNMENTS=1092	SAT TT=27.632 ASSIGNMENTS=1092	SAT TT=3.575 CHECKS=6113 NODES=100	? (TO) TT=1800.09	SAT TT=1.932 CHECKS=2770680 NODES=714	SAT TT=14.486 ASSIGNMENTS=9303 CHECKS=41059400	SAT TT=10.617 ASSIGNMENTS=304 CHECKS=1849980	SAT TT=1227.95	SAT TT=100.72	SAT TT=0.791 ASSIGNMENTS=2293 CHECKS=4600180	SAT TT=6.753 ASSIGNMENTS=15423 CHECKS=40336100	? (TO) TT=1800.08	SAT TT=470.04 ASSIGNMENTS=1121360 CHECKS=2761810000	SAT TT=6.987 ASSIGNMENTS=9303 CHECKS=41059400	SAT TT=37.316	SAT TT=2.077	SAT TT=3.11
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-5.xml	SAT TT=2.354	SAT TT=4.554 CHECKS=26787000 NODES=3652	SAT TT=4.819 CHECKS=31933200 NODES=2400	? (TO) TT=1800.01	SAT TT=26.639 CHECKS=54532300	SAT TT=56.185 CHECKS=118378000	SAT TT=9.892 ASSIGNMENTS=431	SAT TT=10.3 ASSIGNMENTS=431	SAT TT=3.804 CHECKS=22934 NODES=1026	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=13.815 ASSIGNMENTS=9351 CHECKS=39101000	SAT TT=11.738 ASSIGNMENTS=3652 CHECKS=26787000	SAT TT=1643.95	SAT TT=139.964	SAT TT=3.124 ASSIGNMENTS=12819 CHECKS=19946400	SAT TT=12.132 ASSIGNMENTS=25253 CHECKS=76450400	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=6.362 ASSIGNMENTS=9351 CHECKS=39101000	SAT TT=31.161	SAT TT=2.354	SAT TT=3.262
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-7.xml	SAT TT=0.154	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=36.212 CHECKS=75656000	SAT TT=63.491 CHECKS=143710000	SAT TT=11.692 ASSIGNMENTS=360	SAT TT=12.12 ASSIGNMENTS=360	SAT TT=3.838 CHECKS=5247 NODES=100	? (TO) TT=1800	SAT TT=1.922 CHECKS=2210300 NODES=475	SAT TT=0.171 ASSIGNMENTS=338 CHECKS=555105	SAT TT=0.162 ASSIGNMENTS=338 CHECKS=555105	SAT TT=1181.43	SAT TT=81.385	SAT TT=0.154 ASSIGNMENTS=336 CHECKS=594901	SAT TT=77.511 ASSIGNMENTS=130765 CHECKS=480407000	SAT TT=1.787	? (TO) TT=1800.05	SAT TT=17.002 ASSIGNMENTS=26772 CHECKS=99000700	SAT TT=260.37	SAT TT=2.067	SAT TT=3.671
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-8.xml	SAT TT=0.299	? (TO) TT=1800.09	SAT TT=549.947 CHECKS=9017090000 NODES=1358740	SAT TT=1346.98	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=98.578 ASSIGNMENTS=11045	SAT TT=94.039 ASSIGNMENTS=11045	SAT TT=3.188 CHECKS=5984 NODES=100	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=1.284 ASSIGNMENTS=1617 CHECKS=7136690	SAT TT=1.243 ASSIGNMENTS=1617 CHECKS=7136690	SAT TT=1060.78	SAT TT=151.184	SAT TT=0.299 ASSIGNMENTS=480 CHECKS=1535840	SAT TT=3.347 ASSIGNMENTS=13148 CHECKS=22039900	? (TO) TT=1800.05	SAT TT=653.739 ASSIGNMENTS=1874620 CHECKS=3859180000	SAT TT=4.579 ASSIGNMENTS=6409 CHECKS=27420200	SAT TT=661.784	SAT TT=2.163	SAT TT=3.574
csp/super-jobShop/ super-jobShop-e0ddr2/ normalized-super-jobShop-e0ddr2-9.xml	SAT TT=1.421	SAT TT=91.081 CHECKS=1342170000 NODES=196377	SAT TT=480.539 CHECKS=7260330000 NODES=1052150	? (TO) TT=1800.07	SAT TT=45.16 CHECKS=98216700	SAT TT=56.256 CHECKS=124524000	SAT TT=13.062 ASSIGNMENTS=382	SAT TT=13.131 ASSIGNMENTS=382	SAT TT=3.414 CHECKS=5516 NODES=100	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=27.494 ASSIGNMENTS=29586 CHECKS=122163000	SAT TT=90.468 ASSIGNMENTS=196377 CHECKS=1342170000	SAT TT=1521.84	? (MO) TT=650.31	SAT TT=1.421 ASSIGNMENTS=3624 CHECKS=9496990	SAT TT=2.902 ASSIGNMENTS=10683 CHECKS=16773500	? (TO) TT=1800.04	SAT TT=360.124 ASSIGNMENTS=754000 CHECKS=2096980000	SAT TT=18.239 ASSIGNMENTS=29586 CHECKS=122163000	SAT TT=372.565	SAT TT=3.397	SAT TT=3.647
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-10.xml	SAT TT=0.111	SAT TT=2.822 CHECKS=910382 NODES=197	SAT TT=3.496 CHECKS=11582900 NODES=103	SAT TT=0.318	SAT TT=17.997 CHECKS=32241500	SAT TT=0.089 CHECKS=83796	SAT TT=7.478 ASSIGNMENTS=139	SAT TT=7.395 ASSIGNMENTS=139	SAT TT=3.123 CHECKS=5267 NODES=100	SAT TT=137.689 CHECKS=1661760000 NODES=750499	SAT TT=1.99 CHECKS=1534380 NODES=210	SAT TT=0.118 ASSIGNMENTS=256 CHECKS=306866	SAT TT=0.12 ASSIGNMENTS=256 CHECKS=306866	SAT TT=923.085	SAT TT=67.683	SAT TT=0.111 ASSIGNMENTS=300 CHECKS=346047	SAT TT=3.086 ASSIGNMENTS=10957 CHECKS=17539000	SAT TT=1.527	SAT TT=24.099 ASSIGNMENTS=110540 CHECKS=114278000	SAT TT=0.142 ASSIGNMENTS=296 CHECKS=495324	SAT TT=30.383	SAT TT=2.1	SAT TT=3.362
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-4.xml	SAT TT=2.133	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=34.882 ASSIGNMENTS=856	SAT TT=34.703 ASSIGNMENTS=856	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=9.802 ASSIGNMENTS=4421 CHECKS=14670400	SAT TT=730.678 ASSIGNMENTS=4421 CHECKS=14670400	SAT TT=835.492	? (TO) TT=1800.04	SAT TT=482.326 ASSIGNMENTS=1035290 CHECKS=2942440000	SAT TT=568.915 ASSIGNMENTS=1043130 CHECKS=3566480000	? (TO) TT=1800.05	SAT TT=59.114 ASSIGNMENTS=196925 CHECKS=301776000	SAT TT=2.774 ASSIGNMENTS=4421 CHECKS=14670400	SAT TT=61.18	SAT TT=2.133	SAT TT=3.474
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-5.xml	SAT TT=1.891	SAT TT=6.064 CHECKS=40821600 NODES=10717	SAT TT=14.01 CHECKS=140466000 NODES=35077	? (TO) TT=1800.01	SAT TT=39.104 CHECKS=78514100	? (TO) TT=1800.06	SAT TT=7.351 ASSIGNMENTS=174	SAT TT=7.549 ASSIGNMENTS=174	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=3.689 CHECKS=21038300 NODES=7283	SAT TT=9.858 ASSIGNMENTS=4633 CHECKS=13658700	SAT TT=12.436 ASSIGNMENTS=10717 CHECKS=40821600	SAT TT=899.188	SAT TT=66.807	SAT TT=1330.34 ASSIGNMENTS=2864800 CHECKS=3385590000	SAT TT=5.209 ASSIGNMENTS=14936 CHECKS=31439100	SAT TT=631.279	SAT TT=184.194 ASSIGNMENTS=495104 CHECKS=935472000	SAT TT=2.242 ASSIGNMENTS=4633 CHECKS=13658700	SAT TT=39.702	SAT TT=1.891	SAT TT=3.113
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-6.xml	SAT TT=0.065	SAT TT=2.519 CHECKS=887759 NODES=202	SAT TT=2.789 CHECKS=2754110 NODES=315	SAT TT=0.322	SAT TT=1.32 CHECKS=41882	SAT TT=21.014 CHECKS=43417900	SAT TT=7.615 ASSIGNMENTS=178	SAT TT=8.27 ASSIGNMENTS=178	SAT TT=3.34 CHECKS=5003 NODES=101	SAT TT=185.556 CHECKS=2096130000 NODES=924818	SAT TT=1.955 CHECKS=1784750 NODES=314	SAT TT=0.077 ASSIGNMENTS=148 CHECKS=66483	SAT TT=0.078 ASSIGNMENTS=148 CHECKS=66483	SAT TT=898.785	SAT TT=65.792	SAT TT=0.065 ASSIGNMENTS=148 CHECKS=66483	SAT TT=2.248 ASSIGNMENTS=10019 CHECKS=13333100	SAT TT=1.352	SAT TT=1.568 ASSIGNMENTS=6211 CHECKS=6957220	SAT TT=0.146 ASSIGNMENTS=390 CHECKS=576183	SAT TT=30.115	SAT TT=1.935	SAT TT=3.117
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-8.xml	SAT TT=0.127	SAT TT=8.322 CHECKS=82965200 NODES=16230	SAT TT=8.316 CHECKS=86126100 NODES=15809	? (TO) TT=1800.02	SAT TT=62.336 CHECKS=129164000	SAT TT=57.71 CHECKS=124315000	SAT TT=14.059 ASSIGNMENTS=487	SAT TT=15.511 ASSIGNMENTS=487	SAT TT=3.217 CHECKS=4574 NODES=101	? (TO) TT=1800.02	SAT TT=2.072 CHECKS=3132140 NODES=899	SAT TT=7.366 ASSIGNMENTS=291 CHECKS=463949	SAT TT=15.984 ASSIGNMENTS=16230 CHECKS=82965200	SAT TT=1226.49	SAT TT=60.491	SAT TT=68.5 ASSIGNMENTS=95770 CHECKS=393467000	SAT TT=63.019 ASSIGNMENTS=95561 CHECKS=386597000	SAT TT=18.23	SAT TT=79.587 ASSIGNMENTS=221182 CHECKS=408948000	SAT TT=0.127 ASSIGNMENTS=291 CHECKS=463949	SAT TT=42.152	SAT TT=1.967	SAT TT=3.478
csp/super-jobShop/ super-jobShop-enddr1/ normalized-super-jobShop-enddr1-9.xml	SAT TT=0.292	SAT TT=1488.17 CHECKS=18821100000 NODES=4223580	? (TO) TT=1800.16	? (TO) TT=1800.01	SAT TT=82.934 CHECKS=172427000	SAT TT=56.894 CHECKS=118639000	SAT TT=9.586 ASSIGNMENTS=188	SAT TT=10.016 ASSIGNMENTS=188	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=4.301 CHECKS=28039300 NODES=9465	SAT TT=0.881 ASSIGNMENTS=2930 CHECKS=5915380	SAT TT=0.877 ASSIGNMENTS=2930 CHECKS=5915380	SAT TT=984.361	SAT TT=65.314	SAT TT=0.292 ASSIGNMENTS=981 CHECKS=1608220	SAT TT=3.056 ASSIGNMENTS=11658 CHECKS=18327700	? (TO) TT=1800.1	SAT TT=313.424 ASSIGNMENTS=1132540 CHECKS=1801510000	SAT TT=0.375 ASSIGNMENTS=940 CHECKS=1941620	SAT TT=45.91	SAT TT=2.323	SAT TT=3.042
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-10.xml	SAT TT=2.017	SAT TT=3.187 CHECKS=6095400 NODES=599	SAT TT=5.649 CHECKS=43297300 NODES=3616	? (TO) TT=1800.09	SAT TT=37.971 CHECKS=72109900	SAT TT=54.543 CHECKS=113098000	SAT TT=944.837 ASSIGNMENTS=43046	SAT TT=1024.26 ASSIGNMENTS=43046	SAT TT=3.92 CHECKS=14539 NODES=346	? (TO) TT=1800.04	SAT TT=3.095 CHECKS=12711500 NODES=4033	SAT TT=9.244 ASSIGNMENTS=2783 CHECKS=11508400	SAT TT=10.967 ASSIGNMENTS=599 CHECKS=6095400	SAT TT=1496.94	SAT TT=92.121	SAT TT=19.571 ASSIGNMENTS=84582 CHECKS=141005000	SAT TT=35.438 ASSIGNMENTS=63847 CHECKS=212276000	SAT TT=1113.54	SAT TT=1039.73 ASSIGNMENTS=2534490 CHECKS=1834270000	SAT TT=2.017 ASSIGNMENTS=2783 CHECKS=11508400	SAT TT=38.188	SAT TT=2.263	SAT TT=3.44
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-1.xml	SAT TT=0.271	SAT TT=3.341 CHECKS=4328660 NODES=737	SAT TT=4.429 CHECKS=19268600 NODES=1196	SAT TT=1345.7	SAT TT=46.391 CHECKS=87282700	SAT TT=62.402 CHECKS=123084000	SAT TT=18.293 ASSIGNMENTS=438	SAT TT=17.652 ASSIGNMENTS=438	SAT TT=3.601 CHECKS=6365 NODES=100	? (TO) TT=1800.06	SAT TT=1.964 CHECKS=2556440 NODES=555	SAT TT=0.483 ASSIGNMENTS=1138 CHECKS=2635540	SAT TT=0.484 ASSIGNMENTS=1138 CHECKS=2635540	SAT TT=1418.81	SAT TT=120.894	SAT TT=0.631 ASSIGNMENTS=1562 CHECKS=3938520	SAT TT=3.328 ASSIGNMENTS=12417 CHECKS=20822100	? (TO) TT=1800.07	SAT TT=1397.85 ASSIGNMENTS=3974010 CHECKS=44724200	SAT TT=0.271 ASSIGNMENTS=415 CHECKS=1322700	SAT TT=92.734	SAT TT=2.69	SAT TT=3.287
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-2.xml	SAT TT=0.33	SAT TT=2.939 CHECKS=396959 NODES=105	SAT TT=4.381 CHECKS=16088400 NODES=434	SAT TT=0.33	SAT TT=1.34 CHECKS=61996	SAT TT=0.089 CHECKS=82687	SAT TT=8.443 ASSIGNMENTS=242	SAT TT=9.346 ASSIGNMENTS=242	SAT TT=3.884 CHECKS=7323 NODES=100	SAT TT=394.411 CHECKS=4792120000 NODES=1951780	SAT TT=2.184 CHECKS=1715620 NODES=224	SAT TT=0.602 ASSIGNMENTS=1987 CHECKS=3386670	SAT TT=0.648 ASSIGNMENTS=1987 CHECKS=3386670	? (TO) TT=1800.01	SAT TT=92.525	SAT TT=1.769 ASSIGNMENTS=5117 CHECKS=10193700	SAT TT=5.498 ASSIGNMENTS=14426 CHECKS=32314700	? (TO) TT=1800.12	SAT TT=65.248 ASSIGNMENTS=214642 CHECKS=333796000	SAT TT=0.871 ASSIGNMENTS=1886 CHECKS=4538330	SAT TT=38.596	SAT TT=2.383	SAT TT=3.98
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-3.xml	SAT TT=0.088	SAT TT=7.142 CHECKS=59006100 NODES=10818	SAT TT=7.579 CHECKS=65317200 NODES=7322	SAT TT=1340.49	SAT TT=8.741 CHECKS=15379700	SAT TT=0.082 CHECKS=76020	SAT TT=8.951 ASSIGNMENTS=293	SAT TT=9.359 ASSIGNMENTS=293	SAT TT=3.737 CHECKS=9238 NODES=183	? (TO) TT=1800.09	SAT TT=2.954 CHECKS=12739900 NODES=4116	SAT TT=0.384 ASSIGNMENTS=1261 CHECKS=1837400	SAT TT=0.364 ASSIGNMENTS=1261 CHECKS=1837400	SAT TT=1482.24	SAT TT=97.312	SAT TT=0.088 ASSIGNMENTS=362 CHECKS=184579	SAT TT=159.848 ASSIGNMENTS=217980 CHECKS=918491000	SAT TT=14.967	SAT TT=1069.88 ASSIGNMENTS=2953810 CHECKS=2287950000	SAT TT=3.01 ASSIGNMENTS=5044 CHECKS=17970900	SAT TT=58.307	SAT TT=2.006	SAT TT=3.745
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-4.xml	SAT TT=1.667	SAT TT=4.07 CHECKS=19240200 NODES=2418	SAT TT=4.293 CHECKS=19639000 NODES=1087	? (TO) TT=1800.08	SAT TT=46.102 CHECKS=92298600	SAT TT=42.121 CHECKS=87213200	SAT TT=37.215 ASSIGNMENTS=1381	SAT TT=34.768 ASSIGNMENTS=1381	SAT TT=3.636 CHECKS=7215 NODES=100	? (TO) TT=1800.05	SAT TT=2.234 CHECKS=2800960 NODES=537	SAT TT=10.331 ASSIGNMENTS=3516 CHECKS=13502900	SAT TT=11.352 ASSIGNMENTS=2418 CHECKS=19240200	? (TO) TT=1800.1	SAT TT=97.141	SAT TT=22.247 ASSIGNMENTS=29447 CHECKS=141493000	SAT TT=5.161 ASSIGNMENTS=13857 CHECKS=29875200	? (TO) TT=1800.04	SAT TT=237.003 ASSIGNMENTS=951947 CHECKS=1405280000	SAT TT=2.483 ASSIGNMENTS=3516 CHECKS=13502900	SAT TT=40.217	SAT TT=1.667	SAT TT=3.58
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-5.xml	SAT TT=0.3	SAT TT=3.14 CHECKS=370869 NODES=103	SAT TT=3.828 CHECKS=9324400 NODES=0	SAT TT=896.959	SAT TT=7.089 CHECKS=11867900	SAT TT=3.73 CHECKS=7904290	SAT TT=70.564 ASSIGNMENTS=3976	SAT TT=71.399 ASSIGNMENTS=3976	SAT TT=3.616 CHECKS=6231 NODES=103	SAT TT=1579.01 CHECKS=19306300000 NODES=8402710	SAT TT=2.135 CHECKS=2688730 NODES=523	SAT TT=0.485 ASSIGNMENTS=961 CHECKS=2407680	SAT TT=0.449 ASSIGNMENTS=961 CHECKS=2407680	SAT TT=1755.67	SAT TT=91.701	SAT TT=0.432 ASSIGNMENTS=1037 CHECKS=2190760	SAT TT=8.613 ASSIGNMENTS=19782 CHECKS=54388800	SAT TT=31.392	SAT TT=173.836 ASSIGNMENTS=465622 CHECKS=1005140000	SAT TT=0.3 ASSIGNMENTS=471 CHECKS=1519310	SAT TT=35.842	SAT TT=2.118	SAT TT=3.741
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-6.xml	SAT TT=0.121	SAT TT=2.956 CHECKS=759911 NODES=145	SAT TT=3.571 CHECKS=5033280 NODES=200	SAT TT=0.314	SAT TT=1.351 CHECKS=61024	SAT TT=0.074 CHECKS=48747	SAT TT=14.735 ASSIGNMENTS=670	SAT TT=15.213 ASSIGNMENTS=670	SAT TT=4.016 CHECKS=7423 NODES=100	SAT TT=151.395 CHECKS=1792930000 NODES=759441	SAT TT=2.083 CHECKS=3082520 NODES=573	SAT TT=0.13 ASSIGNMENTS=302 CHECKS=343161	SAT TT=0.122 ASSIGNMENTS=302 CHECKS=343161	? (TO) TT=1800.08	SAT TT=95.829	SAT TT=0.157 ASSIGNMENTS=640 CHECKS=628093	SAT TT=3.723 ASSIGNMENTS=13764 CHECKS=22309100	? (TO) TT=1800.08	SAT TT=121.642 ASSIGNMENTS=480888 CHECKS=706470000	SAT TT=0.121 ASSIGNMENTS=282 CHECKS=416881	SAT TT=36.746	SAT TT=2.368	SAT TT=3.83
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-7.xml	SAT TT=0.116	SAT TT=3.308 CHECKS=4196300 NODES=726	SAT TT=4.337 CHECKS=20565800 NODES=103	SAT TT=0.325	SAT TT=7.466 CHECKS=12602600	SAT TT=0.094 CHECKS=95661	SAT TT=7.828 ASSIGNMENTS=201	SAT TT=8.874 ASSIGNMENTS=201	SAT TT=3.694 CHECKS=7016 NODES=100	SAT TT=30.918 CHECKS=327581000 NODES=151603	SAT TT=2.216 CHECKS=2312970 NODES=417	SAT TT=0.118 ASSIGNMENTS=252 CHECKS=244842	SAT TT=0.116 ASSIGNMENTS=252 CHECKS=244842	? (TO) TT=1800.06	SAT TT=94.28	SAT TT=0.135 ASSIGNMENTS=365 CHECKS=465990	SAT TT=6.045 ASSIGNMENTS=16901 CHECKS=35759200	SAT TT=4.322	SAT TT=766.769 ASSIGNMENTS=2397480 CHECKS=60581300	SAT TT=0.133 ASSIGNMENTS=289 CHECKS=444517	SAT TT=37.475	SAT TT=1.835	SAT TT=3.701
csp/super-jobShop/ super-jobShop-ewddr2/ normalized-super-jobShop-ewddr2-8.xml	SAT TT=0.509	SAT TT=3.167 CHECKS=2167680 NODES=305	SAT TT=4.546 CHECKS=21636600 NODES=309	SAT TT=893.665	SAT TT=35.805 CHECKS=73483200	SAT TT=55.138 CHECKS=114210000	SAT TT=10.393 ASSIGNMENTS=320	SAT TT=9.6 ASSIGNMENTS=320	SAT TT=3.895 CHECKS=6936 NODES=102	? (TO) TT=1800.06	SAT TT=2.131 CHECKS=1646600 NODES=191	SAT TT=0.705 ASSIGNMENTS=1982 CHECKS=4737730	SAT TT=0.708 ASSIGNMENTS=1982 CHECKS=4737730	SAT TT=1771.94	SAT TT=112.525	SAT TT=4.123 ASSIGNMENTS=9382 CHECKS=26460200	SAT TT=3.666 ASSIGNMENTS=12926 CHECKS=21466400	? (TO) TT=1800.08	SAT TT=1296.6 ASSIGNMENTS=2897030 CHECKS=3558980000	SAT TT=0.509 ASSIGNMENTS=1134 CHECKS=2865150	SAT TT=37.648	SAT TT=2.262	SAT TT=3.41
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-12.xml	SAT TT=91.57	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=66.667	? (problem) TT=71.14	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? TT=227.107	SAT TT=1114.45	SAT TT=91.57
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-14.xml	SAT TT=106.091	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.02	? (problem) TT=73.776	? (problem) TT=78.028	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (exit code) TT=223.419	SAT TT=995.789	SAT TT=106.091
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-15.xml	SAT TT=57.283	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (problem) TT=62.249	? (problem) TT=68.289	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=226.883	SAT TT=963.645	SAT TT=57.283
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-1.xml	SAT TT=276.089	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (problem) TT=81.452	? (problem) TT=87.855	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=237.392	SAT TT=285.18	SAT TT=276.089
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-20.xml	SAT TT=150.792	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.07	? (problem) TT=66.448	? (problem) TT=68.346	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=235.177	SAT TT=1554.07	SAT TT=150.792
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-22.xml	UNSAT TT=57.912	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=171.35 ASSIGNMENTS=81	UNSAT TT=179.334 ASSIGNMENTS=81	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=87.531 ASSIGNMENTS=78	UNSAT TT=83.038 ASSIGNMENTS=49	? (problem) TT=67.058	? (problem) TT=71.849	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.07	? TT=239.598	UNSAT TT=57.912	UNSAT TT=105.243
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-23.xml	UNSAT TT=31.577	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.02	UNSAT TT=164.978 ASSIGNMENTS=47	UNSAT TT=168.654 ASSIGNMENTS=32	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=80.009 ASSIGNMENTS=69	UNSAT TT=80.058 ASSIGNMENTS=69	? (problem) TT=57.887	? (problem) TT=53.95	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.05	? TT=242.386	UNSAT TT=31.577	UNSAT TT=49.877
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-30.xml	UNSAT TT=29.195	? (TO) TT=1800.17	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1765.69 ASSIGNMENTS=12195	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=556.537 ASSIGNMENTS=3472	UNSAT TT=556.922 ASSIGNMENTS=3472	? (problem) TT=67.408	? (problem) TT=68.724	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=242.841	UNSAT TT=29.195	UNSAT TT=48.711
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-7.xml		? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	? (problem) TT=78.302	? (problem) TT=86.328	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=435.7	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/super-js/super-js-taillard-15/ normalized-super-js-taillard-15-8.xml	UNSAT TT=1118.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.03	? (problem) TT=74.086	? (problem) TT=73.258	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=228.999	UNSAT TT=1118.07	? (TO) TT=1800.07
csp/super-js/super-js-taillard-20-15/ normalized-super-js-taillard-20-15-24.xml	UNSAT TT=5.972	? (TO) TT=1800.09	? (TO) TT=1800.18	UNSAT TT=47.075	? (TO) TT=1800.14	? (TO) TT=1800.02	UNSAT TT=6.037 ASSIGNMENTS=0	UNSAT TT=5.972 ASSIGNMENTS=0	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=12.636 ASSIGNMENTS=0	UNSAT TT=102.756 ASSIGNMENTS=0	? (problem) TT=80.994	? (problem) TT=76.363	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=216.772	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/super-js/super-js-taillard-20-15/ normalized-super-js-taillard-20-15-3.xml		? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800	? (problem) TT=77.734	? (problem) TT=67.808	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=212.925	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/super-js/super-js-taillard-20-15/ normalized-super-js-taillard-20-15-4.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.05	? (problem) TT=79.466	? (problem) TT=74.062	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=207.638	? (TO) TT=1800.16	? (TO) TT=1800.03
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-12.xml		? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (problem) TT=70.502	? (problem) TT=68.338	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=211.458	? (TO) TT=1800.11	? (TO) TT=1800.04
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-20.xml		? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=76.613	? (problem) TT=72.206	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=215.126	? (TO) TT=1800.17	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-21.xml	UNSAT TT=762.199	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (problem) TT=70.431	? (problem) TT=72.097	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=216.429	UNSAT TT=762.199	UNSAT TT=1038.4
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-22.xml		? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (problem) TT=66.753	? (problem) TT=70.337	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=243.926	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-23.xml	UNSAT TT=1413.42	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (problem) TT=71.079	? (problem) TT=70.411	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=219.748	UNSAT TT=1413.42	? (TO) TT=1800.03
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-25.xml	UNSAT TT=956.216	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.37	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (problem) TT=71.932	? (problem) TT=76.71	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.05	? (exit code) TT=211.438	UNSAT TT=956.216	UNSAT TT=1447.59
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-27.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.07	? (problem) TT=77.641	? (problem) TT=75.802	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=220.5	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-29.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=60.666	? (problem) TT=58.695	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=224.362	? (TO) TT=1800.06	? (TO) TT=1800
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-30.xml		? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (problem) TT=62.096	? (problem) TT=67.737	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? TT=219.588	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-3.xml		? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (problem) TT=77.554	? (problem) TT=75.179	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=259.624	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-7.xml		? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (problem) TT=82.941	? (problem) TT=81.243	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=232.751	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/super-js/super-js-taillard-20/ normalized-super-js-taillard-20-9.xml		? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=75.024	? (problem) TT=75.224	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=234.015	? (TO) TT=1800.11	? (TO) TT=1800.02
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-11.xml	SAT TT=15.541	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=33.926 CHECKS=350186000 NODES=11847	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=62.499	? (problem) TT=62.842	? (TO) TT=1800.08	SAT TT=26.048 ASSIGNMENTS=38744 CHECKS=79494000	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=206.107	SAT TT=22.126	SAT TT=38.842
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-14.xml	SAT TT=1.48	? (TO) TT=1800.18	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=13.636 CHECKS=90996300 NODES=3520	SAT TT=8.643 ASSIGNMENTS=1191 CHECKS=3194460	SAT TT=9.269 ASSIGNMENTS=1191 CHECKS=3194460	? (problem) TT=59.264	? (problem) TT=54.778	SAT TT=974.642 ASSIGNMENTS=912647 CHECKS=2143750000	SAT TT=424 ASSIGNMENTS=364739 CHECKS=1126220000	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=1.48 ASSIGNMENTS=1191 CHECKS=3194460	? TT=226.711	SAT TT=11.509	SAT TT=32.419
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-18.xml	SAT TT=8.367	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=32.295 ASSIGNMENTS=785	SAT TT=32.386 ASSIGNMENTS=785	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=15.265 CHECKS=128648000 NODES=4614	SAT TT=16.03 ASSIGNMENTS=7774 CHECKS=22675100	SAT TT=16.686 ASSIGNMENTS=7774 CHECKS=22675100	? (problem) TT=53.383	? (problem) TT=54.5	SAT TT=997.934 ASSIGNMENTS=957848 CHECKS=2930590000	SAT TT=71.765 ASSIGNMENTS=88294 CHECKS=232198000	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=8.367 ASSIGNMENTS=7774 CHECKS=22675100	? TT=251.51	SAT TT=12.214	SAT TT=38.731
csp/super-os/super-os-taillard-10/ normalized-super-os-taillard-10-24.xml	UNSAT TT=1.667	? (TO) TT=1800.1	? (TO) TT=1800.13	UNSAT TT=1.667	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=2.649 ASSIGNMENTS=0	UNSAT TT=2.299 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=10.018 ASSIGNMENTS=0	UNSAT TT=461.757 ASSIGNMENTS=407846 CHECKS=1196220000	? (problem) TT=52.083	? (problem) TT=52.716	? (TO) TT=1800.08	UNSAT TT=106.065 ASSIGNMENTS=122041 CHECKS=247794000	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=462.843 ASSIGNMENTS=407846 CHECKS=1196220000	? TT=319.152	UNSAT TT=54.999	UNSAT TT=130.946
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-13.xml	SAT TT=69.457	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=97.003 CHECKS=4078650 NODES=459	? (TO) TT=1800.04	SAT TT=69.457 CHECKS=434335000 NODES=5112	? (TO) TT=1800.07	? (TO) TT=1800.03	? (problem) TT=63.653	? (problem) TT=68.148	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=199.337	SAT TT=125.212	SAT TT=193.416
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-15.xml	SAT TT=58.161	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.43	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=58.161 CHECKS=327891000 NODES=3415	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=61.235	? (problem) TT=61.069	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=210.91	SAT TT=106.735	SAT TT=219.45
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-1.xml	SAT TT=209.49	? (TO) TT=1800.14	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.09	? (problem) TT=73.247	? (problem) TT=78.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.07	? TT=219.585	SAT TT=320.731	SAT TT=209.49
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-27.xml	UNSAT TT=5.647	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=5.689 ASSIGNMENTS=0	UNSAT TT=5.647 ASSIGNMENTS=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=12.243 ASSIGNMENTS=0	UNSAT TT=210.911 ASSIGNMENTS=0	? (problem) TT=67.661	? (problem) TT=69.151	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=211.236	? (TO) TT=1800.29	? (TO) TT=1800.02
csp/super-os/super-os-taillard-15/ normalized-super-os-taillard-15-4.xml	SAT TT=119.549	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? (problem) TT=58.402	? (problem) TT=61.585	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=204.858	SAT TT=119.549	SAT TT=211.97
csp/super-os/super-os-taillard-20/ normalized-super-os-taillard-20-27.xml	UNSAT TT=11.133	? (TO) TT=1800.18	? (TO) TT=1800.14	UNSAT TT=187.587	? (TO) TT=1800.15	? (TO) TT=1800.11	UNSAT TT=11.581 ASSIGNMENTS=0	UNSAT TT=11.133 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=19.935 ASSIGNMENTS=0	UNSAT TT=36.178 ASSIGNMENTS=0	? (problem) TT=71.285	? (problem) TT=71.519	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=210.638	? (MO) TT=368.937	? (MO) TT=313.651
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-os/super-os-taillard-20/ normalized-super-os-taillard-20-29.xml	UNSAT TT=10.806	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	UNSAT TT=10.806 ASSIGNMENTS=0	UNSAT TT=10.914 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=17.778 ASSIGNMENTS=0	UNSAT TT=37.043 ASSIGNMENTS=0	? (problem) TT=72.002	? (problem) TT=68.94	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=212.777	? (MO) TT=116.549	? (MO) TT=308.866
csp/super-os/super-os-taillard-4/ normalized-super-os-taillard-4-19.xml	SAT TT=0.016	SAT TT=1.565 CHECKS=156605 NODES=33	SAT TT=2.021 CHECKS=3704380 NODES=201	SAT TT=0.057	SAT TT=1.496 CHECKS=2753300	SAT TT=1.139 CHECKS=2715650	SAT TT=1.352 ASSIGNMENTS=154	SAT TT=1.482 ASSIGNMENTS=154	SAT TT=2.027 CHECKS=2245 NODES=36	SAT TT=367.737 CHECKS=3799730000 NODES=1800140	SAT TT=1.869 CHECKS=10470900 NODES=3543	SAT TT=0.029 ASSIGNMENTS=35 CHECKS=7451	SAT TT=0.027 ASSIGNMENTS=35 CHECKS=7451	SAT TT=973.554	SAT TT=90.762	SAT TT=0.018 ASSIGNMENTS=35 CHECKS=7451	SAT TT=0.016 ASSIGNMENTS=35 CHECKS=9203	SAT TT=0.632	SAT TT=0.063 ASSIGNMENTS=771 CHECKS=272258	SAT TT=0.016 ASSIGNMENTS=39 CHECKS=9313	SAT TT=23.692	SAT TT=0.864	SAT TT=1.533
csp/super-os/super-os-taillard-4/ normalized-super-os-taillard-4-5.xml	UNSAT TT=0.029	UNSAT TT=178.73 CHECKS=4793640000 NODES=241577	UNSAT TT=141.366 CHECKS=3754730000 NODES=187153	? (TO) TT=1800.09	UNSAT TT=112.57 CHECKS=238311000	UNSAT TT=109.918 CHECKS=238178000	UNSAT TT=1.448 ASSIGNMENTS=52	UNSAT TT=1.454 ASSIGNMENTS=52	UNSAT TT=24.889 CHECKS=839275 NODES=40423	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=0.049 ASSIGNMENTS=123 CHECKS=158058	UNSAT TT=0.048 ASSIGNMENTS=123 CHECKS=158058	UNSAT TT=1744.3	? (MO) TT=1029.06	UNSAT TT=0.029 ASSIGNMENTS=76 CHECKS=101688	UNSAT TT=0.379 ASSIGNMENTS=4075 CHECKS=2532890	UNSAT TT=2.937	UNSAT TT=39.33 ASSIGNMENTS=503985 CHECKS=215943000	UNSAT TT=0.035 ASSIGNMENTS=128 CHECKS=145218	UNSAT TT=693.351	UNSAT TT=0.979	UNSAT TT=1.465
csp/super-os/super-os-taillard-4/ normalized-super-os-taillard-4-8.xml	UNSAT TT=0.023	UNSAT TT=1.563 CHECKS=3319480 NODES=180	UNSAT TT=1.478 CHECKS=3153710 NODES=0	UNSAT TT=0.068	UNSAT TT=0.765 CHECKS=860472	UNSAT TT=0.482 CHECKS=876304	UNSAT TT=1.477 ASSIGNMENTS=8	UNSAT TT=1.482 ASSIGNMENTS=8	UNSAT TT=1.995 CHECKS=14709 NODES=417	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=0.031 ASSIGNMENTS=32 CHECKS=45353	UNSAT TT=0.033 ASSIGNMENTS=32 CHECKS=45353	UNSAT TT=203.583	UNSAT TT=48.208	UNSAT TT=0.023 ASSIGNMENTS=51 CHECKS=68035	UNSAT TT=0.029 ASSIGNMENTS=67 CHECKS=94030	UNSAT TT=0.69	UNSAT TT=1.352 ASSIGNMENTS=21467 CHECKS=7673110	UNSAT TT=0.029 ASSIGNMENTS=66 CHECKS=107876	UNSAT TT=15.405	UNSAT TT=0.862	UNSAT TT=1.224
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-11.xml	SAT TT=0.038	SAT TT=2.27 CHECKS=773079 NODES=107	SAT TT=2.802 CHECKS=5985960 NODES=310	? (TO) TT=1800.03	SAT TT=23.297 CHECKS=44528100	SAT TT=17.008 CHECKS=29660500	SAT TT=1.981 ASSIGNMENTS=71	SAT TT=1.935 ASSIGNMENTS=71	SAT TT=4.093 CHECKS=13576 NODES=158	? (TO) TT=1800.01	SAT TT=1.776 CHECKS=5752390 NODES=1208	SAT TT=0.051 ASSIGNMENTS=136 CHECKS=96986	SAT TT=0.052 ASSIGNMENTS=136 CHECKS=96986	SAT TT=253.848	SAT TT=211.889	SAT TT=0.038 ASSIGNMENTS=138 CHECKS=106781	SAT TT=0.551 ASSIGNMENTS=6258 CHECKS=3995560	SAT TT=6.311	SAT TT=1.472 ASSIGNMENTS=15367 CHECKS=7122800	SAT TT=0.05 ASSIGNMENTS=162 CHECKS=147688	SAT TT=68.235	SAT TT=1.41	SAT TT=2.685
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-16.xml	SAT TT=0.076	SAT TT=2.75 CHECKS=1893670 NODES=133	SAT TT=2.601 CHECKS=2753900 NODES=99	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=34.9 CHECKS=76880000	SAT TT=2.543 ASSIGNMENTS=193	SAT TT=2.821 ASSIGNMENTS=193	SAT TT=4.596 CHECKS=5172 NODES=59	? (TO) TT=1800.03	SAT TT=2.01 CHECKS=4757220 NODES=809	SAT TT=0.098 ASSIGNMENTS=329 CHECKS=421074	SAT TT=0.099 ASSIGNMENTS=329 CHECKS=421074	SAT TT=678.548	SAT TT=317.87	SAT TT=0.342 ASSIGNMENTS=1874 CHECKS=2101830	SAT TT=0.076 ASSIGNMENTS=500 CHECKS=355118	SAT TT=3.143	SAT TT=7.649 ASSIGNMENTS=75135 CHECKS=40938800	SAT TT=0.106 ASSIGNMENTS=402 CHECKS=564824	SAT TT=86.854	SAT TT=1.472	SAT TT=2.64
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-1.xml	UNSAT TT=2.126	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=130.263 ASSIGNMENTS=26788	UNSAT TT=124.718 ASSIGNMENTS=26788	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=16.81 ASSIGNMENTS=54405 CHECKS=62914400	UNSAT TT=16.963 ASSIGNMENTS=54405 CHECKS=62914400	? (TO) TT=1800.04	? (MO) TT=865.18	UNSAT TT=4.77 ASSIGNMENTS=26212 CHECKS=32630000	UNSAT TT=2.774 ASSIGNMENTS=19396 CHECKS=18705100	UNSAT TT=1023.27	UNSAT TT=57.902 ASSIGNMENTS=462261 CHECKS=368150000	UNSAT TT=8.701 ASSIGNMENTS=54405 CHECKS=62914400	? (TO) TT=1800.14	UNSAT TT=2.126	UNSAT TT=3.046
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-21.xml	UNSAT TT=0.031	UNSAT TT=491.438 CHECKS=14325100000 NODES=509584	UNSAT TT=520.481 CHECKS=14063700000 NODES=498031	UNSAT TT=0.102	UNSAT TT=42.774 CHECKS=92871600	UNSAT TT=60.906 CHECKS=131502000	UNSAT TT=0.972 ASSIGNMENTS=0	UNSAT TT=0.934 ASSIGNMENTS=0	UNSAT TT=40.4 CHECKS=1252980 NODES=49683	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=0.056 ASSIGNMENTS=214 CHECKS=159730	UNSAT TT=0.058 ASSIGNMENTS=214 CHECKS=159730	UNSAT TT=177.786	UNSAT TT=204.122	UNSAT TT=0.041 ASSIGNMENTS=216 CHECKS=144604	UNSAT TT=0.502 ASSIGNMENTS=5485 CHECKS=3274870	UNSAT TT=5.7	UNSAT TT=67.958 ASSIGNMENTS=803222 CHECKS=317940000	UNSAT TT=0.031 ASSIGNMENTS=64 CHECKS=45189	UNSAT TT=140.937	UNSAT TT=1.344	UNSAT TT=2.487
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-4.xml	UNSAT TT=2.324	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=459.997 ASSIGNMENTS=124339	UNSAT TT=469.615 ASSIGNMENTS=124339	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=32.983 ASSIGNMENTS=175271 CHECKS=179910000	UNSAT TT=35.059 ASSIGNMENTS=175271 CHECKS=179910000	? (TO) TT=1800.07	? (MO) TT=575.25	UNSAT TT=13.243 ASSIGNMENTS=71777 CHECKS=88616500	UNSAT TT=3.876 ASSIGNMENTS=22676 CHECKS=25249100	? (TO) TT=1800.11	UNSAT TT=162.215 ASSIGNMENTS=1156670 CHECKS=1018270000	UNSAT TT=25.444 ASSIGNMENTS=175271 CHECKS=179910000	? (TO) TT=1800.11	UNSAT TT=2.324	UNSAT TT=3.182
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-5.xml	UNSAT TT=3.728	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=256.414 ASSIGNMENTS=50788	UNSAT TT=268.14 ASSIGNMENTS=50788	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=34.595 ASSIGNMENTS=163772 CHECKS=176711000	UNSAT TT=34.381 ASSIGNMENTS=163772 CHECKS=176711000	? (MO) TT=1499.41	? (MO) TT=676.39	UNSAT TT=5.502 ASSIGNMENTS=26108 CHECKS=42141900	UNSAT TT=6.534 ASSIGNMENTS=38141 CHECKS=47407100	? (TO) TT=1800.1	UNSAT TT=36.729 ASSIGNMENTS=186687 CHECKS=230160000	UNSAT TT=26.471 ASSIGNMENTS=163772 CHECKS=176711000	? (TO) TT=1800.16	UNSAT TT=3.728	UNSAT TT=3.795
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-os/super-os-taillard-5/ normalized-super-os-taillard-5-7.xml	UNSAT TT=2.081	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=141.615 ASSIGNMENTS=30940	UNSAT TT=133.095 ASSIGNMENTS=30940	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=9.027 ASSIGNMENTS=9341 CHECKS=15738400	UNSAT TT=9.769 ASSIGNMENTS=9341 CHECKS=15738400	? (TO) TT=1800.02	? (MO) TT=1230.52	UNSAT TT=9.454 ASSIGNMENTS=52508 CHECKS=63140700	UNSAT TT=3.585 ASSIGNMENTS=22593 CHECKS=24080800	? (TO) TT=1800.13	UNSAT TT=64.623 ASSIGNMENTS=576555 CHECKS=361599000	UNSAT TT=2.081 ASSIGNMENTS=9341 CHECKS=15738400	? (TO) TT=1800.17	UNSAT TT=2.403	UNSAT TT=3.086
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-18.xml	SAT TT=0.312	SAT TT=184.901 CHECKS=140519000 NODES=160818	SAT TT=115.606 CHECKS=93446300 NODES=109431	? (TO) TT=1800.09	SAT TT=39.688 CHECKS=63888000	SAT TT=50.393 CHECKS=103007000	SAT TT=5.573 ASSIGNMENTS=214	SAT TT=5.671 ASSIGNMENTS=214	SAT TT=115.653 CHECKS=2902620 NODES=58290	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.312 ASSIGNMENTS=796 CHECKS=1325820	SAT TT=0.312 ASSIGNMENTS=796 CHECKS=1325820	? (MO) TT=1001.1	? (MO) TT=1075.7	SAT TT=1.056 ASSIGNMENTS=3707 CHECKS=5811900	SAT TT=4.502 ASSIGNMENTS=22912 CHECKS=22702300	? (TO) TT=1800.08	SAT TT=154.062 ASSIGNMENTS=285920 CHECKS=687530000	SAT TT=0.347 ASSIGNMENTS=659 CHECKS=1378110	? TT=397.033	SAT TT=3.23	SAT TT=8.838
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-19.xml	SAT TT=2.263	SAT TT=27.179 CHECKS=8623660 NODES=22968	SAT TT=165.97 CHECKS=110081000 NODES=192689	? (TO) TT=1800.1	SAT TT=39.38 CHECKS=70806600	? (TO) TT=1800.1	SAT TT=3.952 ASSIGNMENTS=131	SAT TT=4.269 ASSIGNMENTS=131	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=3.612 CHECKS=11738100 NODES=733	SAT TT=12.337 ASSIGNMENTS=13290 CHECKS=24527800	SAT TT=12.374 ASSIGNMENTS=13290 CHECKS=24527800	? (TO) TT=1800.03	? (TO) TT=1800	SAT TT=113.908 ASSIGNMENTS=288752 CHECKS=700504000	SAT TT=2.263 ASSIGNMENTS=13094 CHECKS=10271400	? (TO) TT=1800.07	SAT TT=612.633 ASSIGNMENTS=1411850 CHECKS=2782110000	SAT TT=4.509 ASSIGNMENTS=13290 CHECKS=24527800	? TT=223.609	SAT TT=3.545	SAT TT=8.902
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-2.xml	UNSAT TT=5.093	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	UNSAT TT=1754.43 ASSIGNMENTS=280618	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=17.851 ASSIGNMENTS=37185 CHECKS=47929000	UNSAT TT=17.431 ASSIGNMENTS=37185 CHECKS=47929000	? (MO) TT=1147.78	? (MO) TT=1070.88	UNSAT TT=671.854 ASSIGNMENTS=1719570 CHECKS=3022110000	UNSAT TT=67.526 ASSIGNMENTS=193956 CHECKS=310867000	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=9.79 ASSIGNMENTS=37185 CHECKS=47929000	? TT=283.724	UNSAT TT=5.093	UNSAT TT=10.831
csp/super-os/super-os-taillard-7/ normalized-super-os-taillard-7-30.xml	UNSAT TT=0.612	? (TO) TT=1800.11	? (TO) TT=1800.15	UNSAT TT=1339.18	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=1.484 ASSIGNMENTS=0	UNSAT TT=1.505 ASSIGNMENTS=0	UNSAT TT=1697.57 CHECKS=48716600 NODES=1574140	? (TO) TT=1800.02	? (TO) TT=1800.06	UNSAT TT=1.069 ASSIGNMENTS=3466 CHECKS=5256300	UNSAT TT=1.062 ASSIGNMENTS=3466 CHECKS=5256300	? (MO) TT=818.31	? (MO) TT=813	UNSAT TT=3.129 ASSIGNMENTS=11144 CHECKS=17072700	UNSAT TT=2.165 ASSIGNMENTS=12377 CHECKS=10390900	UNSAT TT=278.265	UNSAT TT=191.779 ASSIGNMENTS=536219 CHECKS=869326000	UNSAT TT=0.612 ASSIGNMENTS=1688 CHECKS=3021770	? TT=225.593	UNSAT TT=3.545	UNSAT TT=8.335
csp/super-queens/ normalized-super-queens-11.xml	UNSAT TT=0.006	UNSAT TT=0.666 CHECKS=8 NODES=0	UNSAT TT=0.682 CHECKS=8 NODES=0	UNSAT TT=0.026	UNSAT TT=0.016 CHECKS=820	UNSAT TT=0.011 CHECKS=1496	UNSAT TT=0.55 ASSIGNMENTS=0	UNSAT TT=0.547 ASSIGNMENTS=0	UNSAT TT=0.466 CHECKS=154 NODES=3	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.017 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.681	UNSAT TT=0.678	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.32	UNSAT TT=0.007 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.006 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.868	UNSAT TT=0.527	UNSAT TT=0.524
csp/super-queens/ normalized-super-queens-13.xml	UNSAT TT=0.009	UNSAT TT=0.827 CHECKS=16 NODES=0	UNSAT TT=0.857 CHECKS=16 NODES=0	UNSAT TT=0.043	UNSAT TT=0.172 CHECKS=70159	UNSAT TT=0.102 CHECKS=317849	UNSAT TT=0.865 ASSIGNMENTS=0	UNSAT TT=0.871 ASSIGNMENTS=0	UNSAT TT=0.73 CHECKS=7336 NODES=156	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.021 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.017	UNSAT TT=1.018	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.011 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.585	UNSAT TT=0.009 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.193	UNSAT TT=0.774	UNSAT TT=0.832
csp/super-queens/ normalized-super-queens-1.xml	UNSAT TT=0.012	UNSAT TT=0.849 CHECKS=20 NODES=0	UNSAT TT=0.788 CHECKS=20 NODES=0	UNSAT TT=0.054	UNSAT TT=3.801 CHECKS=3906660	UNSAT TT=13.293 CHECKS=44362100	UNSAT TT=0.922 ASSIGNMENTS=0	UNSAT TT=1.003 ASSIGNMENTS=0	UNSAT TT=0.988 CHECKS=77829 NODES=1645	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.025 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.612	UNSAT TT=1.678	UNSAT TT=0.013 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.376	UNSAT TT=0.015 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.012 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=3.538	UNSAT TT=1.617	UNSAT TT=1.845
csp/super-queens/ normalized-super-queens-2.xml	UNSAT TT=1.119	UNSAT TT=5.091 CHECKS=238 NODES=0	UNSAT TT=4.956 CHECKS=238 NODES=0	UNSAT TT=3.155	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=19.796 ASSIGNMENTS=0	UNSAT TT=20.087 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1.266 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.119 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=1069.75	? (MO) TT=376.67	UNSAT TT=1.254 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.259 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.02	UNSAT TT=1.164 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.237 ASSIGNMENTS=0 CHECKS=1	? TT=850.493	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/super-queens/ normalized-super-queens-3.xml	UNSAT TT=0.016	UNSAT TT=0.922 CHECKS=24 NODES=0	UNSAT TT=0.889 CHECKS=24 NODES=0	UNSAT TT=0.068	UNSAT TT=297.889 CHECKS=1066540000	UNSAT TT=167.405 CHECKS=616692000	UNSAT TT=1.123 ASSIGNMENTS=0	UNSAT TT=1.107 ASSIGNMENTS=0	UNSAT TT=4.773 CHECKS=1253330 NODES=25152	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=0.028 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.026 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=25.545	UNSAT TT=15.779	UNSAT TT=0.018 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=115.895	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.016 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=80.128	UNSAT TT=20.751	UNSAT TT=31.719
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/super-queens/ normalized-super-queens-4.xml	UNSAT TT=1.602	UNSAT TT=6.173 CHECKS=298 NODES=0	UNSAT TT=6.718 CHECKS=298 NODES=0	UNSAT TT=4.531	? (TO) TT=1800.11	? (TO) TT=1800.03	UNSAT TT=25.128 ASSIGNMENTS=0	UNSAT TT=25.187 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=1.716 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.706 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=840.92	? (MO) TT=390.35	UNSAT TT=1.602 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.692 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.01	UNSAT TT=1.633 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.714 ASSIGNMENTS=0 CHECKS=1	? TT=249.21	? (TO) TT=1800.19	? (TO) TT=1800.06
csp/super-queens/ normalized-super-queens-5.xml	UNSAT TT=0.022	UNSAT TT=0.976 CHECKS=30 NODES=0	UNSAT TT=0.933 CHECKS=30 NODES=0	UNSAT TT=0.093	? (TO) TT=1800.05	? (TO) TT=1800.03	UNSAT TT=1.399 ASSIGNMENTS=0	UNSAT TT=1.51 ASSIGNMENTS=0	UNSAT TT=562.931 CHECKS=147078000 NODES=2584230	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	? (TO) TT=1800.12	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.022 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.06	UNSAT TT=0.024 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.023 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.13
csp/super-queens/ normalized-super-queens-6.xml	UNSAT TT=1.677	UNSAT TT=9.957 CHECKS=412 NODES=0	UNSAT TT=10.01 CHECKS=412 NODES=0	UNSAT TT=7.15	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=41.075 ASSIGNMENTS=0	UNSAT TT=39.877 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1.775 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.716 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=543.29	? (MO) TT=483.4	UNSAT TT=1.685 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.677 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.08	UNSAT TT=1.748 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=1.737 ASSIGNMENTS=0 CHECKS=1	? TT=574.563	? (MO) TT=66.568	? (MO) TT=1035.36
csp/super-queens/ normalized-super-queens-7.xml	UNSAT TT=2.521	UNSAT TT=14.383 CHECKS=532 NODES=0	UNSAT TT=13.477 CHECKS=532 NODES=0	UNSAT TT=10.101	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=52.485 ASSIGNMENTS=0	UNSAT TT=54.371 ASSIGNMENTS=0	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=2.559 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.547 ASSIGNMENTS=0 CHECKS=1	? (MO) TT=685.4	? (MO) TT=744.49	UNSAT TT=2.521 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.65 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	UNSAT TT=2.534 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=2.521 ASSIGNMENTS=0 CHECKS=1	? TT=473.059	? (MO) TT=103.55	? (MO) TT=309.13
csp/super-queens/ normalized-super-queens-8.xml	UNSAT TT=0.04	UNSAT TT=1.12 CHECKS=40 NODES=0	UNSAT TT=1.036 CHECKS=40 NODES=0	UNSAT TT=0.142	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=2.053 ASSIGNMENTS=0	UNSAT TT=2.066 ASSIGNMENTS=0	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=0.052 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.054 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.03	? (TO) TT=1800	UNSAT TT=0.041 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.042 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.07	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	UNSAT TT=0.04 ASSIGNMENTS=0 CHECKS=1	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.08
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle01.xml	SAT TT=0.004	SAT TT=0.64 CHECKS=215 NODES=3	SAT TT=0.682 CHECKS=166 NODES=0	SAT TT=0.025	SAT TT=0.008 CHECKS=54	SAT TT=0.008 CHECKS=45	SAT TT=0.445 ASSIGNMENTS=4	SAT TT=0.493 ASSIGNMENTS=4	SAT TT=0.398 CHECKS=141 NODES=3	SAT TT=0.393 CHECKS=355 NODES=1	SAT TT=0.374 CHECKS=359 NODES=1	SAT TT=0.016 ASSIGNMENTS=3 CHECKS=10	SAT TT=0.015 ASSIGNMENTS=3 CHECKS=10	SAT TT=1.003	SAT TT=0.919	SAT TT=0.004 ASSIGNMENTS=3 CHECKS=10	SAT TT=0.007 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.27	SAT TT=0.006 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.006 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.903	SAT TT=0.478	SAT TT=0.486

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	513	520	375	523	521	415	183	222	596	597	499	515	451	522	309	484	486
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	513	520	375	523	521	415	183	222	596	597	499	515	451	522	309	484	486
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	40	49	65	16	10	1	0	2	13	12	132	60	61	163	0	45	14
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0