CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in intension (2-ARY-INT), subcategory real world problems

This page displays the results of the different solvers for each benchmark for category binary constraints in intension (2-ARY-INT), subcategory real world problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp01/ normalized-fapp01-0200-10.xml	SAT TT=2.432	SAT TT=10.236 CHECKS=509828 NODES=200	SAT TT=10.31 CHECKS=603822 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=5.863 ASSIGNMENTS=155	SAT TT=5.807 ASSIGNMENTS=155	SAT TT=18.154 CHECKS=1045660 NODES=427	SAT TT=14.224 CHECKS=23030900 NODES=6856	SAT TT=12.099 CHECKS=3334850 NODES=591	SAT TT=16.817 ASSIGNMENTS=200 CHECKS=509828	SAT TT=17.103 ASSIGNMENTS=200 CHECKS=509828	? (problem) TT=0.577	? (problem) TT=0.579	SAT TT=2.461 ASSIGNMENTS=418 CHECKS=35520	SAT TT=91.132 ASSIGNMENTS=7543 CHECKS=1512450	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=2.432 ASSIGNMENTS=288 CHECKS=31525	SAT TT=137.591	SAT TT=149.969	SAT TT=75.418
csp/fapp/fapp01/ normalized-fapp01-0200-2.xml	UNSAT TT=9.95	UNSAT TT=10.453 CHECKS=153025 NODES=0	UNSAT TT=9.95 CHECKS=153025 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.19	? (TO) TT=1800.17	UNSAT TT=22.344 CHECKS=9956950 NODES=2675	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=17.535 ASSIGNMENTS=0 CHECKS=153025	UNSAT TT=17.658 ASSIGNMENTS=0 CHECKS=153025	? (problem) TT=0.439	? (problem) TT=0.454	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=160.765	UNSAT TT=26.677	UNSAT TT=54.013
csp/fapp/fapp01/ normalized-fapp01-0200-8.xml	SAT TT=6.562	SAT TT=10.894 CHECKS=616036 NODES=200	SAT TT=10.701 CHECKS=1003130 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=6.788 ASSIGNMENTS=243	SAT TT=6.654 ASSIGNMENTS=243	SAT TT=20.63 CHECKS=5118480 NODES=2183	? (TO) TT=1800.01	SAT TT=11.962 CHECKS=3760060 NODES=693	SAT TT=17.05 ASSIGNMENTS=200 CHECKS=616036	SAT TT=18.338 ASSIGNMENTS=200 CHECKS=616036	? (problem) TT=0.492	SAT TT=608.366	SAT TT=13.894 ASSIGNMENTS=1904 CHECKS=286789	SAT TT=90.181 ASSIGNMENTS=6362 CHECKS=1572420	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=6.562 ASSIGNMENTS=885 CHECKS=116262	SAT TT=141.143	SAT TT=145.2	SAT TT=90.3
csp/fapp/fapp02/ normalized-fapp02-0250-0.xml	UNSAT TT=1.994	UNSAT TT=17.88 CHECKS=28617 NODES=0	UNSAT TT=17.834 CHECKS=28617 NODES=0	UNSAT TT=1.994	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=16.566 ASSIGNMENTS=157	UNSAT TT=17.745 ASSIGNMENTS=157	UNSAT TT=30.681 CHECKS=1811210 NODES=249	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=23.9 ASSIGNMENTS=0 CHECKS=28617	UNSAT TT=24.438 ASSIGNMENTS=0 CHECKS=28617	? (problem) TT=0.45	? (problem) TT=0.577	UNSAT TT=14.794 ASSIGNMENTS=169 CHECKS=100956	UNSAT TT=122.36 ASSIGNMENTS=4369 CHECKS=1408090	UNSAT TT=136.821	UNSAT TT=486.704 ASSIGNMENTS=5748 CHECKS=4531650	UNSAT TT=7.873 ASSIGNMENTS=86 CHECKS=37881	UNSAT TT=247.085	UNSAT TT=38.859	UNSAT TT=79.722
csp/fapp/fapp02/ normalized-fapp02-0250-3.xml	SAT TT=17.484	SAT TT=18.558 CHECKS=5487510 NODES=660	SAT TT=17.484 CHECKS=1608080 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=25.176 ASSIGNMENTS=660 CHECKS=5487510	SAT TT=25.57 ASSIGNMENTS=660 CHECKS=5487510	? (problem) TT=0.575	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=474.405	SAT TT=341.373	SAT TT=220.05
csp/fapp/fapp02/ normalized-fapp02-0250-9.xml	SAT TT=13.973	SAT TT=17.875 CHECKS=1020020 NODES=252	SAT TT=19.367 CHECKS=3970030 NODES=252	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=15.183 ASSIGNMENTS=666	SAT TT=16.591 ASSIGNMENTS=666	SAT TT=33.716 CHECKS=6619340 NODES=1638	? (TO) TT=1800	SAT TT=30.103 CHECKS=48793800 NODES=8922	SAT TT=24.477 ASSIGNMENTS=252 CHECKS=1020020	SAT TT=25.014 ASSIGNMENTS=252 CHECKS=1020020	? (problem) TT=0.44	? (problem) TT=0.582	SAT TT=42.657 ASSIGNMENTS=5513 CHECKS=1443140	SAT TT=217.393 ASSIGNMENTS=11874 CHECKS=3201240	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=13.973 ASSIGNMENTS=1335 CHECKS=233024	SAT TT=260.497	SAT TT=403.726	SAT TT=156.903
csp/fapp/fapp03/ normalized-fapp03-0300-0.xml	UNSAT TT=1.197	UNSAT TT=22.338 CHECKS=16362 NODES=0	UNSAT TT=21.979 CHECKS=11673 NODES=0	UNSAT TT=1.197	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=15.438 ASSIGNMENTS=3	UNSAT TT=15.055 ASSIGNMENTS=3	UNSAT TT=56.661 CHECKS=1059530 NODES=47	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=31.826 ASSIGNMENTS=0 CHECKS=11673	UNSAT TT=31.821 ASSIGNMENTS=0 CHECKS=11673	? (problem) TT=0.595	? (problem) TT=0.479	UNSAT TT=8.472 ASSIGNMENTS=23 CHECKS=33873	UNSAT TT=229.247 ASSIGNMENTS=3885 CHECKS=1940160	UNSAT TT=817.88	UNSAT TT=829.438 ASSIGNMENTS=6060 CHECKS=5641460	UNSAT TT=5.371 ASSIGNMENTS=27 CHECKS=10404	? TT=380.23	UNSAT TT=51.131	UNSAT TT=135.899
csp/fapp/fapp03/ normalized-fapp03-0300-4.xml	UNSAT TT=11.852	UNSAT TT=22.239 CHECKS=45927 NODES=0	UNSAT TT=22.287 CHECKS=56387 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	UNSAT TT=11.852 ASSIGNMENTS=11	UNSAT TT=12.14 ASSIGNMENTS=11	UNSAT TT=50.136 CHECKS=839687 NODES=65	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=31.182 ASSIGNMENTS=0 CHECKS=41775	UNSAT TT=30.007 ASSIGNMENTS=0 CHECKS=41775	? (problem) TT=0.448	? (problem) TT=0.447	UNSAT TT=80.313 ASSIGNMENTS=971 CHECKS=1150040	UNSAT TT=243.623 ASSIGNMENTS=4652 CHECKS=2271150	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=12.056 ASSIGNMENTS=138 CHECKS=69678	? TT=335.06	UNSAT TT=52.068	UNSAT TT=128.538
csp/fapp/fapp03/ normalized-fapp03-0300-7.xml	SAT TT=27.393	SAT TT=27.393 CHECKS=27150600 NODES=2571	SAT TT=30.406 CHECKS=27304700 NODES=2494	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=111.536 ASSIGNMENTS=5276	SAT TT=110.592 ASSIGNMENTS=5276	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=35.432 ASSIGNMENTS=2475 CHECKS=26092700	SAT TT=35.326 ASSIGNMENTS=2475 CHECKS=26080000	? (problem) TT=0.596	? (TO) TT=1800.08	SAT TT=363.381 ASSIGNMENTS=52421 CHECKS=21609700	SAT TT=329.065 ASSIGNMENTS=10171 CHECKS=4564700	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=744.49	SAT TT=964.751	SAT TT=385.458
csp/fapp/fapp04/ normalized-fapp04-0300-0.xml	UNSAT TT=6.461	UNSAT TT=21.836 CHECKS=130470 NODES=0	UNSAT TT=21.945 CHECKS=136039 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=12.871 ASSIGNMENTS=13	UNSAT TT=12.866 ASSIGNMENTS=13	UNSAT TT=51.153 CHECKS=1743780 NODES=223	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=30.801 ASSIGNMENTS=0 CHECKS=114257	UNSAT TT=30.949 ASSIGNMENTS=0 CHECKS=114257	? (problem) TT=0.449	? (problem) TT=563.846	UNSAT TT=7.907 ASSIGNMENTS=117 CHECKS=21951	UNSAT TT=202.067 ASSIGNMENTS=4576 CHECKS=1303920	? (TO) TT=1800.11	? (TO) TT=1800.06	UNSAT TT=6.461 ASSIGNMENTS=54 CHECKS=15256	? TT=972.788	UNSAT TT=49.811	UNSAT TT=120.045
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp04/ normalized-fapp04-0300-5.xml	SAT TT=24.214	SAT TT=24.681 CHECKS=7018200 NODES=303	SAT TT=24.214 CHECKS=6630470 NODES=303	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	SAT TT=155.869 CHECKS=353973000 NODES=33652	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=32.051 ASSIGNMENTS=301 CHECKS=6292900	SAT TT=32.802 ASSIGNMENTS=301 CHECKS=6291610	? (problem) TT=0.449	? (problem) TT=0.45	SAT TT=1231.85 ASSIGNMENTS=114597 CHECKS=24795100	SAT TT=1261.2 ASSIGNMENTS=53012 CHECKS=18772100	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=610.226 ASSIGNMENTS=37496 CHECKS=8916950	? TT=711.431	SAT TT=1099.34	SAT TT=300.795
csp/fapp/fapp04/ normalized-fapp04-0300-6.xml	SAT TT=25.935	SAT TT=25.935 CHECKS=14061100 NODES=688	SAT TT=26.226 CHECKS=12592000 NODES=571	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=227.979 CHECKS=543836000 NODES=85583	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=33.1 ASSIGNMENTS=384 CHECKS=7942480	SAT TT=33.052 ASSIGNMENTS=384 CHECKS=7956210	? (problem) TT=0.574	? (problem) TT=0.453	SAT TT=1684.01 ASSIGNMENTS=195372 CHECKS=34426900	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=335.873 ASSIGNMENTS=19743 CHECKS=4100000	? TT=555.881	SAT TT=1282.26	SAT TT=319.265
csp/fapp/fapp05/ normalized-fapp05-0350-1.xml	UNSAT TT=22.35	UNSAT TT=22.533 CHECKS=317504 NODES=0	UNSAT TT=22.35 CHECKS=316272 NODES=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.22	UNSAT TT=107.749 CHECKS=109373000 NODES=9781	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=33.452 ASSIGNMENTS=0 CHECKS=295425	UNSAT TT=33.784 ASSIGNMENTS=0 CHECKS=295425	? (problem) TT=0.451	? (problem) TT=0.426	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=60.562	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=682.429	UNSAT TT=81.134	UNSAT TT=202.479
csp/fapp/fapp05/ normalized-fapp05-0350-5.xml	UNSAT TT=22.549	UNSAT TT=22.549 CHECKS=600118 NODES=0	UNSAT TT=22.79 CHECKS=623131 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=33.426 ASSIGNMENTS=0 CHECKS=578297	UNSAT TT=33.844 ASSIGNMENTS=0 CHECKS=599784	? (problem) TT=0.592	? (problem) TT=0.582	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=53.71	? (TO) TT=1800.08	? (TO) TT=1800.02	? TT=341.936	UNSAT TT=89.211	UNSAT TT=196.394
csp/fapp/fapp05/ normalized-fapp05-0350-6.xml	UNSAT TT=22.557	UNSAT TT=22.693 CHECKS=635661 NODES=0	UNSAT TT=22.557 CHECKS=614079 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=33.041 ASSIGNMENTS=0 CHECKS=593533	UNSAT TT=32.864 ASSIGNMENTS=0 CHECKS=614079	? (problem) TT=0.417	? (problem) TT=0.417	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=52.152	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=361.521	UNSAT TT=121.544	UNSAT TT=188.846
csp/fapp/fapp06/ normalized-fapp06-0500-0.xml	UNSAT TT=15.646	UNSAT TT=23.35 CHECKS=68156 NODES=0	UNSAT TT=23.322 CHECKS=68156 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=22.752 ASSIGNMENTS=47	UNSAT TT=22.765 ASSIGNMENTS=47	UNSAT TT=108.225 CHECKS=2546970 NODES=185	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=37.967 ASSIGNMENTS=0 CHECKS=68156	UNSAT TT=38.232 ASSIGNMENTS=0 CHECKS=68156	? (problem) TT=0.448	? (problem) TT=0.594	UNSAT TT=53.138 ASSIGNMENTS=314 CHECKS=366433	UNSAT TT=374.933 ASSIGNMENTS=4827 CHECKS=2086840	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=15.646 ASSIGNMENTS=32 CHECKS=26024	? TT=411.282	UNSAT TT=99.112	UNSAT TT=249.105
csp/fapp/fapp06/ normalized-fapp06-0500-4.xml	UNSAT TT=23.433	UNSAT TT=23.654 CHECKS=499244 NODES=0	UNSAT TT=23.433 CHECKS=492091 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.14	UNSAT TT=104.4 CHECKS=7144040 NODES=1644	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=35.828 ASSIGNMENTS=0 CHECKS=491742	UNSAT TT=36.06 ASSIGNMENTS=0 CHECKS=491742	? (problem) TT=0.448	? (problem) TT=0.586	UNSAT TT=382.551 ASSIGNMENTS=30706 CHECKS=2600560	UNSAT TT=740.305 ASSIGNMENTS=33848 CHECKS=5772890	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=53.323 ASSIGNMENTS=1834 CHECKS=274363	? TT=426.333	UNSAT TT=102.18	UNSAT TT=251.959
csp/fapp/fapp06/ normalized-fapp06-0500-9.xml	SAT TT=32.804	SAT TT=33.79 CHECKS=24646300 NODES=892	SAT TT=32.804 CHECKS=24645600 NODES=890	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.19	SAT TT=289.119 CHECKS=343325000 NODES=38162	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=45.115 ASSIGNMENTS=1174 CHECKS=27142700	SAT TT=47.136 ASSIGNMENTS=1727 CHECKS=33099500	? (problem) TT=0.481	? (problem) TT=0.595	SAT TT=509.265 ASSIGNMENTS=35955 CHECKS=6778100	SAT TT=557.666 ASSIGNMENTS=15353 CHECKS=4523690	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=1592.48	? (MO) TT=99.772	SAT TT=809.405
csp/fapp/fapp07/ normalized-fapp07-0600-6.xml	UNSAT TT=17.54	UNSAT TT=25.06 CHECKS=741026 NODES=0	UNSAT TT=25.553 CHECKS=748825 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=24.679 ASSIGNMENTS=99	UNSAT TT=24.716 ASSIGNMENTS=99	UNSAT TT=130.667 CHECKS=8361780 NODES=863	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=36.518 ASSIGNMENTS=0 CHECKS=737757	UNSAT TT=37.834 ASSIGNMENTS=0 CHECKS=737415	? (problem) TT=0.577	? (problem) TT=0.582	UNSAT TT=28.124 ASSIGNMENTS=270 CHECKS=90835	UNSAT TT=399.943 ASSIGNMENTS=5979 CHECKS=3486390	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=17.54 ASSIGNMENTS=181 CHECKS=55218	? TT=355.284	? (MO) TT=102.38	UNSAT TT=272.64
csp/fapp/fapp07/ normalized-fapp07-0600-7.xml	UNSAT TT=15.721	UNSAT TT=25.471 CHECKS=698967 NODES=0	UNSAT TT=25.135 CHECKS=696525 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=31.606 ASSIGNMENTS=151	UNSAT TT=32.742 ASSIGNMENTS=151	UNSAT TT=136.277 CHECKS=9689550 NODES=816	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=36.86 ASSIGNMENTS=0 CHECKS=691651	UNSAT TT=38.221 ASSIGNMENTS=0 CHECKS=705735	? (problem) TT=0.43	? (problem) TT=0.441	UNSAT TT=30.296 ASSIGNMENTS=402 CHECKS=110474	UNSAT TT=436.946 ASSIGNMENTS=6170 CHECKS=3611270	? (TO) TT=1800.01	? (TO) TT=1800.11	UNSAT TT=15.721 ASSIGNMENTS=294 CHECKS=54575	? TT=332.67	? (MO) TT=104.1	UNSAT TT=283.226
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp07/ normalized-fapp07-0600-8.xml	UNSAT TT=22.167	UNSAT TT=24.924 CHECKS=656562 NODES=0	UNSAT TT=25.294 CHECKS=657079 NODES=0	UNSAT TT=204.229	? (TO) TT=1800.14	? (TO) TT=1800.1	UNSAT TT=30.607 ASSIGNMENTS=159	UNSAT TT=28.805 ASSIGNMENTS=159	UNSAT TT=122.792 CHECKS=2948410 NODES=1378	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=36.212 ASSIGNMENTS=0 CHECKS=651455	UNSAT TT=36.292 ASSIGNMENTS=0 CHECKS=656381	? (problem) TT=0.426	? (problem) TT=0.762	UNSAT TT=32.833 ASSIGNMENTS=543 CHECKS=128330	UNSAT TT=496.402 ASSIGNMENTS=12047 CHECKS=4689790	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=22.167 ASSIGNMENTS=342 CHECKS=81711	? TT=312.55	? (MO) TT=102.23	UNSAT TT=273.56
csp/fapp/fapp08/ normalized-fapp08-0700-0.xml	UNSAT TT=17.553	UNSAT TT=24.495 CHECKS=29426 NODES=0	UNSAT TT=24.189 CHECKS=29478 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=596.502 CHECKS=3300580	UNSAT TT=19.691 ASSIGNMENTS=9	UNSAT TT=19.638 ASSIGNMENTS=9	UNSAT TT=113.178 CHECKS=11002700 NODES=2723	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=38.89 ASSIGNMENTS=0 CHECKS=29478	UNSAT TT=38.591 ASSIGNMENTS=0 CHECKS=29478	? (problem) TT=0.437	? (problem) TT=0.664	UNSAT TT=71.447 ASSIGNMENTS=1142 CHECKS=275001	UNSAT TT=302.917 ASSIGNMENTS=5728 CHECKS=1677000	? (TO) TT=1800.09	? (TO) TT=1800.12	UNSAT TT=17.553 ASSIGNMENTS=132 CHECKS=44225	? TT=1325.6	UNSAT TT=100.996	UNSAT TT=229.632
csp/fapp/fapp08/ normalized-fapp08-0700-10.xml	SAT TT=23.692	SAT TT=32.441 CHECKS=20025900 NODES=703	SAT TT=32.484 CHECKS=20025000 NODES=703	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=372.206 ASSIGNMENTS=27703	SAT TT=383.751 ASSIGNMENTS=27703	SAT TT=125.081 CHECKS=46338500 NODES=7813	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=42.518 ASSIGNMENTS=703 CHECKS=19766800	SAT TT=41.478 ASSIGNMENTS=700 CHECKS=18990500	? (problem) TT=0.439	? (problem) TT=0.453	SAT TT=23.692 ASSIGNMENTS=1604 CHECKS=196576	SAT TT=490.187 ASSIGNMENTS=19704 CHECKS=4094470	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=70.675 ASSIGNMENTS=5427 CHECKS=696634	? TT=792.959	? (MO) TT=103.752	SAT TT=760.074
csp/fapp/fapp08/ normalized-fapp08-0700-4.xml	UNSAT TT=24.203	UNSAT TT=24.203 CHECKS=588429 NODES=0	UNSAT TT=24.272 CHECKS=588429 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.13	UNSAT TT=100.83 CHECKS=6031720 NODES=2625	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=37.012 ASSIGNMENTS=0 CHECKS=588429	UNSAT TT=35.402 ASSIGNMENTS=0 CHECKS=578287	? (problem) TT=0.464	? (problem) TT=0.469	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.1	UNSAT TT=959.946 ASSIGNMENTS=142742 CHECKS=7471780	? TT=789.127	UNSAT TT=95.394	UNSAT TT=230.149
csp/fapp/fapp09/ normalized-fapp09-0800-0.xml	UNSAT TT=17.343	UNSAT TT=26.583 CHECKS=190575 NODES=0	UNSAT TT=25.775 CHECKS=185955 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=554.413 ASSIGNMENTS=12976	UNSAT TT=556.74 ASSIGNMENTS=12976	UNSAT TT=120.03 CHECKS=4552890 NODES=548	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=39.85 ASSIGNMENTS=0 CHECKS=184450	UNSAT TT=41.474 ASSIGNMENTS=0 CHECKS=186519	? (problem) TT=0.427	? (problem) TT=1195.52	UNSAT TT=23.406 ASSIGNMENTS=438 CHECKS=104475	UNSAT TT=651.388 ASSIGNMENTS=20150 CHECKS=6178930	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=17.343 ASSIGNMENTS=301 CHECKS=62649	? TT=450.694	UNSAT TT=83.881	UNSAT TT=177.812
csp/fapp/fapp09/ normalized-fapp09-0800-4.xml	SAT TT=32.3	SAT TT=39.155 CHECKS=18880800 NODES=2522	SAT TT=32.3 CHECKS=10874800 NODES=812	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=48.938 ASSIGNMENTS=1859 CHECKS=15146600	SAT TT=42.654 ASSIGNMENTS=812 CHECKS=10874000	? (problem) TT=0.445	? (problem) TT=0.589	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? TT=1064.49	? (TO) TT=1800.19	SAT TT=792.038
csp/fapp/fapp09/ normalized-fapp09-0800-8.xml	SAT TT=13.936	SAT TT=31.464 CHECKS=12277900 NODES=801	SAT TT=31.45 CHECKS=12300700 NODES=801	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=167.178 CHECKS=64794500 NODES=12009	? (TO) TT=1800.07	SAT TT=78.316 CHECKS=21014000 NODES=1674	SAT TT=41.465 ASSIGNMENTS=802 CHECKS=12157700	SAT TT=42.804 ASSIGNMENTS=801 CHECKS=12220200	? (problem) TT=0.435	? (problem) TT=0.567	SAT TT=15.64 ASSIGNMENTS=752 CHECKS=101234	SAT TT=364.242 ASSIGNMENTS=11623 CHECKS=2938500	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=13.936 ASSIGNMENTS=963 CHECKS=109366	? TT=397.012	? (TO) TT=1800.15	SAT TT=586.213
csp/fapp/fapp10/ normalized-fapp10-0900-0.xml	UNSAT TT=3.304	UNSAT TT=26.735 CHECKS=294809 NODES=0	UNSAT TT=26.627 CHECKS=294809 NODES=0	UNSAT TT=3.304	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=150.167 ASSIGNMENTS=651	UNSAT TT=149.17 ASSIGNMENTS=651	UNSAT TT=152.839 CHECKS=32144200 NODES=440	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=52.773 ASSIGNMENTS=0 CHECKS=293330	UNSAT TT=51.171 ASSIGNMENTS=0 CHECKS=256410	? (problem) TT=0.439	? (problem) TT=0.451	UNSAT TT=177.557 ASSIGNMENTS=2088 CHECKS=491684	UNSAT TT=592.054 ASSIGNMENTS=5422 CHECKS=2627870	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=29.405 ASSIGNMENTS=389 CHECKS=54642	? TT=433.024	? (MO) TT=150.14	? (MO) TT=310.886
csp/fapp/fapp10/ normalized-fapp10-0900-10.xml	SAT TT=52.5	SAT TT=53.307 CHECKS=60265700 NODES=1904	SAT TT=52.5 CHECKS=59856800 NODES=1904	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.23	? (TO) TT=1800.19	SAT TT=477.382 CHECKS=485069000 NODES=26005	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=58.673 ASSIGNMENTS=905 CHECKS=45853600	SAT TT=58.811 ASSIGNMENTS=905 CHECKS=45848900	? (problem) TT=0.44	? (problem) TT=0.442	SAT TT=181.421 ASSIGNMENTS=12056 CHECKS=5200560	SAT TT=722.269 ASSIGNMENTS=10349 CHECKS=4836620	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=102.871 ASSIGNMENTS=4669 CHECKS=919358	? TT=683.331	? (MO) TT=153.11	? (MO) TT=339.84
csp/fapp/fapp10/ normalized-fapp10-0900-9.xml	SAT TT=55.309	SAT TT=67.679 CHECKS=81188700 NODES=3513	SAT TT=55.309 CHECKS=60989000 NODES=2141	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=559.3 CHECKS=572095000 NODES=40805	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=66.599 ASSIGNMENTS=1872 CHECKS=59243300	SAT TT=66.925 ASSIGNMENTS=1872 CHECKS=59243300	? (problem) TT=0.446	? (problem) TT=0.647	SAT TT=152.956 ASSIGNMENTS=5165 CHECKS=2201010	SAT TT=1690.6 ASSIGNMENTS=128532 CHECKS=13676100	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=127.789 ASSIGNMENTS=7094 CHECKS=1087640	? TT=350.002	? (MO) TT=143.192	? (MO) TT=314.53
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp11/ normalized-fapp11-1000-1.xml	UNSAT TT=27.31	UNSAT TT=27.31 CHECKS=1849040 NODES=0	UNSAT TT=28.086 CHECKS=1849560 NODES=0	UNSAT TT=73.245	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.17	UNSAT TT=166.361 CHECKS=51643400 NODES=40	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=62.724 ASSIGNMENTS=0 CHECKS=1848430	UNSAT TT=61.75 ASSIGNMENTS=0 CHECKS=1848430	? (problem) TT=0.465	? (problem) TT=0.617	UNSAT TT=972.802 ASSIGNMENTS=3080 CHECKS=2271950	UNSAT TT=673.593 ASSIGNMENTS=3412 CHECKS=2628560	UNSAT TT=1307.2	? (TO) TT=1800.1	UNSAT TT=400.487 ASSIGNMENTS=1603 CHECKS=985145	? TT=419.901	? (MO) TT=241.249	? (MO) TT=403.283
csp/fapp/fapp11/ normalized-fapp11-1000-3.xml	UNSAT TT=27.02	UNSAT TT=27.02 CHECKS=1575160 NODES=0	UNSAT TT=27.57 CHECKS=1575160 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=335.728 ASSIGNMENTS=2471	UNSAT TT=326.354 ASSIGNMENTS=2471	UNSAT TT=170.873 CHECKS=62435200 NODES=193	? (TO) TT=1800.1	? (TO) TT=1800.06	UNSAT TT=59.565 ASSIGNMENTS=0 CHECKS=1575160	UNSAT TT=57.745 ASSIGNMENTS=0 CHECKS=1574610	? (problem) TT=0.477	? (problem) TT=0.478	UNSAT TT=1074.92 ASSIGNMENTS=11869 CHECKS=4164580	UNSAT TT=713.418 ASSIGNMENTS=6147 CHECKS=2932610	UNSAT TT=1519.42	? (TO) TT=1800.06	UNSAT TT=172.649 ASSIGNMENTS=1228 CHECKS=580159	? TT=582.376	? (MO) TT=252.804	? (MO) TT=398.339
csp/fapp/fapp11/ normalized-fapp11-1000-6.xml	UNSAT TT=27.246	UNSAT TT=27.955 CHECKS=1405800 NODES=0	UNSAT TT=27.246 CHECKS=1405800 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.23	? (TO) TT=1800.22	UNSAT TT=176.255 CHECKS=59339800 NODES=165	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=57.188 ASSIGNMENTS=0 CHECKS=1405100	UNSAT TT=57.511 ASSIGNMENTS=0 CHECKS=1405100	? (problem) TT=0.443	? (problem) TT=0.478	UNSAT TT=278.058 ASSIGNMENTS=7753 CHECKS=989157	? (TO) TT=1800.06	UNSAT TT=1211.06	? (TO) TT=1800.03	UNSAT TT=82.321 ASSIGNMENTS=1322 CHECKS=224872	? TT=381.496	? (MO) TT=239.755	? (MO) TT=404.74
csp/fapp/fapp12/ normalized-fapp12-1500-0.xml	UNSAT TT=29.357	UNSAT TT=30.203 CHECKS=874658 NODES=0	UNSAT TT=29.357 CHECKS=874658 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.24	UNSAT TT=231.914 CHECKS=16679400 NODES=0	UNSAT TT=240.434 CHECKS=17651900 NODES=0	UNSAT TT=278.989 CHECKS=17655400 NODES=0	UNSAT TT=85.645 ASSIGNMENTS=0 CHECKS=874658	UNSAT TT=90.468 ASSIGNMENTS=0 CHECKS=874658	? (problem) TT=0.44	? (problem) TT=0.58	UNSAT TT=64.884 ASSIGNMENTS=12 CHECKS=37670	UNSAT TT=605.386 ASSIGNMENTS=1774 CHECKS=2147160	UNSAT TT=1779.97	? (TO) TT=1800.08	UNSAT TT=65.95 ASSIGNMENTS=12 CHECKS=37631	? TT=709.369	? TT=392.266	? TT=417.99
csp/fapp/fapp12/ normalized-fapp12-1500-10.xml	SAT TT=1072.47	SAT TT=1072.47 CHECKS=2710230000 NODES=16896	SAT TT=1157.62 CHECKS=2712340000 NODES=16896	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.22	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1259.39 ASSIGNMENTS=18052 CHECKS=3099210000	SAT TT=1275.33 ASSIGNMENTS=18799 CHECKS=3106840000	? (problem) TT=0.594	? (problem) TT=0.574	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=543.885	? TT=422.086	? TT=419.488
csp/fapp/fapp12/ normalized-fapp12-1500-9.xml	SAT TT=203.296	SAT TT=285.524 CHECKS=561995000 NODES=9933	SAT TT=267.255 CHECKS=561970000 NODES=9933	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=317.161 ASSIGNMENTS=12620 CHECKS=576084000	SAT TT=312.075 ASSIGNMENTS=12620 CHECKS=576079000	? (problem) TT=0.454	? (problem) TT=0.445	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=733.303	? TT=422.452	? TT=420.96
csp/fapp/fapp13/ normalized-fapp13-2000-4.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.23	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (problem) TT=0.474	? (problem) TT=0.6	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=310.908	? TT=366.346	? TT=378.384
csp/fapp/fapp13/ normalized-fapp13-2000-6.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1831.68	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.24	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (problem) TT=0.468	? (problem) TT=0.422	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	? TT=1239.51	? TT=368.87	? TT=376.978
csp/fapp/fapp13/ normalized-fapp13-2000-9.xml	SAT TT=53.788	SAT TT=59.144 CHECKS=61518000 NODES=3329	SAT TT=53.788 CHECKS=48414900 NODES=2020	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1775.88	? (TO) TT=1800.02	SAT TT=75.251 ASSIGNMENTS=3331 CHECKS=61480900	SAT TT=65.478 ASSIGNMENTS=2024 CHECKS=47763000	? (problem) TT=0.436	? (problem) TT=0.762	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=1213.35	? TT=362.158	? TT=381.569
csp/fapp/fapp14/ normalized-fapp14-2500-0.xml	UNSAT TT=35.704	UNSAT TT=36.02 CHECKS=404591 NODES=0	UNSAT TT=35.704 CHECKS=404591 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.22	UNSAT TT=395.794 CHECKS=606433 NODES=0	UNSAT TT=519.522 CHECKS=1637490 NODES=0	UNSAT TT=484.704 CHECKS=1560980 NODES=0	UNSAT TT=139.001 ASSIGNMENTS=0 CHECKS=395664	UNSAT TT=142.868 ASSIGNMENTS=0 CHECKS=404591	? (problem) TT=0.419	? (problem) TT=0.413	UNSAT TT=326.024 ASSIGNMENTS=598 CHECKS=421741	UNSAT TT=711.483 ASSIGNMENTS=1682 CHECKS=1890210	UNSAT TT=43.461	? (TO) TT=1800.08	UNSAT TT=210.401 ASSIGNMENTS=335 CHECKS=208866	? TT=420.712	? TT=527.789	? TT=528.564
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp14/ normalized-fapp14-2500-2.xml	UNSAT TT=36.864	UNSAT TT=36.864 CHECKS=2491180 NODES=0	UNSAT TT=37.132 CHECKS=2491180 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.23	UNSAT TT=412.396 CHECKS=9720230 NODES=0	UNSAT TT=490.118 CHECKS=10197700 NODES=0	UNSAT TT=508.549 CHECKS=10193900 NODES=0	UNSAT TT=123.261 ASSIGNMENTS=0 CHECKS=2482640	UNSAT TT=117.641 ASSIGNMENTS=0 CHECKS=2491180	? (problem) TT=0.457	? (problem) TT=0.582	? (TO) TT=1800.03	UNSAT TT=692.919 ASSIGNMENTS=2523 CHECKS=1881240	UNSAT TT=50.14	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=396.977	? TT=550.442	? TT=489.221
csp/fapp/fapp14/ normalized-fapp14-2500-9.xml	SAT TT=415.716	SAT TT=511.534 CHECKS=1141320000 NODES=22541	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=1010.77 ASSIGNMENTS=47660 CHECKS=1953880000	SAT TT=415.716 ASSIGNMENTS=14255 CHECKS=721391000	? (problem) TT=0.453	? (problem) TT=0.45	? (TO) TT=1800.02	? (TO) TT=1800.08	Wrong UNSAT TT=47.336	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=372.957	? TT=503.614	? TT=493.271
csp/fapp/fapp15/ normalized-fapp15-3000-0.xml	UNSAT TT=30.699	UNSAT TT=31.476 CHECKS=213034 NODES=0	UNSAT TT=30.699 CHECKS=212940 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.04	UNSAT TT=48.158 ASSIGNMENTS=1008	UNSAT TT=51.503 ASSIGNMENTS=1008	UNSAT TT=320.189 CHECKS=12299900 NODES=179	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=66.712 ASSIGNMENTS=0 CHECKS=212940	UNSAT TT=68.555 ASSIGNMENTS=0 CHECKS=212940	? (problem) TT=0.442	? (problem) TT=0.446	UNSAT TT=31.577 ASSIGNMENTS=8 CHECKS=66823	UNSAT TT=608.69 ASSIGNMENTS=6569 CHECKS=4567700	UNSAT TT=34.071	? (TO) TT=1800.14	UNSAT TT=36.603 ASSIGNMENTS=8 CHECKS=66823	? TT=309.894	? TT=346.959	? TT=335.57
csp/fapp/fapp15/ normalized-fapp15-3000-2.xml	UNSAT TT=31.212	UNSAT TT=31.212 CHECKS=1107370 NODES=0	UNSAT TT=31.309 CHECKS=1107370 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=85.662 ASSIGNMENTS=2612	UNSAT TT=85.119 ASSIGNMENTS=2612	UNSAT TT=441.841 CHECKS=22740100 NODES=3343	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=57.954 ASSIGNMENTS=0 CHECKS=1107370	UNSAT TT=56.087 ASSIGNMENTS=0 CHECKS=1107370	? (problem) TT=0.576	? (problem) TT=0.576	UNSAT TT=454.018 ASSIGNMENTS=10523 CHECKS=2428640	UNSAT TT=889.156 ASSIGNMENTS=22811 CHECKS=7818960	UNSAT TT=33.958	? (TO) TT=1800.07	UNSAT TT=712.028 ASSIGNMENTS=12845 CHECKS=3537120	? TT=1214.88	? TT=572.235	? TT=333.034
csp/fapp/fapp15/ normalized-fapp15-3000-8.xml	SAT TT=68.918	SAT TT=181.505 CHECKS=322191000 NODES=10241	SAT TT=68.918 CHECKS=88376000 NODES=3497	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.21	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=91.724 ASSIGNMENTS=3497 CHECKS=88172100	SAT TT=93.619 ASSIGNMENTS=3497 CHECKS=88237200	? (problem) TT=0.569	? (problem) TT=0.428	? (TO) TT=1800.04	? (TO) TT=1800.02	Wrong UNSAT TT=34.22	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=1404.61	? TT=347.811	? TT=361.929
csp/fapp/fapp16/ normalized-fapp16-0260-10.xml	UNSAT TT=1.069	UNSAT TT=21.563 CHECKS=51072 NODES=0	UNSAT TT=21.594 CHECKS=51072 NODES=0	UNSAT TT=1.069	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=15.949 ASSIGNMENTS=65	UNSAT TT=15.837 ASSIGNMENTS=65	UNSAT TT=55.52 CHECKS=2165850 NODES=59	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=32.488 ASSIGNMENTS=0 CHECKS=47493	UNSAT TT=32.58 ASSIGNMENTS=0 CHECKS=47493	? (problem) TT=0.587	? (problem) TT=0.576	UNSAT TT=11.632 ASSIGNMENTS=99 CHECKS=93134	UNSAT TT=114.758 ASSIGNMENTS=3962 CHECKS=1359710	? (TO) TT=1800.09	UNSAT TT=1241.66 ASSIGNMENTS=10476 CHECKS=5170210	UNSAT TT=14.349 ASSIGNMENTS=384 CHECKS=119497	? TT=422.768	UNSAT TT=41.63	UNSAT TT=93.829
csp/fapp/fapp16/ normalized-fapp16-0260-7.xml	UNSAT TT=1.006	UNSAT TT=21.359 CHECKS=49074 NODES=0	UNSAT TT=21.528 CHECKS=50858 NODES=0	UNSAT TT=1.006	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=14.998 ASSIGNMENTS=69	UNSAT TT=16.024 ASSIGNMENTS=69	UNSAT TT=54.658 CHECKS=2355760 NODES=69	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=33.038 ASSIGNMENTS=0 CHECKS=50849	UNSAT TT=33.117 ASSIGNMENTS=0 CHECKS=49074	? (problem) TT=0.584	? (problem) TT=0.59	UNSAT TT=23.197 ASSIGNMENTS=470 CHECKS=326090	UNSAT TT=123.051 ASSIGNMENTS=4071 CHECKS=1365400	? (TO) TT=1800.05	UNSAT TT=1097.03 ASSIGNMENTS=9960 CHECKS=4920140	UNSAT TT=12.284 ASSIGNMENTS=176 CHECKS=90470	? TT=404.459	UNSAT TT=42.087	UNSAT TT=92.441
csp/fapp/fapp16/ normalized-fapp16-0260-8.xml	UNSAT TT=1.081	UNSAT TT=21.559 CHECKS=53030 NODES=0	UNSAT TT=21.701 CHECKS=53636 NODES=0	UNSAT TT=1.081	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=15.848 ASSIGNMENTS=65	UNSAT TT=14.684 ASSIGNMENTS=65	UNSAT TT=53.528 CHECKS=2358290 NODES=69	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=32.279 ASSIGNMENTS=0 CHECKS=49070	UNSAT TT=33.866 ASSIGNMENTS=0 CHECKS=49067	? (problem) TT=0.415	? (problem) TT=0.463	UNSAT TT=20.728 ASSIGNMENTS=352 CHECKS=274473	UNSAT TT=139.603 ASSIGNMENTS=3972 CHECKS=1572330	? (TO) TT=1800.07	UNSAT TT=1092.67 ASSIGNMENTS=9960 CHECKS=4947720	UNSAT TT=10.399 ASSIGNMENTS=96 CHECKS=76869	? (TO) TT=1802.2	UNSAT TT=43.937	UNSAT TT=82.112
csp/fapp/fapp17/ normalized-fapp17-0300-0.xml	UNSAT TT=1.011	UNSAT TT=20.755 CHECKS=91335 NODES=0	UNSAT TT=20.838 CHECKS=91335 NODES=0	UNSAT TT=1.011	? (TO) TT=1800.12	? (TO) TT=1800.03	UNSAT TT=21.103 ASSIGNMENTS=95	UNSAT TT=19.571 ASSIGNMENTS=95	UNSAT TT=59.031 CHECKS=4995480 NODES=398	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=31.769 ASSIGNMENTS=0 CHECKS=91335	UNSAT TT=31.654 ASSIGNMENTS=0 CHECKS=91335	? (problem) TT=0.423	? (problem) TT=0.439	UNSAT TT=12.363 ASSIGNMENTS=77 CHECKS=23445	UNSAT TT=183.765 ASSIGNMENTS=4732 CHECKS=1105530	UNSAT TT=898.862	? (TO) TT=1800.04	UNSAT TT=24.167 ASSIGNMENTS=338 CHECKS=94211	? TT=419.923	UNSAT TT=58.927	UNSAT TT=142.304
csp/fapp/fapp17/ normalized-fapp17-0300-1.xml	UNSAT TT=1.013	UNSAT TT=19.249 CHECKS=91331 NODES=0	UNSAT TT=20.811 CHECKS=91331 NODES=0	UNSAT TT=1.013	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=21.398 ASSIGNMENTS=95	UNSAT TT=19.652 ASSIGNMENTS=95	UNSAT TT=57.554 CHECKS=4994020 NODES=398	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=32.007 ASSIGNMENTS=0 CHECKS=91331	UNSAT TT=34.141 ASSIGNMENTS=0 CHECKS=91331	? (problem) TT=0.455	? (problem) TT=0.456	UNSAT TT=12.145 ASSIGNMENTS=77 CHECKS=23445	UNSAT TT=160.65 ASSIGNMENTS=4547 CHECKS=1040410	UNSAT TT=917.655	? (TO) TT=1800.1	UNSAT TT=23.858 ASSIGNMENTS=338 CHECKS=94211	? TT=920.708	UNSAT TT=55.407	UNSAT TT=143.989
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp17/ normalized-fapp17-0300-4.xml	SAT TT=1.134	SAT TT=22.126 CHECKS=302678 NODES=300	SAT TT=21.971 CHECKS=305981 NODES=300	SAT TT=1.134	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=18.151 ASSIGNMENTS=272	SAT TT=16.797 ASSIGNMENTS=272	SAT TT=68.009 CHECKS=16731500 NODES=1799	SAT TT=35.236 CHECKS=15266600 NODES=1357	SAT TT=38.107 CHECKS=10937800 NODES=583	SAT TT=34.539 ASSIGNMENTS=300 CHECKS=315911	SAT TT=34.927 ASSIGNMENTS=300 CHECKS=315956	? (problem) TT=0.405	? (problem) TT=0.555	SAT TT=12.661 ASSIGNMENTS=286 CHECKS=38159	SAT TT=171.907 ASSIGNMENTS=4747 CHECKS=1035010	Wrong UNSAT TT=853.934	? (TO) TT=1800.07	SAT TT=10.313 ASSIGNMENTS=271 CHECKS=31361	? TT=461.054	SAT TT=167.822	SAT TT=204.387
csp/fapp/fapp18/ normalized-fapp18-0350-4.xml	UNSAT TT=0.973	UNSAT TT=21.283 CHECKS=65039 NODES=0	UNSAT TT=21.308 CHECKS=65039 NODES=0	UNSAT TT=0.973	UNSAT TT=38.737 CHECKS=9957	UNSAT TT=0.373 CHECKS=9957	UNSAT TT=11.97 ASSIGNMENTS=0	UNSAT TT=12.87 ASSIGNMENTS=0	UNSAT TT=58.963 CHECKS=259247 NODES=0	UNSAT TT=30.011 CHECKS=679649 NODES=0	UNSAT TT=27.881 CHECKS=679649 NODES=0	UNSAT TT=6.408 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.556 ASSIGNMENTS=0 CHECKS=6154	? (problem) TT=0.455	? (problem) TT=0.421	UNSAT TT=7.062 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.194 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=22.812	UNSAT TT=6.421 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.244 ASSIGNMENTS=0 CHECKS=6154	? TT=411.35	UNSAT TT=56.572	UNSAT TT=140.927
csp/fapp/fapp18/ normalized-fapp18-0350-5.xml	UNSAT TT=0.988	UNSAT TT=21.48 CHECKS=63301 NODES=0	UNSAT TT=21.488 CHECKS=63150 NODES=0	UNSAT TT=0.988	UNSAT TT=39.185 CHECKS=9957	UNSAT TT=0.369 CHECKS=9957	UNSAT TT=13.172 ASSIGNMENTS=0	UNSAT TT=13.502 ASSIGNMENTS=0	UNSAT TT=55.159 CHECKS=259245 NODES=0	UNSAT TT=30.882 CHECKS=679643 NODES=0	UNSAT TT=31.433 CHECKS=679643 NODES=0	UNSAT TT=5.966 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.34 ASSIGNMENTS=0 CHECKS=6154	? (problem) TT=0.585	? (problem) TT=0.581	UNSAT TT=6.363 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=6.133 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=23.456	UNSAT TT=6.597 ASSIGNMENTS=0 CHECKS=6154	UNSAT TT=5.691 ASSIGNMENTS=0 CHECKS=6154	? TT=470.907	UNSAT TT=55.806	UNSAT TT=140.446
csp/fapp/fapp18/ normalized-fapp18-0350-6.xml	UNSAT TT=0.971	UNSAT TT=21.418 CHECKS=134009 NODES=0	UNSAT TT=21.594 CHECKS=132621 NODES=0	UNSAT TT=0.971	UNSAT TT=36.352 CHECKS=10711	UNSAT TT=0.343 CHECKS=10711	UNSAT TT=12.978 ASSIGNMENTS=0	UNSAT TT=13.065 ASSIGNMENTS=0	UNSAT TT=58.935 CHECKS=683027 NODES=0	UNSAT TT=29.804 CHECKS=1075860 NODES=0	UNSAT TT=29.589 CHECKS=1075860 NODES=0	UNSAT TT=6.256 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.273 ASSIGNMENTS=0 CHECKS=6137	? (problem) TT=0.581	? (problem) TT=0.585	UNSAT TT=5.668 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.991 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=23.185	UNSAT TT=6.193 ASSIGNMENTS=0 CHECKS=6137	UNSAT TT=6.413 ASSIGNMENTS=0 CHECKS=6137	? TT=1383.54	UNSAT TT=64.856	UNSAT TT=145.995
csp/fapp/fapp19/ normalized-fapp19-0350-2.xml	UNSAT TT=1.689	UNSAT TT=22.885 CHECKS=248605 NODES=0	UNSAT TT=23.244 CHECKS=248605 NODES=0	UNSAT TT=1.689	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=108.259 ASSIGNMENTS=583	UNSAT TT=106.51 ASSIGNMENTS=583	UNSAT TT=128.879 CHECKS=795836 NODES=0	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=97.596 ASSIGNMENTS=0 CHECKS=152696	UNSAT TT=95.646 ASSIGNMENTS=0 CHECKS=254715	? (problem) TT=0.441	? (problem) TT=0.438	UNSAT TT=324.262 ASSIGNMENTS=4437 CHECKS=707543	UNSAT TT=684.497 ASSIGNMENTS=1893 CHECKS=869014	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=222.408 ASSIGNMENTS=549 CHECKS=274864	? TT=0.954	? (MO) TT=197.15	? (MO) TT=386.272
csp/fapp/fapp19/ normalized-fapp19-0350-3.xml	UNSAT TT=1.862	UNSAT TT=23.073 CHECKS=293799 NODES=0	UNSAT TT=23.18 CHECKS=293799 NODES=0	UNSAT TT=1.862	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=279.07 ASSIGNMENTS=2633	UNSAT TT=280.456 ASSIGNMENTS=2633	UNSAT TT=128.579 CHECKS=1096120 NODES=0	UNSAT TT=243.057 CHECKS=1606350 NODES=0	UNSAT TT=247.093 CHECKS=1606350 NODES=0	UNSAT TT=87.679 ASSIGNMENTS=0 CHECKS=188151	UNSAT TT=94.098 ASSIGNMENTS=0 CHECKS=188151	? (problem) TT=0.424	? (problem) TT=0.605	UNSAT TT=286.537 ASSIGNMENTS=839 CHECKS=621954	UNSAT TT=1302.46 ASSIGNMENTS=5329 CHECKS=2748710	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=222.171 ASSIGNMENTS=547 CHECKS=351327	? TT=0.935	? (MO) TT=212.96	? (MO) TT=381.058
csp/fapp/fapp19/ normalized-fapp19-0350-5.xml	UNSAT TT=1.728	UNSAT TT=23.213 CHECKS=386572 NODES=0	UNSAT TT=23.148 CHECKS=386572 NODES=0	UNSAT TT=1.728	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=94.51 ASSIGNMENTS=298	UNSAT TT=94.861 ASSIGNMENTS=298	UNSAT TT=150.343 CHECKS=73714100 NODES=252	UNSAT TT=241.099 CHECKS=4041050 NODES=0	UNSAT TT=244.381 CHECKS=4041050 NODES=0	UNSAT TT=96.684 ASSIGNMENTS=0 CHECKS=249898	UNSAT TT=91.105 ASSIGNMENTS=0 CHECKS=249898	? (problem) TT=0.584	? (problem) TT=0.448	UNSAT TT=87.336 ASSIGNMENTS=108 CHECKS=27049	UNSAT TT=893.216 ASSIGNMENTS=2372 CHECKS=1473200	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=134.572 ASSIGNMENTS=334 CHECKS=106947	? TT=0.971	? (MO) TT=210.35	? (MO) TT=385.14
csp/fapp/fapp20/ normalized-fapp20-0420-2.xml	UNSAT TT=1.369	UNSAT TT=21.615 CHECKS=60344 NODES=0	UNSAT TT=21.527 CHECKS=59798 NODES=0	UNSAT TT=1.369	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=44.071 ASSIGNMENTS=1829	UNSAT TT=44.008 ASSIGNMENTS=1829	UNSAT TT=69.526 CHECKS=4254880 NODES=663	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=35.9 ASSIGNMENTS=0 CHECKS=54328	UNSAT TT=35.991 ASSIGNMENTS=0 CHECKS=54328	? (problem) TT=0.432	? (problem) TT=0.435	UNSAT TT=107.867 ASSIGNMENTS=1987 CHECKS=581188	UNSAT TT=193.11 ASSIGNMENTS=5371 CHECKS=1008910	UNSAT TT=203.473	? (TO) TT=1800.04	UNSAT TT=28.35 ASSIGNMENTS=550 CHECKS=111797	? TT=721.253	UNSAT TT=62.43	UNSAT TT=146.504
csp/fapp/fapp20/ normalized-fapp20-0420-5.xml	UNSAT TT=1.393	UNSAT TT=22.038 CHECKS=67595 NODES=0	UNSAT TT=22.232 CHECKS=65881 NODES=0	UNSAT TT=1.393	? (TO) TT=1800.12	? (TO) TT=1800.03	UNSAT TT=27.558 ASSIGNMENTS=505	UNSAT TT=28.19 ASSIGNMENTS=505	UNSAT TT=118.597 CHECKS=125876000 NODES=13745	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=37.455 ASSIGNMENTS=0 CHECKS=67596	UNSAT TT=36.997 ASSIGNMENTS=0 CHECKS=67596	? (problem) TT=0.449	? (problem) TT=0.446	UNSAT TT=39.581 ASSIGNMENTS=950 CHECKS=223724	UNSAT TT=194.094 ASSIGNMENTS=5360 CHECKS=1012520	UNSAT TT=189.766	? (TO) TT=1800.03	UNSAT TT=30.332 ASSIGNMENTS=550 CHECKS=112545	? TT=1618.41	UNSAT TT=70.78	UNSAT TT=147.679
csp/fapp/fapp20/ normalized-fapp20-0420-7.xml	UNSAT TT=1.381	UNSAT TT=22.103 CHECKS=65375 NODES=0	UNSAT TT=22.282 CHECKS=65456 NODES=0	UNSAT TT=1.381	? (TO) TT=1800.13	? (TO) TT=1800.08	UNSAT TT=27.652 ASSIGNMENTS=505	UNSAT TT=27.448 ASSIGNMENTS=505	UNSAT TT=153.205 CHECKS=160636000 NODES=29569	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=35.674 ASSIGNMENTS=0 CHECKS=65375	UNSAT TT=35.325 ASSIGNMENTS=0 CHECKS=65375	? (problem) TT=0.577	? (problem) TT=570.706	UNSAT TT=38.386 ASSIGNMENTS=950 CHECKS=224836	UNSAT TT=197.162 ASSIGNMENTS=5452 CHECKS=1036320	UNSAT TT=201.245	? (TO) TT=1800.05	UNSAT TT=28.013 ASSIGNMENTS=550 CHECKS=112829	? TT=397.754	UNSAT TT=69.452	UNSAT TT=159.796
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp21/ normalized-fapp21-0500-5.xml	SAT TT=21.768	SAT TT=21.768 CHECKS=823489 NODES=500	SAT TT=21.81 CHECKS=869253 NODES=500	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.21	? (TO) TT=1800.17	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=31.783 ASSIGNMENTS=500 CHECKS=766860	SAT TT=32.239 ASSIGNMENTS=500 CHECKS=766860	? (problem) TT=0.567	? (problem) TT=0.578	SAT TT=691.923 ASSIGNMENTS=61905 CHECKS=2821430	SAT TT=281.516 ASSIGNMENTS=29345 CHECKS=1340370	Wrong UNSAT TT=120.356	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=810.244	SAT TT=288.792	SAT TT=261.691
csp/fapp/fapp21/ normalized-fapp21-0500-6.xml	SAT TT=21.607	SAT TT=21.783 CHECKS=942290 NODES=500	SAT TT=21.607 CHECKS=784456 NODES=500	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1001.56 ASSIGNMENTS=140929	SAT TT=1078.84 ASSIGNMENTS=140929	SAT TT=1177.32 CHECKS=2774580000 NODES=751487	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=33.342 ASSIGNMENTS=500 CHECKS=874935	SAT TT=33.801 ASSIGNMENTS=500 CHECKS=990034	? (problem) TT=0.495	? (problem) TT=0.424	SAT TT=1256.21 ASSIGNMENTS=207460 CHECKS=8804110	? (TO) TT=1800.06	Wrong UNSAT TT=119.565	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=976.221	SAT TT=246.303	SAT TT=265.678
csp/fapp/fapp21/ normalized-fapp21-0500-7.xml	SAT TT=21.749	SAT TT=21.792 CHECKS=921553 NODES=500	SAT TT=21.749 CHECKS=919013 NODES=500	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1414.1 CHECKS=4269480000 NODES=902415	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=33.464 ASSIGNMENTS=500 CHECKS=963800	SAT TT=32.737 ASSIGNMENTS=500 CHECKS=936460	? (problem) TT=0.436	? (problem) TT=0.442	? (TO) TT=1800.04	? (TO) TT=1800.06	Wrong UNSAT TT=111.471	? (TO) TT=1800.05	SAT TT=504.034 ASSIGNMENTS=58130 CHECKS=2347850	? TT=363.875	SAT TT=288.646	SAT TT=278.277
csp/fapp/fapp22/ normalized-fapp22-1750-0.xml	UNSAT TT=8.748	UNSAT TT=30.706 CHECKS=338746 NODES=0	UNSAT TT=30.098 CHECKS=363035 NODES=0	UNSAT TT=8.748	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=125.171 ASSIGNMENTS=369	UNSAT TT=115.127 ASSIGNMENTS=369	UNSAT TT=277.861 CHECKS=641601 NODES=0	UNSAT TT=452.141 CHECKS=810381 NODES=0	UNSAT TT=482.188 CHECKS=820657 NODES=0	UNSAT TT=400.568 ASSIGNMENTS=0 CHECKS=358632	UNSAT TT=427.376 ASSIGNMENTS=0 CHECKS=358632	? (problem) TT=0.438	? (problem) TT=0.61	UNSAT TT=539.767 ASSIGNMENTS=227 CHECKS=196084	UNSAT TT=724.406 ASSIGNMENTS=705 CHECKS=382894	UNSAT TT=32.519	? (TO) TT=1800.03	UNSAT TT=537.68 ASSIGNMENTS=2831 CHECKS=464931	? TT=0.766	? TT=742.814	? TT=743.495
csp/fapp/fapp22/ normalized-fapp22-1750-10.xml	SAT TT=36.294	SAT TT=36.294 CHECKS=9267580 NODES=1750	SAT TT=37.143 CHECKS=9269920 NODES=1750	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=284.899 CHECKS=9578020 NODES=1750	SAT TT=547.877 CHECKS=10370900 NODES=648	SAT TT=566.175 CHECKS=16506800 NODES=637	SAT TT=435.138 ASSIGNMENTS=1750 CHECKS=9260380	SAT TT=428.45 ASSIGNMENTS=1750 CHECKS=9278020	? (problem) TT=0.616	? (problem) TT=0.464	? (TO) TT=1800.1	SAT TT=1473.8 ASSIGNMENTS=191233 CHECKS=8365990	Wrong UNSAT TT=32.969	? (TO) TT=1800.05	? (TO) TT=1800.03	? TT=0.837	? TT=774.726	? TT=763.005
csp/fapp/fapp22/ normalized-fapp22-1750-6.xml	UNSAT TT=8.738	UNSAT TT=31.483 CHECKS=59746 NODES=0	UNSAT TT=30.624 CHECKS=59746 NODES=0	UNSAT TT=8.738	? (TO) TT=1800.08	? (TO) TT=1800.1	UNSAT TT=213.607 ASSIGNMENTS=2209	UNSAT TT=214.049 ASSIGNMENTS=2209	UNSAT TT=277.725 CHECKS=500339 NODES=0	UNSAT TT=466.028 CHECKS=514137 NODES=0	UNSAT TT=471.184 CHECKS=514653 NODES=0	UNSAT TT=426.269 ASSIGNMENTS=0 CHECKS=41031	UNSAT TT=427.928 ASSIGNMENTS=0 CHECKS=41543	? (problem) TT=0.45	? (problem) TT=0.58	UNSAT TT=779.036 ASSIGNMENTS=2489 CHECKS=1156160	UNSAT TT=907.015 ASSIGNMENTS=2291 CHECKS=686609	UNSAT TT=30.794	? (TO) TT=1800.07	UNSAT TT=486.689 ASSIGNMENTS=722 CHECKS=322011	? TT=0.811	? TT=773.311	? TT=808.599
csp/fapp/fapp23/ normalized-fapp23-1800-2.xml	UNSAT TT=17.562	UNSAT TT=35.173 CHECKS=786088 NODES=0	UNSAT TT=34.952 CHECKS=786103 NODES=0	UNSAT TT=17.562	UNSAT TT=73.771 CHECKS=7518540	UNSAT TT=36.681 CHECKS=927696	UNSAT TT=55.691 ASSIGNMENTS=0	UNSAT TT=58.451 ASSIGNMENTS=0	UNSAT TT=754.128 CHECKS=474485 NODES=0	UNSAT TT=906.285 CHECKS=552627 NODES=0	UNSAT TT=832.556 CHECKS=552627 NODES=0	UNSAT TT=132.27 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=138.349 ASSIGNMENTS=0 CHECKS=190727	? (problem) TT=0.581	? (problem) TT=0.46	UNSAT TT=129.965 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=136.312 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=66.606	UNSAT TT=125.19 ASSIGNMENTS=0 CHECKS=190727	UNSAT TT=130.063 ASSIGNMENTS=0 CHECKS=190727	? (TO) TT=1802.17	? TT=509.517	? TT=477.864
csp/fapp/fapp23/ normalized-fapp23-1800-4.xml	UNSAT TT=17.811	UNSAT TT=36.028 CHECKS=789237 NODES=0	UNSAT TT=36.778 CHECKS=785308 NODES=0	UNSAT TT=17.811	UNSAT TT=70.821 CHECKS=5701440	? (TO) TT=1800.08	UNSAT TT=56.033 ASSIGNMENTS=0	UNSAT TT=51.334 ASSIGNMENTS=0	UNSAT TT=730.741 CHECKS=473717 NODES=0	? (TO) TT=875	? (TO) TT=882.95	UNSAT TT=140.563 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=130.487 ASSIGNMENTS=0 CHECKS=324708	? (problem) TT=0.474	? (problem) TT=0.608	UNSAT TT=139.764 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=137.658 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=66.293	UNSAT TT=134.018 ASSIGNMENTS=0 CHECKS=324708	UNSAT TT=140.555 ASSIGNMENTS=0 CHECKS=324708	? TT=416.965	? TT=529.713	? TT=512.545
csp/fapp/fapp23/ normalized-fapp23-1800-9.xml	SAT TT=37.915	SAT TT=37.915 CHECKS=2321360 NODES=1800	SAT TT=38.618 CHECKS=2329420 NODES=1800	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	SAT TT=59.94 ASSIGNMENTS=1340	SAT TT=59.89 ASSIGNMENTS=1340	SAT TT=761.868 CHECKS=2372230 NODES=1800	? (TO) TT=980.3	? (TO) TT=952.74	SAT TT=191.556 ASSIGNMENTS=1800 CHECKS=2326670	SAT TT=179.606 ASSIGNMENTS=1800 CHECKS=2336430	? (problem) TT=0.595	? (problem) TT=0.451	SAT TT=144.161 ASSIGNMENTS=905 CHECKS=621531	SAT TT=145.513 ASSIGNMENTS=13058 CHECKS=2142790	Wrong UNSAT TT=65.625	SAT TT=169.489 ASSIGNMENTS=60573 CHECKS=13090500	SAT TT=144.34 ASSIGNMENTS=940 CHECKS=623561	? TT=451.994	? TT=505.105	? TT=531.543
csp/fapp/fapp24/ normalized-fapp24-2000-1.xml	UNSAT TT=8.112	UNSAT TT=24.96 CHECKS=94159 NODES=0	UNSAT TT=25.152 CHECKS=103650 NODES=0	UNSAT TT=8.112	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=47.33 ASSIGNMENTS=671	UNSAT TT=42.964 ASSIGNMENTS=671	UNSAT TT=343.002 CHECKS=54381600 NODES=250	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=93.669 ASSIGNMENTS=0 CHECKS=82101	UNSAT TT=91.937 ASSIGNMENTS=0 CHECKS=82101	? (problem) TT=0.459	? (problem) TT=0.458	UNSAT TT=354.321 ASSIGNMENTS=846 CHECKS=598265	UNSAT TT=754.375 ASSIGNMENTS=4873 CHECKS=2510490	UNSAT TT=1679.91	? (TO) TT=1800.1	UNSAT TT=134.205 ASSIGNMENTS=217 CHECKS=167969	? TT=417.218	? TT=495.533	? TT=467.545
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp24/ normalized-fapp24-2000-2.xml	UNSAT TT=8.719	UNSAT TT=25.9 CHECKS=111735 NODES=0	UNSAT TT=25.73 CHECKS=111735 NODES=0	UNSAT TT=8.719	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=47.472 ASSIGNMENTS=671	UNSAT TT=43.067 ASSIGNMENTS=671	UNSAT TT=286.592 CHECKS=32991100 NODES=52	UNSAT TT=212.19 CHECKS=3103200 NODES=0	UNSAT TT=210.045 CHECKS=3103200 NODES=0	UNSAT TT=94.077 ASSIGNMENTS=0 CHECKS=111735	UNSAT TT=102.138 ASSIGNMENTS=0 CHECKS=111735	? (problem) TT=0.425	? (problem) TT=0.585	UNSAT TT=368.102 ASSIGNMENTS=846 CHECKS=598265	UNSAT TT=747.201 ASSIGNMENTS=5147 CHECKS=2615680	UNSAT TT=1714.11	? (TO) TT=1800.08	UNSAT TT=138.172 ASSIGNMENTS=217 CHECKS=167969	? TT=1467.21	? TT=445.024	? TT=465.473
csp/fapp/fapp24/ normalized-fapp24-2000-7.xml	SAT TT=28.33	SAT TT=29.043 CHECKS=2575070 NODES=2000	SAT TT=28.33 CHECKS=2558380 NODES=2000	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07	SAT TT=49.554 ASSIGNMENTS=4053	SAT TT=46.636 ASSIGNMENTS=4053	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=104.063 ASSIGNMENTS=2000 CHECKS=2561810	SAT TT=101.984 ASSIGNMENTS=2000 CHECKS=2560820	? (problem) TT=0.57	? (problem) TT=0.585	SAT TT=101.11 ASSIGNMENTS=2556 CHECKS=258446	SAT TT=631.069 ASSIGNMENTS=8488 CHECKS=2431550	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=107.598 ASSIGNMENTS=1823 CHECKS=246767	? TT=402.076	? TT=466.298	? TT=478.093
csp/fapp/fapp25/ normalized-fapp25-2230-0.xml	UNSAT TT=5.062	UNSAT TT=24.543 CHECKS=165883 NODES=0	UNSAT TT=24.544 CHECKS=165883 NODES=0	UNSAT TT=5.062	UNSAT TT=45.292 CHECKS=2047800	UNSAT TT=5.273 CHECKS=630863	UNSAT TT=34.78 ASSIGNMENTS=1	UNSAT TT=34.055 ASSIGNMENTS=1	UNSAT TT=167.68 CHECKS=8547990 NODES=0	UNSAT TT=107.745 CHECKS=9708830 NODES=0	UNSAT TT=114.509 CHECKS=9708830 NODES=0	UNSAT TT=56.577 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=53.984 ASSIGNMENTS=0 CHECKS=54523	? (problem) TT=0.583	? (problem) TT=593.591	UNSAT TT=54.314 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=51.959 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=20.957	UNSAT TT=54.751 ASSIGNMENTS=0 CHECKS=54523	UNSAT TT=54.638 ASSIGNMENTS=0 CHECKS=54523	? TT=366.207	? TT=463.682	? TT=466.788
csp/fapp/fapp25/ normalized-fapp25-2230-2.xml	UNSAT TT=4.998	UNSAT TT=25.224 CHECKS=2052920 NODES=0	UNSAT TT=25.621 CHECKS=2110580 NODES=0	UNSAT TT=4.998	UNSAT TT=44.331 CHECKS=216868	? (TO) TT=1800.1	UNSAT TT=35.136 ASSIGNMENTS=48	UNSAT TT=35.05 ASSIGNMENTS=48	UNSAT TT=177.675 CHECKS=8665700 NODES=0	UNSAT TT=126.137 CHECKS=9660360 NODES=0	UNSAT TT=125.132 CHECKS=9660360 NODES=0	UNSAT TT=54.665 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=57.469 ASSIGNMENTS=0 CHECKS=54202	? (problem) TT=0.579	? (problem) TT=0.471	UNSAT TT=54.537 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=51.008 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=20.847	UNSAT TT=51.091 ASSIGNMENTS=0 CHECKS=54202	UNSAT TT=54.301 ASSIGNMENTS=0 CHECKS=54202	? TT=349.054	? TT=457.193	? TT=433.716
csp/fapp/fapp25/ normalized-fapp25-2230-4.xml	SAT TT=28.939	SAT TT=29.277 CHECKS=7810920 NODES=2230	SAT TT=28.939 CHECKS=7802130 NODES=2230	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.21	? (TO) TT=1800.21	SAT TT=235.441 CHECKS=25144900 NODES=4618	SAT TT=134.668 CHECKS=25797700 NODES=4914	SAT TT=140.858 CHECKS=34505200 NODES=855	SAT TT=95.523 ASSIGNMENTS=2230 CHECKS=7810180	SAT TT=95.437 ASSIGNMENTS=2230 CHECKS=7805720	? (problem) TT=0.413	? (problem) TT=0.555	SAT TT=55.985 ASSIGNMENTS=3545 CHECKS=275397	SAT TT=71.274 ASSIGNMENTS=26109 CHECKS=1488000	Wrong UNSAT TT=20.904	SAT TT=465.272 ASSIGNMENTS=694510 CHECKS=45718700	SAT TT=55.854 ASSIGNMENTS=2346 CHECKS=243533	? TT=366.45	? TT=466.208	? TT=455.422
csp/fapp/fapp26/ normalized-fapp26-2300-10.xml	SAT TT=29.892	SAT TT=30.414 CHECKS=3766720 NODES=2300	SAT TT=29.892 CHECKS=3769220 NODES=2300	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.23	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=94.759 ASSIGNMENTS=2300 CHECKS=3768070	SAT TT=90.139 ASSIGNMENTS=2300 CHECKS=3765790	? (problem) TT=0.601	? (problem) TT=0.455	? (TO) TT=1800.06	? (TO) TT=1800.04	Wrong UNSAT TT=26.594	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=393.935	? TT=496.837	? TT=468.886
csp/fapp/fapp26/ normalized-fapp26-2300-4.xml	UNSAT TT=7.495	UNSAT TT=26.587 CHECKS=937741 NODES=0	UNSAT TT=26.638 CHECKS=937741 NODES=0	UNSAT TT=7.495	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.18	UNSAT TT=261.956 CHECKS=91372200 NODES=429	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=91.773 ASSIGNMENTS=0 CHECKS=942312	UNSAT TT=87.006 ASSIGNMENTS=0 CHECKS=939296	? (problem) TT=0.448	? (problem) TT=0.583	? (TO) TT=1800.09	UNSAT TT=965.585 ASSIGNMENTS=15568 CHECKS=3699280	UNSAT TT=28.322	? (TO) TT=1800.11	UNSAT TT=1398.76 ASSIGNMENTS=27298 CHECKS=4234850	? TT=408.171	? TT=486.433	? TT=510.094
csp/fapp/fapp26/ normalized-fapp26-2300-8.xml	SAT TT=29.51	SAT TT=29.51 CHECKS=3539790 NODES=2300	SAT TT=29.718 CHECKS=3539380 NODES=2300	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.25	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=93.375 ASSIGNMENTS=2300 CHECKS=3538920	SAT TT=97.408 ASSIGNMENTS=2300 CHECKS=3535360	? (problem) TT=0.479	? (problem) TT=0.445	? (TO) TT=1800.04	? (TO) TT=1800.04	Wrong UNSAT TT=24.802	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=977.753	? TT=479.309	? TT=492.849
csp/fapp/fapp27/ normalized-fapp27-2550-10.xml	SAT TT=31.712	SAT TT=33.639 CHECKS=22271500 NODES=2550	SAT TT=31.712 CHECKS=21932400 NODES=2550	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.23	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=60.143 ASSIGNMENTS=2550 CHECKS=22253300	SAT TT=60.227 ASSIGNMENTS=2550 CHECKS=21987800	? (problem) TT=461.33	? (problem) TT=0.429	? (TO) TT=1800.03	? (TO) TT=1800.05	Wrong UNSAT TT=11.57	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=390.855	? TT=420.66	? TT=416.07
csp/fapp/fapp27/ normalized-fapp27-2550-3.xml	UNSAT TT=22.787	UNSAT TT=22.787 CHECKS=535609 NODES=0	UNSAT TT=22.953 CHECKS=555096 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.24	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=49.999 ASSIGNMENTS=0 CHECKS=535609	UNSAT TT=49.305 ASSIGNMENTS=0 CHECKS=535609	? (problem) TT=0.593	? (problem) TT=0.424	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=10.636	? (TO) TT=1800.07	UNSAT TT=229.25 ASSIGNMENTS=30980 CHECKS=1036290	? TT=408.839	? TT=429.206	? TT=417.567
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp27/ normalized-fapp27-2550-7.xml	SAT TT=32	SAT TT=32.065 CHECKS=20475000 NODES=2551	SAT TT=32 CHECKS=20473500 NODES=2551	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=55.632 ASSIGNMENTS=2551 CHECKS=20035700	SAT TT=57.052 ASSIGNMENTS=2551 CHECKS=20009300	? (problem) TT=0.469	? (problem) TT=0.644	? (TO) TT=1800.02	? (TO) TT=1800.07	Wrong UNSAT TT=11.269	? (TO) TT=1800.14	? (TO) TT=1800.08	? TT=1039.28	? TT=444.608	? TT=402.845
csp/fapp/fapp28/ normalized-fapp28-2800-10.xml	SAT TT=48.941	SAT TT=50.723 CHECKS=43944400 NODES=2802	SAT TT=48.941 CHECKS=43941100 NODES=2802	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.24	SAT TT=286.491 CHECKS=50975500 NODES=2801	SAT TT=460.014 CHECKS=80877800 NODES=153231	SAT TT=436.837 CHECKS=58829700 NODES=1070	SAT TT=518.374 ASSIGNMENTS=2802 CHECKS=43958800	SAT TT=485.414 ASSIGNMENTS=2802 CHECKS=43953300	? (problem) TT=0.598	? (problem) TT=0.441	? (TO) TT=1800.05	? (TO) TT=1800.05	Wrong UNSAT TT=29.337	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=0.886	? TT=1131.99	? TT=1040.2
csp/fapp/fapp28/ normalized-fapp28-2800-5.xml	SAT TT=44.85	SAT TT=44.85 CHECKS=35049200 NODES=2800	SAT TT=47.72 CHECKS=35048600 NODES=2800	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.27	SAT TT=297.094 CHECKS=38833600 NODES=2800	SAT TT=1410.51 CHECKS=1211510000 NODES=1803300	SAT TT=430.371 CHECKS=45067000 NODES=691	SAT TT=544.549 ASSIGNMENTS=2800 CHECKS=35062900	SAT TT=527.457 ASSIGNMENTS=2800 CHECKS=35049200	? (problem) TT=0.432	? (problem) TT=0.568	? (TO) TT=1800.1	? (TO) TT=1800.02	Wrong UNSAT TT=30.927	? (TO) TT=1800.07	? (TO) TT=1800.03	? TT=0.854	? TT=1046.79	? TT=1044
csp/fapp/fapp28/ normalized-fapp28-2800-6.xml	SAT TT=45.953	SAT TT=45.953 CHECKS=36212400 NODES=2800	SAT TT=48.489 CHECKS=36217300 NODES=2800	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.24	? (TO) TT=1800.24	SAT TT=293.697 CHECKS=39743100 NODES=2801	SAT TT=613.664 CHECKS=264288000 NODES=302500	SAT TT=427.841 CHECKS=45241900 NODES=659	SAT TT=482.583 ASSIGNMENTS=2800 CHECKS=36222800	SAT TT=483.318 ASSIGNMENTS=2800 CHECKS=36231600	? (problem) TT=0.443	? (problem) TT=0.444	? (TO) TT=1800.08	? (TO) TT=1800.1	Wrong UNSAT TT=25.145	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=0.932	? TT=1028.1	? TT=1115.1
csp/fapp/fapp29/ normalized-fapp29-2900-1.xml	UNSAT TT=16.226	UNSAT TT=39.921 CHECKS=1188900 NODES=0	UNSAT TT=37.981 CHECKS=1190080 NODES=0	UNSAT TT=16.226	UNSAT TT=76.26 CHECKS=117301	UNSAT TT=42.512 CHECKS=117301	UNSAT TT=93.607 ASSIGNMENTS=0	UNSAT TT=90.935 ASSIGNMENTS=0	? TT=714.378	? (TO) TT=952.83	? (TO) TT=1010.3	UNSAT TT=221.877 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=244.713 ASSIGNMENTS=0 CHECKS=26170	? (problem) TT=0.428	? (problem) TT=0.421	UNSAT TT=226.761 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=239.994 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=325.531	UNSAT TT=239.708 ASSIGNMENTS=0 CHECKS=26170	UNSAT TT=223.055 ASSIGNMENTS=0 CHECKS=26170	? TT=0.912	? TT=911.879	? TT=795.601
csp/fapp/fapp29/ normalized-fapp29-2900-3.xml	UNSAT TT=17.532	UNSAT TT=40.638 CHECKS=2048040 NODES=0	UNSAT TT=40.168 CHECKS=2048040 NODES=0	UNSAT TT=17.532	UNSAT TT=72.784 CHECKS=117297	UNSAT TT=42.846 CHECKS=117297	UNSAT TT=87.982 ASSIGNMENTS=0	UNSAT TT=94.417 ASSIGNMENTS=0	? TT=768.348	? (TO) TT=920.09	? (TO) TT=946.14	UNSAT TT=293.2 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=319.38 ASSIGNMENTS=0 CHECKS=38032	? (problem) TT=0.603	? (problem) TT=0.444	UNSAT TT=323.441 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=315.465 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=304.592	UNSAT TT=323.136 ASSIGNMENTS=0 CHECKS=38032	UNSAT TT=311.213 ASSIGNMENTS=0 CHECKS=38032	? TT=0.929	? TT=788.517	? TT=820.753
csp/fapp/fapp29/ normalized-fapp29-2900-6.xml	SAT TT=21.955	SAT TT=50.606 CHECKS=6359000 NODES=2900	SAT TT=44.593 CHECKS=6358640 NODES=2900	SAT TT=21.955	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=132.748 ASSIGNMENTS=2827	SAT TT=132.813 ASSIGNMENTS=2827	? TT=754.325	? (TO) TT=951.79	? (TO) TT=992.92	SAT TT=498.622 ASSIGNMENTS=2900 CHECKS=6357900	SAT TT=521.161 ASSIGNMENTS=2900 CHECKS=6362330	? (problem) TT=0.445	? (problem) TT=0.614	SAT TT=452.93 ASSIGNMENTS=155 CHECKS=222572	SAT TT=449.827 ASSIGNMENTS=154 CHECKS=219120	Wrong UNSAT TT=285.232	SAT TT=425.697 ASSIGNMENTS=157 CHECKS=222872	SAT TT=446.85 ASSIGNMENTS=155 CHECKS=222444	? TT=0.922	? TT=837.81	? TT=807.714
csp/fapp/fapp30/ normalized-fapp30-3000-10.xml	SAT TT=91.177	SAT TT=91.177 CHECKS=104858000 NODES=3000	SAT TT=98.724 CHECKS=105023000 NODES=3000	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.21	? (TO) TT=1800.28	? TT=987.488	? (TO) TT=1163.41	? (TO) TT=1238.81	SAT TT=1180.74 ASSIGNMENTS=3000 CHECKS=104798000	SAT TT=1091.79 ASSIGNMENTS=3000 CHECKS=104799000	? (problem) TT=0.572	? (problem) TT=0.593	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=0.776	? TT=910.013	? TT=843.061
csp/fapp/fapp30/ normalized-fapp30-3000-1.xml	UNSAT TT=18.269	UNSAT TT=40.692 CHECKS=47789 NODES=0	UNSAT TT=39.769 CHECKS=47789 NODES=0	UNSAT TT=18.269	? (TO) TT=1800.08	? (TO) TT=1800.15	UNSAT TT=177.905 ASSIGNMENTS=4363	UNSAT TT=191.342 ASSIGNMENTS=4363	? TT=877.318	? (TO) TT=1140.86	? (TO) TT=1138.28	UNSAT TT=1100.95 ASSIGNMENTS=0 CHECKS=47789	UNSAT TT=1113.73 ASSIGNMENTS=0 CHECKS=47789	? (problem) TT=0.453	? (problem) TT=0.56	UNSAT TT=1431.04 ASSIGNMENTS=8780 CHECKS=747186	UNSAT TT=1692.08 ASSIGNMENTS=7497 CHECKS=823907	? (TO) TT=1800.07	? (TO) TT=1800.14	UNSAT TT=1120.55 ASSIGNMENTS=377 CHECKS=92375	? TT=0.832	? TT=818.266	? TT=869.335
csp/fapp/fapp30/ normalized-fapp30-3000-5.xml	UNSAT TT=17.117	UNSAT TT=41.005 CHECKS=48778 NODES=0	UNSAT TT=38.854 CHECKS=48778 NODES=0	UNSAT TT=17.117	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.17	? TT=976.085	? (TO) TT=1163.6	? (TO) TT=1174.72	UNSAT TT=1049.16 ASSIGNMENTS=0 CHECKS=48778	UNSAT TT=1010.52 ASSIGNMENTS=0 CHECKS=48778	? (problem) TT=0.419	? (problem) TT=0.422	UNSAT TT=1080.59 ASSIGNMENTS=3948 CHECKS=263741	UNSAT TT=1377.81 ASSIGNMENTS=3571 CHECKS=417217	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=1502.04 ASSIGNMENTS=16829 CHECKS=625821	? TT=0.808	? TT=818.379	? TT=827.101
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp31/ normalized-fapp31-0400-6.xml	SAT TT=114.448	SAT TT=114.448 CHECKS=229439000 NODES=579	SAT TT=127.651 CHECKS=230468000 NODES=579	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=161.351 ASSIGNMENTS=579 CHECKS=228646000	SAT TT=179.55 ASSIGNMENTS=579 CHECKS=229454000	? (problem) TT=0.58	? (problem) TT=0.613	? (TO) TT=1800.09	? (TO) TT=1800.04	Wrong UNSAT TT=4.134	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=0.797	SAT TT=617.477	SAT TT=409.6
csp/fapp/fapp31/ normalized-fapp31-0400-7.xml	SAT TT=152.754	SAT TT=156.682 CHECKS=302419000 NODES=575	SAT TT=152.754 CHECKS=302419000 NODES=575	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.18	SAT TT=904.917 CHECKS=2185220000 NODES=65763	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=192.196 ASSIGNMENTS=575 CHECKS=300834000	SAT TT=194.882 ASSIGNMENTS=575 CHECKS=301073000	? (problem) TT=0.624	? (problem) TT=0.577	? (TO) TT=1800.1	? (TO) TT=1800.06	Wrong UNSAT TT=4.479	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=0.805	SAT TT=579.433	SAT TT=398.674
csp/fapp/fapp31/ normalized-fapp31-0400-9.xml	SAT TT=144.181	SAT TT=144.181 CHECKS=306631000 NODES=568	SAT TT=152.23 CHECKS=307282000 NODES=568	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.19	SAT TT=1421.48 CHECKS=3851390000 NODES=70800	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=204.111 ASSIGNMENTS=568 CHECKS=306239000	SAT TT=207.736 ASSIGNMENTS=568 CHECKS=306633000	? (problem) TT=0.445	? (problem) TT=0.44	? (TO) TT=1800.07	? (TO) TT=1800.11	Wrong UNSAT TT=4.162	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=0.828	SAT TT=741.89	SAT TT=381.123
csp/fapp/fapp32/ normalized-fapp32-0550-1.xml	UNSAT TT=26.171	UNSAT TT=26.171 CHECKS=1919080 NODES=0	UNSAT TT=26.53 CHECKS=1919080 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	UNSAT TT=1195.83 ASSIGNMENTS=1390	UNSAT TT=1217.44 ASSIGNMENTS=1390	UNSAT TT=142.982 CHECKS=3078800 NODES=0	UNSAT TT=375.427 CHECKS=2556630 NODES=0	UNSAT TT=363.848 CHECKS=3513850 NODES=0	UNSAT TT=265.908 ASSIGNMENTS=0 CHECKS=1919080	UNSAT TT=255.441 ASSIGNMENTS=0 CHECKS=1919080	? (problem) TT=0.573	? (problem) TT=0.448	? (TO) TT=1800.08	UNSAT TT=1730 ASSIGNMENTS=5424 CHECKS=2205760	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=0.824	? (MO) TT=562.416	? (MO) TT=692.399
csp/fapp/fapp32/ normalized-fapp32-0550-5.xml	UNSAT TT=26.545	? (MO) TT=23.035	UNSAT TT=26.545 CHECKS=1883380 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.25	? (TO) TT=1800.19	UNSAT TT=144.292 CHECKS=4251520 NODES=0	UNSAT TT=363.068 CHECKS=4236640 NODES=0	UNSAT TT=354.252 CHECKS=3600670 NODES=0	UNSAT TT=242.32 ASSIGNMENTS=0 CHECKS=1883380	UNSAT TT=258.359 ASSIGNMENTS=0 CHECKS=1883380	? (problem) TT=0.439	? (problem) TT=0.579	? (TO) TT=1800.08	UNSAT TT=1289.1 ASSIGNMENTS=4527 CHECKS=1489190	? (TO) TT=1800.03	? (TO) TT=1800.12	UNSAT TT=1036.62 ASSIGNMENTS=2140 CHECKS=1134710	? TT=0.793	? (MO) TT=531.079	? (MO) TT=690.526
csp/fapp/fapp32/ normalized-fapp32-0550-8.xml	SAT TT=35.15	SAT TT=36.019 CHECKS=12106500 NODES=551	SAT TT=35.15 CHECKS=12112700 NODES=551	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.21	SAT TT=151.439 CHECKS=17679100 NODES=554	SAT TT=457.722 CHECKS=152098000 NODES=150918	SAT TT=388.623 CHECKS=22713700 NODES=668	SAT TT=277.661 ASSIGNMENTS=551 CHECKS=12112700	SAT TT=268.753 ASSIGNMENTS=551 CHECKS=12114300	? (problem) TT=0.445	? (problem) TT=0.436	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=1514.18 ASSIGNMENTS=2362 CHECKS=5683680	? TT=0.783	? (MO) TT=527.318	? (MO) TT=694.381
csp/fapp/fapp33/ normalized-fapp33-0650-10.xml	SAT TT=29.653	SAT TT=30.027 CHECKS=6981000 NODES=654	SAT TT=29.653 CHECKS=6981430 NODES=654	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.25	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=70.342 ASSIGNMENTS=654 CHECKS=6946900	SAT TT=71.3 ASSIGNMENTS=654 CHECKS=6946900	? (problem) TT=0.592	? (problem) TT=0.609	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.01	? TT=550.293	? (MO) TT=200.797	? (MO) TT=357.3
csp/fapp/fapp33/ normalized-fapp33-0650-1.xml	UNSAT TT=24.591	UNSAT TT=24.591 CHECKS=220301 NODES=0	UNSAT TT=24.872 CHECKS=220301 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.03	UNSAT TT=34.845 ASSIGNMENTS=5	UNSAT TT=35.138 ASSIGNMENTS=5	UNSAT TT=136.03 CHECKS=8149610 NODES=0	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=69.722 ASSIGNMENTS=0 CHECKS=213883	UNSAT TT=68.755 ASSIGNMENTS=0 CHECKS=220301	? (problem) TT=0.418	? (problem) TT=0.451	UNSAT TT=45.868 ASSIGNMENTS=18 CHECKS=26979	UNSAT TT=608.018 ASSIGNMENTS=3194 CHECKS=1274760	? (TO) TT=1800.06	UNSAT TT=1084.05 ASSIGNMENTS=3983 CHECKS=1627930	UNSAT TT=44.133 ASSIGNMENTS=16 CHECKS=20734	? TT=460.955	? (MO) TT=200.734	? (MO) TT=383.63
csp/fapp/fapp33/ normalized-fapp33-0650-3.xml	UNSAT TT=24.612	UNSAT TT=24.612 CHECKS=248366 NODES=0	UNSAT TT=24.813 CHECKS=248366 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.08	UNSAT TT=37.213 ASSIGNMENTS=7	UNSAT TT=38.212 ASSIGNMENTS=7	UNSAT TT=133.771 CHECKS=387255 NODES=0	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=67.906 ASSIGNMENTS=0 CHECKS=241982	UNSAT TT=69.713 ASSIGNMENTS=0 CHECKS=241982	? (problem) TT=0.451	? (problem) TT=0.444	UNSAT TT=45.508 ASSIGNMENTS=15 CHECKS=22813	UNSAT TT=617.786 ASSIGNMENTS=3388 CHECKS=1405470	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=49.646 ASSIGNMENTS=19 CHECKS=26436	? TT=491.717	? (MO) TT=202.436	? (MO) TT=366.05
csp/fapp/fapp34/ normalized-fapp34-0750-0.xml	UNSAT TT=25.167	UNSAT TT=25.25 CHECKS=1302480 NODES=0	UNSAT TT=25.167 CHECKS=1302480 NODES=0	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.24	? (TO) TT=1800.18	UNSAT TT=134.837 CHECKS=3003690 NODES=0	UNSAT TT=279.219 CHECKS=6352610 NODES=0	UNSAT TT=264.31 CHECKS=7989820 NODES=0	UNSAT TT=80.426 ASSIGNMENTS=0 CHECKS=1302730	UNSAT TT=80.94 ASSIGNMENTS=0 CHECKS=1302730	? (problem) TT=0.411	? (problem) TT=0.417	? (TO) TT=1800.12	UNSAT TT=1564.58 ASSIGNMENTS=8694 CHECKS=2552100	UNSAT TT=348.781	? (TO) TT=1800.07	UNSAT TT=667.905 ASSIGNMENTS=3105 CHECKS=793840	? TT=0.882	? (MO) TT=241.225	? (MO) TT=440.5
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp34/ normalized-fapp34-0750-4.xml	SAT TT=28.645	SAT TT=28.645 CHECKS=6429710 NODES=750	SAT TT=28.742 CHECKS=6438840 NODES=750	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.17	SAT TT=165.003 CHECKS=29706100 NODES=3962	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=87.985 ASSIGNMENTS=750 CHECKS=6428720	SAT TT=85.857 ASSIGNMENTS=750 CHECKS=6436050	? (problem) TT=0.602	? (problem) TT=0.615	? (TO) TT=1800.05	? (TO) TT=1800.08	Wrong UNSAT TT=260.887	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=0.889	? (MO) TT=221.313	? (MO) TT=401.417
csp/fapp/fapp34/ normalized-fapp34-0750-9.xml	SAT TT=29.225	SAT TT=29.225 CHECKS=8902030 NODES=750	SAT TT=29.551 CHECKS=8895260 NODES=750	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.23	SAT TT=186.057 CHECKS=32468800 NODES=6256	? (TO) TT=1800.1	SAT TT=278.749 CHECKS=43815600 NODES=1687	SAT TT=85.078 ASSIGNMENTS=750 CHECKS=8889800	SAT TT=85.356 ASSIGNMENTS=750 CHECKS=8889800	? (problem) TT=0.446	? (problem) TT=0.438	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=0.964	? (MO) TT=239.79	? (MO) TT=456.4
csp/fapp/fapp35/ normalized-fapp35-1500-3.xml	UNSAT TT=30.412	UNSAT TT=30.412 CHECKS=2478420 NODES=0	UNSAT TT=30.712 CHECKS=2478420 NODES=0	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.22	UNSAT TT=203.113 CHECKS=1200720 NODES=0	UNSAT TT=412.047 CHECKS=1186700 NODES=0	UNSAT TT=391.828 CHECKS=1161650 NODES=0	UNSAT TT=259.656 ASSIGNMENTS=0 CHECKS=2478420	UNSAT TT=255.162 ASSIGNMENTS=0 CHECKS=2478420	? (problem) TT=0.608	? (problem) TT=0.459	UNSAT TT=343.365 ASSIGNMENTS=229 CHECKS=87697	UNSAT TT=677.568 ASSIGNMENTS=616 CHECKS=421825	UNSAT TT=21.632	? (TO) TT=1800.03	UNSAT TT=302.701 ASSIGNMENTS=195 CHECKS=66144	? TT=0.805	? TT=735.109	? TT=733.884
csp/fapp/fapp35/ normalized-fapp35-1500-4.xml	UNSAT TT=31.037	UNSAT TT=31.037 CHECKS=2524260 NODES=0	UNSAT TT=31.715 CHECKS=2524260 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=211.536 CHECKS=1316600 NODES=0	UNSAT TT=413.796 CHECKS=1304870 NODES=0	UNSAT TT=399.291 CHECKS=1304870 NODES=0	UNSAT TT=264.383 ASSIGNMENTS=0 CHECKS=2524260	UNSAT TT=266.303 ASSIGNMENTS=0 CHECKS=2524260	? (problem) TT=0.451	? (problem) TT=0.584	UNSAT TT=347.358 ASSIGNMENTS=240 CHECKS=88267	UNSAT TT=681.319 ASSIGNMENTS=661 CHECKS=428201	UNSAT TT=25.526	? (TO) TT=1800.07	UNSAT TT=287.93 ASSIGNMENTS=191 CHECKS=64053	? TT=0.802	? TT=784.025	? TT=730.874
csp/fapp/fapp35/ normalized-fapp35-1500-9.xml	SAT TT=57.031	SAT TT=57.031 CHECKS=24395000 NODES=1501	SAT TT=60.335 CHECKS=24392600 NODES=1501	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=231.84 CHECKS=33922200 NODES=1876	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=286.862 ASSIGNMENTS=1501 CHECKS=24395300	SAT TT=273.515 ASSIGNMENTS=1501 CHECKS=24395000	? (problem) TT=0.446	? (problem) TT=0.615	? (TO) TT=1800.11	? (TO) TT=1800.05	Wrong UNSAT TT=21.426	? (TO) TT=1800.04	? (TO) TT=1800.09	? TT=0.794	? TT=764.841	? TT=684.25
csp/fapp/fapp36/ normalized-fapp36-2000-10.xml	SAT TT=37.094	SAT TT=37.564 CHECKS=17354000 NODES=2000	SAT TT=37.094 CHECKS=17360800 NODES=2000	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=120.927 ASSIGNMENTS=2000 CHECKS=17345800	SAT TT=124.545 ASSIGNMENTS=2000 CHECKS=17345300	? (problem) TT=0.418	? (problem) TT=0.425	? (TO) TT=1800.05	? (TO) TT=1800.03	Wrong UNSAT TT=19.576	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=375.224	? TT=614.382	? TT=585.416
csp/fapp/fapp36/ normalized-fapp36-2000-3.xml	UNSAT TT=28.107	UNSAT TT=28.447 CHECKS=207354 NODES=0	UNSAT TT=28.107 CHECKS=207354 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=37.464 ASSIGNMENTS=5	UNSAT TT=36.65 ASSIGNMENTS=5	UNSAT TT=174.756 CHECKS=4089450 NODES=0	UNSAT TT=291.136 CHECKS=17144300 NODES=0	? (TO) TT=1800.06	UNSAT TT=108.585 ASSIGNMENTS=0 CHECKS=207354	UNSAT TT=119.976 ASSIGNMENTS=0 CHECKS=207354	? (problem) TT=0.435	? (problem) TT=0.496	UNSAT TT=89.366 ASSIGNMENTS=17 CHECKS=30812	UNSAT TT=630.425 ASSIGNMENTS=3383 CHECKS=928660	UNSAT TT=19.133	? (TO) TT=1800.1	UNSAT TT=94.624 ASSIGNMENTS=32 CHECKS=37244	? TT=956.804	? TT=585.986	? TT=573.289
csp/fapp/fapp36/ normalized-fapp36-2000-6.xml	UNSAT TT=27.624	UNSAT TT=27.624 CHECKS=238659 NODES=0	UNSAT TT=28.216 CHECKS=238659 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.33	? (TO) TT=1800.24	UNSAT TT=174.048 CHECKS=562760 NODES=0	UNSAT TT=328.866 CHECKS=22787100 NODES=0	? (TO) TT=1800.02	UNSAT TT=117.808 ASSIGNMENTS=0 CHECKS=238659	UNSAT TT=112.278 ASSIGNMENTS=0 CHECKS=238659	? (problem) TT=0.46	? (problem) TT=0.608	UNSAT TT=443.232 ASSIGNMENTS=2958 CHECKS=577185	UNSAT TT=844.615 ASSIGNMENTS=6423 CHECKS=1531920	UNSAT TT=18.756	? (TO) TT=1800.05	UNSAT TT=300.343 ASSIGNMENTS=1979 CHECKS=333547	? TT=663.424	? TT=588.021	? TT=564.982
csp/fapp/fapp37/ normalized-fapp37-2250-1.xml	UNSAT TT=41.15	UNSAT TT=41.15 CHECKS=786436 NODES=0	UNSAT TT=41.313 CHECKS=786436 NODES=0	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.14	? (problem) TT=112.465	? (problem) TT=113.737	? TT=367.849	? (TO) TT=627.61	? (TO) TT=633.44	UNSAT TT=757.197 ASSIGNMENTS=0 CHECKS=786436	UNSAT TT=812.561 ASSIGNMENTS=0 CHECKS=786436	? (problem) TT=0.582	? (problem) TT=0.571	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=57.955	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=0.877	? TT=1149.87	? TT=1032.15
csp/fapp/fapp37/ normalized-fapp37-2250-2.xml	UNSAT TT=40.887	UNSAT TT=40.887 CHECKS=2118760 NODES=0	UNSAT TT=42.066 CHECKS=2118760 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	? (problem) TT=106.672	? (problem) TT=112.78	? TT=354.792	? (TO) TT=623.6	? (TO) TT=623.68	UNSAT TT=810.812 ASSIGNMENTS=0 CHECKS=2118760	UNSAT TT=848.84 ASSIGNMENTS=0 CHECKS=2118760	? (problem) TT=0.612	? (problem) TT=0.452	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=69.247	? (TO) TT=1800.12	? (TO) TT=1800.02	? TT=0.893	? TT=1030.02	? TT=1008.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fapp/fapp37/ normalized-fapp37-2250-5.xml	SAT TT=55.601	SAT TT=56.291 CHECKS=25166200 NODES=2250	SAT TT=55.601 CHECKS=25166200 NODES=2250	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.1	? (problem) TT=105.752	? (problem) TT=112.517	? TT=356.214	? (TO) TT=639.96	? (TO) TT=620.82	SAT TT=749.923 ASSIGNMENTS=2250 CHECKS=25166900	SAT TT=823.952 ASSIGNMENTS=2250 CHECKS=25166900	? (problem) TT=0.444	? (problem) TT=0.626	? (TO) TT=1800.11	? (TO) TT=1800.03	Wrong UNSAT TT=68.303	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=0.873	? TT=1078.06	? TT=1005.04
csp/fapp/fapp38/ normalized-fapp38-2500-3.xml	SAT TT=66.206	SAT TT=66.206 CHECKS=38549700 NODES=2501	SAT TT=71.951 CHECKS=38554200 NODES=2501	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (problem) TT=92.479	? (problem) TT=91.332	? TT=790.689	? (TO) TT=1065.71	? (TO) TT=1029.53	SAT TT=711.004 ASSIGNMENTS=2501 CHECKS=38540000	SAT TT=753.005 ASSIGNMENTS=2501 CHECKS=38541700	? (problem) TT=0.572	? (problem) TT=0.624	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=0.82	? TT=658.63	? TT=747.462
csp/fapp/fapp38/ normalized-fapp38-2500-6.xml	SAT TT=70.038	SAT TT=70.038 CHECKS=45327900 NODES=2505	? (MO) TT=34.824	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.04	? (problem) TT=86.399	? (problem) TT=89.067	? TT=797.293	? (TO) TT=1080.63	? (TO) TT=1046.45	SAT TT=709.557 ASSIGNMENTS=2505 CHECKS=45314300	SAT TT=694.741 ASSIGNMENTS=2505 CHECKS=45302200	? (problem) TT=0.585	? (problem) TT=0.602	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	? TT=0.794	? TT=701.589	? TT=717.556
csp/fapp/fapp38/ normalized-fapp38-2500-9.xml	SAT TT=75.16	SAT TT=78.65 CHECKS=60950000 NODES=4587	SAT TT=75.16 CHECKS=60940400 NODES=4587	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.12	? (problem) TT=85.237	? (problem) TT=89.252	? TT=878.564	? (TO) TT=1047.53	? (TO) TT=1051.27	SAT TT=671.41 ASSIGNMENTS=4587 CHECKS=60942100	SAT TT=679.306 ASSIGNMENTS=4587 CHECKS=60942100	? (problem) TT=0.448	? (problem) TT=0.624	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=0.768	? TT=715.233	? TT=672.465
csp/fapp/fapp39/ normalized-fapp39-2750-5.xml	SAT TT=1265	SAT TT=1355.76 CHECKS=2545130000 NODES=3810	SAT TT=1426.19 CHECKS=2544800000 NODES=3810	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.22	? (TO) TT=1800.19	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=1295.94 ASSIGNMENTS=3810 CHECKS=2540110000	SAT TT=1265 ASSIGNMENTS=3810 CHECKS=2540100000	? (problem) TT=0.428	? (problem) TT=0.421	? (TO) TT=1800.03	? (TO) TT=1800.09	Wrong UNSAT TT=25.894	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=0.776	? TT=664.648	? TT=647.761
csp/fapp/fapp39/ normalized-fapp39-2750-6.xml	SAT TT=1499.85	SAT TT=1661.98 CHECKS=3090810000 NODES=4101	SAT TT=1738.17 CHECKS=3090650000 NODES=4101	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.24	? (TO) TT=1800.28	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=1499.85 ASSIGNMENTS=4101 CHECKS=3080200000	SAT TT=1579.99 ASSIGNMENTS=4101 CHECKS=3080430000	? (problem) TT=0.47	? (problem) TT=0.601	? (TO) TT=1800.09	? (TO) TT=1800.09	Wrong UNSAT TT=24.912	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.816	? TT=643.626	? TT=650.326
csp/fapp/fapp39/ normalized-fapp39-2750-9.xml		? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.21	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (problem) TT=0.552	? (problem) TT=0.45	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=24.914	? (TO) TT=1800.09	? (TO) TT=1800.11	? TT=0.803	? TT=622.692	? TT=646.443
csp/fapp/fapp40/ normalized-fapp40-3000-2.xml	UNSAT TT=43.006	UNSAT TT=44.349 CHECKS=4768650 NODES=0	UNSAT TT=43.006 CHECKS=4768650 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (problem) TT=83.419	? (problem) TT=77.724	? TT=664.799	? (TO) TT=843.74	? (TO) TT=844.28	UNSAT TT=692.994 ASSIGNMENTS=0 CHECKS=4768650	UNSAT TT=686.689 ASSIGNMENTS=0 CHECKS=4768650	? (problem) TT=0.458	? (problem) TT=0.451	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=56.632	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=0.812	? TT=650.389	? TT=655.208
csp/fapp/fapp40/ normalized-fapp40-3000-3.xml	UNSAT TT=44.642	UNSAT TT=44.642 CHECKS=4570620 NODES=0	UNSAT TT=44.88 CHECKS=4570620 NODES=0	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (problem) TT=89.69	? (problem) TT=84.367	? TT=572.058	? (TO) TT=866.23	? (TO) TT=854.51	UNSAT TT=645.201 ASSIGNMENTS=0 CHECKS=4570620	UNSAT TT=625.197 ASSIGNMENTS=0 CHECKS=4570620	? (problem) TT=0.422	? (problem) TT=0.422	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=60.008	? (TO) TT=1800.17	? (TO) TT=1800.12	? TT=0.815	? TT=640.526	? TT=611.91
csp/fapp/fapp40/ normalized-fapp40-3000-7.xml	SAT TT=72.287	SAT TT=78.214 CHECKS=61172000 NODES=3004	SAT TT=72.287 CHECKS=61181600 NODES=3004	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.05	? (problem) TT=83.158	? (problem) TT=76.663	? TT=587.281	? (TO) TT=887.26	? (TO) TT=825.86	SAT TT=651.993 ASSIGNMENTS=3004 CHECKS=61192800	SAT TT=684.029 ASSIGNMENTS=3004 CHECKS=61181600	? (problem) TT=0.451	? (problem) TT=0.458	? (TO) TT=1800.12	? (TO) TT=1800.05	Wrong UNSAT TT=56.881	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=0.839	? TT=694.72	? TT=612.659
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapGraphsMod/ normalized-graph12-w0.xml	SAT TT=0.085	SAT TT=2.169 CHECKS=26373 NODES=680	SAT TT=2.086 CHECKS=30060 NODES=0	SAT TT=0.156	SAT TT=36.379 CHECKS=6510070	SAT TT=4.444 CHECKS=2211930	SAT TT=1.253 ASSIGNMENTS=341	SAT TT=1.342 ASSIGNMENTS=341	SAT TT=1.166 CHECKS=24408 NODES=680	SAT TT=1.209 CHECKS=93540 NODES=324	SAT TT=1.198 CHECKS=148620 NODES=324	SAT TT=0.11 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.104 ASSIGNMENTS=340 CHECKS=680	SAT TT=15.206	SAT TT=12.616	SAT TT=0.094 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.085 ASSIGNMENTS=340 CHECKS=680	SAT TT=1.218	SAT TT=0.111 ASSIGNMENTS=340 CHECKS=680	SAT TT=0.096 ASSIGNMENTS=340 CHECKS=680	SAT TT=3.647	SAT TT=2.959	SAT TT=2.99
csp/rlfapGraphsMod/ normalized-graph12-w1.xml	UNSAT TT=0.209	UNSAT TT=2.067 CHECKS=372790 NODES=437	UNSAT TT=1.711 CHECKS=49562 NODES=0	? (TO) TT=1800.04	UNSAT TT=2.559 CHECKS=158798	UNSAT TT=0.325 CHECKS=164912	UNSAT TT=1.956 ASSIGNMENTS=0	UNSAT TT=2.061 ASSIGNMENTS=0	UNSAT TT=3.628 CHECKS=42831 NODES=25	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=0.209 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=0.218 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=68.461	UNSAT TT=69.315	UNSAT TT=0.295 ASSIGNMENTS=85 CHECKS=10554	UNSAT TT=5.782 ASSIGNMENTS=11341 CHECKS=451559	UNSAT TT=101.81	UNSAT TT=0.74 ASSIGNMENTS=828 CHECKS=39462	UNSAT TT=0.219 ASSIGNMENTS=15 CHECKS=4010	UNSAT TT=7.507	UNSAT TT=4.064	UNSAT TT=4.794
csp/rlfapGraphsMod/ normalized-graph13-w0.xml	SAT TT=0.123	SAT TT=3.768 CHECKS=36495 NODES=916	SAT TT=3.265 CHECKS=41113 NODES=0	SAT TT=0.211	SAT TT=36.996 CHECKS=5732920	SAT TT=5.189 CHECKS=1954350	SAT TT=1.548 ASSIGNMENTS=459	SAT TT=1.566 ASSIGNMENTS=459	SAT TT=1.442 CHECKS=34046 NODES=916	SAT TT=1.767 CHECKS=129438 NODES=445	SAT TT=1.494 CHECKS=231572 NODES=445	SAT TT=0.134 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.139 ASSIGNMENTS=458 CHECKS=916	SAT TT=18.098	SAT TT=16.244	SAT TT=0.128 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.123 ASSIGNMENTS=458 CHECKS=916	SAT TT=1.529	SAT TT=0.143 ASSIGNMENTS=458 CHECKS=916	SAT TT=0.125 ASSIGNMENTS=458 CHECKS=916	SAT TT=4.252	SAT TT=3.669	SAT TT=4.186
csp/rlfapGraphsMod/ normalized-graph13-w1.xml	UNSAT TT=0.265	UNSAT TT=2.352 CHECKS=430640 NODES=416	UNSAT TT=2.058 CHECKS=40924 NODES=0	UNSAT TT=1340.48	UNSAT TT=3.858 CHECKS=263217	UNSAT TT=0.528 CHECKS=275302	UNSAT TT=1.872 ASSIGNMENTS=0	UNSAT TT=1.772 ASSIGNMENTS=0	UNSAT TT=4.186 CHECKS=37250 NODES=13	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.265 ASSIGNMENTS=11 CHECKS=5004	UNSAT TT=0.268 ASSIGNMENTS=11 CHECKS=5004	UNSAT TT=98.236	UNSAT TT=86.968	UNSAT TT=0.416 ASSIGNMENTS=58 CHECKS=15543	UNSAT TT=7.787 ASSIGNMENTS=12379 CHECKS=566067	UNSAT TT=1.596	UNSAT TT=15.46 ASSIGNMENTS=21782 CHECKS=1003740	UNSAT TT=0.302 ASSIGNMENTS=13 CHECKS=5726	UNSAT TT=9.225	UNSAT TT=5.109	UNSAT TT=6.026
csp/rlfapGraphsMod/ normalized-graph14-f28.xml	UNSAT TT=0.611	UNSAT TT=5.572 CHECKS=2827300 NODES=11553	UNSAT TT=29.257 CHECKS=11764300 NODES=756	? (TO) TT=1800.08	UNSAT TT=319.439 CHECKS=16788100	? (TO) TT=1800.04	UNSAT TT=4.903 ASSIGNMENTS=60	UNSAT TT=4.573 ASSIGNMENTS=60	UNSAT TT=7.166 CHECKS=28784 NODES=98	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=0.854 ASSIGNMENTS=2630 CHECKS=338944	UNSAT TT=0.839 ASSIGNMENTS=2630 CHECKS=338944	UNSAT TT=34.784	UNSAT TT=32.943	UNSAT TT=0.611 ASSIGNMENTS=1496 CHECKS=208181	UNSAT TT=4.358 ASSIGNMENTS=13026 CHECKS=2078880	? (TO) TT=1800.12	UNSAT TT=59.33 ASSIGNMENTS=124843 CHECKS=27501900	UNSAT TT=2.632 ASSIGNMENTS=8813 CHECKS=1298650	UNSAT TT=9.531	UNSAT TT=4.468	UNSAT TT=6.345
csp/rlfapGraphsMod/ normalized-graph2-f24.xml	SAT TT=0.16	SAT TT=2.277 CHECKS=180188 NODES=836	SAT TT=6.047 CHECKS=7611710 NODES=1040	SAT TT=0.379	SAT TT=3.342 CHECKS=1586100	? (TO) TT=1800.08	SAT TT=3.014 ASSIGNMENTS=179	SAT TT=3.039 ASSIGNMENTS=179	SAT TT=3.937 CHECKS=88922 NODES=1122	SAT TT=11.886 CHECKS=45641200 NODES=169800	? (TO) TT=1800.07	SAT TT=0.186 ASSIGNMENTS=215 CHECKS=24475	SAT TT=0.185 ASSIGNMENTS=215 CHECKS=24475	SAT TT=31.219	SAT TT=34.229	SAT TT=0.16 ASSIGNMENTS=210 CHECKS=24312	SAT TT=3.699 ASSIGNMENTS=12817 CHECKS=1565760	? (TO) TT=1800.1	SAT TT=2.503 ASSIGNMENTS=3892 CHECKS=759946	SAT TT=0.191 ASSIGNMENTS=228 CHECKS=27009	SAT TT=7.046	SAT TT=3.594	SAT TT=3.65
csp/rlfapGraphsMod/ normalized-graph8-f10.xml	SAT TT=1.474	SAT TT=4.051 CHECKS=1454430 NODES=3640	SAT TT=4.361 CHECKS=1292430 NODES=2704	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=5.769 ASSIGNMENTS=1434	SAT TT=5.859 ASSIGNMENTS=1434	SAT TT=9.546 CHECKS=404794 NODES=2815	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.281 ASSIGNMENTS=2351 CHECKS=521685	SAT TT=11.216 ASSIGNMENTS=3640 CHECKS=1454430	SAT TT=79.854	SAT TT=83.725	SAT TT=1.821 ASSIGNMENTS=2697 CHECKS=692904	SAT TT=8.12 ASSIGNMENTS=17992 CHECKS=2813080	? (TO) TT=1800.1	SAT TT=15.045 ASSIGNMENTS=19962 CHECKS=4487820	SAT TT=1.474 ASSIGNMENTS=2351 CHECKS=521685	SAT TT=13.333	SAT TT=17.837	SAT TT=8.754
csp/rlfapGraphsMod/ normalized-graph8-f11.xml	UNSAT TT=0.536	UNSAT TT=4.9 CHECKS=4604290 NODES=5841	UNSAT TT=5.331 CHECKS=4097270 NODES=2898	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=4.788 ASSIGNMENTS=44	UNSAT TT=4.888 ASSIGNMENTS=44	UNSAT TT=6.871 CHECKS=45530 NODES=89	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=11.852 ASSIGNMENTS=5841 CHECKS=4604290	UNSAT TT=13.005 ASSIGNMENTS=5841 CHECKS=4604290	UNSAT TT=78.09	UNSAT TT=77.649	UNSAT TT=2.628 ASSIGNMENTS=4420 CHECKS=1276860	UNSAT TT=6.813 ASSIGNMENTS=13018 CHECKS=2408860	? (TO) TT=1800.06	UNSAT TT=2.868 ASSIGNMENTS=3515 CHECKS=824129	UNSAT TT=0.536 ASSIGNMENTS=477 CHECKS=128676	UNSAT TT=11.885	UNSAT TT=6.302	UNSAT TT=8.057
csp/rlfapGraphsMod/ normalized-graph9-f10.xml	UNSAT TT=0.969	UNSAT TT=6.925 CHECKS=6824400 NODES=8649	UNSAT TT=7.674 CHECKS=8142880 NODES=9257	? (TO) TT=1800.11	UNSAT TT=217.241 CHECKS=13085300	? (TO) TT=1800.03	UNSAT TT=6.302 ASSIGNMENTS=8	UNSAT TT=7.134 ASSIGNMENTS=8	UNSAT TT=14.874 CHECKS=511133 NODES=2336	? (TO) TT=1800.1	? (TO) TT=1800.04	UNSAT TT=1.314 ASSIGNMENTS=1042 CHECKS=393813	UNSAT TT=1.161 ASSIGNMENTS=1042 CHECKS=393813	UNSAT TT=64.761	UNSAT TT=65.829	UNSAT TT=0.969 ASSIGNMENTS=753 CHECKS=284684	UNSAT TT=11.126 ASSIGNMENTS=17622 CHECKS=3880640	? (TO) TT=1800.07	UNSAT TT=3.706 ASSIGNMENTS=4385 CHECKS=956685	UNSAT TT=6.393 ASSIGNMENTS=8708 CHECKS=3007850	UNSAT TT=17.519	UNSAT TT=8.281	UNSAT TT=10.442
csp/rlfapGraphsMod/ normalized-graph9-f9.xml	SAT TT=0.95	SAT TT=6.054 CHECKS=4193910 NODES=6974	SAT TT=6.367 CHECKS=4379440 NODES=6847	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=9.731 ASSIGNMENTS=4869	SAT TT=9.814 ASSIGNMENTS=4869	SAT TT=46.158 CHECKS=2924930 NODES=18042	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=12.577 ASSIGNMENTS=6974 CHECKS=4193910	SAT TT=13.059 ASSIGNMENTS=6974 CHECKS=4193910	SAT TT=73.708	SAT TT=69.983	SAT TT=1.118 ASSIGNMENTS=1702 CHECKS=347961	SAT TT=14.289 ASSIGNMENTS=28695 CHECKS=5020480	? (TO) TT=1800.12	SAT TT=46.577 ASSIGNMENTS=72521 CHECKS=19087000	SAT TT=0.95 ASSIGNMENTS=1379 CHECKS=276578	SAT TT=22.848	SAT TT=36.627	SAT TT=13.029
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapGraphs/ normalized-graph10.xml	SAT TT=1.015	SAT TT=4.103 CHECKS=741372 NODES=932	SAT TT=4.428 CHECKS=3635170 NODES=683	SAT TT=1342.64	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=36.267 ASSIGNMENTS=241	SAT TT=36.59 ASSIGNMENTS=241	SAT TT=8.381 CHECKS=208650 NODES=687	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1.015 ASSIGNMENTS=215 CHECKS=116751	SAT TT=1.038 ASSIGNMENTS=215 CHECKS=116751	SAT TT=219.55	SAT TT=190.876	SAT TT=1.336 ASSIGNMENTS=342 CHECKS=204388	SAT TT=5.693 ASSIGNMENTS=630 CHECKS=793963	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1.027 ASSIGNMENTS=212 CHECKS=116453	SAT TT=17.812	SAT TT=9.686	SAT TT=11.603
csp/rlfapGraphs/ normalized-graph11.xml	UNSAT TT=0.271	UNSAT TT=3.038 CHECKS=4088 NODES=0	UNSAT TT=3.278 CHECKS=4088 NODES=0	UNSAT TT=0.644	UNSAT TT=2.894 CHECKS=512465	UNSAT TT=0.494 CHECKS=443375	UNSAT TT=2.996 ASSIGNMENTS=0	UNSAT TT=3.082 ASSIGNMENTS=0	UNSAT TT=9.013 CHECKS=5027 NODES=0	UNSAT TT=8.963 CHECKS=6090 NODES=0	UNSAT TT=8.54 CHECKS=6090 NODES=0	UNSAT TT=0.271 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.295 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=361.391	UNSAT TT=354.656	UNSAT TT=0.283 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.275 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=2.53	UNSAT TT=0.278 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=0.286 ASSIGNMENTS=0 CHECKS=2410	UNSAT TT=14.934	UNSAT TT=7.274	UNSAT TT=9.674
csp/rlfapGraphs/ normalized-graph14.xml	SAT TT=0.563	SAT TT=5.07 CHECKS=280166 NODES=916	SAT TT=3.841 CHECKS=293518 NODES=0	SAT TT=0.852	SAT TT=6.898 CHECKS=103037	SAT TT=21.538 CHECKS=198701	SAT TT=7.304 ASSIGNMENTS=459	SAT TT=6.907 ASSIGNMENTS=459	SAT TT=8.493 CHECKS=204857 NODES=916	SAT TT=7.475 CHECKS=1125240 NODES=734	SAT TT=7.973 CHECKS=3209380 NODES=721	SAT TT=0.644 ASSIGNMENTS=458 CHECKS=27646	SAT TT=0.617 ASSIGNMENTS=458 CHECKS=27646	SAT TT=55.396	SAT TT=50.221	SAT TT=0.563 ASSIGNMENTS=458 CHECKS=27646	SAT TT=0.601 ASSIGNMENTS=458 CHECKS=29773	? (TO) TT=1800.03	SAT TT=1.191 ASSIGNMENTS=457 CHECKS=35749	SAT TT=0.657 ASSIGNMENTS=458 CHECKS=27280	SAT TT=19.277	SAT TT=11.096	SAT TT=14.108
csp/rlfapGraphs/ normalized-graph1.xml	SAT TT=0.136	SAT TT=1.588 CHECKS=62401 NODES=200	SAT TT=1.574 CHECKS=65702 NODES=0	SAT TT=0.218	SAT TT=0.607 CHECKS=20520	SAT TT=0.115 CHECKS=22738	SAT TT=2.659 ASSIGNMENTS=101	SAT TT=2.523 ASSIGNMENTS=101	SAT TT=2.987 CHECKS=42183 NODES=200	SAT TT=3.037 CHECKS=240144 NODES=159	SAT TT=3.06 CHECKS=389011 NODES=172	SAT TT=0.169 ASSIGNMENTS=100 CHECKS=9591	SAT TT=0.167 ASSIGNMENTS=100 CHECKS=9591	SAT TT=33.63	SAT TT=33.827	SAT TT=0.152 ASSIGNMENTS=100 CHECKS=9591	SAT TT=0.136 ASSIGNMENTS=96 CHECKS=8256	SAT TT=39.11	SAT TT=0.138 ASSIGNMENTS=99 CHECKS=10298	SAT TT=0.149 ASSIGNMENTS=100 CHECKS=9512	SAT TT=7.187	SAT TT=3.186	SAT TT=3.66
csp/rlfapGraphs/ normalized-graph2.xml	SAT TT=0.298	SAT TT=2.327 CHECKS=133861 NODES=400	SAT TT=2.332 CHECKS=140191 NODES=0	SAT TT=0.414	SAT TT=1.676 CHECKS=64619	SAT TT=1.299 CHECKS=111303	SAT TT=3.726 ASSIGNMENTS=201	SAT TT=3.771 ASSIGNMENTS=201	SAT TT=4.654 CHECKS=88161 NODES=401	SAT TT=4.321 CHECKS=506348 NODES=317	SAT TT=4.439 CHECKS=908426 NODES=289	SAT TT=0.317 ASSIGNMENTS=200 CHECKS=16863	SAT TT=0.303 ASSIGNMENTS=200 CHECKS=16863	SAT TT=42.592	SAT TT=44.046	SAT TT=0.326 ASSIGNMENTS=200 CHECKS=16863	SAT TT=0.308 ASSIGNMENTS=200 CHECKS=16138	? (TO) TT=1800.03	SAT TT=0.298 ASSIGNMENTS=199 CHECKS=18762	SAT TT=0.304 ASSIGNMENTS=200 CHECKS=17038	SAT TT=10.487	SAT TT=5.161	SAT TT=6.768
csp/rlfapGraphs/ normalized-graph4.xml	SAT TT=0.351	SAT TT=2.807 CHECKS=398868 NODES=565	SAT TT=2.478 CHECKS=706300 NODES=0	SAT TT=0.424	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=20.236 ASSIGNMENTS=180	SAT TT=17.841 ASSIGNMENTS=180	SAT TT=5.838 CHECKS=209481 NODES=478	? (TO) TT=1800	SAT TT=5.653 CHECKS=1986800 NODES=1402	SAT TT=0.395 ASSIGNMENTS=170 CHECKS=23928	SAT TT=0.378 ASSIGNMENTS=170 CHECKS=23928	SAT TT=129.377	SAT TT=116.961	SAT TT=0.351 ASSIGNMENTS=170 CHECKS=23928	SAT TT=0.553 ASSIGNMENTS=159 CHECKS=62098	? (TO) TT=1800.14	SAT TT=156.993 ASSIGNMENTS=19704 CHECKS=18022300	SAT TT=0.359 ASSIGNMENTS=181 CHECKS=22642	SAT TT=12.411	SAT TT=5.423	SAT TT=7.058
csp/rlfapGraphs/ normalized-graph6.xml	UNSAT TT=0.13	UNSAT TT=2.146 CHECKS=4115 NODES=0	UNSAT TT=2.148 CHECKS=4115 NODES=0	UNSAT TT=0.366	UNSAT TT=1.438 CHECKS=197452	UNSAT TT=0.265 CHECKS=223120	UNSAT TT=2.079 ASSIGNMENTS=0	UNSAT TT=2.462 ASSIGNMENTS=0	UNSAT TT=5.601 CHECKS=6036 NODES=0	UNSAT TT=5.028 CHECKS=9331 NODES=0	UNSAT TT=5.421 CHECKS=9331 NODES=0	UNSAT TT=0.146 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.152 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=151.306	UNSAT TT=176.41	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.134 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=1.764	UNSAT TT=0.13 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=0.135 ASSIGNMENTS=0 CHECKS=705	UNSAT TT=9.66	UNSAT TT=5.191	UNSAT TT=6.528
csp/rlfapGraphs/ normalized-graph7.xml	UNSAT TT=0.124	UNSAT TT=2.114 CHECKS=3567 NODES=0	UNSAT TT=2.149 CHECKS=3567 NODES=0	UNSAT TT=0.39	UNSAT TT=1.388 CHECKS=131592	UNSAT TT=0.143 CHECKS=37561	UNSAT TT=2.396 ASSIGNMENTS=0	UNSAT TT=2.227 ASSIGNMENTS=0	UNSAT TT=6.159 CHECKS=4870 NODES=0	UNSAT TT=5.906 CHECKS=8544 NODES=0	UNSAT TT=5.75 CHECKS=8544 NODES=0	UNSAT TT=0.138 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.138 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=179.881	UNSAT TT=195.481	UNSAT TT=0.127 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.124 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=1.998	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=0.126 ASSIGNMENTS=0 CHECKS=686	UNSAT TT=9.216	UNSAT TT=5.132	UNSAT TT=6.089
csp/rlfapGraphs/ normalized-graph8.xml	SAT TT=0.492	SAT TT=3.872 CHECKS=209983 NODES=680	SAT TT=3.165 CHECKS=369394 NODES=0	SAT TT=0.639	SAT TT=5.74 CHECKS=178952	SAT TT=14.526 CHECKS=455575	SAT TT=12.037 ASSIGNMENTS=340	SAT TT=6.094 ASSIGNMENTS=340	SAT TT=8.096 CHECKS=153423 NODES=681	SAT TT=6.702 CHECKS=1059770 NODES=877	SAT TT=7.503 CHECKS=2480420 NODES=714	SAT TT=0.541 ASSIGNMENTS=339 CHECKS=31071	SAT TT=0.575 ASSIGNMENTS=339 CHECKS=31071	SAT TT=89.176	SAT TT=96.058	SAT TT=0.508 ASSIGNMENTS=339 CHECKS=31071	SAT TT=0.492 ASSIGNMENTS=331 CHECKS=29033	? (TO) TT=1800.03	SAT TT=3.418 ASSIGNMENTS=2720 CHECKS=363800	SAT TT=0.509 ASSIGNMENTS=340 CHECKS=31900	SAT TT=16.368	SAT TT=9.518	SAT TT=10.772
csp/rlfapGraphs/ normalized-graph9.xml	SAT TT=0.644	SAT TT=4.705 CHECKS=283755 NODES=916	SAT TT=3.917 CHECKS=296646 NODES=0	SAT TT=0.96	SAT TT=61.296 CHECKS=746374	SAT TT=145.043 CHECKS=1383040	SAT TT=9.167 ASSIGNMENTS=458	SAT TT=8.541 ASSIGNMENTS=458	SAT TT=11.144 CHECKS=268141 NODES=1362	SAT TT=9.549 CHECKS=1605020 NODES=1185	SAT TT=9.92 CHECKS=4217320 NODES=926	SAT TT=0.79 ASSIGNMENTS=456 CHECKS=43681	SAT TT=0.72 ASSIGNMENTS=456 CHECKS=43681	SAT TT=82.869	SAT TT=76.261	SAT TT=0.644 ASSIGNMENTS=456 CHECKS=43681	SAT TT=0.686 ASSIGNMENTS=455 CHECKS=43623	? (TO) TT=1800.03	SAT TT=4.255 ASSIGNMENTS=3652 CHECKS=534973	SAT TT=0.727 ASSIGNMENTS=458 CHECKS=44150	SAT TT=21.03	SAT TT=15.525	SAT TT=15.608
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens11/ normalized-scen11-f10.xml	UNSAT TT=0.722	UNSAT TT=2.696 CHECKS=440330 NODES=253	UNSAT TT=2.724 CHECKS=65045 NODES=0	? (TO) TT=1800.07	UNSAT TT=2.184 CHECKS=699353	UNSAT TT=1.016 CHECKS=1301930	UNSAT TT=6.058 ASSIGNMENTS=1091	UNSAT TT=6.604 ASSIGNMENTS=1091	UNSAT TT=6.286 CHECKS=76733 NODES=221	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=0.796 ASSIGNMENTS=670 CHECKS=205926	UNSAT TT=0.816 ASSIGNMENTS=670 CHECKS=205926	UNSAT TT=27.202	UNSAT TT=25.308	UNSAT TT=0.759 ASSIGNMENTS=661 CHECKS=204618	UNSAT TT=7.548 ASSIGNMENTS=19771 CHECKS=2888340	? (TO) TT=1800.1	UNSAT TT=6.373 ASSIGNMENTS=7751 CHECKS=1985340	UNSAT TT=0.722 ASSIGNMENTS=495 CHECKS=165159	UNSAT TT=12.726	UNSAT TT=7.214	UNSAT TT=9.202
csp/rlfapScens11/ normalized-scen11-f12.xml	UNSAT TT=0.649	UNSAT TT=2.554 CHECKS=15780 NODES=0	UNSAT TT=2.484 CHECKS=15780 NODES=0	? (TO) TT=1800.11	UNSAT TT=1.744 CHECKS=324105	UNSAT TT=0.904 CHECKS=1067550	UNSAT TT=5.957 ASSIGNMENTS=845	UNSAT TT=6.446 ASSIGNMENTS=845	UNSAT TT=6.042 CHECKS=55192 NODES=144	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=0.702 ASSIGNMENTS=468 CHECKS=162266	UNSAT TT=0.671 ASSIGNMENTS=468 CHECKS=162266	UNSAT TT=24.03	UNSAT TT=24.23	UNSAT TT=0.699 ASSIGNMENTS=464 CHECKS=169037	UNSAT TT=6.494 ASSIGNMENTS=17387 CHECKS=2561700	UNSAT TT=1538.39	UNSAT TT=23.231 ASSIGNMENTS=24760 CHECKS=7633420	UNSAT TT=0.649 ASSIGNMENTS=470 CHECKS=162458	UNSAT TT=12.164	UNSAT TT=8.109	UNSAT TT=8.875
csp/rlfapScens11/ normalized-scen11-f1.xml	UNSAT TT=14.377	UNSAT TT=30.993 CHECKS=131930000 NODES=66963	UNSAT TT=30.52 CHECKS=138782000 NODES=70985	? (TO) TT=1800.07	UNSAT TT=631.624 CHECKS=64180300	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	UNSAT TT=14.377	UNSAT TT=17.761
csp/rlfapScens11/ normalized-scen11-f2.xml	UNSAT TT=12.614	UNSAT TT=12.614 CHECKS=47183500 NODES=25784	UNSAT TT=13.999 CHECKS=49401700 NODES=25606	? (TO) TT=1800.08	UNSAT TT=571.218 CHECKS=37298800	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=13.72	UNSAT TT=17.555
csp/rlfapScens11/ normalized-scen11-f3.xml	UNSAT TT=5.851	UNSAT TT=5.851 CHECKS=13528400 NODES=6753	UNSAT TT=6.292 CHECKS=14707200 NODES=7440	? (TO) TT=1800.05	UNSAT TT=164.453 CHECKS=19031900	UNSAT TT=448.332 CHECKS=25253900	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=1621.81 CHECKS=273269000 NODES=758734	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=438.425	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=533.09 ASSIGNMENTS=744794 CHECKS=201986000	? (TO) TT=1800.09	UNSAT TT=656.602 ASSIGNMENTS=812217 CHECKS=230211000	UNSAT TT=664.886 ASSIGNMENTS=819349 CHECKS=235452000	? (TO) TT=1800.17	UNSAT TT=10.161	UNSAT TT=13.951
csp/rlfapScens11/ normalized-scen11-f4.xml	UNSAT TT=3.566	UNSAT TT=4.21 CHECKS=5082700 NODES=2340	UNSAT TT=3.566 CHECKS=1974780 NODES=1093	? (TO) TT=1800.07	UNSAT TT=12.172 CHECKS=5250390	UNSAT TT=112.373 CHECKS=14684000	? (TO) TT=1800.08	? (TO) TT=1800.12	UNSAT TT=477.351 CHECKS=78497300 NODES=215384	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=182.534	UNSAT TT=238.347	UNSAT TT=1260.05 ASSIGNMENTS=1702530 CHECKS=507298000	UNSAT TT=165.312 ASSIGNMENTS=235699 CHECKS=62847800	? (TO) TT=1800.11	UNSAT TT=207.419 ASSIGNMENTS=253131 CHECKS=76492100	UNSAT TT=198.959 ASSIGNMENTS=251780 CHECKS=74216300	UNSAT TT=372.474	UNSAT TT=9.079	UNSAT TT=12.395
csp/rlfapScens11/ normalized-scen11-f5.xml	UNSAT TT=2.724	UNSAT TT=3.431 CHECKS=2132660 NODES=927	UNSAT TT=2.724 CHECKS=132780 NODES=0	? (TO) TT=1800.07	UNSAT TT=10.117 CHECKS=7068680	UNSAT TT=4.801 CHECKS=6659070	UNSAT TT=664.781 ASSIGNMENTS=923708	UNSAT TT=604.668 ASSIGNMENTS=923708	UNSAT TT=113.569 CHECKS=18503400 NODES=45894	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=713.381 ASSIGNMENTS=2208820 CHECKS=2613080000	UNSAT TT=661.042 ASSIGNMENTS=2208820 CHECKS=2613080000	UNSAT TT=41.806	UNSAT TT=73.23	UNSAT TT=390.947 ASSIGNMENTS=500970 CHECKS=160232000	UNSAT TT=55.746 ASSIGNMENTS=84226 CHECKS=18836900	? (TO) TT=1800.12	UNSAT TT=57.576 ASSIGNMENTS=65817 CHECKS=19491000	UNSAT TT=52.015 ASSIGNMENTS=60738 CHECKS=18224900	UNSAT TT=65.271	UNSAT TT=8.054	UNSAT TT=10.475
csp/rlfapScens11/ normalized-scen11-f6.xml	UNSAT TT=2.923	UNSAT TT=3.238 CHECKS=1194890 NODES=540	UNSAT TT=2.923 CHECKS=78540 NODES=0	? (TO) TT=1800.03	UNSAT TT=3.739 CHECKS=1830160	UNSAT TT=1.753 CHECKS=2779450	UNSAT TT=108.029 ASSIGNMENTS=110191	UNSAT TT=112.737 ASSIGNMENTS=110191	UNSAT TT=30.43 CHECKS=3979890 NODES=10690	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=112.12 ASSIGNMENTS=341772 CHECKS=423566000	UNSAT TT=112.167 ASSIGNMENTS=341772 CHECKS=423566000	UNSAT TT=29.694	UNSAT TT=26.788	UNSAT TT=108.591 ASSIGNMENTS=134685 CHECKS=40136400	UNSAT TT=20.84 ASSIGNMENTS=42235 CHECKS=6207020	? (TO) TT=1800.12	UNSAT TT=27.469 ASSIGNMENTS=34822 CHECKS=9403820	UNSAT TT=11.051 ASSIGNMENTS=12800 CHECKS=3850270	UNSAT TT=25.647	UNSAT TT=7.81	UNSAT TT=10.653
csp/rlfapScens11/ normalized-scen11-f7.xml	UNSAT TT=2.78	UNSAT TT=2.858 CHECKS=981683 NODES=456	UNSAT TT=2.78 CHECKS=60873 NODES=0	? (TO) TT=1800.08	UNSAT TT=2.902 CHECKS=1398620	UNSAT TT=1.513 CHECKS=2328230	UNSAT TT=40.677 ASSIGNMENTS=47519	UNSAT TT=43.896 ASSIGNMENTS=47519	UNSAT TT=19.027 CHECKS=2230100 NODES=5749	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=47.638 ASSIGNMENTS=124244 CHECKS=149291000	UNSAT TT=47.729 ASSIGNMENTS=124244 CHECKS=149291000	UNSAT TT=29.588	UNSAT TT=29.172	UNSAT TT=62.705 ASSIGNMENTS=77568 CHECKS=24159400	UNSAT TT=30.54 ASSIGNMENTS=52458 CHECKS=10581500	? (TO) TT=1800.07	UNSAT TT=26.926 ASSIGNMENTS=33275 CHECKS=9370010	UNSAT TT=6.543 ASSIGNMENTS=7489 CHECKS=2316300	UNSAT TT=19.429	UNSAT TT=7.611	UNSAT TT=10.509
csp/rlfapScens11/ normalized-scen11-f8.xml	UNSAT TT=1.421	UNSAT TT=2.92 CHECKS=569369 NODES=230	UNSAT TT=2.573 CHECKS=54753 NODES=0	? (TO) TT=1800.06	UNSAT TT=3.226 CHECKS=1659280	UNSAT TT=1.171 CHECKS=1603920	UNSAT TT=13.907 ASSIGNMENTS=6305	UNSAT TT=12.964 ASSIGNMENTS=6305	UNSAT TT=7.457 CHECKS=402055 NODES=671	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=15.076 ASSIGNMENTS=13827 CHECKS=17383000	UNSAT TT=14.567 ASSIGNMENTS=13827 CHECKS=17383000	UNSAT TT=38.406	UNSAT TT=48.459	UNSAT TT=9.743 ASSIGNMENTS=11373 CHECKS=3502050	UNSAT TT=13.938 ASSIGNMENTS=31462 CHECKS=4210700	? (TO) TT=1800.03	UNSAT TT=13.359 ASSIGNMENTS=15815 CHECKS=4021800	UNSAT TT=1.421 ASSIGNMENTS=1200 CHECKS=397406	UNSAT TT=13.544	UNSAT TT=7.764	UNSAT TT=9.662
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens11/ normalized-scen11-f9.xml	UNSAT TT=1.963	UNSAT TT=3.016 CHECKS=518692 NODES=266	UNSAT TT=2.631 CHECKS=51021 NODES=0	? (TO) TT=1800.1	UNSAT TT=2.203 CHECKS=864547	UNSAT TT=1.132 CHECKS=1555510	UNSAT TT=9.242 ASSIGNMENTS=3540	UNSAT TT=10.079 ASSIGNMENTS=3540	UNSAT TT=7.55 CHECKS=258832 NODES=407	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=12.846 ASSIGNMENTS=7920 CHECKS=9831370	UNSAT TT=13.461 ASSIGNMENTS=7920 CHECKS=9831370	UNSAT TT=27.741	UNSAT TT=28.904	UNSAT TT=7.452 ASSIGNMENTS=8666 CHECKS=2798290	UNSAT TT=10.231 ASSIGNMENTS=27126 CHECKS=3851640	? (TO) TT=1800.07	UNSAT TT=10.155 ASSIGNMENTS=12355 CHECKS=3184770	UNSAT TT=1.963 ASSIGNMENTS=1892 CHECKS=628991	UNSAT TT=13.95	UNSAT TT=6.973	UNSAT TT=9.644
csp/rlfapScensMod/ normalized-scen10-w1-f3.xml	UNSAT TT=0.229	UNSAT TT=1.578 CHECKS=35049 NODES=0	UNSAT TT=1.556 CHECKS=35049 NODES=0	UNSAT TT=0.276	UNSAT TT=3.764 CHECKS=642167	UNSAT TT=1.053 CHECKS=762694	UNSAT TT=1.947 ASSIGNMENTS=0	UNSAT TT=1.94 ASSIGNMENTS=0	UNSAT TT=2.754 CHECKS=63484 NODES=52	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.255 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=0.229 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=31.691	UNSAT TT=29.052	UNSAT TT=0.243 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=4.815 ASSIGNMENTS=17867 CHECKS=628729	? (TO) TT=1800.08	UNSAT TT=5.816 ASSIGNMENTS=11290 CHECKS=671534	UNSAT TT=0.236 ASSIGNMENTS=117 CHECKS=8548	UNSAT TT=6.761	UNSAT TT=3.584	UNSAT TT=4.635
csp/rlfapScensMod/ normalized-scen1-f9.xml	UNSAT TT=0.906	UNSAT TT=5.248 CHECKS=5581360 NODES=4466	UNSAT TT=5.448 CHECKS=5947820 NODES=4414	? (TO) TT=1800.05	UNSAT TT=9.058 CHECKS=4755950	UNSAT TT=108.054 CHECKS=7408920	UNSAT TT=7.491 ASSIGNMENTS=822	UNSAT TT=7.732 ASSIGNMENTS=822	UNSAT TT=9.961 CHECKS=73845 NODES=150	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.958 ASSIGNMENTS=475 CHECKS=206905	UNSAT TT=0.994 ASSIGNMENTS=475 CHECKS=206905	UNSAT TT=35.458	UNSAT TT=37.202	UNSAT TT=1.105 ASSIGNMENTS=728 CHECKS=290577	UNSAT TT=11.269 ASSIGNMENTS=32470 CHECKS=3819250	? (TO) TT=1800.1	UNSAT TT=11.786 ASSIGNMENTS=14133 CHECKS=3375760	UNSAT TT=0.906 ASSIGNMENTS=361 CHECKS=166635	UNSAT TT=16.527	UNSAT TT=9.886	UNSAT TT=12.46
csp/rlfapScensMod/ normalized-scen2-f24.xml	SAT TT=0.091	SAT TT=1.493 CHECKS=217815 NODES=408	SAT TT=1.617 CHECKS=391341 NODES=487	SAT TT=0.232	SAT TT=0.4 CHECKS=34824	SAT TT=1.45 CHECKS=549179	SAT TT=2.257 ASSIGNMENTS=132	SAT TT=2.422 ASSIGNMENTS=132	SAT TT=2.051 CHECKS=29251 NODES=322	SAT TT=2.043 CHECKS=400136 NODES=599	SAT TT=2.007 CHECKS=475172 NODES=284	SAT TT=0.102 ASSIGNMENTS=115 CHECKS=9590	SAT TT=0.104 ASSIGNMENTS=115 CHECKS=9590	SAT TT=8.21	SAT TT=7.945	SAT TT=0.091 ASSIGNMENTS=151 CHECKS=13024	SAT TT=0.36 ASSIGNMENTS=1451 CHECKS=131239	SAT TT=853.331	SAT TT=0.471 ASSIGNMENTS=730 CHECKS=167091	SAT TT=0.092 ASSIGNMENTS=124 CHECKS=10657	SAT TT=5.691	SAT TT=2.564	SAT TT=2.965
csp/rlfapScensMod/ normalized-scen2-f25.xml	UNSAT TT=0.518	UNSAT TT=4.314 CHECKS=13711300 NODES=10010	UNSAT TT=4.466 CHECKS=13887500 NODES=10048	? (TO) TT=1800.05	UNSAT TT=4.204 CHECKS=2472890	UNSAT TT=15.578 CHECKS=7390980	UNSAT TT=3.652 ASSIGNMENTS=1771	UNSAT TT=3.802 ASSIGNMENTS=1771	UNSAT TT=2.256 CHECKS=77534 NODES=404	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=0.67 ASSIGNMENTS=830 CHECKS=307138	UNSAT TT=0.663 ASSIGNMENTS=830 CHECKS=307138	UNSAT TT=7.734	UNSAT TT=7.444	UNSAT TT=0.667 ASSIGNMENTS=911 CHECKS=343901	UNSAT TT=2.44 ASSIGNMENTS=9894 CHECKS=1130520	UNSAT TT=969.642	UNSAT TT=1.446 ASSIGNMENTS=2668 CHECKS=625943	UNSAT TT=0.518 ASSIGNMENTS=569 CHECKS=227423	UNSAT TT=5.597	UNSAT TT=2.342	UNSAT TT=2.812
csp/rlfapScensMod/ normalized-scen3-f10.xml	SAT TT=0.359	SAT TT=2.393 CHECKS=281340 NODES=711	SAT TT=2.441 CHECKS=347563 NODES=541	SAT TT=0.46	SAT TT=4.54 CHECKS=2141050	SAT TT=7.27 CHECKS=2287680	SAT TT=3.859 ASSIGNMENTS=329	SAT TT=4.017 ASSIGNMENTS=329	SAT TT=4.073 CHECKS=75605 NODES=471	SAT TT=3.912 CHECKS=1253960 NODES=2018	SAT TT=3.768 CHECKS=1610590 NODES=638	SAT TT=0.375 ASSIGNMENTS=369 CHECKS=70090	SAT TT=0.388 ASSIGNMENTS=369 CHECKS=70090	SAT TT=19.201	SAT TT=18.616	SAT TT=0.392 ASSIGNMENTS=446 CHECKS=86223	SAT TT=5.661 ASSIGNMENTS=16394 CHECKS=2269480	? (TO) TT=1800.05	SAT TT=7.261 ASSIGNMENTS=7940 CHECKS=2449160	SAT TT=0.359 ASSIGNMENTS=362 CHECKS=74214	SAT TT=10.41	SAT TT=6.502	SAT TT=6.896
csp/rlfapScensMod/ normalized-scen3-f11.xml	UNSAT TT=0.584	UNSAT TT=3.624 CHECKS=3827460 NODES=4480	UNSAT TT=3.519 CHECKS=3931970 NODES=4441	? (TO) TT=1800.05	UNSAT TT=12.688 CHECKS=3019860	? (TO) TT=1800.04	UNSAT TT=5.305 ASSIGNMENTS=1292	UNSAT TT=4.913 ASSIGNMENTS=1292	UNSAT TT=4.344 CHECKS=55901 NODES=166	? (TO) TT=1800.1	? (TO) TT=1800.02	UNSAT TT=0.584 ASSIGNMENTS=467 CHECKS=167970	UNSAT TT=0.592 ASSIGNMENTS=467 CHECKS=167970	UNSAT TT=18.57	UNSAT TT=16.22	UNSAT TT=0.597 ASSIGNMENTS=561 CHECKS=196978	UNSAT TT=5.523 ASSIGNMENTS=13821 CHECKS=2191410	? (TO) TT=1800.06	UNSAT TT=4.515 ASSIGNMENTS=4627 CHECKS=1461440	UNSAT TT=0.646 ASSIGNMENTS=511 CHECKS=195117	UNSAT TT=10.815	UNSAT TT=5.77	UNSAT TT=7.001
csp/rlfapScensMod/ normalized-scen6-w1-f2.xml	UNSAT TT=0.164	UNSAT TT=1.277 CHECKS=134420 NODES=249	UNSAT TT=1.033 CHECKS=20080 NODES=0	? (TO) TT=1800.06	UNSAT TT=2.216 CHECKS=573508	UNSAT TT=0.721 CHECKS=463712	UNSAT TT=2.093 ASSIGNMENTS=2721	UNSAT TT=2.142 ASSIGNMENTS=2721	UNSAT TT=1.557 CHECKS=62166 NODES=259	? (TO) TT=1800.05	? (TO) TT=1800.1	UNSAT TT=1.304 ASSIGNMENTS=5245 CHECKS=205264	UNSAT TT=1.348 ASSIGNMENTS=5245 CHECKS=205264	UNSAT TT=10.05	UNSAT TT=8.767	UNSAT TT=1.214 ASSIGNMENTS=5120 CHECKS=198249	UNSAT TT=1.601 ASSIGNMENTS=11428 CHECKS=224727	? (TO) TT=1800.09	UNSAT TT=1.15 ASSIGNMENTS=3647 CHECKS=133019	UNSAT TT=0.164 ASSIGNMENTS=427 CHECKS=17176	UNSAT TT=3.863	UNSAT TT=1.83	UNSAT TT=2.249
csp/rlfapScensMod/ normalized-scen6-w1.xml	SAT TT=0.068	SAT TT=1.123 CHECKS=27542 NODES=202	SAT TT=1.306 CHECKS=54790 NODES=202	SAT TT=0.099	SAT TT=4.693 CHECKS=990773	SAT TT=2.042 CHECKS=778794	SAT TT=1.805 ASSIGNMENTS=97	SAT TT=1.734 ASSIGNMENTS=97	SAT TT=1.404 CHECKS=26716 NODES=206	SAT TT=7.12 CHECKS=37952500 NODES=150661	SAT TT=1.479 CHECKS=144206 NODES=256	SAT TT=0.084 ASSIGNMENTS=99 CHECKS=1998	SAT TT=0.085 ASSIGNMENTS=99 CHECKS=1998	SAT TT=11.032	SAT TT=9.726	SAT TT=0.07 ASSIGNMENTS=98 CHECKS=2004	SAT TT=0.072 ASSIGNMENTS=101 CHECKS=2402	? (TO) TT=1800.12	SAT TT=0.098 ASSIGNMENTS=166 CHECKS=3491	SAT TT=0.068 ASSIGNMENTS=98 CHECKS=2019	SAT TT=3.849	SAT TT=1.836	SAT TT=2.44
csp/rlfapScensMod/ normalized-scen7-w1-f4.xml	SAT TT=0.144	SAT TT=1.462 CHECKS=66006 NODES=407	SAT TT=1.8 CHECKS=436612 NODES=409	SAT TT=0.161	SAT TT=14.923 CHECKS=2457350	SAT TT=11 CHECKS=2665900	SAT TT=1.857 ASSIGNMENTS=186	SAT TT=2.02 ASSIGNMENTS=186	SAT TT=1.996 CHECKS=68515 NODES=508	SAT TT=605.951 CHECKS=2042370000 NODES=16652200	SAT TT=2.176 CHECKS=470614 NODES=999	SAT TT=0.152 ASSIGNMENTS=201 CHECKS=5799	SAT TT=0.159 ASSIGNMENTS=201 CHECKS=5799	SAT TT=19.503	SAT TT=17.753	SAT TT=0.144 ASSIGNMENTS=201 CHECKS=5799	SAT TT=0.249 ASSIGNMENTS=634 CHECKS=19158	? (TO) TT=1800.06	SAT TT=3.241 ASSIGNMENTS=12857 CHECKS=421598	SAT TT=0.153 ASSIGNMENTS=235 CHECKS=8522	SAT TT=5.403	SAT TT=3.002	SAT TT=3.42
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScensMod/ normalized-scen9-w1-f3.xml	UNSAT TT=0.239	UNSAT TT=1.499 CHECKS=35049 NODES=0	UNSAT TT=1.515 CHECKS=35049 NODES=0	UNSAT TT=0.278	UNSAT TT=3.754 CHECKS=637999	UNSAT TT=0.931 CHECKS=660858	UNSAT TT=2.098 ASSIGNMENTS=0	UNSAT TT=2.072 ASSIGNMENTS=0	UNSAT TT=2.725 CHECKS=63484 NODES=52	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=0.283 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=0.26 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=32.643	UNSAT TT=29.867	UNSAT TT=0.239 ASSIGNMENTS=126 CHECKS=8895	UNSAT TT=4.821 ASSIGNMENTS=17961 CHECKS=618193	? (TO) TT=1800.12	UNSAT TT=5.597 ASSIGNMENTS=11290 CHECKS=671534	UNSAT TT=0.239 ASSIGNMENTS=117 CHECKS=8548	UNSAT TT=7.339	UNSAT TT=3.722	UNSAT TT=4.757
csp/rlfapScens/ normalized-scen10.xml	UNSAT TT=0.325	UNSAT TT=2.965 CHECKS=28372 NODES=0	UNSAT TT=3.051 CHECKS=28372 NODES=0	UNSAT TT=0.704	UNSAT TT=3.032 CHECKS=895102	UNSAT TT=0.799 CHECKS=838645	UNSAT TT=3.044 ASSIGNMENTS=0	UNSAT TT=3.216 ASSIGNMENTS=0	UNSAT TT=8.779 CHECKS=20253 NODES=0	UNSAT TT=7.079 CHECKS=32670 NODES=0	UNSAT TT=7.853 CHECKS=32670 NODES=0	UNSAT TT=0.352 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.34 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=182.647	UNSAT TT=187.181	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.338 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=4.319	UNSAT TT=0.342 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.325 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=16.58	UNSAT TT=8.147	UNSAT TT=11.121
csp/rlfapScens/ normalized-scen11.xml	SAT TT=0.618	SAT TT=3.225 CHECKS=304730 NODES=724	SAT TT=3.215 CHECKS=245948 NODES=0	SAT TT=93.826	SAT TT=13.146 CHECKS=6564380	SAT TT=9.779 CHECKS=5004100	SAT TT=7.189 ASSIGNMENTS=582	SAT TT=6.836 ASSIGNMENTS=582	SAT TT=6.761 CHECKS=215011 NODES=847	SAT TT=5.601 CHECKS=1756210 NODES=1097	SAT TT=6.133 CHECKS=2907350 NODES=577	SAT TT=0.629 ASSIGNMENTS=525 CHECKS=65628	SAT TT=0.67 ASSIGNMENTS=525 CHECKS=65628	SAT TT=39.855	SAT TT=34.27	SAT TT=0.71 ASSIGNMENTS=528 CHECKS=71078	SAT TT=5.92 ASSIGNMENTS=9932 CHECKS=818679	? (TO) TT=1800.07	SAT TT=22.236 ASSIGNMENTS=16126 CHECKS=3251060	SAT TT=0.618 ASSIGNMENTS=524 CHECKS=65719	SAT TT=19.404	SAT TT=9.373	SAT TT=11.258
csp/rlfapScens/ normalized-scen1.xml	SAT TT=0.685	SAT TT=4.59 CHECKS=321671 NODES=917	SAT TT=3.737 CHECKS=334060 NODES=0	SAT TT=1.011	SAT TT=14.877 CHECKS=5516800	SAT TT=22.801 CHECKS=5400330	SAT TT=8.064 ASSIGNMENTS=459	SAT TT=8.285 ASSIGNMENTS=459	SAT TT=10.251 CHECKS=223669 NODES=916	SAT TT=9.178 CHECKS=1349020 NODES=715	SAT TT=9.198 CHECKS=3796710 NODES=622	SAT TT=0.807 ASSIGNMENTS=457 CHECKS=42321	SAT TT=0.82 ASSIGNMENTS=457 CHECKS=42321	SAT TT=54.716	SAT TT=49.031	SAT TT=0.719 ASSIGNMENTS=457 CHECKS=42321	SAT TT=0.685 ASSIGNMENTS=456 CHECKS=42809	SAT TT=151.76	SAT TT=0.86 ASSIGNMENTS=526 CHECKS=66352	SAT TT=0.739 ASSIGNMENTS=457 CHECKS=41807	SAT TT=22.661	SAT TT=12.009	SAT TT=16.086
csp/rlfapScens/ normalized-scen3.xml	SAT TT=0.328	SAT TT=2.553 CHECKS=158741 NODES=400	SAT TT=2.478 CHECKS=164098 NODES=0	SAT TT=0.493	SAT TT=5.554 CHECKS=2641720	SAT TT=1.715 CHECKS=141144	SAT TT=5.391 ASSIGNMENTS=201	SAT TT=5.411 ASSIGNMENTS=201	SAT TT=4.653 CHECKS=108830 NODES=400	SAT TT=4.068 CHECKS=708765 NODES=344	SAT TT=4.038 CHECKS=1205100 NODES=266	SAT TT=0.384 ASSIGNMENTS=200 CHECKS=20979	SAT TT=0.376 ASSIGNMENTS=200 CHECKS=20979	SAT TT=26.611	SAT TT=23.264	SAT TT=0.353 ASSIGNMENTS=200 CHECKS=20979	SAT TT=0.328 ASSIGNMENTS=200 CHECKS=23152	SAT TT=10.65	SAT TT=0.375 ASSIGNMENTS=199 CHECKS=25953	SAT TT=0.356 ASSIGNMENTS=200 CHECKS=20646	SAT TT=12.974	SAT TT=6.763	SAT TT=8.466
csp/rlfapScens/ normalized-scen4.xml	SAT TT=0.518	SAT TT=4.313 CHECKS=339251 NODES=1697	SAT TT=4.78 CHECKS=1050340 NODES=0	SAT TT=0.705	SAT TT=6.633 CHECKS=4889670	SAT TT=3.536 CHECKS=5519880	SAT TT=3.504 ASSIGNMENTS=236	SAT TT=3.337 ASSIGNMENTS=236	SAT TT=9.547 CHECKS=186478 NODES=803	? (TO) TT=1800.04	SAT TT=13.21 CHECKS=14677200 NODES=7509	SAT TT=0.521 ASSIGNMENTS=276 CHECKS=41543	SAT TT=0.558 ASSIGNMENTS=276 CHECKS=41543	SAT TT=204.748	SAT TT=190.034	SAT TT=0.518 ASSIGNMENTS=276 CHECKS=41543	SAT TT=0.574 ASSIGNMENTS=252 CHECKS=41824	? (TO) TT=1800.05	SAT TT=1.839 ASSIGNMENTS=13208 CHECKS=772461	SAT TT=0.558 ASSIGNMENTS=288 CHECKS=41739	SAT TT=15.695	SAT TT=8.995	SAT TT=10.817
csp/rlfapScens/ normalized-scen5.xml	SAT TT=0.293	SAT TT=2.855 CHECKS=143699 NODES=687	SAT TT=2.762 CHECKS=291420 NODES=0	SAT TT=0.464	SAT TT=3.336 CHECKS=2318510	SAT TT=2.103 CHECKS=2928560	SAT TT=3.252 ASSIGNMENTS=118	SAT TT=2.795 ASSIGNMENTS=118	SAT TT=6.309 CHECKS=82740 NODES=408	SAT TT=37.325 CHECKS=149608000 NODES=751036	SAT TT=6.586 CHECKS=7092170 NODES=2876	SAT TT=0.338 ASSIGNMENTS=123 CHECKS=22528	SAT TT=0.333 ASSIGNMENTS=123 CHECKS=22528	SAT TT=120.14	SAT TT=109.926	SAT TT=0.331 ASSIGNMENTS=123 CHECKS=22528	SAT TT=0.293 ASSIGNMENTS=248 CHECKS=26775	? (TO) TT=1800.05	SAT TT=1.257 ASSIGNMENTS=3641 CHECKS=416351	SAT TT=0.314 ASSIGNMENTS=136 CHECKS=24585	SAT TT=11.685	SAT TT=6.076	SAT TT=6.77
csp/rlfapScens/ normalized-scen6.xml	UNSAT TT=0.159	UNSAT TT=1.644 CHECKS=29270 NODES=0	UNSAT TT=1.609 CHECKS=29270 NODES=0	UNSAT TT=0.245	UNSAT TT=0.938 CHECKS=239807	UNSAT TT=0.223 CHECKS=245160	UNSAT TT=1.674 ASSIGNMENTS=0	UNSAT TT=1.922 ASSIGNMENTS=0	UNSAT TT=3.342 CHECKS=30700 NODES=0	UNSAT TT=3.03 CHECKS=36119 NODES=0	UNSAT TT=3.08 CHECKS=36119 NODES=0	UNSAT TT=0.183 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.188 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=49.908	UNSAT TT=48.228	UNSAT TT=0.172 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.159 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=3.392	UNSAT TT=0.171 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=0.171 ASSIGNMENTS=0 CHECKS=8643	UNSAT TT=7.211	UNSAT TT=3.987	UNSAT TT=4.456
csp/rlfapScens/ normalized-scen7.xml	UNSAT TT=0.266	UNSAT TT=2.633 CHECKS=15349 NODES=0	UNSAT TT=2.55 CHECKS=15349 NODES=0	UNSAT TT=0.494	UNSAT TT=1.967 CHECKS=555364	UNSAT TT=0.439 CHECKS=530226	UNSAT TT=2.55 ASSIGNMENTS=0	UNSAT TT=2.595 ASSIGNMENTS=0	UNSAT TT=6.044 CHECKS=4964 NODES=0	UNSAT TT=5.854 CHECKS=6142 NODES=0	UNSAT TT=5.528 CHECKS=6142 NODES=0	UNSAT TT=0.266 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.283 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=123.077	UNSAT TT=126.03	UNSAT TT=0.281 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.299 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=2.871	UNSAT TT=0.305 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=0.268 ASSIGNMENTS=0 CHECKS=5905	UNSAT TT=13.32	UNSAT TT=6.506	UNSAT TT=7.928
csp/rlfapScens/ normalized-scen8.xml	UNSAT TT=0.548	UNSAT TT=3.757 CHECKS=12529 NODES=0	UNSAT TT=3.87 CHECKS=12529 NODES=0	UNSAT TT=0.898	UNSAT TT=3.757 CHECKS=465144	UNSAT TT=1.01 CHECKS=837000	UNSAT TT=3.987 ASSIGNMENTS=0	UNSAT TT=3.749 ASSIGNMENTS=0	UNSAT TT=12.054 CHECKS=11399 NODES=0	UNSAT TT=11.229 CHECKS=16090 NODES=0	UNSAT TT=10.635 CHECKS=16090 NODES=0	UNSAT TT=0.557 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.614 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=292.112	UNSAT TT=271.184	UNSAT TT=0.548 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.588 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=4.28	UNSAT TT=0.6 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=0.598 ASSIGNMENTS=0 CHECKS=11109	UNSAT TT=20.31	UNSAT TT=11.467	UNSAT TT=14.774
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rlfapScens/ normalized-scen9.xml	UNSAT TT=0.316	UNSAT TT=2.982 CHECKS=28372 NODES=0	UNSAT TT=2.938 CHECKS=28372 NODES=0	UNSAT TT=0.692	UNSAT TT=3.293 CHECKS=875923	UNSAT TT=0.795 CHECKS=854538	UNSAT TT=2.963 ASSIGNMENTS=0	UNSAT TT=3.217 ASSIGNMENTS=0	UNSAT TT=8.071 CHECKS=20253 NODES=0	UNSAT TT=7.793 CHECKS=32670 NODES=0	UNSAT TT=7.093 CHECKS=32670 NODES=0	UNSAT TT=0.343 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.339 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=183.173	UNSAT TT=176.257	UNSAT TT=0.316 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.348 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=4.613	UNSAT TT=0.324 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=0.329 ASSIGNMENTS=0 CHECKS=2931	UNSAT TT=16.673	UNSAT TT=9.058	UNSAT TT=11.096
csp/subs/ normalized-scen06-sub0.xml	UNSAT TT=0.064	UNSAT TT=1 CHECKS=63301 NODES=23	UNSAT TT=1.006 CHECKS=57173 NODES=0	UNSAT TT=0.064	UNSAT TT=0.205 CHECKS=114675	UNSAT TT=0.062 CHECKS=86617	UNSAT TT=1.023 ASSIGNMENTS=0	UNSAT TT=0.926 ASSIGNMENTS=0	UNSAT TT=1.259 CHECKS=27374 NODES=16	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=0.087 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=0.081 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=8.208	UNSAT TT=8.086	UNSAT TT=0.07 ASSIGNMENTS=21 CHECKS=10211	UNSAT TT=0.228 ASSIGNMENTS=257 CHECKS=58745	UNSAT TT=19.898	UNSAT TT=0.091 ASSIGNMENTS=30 CHECKS=9070	UNSAT TT=0.077 ASSIGNMENTS=19 CHECKS=8599	UNSAT TT=3.444	UNSAT TT=1.301	UNSAT TT=1.421
csp/subs/ normalized-scen06-sub1.xml	UNSAT TT=0.077	UNSAT TT=1.028 CHECKS=6951 NODES=0	UNSAT TT=0.965 CHECKS=6951 NODES=0	UNSAT TT=0.077	UNSAT TT=0.171 CHECKS=62414	UNSAT TT=0.056 CHECKS=67162	UNSAT TT=0.928 ASSIGNMENTS=0	UNSAT TT=0.959 ASSIGNMENTS=0	UNSAT TT=1.316 CHECKS=29015 NODES=18	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=0.1 ASSIGNMENTS=15 CHECKS=7678	UNSAT TT=0.089 ASSIGNMENTS=15 CHECKS=7678	UNSAT TT=8.822	UNSAT TT=8.495	UNSAT TT=0.081 ASSIGNMENTS=11 CHECKS=7456	UNSAT TT=0.111 ASSIGNMENTS=91 CHECKS=15516	UNSAT TT=2.616	UNSAT TT=0.083 ASSIGNMENTS=12 CHECKS=5297	UNSAT TT=0.09 ASSIGNMENTS=17 CHECKS=8443	UNSAT TT=3.582	UNSAT TT=1.649	UNSAT TT=1.915
csp/subs/ normalized-scen06-sub2.xml	UNSAT TT=0.077	UNSAT TT=1.055 CHECKS=5863 NODES=0	UNSAT TT=1.009 CHECKS=5863 NODES=0	UNSAT TT=0.087	UNSAT TT=0.187 CHECKS=72563	UNSAT TT=0.063 CHECKS=75191	UNSAT TT=1.193 ASSIGNMENTS=0	UNSAT TT=1.056 ASSIGNMENTS=0	UNSAT TT=1.491 CHECKS=26952 NODES=17	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.106 ASSIGNMENTS=15 CHECKS=7742	UNSAT TT=0.108 ASSIGNMENTS=15 CHECKS=7742	UNSAT TT=11.111	UNSAT TT=9.081	UNSAT TT=0.088 ASSIGNMENTS=11 CHECKS=7053	UNSAT TT=0.104 ASSIGNMENTS=67 CHECKS=14395	UNSAT TT=2.819	UNSAT TT=0.077 ASSIGNMENTS=12 CHECKS=5201	UNSAT TT=0.096 ASSIGNMENTS=13 CHECKS=7462	UNSAT TT=4.04	UNSAT TT=1.622	UNSAT TT=1.92
csp/subs/ normalized-scen06-sub3.xml	UNSAT TT=0.081	UNSAT TT=1.103 CHECKS=7245 NODES=0	UNSAT TT=1.052 CHECKS=7245 NODES=0	UNSAT TT=0.1	UNSAT TT=0.199 CHECKS=79645	UNSAT TT=0.073 CHECKS=96196	UNSAT TT=1.249 ASSIGNMENTS=0	UNSAT TT=1.063 ASSIGNMENTS=0	UNSAT TT=1.633 CHECKS=30514 NODES=17	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.113 ASSIGNMENTS=15 CHECKS=8548	UNSAT TT=0.111 ASSIGNMENTS=15 CHECKS=8548	UNSAT TT=12.75	UNSAT TT=11.147	UNSAT TT=0.096 ASSIGNMENTS=11 CHECKS=7767	UNSAT TT=0.106 ASSIGNMENTS=70 CHECKS=15601	UNSAT TT=3.349	UNSAT TT=0.081 ASSIGNMENTS=12 CHECKS=5731	UNSAT TT=0.095 ASSIGNMENTS=16 CHECKS=8526	UNSAT TT=4.051	UNSAT TT=1.919	UNSAT TT=2.153
csp/subs/ normalized-scen06-sub4.xml	UNSAT TT=0.064	UNSAT TT=1.102 CHECKS=13106 NODES=0	UNSAT TT=1.098 CHECKS=13106 NODES=0	UNSAT TT=0.106	UNSAT TT=0.241 CHECKS=98533	UNSAT TT=0.083 CHECKS=107620	UNSAT TT=1.101 ASSIGNMENTS=0	UNSAT TT=1.215 ASSIGNMENTS=0	UNSAT TT=1.798 CHECKS=28773 NODES=12	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=0.085 ASSIGNMENTS=14 CHECKS=7262	UNSAT TT=0.086 ASSIGNMENTS=14 CHECKS=7262	UNSAT TT=14.114	UNSAT TT=13.714	UNSAT TT=0.066 ASSIGNMENTS=8 CHECKS=5762	UNSAT TT=0.134 ASSIGNMENTS=149 CHECKS=29517	UNSAT TT=6.191	UNSAT TT=0.064 ASSIGNMENTS=9 CHECKS=4718	UNSAT TT=0.075 ASSIGNMENTS=14 CHECKS=7185	UNSAT TT=4.656	UNSAT TT=1.963	UNSAT TT=2.399
csp/subs/ normalized-scen07-sub1.xml	UNSAT TT=0.075	UNSAT TT=0.981 CHECKS=12174 NODES=0	UNSAT TT=0.973 CHECKS=12174 NODES=0	UNSAT TT=0.077	UNSAT TT=0.161 CHECKS=53487	UNSAT TT=0.059 CHECKS=74799	UNSAT TT=1.123 ASSIGNMENTS=0	UNSAT TT=0.998 ASSIGNMENTS=0	UNSAT TT=1.355 CHECKS=30726 NODES=19	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=0.107 ASSIGNMENTS=14 CHECKS=9567	UNSAT TT=0.11 ASSIGNMENTS=14 CHECKS=9567	UNSAT TT=9.561	UNSAT TT=7.687	UNSAT TT=0.086 ASSIGNMENTS=11 CHECKS=7658	UNSAT TT=0.11 ASSIGNMENTS=49 CHECKS=12431	UNSAT TT=4.026	UNSAT TT=0.075 ASSIGNMENTS=14 CHECKS=6421	UNSAT TT=0.089 ASSIGNMENTS=23 CHECKS=7330	UNSAT TT=3.753	UNSAT TT=1.466	UNSAT TT=1.757
csp/subs/ normalized-scen07-sub2.xml	UNSAT TT=0.091	UNSAT TT=1.132 CHECKS=14323 NODES=0	UNSAT TT=1.047 CHECKS=14323 NODES=0	UNSAT TT=0.095	UNSAT TT=0.196 CHECKS=83701	UNSAT TT=0.063 CHECKS=79951	UNSAT TT=1.004 ASSIGNMENTS=0	UNSAT TT=1.202 ASSIGNMENTS=0	UNSAT TT=1.437 CHECKS=33885 NODES=19	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=0.12 ASSIGNMENTS=16 CHECKS=10707	UNSAT TT=0.122 ASSIGNMENTS=16 CHECKS=10707	UNSAT TT=11.75	UNSAT TT=9.294	UNSAT TT=0.101 ASSIGNMENTS=11 CHECKS=8482	UNSAT TT=0.133 ASSIGNMENTS=88 CHECKS=20259	UNSAT TT=4.171	UNSAT TT=0.091 ASSIGNMENTS=14 CHECKS=7029	UNSAT TT=0.103 ASSIGNMENTS=23 CHECKS=8057	UNSAT TT=3.933	UNSAT TT=1.723	UNSAT TT=1.912
csp/subs/ normalized-scen07-sub3.xml	UNSAT TT=0.104	UNSAT TT=1.177 CHECKS=15905 NODES=0	UNSAT TT=1.148 CHECKS=15905 NODES=0	UNSAT TT=0.108	UNSAT TT=0.23 CHECKS=111740	UNSAT TT=0.076 CHECKS=108735	UNSAT TT=1.053 ASSIGNMENTS=0	UNSAT TT=1.058 ASSIGNMENTS=0	UNSAT TT=1.532 CHECKS=35995 NODES=19	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.125 ASSIGNMENTS=16 CHECKS=11751	UNSAT TT=0.138 ASSIGNMENTS=16 CHECKS=11751	UNSAT TT=12.182	UNSAT TT=11.021	UNSAT TT=0.107 ASSIGNMENTS=15 CHECKS=11011	UNSAT TT=0.151 ASSIGNMENTS=74 CHECKS=20943	UNSAT TT=4.838	UNSAT TT=0.104 ASSIGNMENTS=14 CHECKS=7707	UNSAT TT=0.119 ASSIGNMENTS=24 CHECKS=10936	UNSAT TT=4.304	UNSAT TT=1.828	UNSAT TT=1.964
csp/subs/ normalized-scen07-sub4.xml	UNSAT TT=0.098	UNSAT TT=1.186 CHECKS=12750 NODES=0	UNSAT TT=1.108 CHECKS=12750 NODES=0	UNSAT TT=0.121	UNSAT TT=0.275 CHECKS=126370	UNSAT TT=0.085 CHECKS=124172	UNSAT TT=1.182 ASSIGNMENTS=0	UNSAT TT=1.333 ASSIGNMENTS=0	UNSAT TT=1.771 CHECKS=43802 NODES=14	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.126 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=0.123 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=14.813	UNSAT TT=12.681	UNSAT TT=0.113 ASSIGNMENTS=13 CHECKS=8889	UNSAT TT=0.298 ASSIGNMENTS=132 CHECKS=48835	UNSAT TT=68.902	UNSAT TT=0.098 ASSIGNMENTS=14 CHECKS=6249	UNSAT TT=0.112 ASSIGNMENTS=17 CHECKS=8181	UNSAT TT=4.241	UNSAT TT=1.994	UNSAT TT=2.29
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/ukPuzzle/ normalized-crossword-m1-uk-puzzle01.xml	SAT TT=0.004	SAT TT=0.64 CHECKS=215 NODES=3	SAT TT=0.682 CHECKS=166 NODES=0	SAT TT=0.025	SAT TT=0.008 CHECKS=54	SAT TT=0.008 CHECKS=45	SAT TT=0.445 ASSIGNMENTS=4	SAT TT=0.493 ASSIGNMENTS=4	SAT TT=0.398 CHECKS=141 NODES=3	SAT TT=0.393 CHECKS=355 NODES=1	SAT TT=0.374 CHECKS=359 NODES=1	SAT TT=0.016 ASSIGNMENTS=3 CHECKS=10	SAT TT=0.015 ASSIGNMENTS=3 CHECKS=10	SAT TT=1.003	SAT TT=0.919	SAT TT=0.004 ASSIGNMENTS=3 CHECKS=10	SAT TT=0.007 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.27	SAT TT=0.006 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.006 ASSIGNMENTS=3 CHECKS=13	SAT TT=0.903	SAT TT=0.478	SAT TT=0.486

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	177	176	74	110	110	139	54	57	174	174	127	131	76	131	63	99	106
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	177	176	74	110	110	139	54	57	174	174	127	131	76	131	63	99	106
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	35	39	34	1	0	0	0	0	7	3	15	9	9	26	0	1	0
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0