CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory problems with patterns

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory problems with patterns

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-10-13-fair.xml		? TT=8.573	? TT=8.522	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.18	? TT=186.293	? (TO) TT=184.03	? (TO) TT=181.75	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=4.474	? (MO) TT=1333.45	? (MO) TT=1453.95
csp/fischer/ normalized-fischer-10-3-fair.xml	UNSAT TT=1.303	? TT=8.385	? TT=8.24	UNSAT TT=3.793	UNSAT TT=3.849 CHECKS=595113	UNSAT TT=1.557 CHECKS=750206	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=14.437	? (TO) TT=14.33	? (TO) TT=15.35	UNSAT TT=10.189 ASSIGNMENTS=5701 CHECKS=2348860	UNSAT TT=9.687 ASSIGNMENTS=5701 CHECKS=2348860	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=1.303 ASSIGNMENTS=3271 CHECKS=1063190	UNSAT TT=7.046 ASSIGNMENTS=7621 CHECKS=23277400	? (TO) TT=1800.09	UNSAT TT=2.801 ASSIGNMENTS=5759 CHECKS=3650820	UNSAT TT=2.002 ASSIGNMENTS=5701 CHECKS=2348860	? TT=2.57	UNSAT TT=160.569	UNSAT TT=269.585
csp/fischer/ normalized-fischer-10-4-fair.xml	UNSAT TT=8.629	? TT=8.551	? TT=11.688	UNSAT TT=37.466	UNSAT TT=9.773 CHECKS=7435810	UNSAT TT=8.629 CHECKS=6218900	? (TO) TT=1800.08	? (TO) TT=1800.13	? TT=22.087	? (TO) TT=22.84	? (TO) TT=21.48	UNSAT TT=82.879 ASSIGNMENTS=162418 CHECKS=100197000	UNSAT TT=77.143 ASSIGNMENTS=162418 CHECKS=100197000	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=12.218 ASSIGNMENTS=25643 CHECKS=16144800	UNSAT TT=14.39 ASSIGNMENTS=25332 CHECKS=30644600	? (TO) TT=1800.07	UNSAT TT=33.095 ASSIGNMENTS=55030 CHECKS=35295200	UNSAT TT=78.077 ASSIGNMENTS=162418 CHECKS=100197000	? TT=3.254	? (MO) TT=195.02	UNSAT TT=362.817
csp/fischer/ normalized-fischer-10-7-fair.xml		? TT=8.868	? TT=9.425	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.16	? TT=60.352	? (TO) TT=60.95	? (TO) TT=60.39	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=3.542	? (MO) TT=445.02	? (MO) TT=560.75
csp/fischer/ normalized-fischer-10-9-fair.xml		? TT=10.062	? TT=10.159	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.08	? TT=93.049	? (TO) TT=94.9	? (TO) TT=93.37	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=3.619	? (MO) TT=706.661	? (MO) TT=814.34
csp/fischer/ normalized-fischer-11-10-fair.xml		? TT=8.531	? TT=8.632	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? TT=141.302	? (TO) TT=141.57	? (TO) TT=145.12	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=4.094	? (MO) TT=1126.64	? (MO) TT=1160.38
csp/fischer/ normalized-fischer-11-14-fair.xml		? TT=8.846	? TT=9.45	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.14	? TT=276.799	? (TO) TT=281.1	? (TO) TT=277.61	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.12	? TT=3.508	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/fischer/ normalized-fischer-11-1-fair.xml	SAT TT=0.267	? TT=8.741	? TT=13.012	SAT TT=1.113	SAT TT=5.554 CHECKS=615038	SAT TT=3.805 CHECKS=2605130	? (TO) TT=1800.07	SAT TT=430.434 ASSIGNMENTS=23909	? TT=6.752	? (TO) TT=6.52	? (TO) TT=6.62	SAT TT=0.368 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.35 ASSIGNMENTS=72 CHECKS=406552	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.338 ASSIGNMENTS=72 CHECKS=406552	SAT TT=0.267 ASSIGNMENTS=59 CHECKS=90667	SAT TT=375.693	SAT TT=9.248 ASSIGNMENTS=30171 CHECKS=529275	SAT TT=0.309 ASSIGNMENTS=64 CHECKS=224645	? TT=2.213	SAT TT=66.714	SAT TT=117.263
csp/fischer/ normalized-fischer-11-8-fair.xml		? TT=11.755	? TT=10.847	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? TT=94.002	? (TO) TT=94.92	? (TO) TT=96.64	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? TT=3.872	? (MO) TT=738.7	? (MO) TT=810.45
csp/fischer/ normalized-fischer-1-3-fair.xml	UNSAT TT=0.047	? TT=18.857	? TT=19.291	UNSAT TT=0.224	UNSAT TT=1.546 CHECKS=6764	UNSAT TT=0.047 CHECKS=5081	UNSAT TT=1544.87 ASSIGNMENTS=2236150	UNSAT TT=18.489 ASSIGNMENTS=11668	? TT=138.808	? (TO) TT=133.61	? (TO) TT=134.97	UNSAT TT=0.065 ASSIGNMENTS=6 CHECKS=4020	UNSAT TT=0.061 ASSIGNMENTS=6 CHECKS=4020	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=0.051 ASSIGNMENTS=4 CHECKS=3903	UNSAT TT=0.053 ASSIGNMENTS=18 CHECKS=10371	? (TO) TT=1800.11	UNSAT TT=0.056 ASSIGNMENTS=37 CHECKS=9037	UNSAT TT=0.051 ASSIGNMENTS=6 CHECKS=4020	? TT=33.926	UNSAT TT=5.351	UNSAT TT=16.177
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-3-7-fair.xml	UNSAT TT=3.771	? TT=8.697	? TT=8.809	UNSAT TT=107.473	UNSAT TT=244.222 CHECKS=97671000	UNSAT TT=28.176 CHECKS=18782900	? (TO) TT=1800.08	? (TO) TT=1800.11	? TT=10.863	? (TO) TT=8.7	? (TO) TT=10.38	UNSAT TT=11.599 ASSIGNMENTS=6232 CHECKS=10829900	UNSAT TT=11.673 ASSIGNMENTS=6232 CHECKS=10829900	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=22.516 ASSIGNMENTS=40623 CHECKS=80133700	? (TO) TT=1800.12	UNSAT TT=248.404 ASSIGNMENTS=567020 CHECKS=391439000	UNSAT TT=3.771 ASSIGNMENTS=6232 CHECKS=10829900	? TT=3.032	UNSAT TT=96.688	UNSAT TT=132.693
csp/fischer/ normalized-fischer-3-8-fair.xml	SAT TT=2.434	? TT=8.956	? TT=8.93	SAT TT=393.921	SAT TT=278.73 CHECKS=104795000	SAT TT=33.395 CHECKS=22408600	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=10.047	? (TO) TT=9.85	? (TO) TT=9.34	SAT TT=10.083 ASSIGNMENTS=2875 CHECKS=5245520	SAT TT=10.465 ASSIGNMENTS=2875 CHECKS=5245520	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=3.729 ASSIGNMENTS=6768 CHECKS=12788300	? (TO) TT=1800.13	SAT TT=6.223 ASSIGNMENTS=5488 CHECKS=21236500	SAT TT=2.434 ASSIGNMENTS=2875 CHECKS=5245520	? TT=3.251	SAT TT=144.583	SAT TT=170.417
csp/fischer/ normalized-fischer-4-3-fair.xml	UNSAT TT=0.217	? TT=11.948	? TT=8.89	UNSAT TT=0.811	UNSAT TT=4.881 CHECKS=204944	UNSAT TT=0.514 CHECKS=236277	? (TO) TT=1800.08	? (TO) TT=1800.17	? TT=6.472	? (TO) TT=7.03	? (TO) TT=6.31	UNSAT TT=0.256 ASSIGNMENTS=112 CHECKS=59002	UNSAT TT=0.233 ASSIGNMENTS=112 CHECKS=59002	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=0.231 ASSIGNMENTS=181 CHECKS=56491	UNSAT TT=3.005 ASSIGNMENTS=4296 CHECKS=12293300	? (TO) TT=1800.11	UNSAT TT=0.295 ASSIGNMENTS=163 CHECKS=371817	UNSAT TT=0.217 ASSIGNMENTS=139 CHECKS=62790	? TT=2.297	UNSAT TT=35.012	UNSAT TT=71.104
csp/fischer/ normalized-fischer-4-5-fair.xml	UNSAT TT=0.671	? TT=10.282	? TT=9.118	UNSAT TT=9.143	UNSAT TT=36.97 CHECKS=20987900	UNSAT TT=3.611 CHECKS=5038490	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=8.496	? (TO) TT=8.16	? (TO) TT=8.34	UNSAT TT=0.697 ASSIGNMENTS=1141 CHECKS=735989	UNSAT TT=0.671 ASSIGNMENTS=1141 CHECKS=735989	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=0.714 ASSIGNMENTS=1293 CHECKS=723542	UNSAT TT=3.152 ASSIGNMENTS=5951 CHECKS=12005700	? (TO) TT=1800.1	UNSAT TT=26.045 ASSIGNMENTS=60371 CHECKS=16227800	UNSAT TT=0.809 ASSIGNMENTS=1515 CHECKS=979529	? TT=2.987	UNSAT TT=79.357	UNSAT TT=115.514
csp/fischer/ normalized-fischer-4-7-fair.xml	UNSAT TT=9.967	? TT=11.144	? TT=8.372	UNSAT TT=741.046	UNSAT TT=232.195 CHECKS=97493600	UNSAT TT=73.521 CHECKS=41031000	? (TO) TT=1800.09	? (TO) TT=1800.13	? TT=11.435	? (TO) TT=11.39	? (TO) TT=12.13	UNSAT TT=32.662 ASSIGNMENTS=37687 CHECKS=75980000	UNSAT TT=35.511 ASSIGNMENTS=37687 CHECKS=75980000	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=9.967 ASSIGNMENTS=13801 CHECKS=28876400	UNSAT TT=31.76 ASSIGNMENTS=45463 CHECKS=96490500	? (TO) TT=1800.1	UNSAT TT=24.947 ASSIGNMENTS=35301 CHECKS=63197700	UNSAT TT=26.709 ASSIGNMENTS=37687 CHECKS=75980000	? TT=2.645	UNSAT TT=146.316	UNSAT TT=241.585
csp/fischer/ normalized-fischer-5-7-fair.xml	UNSAT TT=35.801	? TT=8.737	? TT=9.728	? (TO) TT=1800.07	UNSAT TT=287.455 CHECKS=107568000	UNSAT TT=171.928 CHECKS=83777100	? (TO) TT=1800.05	? (TO) TT=1800.11	? TT=16.55	? (TO) TT=18.59	? (TO) TT=16.5	UNSAT TT=168.788 ASSIGNMENTS=216764 CHECKS=381172000	UNSAT TT=157.893 ASSIGNMENTS=216764 CHECKS=381172000	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=35.801 ASSIGNMENTS=48166 CHECKS=85378200	UNSAT TT=40.134 ASSIGNMENTS=57924 CHECKS=121142000	? (TO) TT=1800.11	UNSAT TT=190.743 ASSIGNMENTS=226285 CHECKS=416922000	UNSAT TT=150.655 ASSIGNMENTS=216764 CHECKS=381172000	? TT=2.649	UNSAT TT=198.9	UNSAT TT=298.366
csp/fischer/ normalized-fischer-6-11-fair.xml	SAT TT=57.416	? TT=9.065	? TT=8.95	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.15	? TT=56.905	? (TO) TT=57.48	? (TO) TT=56.71	SAT TT=217.742 ASSIGNMENTS=97133 CHECKS=639333000	SAT TT=213.87 ASSIGNMENTS=97133 CHECKS=639333000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=837.111 ASSIGNMENTS=435897 CHECKS=1940240000	SAT TT=207.135 ASSIGNMENTS=97133 CHECKS=639333000	? TT=3.736	? (MO) TT=378.22	? (MO) TT=530.755
csp/fischer/ normalized-fischer-6-4-fair.xml	UNSAT TT=0.899	? TT=9.157	? TT=10.562	UNSAT TT=2.012	UNSAT TT=5.776 CHECKS=2966720	UNSAT TT=2.685 CHECKS=2830600	? (TO) TT=1800.11	? (TO) TT=1800.14	? TT=11.69	? (TO) TT=11.04	? (TO) TT=10.5	UNSAT TT=1.011 ASSIGNMENTS=2019 CHECKS=1056780	UNSAT TT=1.023 ASSIGNMENTS=2019 CHECKS=1056780	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=0.899 ASSIGNMENTS=1440 CHECKS=644124	UNSAT TT=4.748 ASSIGNMENTS=6571 CHECKS=15436700	? (TO) TT=1800.06	UNSAT TT=1.015 ASSIGNMENTS=1425 CHECKS=758630	UNSAT TT=0.945 ASSIGNMENTS=1858 CHECKS=1033880	? TT=3.209	UNSAT TT=102.584	UNSAT TT=171.396
csp/fischer/ normalized-fischer-6-5-fair.xml	UNSAT TT=3.389	? TT=9.063	? TT=9.249	UNSAT TT=154.066	UNSAT TT=15.592 CHECKS=14647100	UNSAT TT=4.637 CHECKS=5646940	? (TO) TT=1800.14	? (TO) TT=1800.1	? TT=14.585	? (TO) TT=12.93	? (TO) TT=13.88	UNSAT TT=19.167 ASSIGNMENTS=26633 CHECKS=18768600	UNSAT TT=20.392 ASSIGNMENTS=26633 CHECKS=18768600	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=3.389 ASSIGNMENTS=7340 CHECKS=4785990	UNSAT TT=6.601 ASSIGNMENTS=11722 CHECKS=19471500	? (TO) TT=1800.06	UNSAT TT=14.018 ASSIGNMENTS=25574 CHECKS=18226400	UNSAT TT=11.44 ASSIGNMENTS=26633 CHECKS=18768600	? TT=2.534	UNSAT TT=184.09	UNSAT TT=224.696
csp/fischer/ normalized-fischer-6-7-fair.xml	UNSAT TT=119.743	? TT=10.142	? TT=12.806	? (TO) TT=1800.05	UNSAT TT=406.253 CHECKS=137578000	UNSAT TT=536.647 CHECKS=221728000	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=22.073	? (TO) TT=21.68	? (TO) TT=21.59	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=119.743 ASSIGNMENTS=144660 CHECKS=254227000	UNSAT TT=121.475 ASSIGNMENTS=158668 CHECKS=279944000	? (TO) TT=1800.03	UNSAT TT=438.638 ASSIGNMENTS=487363 CHECKS=744092000	? (TO) TT=1800.07	? TT=3.193	UNSAT TT=345.985	UNSAT TT=383.907
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/fischer/ normalized-fischer-7-12-fair.xml	SAT TT=1403.18	? TT=8.409	? TT=12.273	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.16	? TT=76.597	? (TO) TT=76.55	? (TO) TT=75.38	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1403.18 ASSIGNMENTS=549108 CHECKS=2282700000	? (TO) TT=1800.08	? TT=3.701	? (MO) TT=587.561	? (MO) TT=667.26
csp/fischer/ normalized-fischer-7-3-fair.xml	UNSAT TT=0.535	? TT=8.428	? TT=10.713	UNSAT TT=1.515	UNSAT TT=3.654 CHECKS=279351	UNSAT TT=1.465 CHECKS=798091	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=8.713	? (TO) TT=8.27	? (TO) TT=8.39	UNSAT TT=0.546 ASSIGNMENTS=704 CHECKS=259497	UNSAT TT=0.535 ASSIGNMENTS=704 CHECKS=259497	? (TO) TT=1800.01	? (TO) TT=1800.09	UNSAT TT=0.549 ASSIGNMENTS=777 CHECKS=228418	UNSAT TT=4.566 ASSIGNMENTS=5483 CHECKS=17690900	? (TO) TT=1800.12	UNSAT TT=0.992 ASSIGNMENTS=1011 CHECKS=717541	UNSAT TT=0.575 ASSIGNMENTS=907 CHECKS=338071	? TT=3.16	UNSAT TT=84.829	UNSAT TT=156.302
csp/fischer/ normalized-fischer-7-4-fair.xml	UNSAT TT=1.476	? TT=8.604	? TT=8.645	UNSAT TT=2.869	UNSAT TT=6.846 CHECKS=3903290	UNSAT TT=7.716 CHECKS=3155140	? (TO) TT=1800.12	? (TO) TT=1800.32	? TT=13.155	? (TO) TT=13.94	? (TO) TT=14.07	UNSAT TT=9.769 ASSIGNMENTS=3262 CHECKS=1681260	UNSAT TT=1.908 ASSIGNMENTS=4698 CHECKS=2510770	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=1.476 ASSIGNMENTS=2780 CHECKS=1322900	UNSAT TT=5.667 ASSIGNMENTS=9327 CHECKS=18040100	? (TO) TT=1800.04	UNSAT TT=99.116 ASSIGNMENTS=127928 CHECKS=68389800	UNSAT TT=2.597 ASSIGNMENTS=3262 CHECKS=1681260	? TT=2.573	UNSAT TT=157.091	UNSAT TT=218.708
csp/fischer/ normalized-fischer-8-11-fair.xml		? TT=10.287	? TT=8.935	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.18	? TT=95.659	? (TO) TT=90.72	? (TO) TT=89.81	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? TT=4.115	? (MO) TT=639.262	? (MO) TT=822.97
csp/fischer/ normalized-fischer-8-3-fair.xml	UNSAT TT=0.625	? TT=11.882	? TT=9.592	UNSAT TT=1.903	UNSAT TT=3.635 CHECKS=411782	UNSAT TT=1.057 CHECKS=500543	? (TO) TT=1800.13	? (TO) TT=1800.11	? TT=10.043	? (TO) TT=12.29	? (TO) TT=12.17	UNSAT TT=0.92 ASSIGNMENTS=1862 CHECKS=704939	UNSAT TT=0.812 ASSIGNMENTS=1862 CHECKS=704939	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.625 ASSIGNMENTS=1116 CHECKS=368377	UNSAT TT=4.65 ASSIGNMENTS=6196 CHECKS=17507800	? (TO) TT=1800.12	UNSAT TT=1.392 ASSIGNMENTS=2406 CHECKS=1351640	UNSAT TT=1.076 ASSIGNMENTS=2698 CHECKS=1008890	? TT=3.509	UNSAT TT=101.627	UNSAT TT=179.364
csp/fischer/ normalized-fischer-9-1-fair.xml	SAT TT=0.248	? TT=9.779	? TT=10.426	SAT TT=0.858	SAT TT=50.08 CHECKS=10428800	SAT TT=4.845 CHECKS=3024060	? (TO) TT=1800.1	SAT TT=17.555 ASSIGNMENTS=2254	? TT=6.171	? (TO) TT=5.45	? (TO) TT=5.47	SAT TT=0.274 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.276 ASSIGNMENTS=126 CHECKS=297862	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.267 ASSIGNMENTS=126 CHECKS=297862	SAT TT=0.248 ASSIGNMENTS=117 CHECKS=168746	SAT TT=57.813	SAT TT=2.559 ASSIGNMENTS=10017 CHECKS=188061	SAT TT=0.259 ASSIGNMENTS=126 CHECKS=218936	? TT=2.004	SAT TT=46.24	SAT TT=96.158
csp/fischer/ normalized-fischer-9-2-fair.xml	UNSAT TT=2.713	? TT=8.487	? TT=8.403	UNSAT TT=57.475	UNSAT TT=6.186 CHECKS=1600900	UNSAT TT=2.713 CHECKS=1589810	? (TO) TT=1800.16	? (TO) TT=1800.06	? TT=9.194	? (TO) TT=8.78	? (TO) TT=9.26	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=1291.43 ASSIGNMENTS=7473280 CHECKS=1320930000	UNSAT TT=14.985 ASSIGNMENTS=28689 CHECKS=59924100	? (TO) TT=1800.08	UNSAT TT=5.422 ASSIGNMENTS=7502 CHECKS=10509300	? (TO) TT=1800.02	? TT=2.898	UNSAT TT=76.46	UNSAT TT=164.58
csp/fischer/ normalized-fischer-9-4-fair.xml	UNSAT TT=5.672	? TT=8.883	? TT=10.321	UNSAT TT=15.213	UNSAT TT=8.973 CHECKS=6207910	UNSAT TT=5.672 CHECKS=4780150	? (TO) TT=1800.12	? (TO) TT=1800.09	? TT=17.785	? (TO) TT=17.39	? (TO) TT=18.12	UNSAT TT=25.756 ASSIGNMENTS=40097 CHECKS=23634500	UNSAT TT=24.505 ASSIGNMENTS=40097 CHECKS=23634500	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=8.405 ASSIGNMENTS=17044 CHECKS=11217400	UNSAT TT=10.866 ASSIGNMENTS=21214 CHECKS=25730400	? (TO) TT=1800.04	UNSAT TT=9.05 ASSIGNMENTS=14040 CHECKS=9230950	UNSAT TT=16.866 ASSIGNMENTS=40097 CHECKS=23634500	? TT=2.837	UNSAT TT=212.554	UNSAT TT=305.81
csp/fischer/ normalized-fischer-9-6-fair.xml	UNSAT TT=125.751	? TT=8.488	? TT=8.554	? (TO) TT=1800.09	UNSAT TT=125.751 CHECKS=61394200	UNSAT TT=358.86 CHECKS=111003000	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=38.227	? (TO) TT=38.14	? (TO) TT=37.94	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=334.426 ASSIGNMENTS=415556 CHECKS=518887000	UNSAT TT=382.529 ASSIGNMENTS=404784 CHECKS=511161000	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=3.319	? (MO) TT=293.34	? (MO) TT=425.74
csp/mknap/ normalized-mknap-1-0.xml	SAT TT=0.007	SAT TT=0.747 CHECKS=71 NODES=6	SAT TT=0.679 CHECKS=71 NODES=0	SAT TT=0.029	SAT TT=0.011 CHECKS=65	SAT TT=0.009 CHECKS=92	SAT TT=0.488 ASSIGNMENTS=1	SAT TT=0.502 ASSIGNMENTS=1	SAT TT=0.547 CHECKS=76 NODES=6	SAT TT=0.573 CHECKS=83 NODES=0	SAT TT=0.531 CHECKS=83 NODES=0	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.018 ASSIGNMENTS=2 CHECKS=635	SAT TT=1.463	SAT TT=1.687	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=635	SAT TT=0.009 ASSIGNMENTS=2 CHECKS=1044	SAT TT=0.302	SAT TT=0.008 ASSIGNMENTS=4 CHECKS=974	SAT TT=0.008 ASSIGNMENTS=3 CHECKS=621	SAT TT=1.364	SAT TT=0.5	SAT TT=0.469
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/mknap/ normalized-mknap-1-2.xml	SAT TT=0.013	SAT TT=1.346 CHECKS=41836 NODES=15	SAT TT=1.223 CHECKS=41836 NODES=0	SAT TT=0.037	SAT TT=0.163 CHECKS=886	SAT TT=0.048 CHECKS=1162	SAT TT=0.575 ASSIGNMENTS=9	SAT TT=0.546 ASSIGNMENTS=25	SAT TT=1.05 CHECKS=46513 NODES=15	SAT TT=0.97 CHECKS=46529 NODES=0	SAT TT=1.041 CHECKS=46529 NODES=0	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=8382	SAT TT=2.801	SAT TT=2.579	SAT TT=0.013 ASSIGNMENTS=13 CHECKS=8382	SAT TT=0.014 ASSIGNMENTS=25 CHECKS=13007	SAT TT=0.365	SAT TT=3.354 ASSIGNMENTS=6398 CHECKS=1937140	SAT TT=0.013 ASSIGNMENTS=10 CHECKS=7062	SAT TT=12.724	SAT TT=1.394	SAT TT=4.058
csp/mknap/ normalized-mknap-1-3.xml	SAT TT=0.03	SAT TT=19.193 CHECKS=1565190 NODES=20	SAT TT=18.805 CHECKS=1565190 NODES=0	SAT TT=0.05	SAT TT=2 CHECKS=36622	SAT TT=2.628 CHECKS=53826	SAT TT=0.545 ASSIGNMENTS=19	SAT TT=0.772 ASSIGNMENTS=254	SAT TT=9.491 CHECKS=1311300 NODES=20	SAT TT=6.645 CHECKS=1311320 NODES=0	SAT TT=6.24 CHECKS=1311320 NODES=0	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.043 ASSIGNMENTS=66 CHECKS=42215	? (problem) TT=39.054	? (problem) TT=32.989	SAT TT=0.03 ASSIGNMENTS=66 CHECKS=42215	SAT TT=0.887 ASSIGNMENTS=3677 CHECKS=1960360	SAT TT=0.378	SAT TT=12.861 ASSIGNMENTS=22355 CHECKS=4544830	SAT TT=0.048 ASSIGNMENTS=143 CHECKS=90571	? TT=340.472	SAT TT=3.398	SAT TT=9.877
csp/mknap/ normalized-mknap-1-4.xml	SAT TT=0.065	? (TO) TT=1800.16	? (TO) TT=1800.18	SAT TT=0.065	SAT TT=42.654 CHECKS=508593	SAT TT=45.474 CHECKS=541580	SAT TT=1.416 ASSIGNMENTS=13258	SAT TT=0.854 ASSIGNMENTS=1807	SAT TT=1568.73 CHECKS=386154000 NODES=28	SAT TT=1608.75 CHECKS=386155000 NODES=0	SAT TT=1607.68 CHECKS=386155000 NODES=0	SAT TT=9.4 ASSIGNMENTS=13258	SAT TT=61.474 ASSIGNMENTS=138723 CHECKS=137352000	? (MO) TT=256.58	? (MO) TT=275.82	SAT TT=1.418 ASSIGNMENTS=3596 CHECKS=3279130	SAT TT=7.971 ASSIGNMENTS=20493 CHECKS=18472800	SAT TT=0.791	SAT TT=136.099 ASSIGNMENTS=32294 CHECKS=22099100	SAT TT=55.486 ASSIGNMENTS=138723 CHECKS=137352000	? TT=939.507	SAT TT=11.99	SAT TT=46.099
csp/mknap/ normalized-mknap-1-5.xml	SAT TT=1.204	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=1.204	SAT TT=120.512 CHECKS=863472	SAT TT=89.942 CHECKS=695190	SAT TT=5.477 ASSIGNMENTS=105826	SAT TT=1.925 ASSIGNMENTS=18723	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=412.224 ASSIGNMENTS=1523430 CHECKS=906612000	SAT TT=410.627 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=79.785 ASSIGNMENTS=286594 CHECKS=180977000	SAT TT=58.954 ASSIGNMENTS=234559 CHECKS=142503000	SAT TT=1.29	SAT TT=239.562 ASSIGNMENTS=168324 CHECKS=97077800	SAT TT=401.278 ASSIGNMENTS=1523430 CHECKS=906612000	? (TO) TT=1800.15	? (MO) TT=139.36	? (MO) TT=347.835
csp/mknap/ normalized-mknap-1-6.xml	SAT TT=12.671	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=302.627	? (TO) TT=1800.02	SAT TT=1589.11 CHECKS=7670940	SAT TT=73.533 ASSIGNMENTS=1489160	SAT TT=12.671 ASSIGNMENTS=200210	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=327.645 ASSIGNMENTS=1489160	SAT TT=1161.51 ASSIGNMENTS=1489160	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=15.122	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=274.199	? TT=256.572
csp/primes-10/ normalized-primes-10-20-2-1.xml	SAT TT=0.01	SAT TT=0.853 CHECKS=158104 NODES=100	SAT TT=0.816 CHECKS=158102 NODES=0	SAT TT=0.033	SAT TT=0.074 CHECKS=8189	SAT TT=0.162 CHECKS=454379	SAT TT=0.915 ASSIGNMENTS=70	SAT TT=0.918 ASSIGNMENTS=70	SAT TT=0.789 CHECKS=123369 NODES=100	SAT TT=1.954 CHECKS=235710 NODES=2550000	SAT TT=0.895 CHECKS=408855 NODES=25	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.024 ASSIGNMENTS=80 CHECKS=426	SAT TT=2.475	SAT TT=2.41	SAT TT=0.01 ASSIGNMENTS=80 CHECKS=426	SAT TT=0.011 ASSIGNMENTS=188 CHECKS=2153	SAT TT=0.36	SAT TT=0.754 ASSIGNMENTS=12314 CHECKS=205605	SAT TT=0.011 ASSIGNMENTS=80 CHECKS=426	SAT TT=4.472	SAT TT=0.661	SAT TT=0.677
csp/primes-10/ normalized-primes-10-20-2-7.xml	SAT TT=0.017	SAT TT=653.535 CHECKS=951192000 NODES=2248	SAT TT=1364.82 CHECKS=1947110000 NODES=3646	SAT TT=0.041	SAT TT=0.384 CHECKS=2307	SAT TT=0.043 CHECKS=3130	SAT TT=2.162 ASSIGNMENTS=68	SAT TT=2.831 ASSIGNMENTS=133	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.032 ASSIGNMENTS=155 CHECKS=11037	SAT TT=0.031 ASSIGNMENTS=155 CHECKS=11037	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.018 ASSIGNMENTS=157 CHECKS=11166	SAT TT=0.319 ASSIGNMENTS=7895 CHECKS=627071	SAT TT=0.408	SAT TT=3.165 ASSIGNMENTS=74177 CHECKS=3854570	SAT TT=0.017 ASSIGNMENTS=188 CHECKS=10088	? TT=96.005	? (MO) TT=75.97	? (MO) TT=286.147
csp/primes-10/ normalized-primes-10-20-3-5.xml	SAT TT=0.016	SAT TT=5.501 CHECKS=8073400 NODES=100	SAT TT=15.358 CHECKS=23870500 NODES=136	SAT TT=0.038	SAT TT=0.49 CHECKS=5200	SAT TT=0.039 CHECKS=4452	SAT TT=1.771 ASSIGNMENTS=74	SAT TT=2.393 ASSIGNMENTS=427	SAT TT=408.086 CHECKS=1231760000 NODES=100	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=0.028 ASSIGNMENTS=292 CHECKS=11929	SAT TT=0.031 ASSIGNMENTS=292 CHECKS=11929	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.018 ASSIGNMENTS=287 CHECKS=10416	SAT TT=0.196 ASSIGNMENTS=8217 CHECKS=358629	SAT TT=0.383	SAT TT=1.672 ASSIGNMENTS=42786 CHECKS=1300880	SAT TT=0.016 ASSIGNMENTS=301 CHECKS=9404	? TT=156.347	SAT TT=50.413	SAT TT=262.697
csp/primes-10/ normalized-primes-10-20-3-7.xml	SAT TT=0.019	? (TO) TT=1800.06	? (TO) TT=1800.12	SAT TT=0.046	SAT TT=0.462 CHECKS=4009	SAT TT=0.095 CHECKS=7125	SAT TT=1.985 ASSIGNMENTS=67	SAT TT=4.031 ASSIGNMENTS=1397	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=0.034 ASSIGNMENTS=367 CHECKS=16057	SAT TT=0.031 ASSIGNMENTS=367 CHECKS=16057	? (TO) TT=1800	? (TO) TT=1800.02	SAT TT=0.022 ASSIGNMENTS=416 CHECKS=21267	SAT TT=0.291 ASSIGNMENTS=8978 CHECKS=616039	SAT TT=0.379	SAT TT=5.415 ASSIGNMENTS=79977 CHECKS=4554320	SAT TT=0.019 ASSIGNMENTS=271 CHECKS=13261	? TT=142.343	? (MO) TT=107.42	? (MO) TT=291.89
csp/primes-10/ normalized-primes-10-40-2-1.xml	SAT TT=0.014	SAT TT=0.881 CHECKS=135689 NODES=100	SAT TT=0.869 CHECKS=136052 NODES=0	SAT TT=0.038	SAT TT=0.151 CHECKS=3125	SAT TT=0.112 CHECKS=192747	SAT TT=1.025 ASSIGNMENTS=43	SAT TT=1.131 ASSIGNMENTS=43	SAT TT=1.055 CHECKS=137067 NODES=100	SAT TT=0.978 CHECKS=150258 NODES=150008	SAT TT=1.197 CHECKS=476634 NODES=695	SAT TT=0.023 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.025 ASSIGNMENTS=77 CHECKS=1489	SAT TT=3.702	SAT TT=3.484	SAT TT=0.014 ASSIGNMENTS=77 CHECKS=1489	SAT TT=0.019 ASSIGNMENTS=607 CHECKS=9911	SAT TT=0.427	SAT TT=0.171 ASSIGNMENTS=14247 CHECKS=153407	SAT TT=0.014 ASSIGNMENTS=81 CHECKS=1668	SAT TT=6.239	SAT TT=0.719	SAT TT=0.821
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-10/ normalized-primes-10-40-2-3.xml	SAT TT=0.024	SAT TT=1.818 CHECKS=2215470 NODES=100	SAT TT=1.748 CHECKS=2118250 NODES=0	SAT TT=0.042	SAT TT=1.058 CHECKS=143718	SAT TT=0.769 CHECKS=141544	SAT TT=1.447 ASSIGNMENTS=41	SAT TT=1.45 ASSIGNMENTS=41	SAT TT=88.129 CHECKS=36681900 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.036 ASSIGNMENTS=265 CHECKS=16199	SAT TT=0.032 ASSIGNMENTS=265 CHECKS=16199	SAT TT=92.853	SAT TT=87.583	SAT TT=0.024 ASSIGNMENTS=248 CHECKS=15065	SAT TT=0.229 ASSIGNMENTS=6072 CHECKS=373064	SAT TT=0.471	SAT TT=4.728 ASSIGNMENTS=44233 CHECKS=3019640	SAT TT=0.048 ASSIGNMENTS=856 CHECKS=63863	? TT=235.257	SAT TT=1.659	SAT TT=3.6
csp/primes-10/ normalized-primes-10-40-2-5.xml	SAT TT=0.046	SAT TT=3.666 CHECKS=4657610 NODES=114	SAT TT=4.847 CHECKS=6028720 NODES=104	SAT TT=0.046	SAT TT=1.665 CHECKS=110788	SAT TT=1.287 CHECKS=103096	SAT TT=1.751 ASSIGNMENTS=66	SAT TT=3.364 ASSIGNMENTS=819	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	SAT TT=0.104 ASSIGNMENTS=2329 CHECKS=179214	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=0.061 ASSIGNMENTS=1234 CHECKS=98205	SAT TT=0.506 ASSIGNMENTS=10783 CHECKS=972402	SAT TT=0.406	SAT TT=1.657 ASSIGNMENTS=22774 CHECKS=1672320	SAT TT=0.046 ASSIGNMENTS=593 CHECKS=56924	? (TO) TT=1802.16	SAT TT=12.266	SAT TT=54.304
csp/primes-10/ normalized-primes-10-40-2-7.xml	SAT TT=33.443	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=115.815 CHECKS=5173190	SAT TT=763.048 CHECKS=34974900	SAT TT=319.275 ASSIGNMENTS=127110	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=40.446 ASSIGNMENTS=158147 CHECKS=72472100	SAT TT=38.867 ASSIGNMENTS=158147 CHECKS=72472100	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=842.724 ASSIGNMENTS=3552770 CHECKS=1768760000	SAT TT=563.257 ASSIGNMENTS=2830140 CHECKS=1210090000	SAT TT=72.969	SAT TT=47.41 ASSIGNMENTS=131010 CHECKS=49656500	SAT TT=33.443 ASSIGNMENTS=158147 CHECKS=72472100	? TT=150.763	? (MO) TT=114.562	? (MO) TT=301.34
csp/primes-10/ normalized-primes-10-40-3-1.xml	SAT TT=0.022	SAT TT=1.772 CHECKS=2005960 NODES=100	SAT TT=1.724 CHECKS=2005960 NODES=0	SAT TT=0.042	SAT TT=0.41 CHECKS=74382	SAT TT=0.212 CHECKS=85477	SAT TT=0.946 ASSIGNMENTS=33	SAT TT=0.969 ASSIGNMENTS=33	SAT TT=7.902 CHECKS=1673280 NODES=100	SAT TT=4.618 CHECKS=3454780 NODES=900005	SAT TT=3.523 CHECKS=1860540 NODES=3	SAT TT=0.033 ASSIGNMENTS=111 CHECKS=13839	SAT TT=0.03 ASSIGNMENTS=111 CHECKS=13839	SAT TT=10.82	SAT TT=10.457	SAT TT=0.022 ASSIGNMENTS=115 CHECKS=13960	SAT TT=0.316 ASSIGNMENTS=5463 CHECKS=539215	SAT TT=0.419	SAT TT=1.096 ASSIGNMENTS=16216 CHECKS=1120890	SAT TT=0.022 ASSIGNMENTS=113 CHECKS=13851	? TT=153.017	SAT TT=1.038	SAT TT=1.692
csp/primes-10/ normalized-primes-10-40-3-5.xml		? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1338.5	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=207.878	? (MO) TT=78.56	? (MO) TT=287.83
csp/primes-10/ normalized-primes-10-60-2-7.xml	SAT TT=0.122	SAT TT=493.417 CHECKS=775250000 NODES=5699	SAT TT=57.725 CHECKS=103653000 NODES=1286	SAT TT=0.122	SAT TT=8.599 CHECKS=334066	SAT TT=5.472 CHECKS=221518	SAT TT=10.268 ASSIGNMENTS=2512	SAT TT=5.397 ASSIGNMENTS=30	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=130.59 ASSIGNMENTS=327787 CHECKS=259520000	SAT TT=128.256 ASSIGNMENTS=327787 CHECKS=259520000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=15.694 ASSIGNMENTS=40637 CHECKS=33102200	SAT TT=2.589 ASSIGNMENTS=8468 CHECKS=5383740	SAT TT=0.64	SAT TT=50.278 ASSIGNMENTS=74191 CHECKS=62653000	SAT TT=122.707 ASSIGNMENTS=327787 CHECKS=259520000	? TT=153.487	? (MO) TT=88.81	? (MO) TT=296.502
csp/primes-10/ normalized-primes-10-60-3-5.xml	SAT TT=5.114	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=30.747	SAT TT=12.447 CHECKS=585172	SAT TT=5.114 CHECKS=236405	SAT TT=69.104 ASSIGNMENTS=19287	SAT TT=17.185 ASSIGNMENTS=2075	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=30.951 ASSIGNMENTS=60397 CHECKS=48981300	SAT TT=29.686 ASSIGNMENTS=60397 CHECKS=48981300	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=130.737 ASSIGNMENTS=331988 CHECKS=269430000	SAT TT=70.003 ASSIGNMENTS=153078 CHECKS=144142000	SAT TT=1.378	SAT TT=371.266 ASSIGNMENTS=236201 CHECKS=231564000	SAT TT=23.846 ASSIGNMENTS=60397 CHECKS=48981300	? (MO) TT=91.924	? (MO) TT=91.78	? (MO) TT=299.823
csp/primes-10/ normalized-primes-10-60-3-7.xml	SAT TT=39.879	? (TO) TT=1800.09	? (TO) TT=1800.18	SAT TT=39.879	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=1251.29	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=159.955	? TT=177.151	? TT=176.403
csp/primes-10/ normalized-primes-10-80-2-3.xml	SAT TT=0.022	SAT TT=1.093 CHECKS=303008 NODES=100	SAT TT=1.076 CHECKS=302110 NODES=0	SAT TT=0.056	SAT TT=0.607 CHECKS=463	SAT TT=0.022 CHECKS=425	SAT TT=1.008 ASSIGNMENTS=4	SAT TT=1.02 ASSIGNMENTS=4	SAT TT=104.127 CHECKS=16003400 NODES=100	SAT TT=43.66 CHECKS=16010400 NODES=0	SAT TT=40.844 CHECKS=16010400 NODES=0	SAT TT=0.033 ASSIGNMENTS=11 CHECKS=3914	SAT TT=0.035 ASSIGNMENTS=11 CHECKS=3914	SAT TT=191.251	SAT TT=187.716	SAT TT=0.023 ASSIGNMENTS=11 CHECKS=3912	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=3784	SAT TT=0.592	SAT TT=0.022 ASSIGNMENTS=10 CHECKS=3892	SAT TT=0.022 ASSIGNMENTS=11 CHECKS=3914	? TT=839.813	SAT TT=1.023	SAT TT=1.052
csp/primes-10/ normalized-primes-10-80-3-7.xml	SAT TT=0.16	SAT TT=86.406 CHECKS=147938000 NODES=1190	SAT TT=72.313 CHECKS=134964000 NODES=1240	SAT TT=0.16	SAT TT=11.46 CHECKS=411761	SAT TT=6.827 CHECKS=269248	SAT TT=6.842 ASSIGNMENTS=48	SAT TT=22.164 ASSIGNMENTS=664	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=32.59 ASSIGNMENTS=42572 CHECKS=58246100	SAT TT=32.78 ASSIGNMENTS=42572 CHECKS=58246100	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=7.263 ASSIGNMENTS=7759 CHECKS=15188400	SAT TT=5.086 ASSIGNMENTS=6721 CHECKS=10624600	SAT TT=7.464	SAT TT=105.574 ASSIGNMENTS=97456 CHECKS=78422600	SAT TT=25.357 ASSIGNMENTS=42572 CHECKS=58246100	? TT=175.723	? TT=179.94	? TT=172.781
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-15/ normalized-primes-15-20-2-1.xml	SAT TT=0.012	SAT TT=1.044 CHECKS=625877 NODES=100	SAT TT=0.999 CHECKS=625878 NODES=0	SAT TT=0.032	SAT TT=0.085 CHECKS=11512	SAT TT=0.191 CHECKS=727194	SAT TT=0.964 ASSIGNMENTS=70	SAT TT=0.965 ASSIGNMENTS=70	SAT TT=1.133 CHECKS=351005 NODES=100	SAT TT=0.829 CHECKS=359460 NODES=3	SAT TT=0.833 CHECKS=359593 NODES=4	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=0.024 ASSIGNMENTS=124 CHECKS=1139	SAT TT=3.971	SAT TT=3.808	SAT TT=0.012 ASSIGNMENTS=131 CHECKS=1287	SAT TT=0.056 ASSIGNMENTS=9295 CHECKS=68768	SAT TT=0.35	SAT TT=0.122 ASSIGNMENTS=15713 CHECKS=116213	SAT TT=0.014 ASSIGNMENTS=124 CHECKS=1139	SAT TT=9.963	SAT TT=0.664	SAT TT=0.689
csp/primes-15/ normalized-primes-15-20-2-3.xml	SAT TT=0.016	SAT TT=4.054 CHECKS=6875710 NODES=208	SAT TT=3.515 CHECKS=5466530 NODES=0	SAT TT=0.039	SAT TT=0.298 CHECKS=9399	SAT TT=0.405 CHECKS=415121	SAT TT=1.843 ASSIGNMENTS=68	SAT TT=2.076 ASSIGNMENTS=68	SAT TT=254.936 CHECKS=522581000 NODES=109	? (TO) TT=1800.04	? (MO) TT=32.08	SAT TT=0.026 ASSIGNMENTS=457 CHECKS=10020	SAT TT=0.031 ASSIGNMENTS=457 CHECKS=10020	SAT TT=672.909	SAT TT=669.211	SAT TT=0.016 ASSIGNMENTS=484 CHECKS=10922	SAT TT=0.115 ASSIGNMENTS=9210 CHECKS=210742	SAT TT=0.386	SAT TT=0.189 ASSIGNMENTS=10828 CHECKS=292168	SAT TT=0.017 ASSIGNMENTS=459 CHECKS=15670	? TT=149.464	SAT TT=5.382	SAT TT=19.036
csp/primes-15/ normalized-primes-15-20-2-5.xml	SAT TT=0.029	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT TT=0.039	SAT TT=1.315 CHECKS=461347	SAT TT=1.048 CHECKS=455362	SAT TT=2.442 ASSIGNMENTS=68	SAT TT=3.189 ASSIGNMENTS=63	? (TO) TT=1800.1	? (MO) TT=37.01	? (TO) TT=1800.08	SAT TT=0.034 ASSIGNMENTS=395 CHECKS=27209	SAT TT=0.036 ASSIGNMENTS=395 CHECKS=27209	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.031 ASSIGNMENTS=215 CHECKS=50660	SAT TT=0.179 ASSIGNMENTS=7414 CHECKS=370628	SAT TT=0.363	SAT TT=0.432 ASSIGNMENTS=17500 CHECKS=785998	SAT TT=0.029 ASSIGNMENTS=628 CHECKS=40274	? TT=484.085	? (MO) TT=64.918	? (MO) TT=256.178
csp/primes-15/ normalized-primes-15-20-2-7.xml	SAT TT=0.016	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=0.045	SAT TT=0.471 CHECKS=2162	SAT TT=0.153 CHECKS=14846	SAT TT=3.504 ASSIGNMENTS=67	SAT TT=4.565 ASSIGNMENTS=403	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=179 CHECKS=11240	SAT TT=0.027 ASSIGNMENTS=179 CHECKS=11240	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=11598	SAT TT=0.312 ASSIGNMENTS=8319 CHECKS=734406	SAT TT=0.397	SAT TT=0.396 ASSIGNMENTS=11581 CHECKS=946619	SAT TT=0.016 ASSIGNMENTS=185 CHECKS=9088	? TT=153.795	? TT=172.008	? TT=177.897
csp/primes-15/ normalized-primes-15-20-3-3.xml	SAT TT=0.014	SAT TT=1058.63 CHECKS=2002010000 NODES=19894	SAT TT=1112.38 CHECKS=2082310000 NODES=19952	SAT TT=0.041	SAT TT=0.346 CHECKS=6410	SAT TT=0.052 CHECKS=13140	SAT TT=3.165 ASSIGNMENTS=1400	SAT TT=4.201 ASSIGNMENTS=153	? (MO) TT=40.81	? (MO) TT=39.08	? (TO) TT=1800.07	SAT TT=0.027 ASSIGNMENTS=226 CHECKS=8194	SAT TT=0.026 ASSIGNMENTS=226 CHECKS=8194	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.016 ASSIGNMENTS=213 CHECKS=7952	SAT TT=0.19 ASSIGNMENTS=8621 CHECKS=388027	SAT TT=0.387	SAT TT=0.549 ASSIGNMENTS=13837 CHECKS=1105280	SAT TT=0.014 ASSIGNMENTS=226 CHECKS=8194	? (MO) TT=80.643	SAT TT=11.798	SAT TT=50.674
csp/primes-15/ normalized-primes-15-20-3-5.xml	SAT TT=0.012	SAT TT=44.969 CHECKS=84104800 NODES=1029	SAT TT=17.091 CHECKS=29812400 NODES=332	SAT TT=0.039	SAT TT=0.499 CHECKS=5503	SAT TT=0.988 CHECKS=308849	SAT TT=3.076 ASSIGNMENTS=65	SAT TT=4.459 ASSIGNMENTS=418	? (MO) TT=31	? (MO) TT=31.21	? (TO) TT=1800.01	SAT TT=0.024 ASSIGNMENTS=209 CHECKS=5780	SAT TT=0.028 ASSIGNMENTS=209 CHECKS=5780	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.014 ASSIGNMENTS=212 CHECKS=5862	SAT TT=0.154 ASSIGNMENTS=8357 CHECKS=346753	SAT TT=0.433	SAT TT=0.222 ASSIGNMENTS=10238 CHECKS=392054	SAT TT=0.012 ASSIGNMENTS=228 CHECKS=6277	? TT=148.497	? TT=171.401	? TT=163.689
csp/primes-15/ normalized-primes-15-40-2-1.xml	SAT TT=0.015	SAT TT=1.016 CHECKS=453007 NODES=100	SAT TT=1.033 CHECKS=453007 NODES=0	SAT TT=0.038	SAT TT=0.201 CHECKS=33733	SAT TT=0.071 CHECKS=183793	SAT TT=0.983 ASSIGNMENTS=40	SAT TT=1.186 ASSIGNMENTS=40	SAT TT=1.843 CHECKS=433837 NODES=100	SAT TT=1.244 CHECKS=438773 NODES=3	SAT TT=1.18 CHECKS=438782 NODES=2	SAT TT=0.026 ASSIGNMENTS=81 CHECKS=1797	SAT TT=0.027 ASSIGNMENTS=81 CHECKS=1797	SAT TT=4.941	SAT TT=5.016	SAT TT=0.015 ASSIGNMENTS=81 CHECKS=1798	SAT TT=0.028 ASSIGNMENTS=1611 CHECKS=20491	SAT TT=0.387	SAT TT=0.042 ASSIGNMENTS=3392 CHECKS=27539	SAT TT=0.016 ASSIGNMENTS=82 CHECKS=1797	SAT TT=17.683	SAT TT=0.722	SAT TT=0.739
csp/primes-15/ normalized-primes-15-40-2-7.xml	SAT TT=1443.63	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (MO) TT=36.87	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=1443.63 ASSIGNMENTS=11022500 CHECKS=3704260000	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=150.714	? TT=168.574	? TT=170.652
csp/primes-15/ normalized-primes-15-40-3-1.xml	SAT TT=0.027	SAT TT=2.708 CHECKS=4512560 NODES=176	SAT TT=1.45 CHECKS=1283470 NODES=0	SAT TT=0.041	SAT TT=0.455 CHECKS=1963	SAT TT=0.126 CHECKS=139933	SAT TT=0.925 ASSIGNMENTS=32	SAT TT=0.928 ASSIGNMENTS=32	SAT TT=50.607 CHECKS=18566900 NODES=100	SAT TT=18.439 CHECKS=19420900 NODES=2250010	SAT TT=15.754 CHECKS=18777000 NODES=3	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=0.042 ASSIGNMENTS=735 CHECKS=30517	SAT TT=45.823	SAT TT=45.152	SAT TT=0.027 ASSIGNMENTS=612 CHECKS=28673	SAT TT=0.171 ASSIGNMENTS=5469 CHECKS=330249	SAT TT=0.426	SAT TT=0.192 ASSIGNMENTS=14231 CHECKS=327165	SAT TT=0.028 ASSIGNMENTS=451 CHECKS=33181	? (MO) TT=70.332	SAT TT=1	SAT TT=1.452
csp/primes-15/ normalized-primes-15-40-3-5.xml		? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.05	? (MO) TT=21.21	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (MO) TT=94.112	? TT=164.007	? TT=160.96
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-15/ normalized-primes-15-40-3-7.xml		? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=156.947	? TT=171.199	? TT=171.363
csp/primes-15/ normalized-primes-15-60-2-7.xml	SAT TT=0.084	SAT TT=11.562 CHECKS=20201800 NODES=995	SAT TT=14.885 CHECKS=24754700 NODES=975	SAT TT=0.084	SAT TT=2.331 CHECKS=47350	SAT TT=2.153 CHECKS=82703	SAT TT=1.579 ASSIGNMENTS=4	SAT TT=1.602 ASSIGNMENTS=4	? (MO) TT=34.32	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.171 ASSIGNMENTS=2582 CHECKS=2852640	SAT TT=1.165 ASSIGNMENTS=2582 CHECKS=2852640	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=9.156 ASSIGNMENTS=16738 CHECKS=23001700	SAT TT=38.774 ASSIGNMENTS=91439 CHECKS=97877200	SAT TT=0.595	SAT TT=3.579 ASSIGNMENTS=14758 CHECKS=8664370	SAT TT=1.442 ASSIGNMENTS=3648 CHECKS=3569320	? (MO) TT=70.793	? TT=175.619	? TT=176.447
csp/primes-15/ normalized-primes-15-80-2-1.xml	SAT TT=0.02	SAT TT=0.977 CHECKS=153841 NODES=100	SAT TT=0.966 CHECKS=153841 NODES=0	SAT TT=0.047	SAT TT=0.371 CHECKS=584	SAT TT=0.02 CHECKS=541	SAT TT=1.027 ASSIGNMENTS=10	SAT TT=1.034 ASSIGNMENTS=10	SAT TT=2.76 CHECKS=122263 NODES=100	SAT TT=1.619 CHECKS=123343 NODES=0	SAT TT=1.621 CHECKS=123343 NODES=0	SAT TT=0.03 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.034 ASSIGNMENTS=42 CHECKS=1496	SAT TT=6.815	SAT TT=6.378	SAT TT=0.022 ASSIGNMENTS=42 CHECKS=1496	SAT TT=0.027 ASSIGNMENTS=1052 CHECKS=10340	SAT TT=0.457	SAT TT=0.024 ASSIGNMENTS=970 CHECKS=2723	SAT TT=0.021 ASSIGNMENTS=42 CHECKS=1496	SAT TT=17.438	SAT TT=0.812	SAT TT=0.821
csp/primes-15/ normalized-primes-15-80-2-3.xml	SAT TT=0.022	SAT TT=1.652 CHECKS=720329 NODES=100	SAT TT=1.586 CHECKS=737764 NODES=0	SAT TT=0.057	SAT TT=0.878 CHECKS=435	SAT TT=0.023 CHECKS=396	SAT TT=0.98 ASSIGNMENTS=4	SAT TT=0.975 ASSIGNMENTS=4	? (MO) TT=121.73	? (MO) TT=32.38	? (MO) TT=464.26	SAT TT=0.038 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.036 ASSIGNMENTS=4 CHECKS=3864	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.026 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.024 ASSIGNMENTS=4 CHECKS=3863	SAT TT=0.516	SAT TT=0.025 ASSIGNMENTS=4 CHECKS=3864	SAT TT=0.022 ASSIGNMENTS=4 CHECKS=3864	? TT=426.146	SAT TT=1.057	SAT TT=1.079
csp/primes-15/ normalized-primes-15-80-3-1.xml	SAT TT=0.025	SAT TT=1.299 CHECKS=872531 NODES=100	SAT TT=1.303 CHECKS=686150 NODES=0	SAT TT=0.057	SAT TT=0.974 CHECKS=5101	SAT TT=0.027 CHECKS=2726	SAT TT=1.023 ASSIGNMENTS=9	SAT TT=0.894 ASSIGNMENTS=9	SAT TT=84.377 CHECKS=8708400 NODES=100	SAT TT=24.955 CHECKS=9043240 NODES=0	SAT TT=24.737 CHECKS=9043240 NODES=0	SAT TT=0.034 ASSIGNMENTS=61 CHECKS=8807	SAT TT=0.036 ASSIGNMENTS=61 CHECKS=8807	SAT TT=96.082	SAT TT=93.246	SAT TT=0.025 ASSIGNMENTS=58 CHECKS=8774	SAT TT=0.028 ASSIGNMENTS=1028 CHECKS=18497	SAT TT=0.538	SAT TT=0.029 ASSIGNMENTS=1303 CHECKS=10591	SAT TT=0.029 ASSIGNMENTS=61 CHECKS=8807	? (MO) TT=52.823	SAT TT=1.038	SAT TT=1.244
csp/primes-15/ normalized-primes-15-80-3-5.xml	SAT TT=0.686	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.686	SAT TT=17.571 CHECKS=752519	SAT TT=11.804 CHECKS=603646	SAT TT=12.083 ASSIGNMENTS=207	SAT TT=21.58 ASSIGNMENTS=701	? (MO) TT=74.55	? (TO) TT=1800.09	? (MO) TT=342.04	SAT TT=92.115 ASSIGNMENTS=119813 CHECKS=227104000	SAT TT=100.176 ASSIGNMENTS=119813 CHECKS=227104000	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=28.595 ASSIGNMENTS=42536 CHECKS=70575200	SAT TT=6.554 ASSIGNMENTS=8435 CHECKS=16202100	SAT TT=1.177	SAT TT=22.438 ASSIGNMENTS=41520 CHECKS=54005800	SAT TT=89.871 ASSIGNMENTS=119813 CHECKS=227104000	? (MO) TT=91.761	? TT=173.009	? TT=167.993
csp/primes-20/ normalized-primes-20-20-2-3.xml	SAT TT=0.011	SAT TT=18.757 CHECKS=34619800 NODES=242	SAT TT=20.774 CHECKS=40845700 NODES=203	SAT TT=0.041	SAT TT=0.383 CHECKS=5637	SAT TT=1.385 CHECKS=705219	SAT TT=4.089 ASSIGNMENTS=71	SAT TT=4.032 ASSIGNMENTS=71	SAT TT=1027.31 CHECKS=4569250000 NODES=102	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.023 ASSIGNMENTS=215 CHECKS=5379	SAT TT=0.024 ASSIGNMENTS=215 CHECKS=5379	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.013 ASSIGNMENTS=204 CHECKS=5269	SAT TT=0.141 ASSIGNMENTS=8448 CHECKS=344251	SAT TT=0.407	SAT TT=0.015 ASSIGNMENTS=514 CHECKS=6741	SAT TT=0.011 ASSIGNMENTS=215 CHECKS=5379	? TT=153.189	SAT TT=9.602	SAT TT=44.141
csp/primes-20/ normalized-primes-20-20-2-7.xml	SAT TT=0.045	? (TO) TT=1800.18	? (TO) TT=1800.1	SAT TT=0.045	SAT TT=0.754 CHECKS=3566	SAT TT=0.123 CHECKS=6495	SAT TT=8.714 ASSIGNMENTS=1980	SAT TT=14.392 ASSIGNMENTS=2190	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	SAT TT=0.05 ASSIGNMENTS=378 CHECKS=69901	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=0.047 ASSIGNMENTS=794 CHECKS=105620	SAT TT=0.326 ASSIGNMENTS=8992 CHECKS=869312	SAT TT=0.418	SAT TT=0.053 ASSIGNMENTS=1107 CHECKS=113350	SAT TT=0.057 ASSIGNMENTS=550 CHECKS=136267	? (MO) TT=78.201	? TT=197.599	? TT=195.926
csp/primes-20/ normalized-primes-20-20-3-5.xml	SAT TT=0.016	SAT TT=444.546 CHECKS=659615000 NODES=2076	SAT TT=414.36 CHECKS=666945000 NODES=2088	SAT TT=0.047	SAT TT=0.587 CHECKS=3626	SAT TT=0.451 CHECKS=123394	SAT TT=6.927 ASSIGNMENTS=62	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=0.029 ASSIGNMENTS=322 CHECKS=15105	SAT TT=0.028 ASSIGNMENTS=322 CHECKS=15105	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=0.016 ASSIGNMENTS=323 CHECKS=15398	SAT TT=0.219 ASSIGNMENTS=8387 CHECKS=553031	SAT TT=0.691	SAT TT=0.026 ASSIGNMENTS=730 CHECKS=39851	SAT TT=0.02 ASSIGNMENTS=635 CHECKS=30686	? (MO) TT=78.021	? TT=225.07	? TT=219.979
csp/primes-20/ normalized-primes-20-40-2-3.xml	SAT TT=0.084	SAT TT=5.56 CHECKS=9644510 NODES=267	SAT TT=5.59 CHECKS=10123300 NODES=194	SAT TT=0.084	SAT TT=4.767 CHECKS=426225	SAT TT=1.857 CHECKS=192701	SAT TT=5.355 ASSIGNMENTS=240	SAT TT=5.822 ASSIGNMENTS=240	SAT TT=552.96 CHECKS=1956630000 NODES=102	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.416 ASSIGNMENTS=11794 CHECKS=1084850	SAT TT=0.419 ASSIGNMENTS=11794 CHECKS=1084850	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT TT=1.391 ASSIGNMENTS=32239 CHECKS=3634010	SAT TT=0.288 ASSIGNMENTS=8340 CHECKS=783517	SAT TT=0.419	SAT TT=0.308 ASSIGNMENTS=5407 CHECKS=804030	SAT TT=0.4 ASSIGNMENTS=7466 CHECKS=1035040	? TT=479.395	SAT TT=11.651	SAT TT=40.428
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-40-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	? (MO) TT=99.079	? TT=180.653	? TT=178.447
csp/primes-20/ normalized-primes-20-60-2-1.xml	SAT TT=0.014	SAT TT=1.179 CHECKS=760011 NODES=100	SAT TT=1.253 CHECKS=760010 NODES=0	SAT TT=0.044	SAT TT=0.474 CHECKS=12045	SAT TT=0.045 CHECKS=76054	SAT TT=1.276 ASSIGNMENTS=22	SAT TT=1.205 ASSIGNMENTS=22	SAT TT=6.557 CHECKS=569187 NODES=100	SAT TT=2.81 CHECKS=574695 NODES=2	SAT TT=3.147 CHECKS=574688 NODES=0	SAT TT=0.028 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.024 ASSIGNMENTS=86 CHECKS=4665	SAT TT=10.585	SAT TT=11.087	SAT TT=0.017 ASSIGNMENTS=86 CHECKS=4665	SAT TT=0.041 ASSIGNMENTS=2704 CHECKS=64570	SAT TT=0.414	SAT TT=0.017 ASSIGNMENTS=177 CHECKS=4847	SAT TT=0.014 ASSIGNMENTS=85 CHECKS=4594	SAT TT=37.177	SAT TT=0.819	SAT TT=0.85
csp/primes-20/ normalized-primes-20-60-2-3.xml	SAT TT=0.026	SAT TT=2.444 CHECKS=3620830 NODES=100	SAT TT=2.196 CHECKS=3494320 NODES=0	SAT TT=0.046	SAT TT=1.289 CHECKS=21236	SAT TT=0.037 CHECKS=17025	SAT TT=1.265 ASSIGNMENTS=12	SAT TT=1.194 ASSIGNMENTS=12	SAT TT=387.381 CHECKS=1121670000 NODES=100	SAT TT=307.261 CHECKS=1121670000 NODES=0	SAT TT=305.714 CHECKS=1121670000 NODES=2	SAT TT=0.037 ASSIGNMENTS=150 CHECKS=26468	SAT TT=0.035 ASSIGNMENTS=150 CHECKS=26468	? (TO) TT=1800	? (TO) TT=1800.01	SAT TT=0.026 ASSIGNMENTS=143 CHECKS=24672	SAT TT=0.371 ASSIGNMENTS=4099 CHECKS=918767	SAT TT=0.485	SAT TT=0.031 ASSIGNMENTS=191 CHECKS=37531	SAT TT=0.026 ASSIGNMENTS=150 CHECKS=26464	? TT=225.439	SAT TT=1.088	SAT TT=1.133
csp/primes-20/ normalized-primes-20-60-3-3.xml	SAT TT=0.065	SAT TT=49.886 CHECKS=103204000 NODES=509	SAT TT=54.667 CHECKS=114149000 NODES=433	SAT TT=0.065	SAT TT=10.812 CHECKS=661914	SAT TT=3.993 CHECKS=248777	SAT TT=11.817 ASSIGNMENTS=145	SAT TT=40.515 ASSIGNMENTS=15261	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.546 ASSIGNMENTS=2670 CHECKS=1358080	SAT TT=0.538 ASSIGNMENTS=2670 CHECKS=1358080	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=94.669 ASSIGNMENTS=332305 CHECKS=269388000	SAT TT=1.683 ASSIGNMENTS=7315 CHECKS=4726500	SAT TT=0.712	SAT TT=1.03 ASSIGNMENTS=2640 CHECKS=2851710	SAT TT=0.841 ASSIGNMENTS=3791 CHECKS=2212590	? (MO) TT=119.9	? (MO) TT=63.141	? (MO) TT=258.92
csp/primes-20/ normalized-primes-20-60-3-5.xml		? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=913.24	? (TO) TT=1800.08	? (TO) TT=1800.04	? (MO) TT=63.267	? TT=178.063	? TT=177.981
csp/primes-20/ normalized-primes-20-60-3-7.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.22	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (MO) TT=92.647	? TT=197.788	? TT=199.588
csp/primes-20/ normalized-primes-20-80-2-1.xml	SAT TT=0.018	SAT TT=1.296 CHECKS=761651 NODES=100	SAT TT=1.223 CHECKS=761650 NODES=0	SAT TT=0.045	SAT TT=0.596 CHECKS=502	SAT TT=0.02 CHECKS=4832	SAT TT=1.157 ASSIGNMENTS=11	SAT TT=1.245 ASSIGNMENTS=11	SAT TT=7.532 CHECKS=564964 NODES=100	SAT TT=3.45 CHECKS=570531 NODES=1	SAT TT=3.427 CHECKS=570616 NODES=1	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.03 ASSIGNMENTS=17 CHECKS=3945	SAT TT=13.099	SAT TT=11.827	SAT TT=0.019 ASSIGNMENTS=17 CHECKS=3945	SAT TT=0.019 ASSIGNMENTS=22 CHECKS=4023	SAT TT=0.447	SAT TT=0.02 ASSIGNMENTS=17 CHECKS=3907	SAT TT=0.018 ASSIGNMENTS=17 CHECKS=3945	SAT TT=38.958	SAT TT=0.903	SAT TT=0.899
csp/primes-20/ normalized-primes-20-80-2-7.xml	SAT TT=0.061	SAT TT=2.608 CHECKS=2280940 NODES=102	? (MO) TT=1.094	SAT TT=0.064	SAT TT=2.616 CHECKS=1993	SAT TT=0.061 CHECKS=1974	SAT TT=1.065 ASSIGNMENTS=1	SAT TT=1.059 ASSIGNMENTS=1	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=0.14 ASSIGNMENTS=86 CHECKS=291675	SAT TT=0.132 ASSIGNMENTS=86 CHECKS=291675	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.121 ASSIGNMENTS=87 CHECKS=290766	SAT TT=2.476 ASSIGNMENTS=4052 CHECKS=7132430	SAT TT=0.566	SAT TT=0.091 ASSIGNMENTS=94 CHECKS=203043	SAT TT=0.121 ASSIGNMENTS=86 CHECKS=291675	? TT=338.589	SAT TT=1.233	SAT TT=1.303
csp/primes-20/ normalized-primes-20-80-3-1.xml	SAT TT=0.026	SAT TT=2.083 CHECKS=2648340 NODES=100	SAT TT=1.626 CHECKS=2002620 NODES=0	SAT TT=0.056	SAT TT=1.189 CHECKS=9015	SAT TT=0.035 CHECKS=9128	SAT TT=1.124 ASSIGNMENTS=10	SAT TT=0.967 ASSIGNMENTS=10	SAT TT=139.976 CHECKS=78008800 NODES=100	SAT TT=136.031 CHECKS=90420600 NODES=1	SAT TT=133.582 CHECKS=90420700 NODES=1	SAT TT=0.039 ASSIGNMENTS=41 CHECKS=19826	SAT TT=0.036 ASSIGNMENTS=41 CHECKS=19826	SAT TT=459.678	SAT TT=448.309	SAT TT=0.028 ASSIGNMENTS=41 CHECKS=19821	SAT TT=0.162 ASSIGNMENTS=1055 CHECKS=350031	SAT TT=0.534	SAT TT=0.036 ASSIGNMENTS=109 CHECKS=37635	SAT TT=0.026 ASSIGNMENTS=41 CHECKS=19826	? TT=154.84	SAT TT=1.145	SAT TT=1.267
csp/primes-20/ normalized-primes-20-80-3-5.xml	SAT TT=91.117	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=114.798	SAT TT=1580.7 CHECKS=81040900	SAT TT=1534.1 CHECKS=74172400	SAT TT=330.626 ASSIGNMENTS=15523	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=179.823 ASSIGNMENTS=186794 CHECKS=502918000	SAT TT=189.874 ASSIGNMENTS=186794 CHECKS=502918000	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=91.117 ASSIGNMENTS=104594 CHECKS=272473000	SAT TT=203.622	SAT TT=276.054 ASSIGNMENTS=178349 CHECKS=814585000	SAT TT=183.603 ASSIGNMENTS=186794 CHECKS=502918000	? TT=224.842	? TT=298.295	? TT=298.739
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-20/ normalized-primes-20-80-3-7.xml	SAT TT=11.866	SAT TT=923.091 CHECKS=1739830000 NODES=11857	SAT TT=911.841 CHECKS=1692960000 NODES=11937	SAT TT=14.554	SAT TT=11.866 CHECKS=332766	SAT TT=13.841 CHECKS=535867	SAT TT=10.107 ASSIGNMENTS=1	SAT TT=16.097 ASSIGNMENTS=1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=82.161 ASSIGNMENTS=93844 CHECKS=212771000	SAT TT=82.772 ASSIGNMENTS=93844 CHECKS=212771000	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=80.136 ASSIGNMENTS=85219 CHECKS=222324000	SAT TT=1.156	? (TO) TT=1800.02	SAT TT=76.13 ASSIGNMENTS=93844 CHECKS=212771000	? (MO) TT=108.635	? TT=195.215	? TT=185.447
csp/primes-25/ normalized-primes-25-20-2-7.xml	SAT TT=0.017	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=0.046	SAT TT=0.705 CHECKS=2746	SAT TT=4.022 CHECKS=412244	SAT TT=12.93 ASSIGNMENTS=65	SAT TT=33.737 ASSIGNMENTS=18751	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.028 ASSIGNMENTS=419 CHECKS=16634	SAT TT=0.031 ASSIGNMENTS=419 CHECKS=16634	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=0.017 ASSIGNMENTS=294 CHECKS=14856	SAT TT=0.348 ASSIGNMENTS=9223 CHECKS=1043960	SAT TT=0.4	SAT TT=0.028 ASSIGNMENTS=799 CHECKS=39635	SAT TT=0.018 ASSIGNMENTS=343 CHECKS=15285	? (MO) TT=64.084	? TT=180.352	? TT=172.936
csp/primes-25/ normalized-primes-25-20-3-1.xml	SAT TT=0.028	SAT TT=38.741 CHECKS=90727300 NODES=217	SAT TT=43.712 CHECKS=103087000 NODES=0	SAT TT=0.036	SAT TT=0.471 CHECKS=11533	SAT TT=3.552 CHECKS=1575720	SAT TT=18.081 ASSIGNMENTS=586	SAT TT=15.635 ASSIGNMENTS=586	SAT TT=256.803 CHECKS=977269000 NODES=100	SAT TT=213.361 CHECKS=986536000 NODES=300000	SAT TT=205.985 CHECKS=1013240000 NODES=1333	SAT TT=0.041 ASSIGNMENTS=329 CHECKS=61249	SAT TT=0.042 ASSIGNMENTS=329 CHECKS=61249	SAT TT=425.732	SAT TT=440.835	SAT TT=0.03 ASSIGNMENTS=322 CHECKS=64288	SAT TT=0.204 ASSIGNMENTS=8076 CHECKS=538835	SAT TT=0.394	SAT TT=0.028 ASSIGNMENTS=669 CHECKS=49310	SAT TT=0.028 ASSIGNMENTS=329 CHECKS=61249	? (MO) TT=113.729	SAT TT=5.2	SAT TT=13.14
csp/primes-25/ normalized-primes-25-20-3-3.xml	SAT TT=0.013	SAT TT=10.806 CHECKS=19666500 NODES=106	SAT TT=47.058 CHECKS=93495400 NODES=189	SAT TT=0.04	SAT TT=0.497 CHECKS=6005	SAT TT=0.047 CHECKS=6574	SAT TT=9.245 ASSIGNMENTS=67	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	SAT TT=0.03 ASSIGNMENTS=876 CHECKS=21278	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.02 ASSIGNMENTS=846 CHECKS=20959	SAT TT=0.172 ASSIGNMENTS=8617 CHECKS=431837	SAT TT=0.42	SAT TT=0.023 ASSIGNMENTS=838 CHECKS=25826	SAT TT=0.013 ASSIGNMENTS=272 CHECKS=7649	? (MO) TT=88.536	? (MO) TT=72.5	? (MO) TT=271.997
csp/primes-25/ normalized-primes-25-20-3-7.xml	SAT TT=0.031	? (TO) TT=1800.15	? (TO) TT=1800.11	SAT TT=0.051	SAT TT=1.375 CHECKS=25469	SAT TT=2.237 CHECKS=276702	SAT TT=14.599 ASSIGNMENTS=727	SAT TT=21.018 ASSIGNMENTS=407	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=906 CHECKS=54594	SAT TT=0.046 ASSIGNMENTS=906 CHECKS=54594	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.031 ASSIGNMENTS=901 CHECKS=55084	SAT TT=0.495 ASSIGNMENTS=12073 CHECKS=1393870	SAT TT=0.427	SAT TT=0.202 ASSIGNMENTS=1931 CHECKS=557057	SAT TT=0.057 ASSIGNMENTS=1018 CHECKS=134418	? TT=481.549	? TT=180.924	? TT=176.414
csp/primes-25/ normalized-primes-25-40-2-7.xml	SAT TT=15.341	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=31.287	? (TO) TT=1800.02	SAT TT=124.228 CHECKS=5432470	SAT TT=733.489 ASSIGNMENTS=78199	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=23.12 ASSIGNMENTS=105150 CHECKS=45655600	SAT TT=22.893 ASSIGNMENTS=105150 CHECKS=45655600	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=21.808 ASSIGNMENTS=161853 CHECKS=64860500	? (TO) TT=1800.07	SAT TT=77.737	SAT TT=279.999 ASSIGNMENTS=1235820 CHECKS=870201000	SAT TT=15.341 ASSIGNMENTS=105150 CHECKS=45655600	? (MO) TT=129.777	? TT=195.327	? TT=200.303
csp/primes-25/ normalized-primes-25-40-3-3.xml	SAT TT=719.109	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=730.806 CHECKS=54069600	? (TO) TT=1800.09	SAT TT=719.109 ASSIGNMENTS=147256	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=576.847	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=65.73	? (MO) TT=92.61	? (MO) TT=269.473
csp/primes-25/ normalized-primes-25-40-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=525.342	? TT=177.195	? TT=186.267
csp/primes-25/ normalized-primes-25-40-3-7.xml		? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (MO) TT=93.638	? TT=195.065	? TT=193.933
csp/primes-25/ normalized-primes-25-60-2-3.xml	SAT TT=0.028	SAT TT=4.821 CHECKS=9112160 NODES=100	SAT TT=4.278 CHECKS=8330110 NODES=0	SAT TT=0.051	SAT TT=1.251 CHECKS=21336	SAT TT=0.05 CHECKS=24184	SAT TT=1.542 ASSIGNMENTS=14	SAT TT=1.397 ASSIGNMENTS=14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=0.043 ASSIGNMENTS=158 CHECKS=39732	SAT TT=0.044 ASSIGNMENTS=158 CHECKS=39732	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=0.034 ASSIGNMENTS=158 CHECKS=39751	SAT TT=0.555 ASSIGNMENTS=4545 CHECKS=1495110	SAT TT=0.469	SAT TT=0.028 ASSIGNMENTS=161 CHECKS=34862	SAT TT=0.033 ASSIGNMENTS=148 CHECKS=39262	? TT=706.195	SAT TT=1.177	SAT TT=1.966
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-25/ normalized-primes-25-60-2-7.xml	SAT TT=2.076	SAT TT=254.464 CHECKS=461773000 NODES=1874	SAT TT=267.483 CHECKS=457298000 NODES=1907	? (TO) TT=1800.03	SAT TT=18.173 CHECKS=644936	SAT TT=7.699 CHECKS=328053	SAT TT=26.452 ASSIGNMENTS=196	SAT TT=100.449 ASSIGNMENTS=4955	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=9.799 ASSIGNMENTS=9957 CHECKS=5897070	SAT TT=9.186 ASSIGNMENTS=9957 CHECKS=5897070	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=628.385 ASSIGNMENTS=1947700 CHECKS=1808710000	SAT TT=92.648 ASSIGNMENTS=346297 CHECKS=266206000	SAT TT=0.785	? (TO) TT=1800.11	SAT TT=2.076 ASSIGNMENTS=9957 CHECKS=5897070	? TT=163.571	? TT=225.154	? TT=220.838
csp/primes-25/ normalized-primes-25-60-3-3.xml	SAT TT=0.243	SAT TT=34.036 CHECKS=71149200 NODES=245	SAT TT=181.798 CHECKS=387635000 NODES=1019	SAT TT=0.243	SAT TT=23.351 CHECKS=1428150	SAT TT=52.088 CHECKS=3235850	SAT TT=17.806 ASSIGNMENTS=11	SAT TT=64.297 ASSIGNMENTS=1435	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=828.83 ASSIGNMENTS=1862700 CHECKS=2181150000	SAT TT=781.47 ASSIGNMENTS=1862700 CHECKS=2181150000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=47.216 ASSIGNMENTS=136977 CHECKS=126786000	SAT TT=43.753 ASSIGNMENTS=84714 CHECKS=117293000	SAT TT=0.628	SAT TT=244.959 ASSIGNMENTS=510823 CHECKS=705319000	SAT TT=756.398 ASSIGNMENTS=1862700 CHECKS=2181150000	? TT=114.406	? (MO) TT=143.56	? (MO) TT=320.08
csp/primes-25/ normalized-primes-25-80-2-5.xml	SAT TT=0.055	SAT TT=3.926 CHECKS=6177420 NODES=108	SAT TT=3.323 CHECKS=5864340 NODES=0	SAT TT=0.064	SAT TT=1.874 CHECKS=1992	SAT TT=0.056 CHECKS=1971	SAT TT=1.166 ASSIGNMENTS=3	SAT TT=1.251 ASSIGNMENTS=3	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.069 ASSIGNMENTS=30 CHECKS=90524	SAT TT=0.071 ASSIGNMENTS=30 CHECKS=90524	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=0.058 ASSIGNMENTS=26 CHECKS=90497	SAT TT=1.351 ASSIGNMENTS=3821 CHECKS=3588220	SAT TT=0.677	SAT TT=0.056 ASSIGNMENTS=45 CHECKS=90257	SAT TT=0.055 ASSIGNMENTS=26 CHECKS=90498	? TT=394.8	SAT TT=1.294	SAT TT=1.155
csp/primes-25/ normalized-primes-25-80-3-1.xml	SAT TT=0.029	SAT TT=3.633 CHECKS=6661920 NODES=100	SAT TT=2.976 CHECKS=5340230 NODES=0	SAT TT=0.057	SAT TT=1.663 CHECKS=14399	SAT TT=0.038 CHECKS=14614	SAT TT=1.541 ASSIGNMENTS=10	SAT TT=1.352 ASSIGNMENTS=10	SAT TT=134.991 CHECKS=342219000 NODES=100	SAT TT=75.785 CHECKS=342220000 NODES=0	SAT TT=81.917 CHECKS=342220000 NODES=0	SAT TT=0.04 ASSIGNMENTS=37 CHECKS=26636	SAT TT=0.044 ASSIGNMENTS=37 CHECKS=26636	SAT TT=1428.05	SAT TT=1470.51	SAT TT=0.032 ASSIGNMENTS=40 CHECKS=27958	SAT TT=0.202 ASSIGNMENTS=673 CHECKS=465261	SAT TT=0.473	SAT TT=0.033 ASSIGNMENTS=72 CHECKS=32763	SAT TT=0.029 ASSIGNMENTS=39 CHECKS=33024	? TT=157.489	SAT TT=1.426	SAT TT=1.637
csp/primes-25/ normalized-primes-25-80-3-3.xml	SAT TT=0.067	SAT TT=7.36 CHECKS=13996200 NODES=154	SAT TT=5.658 CHECKS=10623600 NODES=0	SAT TT=0.067	SAT TT=3.213 CHECKS=70665	SAT TT=5.024 CHECKS=306000	SAT TT=1.338 ASSIGNMENTS=2	SAT TT=1.385 ASSIGNMENTS=2	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1.327 ASSIGNMENTS=1118 CHECKS=3451170	SAT TT=1.339 ASSIGNMENTS=1118 CHECKS=3451170	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.186 ASSIGNMENTS=1812 CHECKS=5750010	SAT TT=4.875 ASSIGNMENTS=5756 CHECKS=13654300	SAT TT=0.734	SAT TT=10.66 ASSIGNMENTS=8665 CHECKS=28272700	SAT TT=5.254 ASSIGNMENTS=4382 CHECKS=14034300	? TT=161.145	? (MO) TT=171.286	? (MO) TT=351.191
csp/primes-25/ normalized-primes-25-80-3-7.xml	SAT TT=91.769	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=1335.59 CHECKS=51343900	SAT TT=296.364 CHECKS=12402700	SAT TT=1533.37 ASSIGNMENTS=63225	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=98.829 ASSIGNMENTS=113994 CHECKS=260918000	SAT TT=100.388 ASSIGNMENTS=113994 CHECKS=260918000	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=479.61 ASSIGNMENTS=439638 CHECKS=1362960000	SAT TT=59.217	SAT TT=753.497 ASSIGNMENTS=351681 CHECKS=2116260000	SAT TT=91.769 ASSIGNMENTS=113994 CHECKS=260918000	? TT=158.871	? TT=212.879	? TT=203.831
csp/primes-30/ normalized-primes-30-20-3-1.xml	SAT TT=0.025	SAT TT=47.135 CHECKS=113997000 NODES=174	SAT TT=113.839 CHECKS=259686000 NODES=140	SAT TT=0.036	SAT TT=4.256 CHECKS=1660860	SAT TT=3.385 CHECKS=1666710	SAT TT=9.961 ASSIGNMENTS=68	SAT TT=9.715 ASSIGNMENTS=68	? (MO) TT=9.97	? (MO) TT=10.18	? (MO) TT=9.84	SAT TT=0.083 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=0.082 ASSIGNMENTS=1900 CHECKS=153548	SAT TT=787.185	SAT TT=812.25	SAT TT=0.065 ASSIGNMENTS=1811 CHECKS=153177	SAT TT=0.308 ASSIGNMENTS=11023 CHECKS=809734	SAT TT=0.363	SAT TT=0.025 ASSIGNMENTS=911 CHECKS=31326	SAT TT=0.036 ASSIGNMENTS=939 CHECKS=70608	? TT=490.312	SAT TT=11.012	SAT TT=17.049
csp/primes-30/ normalized-primes-30-20-3-7.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=0.039	SAT TT=0.876 CHECKS=4683	SAT TT=0.066 CHECKS=4136	SAT TT=19.635 ASSIGNMENTS=73	? (TO) TT=1800.11	? (MO) TT=9.95	? (MO) TT=10.57	? (MO) TT=9.89	SAT TT=0.033 ASSIGNMENTS=531 CHECKS=28064	SAT TT=0.035 ASSIGNMENTS=531 CHECKS=28064	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.022 ASSIGNMENTS=471 CHECKS=28416	SAT TT=0.343 ASSIGNMENTS=8764 CHECKS=944038	SAT TT=0.492	SAT TT=0.032 ASSIGNMENTS=817 CHECKS=52814	SAT TT=0.106 ASSIGNMENTS=1403 CHECKS=267573	? TT=494.361	? TT=597.999	? TT=604.958
csp/primes-30/ normalized-primes-30-40-2-1.xml	SAT TT=0.012	SAT TT=4.397 CHECKS=9115200 NODES=100	SAT TT=4.287 CHECKS=9115200 NODES=0	SAT TT=0.04	SAT TT=0.962 CHECKS=560371	SAT TT=0.573 CHECKS=698240	SAT TT=2.687 ASSIGNMENTS=43	SAT TT=2.408 ASSIGNMENTS=43	SAT TT=15.733 CHECKS=7700660 NODES=100	SAT TT=7.191 CHECKS=9387260 NODES=450006	SAT TT=8.758 CHECKS=15522500 NODES=2134	SAT TT=0.027 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.03 ASSIGNMENTS=211 CHECKS=8042	SAT TT=21.474	SAT TT=21.674	SAT TT=0.012 ASSIGNMENTS=211 CHECKS=8042	SAT TT=0.203 ASSIGNMENTS=5920 CHECKS=473585	SAT TT=0.415	SAT TT=0.018 ASSIGNMENTS=375 CHECKS=14317	SAT TT=0.016 ASSIGNMENTS=211 CHECKS=8042	? TT=191.76	SAT TT=0.866	SAT TT=0.869
csp/primes-30/ normalized-primes-30-40-2-3.xml	SAT TT=3.577	SAT TT=202.689 CHECKS=414973000 NODES=959	SAT TT=246.418 CHECKS=459683000 NODES=1081	SAT TT=3.577	SAT TT=6.879 CHECKS=734556	SAT TT=5.988 CHECKS=582954	SAT TT=14.467 ASSIGNMENTS=1004	SAT TT=13.722 ASSIGNMENTS=1004	? (MO) TT=11.92	? (MO) TT=11.04	? (MO) TT=11.12	SAT TT=20.566 ASSIGNMENTS=1004	SAT TT=193.103 ASSIGNMENTS=4408550 CHECKS=503231000	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=318.843 ASSIGNMENTS=4247820 CHECKS=887005000	? (TO) TT=1800.03	SAT TT=0.525	SAT TT=150.733 ASSIGNMENTS=1829170 CHECKS=423568000	SAT TT=196.395 ASSIGNMENTS=4408550 CHECKS=503231000	? TT=145.686	SAT TT=79.302	SAT TT=130.539
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-40-2-7.xml	SAT TT=278.366	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (MO) TT=11.28	? (MO) TT=12.34	? (MO) TT=10.72	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=826.853 ASSIGNMENTS=3664510 CHECKS=2633670000	SAT TT=278.366 ASSIGNMENTS=1622720 CHECKS=814133000	SAT TT=0.737	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=119.286	? TT=231.169	? TT=227.328
csp/primes-30/ normalized-primes-30-40-3-3.xml	SAT TT=14.829	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=14.829	SAT TT=1320.8 CHECKS=88454600	SAT TT=499.978 CHECKS=35546100	? (TO) TT=1800.05	? (TO) TT=1800.1	? (MO) TT=11.17	? (MO) TT=11.36	? (MO) TT=11.37	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=455.36	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=151.055	? TT=186.026	? TT=184.394
csp/primes-30/ normalized-primes-30-60-2-1.xml	SAT TT=0.017	SAT TT=2.388 CHECKS=3410680 NODES=100	SAT TT=2.18 CHECKS=3410680 NODES=0	SAT TT=0.045	SAT TT=0.96 CHECKS=148016	SAT TT=0.069 CHECKS=149471	SAT TT=1.268 ASSIGNMENTS=23	SAT TT=1.343 ASSIGNMENTS=23	SAT TT=19.504 CHECKS=1160180 NODES=100	SAT TT=7.236 CHECKS=1519750 NODES=2	SAT TT=6.662 CHECKS=1519740 NODES=0	SAT TT=0.029 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.03 ASSIGNMENTS=168 CHECKS=7976	SAT TT=28.208	SAT TT=26.388	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	SAT TT=0.107 ASSIGNMENTS=5200 CHECKS=237600	SAT TT=0.453	SAT TT=0.021 ASSIGNMENTS=344 CHECKS=12337	SAT TT=0.017 ASSIGNMENTS=168 CHECKS=7976	? TT=223.307	SAT TT=0.796	SAT TT=0.832
csp/primes-30/ normalized-primes-30-60-2-3.xml	SAT TT=0.047	SAT TT=7.174 CHECKS=16707800 NODES=101	SAT TT=7.092 CHECKS=16829200 NODES=0	SAT TT=0.047	SAT TT=1.129 CHECKS=16326	SAT TT=0.068 CHECKS=27833	SAT TT=0.983 ASSIGNMENTS=12	SAT TT=1.018 ASSIGNMENTS=12	? (MO) TT=11.27	? (MO) TT=10.35	? (MO) TT=11.45	SAT TT=0.081 ASSIGNMENTS=392 CHECKS=137203	SAT TT=0.08 ASSIGNMENTS=392 CHECKS=137203	? (TO) TT=1800	? (TO) TT=1800.07	SAT TT=0.066 ASSIGNMENTS=390 CHECKS=134809	SAT TT=0.665 ASSIGNMENTS=5733 CHECKS=1674010	SAT TT=0.468	SAT TT=1.312 ASSIGNMENTS=5821 CHECKS=3368750	SAT TT=0.126 ASSIGNMENTS=795 CHECKS=295726	? TT=149.46	SAT TT=1.184	SAT TT=1.206
csp/primes-30/ normalized-primes-30-60-2-7.xml	SAT TT=12.407	? (MO) TT=1.136	SAT TT=1276.81 CHECKS=2150260000 NODES=4940	SAT TT=28.74	SAT TT=28.121 CHECKS=1014520	SAT TT=18.638 CHECKS=738581	SAT TT=169.177 ASSIGNMENTS=10212	SAT TT=45.688 ASSIGNMENTS=1056	? (MO) TT=10.58	? (MO) TT=12.16	? (MO) TT=10.79	SAT TT=26.014 ASSIGNMENTS=94393 CHECKS=50945200	SAT TT=25.495 ASSIGNMENTS=94393 CHECKS=50945200	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=23.148 ASSIGNMENTS=135976 CHECKS=67530700	SAT TT=79.519 ASSIGNMENTS=193114 CHECKS=245997000	SAT TT=0.851	SAT TT=12.407 ASSIGNMENTS=39059 CHECKS=34725600	SAT TT=16.224 ASSIGNMENTS=94393 CHECKS=50945200	? (MO) TT=81.518	? TT=219.635	? TT=220.967
csp/primes-30/ normalized-primes-30-60-3-3.xml	SAT TT=0.674	SAT TT=60.221 CHECKS=139252000 NODES=296	SAT TT=110.352 CHECKS=231389000 NODES=288	SAT TT=0.674	SAT TT=40.382 CHECKS=2430390	SAT TT=46.218 CHECKS=2862840	SAT TT=41.44 ASSIGNMENTS=691	SAT TT=54.801 ASSIGNMENTS=790	? (MO) TT=12.11	? (MO) TT=10.57	? (MO) TT=9.91	SAT TT=26.018 ASSIGNMENTS=38508 CHECKS=49019600	SAT TT=25.502 ASSIGNMENTS=38508 CHECKS=49019600	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=11.311 ASSIGNMENTS=32961 CHECKS=32940800	SAT TT=23.646 ASSIGNMENTS=78284 CHECKS=69518500	SAT TT=0.891	SAT TT=842.592 ASSIGNMENTS=858654 CHECKS=2393900000	SAT TT=18.597 ASSIGNMENTS=38508 CHECKS=49019600	? (MO) TT=60.57	? TT=171.281	? TT=178.448
csp/primes-30/ normalized-primes-30-60-3-7.xml		? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.15	? (MO) TT=11.12	? (MO) TT=11.46	? (MO) TT=10.09	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (MO) TT=77.472	? TT=683.267	? TT=700.466
csp/primes-30/ normalized-primes-30-80-2-1.xml	SAT TT=0.018	SAT TT=2.485 CHECKS=3382230 NODES=100	SAT TT=2.194 CHECKS=3382230 NODES=0	SAT TT=0.047	SAT TT=1.095 CHECKS=737	SAT TT=0.021 CHECKS=956	SAT TT=1.058 ASSIGNMENTS=11	SAT TT=1.052 ASSIGNMENTS=11	SAT TT=22.623 CHECKS=1091400 NODES=100	SAT TT=8.192 CHECKS=1450990 NODES=0	SAT TT=7.922 CHECKS=1451070 NODES=1	SAT TT=0.029 ASSIGNMENTS=85 CHECKS=5309	SAT TT=0.027 ASSIGNMENTS=85 CHECKS=5309	SAT TT=31.822	SAT TT=29.039	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5320	SAT TT=0.035 ASSIGNMENTS=4062 CHECKS=37548	SAT TT=0.483	SAT TT=0.018 ASSIGNMENTS=105 CHECKS=5116	SAT TT=0.019 ASSIGNMENTS=85 CHECKS=5309	SAT TT=154.866	SAT TT=0.873	SAT TT=0.894
csp/primes-30/ normalized-primes-30-80-2-7.xml	SAT TT=0.063	SAT TT=5.919 CHECKS=9242930 NODES=102	SAT TT=8.021 CHECKS=11608100 NODES=0	SAT TT=0.063	SAT TT=2.361 CHECKS=2143	SAT TT=0.075 CHECKS=2126	SAT TT=0.927 ASSIGNMENTS=1	SAT TT=1.016 ASSIGNMENTS=1	? (MO) TT=10.02	? (MO) TT=9.97	? (MO) TT=11.55	SAT TT=0.077 ASSIGNMENTS=60 CHECKS=110160	SAT TT=0.076 ASSIGNMENTS=60 CHECKS=110160	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.066 ASSIGNMENTS=58 CHECKS=112600	SAT TT=1.771 ASSIGNMENTS=4025 CHECKS=4760180	SAT TT=0.606	SAT TT=0.092 ASSIGNMENTS=116 CHECKS=182086	SAT TT=0.07 ASSIGNMENTS=61 CHECKS=111820	? TT=716.435	SAT TT=1.576	SAT TT=1.279
csp/primes-30/ normalized-primes-30-80-3-3.xml	SAT TT=0.292	SAT TT=7.668 CHECKS=17293400 NODES=211	SAT TT=10.088 CHECKS=21120400 NODES=0	SAT TT=1.395	SAT TT=2.897 CHECKS=48424	SAT TT=4.006 CHECKS=265121	SAT TT=1.161 ASSIGNMENTS=2	SAT TT=1.275 ASSIGNMENTS=2	? (MO) TT=11.54	? (MO) TT=10.28	? (MO) TT=10.88	SAT TT=0.292 ASSIGNMENTS=335 CHECKS=697558	SAT TT=0.295 ASSIGNMENTS=335 CHECKS=697558	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.759 ASSIGNMENTS=757 CHECKS=1989930	SAT TT=3.189 ASSIGNMENTS=4989 CHECKS=8399560	SAT TT=0.614	SAT TT=1.939 ASSIGNMENTS=869 CHECKS=5304570	SAT TT=0.894 ASSIGNMENTS=820 CHECKS=2492020	? TT=146.898	? TT=182.067	? TT=174.671
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/primes-30/ normalized-primes-30-80-3-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=10.46	? (MO) TT=10.76	? (MO) TT=10.62	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.06	? TT=143.925	? TT=284.482	? TT=173.16
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-0.xml	SAT TT=0.037	SAT TT=1.99 CHECKS=274420 NODES=359	SAT TT=1.908 CHECKS=375817 NODES=217	SAT TT=1786.74	SAT TT=0.734 CHECKS=17338	SAT TT=0.143 CHECKS=11211	SAT TT=1.577 ASSIGNMENTS=202	SAT TT=2.202 ASSIGNMENTS=93	SAT TT=123.874 CHECKS=214630 NODES=312	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=0.058 ASSIGNMENTS=144 CHECKS=14389	SAT TT=0.056 ASSIGNMENTS=144 CHECKS=14389	? (problem) TT=113.8	? (problem) TT=111.747	SAT TT=0.044 ASSIGNMENTS=134 CHECKS=12242	SAT TT=0.044 ASSIGNMENTS=376 CHECKS=18579	? TT=0.303	SAT TT=0.039 ASSIGNMENTS=102 CHECKS=5235	SAT TT=0.037 ASSIGNMENTS=110 CHECKS=5330	? (TO) TT=1802.39	SAT TT=1.335	SAT TT=1.716
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-18.xml	UNSAT TT=0.034	UNSAT TT=1.709 CHECKS=262672 NODES=0	UNSAT TT=1.817 CHECKS=262672 NODES=0	UNSAT TT=0.081	UNSAT TT=0.641 CHECKS=123	UNSAT TT=0.078 CHECKS=123	UNSAT TT=1.085 ASSIGNMENTS=0	UNSAT TT=0.927 ASSIGNMENTS=0	UNSAT TT=130.956 CHECKS=4936 NODES=0	UNSAT TT=92.215 CHECKS=5476 NODES=0	UNSAT TT=93.858 CHECKS=5476 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.046 ASSIGNMENTS=0 CHECKS=1025	? (problem) TT=113.654	? (problem) TT=115.62	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1025	? TT=0.343	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1025	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1025	? TT=630.553	UNSAT TT=1.311	UNSAT TT=1.633
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-19.xml	UNSAT TT=0.033	UNSAT TT=1.494 CHECKS=21697 NODES=0	UNSAT TT=1.396 CHECKS=21697 NODES=0	UNSAT TT=0.083	UNSAT TT=0.652 CHECKS=133	UNSAT TT=0.07 CHECKS=133	UNSAT TT=0.914 ASSIGNMENTS=0	UNSAT TT=1.137 ASSIGNMENTS=0	UNSAT TT=136.984 CHECKS=16818800 NODES=0	UNSAT TT=97.564 CHECKS=16818800 NODES=0	UNSAT TT=111.113 CHECKS=16818800 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1835	? (problem) TT=124.348	? (problem) TT=126.262	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1835	? TT=0.373	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=1835	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1835	? (TO) TT=1802.16	UNSAT TT=1.324	UNSAT TT=1.507
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-1.xml	UNSAT TT=0.032	UNSAT TT=1.333 CHECKS=72974 NODES=0	UNSAT TT=1.344 CHECKS=72974 NODES=0	UNSAT TT=0.085	UNSAT TT=0.64 CHECKS=134	UNSAT TT=0.063 CHECKS=134	UNSAT TT=0.897 ASSIGNMENTS=0	UNSAT TT=0.929 ASSIGNMENTS=0	UNSAT TT=135.277 CHECKS=177618 NODES=0	UNSAT TT=180.016 CHECKS=177618 NODES=0	UNSAT TT=161.983 CHECKS=177618 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.045 ASSIGNMENTS=0 CHECKS=1738	? (problem) TT=119.52	? (problem) TT=119.949	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1738	? TT=0.372	UNSAT TT=0.033 ASSIGNMENTS=0 CHECKS=1738	UNSAT TT=0.032 ASSIGNMENTS=0 CHECKS=1738	? TT=265.782	UNSAT TT=1.433	UNSAT TT=1.327
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-21.xml	SAT TT=0.04	SAT TT=5.034 CHECKS=2286150 NODES=238	SAT TT=5.482 CHECKS=2422120 NODES=152	? (TO) TT=1800.03	SAT TT=0.802 CHECKS=3897	SAT TT=0.13 CHECKS=3836	SAT TT=1.603 ASSIGNMENTS=122	SAT TT=2.134 ASSIGNMENTS=100	SAT TT=130.515 CHECKS=5678540 NODES=526	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=0.053 ASSIGNMENTS=102 CHECKS=5317	SAT TT=0.054 ASSIGNMENTS=102 CHECKS=5317	? (problem) TT=131.499	? (problem) TT=125.393	SAT TT=0.04 ASSIGNMENTS=109 CHECKS=5905	SAT TT=0.043 ASSIGNMENTS=179 CHECKS=9126	? TT=0.359	SAT TT=0.112 ASSIGNMENTS=782 CHECKS=58762	SAT TT=0.048 ASSIGNMENTS=173 CHECKS=15422	? TT=1717.13	SAT TT=1.574	SAT TT=1.533
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-22.xml	SAT TT=0.036	SAT TT=3.5 CHECKS=1159850 NODES=151	SAT TT=26.005 CHECKS=13977300 NODES=288	? (TO) TT=1800.08	SAT TT=0.635 CHECKS=6818	SAT TT=0.091 CHECKS=6096	SAT TT=1.512 ASSIGNMENTS=111	SAT TT=1.87 ASSIGNMENTS=101	SAT TT=116.951 CHECKS=16955000 NODES=182	SAT TT=1187.78 CHECKS=110177000 NODES=1633050000	? (TO) TT=1800.05	SAT TT=0.049 ASSIGNMENTS=114 CHECKS=5420	SAT TT=0.048 ASSIGNMENTS=114 CHECKS=5420	? (problem) TT=119.445	? (problem) TT=109.979	SAT TT=0.038 ASSIGNMENTS=110 CHECKS=5394	SAT TT=0.045 ASSIGNMENTS=428 CHECKS=20474	? TT=0.375	SAT TT=0.105 ASSIGNMENTS=884 CHECKS=49855	SAT TT=0.036 ASSIGNMENTS=106 CHECKS=4578	? TT=250.865	SAT TT=1.392	SAT TT=1.413
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-23.xml	SAT TT=0.037	SAT TT=55.014 CHECKS=28898600 NODES=322	SAT TT=4.636 CHECKS=1847930 NODES=144	SAT TT=0.086	SAT TT=0.67 CHECKS=3248	SAT TT=0.085 CHECKS=3266	SAT TT=1.455 ASSIGNMENTS=103	SAT TT=2.043 ASSIGNMENTS=97	SAT TT=138.042 CHECKS=16979700 NODES=255	SAT TT=742.013 CHECKS=63239200 NODES=967800000	? (TO) TT=1800.1	SAT TT=0.046 ASSIGNMENTS=97 CHECKS=4764	SAT TT=0.051 ASSIGNMENTS=97 CHECKS=4764	? (problem) TT=93.396	? (problem) TT=84.924	SAT TT=0.037 ASSIGNMENTS=97 CHECKS=4764	SAT TT=0.04 ASSIGNMENTS=217 CHECKS=8971	? TT=0.368	SAT TT=0.044 ASSIGNMENTS=199 CHECKS=8461	SAT TT=0.043 ASSIGNMENTS=106 CHECKS=7137	? TT=714.92	SAT TT=1.613	SAT TT=1.572
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-27.xml	SAT TT=0.044	SAT TT=3.492 CHECKS=1407370 NODES=146	SAT TT=3.708 CHECKS=1577680 NODES=202	SAT TT=0.09	SAT TT=0.8 CHECKS=3005	SAT TT=0.109 CHECKS=2834	SAT TT=1.551 ASSIGNMENTS=238	SAT TT=2.153 ASSIGNMENTS=105	SAT TT=124.316 CHECKS=4595180 NODES=326	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=0.057 ASSIGNMENTS=145 CHECKS=10547	SAT TT=0.058 ASSIGNMENTS=145 CHECKS=10547	? (problem) TT=115.985	? (problem) TT=119.797	SAT TT=0.044 ASSIGNMENTS=154 CHECKS=11097	SAT TT=0.044 ASSIGNMENTS=294 CHECKS=14090	? TT=0.374	SAT TT=0.049 ASSIGNMENTS=166 CHECKS=8262	SAT TT=0.044 ASSIGNMENTS=120 CHECKS=8742	? (TO) TT=1802.22	SAT TT=1.447	SAT TT=1.631
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-2.xml	UNSAT TT=0.035	UNSAT TT=1.586 CHECKS=128206 NODES=0	UNSAT TT=1.466 CHECKS=128206 NODES=0	UNSAT TT=0.086	UNSAT TT=0.687 CHECKS=160	UNSAT TT=0.077 CHECKS=160	UNSAT TT=0.896 ASSIGNMENTS=0	UNSAT TT=0.921 ASSIGNMENTS=0	UNSAT TT=133.455 CHECKS=90382 NODES=0	UNSAT TT=97.355 CHECKS=90382 NODES=0	UNSAT TT=89.501 CHECKS=90382 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1786	? (problem) TT=101.339	? (problem) TT=105.23	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1786	? TT=0.326	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1786	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1786	? TT=273.915	UNSAT TT=1.425	UNSAT TT=1.475
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-30.xml	SAT TT=0.041	SAT TT=1.648 CHECKS=173726 NODES=145	SAT TT=2.291 CHECKS=487017 NODES=226	SAT TT=1346.68	SAT TT=0.861 CHECKS=12192	SAT TT=0.117 CHECKS=4498	SAT TT=1.367 ASSIGNMENTS=112	SAT TT=2.513 ASSIGNMENTS=141	SAT TT=140.548 CHECKS=197525 NODES=317	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=0.053 ASSIGNMENTS=120 CHECKS=7452	SAT TT=0.054 ASSIGNMENTS=120 CHECKS=7452	? (problem) TT=126.746	? (problem) TT=126.476	SAT TT=0.041 ASSIGNMENTS=154 CHECKS=10237	SAT TT=0.056 ASSIGNMENTS=677 CHECKS=40546	? TT=0.321	SAT TT=0.127 ASSIGNMENTS=909 CHECKS=68874	SAT TT=0.041 ASSIGNMENTS=106 CHECKS=5987	? TT=1450.08	SAT TT=1.385	SAT TT=1.55
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-32.xml	UNSAT TT=0.036	UNSAT TT=1.499 CHECKS=26931 NODES=0	UNSAT TT=1.404 CHECKS=26931 NODES=0	UNSAT TT=0.088	UNSAT TT=0.791 CHECKS=179	UNSAT TT=0.094 CHECKS=179	UNSAT TT=0.926 ASSIGNMENTS=0	UNSAT TT=1.116 ASSIGNMENTS=0	UNSAT TT=143.389 CHECKS=67209300 NODES=0	UNSAT TT=183.406 CHECKS=67209800 NODES=0	UNSAT TT=176.201 CHECKS=67209800 NODES=0	UNSAT TT=0.048 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1946	? (problem) TT=99.932	? (problem) TT=107.409	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1946	? TT=0.361	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1946	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1946	? (TO) TT=1802.27	UNSAT TT=1.417	UNSAT TT=1.308
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-40.xml	SAT TT=0.037	SAT TT=3.602 CHECKS=1164390 NODES=151	SAT TT=7.64 CHECKS=3591000 NODES=210	SAT TT=1340.93	SAT TT=0.845 CHECKS=5685	SAT TT=0.159 CHECKS=5604	SAT TT=1.404 ASSIGNMENTS=152	SAT TT=2.2 ASSIGNMENTS=101	SAT TT=137.814 CHECKS=16856500 NODES=150	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=0.056 ASSIGNMENTS=116 CHECKS=6784	SAT TT=0.05 ASSIGNMENTS=116 CHECKS=6784	? (problem) TT=122.328	? (problem) TT=137.343	SAT TT=0.041 ASSIGNMENTS=117 CHECKS=6827	SAT TT=0.037 ASSIGNMENTS=96 CHECKS=4930	? TT=0.381	SAT TT=0.081 ASSIGNMENTS=551 CHECKS=37743	SAT TT=0.041 ASSIGNMENTS=109 CHECKS=5838	? TT=256.108	SAT TT=1.287	SAT TT=1.391
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-41.xml	UNSAT TT=0.035	UNSAT TT=1.427 CHECKS=28388 NODES=0	UNSAT TT=1.293 CHECKS=28388 NODES=0	UNSAT TT=0.084	UNSAT TT=0.677 CHECKS=119	UNSAT TT=0.075 CHECKS=119	UNSAT TT=0.955 ASSIGNMENTS=0	UNSAT TT=1.126 ASSIGNMENTS=0	UNSAT TT=122.74 CHECKS=77911 NODES=0	UNSAT TT=86.069 CHECKS=77911 NODES=0	UNSAT TT=96.238 CHECKS=77911 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1032	? (problem) TT=98.583	? (problem) TT=99.159	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	? TT=0.323	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1032	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1032	? TT=854.754	UNSAT TT=1.516	UNSAT TT=1.388
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-44.xml	UNSAT TT=0.034	UNSAT TT=2.761 CHECKS=1051290 NODES=0	UNSAT TT=2.871 CHECKS=1051290 NODES=0	UNSAT TT=0.083	UNSAT TT=0.687 CHECKS=170	UNSAT TT=0.074 CHECKS=170	UNSAT TT=0.968 ASSIGNMENTS=0	UNSAT TT=0.945 ASSIGNMENTS=0	UNSAT TT=154.94 CHECKS=68214900 NODES=0	UNSAT TT=167.211 CHECKS=68215200 NODES=0	UNSAT TT=154.796 CHECKS=68215200 NODES=0	UNSAT TT=0.047 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1889	? (problem) TT=125.737	? (problem) TT=130.83	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1889	? TT=0.369	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1889	UNSAT TT=0.034 ASSIGNMENTS=0 CHECKS=1889	? TT=252.13	UNSAT TT=1.415	UNSAT TT=1.469
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-45.xml	SAT TT=0.039	SAT TT=1.86 CHECKS=420224 NODES=260	SAT TT=3.286 CHECKS=1186700 NODES=347	SAT TT=381.213	SAT TT=0.626 CHECKS=3276	SAT TT=0.084 CHECKS=3379	SAT TT=1.474 ASSIGNMENTS=102	SAT TT=1.915 ASSIGNMENTS=98	SAT TT=124.18 CHECKS=362965 NODES=149	SAT TT=842.005 CHECKS=44855000 NODES=1036200000	? (TO) TT=1800.09	SAT TT=0.053 ASSIGNMENTS=171 CHECKS=12481	SAT TT=0.05 ASSIGNMENTS=171 CHECKS=12481	? (problem) TT=120.836	? (problem) TT=119.601	SAT TT=0.045 ASSIGNMENTS=174 CHECKS=12695	SAT TT=0.039 ASSIGNMENTS=199 CHECKS=8512	? TT=0.358	SAT TT=0.096 ASSIGNMENTS=797 CHECKS=50206	SAT TT=0.042 ASSIGNMENTS=187 CHECKS=12360	? TT=1477.02	SAT TT=1.463	SAT TT=1.622
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-47.xml	UNSAT TT=0.036	UNSAT TT=1.391 CHECKS=74569 NODES=0	UNSAT TT=1.569 CHECKS=74569 NODES=0	UNSAT TT=0.086	UNSAT TT=0.819 CHECKS=123	UNSAT TT=0.102 CHECKS=123	UNSAT TT=0.905 ASSIGNMENTS=0	UNSAT TT=1.005 ASSIGNMENTS=0	UNSAT TT=121.471 CHECKS=83417 NODES=0	UNSAT TT=136.097 CHECKS=83873 NODES=0	UNSAT TT=120.602 CHECKS=83873 NODES=0	UNSAT TT=0.049 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1730	? (problem) TT=126.269	? (problem) TT=124.47	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1730	? TT=0.302	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1730	UNSAT TT=0.036 ASSIGNMENTS=0 CHECKS=1730	? TT=659.271	UNSAT TT=1.388	UNSAT TT=1.515
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-49.xml	SAT TT=0.038	SAT TT=4.903 CHECKS=2201390 NODES=151	SAT TT=7.033 CHECKS=3328940 NODES=151	SAT TT=0.089	SAT TT=0.737 CHECKS=5898	SAT TT=0.1 CHECKS=3165	SAT TT=1.324 ASSIGNMENTS=105	SAT TT=1.847 ASSIGNMENTS=101	SAT TT=133.473 CHECKS=5397320 NODES=223	SAT TT=241.039 CHECKS=15864400 NODES=188400000	? (TO) TT=1800.09	SAT TT=0.053 ASSIGNMENTS=125 CHECKS=7139	SAT TT=0.049 ASSIGNMENTS=125 CHECKS=7139	? (problem) TT=145.905	? (problem) TT=149.863	SAT TT=0.041 ASSIGNMENTS=145 CHECKS=9494	SAT TT=0.038 ASSIGNMENTS=216 CHECKS=7557	? TT=0.36	SAT TT=0.041 ASSIGNMENTS=115 CHECKS=4634	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4340	? (TO) TT=1802.35	SAT TT=1.199	SAT TT=1.321
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-4.xml	SAT TT=0.04	SAT TT=4.003 CHECKS=1412560 NODES=152	SAT TT=11.501 CHECKS=5347100 NODES=211	? (TO) TT=1800.09	SAT TT=0.733 CHECKS=3914	SAT TT=0.122 CHECKS=3981	SAT TT=1.479 ASSIGNMENTS=125	SAT TT=2.185 ASSIGNMENTS=237	SAT TT=153.341 CHECKS=67456600 NODES=145	? (TO) TT=1800.07	? (MO) TT=62.71	SAT TT=0.053 ASSIGNMENTS=96 CHECKS=4868	SAT TT=0.051 ASSIGNMENTS=96 CHECKS=4868	? (problem) TT=122.832	? (problem) TT=130.522	SAT TT=0.04 ASSIGNMENTS=96 CHECKS=4868	SAT TT=0.04 ASSIGNMENTS=105 CHECKS=5093	? TT=0.308	SAT TT=0.049 ASSIGNMENTS=175 CHECKS=8587	SAT TT=0.046 ASSIGNMENTS=112 CHECKS=8932	? (TO) TT=1802.38	SAT TT=1.35	SAT TT=1.392
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-5.xml	UNSAT TT=0.035	UNSAT TT=1.913 CHECKS=271324 NODES=0	UNSAT TT=1.786 CHECKS=271324 NODES=0	UNSAT TT=0.085	UNSAT TT=0.837 CHECKS=150	UNSAT TT=0.112 CHECKS=150	UNSAT TT=0.991 ASSIGNMENTS=0	UNSAT TT=0.967 ASSIGNMENTS=0	UNSAT TT=146.454 CHECKS=121240 NODES=0	UNSAT TT=141.901 CHECKS=121912 NODES=0	UNSAT TT=170.11 CHECKS=121912 NODES=0	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.05 ASSIGNMENTS=0 CHECKS=1996	? (problem) TT=116.001	? (problem) TT=120.258	UNSAT TT=0.035 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.038 ASSIGNMENTS=0 CHECKS=1996	? TT=0.338	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1996	UNSAT TT=0.037 ASSIGNMENTS=0 CHECKS=1996	? TT=443.947	UNSAT TT=1.452	UNSAT TT=1.339
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-24-3-2/ normalized-radar-8-24-3-2-6.xml	SAT TT=0.041	SAT TT=22.647 CHECKS=10854300 NODES=304	SAT TT=28.387 CHECKS=14856900 NODES=318	SAT TT=0.091	SAT TT=0.763 CHECKS=7323	SAT TT=0.124 CHECKS=7392	SAT TT=1.5 ASSIGNMENTS=104	SAT TT=2.384 ASSIGNMENTS=123	SAT TT=218.82 CHECKS=269355000 NODES=228	SAT TT=841.586 CHECKS=314126000 NODES=891450000	? (TO) TT=1800.05	SAT TT=0.054 ASSIGNMENTS=130 CHECKS=12121	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=12121	? (problem) TT=120.092	? (problem) TT=114.995	SAT TT=0.042 ASSIGNMENTS=141 CHECKS=12146	SAT TT=0.048 ASSIGNMENTS=435 CHECKS=22860	? TT=0.374	SAT TT=0.046 ASSIGNMENTS=131 CHECKS=6305	SAT TT=0.041 ASSIGNMENTS=109 CHECKS=9063	? (TO) TT=1802.25	SAT TT=1.206	SAT TT=1.587
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-10.xml	SAT TT=0.05	SAT TT=1.921 CHECKS=147923 NODES=183	SAT TT=1.857 CHECKS=186477 NODES=0	SAT TT=0.106	SAT TT=1.823 CHECKS=6039	SAT TT=0.397 CHECKS=3810	SAT TT=1.739 ASSIGNMENTS=150	SAT TT=3.518 ASSIGNMENTS=146	SAT TT=159.771 CHECKS=62005200 NODES=442	? (TO) TT=1800.01	? (TO) TT=1800.09	SAT TT=0.071 ASSIGNMENTS=207 CHECKS=19414	SAT TT=0.07 ASSIGNMENTS=207 CHECKS=19414	? (problem) TT=154.874	? (problem) TT=152.763	SAT TT=0.061 ASSIGNMENTS=207 CHECKS=19478	SAT TT=0.056 ASSIGNMENTS=356 CHECKS=19474	? TT=0.335	SAT TT=0.193 ASSIGNMENTS=1352 CHECKS=97848	SAT TT=0.05 ASSIGNMENTS=152 CHECKS=6708	? TT=610.908	SAT TT=1.41	SAT TT=1.738
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-11.xml	SAT TT=0.052	SAT TT=1.91 CHECKS=141370 NODES=183	SAT TT=2.36 CHECKS=359511 NODES=262	SAT TT=0.1	SAT TT=2.092 CHECKS=3631	SAT TT=0.49 CHECKS=3660	SAT TT=1.567 ASSIGNMENTS=139	SAT TT=3.449 ASSIGNMENTS=144	SAT TT=130.806 CHECKS=609569 NODES=283	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=0.069 ASSIGNMENTS=195 CHECKS=13785	SAT TT=0.068 ASSIGNMENTS=195 CHECKS=13785	? (problem) TT=106.983	? (problem) TT=119.757	SAT TT=0.054 ASSIGNMENTS=198 CHECKS=14971	SAT TT=0.058 ASSIGNMENTS=436 CHECKS=23924	? TT=0.336	SAT TT=0.188 ASSIGNMENTS=1249 CHECKS=106931	SAT TT=0.052 ASSIGNMENTS=149 CHECKS=6701	? (TO) TT=1802.3	SAT TT=1.362	SAT TT=2.022
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-13.xml	SAT TT=0.045	SAT TT=1.698 CHECKS=125440 NODES=181	SAT TT=2.214 CHECKS=401711 NODES=185	SAT TT=0.099	SAT TT=1.077 CHECKS=4371	SAT TT=0.193 CHECKS=4115	SAT TT=1.701 ASSIGNMENTS=150	SAT TT=3.917 ASSIGNMENTS=460	SAT TT=129.728 CHECKS=298930 NODES=302	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.058 ASSIGNMENTS=158 CHECKS=9281	SAT TT=0.06 ASSIGNMENTS=158 CHECKS=9281	? (problem) TT=115.153	? (problem) TT=115.097	SAT TT=0.05 ASSIGNMENTS=166 CHECKS=10037	SAT TT=0.045 ASSIGNMENTS=124 CHECKS=5890	? TT=0.337	SAT TT=0.107 ASSIGNMENTS=778 CHECKS=58722	SAT TT=0.05 ASSIGNMENTS=193 CHECKS=13658	? (TO) TT=1802.24	SAT TT=1.366	SAT TT=1.585
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-16.xml	SAT TT=0.046	SAT TT=4.503 CHECKS=1234500 NODES=257	SAT TT=2.108 CHECKS=298555 NODES=181	SAT TT=0.097	SAT TT=1.272 CHECKS=5706	SAT TT=0.268 CHECKS=6228	SAT TT=1.623 ASSIGNMENTS=175	SAT TT=3.569 ASSIGNMENTS=170	SAT TT=134.336 CHECKS=93214 NODES=189	? (TO) TT=1800	? (TO) TT=1800	SAT TT=0.063 ASSIGNMENTS=137 CHECKS=6231	SAT TT=0.058 ASSIGNMENTS=137 CHECKS=6231	? (problem) TT=108.67	? (problem) TT=107.46	SAT TT=0.05 ASSIGNMENTS=137 CHECKS=6231	SAT TT=0.046 ASSIGNMENTS=161 CHECKS=6408	? TT=0.332	SAT TT=0.059 ASSIGNMENTS=233 CHECKS=11116	SAT TT=0.048 ASSIGNMENTS=150 CHECKS=8199	? (TO) TT=1802.28	SAT TT=1.431	SAT TT=1.492
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-1.xml	SAT TT=0.044	SAT TT=2.508 CHECKS=477780 NODES=240	SAT TT=2.595 CHECKS=485197 NODES=276	SAT TT=26.505	SAT TT=1.259 CHECKS=13385	SAT TT=0.32 CHECKS=15031	SAT TT=1.53 ASSIGNMENTS=190	SAT TT=3.253 ASSIGNMENTS=141	SAT TT=136.554 CHECKS=89039 NODES=181	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.06 ASSIGNMENTS=210 CHECKS=9444	SAT TT=0.066 ASSIGNMENTS=210 CHECKS=9444	? (problem) TT=125.321	? (problem) TT=131.533	SAT TT=0.046 ASSIGNMENTS=170 CHECKS=8232	SAT TT=0.044 ASSIGNMENTS=138 CHECKS=6346	? TT=0.374	SAT TT=0.077 ASSIGNMENTS=444 CHECKS=25669	SAT TT=0.057 ASSIGNMENTS=236 CHECKS=19845	? (TO) TT=1802.14	SAT TT=1.394	SAT TT=1.692
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-23.xml	SAT TT=0.049	SAT TT=1.919 CHECKS=152782 NODES=182	SAT TT=2.71 CHECKS=650827 NODES=262	SAT TT=893.382	SAT TT=0.981 CHECKS=3898	SAT TT=0.16 CHECKS=4190	SAT TT=1.702 ASSIGNMENTS=153	SAT TT=3.323 ASSIGNMENTS=148	SAT TT=132.15 CHECKS=223706 NODES=188	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=0.063 ASSIGNMENTS=157 CHECKS=9657	SAT TT=0.06 ASSIGNMENTS=157 CHECKS=9657	? (problem) TT=117.511	? (problem) TT=113.376	SAT TT=0.053 ASSIGNMENTS=178 CHECKS=14142	SAT TT=0.051 ASSIGNMENTS=232 CHECKS=12829	? TT=0.336	SAT TT=0.076 ASSIGNMENTS=473 CHECKS=28224	SAT TT=0.049 ASSIGNMENTS=141 CHECKS=6639	? (TO) TT=1802.09	SAT TT=1.442	SAT TT=1.817
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-24.xml	SAT TT=0.047	SAT TT=1.896 CHECKS=175331 NODES=300	SAT TT=2.922 CHECKS=677155 NODES=297	SAT TT=894.846	SAT TT=1.265 CHECKS=7226	SAT TT=0.226 CHECKS=4893	SAT TT=1.741 ASSIGNMENTS=148	SAT TT=3.491 ASSIGNMENTS=160	SAT TT=124.531 CHECKS=99565 NODES=184	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=0.076 ASSIGNMENTS=247 CHECKS=30902	SAT TT=0.076 ASSIGNMENTS=247 CHECKS=30902	? (problem) TT=134.849	? (problem) TT=148.91	SAT TT=0.081 ASSIGNMENTS=300 CHECKS=53537	SAT TT=0.049 ASSIGNMENTS=140 CHECKS=6264	? TT=0.311	SAT TT=0.121 ASSIGNMENTS=786 CHECKS=57776	SAT TT=0.047 ASSIGNMENTS=147 CHECKS=6945	? TT=148.77	SAT TT=1.485	SAT TT=1.654
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-26.xml	SAT TT=0.052	SAT TT=2.003 CHECKS=189006 NODES=344	SAT TT=2.695 CHECKS=444279 NODES=0	SAT TT=0.098	SAT TT=2.926 CHECKS=3580	SAT TT=0.745 CHECKS=3775	SAT TT=1.632 ASSIGNMENTS=137	SAT TT=3.672 ASSIGNMENTS=151	SAT TT=134.024 CHECKS=405800 NODES=183	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.065 ASSIGNMENTS=146 CHECKS=7420	SAT TT=0.059 ASSIGNMENTS=146 CHECKS=7420	? (problem) TT=147.128	? (problem) TT=150.261	SAT TT=0.052 ASSIGNMENTS=146 CHECKS=7420	SAT TT=0.059 ASSIGNMENTS=328 CHECKS=20261	? TT=0.305	SAT TT=0.176 ASSIGNMENTS=1195 CHECKS=107268	SAT TT=0.054 ASSIGNMENTS=159 CHECKS=9103	? (TO) TT=1802.51	SAT TT=1.361	SAT TT=1.595
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-27.xml	SAT TT=0.046	SAT TT=1.937 CHECKS=159824 NODES=196	SAT TT=2.857 CHECKS=533407 NODES=277	SAT TT=0.113	SAT TT=2.003 CHECKS=5722	SAT TT=0.525 CHECKS=5731	SAT TT=1.651 ASSIGNMENTS=207	SAT TT=3.563 ASSIGNMENTS=167	? (MO) TT=44.99	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.061 ASSIGNMENTS=159 CHECKS=8165	SAT TT=0.058 ASSIGNMENTS=159 CHECKS=8165	? (problem) TT=142.943	? (problem) TT=146.399	SAT TT=0.049 ASSIGNMENTS=175 CHECKS=8258	SAT TT=0.046 ASSIGNMENTS=159 CHECKS=6618	? TT=0.336	SAT TT=0.142 ASSIGNMENTS=1034 CHECKS=87899	SAT TT=0.056 ASSIGNMENTS=173 CHECKS=11177	? (TO) TT=1802.31	SAT TT=1.659	SAT TT=1.651
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-28.xml	SAT TT=0.049	SAT TT=1.992 CHECKS=215655 NODES=258	SAT TT=2.482 CHECKS=547087 NODES=181	SAT TT=0.137	SAT TT=1.679 CHECKS=5621	SAT TT=0.374 CHECKS=5361	SAT TT=1.549 ASSIGNMENTS=170	SAT TT=4.23 ASSIGNMENTS=211	SAT TT=132.823 CHECKS=359902 NODES=521	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=0.063 ASSIGNMENTS=145 CHECKS=7974	SAT TT=0.061 ASSIGNMENTS=145 CHECKS=7974	? (problem) TT=146.721	? (problem) TT=133.627	SAT TT=0.053 ASSIGNMENTS=154 CHECKS=7961	SAT TT=0.059 ASSIGNMENTS=457 CHECKS=25418	? TT=0.374	SAT TT=0.127 ASSIGNMENTS=792 CHECKS=70549	SAT TT=0.049 ASSIGNMENTS=129 CHECKS=6192	? (TO) TT=1802.32	SAT TT=1.672	SAT TT=1.691
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-29.xml	SAT TT=0.048	SAT TT=2.617 CHECKS=420152 NODES=284	SAT TT=2.655 CHECKS=577550 NODES=309	SAT TT=0.097	SAT TT=1.994 CHECKS=4021	SAT TT=0.427 CHECKS=4273	SAT TT=1.817 ASSIGNMENTS=161	SAT TT=3.36 ASSIGNMENTS=141	SAT TT=130.549 CHECKS=151089 NODES=184	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.063 ASSIGNMENTS=150 CHECKS=8155	SAT TT=0.064 ASSIGNMENTS=150 CHECKS=8155	? (problem) TT=134.43	? (problem) TT=128.659	SAT TT=0.052 ASSIGNMENTS=160 CHECKS=9591	SAT TT=0.048 ASSIGNMENTS=140 CHECKS=7228	? TT=0.373	SAT TT=0.19 ASSIGNMENTS=1278 CHECKS=102509	SAT TT=0.049 ASSIGNMENTS=153 CHECKS=7669	? (TO) TT=1802.4	SAT TT=1.395	SAT TT=1.624
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-2.xml	SAT TT=0.046	SAT TT=3.409 CHECKS=775597 NODES=348	SAT TT=2.938 CHECKS=613729 NODES=237	SAT TT=0.099	SAT TT=1.57 CHECKS=4245	SAT TT=0.32 CHECKS=4179	SAT TT=1.55 ASSIGNMENTS=153	SAT TT=3.562 ASSIGNMENTS=190	SAT TT=129.586 CHECKS=116974 NODES=182	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.063 ASSIGNMENTS=141 CHECKS=6429	SAT TT=0.063 ASSIGNMENTS=141 CHECKS=6429	? (problem) TT=115.87	? (problem) TT=110.983	SAT TT=0.046 ASSIGNMENTS=141 CHECKS=6429	SAT TT=0.047 ASSIGNMENTS=257 CHECKS=13313	? TT=0.375	SAT TT=0.08 ASSIGNMENTS=443 CHECKS=24317	SAT TT=0.052 ASSIGNMENTS=141 CHECKS=7424	? (TO) TT=1802.19	SAT TT=1.448	SAT TT=1.51
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-30.xml	SAT TT=0.051	SAT TT=1.849 CHECKS=158592 NODES=182	SAT TT=2.93 CHECKS=717731 NODES=516	SAT TT=896.774	SAT TT=1.189 CHECKS=6868	SAT TT=0.257 CHECKS=7333	SAT TT=1.551 ASSIGNMENTS=205	SAT TT=3.482 ASSIGNMENTS=190	SAT TT=127.44 CHECKS=163678 NODES=181	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=0.06 ASSIGNMENTS=147 CHECKS=6419	SAT TT=0.058 ASSIGNMENTS=147 CHECKS=6419	? (problem) TT=103.765	? (problem) TT=106.738	SAT TT=0.051 ASSIGNMENTS=147 CHECKS=6419	SAT TT=0.051 ASSIGNMENTS=285 CHECKS=10559	? TT=0.31	SAT TT=0.128 ASSIGNMENTS=919 CHECKS=76868	SAT TT=0.051 ASSIGNMENTS=137 CHECKS=6180	? TT=1043.82	SAT TT=1.346	SAT TT=1.518
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-35.xml	SAT TT=0.041	SAT TT=1.69 CHECKS=149604 NODES=187	SAT TT=3.276 CHECKS=849445 NODES=370	SAT TT=0.101	SAT TT=0.985 CHECKS=4418	SAT TT=0.157 CHECKS=4804	SAT TT=1.659 ASSIGNMENTS=142	SAT TT=2.992 ASSIGNMENTS=155	SAT TT=135.968 CHECKS=85049 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800	SAT TT=0.054 ASSIGNMENTS=142 CHECKS=6455	SAT TT=0.056 ASSIGNMENTS=142 CHECKS=6455	? (problem) TT=109.752	? (problem) TT=111.322	SAT TT=0.046 ASSIGNMENTS=142 CHECKS=6455	SAT TT=0.041 ASSIGNMENTS=127 CHECKS=5849	? TT=0.331	SAT TT=0.143 ASSIGNMENTS=1184 CHECKS=83758	SAT TT=0.048 ASSIGNMENTS=132 CHECKS=5729	? TT=1133.73	SAT TT=1.484	SAT TT=1.869
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-36.xml	SAT TT=0.048	SAT TT=1.881 CHECKS=142330 NODES=185	SAT TT=2.397 CHECKS=441724 NODES=248	SAT TT=868.215	SAT TT=1.798 CHECKS=3915	SAT TT=0.36 CHECKS=4149	SAT TT=1.852 ASSIGNMENTS=152	SAT TT=3.63 ASSIGNMENTS=164	SAT TT=138.968 CHECKS=31488000 NODES=339	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=0.063 ASSIGNMENTS=136 CHECKS=6816	SAT TT=0.063 ASSIGNMENTS=136 CHECKS=6816	? (problem) TT=134.6	? (problem) TT=134.821	SAT TT=0.048 ASSIGNMENTS=136 CHECKS=6816	SAT TT=0.048 ASSIGNMENTS=206 CHECKS=12173	? TT=0.373	SAT TT=0.184 ASSIGNMENTS=1183 CHECKS=105608	SAT TT=0.077 ASSIGNMENTS=323 CHECKS=44000	? TT=545.391	SAT TT=1.62	SAT TT=1.581
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-38.xml	SAT TT=0.049	SAT TT=1.941 CHECKS=134163 NODES=180	SAT TT=1.797 CHECKS=151727 NODES=0	SAT TT=0.108	SAT TT=2.613 CHECKS=3213	SAT TT=0.608 CHECKS=3272	SAT TT=1.575 ASSIGNMENTS=151	SAT TT=4.033 ASSIGNMENTS=143	SAT TT=136.024 CHECKS=8658840 NODES=346	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=0.065 ASSIGNMENTS=162 CHECKS=10027	SAT TT=0.066 ASSIGNMENTS=162 CHECKS=10027	? (problem) TT=133.344	? (problem) TT=133.289	SAT TT=0.053 ASSIGNMENTS=170 CHECKS=9872	SAT TT=0.06 ASSIGNMENTS=496 CHECKS=24645	? TT=0.309	SAT TT=0.066 ASSIGNMENTS=245 CHECKS=13852	SAT TT=0.049 ASSIGNMENTS=143 CHECKS=6674	? (TO) TT=1802.29	SAT TT=1.386	SAT TT=1.631
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-39.xml	SAT TT=0.048	SAT TT=2.168 CHECKS=211389 NODES=263	SAT TT=2.216 CHECKS=292066 NODES=182	SAT TT=0.098	SAT TT=1.412 CHECKS=7565	SAT TT=0.281 CHECKS=3401	SAT TT=1.656 ASSIGNMENTS=218	SAT TT=3.678 ASSIGNMENTS=153	SAT TT=132.369 CHECKS=201732 NODES=409	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.059 ASSIGNMENTS=145 CHECKS=7675	SAT TT=0.064 ASSIGNMENTS=145 CHECKS=7675	? (problem) TT=96.721	? (problem) TT=99.219	SAT TT=0.051 ASSIGNMENTS=142 CHECKS=7678	SAT TT=0.048 ASSIGNMENTS=131 CHECKS=6479	? TT=0.37	SAT TT=0.154 ASSIGNMENTS=1061 CHECKS=94027	SAT TT=0.049 ASSIGNMENTS=145 CHECKS=7755	? (TO) TT=1802.17	SAT TT=1.548	SAT TT=1.522
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-42.xml	SAT TT=0.046	SAT TT=2.036 CHECKS=238463 NODES=335	SAT TT=2.77 CHECKS=638293 NODES=427	SAT TT=1343.92	SAT TT=1.281 CHECKS=3737	SAT TT=0.24 CHECKS=3793	SAT TT=1.583 ASSIGNMENTS=146	SAT TT=3.618 ASSIGNMENTS=167	SAT TT=135.156 CHECKS=96886 NODES=185	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=0.059 ASSIGNMENTS=155 CHECKS=9389	SAT TT=0.063 ASSIGNMENTS=155 CHECKS=9389	? (problem) TT=119.84	? (problem) TT=119.887	SAT TT=0.05 ASSIGNMENTS=163 CHECKS=9421	SAT TT=0.046 ASSIGNMENTS=139 CHECKS=6324	? TT=0.335	SAT TT=0.069 ASSIGNMENTS=388 CHECKS=21468	SAT TT=0.049 ASSIGNMENTS=173 CHECKS=10042	? TT=686.018	SAT TT=1.565	SAT TT=1.743
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-47.xml	SAT TT=0.046	SAT TT=1.847 CHECKS=145117 NODES=180	SAT TT=6.144 CHECKS=1799640 NODES=344	SAT TT=0.104	SAT TT=1.569 CHECKS=3669	SAT TT=0.317 CHECKS=3518	SAT TT=1.527 ASSIGNMENTS=144	SAT TT=3.701 ASSIGNMENTS=159	SAT TT=129.155 CHECKS=121193 NODES=307	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.062 ASSIGNMENTS=131 CHECKS=6336	SAT TT=0.063 ASSIGNMENTS=131 CHECKS=6336	? (problem) TT=121.021	? (problem) TT=120.082	SAT TT=0.047 ASSIGNMENTS=131 CHECKS=6336	SAT TT=0.046 ASSIGNMENTS=138 CHECKS=6596	? TT=0.371	SAT TT=0.072 ASSIGNMENTS=316 CHECKS=17246	SAT TT=0.055 ASSIGNMENTS=176 CHECKS=12022	? (TO) TT=1802.17	SAT TT=1.618	SAT TT=1.458
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-48.xml	SAT TT=0.044	SAT TT=1.66 CHECKS=115342 NODES=183	SAT TT=2.436 CHECKS=443382 NODES=270	SAT TT=0.101	SAT TT=1.003 CHECKS=4435	SAT TT=0.151 CHECKS=4302	SAT TT=1.461 ASSIGNMENTS=153	SAT TT=3.435 ASSIGNMENTS=244	SAT TT=127.421 CHECKS=3275180 NODES=180	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.059 ASSIGNMENTS=143 CHECKS=5797	SAT TT=0.059 ASSIGNMENTS=143 CHECKS=5797	? (problem) TT=119.687	? (problem) TT=119.189	SAT TT=0.047 ASSIGNMENTS=143 CHECKS=5797	SAT TT=0.044 ASSIGNMENTS=164 CHECKS=6259	? TT=0.337	SAT TT=0.063 ASSIGNMENTS=319 CHECKS=15816	SAT TT=0.045 ASSIGNMENTS=136 CHECKS=5822	? TT=1465.07	SAT TT=1.497	SAT TT=1.776
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-49.xml	SAT TT=0.048	SAT TT=1.716 CHECKS=127994 NODES=182	SAT TT=11.247 CHECKS=3854660 NODES=333	SAT TT=0.103	SAT TT=1.715 CHECKS=4671	SAT TT=0.392 CHECKS=4411	SAT TT=1.62 ASSIGNMENTS=155	SAT TT=4.107 ASSIGNMENTS=404	SAT TT=135.782 CHECKS=13496500 NODES=426	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.084 ASSIGNMENTS=309 CHECKS=41066	SAT TT=0.083 ASSIGNMENTS=309 CHECKS=41066	? (problem) TT=107.38	? (problem) TT=111.347	SAT TT=0.069 ASSIGNMENTS=282 CHECKS=37384	SAT TT=0.048 ASSIGNMENTS=136 CHECKS=6331	? TT=0.331	SAT TT=0.062 ASSIGNMENTS=272 CHECKS=14858	SAT TT=0.055 ASSIGNMENTS=239 CHECKS=19381	? TT=578.127	SAT TT=1.623	SAT TT=1.658
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-4.xml	SAT TT=0.052	SAT TT=2.487 CHECKS=331039 NODES=275	SAT TT=2.832 CHECKS=525093 NODES=296	SAT TT=0.389	SAT TT=3.018 CHECKS=4464	SAT TT=0.811 CHECKS=4609	SAT TT=1.718 ASSIGNMENTS=152	SAT TT=3.944 ASSIGNMENTS=182	SAT TT=130.738 CHECKS=111924 NODES=183	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.064 ASSIGNMENTS=143 CHECKS=7558	SAT TT=0.061 ASSIGNMENTS=143 CHECKS=7558	? (problem) TT=183.105	? (problem) TT=183.118	SAT TT=0.052 ASSIGNMENTS=143 CHECKS=7558	SAT TT=0.053 ASSIGNMENTS=266 CHECKS=12524	? TT=0.332	SAT TT=0.181 ASSIGNMENTS=1272 CHECKS=105239	SAT TT=0.054 ASSIGNMENTS=154 CHECKS=8013	? (TO) TT=1802.15	SAT TT=1.55	SAT TT=1.766
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-5.xml	SAT TT=0.05	SAT TT=2.032 CHECKS=152560 NODES=183	SAT TT=2.105 CHECKS=212957 NODES=0	SAT TT=0.108	SAT TT=2.181 CHECKS=4085	SAT TT=0.487 CHECKS=3170	SAT TT=1.684 ASSIGNMENTS=142	SAT TT=4.047 ASSIGNMENTS=229	SAT TT=127.502 CHECKS=113266 NODES=188	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.065 ASSIGNMENTS=142 CHECKS=7390	SAT TT=0.064 ASSIGNMENTS=142 CHECKS=7390	? (problem) TT=101.457	? (problem) TT=102.483	SAT TT=0.05 ASSIGNMENTS=152 CHECKS=7324	SAT TT=0.053 ASSIGNMENTS=245 CHECKS=14701	? TT=0.331	SAT TT=0.194 ASSIGNMENTS=1273 CHECKS=113971	SAT TT=0.05 ASSIGNMENTS=138 CHECKS=6893	? (TO) TT=1802.32	SAT TT=1.601	SAT TT=1.885
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-7.xml	SAT TT=0.053	SAT TT=1.924 CHECKS=142987 NODES=186	SAT TT=2.174 CHECKS=206816 NODES=0	SAT TT=1.856	SAT TT=2.221 CHECKS=4833	SAT TT=0.531 CHECKS=4247	SAT TT=1.723 ASSIGNMENTS=144	SAT TT=3.972 ASSIGNMENTS=222	SAT TT=122.929 CHECKS=110610 NODES=188	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=0.066 ASSIGNMENTS=188 CHECKS=10897	SAT TT=0.066 ASSIGNMENTS=188 CHECKS=10897	? (problem) TT=122.427	? (problem) TT=118.768	SAT TT=0.053 ASSIGNMENTS=168 CHECKS=9309	SAT TT=0.057 ASSIGNMENTS=373 CHECKS=18325	? TT=0.336	SAT TT=0.178 ASSIGNMENTS=1121 CHECKS=100408	SAT TT=0.072 ASSIGNMENTS=368 CHECKS=35521	? TT=393.345	SAT TT=1.49	SAT TT=1.821
csp/radar-8-30-3-0/ normalized-radar-8-30-3-0-8.xml	SAT TT=0.05	SAT TT=2.076 CHECKS=243092 NODES=294	SAT TT=2.393 CHECKS=372865 NODES=190	SAT TT=478.84	SAT TT=1.599 CHECKS=4207	SAT TT=0.333 CHECKS=4150	SAT TT=1.611 ASSIGNMENTS=205	SAT TT=3.472 ASSIGNMENTS=141	SAT TT=121.91 CHECKS=1927660 NODES=185	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=0.056 ASSIGNMENTS=147 CHECKS=7011	SAT TT=0.057 ASSIGNMENTS=147 CHECKS=7011	? (problem) TT=137.759	? (problem) TT=129.369	SAT TT=0.051 ASSIGNMENTS=147 CHECKS=7011	SAT TT=0.06 ASSIGNMENTS=707 CHECKS=34826	? TT=0.328	SAT TT=0.166 ASSIGNMENTS=1157 CHECKS=88643	SAT TT=0.05 ASSIGNMENTS=156 CHECKS=8021	? TT=485.756	SAT TT=1.464	SAT TT=1.681
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-11.xml	SAT TT=0.069	SAT TT=126.017 CHECKS=60162000 NODES=1524	SAT TT=116.156 CHECKS=61636300 NODES=1907	? (TO) TT=1800.11	SAT TT=4.438 CHECKS=8349	SAT TT=1.483 CHECKS=16887	SAT TT=2.159 ASSIGNMENTS=168	SAT TT=9.13 ASSIGNMENTS=182	SAT TT=544.347 CHECKS=1370410000 NODES=384	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=125 CHECKS=11757	SAT TT=0.084 ASSIGNMENTS=125 CHECKS=11757	? (problem) TT=62.509	? (problem) TT=58.669	SAT TT=0.069 ASSIGNMENTS=125 CHECKS=11757	SAT TT=0.073 ASSIGNMENTS=235 CHECKS=20369	? TT=0.314	SAT TT=0.309 ASSIGNMENTS=1545 CHECKS=222969	SAT TT=0.095 ASSIGNMENTS=367 CHECKS=44248	? TT=964.328	SAT TT=1.952	SAT TT=1.938
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-12.xml	UNSAT TT=0.069	UNSAT TT=24.343 CHECKS=14446400 NODES=66	UNSAT TT=23.176 CHECKS=14780700 NODES=30	UNSAT TT=0.138	UNSAT TT=10.38 CHECKS=167	UNSAT TT=3.055 CHECKS=167	UNSAT TT=1.127 ASSIGNMENTS=0	UNSAT TT=1.313 ASSIGNMENTS=0	UNSAT TT=125.315 CHECKS=10685500 NODES=0	UNSAT TT=122.887 CHECKS=10685500 NODES=0	UNSAT TT=122.029 CHECKS=10685500 NODES=0	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=4108	? (problem) TT=73.468	? (problem) TT=76.662	UNSAT TT=0.07 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	? TT=0.339	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=4108	? TT=250.754	UNSAT TT=1.687	UNSAT TT=1.776
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-14.xml	SAT TT=0.067	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=8.113 CHECKS=76619	SAT TT=2.212 CHECKS=20913	SAT TT=2.262 ASSIGNMENTS=303	SAT TT=7.816 ASSIGNMENTS=165	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=0.085 ASSIGNMENTS=112 CHECKS=12593	SAT TT=0.086 ASSIGNMENTS=112 CHECKS=12593	? (problem) TT=60.967	? (problem) TT=64.696	SAT TT=0.067 ASSIGNMENTS=121 CHECKS=12612	SAT TT=0.117 ASSIGNMENTS=987 CHECKS=97505	? TT=0.34	SAT TT=0.243 ASSIGNMENTS=1273 CHECKS=146171	SAT TT=0.081 ASSIGNMENTS=183 CHECKS=28610	? TT=267.762	SAT TT=1.628	SAT TT=1.692
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-26.xml	UNSAT TT=0.062	UNSAT TT=2.153 CHECKS=31225 NODES=0	UNSAT TT=2.051 CHECKS=31225 NODES=0	UNSAT TT=0.131	UNSAT TT=4.844 CHECKS=203	UNSAT TT=1.196 CHECKS=203	UNSAT TT=1.214 ASSIGNMENTS=0	UNSAT TT=1.177 ASSIGNMENTS=0	UNSAT TT=129.084 CHECKS=361888 NODES=0	UNSAT TT=105.093 CHECKS=361889 NODES=0	UNSAT TT=109.861 CHECKS=361889 NODES=0	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.07 ASSIGNMENTS=0 CHECKS=4099	? (problem) TT=73.53	? (problem) TT=73.724	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=4099	? TT=0.32	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=4099	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=4099	? TT=1509.66	UNSAT TT=1.849	UNSAT TT=1.981
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-27.xml	SAT TT=0.066	SAT TT=249.548 CHECKS=105847000 NODES=2151	SAT TT=212.923 CHECKS=89020500 NODES=1779	? (TO) TT=1800.04	SAT TT=8.444 CHECKS=161717	SAT TT=3.164 CHECKS=106125	SAT TT=2.137 ASSIGNMENTS=346	SAT TT=8.341 ASSIGNMENTS=176	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.091 ASSIGNMENTS=201 CHECKS=19190	SAT TT=0.088 ASSIGNMENTS=201 CHECKS=19190	? (problem) TT=73.635	? (problem) TT=60.61	SAT TT=0.074 ASSIGNMENTS=191 CHECKS=18383	SAT TT=0.314 ASSIGNMENTS=4839 CHECKS=482461	? TT=0.337	SAT TT=0.313 ASSIGNMENTS=1511 CHECKS=187535	SAT TT=0.066 ASSIGNMENTS=138 CHECKS=11619	? TT=248.245	SAT TT=1.725	SAT TT=2.039
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-29.xml	UNSAT TT=0.062	? (TO) TT=1800.13	? (TO) TT=1800.14	UNSAT TT=0.137	UNSAT TT=15.645 CHECKS=210	UNSAT TT=4.719 CHECKS=210	UNSAT TT=1.223 ASSIGNMENTS=0	UNSAT TT=1.201 ASSIGNMENTS=0	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=0.081 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=3880	? (problem) TT=64.712	? (problem) TT=65.442	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3880	? TT=0.355	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3880	UNSAT TT=0.069 ASSIGNMENTS=0 CHECKS=3880	? TT=246.293	UNSAT TT=1.527	UNSAT TT=1.91
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-2.xml	UNSAT TT=0.062	UNSAT TT=38.48 CHECKS=24104200 NODES=98	UNSAT TT=37.099 CHECKS=23165300 NODES=73	UNSAT TT=0.126	UNSAT TT=6.72 CHECKS=181	UNSAT TT=1.916 CHECKS=181	UNSAT TT=1.044 ASSIGNMENTS=0	UNSAT TT=1.159 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.03	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3446	? (problem) TT=77.174	? (problem) TT=77.047	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3446	? TT=0.363	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3446	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3446	? TT=1216.66	UNSAT TT=1.637	UNSAT TT=1.852
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-30.xml	UNSAT TT=0.059	UNSAT TT=107.082 CHECKS=76092100 NODES=414	UNSAT TT=110.092 CHECKS=72669900 NODES=323	UNSAT TT=0.128	UNSAT TT=5.425 CHECKS=189	UNSAT TT=1.457 CHECKS=189	UNSAT TT=1.039 ASSIGNMENTS=0	UNSAT TT=1.095 ASSIGNMENTS=0	UNSAT TT=131.89 CHECKS=50224400 NODES=0	UNSAT TT=73.717 CHECKS=50224400 NODES=0	UNSAT TT=74.967 CHECKS=50224400 NODES=0	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3445	? (problem) TT=64.565	? (problem) TT=63.212	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=3445	? TT=0.425	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3445	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3445	? TT=289.071	UNSAT TT=1.669	UNSAT TT=1.752
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-31.xml	UNSAT TT=0.057	? (TO) TT=1800.12	? (TO) TT=1800.11	UNSAT TT=0.116	UNSAT TT=2.195 CHECKS=194	UNSAT TT=0.415 CHECKS=194	UNSAT TT=1.097 ASSIGNMENTS=0	UNSAT TT=1.188 ASSIGNMENTS=0	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3293	? (problem) TT=68.523	? (problem) TT=64.63	UNSAT TT=0.057 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3293	? TT=0.358	UNSAT TT=0.058 ASSIGNMENTS=0 CHECKS=3293	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3293	? TT=252.306	UNSAT TT=1.618	UNSAT TT=1.926
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-33.xml	SAT TT=0.075	SAT TT=110.28 CHECKS=51272600 NODES=1258	SAT TT=18.882 CHECKS=8406970 NODES=288	? (TO) TT=1800.04	SAT TT=13.889 CHECKS=75960	SAT TT=10.166 CHECKS=322170	SAT TT=3.214 ASSIGNMENTS=580	SAT TT=14.025 ASSIGNMENTS=767	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	SAT TT=0.089 ASSIGNMENTS=134 CHECKS=13775	SAT TT=0.087 ASSIGNMENTS=134 CHECKS=13775	? (problem) TT=65.849	? (problem) TT=66.094	SAT TT=0.075 ASSIGNMENTS=133 CHECKS=13806	SAT TT=0.139 ASSIGNMENTS=1119 CHECKS=142236	? TT=0.312	SAT TT=0.341 ASSIGNMENTS=1501 CHECKS=250245	SAT TT=0.085 ASSIGNMENTS=166 CHECKS=23042	? TT=1125.97	SAT TT=1.716	SAT TT=2.124
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-34.xml	UNSAT TT=0.059	UNSAT TT=566.448 CHECKS=326865000 NODES=1584	UNSAT TT=798.389 CHECKS=434644000 NODES=1731	UNSAT TT=0.116	UNSAT TT=2.455 CHECKS=185	UNSAT TT=0.511 CHECKS=185	UNSAT TT=1.318 ASSIGNMENTS=0	UNSAT TT=1.225 ASSIGNMENTS=0	UNSAT TT=198.652 CHECKS=244477000 NODES=0	UNSAT TT=141.152 CHECKS=244477000 NODES=0	UNSAT TT=131.272 CHECKS=244477000 NODES=0	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3384	? (problem) TT=61.8	? (problem) TT=66.067	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3384	? TT=0.313	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3384	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3384	? TT=294.963	UNSAT TT=1.862	UNSAT TT=1.867
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-36.xml	SAT TT=0.1	SAT TT=224.183 CHECKS=96117800 NODES=2474	SAT TT=1147.56 CHECKS=457179000 NODES=7018	? (TO) TT=1800.03	SAT TT=6.056 CHECKS=154885	SAT TT=7.358 CHECKS=423545	SAT TT=2.251 ASSIGNMENTS=406	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.208 ASSIGNMENTS=838 CHECKS=229200	SAT TT=0.343 ASSIGNMENTS=838 CHECKS=229200	? (problem) TT=71.694	? (problem) TT=80.264	SAT TT=0.17 ASSIGNMENTS=867 CHECKS=179649	SAT TT=0.58 ASSIGNMENTS=8499 CHECKS=1000790	? TT=0.317	SAT TT=0.395 ASSIGNMENTS=1827 CHECKS=243830	SAT TT=0.1 ASSIGNMENTS=394 CHECKS=60957	? TT=252.785	SAT TT=1.507	SAT TT=1.986
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-39.xml	SAT TT=0.082	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=16.45 CHECKS=27933	SAT TT=6.087 CHECKS=50805	SAT TT=3.361 ASSIGNMENTS=581	SAT TT=12.034 ASSIGNMENTS=936	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=0.095 ASSIGNMENTS=172 CHECKS=19756	SAT TT=0.094 ASSIGNMENTS=172 CHECKS=19756	? (problem) TT=66.642	? (problem) TT=70.769	SAT TT=0.082 ASSIGNMENTS=167 CHECKS=18965	SAT TT=0.132 ASSIGNMENTS=1131 CHECKS=120806	? TT=0.334	SAT TT=2.773 ASSIGNMENTS=16574 CHECKS=2429780	SAT TT=0.083 ASSIGNMENTS=198 CHECKS=21290	? TT=243.853	SAT TT=1.521	SAT TT=1.811
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-43.xml	UNSAT TT=0.059	UNSAT TT=2.376 CHECKS=128066 NODES=0	UNSAT TT=2.206 CHECKS=128066 NODES=0	UNSAT TT=0.117	UNSAT TT=5.233 CHECKS=143	UNSAT TT=1.41 CHECKS=143	UNSAT TT=1.146 ASSIGNMENTS=0	UNSAT TT=1.056 ASSIGNMENTS=0	UNSAT TT=143.174 CHECKS=49658000 NODES=0	UNSAT TT=88.966 CHECKS=49960200 NODES=0	UNSAT TT=92.974 CHECKS=49960200 NODES=0	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=3399	? (problem) TT=72.02	? (problem) TT=87.655	UNSAT TT=0.059 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=3399	? TT=0.319	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3399	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3399	? TT=1049.92	UNSAT TT=1.397	UNSAT TT=1.852
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-44.xml	SAT TT=0.075	SAT TT=78.282 CHECKS=39919500 NODES=1020	SAT TT=372.347 CHECKS=198001000 NODES=4352	? (TO) TT=1800.03	SAT TT=8.934 CHECKS=118415	SAT TT=7.26 CHECKS=328464	SAT TT=2.465 ASSIGNMENTS=171	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=0.084 ASSIGNMENTS=127 CHECKS=12077	SAT TT=0.083 ASSIGNMENTS=127 CHECKS=12077	? (problem) TT=61.727	? (problem) TT=62.454	SAT TT=0.075 ASSIGNMENTS=127 CHECKS=12077	SAT TT=0.093 ASSIGNMENTS=458 CHECKS=56009	? TT=0.424	SAT TT=0.498 ASSIGNMENTS=1839 CHECKS=281751	SAT TT=0.082 ASSIGNMENTS=183 CHECKS=24251	? TT=262.854	SAT TT=1.545	SAT TT=1.999
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-47.xml	UNSAT TT=0.06	UNSAT TT=2.489 CHECKS=407665 NODES=0	UNSAT TT=2.673 CHECKS=407665 NODES=0	UNSAT TT=0.129	UNSAT TT=14.231 CHECKS=130	UNSAT TT=4.567 CHECKS=130	UNSAT TT=1.148 ASSIGNMENTS=0	UNSAT TT=1.186 ASSIGNMENTS=0	UNSAT TT=147.593 CHECKS=49766900 NODES=0	UNSAT TT=184.661 CHECKS=49766900 NODES=0	UNSAT TT=190.015 CHECKS=49766900 NODES=0	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=2043	? (problem) TT=65.417	? (problem) TT=65.512	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.063 ASSIGNMENTS=0 CHECKS=2043	? TT=0.321	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=2043	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=2043	? TT=219.46	UNSAT TT=1.529	UNSAT TT=1.991
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-48.xml	UNSAT TT=0.06	UNSAT TT=5.145 CHECKS=1343400 NODES=173	UNSAT TT=3.268 CHECKS=655097 NODES=0	UNSAT TT=0.125	UNSAT TT=14.414 CHECKS=240	UNSAT TT=4.315 CHECKS=240	UNSAT TT=1.279 ASSIGNMENTS=0	UNSAT TT=1.196 ASSIGNMENTS=0	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=0.077 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.082 ASSIGNMENTS=0 CHECKS=3416	? (problem) TT=61.718	? (problem) TT=60.77	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3416	? TT=0.333	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3416	UNSAT TT=0.067 ASSIGNMENTS=0 CHECKS=3416	? TT=1059.62	UNSAT TT=1.561	UNSAT TT=1.893
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-49.xml	UNSAT TT=0.06	UNSAT TT=22.822 CHECKS=14257400 NODES=45	UNSAT TT=6.016 CHECKS=2970320 NODES=0	UNSAT TT=0.115	UNSAT TT=3.958 CHECKS=152	UNSAT TT=1.074 CHECKS=152	UNSAT TT=1.094 ASSIGNMENTS=0	UNSAT TT=1.065 ASSIGNMENTS=0	UNSAT TT=148.19 CHECKS=49612600 NODES=0	UNSAT TT=204.035 CHECKS=49612600 NODES=0	UNSAT TT=198.491 CHECKS=49612600 NODES=0	UNSAT TT=0.071 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=3472	? (problem) TT=70.465	? (problem) TT=66.524	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.061 ASSIGNMENTS=0 CHECKS=3472	? TT=0.334	UNSAT TT=0.065 ASSIGNMENTS=0 CHECKS=3472	UNSAT TT=0.06 ASSIGNMENTS=0 CHECKS=3472	? TT=997.317	UNSAT TT=1.509	UNSAT TT=2.09
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-7.xml	UNSAT TT=0.053	UNSAT TT=1111.23 CHECKS=543047000 NODES=3972	UNSAT TT=1058.81 CHECKS=550291000 NODES=3970	UNSAT TT=0.127	UNSAT TT=4.618 CHECKS=170	UNSAT TT=1.134 CHECKS=170	UNSAT TT=1.018 ASSIGNMENTS=0	UNSAT TT=1.057 ASSIGNMENTS=0	UNSAT TT=579.423 CHECKS=1220950000 NODES=0	UNSAT TT=567.536 CHECKS=1220950000 NODES=0	UNSAT TT=611.065 CHECKS=1220950000 NODES=0	UNSAT TT=0.074 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.073 ASSIGNMENTS=0 CHECKS=1944	? (problem) TT=78.958	? (problem) TT=70.928	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.062 ASSIGNMENTS=0 CHECKS=1944	? TT=0.317	UNSAT TT=0.053 ASSIGNMENTS=0 CHECKS=1944	UNSAT TT=0.055 ASSIGNMENTS=0 CHECKS=1944	? TT=1048.53	UNSAT TT=1.499	UNSAT TT=1.668
csp/radar-9-28-4-2/ normalized-radar-9-28-4-2-9.xml	UNSAT TT=0.064	UNSAT TT=2.513 CHECKS=445775 NODES=0	UNSAT TT=2.506 CHECKS=445775 NODES=0	UNSAT TT=0.124	UNSAT TT=3.935 CHECKS=179	UNSAT TT=0.971 CHECKS=179	UNSAT TT=1.148 ASSIGNMENTS=0	UNSAT TT=1.085 ASSIGNMENTS=0	UNSAT TT=123.445 CHECKS=798161 NODES=0	UNSAT TT=201.341 CHECKS=798161 NODES=0	UNSAT TT=202.247 CHECKS=798161 NODES=0	UNSAT TT=0.075 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.072 ASSIGNMENTS=0 CHECKS=3536	? (problem) TT=71.309	? (problem) TT=71.859	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.067 ASSIGNMENTS=0 CHECKS=3536	? TT=0.358	UNSAT TT=0.066 ASSIGNMENTS=0 CHECKS=3536	UNSAT TT=0.064 ASSIGNMENTS=0 CHECKS=3536	? TT=269.642	UNSAT TT=1.631	UNSAT TT=1.841
csp/tdsp/ normalized-C1-1-20.xml	SAT TT=4.784	SAT TT=86.238 CHECKS=57861100 NODES=65274	SAT TT=1235.48 CHECKS=928176000 NODES=852887	SAT TT=1342.54	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=77.892 CHECKS=9735920 NODES=14134	SAT TT=47.121 CHECKS=50109200 NODES=58411	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800	? (problem) TT=68.54	? (problem) TT=64.586	? (TO) TT=1800.06	SAT TT=20.575 ASSIGNMENTS=282451 CHECKS=55700500	? TT=0.309	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=534.728	SAT TT=28.086	SAT TT=4.784
csp/tdsp/ normalized-C1-2-20.xml	SAT TT=5.284	? (TO) TT=1800.13	? (TO) TT=1800.16	SAT TT=1343.62	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (problem) TT=77.104	? (problem) TT=72.826	? (TO) TT=1800.11	? (TO) TT=1800.09	? TT=0.361	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=763.551	SAT TT=5.284	SAT TT=45.567
csp/tdsp/ normalized-C1-2-21.xml	SAT TT=0.69	SAT TT=22.048 CHECKS=14513200 NODES=9536	SAT TT=2.252 CHECKS=477386 NODES=599	SAT TT=1764.58	SAT TT=51.745 CHECKS=21923800	SAT TT=71.256 CHECKS=31521600	SAT TT=5.266 ASSIGNMENTS=1103	? (TO) TT=1800.16	SAT TT=80.764 CHECKS=11732000 NODES=16517	SAT TT=195.256 CHECKS=389309000 NODES=404081	SAT TT=30.784 CHECKS=1052750 NODES=891	SAT TT=1.011 ASSIGNMENTS=9945 CHECKS=2364700	SAT TT=1.016 ASSIGNMENTS=9945 CHECKS=2364700	? (problem) TT=79.246	? (problem) TT=80.583	SAT TT=2.456 ASSIGNMENTS=27859 CHECKS=6214920	SAT TT=1.473 ASSIGNMENTS=15143 CHECKS=3786700	? TT=0.329	SAT TT=442.012 ASSIGNMENTS=3638160 CHECKS=747705000	SAT TT=0.69 ASSIGNMENTS=5605 CHECKS=1590770	? (TO) TT=1802.21	SAT TT=1.087	SAT TT=1.551
csp/tdsp/ normalized-C2-1-15.xml	SAT TT=13.833	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.13	? (problem) TT=77.551	? (problem) TT=83.883	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=0.412	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=690.107	SAT TT=13.833	SAT TT=160.481
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tdsp/ normalized-C2-2-15.xml	SAT TT=5.175	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=54.063 ASSIGNMENTS=203502 CHECKS=94414500	SAT TT=56.208 ASSIGNMENTS=203502 CHECKS=94414500	? (problem) TT=114.428	? (problem) TT=101.036	? (TO) TT=1800.09	? (TO) TT=1800.09	? TT=0.453	? (TO) TT=1800.09	SAT TT=48.643 ASSIGNMENTS=203502 CHECKS=94414500	? TT=860.842	SAT TT=5.175	SAT TT=31.941
csp/tdsp/ normalized-C2-3-16.xml	SAT TT=1.024	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=38.132 CHECKS=14261600	SAT TT=94.718 CHECKS=35343600	SAT TT=96.591 ASSIGNMENTS=23864	? (TO) TT=1800.14	? (TO) TT=1800.04	SAT TT=605.575 CHECKS=1122470000 NODES=625967	SAT TT=90.583 CHECKS=946549 NODES=374	SAT TT=8.718 ASSIGNMENTS=1958 CHECKS=1792950	SAT TT=8.52 ASSIGNMENTS=1958 CHECKS=1792950	? (problem) TT=69.913	? (problem) TT=73.722	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=0.404	? (TO) TT=1800.09	SAT TT=1.024 ASSIGNMENTS=1958 CHECKS=1792950	? (TO) TT=1802.19	SAT TT=1.725	SAT TT=2.9
csp/tdsp/ normalized-C3-1-31.xml	SAT TT=6.587	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	Wrong Cert. TT=1198.58 ASSIGNMENTS=372916	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	? (problem) TT=87.409	? (problem) TT=86.749	? (TO) TT=1800.02	? (TO) TT=1800.07	? TT=0.55	? (TO) TT=1800.11	? (TO) TT=1800.05	? TT=900.718	SAT TT=6.587	SAT TT=8.783
csp/tdsp/ normalized-C3-2-30.xml		? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.34	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.06	? (problem) TT=74.183	? (problem) TT=80.031	? (TO) TT=1800.03	? (TO) TT=1800.06	? TT=0.417	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=718.15	? (TO) TT=1800.03	? (TO) TT=1800.01
csp/tdsp/ normalized-C4-1-60.xml	SAT TT=96.907	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=96.907 ASSIGNMENTS=468	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (problem) TT=188.282	? (problem) TT=181.572	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=0.473	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1801.01	? (TO) TT=1800.03	? (TO) TT=1800.04
csp/tdsp/ normalized-C4-2-60.xml	SAT TT=1353.87	? (TO) TT=1800.1	? (TO) TT=1800.13	SAT TT=1353.87	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (MO) TT=99.52	? (problem) TT=107.619	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.629	? (TO) TT=1800.07	? (TO) TT=1800.08	? TT=794.093	? (TO) TT=1800.02	? (TO) TT=1800.09
csp/tdsp/ normalized-C4-3-60.xml	SAT TT=104.074	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=1784.59	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=104.074 ASSIGNMENTS=750	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.14	? (problem) TT=159.833	? (problem) TT=170.942	? (TO) TT=1800.04	? (TO) TT=1800.05	? TT=0.465	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=1707.04	? (TO) TT=1800.1	? (TO) TT=1800.01
csp/tdsp/ normalized-C4-3-61.xml	SAT TT=12.237	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=297.475 ASSIGNMENTS=1202370 CHECKS=972831000	SAT TT=1745.81 ASSIGNMENTS=1202370 CHECKS=972831000	? (problem) TT=189.352	? (problem) TT=160.853	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=0.633	SAT TT=423.799 ASSIGNMENTS=1611260 CHECKS=1481060000	SAT TT=287.246 ASSIGNMENTS=1202370 CHECKS=972831000	? (TO) TT=1800.9	SAT TT=12.237	SAT TT=98.289
csp/tdsp/ normalized-C5-1-90.xml		? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (MO) TT=93.94	? (MO) TT=90.69	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=0.729	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=1166.35	? (TO) TT=1800.1	? (TO) TT=1800.03
csp/tdsp/ normalized-C5-1-91.xml	SAT TT=257.173	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=96.51	? (MO) TT=95.37	? (TO) TT=1800.08	? (TO) TT=1800.1	? TT=0.529	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1176.37	SAT TT=257.173	? (TO) TT=1800.01
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tdsp/ normalized-C5-2-91.xml	SAT TT=588.036	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.03	? (MO) TT=177.99	? (MO) TT=179.88	? (TO) TT=1800.05	? (TO) TT=1800.04	? TT=0.594	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.29	SAT TT=588.036	SAT TT=796.881
csp/tdsp/ normalized-C5-3-91.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	? (MO) TT=380.42	? (TO) TT=1800.09	? (TO) TT=1800.08	? (MO) TT=95.65	? (MO) TT=98.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? TT=0.73	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=665.229	? (MO) TT=1682.37	? (TO) TT=1800.09
csp/tdsp/ normalized-C6-1-121.xml		? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.22	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.04	? (MO) TT=159.33	? (MO) TT=160.83	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=0.632	? (TO) TT=1800.12	? (TO) TT=1800.07	? TT=1207.08	? (MO) TT=1297.15	? (TO) TT=1800.08
csp/tdsp/ normalized-C6-3-121.xml		? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.06	? (MO) TT=141.94	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (MO) TT=242.65	? (MO) TT=260.23	? (TO) TT=1800.06	? (TO) TT=1800.12	? TT=0.641	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1801.53	? (MO) TT=1024.04	? (TO) TT=1800
csp/tdsp/ normalized-C7-1-240.xml		? (TO) TT=1800.18	? (TO) TT=1800.27	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.13	? (problem) TT=1620.89	? TT=204.381	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	? (MO) TT=518.58	? (MO) TT=529.92	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=1.365	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.26	? TT=184.402	? TT=177.64
csp/tdsp/ normalized-C7-3-240.xml		? (TO) TT=1800.22	? (TO) TT=1800.24	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.51	? (problem) TT=56.485	? TT=204.269	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	? (MO) TT=785.97	? (MO) TT=784.96	? (TO) TT=1800.14	? (TO) TT=1800.16	? TT=1.226	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.26	? TT=182.376	? TT=180.267

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	113	113	143	153	156	129	83	48	42	154	154	148	153	152	153	10	130	130
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	113	113	143	153	156	129	83	48	42	154	154	148	153	152	153	10	130	130
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	19	2	7	4	0	0	0	1	2	47	24	16	57	0	7	1
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0