CSP 2008 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory boolean problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory boolean problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-100-1-6-1.xml	SAT TT=0.038	SAT TT=1.201 CHECKS=21846 NODES=1200	SAT TT=1.105 CHECKS=16672 NODES=1093	SAT TT=1132.65	SAT TT=0.185 CHECKS=111710	SAT TT=0.164 CHECKS=103884	SAT TT=1.384 ASSIGNMENTS=3338	SAT TT=1.388 ASSIGNMENTS=3338	SAT TT=1.091 CHECKS=5151 NODES=438	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=0.134 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=0.125 ASSIGNMENTS=1187 CHECKS=138942	SAT TT=1.453	SAT TT=1.44	SAT TT=0.058 ASSIGNMENTS=490 CHECKS=50727	SAT TT=0.211 ASSIGNMENTS=6629 CHECKS=281140	SAT TT=0.722	SAT TT=0.37 ASSIGNMENTS=2944 CHECKS=275974	SAT TT=0.038 ASSIGNMENTS=278 CHECKS=23153	SAT TT=1.983	SAT TT=0.925	SAT TT=1.024
csp/pseudo/aim/ normalized-aim-100-1-6-4.xml	SAT TT=0.097	SAT TT=1.128 CHECKS=17655 NODES=1131	SAT TT=1.062 CHECKS=20123 NODES=1075	? (TO) TT=1800.03	SAT TT=0.318 CHECKS=186055	SAT TT=0.317 CHECKS=193769	SAT TT=1.065 ASSIGNMENTS=828	SAT TT=1.081 ASSIGNMENTS=828	SAT TT=1.042 CHECKS=15977 NODES=821	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=0.181 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=0.178 ASSIGNMENTS=1919 CHECKS=197180	SAT TT=1.437	SAT TT=1.622	SAT TT=0.14 ASSIGNMENTS=1563 CHECKS=167446	SAT TT=0.143 ASSIGNMENTS=5004 CHECKS=199060	SAT TT=0.652	SAT TT=0.097 ASSIGNMENTS=937 CHECKS=61589	SAT TT=0.109 ASSIGNMENTS=1034 CHECKS=126171	SAT TT=1.779	SAT TT=0.814	SAT TT=0.924
csp/pseudo/aim/ normalized-aim-100-2-0-2.xml	SAT TT=0.489	SAT TT=3.198 CHECKS=896852 NODES=36656	SAT TT=4.525 CHECKS=1679380 NODES=65563	SAT TT=407.963	SAT TT=8.321 CHECKS=6348600	SAT TT=6.83 CHECKS=5231120	SAT TT=2.714 ASSIGNMENTS=18602	SAT TT=2.975 ASSIGNMENTS=18602	SAT TT=2.014 CHECKS=260619 NODES=6598	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=10.85 ASSIGNMENTS=36656 CHECKS=896852	SAT TT=11.36 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.557	SAT TT=1.711	SAT TT=2.533 ASSIGNMENTS=21939 CHECKS=3586780	SAT TT=0.489 ASSIGNMENTS=7731 CHECKS=682765	SAT TT=0.827	SAT TT=3.019 ASSIGNMENTS=17937 CHECKS=2852450	SAT TT=3.531 ASSIGNMENTS=31349 CHECKS=5409650	SAT TT=1.904	SAT TT=0.994	SAT TT=0.934
csp/pseudo/aim/ normalized-aim-100-3-4-2.xml	SAT TT=0.172	SAT TT=1.607 CHECKS=168115 NODES=5662	SAT TT=1.631 CHECKS=141600 NODES=5683	SAT TT=0.922	SAT TT=0.409 CHECKS=338498	SAT TT=0.311 CHECKS=273653	SAT TT=2.983 ASSIGNMENTS=11371	SAT TT=2.831 ASSIGNMENTS=11371	SAT TT=2.881 CHECKS=497348 NODES=5486	SAT TT=6.965 CHECKS=11520500 NODES=515730	? (TO) TT=1800.06	SAT TT=0.223 ASSIGNMENTS=996 CHECKS=272827	SAT TT=0.209 ASSIGNMENTS=996 CHECKS=272827	SAT TT=1.865	SAT TT=1.88	SAT TT=0.172 ASSIGNMENTS=727 CHECKS=217532	SAT TT=1.05 ASSIGNMENTS=7639 CHECKS=1617400	SAT TT=0.862	SAT TT=0.731 ASSIGNMENTS=2749 CHECKS=753824	SAT TT=0.599 ASSIGNMENTS=2617 CHECKS=967997	SAT TT=2.094	SAT TT=0.949	SAT TT=1.108
csp/pseudo/aim/ normalized-aim-100-3-4-3.xml	SAT TT=0.055	SAT TT=1.19 CHECKS=24647 NODES=1375	SAT TT=1.304 CHECKS=26200 NODES=1514	SAT TT=0.513	SAT TT=0.519 CHECKS=429416	SAT TT=1.863 CHECKS=1719700	SAT TT=2.525 ASSIGNMENTS=8616	SAT TT=2.354 ASSIGNMENTS=8616	SAT TT=1.967 CHECKS=138679 NODES=2729	SAT TT=11.894 CHECKS=20200200 NODES=895870	? (TO) TT=1800.01	SAT TT=0.513 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=0.506 ASSIGNMENTS=1774 CHECKS=719746	SAT TT=1.695	SAT TT=1.744	SAT TT=0.518 ASSIGNMENTS=1764 CHECKS=769907	SAT TT=0.82 ASSIGNMENTS=7032 CHECKS=1318810	SAT TT=0.809	SAT TT=1.555 ASSIGNMENTS=5720 CHECKS=1566430	SAT TT=0.055 ASSIGNMENTS=116 CHECKS=39128	SAT TT=2.26	SAT TT=0.961	SAT TT=0.969
csp/pseudo/aim/ normalized-aim-100-3-4-4.xml	SAT TT=0.61	SAT TT=1.474 CHECKS=104142 NODES=4184	SAT TT=1.812 CHECKS=208276 NODES=7626	SAT TT=2.179	SAT TT=2.656 CHECKS=2395670	SAT TT=2.02 CHECKS=1849220	SAT TT=3.356 ASSIGNMENTS=13397	SAT TT=2.977 ASSIGNMENTS=13397	SAT TT=6.461 CHECKS=1722550 NODES=17499	SAT TT=7.898 CHECKS=12418100 NODES=553986	? (TO) TT=1800.02	SAT TT=1.33 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.325 ASSIGNMENTS=4798 CHECKS=2012540	SAT TT=1.909	SAT TT=1.718	SAT TT=0.61 ASSIGNMENTS=2256 CHECKS=908128	SAT TT=1.046 ASSIGNMENTS=7468 CHECKS=1637620	SAT TT=0.787	SAT TT=0.622 ASSIGNMENTS=2197 CHECKS=660543	SAT TT=2.282 ASSIGNMENTS=10167 CHECKS=3802740	SAT TT=2.314	SAT TT=1.068	SAT TT=0.932
csp/pseudo/aim/ normalized-aim-100-6-0-3.xml	SAT TT=0.072	SAT TT=1.338 CHECKS=22533 NODES=1124	SAT TT=1.452 CHECKS=23208 NODES=1015	SAT TT=0.904	SAT TT=0.201 CHECKS=134020	SAT TT=0.182 CHECKS=146791	SAT TT=1.54 ASSIGNMENTS=426	SAT TT=1.772 ASSIGNMENTS=426	SAT TT=1.725 CHECKS=99981 NODES=840	SAT TT=1.421 CHECKS=121799 NODES=2977	SAT TT=1.426 CHECKS=171365 NODES=1311	SAT TT=0.171 ASSIGNMENTS=292 CHECKS=184441	SAT TT=0.177 ASSIGNMENTS=292 CHECKS=184441	SAT TT=2.001	SAT TT=1.997	SAT TT=0.101 ASSIGNMENTS=147 CHECKS=85816	SAT TT=0.84 ASSIGNMENTS=5220 CHECKS=1316770	SAT TT=0.818	SAT TT=0.342 ASSIGNMENTS=1272 CHECKS=356842	SAT TT=0.072 ASSIGNMENTS=70 CHECKS=48759	SAT TT=2.434	SAT TT=1.095	SAT TT=1.328
csp/pseudo/aim/ normalized-aim-200-1-6-1.xml	SAT TT=1.167	SAT TT=1.873 CHECKS=193472 NODES=7946	SAT TT=2.102 CHECKS=222317 NODES=9646	? (TO) TT=1800.1	SAT TT=13.37 CHECKS=8478830	SAT TT=5.643 CHECKS=3485080	SAT TT=11.301 ASSIGNMENTS=92753	SAT TT=12.093 ASSIGNMENTS=92753	SAT TT=2.201 CHECKS=127369 NODES=3715	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=9.134 ASSIGNMENTS=7946 CHECKS=193472	SAT TT=9.697 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=1.904	SAT TT=1.975	SAT TT=1.167 ASSIGNMENTS=7981 CHECKS=1580700	SAT TT=1.55 ASSIGNMENTS=19204 CHECKS=2118470	SAT TT=1.108	SAT TT=11.347 ASSIGNMENTS=43732 CHECKS=8977590	SAT TT=2.675 ASSIGNMENTS=17344 CHECKS=3743000	SAT TT=2.455	SAT TT=1.238	SAT TT=1.2
csp/pseudo/aim/ normalized-aim-200-1-6-2.xml	SAT TT=0.885	SAT TT=3.875 CHECKS=792276 NODES=37887	SAT TT=3.731 CHECKS=753234 NODES=34327	? (TO) TT=1800.11	SAT TT=6.03 CHECKS=3193740	SAT TT=8.23 CHECKS=4269140	SAT TT=4.293 ASSIGNMENTS=37937	SAT TT=4.343 ASSIGNMENTS=37937	SAT TT=5.124 CHECKS=515808 NODES=17253	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=11.145 ASSIGNMENTS=37887 CHECKS=792276	SAT TT=1.496 ASSIGNMENTS=15438 CHECKS=1912100	SAT TT=1.787	SAT TT=1.818	SAT TT=2.87 ASSIGNMENTS=27719 CHECKS=3586480	SAT TT=0.885 ASSIGNMENTS=15727 CHECKS=1141810	SAT TT=1.393	SAT TT=1.673 ASSIGNMENTS=8113 CHECKS=893074	SAT TT=1.369 ASSIGNMENTS=13464 CHECKS=1660980	SAT TT=2.681	SAT TT=1.348	SAT TT=1.049
csp/pseudo/aim/ normalized-aim-200-1-6-4.xml	SAT TT=1.059	SAT TT=3.649 CHECKS=822520 NODES=29579	SAT TT=3.322 CHECKS=672110 NODES=27165	? (TO) TT=1800.05	SAT TT=44.571 CHECKS=23011200	SAT TT=15.367 CHECKS=8411770	SAT TT=14.026 ASSIGNMENTS=149488	SAT TT=14.846 ASSIGNMENTS=149488	SAT TT=22.21 CHECKS=2919140 NODES=103049	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=11.131 ASSIGNMENTS=29579 CHECKS=822520	SAT TT=29.646 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.098	SAT TT=1.891	SAT TT=30.501 ASSIGNMENTS=297005 CHECKS=37328500	SAT TT=261.23 ASSIGNMENTS=1834890 CHECKS=356778000	SAT TT=26.301	SAT TT=5.825 ASSIGNMENTS=29095 CHECKS=3493110	SAT TT=24.099 ASSIGNMENTS=240841 CHECKS=29674400	SAT TT=2.336	SAT TT=1.207	SAT TT=1.059
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/aim/ normalized-aim-200-2-0-3.xml	SAT TT=1.049	SAT TT=1.711 CHECKS=122864 NODES=7037	SAT TT=2.098 CHECKS=198192 NODES=10306	? (TO) TT=1800.07	SAT TT=8.241 CHECKS=4445050	SAT TT=31.368 CHECKS=17618400	SAT TT=30.033 ASSIGNMENTS=302970	SAT TT=28.622 ASSIGNMENTS=302970	SAT TT=20.612 CHECKS=2784570 NODES=73865	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=9.259 ASSIGNMENTS=7037 CHECKS=122864	SAT TT=10.915 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.134	SAT TT=2.283	SAT TT=223.076 ASSIGNMENTS=1478320 CHECKS=296022000	SAT TT=1.72 ASSIGNMENTS=21420 CHECKS=2293980	SAT TT=1.005	SAT TT=16.693 ASSIGNMENTS=62767 CHECKS=9498680	SAT TT=3.482 ASSIGNMENTS=27190 CHECKS=4337900	SAT TT=2.657	SAT TT=1.049	SAT TT=1.069
csp/pseudo/aim/ normalized-aim-200-3-4-4.xml	SAT TT=1.029	SAT TT=2.103 CHECKS=188104 NODES=6840	SAT TT=2.531 CHECKS=299548 NODES=10161	SAT TT=1785.89	SAT TT=6.663 CHECKS=4954940	SAT TT=9.721 CHECKS=7349590	SAT TT=7.977 ASSIGNMENTS=38004	SAT TT=8.888 ASSIGNMENTS=38004	SAT TT=27.206 CHECKS=5180360 NODES=49190	SAT TT=7.911 CHECKS=8404530 NODES=376254	? (TO) TT=1800.05	SAT TT=9.423 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=9.54 ASSIGNMENTS=6840 CHECKS=188104	SAT TT=2.361	SAT TT=2.326	SAT TT=10.483 ASSIGNMENTS=30817 CHECKS=14973000	SAT TT=5.321 ASSIGNMENTS=17393 CHECKS=7865580	SAT TT=1.861	SAT TT=9.741 ASSIGNMENTS=17184 CHECKS=7550590	SAT TT=1.029 ASSIGNMENTS=3467 CHECKS=1385420	SAT TT=3.044	SAT TT=1.281	SAT TT=1.207
csp/pseudo/aim/ normalized-aim-200-6-0-3.xml	SAT TT=0.417	SAT TT=1.797 CHECKS=37739 NODES=2224	SAT TT=2.286 CHECKS=146463 NODES=4784	? (TO) TT=1800.06	SAT TT=1.431 CHECKS=1022330	SAT TT=3.134 CHECKS=2895050	SAT TT=2.181 ASSIGNMENTS=764	SAT TT=2.4 ASSIGNMENTS=764	SAT TT=2.538 CHECKS=83377 NODES=744	SAT TT=1488.82 CHECKS=2147590000 NODES=56854500	SAT TT=2.895 CHECKS=2701400 NODES=10360	SAT TT=0.417 ASSIGNMENTS=421 CHECKS=398974	SAT TT=0.434 ASSIGNMENTS=421 CHECKS=398974	SAT TT=2.787	SAT TT=2.666	SAT TT=0.592 ASSIGNMENTS=632 CHECKS=622537	SAT TT=2.577 ASSIGNMENTS=6603 CHECKS=3270170	SAT TT=1.078	SAT TT=2.801 ASSIGNMENTS=3518 CHECKS=1864890	SAT TT=2.274 ASSIGNMENTS=2156 CHECKS=2641370	SAT TT=3.709	SAT TT=1.234	SAT TT=1.358
csp/pseudo/aim/ normalized-aim-50-1-6-2.xml	SAT TT=0.013	SAT TT=0.989 CHECKS=16430 NODES=909	SAT TT=0.858 CHECKS=757 NODES=0	SAT TT=0.081	SAT TT=0.021 CHECKS=969	SAT TT=0.015 CHECKS=1069	SAT TT=0.733 ASSIGNMENTS=3	SAT TT=0.784 ASSIGNMENTS=3	SAT TT=0.838 CHECKS=6687 NODES=368	SAT TT=110.969 CHECKS=229738000 NODES=21019000	? (TO) TT=1800.05	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.025 ASSIGNMENTS=2 CHECKS=802	SAT TT=1.28	SAT TT=1.152	SAT TT=0.013 ASSIGNMENTS=2 CHECKS=802	SAT TT=0.048 ASSIGNMENTS=1251 CHECKS=50569	SAT TT=0.466	SAT TT=0.039 ASSIGNMENTS=472 CHECKS=27861	SAT TT=0.027 ASSIGNMENTS=209 CHECKS=22312	SAT TT=1.139	SAT TT=0.708	SAT TT=0.791
csp/pseudo/aim/ normalized-aim-50-2-0-1.xml	SAT TT=0.037	SAT TT=1.017 CHECKS=8669 NODES=713	SAT TT=0.941 CHECKS=4777 NODES=410	SAT TT=6.479	SAT TT=0.203 CHECKS=147342	SAT TT=0.183 CHECKS=128657	SAT TT=0.945 ASSIGNMENTS=1211	SAT TT=1.195 ASSIGNMENTS=1211	SAT TT=0.832 CHECKS=5945 NODES=339	SAT TT=5.322 CHECKS=10376100 NODES=743890	? (TO) TT=1800.09	SAT TT=0.081 ASSIGNMENTS=749 CHECKS=81799	SAT TT=0.073 ASSIGNMENTS=749 CHECKS=81799	SAT TT=1.543	SAT TT=1.436	SAT TT=0.073 ASSIGNMENTS=718 CHECKS=82307	SAT TT=0.198 ASSIGNMENTS=4767 CHECKS=269997	SAT TT=0.501	SAT TT=0.047 ASSIGNMENTS=493 CHECKS=33401	SAT TT=0.037 ASSIGNMENTS=305 CHECKS=33295	SAT TT=1.187	SAT TT=0.746	SAT TT=0.731
csp/pseudo/aim/ normalized-aim-50-3-4-1.xml	SAT TT=0.019	SAT TT=0.993 CHECKS=4713 NODES=377	SAT TT=0.958 CHECKS=2685 NODES=157	SAT TT=0.081	SAT TT=0.047 CHECKS=20574	SAT TT=0.036 CHECKS=20512	SAT TT=0.967 ASSIGNMENTS=79	SAT TT=0.901 ASSIGNMENTS=79	SAT TT=1.004 CHECKS=23759 NODES=479	SAT TT=1.639 CHECKS=1525370 NODES=67916	SAT TT=1.11 CHECKS=119150 NODES=1079	SAT TT=0.043 ASSIGNMENTS=68 CHECKS=20150	SAT TT=0.041 ASSIGNMENTS=68 CHECKS=20150	SAT TT=1.691	SAT TT=1.359	SAT TT=0.026 ASSIGNMENTS=51 CHECKS=13384	SAT TT=0.363 ASSIGNMENTS=4407 CHECKS=559116	SAT TT=0.599	SAT TT=0.064 ASSIGNMENTS=441 CHECKS=59095	SAT TT=0.019 ASSIGNMENTS=6 CHECKS=1812	SAT TT=1.741	SAT TT=0.856	SAT TT=0.843
csp/pseudo/aim/ normalized-aim-50-3-4-4.xml	SAT TT=0.039	SAT TT=1.027 CHECKS=9606 NODES=578	SAT TT=0.994 CHECKS=5887 NODES=356	SAT TT=0.079	SAT TT=0.061 CHECKS=38409	SAT TT=0.056 CHECKS=38389	SAT TT=0.973 ASSIGNMENTS=460	SAT TT=1.044 ASSIGNMENTS=460	SAT TT=0.91 CHECKS=6600 NODES=186	SAT TT=1.161 CHECKS=485601 NODES=21639	SAT TT=1.08 CHECKS=434549 NODES=3331	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=0.057 ASSIGNMENTS=152 CHECKS=43768	SAT TT=1.417	SAT TT=1.385	SAT TT=0.039 ASSIGNMENTS=125 CHECKS=34909	SAT TT=0.35 ASSIGNMENTS=4402 CHECKS=545662	SAT TT=0.609	SAT TT=0.045 ASSIGNMENTS=361 CHECKS=42302	SAT TT=0.045 ASSIGNMENTS=147 CHECKS=41742	SAT TT=1.759	SAT TT=0.785	SAT TT=0.814
csp/pseudo/aim/ normalized-aim-50-6-0-1.xml	SAT TT=0.025	SAT TT=1.093 CHECKS=3257 NODES=192	SAT TT=1.095 CHECKS=8303 NODES=337	SAT TT=0.101	SAT TT=0.046 CHECKS=11108	SAT TT=0.032 CHECKS=11017	SAT TT=1.025 ASSIGNMENTS=36	SAT TT=1.037 ASSIGNMENTS=36	SAT TT=0.993 CHECKS=2873 NODES=116	SAT TT=1.099 CHECKS=77826 NODES=1933	SAT TT=1.081 CHECKS=62076 NODES=596	SAT TT=0.048 ASSIGNMENTS=50 CHECKS=21446	SAT TT=0.049 ASSIGNMENTS=50 CHECKS=21446	SAT TT=1.716	SAT TT=1.545	SAT TT=0.035 ASSIGNMENTS=43 CHECKS=19179	SAT TT=0.081 ASSIGNMENTS=533 CHECKS=103306	SAT TT=0.861	SAT TT=0.038 ASSIGNMENTS=72 CHECKS=17033	SAT TT=0.025 ASSIGNMENTS=7 CHECKS=3218	SAT TT=1.82	SAT TT=0.89	SAT TT=0.901
csp/pseudo/aim/ normalized-aim-50-6-0-3.xml	SAT TT=0.028	SAT TT=1.186 CHECKS=2355 NODES=157	SAT TT=1.106 CHECKS=3434 NODES=166	SAT TT=0.092	SAT TT=0.044 CHECKS=9519	SAT TT=0.028 CHECKS=9275	SAT TT=1.077 ASSIGNMENTS=4	SAT TT=1.016 ASSIGNMENTS=4	SAT TT=0.992 CHECKS=2817 NODES=128	SAT TT=1.114 CHECKS=72436 NODES=1813	SAT TT=1.081 CHECKS=54098 NODES=485	SAT TT=0.047 ASSIGNMENTS=18 CHECKS=9890	SAT TT=0.04 ASSIGNMENTS=18 CHECKS=9890	SAT TT=1.8	SAT TT=1.61	SAT TT=0.028 ASSIGNMENTS=16 CHECKS=7480	SAT TT=0.053 ASSIGNMENTS=297 CHECKS=46804	SAT TT=0.858	SAT TT=0.049 ASSIGNMENTS=203 CHECKS=38747	SAT TT=0.038 ASSIGNMENTS=48 CHECKS=21982	SAT TT=1.723	SAT TT=0.969	SAT TT=1.107
csp/pseudo/aim/ normalized-aim-50-6-0-4.xml	SAT TT=0.028	SAT TT=1.104 CHECKS=3435 NODES=199	SAT TT=1.072 CHECKS=4642 NODES=208	SAT TT=0.105	SAT TT=0.045 CHECKS=11808	SAT TT=0.032 CHECKS=11886	SAT TT=1.223 ASSIGNMENTS=41	SAT TT=1.209 ASSIGNMENTS=41	SAT TT=1.079 CHECKS=9331 NODES=170	SAT TT=1.046 CHECKS=57955 NODES=1410	SAT TT=1.058 CHECKS=191551 NODES=1592	SAT TT=0.039 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.038 ASSIGNMENTS=7 CHECKS=5576	SAT TT=1.482	SAT TT=1.525	SAT TT=0.028 ASSIGNMENTS=7 CHECKS=5576	SAT TT=0.041 ASSIGNMENTS=140 CHECKS=26608	SAT TT=0.801	SAT TT=0.036 ASSIGNMENTS=90 CHECKS=16234	SAT TT=0.037 ASSIGNMENTS=43 CHECKS=21011	SAT TT=1.893	SAT TT=0.962	SAT TT=0.986
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/chnl/ normalized-chnl-10-11.xml	UNSAT TT=0.058	UNSAT TT=1.467 CHECKS=212572 NODES=2319	UNSAT TT=1.584 CHECKS=254326 NODES=1665	? (TO) TT=1800.07	UNSAT TT=0.076 CHECKS=11881	UNSAT TT=0.058 CHECKS=7538	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=720.789 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=869.723 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=16.988	UNSAT TT=4.25	? (TO) TT=1800.1	UNSAT TT=685.082 ASSIGNMENTS=9135120 CHECKS=883770000	UNSAT TT=37.465	? (TO) TT=1800.04	UNSAT TT=531.88 ASSIGNMENTS=6161630 CHECKS=725834000	UNSAT TT=1426.01	UNSAT TT=11.762	UNSAT TT=11.287
csp/pseudo/chnl/ normalized-chnl-10-15.xml	UNSAT TT=0.062	UNSAT TT=6.176 CHECKS=2773630 NODES=2183	UNSAT TT=3.536 CHECKS=1683300 NODES=1354	? (TO) TT=1800.05	UNSAT TT=0.064 CHECKS=5081	UNSAT TT=0.062 CHECKS=5051	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=1655.7 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=1655.95 ASSIGNMENTS=2865710 CHECKS=474578000	UNSAT TT=15.581	UNSAT TT=4.353	? (TO) TT=1800.02	UNSAT TT=613.737 ASSIGNMENTS=5287110 CHECKS=852119000	UNSAT TT=50.798	UNSAT TT=1554.08 ASSIGNMENTS=6517850 CHECKS=1113020000	UNSAT TT=347.557 ASSIGNMENTS=2865710 CHECKS=474578000	? (TO) TT=1800.18	UNSAT TT=16.435	UNSAT TT=5.999
csp/pseudo/chnl/ normalized-chnl-15-16.xml	UNSAT TT=0.327	UNSAT TT=73.688 CHECKS=51110700 NODES=29733	UNSAT TT=288.369 CHECKS=204356000 NODES=42154	? (TO) TT=1800.09	UNSAT TT=0.327 CHECKS=46106	UNSAT TT=0.336 CHECKS=47946	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-15-20.xml	UNSAT TT=0.437	UNSAT TT=1103 CHECKS=716887000 NODES=32764	? (TO) TT=1800.17	? (TO) TT=1800.06	UNSAT TT=0.437 CHECKS=58974	UNSAT TT=0.458 CHECKS=55833	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=213.121	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-20-21.xml	UNSAT TT=1.032	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1.065 CHECKS=131908	UNSAT TT=1.032 CHECKS=125953	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=500.586	? (TO) TT=1800.05	? (TO) TT=1800.11
csp/pseudo/chnl/ normalized-chnl-20-30.xml	UNSAT TT=1.889	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=2.265 CHECKS=206040	UNSAT TT=1.889 CHECKS=165351	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=666.893	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/pseudo/chnl/ normalized-chnl-30-31.xml	UNSAT TT=7.287	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=7.287 CHECKS=587577	? (TO) TT=1800.23	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/pseudo/chnl/ normalized-chnl-30-35.xml	UNSAT TT=9.795	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=9.795 CHECKS=663367	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800
csp/pseudo/chnl/ normalized-chnl-30-40.xml	UNSAT TT=13.431	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.06	UNSAT TT=13.431 CHECKS=842229	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/pseudo/chnl/ normalized-chnl-35-40.xml	UNSAT TT=21.029	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=21.029 CHECKS=1251830	? (TO) TT=1800.02	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/chnl/ normalized-chnl-35-45.xml	UNSAT TT=29.427	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.04	UNSAT TT=29.427 CHECKS=1461720	UNSAT TT=44.48 CHECKS=1923810	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-41.xml		? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-40-50.xml		? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/pseudo/chnl/ normalized-chnl-50-55.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.03
csp/pseudo/chnl/ normalized-chnl-50-60.xml		? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/pseudo/ circuits/ normalized-b1.xml	SAT TT=0.007	SAT TT=0.735 CHECKS=144 NODES=24	SAT TT=0.732 CHECKS=150 NODES=0	SAT TT=0.034	SAT TT=0.012 CHECKS=657	SAT TT=0.009 CHECKS=515	SAT TT=0.626 ASSIGNMENTS=11	SAT TT=0.697 ASSIGNMENTS=20	SAT TT=0.681 CHECKS=221 NODES=24	SAT TT=0.687 CHECKS=648 NODES=2	SAT TT=0.723 CHECKS=708 NODES=2	SAT TT=0.021 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.022 ASSIGNMENTS=12 CHECKS=609	SAT TT=1.56	SAT TT=1.287	SAT TT=0.01 ASSIGNMENTS=12 CHECKS=609	SAT TT=0.01 ASSIGNMENTS=17 CHECKS=628	SAT TT=0.351	SAT TT=0.009 ASSIGNMENTS=22 CHECKS=873	SAT TT=0.007 ASSIGNMENTS=12 CHECKS=603	SAT TT=1.503	SAT TT=0.64	SAT TT=0.592
csp/pseudo/ circuits/ normalized-C17.xml	SAT TT=0.007	SAT TT=0.676 CHECKS=58 NODES=15	SAT TT=0.679 CHECKS=61 NODES=0	SAT TT=0.028	SAT TT=0.008 CHECKS=118	SAT TT=0.01 CHECKS=172	SAT TT=0.537 ASSIGNMENTS=6	SAT TT=0.511 ASSIGNMENTS=6	SAT TT=0.474 CHECKS=64 NODES=15	SAT TT=0.504 CHECKS=230 NODES=0	SAT TT=0.507 CHECKS=267 NODES=1	SAT TT=0.019 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.016 ASSIGNMENTS=5 CHECKS=160	SAT TT=1.004	SAT TT=1.084	SAT TT=0.008 ASSIGNMENTS=5 CHECKS=160	SAT TT=0.009 ASSIGNMENTS=9 CHECKS=154	SAT TT=0.308	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=156	SAT TT=0.007 ASSIGNMENTS=6 CHECKS=155	SAT TT=0.963	SAT TT=0.481	SAT TT=0.507
csp/pseudo/ circuits/ normalized-C432.xml	SAT TT=0.331	SAT TT=2.652 CHECKS=9896 NODES=771	SAT TT=2.462 CHECKS=5573 NODES=0	SAT TT=0.641	SAT TT=0.398 CHECKS=24106	SAT TT=0.393 CHECKS=55174	SAT TT=2.81 ASSIGNMENTS=324	SAT TT=3.139 ASSIGNMENTS=655	SAT TT=106.913 CHECKS=16911 NODES=779	SAT TT=46.841 CHECKS=39305 NODES=40	SAT TT=49.29 CHECKS=108599 NODES=44	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.415 ASSIGNMENTS=344 CHECKS=70844	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=0.411 ASSIGNMENTS=344 CHECKS=70844	SAT TT=0.331 ASSIGNMENTS=456 CHECKS=119270	SAT TT=1.968	SAT TT=73.603 ASSIGNMENTS=42765 CHECKS=8746720	SAT TT=0.417 ASSIGNMENTS=350 CHECKS=71008	? (TO) TT=1800.15	SAT TT=3.014	SAT TT=3.086
csp/pseudo/ circuits/ normalized-c8.xml	SAT TT=0.063	SAT TT=1.388 CHECKS=2962 NODES=239	SAT TT=1.444 CHECKS=2306 NODES=0	SAT TT=0.192	SAT TT=0.107 CHECKS=13694	SAT TT=0.083 CHECKS=13548	SAT TT=1.368 ASSIGNMENTS=83	SAT TT=1.418 ASSIGNMENTS=199	SAT TT=81.662 CHECKS=3766 NODES=243	SAT TT=25.481 CHECKS=9341 NODES=11	SAT TT=23.438 CHECKS=13615 NODES=11	SAT TT=0.077 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.075 ASSIGNMENTS=81 CHECKS=13533	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=0.067 ASSIGNMENTS=81 CHECKS=13533	SAT TT=0.063 ASSIGNMENTS=88 CHECKS=14729	SAT TT=0.844	SAT TT=0.984 ASSIGNMENTS=4663 CHECKS=763194	SAT TT=0.064 ASSIGNMENTS=81 CHECKS=13281	? (TO) TT=1800.07	SAT TT=1.34	SAT TT=1.47
csp/pseudo/ circuits/ normalized-cc.xml	SAT TT=0.025	SAT TT=1.044 CHECKS=1597 NODES=133	SAT TT=1.037 CHECKS=791 NODES=0	SAT TT=0.084	SAT TT=0.039 CHECKS=2239	SAT TT=0.029 CHECKS=2287	SAT TT=1.08 ASSIGNMENTS=27	SAT TT=1.868 ASSIGNMENTS=104	SAT TT=76.011 CHECKS=1387 NODES=133	SAT TT=16.785 CHECKS=3388 NODES=4	SAT TT=16.546 CHECKS=4359 NODES=6	SAT TT=0.039 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.038 ASSIGNMENTS=28 CHECKS=4754	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=0.026 ASSIGNMENTS=28 CHECKS=4754	SAT TT=0.028 ASSIGNMENTS=43 CHECKS=5080	SAT TT=0.68	SAT TT=0.03 ASSIGNMENTS=81 CHECKS=5993	SAT TT=0.025 ASSIGNMENTS=28 CHECKS=4757	? (TO) TT=1800.18	SAT TT=0.944	SAT TT=1.055
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ circuits/ normalized-cm42a.xml	SAT TT=0.02	SAT TT=1.021 CHECKS=1184 NODES=99	SAT TT=0.998 CHECKS=1442 NODES=0	SAT TT=0.073	SAT TT=0.035 CHECKS=4028	SAT TT=0.027 CHECKS=3507	SAT TT=0.972 ASSIGNMENTS=38	SAT TT=0.918 ASSIGNMENTS=38	SAT TT=2.872 CHECKS=1006 NODES=101	SAT TT=1.531 CHECKS=2909 NODES=9	SAT TT=1.661 CHECKS=4217 NODES=9	SAT TT=0.034 ASSIGNMENTS=52 CHECKS=4021	SAT TT=0.033 ASSIGNMENTS=52 CHECKS=4021	SAT TT=2.539	Wrong Cert. TT=2.667	SAT TT=0.021 ASSIGNMENTS=43 CHECKS=3994	SAT TT=0.021 ASSIGNMENTS=45 CHECKS=3277	SAT TT=0.557	SAT TT=0.034 ASSIGNMENTS=325 CHECKS=16138	SAT TT=0.02 ASSIGNMENTS=50 CHECKS=4024	SAT TT=20.301	SAT TT=0.934	SAT TT=0.907
csp/pseudo/ circuits/ normalized-cmb.xml	SAT TT=0.093	SAT TT=1.607 CHECKS=5563 NODES=304	SAT TT=1.701 CHECKS=2755 NODES=0	SAT TT=0.619	SAT TT=0.122 CHECKS=9069	SAT TT=0.113 CHECKS=18859	SAT TT=1.533 ASSIGNMENTS=153	SAT TT=1.879 ASSIGNMENTS=245	SAT TT=106.891 CHECKS=5575 NODES=308	SAT TT=50.533 CHECKS=13721 NODES=16	SAT TT=43.758 CHECKS=21439 NODES=16	SAT TT=0.114 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.119 ASSIGNMENTS=162 CHECKS=29368	SAT TT=375.349	Wrong Cert. TT=373.297	SAT TT=0.104 ASSIGNMENTS=162 CHECKS=29368	SAT TT=0.093 ASSIGNMENTS=119 CHECKS=27145	SAT TT=0.93	SAT TT=2.275 ASSIGNMENTS=7506 CHECKS=1539860	SAT TT=0.107 ASSIGNMENTS=160 CHECKS=29474	? (TO) TT=1800.13	SAT TT=1.527	SAT TT=2.256
csp/pseudo/ course/ normalized-ss97-4.xml	SAT TT=2.532	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=252.285 ASSIGNMENTS=475286	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=1162.83 ASSIGNMENTS=1731 CHECKS=580222	SAT TT=1252.26 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=3.011 ASSIGNMENTS=1822 CHECKS=2222770	SAT TT=4.848 ASSIGNMENTS=7039 CHECKS=7819150	? (TO) TT=1800.1	SAT TT=15.986 ASSIGNMENTS=7291 CHECKS=5985600	SAT TT=2.532 ASSIGNMENTS=1731 CHECKS=580222	? (TO) TT=1800.14	SAT TT=3.746	SAT TT=7.42
csp/pseudo/ course/ normalized-ss97-6.xml	SAT TT=0.04	? (TO) TT=1800.13	SAT TT=224 CHECKS=46781300 NODES=23817	? (TO) TT=1800.05	SAT TT=0.873 CHECKS=22994	SAT TT=0.879 CHECKS=23150	? (TO) TT=1800.08	SAT TT=1.25 ASSIGNMENTS=351	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.056 ASSIGNMENTS=130 CHECKS=18175	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=0.04 ASSIGNMENTS=130 CHECKS=18175	SAT TT=0.06 ASSIGNMENTS=271 CHECKS=66053	SAT TT=141.642	SAT TT=0.151 ASSIGNMENTS=867 CHECKS=156378	SAT TT=0.044 ASSIGNMENTS=153 CHECKS=18742	? (TO) TT=1800.09	SAT TT=1.252	SAT TT=1.385
csp/pseudo/ course/ normalized-ws97-3.xml	SAT TT=1.208	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=82.455 ASSIGNMENTS=57720	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=1.208 ASSIGNMENTS=2431 CHECKS=958859	? (TO) TT=1800.06	SAT TT=2.301 ASSIGNMENTS=2714 CHECKS=2591590	? (TO) TT=1800.09	? (TO) TT=1800.15	SAT TT=5.497	SAT TT=10.207
csp/pseudo/ course/ normalized-ws97-5.xml	SAT TT=0.17	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	SAT TT=37.14 CHECKS=108787	? (TO) TT=1800.04	? (TO) TT=1800.18	SAT TT=2.642 ASSIGNMENTS=2436	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=1160.24 ASSIGNMENTS=606 CHECKS=179057	SAT TT=223.785 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.17 ASSIGNMENTS=156 CHECKS=122762	? (TO) TT=1800.12	SAT TT=0.248 ASSIGNMENTS=537 CHECKS=166124	SAT TT=0.291 ASSIGNMENTS=606 CHECKS=179057	? (TO) TT=1800.11	SAT TT=2.417	SAT TT=3.72
csp/pseudo/fpga/ normalized-fpga-10-10.xml	SAT TT=0.084	SAT TT=1.568 CHECKS=150473 NODES=2926	SAT TT=1.01 CHECKS=1465 NODES=0	SAT TT=888.318	SAT TT=0.084 CHECKS=16539	SAT TT=0.104 CHECKS=25361	SAT TT=9.226 ASSIGNMENTS=127355	SAT TT=0.915 ASSIGNMENTS=66	SAT TT=0.859 CHECKS=2827 NODES=150	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=8.835 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=8.868 ASSIGNMENTS=1966 CHECKS=195642	SAT TT=1.728	SAT TT=1.705	SAT TT=285.619 ASSIGNMENTS=2580350 CHECKS=421864000	? (TO) TT=1800.09	SAT TT=20.086	SAT TT=0.167 ASSIGNMENTS=1088 CHECKS=159381	SAT TT=0.144 ASSIGNMENTS=994 CHECKS=167247	SAT TT=3.856	SAT TT=0.946	SAT TT=0.918
csp/pseudo/fpga/ normalized-fpga-10-8.xml	SAT TT=0.11	SAT TT=1.341 CHECKS=66706 NODES=3257	SAT TT=1.393 CHECKS=72754 NODES=3718	SAT TT=896.532	SAT TT=0.127 CHECKS=35289	SAT TT=0.114 CHECKS=32861	SAT TT=16.672 ASSIGNMENTS=269893	SAT TT=1.055 ASSIGNMENTS=2002	SAT TT=0.911 CHECKS=21518 NODES=608	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.775 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=8.929 ASSIGNMENTS=1836 CHECKS=67604	SAT TT=1.613	SAT TT=1.716	SAT TT=456.374 ASSIGNMENTS=2654620 CHECKS=678505000	SAT TT=0.214 ASSIGNMENTS=2536 CHECKS=307420	SAT TT=31.898	SAT TT=0.11 ASSIGNMENTS=735 CHECKS=108930	SAT TT=1.19 ASSIGNMENTS=7694 CHECKS=1786280	SAT TT=3.046	SAT TT=0.833	SAT TT=0.858
csp/pseudo/fpga/ normalized-fpga-10-9.xml	SAT TT=0.099	SAT TT=1.618 CHECKS=204440 NODES=5028	SAT TT=1.017 CHECKS=908 NODES=0	SAT TT=898.535	SAT TT=0.115 CHECKS=29591	SAT TT=0.099 CHECKS=24007	SAT TT=14.857 ASSIGNMENTS=256375	SAT TT=0.812 ASSIGNMENTS=66	SAT TT=0.833 CHECKS=2025 NODES=135	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=75.108 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=69.54 ASSIGNMENTS=552372 CHECKS=52670100	SAT TT=1.769	SAT TT=1.689	SAT TT=49.719 ASSIGNMENTS=446877 CHECKS=70943500	SAT TT=300.101 ASSIGNMENTS=1657720 CHECKS=421911000	SAT TT=1.976	SAT TT=0.152 ASSIGNMENTS=964 CHECKS=154165	SAT TT=2.522 ASSIGNMENTS=15326 CHECKS=4107750	SAT TT=2.889	SAT TT=1.11	SAT TT=0.952
csp/pseudo/fpga/ normalized-fpga-11-11.xml	SAT TT=0.103	SAT TT=3.418 CHECKS=1539180 NODES=8471	SAT TT=1.122 CHECKS=2593 NODES=0	SAT TT=899.513	SAT TT=0.103 CHECKS=23182	SAT TT=0.149 CHECKS=42717	SAT TT=48.444 ASSIGNMENTS=687776	SAT TT=0.924 ASSIGNMENTS=81	SAT TT=0.986 CHECKS=4349 NODES=182	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=842.377 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=849.179 ASSIGNMENTS=3256280 CHECKS=751090000	SAT TT=1.974	SAT TT=1.918	? (TO) TT=1800.06	? (TO) TT=1800.01	SAT TT=217.837	SAT TT=0.572 ASSIGNMENTS=2096 CHECKS=465899	SAT TT=0.238 ASSIGNMENTS=1478 CHECKS=272798	SAT TT=5.238	SAT TT=1.15	SAT TT=1.031
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-12-10.xml	SAT TT=0.248	SAT TT=2.246 CHECKS=485940 NODES=10241	SAT TT=4.94 CHECKS=1748620 NODES=34316	SAT TT=892.112	SAT TT=0.248 CHECKS=74225	SAT TT=0.263 CHECKS=75337	SAT TT=32.826 ASSIGNMENTS=534094	SAT TT=1.508 ASSIGNMENTS=3170	SAT TT=1.082 CHECKS=22431 NODES=681	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=61.934 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=61.736 ASSIGNMENTS=319181 CHECKS=47496900	SAT TT=1.834	SAT TT=1.772	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=0.6 ASSIGNMENTS=2402 CHECKS=550230	? (TO) TT=1800.01	SAT TT=27.779	SAT TT=238.015	SAT TT=0.936
csp/pseudo/fpga/ normalized-fpga-13-11.xml	SAT TT=0.414	SAT TT=4.556 CHECKS=1959720 NODES=18904	SAT TT=10.727 CHECKS=5540890 NODES=60162	SAT TT=896.141	SAT TT=0.418 CHECKS=116820	SAT TT=0.414 CHECKS=116734	SAT TT=281.34 ASSIGNMENTS=4077740	SAT TT=1.057 ASSIGNMENTS=436	SAT TT=1.335 CHECKS=72886 NODES=1420	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	SAT TT=1.94	SAT TT=2.14	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=0.51 ASSIGNMENTS=1933 CHECKS=508338	? (TO) TT=1800.02	? (TO) TT=1800.17	SAT TT=54.38	SAT TT=1.173
csp/pseudo/fpga/ normalized-fpga-14-12.xml	SAT TT=0.599	SAT TT=6.184 CHECKS=2708710 NODES=26881	SAT TT=10.174 CHECKS=5346440 NODES=35760	SAT TT=892.64	SAT TT=0.599 CHECKS=163920	SAT TT=2.056 CHECKS=570581	SAT TT=257.221 ASSIGNMENTS=3779120	SAT TT=1.367 ASSIGNMENTS=580	SAT TT=2.282 CHECKS=502873 NODES=3937	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=2.058	SAT TT=2.35	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=2.787 ASSIGNMENTS=6271 CHECKS=2729220	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.04	SAT TT=1.242
csp/pseudo/fpga/ normalized-fpga-14-14.xml	SAT TT=0.4	SAT TT=7.391 CHECKS=3720990 NODES=11364	SAT TT=1.228 CHECKS=17739 NODES=0	SAT TT=897.856	SAT TT=0.403 CHECKS=101586	SAT TT=0.4 CHECKS=102879	SAT TT=281.432 ASSIGNMENTS=3266990	SAT TT=1.355 ASSIGNMENTS=134	SAT TT=1.319 CHECKS=20643 NODES=294	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=1646.34 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=2.265	SAT TT=2.362	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=9.226 ASSIGNMENTS=27739 CHECKS=8360460	SAT TT=0.44 ASSIGNMENTS=1728 CHECKS=500466	SAT TT=786.124	SAT TT=18.648	SAT TT=1.677
csp/pseudo/fpga/ normalized-fpga-15-14.xml	SAT TT=0.673	SAT TT=41.549 CHECKS=29154300 NODES=57432	SAT TT=164.826 CHECKS=121277000 NODES=237929	SAT TT=915.463	SAT TT=0.673 CHECKS=166547	SAT TT=0.678 CHECKS=169488	SAT TT=1072.71 ASSIGNMENTS=13542700	SAT TT=1.476 ASSIGNMENTS=779	SAT TT=1.758 CHECKS=99455 NODES=902	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=2.492	SAT TT=2.607	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	SAT TT=16.295 ASSIGNMENTS=43526 CHECKS=15120000	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=144.166	SAT TT=1.503
csp/pseudo/fpga/ normalized-fpga-20-18.xml	SAT TT=3.861	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=26.489 CHECKS=6110250	SAT TT=30.563 CHECKS=7127170	? (TO) TT=1800.07	SAT TT=3.861 ASSIGNMENTS=13085	SAT TT=488.436 CHECKS=451410000 NODES=486194	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=4.562	SAT TT=6.476	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=198.63	? (TO) TT=1800.07	SAT TT=4.73
csp/pseudo/fpga/ normalized-fpga-25-23.xml	SAT TT=3.817	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=148.618 CHECKS=30253500	? (TO) TT=1800.05	? (TO) TT=1800.12	SAT TT=322.582 ASSIGNMENTS=1223930	SAT TT=115.662 CHECKS=83178000 NODES=4889	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=50.395	SAT TT=87.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=253.506	? (TO) TT=1800	SAT TT=3.817
csp/pseudo/fpga/ normalized-fpga-30-28.xml	SAT TT=5.074	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=5.342 ASSIGNMENTS=6892	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1552.7	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=309.57	? (TO) TT=1800.02	SAT TT=5.074
csp/pseudo/fpga/ normalized-fpga-30-30.xml	SAT TT=3.288	? (TO) TT=1800.17	? (TO) TT=1800.15	SAT TT=1349.2	SAT TT=86.505 CHECKS=13296500	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=3.288 ASSIGNMENTS=646	SAT TT=767.231 CHECKS=1073840000 NODES=1350	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.02	SAT TT=6.841
csp/pseudo/fpga/ normalized-fpga-35-34.xml	SAT TT=10.837	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=262.674 CHECKS=18969900	? (TO) TT=1800.11	SAT TT=77.418 ASSIGNMENTS=135627	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.2	? (TO) TT=1800.1	SAT TT=10.837
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/fpga/ normalized-fpga-35-35.xml	SAT TT=5.027	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=1346.36	SAT TT=184.1 CHECKS=21793500	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=5.027 ASSIGNMENTS=885	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=1402.68	? (TO) TT=1800.03	SAT TT=10.406
csp/pseudo/garden/ normalized-g-100x100.xml	SAT TT=1.391	SAT TT=23.335 CHECKS=20002 NODES=10000	SAT TT=26.992 CHECKS=20001 NODES=0	SAT TT=3.967	SAT TT=43.526 CHECKS=166909	SAT TT=38.154 CHECKS=167626	SAT TT=30.622 ASSIGNMENTS=6226	SAT TT=25.056 ASSIGNMENTS=6226	SAT TT=64.946 CHECKS=129270 NODES=10000	? TT=36.127 CHECKS=60679 NODES=0	SAT TT=36.901 CHECKS=1598420 NODES=203	SAT TT=1.759 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=2.023 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=124.925	SAT TT=118.284	SAT TT=2.02 ASSIGNMENTS=6715 CHECKS=260632	SAT TT=1.391 ASSIGNMENTS=7033 CHECKS=265221	SAT TT=6.713	SAT TT=2.16 ASSIGNMENTS=6666 CHECKS=261790	SAT TT=2.477 ASSIGNMENTS=7022 CHECKS=265144	SAT TT=9.162	SAT TT=3.968	SAT TT=4.056
csp/pseudo/ garden/ normalized-g-15x15.xml	SAT TT=0.029	SAT TT=1.257 CHECKS=452 NODES=225	SAT TT=1.042 CHECKS=452 NODES=0	SAT TT=0.104	SAT TT=0.041 CHECKS=3383	SAT TT=0.031 CHECKS=3317	SAT TT=0.98 ASSIGNMENTS=144	SAT TT=0.995 ASSIGNMENTS=144	SAT TT=0.991 CHECKS=2454 NODES=225	SAT TT=0.953 CHECKS=3903 NODES=1	SAT TT=0.945 CHECKS=4394 NODES=2	SAT TT=0.043 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.036 ASSIGNMENTS=154 CHECKS=5461	SAT TT=1.893	SAT TT=1.671	SAT TT=0.03 ASSIGNMENTS=154 CHECKS=5461	SAT TT=0.029 ASSIGNMENTS=97 CHECKS=5098	SAT TT=0.651	SAT TT=0.04 ASSIGNMENTS=312 CHECKS=8475	SAT TT=0.031 ASSIGNMENTS=153 CHECKS=5467	SAT TT=2.062	SAT TT=0.923	SAT TT=1.066
csp/pseudo/ garden/ normalized-g-2x2.xml	SAT TT=0.005	SAT TT=0.651 CHECKS=11 NODES=4	SAT TT=0.648 CHECKS=9 NODES=0	SAT TT=0.024	SAT TT=0.008 CHECKS=56	SAT TT=0.005 CHECKS=60	SAT TT=0.455 ASSIGNMENTS=3	SAT TT=0.509 ASSIGNMENTS=3	SAT TT=0.421 CHECKS=6 NODES=4	SAT TT=0.422 CHECKS=58 NODES=0	SAT TT=0.444 CHECKS=58 NODES=0	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.019 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.785	SAT TT=0.766	SAT TT=0.006 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.005 ASSIGNMENTS=1 CHECKS=30	SAT TT=0.264	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.007 ASSIGNMENTS=2 CHECKS=36	SAT TT=0.892	SAT TT=0.481	SAT TT=0.442
csp/pseudo/ garden/ normalized-g-4x4.xml	SAT TT=0.006	SAT TT=0.702 CHECKS=33 NODES=16	SAT TT=0.683 CHECKS=33 NODES=0	SAT TT=0.029	SAT TT=0.008 CHECKS=200	SAT TT=0.007 CHECKS=244	SAT TT=0.592 ASSIGNMENTS=11	SAT TT=0.486 ASSIGNMENTS=11	SAT TT=0.506 CHECKS=86 NODES=16	SAT TT=0.51 CHECKS=264 NODES=0	SAT TT=0.514 CHECKS=264 NODES=0	SAT TT=0.018 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.02 ASSIGNMENTS=10 CHECKS=280	SAT TT=1.008	SAT TT=0.964	SAT TT=0.007 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.008 ASSIGNMENTS=9 CHECKS=254	SAT TT=0.293	SAT TT=0.008 ASSIGNMENTS=11 CHECKS=270	SAT TT=0.006 ASSIGNMENTS=10 CHECKS=280	SAT TT=0.896	SAT TT=0.484	SAT TT=0.514
csp/pseudo/ garden/ normalized-g-7x7.xml	SAT TT=0.009	SAT TT=0.867 CHECKS=100 NODES=49	SAT TT=0.781 CHECKS=99 NODES=0	SAT TT=0.042	SAT TT=0.015 CHECKS=702	SAT TT=0.012 CHECKS=673	SAT TT=0.678 ASSIGNMENTS=31	SAT TT=0.689 ASSIGNMENTS=31	SAT TT=0.633 CHECKS=403 NODES=49	SAT TT=0.689 CHECKS=839 NODES=0	SAT TT=0.698 CHECKS=834 NODES=0	SAT TT=0.021 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.022 ASSIGNMENTS=33 CHECKS=1041	SAT TT=1.325	SAT TT=1.183	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1041	SAT TT=0.009 ASSIGNMENTS=21 CHECKS=960	SAT TT=0.391	SAT TT=0.01 ASSIGNMENTS=30 CHECKS=1030	SAT TT=0.01 ASSIGNMENTS=33 CHECKS=1051	SAT TT=1.538	SAT TT=0.635	SAT TT=0.574
csp/pseudo/ garden/ normalized-g-9x3.xml	SAT TT=0.006	SAT TT=0.718 CHECKS=56 NODES=27	SAT TT=0.737 CHECKS=56 NODES=0	SAT TT=0.033	SAT TT=0.011 CHECKS=382	SAT TT=0.006 CHECKS=337	SAT TT=0.512 ASSIGNMENTS=19	SAT TT=0.568 ASSIGNMENTS=19	SAT TT=0.562 CHECKS=176 NODES=27	SAT TT=0.624 CHECKS=483 NODES=1	SAT TT=0.535 CHECKS=457 NODES=0	SAT TT=0.019 ASSIGNMENTS=18 CHECKS=497	SAT TT=0.018 ASSIGNMENTS=18 CHECKS=497	SAT TT=1.165	SAT TT=1.041	SAT TT=0.009 ASSIGNMENTS=18 CHECKS=497	SAT TT=0.008 ASSIGNMENTS=13 CHECKS=413	SAT TT=0.329	SAT TT=0.008 ASSIGNMENTS=21 CHECKS=488	SAT TT=0.009 ASSIGNMENTS=18 CHECKS=497	SAT TT=1.024	SAT TT=0.556	SAT TT=0.524
csp/pseudo/ garden/ normalized-g-9x9.xml	SAT TT=0.011	SAT TT=0.867 CHECKS=164 NODES=81	SAT TT=0.828 CHECKS=164 NODES=0	SAT TT=0.052	SAT TT=0.02 CHECKS=1149	SAT TT=0.014 CHECKS=1180	SAT TT=0.713 ASSIGNMENTS=54	SAT TT=0.713 ASSIGNMENTS=54	SAT TT=0.752 CHECKS=766 NODES=81	SAT TT=0.744 CHECKS=1424 NODES=1	SAT TT=0.82 CHECKS=1506 NODES=1	SAT TT=0.025 ASSIGNMENTS=54 CHECKS=1829	SAT TT=0.025 ASSIGNMENTS=54 CHECKS=1829	SAT TT=1.316	SAT TT=1.365	SAT TT=0.011 ASSIGNMENTS=54 CHECKS=1829	SAT TT=0.014 ASSIGNMENTS=33 CHECKS=1680	SAT TT=0.469	SAT TT=0.012 ASSIGNMENTS=58 CHECKS=1805	SAT TT=0.014 ASSIGNMENTS=55 CHECKS=1823	SAT TT=1.567	SAT TT=0.663	SAT TT=0.684
csp/pseudo/ii/ normalized-ii-16a2.xml	SAT TT=1.822	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=3.935	SAT TT=13.619 CHECKS=12729400	SAT TT=8.943 CHECKS=6015530	SAT TT=23.485 ASSIGNMENTS=100	SAT TT=22.436 ASSIGNMENTS=100	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=1.822 ASSIGNMENTS=103 CHECKS=342975	SAT TT=1.979 ASSIGNMENTS=103 CHECKS=342975	SAT TT=31.515	SAT TT=31.775	SAT TT=1.916 ASSIGNMENTS=103 CHECKS=342975	SAT TT=2.223 ASSIGNMENTS=908 CHECKS=647487	SAT TT=48.861	? (TO) TT=1800.1	SAT TT=1.885 ASSIGNMENTS=103 CHECKS=338350	SAT TT=176.958	SAT TT=5.352	SAT TT=6.198
csp/pseudo/ii/ normalized-ii-16b2.xml	SAT TT=5.129	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=1615.96	? (TO) TT=1800.06	SAT TT=205.18 CHECKS=213195000	? (TO) TT=1800.1	? (TO) TT=1800.16	SAT TT=476.737 CHECKS=18314400 NODES=12858	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=21.027	SAT TT=20.798	? (TO) TT=1800.11	SAT TT=5.433 ASSIGNMENTS=596 CHECKS=3650160	SAT TT=11.079	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=257.18	SAT TT=5.129	SAT TT=6.386
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ii/ normalized-ii-16c2.xml	SAT TT=5.995	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=1611.36	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.28	SAT TT=918.014 CHECKS=41894500 NODES=26932	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=19	SAT TT=18.131	? (TO) TT=1800.03	SAT TT=50.365 ASSIGNMENTS=4687 CHECKS=37051400	SAT TT=12.333	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=336.72	SAT TT=5.995	SAT TT=6.714
csp/pseudo/ii/ normalized-ii-16d1.xml	SAT TT=7.45	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=88.416 CHECKS=39468800	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=822.658 CHECKS=35391100 NODES=39811	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=26.566	SAT TT=26.986	? (TO) TT=1800.08	SAT TT=20.411 ASSIGNMENTS=7762 CHECKS=19490600	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=417.987	SAT TT=7.45	SAT TT=8.138
csp/pseudo/ii/ normalized-ii-16e1.xml	SAT TT=8.592	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.02	SAT TT=64.493 CHECKS=16959200	SAT TT=73.737 CHECKS=18390400	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=32.051	SAT TT=31.96	? (TO) TT=1800.06	SAT TT=24.881 ASSIGNMENTS=8248 CHECKS=24904900	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=888.211	SAT TT=8.592	SAT TT=13.004
csp/pseudo/ii/ normalized-ii-16e2.xml	SAT TT=5.925	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT TT=923.206	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.14	SAT TT=461.489 CHECKS=31062500 NODES=14989	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=12.388	SAT TT=12.566	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=17.101	? (TO) TT=1800.06	? (TO) TT=1800.07	SAT TT=462.383	SAT TT=5.925	SAT TT=7.817
csp/pseudo/ii/ normalized-ii-32a1.xml	SAT TT=7.118	? (TO) TT=1800.12	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.07	SAT TT=1063.84 CHECKS=25046000 NODES=14972	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=7.118 ASSIGNMENTS=238 CHECKS=6054420	SAT TT=9.839	SAT TT=7.648 ASSIGNMENTS=510 CHECKS=6471450	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=7.781	SAT TT=8.448
csp/pseudo/ii/ normalized-ii-32b3.xml	SAT TT=4.083	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=1603.68	SAT TT=47.058 CHECKS=17658200	SAT TT=68.159 CHECKS=26673300	SAT TT=19.494 ASSIGNMENTS=3034	SAT TT=16.806 ASSIGNMENTS=3034	SAT TT=108.32 CHECKS=1137050 NODES=1355	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=254.011 ASSIGNMENTS=26680 CHECKS=95700900	SAT TT=245.502 ASSIGNMENTS=26680 CHECKS=95700900	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=49.876 ASSIGNMENTS=1479 CHECKS=38285300	SAT TT=11.226	SAT TT=4.083 ASSIGNMENTS=224 CHECKS=3126790	? (TO) TT=1800.02	? (TO) TT=1800.17	SAT TT=6.292	SAT TT=10.813
csp/pseudo/ii/ normalized-ii-32c3.xml	SAT TT=1.938	? (TO) TT=1800.09	SAT TT=1722.4 CHECKS=566503000 NODES=220969	? (TO) TT=1800.09	SAT TT=7.381 CHECKS=1866220	SAT TT=9.237 CHECKS=2416450	SAT TT=850.913 ASSIGNMENTS=492279	SAT TT=856.302 ASSIGNMENTS=492279	SAT TT=71.232 CHECKS=176945 NODES=768	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=1.938 ASSIGNMENTS=140 CHECKS=1597340	SAT TT=16.435	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=4.25	SAT TT=6.336
csp/pseudo/ii/ normalized-ii-32d2.xml	SAT TT=5.815	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=219.158 CHECKS=103325000	SAT TT=419.212 CHECKS=237242000	SAT TT=52.832 ASSIGNMENTS=19079	SAT TT=52.798 ASSIGNMENTS=19079	SAT TT=738.448 CHECKS=20656200 NODES=25782	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1649.14 ASSIGNMENTS=19079	SAT TT=1646.63 ASSIGNMENTS=19079	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.12	SAT TT=26.645 ASSIGNMENTS=4673 CHECKS=26839100	SAT TT=1290.89	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.12	SAT TT=7.604	SAT TT=5.815
csp/pseudo/ii/ normalized-ii-32e1.xml	SAT TT=0.194	SAT TT=1.869 CHECKS=8106 NODES=444	SAT TT=2.026 CHECKS=19180 NODES=444	SAT TT=0.45	SAT TT=0.927 CHECKS=253165	SAT TT=0.333 CHECKS=72134	SAT TT=2.085 ASSIGNMENTS=30	SAT TT=2.299 ASSIGNMENTS=30	SAT TT=62.302 CHECKS=12069 NODES=511	SAT TT=4.114 CHECKS=1997470 NODES=31587	SAT TT=2.723 CHECKS=1236850 NODES=1029	SAT TT=0.206 ASSIGNMENTS=44 CHECKS=99064	SAT TT=0.219 ASSIGNMENTS=44 CHECKS=99064	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=0.196 ASSIGNMENTS=44 CHECKS=99064	SAT TT=1.451 ASSIGNMENTS=1324 CHECKS=2168180	SAT TT=1.268	SAT TT=0.317 ASSIGNMENTS=153 CHECKS=203557	SAT TT=0.194 ASSIGNMENTS=43 CHECKS=97828	? (TO) TT=1800.08	SAT TT=2.1	SAT TT=3.038
csp/pseudo/ii/ normalized-ii-32e2.xml	SAT TT=3.064	SAT TT=15.922 CHECKS=5268120 NODES=5115	SAT TT=154.685 CHECKS=58904200 NODES=37606	SAT TT=1791.51	SAT TT=14.449 CHECKS=6814430	SAT TT=19.361 CHECKS=9428700	SAT TT=244.352 ASSIGNMENTS=183291	SAT TT=264.796 ASSIGNMENTS=183291	SAT TT=64.686 CHECKS=38104 NODES=612	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=54.034 ASSIGNMENTS=17054 CHECKS=20229200	SAT TT=56.136 ASSIGNMENTS=17054 CHECKS=20229200	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=6.705	SAT TT=3.465 ASSIGNMENTS=729 CHECKS=2552010	SAT TT=800.004 ASSIGNMENTS=68954 CHECKS=677669000	? (TO) TT=1800.14	SAT TT=3.064	SAT TT=4.544
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ii/ normalized-ii-32e3.xml	SAT TT=1.232	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=38.897 CHECKS=17865500	SAT TT=66.393 CHECKS=24961600	SAT TT=372.349 ASSIGNMENTS=121330	SAT TT=353.778 ASSIGNMENTS=121330	SAT TT=86.052 CHECKS=421584 NODES=1003	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=255.194 ASSIGNMENTS=25304 CHECKS=93659400	SAT TT=254.614 ASSIGNMENTS=25304 CHECKS=93659400	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=1.232 ASSIGNMENTS=60 CHECKS=758327	SAT TT=11.698	SAT TT=1.355 ASSIGNMENTS=172 CHECKS=1009690	? (TO) TT=1800.06	? (TO) TT=1800.14	SAT TT=4.808	SAT TT=8.347
csp/pseudo/ ii/ normalized-ii-8a1.xml	SAT TT=0.02	SAT TT=0.988 CHECKS=1070 NODES=134	SAT TT=0.975 CHECKS=1334 NODES=0	SAT TT=0.08	SAT TT=0.042 CHECKS=9238	SAT TT=0.029 CHECKS=6426	SAT TT=1.099 ASSIGNMENTS=21	SAT TT=1.332 ASSIGNMENTS=21	SAT TT=0.994 CHECKS=1160 NODES=140	SAT TT=1.191 CHECKS=11217 NODES=555	SAT TT=1.022 CHECKS=63712 NODES=324	SAT TT=0.032 ASSIGNMENTS=16 CHECKS=1337	SAT TT=0.033 ASSIGNMENTS=16 CHECKS=1337	SAT TT=1.686	SAT TT=1.787	SAT TT=0.02 ASSIGNMENTS=16 CHECKS=1337	SAT TT=0.021 ASSIGNMENTS=32 CHECKS=1611	SAT TT=0.597	SAT TT=0.021 ASSIGNMENTS=79 CHECKS=4220	SAT TT=0.022 ASSIGNMENTS=19 CHECKS=1371	SAT TT=1.846	SAT TT=0.913	SAT TT=0.92
csp/pseudo/ ii/ normalized-ii-8b1.xml	SAT TT=0.133	SAT TT=8.312 CHECKS=7477 NODES=672	SAT TT=8.275 CHECKS=23179 NODES=672	SAT TT=0.453	SAT TT=0.393 CHECKS=137611	SAT TT=0.411 CHECKS=325535	SAT TT=2.882 ASSIGNMENTS=55	SAT TT=3.085 ASSIGNMENTS=55	SAT TT=3.171 CHECKS=8774 NODES=674	SAT TT=2.758 CHECKS=51132 NODES=826	SAT TT=3.493 CHECKS=717578 NODES=661	SAT TT=0.155 ASSIGNMENTS=54 CHECKS=11621	SAT TT=0.162 ASSIGNMENTS=54 CHECKS=11621	SAT TT=3.48	SAT TT=3.462	SAT TT=0.144 ASSIGNMENTS=54 CHECKS=11621	SAT TT=0.699 ASSIGNMENTS=7187 CHECKS=837611	SAT TT=1.226	SAT TT=0.171 ASSIGNMENTS=260 CHECKS=19702	SAT TT=0.133 ASSIGNMENTS=54 CHECKS=11643	SAT TT=5.215	SAT TT=1.712	SAT TT=1.519
csp/pseudo/ ii/ normalized-ii-8b2.xml	SAT TT=0.294	SAT TT=14.348 CHECKS=551906 NODES=3076	SAT TT=14.326 CHECKS=355945 NODES=2814	SAT TT=0.853	SAT TT=1.327 CHECKS=997002	SAT TT=1.133 CHECKS=1025090	SAT TT=4.59 ASSIGNMENTS=53	SAT TT=4.375 ASSIGNMENTS=53	SAT TT=8.394 CHECKS=94586 NODES=1506	? (TO) TT=1800.09	SAT TT=8.652 CHECKS=9112610 NODES=4396	SAT TT=0.3 ASSIGNMENTS=52 CHECKS=22824	SAT TT=0.314 ASSIGNMENTS=52 CHECKS=22824	SAT TT=5.749	SAT TT=5.508	SAT TT=0.302 ASSIGNMENTS=52 CHECKS=22824	SAT TT=1.469 ASSIGNMENTS=8086 CHECKS=1428680	SAT TT=1.742	SAT TT=0.425 ASSIGNMENTS=414 CHECKS=65912	SAT TT=0.294 ASSIGNMENTS=52 CHECKS=22833	SAT TT=6.58	SAT TT=2.221	SAT TT=2.12
csp/pseudo/ ii/ normalized-ii-8b4.xml	SAT TT=0.582	SAT TT=9.22 CHECKS=1845260 NODES=6271	SAT TT=9.888 CHECKS=1999360 NODES=6549	SAT TT=1.679	SAT TT=3.194 CHECKS=1309160	SAT TT=4.172 CHECKS=3530280	SAT TT=8.754 ASSIGNMENTS=46	SAT TT=8.454 ASSIGNMENTS=46	SAT TT=29.277 CHECKS=170291 NODES=2490	? (TO) TT=1800.09	SAT TT=24.672 CHECKS=16318700 NODES=2875	SAT TT=0.603 ASSIGNMENTS=46 CHECKS=45058	SAT TT=0.62 ASSIGNMENTS=46 CHECKS=45058	SAT TT=11.476	SAT TT=11.266	SAT TT=0.619 ASSIGNMENTS=46 CHECKS=45058	SAT TT=1.582 ASSIGNMENTS=5099 CHECKS=1273690	SAT TT=3.182	SAT TT=3.108 ASSIGNMENTS=1502 CHECKS=214309	SAT TT=0.582 ASSIGNMENTS=46 CHECKS=45058	SAT TT=7.505	SAT TT=2.651	SAT TT=3.094
csp/pseudo/ ii/ normalized-ii-8c2.xml	SAT TT=0.473	SAT TT=13.038 CHECKS=7848340 NODES=16084	SAT TT=8.055 CHECKS=1839020 NODES=5766	SAT TT=1.398	SAT TT=2.647 CHECKS=2032650	SAT TT=1.674 CHECKS=828840	SAT TT=6.736 ASSIGNMENTS=100	SAT TT=6.118 ASSIGNMENTS=100	SAT TT=17.293 CHECKS=60424 NODES=2161	SAT TT=99.082 CHECKS=105619000 NODES=1651790	SAT TT=16.837 CHECKS=10331500 NODES=2675	SAT TT=0.514 ASSIGNMENTS=100 CHECKS=41973	SAT TT=0.521 ASSIGNMENTS=100 CHECKS=41973	SAT TT=10.195	SAT TT=8.639	SAT TT=0.473 ASSIGNMENTS=100 CHECKS=41973	SAT TT=3.785 ASSIGNMENTS=21780 CHECKS=3455760	SAT TT=166.428	SAT TT=5.615 ASSIGNMENTS=3119 CHECKS=558330	SAT TT=0.538 ASSIGNMENTS=100 CHECKS=41973	SAT TT=7.881	SAT TT=3.152	SAT TT=3.371
csp/pseudo/jnh/ normalized-jnh-12.xml	SAT TT=0.092	SAT TT=1.902 CHECKS=11436 NODES=461	SAT TT=1.793 CHECKS=17056 NODES=256	SAT TT=0.33	SAT TT=0.135 CHECKS=30684	SAT TT=0.092 CHECKS=28671	SAT TT=1.546 ASSIGNMENTS=9	SAT TT=1.682 ASSIGNMENTS=9	SAT TT=1.979 CHECKS=107856 NODES=278	SAT TT=151.701 CHECKS=241627000 NODES=1201210	? (TO) TT=1800	SAT TT=0.359 ASSIGNMENTS=54 CHECKS=253825	SAT TT=0.327 ASSIGNMENTS=54 CHECKS=253825	SAT TT=3.356	SAT TT=3.097	SAT TT=0.46 ASSIGNMENTS=102 CHECKS=414681	SAT TT=2.044 ASSIGNMENTS=1095 CHECKS=2016190	SAT TT=0.98	SAT TT=0.281 ASSIGNMENTS=88 CHECKS=163740	SAT TT=0.339 ASSIGNMENTS=72 CHECKS=283895	SAT TT=3.901	SAT TT=1.414	SAT TT=1.748
csp/pseudo/jnh/ normalized-jnh-17.xml	SAT TT=0.207	SAT TT=1.629 CHECKS=14698 NODES=615	SAT TT=1.793 CHECKS=16441 NODES=597	SAT TT=0.317	SAT TT=0.251 CHECKS=131484	SAT TT=0.207 CHECKS=132865	SAT TT=1.636 ASSIGNMENTS=57	SAT TT=1.809 ASSIGNMENTS=57	SAT TT=1.871 CHECKS=31727 NODES=221	SAT TT=20.825 CHECKS=30696500 NODES=154438	SAT TT=5.972 CHECKS=9196790 NODES=12798	SAT TT=0.304 ASSIGNMENTS=53 CHECKS=222386	SAT TT=0.312 ASSIGNMENTS=53 CHECKS=222386	SAT TT=3.283	SAT TT=3.155	SAT TT=0.364 ASSIGNMENTS=74 CHECKS=297358	SAT TT=3.276 ASSIGNMENTS=2016 CHECKS=3616030	SAT TT=0.987	SAT TT=0.35 ASSIGNMENTS=148 CHECKS=244119	SAT TT=0.303 ASSIGNMENTS=47 CHECKS=211728	SAT TT=3.863	SAT TT=1.449	SAT TT=1.632
csp/pseudo/ jnh/ normalized-jnh-1.xml	SAT TT=0.3	SAT TT=1.565 CHECKS=4504 NODES=274	SAT TT=1.689 CHECKS=7021 NODES=259	SAT TT=0.34	SAT TT=0.332 CHECKS=184915	SAT TT=0.3 CHECKS=211900	SAT TT=2.009 ASSIGNMENTS=122	SAT TT=1.98 ASSIGNMENTS=122	SAT TT=2.098 CHECKS=166082 NODES=364	SAT TT=40 CHECKS=59863800 NODES=271081	SAT TT=2.069 CHECKS=540676 NODES=885	SAT TT=1.355 ASSIGNMENTS=254 CHECKS=1146800	SAT TT=1.131 ASSIGNMENTS=254 CHECKS=1146800	SAT TT=3.379	SAT TT=3.567	SAT TT=0.631 ASSIGNMENTS=145 CHECKS=484978	SAT TT=8.151 ASSIGNMENTS=4130 CHECKS=8143300	SAT TT=1.004	SAT TT=2.715 ASSIGNMENTS=1233 CHECKS=2197790	SAT TT=0.344 ASSIGNMENTS=80 CHECKS=264577	SAT TT=4.802	SAT TT=1.707	SAT TT=1.52
csp/pseudo/jnh/ normalized-jnh-201.xml	SAT TT=0.168	SAT TT=1.626 CHECKS=2276 NODES=200	SAT TT=1.647 CHECKS=5461 NODES=200	SAT TT=0.305	SAT TT=0.295 CHECKS=156366	SAT TT=0.187 CHECKS=101791	SAT TT=1.806 ASSIGNMENTS=87	SAT TT=1.697 ASSIGNMENTS=87	SAT TT=1.836 CHECKS=46552 NODES=269	SAT TT=1.793 CHECKS=147916 NODES=622	SAT TT=1.837 CHECKS=372033 NODES=544	SAT TT=0.209 ASSIGNMENTS=54 CHECKS=123137	SAT TT=0.212 ASSIGNMENTS=54 CHECKS=123137	SAT TT=3.339	SAT TT=3.566	SAT TT=0.185 ASSIGNMENTS=43 CHECKS=86177	SAT TT=1.88 ASSIGNMENTS=895 CHECKS=1829800	SAT TT=0.982	SAT TT=0.168 ASSIGNMENTS=60 CHECKS=61658	SAT TT=0.177 ASSIGNMENTS=42 CHECKS=90691	SAT TT=6.542	SAT TT=1.49	SAT TT=1.84
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/jnh/ normalized-jnh-204.xml	SAT TT=0.272	SAT TT=2.173 CHECKS=77565 NODES=3236	SAT TT=2.012 CHECKS=55229 NODES=2052	SAT TT=0.368	SAT TT=0.366 CHECKS=208995	SAT TT=0.396 CHECKS=270045	SAT TT=1.747 ASSIGNMENTS=97	SAT TT=1.888 ASSIGNMENTS=97	SAT TT=3.795 CHECKS=900740 NODES=837	SAT TT=1631.49 CHECKS=2880170000 NODES=15647600	SAT TT=2.42 CHECKS=1580960 NODES=2889	SAT TT=0.272 ASSIGNMENTS=61 CHECKS=192895	SAT TT=0.275 ASSIGNMENTS=61 CHECKS=192895	SAT TT=3.288	SAT TT=3.096	SAT TT=0.455 ASSIGNMENTS=123 CHECKS=403486	SAT TT=2.086 ASSIGNMENTS=1386 CHECKS=2147430	SAT TT=1.251	SAT TT=2.786 ASSIGNMENTS=1852 CHECKS=2565340	SAT TT=0.88 ASSIGNMENTS=200 CHECKS=824075	SAT TT=4.122	SAT TT=1.978	SAT TT=1.64
csp/pseudo/jnh/ normalized-jnh-205.xml	SAT TT=0.318	SAT TT=1.592 CHECKS=6757 NODES=360	SAT TT=1.602 CHECKS=8667 NODES=434	SAT TT=0.318	SAT TT=0.567 CHECKS=394626	SAT TT=0.446 CHECKS=314465	SAT TT=1.642 ASSIGNMENTS=103	SAT TT=1.609 ASSIGNMENTS=103	SAT TT=2.775 CHECKS=465656 NODES=517	SAT TT=8.581 CHECKS=11183700 NODES=58974	SAT TT=1.993 CHECKS=733962 NODES=1320	SAT TT=0.397 ASSIGNMENTS=88 CHECKS=337455	SAT TT=0.389 ASSIGNMENTS=88 CHECKS=337455	SAT TT=3.382	SAT TT=3.245	SAT TT=0.522 ASSIGNMENTS=110 CHECKS=437708	SAT TT=6.541 ASSIGNMENTS=4112 CHECKS=7268580	SAT TT=1.049	SAT TT=2.159 ASSIGNMENTS=1322 CHECKS=2231160	SAT TT=0.65 ASSIGNMENTS=142 CHECKS=631937	SAT TT=3.73	SAT TT=1.649	SAT TT=1.636
csp/pseudo/jnh/ normalized-jnh-207.xml	SAT TT=0.432	SAT TT=1.612 CHECKS=9320 NODES=424	SAT TT=1.762 CHECKS=14618 NODES=542	SAT TT=0.707	SAT TT=0.547 CHECKS=366437	SAT TT=0.468 CHECKS=337755	SAT TT=2.008 ASSIGNMENTS=172	SAT TT=1.78 ASSIGNMENTS=172	SAT TT=1.951 CHECKS=52234 NODES=245	SAT TT=1295.14 CHECKS=2267540000 NODES=12112100	? (TO) TT=1800.07	SAT TT=0.542 ASSIGNMENTS=114 CHECKS=485879	SAT TT=0.582 ASSIGNMENTS=114 CHECKS=485879	SAT TT=2.993	SAT TT=3.467	SAT TT=1.173 ASSIGNMENTS=287 CHECKS=1204540	SAT TT=6.889 ASSIGNMENTS=4339 CHECKS=7195940	SAT TT=0.992	SAT TT=0.55 ASSIGNMENTS=274 CHECKS=432668	SAT TT=0.432 ASSIGNMENTS=95 CHECKS=375519	SAT TT=4.12	SAT TT=1.616	SAT TT=1.412
csp/pseudo/jnh/ normalized-jnh-209.xml	SAT TT=0.359	SAT TT=1.832 CHECKS=16056 NODES=755	SAT TT=1.704 CHECKS=14446 NODES=548	SAT TT=0.359	SAT TT=0.701 CHECKS=483216	SAT TT=0.677 CHECKS=493898	SAT TT=1.986 ASSIGNMENTS=446	SAT TT=1.986 ASSIGNMENTS=446	SAT TT=1.812 CHECKS=70396 NODES=250	SAT TT=292.256 CHECKS=514017000 NODES=2801820	? (TO) TT=1800.03	SAT TT=1.09 ASSIGNMENTS=274 CHECKS=979847	SAT TT=1.079 ASSIGNMENTS=274 CHECKS=979847	SAT TT=3.371	SAT TT=3.183	SAT TT=1.098 ASSIGNMENTS=273 CHECKS=1022760	SAT TT=6.228 ASSIGNMENTS=4548 CHECKS=6666210	SAT TT=0.943	SAT TT=4.132 ASSIGNMENTS=2346 CHECKS=4091210	SAT TT=0.673 ASSIGNMENTS=168 CHECKS=603594	SAT TT=3.852	SAT TT=1.49	SAT TT=1.482
csp/pseudo/jnh/ normalized-jnh-210.xml	SAT TT=0.215	SAT TT=1.686 CHECKS=9707 NODES=540	SAT TT=1.659 CHECKS=11769 NODES=412	SAT TT=0.316	SAT TT=0.294 CHECKS=180968	SAT TT=0.296 CHECKS=218461	SAT TT=1.823 ASSIGNMENTS=66	SAT TT=1.951 ASSIGNMENTS=66	SAT TT=1.664 CHECKS=14071 NODES=204	SAT TT=3.083 CHECKS=2106610 NODES=11123	SAT TT=1.914 CHECKS=332638 NODES=707	SAT TT=0.299 ASSIGNMENTS=62 CHECKS=211328	SAT TT=0.287 ASSIGNMENTS=62 CHECKS=211328	SAT TT=3.168	SAT TT=3.225	SAT TT=0.348 ASSIGNMENTS=71 CHECKS=270578	SAT TT=5.497 ASSIGNMENTS=3393 CHECKS=6000920	SAT TT=0.982	SAT TT=0.266 ASSIGNMENTS=95 CHECKS=163168	SAT TT=0.215 ASSIGNMENTS=48 CHECKS=141060	SAT TT=3.952	SAT TT=1.733	SAT TT=1.802
csp/pseudo/jnh/ normalized-jnh-213.xml	SAT TT=0.19	SAT TT=1.623 CHECKS=8347 NODES=426	SAT TT=1.512 CHECKS=5890 NODES=0	SAT TT=0.386	SAT TT=0.319 CHECKS=200747	SAT TT=0.258 CHECKS=187587	SAT TT=1.672 ASSIGNMENTS=20	SAT TT=1.786 ASSIGNMENTS=20	SAT TT=1.624 CHECKS=32949 NODES=225	SAT TT=9.354 CHECKS=12345900 NODES=66492	SAT TT=2.349 CHECKS=1539550 NODES=2680	SAT TT=0.19 ASSIGNMENTS=54 CHECKS=127369	SAT TT=0.221 ASSIGNMENTS=54 CHECKS=127369	SAT TT=3.245	SAT TT=3.168	SAT TT=0.325 ASSIGNMENTS=81 CHECKS=274473	SAT TT=4.743 ASSIGNMENTS=3123 CHECKS=5254140	SAT TT=0.991	SAT TT=1.884 ASSIGNMENTS=952 CHECKS=1683370	SAT TT=0.201 ASSIGNMENTS=41 CHECKS=120061	SAT TT=4.116	SAT TT=1.606	SAT TT=1.596
csp/pseudo/jnh/ normalized-jnh-217.xml	SAT TT=0.232	SAT TT=1.865 CHECKS=15338 NODES=796	SAT TT=1.754 CHECKS=13338 NODES=619	SAT TT=0.351	SAT TT=0.271 CHECKS=134021	SAT TT=0.232 CHECKS=134257	SAT TT=1.845 ASSIGNMENTS=142	SAT TT=1.732 ASSIGNMENTS=142	SAT TT=1.86 CHECKS=77250 NODES=290	SAT TT=38.223 CHECKS=57262500 NODES=303588	SAT TT=5.978 CHECKS=10169500 NODES=13548	SAT TT=0.646 ASSIGNMENTS=168 CHECKS=598366	SAT TT=0.671 ASSIGNMENTS=168 CHECKS=598366	SAT TT=2.928	SAT TT=3.064	SAT TT=1.033 ASSIGNMENTS=282 CHECKS=1021120	SAT TT=3.953 ASSIGNMENTS=2805 CHECKS=4410500	SAT TT=0.97	SAT TT=14.692 ASSIGNMENTS=9882 CHECKS=14044200	SAT TT=0.537 ASSIGNMENTS=117 CHECKS=442509	SAT TT=4.812	SAT TT=1.42	SAT TT=1.795
csp/pseudo/jnh/ normalized-jnh-218.xml	SAT TT=0.176	SAT TT=1.678 CHECKS=11733 NODES=508	SAT TT=1.658 CHECKS=13636 NODES=443	SAT TT=0.331	SAT TT=0.222 CHECKS=110884	SAT TT=0.176 CHECKS=105033	SAT TT=1.588 ASSIGNMENTS=24	SAT TT=1.699 ASSIGNMENTS=24	SAT TT=1.616 CHECKS=31664 NODES=223	SAT TT=13.108 CHECKS=18478600 NODES=98000	? (TO) TT=1800.07	SAT TT=0.275 ASSIGNMENTS=59 CHECKS=181564	SAT TT=0.262 ASSIGNMENTS=59 CHECKS=181564	SAT TT=3.251	SAT TT=3.369	SAT TT=0.347 ASSIGNMENTS=82 CHECKS=263507	SAT TT=3.948 ASSIGNMENTS=2400 CHECKS=4121460	SAT TT=0.997	SAT TT=0.434 ASSIGNMENTS=286 CHECKS=323000	SAT TT=0.259 ASSIGNMENTS=62 CHECKS=199714	SAT TT=4.101	SAT TT=1.759	SAT TT=1.421
csp/pseudo/jnh/ normalized-jnh-220.xml	SAT TT=0.158	SAT TT=2.152 CHECKS=72228 NODES=2377	SAT TT=2.335 CHECKS=87729 NODES=2877	SAT TT=0.442	SAT TT=0.202 CHECKS=85141	SAT TT=0.158 CHECKS=81582	SAT TT=1.707 ASSIGNMENTS=88	SAT TT=1.708 ASSIGNMENTS=88	SAT TT=1.952 CHECKS=121631 NODES=299	SAT TT=573.648 CHECKS=915979000 NODES=4958410	SAT TT=3.826 CHECKS=4809690 NODES=7371	SAT TT=0.307 ASSIGNMENTS=62 CHECKS=223434	SAT TT=0.312 ASSIGNMENTS=62 CHECKS=223434	SAT TT=3.335	SAT TT=3.2	SAT TT=0.287 ASSIGNMENTS=62 CHECKS=192758	SAT TT=6.802 ASSIGNMENTS=4253 CHECKS=7139510	SAT TT=0.99	SAT TT=2.665 ASSIGNMENTS=1516 CHECKS=2273940	SAT TT=0.397 ASSIGNMENTS=80 CHECKS=335072	SAT TT=4.478	SAT TT=1.615	SAT TT=1.715
csp/pseudo/jnh/ normalized-jnh-301.xml	SAT TT=0.704	SAT TT=1.755 CHECKS=6351 NODES=538	SAT TT=1.816 CHECKS=7910 NODES=258	SAT TT=0.704	SAT TT=0.992 CHECKS=678516	SAT TT=1.252 CHECKS=914823	SAT TT=2.049 ASSIGNMENTS=767	SAT TT=2.018 ASSIGNMENTS=767	SAT TT=2.101 CHECKS=95691 NODES=291	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=9.92 ASSIGNMENTS=767	SAT TT=1.543 ASSIGNMENTS=288 CHECKS=1426390	SAT TT=3.688	SAT TT=3.818	SAT TT=2.124 ASSIGNMENTS=384 CHECKS=1832000	SAT TT=9.472 ASSIGNMENTS=4222 CHECKS=9186690	SAT TT=0.971	SAT TT=4.158 ASSIGNMENTS=1480 CHECKS=3396950	SAT TT=1.889 ASSIGNMENTS=323 CHECKS=1631930	SAT TT=4.889	SAT TT=1.559	SAT TT=1.771
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ jnh/ normalized-jnh-7.xml	SAT TT=0.26	SAT TT=1.667 CHECKS=8218 NODES=339	SAT TT=1.797 CHECKS=11671 NODES=342	SAT TT=0.35	SAT TT=0.26 CHECKS=142573	SAT TT=0.268 CHECKS=187535	SAT TT=1.591 ASSIGNMENTS=51	SAT TT=1.649 ASSIGNMENTS=51	SAT TT=1.681 CHECKS=12455 NODES=201	SAT TT=1.914 CHECKS=677138 NODES=3322	? (TO) TT=1800.06	SAT TT=0.331 ASSIGNMENTS=67 CHECKS=259351	SAT TT=0.369 ASSIGNMENTS=67 CHECKS=259351	SAT TT=3.127	SAT TT=3.403	SAT TT=0.665 ASSIGNMENTS=145 CHECKS=558267	SAT TT=0.424 ASSIGNMENTS=183 CHECKS=345990	SAT TT=0.98	SAT TT=0.309 ASSIGNMENTS=108 CHECKS=184186	SAT TT=0.483 ASSIGNMENTS=104 CHECKS=434527	SAT TT=4.076	SAT TT=1.73	SAT TT=1.447
csp/pseudo/ logic-synthesis/ normalized-5xp1-b.xml	SAT TT=1.543	SAT TT=4.112 CHECKS=23761 NODES=464	SAT TT=4.031 CHECKS=24239 NODES=0	SAT TT=1.72	SAT TT=7.097 CHECKS=164318	SAT TT=10.966 CHECKS=238309	SAT TT=3.519 ASSIGNMENTS=170	SAT TT=3.664 ASSIGNMENTS=441	SAT TT=128.313 CHECKS=42962 NODES=465	SAT TT=156.54 CHECKS=91826 NODES=0	SAT TT=177.303 CHECKS=91835 NODES=0	SAT TT=1.584 ASSIGNMENTS=169 CHECKS=1216870	SAT TT=1.675 ASSIGNMENTS=169 CHECKS=1216870	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=1.543 ASSIGNMENTS=169 CHECKS=1216870	SAT TT=2.255 ASSIGNMENTS=442 CHECKS=1514740	SAT TT=2.929	SAT TT=2.094 ASSIGNMENTS=572 CHECKS=1749760	SAT TT=1.631 ASSIGNMENTS=169 CHECKS=1216870	? (TO) TT=1800.12	SAT TT=8.191	SAT TT=14.739
csp/pseudo/ logic-synthesis/ normalized-9sym-b.xml	SAT TT=0.996	SAT TT=3.118 CHECKS=18466 NODES=309	SAT TT=3.916 CHECKS=35697 NODES=309	SAT TT=1.246	SAT TT=2.585 CHECKS=108923	SAT TT=3.638 CHECKS=158449	SAT TT=2.65 ASSIGNMENTS=139	SAT TT=2.866 ASSIGNMENTS=189	SAT TT=88.778 CHECKS=38558 NODES=310	SAT TT=24.585 CHECKS=70388 NODES=0	SAT TT=26.695 CHECKS=75961 NODES=1	SAT TT=1.04 ASSIGNMENTS=141 CHECKS=711307	SAT TT=1.113 ASSIGNMENTS=141 CHECKS=711307	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=1.016 ASSIGNMENTS=141 CHECKS=711307	SAT TT=1.106 ASSIGNMENTS=224 CHECKS=795965	SAT TT=2.132	SAT TT=1.439 ASSIGNMENTS=365 CHECKS=1027400	SAT TT=0.996 ASSIGNMENTS=139 CHECKS=681698	? (TO) TT=1800.13	SAT TT=5.253	SAT TT=9.799
csp/pseudo/ logic-synthesis/ normalized-9symml.xml	SAT TT=0.213	SAT TT=2.304 CHECKS=8504 NODES=651	SAT TT=2.159 CHECKS=8668 NODES=0	SAT TT=0.54	SAT TT=0.376 CHECKS=51114	SAT TT=0.3 CHECKS=49311	SAT TT=2.753 ASSIGNMENTS=334	SAT TT=3.217 ASSIGNMENTS=559	SAT TT=108.996 CHECKS=12354 NODES=657	SAT TT=54.97 CHECKS=29511 NODES=40	SAT TT=64.251 CHECKS=61910 NODES=27	SAT TT=0.269 ASSIGNMENTS=340 CHECKS=46480	SAT TT=0.268 ASSIGNMENTS=340 CHECKS=46480	? (TO) TT=1800	? (TO) TT=1800.08	SAT TT=0.283 ASSIGNMENTS=344 CHECKS=46384	SAT TT=0.213 ASSIGNMENTS=252 CHECKS=40802	SAT TT=1.955	SAT TT=87.176 ASSIGNMENTS=106253 CHECKS=15387600	SAT TT=0.284 ASSIGNMENTS=342 CHECKS=47964	? (TO) TT=1800.14	SAT TT=2.166	SAT TT=2.185
csp/pseudo/ logic-synthesis/ normalized-alu4-b.xml	SAT TT=1.435	SAT TT=5.374 CHECKS=57694 NODES=807	SAT TT=5.715 CHECKS=52487 NODES=0	SAT TT=2.161	SAT TT=5.172 CHECKS=182985	SAT TT=6.772 CHECKS=274766	SAT TT=4.413 ASSIGNMENTS=443	SAT TT=4.305 ASSIGNMENTS=773	SAT TT=139.052 CHECKS=54510 NODES=810	SAT TT=314.744 CHECKS=113288 NODES=0	SAT TT=336.322 CHECKS=113280 NODES=0	SAT TT=1.435 ASSIGNMENTS=442 CHECKS=938023	SAT TT=1.68 ASSIGNMENTS=442 CHECKS=938023	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=1.475 ASSIGNMENTS=442 CHECKS=938023	SAT TT=1.72 ASSIGNMENTS=745 CHECKS=1097510	SAT TT=7.32	SAT TT=2.113 ASSIGNMENTS=1104 CHECKS=1722680	SAT TT=1.764 ASSIGNMENTS=442 CHECKS=937460	? (TO) TT=1800.08	SAT TT=8.79	SAT TT=14.5
csp/pseudo/ logic-synthesis/ normalized-apex4-a.xml	SAT TT=2.072	SAT TT=9.502 CHECKS=50601 NODES=4316	SAT TT=12.755 CHECKS=65043 NODES=4316	SAT TT=4.343	SAT TT=32.517 CHECKS=265348	SAT TT=83.933 CHECKS=931077	SAT TT=16.285 ASSIGNMENTS=2403	SAT TT=101.263 ASSIGNMENTS=3981	SAT TT=171.956 CHECKS=74442 NODES=4323	SAT TT=448.745 CHECKS=203580 NODES=14	SAT TT=574.466 CHECKS=310988 NODES=11	SAT TT=2.072 ASSIGNMENTS=2377 CHECKS=795047	SAT TT=2.17 ASSIGNMENTS=2377 CHECKS=795047	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=2.245 ASSIGNMENTS=2377 CHECKS=795047	SAT TT=2.205 ASSIGNMENTS=3212 CHECKS=806602	SAT TT=93.027	SAT TT=2.888 ASSIGNMENTS=6051 CHECKS=1461360	SAT TT=2.251 ASSIGNMENTS=2384 CHECKS=795454	? (TO) TT=1800.11	SAT TT=9.87	SAT TT=11.987
csp/pseudo/ logic-synthesis/ normalized-bench1-pi.xml	SAT TT=0.37	SAT TT=6.556 CHECKS=16806 NODES=4676	SAT TT=6.343 CHECKS=15108 NODES=0	SAT TT=0.97	SAT TT=7.542 CHECKS=88905	SAT TT=7.273 CHECKS=58533	SAT TT=6.211 ASSIGNMENTS=4318	SAT TT=5.332 ASSIGNMENTS=4318	SAT TT=135.18 CHECKS=15774 NODES=4676	SAT TT=770.873 CHECKS=29554 NODES=1	SAT TT=961.015 CHECKS=29499 NODES=0	SAT TT=13.67 ASSIGNMENTS=4318	SAT TT=11.248 ASSIGNMENTS=4676 CHECKS=15686	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=5.717 ASSIGNMENTS=4286 CHECKS=292844	SAT TT=0.37 ASSIGNMENTS=1160 CHECKS=168646	SAT TT=1.95	SAT TT=13.686 ASSIGNMENTS=6658 CHECKS=482534	SAT TT=4.993 ASSIGNMENTS=4428 CHECKS=292751	? (TO) TT=1800.15	SAT TT=3.998	SAT TT=5.074
csp/pseudo/ logic-synthesis/ normalized-clip-b.xml	SAT TT=0.713	SAT TT=2.607 CHECKS=15723 NODES=349	SAT TT=2.737 CHECKS=13381 NODES=0	SAT TT=0.821	SAT TT=2.012 CHECKS=57986	SAT TT=2.419 CHECKS=77633	SAT TT=2.146 ASSIGNMENTS=217	SAT TT=2.18 ASSIGNMENTS=306	SAT TT=123.663 CHECKS=21489 NODES=350	SAT TT=76.775 CHECKS=45530 NODES=1	SAT TT=75.021 CHECKS=46777 NODES=1	SAT TT=0.872 ASSIGNMENTS=218 CHECKS=547935	SAT TT=0.866 ASSIGNMENTS=218 CHECKS=547935	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=0.845 ASSIGNMENTS=218 CHECKS=547935	SAT TT=0.763 ASSIGNMENTS=313 CHECKS=562889	SAT TT=2.006	SAT TT=0.713 ASSIGNMENTS=313 CHECKS=561647	SAT TT=0.737 ASSIGNMENTS=220 CHECKS=546847	? (TO) TT=1800.08	SAT TT=3.816	SAT TT=7.138
csp/pseudo/ logic-synthesis/ normalized-count-b.xml	SAT TT=0.74	SAT TT=3.201 CHECKS=16860 NODES=467	SAT TT=3.189 CHECKS=21823 NODES=0	SAT TT=1.04	SAT TT=2.134 CHECKS=94584	SAT TT=2.742 CHECKS=124431	SAT TT=2.162 ASSIGNMENTS=319	SAT TT=2.509 ASSIGNMENTS=446	SAT TT=128.307 CHECKS=21992 NODES=468	SAT TT=563.925 CHECKS=53996 NODES=0	SAT TT=568.243 CHECKS=57734 NODES=1	SAT TT=0.779 ASSIGNMENTS=313 CHECKS=518929	SAT TT=0.79 ASSIGNMENTS=313 CHECKS=518929	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=0.74 ASSIGNMENTS=313 CHECKS=518929	SAT TT=0.772 ASSIGNMENTS=415 CHECKS=530954	SAT TT=1.782	SAT TT=1.089 ASSIGNMENTS=652 CHECKS=854530	SAT TT=0.787 ASSIGNMENTS=318 CHECKS=564488	? (TO) TT=1800.1	SAT TT=4.492	SAT TT=7.726
csp/pseudo/ logic-synthesis/ normalized-e-am-pi.xml	SAT TT=1.977	SAT TT=7.427 CHECKS=18602 NODES=4676	SAT TT=6.254 CHECKS=18619 NODES=0	SAT TT=1.977	SAT TT=11.633 CHECKS=71293	SAT TT=10.275 CHECKS=71842	SAT TT=8.192 ASSIGNMENTS=4410	SAT TT=8.536 ASSIGNMENTS=4410	SAT TT=151.768 CHECKS=51022 NODES=4676	SAT TT=348.4 CHECKS=128986 NODES=0	SAT TT=295.467 CHECKS=128986 NODES=0	SAT TT=11.526 ASSIGNMENTS=4420 CHECKS=1789690	SAT TT=14.375 ASSIGNMENTS=4676 CHECKS=18409	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=2.402 ASSIGNMENTS=4414 CHECKS=1789700	SAT TT=2.635 ASSIGNMENTS=4554 CHECKS=1790230	SAT TT=3.493	SAT TT=2.171 ASSIGNMENTS=4520 CHECKS=1790110	SAT TT=2.749 ASSIGNMENTS=4420 CHECKS=1789690	? (TO) TT=1800.15	SAT TT=8.314	SAT TT=18.229
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ logic-synthesis/ normalized-ex5-pi.xml	SAT TT=2.653	SAT TT=7.273 CHECKS=34697 NODES=2459	SAT TT=6.598 CHECKS=26787 NODES=0	SAT TT=2.653	SAT TT=10.591 CHECKS=87846	SAT TT=10.263 CHECKS=86998	SAT TT=5.459 ASSIGNMENTS=2299	SAT TT=5.405 ASSIGNMENTS=2299	SAT TT=148.627 CHECKS=92258 NODES=2459	SAT TT=1008.2 CHECKS=121457 NODES=0	SAT TT=918.267 CHECKS=124842 NODES=1	SAT TT=13.828 ASSIGNMENTS=2306 CHECKS=2594730	SAT TT=15.092 ASSIGNMENTS=2459 CHECKS=34670	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=3.959 ASSIGNMENTS=2302 CHECKS=2594070	SAT TT=3.271 ASSIGNMENTS=2349 CHECKS=2594800	SAT TT=19.119	SAT TT=3.321 ASSIGNMENTS=2364 CHECKS=2591550	SAT TT=3.537 ASSIGNMENTS=2306 CHECKS=2594730	? (TO) TT=1800.13	SAT TT=11.341	SAT TT=26.354
csp/pseudo/ logic-synthesis/ normalized-f51m-b.xml	SAT TT=0.696	SAT TT=2.763 CHECKS=13302 NODES=406	SAT TT=2.842 CHECKS=16722 NODES=0	SAT TT=0.82	SAT TT=1.3 CHECKS=36109	SAT TT=1.499 CHECKS=43272	SAT TT=2.006 ASSIGNMENTS=158	SAT TT=2.437 ASSIGNMENTS=385	SAT TT=128.771 CHECKS=21160 NODES=407	SAT TT=75.179 CHECKS=41348 NODES=0	SAT TT=80.098 CHECKS=41346 NODES=0	SAT TT=0.718 ASSIGNMENTS=155 CHECKS=478880	SAT TT=0.714 ASSIGNMENTS=155 CHECKS=478880	? (TO) TT=1800.05	? (TO) TT=1800.01	SAT TT=0.7 ASSIGNMENTS=155 CHECKS=478880	SAT TT=0.758 ASSIGNMENTS=381 CHECKS=568577	SAT TT=2.14	SAT TT=0.7 ASSIGNMENTS=365 CHECKS=562472	SAT TT=0.696 ASSIGNMENTS=155 CHECKS=479221	? (TO) TT=1800.14	SAT TT=4.245	SAT TT=7.201
csp/pseudo/ logic-synthesis/ normalized-max1024-pi.xml	SAT TT=0.295	SAT TT=3.073 CHECKS=9830 NODES=1278	SAT TT=2.079 CHECKS=4324 NODES=0	SAT TT=0.541	SAT TT=0.387 CHECKS=22526	SAT TT=0.333 CHECKS=17711	SAT TT=2.053 ASSIGNMENTS=912	SAT TT=2.222 ASSIGNMENTS=912	SAT TT=9.631 CHECKS=15156 NODES=1278	SAT TT=5.841 CHECKS=24662 NODES=5	SAT TT=6.181 CHECKS=25119 NODES=1	SAT TT=0.528 ASSIGNMENTS=922 CHECKS=61434	SAT TT=0.505 ASSIGNMENTS=922 CHECKS=61434	SAT TT=6.053	SAT TT=7.062	SAT TT=0.419 ASSIGNMENTS=922 CHECKS=61434	SAT TT=0.295 ASSIGNMENTS=1213 CHECKS=152504	SAT TT=1.553	SAT TT=26.63 ASSIGNMENTS=23180 CHECKS=2911850	SAT TT=0.537 ASSIGNMENTS=918 CHECKS=61401	SAT TT=34.977	SAT TT=2.889	SAT TT=2.646
csp/pseudo/ logic-synthesis/ normalized-prom2-pi.xml	SAT TT=0.485	SAT TT=3.756 CHECKS=34835 NODES=2617	SAT TT=3.643 CHECKS=12253 NODES=0	SAT TT=1.11	SAT TT=2.3 CHECKS=37165	SAT TT=2.13 CHECKS=37018	SAT TT=4.059 ASSIGNMENTS=1978	SAT TT=8.107 ASSIGNMENTS=2207	SAT TT=132.285 CHECKS=35952 NODES=2617	SAT TT=142.015 CHECKS=52404 NODES=11	SAT TT=124.545 CHECKS=68090 NODES=11	SAT TT=0.545 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=0.51 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=1222.31	SAT TT=1269.83	SAT TT=0.566 ASSIGNMENTS=1990 CHECKS=166534	SAT TT=0.527 ASSIGNMENTS=2158 CHECKS=166853	SAT TT=2.507	SAT TT=0.485 ASSIGNMENTS=2148 CHECKS=166856	SAT TT=0.499 ASSIGNMENTS=1986 CHECKS=166402	? (TO) TT=1800.07	SAT TT=4.753	SAT TT=5.8
csp/pseudo/ logic-synthesis/ normalized-rot-b.xml	SAT TT=1.555	SAT TT=6.263 CHECKS=58091 NODES=1451	SAT TT=7.501 CHECKS=80442 NODES=1451	SAT TT=2.387	SAT TT=8.973 CHECKS=291760	SAT TT=10.412 CHECKS=293068	SAT TT=5.204 ASSIGNMENTS=970	SAT TT=6.601 ASSIGNMENTS=1321	SAT TT=130.813 CHECKS=57157 NODES=1454	SAT TT=451.87 CHECKS=129137 NODES=2	SAT TT=455.203 CHECKS=136745 NODES=3	SAT TT=1.633 ASSIGNMENTS=978 CHECKS=910309	SAT TT=1.6 ASSIGNMENTS=978 CHECKS=910309	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=1.633 ASSIGNMENTS=978 CHECKS=910309	SAT TT=1.555 ASSIGNMENTS=1289 CHECKS=925883	SAT TT=8.929	SAT TT=2.898 ASSIGNMENTS=3808 CHECKS=2613260	SAT TT=1.655 ASSIGNMENTS=970 CHECKS=910296	? (TO) TT=1800.11	SAT TT=9.25	SAT TT=15.271
csp/pseudo/ logic-synthesis/ normalized-sao2-b.xml	SAT TT=0.465	SAT TT=2.787 CHECKS=26899 NODES=372	SAT TT=2.933 CHECKS=37190 NODES=372	SAT TT=0.795	SAT TT=0.644 CHECKS=28378	SAT TT=0.743 CHECKS=37262	SAT TT=2.448 ASSIGNMENTS=163	SAT TT=2.13 ASSIGNMENTS=358	SAT TT=128.827 CHECKS=19381 NODES=373	SAT TT=182.168 CHECKS=40254 NODES=0	SAT TT=177.589 CHECKS=40279 NODES=0	SAT TT=0.527 ASSIGNMENTS=162 CHECKS=275577	SAT TT=0.474 ASSIGNMENTS=162 CHECKS=275577	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=0.465 ASSIGNMENTS=162 CHECKS=275577	SAT TT=0.644 ASSIGNMENTS=338 CHECKS=365000	SAT TT=1.807	SAT TT=0.673 ASSIGNMENTS=449 CHECKS=475534	SAT TT=0.509 ASSIGNMENTS=163 CHECKS=276049	? (TO) TT=1800.08	SAT TT=4.289	SAT TT=5.75
csp/pseudo/mps/ normalized-mps-10teams.xml	SAT TT=6.266	? (TO) TT=1800.07	? (TO) TT=1800.15	SAT TT=7.481	SAT TT=1224.27 CHECKS=7024600	? (TO) TT=1800.03	SAT TT=13.293 ASSIGNMENTS=413	SAT TT=13.206 ASSIGNMENTS=403	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=19.813 ASSIGNMENTS=413	SAT TT=1605.46 ASSIGNMENTS=413	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=563.688 ASSIGNMENTS=91810 CHECKS=485503000	? (TO) TT=1800.08	SAT TT=57.405	SAT TT=866.813 ASSIGNMENTS=105160 CHECKS=700807000	SAT TT=528.981 ASSIGNMENTS=69460 CHECKS=398790000	? (TO) TT=1800.13	SAT TT=8.774	SAT TT=6.266
csp/pseudo/mps/ normalized-mps-air01.xml	SAT TT=0.975	SAT TT=4.413 CHECKS=48393 NODES=784	SAT TT=5.047 CHECKS=114850 NODES=1417	SAT TT=0.975	SAT TT=39.604 CHECKS=36496	SAT TT=5.566 CHECKS=4864	SAT TT=5.223 ASSIGNMENTS=374	SAT TT=5.683 ASSIGNMENTS=219	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	SAT TT=9.833 ASSIGNMENTS=724 CHECKS=1286420	SAT TT=12.337 ASSIGNMENTS=784 CHECKS=48393	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=3.234 ASSIGNMENTS=866 CHECKS=4026810	SAT TT=6.25 ASSIGNMENTS=3702 CHECKS=8587800	SAT TT=3.509	SAT TT=4.056 ASSIGNMENTS=1828 CHECKS=6244830	SAT TT=1.711 ASSIGNMENTS=724 CHECKS=1286420	? TT=1680.71	SAT TT=4.926	SAT TT=10.945
csp/pseudo/mps/ normalized-mps-air02.xml	SAT TT=33.176	? TT=78.573	? TT=70.217	SAT TT=33.176	Signal TT=13.116	Signal TT=14.099	? (problem) TT=53.27	? (problem) TT=50.585	? TT=0.652	? TT=0.694	? TT=0.695	? (MO) TT=227.4	? (MO) TT=242.07	? (problem) TT=38.889	? (problem) TT=41.385	Signal TT=109.874	Signal TT=115.808	? (exit code) TT=202.793	SAT TT=174.206 ASSIGNMENTS=2960 CHECKS=143411000	Signal TT=107.316	? (TO) TT=1800.24	? (MO) TT=133.147	? (MO) TT=344.443
csp/pseudo/mps/ normalized-mps-air03.xml	SAT TT=51.237	? TT=102.88	? TT=110.348	SAT TT=51.237	Signal TT=13.606	Signal TT=14.332	? (problem) TT=60.625	? (problem) TT=65.132	? TT=1.259	? TT=1.178	? TT=1.504	? (MO) TT=324.09	? (MO) TT=317.37	? (problem) TT=56.809	? (problem) TT=60.952	Signal TT=133.986	Signal TT=180.765	? (exit code) TT=285.484	SAT TT=211.219 ASSIGNMENTS=2978 CHECKS=161318000	Signal TT=142.895	? (TO) TT=1800.09	? (MO) TT=204.502	? (MO) TT=386.423
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mps/ normalized-mps-air05.xml	SAT TT=46.035	? (TO) TT=1800.2	? (TO) TT=1800.19	SAT TT=902.087	SAT TT=393.723 CHECKS=314931	SAT TT=169.741 CHECKS=133562	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.04	? TT=190.769 CHECKS=51193 NODES=0	? TT=195.738 CHECKS=51185 NODES=0	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.12	? TT=300.482	SAT TT=46.035	SAT TT=102.116
csp/pseudo/mps/ normalized-mps-air06.xml	SAT TT=912.34	? (TO) TT=1800.21	? (TO) TT=1800.09	SAT TT=912.34	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=233.923 CHECKS=2166780 NODES=0	? TT=225.272 CHECKS=2166740 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.16	? TT=515.17	? (TO) TT=1800.12	? (TO) TT=1800.06
csp/pseudo/mps/ normalized-mps-bm23.xml	SAT TT=0.053	SAT TT=18.278 CHECKS=7659260 NODES=181	SAT TT=41.982 CHECKS=18496700 NODES=202	SAT TT=0.069	SAT TT=0.128 CHECKS=1524	SAT TT=0.13 CHECKS=1512	SAT TT=0.656 ASSIGNMENTS=29	SAT TT=0.87 ASSIGNMENTS=188	SAT TT=131.906 CHECKS=790925 NODES=93	SAT TT=139.59 CHECKS=120578 NODES=600025	SAT TT=129.564 CHECKS=117528 NODES=7	SAT TT=0.082 ASSIGNMENTS=61 CHECKS=85446	SAT TT=0.08 ASSIGNMENTS=61 CHECKS=85446	? (problem) TT=38.057	? (problem) TT=37.496	SAT TT=0.064 ASSIGNMENTS=50 CHECKS=72707	SAT TT=0.288 ASSIGNMENTS=436 CHECKS=465635	SAT TT=0.501	SAT TT=48.097 ASSIGNMENTS=38426 CHECKS=25142200	SAT TT=0.053 ASSIGNMENTS=29 CHECKS=46196	? TT=480.457	SAT TT=1.602	SAT TT=2.527
csp/pseudo/mps/ normalized-mps-l152lav.xml		? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? TT=0.413	? TT=0.423	? TT=0.428	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=11.019	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=312.093	? (TO) TT=1800.18	? (TO) TT=1800.09
csp/pseudo/mps/ normalized-mps-mitre.xml	SAT TT=1598.68	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1598.68	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=1205.44	? (TO) TT=1800.12	? (TO) TT=1800.04	? TT=235.746	? TT=174.062	? TT=169.608
csp/pseudo/mps/ normalized-mps-mzzv11.xml	SAT TT=7.263	? (TO) TT=1800.24	SAT TT=323.987 CHECKS=108458000 NODES=0	SAT TT=14.596	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=43.82 ASSIGNMENTS=2919	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=19.478 ASSIGNMENTS=3611 CHECKS=1266060	SAT TT=1104.74 ASSIGNMENTS=3611 CHECKS=1266060	? (problem) TT=209.161	? (problem) TT=197.863	SAT TT=7.431 ASSIGNMENTS=3600 CHECKS=1266010	SAT TT=7.975 ASSIGNMENTS=4513 CHECKS=1915370	SAT TT=31.594	SAT TT=66.896 ASSIGNMENTS=25378 CHECKS=25954300	SAT TT=7.263 ASSIGNMENTS=3611 CHECKS=1266060	? TT=219.312	? (MO) TT=80.546	? (MO) TT=269.523
csp/pseudo/mps/ normalized-mps-neos5.xml	SAT TT=0.426	SAT TT=2.459 CHECKS=124363 NODES=163	SAT TT=14.042 CHECKS=2252970 NODES=0	SAT TT=0.426	SAT TT=8.603 CHECKS=12823	SAT TT=8.846 CHECKS=12282	SAT TT=1.442 ASSIGNMENTS=145	SAT TT=1.505 ASSIGNMENTS=145	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=0.626 ASSIGNMENTS=145 CHECKS=627292	SAT TT=0.627 ASSIGNMENTS=145 CHECKS=627292	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=0.614 ASSIGNMENTS=145 CHECKS=627292	SAT TT=2.422 ASSIGNMENTS=764 CHECKS=3287350	SAT TT=1.452	? (TO) TT=1800.09	SAT TT=0.614 ASSIGNMENTS=144 CHECKS=623010	? (TO) TT=1800.15	? TT=220.732	? TT=218.814
csp/pseudo/mps/ normalized-mps-opt1217.xml	SAT TT=0.137	SAT TT=1.796 CHECKS=3116 NODES=787	SAT TT=1.422 CHECKS=3316 NODES=0	SAT TT=0.277	SAT TT=3.116 CHECKS=12385	SAT TT=4.013 CHECKS=15086	SAT TT=1.574 ASSIGNMENTS=738	SAT TT=1.922 ASSIGNMENTS=721	SAT TT=780.999 CHECKS=806636000 NODES=787	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=0.187 ASSIGNMENTS=738 CHECKS=85373	SAT TT=0.163 ASSIGNMENTS=738 CHECKS=85373	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.178 ASSIGNMENTS=738 CHECKS=85373	SAT TT=0.137 ASSIGNMENTS=133 CHECKS=83899	SAT TT=1.224	SAT TT=0.17 ASSIGNMENTS=504 CHECKS=82796	SAT TT=0.178 ASSIGNMENTS=738 CHECKS=85373	? (TO) TT=1800.23	? TT=200.637	? TT=191.939
csp/pseudo/mps/ normalized-mps-p0282.xml	SAT TT=0.07	SAT TT=54.075 CHECKS=22091000 NODES=284	SAT TT=147.706 CHECKS=42640500 NODES=0	SAT TT=0.169	SAT TT=0.613 CHECKS=11903	SAT TT=0.611 CHECKS=12400	SAT TT=1.296 ASSIGNMENTS=221	SAT TT=1.171 ASSIGNMENTS=266	SAT TT=124.648 CHECKS=3573950 NODES=282	SAT TT=250.547 CHECKS=2506190 NODES=13	SAT TT=261.429 CHECKS=3403180 NODES=49	SAT TT=0.082 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.084 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=79.221	? (problem) TT=72.285	SAT TT=0.074 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.073 ASSIGNMENTS=133 CHECKS=39479	SAT TT=0.837	SAT TT=0.07 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.071 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1801.37	SAT TT=36.761	SAT TT=159.111
csp/pseudo/mps/ normalized-mps-p0291.xml	SAT TT=0.036	SAT TT=14.597 CHECKS=3270560 NODES=291	SAT TT=52.658 CHECKS=12747000 NODES=0	SAT TT=0.106	SAT TT=0.728 CHECKS=18263	SAT TT=0.659 CHECKS=16522	SAT TT=1.038 ASSIGNMENTS=274	SAT TT=1.245 ASSIGNMENTS=115	? (TO) TT=1800	SAT TT=40.551 CHECKS=5933 NODES=11	SAT TT=40.363 CHECKS=9690 NODES=15	SAT TT=0.053 ASSIGNMENTS=274 CHECKS=19556	SAT TT=0.051 ASSIGNMENTS=274 CHECKS=19556	? (MO) TT=1476.11	? (MO) TT=1465.58	SAT TT=0.04 ASSIGNMENTS=274 CHECKS=19556	SAT TT=0.036 ASSIGNMENTS=122 CHECKS=13175	SAT TT=0.829	SAT TT=0.038 ASSIGNMENTS=192 CHECKS=9930	SAT TT=0.041 ASSIGNMENTS=278 CHECKS=19833	? (TO) TT=1800.16	SAT TT=11.746	SAT TT=47.864
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mps/ normalized-mps-p0548.xml	SAT TT=0.097	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=3.476 CHECKS=16160	SAT TT=3.503 CHECKS=17109	SAT TT=1.311 ASSIGNMENTS=389	SAT TT=2.316 ASSIGNMENTS=2810	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=0.109 ASSIGNMENTS=382 CHECKS=54026	SAT TT=0.11 ASSIGNMENTS=382 CHECKS=54026	? (MO) TT=27.01	? (MO) TT=24.38	SAT TT=0.097 ASSIGNMENTS=384 CHECKS=53525	? (TO) TT=1800.09	SAT TT=1.277	? (TO) TT=1800.04	SAT TT=0.255 ASSIGNMENTS=971 CHECKS=371348	? TT=410.431	? TT=165.183	? TT=172.715
csp/pseudo/mps/ normalized-mps-seymour.xml	SAT TT=0.9	SAT TT=10.219 CHECKS=27824 NODES=1372	SAT TT=5.339 CHECKS=15815 NODES=0	SAT TT=2.125	SAT TT=2.033 CHECKS=181757	SAT TT=1.856 CHECKS=184204	SAT TT=4.816 ASSIGNMENTS=792	SAT TT=5.198 ASSIGNMENTS=792	SAT TT=14.75 CHECKS=86280 NODES=1372	SAT TT=7.577 CHECKS=116673 NODES=3	SAT TT=7.364 CHECKS=132767 NODES=4	SAT TT=0.946 ASSIGNMENTS=801 CHECKS=293943	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293943	SAT TT=16.69	SAT TT=21.279	SAT TT=0.928 ASSIGNMENTS=801 CHECKS=293943	SAT TT=0.915 ASSIGNMENTS=893 CHECKS=294998	SAT TT=16.128	SAT TT=0.9 ASSIGNMENTS=876 CHECKS=295079	SAT TT=0.922 ASSIGNMENTS=803 CHECKS=293957	SAT TT=56.852	SAT TT=7.394	SAT TT=8.315
csp/pseudo/mps/ normalized-mps-stein27.xml	SAT TT=0.012	SAT TT=0.942 CHECKS=1864 NODES=27	SAT TT=0.883 CHECKS=3714 NODES=0	SAT TT=0.05	SAT TT=0.039 CHECKS=7897	SAT TT=0.026 CHECKS=7133	SAT TT=0.701 ASSIGNMENTS=9	SAT TT=0.666 ASSIGNMENTS=9	SAT TT=74.718 CHECKS=277484 NODES=27	SAT TT=14.306 CHECKS=165499 NODES=0	SAT TT=14.338 CHECKS=165467 NODES=0	SAT TT=0.024 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.025 ASSIGNMENTS=8 CHECKS=1620	? (MO) TT=38.08	? (MO) TT=38.27	SAT TT=0.012 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.013 ASSIGNMENTS=6 CHECKS=1590	SAT TT=0.421	SAT TT=0.015 ASSIGNMENTS=8 CHECKS=1631	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1593	? TT=1091.71	SAT TT=0.649	SAT TT=0.687
csp/pseudo/mps/ normalized-mps-stein9.xml	SAT TT=0.006	SAT TT=0.708 CHECKS=61 NODES=9	SAT TT=0.67 CHECKS=68 NODES=0	SAT TT=0.026	SAT TT=0.007 CHECKS=342	SAT TT=0.012 CHECKS=946	SAT TT=0.498 ASSIGNMENTS=5	SAT TT=0.476 ASSIGNMENTS=5	SAT TT=0.475 CHECKS=186 NODES=9	SAT TT=0.435 CHECKS=277 NODES=0	SAT TT=0.46 CHECKS=275 NODES=0	SAT TT=0.019 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.018 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.958	SAT TT=1.242	SAT TT=0.006 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=183	SAT TT=0.276	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.007 ASSIGNMENTS=4 CHECKS=186	SAT TT=0.988	SAT TT=0.485	SAT TT=0.51
csp/pseudo/mps/ normalized-mps-vpm2.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.12	? (MO) TT=1428.96	? (MO) TT=1422.49	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=1732.42	? TT=149.051	? TT=143.138
csp/pseudo/mpsReduced/ normalized-mps-red-afiro.xml	SAT TT=2.419	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=1679.15	SAT TT=1059.91 CHECKS=1127600	SAT TT=72.893 CHECKS=88785	SAT TT=3.26 ASSIGNMENTS=4152	SAT TT=2.419 ASSIGNMENTS=1185	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=12.857 ASSIGNMENTS=7661 CHECKS=11010100	SAT TT=1254.63 ASSIGNMENTS=7661 CHECKS=11010100	? (MO) TT=232.41	? (MO) TT=229.28	SAT TT=2.592 ASSIGNMENTS=9210 CHECKS=4777940	SAT TT=5.396 ASSIGNMENTS=14673 CHECKS=11742200	SAT TT=20.733	? (TO) TT=1800.03	SAT TT=5.35 ASSIGNMENTS=7661 CHECKS=11010100	? (TO) TT=1802.2	SAT TT=42.305	SAT TT=198.856
csp/pseudo/mpsReduced/ normalized-mps-red-agg3.xml	SAT TT=18.197	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=18.197	? (TO) TT=1800.13	? (TO) TT=1800.21	SAT TT=62.033 ASSIGNMENTS=7209	? (TO) TT=1800.14	? TT=0.907	? TT=1.058	? TT=0.898	SAT TT=793.552 ASSIGNMENTS=7209	SAT TT=1729.36 ASSIGNMENTS=7209	? (MO) TT=154.97	? (MO) TT=155.59	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=44.401	? (TO) TT=1800.12	? (TO) TT=1800.14	? TT=234.481	? TT=153.627	? TT=147.522
csp/pseudo/mpsReduced/ normalized-mps-red-agg.xml	SAT TT=1479.2	? (TO) TT=1800.06	? (TO) TT=1800.19	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	SAT TT=141.404 ASSIGNMENTS=102049	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800	SAT TT=1479.2 ASSIGNMENTS=102049	? (MO) TT=117.55	? (MO) TT=117.94	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.13	? TT=237.629	? TT=158.975	? TT=161.948
csp/pseudo/mpsReduced/ normalized-mps-red-air01.xml	SAT TT=0.972	SAT TT=4.383 CHECKS=48393 NODES=784	SAT TT=5.03 CHECKS=114850 NODES=1417	SAT TT=0.972	SAT TT=42.169 CHECKS=37578	SAT TT=6.311 CHECKS=5059	SAT TT=5.245 ASSIGNMENTS=374	SAT TT=5.477 ASSIGNMENTS=219	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=10.278 ASSIGNMENTS=724 CHECKS=1286420	SAT TT=12.309 ASSIGNMENTS=784 CHECKS=48393	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=3.187 ASSIGNMENTS=866 CHECKS=4026810	SAT TT=13.581 ASSIGNMENTS=7867 CHECKS=21503600	SAT TT=3.296	SAT TT=3.676 ASSIGNMENTS=1828 CHECKS=6244830	SAT TT=1.692 ASSIGNMENTS=724 CHECKS=1286420	? TT=1578.44	SAT TT=4.555	SAT TT=10.938
csp/pseudo/mpsReduced/ normalized-mps-red-air03.xml	SAT TT=48.271	? TT=110.398	? TT=110.616	SAT TT=48.271	Signal TT=12.54	Signal TT=13.569	? (problem) TT=65.158	? (problem) TT=60.638	? TT=1.206	? TT=1.143	? TT=1.402	? (MO) TT=302.74	? (MO) TT=307.37	? (problem) TT=56.993	? (problem) TT=62.244	Signal TT=138.532	Signal TT=285.352	? (exit code) TT=295.178	SAT TT=203.283 ASSIGNMENTS=2978 CHECKS=161318000	Signal TT=138.98	? (TO) TT=1800.1	? (MO) TT=194.775	? (MO) TT=408.775
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-bandm.xml	UNSAT TT=21.105	? (TO) TT=1800.21	? (TO) TT=1800.22	UNSAT TT=21.105	Signal TT=14.018	Signal TT=14.019	UNSAT TT=114.31 ASSIGNMENTS=0	UNSAT TT=101.17 ASSIGNMENTS=0	? TT=0.87	? TT=0.949	? TT=0.717	UNSAT TT=108.4 ASSIGNMENTS=49 CHECKS=25473600	UNSAT TT=1468.6 ASSIGNMENTS=49 CHECKS=25473600	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=50.685 ASSIGNMENTS=24 CHECKS=24615600	UNSAT TT=632.021 ASSIGNMENTS=226086 CHECKS=725820000	? (exit code) TT=104.874	UNSAT TT=68.545 ASSIGNMENTS=3132 CHECKS=46213100	UNSAT TT=51.693 ASSIGNMENTS=49 CHECKS=25473600	? (TO) TT=1800.08	? TT=449.466	? TT=430.444
csp/pseudo/mpsReduced/ normalized-mps-red-beaconfd.xml	SAT TT=73.052	? TT=2.874	? TT=3.163	SAT TT=73.052	Signal TT=14.504	Signal TT=14.235	? (problem) TT=2.291	? (problem) TT=2.555	? TT=0.672	? TT=0.52	? TT=0.67	? (MO) TT=802.83	? (MO) TT=794.9	? (problem) TT=2.045	? (problem) TT=2.05	Signal TT=272.803	? (MO) TT=819.844	? (exit code) TT=540.097	Signal TT=593.244	Signal TT=652.733	? TT=199.974	? TT=248.779	? TT=301.993
csp/pseudo/mpsReduced/ normalized-mps-red-bell3a.xml	SAT TT=0.485	? (TO) TT=1800.19	? (TO) TT=1800.27	? (TO) TT=1800.02	SAT TT=31.81 CHECKS=131276	SAT TT=22.222 CHECKS=77469	SAT TT=3.443 ASSIGNMENTS=3372	SAT TT=10.285 ASSIGNMENTS=6678	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=8.153 ASSIGNMENTS=1169 CHECKS=289654	SAT TT=1250.44 ASSIGNMENTS=1169 CHECKS=289654	? (MO) TT=537.99	? (MO) TT=494.37	? (TO) TT=1800.11	SAT TT=1.029 ASSIGNMENTS=4512 CHECKS=1626570	? (TO) TT=1800.06	SAT TT=302.715 ASSIGNMENTS=833196 CHECKS=289974000	SAT TT=0.485 ASSIGNMENTS=1169 CHECKS=289654	? (TO) TT=1800.13	? TT=221.264	? TT=239.706
csp/pseudo/mpsReduced/ normalized-mps-red-berlin-5-8_0.xml	SAT TT=5.005	? (TO) TT=1800.18	? (TO) TT=1800.11	SAT TT=900.454	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=17.28 ASSIGNMENTS=4928	SAT TT=95.596 ASSIGNMENTS=4288	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=14.181 ASSIGNMENTS=4599 CHECKS=4325660	SAT TT=1419.32 ASSIGNMENTS=4599 CHECKS=4325660	? (MO) TT=579.96	? (MO) TT=607.66	? (TO) TT=1800.06	SAT TT=5.087 ASSIGNMENTS=5216 CHECKS=4546580	? (TO) TT=1800.02	SAT TT=15.097 ASSIGNMENTS=18701 CHECKS=13020400	SAT TT=5.005 ASSIGNMENTS=4599 CHECKS=4325660	? (TO) TT=1801.57	? TT=143.6	? TT=152.077
csp/pseudo/mpsReduced/ normalized-mps-red-blend.xml	UNSAT TT=2.462	? (TO) TT=1800.07	? (TO) TT=1800.15	UNSAT TT=2.462	UNSAT TT=113.53 CHECKS=11528	UNSAT TT=86.548 CHECKS=8647	UNSAT TT=22.28 ASSIGNMENTS=0	UNSAT TT=23.238 ASSIGNMENTS=0	? TT=0.653	? TT=0.652	? TT=0.62	UNSAT TT=30.582 ASSIGNMENTS=0	UNSAT TT=1062.64 ASSIGNMENTS=3625 CHECKS=51568400	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=7.043 ASSIGNMENTS=707 CHECKS=10691500	UNSAT TT=96.859 ASSIGNMENTS=123863 CHECKS=132840000	UNSAT TT=696.233	UNSAT TT=18.845 ASSIGNMENTS=6079 CHECKS=37485300	UNSAT TT=28.478 ASSIGNMENTS=3625 CHECKS=51568400	? (TO) TT=1800.12	? TT=422.801	? TT=413.084
csp/pseudo/mpsReduced/ normalized-mps-red-egout.xml	UNSAT TT=3.322	UNSAT TT=650.846 CHECKS=51621000 NODES=3119	UNSAT TT=866.605 CHECKS=68554800 NODES=3153	? (TO) TT=1800.03	UNSAT TT=16.145 CHECKS=13989	? (TO) TT=1800.04	UNSAT TT=3.139 ASSIGNMENTS=0	UNSAT TT=3.322 ASSIGNMENTS=0	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=11.424 ASSIGNMENTS=3342 CHECKS=3401380	UNSAT TT=621.558 ASSIGNMENTS=3119 CHECKS=51621000	? (TO) TT=1800.04	? (TO) TT=1800.02	UNSAT TT=8.168 ASSIGNMENTS=10905 CHECKS=6502830	UNSAT TT=7.923 ASSIGNMENTS=9669 CHECKS=10692300	UNSAT TT=88.215	UNSAT TT=270.572 ASSIGNMENTS=262694 CHECKS=154697000	UNSAT TT=4.039 ASSIGNMENTS=3342 CHECKS=3401380	? TT=298.191	UNSAT TT=4.248	UNSAT TT=8.66
csp/pseudo/mpsReduced/ normalized-mps-red-fiber.xml	SAT TT=30.47	SAT TT=175.287 CHECKS=21022700 NODES=5416	SAT TT=191.845 CHECKS=21396700 NODES=3237	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=10.564 ASSIGNMENTS=29319	SAT TT=30.47 ASSIGNMENTS=31271	SAT TT=186.977 CHECKS=59048600 NODES=5701	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=1693.8 ASSIGNMENTS=29319	? (MO) TT=154.4	? (MO) TT=153.41	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=37.359	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1802.12	? (MO) TT=83.658	? (MO) TT=285.83
csp/pseudo/mpsReduced/ normalized-mps-red-flugpl.xml	SAT TT=1.526	SAT TT=20.658 CHECKS=5302800 NODES=265	SAT TT=10.34 CHECKS=2493400 NODES=0	SAT TT=3.916	SAT TT=4.168 CHECKS=78985	SAT TT=5.322 CHECKS=101816	SAT TT=1.213 ASSIGNMENTS=2523	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=9.704 ASSIGNMENTS=12564 CHECKS=4357580	SAT TT=27.363 ASSIGNMENTS=265 CHECKS=5302800	? (MO) TT=126.36	? (MO) TT=126.15	SAT TT=3.201 ASSIGNMENTS=14937 CHECKS=6288580	SAT TT=1.526 ASSIGNMENTS=11249 CHECKS=3010990	SAT TT=0.957	? (TO) TT=1800.06	SAT TT=2.246 ASSIGNMENTS=12564 CHECKS=4357580	? TT=601.587	? (MO) TT=92.19	? (MO) TT=299.048
csp/pseudo/mpsReduced/ normalized-mps-red-gr4x6.xml	UNSAT TT=1562.29	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	UNSAT TT=1660.67 CHECKS=1732750	UNSAT TT=1562.29 CHECKS=2015800	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/pseudo/mpsReduced/ normalized-mps-red-markshare2-1.xml	SAT TT=0.236	SAT TT=153.348 CHECKS=7590860 NODES=330	SAT TT=171.614 CHECKS=8639440 NODES=0	SAT TT=0.236	SAT TT=10.138 CHECKS=6950	SAT TT=9.163 CHECKS=6400	SAT TT=1.462 ASSIGNMENTS=199	SAT TT=2.879 ASSIGNMENTS=3158	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=0.359 ASSIGNMENTS=193 CHECKS=327075	SAT TT=0.356 ASSIGNMENTS=193 CHECKS=327075	? (MO) TT=120.28	? (MO) TT=119.31	SAT TT=0.336 ASSIGNMENTS=193 CHECKS=327075	SAT TT=12.464 ASSIGNMENTS=8980 CHECKS=24590900	SAT TT=4.395	SAT TT=45.67 ASSIGNMENTS=48949 CHECKS=75524800	SAT TT=0.368 ASSIGNMENTS=203 CHECKS=328221	? TT=338.429	? (MO) TT=91.71	? (MO) TT=298.381
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/mpsReduced/ normalized-mps-red-misc03.xml	SAT TT=1.592	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=38.677	SAT TT=15.145 CHECKS=67630	SAT TT=8.398 CHECKS=41579	SAT TT=1.199 ASSIGNMENTS=374	SAT TT=4.403 ASSIGNMENTS=18864	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=405.419 ASSIGNMENTS=739 CHECKS=1995020	SAT TT=459.475 ASSIGNMENTS=739 CHECKS=1995020	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=10.56 ASSIGNMENTS=4042 CHECKS=14280500	SAT TT=10.009 ASSIGNMENTS=6291 CHECKS=14211700	SAT TT=3.034	SAT TT=3.126 ASSIGNMENTS=1204 CHECKS=4475840	SAT TT=1.592 ASSIGNMENTS=739 CHECKS=1995020	? TT=253.507	? TT=229.072	? TT=203.201
csp/pseudo/mpsReduced/ normalized-mps-red-p0282.xml	SAT TT=0.064	SAT TT=54.257 CHECKS=22091000 NODES=284	SAT TT=139.239 CHECKS=42640500 NODES=0	SAT TT=0.166	SAT TT=0.574 CHECKS=12253	SAT TT=0.59 CHECKS=12859	SAT TT=1.22 ASSIGNMENTS=221	SAT TT=1.368 ASSIGNMENTS=266	SAT TT=131.655 CHECKS=3574300 NODES=282	SAT TT=239.739 CHECKS=2505840 NODES=14	SAT TT=256.452 CHECKS=2956720 NODES=20	SAT TT=0.08 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.078 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=73.758	? (problem) TT=75.673	SAT TT=0.068 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.064 ASSIGNMENTS=133 CHECKS=40840	SAT TT=0.979	SAT TT=0.067 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.071 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1801.47	SAT TT=36.177	SAT TT=146.682
csp/pseudo/mpsReduced/ normalized-mps-red-pk1.xml	SAT TT=0.484	? (TO) TT=1800.06	? (TO) TT=1800.16	SAT TT=0.521	? (TO) TT=1800.1	SAT TT=122.784 CHECKS=187313	SAT TT=1.981 ASSIGNMENTS=690	SAT TT=6.342 ASSIGNMENTS=19099	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=8.737 ASSIGNMENTS=690	SAT TT=8.44 ASSIGNMENTS=246 CHECKS=446702	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1.654	? (TO) TT=1800.05	SAT TT=0.484 ASSIGNMENTS=246 CHECKS=446702	? (TO) TT=1800.1	? TT=148.2	? TT=148.264
csp/pseudo/mpsReduced/ normalized-mps-red-ran10x10b.xml	SAT TT=1.359	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=1.359	SAT TT=53.791 CHECKS=21423	SAT TT=57.726 CHECKS=24249	SAT TT=43.759 ASSIGNMENTS=3171	SAT TT=45.097 ASSIGNMENTS=833	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=10.122 ASSIGNMENTS=1424 CHECKS=524730	SAT TT=1090.37 ASSIGNMENTS=1424 CHECKS=524730	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=83.576 ASSIGNMENTS=42072 CHECKS=139280000	SAT TT=3.563 ASSIGNMENTS=2012 CHECKS=6083780	SAT TT=691.709	SAT TT=5.719 ASSIGNMENTS=1130 CHECKS=7461970	SAT TT=1.739 ASSIGNMENTS=1424 CHECKS=524730	? (TO) TT=1800.31	SAT TT=4.77	SAT TT=7.749
csp/pseudo/mpsReduced/ normalized-mps-red-ran14x18.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.06	? TT=37.467 CHECKS=4275050 NODES=0	? TT=40.333 CHECKS=4275050 NODES=0	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1802.14	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/pseudo/mpsReduced/ normalized-mps-red-ran16x16.xml	SAT TT=1.757	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=3.45	SAT TT=60.886 CHECKS=4834	SAT TT=58.629 CHECKS=4556	SAT TT=88.468 ASSIGNMENTS=3739	SAT TT=85.826 ASSIGNMENTS=2088	? (TO) TT=1800.01	? TT=39.466 CHECKS=3254050 NODES=0	? TT=39.897 CHECKS=3254050 NODES=0	SAT TT=1.757 ASSIGNMENTS=3545 CHECKS=2136710	SAT TT=1.862 ASSIGNMENTS=3545 CHECKS=2136710	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=1.846 ASSIGNMENTS=3545 CHECKS=2136710	SAT TT=106.889 ASSIGNMENTS=240474 CHECKS=158768000	? (TO) TT=1800.08	SAT TT=1.907 ASSIGNMENTS=3495 CHECKS=2135200	SAT TT=2.38 ASSIGNMENTS=3774 CHECKS=2136030	? TT=431.907	SAT TT=11.169	SAT TT=22.046
csp/pseudo/mpsReduced/ normalized-mps-red-sample2.xml	UNSAT TT=11.859	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=13.829 CHECKS=23622	UNSAT TT=11.859 CHECKS=26584	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=1071.58 ASSIGNMENTS=865701 CHECKS=1034350000	? (TO) TT=1800.12	UNSAT TT=233.564 ASSIGNMENTS=275425 CHECKS=135550000	UNSAT TT=562.817 ASSIGNMENTS=478493 CHECKS=568487000	? (TO) TT=1800.2	? (MO) TT=81.91	? (MO) TT=284.27
csp/pseudo/mpsReduced/ normalized-mps-red-share2b.xml	UNSAT TT=12.69	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.11	UNSAT TT=333.675 CHECKS=88439	UNSAT TT=402.188 CHECKS=121378	UNSAT TT=9.878 ASSIGNMENTS=0	UNSAT TT=13.775 ASSIGNMENTS=0	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=37.998 ASSIGNMENTS=6486 CHECKS=54297400	UNSAT TT=1280.38 ASSIGNMENTS=6486 CHECKS=54297400	? (MO) TT=210.33	? (MO) TT=207.82	UNSAT TT=1007.41 ASSIGNMENTS=127421 CHECKS=2700260000	UNSAT TT=148.885 ASSIGNMENTS=113885 CHECKS=178021000	UNSAT TT=747.321	UNSAT TT=12.69 ASSIGNMENTS=16157 CHECKS=23071700	UNSAT TT=27.037 ASSIGNMENTS=6486 CHECKS=54297400	? TT=408.482	? (MO) TT=157.134	? (MO) TT=355.992
csp/pseudo/mpsReduced/ normalized-mps-red-vtp-base.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=0.82	? TT=0.827	? TT=0.595	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.18	? TT=161.023	? TT=171.371
csp/pseudo/ niklas/ normalized-air04.xml	SAT TT=13.832	SAT TT=25.471 CHECKS=17721 NODES=8904	SAT TT=20.363 CHECKS=17721 NODES=0	SAT TT=13.832	SAT TT=85.646 CHECKS=53965	SAT TT=87.134 CHECKS=54270	SAT TT=70.159 ASSIGNMENTS=8905	SAT TT=150.549 ASSIGNMENTS=8905	SAT TT=383.4 CHECKS=71747 NODES=8904	? TT=224.569 CHECKS=70994 NODES=0	? TT=186.97 CHECKS=70989 NODES=0	SAT TT=29.771 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=37.209 ASSIGNMENTS=8904 CHECKS=17721	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=17.138 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=15.86 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=41.423	SAT TT=16.441 ASSIGNMENTS=8904 CHECKS=10060500	SAT TT=17.45 ASSIGNMENTS=8904 CHECKS=10060500	? TT=1031.2	SAT TT=53.998	SAT TT=93.643
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ niklas/ normalized-air05.xml	SAT TT=10.708	SAT TT=23.167 CHECKS=9177 NODES=7195	SAT TT=19.064 CHECKS=9177 NODES=0	SAT TT=10.708	SAT TT=119.545 CHECKS=42154	SAT TT=119.909 CHECKS=40515	SAT TT=62.398 ASSIGNMENTS=7196	SAT TT=128.472 ASSIGNMENTS=7196	SAT TT=332.523 CHECKS=51575 NODES=7195	? TT=192.323 CHECKS=51180 NODES=0	? TT=201.31 CHECKS=51180 NODES=0	SAT TT=28.95 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=34.058 ASSIGNMENTS=7195 CHECKS=9177	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=16.659 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=17.742 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=35.808	SAT TT=14.145 ASSIGNMENTS=7195 CHECKS=10019200	SAT TT=17.363 ASSIGNMENTS=7195 CHECKS=10019200	? TT=246.45	SAT TT=43.41	SAT TT=80.006
csp/pseudo/ niklas/ normalized-enigma.xml	SAT TT=0.037	SAT TT=10.369 CHECKS=811227 NODES=100	SAT TT=3.332 CHECKS=262498 NODES=0	SAT TT=0.078	SAT TT=0.402 CHECKS=2936	SAT TT=0.415 CHECKS=3340	SAT TT=0.746 ASSIGNMENTS=94	SAT TT=0.776 ASSIGNMENTS=87	SAT TT=60.927 CHECKS=42396 NODES=100	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=17832	SAT TT=0.048 ASSIGNMENTS=96 CHECKS=17832	? (MO) TT=472.53	? (MO) TT=541.95	SAT TT=0.038 ASSIGNMENTS=96 CHECKS=17832	SAT TT=0.037 ASSIGNMENTS=26 CHECKS=18535	SAT TT=0.665	SAT TT=0.087 ASSIGNMENTS=174 CHECKS=126054	SAT TT=0.038 ASSIGNMENTS=98 CHECKS=17941	? TT=1135.93	? TT=804.05	? TT=837.737
csp/pseudo/ niklas/ normalized-l152lav.xml	SAT TT=2.854	SAT TT=12.468 CHECKS=2178 NODES=1989	SAT TT=11.608 CHECKS=2178 NODES=0	SAT TT=2.854	SAT TT=228.981 CHECKS=10027	SAT TT=220.383 CHECKS=10997	SAT TT=16.215 ASSIGNMENTS=1990	SAT TT=18.098 ASSIGNMENTS=1990	? TT=0.604	? TT=0.627	? TT=0.602	SAT TT=16.519 ASSIGNMENTS=1989 CHECKS=4846840	SAT TT=22.242 ASSIGNMENTS=1989 CHECKS=2178	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=6.29 ASSIGNMENTS=1989 CHECKS=4846640	SAT TT=6.666 ASSIGNMENTS=1989 CHECKS=4846530	? (exit code) TT=16.483	SAT TT=6.219 ASSIGNMENTS=1989 CHECKS=4846560	SAT TT=6.387 ASSIGNMENTS=1989 CHECKS=4846840	? TT=1159.1	SAT TT=20.945	SAT TT=83.957
csp/pseudo/ niklas/ normalized-lseu.xml	SAT TT=0.02	SAT TT=1.354 CHECKS=20525 NODES=91	SAT TT=1.485 CHECKS=48696 NODES=0	SAT TT=0.053	SAT TT=0.091 CHECKS=946	SAT TT=0.11 CHECKS=1045	SAT TT=0.681 ASSIGNMENTS=67	SAT TT=0.86 ASSIGNMENTS=306	SAT TT=68.279 CHECKS=199605 NODES=172	? (TO) TT=1800.03	SAT TT=1001.18 CHECKS=985807000 NODES=99979	SAT TT=0.033 ASSIGNMENTS=69 CHECKS=7810	SAT TT=0.031 ASSIGNMENTS=69 CHECKS=7810	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=0.02 ASSIGNMENTS=69 CHECKS=7810	SAT TT=0.033 ASSIGNMENTS=225 CHECKS=36172	SAT TT=0.54	SAT TT=0.028 ASSIGNMENTS=137 CHECKS=26264	SAT TT=0.021 ASSIGNMENTS=69 CHECKS=7948	? (TO) TT=1800.16	SAT TT=36.265	SAT TT=156.611
csp/pseudo/ niklas/ normalized-mitre.xml	SAT TT=995.97	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=995.97 CHECKS=2566540	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=1202.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=953.048	? TT=162.853	? TT=168.942
csp/pseudo/ niklas/ normalized-mod008.xml	SAT TT=0.193	SAT TT=1.524 CHECKS=330 NODES=319	SAT TT=1.43 CHECKS=824 NODES=0	SAT TT=0.193	SAT TT=10.871 CHECKS=3079	SAT TT=10.577 CHECKS=2981	SAT TT=1.41 ASSIGNMENTS=315	SAT TT=1.455 ASSIGNMENTS=319	SAT TT=62.049 CHECKS=1505 NODES=319	SAT TT=1.903 CHECKS=3951 NODES=0	SAT TT=1.868 CHECKS=3951 NODES=0	SAT TT=0.275 ASSIGNMENTS=315 CHECKS=266439	SAT TT=0.273 ASSIGNMENTS=315 CHECKS=266439	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=0.248 ASSIGNMENTS=315 CHECKS=266439	SAT TT=0.245 ASSIGNMENTS=317 CHECKS=266979	SAT TT=0.989	SAT TT=0.265 ASSIGNMENTS=317 CHECKS=266853	SAT TT=0.265 ASSIGNMENTS=315 CHECKS=266155	? (TO) TT=1800.15	? TT=187.553	? TT=175.049
csp/pseudo/ niklas/ normalized-mux.xml	SAT TT=0.061	SAT TT=1.312 CHECKS=2210 NODES=232	SAT TT=1.3 CHECKS=1450 NODES=0	SAT TT=0.195	SAT TT=0.086 CHECKS=6690	SAT TT=0.078 CHECKS=13304	SAT TT=1.683 ASSIGNMENTS=95	SAT TT=1.518 ASSIGNMENTS=201	SAT TT=78.258 CHECKS=3939 NODES=234	SAT TT=19.218 CHECKS=10626 NODES=21	SAT TT=19.083 CHECKS=17854 NODES=21	SAT TT=0.074 ASSIGNMENTS=93 CHECKS=14034	SAT TT=0.077 ASSIGNMENTS=93 CHECKS=14034	SAT TT=135.997	Wrong Cert. TT=138.822	SAT TT=0.064 ASSIGNMENTS=93 CHECKS=14034	SAT TT=0.061 ASSIGNMENTS=79 CHECKS=13836	SAT TT=0.883	SAT TT=0.817 ASSIGNMENTS=4173 CHECKS=533507	SAT TT=0.07 ASSIGNMENTS=89 CHECKS=13977	SAT TT=1581.31	SAT TT=1.451	SAT TT=1.603
csp/pseudo/ niklas/ normalized-my-adder.xml	SAT TT=0.172	SAT TT=1.934 CHECKS=3817 NODES=577	SAT TT=1.642 CHECKS=3684 NODES=0	SAT TT=0.407	SAT TT=0.266 CHECKS=34902	SAT TT=0.204 CHECKS=34362	SAT TT=2.097 ASSIGNMENTS=345	SAT TT=2.3 ASSIGNMENTS=482	SAT TT=2.305 CHECKS=7777 NODES=577	SAT TT=2.305 CHECKS=22321 NODES=54	SAT TT=2.316 CHECKS=55715 NODES=34	SAT TT=0.186 ASSIGNMENTS=324 CHECKS=26582	SAT TT=0.193 ASSIGNMENTS=324 CHECKS=26582	SAT TT=4.238	Wrong Cert. TT=4.211	SAT TT=0.172 ASSIGNMENTS=324 CHECKS=26582	SAT TT=0.794 ASSIGNMENTS=8049 CHECKS=747405	SAT TT=1.307	SAT TT=19.489 ASSIGNMENTS=45203 CHECKS=3678420	SAT TT=0.18 ASSIGNMENTS=320 CHECKS=26679	SAT TT=6.799	SAT TT=1.5	SAT TT=1.877
csp/pseudo/ niklas/ normalized-p0282.xml	SAT TT=0.067	SAT TT=50.812 CHECKS=22091000 NODES=284	SAT TT=148.827 CHECKS=42640500 NODES=0	SAT TT=0.153	SAT TT=0.633 CHECKS=13648	SAT TT=0.6 CHECKS=12841	SAT TT=1.113 ASSIGNMENTS=221	SAT TT=1.233 ASSIGNMENTS=266	SAT TT=130.406 CHECKS=3573950 NODES=282	SAT TT=255.19 CHECKS=2505550 NODES=12	SAT TT=254.761 CHECKS=2502250 NODES=7	SAT TT=0.083 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.084 ASSIGNMENTS=237 CHECKS=46009	? (problem) TT=72.591	? (problem) TT=73.466	SAT TT=0.071 ASSIGNMENTS=237 CHECKS=46009	SAT TT=0.069 ASSIGNMENTS=148 CHECKS=43002	SAT TT=0.978	SAT TT=0.07 ASSIGNMENTS=212 CHECKS=35108	SAT TT=0.067 ASSIGNMENTS=228 CHECKS=45887	? (TO) TT=1802.07	SAT TT=35.958	SAT TT=156.52
csp/pseudo/ niklas/ normalized-p0548.xml	SAT TT=0.151	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=2.091 CHECKS=10812	SAT TT=3.077 CHECKS=15728	SAT TT=1.208 ASSIGNMENTS=397	SAT TT=1.749 ASSIGNMENTS=2169	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.06	SAT TT=0.17 ASSIGNMENTS=606 CHECKS=202978	SAT TT=0.169 ASSIGNMENTS=606 CHECKS=202978	? (MO) TT=22.94	? (MO) TT=24.69	SAT TT=0.151 ASSIGNMENTS=565 CHECKS=194339	SAT TT=7.641 ASSIGNMENTS=35883 CHECKS=16389100	SAT TT=0.876	? (TO) TT=1800.09	SAT TT=0.347 ASSIGNMENTS=1043 CHECKS=597264	? TT=385.758	? TT=281.337	? TT=185.946
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ niklas/ normalized-pk1.xml	SAT TT=0.099	SAT TT=1.079 CHECKS=435 NODES=86	SAT TT=0.989 CHECKS=435 NODES=0	SAT TT=0.153	SAT TT=1.133 CHECKS=3844	SAT TT=1.116 CHECKS=3862	SAT TT=1.061 ASSIGNMENTS=57	SAT TT=0.992 ASSIGNMENTS=86	SAT TT=61.478 CHECKS=1035 NODES=86	SAT TT=1.685 CHECKS=11281 NODES=5	SAT TT=2.295 CHECKS=98371 NODES=4	SAT TT=0.118 ASSIGNMENTS=56 CHECKS=89064	SAT TT=0.121 ASSIGNMENTS=56 CHECKS=89064	? (TO) TT=1800.02	? (TO) TT=1800.08	SAT TT=0.112 ASSIGNMENTS=56 CHECKS=89064	SAT TT=0.099 ASSIGNMENTS=33 CHECKS=77962	SAT TT=0.799	SAT TT=39.2 ASSIGNMENTS=35397 CHECKS=61216900	SAT TT=0.105 ASSIGNMENTS=56 CHECKS=89586	? (TO) TT=1800.13	? (MO) TT=76.804	? (MO) TT=283.747
csp/pseudo/ niklas/ normalized-seymour.xml	SAT TT=0.892	SAT TT=8.927 CHECKS=27702 NODES=1255	SAT TT=4.531 CHECKS=17069 NODES=0	SAT TT=2.095	SAT TT=1.878 CHECKS=239380	SAT TT=1.668 CHECKS=237091	SAT TT=4.794 ASSIGNMENTS=792	SAT TT=5.549 ASSIGNMENTS=792	SAT TT=12.01 CHECKS=93523 NODES=1255	SAT TT=5.509 CHECKS=122763 NODES=8	SAT TT=5.886 CHECKS=134146 NODES=4	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293685	SAT TT=0.934 ASSIGNMENTS=801 CHECKS=293685	SAT TT=15.52	SAT TT=21.469	SAT TT=0.929 ASSIGNMENTS=801 CHECKS=293685	SAT TT=0.912 ASSIGNMENTS=880 CHECKS=294436	SAT TT=2.677	SAT TT=0.892 ASSIGNMENTS=851 CHECKS=293637	SAT TT=0.904 ASSIGNMENTS=804 CHECKS=293914	SAT TT=62.273	SAT TT=7.627	SAT TT=8.425
csp/pseudo/ niklas/ normalized-stein27.xml	SAT TT=0.013	SAT TT=0.855 CHECKS=1864 NODES=27	SAT TT=0.861 CHECKS=3714 NODES=0	SAT TT=0.048	SAT TT=0.032 CHECKS=8042	SAT TT=0.027 CHECKS=7707	SAT TT=0.65 ASSIGNMENTS=9	SAT TT=0.848 ASSIGNMENTS=9	SAT TT=74.706 CHECKS=277484 NODES=27	SAT TT=14.331 CHECKS=165501 NODES=0	SAT TT=13.888 CHECKS=165499 NODES=0	SAT TT=0.026 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.027 ASSIGNMENTS=8 CHECKS=1620	? (MO) TT=41.56	? (MO) TT=40.99	SAT TT=0.014 ASSIGNMENTS=8 CHECKS=1620	SAT TT=0.015 ASSIGNMENTS=6 CHECKS=1478	SAT TT=0.398	SAT TT=0.013 ASSIGNMENTS=8 CHECKS=1631	SAT TT=0.013 ASSIGNMENTS=9 CHECKS=1593	? TT=172.37	SAT TT=0.687	SAT TT=0.694
csp/pseudo/ niklas/ normalized-stein45.xml	SAT TT=0.025	SAT TT=1.069 CHECKS=886 NODES=45	SAT TT=1.027 CHECKS=855 NODES=0	SAT TT=0.087	SAT TT=0.037 CHECKS=2220	SAT TT=0.025 CHECKS=2403	SAT TT=1.013 ASSIGNMENTS=13	SAT TT=0.95 ASSIGNMENTS=13	SAT TT=203.43 CHECKS=235859000 NODES=45	SAT TT=85.226 CHECKS=140514000 NODES=0	SAT TT=85.033 CHECKS=140514000 NODES=0	SAT TT=0.046 ASSIGNMENTS=12 CHECKS=4532	SAT TT=0.039 ASSIGNMENTS=12 CHECKS=4532	? (TO) TT=1800.02	? (TO) TT=1800.1	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=4532	SAT TT=0.032 ASSIGNMENTS=59 CHECKS=13639	SAT TT=0.742	SAT TT=0.029 ASSIGNMENTS=26 CHECKS=5771	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=4512	? TT=754.848	SAT TT=0.902	SAT TT=0.856
csp/pseudo/par/ normalized-par-16-2-c.xml	SAT TT=1.788	SAT TT=6.541 CHECKS=1678500 NODES=10893	SAT TT=44.202 CHECKS=15647300 NODES=117004	SAT TT=5.991	SAT TT=260.227 CHECKS=239070000	SAT TT=166.655 CHECKS=177948000	SAT TT=290.106 ASSIGNMENTS=367998	SAT TT=268.478 ASSIGNMENTS=367998	SAT TT=390.549 CHECKS=130430000 NODES=113465	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=13.265 ASSIGNMENTS=10893 CHECKS=1678500	SAT TT=159.531 ASSIGNMENTS=76639 CHECKS=181434000	SAT TT=3.539	SAT TT=3.335	SAT TT=48.122 ASSIGNMENTS=24387 CHECKS=56319300	SAT TT=55.001 ASSIGNMENTS=35415 CHECKS=65498500	SAT TT=3.738	SAT TT=571.787 ASSIGNMENTS=201110 CHECKS=481324000	SAT TT=152.008 ASSIGNMENTS=76639 CHECKS=181434000	SAT TT=5.763	SAT TT=2.075	SAT TT=1.788
csp/pseudo/par/ normalized-par-16-3-c.xml	SAT TT=1.667	SAT TT=201.275 CHECKS=75106700 NODES=574385	SAT TT=108.854 CHECKS=40865200 NODES=323384	SAT TT=2.882	SAT TT=93.108 CHECKS=85804300	SAT TT=145.248 CHECKS=159807000	SAT TT=24.679 ASSIGNMENTS=33908	SAT TT=24.871 ASSIGNMENTS=33908	SAT TT=57.14 CHECKS=19859400 NODES=19231	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=126.902 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=123.701 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=3.211	SAT TT=3.111	SAT TT=96.459 ASSIGNMENTS=52652 CHECKS=119688000	SAT TT=118.735 ASSIGNMENTS=66614 CHECKS=138597000	SAT TT=5.96	SAT TT=239.023 ASSIGNMENTS=88562 CHECKS=215346000	SAT TT=115.363 ASSIGNMENTS=60189 CHECKS=140788000	SAT TT=6.617	SAT TT=1.917	SAT TT=1.667
csp/pseudo/par/ normalized-par-16-4.xml	SAT TT=2.042	SAT TT=30.149 CHECKS=10481100 NODES=37310	SAT TT=83.391 CHECKS=29182600 NODES=96747	SAT TT=3.909	SAT TT=152.005 CHECKS=91980900	SAT TT=24.093 CHECKS=19708500	SAT TT=160.062 ASSIGNMENTS=98083	SAT TT=169.629 ASSIGNMENTS=98083	SAT TT=843.765 CHECKS=138728000 NODES=184926	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=44.534 ASSIGNMENTS=12418 CHECKS=34671800	SAT TT=37.88 ASSIGNMENTS=37310 CHECKS=10481100	SAT TT=8.464	SAT TT=8.511	SAT TT=57.43 ASSIGNMENTS=23176 CHECKS=62770600	SAT TT=20.664 ASSIGNMENTS=13789 CHECKS=20549300	SAT TT=37.292	SAT TT=137.578 ASSIGNMENTS=38888 CHECKS=96856500	SAT TT=35.29 ASSIGNMENTS=12418 CHECKS=34671800	SAT TT=7.857	SAT TT=2.042	SAT TT=2.217
csp/pseudo/par/ normalized-par-16-5-c.xml	SAT TT=1.618	SAT TT=194.223 CHECKS=71874700 NODES=613452	SAT TT=221.917 CHECKS=83949300 NODES=732514	SAT TT=10.628	SAT TT=139.07 CHECKS=135220000	SAT TT=463.76 CHECKS=555591000	SAT TT=42.873 ASSIGNMENTS=52888	SAT TT=43.357 ASSIGNMENTS=52888	SAT TT=302.746 CHECKS=99625400 NODES=87998	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=181.184 ASSIGNMENTS=613452 CHECKS=71874700	SAT TT=339.471 ASSIGNMENTS=160068 CHECKS=389951000	SAT TT=3.403	SAT TT=3.077	SAT TT=42.624 ASSIGNMENTS=25876 CHECKS=54410600	SAT TT=24.594 ASSIGNMENTS=19489 CHECKS=29493000	SAT TT=2.47	SAT TT=34.441 ASSIGNMENTS=16364 CHECKS=30878600	SAT TT=328.516 ASSIGNMENTS=160068 CHECKS=389951000	SAT TT=5.772	SAT TT=2.129	SAT TT=1.618
csp/pseudo/par/ normalized-par-16-5.xml	SAT TT=2.63	SAT TT=376.944 CHECKS=131326000 NODES=381898	SAT TT=356.438 CHECKS=131333000 NODES=381864	SAT TT=2.63	SAT TT=43.562 CHECKS=28905500	SAT TT=72.808 CHECKS=49731100	SAT TT=21.875 ASSIGNMENTS=12758	SAT TT=23.543 ASSIGNMENTS=12758	SAT TT=647.241 CHECKS=102235000 NODES=127106	? (TO) TT=1800	? (TO) TT=1800.04	SAT TT=325.33 ASSIGNMENTS=117479 CHECKS=326218000	SAT TT=312.483 ASSIGNMENTS=381898 CHECKS=131326000	SAT TT=8.43	SAT TT=8.281	SAT TT=56.566 ASSIGNMENTS=23238 CHECKS=60958500	SAT TT=177.633 ASSIGNMENTS=69014 CHECKS=178059000	SAT TT=37.025	SAT TT=251.803 ASSIGNMENTS=76474 CHECKS=198151000	SAT TT=323.054 ASSIGNMENTS=117479 CHECKS=326218000	SAT TT=10.849	SAT TT=2.766	SAT TT=2.646
csp/pseudo/par/ normalized-par-32-1-c.xml		? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/par/ normalized-par-32-1.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/pseudo/par/ normalized-par-32-2-c.xml	SAT TT=180.881	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=180.881	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/pseudo/par/ normalized-par-32-3-c.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/pseudo/par/ normalized-par-32-4.xml		? (TO) TT=1800.1	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/pseudo/par/ normalized-par-32-5-c.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/pseudo/par/ normalized-par-8-1-c.xml	SAT TT=0.031	SAT TT=1.039 CHECKS=1966 NODES=141	SAT TT=1.022 CHECKS=2827 NODES=132	SAT TT=0.086	SAT TT=0.052 CHECKS=18976	SAT TT=0.038 CHECKS=19433	SAT TT=1.039 ASSIGNMENTS=20	SAT TT=1.264 ASSIGNMENTS=20	SAT TT=0.97 CHECKS=1336 NODES=130	SAT TT=2.148 CHECKS=2649100 NODES=81086	SAT TT=1.78 CHECKS=1851390 NODES=10291	SAT TT=0.041 ASSIGNMENTS=15 CHECKS=10408	SAT TT=0.042 ASSIGNMENTS=15 CHECKS=10408	SAT TT=1.709	SAT TT=1.783	SAT TT=0.031 ASSIGNMENTS=19 CHECKS=11997	SAT TT=0.067 ASSIGNMENTS=374 CHECKS=84056	SAT TT=0.739	SAT TT=0.072 ASSIGNMENTS=436 CHECKS=60847	SAT TT=0.035 ASSIGNMENTS=21 CHECKS=14559	SAT TT=1.824	SAT TT=1.007	SAT TT=0.982
csp/pseudo/par/ normalized-par-8-2-c.xml	SAT TT=0.026	SAT TT=1.024 CHECKS=3607 NODES=157	SAT TT=1.144 CHECKS=4729 NODES=155	SAT TT=0.101	SAT TT=0.052 CHECKS=16107	SAT TT=0.035 CHECKS=17193	SAT TT=1.179 ASSIGNMENTS=17	SAT TT=1.277 ASSIGNMENTS=17	SAT TT=1.018 CHECKS=5574 NODES=151	SAT TT=2.43 CHECKS=2718350 NODES=79202	SAT TT=1.702 CHECKS=1149830 NODES=7072	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=4600	SAT TT=0.037 ASSIGNMENTS=11 CHECKS=4600	SAT TT=1.732	SAT TT=1.499	SAT TT=0.026 ASSIGNMENTS=12 CHECKS=5269	SAT TT=0.083 ASSIGNMENTS=477 CHECKS=106508	SAT TT=0.687	SAT TT=0.072 ASSIGNMENTS=456 CHECKS=57713	SAT TT=0.028 ASSIGNMENTS=11 CHECKS=5867	SAT TT=1.787	SAT TT=0.874	SAT TT=1.008
csp/pseudo/par/ normalized-par-8-5-c.xml	SAT TT=0.027	SAT TT=1.045 CHECKS=1934 NODES=158	SAT TT=1.038 CHECKS=3944 NODES=166	SAT TT=0.096	SAT TT=0.054 CHECKS=19592	SAT TT=0.042 CHECKS=20062	SAT TT=1.085 ASSIGNMENTS=12	SAT TT=1.202 ASSIGNMENTS=12	SAT TT=1.101 CHECKS=4353 NODES=167	SAT TT=2.805 CHECKS=4085280 NODES=113948	SAT TT=1.159 CHECKS=67901 NODES=532	SAT TT=0.041 ASSIGNMENTS=8 CHECKS=5958	SAT TT=0.04 ASSIGNMENTS=8 CHECKS=5958	SAT TT=1.638	SAT TT=1.66	SAT TT=0.031 ASSIGNMENTS=7 CHECKS=5947	SAT TT=0.027 ASSIGNMENTS=6 CHECKS=3708	SAT TT=0.751	SAT TT=0.062 ASSIGNMENTS=313 CHECKS=54157	SAT TT=0.03 ASSIGNMENTS=8 CHECKS=5958	SAT TT=2.013	SAT TT=0.989	SAT TT=0.885
csp/pseudo/par/ normalized-par-8-5.xml	SAT TT=0.076	SAT TT=2.022 CHECKS=7922 NODES=718	SAT TT=1.961 CHECKS=12491 NODES=718	SAT TT=0.343	SAT TT=0.222 CHECKS=93738	SAT TT=0.168 CHECKS=90572	SAT TT=1.958 ASSIGNMENTS=10	SAT TT=2.012 ASSIGNMENTS=10	SAT TT=2.305 CHECKS=24002 NODES=768	SAT TT=2.648 CHECKS=1290310 NODES=49773	SAT TT=342.776 CHECKS=1110620000 NODES=1978640	SAT TT=0.095 ASSIGNMENTS=6 CHECKS=4243	SAT TT=0.095 ASSIGNMENTS=6 CHECKS=4243	SAT TT=3.505	SAT TT=3.447	SAT TT=0.076 ASSIGNMENTS=6 CHECKS=4243	SAT TT=0.098 ASSIGNMENTS=94 CHECKS=36877	SAT TT=5.008	SAT TT=0.164 ASSIGNMENTS=623 CHECKS=92497	SAT TT=0.086 ASSIGNMENTS=10 CHECKS=9367	SAT TT=4.076	SAT TT=1.849	SAT TT=1.233
csp/pseudo/ppp/ normalized-ppp-1-11-19-21.xml		? (TO) TT=1800.09	? (MO) TT=7.447	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (MO) TT=18.45	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=415.35	? (TO) TT=1800.1	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ppp/ normalized-ppp-1-12-16.xml	SAT TT=7.417	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=85.287 CHECKS=3104980	? (TO) TT=1800.16	SAT TT=930.838 ASSIGNMENTS=194215	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=392.493 ASSIGNMENTS=174205 CHECKS=306943000	SAT TT=1148.91 ASSIGNMENTS=174205 CHECKS=306943000	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (exit code) TT=15.752	? (TO) TT=1800.02	SAT TT=379.522 ASSIGNMENTS=174205 CHECKS=306943000	? TT=269.88	SAT TT=7.417	SAT TT=8.337
csp/pseudo/ppp/ normalized-ppp-1-13.xml	SAT TT=8.717	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.97	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.07	? (exit code) TT=20.543	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=291.68	SAT TT=94.45	SAT TT=8.717
csp/pseudo/ppp/ normalized-ppp-1-3-13-19.xml	SAT TT=8.516	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (MO) TT=297.57	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=302.357	SAT TT=108.01	SAT TT=8.516
csp/pseudo/ppp/ normalized-ppp-1-9-16-19.xml		? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (exit code) TT=16.842	? (TO) TT=1800.08	? (TO) TT=1800.12	? TT=299.157	? (TO) TT=1800.08	? (TO) TT=1800.02
csp/pseudo/ppp/ normalized-ppp-3-13-25-26.xml	SAT TT=16.056	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=221.4 ASSIGNMENTS=130071 CHECKS=175138000	SAT TT=981.523 ASSIGNMENTS=130071 CHECKS=175138000	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.1	? (exit code) TT=17.596	? (TO) TT=1800.1	SAT TT=214.613 ASSIGNMENTS=130071 CHECKS=175138000	? TT=268.202	SAT TT=109.857	SAT TT=16.056
csp/pseudo/ primesDimacs/ normalized-bf-0432-007.xml	UNSAT TT=1.94	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.02	UNSAT TT=1256.28 CHECKS=782476000	UNSAT TT=1235.92 CHECKS=816716000	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=7.614	UNSAT TT=7.818	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=72.158	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=7.774	UNSAT TT=1.94	UNSAT TT=2.052
csp/pseudo/ primesDimacs/ normalized-bf-1355-075.xml	UNSAT TT=1.021	UNSAT TT=7.156 CHECKS=98296 NODES=5660	UNSAT TT=12.961 CHECKS=137672 NODES=5652	? (TO) TT=1800.09	UNSAT TT=14.877 CHECKS=13263500	UNSAT TT=4.712 CHECKS=3585030	UNSAT TT=11.932 ASSIGNMENTS=326	? (TO) TT=1800.14	UNSAT TT=18.079 CHECKS=27469 NODES=104	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=1.236 ASSIGNMENTS=290 CHECKS=286640	UNSAT TT=1.021 ASSIGNMENTS=290 CHECKS=286640	UNSAT TT=18.743	UNSAT TT=20.224	UNSAT TT=1.122 ASSIGNMENTS=282 CHECKS=318791	UNSAT TT=5.285 ASSIGNMENTS=9653 CHECKS=4080640	UNSAT TT=114.214	UNSAT TT=784.844 ASSIGNMENTS=272907 CHECKS=246666000	UNSAT TT=1.161 ASSIGNMENTS=333 CHECKS=323600	UNSAT TT=8.264	UNSAT TT=2.426	UNSAT TT=3.08
csp/pseudo/ primesDimacs/ normalized-bf-1355-638.xml	UNSAT TT=1.038	UNSAT TT=8.287 CHECKS=163179 NODES=7933	UNSAT TT=11.663 CHECKS=217720 NODES=8047	? (TO) TT=1800.02	UNSAT TT=11.083 CHECKS=8958060	UNSAT TT=5.816 CHECKS=3866100	UNSAT TT=11.173 ASSIGNMENTS=642	? (TO) TT=1800.14	UNSAT TT=18.505 CHECKS=17795 NODES=113	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=1.066 ASSIGNMENTS=332 CHECKS=270840	UNSAT TT=1.038 ASSIGNMENTS=332 CHECKS=270840	UNSAT TT=18.426	UNSAT TT=17.976	UNSAT TT=1.128 ASSIGNMENTS=324 CHECKS=279024	UNSAT TT=5.448 ASSIGNMENTS=9567 CHECKS=4074000	UNSAT TT=94.874	UNSAT TT=319.55 ASSIGNMENTS=107294 CHECKS=72951900	UNSAT TT=1.056 ASSIGNMENTS=292 CHECKS=243472	UNSAT TT=8.556	UNSAT TT=2.371	UNSAT TT=2.62
csp/pseudo/ primesDimacs/ normalized-bf-2670-001.xml	UNSAT TT=0.758	UNSAT TT=4.319 CHECKS=175155 NODES=3944	UNSAT TT=5.957 CHECKS=216075 NODES=4189	? (TO) TT=1800.04	UNSAT TT=2.77 CHECKS=1358240	UNSAT TT=3.374 CHECKS=1504840	UNSAT TT=5.075 ASSIGNMENTS=715	UNSAT TT=5.27 ASSIGNMENTS=715	UNSAT TT=9.879 CHECKS=69756 NODES=833	? (TO) TT=1800.09	? (TO) TT=1800.07	UNSAT TT=0.905 ASSIGNMENTS=951 CHECKS=454543	UNSAT TT=0.913 ASSIGNMENTS=951 CHECKS=454543	UNSAT TT=8.008	UNSAT TT=7.867	UNSAT TT=1.013 ASSIGNMENTS=1143 CHECKS=549452	UNSAT TT=2.157 ASSIGNMENTS=11329 CHECKS=2067920	UNSAT TT=22.101	UNSAT TT=63.338 ASSIGNMENTS=97727 CHECKS=20923500	UNSAT TT=0.758 ASSIGNMENTS=656 CHECKS=323854	UNSAT TT=6.212	UNSAT TT=2.373	UNSAT TT=1.888
csp/pseudo/ primesDimacs/ normalized-f1000.xml		? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ primesDimacs/ normalized-f2000.xml		? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/pseudo/ primesDimacs/ normalized-f600.xml		? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/pseudo/ primesDimacs/ normalized-g-125-17.xml		? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.12
csp/pseudo/ primesDimacs/ normalized-g-125-18.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/pseudo/ primesDimacs/ normalized-hanoi4.xml	SAT TT=2.365	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=1465.29	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	SAT TT=40.033 CHECKS=3044760 NODES=9216	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=9.233	SAT TT=8.603	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=81.875	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=9.202	SAT TT=2.365	SAT TT=2.475
csp/pseudo/ primesDimacs/ normalized-hanoi5.xml	SAT TT=5.43	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=32.439	SAT TT=35.235	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=237.339	SAT TT=14.201	SAT TT=5.43
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.5-100.xml	SAT TT=0.036	SAT TT=1.326 CHECKS=4336 NODES=372	SAT TT=1.176 CHECKS=4570 NODES=0	SAT TT=0.154	SAT TT=0.066 CHECKS=6431	SAT TT=0.047 CHECKS=6596	SAT TT=1.365 ASSIGNMENTS=46	SAT TT=1.395 ASSIGNMENTS=46	SAT TT=2.143 CHECKS=5858 NODES=372	SAT TT=6.102 CHECKS=124518 NODES=2100100	SAT TT=3.427 CHECKS=5919430 NODES=772	SAT TT=0.055 ASSIGNMENTS=58 CHECKS=9106	SAT TT=0.055 ASSIGNMENTS=58 CHECKS=9106	Wrong Cert. TT=3.497	Wrong Cert. TT=3.564	SAT TT=0.041 ASSIGNMENTS=58 CHECKS=9106	SAT TT=0.036 ASSIGNMENTS=81 CHECKS=7956	SAT TT=0.835	SAT TT=0.048 ASSIGNMENTS=236 CHECKS=14489	SAT TT=0.042 ASSIGNMENTS=57 CHECKS=9112	SAT TT=11.039	SAT TT=1.423	SAT TT=1.51
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.95-100.xml	SAT TT=0.047	SAT TT=1.424 CHECKS=4113 NODES=435	SAT TT=1.48 CHECKS=5379 NODES=0	SAT TT=0.176	SAT TT=0.077 CHECKS=8093	SAT TT=0.054 CHECKS=8344	SAT TT=1.588 ASSIGNMENTS=58	SAT TT=1.746 ASSIGNMENTS=58	SAT TT=1.747 CHECKS=7588 NODES=435	SAT TT=34.309 CHECKS=861164 NODES=13350100	SAT TT=50.726 CHECKS=234371000 NODES=27583	SAT TT=0.06 ASSIGNMENTS=55 CHECKS=9946	SAT TT=0.059 ASSIGNMENTS=55 CHECKS=9946	Wrong Cert. TT=3.36	Wrong Cert. TT=3.638	SAT TT=0.047 ASSIGNMENTS=55 CHECKS=9946	SAT TT=0.057 ASSIGNMENTS=347 CHECKS=27212	SAT TT=0.941	SAT TT=0.053 ASSIGNMENTS=131 CHECKS=9914	SAT TT=0.048 ASSIGNMENTS=74 CHECKS=9944	SAT TT=6.516	SAT TT=1.48	SAT TT=1.481
csp/pseudo/radar/ normalized-radar-10-10-4.5-0.95-98.xml	SAT TT=0.044	SAT TT=1.286 CHECKS=3485 NODES=411	SAT TT=1.186 CHECKS=4631 NODES=0	SAT TT=0.167	SAT TT=0.069 CHECKS=7944	SAT TT=0.051 CHECKS=7901	SAT TT=1.592 ASSIGNMENTS=41	SAT TT=1.407 ASSIGNMENTS=41	SAT TT=1.638 CHECKS=7280 NODES=411	SAT TT=32.163 CHECKS=781950 NODES=12750100	SAT TT=25.588 CHECKS=113900000 NODES=13790	SAT TT=0.055 ASSIGNMENTS=45 CHECKS=9120	SAT TT=0.057 ASSIGNMENTS=45 CHECKS=9120	Wrong Cert. TT=3.932	Wrong Cert. TT=4.114	SAT TT=0.047 ASSIGNMENTS=45 CHECKS=9120	SAT TT=0.045 ASSIGNMENTS=98 CHECKS=8213	SAT TT=0.831	SAT TT=0.086 ASSIGNMENTS=661 CHECKS=44723	SAT TT=0.044 ASSIGNMENTS=45 CHECKS=9101	SAT TT=6.061	SAT TT=1.271	SAT TT=1.653
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.5-100.xml	SAT TT=0.086	SAT TT=1.835 CHECKS=10585 NODES=776	SAT TT=1.625 CHECKS=10200 NODES=0	SAT TT=0.261	SAT TT=0.138 CHECKS=14916	SAT TT=0.114 CHECKS=14960	SAT TT=2.021 ASSIGNMENTS=91	SAT TT=2.168 ASSIGNMENTS=91	SAT TT=7.723 CHECKS=12459 NODES=776	SAT TT=7.534 CHECKS=135740 NODES=900207	SAT TT=14.803 CHECKS=50382100 NODES=5509	SAT TT=0.092 ASSIGNMENTS=98 CHECKS=21935	SAT TT=0.106 ASSIGNMENTS=98 CHECKS=21935	Wrong Cert. TT=7.239	Wrong Cert. TT=6.562	SAT TT=0.088 ASSIGNMENTS=98 CHECKS=21935	SAT TT=0.086 ASSIGNMENTS=181 CHECKS=19281	SAT TT=1.053	SAT TT=0.201 ASSIGNMENTS=1128 CHECKS=102982	SAT TT=0.095 ASSIGNMENTS=112 CHECKS=21976	SAT TT=86.241	SAT TT=1.67	SAT TT=1.762
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.95-100.xml	SAT TT=0.103	SAT TT=2.317 CHECKS=12164 NODES=934	SAT TT=1.842 CHECKS=12582 NODES=0	SAT TT=0.374	SAT TT=0.158 CHECKS=18372	SAT TT=0.113 CHECKS=17657	SAT TT=1.966 ASSIGNMENTS=78	SAT TT=2.331 ASSIGNMENTS=78	SAT TT=5.283 CHECKS=16390 NODES=934	SAT TT=548.821 CHECKS=15243600 NODES=96000300	SAT TT=56.226 CHECKS=206660000 NODES=23809	SAT TT=0.129 ASSIGNMENTS=86 CHECKS=26871	SAT TT=0.12 ASSIGNMENTS=86 CHECKS=26871	Wrong Cert. TT=7.303	Wrong Cert. TT=7.772	SAT TT=0.104 ASSIGNMENTS=86 CHECKS=26871	SAT TT=0.113 ASSIGNMENTS=423 CHECKS=45299	SAT TT=1.105	SAT TT=0.12 ASSIGNMENTS=305 CHECKS=26712	SAT TT=0.103 ASSIGNMENTS=98 CHECKS=26865	SAT TT=43.079	SAT TT=1.914	SAT TT=2.257
csp/pseudo/radar/ normalized-radar-10-20-4.5-0.95-98.xml	SAT TT=0.101	SAT TT=2.172 CHECKS=12591 NODES=906	SAT TT=1.645 CHECKS=12927 NODES=0	SAT TT=0.34	SAT TT=0.167 CHECKS=18199	SAT TT=0.119 CHECKS=17838	SAT TT=2.086 ASSIGNMENTS=69	SAT TT=2.32 ASSIGNMENTS=69	SAT TT=3.695 CHECKS=16274 NODES=906	SAT TT=401.955 CHECKS=12171800 NODES=79650300	SAT TT=188.945 CHECKS=746862000 NODES=87924	SAT TT=0.119 ASSIGNMENTS=76 CHECKS=25008	SAT TT=0.114 ASSIGNMENTS=76 CHECKS=25008	Wrong Cert. TT=5.543	Wrong Cert. TT=5.706	SAT TT=0.101 ASSIGNMENTS=76 CHECKS=25008	SAT TT=0.113 ASSIGNMENTS=380 CHECKS=41557	SAT TT=1.067	SAT TT=0.125 ASSIGNMENTS=275 CHECKS=24879	SAT TT=0.11 ASSIGNMENTS=75 CHECKS=25025	SAT TT=30.089	SAT TT=1.785	SAT TT=2.149
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.5-100.xml	SAT TT=0.876	SAT TT=5.754 CHECKS=89373 NODES=4447	SAT TT=5.148 CHECKS=70991 NODES=0	SAT TT=1.695	SAT TT=1.38 CHECKS=89997	SAT TT=1.165 CHECKS=92120	SAT TT=5.357 ASSIGNMENTS=332	SAT TT=5.69 ASSIGNMENTS=332	SAT TT=140.923 CHECKS=77519 NODES=4447	? (TO) TT=1800.08	SAT TT=561.512 CHECKS=670038000 NODES=72999	SAT TT=1.051 ASSIGNMENTS=392 CHECKS=186616	SAT TT=1.052 ASSIGNMENTS=392 CHECKS=186616	Wrong Cert. TT=275.72	Wrong Cert. TT=315.247	SAT TT=0.876 ASSIGNMENTS=392 CHECKS=186616	SAT TT=0.984 ASSIGNMENTS=2960 CHECKS=598849	SAT TT=2.617	SAT TT=249.122 ASSIGNMENTS=70895 CHECKS=13330800	SAT TT=0.902 ASSIGNMENTS=386 CHECKS=186685	? (TO) TT=1800.15	SAT TT=3.85	SAT TT=5.108
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.95-100.xml	SAT TT=0.875	SAT TT=5.716 CHECKS=75346 NODES=4617	SAT TT=4.973 CHECKS=70153 NODES=0	SAT TT=1.735	SAT TT=1.383 CHECKS=97380	SAT TT=1.116 CHECKS=98287	SAT TT=6.649 ASSIGNMENTS=430	SAT TT=6.297 ASSIGNMENTS=430	SAT TT=77.746 CHECKS=93265 NODES=4617	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=0.976 ASSIGNMENTS=501 CHECKS=157778	SAT TT=0.903 ASSIGNMENTS=501 CHECKS=157778	Wrong Cert. TT=47.9	Wrong Cert. TT=68.55	SAT TT=0.875 ASSIGNMENTS=501 CHECKS=157778	SAT TT=3.284 ASSIGNMENTS=17975 CHECKS=3051980	SAT TT=2.732	SAT TT=231.641 ASSIGNMENTS=73622 CHECKS=10459600	SAT TT=0.902 ASSIGNMENTS=397 CHECKS=157703	SAT TT=1484.3	SAT TT=3.913	SAT TT=5.291
csp/pseudo/radar/ normalized-radar-30-30-4.5-0.95-98.xml	SAT TT=0.814	SAT TT=5.421 CHECKS=74144 NODES=4624	SAT TT=4.859 CHECKS=68809 NODES=0	SAT TT=1.595	SAT TT=1.233 CHECKS=96767	SAT TT=1.115 CHECKS=96027	SAT TT=5.795 ASSIGNMENTS=415	SAT TT=5.929 ASSIGNMENTS=415	SAT TT=73.559 CHECKS=83902 NODES=4624	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=0.814 ASSIGNMENTS=448 CHECKS=154239	SAT TT=0.82 ASSIGNMENTS=448 CHECKS=154239	Wrong Cert. TT=37.708	Wrong Cert. TT=62.883	SAT TT=0.842 ASSIGNMENTS=448 CHECKS=154239	SAT TT=3.276 ASSIGNMENTS=19582 CHECKS=3131600	SAT TT=2.988	SAT TT=452.263 ASSIGNMENTS=104093 CHECKS=14025900	SAT TT=0.891 ASSIGNMENTS=435 CHECKS=154231	SAT TT=730.548	SAT TT=4.545	SAT TT=4.727
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.5-100.xml	SAT TT=1.533	SAT TT=25.505 CHECKS=214996 NODES=10772	SAT TT=22.773 CHECKS=172713 NODES=0	SAT TT=4.184	SAT TT=14.503 CHECKS=231633	SAT TT=15.615 CHECKS=232213	SAT TT=14.939 ASSIGNMENTS=850	SAT TT=16.895 ASSIGNMENTS=850	SAT TT=187.598 CHECKS=191093 NODES=10772	? TT=106.329 CHECKS=164245 NODES=0	? TT=110.41 CHECKS=164069 NODES=0	SAT TT=1.604 ASSIGNMENTS=941 CHECKS=448309	SAT TT=1.605 ASSIGNMENTS=941 CHECKS=448309	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=1.683 ASSIGNMENTS=941 CHECKS=448309	SAT TT=1.533 ASSIGNMENTS=3045 CHECKS=447597	SAT TT=6.118	SAT TT=1.803 ASSIGNMENTS=2422 CHECKS=448511	SAT TT=1.831 ASSIGNMENTS=928 CHECKS=448228	? (TO) TT=1800.12	SAT TT=7.675	SAT TT=10.415
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.95-100.xml	SAT TT=1.501	SAT TT=23.344 CHECKS=177903 NODES=10976	SAT TT=21.69 CHECKS=166790 NODES=0	SAT TT=4.288	SAT TT=14.353 CHECKS=233431	SAT TT=15.63 CHECKS=235580	SAT TT=14.798 ASSIGNMENTS=856	SAT TT=18.018 ASSIGNMENTS=856	SAT TT=135.161 CHECKS=220962 NODES=10976	? TT=53.939 CHECKS=170982 NODES=0	? TT=61.808 CHECKS=171085 NODES=0	SAT TT=1.563 ASSIGNMENTS=981 CHECKS=376839	SAT TT=1.571 ASSIGNMENTS=981 CHECKS=376839	Wrong Cert. TT=171.127	Wrong Cert. TT=375.601	SAT TT=1.613 ASSIGNMENTS=981 CHECKS=376839	SAT TT=1.501 ASSIGNMENTS=2976 CHECKS=376641	SAT TT=5.994	SAT TT=1.802 ASSIGNMENTS=2615 CHECKS=376844	SAT TT=1.566 ASSIGNMENTS=1042 CHECKS=376860	? (TO) TT=1800.1	SAT TT=8.309	SAT TT=10.522
csp/pseudo/radar/ normalized-radar-30-70-4.5-0.95-98.xml	SAT TT=1.48	SAT TT=24.703 CHECKS=182863 NODES=10990	SAT TT=20.81 CHECKS=167199 NODES=0	SAT TT=3.944	SAT TT=13.761 CHECKS=231852	SAT TT=15.845 CHECKS=233448	SAT TT=15.16 ASSIGNMENTS=892	SAT TT=14.342 ASSIGNMENTS=892	SAT TT=165.621 CHECKS=219565 NODES=10990	? TT=73.854 CHECKS=169196 NODES=0	? TT=79.171 CHECKS=169125 NODES=0	SAT TT=1.48 ASSIGNMENTS=965 CHECKS=384815	SAT TT=1.584 ASSIGNMENTS=965 CHECKS=384815	Wrong Cert. TT=205.62	Wrong Cert. TT=384.528	SAT TT=1.495 ASSIGNMENTS=965 CHECKS=384815	SAT TT=1.495 ASSIGNMENTS=3049 CHECKS=384204	SAT TT=5.91	SAT TT=1.89 ASSIGNMENTS=2670 CHECKS=384718	SAT TT=1.673 ASSIGNMENTS=1004 CHECKS=384754	? (TO) TT=1800.12	SAT TT=7.389	SAT TT=9.698
csp/pseudo/routing/ normalized-s3-3-3-1.xml	SAT TT=0.165	SAT TT=14.15 CHECKS=8356460 NODES=3646	SAT TT=10.001 CHECKS=5845300 NODES=2201	SAT TT=898.823	SAT TT=0.259 CHECKS=30227	SAT TT=0.23 CHECKS=30202	SAT TT=1.973 ASSIGNMENTS=1119	SAT TT=30.096 ASSIGNMENTS=180124	SAT TT=23.862 CHECKS=51383700 NODES=891	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=0.573 ASSIGNMENTS=1026 CHECKS=670839	SAT TT=0.548 ASSIGNMENTS=1026 CHECKS=670839	Wrong Cert. TT=2.818	Wrong Cert. TT=2.966	SAT TT=0.623 ASSIGNMENTS=1259 CHECKS=822169	SAT TT=1.661 ASSIGNMENTS=6610 CHECKS=2224080	SAT TT=1.135	SAT TT=1.201 ASSIGNMENTS=3037 CHECKS=966826	SAT TT=0.165 ASSIGNMENTS=369 CHECKS=167073	? TT=434.334	SAT TT=1.534	SAT TT=1.498
csp/pseudo/routing/ normalized-s3-3-3-2.xml	SAT TT=0.259	? (TO) TT=1800.15	SAT TT=376.504 CHECKS=210100000 NODES=17165	SAT TT=893.605	SAT TT=0.285 CHECKS=27068	SAT TT=0.259 CHECKS=26980	SAT TT=1.862 ASSIGNMENTS=698	SAT TT=344.679 ASSIGNMENTS=1759760	SAT TT=219.298 CHECKS=399000000 NODES=944	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1.213 ASSIGNMENTS=2013 CHECKS=1548150	SAT TT=1.199 ASSIGNMENTS=2013 CHECKS=1548150	Wrong Cert. TT=8.591	Wrong Cert. TT=8.595	SAT TT=1.495 ASSIGNMENTS=2943 CHECKS=1970080	SAT TT=1.815 ASSIGNMENTS=6691 CHECKS=2403800	SAT TT=1.129	SAT TT=0.764 ASSIGNMENTS=2184 CHECKS=606330	SAT TT=0.376 ASSIGNMENTS=731 CHECKS=478232	? TT=233.332	SAT TT=1.215	SAT TT=1.208
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/routing/ normalized-s3-3-3-3.xml	SAT TT=0.177	SAT TT=22.11 CHECKS=13661100 NODES=1915	SAT TT=25.388 CHECKS=13904200 NODES=2489	SAT TT=3.411	SAT TT=0.98 CHECKS=184509	SAT TT=1.657 CHECKS=305361	SAT TT=1.728 ASSIGNMENTS=1095	SAT TT=12.906 ASSIGNMENTS=55946	SAT TT=83.182 CHECKS=187643000 NODES=961	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=0.208 ASSIGNMENTS=338 CHECKS=198751	SAT TT=0.205 ASSIGNMENTS=338 CHECKS=198751	Wrong Cert. TT=4.217	Wrong Cert. TT=3.997	SAT TT=0.177 ASSIGNMENTS=357 CHECKS=194747	SAT TT=0.956 ASSIGNMENTS=5230 CHECKS=1372310	SAT TT=0.976	SAT TT=1.303 ASSIGNMENTS=2366 CHECKS=733452	SAT TT=0.242 ASSIGNMENTS=597 CHECKS=284057	? TT=863.345	SAT TT=1.388	SAT TT=1.418
csp/pseudo/routing/ normalized-s3-3-3-4.xml	SAT TT=0.129	SAT TT=24.373 CHECKS=14317700 NODES=5497	SAT TT=36.949 CHECKS=22273400 NODES=10519	SAT TT=896.77	SAT TT=1.154 CHECKS=225197	SAT TT=0.581 CHECKS=102051	SAT TT=2.121 ASSIGNMENTS=1135	SAT TT=17.576 ASSIGNMENTS=83525	SAT TT=12.752 CHECKS=19297500 NODES=370	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.131 ASSIGNMENTS=216 CHECKS=92278	SAT TT=0.129 ASSIGNMENTS=216 CHECKS=92278	Wrong Cert. TT=3.937	Wrong Cert. TT=3.78	SAT TT=0.13 ASSIGNMENTS=271 CHECKS=129332	SAT TT=1.036 ASSIGNMENTS=5395 CHECKS=1472080	SAT TT=0.93	SAT TT=2.188 ASSIGNMENTS=4109 CHECKS=1605360	SAT TT=0.159 ASSIGNMENTS=311 CHECKS=153881	? TT=866.116	SAT TT=1.307	SAT TT=1.413
csp/pseudo/routing/ normalized-s3-3-3-5.xml	SAT TT=0.143	SAT TT=19.753 CHECKS=12106400 NODES=1401	SAT TT=1.987 CHECKS=481814 NODES=0	SAT TT=893.074	SAT TT=1.589 CHECKS=271924	SAT TT=1.363 CHECKS=234202	SAT TT=2.715 ASSIGNMENTS=3781	SAT TT=350.812 ASSIGNMENTS=1967270	SAT TT=9.807 CHECKS=38244 NODES=243	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=0.162 ASSIGNMENTS=273 CHECKS=128870	SAT TT=0.154 ASSIGNMENTS=273 CHECKS=128870	Wrong Cert. TT=3.839	Wrong Cert. TT=4.385	SAT TT=0.143 ASSIGNMENTS=268 CHECKS=128019	SAT TT=1.338 ASSIGNMENTS=6222 CHECKS=1946730	SAT TT=0.947	SAT TT=0.637 ASSIGNMENTS=1906 CHECKS=496858	SAT TT=0.161 ASSIGNMENTS=313 CHECKS=146457	? TT=207.688	SAT TT=1.158	SAT TT=1.189
csp/pseudo/routing/ normalized-s4-4-3-10.xml	SAT TT=1.851	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=714.126 CHECKS=113037000	SAT TT=346.673 CHECKS=53284700	SAT TT=67.755 ASSIGNMENTS=139606	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=585.333 ASSIGNMENTS=361214 CHECKS=418929000	SAT TT=618.491 ASSIGNMENTS=361214 CHECKS=418929000	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=627.07 ASSIGNMENTS=332522 CHECKS=471651000	SAT TT=116.662 ASSIGNMENTS=75487 CHECKS=87496900	SAT TT=8.992	SAT TT=745.97 ASSIGNMENTS=454432 CHECKS=401492000	SAT TT=569.279 ASSIGNMENTS=361214 CHECKS=418929000	? TT=228.42	SAT TT=1.851	SAT TT=2.103
csp/pseudo/routing/ normalized-s4-4-3-1.xml	SAT TT=2.412	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=348.164 CHECKS=65336600	? (TO) TT=1800.02	SAT TT=49.263 ASSIGNMENTS=104331	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=1143.33 ASSIGNMENTS=946779 CHECKS=901929000	SAT TT=1173.11 ASSIGNMENTS=946779 CHECKS=901929000	Wrong Cert. TT=475.067	Wrong Cert. TT=508.889	? (TO) TT=1800.09	SAT TT=31.884 ASSIGNMENTS=34430 CHECKS=28474600	? (TO) TT=1800.1	SAT TT=754.076 ASSIGNMENTS=583745 CHECKS=500745000	SAT TT=1108.59 ASSIGNMENTS=946779 CHECKS=901929000	? TT=220.063	SAT TT=2.412	SAT TT=3.221
csp/pseudo/routing/ normalized-s4-4-3-2.xml	SAT TT=2.062	? (TO) TT=1800.13	? (TO) TT=1800.11	SAT TT=1349.76	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=55.239 ASSIGNMENTS=127283	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=82.281 ASSIGNMENTS=64781 CHECKS=62146300	SAT TT=124.11 ASSIGNMENTS=64781 CHECKS=62146300	Wrong Cert. TT=236.383	Wrong Cert. TT=235.653	SAT TT=1111.19 ASSIGNMENTS=883703 CHECKS=936309000	SAT TT=1129.71 ASSIGNMENTS=812850 CHECKS=1025900000	SAT TT=93.435	? (TO) TT=1800.1	SAT TT=70.603 ASSIGNMENTS=64781 CHECKS=62146300	? TT=233.646	SAT TT=2.062	SAT TT=2.687
csp/pseudo/routing/ normalized-s4-4-3-3.xml	SAT TT=2.687	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=1252.36 CHECKS=258071000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.01	Wrong Cert. TT=227.703	Wrong Cert. TT=230.09	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=292.826	? (TO) TT=1800.05	? (TO) TT=1800.05	? TT=1273.83	SAT TT=4.396	SAT TT=2.687
csp/pseudo/routing/ normalized-s4-4-3-4.xml	SAT TT=1.942	? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.09	SAT TT=948.805 CHECKS=170461000	? (TO) TT=1800.11	SAT TT=9.58 ASSIGNMENTS=22126	SAT TT=774.258 ASSIGNMENTS=2055640	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=18.043 ASSIGNMENTS=8482 CHECKS=9559560	SAT TT=56.034 ASSIGNMENTS=8482 CHECKS=9559560	Wrong Cert. TT=1017.73	Wrong Cert. TT=973.514	SAT TT=1167.41 ASSIGNMENTS=811360 CHECKS=980026000	SAT TT=827.038 ASSIGNMENTS=558581 CHECKS=713791000	SAT TT=233.012	SAT TT=596.035 ASSIGNMENTS=455410 CHECKS=354587000	SAT TT=11.923 ASSIGNMENTS=8482 CHECKS=9559560	? TT=238.316	SAT TT=2.02	SAT TT=1.942
csp/pseudo/routing/ normalized-s4-4-3-5.xml	SAT TT=2.348	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.11	SAT TT=451.578 ASSIGNMENTS=1240490	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	SAT TT=1280.73 ASSIGNMENTS=729462 CHECKS=1024890000	SAT TT=466.262 ASSIGNMENTS=293825 CHECKS=369415000	SAT TT=103.319	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=250.146	SAT TT=2.348	SAT TT=3.079
csp/pseudo/routing/ normalized-s4-4-3-6.xml	SAT TT=1.577	? (TO) TT=1800.11	? (TO) TT=1800.07	SAT TT=898.929	? (TO) TT=1800.08	SAT TT=322.117 CHECKS=66114800	SAT TT=23.156 ASSIGNMENTS=61151	SAT TT=883.436 ASSIGNMENTS=2963120	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=9.913 ASSIGNMENTS=2157 CHECKS=2020660	SAT TT=45.882 ASSIGNMENTS=2157 CHECKS=2020660	Wrong Cert. TT=124.222	Wrong Cert. TT=115.512	SAT TT=189.918 ASSIGNMENTS=182121 CHECKS=156986000	SAT TT=45.711 ASSIGNMENTS=51641 CHECKS=43571700	SAT TT=3.408	SAT TT=1311.72 ASSIGNMENTS=1223880 CHECKS=1011160000	SAT TT=2.415 ASSIGNMENTS=2157 CHECKS=2020660	? TT=224.588	SAT TT=1.577	SAT TT=15.071
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/routing/ normalized-s4-4-3-7.xml	SAT TT=2.849	? (TO) TT=1800.17	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=214.74 CHECKS=40191200	SAT TT=118.69 ASSIGNMENTS=308413	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=78.628 ASSIGNMENTS=65127 CHECKS=57304100	SAT TT=113.435 ASSIGNMENTS=65127 CHECKS=57304100	Wrong Cert. TT=492.662	Wrong Cert. TT=501.154	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=83.266	SAT TT=936.736 ASSIGNMENTS=704807 CHECKS=497311000	SAT TT=68.592 ASSIGNMENTS=65127 CHECKS=57304100	? TT=230.073	SAT TT=2.849	SAT TT=8.755
csp/pseudo/routing/ normalized-s4-4-3-8.xml	SAT TT=1.898	SAT TT=193.134 CHECKS=127189000 NODES=57137	? (TO) TT=1800.11	SAT TT=1030.57	SAT TT=16.01 CHECKS=3359980	SAT TT=31.782 CHECKS=7173040	SAT TT=3.361 ASSIGNMENTS=6180	SAT TT=253.789 ASSIGNMENTS=828416	SAT TT=1130.57 CHECKS=2814190000 NODES=40957	? (TO) TT=1800.03	? (TO) TT=1800.01	SAT TT=48.233 ASSIGNMENTS=7609 CHECKS=4472960	SAT TT=48.21 ASSIGNMENTS=7609 CHECKS=4472960	Wrong Cert. TT=4.003	Wrong Cert. TT=3.697	SAT TT=16.701 ASSIGNMENTS=23841 CHECKS=18524800	SAT TT=5.035 ASSIGNMENTS=11778 CHECKS=5178070	SAT TT=1.971	SAT TT=97.975 ASSIGNMENTS=116307 CHECKS=51551200	SAT TT=4.393 ASSIGNMENTS=7609 CHECKS=4472960	? TT=866.223	SAT TT=1.898	SAT TT=2.552
csp/pseudo/routing/ normalized-s4-4-3-9.xml	SAT TT=2.248	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=950.913 ASSIGNMENTS=1613820	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	SAT TT=98.015 ASSIGNMENTS=46442 CHECKS=64568800	? (TO) TT=1800.06	SAT TT=1461.19 ASSIGNMENTS=802936 CHECKS=878707000	? (TO) TT=1800.05	? TT=250.912	SAT TT=2.248	SAT TT=2.357
csp/pseudo/ssa/ normalized-ssa-0432-003.xml	UNSAT TT=0.298	UNSAT TT=67.794 CHECKS=17319900 NODES=115972	UNSAT TT=47.533 CHECKS=10329100 NODES=83152	UNSAT TT=0.543	UNSAT TT=0.298 CHECKS=134508	UNSAT TT=0.384 CHECKS=296461	UNSAT TT=5.699 ASSIGNMENTS=7301	UNSAT TT=5.587 ASSIGNMENTS=7301	UNSAT TT=803.196 CHECKS=145049000 NODES=786797	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=43.326 ASSIGNMENTS=90077 CHECKS=45147400	UNSAT TT=76.576 ASSIGNMENTS=115966 CHECKS=17319900	UNSAT TT=4.312	UNSAT TT=4.283	UNSAT TT=25.691 ASSIGNMENTS=83408 CHECKS=36542000	UNSAT TT=33.26 ASSIGNMENTS=79659 CHECKS=47831900	UNSAT TT=3.296	UNSAT TT=82.105 ASSIGNMENTS=192025 CHECKS=88303200	UNSAT TT=31.735 ASSIGNMENTS=90077 CHECKS=45147400	UNSAT TT=4.201	UNSAT TT=1.312	UNSAT TT=1.807
csp/pseudo/ssa/ normalized-ssa-2670-130.xml	UNSAT TT=1.875	UNSAT TT=39.258 CHECKS=10931100 NODES=79830	UNSAT TT=53.557 CHECKS=15120200 NODES=105700	? (TO) TT=1800.03	UNSAT TT=223.818 CHECKS=85111100	UNSAT TT=107.613 CHECKS=48062400	UNSAT TT=179.144 ASSIGNMENTS=166440	UNSAT TT=174.23 ASSIGNMENTS=166440	UNSAT TT=827.407 CHECKS=57666800 NODES=194732	? (TO) TT=1800.01	? (TO) TT=1800.08	UNSAT TT=77.499 ASSIGNMENTS=62778 CHECKS=58091100	UNSAT TT=68.917 ASSIGNMENTS=142087 CHECKS=20250300	UNSAT TT=7.923	UNSAT TT=7.687	UNSAT TT=19.769 ASSIGNMENTS=20890 CHECKS=16809300	UNSAT TT=21.163 ASSIGNMENTS=26136 CHECKS=17147900	UNSAT TT=10.298	UNSAT TT=120.797 ASSIGNMENTS=149252 CHECKS=45695800	UNSAT TT=71.167 ASSIGNMENTS=62778 CHECKS=58091100	UNSAT TT=7.036	UNSAT TT=1.875	UNSAT TT=1.916
csp/pseudo/ssa/ normalized-ssa-2670-141.xml	UNSAT TT=1.618	UNSAT TT=115.509 CHECKS=39541600 NODES=423668	UNSAT TT=152.2 CHECKS=50122100 NODES=518679	? (TO) TT=1800.03	UNSAT TT=209.122 CHECKS=100853000	UNSAT TT=183.995 CHECKS=103197000	UNSAT TT=497.851 ASSIGNMENTS=481942	UNSAT TT=334.362 ASSIGNMENTS=481942	UNSAT TT=1612.47 CHECKS=168008000 NODES=608122	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=214.234 ASSIGNMENTS=290547 CHECKS=230652000	UNSAT TT=165.477 ASSIGNMENTS=566893 CHECKS=53130300	UNSAT TT=3.704	UNSAT TT=4.182	UNSAT TT=45.511 ASSIGNMENTS=75002 CHECKS=50539200	UNSAT TT=41.691 ASSIGNMENTS=66685 CHECKS=47819500	UNSAT TT=6.635	UNSAT TT=476.424 ASSIGNMENTS=521618 CHECKS=315898000	UNSAT TT=204.684 ASSIGNMENTS=290547 CHECKS=230652000	UNSAT TT=5.882	UNSAT TT=1.618	UNSAT TT=1.657
csp/pseudo/ssa/ normalized-ssa-6288-047.xml	UNSAT TT=2.52	UNSAT TT=22.678 CHECKS=791 NODES=0	UNSAT TT=23.555 CHECKS=791 NODES=0	UNSAT TT=10.197	UNSAT TT=17.256 CHECKS=45469	UNSAT TT=14.187 CHECKS=45469	UNSAT TT=30.377 ASSIGNMENTS=0	UNSAT TT=28.175 ASSIGNMENTS=0	UNSAT TT=345.964 CHECKS=2027 NODES=0	UNSAT TT=355.62 CHECKS=3956 NODES=0	UNSAT TT=401.097 CHECKS=3956 NODES=0	UNSAT TT=2.69 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.683 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=417.548	UNSAT TT=223.157	UNSAT TT=2.657 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.52 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=22.751	UNSAT TT=2.637 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=2.649 ASSIGNMENTS=0 CHECKS=45234	UNSAT TT=10.811	UNSAT TT=8.68	UNSAT TT=9.353
csp/pseudo/ssa/ normalized-ssa-7552-038.xml	SAT TT=0.336	SAT TT=3.985 CHECKS=61821 NODES=4149	SAT TT=6.493 CHECKS=97109 NODES=4100	SAT TT=1799.09	SAT TT=8.52 CHECKS=6664050	SAT TT=5.069 CHECKS=3594130	SAT TT=6.876 ASSIGNMENTS=1206	SAT TT=6.374 ASSIGNMENTS=1206	SAT TT=8.048 CHECKS=19334 NODES=3034	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=8.6 ASSIGNMENTS=1224 CHECKS=455939	SAT TT=10.506 ASSIGNMENTS=4145 CHECKS=61584	SAT TT=12.084	SAT TT=12.182	SAT TT=5.369 ASSIGNMENTS=11874 CHECKS=4911170	SAT TT=0.336 ASSIGNMENTS=216 CHECKS=20447	SAT TT=7.661	SAT TT=3.052 ASSIGNMENTS=3051 CHECKS=661481	SAT TT=0.732 ASSIGNMENTS=1224 CHECKS=455939	SAT TT=7.426	SAT TT=2.013	SAT TT=2.348
csp/pseudo/ssa/ normalized-ssa-7552-158.xml	SAT TT=0.26	SAT TT=3.473 CHECKS=15039 NODES=2726	SAT TT=5.482 CHECKS=43370 NODES=2726	SAT TT=0.89	SAT TT=6.006 CHECKS=4600080	SAT TT=4.03 CHECKS=3241330	SAT TT=4.948 ASSIGNMENTS=134	SAT TT=5.047 ASSIGNMENTS=134	SAT TT=6.947 CHECKS=17650 NODES=2757	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.291 ASSIGNMENTS=142 CHECKS=15319	SAT TT=0.292 ASSIGNMENTS=142 CHECKS=15319	SAT TT=11.312	SAT TT=11.538	SAT TT=0.26 ASSIGNMENTS=142 CHECKS=15322	SAT TT=0.276 ASSIGNMENTS=210 CHECKS=14574	SAT TT=20.763	SAT TT=2.887 ASSIGNMENTS=7016 CHECKS=652881	SAT TT=0.26 ASSIGNMENTS=135 CHECKS=13865	SAT TT=6.989	SAT TT=1.892	SAT TT=2.185
csp/pseudo/ssa/ normalized-ssa-7552-159.xml	SAT TT=0.271	SAT TT=3.23 CHECKS=15826 NODES=2728	SAT TT=4.947 CHECKS=43322 NODES=2728	SAT TT=0.891	SAT TT=7.027 CHECKS=5525820	SAT TT=3.985 CHECKS=3182480	SAT TT=5.187 ASSIGNMENTS=144	SAT TT=5.112 ASSIGNMENTS=144	SAT TT=6.52 CHECKS=17785 NODES=2757	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=0.299 ASSIGNMENTS=159 CHECKS=19325	SAT TT=0.3 ASSIGNMENTS=159 CHECKS=19325	SAT TT=11.323	SAT TT=11.493	SAT TT=0.29 ASSIGNMENTS=170 CHECKS=24861	SAT TT=0.285 ASSIGNMENTS=182 CHECKS=14459	SAT TT=15.832	SAT TT=2.653 ASSIGNMENTS=5221 CHECKS=490847	SAT TT=0.271 ASSIGNMENTS=153 CHECKS=15403	SAT TT=6.648	SAT TT=1.947	SAT TT=2.055
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/ssa/ normalized-ssa-7552-160.xml	SAT TT=0.292	SAT TT=3.362 CHECKS=18673 NODES=2788	SAT TT=4.447 CHECKS=51359 NODES=0	SAT TT=0.985	SAT TT=6.924 CHECKS=5644880	SAT TT=4.595 CHECKS=3379640	SAT TT=5.385 ASSIGNMENTS=139	SAT TT=5.152 ASSIGNMENTS=139	SAT TT=7.121 CHECKS=18907 NODES=2817	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=0.785 ASSIGNMENTS=1377 CHECKS=519920	SAT TT=0.783 ASSIGNMENTS=1377 CHECKS=519920	SAT TT=9.867	SAT TT=9.776	SAT TT=0.407 ASSIGNMENTS=451 CHECKS=133595	SAT TT=0.292 ASSIGNMENTS=175 CHECKS=16519	SAT TT=5.194	SAT TT=2.269 ASSIGNMENTS=3735 CHECKS=456520	SAT TT=0.31 ASSIGNMENTS=180 CHECKS=30534	SAT TT=6.648	SAT TT=2.217	SAT TT=2.484
csp/pseudo/ttp/ normalized-circ-4-3.xml	SAT TT=0.08	SAT TT=1.667 CHECKS=17194 NODES=488	SAT TT=1.336 CHECKS=4809 NODES=0	SAT TT=1.123	SAT TT=0.639 CHECKS=100384	SAT TT=0.61 CHECKS=98983	SAT TT=1.929 ASSIGNMENTS=302	SAT TT=1.593 ASSIGNMENTS=78	SAT TT=1.585 CHECKS=4097 NODES=148	SAT TT=2.203 CHECKS=1035660 NODES=7376	SAT TT=1.482 CHECKS=90225 NODES=160	SAT TT=0.123 ASSIGNMENTS=93 CHECKS=62074	SAT TT=0.129 ASSIGNMENTS=93 CHECKS=62074	Wrong UNSAT TT=2.237	Wrong UNSAT TT=2.311	SAT TT=0.122 ASSIGNMENTS=143 CHECKS=86225	SAT TT=0.103 ASSIGNMENTS=113 CHECKS=59010	SAT TT=1.261	SAT TT=0.08 ASSIGNMENTS=34 CHECKS=15972	SAT TT=0.122 ASSIGNMENTS=104 CHECKS=76973	SAT TT=5.125	SAT TT=1.394	SAT TT=1.155
csp/pseudo/ttp/ normalized-circ-8-3.xml	SAT TT=17.092	? (TO) TT=1800.15	SAT TT=810.724 CHECKS=43264900 NODES=198694	? (TO) TT=1800.03	SAT TT=320.371 CHECKS=15876400	SAT TT=349.909 CHECKS=17755200	SAT TT=80.539 ASSIGNMENTS=22310	? (TO) TT=1800.09	SAT TT=118.903 CHECKS=2921390 NODES=1939	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=134.499 ASSIGNMENTS=63426 CHECKS=7925780	SAT TT=133.902 ASSIGNMENTS=63426 CHECKS=7925780	Wrong UNSAT TT=535.641	Wrong UNSAT TT=565.076	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=767.23 ASSIGNMENTS=21464 CHECKS=416750000	? TT=488.945	SAT TT=17.092	SAT TT=27.931
csp/pseudo/ttp/ normalized-data-6-3.xml	SAT TT=3.588	SAT TT=12.839 CHECKS=584163 NODES=8984	SAT TT=13.694 CHECKS=747346 NODES=10248	? (TO) TT=1800.03	SAT TT=26.028 CHECKS=2210310	SAT TT=17.377 CHECKS=1300180	SAT TT=6.925 ASSIGNMENTS=2445	SAT TT=36.113 ASSIGNMENTS=27194	SAT TT=34.832 CHECKS=83261 NODES=677	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=16.787 ASSIGNMENTS=6593 CHECKS=499480	SAT TT=16.742 ASSIGNMENTS=6593 CHECKS=499480	Wrong UNSAT TT=11.489	Wrong UNSAT TT=11.573	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=94.262 ASSIGNMENTS=11862 CHECKS=57986600	SAT TT=11.633 ASSIGNMENTS=1536 CHECKS=7151380	? TT=217.951	SAT TT=3.689	SAT TT=3.588
csp/pseudo/ttp/ normalized-data-8-3.xml	SAT TT=17.557	? (TO) TT=1800.15	SAT TT=826.24 CHECKS=43264900 NODES=198694	? (TO) TT=1800.11	SAT TT=339.49 CHECKS=19143000	SAT TT=710.767 CHECKS=38680600	SAT TT=90.297 ASSIGNMENTS=22310	? (TO) TT=1800.14	SAT TT=120.084 CHECKS=2921390 NODES=1939	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=138.837 ASSIGNMENTS=63426 CHECKS=7925780	SAT TT=137.892 ASSIGNMENTS=63426 CHECKS=7925780	Wrong UNSAT TT=574.925	Wrong UNSAT TT=544.635	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=1006.39 ASSIGNMENTS=21464 CHECKS=416750000	? TT=353.593	SAT TT=17.557	SAT TT=27.876
csp/pseudo/uclid/ normalized-22s-smv.xml	UNSAT TT=25.823	UNSAT TT=718.577 CHECKS=119897000 NODES=508834	UNSAT TT=951.029 CHECKS=143993000 NODES=693595	? (TO) TT=1800.08	UNSAT TT=25.823 CHECKS=11009000	UNSAT TT=325.929 CHECKS=45990200	UNSAT TT=26.194 ASSIGNMENTS=0	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=384.459	UNSAT TT=31.104 ASSIGNMENTS=54207 CHECKS=22373800	? (TO) TT=1800.1	? TT=484.289	? (MO) TT=70.3	? (MO) TT=268.54
csp/pseudo/uclid/ normalized-37s-smv.xml	UNSAT TT=2.663	UNSAT TT=87.937 CHECKS=13267400 NODES=75094	UNSAT TT=98.718 CHECKS=12752900 NODES=77610	UNSAT TT=214.017	UNSAT TT=389.223 CHECKS=83135600	UNSAT TT=673.092 CHECKS=153648000	UNSAT TT=500.187 ASSIGNMENTS=483920	UNSAT TT=60.46 ASSIGNMENTS=46176	UNSAT TT=324.58 CHECKS=73676000 NODES=148518	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=24.976 ASSIGNMENTS=42669 CHECKS=16490000	UNSAT TT=90.854 ASSIGNMENTS=75094 CHECKS=13267400	UNSAT TT=10.086	UNSAT TT=9.285	UNSAT TT=122.844 ASSIGNMENTS=229315 CHECKS=141101000	UNSAT TT=71.94 ASSIGNMENTS=123784 CHECKS=78168300	UNSAT TT=54.053	? (TO) TT=1800.04	UNSAT TT=15.997 ASSIGNMENTS=42669 CHECKS=16490000	UNSAT TT=9.152	UNSAT TT=2.663	UNSAT TT=3.75
csp/pseudo/uclid/ normalized-43s-smv.xml	UNSAT TT=93.958	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.06	Wrong Cert. TT=204.394	Wrong Cert. TT=931.325	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=401.908	UNSAT TT=93.958	UNSAT TT=195.867
csp/pseudo/uclid/ normalized-44s-smv.xml	UNSAT TT=5.33	UNSAT TT=50.445 CHECKS=14484600 NODES=76972	UNSAT TT=45.018 CHECKS=11241800 NODES=77829	? (TO) TT=1800.07	UNSAT TT=103.26 CHECKS=11890700	UNSAT TT=96.554 CHECKS=13044800	UNSAT TT=73.293 ASSIGNMENTS=273394	? (TO) TT=1800.15	UNSAT TT=79.916 CHECKS=18628800 NODES=179941	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=492.506 ASSIGNMENTS=418658 CHECKS=714841000	UNSAT TT=52.668 ASSIGNMENTS=76963 CHECKS=14484600	Wrong Cert. TT=12.231	Wrong Cert. TT=12.65	UNSAT TT=67.703 ASSIGNMENTS=71468 CHECKS=97553200	UNSAT TT=175.009 ASSIGNMENTS=133658 CHECKS=261120000	UNSAT TT=3.955	? (TO) TT=1800.06	UNSAT TT=486.059 ASSIGNMENTS=418658 CHECKS=714841000	UNSAT TT=18.219	UNSAT TT=5.33	UNSAT TT=10.357
csp/pseudo/uclid/ normalized-46s-smv.xml	UNSAT TT=11.623	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	Wrong Cert. TT=39.757	Wrong Cert. TT=50.397	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=48.599	UNSAT TT=11.623	UNSAT TT=28.601
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/uclid/ normalized-blast-floppy1-4.xml	SAT TT=0.046	SAT TT=2.026 CHECKS=146231 NODES=241	SAT TT=1.999 CHECKS=147760 NODES=0	SAT TT=0.143	SAT TT=0.225 CHECKS=10535	SAT TT=0.214 CHECKS=10382	SAT TT=1.13 ASSIGNMENTS=268	SAT TT=1.251 ASSIGNMENTS=75	SAT TT=11.983 CHECKS=949685 NODES=595	SAT TT=4.368 CHECKS=162600 NODES=34	SAT TT=4.431 CHECKS=164786 NODES=24	SAT TT=0.061 ASSIGNMENTS=156 CHECKS=18373	SAT TT=0.06 ASSIGNMENTS=156 CHECKS=18373	Wrong Cert. TT=47.156	Wrong Cert. TT=41.801	SAT TT=0.046 ASSIGNMENTS=156 CHECKS=18373	SAT TT=0.069 ASSIGNMENTS=387 CHECKS=62613	SAT TT=0.704	SAT TT=20.502 ASSIGNMENTS=179234 CHECKS=12037300	SAT TT=0.051 ASSIGNMENTS=153 CHECKS=18196	SAT TT=303.234	SAT TT=26.056	SAT TT=120.061
csp/pseudo/uclid/ normalized-blast-floppy1-7.xml	UNSAT TT=0.666	UNSAT TT=663.041 CHECKS=273666000 NODES=430	UNSAT TT=911.183 CHECKS=382944000 NODES=410	UNSAT TT=2.763	UNSAT TT=1.079 CHECKS=3907	UNSAT TT=1.371 CHECKS=9043	UNSAT TT=4.718 ASSIGNMENTS=0	UNSAT TT=4.582 ASSIGNMENTS=0	UNSAT TT=351.755 CHECKS=434108000 NODES=2	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=0.723 ASSIGNMENTS=1 CHECKS=101483	UNSAT TT=0.722 ASSIGNMENTS=1 CHECKS=101483	? (problem) TT=49.452	? (problem) TT=49.241	UNSAT TT=0.666 ASSIGNMENTS=1 CHECKS=101483	UNSAT TT=39.211 ASSIGNMENTS=49980 CHECKS=46305600	UNSAT TT=84.165	UNSAT TT=0.725 ASSIGNMENTS=2 CHECKS=107550	UNSAT TT=0.849 ASSIGNMENTS=5 CHECKS=192020	? TT=426.602	? TT=167.298	? TT=170.784
csp/pseudo/uclid/ normalized-blast-tlan3.xml	SAT TT=8.804	SAT TT=306.078 CHECKS=12140800 NODES=52024	SAT TT=566.465 CHECKS=12767000 NODES=52040	SAT TT=24.592	SAT TT=101.289 CHECKS=12864400	SAT TT=99.173 CHECKS=1057690	SAT TT=648.564 ASSIGNMENTS=3233	? (TO) TT=1800.18	SAT TT=1643.71 CHECKS=51654100 NODES=25505	? (TO) TT=1800.02	? (TO) TT=1800.04	SAT TT=94.588 ASSIGNMENTS=19952 CHECKS=2651060	SAT TT=94.8 ASSIGNMENTS=19952 CHECKS=2651060	? (problem) TT=267.233	? (problem) TT=275.675	SAT TT=8.804 ASSIGNMENTS=1713 CHECKS=3047720	? (TO) TT=1800.12	SAT TT=48.804	? (TO) TT=1800.12	SAT TT=9.992 ASSIGNMENTS=1718 CHECKS=3027510	? TT=591.112	? TT=173.949	? TT=181.396
csp/pseudo/uclid/ normalized-cache-ibm-q-unbounded-Icl2arity-ucl.xml	UNSAT TT=140.591	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.16	? (TO) TT=1800.05	? TT=1174.03 CHECKS=370173 NODES=0	? TT=1191.08 CHECKS=370173 NODES=0	? (TO) TT=1800.02	? (TO) TT=1800	UNSAT TT=533.29	UNSAT TT=519.142	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=399.397	UNSAT TT=140.591	UNSAT TT=253.6
csp/pseudo/uclid/ normalized-elf-rf6.xml	UNSAT TT=0.014	UNSAT TT=0.862 CHECKS=525 NODES=18	UNSAT TT=0.856 CHECKS=811 NODES=0	UNSAT TT=0.052	UNSAT TT=0.023 CHECKS=1321	UNSAT TT=0.018 CHECKS=1203	UNSAT TT=0.764 ASSIGNMENTS=0	UNSAT TT=0.779 ASSIGNMENTS=0	UNSAT TT=0.857 CHECKS=749 NODES=5	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=0.028 ASSIGNMENTS=3 CHECKS=772	UNSAT TT=0.025 ASSIGNMENTS=3 CHECKS=772	Wrong Cert. TT=2.016	Wrong Cert. TT=1.906	UNSAT TT=0.016 ASSIGNMENTS=19 CHECKS=3367	UNSAT TT=0.056 ASSIGNMENTS=647 CHECKS=69852	UNSAT TT=0.533	UNSAT TT=0.015 ASSIGNMENTS=10 CHECKS=1206	UNSAT TT=0.014 ASSIGNMENTS=3 CHECKS=772	UNSAT TT=1.649	UNSAT TT=0.708	UNSAT TT=0.682
csp/pseudo/uclid/ normalized-elf-rf8.xml	UNSAT TT=7.811	UNSAT TT=26.774 CHECKS=2650340 NODES=16891	UNSAT TT=62.814 CHECKS=4753880 NODES=15612	? (TO) TT=1800.09	UNSAT TT=71.863 CHECKS=22158200	UNSAT TT=37.627 CHECKS=5729870	UNSAT TT=171.47 ASSIGNMENTS=11133	? (TO) TT=1800.1	UNSAT TT=110.433 CHECKS=1241940 NODES=2103	? (TO) TT=1800.06	? (TO) TT=1800.06	UNSAT TT=17.4 ASSIGNMENTS=3265 CHECKS=7081820	UNSAT TT=36.659 ASSIGNMENTS=16891 CHECKS=2650340	Wrong Cert. TT=83.67	Wrong Cert. TT=137.229	UNSAT TT=22.484 ASSIGNMENTS=8031 CHECKS=20453600	UNSAT TT=19.389 ASSIGNMENTS=26824 CHECKS=15519500	UNSAT TT=20.641	UNSAT TT=49.978 ASSIGNMENTS=32218 CHECKS=36334900	UNSAT TT=9.493 ASSIGNMENTS=3265 CHECKS=7081820	UNSAT TT=26.823	UNSAT TT=7.811	UNSAT TT=18.498
csp/pseudo/uclid/ normalized-elf-rf9.xml	UNSAT TT=34.642	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=1607.25 CHECKS=337241000	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1846.07	? TT=861.637 CHECKS=311880 NODES=0	? TT=876.546 CHECKS=309277 NODES=0	UNSAT TT=558.807 ASSIGNMENTS=43991 CHECKS=177041000	UNSAT TT=1012.26 ASSIGNMENTS=43991 CHECKS=177041000	Wrong Cert. TT=798.713	? (TO) TT=1800.08	UNSAT TT=331.337 ASSIGNMENTS=83654 CHECKS=267958000	UNSAT TT=198.187 ASSIGNMENTS=95084 CHECKS=139816000	? (TO) TT=1800.04	? (TO) TT=1800.14	UNSAT TT=220.647 ASSIGNMENTS=43991 CHECKS=177041000	UNSAT TT=135.041	UNSAT TT=34.642	UNSAT TT=109.246
csp/pseudo/uclid/ normalized-ooo-burch-dill-4-accl.xml	UNSAT TT=22.61	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=63.355	UNSAT TT=44.046	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=64.754	UNSAT TT=22.61	UNSAT TT=52.781
csp/pseudo/uclid/ normalized-ooo-burch-dill-8-accl.xml		? (TO) TT=1800.22	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.01	? TT=1020.73 CHECKS=311195 NODES=0	? TT=928.62 CHECKS=311195 NODES=0	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=678.531	UNSAT TT=425.42	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.05	? TT=1118.06	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/pseudo/uclid/ normalized-ooo-rf10.xml	UNSAT TT=59.254	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? TT=1556.28 CHECKS=25012000 NODES=600000	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.03	Wrong Cert. TT=468.035	Wrong Cert. TT=499.765	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=598.623	UNSAT TT=59.254	UNSAT TT=64.058
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudo/uclid/ normalized-ooo-rf8.xml	UNSAT TT=7.511	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.03	Wrong Cert. TT=82.715	Wrong Cert. TT=96.651	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=505.96	? (TO) TT=1800.1	? (TO) TT=1800.09	UNSAT TT=30.381	UNSAT TT=7.511	UNSAT TT=12.707
csp/pseudo/uclid/ normalized-ooo-tag10.xml	UNSAT TT=17.802	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	Wrong Cert. TT=146.604	Wrong Cert. TT=191.221	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	UNSAT TT=370.497	UNSAT TT=17.802	UNSAT TT=27.609

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	159	163	167	197	195	181	162	87	81	185	188	166	180	178	182	113	192	199
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	159	163	167	197	195	181	162	87	81	185	188	166	180	178	182	113	192	199
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	24	15	21	6	0	0	0	9	4	32	32	13	36	1	35	16
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0