CSP 2008 Competition: results by benchmark

Results by benchmark for category binary constraints in extension (2-ARY-EXT), subcategory random problems

This page displays the results of the different solvers for each benchmark for category binary constraints in extension (2-ARY-EXT), subcategory random problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
Concrete + CPS4J 2008-05-30
Concrete + CSP4J - Tabu Engine 2008-05-30
Concrete + CSP4J - WMC Engine 2008-05-30
cpHydra k_10
cpHydra k_40
galac E
galac M
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
spider 2008-06-14
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb30-15/ normalized-frb30-15-2_ext.xml	SAT TT=0.48	SAT TT=1.176 CHECKS=1297170 NODES=1277	SAT TT=1.227 CHECKS=1322770 NODES=1268	SAT TT=1.118	SAT TT=4.227 CHECKS=1528470	SAT TT=12.847 CHECKS=5075230	SAT TT=3.55 ASSIGNMENTS=4256	SAT TT=6.611 ASSIGNMENTS=4256	SAT TT=3.175 CHECKS=730474 NODES=9587	SAT TT=0.746 CHECKS=1117400 NODES=3869	? (TO) TT=1800.01	SAT TT=0.772 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=0.767 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=3.906	SAT TT=8.538	SAT TT=0.48 ASSIGNMENTS=5794 CHECKS=2176340	SAT TT=0.791 ASSIGNMENTS=10173 CHECKS=3325610	SAT TT=7.818	SAT TT=0.759 ASSIGNMENTS=8492 CHECKS=3243040	SAT TT=0.742 ASSIGNMENTS=8366 CHECKS=3192600	SAT TT=7.679	SAT TT=6.992 ASSIGNMENTS=3908 CHECKS=5281080	SAT TT=2.372	SAT TT=4.91
csp/frb30-15/ normalized-frb30-15-3_ext.xml	SAT TT=0.232	SAT TT=1.436 CHECKS=2200670 NODES=2076	SAT TT=1.374 CHECKS=2245180 NODES=2116	SAT TT=0.873	SAT TT=8.603 CHECKS=2986530	SAT TT=1.246 CHECKS=447432	SAT TT=3.11 ASSIGNMENTS=3205	SAT TT=2.925 ASSIGNMENTS=3205	SAT TT=1.391 CHECKS=255344 NODES=3153	SAT TT=0.847 CHECKS=1484340 NODES=5241	? (TO) TT=1800.01	SAT TT=0.618 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=0.611 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=3.224	SAT TT=3.781	SAT TT=0.251 ASSIGNMENTS=2502 CHECKS=981803	SAT TT=0.232 ASSIGNMENTS=3601 CHECKS=870854	SAT TT=2.914	SAT TT=0.564 ASSIGNMENTS=6040 CHECKS=2325810	SAT TT=0.55 ASSIGNMENTS=6409 CHECKS=2506560	SAT TT=10.667	SAT TT=1.787 ASSIGNMENTS=902 CHECKS=1402030	SAT TT=3.212	SAT TT=2.107
csp/frb30-15/ normalized-frb30-15-3-mgd_ext.xml	SAT TT=0.104	SAT TT=1.485 CHECKS=2050380 NODES=1974	SAT TT=1.56 CHECKS=2357120 NODES=2190	SAT TT=0.844	SAT TT=7.032 CHECKS=2593850	SAT TT=0.756 CHECKS=239356	SAT TT=2.013 ASSIGNMENTS=1872	SAT TT=2.193 ASSIGNMENTS=1872	SAT TT=0.625 CHECKS=20868 NODES=190	SAT TT=1.414 CHECKS=4458570 NODES=20899	? (TO) TT=1800.03	SAT TT=0.117 ASSIGNMENTS=946 CHECKS=358327	SAT TT=0.124 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.446	SAT TT=3.781	SAT TT=0.104 ASSIGNMENTS=829 CHECKS=311856	SAT TT=0.225 ASSIGNMENTS=3494 CHECKS=796360	SAT TT=1.298	SAT TT=0.124 ASSIGNMENTS=1188 CHECKS=412758	SAT TT=0.114 ASSIGNMENTS=946 CHECKS=358327	SAT TT=3.645	SAT TT=4.139 ASSIGNMENTS=2754 CHECKS=4194390	SAT TT=1.174	SAT TT=1.375
csp/frb30-15/ normalized-frb30-15-4_ext.xml	SAT TT=0.535	SAT TT=1.471 CHECKS=2149640 NODES=2044	SAT TT=1.476 CHECKS=2001490 NODES=1873	SAT TT=0.569	SAT TT=13.818 CHECKS=4880750	SAT TT=7.603 CHECKS=3098850	SAT TT=2.69 ASSIGNMENTS=3280	SAT TT=2.671 ASSIGNMENTS=3280	SAT TT=1.934 CHECKS=385312 NODES=4958	SAT TT=0.795 CHECKS=1387120 NODES=4912	SAT TT=1.094 CHECKS=2253980 NODES=4524	SAT TT=0.563 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=0.549 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=3.375	SAT TT=5.238	SAT TT=0.569 ASSIGNMENTS=6310 CHECKS=2346240	SAT TT=0.626 ASSIGNMENTS=8407 CHECKS=2575520	SAT TT=5.152	SAT TT=0.538 ASSIGNMENTS=6574 CHECKS=2432320	SAT TT=0.535 ASSIGNMENTS=5722 CHECKS=2187620	SAT TT=5.162	SAT TT=3.59 ASSIGNMENTS=1245 CHECKS=1766670	SAT TT=2.1	SAT TT=1.962
csp/frb30-15/ normalized-frb30-15-5-mgd_ext.xml	SAT TT=0.076	SAT TT=1.641 CHECKS=3631220 NODES=3306	SAT TT=1.642 CHECKS=3560470 NODES=3191	SAT TT=0.575	SAT TT=23.173 CHECKS=8382770	SAT TT=1.881 CHECKS=583739	SAT TT=1.315 ASSIGNMENTS=867	SAT TT=1.311 ASSIGNMENTS=867	SAT TT=1.028 CHECKS=159171 NODES=1547	SAT TT=0.951 CHECKS=2146380 NODES=10447	? (TO) TT=1800.03	SAT TT=0.086 ASSIGNMENTS=515 CHECKS=198122	SAT TT=0.087 ASSIGNMENTS=515 CHECKS=198122	SAT TT=2.669	SAT TT=2.176	SAT TT=0.167 ASSIGNMENTS=1652 CHECKS=656748	SAT TT=0.33 ASSIGNMENTS=4633 CHECKS=1235290	SAT TT=2.201	SAT TT=0.161 ASSIGNMENTS=1668 CHECKS=610834	SAT TT=0.076 ASSIGNMENTS=515 CHECKS=198122	SAT TT=4.008	SAT TT=1.455 ASSIGNMENTS=1473 CHECKS=2469010	SAT TT=1.161	SAT TT=1.591
csp/frb35-17/ normalized-frb35-17-1_ext.xml	SAT TT=1.414	SAT TT=4.267 CHECKS=17982000 NODES=13236	SAT TT=4.222 CHECKS=17404500 NODES=12846	SAT TT=1.711	SAT TT=20.617 CHECKS=6364460	SAT TT=10.276 CHECKS=3036390	SAT TT=5.716 ASSIGNMENTS=6144	SAT TT=5.852 ASSIGNMENTS=6144	SAT TT=5.297 CHECKS=1370210 NODES=14470	SAT TT=2.361 CHECKS=13076700 NODES=38829	? (TO) TT=1800.04	SAT TT=1.505 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=9.1 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=12.389	SAT TT=77.162	SAT TT=1.414 ASSIGNMENTS=13166 CHECKS=5972560	SAT TT=1.427 ASSIGNMENTS=14626 CHECKS=5926340	SAT TT=26.611	SAT TT=1.445 ASSIGNMENTS=13301 CHECKS=6010240	SAT TT=1.583 ASSIGNMENTS=14573 CHECKS=6635520	SAT TT=56.176	SAT TT=14.269 ASSIGNMENTS=7192 CHECKS=13335200	SAT TT=14.802	SAT TT=15.327
csp/frb35-17/ normalized-frb35-17-1-mgd_ext.xml	SAT TT=0.455	SAT TT=4.074 CHECKS=16945800 NODES=12506	SAT TT=4.231 CHECKS=17529200 NODES=12965	SAT TT=2.011	SAT TT=13.679 CHECKS=4191500	SAT TT=14.89 CHECKS=3985110	SAT TT=8.823 ASSIGNMENTS=9389	SAT TT=8.923 ASSIGNMENTS=9389	SAT TT=2.899 CHECKS=925837 NODES=7788	SAT TT=6.556 CHECKS=43404000 NODES=171674	? (TO) TT=1800.02	SAT TT=1.436 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=1.435 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=14.304	SAT TT=47.528	SAT TT=1.032 ASSIGNMENTS=9529 CHECKS=4391920	SAT TT=1.053 ASSIGNMENTS=10522 CHECKS=4107470	SAT TT=19.22	SAT TT=0.455 ASSIGNMENTS=3877 CHECKS=1665750	SAT TT=1.422 ASSIGNMENTS=11853 CHECKS=5633610	SAT TT=24.086	SAT TT=15.484 ASSIGNMENTS=12733 CHECKS=24512300	SAT TT=10.009	SAT TT=19.222
csp/frb35-17/ normalized-frb35-17-2_ext.xml	SAT TT=1.292	SAT TT=6.764 CHECKS=32619000 NODES=26172	SAT TT=7.012 CHECKS=30940000 NODES=24648	SAT TT=1.292	SAT TT=109.451 CHECKS=34546600	SAT TT=71.819 CHECKS=23712600	SAT TT=23.19 ASSIGNMENTS=30811	SAT TT=21.731 ASSIGNMENTS=30811	SAT TT=16.052 CHECKS=4642070 NODES=53894	SAT TT=32.967 CHECKS=239608000 NODES=719505	? (TO) TT=1800.08	SAT TT=9.625 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.263 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=10.045	SAT TT=122.021	SAT TT=6.453 ASSIGNMENTS=63528 CHECKS=27836600	SAT TT=1.626 ASSIGNMENTS=18543 CHECKS=7393470	SAT TT=119.057	SAT TT=1.646 ASSIGNMENTS=15967 CHECKS=6859800	SAT TT=2.796 ASSIGNMENTS=26903 CHECKS=11724300	SAT TT=217.797	SAT TT=41.848 ASSIGNMENTS=28391 CHECKS=45506800	SAT TT=22.863	SAT TT=4.26
csp/frb35-17/ normalized-frb35-17-2-mgd_ext.xml	SAT TT=1.04	SAT TT=7.054 CHECKS=31423100 NODES=25353	SAT TT=7.378 CHECKS=33449100 NODES=26916	SAT TT=1.206	SAT TT=144.091 CHECKS=44230300	SAT TT=95.396 CHECKS=24573400	SAT TT=14.69 ASSIGNMENTS=19103	SAT TT=14.864 ASSIGNMENTS=19103	SAT TT=12.415 CHECKS=4583950 NODES=43269	SAT TT=11.06 CHECKS=73984900 NODES=294981	? (TO) TT=1800.02	SAT TT=1.424 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=1.404 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=146.405	SAT TT=33.868	SAT TT=1.66 ASSIGNMENTS=15533 CHECKS=6716900	SAT TT=1.407 ASSIGNMENTS=15433 CHECKS=6100480	SAT TT=37.496	SAT TT=1.04 ASSIGNMENTS=9896 CHECKS=4141940	SAT TT=1.507 ASSIGNMENTS=13720 CHECKS=5967700	SAT TT=170.818	SAT TT=12.521 ASSIGNMENTS=10627 CHECKS=17243600	SAT TT=71.743	SAT TT=41.51
csp/frb35-17/ normalized-frb35-17-5_ext.xml	SAT TT=0.369	SAT TT=17.705 CHECKS=89886200 NODES=68293	SAT TT=16.402 CHECKS=89154700 NODES=67925	SAT TT=5.24	SAT TT=22.799 CHECKS=7397240	SAT TT=107.386 CHECKS=35261300	SAT TT=22.693 ASSIGNMENTS=29214	SAT TT=23.09 ASSIGNMENTS=29214	SAT TT=12.484 CHECKS=3462450 NODES=38369	SAT TT=3.645 CHECKS=20069400 NODES=60271	? (TO) TT=1800.06	SAT TT=9.848 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=9.46 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=34.783	SAT TT=194.048	SAT TT=3.725 ASSIGNMENTS=35072 CHECKS=16211400	SAT TT=0.465 ASSIGNMENTS=5323 CHECKS=1795740	SAT TT=35.136	SAT TT=2.086 ASSIGNMENTS=19113 CHECKS=8798110	SAT TT=2.434 ASSIGNMENTS=22150 CHECKS=10223400	SAT TT=393.296	SAT TT=0.369 ASSIGNMENTS=224 CHECKS=269523	SAT TT=56.455	SAT TT=76.906
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb40-19/ normalized-frb40-19-1_ext.xml	SAT TT=1.284	SAT TT=1.473 CHECKS=1486350 NODES=1112	SAT TT=1.284 CHECKS=1395190 NODES=997	SAT TT=9.429	SAT TT=444.893 CHECKS=113052000	SAT TT=476.993 CHECKS=135474000	SAT TT=28.796 ASSIGNMENTS=31770	SAT TT=29.867 ASSIGNMENTS=31770	SAT TT=29.909 CHECKS=8685270 NODES=81694	SAT TT=2.871 CHECKS=16974000 NODES=44106	? (TO) TT=1800.06	SAT TT=17.506 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=8.907 ASSIGNMENTS=1112 CHECKS=1486350	SAT TT=32.975	SAT TT=4.168	SAT TT=10.181 ASSIGNMENTS=81156 CHECKS=41923900	SAT TT=10.059 ASSIGNMENTS=81824 CHECKS=41651600	SAT TT=73.093	SAT TT=9.4 ASSIGNMENTS=78925 CHECKS=40697200	SAT TT=9.914 ASSIGNMENTS=79447 CHECKS=41005000	SAT TT=276.901	SAT TT=116.309 ASSIGNMENTS=50335 CHECKS=104712000	SAT TT=46.349	SAT TT=40.14
csp/frb40-19/ normalized-frb40-19-1-mgd_ext.xml	SAT TT=1.265	SAT TT=1.462 CHECKS=2543180 NODES=1893	SAT TT=1.265 CHECKS=1047030 NODES=744	SAT TT=9.971	SAT TT=703.803 CHECKS=189262000	SAT TT=29.645 CHECKS=5676960	SAT TT=29.123 ASSIGNMENTS=30271	SAT TT=29.503 ASSIGNMENTS=30271	SAT TT=15.225 CHECKS=5281000 NODES=40765	SAT TT=2.509 CHECKS=13794700 NODES=45990	? (TO) TT=1800.03	SAT TT=12.722 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=8.661 ASSIGNMENTS=1893 CHECKS=2543180	SAT TT=56.419	SAT TT=132.725	SAT TT=5.454 ASSIGNMENTS=43261 CHECKS=23091600	SAT TT=5.362 ASSIGNMENTS=41197 CHECKS=21070800	SAT TT=53.618	SAT TT=5.451 ASSIGNMENTS=43164 CHECKS=23027900	SAT TT=6.021 ASSIGNMENTS=44231 CHECKS=23776100	SAT TT=68.325	SAT TT=79.653 ASSIGNMENTS=49268 CHECKS=103013000	SAT TT=8.493	SAT TT=35.889
csp/frb40-19/ normalized-frb40-19-2_ext.xml	SAT TT=1.401	SAT TT=1.401 CHECKS=1968880 NODES=1491	SAT TT=1.492 CHECKS=2250610 NODES=1749	SAT TT=35.332	SAT TT=412.852 CHECKS=109540000	SAT TT=139.972 CHECKS=36091400	SAT TT=51.201 ASSIGNMENTS=62844	SAT TT=54.55 ASSIGNMENTS=62844	SAT TT=29.252 CHECKS=7789540 NODES=73522	SAT TT=51.095 CHECKS=365420000 NODES=951552	? (TO) TT=1800.04	SAT TT=22.778 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=9.219 ASSIGNMENTS=1491 CHECKS=1968880	SAT TT=67.686	SAT TT=383.43	SAT TT=14.262 ASSIGNMENTS=123409 CHECKS=63059400	SAT TT=8.142 ASSIGNMENTS=66182 CHECKS=33546700	SAT TT=108.797	SAT TT=9.856 ASSIGNMENTS=78210 CHECKS=40268900	SAT TT=15.19 ASSIGNMENTS=122062 CHECKS=62635700	SAT TT=333.918	SAT TT=168.113 ASSIGNMENTS=137602 CHECKS=273439000	SAT TT=80.349	SAT TT=194.22
csp/frb40-19/ normalized-frb40-19-2-mgd_ext.xml	SAT TT=1.833	SAT TT=2.053 CHECKS=4801120 NODES=3785	SAT TT=1.908 CHECKS=3823490 NODES=2909	SAT TT=11.158	SAT TT=344.771 CHECKS=88365000	SAT TT=161.67 CHECKS=32992300	SAT TT=16.038 ASSIGNMENTS=17329	SAT TT=17.402 ASSIGNMENTS=17329	SAT TT=24.206 CHECKS=8871590 NODES=69356	SAT TT=27.059 CHECKS=184894000 NODES=610905	? (TO) TT=1800	SAT TT=18.743 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=9.836 ASSIGNMENTS=3785 CHECKS=4801120	SAT TT=97.854	SAT TT=226.271	SAT TT=11.777 ASSIGNMENTS=88457 CHECKS=46753900	SAT TT=10.891 ASSIGNMENTS=89318 CHECKS=46667200	SAT TT=37.788	SAT TT=1.833 ASSIGNMENTS=14154 CHECKS=6941560	SAT TT=11.657 ASSIGNMENTS=87455 CHECKS=46217800	SAT TT=485.443	SAT TT=122.091 ASSIGNMENTS=48051 CHECKS=95391700	SAT TT=113.424	SAT TT=118.982
csp/frb40-19/ normalized-frb40-19-4-mgd_ext.xml	SAT TT=11.577	SAT TT=77.087 CHECKS=461083000 NODES=305197	SAT TT=80.622 CHECKS=451112000 NODES=297888	SAT TT=11.577	SAT TT=553.672 CHECKS=156444000	SAT TT=548.543 CHECKS=118406000	SAT TT=23.744 ASSIGNMENTS=24644	SAT TT=23.428 ASSIGNMENTS=24644	SAT TT=28.12 CHECKS=9476980 NODES=76187	SAT TT=21.197 CHECKS=152218000 NODES=494901	? (TO) TT=1800.01	SAT TT=33.728 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=84.116 ASSIGNMENTS=305197 CHECKS=461083000	SAT TT=1688.18	SAT TT=204.461	SAT TT=27.784 ASSIGNMENTS=213490 CHECKS=110685000	SAT TT=26.586 ASSIGNMENTS=201173 CHECKS=103774000	SAT TT=163.345	SAT TT=25.784 ASSIGNMENTS=196827 CHECKS=102505000	SAT TT=25.79 ASSIGNMENTS=199268 CHECKS=103528000	SAT TT=1395.18	SAT TT=306.9 ASSIGNMENTS=221577 CHECKS=455603000	SAT TT=183.355	SAT TT=192.929
csp/frb45-21/ normalized-frb45-21-1-mgd_ext.xml	SAT TT=6.494	SAT TT=6.494 CHECKS=30155700 NODES=19236	SAT TT=11.591 CHECKS=59132800 NODES=36674	SAT TT=850.839	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1393.89 ASSIGNMENTS=1528250	SAT TT=1419.21 ASSIGNMENTS=1528250	SAT TT=1445.67 CHECKS=453893000 NODES=3615300	SAT TT=76.666 CHECKS=591535000 NODES=1628720	? (TO) TT=1800.1	SAT TT=13.345 ASSIGNMENTS=19236 CHECKS=30155700	SAT TT=13.666 ASSIGNMENTS=19236 CHECKS=30155700	? (TO) TT=1800.02	? (TO) TT=1800.05	SAT TT=343.817 ASSIGNMENTS=2424200 CHECKS=1408590000	SAT TT=545.998 ASSIGNMENTS=3944080 CHECKS=2290690000	? (TO) TT=1800.12	SAT TT=732.982 ASSIGNMENTS=5262120 CHECKS=3087180000	SAT TT=726.1 ASSIGNMENTS=5272420 CHECKS=3090050000	? (TO) TT=1800.6	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/frb45-21/ normalized-frb45-21-2_ext.xml	SAT TT=56.465	SAT TT=281.714 CHECKS=1630410000 NODES=992992	SAT TT=267.357 CHECKS=1643270000 NODES=1001220	SAT TT=162.023	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=364.334 ASSIGNMENTS=415146	SAT TT=370.812 ASSIGNMENTS=415146	SAT TT=62.15 CHECKS=15563400 NODES=143904	SAT TT=93.128 CHECKS=734694000 NODES=1675070	? (TO) TT=1800.05	SAT TT=287.579 ASSIGNMENTS=992992 CHECKS=1630410000	SAT TT=266.698 ASSIGNMENTS=992992 CHECKS=1630410000	? (TO) TT=1800.08	? (TO) TT=1800.03	SAT TT=157.098 ASSIGNMENTS=1136460 CHECKS=634265000	SAT TT=74.146 ASSIGNMENTS=539450 CHECKS=299255000	? (TO) TT=1800.11	SAT TT=175.98 ASSIGNMENTS=1258950 CHECKS=701831000	SAT TT=171.932 ASSIGNMENTS=1255070 CHECKS=699122000	? (TO) TT=1800.13	SAT TT=1622.18 ASSIGNMENTS=1446710 CHECKS=2843190000	SAT TT=56.465	SAT TT=754.475
csp/frb45-21/ normalized-frb45-21-3_ext.xml	SAT TT=148.506	SAT TT=181.416 CHECKS=1051930000 NODES=646600	SAT TT=174.114 CHECKS=1006020000 NODES=617234	SAT TT=148.506	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT TT=487.654 ASSIGNMENTS=540035	SAT TT=491.026 ASSIGNMENTS=540035	SAT TT=1029.22 CHECKS=276126000 NODES=2527100	SAT TT=544.747 CHECKS=3873220000 NODES=8840730	? (TO) TT=1800.06	SAT TT=175.484 ASSIGNMENTS=646600 CHECKS=1051930000	SAT TT=175.45 ASSIGNMENTS=646600 CHECKS=1051930000	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=323.165 ASSIGNMENTS=2494740 CHECKS=1396940000	SAT TT=350.881 ASSIGNMENTS=2492820 CHECKS=1395820000	? (TO) TT=1800.1	SAT TT=371.761 ASSIGNMENTS=2688050 CHECKS=1496940000	SAT TT=306.679 ASSIGNMENTS=2298810 CHECKS=1279990000	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.04
csp/frb45-21/ normalized-frb45-21-4-mgd_ext.xml	SAT TT=33.995	SAT TT=464.625 CHECKS=2713320000 NODES=1581910	SAT TT=475.64 CHECKS=2712720000 NODES=1581220	SAT TT=212.315	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=468.567 ASSIGNMENTS=457995	SAT TT=456.294 ASSIGNMENTS=457995	SAT TT=258.271 CHECKS=86349900 NODES=637252	SAT TT=33.995 CHECKS=254471000 NODES=729987	? (TO) TT=1800.07	SAT TT=510.08 ASSIGNMENTS=740055 CHECKS=432669000	SAT TT=533.522 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=116.442 ASSIGNMENTS=813570 CHECKS=476930000	SAT TT=115.028 ASSIGNMENTS=809045 CHECKS=471841000	SAT TT=594.335	SAT TT=100.864 ASSIGNMENTS=703434 CHECKS=410663000	SAT TT=111.353 ASSIGNMENTS=740055 CHECKS=432669000	? (TO) TT=1800.16	SAT TT=1410.35 ASSIGNMENTS=771186 CHECKS=1766350000	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/frb45-21/ normalized-frb45-21-5_ext.xml	SAT TT=51.605	SAT TT=1205.42 CHECKS=7698180000 NODES=4608170	SAT TT=1192.99 CHECKS=7596680000 NODES=4566800	SAT TT=310.574	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=1417.99 ASSIGNMENTS=1634200	SAT TT=1379.45 ASSIGNMENTS=1634200	SAT TT=1715.49 CHECKS=447491000 NODES=4066110	SAT TT=1439.2 CHECKS=11194400000 NODES=25467000	? (TO) TT=1800.09	SAT TT=1217.77 ASSIGNMENTS=4608170 CHECKS=7698180000	SAT TT=616.419 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=146.384 ASSIGNMENTS=1131400 CHECKS=639110000	SAT TT=51.605 ASSIGNMENTS=395471 CHECKS=221508000	? (TO) TT=1800.06	SAT TT=228.028 ASSIGNMENTS=1635840 CHECKS=922834000	SAT TT=211.723 ASSIGNMENTS=1626250 CHECKS=917646000	? (TO) TT=1800.1	SAT TT=303.121 ASSIGNMENTS=134246 CHECKS=285696000	SAT TT=1169.44	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb50-23/ normalized-frb50-23-1_ext.xml	SAT TT=146.492	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=146.492 CHECKS=1173860000 NODES=2373200	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=695.497 ASSIGNMENTS=4795790 CHECKS=2908190000	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.11
csp/frb50-23/ normalized-frb50-23-2_ext.xml	SAT TT=723.997	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=723.997 CHECKS=5766420000 NODES=11594900	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.23	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/frb50-23/ normalized-frb50-23-3-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/frb50-23/ normalized-frb50-23-4_ext.xml	SAT TT=31.085	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.01	SAT TT=31.085 CHECKS=244381000 NODES=496298	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=1092.62 ASSIGNMENTS=7048760 CHECKS=4249560000	SAT TT=1217.49 ASSIGNMENTS=8344290 CHECKS=837528000	? (TO) TT=1800.12	SAT TT=53.65 ASSIGNMENTS=352179 CHECKS=210349000	SAT TT=1013.87 ASSIGNMENTS=7063340 CHECKS=4262920000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/frb50-23/ normalized-frb50-23-5-mgd_ext.xml	SAT TT=114.342	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.09	SAT TT=114.342 CHECKS=827626000 NODES=2125900	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=873.609 ASSIGNMENTS=5087140 CHECKS=3257300000	SAT TT=857.956 ASSIGNMENTS=5080320 CHECKS=3251550000	? (TO) TT=1800.09	SAT TT=497.023 ASSIGNMENTS=3112150 CHECKS=1970790000	SAT TT=892.124 ASSIGNMENTS=5637970 CHECKS=3604650000	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05
csp/frb53-24/ normalized-frb53-24-1_ext.xml	SAT TT=321.702	SAT TT=342.275 CHECKS=2177490000 NODES=1127960	SAT TT=321.702 CHECKS=2106410000 NODES=1085060	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	SAT TT=359.785 ASSIGNMENTS=1127960 CHECKS=2177490000	SAT TT=347.514 ASSIGNMENTS=1127960 CHECKS=2177490000	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
csp/frb53-24/ normalized-frb53-24-2-mgd_ext.xml		? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07
csp/frb53-24/ normalized-frb53-24-3-mgd_ext.xml	SAT TT=166.74	SAT TT=1232.69 CHECKS=7918130000 NODES=4090410	SAT TT=166.74 CHECKS=970369000 NODES=524253	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=483.531 CHECKS=3459900000 NODES=8210420	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/frb53-24/ normalized-frb53-24-5_ext.xml		? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/frb53-24/ normalized-frb53-24-5-mgd_ext.xml	SAT TT=357.979	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=357.979 CHECKS=2528940000 NODES=5884320	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/frb56-25/ normalized-frb56-25-2_ext.xml		? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-2-mgd_ext.xml		? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/frb56-25/ normalized-frb56-25-4_ext.xml	SAT TT=1708.24	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.02	SAT TT=1708.24 CHECKS=13675700000 NODES=24792100	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/frb56-25/ normalized-frb56-25-4-mgd_ext.xml	SAT TT=799.497	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=799.497 CHECKS=6301600000 NODES=13590800	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07
csp/frb56-25/ normalized-frb56-25-5-mgd_ext.xml	SAT TT=198.782	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=198.782 CHECKS=1553000000 NODES=3433000	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/frb59-26/ normalized-frb59-26-2_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/frb59-26/ normalized-frb59-26-3_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11
csp/frb59-26/ normalized-frb59-26-3-mgd_ext.xml		? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.15
csp/frb59-26/ normalized-frb59-26-4-mgd_ext.xml		? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/frb59-26/ normalized-frb59-26-5-mgd_ext.xml	SAT TT=60.642	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.08	SAT TT=60.642 CHECKS=442901000 NODES=937734	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/marc/ normalized-large-80-sat_ext.xml	SAT TT=9.085	SAT TT=11.884 CHECKS=34612 NODES=80	SAT TT=12.754 CHECKS=34612 NODES=0	? (problem) TT=276.855	SAT TT=16.323 CHECKS=4953	SAT TT=16.346 CHECKS=4953	SAT TT=13.289 ASSIGNMENTS=1	SAT TT=13.658 ASSIGNMENTS=1	SAT TT=49.399 CHECKS=35136 NODES=80	SAT TT=45.328 CHECKS=51592 NODES=0	SAT TT=46.868 CHECKS=51592 NODES=0	SAT TT=9.711 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.86 ASSIGNMENTS=0 CHECKS=9401	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=9.735 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.708 ASSIGNMENTS=0 CHECKS=9401	? (exit code) TT=69.884	SAT TT=9.085 ASSIGNMENTS=0 CHECKS=9401	SAT TT=9.568 ASSIGNMENTS=0 CHECKS=9401	SAT TT=45.187	SAT TT=26.696 ASSIGNMENTS=80 CHECKS=31232	? (MO) TT=24.37	? (MO) TT=23.46
csp/marc/ normalized-large-80-unsat_ext.xml	UNSAT TT=7.233	UNSAT TT=10.136 CHECKS=1146780 NODES=79	UNSAT TT=10.2 CHECKS=1181720 NODES=0	? (problem) TT=213.208	UNSAT TT=72.162 CHECKS=60976	UNSAT TT=51.007 CHECKS=40620	UNSAT TT=13.099 ASSIGNMENTS=1	UNSAT TT=12.609 ASSIGNMENTS=1	UNSAT TT=39.552 CHECKS=1281460 NODES=128	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=7.784 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=7.831 ASSIGNMENTS=123 CHECKS=22876	? (TO) TT=1800.06	UNSAT TT=317.066	UNSAT TT=7.233 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=8.737 ASSIGNMENTS=3028 CHECKS=486042	? (exit code) TT=30.115	UNSAT TT=7.637 ASSIGNMENTS=79 CHECKS=15801	UNSAT TT=7.699 ASSIGNMENTS=123 CHECKS=22876	UNSAT TT=37.149	UNSAT TT=22.689 ASSIGNMENTS=80 CHECKS=910185	? (MO) TT=21.34	? (MO) TT=20.36
csp/marc/ normalized-large-84-sat_ext.xml	SAT TT=11.008	SAT TT=15.023 CHECKS=49944 NODES=84	SAT TT=15.211 CHECKS=49944 NODES=0	? (problem) TT=329.025	SAT TT=16.189 CHECKS=5532	SAT TT=16.754 CHECKS=5532	SAT TT=15.886 ASSIGNMENTS=1	SAT TT=15.036 ASSIGNMENTS=1	SAT TT=55.895 CHECKS=87803 NODES=84	SAT TT=55.453 CHECKS=109463 NODES=0	SAT TT=50.726 CHECKS=109463 NODES=0	SAT TT=11.008 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.797 ASSIGNMENTS=0 CHECKS=10375	? (problem) TT=185.134	? (problem) TT=177.841	SAT TT=11.858 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.798 ASSIGNMENTS=0 CHECKS=10375	? (exit code) TT=29.635	SAT TT=11.841 ASSIGNMENTS=0 CHECKS=10375	SAT TT=11.67 ASSIGNMENTS=0 CHECKS=10375	SAT TT=50.11	SAT TT=35.453 ASSIGNMENTS=85 CHECKS=35028	? (MO) TT=26.8	? (MO) TT=26.84
csp/marc/ normalized-large-84-unsat_ext.xml	UNSAT TT=8.963	UNSAT TT=13.002 CHECKS=1239080 NODES=82	UNSAT TT=13.188 CHECKS=1413230 NODES=0	? (problem) TT=253.355	UNSAT TT=100.677 CHECKS=73853	UNSAT TT=59.284 CHECKS=41942	UNSAT TT=14.614 ASSIGNMENTS=1	UNSAT TT=16.017 ASSIGNMENTS=1	UNSAT TT=50.34 CHECKS=1375600 NODES=123	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=8.963 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=9.176 ASSIGNMENTS=130 CHECKS=25612	? (problem) TT=130.743	? (problem) TT=129.726	UNSAT TT=9.53 ASSIGNMENTS=83 CHECKS=17431	UNSAT TT=10.376 ASSIGNMENTS=3034 CHECKS=512771	? (exit code) TT=32.224	UNSAT TT=9.585 ASSIGNMENTS=83 CHECKS=17680	UNSAT TT=9.564 ASSIGNMENTS=130 CHECKS=25612	UNSAT TT=47.734	UNSAT TT=28.634 ASSIGNMENTS=84 CHECKS=1041690	? (MO) TT=22.545	? (MO) TT=22.72
csp/marc/ normalized-large-88-sat_ext.xml	SAT TT=13.162	SAT TT=18.295 CHECKS=41489 NODES=88	SAT TT=16.523 CHECKS=41489 NODES=0	? (problem) TT=369.383	SAT TT=18.862 CHECKS=5939	SAT TT=16.931 CHECKS=5939	SAT TT=26.639 ASSIGNMENTS=1	SAT TT=27.684 ASSIGNMENTS=1	SAT TT=69.672 CHECKS=79561 NODES=88	SAT TT=66.237 CHECKS=99998 NODES=0	SAT TT=66.47 CHECKS=99998 NODES=0	SAT TT=14.165 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.211 ASSIGNMENTS=0 CHECKS=11397	? (problem) TT=296.501	? (problem) TT=322.321	SAT TT=14.173 ASSIGNMENTS=0 CHECKS=11397	SAT TT=13.162 ASSIGNMENTS=0 CHECKS=11397	? (exit code) TT=109.609	SAT TT=14.912 ASSIGNMENTS=0 CHECKS=11397	SAT TT=14.06 ASSIGNMENTS=0 CHECKS=11397	SAT TT=58.956	SAT TT=41.011 ASSIGNMENTS=88 CHECKS=34037	? (MO) TT=28.16	? (MO) TT=30.202
csp/marc/ normalized-large-88-unsat_ext.xml	UNSAT TT=10.484	UNSAT TT=13.885 CHECKS=1349870 NODES=81	UNSAT TT=14.046 CHECKS=1645020 NODES=0	? (problem) TT=297.964	Signal TT=18.626	Signal TT=19.431	UNSAT TT=18.222 ASSIGNMENTS=1	UNSAT TT=17.078 ASSIGNMENTS=1	UNSAT TT=57.322 CHECKS=1716860 NODES=141	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=11.379 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=11.282 ASSIGNMENTS=136 CHECKS=27629	? (problem) TT=114.674	? (problem) TT=115.175	UNSAT TT=10.554 ASSIGNMENTS=87 CHECKS=19402	UNSAT TT=13.092 ASSIGNMENTS=3041 CHECKS=538448	? (exit code) TT=27.745	UNSAT TT=10.484 ASSIGNMENTS=87 CHECKS=19315	UNSAT TT=11.159 ASSIGNMENTS=136 CHECKS=27629	UNSAT TT=52.226	UNSAT TT=32.681 ASSIGNMENTS=88 CHECKS=1220360	? TT=161.374	? (MO) TT=25.038
csp/marc/ normalized-large-92-sat_ext.xml	SAT TT=15.846	SAT TT=19.524 CHECKS=51620 NODES=92	SAT TT=21.425 CHECKS=51620 NODES=0	? (problem) TT=468.339	? TT=13.722	? TT=12.909	? (problem) TT=40.885	? (problem) TT=40.01	SAT TT=84.206 CHECKS=56908 NODES=92	SAT TT=79.75 CHECKS=79336 NODES=0	SAT TT=77.373 CHECKS=79336 NODES=0	SAT TT=17.712 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.23 ASSIGNMENTS=0 CHECKS=12467	? (problem) TT=314.918	? (problem) TT=307.074	SAT TT=16.034 ASSIGNMENTS=0 CHECKS=12467	SAT TT=16.092 ASSIGNMENTS=0 CHECKS=12467	? (exit code) TT=37.853	SAT TT=15.846 ASSIGNMENTS=0 CHECKS=12467	SAT TT=17.156 ASSIGNMENTS=0 CHECKS=12467	SAT TT=70.487	SAT TT=49.051 ASSIGNMENTS=92 CHECKS=58017	? (MO) TT=34.28	? (MO) TT=34.32
csp/marc/ normalized-large-92-unsat_ext.xml	UNSAT TT=12.586	UNSAT TT=16.578 CHECKS=1691770 NODES=91	UNSAT TT=16.317 CHECKS=1909970 NODES=0	? (problem) TT=348.758	Signal TT=21.23	Signal TT=21.084	UNSAT TT=22.33 ASSIGNMENTS=1	UNSAT TT=24.072 ASSIGNMENTS=1	UNSAT TT=62.843 CHECKS=1952880 NODES=147	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=13.831 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=13.655 ASSIGNMENTS=142 CHECKS=30355	? (problem) TT=319.299	? (problem) TT=318.085	UNSAT TT=12.797 ASSIGNMENTS=91 CHECKS=21022	UNSAT TT=15.677 ASSIGNMENTS=3042 CHECKS=561984	? (exit code) TT=34.357	UNSAT TT=12.586 ASSIGNMENTS=91 CHECKS=20840	UNSAT TT=13.624 ASSIGNMENTS=142 CHECKS=30355	UNSAT TT=63.759	UNSAT TT=38.773 ASSIGNMENTS=92 CHECKS=1376540	? (MO) TT=28.36	? (MO) TT=26.926
csp/marc/ normalized-large-96-sat_ext.xml	SAT TT=18.77	SAT TT=25.172 CHECKS=62678 NODES=96	SAT TT=22.67 CHECKS=62678 NODES=0	? (problem) TT=543.195	? TT=15.68	? TT=15.561	? (problem) TT=38.47	? (problem) TT=40.999	SAT TT=103.741 CHECKS=48181 NODES=96	SAT TT=94.933 CHECKS=72297 NODES=0	SAT TT=97.055 CHECKS=72297 NODES=0	SAT TT=20.426 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	? (problem) TT=298.973	? (problem) TT=301.079	SAT TT=20.398 ASSIGNMENTS=0 CHECKS=13585	SAT TT=20.455 ASSIGNMENTS=0 CHECKS=13585	? (exit code) TT=115.378	SAT TT=21.135 ASSIGNMENTS=0 CHECKS=13585	SAT TT=18.77 ASSIGNMENTS=0 CHECKS=13585	SAT TT=113.776	SAT TT=54.726 ASSIGNMENTS=103 CHECKS=67904	? (MO) TT=39.3	? (MO) TT=36.89
csp/marc/ normalized-large-96-unsat_ext.xml	UNSAT TT=15.143	UNSAT TT=20.664 CHECKS=1934710 NODES=95	UNSAT TT=20.578 CHECKS=2215540 NODES=0	? (problem) TT=426.432	? TT=12.262	? TT=13.04	? (problem) TT=42.723	? (problem) TT=43.281	UNSAT TT=82.913 CHECKS=2209300 NODES=153	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=16.876 ASSIGNMENTS=149 CHECKS=33400	UNSAT TT=16.488 ASSIGNMENTS=149 CHECKS=33400	? (problem) TT=308.015	? (problem) TT=325.828	UNSAT TT=15.889 ASSIGNMENTS=95 CHECKS=23086	UNSAT TT=17.307 ASSIGNMENTS=3052 CHECKS=587597	? (exit code) TT=44.863	UNSAT TT=16.057 ASSIGNMENTS=95 CHECKS=22991	UNSAT TT=15.143 ASSIGNMENTS=149 CHECKS=33400	? TT=119.82	UNSAT TT=46.805 ASSIGNMENTS=95 CHECKS=1561180	? TT=183.309	? (MO) TT=32.531
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-23/ normalized-rand-23-23-253-131-46021_ext.xml	UNSAT TT=22.416	UNSAT TT=96.493 CHECKS=533169000 NODES=398553	UNSAT TT=94.597 CHECKS=532351000 NODES=398015	UNSAT TT=22.416	UNSAT TT=735.712 CHECKS=218785000	UNSAT TT=500.384 CHECKS=92168600	UNSAT TT=142.58 ASSIGNMENTS=188574	UNSAT TT=150.896 ASSIGNMENTS=188574	UNSAT TT=117.499 CHECKS=29226500 NODES=439459	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=44.885 ASSIGNMENTS=384589 CHECKS=157639000	UNSAT TT=96.014 ASSIGNMENTS=398553 CHECKS=533169000	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=34.325 ASSIGNMENTS=388764 CHECKS=159740000	UNSAT TT=39.227 ASSIGNMENTS=407900 CHECKS=166703000	? (TO) TT=1800.12	UNSAT TT=36.352 ASSIGNMENTS=412299 CHECKS=169003000	UNSAT TT=34.284 ASSIGNMENTS=384589 CHECKS=157639000	? (TO) TT=1800.08	UNSAT TT=493.428 ASSIGNMENTS=409929 CHECKS=622859000	? (TO) TT=1800.09	? (TO) TT=1800.04
csp/rand-2-23/ normalized-rand-23-23-253-131-47021_ext.xml	UNSAT TT=19.782	UNSAT TT=89.888 CHECKS=539958000 NODES=401195	UNSAT TT=91.112 CHECKS=543707000 NODES=404017	UNSAT TT=19.782	UNSAT TT=889.333 CHECKS=255497000	UNSAT TT=508.22 CHECKS=89201600	UNSAT TT=133.043 ASSIGNMENTS=181934	UNSAT TT=148.274 ASSIGNMENTS=181934	UNSAT TT=124.334 CHECKS=29145300 NODES=434935	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=45.147 ASSIGNMENTS=395034 CHECKS=163451000	UNSAT TT=98.222 ASSIGNMENTS=401195 CHECKS=539958000	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=38.148 ASSIGNMENTS=402640 CHECKS=165885000	UNSAT TT=37.567 ASSIGNMENTS=390675 CHECKS=160940000	? (TO) TT=1800.09	UNSAT TT=36.141 ASSIGNMENTS=394360 CHECKS=162732000	UNSAT TT=37.55 ASSIGNMENTS=395034 CHECKS=163451000	? (TO) TT=1800.15	UNSAT TT=518.774 ASSIGNMENTS=396010 CHECKS=604015000	? (TO) TT=1800.09	? (TO) TT=1800.06
csp/rand-2-23/ normalized-rand-23-23-253-131-48021_ext.xml	SAT TT=5.175	SAT TT=39.719 CHECKS=217622000 NODES=162155	SAT TT=38.687 CHECKS=212054000 NODES=158138	SAT TT=5.175	SAT TT=290.696 CHECKS=87249600	SAT TT=160.976 CHECKS=30004200	SAT TT=105.624 ASSIGNMENTS=132336	SAT TT=117.735 ASSIGNMENTS=132336	SAT TT=43.979 CHECKS=10069800 NODES=150437	SAT TT=8.491 CHECKS=59319000 NODES=117182	SAT TT=1566.28 CHECKS=10502000000 NODES=5155690	SAT TT=20.47 ASSIGNMENTS=129255 CHECKS=52884500	SAT TT=44.253 ASSIGNMENTS=162155 CHECKS=217622000	SAT TT=169.142	? (TO) TT=1800.03	SAT TT=22.376 ASSIGNMENTS=251997 CHECKS=103514000	SAT TT=11.072 ASSIGNMENTS=126740 CHECKS=51486200	SAT TT=1514.25	SAT TT=6.221 ASSIGNMENTS=64139 CHECKS=26278600	SAT TT=12.395 ASSIGNMENTS=129255 CHECKS=52884500	? (TO) TT=1800.16	SAT TT=116.133 ASSIGNMENTS=64131 CHECKS=97844800	SAT TT=1198.47	? (TO) TT=1800.05
csp/rand-2-23/ normalized-rand-23-23-253-131-49021_ext.xml	SAT TT=3.386	SAT TT=14.107 CHECKS=72465500 NODES=54631	SAT TT=13.762 CHECKS=70516800 NODES=53062	SAT TT=15.875	SAT TT=801.051 CHECKS=229143000	SAT TT=351.196 CHECKS=66421000	SAT TT=12.638 ASSIGNMENTS=14425	SAT TT=13.829 ASSIGNMENTS=14425	SAT TT=76.191 CHECKS=17410300 NODES=259781	SAT TT=54.062 CHECKS=409586000 NODES=809278	? (TO) TT=1800.07	SAT TT=12.42 ASSIGNMENTS=49308 CHECKS=20104800	SAT TT=21.444 ASSIGNMENTS=54631 CHECKS=72465500	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=3.386 ASSIGNMENTS=35898 CHECKS=14618900	SAT TT=15.201 ASSIGNMENTS=161070 CHECKS=65825400	SAT TT=1310.13	SAT TT=19.182 ASSIGNMENTS=200759 CHECKS=82712000	SAT TT=4.684 ASSIGNMENTS=49308 CHECKS=20104800	? (TO) TT=1800.17	SAT TT=153.363 ASSIGNMENTS=144913 CHECKS=224387000	SAT TT=288.602	? (TO) TT=1800.09
csp/rand-2-23/ normalized-rand-23-23-253-131-50021_ext.xml	SAT TT=3.707	SAT TT=68.224 CHECKS=372168000 NODES=283408	SAT TT=68.054 CHECKS=372414000 NODES=283348	SAT TT=18.381	SAT TT=249.154 CHECKS=69532500	SAT TT=68.779 CHECKS=12632900	SAT TT=142.248 ASSIGNMENTS=198953	SAT TT=170.758 ASSIGNMENTS=198953	SAT TT=106.136 CHECKS=24283500 NODES=369051	SAT TT=3.764 CHECKS=25738400 NODES=50817	? (TO) TT=1800.02	SAT TT=19.124 ASSIGNMENTS=120701 CHECKS=48578800	SAT TT=71.246 ASSIGNMENTS=283408 CHECKS=372168000	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=30.627 ASSIGNMENTS=353961 CHECKS=143629000	SAT TT=18.403 ASSIGNMENTS=197022 CHECKS=79727800	SAT TT=1521.66	SAT TT=3.707 ASSIGNMENTS=42496 CHECKS=16971700	SAT TT=11.383 ASSIGNMENTS=120701 CHECKS=48578800	? (TO) TT=1800.14	SAT TT=89.904 ASSIGNMENTS=24708 CHECKS=35504300	SAT TT=1316.77	SAT TT=34.992
csp/rand-2-23/ normalized-rand-23-23-253-131-51021_ext.xml	UNSAT TT=23.169	UNSAT TT=101.144 CHECKS=562904000 NODES=422183	UNSAT TT=101.69 CHECKS=561518000 NODES=421807	UNSAT TT=23.169	UNSAT TT=950.811 CHECKS=261326000	UNSAT TT=502.703 CHECKS=94820100	UNSAT TT=161.519 ASSIGNMENTS=206864	UNSAT TT=166.036 ASSIGNMENTS=206864	UNSAT TT=132.303 CHECKS=30132700 NODES=453877	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=49.526 ASSIGNMENTS=441309 CHECKS=180994000	UNSAT TT=47.019 ASSIGNMENTS=441309 CHECKS=180994000	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=39.7 ASSIGNMENTS=449184 CHECKS=183500000	UNSAT TT=41.123 ASSIGNMENTS=431923 CHECKS=176336000	? (TO) TT=1800.1	UNSAT TT=39.02 ASSIGNMENTS=439242 CHECKS=179912000	UNSAT TT=39.179 ASSIGNMENTS=441309 CHECKS=180994000	? (TO) TT=1800.2	UNSAT TT=505.358 ASSIGNMENTS=419396 CHECKS=637345000	? (TO) TT=1800.13	? (TO) TT=1800.05
csp/rand-2-23/ normalized-rand-23-23-253-131-52021_ext.xml	UNSAT TT=21.389	UNSAT TT=91.948 CHECKS=512578000 NODES=378497	UNSAT TT=91.224 CHECKS=511852000 NODES=377631	UNSAT TT=21.389	UNSAT TT=843.612 CHECKS=249713000	UNSAT TT=618.456 CHECKS=112021000	UNSAT TT=131.312 ASSIGNMENTS=178927	UNSAT TT=156.532 ASSIGNMENTS=178927	UNSAT TT=120.828 CHECKS=27564700 NODES=411870	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=42.802 ASSIGNMENTS=397901 CHECKS=164363000	UNSAT TT=92.549 ASSIGNMENTS=378497 CHECKS=512578000	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=35.046 ASSIGNMENTS=380924 CHECKS=157006000	UNSAT TT=37.316 ASSIGNMENTS=388200 CHECKS=159503000	? (TO) TT=1800.1	UNSAT TT=36.122 ASSIGNMENTS=378555 CHECKS=156225000	UNSAT TT=37.981 ASSIGNMENTS=397901 CHECKS=164363000	? (TO) TT=1800.11	UNSAT TT=320.485 ASSIGNMENTS=370652 CHECKS=568510000	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/rand-2-23/ normalized-rand-23-23-253-131-53021_ext.xml	SAT TT=2.822	SAT TT=75.704 CHECKS=443801000 NODES=329021	SAT TT=74.313 CHECKS=440558000 NODES=326414	SAT TT=11.146	SAT TT=103.316 CHECKS=26967500	SAT TT=337.099 CHECKS=63798300	SAT TT=80.592 ASSIGNMENTS=103260	SAT TT=85.174 ASSIGNMENTS=103260	SAT TT=67.004 CHECKS=16882700 NODES=251429	SAT TT=122.304 CHECKS=1009520000 NODES=1994700	? (TO) TT=1800.09	SAT TT=35.733 ASSIGNMENTS=302971 CHECKS=125038000	SAT TT=36.774 ASSIGNMENTS=302971 CHECKS=125038000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=2.822 ASSIGNMENTS=29404 CHECKS=11982400	SAT TT=21.406 ASSIGNMENTS=227447 CHECKS=93031600	SAT TT=1077.57	SAT TT=4.695 ASSIGNMENTS=48401 CHECKS=19792500	SAT TT=27.815 ASSIGNMENTS=302971 CHECKS=125038000	? (TO) TT=1800.12	SAT TT=71.49 ASSIGNMENTS=62038 CHECKS=95682100	SAT TT=418.232	? (TO) TT=1800.06
csp/rand-2-23/ normalized-rand-23-23-253-131-54021_ext.xml	SAT TT=0.811	SAT TT=19.193 CHECKS=100834000 NODES=76678	SAT TT=18.42 CHECKS=96406500 NODES=73599	SAT TT=12.762	SAT TT=231.606 CHECKS=65259300	SAT TT=2.26 CHECKS=364396	SAT TT=88.625 ASSIGNMENTS=121725	SAT TT=105.304 ASSIGNMENTS=121725	SAT TT=0.811 CHECKS=27399 NODES=272	SAT TT=5.59 CHECKS=38974300 NODES=76975	SAT TT=260.178 CHECKS=1877970000 NODES=949100	SAT TT=9.187 ASSIGNMENTS=15951 CHECKS=6633180	SAT TT=26.56 ASSIGNMENTS=76678 CHECKS=100834000	? (TO) TT=1800.08	SAT TT=1381.35	SAT TT=16.48 ASSIGNMENTS=184923 CHECKS=75986800	SAT TT=5.593 ASSIGNMENTS=65172 CHECKS=25897900	SAT TT=281.58	SAT TT=21.12 ASSIGNMENTS=219847 CHECKS=89707600	SAT TT=1.465 ASSIGNMENTS=15951 CHECKS=6633180	? (TO) TT=1800.09	SAT TT=290.165 ASSIGNMENTS=304000 CHECKS=460191000	SAT TT=188.53	SAT TT=805.344
csp/rand-2-23/ normalized-rand-23-23-253-131-55021_ext.xml	UNSAT TT=22.347	UNSAT TT=95.572 CHECKS=530105000 NODES=396088	UNSAT TT=96.247 CHECKS=527259000 NODES=393986	UNSAT TT=22.347	UNSAT TT=933.805 CHECKS=259278000	UNSAT TT=463.729 CHECKS=90367800	UNSAT TT=137.084 ASSIGNMENTS=185544	UNSAT TT=160.234 ASSIGNMENTS=185544	UNSAT TT=111.782 CHECKS=28241200 NODES=425598	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=45.841 ASSIGNMENTS=404123 CHECKS=165423000	UNSAT TT=97.106 ASSIGNMENTS=396088 CHECKS=530105000	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=38.627 ASSIGNMENTS=434730 CHECKS=178183000	UNSAT TT=40.934 ASSIGNMENTS=434318 CHECKS=177530000	? (TO) TT=1800.08	UNSAT TT=39.203 ASSIGNMENTS=412282 CHECKS=169276000	UNSAT TT=38.137 ASSIGNMENTS=404123 CHECKS=165423000	? (TO) TT=1800.11	UNSAT TT=498.465 ASSIGNMENTS=416351 CHECKS=630602000	? (TO) TT=1800.1	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-24/ normalized-rand-24-24-276-139-48021_ext.xml	SAT TT=2.009	SAT TT=66.229 CHECKS=360552000 NODES=257174	SAT TT=60.053 CHECKS=361825000 NODES=257652	SAT TT=3.286	SAT TT=1762.96 CHECKS=499084000	SAT TT=4.766 CHECKS=771811	SAT TT=59.735 ASSIGNMENTS=68090	SAT TT=58.085 ASSIGNMENTS=68090	SAT TT=211.674 CHECKS=46403600 NODES=686833	SAT TT=5.98 CHECKS=40404300 NODES=73145	? (TO) TT=1800.08	SAT TT=27.173 ASSIGNMENTS=204412 CHECKS=88954500	SAT TT=68.279 ASSIGNMENTS=257174 CHECKS=360552000	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=20.824 ASSIGNMENTS=217758 CHECKS=94882100	SAT TT=10.508 ASSIGNMENTS=103299 CHECKS=44579700	SAT TT=372.304	SAT TT=77.232 ASSIGNMENTS=736516 CHECKS=322795000	SAT TT=21.255 ASSIGNMENTS=204412 CHECKS=88954500	? (TO) TT=1800.14	SAT TT=2.009 ASSIGNMENTS=748 CHECKS=1172300	? (TO) TT=1800.04	SAT TT=479.011
csp/rand-2-24/ normalized-rand-24-24-276-139-49021_ext.xml	UNSAT TT=48.246	UNSAT TT=200.805 CHECKS=1207730000 NODES=839841	UNSAT TT=213.756 CHECKS=1204170000 NODES=836873	UNSAT TT=48.246	? (TO) TT=1800.1	UNSAT TT=918.495 CHECKS=167487000	UNSAT TT=329.217 ASSIGNMENTS=392312	UNSAT TT=315.412 ASSIGNMENTS=392312	UNSAT TT=269.181 CHECKS=62349900 NODES=910012	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=93.34 ASSIGNMENTS=838067 CHECKS=368644000	UNSAT TT=217.264 ASSIGNMENTS=839841 CHECKS=1207730000	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=80.941 ASSIGNMENTS=778136 CHECKS=341993000	UNSAT TT=81.344 ASSIGNMENTS=790847 CHECKS=346880000	? (TO) TT=1800.11	UNSAT TT=90.882 ASSIGNMENTS=850339 CHECKS=375601000	UNSAT TT=84.487 ASSIGNMENTS=838067 CHECKS=368644000	? (TO) TT=1800.14	UNSAT TT=1105.38 ASSIGNMENTS=871473 CHECKS=1405020000	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/rand-2-24/ normalized-rand-24-24-276-139-50021_ext.xml	SAT TT=2.804	SAT TT=42.513 CHECKS=234733000 NODES=166976	SAT TT=42.506 CHECKS=232604000 NODES=165664	SAT TT=2.804	SAT TT=579.726 CHECKS=159937000	SAT TT=817.497 CHECKS=146342000	SAT TT=36.697 ASSIGNMENTS=45411	SAT TT=35.744 ASSIGNMENTS=45411	SAT TT=235.284 CHECKS=54520000 NODES=797412	SAT TT=123.522 CHECKS=1011160000 NODES=1831430	? (TO) TT=1800.1	SAT TT=19.345 ASSIGNMENTS=110625 CHECKS=48262300	SAT TT=46.762 ASSIGNMENTS=166976 CHECKS=234733000	? (TO) TT=1800.09	? (TO) TT=1800.02	SAT TT=14.32 ASSIGNMENTS=139336 CHECKS=60754900	SAT TT=25.502 ASSIGNMENTS=268504 CHECKS=116794000	? (TO) TT=1800.06	SAT TT=31.738 ASSIGNMENTS=303968 CHECKS=133453000	SAT TT=11.258 ASSIGNMENTS=110625 CHECKS=48262300	? (TO) TT=1800.13	SAT TT=695.136 ASSIGNMENTS=737258 CHECKS=1178840000	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/rand-2-24/ normalized-rand-24-24-276-139-51021_ext.xml	UNSAT TT=46.547	UNSAT TT=218.029 CHECKS=1222180000 NODES=852867	UNSAT TT=216.31 CHECKS=1217920000 NODES=850241	UNSAT TT=46.547	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=337.686 ASSIGNMENTS=425255	UNSAT TT=327.705 ASSIGNMENTS=425255	UNSAT TT=265.896 CHECKS=61855700 NODES=905038	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=96.026 ASSIGNMENTS=861857 CHECKS=378822000	UNSAT TT=206.505 ASSIGNMENTS=852867 CHECKS=1222180000	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=86.541 ASSIGNMENTS=905083 CHECKS=397446000	UNSAT TT=91.684 ASSIGNMENTS=888562 CHECKS=390640000	? (TO) TT=1800.03	UNSAT TT=92.812 ASSIGNMENTS=881478 CHECKS=386924000	UNSAT TT=83.047 ASSIGNMENTS=861857 CHECKS=378822000	? (TO) TT=1800.16	UNSAT TT=1110.85 ASSIGNMENTS=867784 CHECKS=1401450000	? (TO) TT=1800.12	? (TO) TT=1800.1
csp/rand-2-24/ normalized-rand-24-24-276-139-52021_ext.xml	UNSAT TT=44.878	UNSAT TT=217.321 CHECKS=1218930000 NODES=852772	UNSAT TT=199.89 CHECKS=1218640000 NODES=852052	UNSAT TT=44.878	? (TO) TT=1800.06	UNSAT TT=1059.09 CHECKS=187121000	UNSAT TT=352.075 ASSIGNMENTS=420028	UNSAT TT=334.663 ASSIGNMENTS=420028	UNSAT TT=281.997 CHECKS=63028100 NODES=923341	? (TO) TT=1800.06	? (TO) TT=1800.09	UNSAT TT=100.143 ASSIGNMENTS=905639 CHECKS=399422000	UNSAT TT=206.725 ASSIGNMENTS=852772 CHECKS=1218930000	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=93.267 ASSIGNMENTS=899872 CHECKS=396029000	UNSAT TT=88.872 ASSIGNMENTS=863148 CHECKS=378583000	? (TO) TT=1800.1	UNSAT TT=92.304 ASSIGNMENTS=908414 CHECKS=399648000	UNSAT TT=89.111 ASSIGNMENTS=905639 CHECKS=399422000	? (TO) TT=1800.12	UNSAT TT=1116.72 ASSIGNMENTS=902362 CHECKS=1451190000	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/rand-2-24/ normalized-rand-24-24-276-139-53021_ext.xml	UNSAT TT=46.142	UNSAT TT=214.137 CHECKS=1210830000 NODES=851845	UNSAT TT=201.499 CHECKS=1211730000 NODES=851864	UNSAT TT=46.142	? (TO) TT=1800.07	UNSAT TT=1166.89 CHECKS=195716000	UNSAT TT=332.761 ASSIGNMENTS=430003	UNSAT TT=348.889 ASSIGNMENTS=430003	UNSAT TT=266.498 CHECKS=64694700 NODES=955553	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=103.359 ASSIGNMENTS=928184 CHECKS=406476000	UNSAT TT=218.641 ASSIGNMENTS=851845 CHECKS=1210830000	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=93.821 ASSIGNMENTS=914250 CHECKS=400421000	UNSAT TT=88.189 ASSIGNMENTS=920321 CHECKS=400980000	? (TO) TT=1800.05	UNSAT TT=87.83 ASSIGNMENTS=908358 CHECKS=396845000	UNSAT TT=88.593 ASSIGNMENTS=928184 CHECKS=406476000	? (TO) TT=1800.13	UNSAT TT=1217.72 ASSIGNMENTS=912563 CHECKS=1455430000	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/rand-2-24/ normalized-rand-24-24-276-139-54021_ext.xml	UNSAT TT=49.472	UNSAT TT=214.288 CHECKS=1204420000 NODES=846312	UNSAT TT=199.539 CHECKS=1200230000 NODES=843554	UNSAT TT=49.472	? (TO) TT=1800.04	UNSAT TT=1133.42 CHECKS=189550000	UNSAT TT=344.414 ASSIGNMENTS=434118	UNSAT TT=332.651 ASSIGNMENTS=434118	UNSAT TT=270.818 CHECKS=61137300 NODES=900623	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=93.599 ASSIGNMENTS=869144 CHECKS=381059000	UNSAT TT=205.783 ASSIGNMENTS=846312 CHECKS=1204420000	? (TO) TT=1800.03	? (TO) TT=1800.02	UNSAT TT=86.576 ASSIGNMENTS=900992 CHECKS=395121000	UNSAT TT=88.477 ASSIGNMENTS=870026 CHECKS=379656000	? (TO) TT=1800.13	UNSAT TT=95.299 ASSIGNMENTS=921877 CHECKS=403835000	UNSAT TT=85.981 ASSIGNMENTS=869144 CHECKS=381059000	? (TO) TT=1800.07	UNSAT TT=1165.45 ASSIGNMENTS=945633 CHECKS=1506710000	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/rand-2-24/ normalized-rand-24-24-276-139-55021_ext.xml	SAT TT=5.384	SAT TT=32.603 CHECKS=178266000 NODES=128737	SAT TT=33.605 CHECKS=183296000 NODES=131329	SAT TT=28.537	SAT TT=1711.12 CHECKS=483083000	SAT TT=159.546 CHECKS=26500800	SAT TT=100.983 ASSIGNMENTS=119555	SAT TT=90.555 ASSIGNMENTS=119555	SAT TT=21.172 CHECKS=4902390 NODES=72453	SAT TT=18.34 CHECKS=136050000 NODES=246388	? (TO) TT=1800.05	SAT TT=12.682 ASSIGNMENTS=52551 CHECKS=22982100	SAT TT=39.941 ASSIGNMENTS=128737 CHECKS=178266000	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=8.887 ASSIGNMENTS=88388 CHECKS=38533000	SAT TT=7.382 ASSIGNMENTS=75106 CHECKS=32069300	SAT TT=1243.58	SAT TT=68.077 ASSIGNMENTS=682438 CHECKS=298830000	SAT TT=5.384 ASSIGNMENTS=52551 CHECKS=22982100	? (TO) TT=1800.15	SAT TT=656.205 ASSIGNMENTS=565566 CHECKS=902690000	? (TO) TT=1800.09	SAT TT=950.93
csp/rand-2-24/ normalized-rand-24-24-276-139-56021_ext.xml	UNSAT TT=50.615	UNSAT TT=231.273 CHECKS=1295510000 NODES=911013	UNSAT TT=228.584 CHECKS=1284920000 NODES=903188	UNSAT TT=50.615	? (TO) TT=1800.05	UNSAT TT=1129.39 CHECKS=200974000	UNSAT TT=355.753 ASSIGNMENTS=421992	UNSAT TT=317.022 ASSIGNMENTS=421992	UNSAT TT=275.537 CHECKS=62452200 NODES=918422	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=91.551 ASSIGNMENTS=885203 CHECKS=387148000	UNSAT TT=234.239 ASSIGNMENTS=911013 CHECKS=1295510000	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=95.459 ASSIGNMENTS=926372 CHECKS=407350000	UNSAT TT=91.75 ASSIGNMENTS=884249 CHECKS=385926000	? (TO) TT=1800.08	UNSAT TT=92.815 ASSIGNMENTS=909281 CHECKS=398017000	UNSAT TT=85.541 ASSIGNMENTS=885203 CHECKS=387148000	? (TO) TT=1800.14	UNSAT TT=1122.94 ASSIGNMENTS=911702 CHECKS=1455850000	? (TO) TT=1800.14	? (TO) TT=1800.13
csp/rand-2-24/ normalized-rand-24-24-276-139-57021_ext.xml	UNSAT TT=44.685	UNSAT TT=211.813 CHECKS=1196000000 NODES=829442	UNSAT TT=212.291 CHECKS=1192500000 NODES=827363	UNSAT TT=44.685	? (TO) TT=1800.01	UNSAT TT=1044.16 CHECKS=184058000	UNSAT TT=345.125 ASSIGNMENTS=404257	UNSAT TT=312.063 ASSIGNMENTS=404257	UNSAT TT=255.279 CHECKS=60754500 NODES=890236	? (TO) TT=1800.1	? (TO) TT=1800.01	UNSAT TT=89.592 ASSIGNMENTS=860974 CHECKS=378566000	UNSAT TT=200.69 ASSIGNMENTS=829442 CHECKS=1196000000	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=88.971 ASSIGNMENTS=863505 CHECKS=380008000	UNSAT TT=81.44 ASSIGNMENTS=843684 CHECKS=371025000	? (TO) TT=1800.08	UNSAT TT=85.941 ASSIGNMENTS=872867 CHECKS=383250000	UNSAT TT=89.935 ASSIGNMENTS=860974 CHECKS=378566000	? (TO) TT=1800.13	UNSAT TT=1186.8 ASSIGNMENTS=854171 CHECKS=1379490000	? (TO) TT=1800.14	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-25/ normalized-rand-25-25-300-147-50021_ext.xml	UNSAT TT=107.632	UNSAT TT=475.116 CHECKS=2885910000 NODES=1905630	UNSAT TT=504.538 CHECKS=2880290000 NODES=1902140	UNSAT TT=107.632	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=736.701 ASSIGNMENTS=911836	UNSAT TT=737.083 ASSIGNMENTS=911836	UNSAT TT=660.541 CHECKS=139345000 NODES=2002670	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=218.472 ASSIGNMENTS=1940510 CHECKS=908851000	UNSAT TT=473.647 ASSIGNMENTS=1905630 CHECKS=2885910000	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=200.463 ASSIGNMENTS=1901870 CHECKS=887916000	UNSAT TT=191.953 ASSIGNMENTS=1911460 CHECKS=892444000	? (TO) TT=1800.09	UNSAT TT=209.038 ASSIGNMENTS=1914350 CHECKS=893124000	UNSAT TT=213.334 ASSIGNMENTS=1940510 CHECKS=908851000	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.1
csp/rand-2-25/ normalized-rand-25-25-300-147-51021_ext.xml	SAT TT=17.791	SAT TT=52.412 CHECKS=307690000 NODES=207574	SAT TT=55.088 CHECKS=310305000 NODES=209187	SAT TT=23.269	? (TO) TT=1800.08	SAT TT=520.187 CHECKS=74229300	SAT TT=68.199 ASSIGNMENTS=77028	SAT TT=68.259 ASSIGNMENTS=77028	SAT TT=299.554 CHECKS=63340000 NODES=912077	SAT TT=17.791 CHECKS=144361000 NODES=240519	? (TO) TT=1800.1	SAT TT=74.975 ASSIGNMENTS=625344 CHECKS=290008000	SAT TT=58.848 ASSIGNMENTS=207574 CHECKS=307690000	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=78.735 ASSIGNMENTS=724347 CHECKS=336973000	SAT TT=60.014 ASSIGNMENTS=600179 CHECKS=279308000	? (TO) TT=1800.06	SAT TT=108.137 ASSIGNMENTS=1062880 CHECKS=496400000	SAT TT=62.988 ASSIGNMENTS=625344 CHECKS=290008000	? (TO) TT=1800.14	SAT TT=512.991 ASSIGNMENTS=258446 CHECKS=435965000	? (TO) TT=1800.08	? (TO) TT=1800.07
csp/rand-2-25/ normalized-rand-25-25-300-147-52021_ext.xml	SAT TT=1.945	SAT TT=458.282 CHECKS=2586830000 NODES=1715120	SAT TT=453.551 CHECKS=2587730000 NODES=1715780	SAT TT=1.945	? (TO) TT=1800.02	SAT TT=1387.74 CHECKS=209473000	SAT TT=180.692 ASSIGNMENTS=224939	SAT TT=180.304 ASSIGNMENTS=224939	SAT TT=530.123 CHECKS=111184000 NODES=1608380	SAT TT=59.063 CHECKS=450848000 NODES=751218	? (TO) TT=1800.08	SAT TT=104.994 ASSIGNMENTS=893445 CHECKS=413503000	SAT TT=434.267 ASSIGNMENTS=1715120 CHECKS=2586830000	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=106.398 ASSIGNMENTS=979408 CHECKS=454881000	SAT TT=205.113 ASSIGNMENTS=1882190 CHECKS=877792000	? (TO) TT=1800.04	SAT TT=42.875 ASSIGNMENTS=396564 CHECKS=183213000	SAT TT=98.363 ASSIGNMENTS=893445 CHECKS=413503000	? (TO) TT=1800.15	SAT TT=218.331 ASSIGNMENTS=14984 CHECKS=25106700	? (TO) TT=1800.12	? (TO) TT=1800.12
csp/rand-2-25/ normalized-rand-25-25-300-147-53021_ext.xml	SAT TT=0.808	SAT TT=8.435 CHECKS=41161500 NODES=29309	SAT TT=29.266 CHECKS=160045000 NODES=111802	SAT TT=76.005	SAT TT=531.592 CHECKS=132452000	? (TO) TT=1800.11	SAT TT=410.653 ASSIGNMENTS=509564	SAT TT=446.888 ASSIGNMENTS=509564	SAT TT=236.877 CHECKS=54288800 NODES=784456	SAT TT=0.808 CHECKS=733485 NODES=1169	? (TO) TT=1800.06	SAT TT=22.195 ASSIGNMENTS=145935 CHECKS=68306800	SAT TT=15.388 ASSIGNMENTS=29309 CHECKS=41161500	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=145.7 ASSIGNMENTS=1329110 CHECKS=620534000	SAT TT=9.631 ASSIGNMENTS=90009 CHECKS=41667800	? (TO) TT=1800.1	SAT TT=13.709 ASSIGNMENTS=121876 CHECKS=57102900	SAT TT=14.815 ASSIGNMENTS=145935 CHECKS=68306800	? (TO) TT=1800.13	SAT TT=10.117 ASSIGNMENTS=6713 CHECKS=11024500	? (TO) TT=1800.06	? (TO) TT=1800.06
csp/rand-2-25/ normalized-rand-25-25-300-147-54021_ext.xml	SAT TT=9.298	SAT TT=82.066 CHECKS=488488000 NODES=328170	SAT TT=86.065 CHECKS=486602000 NODES=327133	SAT TT=40.194	SAT TT=332.742 CHECKS=76467000	SAT TT=72.896 CHECKS=12113100	SAT TT=149.252 ASSIGNMENTS=184166	SAT TT=161.361 ASSIGNMENTS=184166	SAT TT=140.172 CHECKS=32345200 NODES=467642	SAT TT=11.041 CHECKS=81865500 NODES=136389	? (TO) TT=1800.09	SAT TT=175.89 ASSIGNMENTS=1519940 CHECKS=709718000	SAT TT=87.524 ASSIGNMENTS=328170 CHECKS=488488000	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=9.298 ASSIGNMENTS=93083 CHECKS=43269000	SAT TT=53.548 ASSIGNMENTS=497193 CHECKS=228423000	? (TO) TT=1800.03	SAT TT=30.917 ASSIGNMENTS=286600 CHECKS=131996000	SAT TT=153.099 ASSIGNMENTS=1519940 CHECKS=709718000	? (TO) TT=1800.13	SAT TT=1299.23 ASSIGNMENTS=1076830 CHECKS=1792660000	? (TO) TT=1800.04	SAT TT=407.837
csp/rand-2-25/ normalized-rand-25-25-300-147-55021_ext.xml	UNSAT TT=112.041	UNSAT TT=505.506 CHECKS=2852920000 NODES=1873800	UNSAT TT=461.901 CHECKS=2856310000 NODES=1876330	UNSAT TT=112.041	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=761.465 ASSIGNMENTS=877517	UNSAT TT=768.537 ASSIGNMENTS=877517	UNSAT TT=602.561 CHECKS=140116000 NODES=2005510	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=198.822 ASSIGNMENTS=1902060 CHECKS=891558000	UNSAT TT=466.362 ASSIGNMENTS=1873800 CHECKS=2852920000	? (TO) TT=1800.05	? (TO) TT=1800.06	UNSAT TT=201.022 ASSIGNMENTS=1940120 CHECKS=910663000	UNSAT TT=195.007 ASSIGNMENTS=1915310 CHECKS=896406000	? (TO) TT=1800.07	UNSAT TT=203.747 ASSIGNMENTS=1989780 CHECKS=933378000	UNSAT TT=200.336 ASSIGNMENTS=1902060 CHECKS=891558000	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-25/ normalized-rand-25-25-300-147-56021_ext.xml	SAT TT=8.105	SAT TT=186.57 CHECKS=1047070000 NODES=705773	SAT TT=186.691 CHECKS=1051570000 NODES=708660	SAT TT=93.978	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=770.293 ASSIGNMENTS=961905	SAT TT=770.442 ASSIGNMENTS=961905	SAT TT=241.124 CHECKS=55914500 NODES=806636	SAT TT=193.74 CHECKS=1488880000 NODES=2480960	? (TO) TT=1800.04	SAT TT=187.931 ASSIGNMENTS=1771150 CHECKS=825986000	SAT TT=181.608 ASSIGNMENTS=705773 CHECKS=1047070000	? (TO) TT=1800.05	? (TO) TT=1800.03	SAT TT=43.481 ASSIGNMENTS=401774 CHECKS=185582000	SAT TT=8.105 ASSIGNMENTS=77259 CHECKS=34829600	? (TO) TT=1800.06	SAT TT=214.402 ASSIGNMENTS=1983530 CHECKS=926695000	SAT TT=190.782 ASSIGNMENTS=1771150 CHECKS=825986000	? (TO) TT=1800.13	SAT TT=138.478 ASSIGNMENTS=66959 CHECKS=111979000	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/rand-2-25/ normalized-rand-25-25-300-147-57021_ext.xml	UNSAT TT=113.236	UNSAT TT=488.431 CHECKS=2779210000 NODES=1825840	UNSAT TT=484.278 CHECKS=2768240000 NODES=1818530	UNSAT TT=113.236	? (TO) TT=1800.03	? (TO) TT=1800.11	UNSAT TT=773.522 ASSIGNMENTS=889479	UNSAT TT=743.812 ASSIGNMENTS=889479	UNSAT TT=623.192 CHECKS=138627000 NODES=1982050	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=210.312 ASSIGNMENTS=1864800 CHECKS=874483000	UNSAT TT=457.631 ASSIGNMENTS=1825840 CHECKS=2779210000	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=195.354 ASSIGNMENTS=1815280 CHECKS=851000000	UNSAT TT=214.945 ASSIGNMENTS=1978450 CHECKS=931513000	? (TO) TT=1800.11	UNSAT TT=204.641 ASSIGNMENTS=1873070 CHECKS=877892000	UNSAT TT=188.661 ASSIGNMENTS=1864800 CHECKS=874483000	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-25/ normalized-rand-25-25-300-147-58021_ext.xml	UNSAT TT=113.305	UNSAT TT=487.535 CHECKS=2928760000 NODES=1928720	UNSAT TT=511.134 CHECKS=2929430000 NODES=1929820	UNSAT TT=113.305	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=745.477 ASSIGNMENTS=936209	UNSAT TT=798.805 ASSIGNMENTS=936209	UNSAT TT=684.323 CHECKS=144570000 NODES=2077810	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=208.517 ASSIGNMENTS=1959470 CHECKS=918238000	UNSAT TT=505.997 ASSIGNMENTS=1928720 CHECKS=2928760000	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=207.493 ASSIGNMENTS=1893430 CHECKS=884805000	UNSAT TT=206.537 ASSIGNMENTS=1911280 CHECKS=895419000	? (TO) TT=1800.09	UNSAT TT=202.641 ASSIGNMENTS=1853260 CHECKS=867974000	UNSAT TT=215.928 ASSIGNMENTS=1959470 CHECKS=918238000	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/rand-2-25/ normalized-rand-25-25-300-147-59021_ext.xml	SAT TT=8.352	SAT TT=275.926 CHECKS=1561550000 NODES=1041490	SAT TT=272.582 CHECKS=1566140000 NODES=1043550	SAT TT=43.033	? (TO) TT=1800.07	SAT TT=284.53 CHECKS=44992700	SAT TT=357.848 ASSIGNMENTS=448165	SAT TT=360.876 ASSIGNMENTS=448165	SAT TT=485.607 CHECKS=109600000 NODES=1580140	SAT TT=8.352 CHECKS=64124100 NODES=106820	? (TO) TT=1800.08	SAT TT=58.476 ASSIGNMENTS=514183 CHECKS=238797000	SAT TT=275.704 ASSIGNMENTS=1041490 CHECKS=1561550000	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=204.027 ASSIGNMENTS=1893770 CHECKS=886052000	SAT TT=155.581 ASSIGNMENTS=1562480 CHECKS=729007000	? (TO) TT=1800.05	SAT TT=227.144 ASSIGNMENTS=2036920 CHECKS=953861000	SAT TT=51.367 ASSIGNMENTS=514183 CHECKS=238797000	? (TO) TT=1800.12	SAT TT=799.268 ASSIGNMENTS=41685 CHECKS=68361400	? (TO) TT=1800.11	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-26/ normalized-rand-26-26-325-155-52021_ext.xml	UNSAT TT=291.567	UNSAT TT=1170 CHECKS=7246210000 NODES=4551170	UNSAT TT=1234.79 CHECKS=7278110000 NODES=4570440	UNSAT TT=291.567	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1610.96 CHECKS=344139000 NODES=4879860	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=500.702 ASSIGNMENTS=4501490 CHECKS=2220650000	UNSAT TT=1189.57 ASSIGNMENTS=4551170 CHECKS=7246210000	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=491.253 ASSIGNMENTS=4482190 CHECKS=2211450000	UNSAT TT=504.795 ASSIGNMENTS=4332340 CHECKS=2140570000	? (TO) TT=1800.1	UNSAT TT=508.273 ASSIGNMENTS=4392540 CHECKS=2171510000	UNSAT TT=514.461 ASSIGNMENTS=4501490 CHECKS=2220650000	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-53021_ext.xml	SAT TT=74.507	SAT TT=488.582 CHECKS=2747490000 NODES=1738760	SAT TT=471.451 CHECKS=2705540000 NODES=1712600	SAT TT=130.733	? (TO) TT=1800.07	SAT TT=532.609 CHECKS=76451600	SAT TT=622.727 ASSIGNMENTS=732319	SAT TT=669.775 ASSIGNMENTS=732319	SAT TT=419.335 CHECKS=86304400 NODES=1226660	SAT TT=74.507 CHECKS=572688000 NODES=880856	? (TO) TT=1800.08	SAT TT=319.084 ASSIGNMENTS=2879850 CHECKS=1426670000	SAT TT=463.399 ASSIGNMENTS=1738760 CHECKS=2747490000	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=280.189 ASSIGNMENTS=2557020 CHECKS=1266670000	SAT TT=96.283 ASSIGNMENTS=830431 CHECKS=405480000	? (TO) TT=1800.12	SAT TT=146.669 ASSIGNMENTS=1256800 CHECKS=617760000	SAT TT=336.227 ASSIGNMENTS=2879850 CHECKS=1426670000	? (TO) TT=1800.18	SAT TT=1763.23 ASSIGNMENTS=1352370 CHECKS=2366150000	? (TO) TT=1800.05	SAT TT=634.817
csp/rand-2-26/ normalized-rand-26-26-325-155-54021_ext.xml	SAT TT=11.206	SAT TT=371.826 CHECKS=2101470000 NODES=1345220	SAT TT=345.023 CHECKS=2104180000 NODES=1346860	SAT TT=66.845	SAT TT=1644.68 CHECKS=392962000	? (TO) TT=1800.06	SAT TT=725.201 ASSIGNMENTS=808546	SAT TT=718.961 ASSIGNMENTS=808546	SAT TT=772.192 CHECKS=166532000 NODES=2368080	SAT TT=11.206 CHECKS=88974300 NODES=136828	SAT TT=1.492 CHECKS=5018890 NODES=5043	SAT TT=37.71 ASSIGNMENTS=258777 CHECKS=127833000	SAT TT=352.147 ASSIGNMENTS=1345220 CHECKS=2101470000	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=29.207 ASSIGNMENTS=252115 CHECKS=124265000	SAT TT=98.756 ASSIGNMENTS=908394 CHECKS=444034000	? (TO) TT=1800.07	SAT TT=140.284 ASSIGNMENTS=1199900 CHECKS=590341000	SAT TT=29.77 ASSIGNMENTS=258777 CHECKS=127833000	? (TO) TT=1800.19	SAT TT=63.431 ASSIGNMENTS=2717 CHECKS=4734370	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/rand-2-26/ normalized-rand-26-26-325-155-55021_ext.xml	SAT TT=33.314	SAT TT=334.003 CHECKS=1901920000 NODES=1202430	SAT TT=307.624 CHECKS=1869650000 NODES=1182580	SAT TT=89.045	? (TO) TT=1800.09	SAT TT=1650.78 CHECKS=231360000	SAT TT=1687.57 ASSIGNMENTS=1994820	SAT TT=1765.19 ASSIGNMENTS=1994820	SAT TT=1291.14 CHECKS=286550000 NODES=4043770	SAT TT=234.007 CHECKS=1981320000 NODES=3047540	? (TO) TT=1800.01	SAT TT=515.776 ASSIGNMENTS=4348020 CHECKS=2158560000	SAT TT=313.938 ASSIGNMENTS=1202430 CHECKS=1901920000	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=33.314 ASSIGNMENTS=280727 CHECKS=139531000	SAT TT=39.77 ASSIGNMENTS=367542 CHECKS=181709000	? (TO) TT=1800.1	SAT TT=59.763 ASSIGNMENTS=518455 CHECKS=255702000	SAT TT=466.157 ASSIGNMENTS=4348020 CHECKS=2158560000	? (TO) TT=1800.17	SAT TT=79.261 ASSIGNMENTS=28569 CHECKS=50370800	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-56021_ext.xml	UNSAT TT=264.937	UNSAT TT=1266.04 CHECKS=7252870000 NODES=4545840	UNSAT TT=1235.74 CHECKS=7256540000 NODES=4546850	UNSAT TT=264.937	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=1722.76 CHECKS=352037000 NODES=4974840	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=507.377 ASSIGNMENTS=4579750 CHECKS=2269450000	UNSAT TT=1177.76 ASSIGNMENTS=4545840 CHECKS=7252870000	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=505.879 ASSIGNMENTS=4620170 CHECKS=2289230000	UNSAT TT=493.841 ASSIGNMENTS=4505960 CHECKS=2226490000	? (TO) TT=1800.11	UNSAT TT=499.229 ASSIGNMENTS=4620530 CHECKS=2288230000	UNSAT TT=524.308 ASSIGNMENTS=4579750 CHECKS=2269450000	? (TO) TT=1800.61	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.12
csp/rand-2-26/ normalized-rand-26-26-325-155-57021_ext.xml	UNSAT TT=276.757	UNSAT TT=1210.09 CHECKS=7015920000 NODES=4417690	UNSAT TT=1175.99 CHECKS=7021850000 NODES=4420660	UNSAT TT=276.757	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.11	UNSAT TT=1640.61 CHECKS=341969000 NODES=4843420	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=556.501 ASSIGNMENTS=4733860 CHECKS=2341110000	UNSAT TT=1152.36 ASSIGNMENTS=4417690 CHECKS=7015920000	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=515.35 ASSIGNMENTS=4501240 CHECKS=2221670000	UNSAT TT=512.557 ASSIGNMENTS=4544040 CHECKS=2243480000	? (TO) TT=1800.09	UNSAT TT=537.484 ASSIGNMENTS=4658280 CHECKS=2307440000	UNSAT TT=546.6 ASSIGNMENTS=4733860 CHECKS=2341110000	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.15
csp/rand-2-26/ normalized-rand-26-26-325-155-58021_ext.xml	UNSAT TT=260.419	UNSAT TT=1215.36 CHECKS=7107960000 NODES=4462970	UNSAT TT=1166.22 CHECKS=7088050000 NODES=4451760	UNSAT TT=260.419	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	UNSAT TT=1473.88 CHECKS=328956000 NODES=4662900	? (TO) TT=1800.04	? (TO) TT=1800.09	UNSAT TT=551.869 ASSIGNMENTS=4691570 CHECKS=2319110000	UNSAT TT=1164.5 ASSIGNMENTS=4462970 CHECKS=7107960000	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=502.395 ASSIGNMENTS=4588640 CHECKS=2267240000	UNSAT TT=546.146 ASSIGNMENTS=4652680 CHECKS=2297180000	? (TO) TT=1800.04	UNSAT TT=552.202 ASSIGNMENTS=4744880 CHECKS=2340850000	UNSAT TT=507.811 ASSIGNMENTS=4691570 CHECKS=2319110000	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/rand-2-26/ normalized-rand-26-26-325-155-59021_ext.xml	SAT TT=75.046	SAT TT=1133.78 CHECKS=6596790000 NODES=4173600	SAT TT=1120.35 CHECKS=6638820000 NODES=4200470	SAT TT=275.969	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=700.225 ASSIGNMENTS=771510	SAT TT=653.567 ASSIGNMENTS=771510	SAT TT=835.961 CHECKS=182203000 NODES=2597540	SAT TT=75.046 CHECKS=632105000 NODES=972237	? (TO) TT=1800	SAT TT=291.402 ASSIGNMENTS=2621480 CHECKS=1292590000	SAT TT=1084.17 ASSIGNMENTS=4173600 CHECKS=6596790000	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=288.294 ASSIGNMENTS=2507820 CHECKS=1235730000	SAT TT=185.282 ASSIGNMENTS=1613280 CHECKS=791390000	? (TO) TT=1800.1	SAT TT=399.79 ASSIGNMENTS=3517910 CHECKS=1734290000	SAT TT=297.813 ASSIGNMENTS=2621480 CHECKS=1292590000	? (TO) TT=1800.13	SAT TT=350.877 ASSIGNMENTS=221126 CHECKS=386187000	? (TO) TT=1800.07	? (TO) TT=1800.07
csp/rand-2-26/ normalized-rand-26-26-325-155-60021_ext.xml	UNSAT TT=280.708	UNSAT TT=1186.75 CHECKS=6859850000 NODES=4289250	UNSAT TT=1155.75 CHECKS=6855260000 NODES=4288530	UNSAT TT=280.708	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=1592.19 CHECKS=348946000 NODES=4904260	? (TO) TT=1800.05	? (TO) TT=1800.01	UNSAT TT=488.397 ASSIGNMENTS=4398790 CHECKS=2187410000	UNSAT TT=1168.55 ASSIGNMENTS=4289250 CHECKS=6859850000	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=474.532 ASSIGNMENTS=4169820 CHECKS=2068820000	UNSAT TT=521.623 ASSIGNMENTS=4416350 CHECKS=2192040000	? (TO) TT=1800.13	UNSAT TT=533.293 ASSIGNMENTS=4524370 CHECKS=2243320000	UNSAT TT=481.591 ASSIGNMENTS=4398790 CHECKS=2187410000	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.13
csp/rand-2-26/ normalized-rand-26-26-325-155-61021_ext.xml	SAT TT=16.186	SAT TT=412.164 CHECKS=2339320000 NODES=1481240	SAT TT=379.326 CHECKS=2346210000 NODES=1483280	SAT TT=231.294	? (TO) TT=1800.1	SAT TT=461.776 CHECKS=63994800	SAT TT=1488.84 ASSIGNMENTS=1770830	SAT TT=1558.72 ASSIGNMENTS=1770830	SAT TT=285.284 CHECKS=62336100 NODES=884898	SAT TT=99.692 CHECKS=778346000 NODES=1197190	? (TO) TT=1800.02	SAT TT=182.003 ASSIGNMENTS=1497890 CHECKS=733251000	SAT TT=385.659 ASSIGNMENTS=1481240 CHECKS=2339320000	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=48.109 ASSIGNMENTS=414410 CHECKS=204939000	SAT TT=56.578 ASSIGNMENTS=491283 CHECKS=242013000	? (TO) TT=1800.12	SAT TT=71.098 ASSIGNMENTS=621766 CHECKS=302977000	SAT TT=174.244 ASSIGNMENTS=1497890 CHECKS=733251000	? (TO) TT=1800.15	SAT TT=935.911 ASSIGNMENTS=18721 CHECKS=31862700	? (TO) TT=1800.14	? (TO) TT=1800.03
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-27/ normalized-rand-27-27-351-163-54021_ext.xml	SAT TT=39.221	SAT TT=518.283 CHECKS=2913850000 NODES=1764170	SAT TT=466.648 CHECKS=2862790000 NODES=1735170	SAT TT=302.673	SAT TT=1535.8 CHECKS=337842000	? (TO) TT=1800.07	SAT TT=1666.03 ASSIGNMENTS=1908750	SAT TT=1751.86 ASSIGNMENTS=1908750	SAT TT=205.152 CHECKS=41736300 NODES=581981	SAT TT=39.221 CHECKS=305679000 NODES=435322	? (TO) TT=1800.05	SAT TT=98.531 ASSIGNMENTS=762452 CHECKS=393017000	SAT TT=512.89 ASSIGNMENTS=1764170 CHECKS=2913850000	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT TT=93.115 ASSIGNMENTS=760768 CHECKS=392144000	SAT TT=84.779 ASSIGNMENTS=689647 CHECKS=356895000	? (TO) TT=1800.1	SAT TT=88.889 ASSIGNMENTS=766059 CHECKS=402327000	SAT TT=91.905 ASSIGNMENTS=762452 CHECKS=393017000	? (TO) TT=1800.14	SAT TT=194.178 ASSIGNMENTS=133156 CHECKS=237466000	? (TO) TT=1800.14	? (TO) TT=1800.05
csp/rand-2-27/ normalized-rand-27-27-351-163-55021_ext.xml	UNSAT TT=649.53	? (TO) TT=1800.17	? (TO) TT=1800.05	UNSAT TT=649.53	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=1184.66 ASSIGNMENTS=10067500 CHECKS=997937000	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	UNSAT TT=1186.95 ASSIGNMENTS=10088000 CHECKS=1016310000	UNSAT TT=1133.93 ASSIGNMENTS=9815660 CHECKS=869883000	? (TO) TT=1800.04	UNSAT TT=1117.28 ASSIGNMENTS=9695890 CHECKS=797752000	UNSAT TT=1266.26 ASSIGNMENTS=10067500 CHECKS=997937000	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/rand-2-27/ normalized-rand-27-27-351-163-56021_ext.xml	SAT TT=11.551	SAT TT=1129.72 CHECKS=6568260000 NODES=3938380	SAT TT=1066.43 CHECKS=6578250000 NODES=3943740	SAT TT=11.551	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=800.557 ASSIGNMENTS=876331	SAT TT=789.133 ASSIGNMENTS=876331	? (TO) TT=1800.04	SAT TT=77.193 CHECKS=656088000 NODES=934358	? (TO) TT=1800	SAT TT=245.316 ASSIGNMENTS=1975550 CHECKS=1029770000	SAT TT=1100.84 ASSIGNMENTS=3938380 CHECKS=6568260000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=244.34 ASSIGNMENTS=1975850 CHECKS=1029590000	SAT TT=125.508 ASSIGNMENTS=1033040 CHECKS=538907000	? (TO) TT=1800.05	SAT TT=304.722 ASSIGNMENTS=2484060 CHECKS=1299260000	SAT TT=243.473 ASSIGNMENTS=1975550 CHECKS=1029770000	? (TO) TT=1800.09	SAT TT=1761.44 ASSIGNMENTS=1500920 CHECKS=2780240000	? (TO) TT=1800.08	? (TO) TT=1800.04
csp/rand-2-27/ normalized-rand-27-27-351-163-57021_ext.xml	UNSAT TT=637.335	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=637.335	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=1243.23 ASSIGNMENTS=10398400 CHECKS=1129510000	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=1226.39 ASSIGNMENTS=10369100 CHECKS=1115610000	UNSAT TT=1221.11 ASSIGNMENTS=10707400 CHECKS=1308980000	? (TO) TT=1800.04	UNSAT TT=1308.1 ASSIGNMENTS=10618600 CHECKS=1251130000	UNSAT TT=1186.19 ASSIGNMENTS=10398400 CHECKS=1129510000	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-27/ normalized-rand-27-27-351-163-58021_ext.xml	UNSAT TT=614.741	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=614.741	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=1205.17 ASSIGNMENTS=10546800 CHECKS=1241420000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=1318.48 ASSIGNMENTS=10825600 CHECKS=1388210000	UNSAT TT=1118.51 ASSIGNMENTS=9871870 CHECKS=876236000	? (TO) TT=1800.06	UNSAT TT=1280.71 ASSIGNMENTS=10626800 CHECKS=1290840000	UNSAT TT=1220.17 ASSIGNMENTS=10546800 CHECKS=1241420000	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06
csp/rand-2-27/ normalized-rand-27-27-351-163-59021_ext.xml	UNSAT TT=640.244	? (TO) TT=1800.09	? (TO) TT=1800.17	UNSAT TT=640.244	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=1211.17 ASSIGNMENTS=10415200 CHECKS=1148830000	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=1243.58 ASSIGNMENTS=10776200 CHECKS=1344300000	UNSAT TT=1192.9 ASSIGNMENTS=10404700 CHECKS=1149450000	? (TO) TT=1800.09	UNSAT TT=1249.19 ASSIGNMENTS=10576600 CHECKS=1241860000	UNSAT TT=1192.76 ASSIGNMENTS=10415200 CHECKS=1148830000	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/rand-2-27/ normalized-rand-27-27-351-163-60021_ext.xml	SAT TT=154.041	SAT TT=159.193 CHECKS=973939000 NODES=576192	SAT TT=154.041 CHECKS=954643000 NODES=563382	SAT TT=534.268	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT TT=1583.98 CHECKS=314194000 NODES=4335760	SAT TT=354.708 CHECKS=2812040000 NODES=4004900	? (TO) TT=1800.01	SAT TT=714.927 ASSIGNMENTS=6162560 CHECKS=3235710000	SAT TT=165.254 ASSIGNMENTS=576192 CHECKS=973939000	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=648.661 ASSIGNMENTS=5642300 CHECKS=2962640000	SAT TT=425.577 ASSIGNMENTS=3491900 CHECKS=1834060000	? (TO) TT=1800.04	SAT TT=350.568 ASSIGNMENTS=3047410 CHECKS=1592920000	SAT TT=722.034 ASSIGNMENTS=6162560 CHECKS=3235710000	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-2-27/ normalized-rand-27-27-351-163-61021_ext.xml	UNSAT TT=710.261	? (TO) TT=1800.13	? (TO) TT=1800.15	UNSAT TT=710.261	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=1293.36 ASSIGNMENTS=11299800 CHECKS=1581930000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	UNSAT TT=1411.74 ASSIGNMENTS=11501200 CHECKS=1696040000	UNSAT TT=1314.26 ASSIGNMENTS=11369800 CHECKS=1613550000	? (TO) TT=1800.04	UNSAT TT=1339.52 ASSIGNMENTS=11141000 CHECKS=1504690000	UNSAT TT=1333.76 ASSIGNMENTS=11299800 CHECKS=1581930000	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06
csp/rand-2-27/ normalized-rand-27-27-351-163-62021_ext.xml	UNSAT TT=614.566	? (TO) TT=1800.14	? (TO) TT=1800.12	UNSAT TT=614.566	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=1243.82 ASSIGNMENTS=10145100 CHECKS=1029940000	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	UNSAT TT=1243.01 ASSIGNMENTS=10143700 CHECKS=1029480000	UNSAT TT=1258.31 ASSIGNMENTS=10064200 CHECKS=989803000	? (TO) TT=1800.03	UNSAT TT=1161.25 ASSIGNMENTS=10115600 CHECKS=1010630000	UNSAT TT=1166.09 ASSIGNMENTS=10145100 CHECKS=1029940000	? (TO) TT=1800.19	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.12
csp/rand-2-27/ normalized-rand-27-27-351-163-63021_ext.xml	SAT TT=101.245	SAT TT=391.378 CHECKS=2236910000 NODES=1345970	SAT TT=364.665 CHECKS=2237000000 NODES=1346900	SAT TT=603.986	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=1230.45 ASSIGNMENTS=1373910	SAT TT=1304.28 ASSIGNMENTS=1373910	? (TO) TT=1800.03	SAT TT=101.245 CHECKS=788549000 NODES=1123020	? (TO) TT=1800.01	SAT TT=1001.75 ASSIGNMENTS=8796990 CHECKS=320063000	SAT TT=370.103 ASSIGNMENTS=1345970 CHECKS=2236910000	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1055.26 ASSIGNMENTS=8640940 CHECKS=236682000	SAT TT=423.283 ASSIGNMENTS=3479330 CHECKS=1816440000	? (TO) TT=1800.1	SAT TT=633.102 ASSIGNMENTS=5046240 CHECKS=2645030000	SAT TT=1011.48 ASSIGNMENTS=8796990 CHECKS=320063000	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.12
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-15_ext.xml	SAT TT=0.178	SAT TT=0.908 CHECKS=123920 NODES=197	SAT TT=0.92 CHECKS=195296 NODES=224	SAT TT=0.603	SAT TT=0.558 CHECKS=179373	SAT TT=0.497 CHECKS=142905	SAT TT=1.212 ASSIGNMENTS=606	SAT TT=1.139 ASSIGNMENTS=606	SAT TT=1.007 CHECKS=124898 NODES=1420	SAT TT=1.429 CHECKS=6274190 NODES=28221	SAT TT=1.344 CHECKS=4857740 NODES=10477	SAT TT=0.196 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=0.192 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=2.627	SAT TT=2.246	SAT TT=0.181 ASSIGNMENTS=1870 CHECKS=651701	SAT TT=0.233 ASSIGNMENTS=3774 CHECKS=905310	SAT TT=2.647	SAT TT=0.219 ASSIGNMENTS=2378 CHECKS=805830	SAT TT=0.178 ASSIGNMENTS=1847 CHECKS=641129	SAT TT=4.637	SAT TT=0.365 ASSIGNMENTS=463 CHECKS=501836	SAT TT=1.679	SAT TT=2.994
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-16_ext.xml	SAT TT=0.516	SAT TT=2.622 CHECKS=8899850 NODES=9067	SAT TT=2.808 CHECKS=8924320 NODES=9107	SAT TT=1.087	SAT TT=67.68 CHECKS=23165500	SAT TT=25.727 CHECKS=8882320	SAT TT=2.144 ASSIGNMENTS=2298	SAT TT=2.432 ASSIGNMENTS=2298	SAT TT=2.556 CHECKS=704330 NODES=8309	SAT TT=0.808 CHECKS=1381640 NODES=6061	? (TO) TT=1800.01	SAT TT=0.535 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=0.536 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=13.231	SAT TT=13.58	SAT TT=1.125 ASSIGNMENTS=12254 CHECKS=4674600	SAT TT=0.708 ASSIGNMENTS=8839 CHECKS=2833900	SAT TT=22.647	SAT TT=1.035 ASSIGNMENTS=11532 CHECKS=4320670	SAT TT=0.516 ASSIGNMENTS=5972 CHECKS=2246900	SAT TT=51.594	SAT TT=9.443 ASSIGNMENTS=10308 CHECKS=13471800	SAT TT=6.533	SAT TT=22.32
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-19_ext.xml	SAT TT=0.062	SAT TT=1.21 CHECKS=528260 NODES=617	SAT TT=0.955 CHECKS=297234 NODES=317	SAT TT=0.486	SAT TT=5.615 CHECKS=2167280	SAT TT=0.453 CHECKS=135967	SAT TT=1.044 ASSIGNMENTS=196	SAT TT=0.942 ASSIGNMENTS=196	SAT TT=0.941 CHECKS=104884 NODES=1185	SAT TT=1.769 CHECKS=6791430 NODES=30588	? (TO) TT=1800.01	SAT TT=0.081 ASSIGNMENTS=474 CHECKS=166230	SAT TT=0.082 ASSIGNMENTS=474 CHECKS=166230	SAT TT=2.683	SAT TT=11.561	SAT TT=0.062 ASSIGNMENTS=420 CHECKS=140892	SAT TT=0.269 ASSIGNMENTS=4053 CHECKS=992457	SAT TT=4.248	SAT TT=0.303 ASSIGNMENTS=3302 CHECKS=1172650	SAT TT=0.069 ASSIGNMENTS=474 CHECKS=166230	SAT TT=6.881	SAT TT=0.372 ASSIGNMENTS=430 CHECKS=557670	SAT TT=4.771	SAT TT=1.315
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-1_ext.xml	SAT TT=0.284	SAT TT=1.877 CHECKS=4603140 NODES=4608	SAT TT=1.889 CHECKS=4885520 NODES=4933	SAT TT=1.169	SAT TT=14.887 CHECKS=5290830	SAT TT=13.67 CHECKS=4554690	SAT TT=1.377 ASSIGNMENTS=986	SAT TT=1.513 ASSIGNMENTS=986	SAT TT=2.008 CHECKS=556289 NODES=5984	SAT TT=1.08 CHECKS=3605040 NODES=15953	? (TO) TT=1800.01	SAT TT=0.624 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=0.618 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=2.456	SAT TT=6.212	SAT TT=0.584 ASSIGNMENTS=6139 CHECKS=2421360	SAT TT=0.284 ASSIGNMENTS=4198 CHECKS=1086540	SAT TT=6.951	SAT TT=0.591 ASSIGNMENTS=6122 CHECKS=2368420	SAT TT=0.602 ASSIGNMENTS=6266 CHECKS=2446650	SAT TT=8.829	SAT TT=5.261 ASSIGNMENTS=6154 CHECKS=8875920	SAT TT=2.608	SAT TT=2.926
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-22_ext.xml	SAT TT=0.129	SAT TT=0.984 CHECKS=343064 NODES=376	SAT TT=1.176 CHECKS=369477 NODES=377	SAT TT=0.502	SAT TT=1.681 CHECKS=620642	SAT TT=0.716 CHECKS=227760	SAT TT=1.126 ASSIGNMENTS=673	SAT TT=1.142 ASSIGNMENTS=673	SAT TT=1.104 CHECKS=193318 NODES=2133	SAT TT=0.648 CHECKS=565747 NODES=2453	SAT TT=0.634 CHECKS=79050 NODES=186	SAT TT=0.147 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=0.135 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=2.349	SAT TT=2.198	SAT TT=0.189 ASSIGNMENTS=2039 CHECKS=758625	SAT TT=0.353 ASSIGNMENTS=5417 CHECKS=1501960	SAT TT=2.219	SAT TT=0.129 ASSIGNMENTS=1403 CHECKS=470730	SAT TT=0.131 ASSIGNMENTS=1227 CHECKS=436220	SAT TT=3.242	SAT TT=0.296 ASSIGNMENTS=233 CHECKS=290945	SAT TT=1.547	SAT TT=1.919
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-24_ext.xml	SAT TT=0.082	SAT TT=2.561 CHECKS=8115810 NODES=8584	SAT TT=2.623 CHECKS=8080930 NODES=8594	SAT TT=0.899	SAT TT=4.897 CHECKS=1783080	SAT TT=2.395 CHECKS=729140	SAT TT=1.079 ASSIGNMENTS=575	SAT TT=1.063 ASSIGNMENTS=575	SAT TT=1.562 CHECKS=384909 NODES=4187	SAT TT=3.037 CHECKS=17907200 NODES=87235	SAT TT=1078.74 CHECKS=7972670000 NODES=2303600	SAT TT=0.096 ASSIGNMENTS=642 CHECKS=226644	SAT TT=0.093 ASSIGNMENTS=642 CHECKS=226644	SAT TT=2.818	SAT TT=3.413	SAT TT=0.379 ASSIGNMENTS=4136 CHECKS=1481580	SAT TT=0.284 ASSIGNMENTS=4288 CHECKS=1040480	SAT TT=1.531	SAT TT=0.148 ASSIGNMENTS=1562 CHECKS=513736	SAT TT=0.082 ASSIGNMENTS=642 CHECKS=226644	SAT TT=7.776	SAT TT=0.825 ASSIGNMENTS=493 CHECKS=658842	SAT TT=3.013	SAT TT=2.073
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-26_ext.xml	SAT TT=0.123	SAT TT=0.823 CHECKS=18687 NODES=43	SAT TT=0.896 CHECKS=52354 NODES=42	SAT TT=1.279	SAT TT=9.187 CHECKS=3607620	SAT TT=6.619 CHECKS=2103710	SAT TT=4.249 ASSIGNMENTS=5829	SAT TT=3.79 ASSIGNMENTS=5829	SAT TT=2.471 CHECKS=589963 NODES=7146	SAT TT=1.479 CHECKS=5818670 NODES=26339	SAT TT=0.711 CHECKS=621543 NODES=1634	SAT TT=1.028 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=1.102 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=5.228	SAT TT=8.812	SAT TT=1.33 ASSIGNMENTS=16927 CHECKS=6105880	SAT TT=0.123 ASSIGNMENTS=1657 CHECKS=380613	SAT TT=15.52	SAT TT=0.375 ASSIGNMENTS=4585 CHECKS=1634280	SAT TT=1.072 ASSIGNMENTS=12685 CHECKS=4565220	SAT TT=9.148	SAT TT=5.501 ASSIGNMENTS=2572 CHECKS=2752160	SAT TT=4.113	SAT TT=7.822
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-28_ext.xml	SAT TT=0.075	SAT TT=3.162 CHECKS=11088300 NODES=11039	SAT TT=2.865 CHECKS=10331800 NODES=10275	SAT TT=0.721	SAT TT=4.258 CHECKS=1564640	SAT TT=0.792 CHECKS=227608	SAT TT=2.119 ASSIGNMENTS=1881	SAT TT=2.189 ASSIGNMENTS=1881	SAT TT=0.782 CHECKS=66421 NODES=717	SAT TT=0.896 CHECKS=1905360 NODES=9003	SAT TT=0.724 CHECKS=1075430 NODES=2965	SAT TT=0.087 ASSIGNMENTS=543 CHECKS=194398	SAT TT=0.087 ASSIGNMENTS=543 CHECKS=194398	SAT TT=2.477	SAT TT=3.545	SAT TT=0.271 ASSIGNMENTS=2824 CHECKS=1045100	SAT TT=0.091 ASSIGNMENTS=1118 CHECKS=254359	SAT TT=1.18	SAT TT=0.287 ASSIGNMENTS=3399 CHECKS=1186760	SAT TT=0.075 ASSIGNMENTS=543 CHECKS=194398	SAT TT=5.549	SAT TT=1.843 ASSIGNMENTS=976 CHECKS=1358060	SAT TT=1.496	SAT TT=1.345
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-29_ext.xml	SAT TT=0.288	SAT TT=0.902 CHECKS=80200 NODES=120	SAT TT=0.869 CHECKS=58293 NODES=50	SAT TT=1.221	SAT TT=5.763 CHECKS=2308350	SAT TT=4.354 CHECKS=1475450	SAT TT=2.498 ASSIGNMENTS=2280	SAT TT=2.366 ASSIGNMENTS=2280	SAT TT=1.175 CHECKS=195747 NODES=2166	SAT TT=2.127 CHECKS=11270100 NODES=50937	? (TO) TT=1800.08	SAT TT=0.402 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=0.404 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=2.413	SAT TT=5.022	SAT TT=0.328 ASSIGNMENTS=3307 CHECKS=1279910	SAT TT=0.751 ASSIGNMENTS=9560 CHECKS=3083300	SAT TT=8.667	SAT TT=0.288 ASSIGNMENTS=3308 CHECKS=1219400	SAT TT=0.387 ASSIGNMENTS=3986 CHECKS=1544860	SAT TT=11.107	SAT TT=4.843 ASSIGNMENTS=6125 CHECKS=7902050	SAT TT=1.86	SAT TT=4.496
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-2_ext.xml	SAT TT=0.093	SAT TT=1.527 CHECKS=1844270 NODES=1875	SAT TT=1.295 CHECKS=1833360 NODES=1823	SAT TT=0.914	SAT TT=6.045 CHECKS=2193290	SAT TT=0.561 CHECKS=174289	SAT TT=1.106 ASSIGNMENTS=538	SAT TT=1.045 ASSIGNMENTS=538	SAT TT=2.01 CHECKS=573376 NODES=6096	SAT TT=1.24 CHECKS=4163880 NODES=18829	? (TO) TT=1800.03	SAT TT=0.233 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=0.23 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=3.07	SAT TT=3.243	SAT TT=0.093 ASSIGNMENTS=706 CHECKS=269398	SAT TT=0.267 ASSIGNMENTS=4139 CHECKS=1069770	SAT TT=2.137	SAT TT=0.096 ASSIGNMENTS=986 CHECKS=322095	SAT TT=0.199 ASSIGNMENTS=2143 CHECKS=807120	SAT TT=2.583	SAT TT=0.529 ASSIGNMENTS=276 CHECKS=409849	SAT TT=2.986	SAT TT=1.881
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-31_ext.xml	SAT TT=0.099	SAT TT=3.05 CHECKS=10505700 NODES=10043	SAT TT=3.203 CHECKS=10682600 NODES=10203	SAT TT=1.143	SAT TT=1.384 CHECKS=461644	SAT TT=0.704 CHECKS=212230	SAT TT=2.972 ASSIGNMENTS=3612	SAT TT=3.312 ASSIGNMENTS=3612	SAT TT=0.859 CHECKS=38314 NODES=413	SAT TT=5.231 CHECKS=30226300 NODES=136652	? (TO) TT=1800.09	SAT TT=0.617 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=0.576 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=3.51	SAT TT=4.982	SAT TT=0.137 ASSIGNMENTS=1323 CHECKS=467497	SAT TT=0.653 ASSIGNMENTS=9110 CHECKS=2867310	SAT TT=4.257	SAT TT=0.108 ASSIGNMENTS=1043 CHECKS=340257	SAT TT=0.609 ASSIGNMENTS=6498 CHECKS=2478920	SAT TT=3.474	SAT TT=0.099 ASSIGNMENTS=95 CHECKS=100550	SAT TT=3.659	SAT TT=4.011
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-34_ext.xml	SAT TT=0.03	SAT TT=0.82 CHECKS=8165 NODES=31	SAT TT=0.885 CHECKS=39025 NODES=31	SAT TT=0.404	SAT TT=0.132 CHECKS=21669	SAT TT=0.091 CHECKS=7359	SAT TT=0.755 ASSIGNMENTS=29	SAT TT=0.76 ASSIGNMENTS=29	SAT TT=0.827 CHECKS=32326 NODES=340	SAT TT=0.711 CHECKS=724091 NODES=3283	SAT TT=409.035 CHECKS=2851290000 NODES=1224660	SAT TT=0.042 ASSIGNMENTS=30 CHECKS=8910	SAT TT=0.042 ASSIGNMENTS=30 CHECKS=8910	SAT TT=2.109	SAT TT=3.139	SAT TT=0.032 ASSIGNMENTS=33 CHECKS=9607	SAT TT=0.233 ASSIGNMENTS=3748 CHECKS=907229	SAT TT=0.883	SAT TT=0.075 ASSIGNMENTS=732 CHECKS=228862	SAT TT=0.03 ASSIGNMENTS=30 CHECKS=8910	SAT TT=2.808	SAT TT=0.288 ASSIGNMENTS=306 CHECKS=340019	SAT TT=1.641	SAT TT=1.511
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-38_ext.xml	SAT TT=0.739	SAT TT=0.885 CHECKS=110060 NODES=154	SAT TT=1.497 CHECKS=2310440 NODES=2632	SAT TT=1.763	SAT TT=12.569 CHECKS=5020860	SAT TT=14.787 CHECKS=4863520	SAT TT=5.165 ASSIGNMENTS=8165	SAT TT=5.679 ASSIGNMENTS=8165	SAT TT=2.941 CHECKS=778456 NODES=9626	SAT TT=0.739 CHECKS=870495 NODES=3840	? (TO) TT=1800.07	SAT TT=1.021 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=1.021 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=6.954	SAT TT=3.42	SAT TT=1.076 ASSIGNMENTS=12692 CHECKS=4559080	SAT TT=0.979 ASSIGNMENTS=12496 CHECKS=4031100	SAT TT=6.166	SAT TT=0.978 ASSIGNMENTS=12305 CHECKS=4375400	SAT TT=0.992 ASSIGNMENTS=11560 CHECKS=4149040	SAT TT=14.599	SAT TT=9.024 ASSIGNMENTS=11674 CHECKS=13410600	SAT TT=5.048	SAT TT=1.712
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-41_ext.xml	SAT TT=0.183	SAT TT=2.95 CHECKS=10094900 NODES=11354	SAT TT=3.155 CHECKS=10383100 NODES=11702	SAT TT=0.879	SAT TT=5.826 CHECKS=2395940	SAT TT=4.723 CHECKS=1588920	SAT TT=3.269 ASSIGNMENTS=4830	SAT TT=3.559 ASSIGNMENTS=4830	SAT TT=3.502 CHECKS=975984 NODES=11017	SAT TT=0.977 CHECKS=1925540 NODES=8613	SAT TT=0.631 CHECKS=147112 NODES=423	SAT TT=0.29 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=0.286 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=5.351	SAT TT=3.409	SAT TT=0.183 ASSIGNMENTS=1815 CHECKS=668429	SAT TT=0.791 ASSIGNMENTS=10418 CHECKS=3263410	SAT TT=4.15	SAT TT=0.2 ASSIGNMENTS=2104 CHECKS=746236	SAT TT=0.27 ASSIGNMENTS=2869 CHECKS=1057420	SAT TT=11.863	SAT TT=8.476 ASSIGNMENTS=7482 CHECKS=10006300	SAT TT=1.175	SAT TT=2.167
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-42_ext.xml	SAT TT=0.204	SAT TT=0.886 CHECKS=78877 NODES=109	SAT TT=1.014 CHECKS=510458 NODES=514	SAT TT=1.215	SAT TT=78.517 CHECKS=25106000	SAT TT=10.012 CHECKS=3338060	SAT TT=3 ASSIGNMENTS=3251	SAT TT=3.156 ASSIGNMENTS=3251	SAT TT=1.844 CHECKS=436037 NODES=4689	SAT TT=1.069 CHECKS=3029090 NODES=14030	? (TO) TT=1800.08	SAT TT=0.41 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=0.41 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=3.927	SAT TT=10.014	SAT TT=0.383 ASSIGNMENTS=4020 CHECKS=1508420	SAT TT=0.614 ASSIGNMENTS=7980 CHECKS=2457460	SAT TT=7.338	SAT TT=0.204 ASSIGNMENTS=2184 CHECKS=757805	SAT TT=0.399 ASSIGNMENTS=4151 CHECKS=1564440	SAT TT=8.326	SAT TT=4.471 ASSIGNMENTS=4508 CHECKS=6251840	SAT TT=1.719	SAT TT=2.785
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-45_ext.xml	SAT TT=0.06	SAT TT=0.838 CHECKS=23815 NODES=47	SAT TT=0.935 CHECKS=56847 NODES=41	SAT TT=0.503	SAT TT=19.04 CHECKS=7299270	SAT TT=3.249 CHECKS=1058720	SAT TT=1.318 ASSIGNMENTS=858	SAT TT=1.399 ASSIGNMENTS=858	SAT TT=1.155 CHECKS=219664 NODES=2232	SAT TT=0.673 CHECKS=435371 NODES=1911	SAT TT=0.91 CHECKS=1052620 NODES=2621	SAT TT=0.159 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=0.16 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=2.153	SAT TT=2.542	SAT TT=0.06 ASSIGNMENTS=365 CHECKS=134158	SAT TT=0.262 ASSIGNMENTS=4145 CHECKS=1039480	SAT TT=2.265	SAT TT=0.115 ASSIGNMENTS=1181 CHECKS=412423	SAT TT=0.145 ASSIGNMENTS=1231 CHECKS=503775	SAT TT=3.875	SAT TT=0.91 ASSIGNMENTS=344 CHECKS=464126	SAT TT=1.798	SAT TT=1.305
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-49_ext.xml	SAT TT=0.159	SAT TT=1.706 CHECKS=3865680 NODES=4179	SAT TT=1.842 CHECKS=3966590 NODES=4123	SAT TT=0.553	SAT TT=9.746 CHECKS=3611280	SAT TT=0.413 CHECKS=112440	SAT TT=1.148 ASSIGNMENTS=704	SAT TT=1.238 ASSIGNMENTS=704	SAT TT=0.966 CHECKS=123562 NODES=1327	SAT TT=0.644 CHECKS=514704 NODES=2223	? (TO) TT=1800.04	SAT TT=0.174 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=0.181 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=5.898	SAT TT=2.633	SAT TT=0.304 ASSIGNMENTS=3169 CHECKS=1186160	SAT TT=0.35 ASSIGNMENTS=4865 CHECKS=1345960	SAT TT=5.213	SAT TT=0.243 ASSIGNMENTS=2582 CHECKS=924587	SAT TT=0.159 ASSIGNMENTS=1612 CHECKS=604744	SAT TT=2.421	SAT TT=2.042 ASSIGNMENTS=1534 CHECKS=2127940	SAT TT=3.584	SAT TT=2.966
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-4_ext.xml	SAT TT=0.204	SAT TT=1.597 CHECKS=3069070 NODES=3077	SAT TT=1.618 CHECKS=2897420 NODES=2862	SAT TT=0.566	SAT TT=5.399 CHECKS=2042990	SAT TT=1.191 CHECKS=355126	SAT TT=0.973 ASSIGNMENTS=379	SAT TT=0.983 ASSIGNMENTS=379	SAT TT=1.317 CHECKS=198986 NODES=2225	SAT TT=0.871 CHECKS=134232 NODES=529	SAT TT=1135.01 CHECKS=7972940000 NODES=3165090	SAT TT=0.233 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=0.217 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=2.574	SAT TT=4.331	SAT TT=0.204 ASSIGNMENTS=1989 CHECKS=754100	SAT TT=0.346 ASSIGNMENTS=4993 CHECKS=1363930	SAT TT=6.434	SAT TT=0.42 ASSIGNMENTS=4632 CHECKS=1689700	SAT TT=0.22 ASSIGNMENTS=2213 CHECKS=815286	SAT TT=2.877	SAT TT=6.283 ASSIGNMENTS=1331 CHECKS=1740390	SAT TT=1.429	SAT TT=2.577
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-50_ext.xml	SAT TT=0.078	SAT TT=1.275 CHECKS=1505390 NODES=1379	SAT TT=1.242 CHECKS=1517630 NODES=1383	SAT TT=0.632	SAT TT=11.231 CHECKS=3916130	SAT TT=0.766 CHECKS=242636	SAT TT=0.852 ASSIGNMENTS=181	SAT TT=0.952 ASSIGNMENTS=181	SAT TT=0.953 CHECKS=121376 NODES=1167	SAT TT=2.883 CHECKS=15381900 NODES=68875	? (TO) TT=1800.06	SAT TT=0.117 ASSIGNMENTS=768 CHECKS=311977	SAT TT=0.114 ASSIGNMENTS=768 CHECKS=311977	SAT TT=2.662	SAT TT=2.64	SAT TT=0.083 ASSIGNMENTS=581 CHECKS=232394	SAT TT=0.307 ASSIGNMENTS=4221 CHECKS=1151660	SAT TT=1.946	SAT TT=0.078 ASSIGNMENTS=664 CHECKS=213952	SAT TT=0.103 ASSIGNMENTS=768 CHECKS=311977	SAT TT=4.587	SAT TT=1.18 ASSIGNMENTS=672 CHECKS=1045770	SAT TT=2.126	SAT TT=1.642
csp/rand-2-30-15-fcd/ normalized-rand-2-30-15-306-230-fcd-7_ext.xml	SAT TT=0.257	SAT TT=1.322 CHECKS=2046260 NODES=2134	SAT TT=1.342 CHECKS=1884960 NODES=1955	SAT TT=0.464	SAT TT=9.143 CHECKS=3390600	SAT TT=3.416 CHECKS=1188570	SAT TT=0.98 ASSIGNMENTS=326	SAT TT=0.935 ASSIGNMENTS=326	SAT TT=1.167 CHECKS=179975 NODES=2035	SAT TT=0.59 CHECKS=74817 NODES=277	SAT TT=878.244 CHECKS=6258150000 NODES=1624220	SAT TT=0.355 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=0.385 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=4.702	SAT TT=15.589	SAT TT=0.341 ASSIGNMENTS=3614 CHECKS=1348380	SAT TT=0.257 ASSIGNMENTS=3843 CHECKS=936548	SAT TT=4.409	SAT TT=0.3 ASSIGNMENTS=3489 CHECKS=1267220	SAT TT=0.363 ASSIGNMENTS=3831 CHECKS=1462500	SAT TT=10.221	SAT TT=4.024 ASSIGNMENTS=3346 CHECKS=4519890	SAT TT=1.664	SAT TT=1.467
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-10_ext.xml	SAT TT=0.086	SAT TT=1.444 CHECKS=2363930 NODES=2305	SAT TT=1.108 CHECKS=771887 NODES=736	SAT TT=0.691	SAT TT=20.328 CHECKS=7468090	SAT TT=1.471 CHECKS=441265	SAT TT=2.054 ASSIGNMENTS=1817	SAT TT=2.209 ASSIGNMENTS=1817	SAT TT=1.192 CHECKS=152323 NODES=1626	SAT TT=0.924 CHECKS=2432960 NODES=10851	? (TO) TT=1800	SAT TT=0.181 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=0.181 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=2.635	SAT TT=2.896	SAT TT=0.086 ASSIGNMENTS=653 CHECKS=254173	SAT TT=0.271 ASSIGNMENTS=3982 CHECKS=1011340	SAT TT=4.071	SAT TT=0.12 ASSIGNMENTS=1203 CHECKS=404883	SAT TT=0.165 ASSIGNMENTS=1539 CHECKS=605548	SAT TT=2.885	SAT TT=1.898 ASSIGNMENTS=712 CHECKS=898756	SAT TT=2.306	SAT TT=3.622
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-17_ext.xml	SAT TT=0.116	SAT TT=1.899 CHECKS=4372710 NODES=4283	SAT TT=1.843 CHECKS=4266450 NODES=4114	SAT TT=0.564	SAT TT=9.437 CHECKS=3512470	SAT TT=3.825 CHECKS=1285540	SAT TT=1.257 ASSIGNMENTS=816	SAT TT=1.366 ASSIGNMENTS=816	SAT TT=0.907 CHECKS=132008 NODES=1336	SAT TT=0.722 CHECKS=886974 NODES=3969	? (TO) TT=1800.01	SAT TT=0.125 ASSIGNMENTS=874 CHECKS=362571	SAT TT=0.127 ASSIGNMENTS=874 CHECKS=362571	SAT TT=3.503	SAT TT=2.235	SAT TT=0.272 ASSIGNMENTS=2737 CHECKS=1049100	SAT TT=0.383 ASSIGNMENTS=5296 CHECKS=1525300	SAT TT=1.813	SAT TT=0.333 ASSIGNMENTS=3401 CHECKS=1276100	SAT TT=0.116 ASSIGNMENTS=874 CHECKS=362571	SAT TT=5.37	SAT TT=2.241 ASSIGNMENTS=1542 CHECKS=2337050	SAT TT=1.282	SAT TT=1.911
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-18_ext.xml	SAT TT=0.214	SAT TT=1.169 CHECKS=1023240 NODES=1065	SAT TT=1.422 CHECKS=2275320 NODES=2310	SAT TT=0.557	SAT TT=3.424 CHECKS=1284680	SAT TT=1.88 CHECKS=578291	SAT TT=1.479 ASSIGNMENTS=1092	SAT TT=1.697 ASSIGNMENTS=1092	SAT TT=1.545 CHECKS=375474 NODES=4055	SAT TT=2.759 CHECKS=14912600 NODES=68991	? (TO) TT=1800.01	SAT TT=0.275 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=0.28 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=2.948	SAT TT=4.678	SAT TT=0.214 ASSIGNMENTS=2161 CHECKS=803322	SAT TT=0.293 ASSIGNMENTS=4350 CHECKS=1088150	SAT TT=3.846	SAT TT=0.388 ASSIGNMENTS=4337 CHECKS=1544100	SAT TT=0.263 ASSIGNMENTS=2762 CHECKS=992843	SAT TT=2.943	SAT TT=2.308 ASSIGNMENTS=2682 CHECKS=3669730	SAT TT=1.459	SAT TT=1.615
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-19_ext.xml	UNSAT TT=0.69	UNSAT TT=5.2 CHECKS=20354000 NODES=19520	UNSAT TT=5.272 CHECKS=20939400 NODES=20055	UNSAT TT=1.323	UNSAT TT=88.925 CHECKS=30628400	UNSAT TT=72.693 CHECKS=25807700	UNSAT TT=3.745 ASSIGNMENTS=4458	UNSAT TT=3.74 ASSIGNMENTS=4458	UNSAT TT=2.968 CHECKS=832185 NODES=9152	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=0.903 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=0.83 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=7.14	UNSAT TT=16.353	UNSAT TT=0.861 ASSIGNMENTS=9542 CHECKS=3601020	UNSAT TT=0.69 ASSIGNMENTS=9428 CHECKS=3021180	UNSAT TT=14.126	UNSAT TT=0.757 ASSIGNMENTS=8400 CHECKS=3127840	UNSAT TT=0.866 ASSIGNMENTS=9513 CHECKS=3626910	UNSAT TT=21.971	UNSAT TT=9.501 ASSIGNMENTS=8982 CHECKS=12219500	UNSAT TT=6.352	UNSAT TT=7.18
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-23_ext.xml	SAT TT=0.761	SAT TT=3.334 CHECKS=10355600 NODES=10741	SAT TT=3.147 CHECKS=10485800 NODES=10974	SAT TT=1.293	SAT TT=22.163 CHECKS=9079140	SAT TT=4.076 CHECKS=1270130	SAT TT=3.437 ASSIGNMENTS=4857	SAT TT=3.662 ASSIGNMENTS=4857	SAT TT=3.133 CHECKS=892670 NODES=10315	SAT TT=6.556 CHECKS=43347300 NODES=197254	? (TO) TT=1800.03	SAT TT=1.2 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=1.213 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=10.314	SAT TT=3.756	SAT TT=1.2 ASSIGNMENTS=14028 CHECKS=5135010	SAT TT=0.761 ASSIGNMENTS=9908 CHECKS=3174880	SAT TT=13.779	SAT TT=1.193 ASSIGNMENTS=13908 CHECKS=5063530	SAT TT=1.272 ASSIGNMENTS=14464 CHECKS=5319360	SAT TT=23.752	SAT TT=13.961 ASSIGNMENTS=10565 CHECKS=13242400	SAT TT=7.143	SAT TT=6.501
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-24_ext.xml	SAT TT=0.035	SAT TT=2.27 CHECKS=6309920 NODES=6715	SAT TT=2.202 CHECKS=5719260 NODES=6170	SAT TT=0.407	SAT TT=2.912 CHECKS=1056630	SAT TT=0.126 CHECKS=17744	SAT TT=0.789 ASSIGNMENTS=74	SAT TT=0.931 ASSIGNMENTS=74	SAT TT=0.684 CHECKS=43926 NODES=462	SAT TT=0.888 CHECKS=1068410 NODES=5122	SAT TT=0.63 CHECKS=224216 NODES=695	SAT TT=0.049 ASSIGNMENTS=124 CHECKS=39015	SAT TT=0.049 ASSIGNMENTS=124 CHECKS=39015	SAT TT=2.993	SAT TT=6.224	SAT TT=0.035 ASSIGNMENTS=96 CHECKS=32139	SAT TT=0.227 ASSIGNMENTS=3842 CHECKS=879586	SAT TT=0.932	SAT TT=0.382 ASSIGNMENTS=4450 CHECKS=1511040	SAT TT=0.039 ASSIGNMENTS=124 CHECKS=39015	SAT TT=3.585	SAT TT=0.248 ASSIGNMENTS=171 CHECKS=159889	SAT TT=4.133	SAT TT=1.487
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-29_ext.xml	UNSAT TT=0.729	UNSAT TT=4.258 CHECKS=16335400 NODES=15881	UNSAT TT=4.267 CHECKS=16016900 NODES=15412	UNSAT TT=1.349	UNSAT TT=89.581 CHECKS=33558600	UNSAT TT=77.487 CHECKS=27151500	UNSAT TT=4.839 ASSIGNMENTS=6121	UNSAT TT=4.756 ASSIGNMENTS=6121	UNSAT TT=2.891 CHECKS=865097 NODES=9606	? (TO) TT=1800.06	? (TO) TT=1800	UNSAT TT=0.817 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=0.815 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=5.708	UNSAT TT=11.737	UNSAT TT=0.786 ASSIGNMENTS=8631 CHECKS=3294570	UNSAT TT=0.839 ASSIGNMENTS=10534 CHECKS=3395900	UNSAT TT=12.992	UNSAT TT=0.745 ASSIGNMENTS=8549 CHECKS=3288930	UNSAT TT=0.729 ASSIGNMENTS=8667 CHECKS=3268430	UNSAT TT=15.716	UNSAT TT=11.138 ASSIGNMENTS=14965 CHECKS=19271200	UNSAT TT=5.72	UNSAT TT=6.647
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-31_ext.xml	UNSAT TT=0.792	UNSAT TT=4.513 CHECKS=16844800 NODES=16342	UNSAT TT=4.031 CHECKS=16871100 NODES=16421	UNSAT TT=1.355	UNSAT TT=82.687 CHECKS=29733200	UNSAT TT=73.414 CHECKS=24969500	UNSAT TT=4.071 ASSIGNMENTS=4869	UNSAT TT=3.723 ASSIGNMENTS=4869	UNSAT TT=3.029 CHECKS=867251 NODES=9517	? (TO) TT=1800.05	? (TO) TT=1800	UNSAT TT=0.827 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=0.839 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=10.052	UNSAT TT=14.928	UNSAT TT=0.834 ASSIGNMENTS=9163 CHECKS=3454770	UNSAT TT=0.889 ASSIGNMENTS=10952 CHECKS=3582430	UNSAT TT=14.027	UNSAT TT=0.891 ASSIGNMENTS=10001 CHECKS=3698750	UNSAT TT=0.792 ASSIGNMENTS=8773 CHECKS=3310030	UNSAT TT=32.212	UNSAT TT=11.139 ASSIGNMENTS=13083 CHECKS=18754100	UNSAT TT=10.361	UNSAT TT=11.628
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-34_ext.xml	SAT TT=0.09	SAT TT=2.619 CHECKS=8353750 NODES=8200	SAT TT=2.741 CHECKS=9474020 NODES=9181	SAT TT=0.612	SAT TT=24.617 CHECKS=8782210	SAT TT=2.905 CHECKS=957759	SAT TT=1.395 ASSIGNMENTS=1091	SAT TT=1.492 ASSIGNMENTS=1091	SAT TT=0.916 CHECKS=124958 NODES=1366	SAT TT=1.314 CHECKS=5417480 NODES=24971	? (TO) TT=1800.08	SAT TT=0.108 ASSIGNMENTS=904 CHECKS=313146	SAT TT=0.117 ASSIGNMENTS=904 CHECKS=313146	SAT TT=2.405	SAT TT=5.321	SAT TT=0.09 ASSIGNMENTS=782 CHECKS=267404	SAT TT=0.32 ASSIGNMENTS=4949 CHECKS=1320520	SAT TT=5.511	SAT TT=0.096 ASSIGNMENTS=957 CHECKS=298994	SAT TT=0.1 ASSIGNMENTS=904 CHECKS=313146	SAT TT=5.198	SAT TT=0.97 ASSIGNMENTS=795 CHECKS=980972	SAT TT=1.956	SAT TT=1.602
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-38_ext.xml	SAT TT=0.16	SAT TT=1.285 CHECKS=1473740 NODES=1727	SAT TT=1.312 CHECKS=1641130 NODES=1891	SAT TT=0.897	SAT TT=30.911 CHECKS=11637400	SAT TT=2.39 CHECKS=750857	SAT TT=2.595 ASSIGNMENTS=2774	SAT TT=2.404 ASSIGNMENTS=2774	SAT TT=1.991 CHECKS=517369 NODES=6226	SAT TT=7.39 CHECKS=46071700 NODES=207327	? (TO) TT=1800.07	SAT TT=0.236 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=0.254 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=3.937	SAT TT=6.559	SAT TT=0.218 ASSIGNMENTS=2392 CHECKS=852916	SAT TT=0.41 ASSIGNMENTS=6019 CHECKS=1748240	SAT TT=13.848	SAT TT=0.16 ASSIGNMENTS=1668 CHECKS=553068	SAT TT=0.242 ASSIGNMENTS=2536 CHECKS=896350	SAT TT=20.822	SAT TT=2.585 ASSIGNMENTS=3208 CHECKS=4021310	SAT TT=10.02	SAT TT=9.577
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-39_ext.xml	SAT TT=0.152	SAT TT=1.369 CHECKS=1334410 NODES=1465	SAT TT=1.26 CHECKS=1383000 NODES=1512	SAT TT=0.446	SAT TT=7.249 CHECKS=2676550	SAT TT=5.094 CHECKS=1648420	SAT TT=1.486 ASSIGNMENTS=1183	SAT TT=1.543 ASSIGNMENTS=1183	SAT TT=1.84 CHECKS=361013 NODES=4130	SAT TT=2.09 CHECKS=10907000 NODES=50047	? (TO) TT=1800.03	SAT TT=0.169 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=0.168 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=2.263	SAT TT=8.512	SAT TT=0.229 ASSIGNMENTS=2505 CHECKS=920648	SAT TT=0.228 ASSIGNMENTS=3696 CHECKS=876232	SAT TT=4.484	SAT TT=0.226 ASSIGNMENTS=2446 CHECKS=827809	SAT TT=0.152 ASSIGNMENTS=1490 CHECKS=524856	SAT TT=3.996	SAT TT=1.568 ASSIGNMENTS=778 CHECKS=1071310	SAT TT=4.419	SAT TT=1.758
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-40_ext.xml	UNSAT TT=0.912	UNSAT TT=4.135 CHECKS=15509500 NODES=15149	UNSAT TT=4.225 CHECKS=15126500 NODES=14762	UNSAT TT=2.178	UNSAT TT=88.869 CHECKS=30634600	UNSAT TT=74.938 CHECKS=26163100	UNSAT TT=4.499 ASSIGNMENTS=6322	UNSAT TT=5.045 ASSIGNMENTS=6322	UNSAT TT=3.548 CHECKS=1014540 NODES=11409	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=0.993 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=0.981 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=12.821	UNSAT TT=18.786	UNSAT TT=0.956 ASSIGNMENTS=10723 CHECKS=4016950	UNSAT TT=0.973 ASSIGNMENTS=12150 CHECKS=4035030	UNSAT TT=20.217	UNSAT TT=0.912 ASSIGNMENTS=10142 CHECKS=3773960	UNSAT TT=0.947 ASSIGNMENTS=10679 CHECKS=3983840	UNSAT TT=50.096	UNSAT TT=10.688 ASSIGNMENTS=13404 CHECKS=18154900	UNSAT TT=9.387	UNSAT TT=13.226
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-43_ext.xml	SAT TT=0.122	SAT TT=2.03 CHECKS=4914060 NODES=5334	SAT TT=2.057 CHECKS=5267510 NODES=5840	SAT TT=1.869	SAT TT=1.177 CHECKS=414091	SAT TT=4.866 CHECKS=1755200	SAT TT=1.205 ASSIGNMENTS=602	SAT TT=1.149 ASSIGNMENTS=602	SAT TT=0.957 CHECKS=69156 NODES=713	SAT TT=1.355 CHECKS=5030810 NODES=22323	SAT TT=412.766 CHECKS=3036610000 NODES=1199480	SAT TT=0.316 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=0.293 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=3.808	SAT TT=2.448	SAT TT=0.361 ASSIGNMENTS=3895 CHECKS=1441880	SAT TT=0.328 ASSIGNMENTS=4690 CHECKS=1262680	SAT TT=1.589	SAT TT=0.122 ASSIGNMENTS=1186 CHECKS=416120	SAT TT=0.29 ASSIGNMENTS=3089 CHECKS=1173330	SAT TT=4.5	SAT TT=1.193 ASSIGNMENTS=1405 CHECKS=1724600	SAT TT=1.499	SAT TT=3.643
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-45_ext.xml	SAT TT=0.096	SAT TT=0.999 CHECKS=288169 NODES=333	SAT TT=0.935 CHECKS=276807 NODES=283	SAT TT=0.452	SAT TT=3.1 CHECKS=1144210	SAT TT=1.863 CHECKS=604195	SAT TT=1.337 ASSIGNMENTS=737	SAT TT=1.308 ASSIGNMENTS=737	SAT TT=1.316 CHECKS=272352 NODES=2859	SAT TT=1.086 CHECKS=2049230 NODES=9128	SAT TT=7.718 CHECKS=54507700 NODES=74657	SAT TT=0.11 ASSIGNMENTS=771 CHECKS=299021	SAT TT=0.11 ASSIGNMENTS=771 CHECKS=299021	SAT TT=2.339	SAT TT=2.449	SAT TT=0.147 ASSIGNMENTS=1446 CHECKS=555271	SAT TT=0.293 ASSIGNMENTS=4201 CHECKS=1082430	SAT TT=1.573	SAT TT=0.197 ASSIGNMENTS=2120 CHECKS=742463	SAT TT=0.096 ASSIGNMENTS=771 CHECKS=299021	SAT TT=3.208	SAT TT=0.979 ASSIGNMENTS=483 CHECKS=639260	SAT TT=2.19	SAT TT=1.761
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-46_ext.xml	SAT TT=0.047	SAT TT=1.496 CHECKS=2583770 NODES=2699	SAT TT=1.652 CHECKS=2636970 NODES=2661	SAT TT=0.628	SAT TT=0.579 CHECKS=173019	SAT TT=5.162 CHECKS=1847480	SAT TT=1.578 ASSIGNMENTS=1258	SAT TT=1.599 ASSIGNMENTS=1258	SAT TT=0.801 CHECKS=85711 NODES=865	SAT TT=6.883 CHECKS=42830400 NODES=184570	SAT TT=1358.96 CHECKS=10092000000 NODES=4394940	SAT TT=0.056 ASSIGNMENTS=173 CHECKS=71353	SAT TT=0.061 ASSIGNMENTS=173 CHECKS=71353	SAT TT=2.843	SAT TT=3.665	SAT TT=0.269 ASSIGNMENTS=2584 CHECKS=1006350	SAT TT=0.355 ASSIGNMENTS=4857 CHECKS=1364780	SAT TT=3.585	SAT TT=0.331 ASSIGNMENTS=3643 CHECKS=1430800	SAT TT=0.047 ASSIGNMENTS=173 CHECKS=71353	SAT TT=3.429	SAT TT=1.89 ASSIGNMENTS=1116 CHECKS=1597920	SAT TT=3.056	SAT TT=1.455
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-48_ext.xml	SAT TT=0.069	SAT TT=2.707 CHECKS=8625390 NODES=8418	SAT TT=2.957 CHECKS=9779390 NODES=9376	SAT TT=0.929	SAT TT=6.812 CHECKS=2500850	SAT TT=3.019 CHECKS=972194	SAT TT=2.027 ASSIGNMENTS=1697	SAT TT=2.189 ASSIGNMENTS=1697	SAT TT=1.267 CHECKS=180128 NODES=1898	SAT TT=5.396 CHECKS=33958000 NODES=153002	? (TO) TT=1800.08	SAT TT=0.228 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=0.225 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=2.788	SAT TT=7.618	SAT TT=0.141 ASSIGNMENTS=1234 CHECKS=468716	SAT TT=0.235 ASSIGNMENTS=3648 CHECKS=846974	SAT TT=6.554	SAT TT=0.069 ASSIGNMENTS=611 CHECKS=176391	SAT TT=0.198 ASSIGNMENTS=2091 CHECKS=774295	SAT TT=7.838	SAT TT=0.363 ASSIGNMENTS=318 CHECKS=468899	SAT TT=2.511	SAT TT=2.495
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-49_ext.xml	UNSAT TT=0.816	UNSAT TT=12.72 CHECKS=57045400 NODES=57653	UNSAT TT=12.746 CHECKS=57813400 NODES=58485	UNSAT TT=1.519	UNSAT TT=35.903 CHECKS=13410800	UNSAT TT=78.248 CHECKS=28047800	UNSAT TT=4.58 ASSIGNMENTS=6540	UNSAT TT=5.058 ASSIGNMENTS=6540	UNSAT TT=3.345 CHECKS=981323 NODES=10843	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=0.913 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=0.908 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=7.704	UNSAT TT=12.87	UNSAT TT=0.823 ASSIGNMENTS=9155 CHECKS=3453100	UNSAT TT=0.863 ASSIGNMENTS=11177 CHECKS=3578580	UNSAT TT=15.92	UNSAT TT=0.816 ASSIGNMENTS=9303 CHECKS=3446200	UNSAT TT=0.881 ASSIGNMENTS=9837 CHECKS=3709350	UNSAT TT=19.077	UNSAT TT=9.575 ASSIGNMENTS=10706 CHECKS=13625700	UNSAT TT=7.02	UNSAT TT=9.717
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-5_ext.xml	SAT TT=0.064	SAT TT=3.765 CHECKS=14772900 NODES=15122	SAT TT=4.277 CHECKS=15875500 NODES=16141	SAT TT=0.692	SAT TT=3.836 CHECKS=1360890	SAT TT=0.318 CHECKS=84613	SAT TT=2.473 ASSIGNMENTS=2440	SAT TT=2.317 ASSIGNMENTS=2440	SAT TT=1.15 CHECKS=184557 NODES=2088	SAT TT=1.32 CHECKS=3949220 NODES=18115	SAT TT=1016.61 CHECKS=6948680000 NODES=1480610	SAT TT=0.357 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=0.356 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=3.367	SAT TT=4.192	SAT TT=0.453 ASSIGNMENTS=5364 CHECKS=1976140	SAT TT=0.249 ASSIGNMENTS=3655 CHECKS=907535	SAT TT=2.255	SAT TT=0.064 ASSIGNMENTS=615 CHECKS=183207	SAT TT=0.316 ASSIGNMENTS=3650 CHECKS=1333320	SAT TT=10.411	SAT TT=0.883 ASSIGNMENTS=378 CHECKS=532084	SAT TT=2.761	SAT TT=4.061
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-6_ext.xml	UNSAT TT=0.427	UNSAT TT=3.635 CHECKS=13208300 NODES=12342	UNSAT TT=3.589 CHECKS=13315800 NODES=12415	UNSAT TT=0.887	UNSAT TT=85.38 CHECKS=29975600	UNSAT TT=13.458 CHECKS=4325160	UNSAT TT=2.63 ASSIGNMENTS=2599	UNSAT TT=2.339 ASSIGNMENTS=2599	UNSAT TT=2.039 CHECKS=533132 NODES=5400	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=0.466 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=0.471 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=3.426	UNSAT TT=5.79	UNSAT TT=0.427 ASSIGNMENTS=4379 CHECKS=1715350	UNSAT TT=0.565 ASSIGNMENTS=7251 CHECKS=2250930	UNSAT TT=6.139	UNSAT TT=0.45 ASSIGNMENTS=4687 CHECKS=1779280	UNSAT TT=0.441 ASSIGNMENTS=4596 CHECKS=1783280	UNSAT TT=8.508	UNSAT TT=6.36 ASSIGNMENTS=7478 CHECKS=11698900	UNSAT TT=3.473	UNSAT TT=3.604
csp/rand-2-30-15/ normalized-rand-2-30-15-306-230-9_ext.xml	SAT TT=0.275	SAT TT=1.927 CHECKS=4366730 NODES=4737	SAT TT=1.841 CHECKS=3918240 NODES=4220	SAT TT=1.151	SAT TT=0.981 CHECKS=341156	SAT TT=3.1 CHECKS=1026450	SAT TT=3.04 ASSIGNMENTS=3241	SAT TT=2.765 ASSIGNMENTS=3241	SAT TT=1.765 CHECKS=365261 NODES=4542	SAT TT=1.539 CHECKS=6239530 NODES=27681	? (TO) TT=1800.04	SAT TT=0.381 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=0.386 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=2.543	SAT TT=12.879	SAT TT=0.406 ASSIGNMENTS=4422 CHECKS=1627760	SAT TT=0.275 ASSIGNMENTS=4068 CHECKS=1018070	SAT TT=15.902	SAT TT=0.384 ASSIGNMENTS=4276 CHECKS=1511090	SAT TT=0.372 ASSIGNMENTS=3969 CHECKS=1436140	SAT TT=5.531	SAT TT=2.219 ASSIGNMENTS=2144 CHECKS=2836740	SAT TT=1.295	SAT TT=4.473
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-11_ext.xml	SAT TT=2.111	SAT TT=113.436 CHECKS=608190000 NODES=438246	SAT TT=113.041 CHECKS=608060000 NODES=437565	SAT TT=73.256	SAT TT=283.924 CHECKS=75019200	SAT TT=531.775 CHECKS=107383000	SAT TT=141.211 ASSIGNMENTS=165111	SAT TT=142.137 ASSIGNMENTS=165111	SAT TT=86.509 CHECKS=26862700 NODES=240225	SAT TT=2.111 CHECKS=9550740 NODES=29954	? (TO) TT=1800.01	SAT TT=74.82 ASSIGNMENTS=568203 CHECKS=291652000	SAT TT=110.808 ASSIGNMENTS=438246 CHECKS=608190000	SAT TT=979.749	? (TO) TT=1800.02	SAT TT=72.761 ASSIGNMENTS=569910 CHECKS=292607000	SAT TT=59.975 ASSIGNMENTS=468155 CHECKS=239694000	? (TO) TT=1800.03	SAT TT=32.369 ASSIGNMENTS=252544 CHECKS=128950000	SAT TT=72.766 ASSIGNMENTS=568203 CHECKS=291652000	? (TO) TT=1800.1	SAT TT=466.863 ASSIGNMENTS=218077 CHECKS=389968000	SAT TT=1472.25	? (TO) TT=1800.11
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-12_ext.xml	SAT TT=21.033	SAT TT=35.785 CHECKS=202069000 NODES=153181	SAT TT=37.811 CHECKS=197436000 NODES=150291	SAT TT=49.544	SAT TT=784.138 CHECKS=225710000	SAT TT=1432.41 CHECKS=343163000	SAT TT=126.353 ASSIGNMENTS=164715	SAT TT=131.174 ASSIGNMENTS=164715	SAT TT=125.091 CHECKS=38009900 NODES=340105	SAT TT=21.033 CHECKS=141425000 NODES=453040	? (TO) TT=1800.04	SAT TT=40.135 ASSIGNMENTS=265420 CHECKS=131549000	SAT TT=40.47 ASSIGNMENTS=265420 CHECKS=131549000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=38.66 ASSIGNMENTS=313951 CHECKS=155929000	SAT TT=38.786 ASSIGNMENTS=319600 CHECKS=157960000	SAT TT=1297.18	SAT TT=36.217 ASSIGNMENTS=314683 CHECKS=156184000	SAT TT=32.507 ASSIGNMENTS=265420 CHECKS=131549000	? (TO) TT=1800.16	SAT TT=266.547 ASSIGNMENTS=211162 CHECKS=367710000	SAT TT=1079.55	SAT TT=1044.31
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-17_ext.xml	SAT TT=20.832	SAT TT=34.907 CHECKS=198350000 NODES=142535	SAT TT=21.345 CHECKS=107951000 NODES=79011	SAT TT=25.627	? (TO) TT=1800.03	SAT TT=874.948 CHECKS=184436000	SAT TT=267.066 ASSIGNMENTS=343550	SAT TT=266.651 ASSIGNMENTS=343550	SAT TT=174.826 CHECKS=54945600 NODES=503670	SAT TT=20.832 CHECKS=154237000 NODES=470471	? (TO) TT=1800.05	SAT TT=77.558 ASSIGNMENTS=556670 CHECKS=288296000	SAT TT=41.782 ASSIGNMENTS=142535 CHECKS=198350000	SAT TT=731.92	SAT TT=77.645	SAT TT=57.97 ASSIGNMENTS=458994 CHECKS=239601000	SAT TT=57.483 ASSIGNMENTS=453641 CHECKS=233938000	SAT TT=1086.34	SAT TT=26.782 ASSIGNMENTS=227959 CHECKS=117490000	SAT TT=66.469 ASSIGNMENTS=556670 CHECKS=288296000	? (TO) TT=1800.08	SAT TT=611.393 ASSIGNMENTS=573815 CHECKS=1062390000	? (TO) TT=1800.08	SAT TT=1547.81
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-18_ext.xml	SAT TT=2.292	SAT TT=60.563 CHECKS=322143000 NODES=221723	SAT TT=56.51 CHECKS=305814000 NODES=211512	SAT TT=20.671	SAT TT=20.673 CHECKS=5603280	SAT TT=86.982 CHECKS=18316100	SAT TT=61.563 ASSIGNMENTS=74128	SAT TT=60.25 ASSIGNMENTS=74128	SAT TT=57.967 CHECKS=18730200 NODES=163345	SAT TT=2.292 CHECKS=11100800 NODES=34277	? (TO) TT=1800.06	SAT TT=18.144 ASSIGNMENTS=83732 CHECKS=43215100	SAT TT=62.228 ASSIGNMENTS=221723 CHECKS=322143000	? (TO) TT=1800.05	SAT TT=1701.58	SAT TT=17.918 ASSIGNMENTS=138357 CHECKS=72031400	SAT TT=13.199 ASSIGNMENTS=112102 CHECKS=58113600	SAT TT=126.381	SAT TT=16.64 ASSIGNMENTS=128546 CHECKS=66078900	SAT TT=10.586 ASSIGNMENTS=83732 CHECKS=43215100	? (TO) TT=1800.17	SAT TT=137.018 ASSIGNMENTS=109103 CHECKS=198174000	SAT TT=136.773	SAT TT=63.174
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-19_ext.xml	SAT TT=3.448	SAT TT=74.323 CHECKS=399078000 NODES=282181	SAT TT=69.497 CHECKS=399592000 NODES=282606	SAT TT=33.156	SAT TT=836.026 CHECKS=229575000	SAT TT=804.12 CHECKS=185189000	SAT TT=58.521 ASSIGNMENTS=67125	SAT TT=58.356 ASSIGNMENTS=67125	SAT TT=91.476 CHECKS=28767000 NODES=245985	SAT TT=187.752 CHECKS=1396980000 NODES=4442790	? (TO) TT=1800.02	SAT TT=38.469 ASSIGNMENTS=233901 CHECKS=122615000	SAT TT=36.497 ASSIGNMENTS=233901 CHECKS=122615000	SAT TT=347.535	? (TO) TT=1800.06	SAT TT=28.129 ASSIGNMENTS=234569 CHECKS=123026000	SAT TT=3.448 ASSIGNMENTS=29837 CHECKS=14834700	SAT TT=320.491	SAT TT=3.56 ASSIGNMENTS=29229 CHECKS=15117100	SAT TT=28.653 ASSIGNMENTS=233901 CHECKS=122615000	? (TO) TT=1800.14	SAT TT=114.18 ASSIGNMENTS=43723 CHECKS=81565900	SAT TT=120.577	SAT TT=734.511
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-1_ext.xml	SAT TT=1.093	SAT TT=1.12 CHECKS=828664 NODES=665	SAT TT=1.093 CHECKS=661944 NODES=479	SAT TT=11.347	SAT TT=715.383 CHECKS=207735000	SAT TT=45.441 CHECKS=10470400	SAT TT=16.337 ASSIGNMENTS=16215	SAT TT=16.164 ASSIGNMENTS=16215	SAT TT=38.438 CHECKS=12199500 NODES=103200	SAT TT=25.875 CHECKS=194215000 NODES=593020	? (TO) TT=1800	SAT TT=16.47 ASSIGNMENTS=67711 CHECKS=36055900	SAT TT=8.751 ASSIGNMENTS=665 CHECKS=828664	SAT TT=1604.56	? (TO) TT=1800	SAT TT=7.856 ASSIGNMENTS=58991 CHECKS=31448800	SAT TT=25.003 ASSIGNMENTS=188515 CHECKS=100879000	SAT TT=632.393	SAT TT=14.615 ASSIGNMENTS=109979 CHECKS=58509100	SAT TT=8.985 ASSIGNMENTS=67711 CHECKS=36055900	? (TO) TT=1800.12	SAT TT=79.531 ASSIGNMENTS=52159 CHECKS=103375000	SAT TT=37.936	SAT TT=532.042
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-20_ext.xml	SAT TT=5.763	SAT TT=7.451 CHECKS=33186800 NODES=25969	SAT TT=41.11 CHECKS=213570000 NODES=161019	SAT TT=5.763	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=327.116 ASSIGNMENTS=403922	SAT TT=310.271 ASSIGNMENTS=403922	SAT TT=115.538 CHECKS=35348200 NODES=317507	SAT TT=50.741 CHECKS=352251000 NODES=1156420	? (TO) TT=1800.04	SAT TT=53.358 ASSIGNMENTS=372279 CHECKS=185493000	SAT TT=14.309 ASSIGNMENTS=25969 CHECKS=33186800	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=35.905 ASSIGNMENTS=287978 CHECKS=143668000	SAT TT=89.694 ASSIGNMENTS=721511 CHECKS=359210000	SAT TT=1495.7	SAT TT=50.553 ASSIGNMENTS=400085 CHECKS=198853000	SAT TT=46.281 ASSIGNMENTS=372279 CHECKS=185493000	? (TO) TT=1800.11	SAT TT=579.216 ASSIGNMENTS=465773 CHECKS=814409000	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-22_ext.xml	SAT TT=0.835	SAT TT=24.379 CHECKS=132298000 NODES=99710	SAT TT=16.855 CHECKS=83483300 NODES=63195	SAT TT=248.633	? (TO) TT=1800.09	SAT TT=1352.74 CHECKS=325111000	SAT TT=82.834 ASSIGNMENTS=103234	SAT TT=80.795 ASSIGNMENTS=103234	SAT TT=6.862 CHECKS=1932110 NODES=18388	SAT TT=3.993 CHECKS=25333800 NODES=78967	? (TO) TT=1800.09	SAT TT=30.996 ASSIGNMENTS=180652 CHECKS=91127700	SAT TT=31.286 ASSIGNMENTS=99710 CHECKS=132298000	? (TO) TT=1800.01	? (TO) TT=1800.05	SAT TT=9.223 ASSIGNMENTS=72313 CHECKS=37086900	SAT TT=0.835 ASSIGNMENTS=7658 CHECKS=3114620	SAT TT=124.757	SAT TT=21.981 ASSIGNMENTS=172266 CHECKS=86594800	SAT TT=22.406 ASSIGNMENTS=180652 CHECKS=91127700	SAT TT=696.188	SAT TT=79.198 ASSIGNMENTS=70996 CHECKS=120339000	SAT TT=1112	SAT TT=219.342
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-23_ext.xml	SAT TT=2.763	SAT TT=9.294 CHECKS=43676300 NODES=32744	SAT TT=8.962 CHECKS=41721000 NODES=31260	SAT TT=40.997	SAT TT=502.617 CHECKS=139874000	SAT TT=1445.16 CHECKS=355157000	SAT TT=23.109 ASSIGNMENTS=23709	SAT TT=23.224 ASSIGNMENTS=23709	SAT TT=15.743 CHECKS=4706950 NODES=41649	SAT TT=16.331 CHECKS=117731000 NODES=375508	? (TO) TT=1800.07	SAT TT=10.212 ASSIGNMENTS=21319 CHECKS=10876400	SAT TT=16.613 ASSIGNMENTS=32744 CHECKS=43676300	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=3.391 ASSIGNMENTS=26248 CHECKS=13449200	SAT TT=6.988 ASSIGNMENTS=56470 CHECKS=28232000	SAT TT=6.004	SAT TT=7.295 ASSIGNMENTS=55317 CHECKS=29172700	SAT TT=2.763 ASSIGNMENTS=21319 CHECKS=10876400	? (TO) TT=1800.11	SAT TT=102.582 ASSIGNMENTS=24934 CHECKS=44453900	SAT TT=347.277	SAT TT=72.183
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-25_ext.xml	SAT TT=7.184	SAT TT=82.56 CHECKS=474895000 NODES=326374	SAT TT=83.874 CHECKS=458625000 NODES=315180	SAT TT=40.92	SAT TT=798.066 CHECKS=228916000	? (TO) TT=1800.02	SAT TT=69.211 ASSIGNMENTS=81891	SAT TT=72.475 ASSIGNMENTS=81891	SAT TT=38.071 CHECKS=12345500 NODES=107867	SAT TT=7.184 CHECKS=43722400 NODES=137169	? (TO) TT=1800	SAT TT=20.607 ASSIGNMENTS=96496 CHECKS=50354700	SAT TT=87.856 ASSIGNMENTS=326374 CHECKS=474895000	SAT TT=326.631	SAT TT=923.714	SAT TT=35.89 ASSIGNMENTS=272584 CHECKS=142914000	SAT TT=12.671 ASSIGNMENTS=98113 CHECKS=50622300	SAT TT=414.267	SAT TT=12.985 ASSIGNMENTS=99424 CHECKS=51949800	SAT TT=12.478 ASSIGNMENTS=96496 CHECKS=50354700	? (TO) TT=1800.14	SAT TT=208.996 ASSIGNMENTS=97878 CHECKS=168275000	SAT TT=788.647	SAT TT=32.422
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-27_ext.xml	SAT TT=3.314	SAT TT=43.443 CHECKS=235043000 NODES=151929	SAT TT=47.376 CHECKS=260325000 NODES=169311	SAT TT=58.937	SAT TT=613.242 CHECKS=173711000	SAT TT=380.035 CHECKS=76911000	SAT TT=116.813 ASSIGNMENTS=124912	SAT TT=116.868 ASSIGNMENTS=124912	SAT TT=37.515 CHECKS=12064400 NODES=108430	SAT TT=3.314 CHECKS=18123800 NODES=58859	? (TO) TT=1800.02	SAT TT=36.835 ASSIGNMENTS=230282 CHECKS=120453000	SAT TT=46.984 ASSIGNMENTS=151929 CHECKS=235043000	SAT TT=1547.48	? (TO) TT=1800.1	SAT TT=29.459 ASSIGNMENTS=230077 CHECKS=120769000	SAT TT=27.821 ASSIGNMENTS=218643 CHECKS=113551000	SAT TT=130.069	SAT TT=29.081 ASSIGNMENTS=226860 CHECKS=118497000	SAT TT=27.452 ASSIGNMENTS=230282 CHECKS=120453000	? (TO) TT=1800.11	SAT TT=339.007 ASSIGNMENTS=279392 CHECKS=538842000	SAT TT=603.511	SAT TT=835.53
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-28_ext.xml	SAT TT=0.233	SAT TT=9.097 CHECKS=44797300 NODES=29654	SAT TT=9.86 CHECKS=53978900 NODES=35582	SAT TT=31.745	SAT TT=11.531 CHECKS=3013110	SAT TT=163.602 CHECKS=33623900	SAT TT=1.535 ASSIGNMENTS=563	SAT TT=1.447 ASSIGNMENTS=563	SAT TT=17.655 CHECKS=5924950 NODES=49036	SAT TT=7.674 CHECKS=48088000 NODES=151766	? (TO) TT=1800.01	SAT TT=0.263 ASSIGNMENTS=1493 CHECKS=785748	SAT TT=0.253 ASSIGNMENTS=1493 CHECKS=785748	? (TO) TT=1800.04	SAT TT=229.694	SAT TT=0.233 ASSIGNMENTS=1289 CHECKS=699504	SAT TT=1.651 ASSIGNMENTS=13179 CHECKS=6396530	SAT TT=15.634	SAT TT=1.138 ASSIGNMENTS=8905 CHECKS=4643320	SAT TT=0.246 ASSIGNMENTS=1493 CHECKS=785748	? (TO) TT=1800.09	SAT TT=52.143 ASSIGNMENTS=7192 CHECKS=14022500	SAT TT=383.061	SAT TT=466.948
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-33_ext.xml	SAT TT=6.794	SAT TT=128.027 CHECKS=671453000 NODES=519406	SAT TT=121.146 CHECKS=640932000 NODES=498622	SAT TT=173.808	SAT TT=754.349 CHECKS=204736000	SAT TT=171.885 CHECKS=34628500	SAT TT=333.071 ASSIGNMENTS=438888	SAT TT=336.449 ASSIGNMENTS=438888	SAT TT=269.358 CHECKS=78724100 NODES=742371	SAT TT=29.754 CHECKS=203229000 NODES=644521	? (TO) TT=1800.04	SAT TT=32.274 ASSIGNMENTS=200153 CHECKS=100239000	SAT TT=125.938 ASSIGNMENTS=519406 CHECKS=671453000	? (TO) TT=1800.05	SAT TT=316.184	SAT TT=24.614 ASSIGNMENTS=196070 CHECKS=98311500	SAT TT=8.773 ASSIGNMENTS=76445 CHECKS=37867500	? (TO) TT=1800.08	SAT TT=6.794 ASSIGNMENTS=52609 CHECKS=26711600	SAT TT=22.98 ASSIGNMENTS=200153 CHECKS=100239000	? (TO) TT=1800.18	SAT TT=362.272 ASSIGNMENTS=65372 CHECKS=108406000	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-38_ext.xml	SAT TT=16.426	SAT TT=27.162 CHECKS=142937000 NODES=99464	SAT TT=30.083 CHECKS=157289000 NODES=108479	SAT TT=23.859	SAT TT=355.613 CHECKS=96906200	SAT TT=572.381 CHECKS=136704000	SAT TT=36.752 ASSIGNMENTS=41502	SAT TT=36.906 ASSIGNMENTS=41502	SAT TT=48.278 CHECKS=14517500 NODES=128345	SAT TT=28.102 CHECKS=209186000 NODES=653985	? (TO) TT=1800.08	SAT TT=30.504 ASSIGNMENTS=175705 CHECKS=91852100	SAT TT=32.652 ASSIGNMENTS=99464 CHECKS=142937000	? (TO) TT=1800	SAT TT=490.65	SAT TT=20.656 ASSIGNMENTS=159666 CHECKS=82486400	SAT TT=16.426 ASSIGNMENTS=140248 CHECKS=71853900	SAT TT=277.231	SAT TT=23.136 ASSIGNMENTS=176904 CHECKS=92512200	SAT TT=22.469 ASSIGNMENTS=175705 CHECKS=91852100	SAT TT=528.434	SAT TT=283.787 ASSIGNMENTS=235286 CHECKS=434715000	SAT TT=209.817	SAT TT=103.887
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-39_ext.xml	SAT TT=4.806	SAT TT=64.486 CHECKS=358305000 NODES=229869	SAT TT=72.702 CHECKS=405221000 NODES=258826	SAT TT=13.765	SAT TT=1129.94 CHECKS=300972000	SAT TT=661.742 CHECKS=160561000	SAT TT=51.721 ASSIGNMENTS=53928	SAT TT=51.444 ASSIGNMENTS=53928	SAT TT=15.289 CHECKS=4987840 NODES=39493	SAT TT=4.806 CHECKS=30098000 NODES=91108	? (TO) TT=1800.04	SAT TT=21.239 ASSIGNMENTS=101575 CHECKS=55893400	SAT TT=66.42 ASSIGNMENTS=229869 CHECKS=358305000	SAT TT=222.362	SAT TT=128.995	SAT TT=13.836 ASSIGNMENTS=101751 CHECKS=55915800	SAT TT=13.708 ASSIGNMENTS=102664 CHECKS=55865500	SAT TT=247.291	SAT TT=7.433 ASSIGNMENTS=54058 CHECKS=29895200	SAT TT=12.729 ASSIGNMENTS=101575 CHECKS=55893400	SAT TT=948.763	SAT TT=66.336 ASSIGNMENTS=25933 CHECKS=52244000	SAT TT=66.591	SAT TT=191.417
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-3_ext.xml	SAT TT=4.581	SAT TT=118.662 CHECKS=705927000 NODES=481550	SAT TT=124.111 CHECKS=684149000 NODES=468122	SAT TT=4.581	SAT TT=915.284 CHECKS=244726000	SAT TT=425.701 CHECKS=99288900	SAT TT=44.788 ASSIGNMENTS=49021	SAT TT=45.573 ASSIGNMENTS=49021	SAT TT=125.374 CHECKS=41169900 NODES=350418	SAT TT=26.157 CHECKS=187690000 NODES=587375	? (TO) TT=1800.08	SAT TT=26.409 ASSIGNMENTS=142556 CHECKS=74883700	SAT TT=125.661 ASSIGNMENTS=481550 CHECKS=705927000	SAT TT=367.672	SAT TT=389.431	SAT TT=17.541 ASSIGNMENTS=142751 CHECKS=75036700	SAT TT=22.783 ASSIGNMENTS=179556 CHECKS=91929500	SAT TT=591.093	SAT TT=47.231 ASSIGNMENTS=354054 CHECKS=185830000	SAT TT=18.694 ASSIGNMENTS=142556 CHECKS=74883700	? (TO) TT=1800.13	SAT TT=280.068 ASSIGNMENTS=175241 CHECKS=351829000	SAT TT=703.824	SAT TT=1419.48
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-40_ext.xml	SAT TT=6.719	SAT TT=122.867 CHECKS=720062000 NODES=493848	SAT TT=121.714 CHECKS=725215000 NODES=497344	SAT TT=6.719	SAT TT=183.497 CHECKS=46841800	SAT TT=108.02 CHECKS=24372100	SAT TT=28.266 ASSIGNMENTS=30334	SAT TT=27.689 ASSIGNMENTS=30334	SAT TT=104.431 CHECKS=33562600 NODES=290578	SAT TT=119.172 CHECKS=903064000 NODES=2742740	? (TO) TT=1800.1	SAT TT=24.379 ASSIGNMENTS=128199 CHECKS=68466100	SAT TT=130.116 ASSIGNMENTS=493848 CHECKS=720062000	SAT TT=182.752	SAT TT=252.116	SAT TT=16.444 ASSIGNMENTS=136390 CHECKS=72315800	SAT TT=35.232 ASSIGNMENTS=283509 CHECKS=153011000	SAT TT=422.404	SAT TT=34.697 ASSIGNMENTS=281985 CHECKS=152243000	SAT TT=16.727 ASSIGNMENTS=128199 CHECKS=68466100	SAT TT=1664.31	SAT TT=229.107 ASSIGNMENTS=74859 CHECKS=138195000	SAT TT=664.729	SAT TT=22.574
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-41_ext.xml	SAT TT=2.378	SAT TT=333.902 CHECKS=1838650000 NODES=1219540	SAT TT=337.293 CHECKS=1853890000 NODES=1227720	SAT TT=48.401	SAT TT=1071.52 CHECKS=297719000	SAT TT=192.044 CHECKS=42372300	SAT TT=149.08 ASSIGNMENTS=166967	SAT TT=135.817 ASSIGNMENTS=166967	SAT TT=63.54 CHECKS=20631700 NODES=174065	SAT TT=40.813 CHECKS=282924000 NODES=891626	? (TO) TT=1800.05	SAT TT=10.01 ASSIGNMENTS=17126 CHECKS=9335190	SAT TT=316.589 ASSIGNMENTS=1219540 CHECKS=1838650000	SAT TT=1123.3	? (TO) TT=1800.09	SAT TT=2.409 ASSIGNMENTS=17683 CHECKS=9647800	SAT TT=14.694 ASSIGNMENTS=110101 CHECKS=59222200	SAT TT=806.929	SAT TT=31.76 ASSIGNMENTS=234481 CHECKS=127040000	SAT TT=2.378 ASSIGNMENTS=17126 CHECKS=9335190	? (TO) TT=1800.1	SAT TT=210.881 ASSIGNMENTS=33786 CHECKS=71497200	SAT TT=498.924	SAT TT=1795.52
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-42_ext.xml	SAT TT=2.398	SAT TT=83.068 CHECKS=448155000 NODES=311580	SAT TT=80.227 CHECKS=467003000 NODES=324668	SAT TT=3.298	SAT TT=606.928 CHECKS=167501000	SAT TT=201.709 CHECKS=39560600	SAT TT=8.581 ASSIGNMENTS=8840	SAT TT=8.605 ASSIGNMENTS=8840	SAT TT=58.321 CHECKS=17892800 NODES=159050	SAT TT=3.379 CHECKS=20154500 NODES=63277	? (TO) TT=1800.03	SAT TT=10.06 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=9.546 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=1220.22	? (TO) TT=1800.03	SAT TT=3.659 ASSIGNMENTS=29323 CHECKS=14727300	SAT TT=2.398 ASSIGNMENTS=21205 CHECKS=10076800	SAT TT=101.256	SAT TT=22.305 ASSIGNMENTS=169781 CHECKS=87397400	SAT TT=2.445 ASSIGNMENTS=18960 CHECKS=9625810	SAT TT=229.959	SAT TT=157.097 ASSIGNMENTS=131390 CHECKS=233757000	SAT TT=800.856	SAT TT=23.379
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-44_ext.xml	SAT TT=11.489	SAT TT=34.111 CHECKS=181257000 NODES=128365	SAT TT=32.002 CHECKS=180737000 NODES=128483	SAT TT=45.423	SAT TT=803.378 CHECKS=217282000	SAT TT=439.541 CHECKS=96908600	SAT TT=95.395 ASSIGNMENTS=121544	SAT TT=101.942 ASSIGNMENTS=121544	SAT TT=219.225 CHECKS=72173200 NODES=656001	SAT TT=11.489 CHECKS=82511100 NODES=258089	? (TO) TT=1800.03	SAT TT=48.193 ASSIGNMENTS=355220 CHECKS=179501000	SAT TT=39.556 ASSIGNMENTS=128365 CHECKS=181257000	SAT TT=292.29	SAT TT=698.385	SAT TT=44.1 ASSIGNMENTS=354039 CHECKS=178786000	SAT TT=49.691 ASSIGNMENTS=430235 CHECKS=216829000	SAT TT=1085.41	SAT TT=42.942 ASSIGNMENTS=361111 CHECKS=181395000	SAT TT=43.634 ASSIGNMENTS=355220 CHECKS=179501000	? (TO) TT=1800.2	SAT TT=559.245 ASSIGNMENTS=436501 CHECKS=746116000	SAT TT=415.567	SAT TT=684.203
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-49_ext.xml	SAT TT=2.727	SAT TT=64.525 CHECKS=337963000 NODES=248994	SAT TT=72.965 CHECKS=384733000 NODES=281667	SAT TT=3.777	SAT TT=1447.18 CHECKS=433538000	SAT TT=149.868 CHECKS=32189900	SAT TT=10.456 ASSIGNMENTS=12307	SAT TT=11.339 ASSIGNMENTS=12307	SAT TT=57.832 CHECKS=18725600 NODES=168365	SAT TT=8.485 CHECKS=53471900 NODES=164255	? (TO) TT=1800.05	SAT TT=10.869 ASSIGNMENTS=26732 CHECKS=13288400	SAT TT=67.154 ASSIGNMENTS=248994 CHECKS=337963000	? (TO) TT=1800	? (TO) TT=1800.02	SAT TT=3.091 ASSIGNMENTS=24682 CHECKS=12326200	SAT TT=2.727 ASSIGNMENTS=25137 CHECKS=11848300	SAT TT=112.498	SAT TT=3.044 ASSIGNMENTS=26730 CHECKS=13237000	SAT TT=3.04 ASSIGNMENTS=26732 CHECKS=13288400	? (TO) TT=1800.15	SAT TT=208.495 ASSIGNMENTS=93586 CHECKS=167814000	SAT TT=779.068	SAT TT=58.189
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-50_ext.xml	SAT TT=2.522	SAT TT=266.839 CHECKS=1542810000 NODES=1143930	SAT TT=282.252 CHECKS=1519570000 NODES=1121160	SAT TT=2.522	? (TO) TT=1800.02	SAT TT=1664.5 CHECKS=366205000	SAT TT=805.909 ASSIGNMENTS=1028690	SAT TT=838.41 ASSIGNMENTS=1028690	SAT TT=346.193 CHECKS=105625000 NODES=1010360	SAT TT=418.677 CHECKS=3132570000 NODES=9607250	? (TO) TT=1800.05	SAT TT=157.883 ASSIGNMENTS=1282050 CHECKS=658419000	SAT TT=275.592 ASSIGNMENTS=1143930 CHECKS=1542810000	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=143.846 ASSIGNMENTS=1238390 CHECKS=636029000	SAT TT=11.256 ASSIGNMENTS=91760 CHECKS=45682500	? (TO) TT=1800.11	SAT TT=99.802 ASSIGNMENTS=851275 CHECKS=431767000	SAT TT=152.351 ASSIGNMENTS=1282050 CHECKS=658419000	? (TO) TT=1800.16	SAT TT=1061.32 ASSIGNMENTS=828230 CHECKS=1377490000	SAT TT=730.415	? (TO) TT=1800.07
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-6_ext.xml	SAT TT=3.652	SAT TT=34.509 CHECKS=202743000 NODES=134223	SAT TT=27.328 CHECKS=147131000 NODES=96639	SAT TT=17.572	? (TO) TT=1800.07	SAT TT=1412.21 CHECKS=333073000	SAT TT=116.03 ASSIGNMENTS=139103	SAT TT=114.249 ASSIGNMENTS=139103	SAT TT=130.219 CHECKS=43985300 NODES=378105	SAT TT=3.652 CHECKS=20113500 NODES=64441	? (TO) TT=1800.1	SAT TT=36.504 ASSIGNMENTS=219918 CHECKS=114636000	SAT TT=41.882 ASSIGNMENTS=134223 CHECKS=202743000	? (TO) TT=1800.06	SAT TT=680.515	SAT TT=29.546 ASSIGNMENTS=227762 CHECKS=118854000	SAT TT=42.766 ASSIGNMENTS=322088 CHECKS=168914000	SAT TT=307.531	SAT TT=37.678 ASSIGNMENTS=286323 CHECKS=149686000	SAT TT=26.613 ASSIGNMENTS=219918 CHECKS=114636000	SAT TT=439.539	SAT TT=302.528 ASSIGNMENTS=274261 CHECKS=510173000	SAT TT=1033.88	SAT TT=32.288
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-7_ext.xml	SAT TT=10.441	SAT TT=15.979 CHECKS=78452400 NODES=60331	SAT TT=24.706 CHECKS=125463000 NODES=96715	SAT TT=96.255	SAT TT=1389.59 CHECKS=382281000	? (TO) TT=1800.06	SAT TT=316.132 ASSIGNMENTS=400563	SAT TT=317.465 ASSIGNMENTS=400563	SAT TT=179.968 CHECKS=53901100 NODES=496611	SAT TT=13.676 CHECKS=90881100 NODES=289476	? (TO) TT=1800.04	SAT TT=110.374 ASSIGNMENTS=832174 CHECKS=415395000	SAT TT=22.903 ASSIGNMENTS=60331 CHECKS=78452400	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=10.471 ASSIGNMENTS=86327 CHECKS=42462700	SAT TT=10.441 ASSIGNMENTS=87148 CHECKS=42254400	SAT TT=350.258	SAT TT=33.271 ASSIGNMENTS=268835 CHECKS=133530000	SAT TT=106.609 ASSIGNMENTS=832174 CHECKS=415395000	? (TO) TT=1800.16	SAT TT=1053.69 ASSIGNMENTS=799360 CHECKS=1301740000	? (TO) TT=1800.06	SAT TT=1062.08
csp/rand-2-40-19-fcd/ normalized-rand-2-40-19-443-230-fcd-8_ext.xml	SAT TT=6.669	SAT TT=79.698 CHECKS=450018000 NODES=287009	SAT TT=84.474 CHECKS=471067000 NODES=299430	SAT TT=20.504	SAT TT=528.157 CHECKS=132372000	SAT TT=279.613 CHECKS=56463700	SAT TT=49.434 ASSIGNMENTS=49890	SAT TT=45.982 ASSIGNMENTS=49890	SAT TT=63.784 CHECKS=20747700 NODES=176953	SAT TT=16.594 CHECKS=122544000 NODES=381471	? (TO) TT=1800	SAT TT=13.585 ASSIGNMENTS=49057 CHECKS=26140500	SAT TT=81.44 ASSIGNMENTS=287009 CHECKS=450018000	SAT TT=623.722	SAT TT=1069.08	SAT TT=23.187 ASSIGNMENTS=173702 CHECKS=93003800	SAT TT=13.053 ASSIGNMENTS=105777 CHECKS=56239500	SAT TT=181.596	SAT TT=13.011 ASSIGNMENTS=95388 CHECKS=50727600	SAT TT=6.669 ASSIGNMENTS=49057 CHECKS=26140500	SAT TT=531.048	SAT TT=116.781 ASSIGNMENTS=32773 CHECKS=62278100	SAT TT=341.871	SAT TT=285.02
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-10_ext.xml	SAT TT=28.202	SAT TT=69.028 CHECKS=364894000 NODES=276758	SAT TT=68.909 CHECKS=363721000 NODES=274769	SAT TT=135.418	? (TO) TT=1800.02	SAT TT=1640.55 CHECKS=331296000	SAT TT=285.145 ASSIGNMENTS=347458	SAT TT=292.405 ASSIGNMENTS=347458	SAT TT=178.039 CHECKS=51072200 NODES=467696	SAT TT=28.202 CHECKS=210717000 NODES=652673	? (TO) TT=1800.02	SAT TT=97.421 ASSIGNMENTS=713151 CHECKS=368278000	SAT TT=71.141 ASSIGNMENTS=276758 CHECKS=364894000	SAT TT=276.09	SAT TT=286.809	SAT TT=68.867 ASSIGNMENTS=556038 CHECKS=283010000	SAT TT=68.424 ASSIGNMENTS=557184 CHECKS=282784000	? (TO) TT=1800.07	SAT TT=68.353 ASSIGNMENTS=545002 CHECKS=277779000	SAT TT=83.94 ASSIGNMENTS=713151 CHECKS=368278000	SAT TT=1510.92	SAT TT=1265.07 ASSIGNMENTS=1206190 CHECKS=2031530000	SAT TT=194.285	SAT TT=1626.45
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-11_ext.xml	UNSAT TT=104.571	UNSAT TT=358.316 CHECKS=1946750000 NODES=1374860	UNSAT TT=336.795 CHECKS=1957920000 NODES=1379980	UNSAT TT=170.921	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=492.315 ASSIGNMENTS=594198	UNSAT TT=485.189 ASSIGNMENTS=594198	UNSAT TT=386.367 CHECKS=119229000 NODES=1084310	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=119.161 ASSIGNMENTS=868010 CHECKS=446714000	UNSAT TT=335.462 ASSIGNMENTS=1374860 CHECKS=1946750000	? (TO) TT=1800.08	? (TO) TT=1800.03	UNSAT TT=115.569 ASSIGNMENTS=973805 CHECKS=497934000	UNSAT TT=115.448 ASSIGNMENTS=905233 CHECKS=464851000	? (TO) TT=1800.04	UNSAT TT=104.571 ASSIGNMENTS=876258 CHECKS=450591000	UNSAT TT=109.238 ASSIGNMENTS=868010 CHECKS=446714000	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-13_ext.xml	UNSAT TT=27.619	UNSAT TT=138.109 CHECKS=768417000 NODES=501800	UNSAT TT=140.051 CHECKS=790862000 NODES=514776	UNSAT TT=48.975	? (TO) TT=1800.04	? (TO) TT=1800.11	UNSAT TT=116.039 ASSIGNMENTS=134012	UNSAT TT=126.27 ASSIGNMENTS=134012	UNSAT TT=85.347 CHECKS=28846000 NODES=242672	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=39.87 ASSIGNMENTS=237191 CHECKS=128647000	UNSAT TT=133.468 ASSIGNMENTS=501800 CHECKS=768417000	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=30.647 ASSIGNMENTS=227826 CHECKS=122972000	UNSAT TT=27.619 ASSIGNMENTS=222006 CHECKS=118911000	UNSAT TT=648.706	UNSAT TT=29.82 ASSIGNMENTS=220528 CHECKS=119027000	UNSAT TT=31.545 ASSIGNMENTS=237191 CHECKS=128647000	? (TO) TT=1800.14	UNSAT TT=604.761 ASSIGNMENTS=412849 CHECKS=813209000	UNSAT TT=469.602	UNSAT TT=1377.33
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-15_ext.xml	SAT TT=2.342	SAT TT=30.274 CHECKS=169255000 NODES=107442	SAT TT=26.301 CHECKS=158617000 NODES=102361	SAT TT=2.342	? (TO) TT=1800.09	SAT TT=301.586 CHECKS=62924800	SAT TT=60.219 ASSIGNMENTS=64944	SAT TT=60.972 ASSIGNMENTS=64944	SAT TT=37.921 CHECKS=13629400 NODES=106775	SAT TT=20.378 CHECKS=138851000 NODES=439135	? (TO) TT=1800.07	SAT TT=23.201 ASSIGNMENTS=114729 CHECKS=61629100	SAT TT=35.188 ASSIGNMENTS=107442 CHECKS=169255000	SAT TT=85.066	SAT TT=766.207	SAT TT=7.241 ASSIGNMENTS=52911 CHECKS=28605500	SAT TT=13.69 ASSIGNMENTS=111537 CHECKS=59179800	SAT TT=134.819	SAT TT=15.526 ASSIGNMENTS=114489 CHECKS=61204400	SAT TT=15.699 ASSIGNMENTS=114729 CHECKS=61629100	SAT TT=1343.23	SAT TT=87.79 ASSIGNMENTS=57383 CHECKS=126015000	SAT TT=4.433	SAT TT=6.382
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-16_ext.xml	UNSAT TT=99.686	UNSAT TT=224.628 CHECKS=1314660000 NODES=1002760	UNSAT TT=227.358 CHECKS=1306120000 NODES=997863	UNSAT TT=131.696	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=372.422 ASSIGNMENTS=503703	UNSAT TT=400.221 ASSIGNMENTS=503703	UNSAT TT=307.555 CHECKS=92418000 NODES=865385	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=110.213 ASSIGNMENTS=818408 CHECKS=414846000	UNSAT TT=232.156 ASSIGNMENTS=1002760 CHECKS=1314660000	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=100.91 ASSIGNMENTS=820446 CHECKS=415822000	UNSAT TT=99.686 ASSIGNMENTS=818978 CHECKS=414396000	? (TO) TT=1800.02	UNSAT TT=104.873 ASSIGNMENTS=829731 CHECKS=422683000	UNSAT TT=102.707 ASSIGNMENTS=818408 CHECKS=414846000	? (TO) TT=1800.17	UNSAT TT=1120.61 ASSIGNMENTS=1095710 CHECKS=1824950000	? (TO) TT=1800.11	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-19_ext.xml	UNSAT TT=43.001	UNSAT TT=126.294 CHECKS=735696000 NODES=510919	UNSAT TT=125.754 CHECKS=729967000 NODES=506283	UNSAT TT=109.154	? (TO) TT=1800.09	UNSAT TT=786.588 CHECKS=165167000	UNSAT TT=179.661 ASSIGNMENTS=211865	UNSAT TT=194.144 ASSIGNMENTS=211865	UNSAT TT=143.757 CHECKS=48902200 NODES=418900	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=58.447 ASSIGNMENTS=391312 CHECKS=203760000	UNSAT TT=134.054 ASSIGNMENTS=510919 CHECKS=735696000	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=51.348 ASSIGNMENTS=399906 CHECKS=207899000	UNSAT TT=43.001 ASSIGNMENTS=363298 CHECKS=187928000	UNSAT TT=1270.51	UNSAT TT=47.255 ASSIGNMENTS=364689 CHECKS=189601000	UNSAT TT=51.201 ASSIGNMENTS=391312 CHECKS=203760000	? (TO) TT=1800.13	UNSAT TT=675.025 ASSIGNMENTS=586166 CHECKS=1102780000	UNSAT TT=899.862	? (TO) TT=1800.07
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-21_ext.xml	SAT TT=15.481	SAT TT=206.115 CHECKS=1120530000 NODES=821150	SAT TT=191.297 CHECKS=1119030000 NODES=820530	SAT TT=113.192	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=226.526 ASSIGNMENTS=279457	SAT TT=222.905 ASSIGNMENTS=279457	SAT TT=109.735 CHECKS=33419000 NODES=306080	SAT TT=44.257 CHECKS=331528000 NODES=1057260	? (TO) TT=1800.03	SAT TT=22.715 ASSIGNMENTS=137343 CHECKS=67687600	SAT TT=199.589 ASSIGNMENTS=821150 CHECKS=1120530000	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=17.138 ASSIGNMENTS=138497 CHECKS=68301300	SAT TT=56.114 ASSIGNMENTS=454319 CHECKS=226718000	SAT TT=1041.64	SAT TT=36.177 ASSIGNMENTS=289290 CHECKS=143070000	SAT TT=15.481 ASSIGNMENTS=137343 CHECKS=67687600	? (TO) TT=1800.12	SAT TT=30.05 ASSIGNMENTS=21079 CHECKS=33645500	SAT TT=122.853	SAT TT=233.456
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-23_ext.xml	SAT TT=8.544	SAT TT=110.511 CHECKS=612481000 NODES=422681	SAT TT=112.046 CHECKS=607753000 NODES=419473	SAT TT=26.14	SAT TT=669.139 CHECKS=195389000	SAT TT=1415.52 CHECKS=364294000	SAT TT=176.465 ASSIGNMENTS=188229	SAT TT=164.443 ASSIGNMENTS=188229	SAT TT=83.469 CHECKS=26351600 NODES=221603	SAT TT=347.882 CHECKS=2655550000 NODES=8456400	? (TO) TT=1800.03	SAT TT=19.662 ASSIGNMENTS=102133 CHECKS=54478800	SAT TT=111.287 ASSIGNMENTS=422681 CHECKS=612481000	SAT TT=8.544	SAT TT=573.67	SAT TT=26.012 ASSIGNMENTS=198337 CHECKS=104047000	SAT TT=23.904 ASSIGNMENTS=183041 CHECKS=95836500	SAT TT=688.662	SAT TT=22.051 ASSIGNMENTS=178867 CHECKS=94465800	SAT TT=13.547 ASSIGNMENTS=102133 CHECKS=54478800	SAT TT=47.654	SAT TT=334.719 ASSIGNMENTS=273356 CHECKS=514280000	SAT TT=607.605	SAT TT=186.015
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-24_ext.xml	UNSAT TT=53.868	UNSAT TT=140.245 CHECKS=760093000 NODES=537383	UNSAT TT=138.119 CHECKS=740737000 NODES=522900	UNSAT TT=152.715	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=277.333 ASSIGNMENTS=303800	UNSAT TT=273.978 ASSIGNMENTS=303800	UNSAT TT=201.479 CHECKS=60180600 NODES=525053	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=61.072 ASSIGNMENTS=447356 CHECKS=236430000	UNSAT TT=138.21 ASSIGNMENTS=537383 CHECKS=760093000	? (TO) TT=1800.01	? (TO) TT=1800.06	UNSAT TT=64.211 ASSIGNMENTS=491123 CHECKS=261250000	UNSAT TT=57.387 ASSIGNMENTS=446119 CHECKS=234743000	UNSAT TT=1388.4	UNSAT TT=53.868 ASSIGNMENTS=442748 CHECKS=233632000	UNSAT TT=57.717 ASSIGNMENTS=447356 CHECKS=236430000	? (TO) TT=1800.16	UNSAT TT=1012.63 ASSIGNMENTS=657348 CHECKS=1239070000	UNSAT TT=1608.04	? (TO) TT=1800.06
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-25_ext.xml	UNSAT TT=53.415	UNSAT TT=203.88 CHECKS=1138680000 NODES=764698	UNSAT TT=205.487 CHECKS=1145510000 NODES=769644	UNSAT TT=118.915	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=211.132 ASSIGNMENTS=258629	UNSAT TT=228.985 ASSIGNMENTS=258629	UNSAT TT=181.807 CHECKS=58387400 NODES=498075	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=67.071 ASSIGNMENTS=440854 CHECKS=236197000	UNSAT TT=197.187 ASSIGNMENTS=764698 CHECKS=1138680000	? (TO) TT=1800.07	? (TO) TT=1800.03	UNSAT TT=53.415 ASSIGNMENTS=427107 CHECKS=229072000	UNSAT TT=56.959 ASSIGNMENTS=428140 CHECKS=228003000	UNSAT TT=1366.28	UNSAT TT=55.731 ASSIGNMENTS=449335 CHECKS=237713000	UNSAT TT=58.39 ASSIGNMENTS=440854 CHECKS=236197000	? (TO) TT=1800.14	UNSAT TT=689.401 ASSIGNMENTS=585184 CHECKS=1113690000	UNSAT TT=1012.34	? (TO) TT=1800.14
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-28_ext.xml	UNSAT TT=46.747	UNSAT TT=329.119 CHECKS=1840180000 NODES=1241810	UNSAT TT=319.799 CHECKS=1818330000 NODES=1230180	UNSAT TT=60.374	UNSAT TT=1667.09 CHECKS=491474000	? (TO) TT=1800.02	UNSAT TT=197.35 ASSIGNMENTS=241267	UNSAT TT=205.26 ASSIGNMENTS=241267	UNSAT TT=149.772 CHECKS=47600700 NODES=407725	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=53.909 ASSIGNMENTS=390210 CHECKS=204598000	UNSAT TT=336.891 ASSIGNMENTS=1241810 CHECKS=1840180000	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=50.772 ASSIGNMENTS=392109 CHECKS=205698000	UNSAT TT=50.012 ASSIGNMENTS=388048 CHECKS=203128000	UNSAT TT=1470.76	UNSAT TT=51.717 ASSIGNMENTS=396311 CHECKS=206639000	UNSAT TT=46.747 ASSIGNMENTS=390210 CHECKS=204598000	? (TO) TT=1800.16	UNSAT TT=706.624 ASSIGNMENTS=638200 CHECKS=1189110000	UNSAT TT=1131.9	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-29_ext.xml	UNSAT TT=18.324	UNSAT TT=42.578 CHECKS=234743000 NODES=156589	UNSAT TT=42.481 CHECKS=236131000 NODES=157630	UNSAT TT=44.918	UNSAT TT=1057.54 CHECKS=268851000	UNSAT TT=369.463 CHECKS=74603200	UNSAT TT=72.082 ASSIGNMENTS=79731	UNSAT TT=75.891 ASSIGNMENTS=79731	UNSAT TT=56.71 CHECKS=19304700 NODES=154409	? (TO) TT=1800.03	? (TO) TT=1800.07	UNSAT TT=26.113 ASSIGNMENTS=137878 CHECKS=73745500	UNSAT TT=46.845 ASSIGNMENTS=156589 CHECKS=234743000	UNSAT TT=1416.62	UNSAT TT=945.147	UNSAT TT=18.956 ASSIGNMENTS=141065 CHECKS=76048000	UNSAT TT=19.529 ASSIGNMENTS=147148 CHECKS=78504800	UNSAT TT=472.159	UNSAT TT=19.243 ASSIGNMENTS=142862 CHECKS=76495100	UNSAT TT=18.324 ASSIGNMENTS=137878 CHECKS=73745500	? (TO) TT=1800.12	UNSAT TT=316.486 ASSIGNMENTS=206712 CHECKS=428672000	UNSAT TT=398.478	UNSAT TT=832.773
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-2_ext.xml	UNSAT TT=87.705	UNSAT TT=216.601 CHECKS=1221890000 NODES=871538	UNSAT TT=225.284 CHECKS=1227120000 NODES=874571	UNSAT TT=112.184	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=385.617 ASSIGNMENTS=486744	UNSAT TT=420.058 ASSIGNMENTS=486744	UNSAT TT=264.354 CHECKS=89984100 NODES=782251	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=100.157 ASSIGNMENTS=728500 CHECKS=375463000	UNSAT TT=212.49 ASSIGNMENTS=871538 CHECKS=1221890000	? (TO) TT=1800.01	? (TO) TT=1800	UNSAT TT=93.115 ASSIGNMENTS=728648 CHECKS=375642000	UNSAT TT=93.493 ASSIGNMENTS=736590 CHECKS=380314000	? (TO) TT=1800.12	UNSAT TT=87.705 ASSIGNMENTS=737286 CHECKS=381430000	UNSAT TT=87.719 ASSIGNMENTS=728500 CHECKS=375463000	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-30_ext.xml	UNSAT TT=116.132	UNSAT TT=558.705 CHECKS=3301530000 NODES=2276680	UNSAT TT=578.806 CHECKS=3415650000 NODES=2353330	UNSAT TT=207.431	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=574.557 ASSIGNMENTS=691962	UNSAT TT=536.196 ASSIGNMENTS=691962	UNSAT TT=428.092 CHECKS=132678000 NODES=1176460	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=138.393 ASSIGNMENTS=1030830 CHECKS=530982000	UNSAT TT=534.906 ASSIGNMENTS=1030830 CHECKS=530982000	? (TO) TT=1800.03	? (TO) TT=1800.04	UNSAT TT=137.296 ASSIGNMENTS=1090820 CHECKS=561084000	UNSAT TT=125.95 ASSIGNMENTS=996864 CHECKS=512723000	? (TO) TT=1800.11	UNSAT TT=116.132 ASSIGNMENTS=956225 CHECKS=489579000	UNSAT TT=130.914 ASSIGNMENTS=1030830 CHECKS=530982000	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.08
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-31_ext.xml	SAT TT=1.208	SAT TT=71.96 CHECKS=422272000 NODES=293133	SAT TT=75.728 CHECKS=415903000 NODES=289318	SAT TT=1.208	SAT TT=667.337 CHECKS=187444000	SAT TT=148.511 CHECKS=31962300	SAT TT=46.427 ASSIGNMENTS=55787	SAT TT=45.707 ASSIGNMENTS=55787	SAT TT=11.482 CHECKS=3735960 NODES=32691	SAT TT=1.584 CHECKS=6616610 NODES=21403	? (TO) TT=1800.07	SAT TT=19.977 ASSIGNMENTS=99024 CHECKS=49844100	SAT TT=78.464 ASSIGNMENTS=293133 CHECKS=422272000	SAT TT=236.174	SAT TT=257.71	SAT TT=24.721 ASSIGNMENTS=205274 CHECKS=104987000	SAT TT=3.931 ASSIGNMENTS=32264 CHECKS=15816500	SAT TT=272.901	SAT TT=3.757 ASSIGNMENTS=29063 CHECKS=14709400	SAT TT=12.281 ASSIGNMENTS=99024 CHECKS=49844100	? (TO) TT=1800.08	SAT TT=287.401 ASSIGNMENTS=266612 CHECKS=475770000	SAT TT=65.331	SAT TT=34.406
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-32_ext.xml	UNSAT TT=69.694	UNSAT TT=272.218 CHECKS=1497120000 NODES=1066320	UNSAT TT=270.402 CHECKS=1497250000 NODES=1066530	UNSAT TT=182.803	? (TO) TT=1800.07	UNSAT TT=1599.47 CHECKS=344219000	UNSAT TT=287.807 ASSIGNMENTS=379148	UNSAT TT=297.746 ASSIGNMENTS=379148	UNSAT TT=332.115 CHECKS=108564000 NODES=933721	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=83.66 ASSIGNMENTS=588225 CHECKS=302278000	UNSAT TT=77.337 ASSIGNMENTS=588225 CHECKS=302278000	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=69.694 ASSIGNMENTS=590537 CHECKS=303223000	UNSAT TT=77.415 ASSIGNMENTS=609524 CHECKS=312243000	? (TO) TT=1800.07	UNSAT TT=88.592 ASSIGNMENTS=687413 CHECKS=356005000	UNSAT TT=74.526 ASSIGNMENTS=588225 CHECKS=302278000	? (TO) TT=1800.14	UNSAT TT=1173.61 ASSIGNMENTS=1050180 CHECKS=1921540000	? (TO) TT=1800.11	? (TO) TT=1800.12
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-33_ext.xml	UNSAT TT=175.257	UNSAT TT=861.173 CHECKS=4635010000 NODES=3407270	UNSAT TT=794.987 CHECKS=4632330000 NODES=3406010	UNSAT TT=208.595	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=844.08 ASSIGNMENTS=1011330	UNSAT TT=767.953 ASSIGNMENTS=1011330	UNSAT TT=648.531 CHECKS=190411000 NODES=1771030	? (TO) TT=1800	? (TO) TT=1800	UNSAT TT=197.858 ASSIGNMENTS=1524370 CHECKS=768333000	UNSAT TT=596.025 ASSIGNMENTS=1524370 CHECKS=768333000	? (TO) TT=1800.02	? (TO) TT=1800.03	UNSAT TT=176.87 ASSIGNMENTS=1531150 CHECKS=771871000	UNSAT TT=199.956 ASSIGNMENTS=1605240 CHECKS=811978000	? (TO) TT=1800.11	UNSAT TT=193.024 ASSIGNMENTS=1535300 CHECKS=779664000	UNSAT TT=175.257 ASSIGNMENTS=1524370 CHECKS=768333000	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-35_ext.xml	SAT TT=10.911	SAT TT=143.318 CHECKS=764937000 NODES=582454	SAT TT=143.216 CHECKS=768106000 NODES=584693	SAT TT=289.731	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=105.413 ASSIGNMENTS=142938	SAT TT=115.303 ASSIGNMENTS=142938	SAT TT=389.881 CHECKS=114830000 NODES=1079660	SAT TT=27.622 CHECKS=189040000 NODES=583466	? (TO) TT=1800.09	SAT TT=81.757 ASSIGNMENTS=597435 CHECKS=304648000	SAT TT=140.492 ASSIGNMENTS=582454 CHECKS=764937000	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=51.54 ASSIGNMENTS=450228 CHECKS=227825000	SAT TT=126.02 ASSIGNMENTS=1024190 CHECKS=521673000	? (TO) TT=1800.06	SAT TT=52.121 ASSIGNMENTS=453224 CHECKS=228849000	SAT TT=74.584 ASSIGNMENTS=597435 CHECKS=304648000	? (TO) TT=1800.07	SAT TT=1749.77 ASSIGNMENTS=993786 CHECKS=1716950000	? (TO) TT=1800.08	SAT TT=10.911
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-36_ext.xml	SAT TT=10.221	SAT TT=201.537 CHECKS=1086150000 NODES=782463	SAT TT=178.523 CHECKS=1037890000 NODES=754564	SAT TT=16.299	SAT TT=1676.08 CHECKS=491545000	? (TO) TT=1800.02	SAT TT=247.759 ASSIGNMENTS=312940	SAT TT=248.953 ASSIGNMENTS=312940	SAT TT=109.573 CHECKS=33378800 NODES=301932	SAT TT=28.126 CHECKS=193437000 NODES=598790	? (TO) TT=1800.03	SAT TT=113.463 ASSIGNMENTS=837075 CHECKS=432774000	SAT TT=193.416 ASSIGNMENTS=782463 CHECKS=1086150000	? (TO) TT=1800.06	SAT TT=544.623	SAT TT=99.643 ASSIGNMENTS=803317 CHECKS=416893000	SAT TT=94.494 ASSIGNMENTS=806993 CHECKS=418006000	? (TO) TT=1800.08	SAT TT=10.221 ASSIGNMENTS=88615 CHECKS=43716800	SAT TT=106.699 ASSIGNMENTS=837075 CHECKS=432774000	SAT TT=744.649	SAT TT=996.022 ASSIGNMENTS=750462 CHECKS=1315180000	? (TO) TT=1800.1	? (TO) TT=1800.1
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-39_ext.xml	SAT TT=2.212	SAT TT=109.54 CHECKS=621663000 NODES=387323	SAT TT=109.578 CHECKS=621980000 NODES=387581	SAT TT=11.452	SAT TT=376.023 CHECKS=93482500	SAT TT=157.611 CHECKS=33164600	SAT TT=48.788 ASSIGNMENTS=49000	SAT TT=48.191 ASSIGNMENTS=49000	SAT TT=23.585 CHECKS=8219540 NODES=64957	SAT TT=42.488 CHECKS=321196000 NODES=973624	? (TO) TT=1800.07	SAT TT=20.662 ASSIGNMENTS=91217 CHECKS=50763000	SAT TT=109.772 ASSIGNMENTS=387323 CHECKS=621663000	SAT TT=82.48	SAT TT=173.025	SAT TT=12.52 ASSIGNMENTS=90466 CHECKS=50380900	SAT TT=5.657 ASSIGNMENTS=45098 CHECKS=24700200	SAT TT=335.15	SAT TT=12.854 ASSIGNMENTS=92546 CHECKS=51358800	SAT TT=12.497 ASSIGNMENTS=91217 CHECKS=50763000	SAT TT=560.15	SAT TT=96.54 ASSIGNMENTS=71398 CHECKS=161091000	SAT TT=10.285	SAT TT=2.212
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-41_ext.xml	UNSAT TT=40.626	UNSAT TT=436.765 CHECKS=2654060000 NODES=1700740	UNSAT TT=442.951 CHECKS=2656100000 NODES=1703180	UNSAT TT=57.094	? (TO) TT=1800.02	UNSAT TT=733.814 CHECKS=156934000	UNSAT TT=169.68 ASSIGNMENTS=184459	UNSAT TT=166.228 ASSIGNMENTS=184459	UNSAT TT=133.085 CHECKS=43252500 NODES=365570	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=52.015 ASSIGNMENTS=333371 CHECKS=181085000	UNSAT TT=444.73 ASSIGNMENTS=333371 CHECKS=181085000	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=42.537 ASSIGNMENTS=315252 CHECKS=170078000	UNSAT TT=43.808 ASSIGNMENTS=321785 CHECKS=175248000	UNSAT TT=1300.08	UNSAT TT=40.626 ASSIGNMENTS=324931 CHECKS=177530000	UNSAT TT=44.286 ASSIGNMENTS=333371 CHECKS=181085000	? (TO) TT=1800.15	UNSAT TT=763.889 ASSIGNMENTS=639098 CHECKS=1322820000	UNSAT TT=619.154	? (TO) TT=1800.11
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-43_ext.xml	UNSAT TT=133.496	UNSAT TT=322.912 CHECKS=1771390000 NODES=1272930	UNSAT TT=306.211 CHECKS=1759810000 NODES=1265280	UNSAT TT=247.638	? (TO) TT=1800.1	? (TO) TT=1800.11	UNSAT TT=446.486 ASSIGNMENTS=573516	UNSAT TT=449.15 ASSIGNMENTS=573516	UNSAT TT=498.069 CHECKS=148577000 NODES=1361080	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=150.157 ASSIGNMENTS=1128720 CHECKS=579402000	UNSAT TT=307.115 ASSIGNMENTS=1272930 CHECKS=1771390000	? (TO) TT=1800	? (TO) TT=1800.01	UNSAT TT=140.535 ASSIGNMENTS=1100590 CHECKS=562597000	UNSAT TT=133.496 ASSIGNMENTS=1118490 CHECKS=573200000	? (TO) TT=1800.07	UNSAT TT=135.477 ASSIGNMENTS=1145620 CHECKS=591854000	UNSAT TT=141.483 ASSIGNMENTS=1128720 CHECKS=579402000	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-48_ext.xml	UNSAT TT=27.72	UNSAT TT=101.835 CHECKS=560349000 NODES=375736	UNSAT TT=101.232 CHECKS=558021000 NODES=374569	UNSAT TT=42.603	? (TO) TT=1800.1	UNSAT TT=564.008 CHECKS=114524000	UNSAT TT=100.341 ASSIGNMENTS=116358	UNSAT TT=91.775 ASSIGNMENTS=116358	UNSAT TT=97.65 CHECKS=31774400 NODES=258073	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=36.176 ASSIGNMENTS=219132 CHECKS=116830000	UNSAT TT=105.415 ASSIGNMENTS=375736 CHECKS=560349000	? (TO) TT=1800.02	UNSAT TT=1748.22	UNSAT TT=30.355 ASSIGNMENTS=229269 CHECKS=122945000	UNSAT TT=27.72 ASSIGNMENTS=212127 CHECKS=112116000	UNSAT TT=599.42	UNSAT TT=29.863 ASSIGNMENTS=223642 CHECKS=119459000	UNSAT TT=29.522 ASSIGNMENTS=219132 CHECKS=116830000	? (TO) TT=1800.12	UNSAT TT=635.448 ASSIGNMENTS=443929 CHECKS=866901000	UNSAT TT=321.489	UNSAT TT=1093.04
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-49_ext.xml	SAT TT=22.83	SAT TT=484.633 CHECKS=2602500000 NODES=1827620	SAT TT=449.963 CHECKS=2607160000 NODES=1827600	SAT TT=61.172	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=199.437 ASSIGNMENTS=270962	SAT TT=212.559 ASSIGNMENTS=270962	SAT TT=82.312 CHECKS=25816900 NODES=240030	SAT TT=521.268 CHECKS=4018360000 NODES=12308900	? (TO) TT=1800.03	SAT TT=28.79 ASSIGNMENTS=185571 CHECKS=94084500	SAT TT=425.179 ASSIGNMENTS=185571 CHECKS=94084500	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=79.388 ASSIGNMENTS=635279 CHECKS=324781000	SAT TT=79.227 ASSIGNMENTS=635102 CHECKS=324030000	SAT TT=612.509	SAT TT=79.99 ASSIGNMENTS=637152 CHECKS=325593000	SAT TT=22.83 ASSIGNMENTS=185571 CHECKS=94084500	? (TO) TT=1800.17	SAT TT=1065.15 ASSIGNMENTS=911803 CHECKS=1575110000	SAT TT=819.584	SAT TT=1022.94
csp/rand-2-40-19/ normalized-rand-2-40-19-443-230-50_ext.xml	SAT TT=7.312	SAT TT=888.714 CHECKS=5163200000 NODES=3808050	SAT TT=956.667 CHECKS=5150720000 NODES=3797950	SAT TT=71.21	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=871.58 ASSIGNMENTS=1068690	SAT TT=836.456 ASSIGNMENTS=1068690	SAT TT=436.884 CHECKS=128141000 NODES=1226630	SAT TT=71.164 CHECKS=496490000 NODES=1526620	? (TO) TT=1800	SAT TT=148.417 ASSIGNMENTS=1104030 CHECKS=565880000	SAT TT=543.421 ASSIGNMENTS=1104030 CHECKS=565880000	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=147.377 ASSIGNMENTS=1254260 CHECKS=643813000	SAT TT=72.657 ASSIGNMENTS=578125 CHECKS=295126000	? (TO) TT=1800.09	SAT TT=7.312 ASSIGNMENTS=58222 CHECKS=29239000	SAT TT=139.327 ASSIGNMENTS=1104030 CHECKS=565880000	? (TO) TT=1800.16	SAT TT=388.084 ASSIGNMENTS=121201 CHECKS=214940000	SAT TT=1071.79	? (TO) TT=1800.09
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-10_ext.xml	SAT TT=98.581	? (TO) TT=1800.11	SAT TT=1597.81 CHECKS=9438360000 NODES=5625970	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.01	SAT TT=98.581 CHECKS=699321000 NODES=1650830	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=851.779 ASSIGNMENTS=5701800 CHECKS=3398380000	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.06
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-14_ext.xml	SAT TT=200.759	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800	SAT TT=200.759 CHECKS=1552980000 NODES=3625110	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-15_ext.xml	SAT TT=22.577	SAT TT=154.336 CHECKS=928995000 NODES=559115	SAT TT=224.013 CHECKS=1264170000 NODES=762696	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=159.413 CHECKS=1227630000 NODES=2885800	? (TO) TT=1800.08	SAT TT=159.919 ASSIGNMENTS=559115 CHECKS=928995000	SAT TT=160.608 ASSIGNMENTS=559115 CHECKS=928995000	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=1116.28 ASSIGNMENTS=7319120 CHECKS=370393000	SAT TT=1192.84 ASSIGNMENTS=7300660 CHECKS=357800000	? (TO) TT=1800.1	SAT TT=22.577 ASSIGNMENTS=152327 CHECKS=92851800	SAT TT=1155.73 ASSIGNMENTS=7496360 CHECKS=488090000	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-17_ext.xml	SAT TT=200.667	SAT TT=210.961 CHECKS=1175350000 NODES=728272	SAT TT=200.906 CHECKS=1135320000 NODES=701559	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.12	SAT TT=276.869 CHECKS=71341200 NODES=544941	SAT TT=340.734 CHECKS=2713320000 NODES=6464880	? (TO) TT=1800.02	SAT TT=200.667 ASSIGNMENTS=728272 CHECKS=1175350000	SAT TT=200.816 ASSIGNMENTS=728272 CHECKS=1175350000	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1784.06 ASSIGNMENTS=11150900 CHECKS=2722220000	SAT TT=1766.04 ASSIGNMENTS=11053600 CHECKS=2654150000	? (TO) TT=1800.11	SAT TT=390.599 ASSIGNMENTS=2484470 CHECKS=1524580000	SAT TT=1658.14 ASSIGNMENTS=10968000 CHECKS=2603940000	? (TO) TT=1800.13	SAT TT=1544.05 ASSIGNMENTS=812288 CHECKS=1681240000	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-18_ext.xml	SAT TT=173.837	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=173.837 CHECKS=1259990000 NODES=2859210	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=1795.37 ASSIGNMENTS=12275000 CHECKS=3267060000	SAT TT=333.819 ASSIGNMENTS=2191820 CHECKS=1353190000	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-1_ext.xml	SAT TT=37.306	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=37.306 CHECKS=262546000 NODES=621625	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.1	SAT TT=653.22 ASSIGNMENTS=4081480 CHECKS=2552980000	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-20_ext.xml	SAT TT=6.408	SAT TT=250.098 CHECKS=1487760000 NODES=846695	SAT TT=31.053 CHECKS=178398000 NODES=99390	SAT TT=493.989	SAT TT=919.788 CHECKS=186742000	? (TO) TT=1800.03	SAT TT=773.775 ASSIGNMENTS=739594	SAT TT=772.62 ASSIGNMENTS=739594	SAT TT=468.237 CHECKS=135434000 NODES=984092	SAT TT=139.718 CHECKS=1108330000 NODES=2674630	? (TO) TT=1800.02	SAT TT=254.595 ASSIGNMENTS=846695 CHECKS=1487760000	SAT TT=238.198 ASSIGNMENTS=846695 CHECKS=1487760000	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=399.285 ASSIGNMENTS=2348420 CHECKS=1527270000	SAT TT=373.556 ASSIGNMENTS=2209080 CHECKS=1440260000	? (TO) TT=1800.04	SAT TT=6.408 ASSIGNMENTS=37539 CHECKS=23928900	SAT TT=352.853 ASSIGNMENTS=2242440 CHECKS=1463380000	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.1
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-22_ext.xml	SAT TT=209.235	SAT TT=1216.02 CHECKS=7489920000 NODES=4467590	SAT TT=618.702 CHECKS=3809160000 NODES=2299560	SAT TT=653.448	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=853.497 ASSIGNMENTS=859644	SAT TT=836.053 ASSIGNMENTS=859644	SAT TT=1017.83 CHECKS=282886000 NODES=2179520	SAT TT=582.538 CHECKS=4551390000 NODES=10716100	? (TO) TT=1800.08	SAT TT=597.419 ASSIGNMENTS=1283940 CHECKS=813954000	SAT TT=617.2 ASSIGNMENTS=1283940 CHECKS=813954000	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=330.267 ASSIGNMENTS=2201490 CHECKS=1393890000	SAT TT=357.246 ASSIGNMENTS=2199500 CHECKS=1390480000	? (TO) TT=1800.12	SAT TT=356.783 ASSIGNMENTS=2193330 CHECKS=1386740000	SAT TT=209.235 ASSIGNMENTS=1283940 CHECKS=813954000	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.06
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-24_ext.xml	SAT TT=10.139	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	SAT TT=842.196 ASSIGNMENTS=803077	SAT TT=844.527 ASSIGNMENTS=803077	? (TO) TT=1800.01	SAT TT=10.139 CHECKS=64161000 NODES=149591	? (TO) TT=1800.1	SAT TT=697.378 ASSIGNMENTS=1719790 CHECKS=1110710000	SAT TT=711.726 ASSIGNMENTS=1719790 CHECKS=1110710000	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=289.243 ASSIGNMENTS=1724640 CHECKS=1114250000	SAT TT=135.139 ASSIGNMENTS=809452 CHECKS=524530000	? (TO) TT=1800.12	SAT TT=797.381 ASSIGNMENTS=4781560 CHECKS=3067750000	SAT TT=281.804 ASSIGNMENTS=1719790 CHECKS=1110710000	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-25_ext.xml	SAT TT=408.171	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	SAT TT=408.171 CHECKS=3152150000 NODES=7361730	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-29_ext.xml	SAT TT=140.391	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.06	SAT TT=565.531 CHECKS=149621000 NODES=1184740	SAT TT=140.391 CHECKS=1009950000 NODES=2388160	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT TT=1102.43 ASSIGNMENTS=7082680 CHECKS=68728200	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-30_ext.xml	SAT TT=43.68	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.01	SAT TT=43.68 CHECKS=335257000 NODES=782987	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=1406.02 ASSIGNMENTS=9592680 CHECKS=1677110000	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-31_ext.xml	SAT TT=11.463	SAT TT=11.463 CHECKS=61828700 NODES=35983	SAT TT=26.02 CHECKS=158301000 NODES=90424	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=1173.78 ASSIGNMENTS=1185560	SAT TT=1262.26 ASSIGNMENTS=1185560	? (TO) TT=1800.02	SAT TT=48.42 CHECKS=371346000 NODES=859549	? (TO) TT=1800.02	SAT TT=17.749 ASSIGNMENTS=35983 CHECKS=61828700	SAT TT=18.261 ASSIGNMENTS=35983 CHECKS=61828700	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=296.172 ASSIGNMENTS=1802580 CHECKS=1168620000	SAT TT=285.988 ASSIGNMENTS=1736640 CHECKS=1123890000	? (TO) TT=1800.04	SAT TT=298.756 ASSIGNMENTS=1807700 CHECKS=1171720000	SAT TT=285.072 ASSIGNMENTS=1735910 CHECKS=1125460000	? (TO) TT=1800.89	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-32_ext.xml	SAT TT=245.394	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.02	SAT TT=245.394 CHECKS=1738400000 NODES=4061960	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.14
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-37_ext.xml	SAT TT=44.604	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=44.604 CHECKS=339712000 NODES=768130	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-38_ext.xml	SAT TT=160.303	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=879.556 CHECKS=6747010000 NODES=15985000	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-40_ext.xml	SAT TT=101.396	SAT TT=1085.03 CHECKS=6378480000 NODES=3636110	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.03	SAT TT=101.396 CHECKS=739540000 NODES=1755150	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=1415.23 ASSIGNMENTS=8788760 CHECKS=1208610000	SAT TT=161.99 ASSIGNMENTS=1016920 CHECKS=618775000	? (TO) TT=1800.06	SAT TT=182.135 ASSIGNMENTS=1128990 CHECKS=694237000	SAT TT=1355.64 ASSIGNMENTS=8773730 CHECKS=1198770000	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-41_ext.xml	SAT TT=250.205	? (TO) TT=1800.17	? (TO) TT=1800.07	SAT TT=375.241	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=942.138 ASSIGNMENTS=1019870	SAT TT=936.617 ASSIGNMENTS=1019870	? (TO) TT=1800.01	SAT TT=779.495 CHECKS=6034310000 NODES=14448300	? (TO) TT=1800.07	SAT TT=649.687 ASSIGNMENTS=1566560 CHECKS=954342000	SAT TT=652.892 ASSIGNMENTS=1566560 CHECKS=954342000	? (TO) TT=1800.01	? (TO) TT=1800.06	SAT TT=274.883 ASSIGNMENTS=1848430 CHECKS=1128530000	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=250.205 ASSIGNMENTS=1566560 CHECKS=954342000	? (TO) TT=1800.63	? (TO) TT=1800.06	SAT TT=360.106	? (TO) TT=1800.09
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-42_ext.xml	SAT TT=6.273	SAT TT=247.095 CHECKS=1491670000 NODES=861345	SAT TT=6.273 CHECKS=31014700 NODES=18741	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.08	SAT TT=728.943 ASSIGNMENTS=710176	SAT TT=733.417 ASSIGNMENTS=710176	? (TO) TT=1800.05	SAT TT=272.788 CHECKS=1970470000 NODES=4687070	? (TO) TT=1800.05	SAT TT=246.933 ASSIGNMENTS=861345 CHECKS=1491670000	SAT TT=258.321 ASSIGNMENTS=861345 CHECKS=1491670000	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=174.068 ASSIGNMENTS=1038020 CHECKS=665244000	SAT TT=1234.12 ASSIGNMENTS=8095000 CHECKS=786497000	SAT TT=1195.5	SAT TT=1299.67 ASSIGNMENTS=8067700 CHECKS=763485000	SAT TT=173.553 ASSIGNMENTS=1024030 CHECKS=657058000	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-43_ext.xml	SAT TT=170.779	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=170.779 CHECKS=1332520000 NODES=3057080	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.13
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-44_ext.xml	SAT TT=42.149	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.03	SAT TT=42.149 CHECKS=322577000 NODES=740400	? (TO) TT=1800.03	SAT TT=636.581 ASSIGNMENTS=1458530 CHECKS=910314000	SAT TT=636.433 ASSIGNMENTS=1458530 CHECKS=910314000	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=237.293 ASSIGNMENTS=1486870 CHECKS=930255000	? (TO) TT=1800.04	? (TO) TT=1800.1	SAT TT=236.431 ASSIGNMENTS=1474630 CHECKS=919857000	SAT TT=218.817 ASSIGNMENTS=1458530 CHECKS=910314000	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.13
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-47_ext.xml	SAT TT=1691.98	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.06	SAT TT=1691.98 CHECKS=12403100000 NODES=29592300	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-7_ext.xml	SAT TT=148.844	SAT TT=1756.55 CHECKS=10821600000 NODES=5839610	SAT TT=1787.99 CHECKS=11369000000 NODES=6114040	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=148.844 CHECKS=1144550000 NODES=2698700	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.11
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-8_ext.xml	SAT TT=219.913	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=219.913 CHECKS=1726360000 NODES=4109370	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	SAT TT=642.238 ASSIGNMENTS=4037110 CHECKS=2474580000	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	SAT TT=615.929 ASSIGNMENTS=3911900 CHECKS=2391800000	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.12
csp/rand-2-50-23-fcd/ normalized-rand-2-50-23-587-230-fcd-9_ext.xml	SAT TT=138.991	SAT TT=580.073 CHECKS=3353890000 NODES=2055440	SAT TT=138.991 CHECKS=829415000 NODES=515531	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.06	SAT TT=319.325 CHECKS=2525020000 NODES=6040810	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	SAT TT=1161.67 ASSIGNMENTS=7371760 CHECKS=236856000	SAT TT=1068.86 ASSIGNMENTS=7371810 CHECKS=226862000	? (TO) TT=1800.06	? (TO) TT=1800.03	SAT TT=1085.34 ASSIGNMENTS=7366520 CHECKS=231098000	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-10_ext.xml	SAT TT=576.094	? (TO) TT=1800.13	? (TO) TT=1800.14	SAT TT=848.544	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	SAT TT=576.094 CHECKS=4428530000 NODES=10460900	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-1_ext.xml	SAT TT=148.397	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=148.397 CHECKS=1068960000 NODES=2533800	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-20_ext.xml	SAT TT=155.136	? (TO) TT=1800.1	? (TO) TT=1800.17	SAT TT=849.825	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=1754.95 ASSIGNMENTS=1688690	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=198.919 CHECKS=1463070000 NODES=3527900	? (TO) TT=1800.07	SAT TT=172.685 ASSIGNMENTS=993263 CHECKS=633305000	SAT TT=576.45 ASSIGNMENTS=993263 CHECKS=633305000	? (TO) TT=1800	? (TO) TT=1800.09	SAT TT=164.148 ASSIGNMENTS=993834 CHECKS=633064000	SAT TT=248.693 ASSIGNMENTS=1491090 CHECKS=959874000	? (TO) TT=1800.11	SAT TT=1776.9 ASSIGNMENTS=10453200 CHECKS=2449180000	SAT TT=155.136 ASSIGNMENTS=993263 CHECKS=633305000	? (TO) TT=1800.12	SAT TT=874.99 ASSIGNMENTS=435913 CHECKS=965554000	? (TO) TT=1800.14	? (TO) TT=1800.11
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-21_ext.xml	SAT TT=157.878	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.17	? (TO) TT=1800.14	SAT TT=727.168 CHECKS=193897000 NODES=1471850	SAT TT=157.878 CHECKS=1214530000 NODES=2788120	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-24_ext.xml	SAT TT=590.139	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=590.139 CHECKS=4367570000 NODES=10240800	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.15	? (TO) TT=1800.06
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-25_ext.xml	SAT TT=1682.54	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=1682.54 CHECKS=13009700000 NODES=30381800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-27_ext.xml	SAT TT=137.858	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.04	SAT TT=137.858 CHECKS=972194000 NODES=2276630	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.81	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-29_ext.xml	SAT TT=30.595	SAT TT=30.595 CHECKS=164163000 NODES=101562	SAT TT=351.299 CHECKS=2103520000 NODES=1253230	SAT TT=316.911	? (TO) TT=1800.09	? (TO) TT=1800.06	SAT TT=844.453 ASSIGNMENTS=785973	SAT TT=844.735 ASSIGNMENTS=785973	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=35.706 ASSIGNMENTS=101562 CHECKS=164163000	SAT TT=35.844 ASSIGNMENTS=101562 CHECKS=164163000	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=249.277 ASSIGNMENTS=1534150 CHECKS=987591000	SAT TT=250.112 ASSIGNMENTS=1511460 CHECKS=972959000	? (TO) TT=1800.04	? (TO) TT=1800.09	SAT TT=209.518 ASSIGNMENTS=1253730 CHECKS=805907000	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-2_ext.xml	SAT TT=380.688	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT TT=663.018 CHECKS=4769910000 NODES=11192700	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.05	SAT TT=863.068 ASSIGNMENTS=4975910 CHECKS=3295370000	SAT TT=380.688 ASSIGNMENTS=2221600 CHECKS=1451650000	? (TO) TT=1800.05	SAT TT=610.995 ASSIGNMENTS=3580070 CHECKS=2348730000	SAT TT=833.996 ASSIGNMENTS=4953280 CHECKS=3279720000	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-30_ext.xml	SAT TT=1166.35	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=1166.35 CHECKS=8434440000 NODES=19697200	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-35_ext.xml		? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-36_ext.xml	SAT TT=966.597	SAT TT=1183.09 CHECKS=6657870000 NODES=4007890	SAT TT=1059.5 CHECKS=6509120000 NODES=3931210	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=993.307 ASSIGNMENTS=6371730 CHECKS=4033130000	SAT TT=966.597 ASSIGNMENTS=6330560 CHECKS=4002570000	? (TO) TT=1800.03	? (TO) TT=1800.02	SAT TT=1026.39 ASSIGNMENTS=6367460 CHECKS=4029880000	SAT TT=1126.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.15
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-37_ext.xml	SAT TT=680.963	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.01	SAT TT=680.963 CHECKS=5330020000 NODES=12061000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.05
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-40_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.07
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-41_ext.xml	SAT TT=129.195	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	SAT TT=129.195 CHECKS=925751000 NODES=2213500	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-42_ext.xml	SAT TT=431.763	? (TO) TT=1800.15	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.02	SAT TT=431.763 CHECKS=3143970000 NODES=7468140	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-44_ext.xml	SAT TT=147.156	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=147.156 ASSIGNMENTS=931286 CHECKS=585770000	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-46_ext.xml	SAT TT=391.069	SAT TT=391.069 CHECKS=2356840000 NODES=1494170	SAT TT=395.917 CHECKS=2226390000 NODES=1424280	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=579.218 CHECKS=4158490000 NODES=9860180	? (TO) TT=1800.06	SAT TT=394.26 ASSIGNMENTS=1494170 CHECKS=2356840000	SAT TT=406.541 ASSIGNMENTS=1494170 CHECKS=2356840000	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-47_ext.xml	SAT TT=424.404	SAT TT=424.404 CHECKS=2525550000 NODES=1617500	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=581.928 CHECKS=4199430000 NODES=10005900	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.17	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-48_ext.xml	SAT TT=439.352	? (TO) TT=1800.16	? (TO) TT=1800.09	SAT TT=439.352	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1036.45 ASSIGNMENTS=923032	SAT TT=1066.77 ASSIGNMENTS=923032	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.05	SAT TT=690.108 ASSIGNMENTS=4212240 CHECKS=2799820000	SAT TT=675.242 ASSIGNMENTS=4213310 CHECKS=2798470000	? (TO) TT=1800.06	SAT TT=688.195 ASSIGNMENTS=4199920 CHECKS=2789750000	SAT TT=680.218 ASSIGNMENTS=4192870 CHECKS=2786010000	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.11
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-49_ext.xml		? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.08
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-4_ext.xml	SAT TT=84.871	? (TO) TT=1800.08	SAT TT=1299.88 CHECKS=8001200000 NODES=4584710	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.01	SAT TT=84.871 CHECKS=654610000 NODES=1533330	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.09	SAT TT=774.016 ASSIGNMENTS=4655450 CHECKS=3008550000	SAT TT=459.784 ASSIGNMENTS=2773580 CHECKS=1777890000	? (TO) TT=1800.1	SAT TT=366.197 ASSIGNMENTS=2209780 CHECKS=1422430000	SAT TT=739.971 ASSIGNMENTS=4625840 CHECKS=2988170000	? (TO) TT=1800.17	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-50_ext.xml	SAT TT=1198.98	? (TO) TT=1800.14	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.03	SAT TT=1198.98 CHECKS=9264470000 NODES=21958100	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.12
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-6_ext.xml	SAT TT=13.416	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800	SAT TT=13.416 CHECKS=89089400 NODES=206634	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.13	? (TO) TT=1800.14
csp/rand-2-50-23/ normalized-rand-2-50-23-587-230-7_ext.xml		? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1795.07	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.13	? (TO) TT=1800.1
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.1/ normalized-rand-2-40-8-753-100-0_ext.xml	SAT TT=1.975	SAT TT=2.019 CHECKS=2311260 NODES=3421	SAT TT=1.975 CHECKS=2123650 NODES=3208	SAT TT=6.008	SAT TT=85.343 CHECKS=71408100	SAT TT=15.617 CHECKS=15465800	SAT TT=11.295 ASSIGNMENTS=24029	SAT TT=12.278 ASSIGNMENTS=24029	SAT TT=6.905 CHECKS=709429 NODES=12491	SAT TT=2.535 CHECKS=8835820 NODES=29237	? (TO) TT=1800.09	SAT TT=10.591 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=11.211 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=5.783	SAT TT=4.016	SAT TT=3.822 ASSIGNMENTS=32395 CHECKS=27389400	SAT TT=2.28 ASSIGNMENTS=19712 CHECKS=15147100	SAT TT=26.709	SAT TT=3.918 ASSIGNMENTS=31115 CHECKS=25700400	SAT TT=3.409 ASSIGNMENTS=27583 CHECKS=22593400	SAT TT=194.043	SAT TT=16.487 ASSIGNMENTS=9878 CHECKS=13289600	SAT TT=12.65	SAT TT=29.234
csp/tightness0.1/ normalized-rand-2-40-8-753-100-11_ext.xml	SAT TT=0.814	SAT TT=5.842 CHECKS=12934300 NODES=17802	SAT TT=4.962 CHECKS=11697900 NODES=16180	SAT TT=4.087	SAT TT=112.161 CHECKS=92454000	SAT TT=11.814 CHECKS=11446500	SAT TT=12.553 ASSIGNMENTS=26230	SAT TT=13.185 ASSIGNMENTS=26230	SAT TT=23.898 CHECKS=2770180 NODES=48955	SAT TT=1.067 CHECKS=1651080 NODES=5406	SAT TT=1.294 CHECKS=3602980 NODES=4697	SAT TT=11.068 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=11.397 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=10.71	SAT TT=4.658	SAT TT=2.016 ASSIGNMENTS=16002 CHECKS=13240600	SAT TT=0.814 ASSIGNMENTS=7324 CHECKS=5146170	SAT TT=28.078	SAT TT=3.34 ASSIGNMENTS=28726 CHECKS=24076300	SAT TT=3.722 ASSIGNMENTS=30110 CHECKS=25169800	SAT TT=54.113	SAT TT=25.153 ASSIGNMENTS=32690 CHECKS=45766700	SAT TT=5.972	SAT TT=2.077
csp/tightness0.1/ normalized-rand-2-40-8-753-100-32_ext.xml	SAT TT=0.421	SAT TT=1.826 CHECKS=1797270 NODES=2687	SAT TT=2.17 CHECKS=2687810 NODES=4077	SAT TT=0.421	SAT TT=96.107 CHECKS=87280600	SAT TT=1.18 CHECKS=1054370	SAT TT=10.134 ASSIGNMENTS=22262	SAT TT=10.135 ASSIGNMENTS=22262	SAT TT=2.361 CHECKS=190970 NODES=3253	SAT TT=1.579 CHECKS=4809030 NODES=15962	SAT TT=1.136 CHECKS=3003320 NODES=4105	SAT TT=9.391 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=9.634 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=9.574	SAT TT=3.307	SAT TT=2.064 ASSIGNMENTS=17950 CHECKS=14573100	SAT TT=0.969 ASSIGNMENTS=8804 CHECKS=6255620	SAT TT=76.867	SAT TT=0.933 ASSIGNMENTS=7976 CHECKS=6388720	SAT TT=1.679 ASSIGNMENTS=13448 CHECKS=11234700	SAT TT=72.917	SAT TT=2.794 ASSIGNMENTS=3734 CHECKS=4988570	SAT TT=6.412	SAT TT=3.199
csp/tightness0.1/ normalized-rand-2-40-8-753-100-41_ext.xml	SAT TT=0.134	SAT TT=5.728 CHECKS=12381300 NODES=18439	SAT TT=4.958 CHECKS=11441600 NODES=17104	SAT TT=12.334	SAT TT=2.367 CHECKS=2025950	SAT TT=3.148 CHECKS=3055130	SAT TT=1.562 ASSIGNMENTS=1094	SAT TT=1.261 ASSIGNMENTS=1094	SAT TT=7.202 CHECKS=760665 NODES=13738	SAT TT=7.757 CHECKS=40660700 NODES=135032	? (TO) TT=1800.01	SAT TT=0.148 ASSIGNMENTS=786 CHECKS=625484	SAT TT=0.147 ASSIGNMENTS=786 CHECKS=625484	SAT TT=36.349	SAT TT=56.771	SAT TT=0.166 ASSIGNMENTS=1060 CHECKS=830357	SAT TT=0.484 ASSIGNMENTS=4912 CHECKS=2932930	SAT TT=6.949	SAT TT=2.756 ASSIGNMENTS=24295 CHECKS=19603800	SAT TT=0.134 ASSIGNMENTS=786 CHECKS=625484	SAT TT=13.684	SAT TT=3.054 ASSIGNMENTS=4365 CHECKS=5369940	SAT TT=6.202	SAT TT=21.241
csp/tightness0.1/ normalized-rand-2-40-8-753-100-48_ext.xml	SAT TT=0.972	SAT TT=2.351 CHECKS=2985560 NODES=4205	SAT TT=2.904 CHECKS=4720170 NODES=6769	SAT TT=5.734	SAT TT=5.027 CHECKS=3930650	SAT TT=11.861 CHECKS=10663000	SAT TT=11.137 ASSIGNMENTS=22220	SAT TT=10.308 ASSIGNMENTS=22220	SAT TT=19.916 CHECKS=2250870 NODES=40216	SAT TT=2.225 CHECKS=8462850 NODES=28055	? (TO) TT=1800.05	SAT TT=8.701 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=9.176 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=23.646	SAT TT=14.971	SAT TT=1.63 ASSIGNMENTS=13322 CHECKS=10800500	SAT TT=0.972 ASSIGNMENTS=8745 CHECKS=6255490	SAT TT=86.993	SAT TT=6.131 ASSIGNMENTS=52750 CHECKS=43372200	SAT TT=1.673 ASSIGNMENTS=13606 CHECKS=11009400	SAT TT=500.845	SAT TT=5.827 ASSIGNMENTS=7614 CHECKS=9941790	SAT TT=12.289	SAT TT=5.043
csp/tightness0.1/ normalized-rand-2-40-8-753-100-56_ext.xml	SAT TT=0.605	SAT TT=1.401 CHECKS=770964 NODES=1087	SAT TT=2.319 CHECKS=3416050 NODES=4831	SAT TT=0.605	SAT TT=2.444 CHECKS=1978430	SAT TT=1.287 CHECKS=1136140	SAT TT=12.865 ASSIGNMENTS=27434	SAT TT=12.988 ASSIGNMENTS=27434	SAT TT=1.036 CHECKS=52278 NODES=742	SAT TT=6.4 CHECKS=30039200 NODES=99562	SAT TT=5.181 CHECKS=33388100 NODES=27497	SAT TT=9.402 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=9.747 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=5.52	SAT TT=19.198	SAT TT=0.914 ASSIGNMENTS=7402 CHECKS=6586340	SAT TT=1 ASSIGNMENTS=8926 CHECKS=6561500	SAT TT=43.619	SAT TT=1.008 ASSIGNMENTS=7601 CHECKS=6589330	SAT TT=2.238 ASSIGNMENTS=17371 CHECKS=15196300	SAT TT=107.597	SAT TT=3.641 ASSIGNMENTS=725 CHECKS=898353	SAT TT=13.51	SAT TT=2.318
csp/tightness0.1/ normalized-rand-2-40-8-753-100-64_ext.xml	UNSAT TT=4.48	UNSAT TT=19.451 CHECKS=51706200 NODES=68370	UNSAT TT=18.988 CHECKS=50529900 NODES=66988	UNSAT TT=7.565	UNSAT TT=126.586 CHECKS=106877000	UNSAT TT=78.884 CHECKS=85934200	UNSAT TT=18.814 ASSIGNMENTS=38061	UNSAT TT=18.194 ASSIGNMENTS=38061	UNSAT TT=21.411 CHECKS=2679380 NODES=46312	? (TO) TT=1800.02	? (TO) TT=1800.05	UNSAT TT=11.255 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=12.012 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=35.707	UNSAT TT=87.765	UNSAT TT=4.599 ASSIGNMENTS=36610 CHECKS=31199000	UNSAT TT=5.137 ASSIGNMENTS=41856 CHECKS=34839500	UNSAT TT=140.927	UNSAT TT=5.262 ASSIGNMENTS=40996 CHECKS=35306700	UNSAT TT=4.48 ASSIGNMENTS=35900 CHECKS=30523100	UNSAT TT=405.616	UNSAT TT=49.267 ASSIGNMENTS=61846 CHECKS=87881200	UNSAT TT=20.084	UNSAT TT=100.848
csp/tightness0.1/ normalized-rand-2-40-8-753-100-65_ext.xml	UNSAT TT=5.441	UNSAT TT=21.26 CHECKS=61447000 NODES=82502	UNSAT TT=19.554 CHECKS=56734600 NODES=75877	UNSAT TT=7.517	UNSAT TT=133.324 CHECKS=112496000	UNSAT TT=88.527 CHECKS=88418700	UNSAT TT=22.128 ASSIGNMENTS=46716	UNSAT TT=22.081 ASSIGNMENTS=46716	UNSAT TT=30.498 CHECKS=3360850 NODES=58208	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=13.201 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=13.966 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=91.123	UNSAT TT=117.818	UNSAT TT=5.441 ASSIGNMENTS=47660 CHECKS=39920100	UNSAT TT=5.759 ASSIGNMENTS=51545 CHECKS=42585900	UNSAT TT=209.192	UNSAT TT=6.171 ASSIGNMENTS=49973 CHECKS=41936200	UNSAT TT=6.17 ASSIGNMENTS=49942 CHECKS=42034400	UNSAT TT=864.002	UNSAT TT=49.351 ASSIGNMENTS=73994 CHECKS=104987000	UNSAT TT=47.75	UNSAT TT=154.142
csp/tightness0.1/ normalized-rand-2-40-8-753-100-6_ext.xml	UNSAT TT=4.675	UNSAT TT=17.77 CHECKS=46673500 NODES=61059	UNSAT TT=17.752 CHECKS=47518000 NODES=62059	UNSAT TT=6.9	UNSAT TT=131.167 CHECKS=107708000	UNSAT TT=86.789 CHECKS=85574600	UNSAT TT=14.56 ASSIGNMENTS=31054	UNSAT TT=14.156 ASSIGNMENTS=31054	UNSAT TT=21.537 CHECKS=2608290 NODES=43881	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=11.181 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=12.437 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=41.172	UNSAT TT=46.928	UNSAT TT=4.738 ASSIGNMENTS=39760 CHECKS=35004900	UNSAT TT=4.719 ASSIGNMENTS=41711 CHECKS=35276600	UNSAT TT=158.921	UNSAT TT=4.74 ASSIGNMENTS=39150 CHECKS=34291800	UNSAT TT=4.675 ASSIGNMENTS=36233 CHECKS=31505300	UNSAT TT=690.018	UNSAT TT=43.938 ASSIGNMENTS=49511 CHECKS=72785900	UNSAT TT=38.89	UNSAT TT=110.877
csp/tightness0.1/ normalized-rand-2-40-8-753-100-72_ext.xml	UNSAT TT=4.469	UNSAT TT=15.341 CHECKS=39670200 NODES=51808	UNSAT TT=13.756 CHECKS=38692800 NODES=50397	UNSAT TT=5.36	UNSAT TT=117.425 CHECKS=107844000	UNSAT TT=78.843 CHECKS=80736100	UNSAT TT=14.671 ASSIGNMENTS=31763	UNSAT TT=15.962 ASSIGNMENTS=31763	UNSAT TT=20.894 CHECKS=2599930 NODES=43924	? (TO) TT=1800.05	? (TO) TT=1800.04	UNSAT TT=12.616 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=11.975 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=49.533	UNSAT TT=51.694	UNSAT TT=4.478 ASSIGNMENTS=34835 CHECKS=30400600	UNSAT TT=5.199 ASSIGNMENTS=41457 CHECKS=35167400	UNSAT TT=118.188	UNSAT TT=4.469 ASSIGNMENTS=36754 CHECKS=32177000	UNSAT TT=5.105 ASSIGNMENTS=39867 CHECKS=34908000	UNSAT TT=507.101	UNSAT TT=45.862 ASSIGNMENTS=47769 CHECKS=70588300	UNSAT TT=22.01	UNSAT TT=69.967
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.1/ normalized-rand-2-40-8-753-100-77_ext.xml	SAT TT=0.326	SAT TT=1.37 CHECKS=933727 NODES=1421	SAT TT=1.234 CHECKS=261015 NODES=411	SAT TT=1.22	SAT TT=1.636 CHECKS=1344400	SAT TT=2.324 CHECKS=2179850	SAT TT=3.943 ASSIGNMENTS=7339	SAT TT=4.201 ASSIGNMENTS=7339	SAT TT=4.818 CHECKS=485414 NODES=8507	SAT TT=0.831 CHECKS=311614 NODES=961	SAT TT=1.852 CHECKS=8604390 NODES=9604	SAT TT=8.789 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=9.461 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=11.544	SAT TT=3.224	SAT TT=0.857 ASSIGNMENTS=7262 CHECKS=5971150	SAT TT=2.232 ASSIGNMENTS=20682 CHECKS=15887400	SAT TT=60.654	SAT TT=0.326 ASSIGNMENTS=2625 CHECKS=2122540	SAT TT=1.789 ASSIGNMENTS=14865 CHECKS=12282400	SAT TT=152.334	SAT TT=1.09 ASSIGNMENTS=521 CHECKS=620777	SAT TT=3.231	SAT TT=3.196
csp/tightness0.1/ normalized-rand-2-40-8-753-100-78_ext.xml	UNSAT TT=3.519	UNSAT TT=12.203 CHECKS=31217900 NODES=39710	UNSAT TT=11.193 CHECKS=30959200 NODES=39265	UNSAT TT=4.527	UNSAT TT=108.685 CHECKS=96040300	UNSAT TT=77.302 CHECKS=77403000	UNSAT TT=10.635 ASSIGNMENTS=20651	UNSAT TT=10.937 ASSIGNMENTS=20651	UNSAT TT=17.5 CHECKS=2278370 NODES=37137	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=11.187 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=11.9 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=45.903	UNSAT TT=55.682	UNSAT TT=3.556 ASSIGNMENTS=29732 CHECKS=26427600	UNSAT TT=3.519 ASSIGNMENTS=28381 CHECKS=24033800	UNSAT TT=113.643	UNSAT TT=3.744 ASSIGNMENTS=28573 CHECKS=25395000	UNSAT TT=3.848 ASSIGNMENTS=29659 CHECKS=26388100	UNSAT TT=261.12	UNSAT TT=30.507 ASSIGNMENTS=39976 CHECKS=62490300	UNSAT TT=19.124	UNSAT TT=76.231
csp/tightness0.1/ normalized-rand-2-40-8-753-100-82_ext.xml	UNSAT TT=5.271	UNSAT TT=22.45 CHECKS=59935200 NODES=80448	UNSAT TT=22.964 CHECKS=61231200 NODES=81900	UNSAT TT=9.224	UNSAT TT=138.177 CHECKS=112322000	UNSAT TT=85.508 CHECKS=84703500	UNSAT TT=23.225 ASSIGNMENTS=48513	UNSAT TT=22.56 ASSIGNMENTS=48513	UNSAT TT=30.76 CHECKS=3579240 NODES=62128	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=13.821 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=12.778 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=65.562	UNSAT TT=70.233	UNSAT TT=5.502 ASSIGNMENTS=44332 CHECKS=37272200	UNSAT TT=5.271 ASSIGNMENTS=46952 CHECKS=38587800	UNSAT TT=167.027	UNSAT TT=6 ASSIGNMENTS=48371 CHECKS=40602600	UNSAT TT=6.124 ASSIGNMENTS=49943 CHECKS=41827600	UNSAT TT=580.146	UNSAT TT=48.007 ASSIGNMENTS=66809 CHECKS=94248800	UNSAT TT=30.82	UNSAT TT=109.196
csp/tightness0.1/ normalized-rand-2-40-8-753-100-83_ext.xml	UNSAT TT=4.554	UNSAT TT=19.951 CHECKS=52732400 NODES=70053	UNSAT TT=19.225 CHECKS=55640900 NODES=73980	UNSAT TT=8.129	UNSAT TT=113.918 CHECKS=97439700	UNSAT TT=83.874 CHECKS=84936100	UNSAT TT=14.588 ASSIGNMENTS=32501	UNSAT TT=14.488 ASSIGNMENTS=32501	UNSAT TT=21.246 CHECKS=2529280 NODES=43372	? (TO) TT=1800.04	? (TO) TT=1800.06	UNSAT TT=13.151 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=12.327 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=55.66	UNSAT TT=57.261	UNSAT TT=5.079 ASSIGNMENTS=40509 CHECKS=34873300	UNSAT TT=5.045 ASSIGNMENTS=41348 CHECKS=34602300	UNSAT TT=134.149	UNSAT TT=4.554 ASSIGNMENTS=38989 CHECKS=33407100	UNSAT TT=5.36 ASSIGNMENTS=45401 CHECKS=39504000	UNSAT TT=689.342	UNSAT TT=49.034 ASSIGNMENTS=58575 CHECKS=84318300	UNSAT TT=21.573	UNSAT TT=99.914
csp/tightness0.1/ normalized-rand-2-40-8-753-100-94_ext.xml	UNSAT TT=4.067	UNSAT TT=17.128 CHECKS=44537200 NODES=59512	UNSAT TT=15.942 CHECKS=45046000 NODES=60088	UNSAT TT=6.9	UNSAT TT=113.346 CHECKS=95060500	UNSAT TT=82.367 CHECKS=84345000	UNSAT TT=13.942 ASSIGNMENTS=30585	UNSAT TT=13.803 ASSIGNMENTS=30585	UNSAT TT=18.947 CHECKS=2434540 NODES=41103	? (TO) TT=1800.02	? (TO) TT=1800.1	UNSAT TT=11.249 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=12.603 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=49.324	UNSAT TT=67.783	UNSAT TT=4.582 ASSIGNMENTS=36068 CHECKS=31049700	UNSAT TT=4.067 ASSIGNMENTS=35704 CHECKS=29618900	UNSAT TT=145.651	UNSAT TT=4.42 ASSIGNMENTS=34341 CHECKS=29580500	UNSAT TT=4.782 ASSIGNMENTS=38114 CHECKS=32542900	UNSAT TT=424.975	UNSAT TT=43.931 ASSIGNMENTS=52106 CHECKS=75092500	UNSAT TT=17.927	UNSAT TT=50.488
csp/tightness0.2/ normalized-rand-2-40-11-414-200-10_ext.xml	SAT TT=1.335	SAT TT=12.673 CHECKS=45884900 NODES=55001	SAT TT=12.941 CHECKS=46025500 NODES=55435	SAT TT=5.08	SAT TT=199.117 CHECKS=106847000	SAT TT=85.589 CHECKS=52501200	SAT TT=7.204 ASSIGNMENTS=13374	SAT TT=7.969 ASSIGNMENTS=13374	SAT TT=38.118 CHECKS=8037150 NODES=111501	SAT TT=1.335 CHECKS=4236290 NODES=18514	? (TO) TT=1800.08	SAT TT=9.883 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=10.14 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=8.786	SAT TT=33.544	SAT TT=11.204 ASSIGNMENTS=109013 CHECKS=56988000	SAT TT=8.099 ASSIGNMENTS=77915 CHECKS=39905900	SAT TT=128.786	SAT TT=9.97 ASSIGNMENTS=94750 CHECKS=49665500	SAT TT=3.289 ASSIGNMENTS=31044 CHECKS=16419300	SAT TT=366.018	SAT TT=79.024 ASSIGNMENTS=86445 CHECKS=98478400	SAT TT=47.2	SAT TT=87.588
csp/tightness0.2/ normalized-rand-2-40-11-414-200-11_ext.xml	UNSAT TT=5.81	UNSAT TT=21.161 CHECKS=82398100 NODES=87241	UNSAT TT=20.306 CHECKS=83544300 NODES=88515	UNSAT TT=6.489	UNSAT TT=189.943 CHECKS=90907500	UNSAT TT=96.817 CHECKS=61060500	UNSAT TT=22.571 ASSIGNMENTS=41032	UNSAT TT=23.47 ASSIGNMENTS=41032	UNSAT TT=24.333 CHECKS=5460600 NODES=69751	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=13.813 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=13.136 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=89.777	UNSAT TT=164.961	UNSAT TT=5.826 ASSIGNMENTS=57045 CHECKS=31577300	UNSAT TT=5.81 ASSIGNMENTS=58119 CHECKS=31399700	UNSAT TT=123.322	UNSAT TT=6.259 ASSIGNMENTS=56784 CHECKS=31331100	UNSAT TT=6.121 ASSIGNMENTS=58160 CHECKS=32306500	UNSAT TT=576.598	UNSAT TT=84.763 ASSIGNMENTS=88016 CHECKS=117872000	UNSAT TT=42.781	UNSAT TT=132.127
csp/tightness0.2/ normalized-rand-2-40-11-414-200-15_ext.xml	SAT TT=1.357	SAT TT=13.573 CHECKS=54300600 NODES=62324	SAT TT=15.051 CHECKS=55907600 NODES=63510	SAT TT=2.846	SAT TT=139.175 CHECKS=67663900	SAT TT=70.99 CHECKS=44138000	SAT TT=10.21 ASSIGNMENTS=18190	SAT TT=10.022 ASSIGNMENTS=18190	SAT TT=21.987 CHECKS=4615940 NODES=62433	SAT TT=2.397 CHECKS=12245800 NODES=53966	? (TO) TT=1800.08	SAT TT=13.635 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=13.737 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=80.32	SAT TT=6.383	SAT TT=5.056 ASSIGNMENTS=51361 CHECKS=27660100	SAT TT=1.357 ASSIGNMENTS=13805 CHECKS=6693430	SAT TT=20.457	SAT TT=7.145 ASSIGNMENTS=65963 CHECKS=35584100	SAT TT=6.151 ASSIGNMENTS=57402 CHECKS=30813600	SAT TT=101.758	SAT TT=16.573 ASSIGNMENTS=12467 CHECKS=16102800	SAT TT=79.317	SAT TT=130.384
csp/tightness0.2/ normalized-rand-2-40-11-414-200-20_ext.xml	SAT TT=0.826	SAT TT=17.47 CHECKS=66234400 NODES=70882	SAT TT=16.764 CHECKS=68671800 NODES=72887	SAT TT=2.317	SAT TT=93.852 CHECKS=44421600	SAT TT=24.665 CHECKS=15656300	SAT TT=8.924 ASSIGNMENTS=15468	SAT TT=9.461 ASSIGNMENTS=15468	SAT TT=17.94 CHECKS=4165740 NODES=54381	SAT TT=10.95 CHECKS=70629000 NODES=310749	SAT TT=0.996 CHECKS=1303460 NODES=2918	SAT TT=11.414 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=11.278 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=37.067	SAT TT=56.59	SAT TT=0.826 ASSIGNMENTS=7812 CHECKS=4366210	SAT TT=3.363 ASSIGNMENTS=30934 CHECKS=16263400	SAT TT=109.226	SAT TT=4.372 ASSIGNMENTS=43356 CHECKS=23857100	SAT TT=3.802 ASSIGNMENTS=34943 CHECKS=19283000	SAT TT=112.755	SAT TT=48.682 ASSIGNMENTS=50485 CHECKS=65520400	SAT TT=11.558	SAT TT=2.991
csp/tightness0.2/ normalized-rand-2-40-11-414-200-23_ext.xml	SAT TT=0.515	SAT TT=1.292 CHECKS=697289 NODES=951	SAT TT=1.503 CHECKS=1943940 NODES=2422	SAT TT=0.751	SAT TT=97.075 CHECKS=50286100	SAT TT=11.879 CHECKS=7494820	SAT TT=2.45 ASSIGNMENTS=3259	SAT TT=2.4 ASSIGNMENTS=3259	SAT TT=5.776 CHECKS=1116240 NODES=15028	SAT TT=1.166 CHECKS=3736110 NODES=16333	SAT TT=1.108 CHECKS=3663330 NODES=6647	SAT TT=0.55 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=0.515 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=7.794	SAT TT=3.77	SAT TT=0.523 ASSIGNMENTS=4787 CHECKS=2474680	SAT TT=0.815 ASSIGNMENTS=8688 CHECKS=3895810	SAT TT=2.903	SAT TT=0.663 ASSIGNMENTS=6233 CHECKS=3193240	SAT TT=0.531 ASSIGNMENTS=4821 CHECKS=2524320	SAT TT=310.957	SAT TT=68.463 ASSIGNMENTS=46465 CHECKS=55873900	SAT TT=54.831	SAT TT=18.608
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.2/ normalized-rand-2-40-11-414-200-27_ext.xml	SAT TT=0.706	SAT TT=1.077 CHECKS=575397 NODES=705	SAT TT=0.973 CHECKS=202579 NODES=231	SAT TT=2.331	SAT TT=113.902 CHECKS=53754300	SAT TT=21.675 CHECKS=12933200	SAT TT=7.217 ASSIGNMENTS=12072	SAT TT=7.237 ASSIGNMENTS=12072	SAT TT=8.959 CHECKS=1844420 NODES=23571	SAT TT=1.68 CHECKS=6396050 NODES=27814	? (TO) TT=1800	SAT TT=11.267 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=11.796 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=5.598	SAT TT=16.196	SAT TT=3.364 ASSIGNMENTS=30426 CHECKS=16717900	SAT TT=0.706 ASSIGNMENTS=8097 CHECKS=3654930	SAT TT=36.43	SAT TT=2.205 ASSIGNMENTS=21463 CHECKS=11744700	SAT TT=4 ASSIGNMENTS=37778 CHECKS=20967100	SAT TT=15.486	SAT TT=40.645 ASSIGNMENTS=41373 CHECKS=54075500	SAT TT=5.765	SAT TT=2.785
csp/tightness0.2/ normalized-rand-2-40-11-414-200-30_ext.xml	SAT TT=0.779	SAT TT=8.947 CHECKS=33146200 NODES=37515	SAT TT=9.612 CHECKS=33935300 NODES=38900	SAT TT=2.627	SAT TT=3.762 CHECKS=1990720	SAT TT=2.969 CHECKS=1866630	SAT TT=20.001 ASSIGNMENTS=38835	SAT TT=22.339 ASSIGNMENTS=38835	SAT TT=25.802 CHECKS=5520610 NODES=72829	SAT TT=0.779 CHECKS=808131 NODES=3448	? (TO) TT=1800.08	SAT TT=12.772 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=13.781 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=133.818	SAT TT=98.712	SAT TT=6.45 ASSIGNMENTS=64578 CHECKS=35185200	SAT TT=2.18 ASSIGNMENTS=22063 CHECKS=11012100	SAT TT=126.248	SAT TT=7.255 ASSIGNMENTS=66234 CHECKS=35993800	SAT TT=6.339 ASSIGNMENTS=58819 CHECKS=32059800	SAT TT=235.204	SAT TT=46.589 ASSIGNMENTS=59445 CHECKS=71267200	SAT TT=47.482	SAT TT=108.88
csp/tightness0.2/ normalized-rand-2-40-11-414-200-32_ext.xml	SAT TT=1.552	SAT TT=16.122 CHECKS=63555600 NODES=76481	SAT TT=17.825 CHECKS=66778900 NODES=79808	SAT TT=6.252	SAT TT=16.958 CHECKS=8667890	SAT TT=17.036 CHECKS=10526600	SAT TT=19.908 ASSIGNMENTS=40744	SAT TT=21.665 ASSIGNMENTS=40744	SAT TT=17.024 CHECKS=3454960 NODES=47888	SAT TT=2.26 CHECKS=10021700 NODES=43838	? (TO) TT=1800.08	SAT TT=13.251 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=12.613 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=3.075	SAT TT=7.973	SAT TT=5.396 ASSIGNMENTS=51682 CHECKS=26987700	SAT TT=1.552 ASSIGNMENTS=15627 CHECKS=7348760	SAT TT=44.834	SAT TT=4.627 ASSIGNMENTS=44613 CHECKS=22981600	SAT TT=5.565 ASSIGNMENTS=54159 CHECKS=28163600	SAT TT=105.554	SAT TT=22.231 ASSIGNMENTS=29265 CHECKS=32971500	SAT TT=3.712	SAT TT=11.935
csp/tightness0.2/ normalized-rand-2-40-11-414-200-54_ext.xml	SAT TT=4.077	SAT TT=19.597 CHECKS=79415700 NODES=88625	SAT TT=21.073 CHECKS=79353100 NODES=88900	SAT TT=7.702	SAT TT=200.04 CHECKS=98505800	SAT TT=75.883 CHECKS=46209600	SAT TT=30.094 ASSIGNMENTS=56237	SAT TT=30.031 ASSIGNMENTS=56237	SAT TT=31.078 CHECKS=6501710 NODES=87470	SAT TT=4.077 CHECKS=20559200 NODES=90495	? (TO) TT=1800.07	SAT TT=16.071 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=16.147 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=85.88	SAT TT=133.72	SAT TT=9.026 ASSIGNMENTS=84632 CHECKS=45520700	SAT TT=8.803 ASSIGNMENTS=84446 CHECKS=44620000	SAT TT=222.283	SAT TT=8.811 ASSIGNMENTS=82253 CHECKS=44056100	SAT TT=8.721 ASSIGNMENTS=81404 CHECKS=43664400	SAT TT=439.944	SAT TT=93.709 ASSIGNMENTS=139766 CHECKS=176841000	SAT TT=64.083	SAT TT=116.789
csp/tightness0.2/ normalized-rand-2-40-11-414-200-57_ext.xml	SAT TT=0.649	SAT TT=17.468 CHECKS=63830500 NODES=72951	SAT TT=17.125 CHECKS=63390400 NODES=72268	SAT TT=0.808	SAT TT=141.101 CHECKS=69825800	SAT TT=74.759 CHECKS=48406800	SAT TT=3.004 ASSIGNMENTS=3662	SAT TT=2.604 ASSIGNMENTS=3662	SAT TT=37.598 CHECKS=8692410 NODES=118036	SAT TT=9.392 CHECKS=59987100 NODES=262731	? (TO) TT=1800.08	SAT TT=0.691 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=0.673 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=11.144	SAT TT=12.056	SAT TT=0.734 ASSIGNMENTS=6637 CHECKS=3533550	SAT TT=3.804 ASSIGNMENTS=37212 CHECKS=19194800	SAT TT=13.446	SAT TT=9.381 ASSIGNMENTS=88965 CHECKS=47037100	SAT TT=0.649 ASSIGNMENTS=5842 CHECKS=3137790	SAT TT=126.891	SAT TT=19.332 ASSIGNMENTS=17512 CHECKS=21261500	SAT TT=5.733	SAT TT=49.283
csp/tightness0.2/ normalized-rand-2-40-11-414-200-6_ext.xml	SAT TT=1.019	SAT TT=23.722 CHECKS=98831400 NODES=104001	SAT TT=24.725 CHECKS=95058400 NODES=100263	SAT TT=4.92	SAT TT=162.858 CHECKS=74463900	SAT TT=25.275 CHECKS=14577800	SAT TT=18.459 ASSIGNMENTS=35711	SAT TT=20.256 ASSIGNMENTS=35711	SAT TT=17.245 CHECKS=3665850 NODES=46911	SAT TT=1.019 CHECKS=2601270 NODES=11412	? (TO) TT=1800.08	SAT TT=11.087 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=11.207 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=45.045	SAT TT=123.682	SAT TT=6.096 ASSIGNMENTS=56615 CHECKS=31136500	SAT TT=3.81 ASSIGNMENTS=39211 CHECKS=20730400	SAT TT=113.115	SAT TT=2.134 ASSIGNMENTS=18678 CHECKS=10334500	SAT TT=3.66 ASSIGNMENTS=33576 CHECKS=18513800	SAT TT=489.865	SAT TT=33.257 ASSIGNMENTS=10728 CHECKS=14347700	SAT TT=3.199	SAT TT=9.352
csp/tightness0.2/ normalized-rand-2-40-11-414-200-71_ext.xml	SAT TT=2.33	SAT TT=12.254 CHECKS=44541800 NODES=50801	SAT TT=12.645 CHECKS=45699500 NODES=52008	SAT TT=5.991	SAT TT=96.899 CHECKS=45866000	SAT TT=75.768 CHECKS=48993900	SAT TT=20.01 ASSIGNMENTS=39269	SAT TT=22.129 ASSIGNMENTS=39269	SAT TT=34.012 CHECKS=7566420 NODES=100509	SAT TT=18.387 CHECKS=113190000 NODES=496730	? (TO) TT=1800.09	SAT TT=13.254 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=14.239 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=90.921	SAT TT=22.505	SAT TT=6.554 ASSIGNMENTS=60847 CHECKS=33209100	SAT TT=2.33 ASSIGNMENTS=24753 CHECKS=12501400	SAT TT=252.57	SAT TT=8.374 ASSIGNMENTS=83006 CHECKS=44991400	SAT TT=6.779 ASSIGNMENTS=62470 CHECKS=33931800	SAT TT=614.04	SAT TT=52.851 ASSIGNMENTS=72360 CHECKS=88328500	SAT TT=50.045	SAT TT=26.859
csp/tightness0.2/ normalized-rand-2-40-11-414-200-76_ext.xml	UNSAT TT=7.452	UNSAT TT=31.281 CHECKS=121877000 NODES=132526	UNSAT TT=29.346 CHECKS=123009000 NODES=133243	UNSAT TT=8.456	UNSAT TT=212.981 CHECKS=100342000	UNSAT TT=119.067 CHECKS=69161000	UNSAT TT=29.351 ASSIGNMENTS=53891	UNSAT TT=26.943 ASSIGNMENTS=53891	UNSAT TT=35.126 CHECKS=7541860 NODES=96257	? (TO) TT=1800.01	? (TO) TT=1800.02	UNSAT TT=16.065 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=15.618 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=131.321	UNSAT TT=172.36	UNSAT TT=8.189 ASSIGNMENTS=79674 CHECKS=44272500	UNSAT TT=7.452 ASSIGNMENTS=69214 CHECKS=37410600	UNSAT TT=161.757	UNSAT TT=8.367 ASSIGNMENTS=74830 CHECKS=41480300	UNSAT TT=7.594 ASSIGNMENTS=74618 CHECKS=41395000	UNSAT TT=998.02	UNSAT TT=98.186 ASSIGNMENTS=113396 CHECKS=148447000	UNSAT TT=64.731	UNSAT TT=194.528
csp/tightness0.2/ normalized-rand-2-40-11-414-200-84_ext.xml	SAT TT=1.359	SAT TT=9.968 CHECKS=38396900 NODES=43025	SAT TT=10.643 CHECKS=37562100 NODES=42184	SAT TT=2.262	SAT TT=19.525 CHECKS=9756160	SAT TT=18.785 CHECKS=11608700	SAT TT=7.508 ASSIGNMENTS=13093	SAT TT=7.015 ASSIGNMENTS=13093	SAT TT=21.338 CHECKS=4514630 NODES=60257	SAT TT=1.359 CHECKS=4991240 NODES=21967	? (TO) TT=1800.02	SAT TT=14.222 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=14.181 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=18.474	SAT TT=2.126	SAT TT=5.191 ASSIGNMENTS=47439 CHECKS=24895900	SAT TT=3.674 ASSIGNMENTS=36213 CHECKS=18263800	SAT TT=88.899	SAT TT=1.909 ASSIGNMENTS=18415 CHECKS=9441660	SAT TT=6.745 ASSIGNMENTS=61706 CHECKS=33066100	SAT TT=125.734	SAT TT=21.204 ASSIGNMENTS=25142 CHECKS=27969000	SAT TT=2.21	SAT TT=5.315
csp/tightness0.2/ normalized-rand-2-40-11-414-200-85_ext.xml	SAT TT=0.664	SAT TT=7.344 CHECKS=26939700 NODES=30464	SAT TT=6.187 CHECKS=19317700 NODES=21896	SAT TT=4.307	SAT TT=37.061 CHECKS=18986000	SAT TT=6.071 CHECKS=3522100	SAT TT=17.423 ASSIGNMENTS=31800	SAT TT=17.559 ASSIGNMENTS=31800	SAT TT=5.23 CHECKS=1088760 NODES=14344	SAT TT=0.701 CHECKS=608275 NODES=2606	? (TO) TT=1800.06	SAT TT=0.674 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=0.664 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=4.367	SAT TT=20.946	SAT TT=0.84 ASSIGNMENTS=7548 CHECKS=4187880	SAT TT=1.232 ASSIGNMENTS=12631 CHECKS=6112840	SAT TT=11.531	SAT TT=1.03 ASSIGNMENTS=9376 CHECKS=4900020	SAT TT=0.731 ASSIGNMENTS=6270 CHECKS=3402800	SAT TT=20.324	SAT TT=32.748 ASSIGNMENTS=19091 CHECKS=22519600	SAT TT=22.161	SAT TT=41.214
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.35/ normalized-rand-2-40-16-250-350-10_ext.xml	UNSAT TT=4.926	UNSAT TT=19.814 CHECKS=98960300 NODES=83547	UNSAT TT=19.252 CHECKS=96822600 NODES=82085	UNSAT TT=7.138	UNSAT TT=232.077 CHECKS=71037500	UNSAT TT=126.121 CHECKS=34182600	UNSAT TT=20.291 ASSIGNMENTS=28284	UNSAT TT=22.259 ASSIGNMENTS=28284	UNSAT TT=17.478 CHECKS=6773150 NODES=57331	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=13.098 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=12.801 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=56.429	UNSAT TT=278.284	UNSAT TT=6.115 ASSIGNMENTS=57163 CHECKS=23350900	UNSAT TT=4.926 ASSIGNMENTS=51354 CHECKS=20282900	UNSAT TT=92.341	UNSAT TT=5.58 ASSIGNMENTS=52746 CHECKS=21185500	UNSAT TT=5.029 ASSIGNMENTS=49080 CHECKS=19683800	UNSAT TT=465.955	UNSAT TT=71.29 ASSIGNMENTS=81679 CHECKS=137294000	UNSAT TT=52.511	UNSAT TT=89.069
csp/tightness0.35/ normalized-rand-2-40-16-250-350-11_ext.xml	UNSAT TT=8.84	UNSAT TT=23.514 CHECKS=116782000 NODES=106386	UNSAT TT=22.892 CHECKS=115100000 NODES=104583	UNSAT TT=15.202	UNSAT TT=492.308 CHECKS=145087000	UNSAT TT=178.588 CHECKS=51171600	UNSAT TT=36.949 ASSIGNMENTS=52952	UNSAT TT=34.343 ASSIGNMENTS=52952	UNSAT TT=28.159 CHECKS=11845100 NODES=102097	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=16.869 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=16.686 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=179.181	UNSAT TT=459.885	UNSAT TT=9.478 ASSIGNMENTS=92081 CHECKS=37428300	UNSAT TT=8.84 ASSIGNMENTS=86664 CHECKS=34724300	UNSAT TT=177.288	UNSAT TT=9.629 ASSIGNMENTS=91937 CHECKS=37159200	UNSAT TT=9.142 ASSIGNMENTS=87553 CHECKS=35799000	UNSAT TT=1384.29	UNSAT TT=129.149 ASSIGNMENTS=126745 CHECKS=201868000	UNSAT TT=122.224	UNSAT TT=332.342
csp/tightness0.35/ normalized-rand-2-40-16-250-350-22_ext.xml	SAT TT=0.185	SAT TT=1.158 CHECKS=1230090 NODES=1226	SAT TT=1.519 CHECKS=2462380 NODES=2464	SAT TT=4.975	SAT TT=261.846 CHECKS=89181800	SAT TT=85.042 CHECKS=24187800	SAT TT=5.618 ASSIGNMENTS=6914	SAT TT=5.241 ASSIGNMENTS=6914	SAT TT=3.802 CHECKS=1281850 NODES=12180	SAT TT=1.492 CHECKS=6031510 NODES=30365	? (TO) TT=1800	SAT TT=10.892 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=10.856 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=88.548	SAT TT=54.26	SAT TT=1.689 ASSIGNMENTS=17124 CHECKS=6451090	SAT TT=3.658 ASSIGNMENTS=41609 CHECKS=15195200	SAT TT=171.872	SAT TT=0.185 ASSIGNMENTS=1770 CHECKS=576901	SAT TT=4.067 ASSIGNMENTS=42426 CHECKS=15985900	SAT TT=239.7	SAT TT=14.2 ASSIGNMENTS=16827 CHECKS=23380900	SAT TT=7.371	SAT TT=3.334
csp/tightness0.35/ normalized-rand-2-40-16-250-350-27_ext.xml	UNSAT TT=9.558	UNSAT TT=49.733 CHECKS=247559000 NODES=227760	UNSAT TT=44.68 CHECKS=239644000 NODES=221850	UNSAT TT=16.211	UNSAT TT=261.555 CHECKS=79730200	UNSAT TT=200.025 CHECKS=55288200	UNSAT TT=42.467 ASSIGNMENTS=60279	UNSAT TT=41.842 ASSIGNMENTS=60279	UNSAT TT=32.235 CHECKS=11991600 NODES=107919	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=17.201 ASSIGNMENTS=107884 CHECKS=42576600	UNSAT TT=18.878 ASSIGNMENTS=107884 CHECKS=42576600	UNSAT TT=221.736	UNSAT TT=496.352	UNSAT TT=10.391 ASSIGNMENTS=108207 CHECKS=43101900	UNSAT TT=9.875 ASSIGNMENTS=98479 CHECKS=38283700	UNSAT TT=170.603	UNSAT TT=9.558 ASSIGNMENTS=94678 CHECKS=37169200	UNSAT TT=10.225 ASSIGNMENTS=107884 CHECKS=42576600	? (TO) TT=1800.15	UNSAT TT=131.073 ASSIGNMENTS=143832 CHECKS=217699000	UNSAT TT=107.513	UNSAT TT=352.225
csp/tightness0.35/ normalized-rand-2-40-16-250-350-2_ext.xml	UNSAT TT=10.17	UNSAT TT=28.436 CHECKS=150810000 NODES=141390	UNSAT TT=29.739 CHECKS=147848000 NODES=138677	UNSAT TT=16.932	UNSAT TT=276.787 CHECKS=82391400	UNSAT TT=191.468 CHECKS=56244400	UNSAT TT=44.411 ASSIGNMENTS=63359	UNSAT TT=44.221 ASSIGNMENTS=63359	UNSAT TT=33.779 CHECKS=14026900 NODES=124331	? (TO) TT=1800.04	? (TO) TT=1800.01	UNSAT TT=18.401 ASSIGNMENTS=105816 CHECKS=41683600	UNSAT TT=18.635 ASSIGNMENTS=105816 CHECKS=41683600	UNSAT TT=438.57	UNSAT TT=731.47	UNSAT TT=11.896 ASSIGNMENTS=114937 CHECKS=45715700	UNSAT TT=11.572 ASSIGNMENTS=115255 CHECKS=44457100	UNSAT TT=261.35	UNSAT TT=10.816 ASSIGNMENTS=112877 CHECKS=44096700	UNSAT TT=10.17 ASSIGNMENTS=105816 CHECKS=41683600	? (TO) TT=1800.14	UNSAT TT=130.079 ASSIGNMENTS=157392 CHECKS=245774000	UNSAT TT=165.608	UNSAT TT=452.974
csp/tightness0.35/ normalized-rand-2-40-16-250-350-32_ext.xml	SAT TT=1.724	SAT TT=8.759 CHECKS=40779100 NODES=38798	SAT TT=10.425 CHECKS=50713100 NODES=49552	SAT TT=3.97	SAT TT=590.888 CHECKS=200298000	SAT TT=87.084 CHECKS=25666000	SAT TT=15.179 ASSIGNMENTS=20970	SAT TT=14.306 ASSIGNMENTS=20970	SAT TT=7.025 CHECKS=2678480 NODES=24647	SAT TT=2.417 CHECKS=11457600 NODES=57860	? (TO) TT=1800.05	SAT TT=13.378 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=13.239 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=9.099	SAT TT=84.621	SAT TT=3.66 ASSIGNMENTS=39241 CHECKS=15158700	SAT TT=1.995 ASSIGNMENTS=21671 CHECKS=7673360	SAT TT=12.952	SAT TT=1.724 ASSIGNMENTS=18450 CHECKS=6834510	SAT TT=5.449 ASSIGNMENTS=57868 CHECKS=22186900	SAT TT=183.109	SAT TT=14.013 ASSIGNMENTS=15345 CHECKS=20080000	SAT TT=14.895	SAT TT=40.845
csp/tightness0.35/ normalized-rand-2-40-16-250-350-40_ext.xml	UNSAT TT=7.285	UNSAT TT=32.884 CHECKS=148983000 NODES=132460	UNSAT TT=29.6 CHECKS=148105000 NODES=131334	UNSAT TT=15.448	UNSAT TT=240.54 CHECKS=75354400	UNSAT TT=184.649 CHECKS=50218900	UNSAT TT=35.963 ASSIGNMENTS=54703	UNSAT TT=35.641 ASSIGNMENTS=54703	UNSAT TT=24.159 CHECKS=10151500 NODES=89268	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=16.279 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=17.949 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=205.608	UNSAT TT=581.185	UNSAT TT=9.375 ASSIGNMENTS=97140 CHECKS=38665900	UNSAT TT=9.792 ASSIGNMENTS=95720 CHECKS=37609600	UNSAT TT=155.985	UNSAT TT=7.285 ASSIGNMENTS=76113 CHECKS=30098400	UNSAT TT=10.003 ASSIGNMENTS=96977 CHECKS=38521800	UNSAT TT=1293.86	UNSAT TT=126.999 ASSIGNMENTS=124000 CHECKS=194207000	UNSAT TT=136.817	UNSAT TT=330.196
csp/tightness0.35/ normalized-rand-2-40-16-250-350-53_ext.xml	UNSAT TT=16.006	UNSAT TT=69.716 CHECKS=373919000 NODES=354527	UNSAT TT=75.712 CHECKS=378104000 NODES=358747	UNSAT TT=22.365	UNSAT TT=1036.61 CHECKS=342167000	UNSAT TT=296.073 CHECKS=84568500	UNSAT TT=70.417 ASSIGNMENTS=109780	UNSAT TT=64.392 ASSIGNMENTS=109780	UNSAT TT=52.834 CHECKS=20499100 NODES=186797	? (TO) TT=1800.09	? (TO) TT=1800.02	UNSAT TT=23.795 ASSIGNMENTS=172849 CHECKS=68487600	UNSAT TT=25.105 ASSIGNMENTS=172849 CHECKS=68487600	UNSAT TT=622.143	UNSAT TT=1238.71	UNSAT TT=18.579 ASSIGNMENTS=182024 CHECKS=72550500	UNSAT TT=16.535 ASSIGNMENTS=162947 CHECKS=64006100	UNSAT TT=374.462	UNSAT TT=16.006 ASSIGNMENTS=156891 CHECKS=61725800	UNSAT TT=17.598 ASSIGNMENTS=172849 CHECKS=68487600	? (TO) TT=1800.16	UNSAT TT=232.708 ASSIGNMENTS=247548 CHECKS=353321000	UNSAT TT=221.912	UNSAT TT=761.304
csp/tightness0.35/ normalized-rand-2-40-16-250-350-55_ext.xml	UNSAT TT=6.08	UNSAT TT=21.062 CHECKS=112365000 NODES=99419	UNSAT TT=22.39 CHECKS=112169000 NODES=99445	UNSAT TT=9.092	UNSAT TT=210.022 CHECKS=61191100	UNSAT TT=334.239 CHECKS=94736900	UNSAT TT=25.521 ASSIGNMENTS=36866	UNSAT TT=24.873 ASSIGNMENTS=36866	UNSAT TT=19.726 CHECKS=7595620 NODES=67522	? (TO) TT=1800	? (TO) TT=1800.08	UNSAT TT=13.327 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=14.607 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=83.332	UNSAT TT=252.883	UNSAT TT=6.336 ASSIGNMENTS=61060 CHECKS=24315500	UNSAT TT=6.082 ASSIGNMENTS=63774 CHECKS=24601700	UNSAT TT=103.546	UNSAT TT=6.08 ASSIGNMENTS=61979 CHECKS=24707000	UNSAT TT=6.742 ASSIGNMENTS=65564 CHECKS=26233000	UNSAT TT=838.688	UNSAT TT=121.013 ASSIGNMENTS=110865 CHECKS=175180000	UNSAT TT=72.001	UNSAT TT=156.595
csp/tightness0.35/ normalized-rand-2-40-16-250-350-64_ext.xml	SAT TT=3.135	SAT TT=14.875 CHECKS=71699600 NODES=63505	SAT TT=14.341 CHECKS=74925500 NODES=65404	SAT TT=3.135	SAT TT=104.793 CHECKS=29578700	SAT TT=99.121 CHECKS=26818100	SAT TT=8.765 ASSIGNMENTS=10046	SAT TT=8.646 ASSIGNMENTS=10046	SAT TT=10.695 CHECKS=4367420 NODES=36422	SAT TT=6.723 CHECKS=42584000 NODES=215270	? (TO) TT=1800.08	SAT TT=11.032 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=11.422 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=44.122	SAT TT=156.017	SAT TT=3.192 ASSIGNMENTS=32395 CHECKS=13039100	SAT TT=4.212 ASSIGNMENTS=40363 CHECKS=15709600	SAT TT=18.865	SAT TT=3.866 ASSIGNMENTS=38548 CHECKS=15488800	SAT TT=3.394 ASSIGNMENTS=33744 CHECKS=13737600	SAT TT=70.148	SAT TT=47.813 ASSIGNMENTS=30534 CHECKS=51608300	SAT TT=30.288	SAT TT=61.678
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.35/ normalized-rand-2-40-16-250-350-72_ext.xml	SAT TT=0.596	SAT TT=10.944 CHECKS=50366800 NODES=47006	SAT TT=10.363 CHECKS=52387200 NODES=48941	SAT TT=3.887	SAT TT=10.592 CHECKS=3399620	SAT TT=11.77 CHECKS=3365360	SAT TT=3.677 ASSIGNMENTS=3711	SAT TT=3.366 ASSIGNMENTS=3711	SAT TT=10.531 CHECKS=4085900 NODES=36646	SAT TT=4.547 CHECKS=25798600 NODES=129759	? (TO) TT=1800.03	SAT TT=1.45 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=1.465 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=23.131	SAT TT=64.916	SAT TT=1.435 ASSIGNMENTS=13749 CHECKS=5421910	SAT TT=0.596 ASSIGNMENTS=6893 CHECKS=2095540	SAT TT=56.706	SAT TT=3.573 ASSIGNMENTS=34780 CHECKS=13547900	SAT TT=1.416 ASSIGNMENTS=13485 CHECKS=5337640	SAT TT=36.306	SAT TT=75.32 ASSIGNMENTS=9598 CHECKS=14305800	SAT TT=63.687	SAT TT=23.107
csp/tightness0.35/ normalized-rand-2-40-16-250-350-7_ext.xml	UNSAT TT=10.151	UNSAT TT=61.579 CHECKS=308670000 NODES=278461	UNSAT TT=61.402 CHECKS=308969000 NODES=278608	UNSAT TT=18.466	UNSAT TT=783.628 CHECKS=263363000	UNSAT TT=198.473 CHECKS=54370500	UNSAT TT=37.523 ASSIGNMENTS=61281	UNSAT TT=37.354 ASSIGNMENTS=61281	UNSAT TT=31.102 CHECKS=12559400 NODES=114028	? (TO) TT=1800.01	? (TO) TT=1800.03	UNSAT TT=19.671 ASSIGNMENTS=118389 CHECKS=47383100	UNSAT TT=19.815 ASSIGNMENTS=118389 CHECKS=47383100	UNSAT TT=323.94	UNSAT TT=799.014	UNSAT TT=10.151 ASSIGNMENTS=100350 CHECKS=39256200	UNSAT TT=10.781 ASSIGNMENTS=107636 CHECKS=42318600	UNSAT TT=197.672	UNSAT TT=11.409 ASSIGNMENTS=112405 CHECKS=44698600	UNSAT TT=12.111 ASSIGNMENTS=118389 CHECKS=47383100	? (TO) TT=1800.12	UNSAT TT=216.347 ASSIGNMENTS=180304 CHECKS=268260000	UNSAT TT=132.065	UNSAT TT=448.671
csp/tightness0.35/ normalized-rand-2-40-16-250-350-8_ext.xml	UNSAT TT=2.986	UNSAT TT=25.784 CHECKS=143612000 NODES=116336	UNSAT TT=25.582 CHECKS=142687000 NODES=115500	UNSAT TT=7.598	UNSAT TT=124.193 CHECKS=37011200	UNSAT TT=97.773 CHECKS=28356700	UNSAT TT=15.101 ASSIGNMENTS=17364	UNSAT TT=15.025 ASSIGNMENTS=17364	UNSAT TT=10.786 CHECKS=4256100 NODES=34949	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=10.856 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=10.787 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=40.118	UNSAT TT=114.572	UNSAT TT=3.431 ASSIGNMENTS=31716 CHECKS=13333900	UNSAT TT=2.986 ASSIGNMENTS=29014 CHECKS=11379600	UNSAT TT=58.282	UNSAT TT=3.501 ASSIGNMENTS=31888 CHECKS=13181800	UNSAT TT=2.997 ASSIGNMENTS=29776 CHECKS=12377800	UNSAT TT=369.26	UNSAT TT=59.311 ASSIGNMENTS=42164 CHECKS=71985000	UNSAT TT=30.448	UNSAT TT=69.309
csp/tightness0.35/ normalized-rand-2-40-16-250-350-90_ext.xml	UNSAT TT=7.626	UNSAT TT=30.275 CHECKS=164079000 NODES=145182	UNSAT TT=31.928 CHECKS=162421000 NODES=143626	UNSAT TT=10.327	UNSAT TT=448.827 CHECKS=142209000	UNSAT TT=185.717 CHECKS=51488300	UNSAT TT=29.748 ASSIGNMENTS=46323	UNSAT TT=29.73 ASSIGNMENTS=46323	UNSAT TT=26.6 CHECKS=10113400 NODES=90778	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=15.704 ASSIGNMENTS=82408 CHECKS=32375100	UNSAT TT=16.077 ASSIGNMENTS=82408 CHECKS=32375100	UNSAT TT=197.255	UNSAT TT=459.957	UNSAT TT=7.626 ASSIGNMENTS=81213 CHECKS=31679600	UNSAT TT=7.919 ASSIGNMENTS=81747 CHECKS=31132800	UNSAT TT=218.422	UNSAT TT=8.178 ASSIGNMENTS=80447 CHECKS=31336300	UNSAT TT=8.214 ASSIGNMENTS=82408 CHECKS=32375100	? (TO) TT=1800.13	UNSAT TT=125.827 ASSIGNMENTS=123425 CHECKS=201909000	UNSAT TT=139.367	UNSAT TT=319.362
csp/tightness0.35/ normalized-rand-2-40-16-250-350-95_ext.xml	UNSAT TT=14.854	UNSAT TT=58.926 CHECKS=249233000 NODES=239111	UNSAT TT=46.265 CHECKS=247402000 NODES=237855	UNSAT TT=21.467	UNSAT TT=424.102 CHECKS=131550000	UNSAT TT=318.027 CHECKS=92312600	UNSAT TT=63.959 ASSIGNMENTS=96838	UNSAT TT=59.048 ASSIGNMENTS=96838	UNSAT TT=51.448 CHECKS=20931800 NODES=196433	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=21.602 ASSIGNMENTS=161097 CHECKS=61825500	UNSAT TT=23.387 ASSIGNMENTS=161097 CHECKS=61825500	UNSAT TT=572.646	UNSAT TT=1283.16	UNSAT TT=14.854 ASSIGNMENTS=161924 CHECKS=62137500	UNSAT TT=15.257 ASSIGNMENTS=157108 CHECKS=59524700	UNSAT TT=396.441	UNSAT TT=17.654 ASSIGNMENTS=176286 CHECKS=67568700	UNSAT TT=15.733 ASSIGNMENTS=161097 CHECKS=61825500	? (TO) TT=1800.15	UNSAT TT=230.722 ASSIGNMENTS=235446 CHECKS=341990000	UNSAT TT=319.801	UNSAT TT=780.711
csp/tightness0.5/ normalized-rand-2-40-25-180-500-11_ext.xml	UNSAT TT=6.063	UNSAT TT=14.883 CHECKS=98706700 NODES=68220	UNSAT TT=15.256 CHECKS=101317000 NODES=69309	UNSAT TT=64.031	UNSAT TT=399.464 CHECKS=45344500	UNSAT TT=377.411 CHECKS=31813500	UNSAT TT=42.585 ASSIGNMENTS=36874	UNSAT TT=38.954 ASSIGNMENTS=36874	UNSAT TT=16.063 CHECKS=9837400 NODES=50990	? (TO) TT=1800.04	? (TO) TT=1800	UNSAT TT=14.656 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=13.571 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=361.479	UNSAT TT=343.182	UNSAT TT=6.877 ASSIGNMENTS=56795 CHECKS=20320500	UNSAT TT=6.33 ASSIGNMENTS=54649 CHECKS=18834400	UNSAT TT=99.061	UNSAT TT=6.063 ASSIGNMENTS=53690 CHECKS=18965100	UNSAT TT=6.323 ASSIGNMENTS=56056 CHECKS=20028800	UNSAT TT=567.168	UNSAT TT=80.69 ASSIGNMENTS=69879 CHECKS=99886500	UNSAT TT=84.855	UNSAT TT=198.27
csp/tightness0.5/ normalized-rand-2-40-25-180-500-12_ext.xml	UNSAT TT=12.856	UNSAT TT=265.058 CHECKS=1704590000 NODES=1188700	UNSAT TT=267.851 CHECKS=1705090000 NODES=1188620	UNSAT TT=162.069	? (TO) TT=1800.09	UNSAT TT=784.198 CHECKS=64887600	UNSAT TT=69.521 ASSIGNMENTS=62598	UNSAT TT=63.895 ASSIGNMENTS=62598	UNSAT TT=38.41 CHECKS=24308000 NODES=139559	? (TO) TT=1800	? (TO) TT=1800.09	UNSAT TT=20.973 ASSIGNMENTS=118525 CHECKS=40774400	UNSAT TT=21.112 ASSIGNMENTS=118525 CHECKS=40774400	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=12.856 ASSIGNMENTS=123123 CHECKS=42677100	UNSAT TT=12.857 ASSIGNMENTS=116626 CHECKS=39448600	UNSAT TT=538.328	UNSAT TT=13.196 ASSIGNMENTS=117144 CHECKS=39884500	UNSAT TT=13.541 ASSIGNMENTS=118525 CHECKS=40774400	? (TO) TT=1800.07	UNSAT TT=170.056 ASSIGNMENTS=148691 CHECKS=226208000	UNSAT TT=482.879	? (TO) TT=1800.05
csp/tightness0.5/ normalized-rand-2-40-25-180-500-16_ext.xml	UNSAT TT=5.862	UNSAT TT=13.09 CHECKS=84442600 NODES=56760	UNSAT TT=13.92 CHECKS=84756500 NODES=56981	UNSAT TT=120.075	UNSAT TT=991.295 CHECKS=134136000	UNSAT TT=1135.57 CHECKS=92165100	UNSAT TT=29.779 ASSIGNMENTS=25740	UNSAT TT=29.268 ASSIGNMENTS=25740	UNSAT TT=15.373 CHECKS=9902800 NODES=54772	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=13.477 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=13.417 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=349.297	UNSAT TT=375.948	UNSAT TT=5.897 ASSIGNMENTS=50694 CHECKS=17704700	UNSAT TT=5.971 ASSIGNMENTS=52296 CHECKS=17579100	UNSAT TT=164.188	UNSAT TT=6.051 ASSIGNMENTS=51518 CHECKS=17816300	UNSAT TT=5.862 ASSIGNMENTS=50469 CHECKS=17538200	UNSAT TT=746.399	UNSAT TT=81.469 ASSIGNMENTS=73003 CHECKS=118625000	UNSAT TT=112.943	UNSAT TT=197.742
csp/tightness0.5/ normalized-rand-2-40-25-180-500-18_ext.xml	UNSAT TT=6.126	UNSAT TT=22.292 CHECKS=138580000 NODES=89378	UNSAT TT=22.879 CHECKS=140973000 NODES=90547	UNSAT TT=52.561	UNSAT TT=946.917 CHECKS=145930000	UNSAT TT=332.666 CHECKS=29344700	UNSAT TT=27.812 ASSIGNMENTS=25540	UNSAT TT=27.916 ASSIGNMENTS=25540	UNSAT TT=20.118 CHECKS=12241200 NODES=63901	? (TO) TT=1800.06	? (TO) TT=1800.04	UNSAT TT=15.275 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=14.814 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=541.562	UNSAT TT=591.22	UNSAT TT=7.049 ASSIGNMENTS=58781 CHECKS=21121500	UNSAT TT=7.007 ASSIGNMENTS=57207 CHECKS=19962200	UNSAT TT=184.877	UNSAT TT=6.126 ASSIGNMENTS=54971 CHECKS=19534200	UNSAT TT=6.946 ASSIGNMENTS=58551 CHECKS=21052300	UNSAT TT=1249.56	UNSAT TT=139.697 ASSIGNMENTS=66908 CHECKS=112362000	UNSAT TT=176.847	UNSAT TT=304.714
csp/tightness0.5/ normalized-rand-2-40-25-180-500-19_ext.xml	SAT TT=0.274	SAT TT=1.932 CHECKS=6959850 NODES=4410	SAT TT=2.272 CHECKS=7330000 NODES=4539	SAT TT=22.814	SAT TT=13.347 CHECKS=1357640	SAT TT=62.418 CHECKS=4371710	SAT TT=3.338 ASSIGNMENTS=1886	SAT TT=3.731 ASSIGNMENTS=1886	SAT TT=1.209 CHECKS=358321 NODES=1660	SAT TT=8.926 CHECKS=55693200 NODES=253812	? (TO) TT=1800.06	SAT TT=0.382 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=0.382 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=5.893	SAT TT=30.06	SAT TT=0.274 ASSIGNMENTS=1942 CHECKS=666487	SAT TT=0.431 ASSIGNMENTS=4843 CHECKS=1124880	SAT TT=3.949	SAT TT=0.295 ASSIGNMENTS=2163 CHECKS=619689	SAT TT=0.366 ASSIGNMENTS=2515 CHECKS=864748	SAT TT=13.116	SAT TT=1.847 ASSIGNMENTS=339 CHECKS=520707	SAT TT=2.732	SAT TT=4.709
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.5/ normalized-rand-2-40-25-180-500-24_ext.xml	UNSAT TT=22.399	UNSAT TT=68.523 CHECKS=420758000 NODES=301210	UNSAT TT=68.151 CHECKS=422330000 NODES=302320	UNSAT TT=208.771	? (TO) TT=1800.1	UNSAT TT=1696.83 CHECKS=149834000	UNSAT TT=98.98 ASSIGNMENTS=106081	UNSAT TT=107.64 ASSIGNMENTS=106081	UNSAT TT=74.724 CHECKS=42436900 NODES=260538	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=30.141 ASSIGNMENTS=211146 CHECKS=69777100	UNSAT TT=30.801 ASSIGNMENTS=211146 CHECKS=69777100	? (TO) TT=1800.02	? (TO) TT=1800.01	UNSAT TT=22.698 ASSIGNMENTS=209825 CHECKS=69354000	UNSAT TT=26.677 ASSIGNMENTS=252219 CHECKS=82275800	UNSAT TT=666.443	UNSAT TT=22.399 ASSIGNMENTS=208230 CHECKS=68551700	UNSAT TT=22.679 ASSIGNMENTS=211146 CHECKS=69777100	? (TO) TT=1800.16	UNSAT TT=509.071 ASSIGNMENTS=365949 CHECKS=495527000	UNSAT TT=926.28	? (TO) TT=1800.1
csp/tightness0.5/ normalized-rand-2-40-25-180-500-35_ext.xml	SAT TT=2.163	SAT TT=14.077 CHECKS=89695100 NODES=65793	SAT TT=15.121 CHECKS=90333700 NODES=65910	SAT TT=2.762	SAT TT=177.733 CHECKS=21269900	SAT TT=494.751 CHECKS=42136300	SAT TT=14.634 ASSIGNMENTS=13267	SAT TT=14.423 ASSIGNMENTS=13267	SAT TT=11.497 CHECKS=6439490 NODES=36400	SAT TT=50.159 CHECKS=363498000 NODES=1656770	? (TO) TT=1800.02	SAT TT=9.571 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=9.818 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=1508.34	SAT TT=355.002	SAT TT=7.157 ASSIGNMENTS=63026 CHECKS=21400200	SAT TT=3.914 ASSIGNMENTS=36077 CHECKS=11681200	SAT TT=31.476	SAT TT=6.672 ASSIGNMENTS=59468 CHECKS=19918400	SAT TT=2.163 ASSIGNMENTS=20561 CHECKS=6775240	SAT TT=347.621	SAT TT=47.41 ASSIGNMENTS=24689 CHECKS=32454100	SAT TT=60.751	SAT TT=27.804
csp/tightness0.5/ normalized-rand-2-40-25-180-500-37_ext.xml	UNSAT TT=25.124	UNSAT TT=97.268 CHECKS=620314000 NODES=470657	UNSAT TT=101.141 CHECKS=620452000 NODES=469967	UNSAT TT=250.405	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=119.044 ASSIGNMENTS=125338	UNSAT TT=116.841 ASSIGNMENTS=125338	UNSAT TT=78.06 CHECKS=44545300 NODES=278710	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=32.028 ASSIGNMENTS=252577 CHECKS=82983100	UNSAT TT=36.068 ASSIGNMENTS=252577 CHECKS=82983100	? (TO) TT=1800.06	? (TO) TT=1800.07	UNSAT TT=26.114 ASSIGNMENTS=249460 CHECKS=81567300	UNSAT TT=25.792 ASSIGNMENTS=247250 CHECKS=80635800	UNSAT TT=922.387	UNSAT TT=25.134 ASSIGNMENTS=255902 CHECKS=83131700	UNSAT TT=25.124 ASSIGNMENTS=252577 CHECKS=82983100	? (TO) TT=1800.11	UNSAT TT=466.743 ASSIGNMENTS=348303 CHECKS=507433000	UNSAT TT=1588.52	? (TO) TT=1800.11
csp/tightness0.5/ normalized-rand-2-40-25-180-500-46_ext.xml	SAT TT=0.563	SAT TT=1.144 CHECKS=1444140 NODES=1043	SAT TT=2.779 CHECKS=12221200 NODES=8171	SAT TT=5.113	SAT TT=317.01 CHECKS=37658100	SAT TT=51.243 CHECKS=3698310	SAT TT=5.198 ASSIGNMENTS=3659	SAT TT=5.022 ASSIGNMENTS=3659	SAT TT=6.365 CHECKS=3584060 NODES=20101	SAT TT=11.589 CHECKS=79594500 NODES=367188	SAT TT=0.986 CHECKS=1125610 NODES=3583	SAT TT=8.876 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=9.51 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=31.272	SAT TT=367.949	SAT TT=0.902 ASSIGNMENTS=7375 CHECKS=2532160	SAT TT=0.563 ASSIGNMENTS=6345 CHECKS=1470540	SAT TT=18.55	SAT TT=0.966 ASSIGNMENTS=8383 CHECKS=2684700	SAT TT=1.805 ASSIGNMENTS=16512 CHECKS=5642340	SAT TT=17.486	SAT TT=2.068 ASSIGNMENTS=1003 CHECKS=1672430	SAT TT=68.686	SAT TT=21.216
csp/tightness0.5/ normalized-rand-2-40-25-180-500-51_ext.xml	SAT TT=4.494	SAT TT=62.174 CHECKS=373763000 NODES=301978	SAT TT=62.594 CHECKS=374849000 NODES=302821	SAT TT=126.557	SAT TT=361.085 CHECKS=51528900	SAT TT=567.93 CHECKS=47366100	SAT TT=9.092 ASSIGNMENTS=8431	SAT TT=9.519 ASSIGNMENTS=8431	SAT TT=13.556 CHECKS=7406600 NODES=46690	SAT TT=212.951 CHECKS=1441960000 NODES=6520200	? (TO) TT=1800.01	SAT TT=12.584 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=12.515 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=203.471	SAT TT=677.931	SAT TT=4.596 ASSIGNMENTS=44403 CHECKS=13867000	SAT TT=4.494 ASSIGNMENTS=44528 CHECKS=13465000	SAT TT=197.629	SAT TT=6.948 ASSIGNMENTS=66763 CHECKS=20966200	SAT TT=4.691 ASSIGNMENTS=46157 CHECKS=14332800	SAT TT=1123.72	SAT TT=44.295 ASSIGNMENTS=13249 CHECKS=17500900	SAT TT=32.049	SAT TT=24.758
csp/tightness0.5/ normalized-rand-2-40-25-180-500-68_ext.xml	SAT TT=0.109	SAT TT=1.039 CHECKS=32389 NODES=60	SAT TT=0.914 CHECKS=107526 NODES=59	SAT TT=2.875	SAT TT=19.883 CHECKS=2353380	SAT TT=4.624 CHECKS=278301	SAT TT=4.267 ASSIGNMENTS=2618	SAT TT=4.625 ASSIGNMENTS=2618	SAT TT=1.129 CHECKS=232302 NODES=1059	SAT TT=2.249 CHECKS=8428070 NODES=38438	? (TO) TT=1800.02	SAT TT=0.324 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=0.317 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=8.552	SAT TT=38	SAT TT=0.109 ASSIGNMENTS=359 CHECKS=128978	SAT TT=0.787 ASSIGNMENTS=7606 CHECKS=2057380	SAT TT=9.887	SAT TT=0.601 ASSIGNMENTS=4660 CHECKS=1507310	SAT TT=0.301 ASSIGNMENTS=1945 CHECKS=682630	SAT TT=3.311	SAT TT=1.172 ASSIGNMENTS=417 CHECKS=710609	SAT TT=2.898	SAT TT=2.748
csp/tightness0.5/ normalized-rand-2-40-25-180-500-75_ext.xml	SAT TT=2.714	SAT TT=38.102 CHECKS=234881000 NODES=160583	SAT TT=39.777 CHECKS=242843000 NODES=166105	SAT TT=73.935	SAT TT=1530 CHECKS=230947000	SAT TT=56.519 CHECKS=4514980	SAT TT=16.025 ASSIGNMENTS=14021	SAT TT=16.112 ASSIGNMENTS=14021	SAT TT=8.583 CHECKS=4781990 NODES=25866	SAT TT=90.814 CHECKS=668740000 NODES=3068630	? (TO) TT=1800.08	SAT TT=11.434 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=11.581 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=8.655	SAT TT=21.393	SAT TT=4.719 ASSIGNMENTS=40253 CHECKS=14127900	SAT TT=2.714 ASSIGNMENTS=24250 CHECKS=7982500	SAT TT=128.118	SAT TT=4.003 ASSIGNMENTS=34543 CHECKS=11832700	SAT TT=3.99 ASSIGNMENTS=33929 CHECKS=11912500	SAT TT=1771.56	SAT TT=34.027 ASSIGNMENTS=18002 CHECKS=28835200	SAT TT=78.668	SAT TT=117.269
csp/tightness0.5/ normalized-rand-2-40-25-180-500-79_ext.xml	SAT TT=0.692	SAT TT=45.27 CHECKS=272556000 NODES=212904	SAT TT=43.12 CHECKS=272684000 NODES=212887	SAT TT=484.618	SAT TT=37.773 CHECKS=4414900	SAT TT=42.083 CHECKS=3212420	SAT TT=4.234 ASSIGNMENTS=3113	SAT TT=4.273 ASSIGNMENTS=3113	SAT TT=4.559 CHECKS=2191790 NODES=13059	SAT TT=212.025 CHECKS=1553370000 NODES=7014260	? (TO) TT=1800.04	SAT TT=0.744 ASSIGNMENTS=5978 CHECKS=1989610	SAT TT=0.726 ASSIGNMENTS=5978 CHECKS=1989610	SAT TT=148.478	? (TO) TT=1800.01	SAT TT=0.692 ASSIGNMENTS=5836 CHECKS=1951410	SAT TT=28.649 ASSIGNMENTS=285148 CHECKS=95037500	SAT TT=4.914	SAT TT=1.4 ASSIGNMENTS=12466 CHECKS=4027310	SAT TT=0.711 ASSIGNMENTS=5978 CHECKS=1989610	? (TO) TT=1800.18	SAT TT=281.572 ASSIGNMENTS=5005 CHECKS=4815540	SAT TT=991.88	SAT TT=150.535
csp/tightness0.5/ normalized-rand-2-40-25-180-500-93_ext.xml	UNSAT TT=2.502	UNSAT TT=13.673 CHECKS=86255100 NODES=53734	UNSAT TT=13.946 CHECKS=86884400 NODES=54138	UNSAT TT=51.359	UNSAT TT=372.187 CHECKS=46751100	UNSAT TT=183.685 CHECKS=13938600	UNSAT TT=12.334 ASSIGNMENTS=10075	UNSAT TT=12.294 ASSIGNMENTS=10075	UNSAT TT=8.234 CHECKS=4699730 NODES=24654	? (TO) TT=1800.06	? (TO) TT=1800.01	UNSAT TT=9.757 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=10.611 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=74.062	UNSAT TT=133.234	UNSAT TT=3.259 ASSIGNMENTS=26661 CHECKS=9514670	UNSAT TT=2.502 ASSIGNMENTS=21665 CHECKS=7242970	UNSAT TT=58.166	UNSAT TT=3.109 ASSIGNMENTS=25452 CHECKS=8963550	UNSAT TT=3.026 ASSIGNMENTS=24565 CHECKS=8817960	UNSAT TT=142.049	UNSAT TT=44.763 ASSIGNMENTS=34598 CHECKS=67619600	UNSAT TT=40.441	UNSAT TT=46.568
csp/tightness0.5/ normalized-rand-2-40-25-180-500-9_ext.xml	SAT TT=0.707	SAT TT=33.367 CHECKS=226193000 NODES=158281	SAT TT=33.751 CHECKS=227224000 NODES=158643	SAT TT=57.696	SAT TT=312.954 CHECKS=44424200	SAT TT=457.101 CHECKS=40430200	SAT TT=5.939 ASSIGNMENTS=3518	SAT TT=6.022 ASSIGNMENTS=3518	SAT TT=8.63 CHECKS=5085470 NODES=28383	SAT TT=6.034 CHECKS=38566600 NODES=173758	? (TO) TT=1800.07	SAT TT=1.25 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=1.251 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=31.501	SAT TT=169.653	SAT TT=0.707 ASSIGNMENTS=6124 CHECKS=2065640	SAT TT=1.3 ASSIGNMENTS=13015 CHECKS=3931700	SAT TT=76.996	SAT TT=2.298 ASSIGNMENTS=21397 CHECKS=7220860	SAT TT=1.143 ASSIGNMENTS=10471 CHECKS=3496240	SAT TT=534.796	SAT TT=4.933 ASSIGNMENTS=4667 CHECKS=7128370	SAT TT=3.871	SAT TT=3.878
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.65/ normalized-rand-2-40-40-135-650-11_ext.xml	SAT TT=2.336	SAT TT=5.206 CHECKS=33986000 NODES=16590	SAT TT=4.896 CHECKS=34362800 NODES=16822	SAT TT=36.593	SAT TT=237.673 CHECKS=6858870	SAT TT=26.232 CHECKS=827668	SAT TT=3.325 ASSIGNMENTS=1126	SAT TT=3.645 ASSIGNMENTS=1126	SAT TT=5.845 CHECKS=11713300 NODES=16352	SAT TT=6.508 CHECKS=39915000 NODES=146660	? (TO) TT=1800.06	SAT TT=12.981 ASSIGNMENTS=16590 CHECKS=33986000	SAT TT=12.175 ASSIGNMENTS=16590 CHECKS=33986000	SAT TT=5.868	SAT TT=25.879	SAT TT=2.336 ASSIGNMENTS=15328 CHECKS=4472980	SAT TT=2.921 ASSIGNMENTS=19372 CHECKS=5056520	SAT TT=66.764	SAT TT=2.57 ASSIGNMENTS=17235 CHECKS=4776940	SAT TT=2.466 ASSIGNMENTS=15144 CHECKS=4403040	SAT TT=18.198	SAT TT=19.674 ASSIGNMENTS=16448 CHECKS=19267100	SAT TT=22.296	SAT TT=101.563
csp/tightness0.65/ normalized-rand-2-40-40-135-650-13_ext.xml	UNSAT TT=4.091	UNSAT TT=7.346 CHECKS=47834200 NODES=25888	UNSAT TT=7.554 CHECKS=48020400 NODES=25906	UNSAT TT=154.653	UNSAT TT=775.698 CHECKS=24210200	UNSAT TT=971.086 CHECKS=32139800	UNSAT TT=31.33 ASSIGNMENTS=16603	UNSAT TT=31.533 ASSIGNMENTS=16603	UNSAT TT=9.431 CHECKS=19503400 NODES=26824	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=14.707 ASSIGNMENTS=25888 CHECKS=47834200	UNSAT TT=11.15 ASSIGNMENTS=26607 CHECKS=8067130	UNSAT TT=123.939	UNSAT TT=265.701	UNSAT TT=4.412 ASSIGNMENTS=27223 CHECKS=8288010	UNSAT TT=4.216 ASSIGNMENTS=28019 CHECKS=7908720	UNSAT TT=162.305	UNSAT TT=4.226 ASSIGNMENTS=26471 CHECKS=7742010	UNSAT TT=4.091 ASSIGNMENTS=26607 CHECKS=8067130	UNSAT TT=321.811	UNSAT TT=39.393 ASSIGNMENTS=36099 CHECKS=38989400	UNSAT TT=145.376	UNSAT TT=169.924
csp/tightness0.65/ normalized-rand-2-40-40-135-650-14_ext.xml	UNSAT TT=2.326	UNSAT TT=57.361 CHECKS=455172000 NODES=204711	UNSAT TT=59.345 CHECKS=461114000 NODES=208029	UNSAT TT=60.148	UNSAT TT=400.334 CHECKS=12351300	UNSAT TT=316.693 CHECKS=10400300	UNSAT TT=16.831 ASSIGNMENTS=8446	UNSAT TT=15.103 ASSIGNMENTS=8446	UNSAT TT=6.859 CHECKS=13732400 NODES=17954	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=62.388 ASSIGNMENTS=204711 CHECKS=455172000	UNSAT TT=62.15 ASSIGNMENTS=204711 CHECKS=455172000	UNSAT TT=61.268	UNSAT TT=144.597	UNSAT TT=2.79 ASSIGNMENTS=15895 CHECKS=5075580	UNSAT TT=2.326 ASSIGNMENTS=15873 CHECKS=4608090	UNSAT TT=130.146	UNSAT TT=2.873 ASSIGNMENTS=16756 CHECKS=5135360	UNSAT TT=2.952 ASSIGNMENTS=17126 CHECKS=5428820	UNSAT TT=118.832	UNSAT TT=34.774 ASSIGNMENTS=17709 CHECKS=20911300	UNSAT TT=131.838	UNSAT TT=125.052
csp/tightness0.65/ normalized-rand-2-40-40-135-650-26_ext.xml	SAT TT=0.471	SAT TT=1.891 CHECKS=6285740 NODES=3627	SAT TT=1.864 CHECKS=6299260 NODES=3572	SAT TT=109.292	SAT TT=122.408 CHECKS=3143080	SAT TT=81.04 CHECKS=2242070	SAT TT=12.51 ASSIGNMENTS=6600	SAT TT=13.988 ASSIGNMENTS=6600	SAT TT=2.185 CHECKS=3132170 NODES=4261	SAT TT=20.946 CHECKS=152410000 NODES=577060	? (TO) TT=1800	SAT TT=0.526 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=0.518 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=15.707	SAT TT=174.94	SAT TT=0.552 ASSIGNMENTS=2857 CHECKS=877817	SAT TT=0.779 ASSIGNMENTS=6149 CHECKS=1353750	SAT TT=17.714	SAT TT=0.471 ASSIGNMENTS=2889 CHECKS=674050	SAT TT=0.514 ASSIGNMENTS=2634 CHECKS=784827	SAT TT=4.544	SAT TT=3.408 ASSIGNMENTS=495 CHECKS=558026	SAT TT=21.598	SAT TT=24.047
csp/tightness0.65/ normalized-rand-2-40-40-135-650-32_ext.xml	SAT TT=1.907	SAT TT=5.902 CHECKS=38170800 NODES=21251	SAT TT=5.875 CHECKS=34559400 NODES=19257	SAT TT=18.598	SAT TT=5.113 CHECKS=182242	SAT TT=301.085 CHECKS=10191700	SAT TT=4.871 ASSIGNMENTS=1854	SAT TT=4.251 ASSIGNMENTS=1854	SAT TT=4.06 CHECKS=7158330 NODES=10873	SAT TT=35.406 CHECKS=262726000 NODES=1053630	? (TO) TT=1800.07	SAT TT=13.377 ASSIGNMENTS=21251 CHECKS=38170800	SAT TT=13.473 ASSIGNMENTS=21251 CHECKS=38170800	SAT TT=24.002	SAT TT=109.969	SAT TT=2.013 ASSIGNMENTS=12987 CHECKS=3860290	SAT TT=1.907 ASSIGNMENTS=13277 CHECKS=3482840	SAT TT=68.312	SAT TT=2.855 ASSIGNMENTS=18211 CHECKS=5353010	SAT TT=2.168 ASSIGNMENTS=13586 CHECKS=4042520	SAT TT=33.642	SAT TT=41.134 ASSIGNMENTS=36535 CHECKS=38335200	SAT TT=6.694	SAT TT=115.074
csp/tightness0.65/ normalized-rand-2-40-40-135-650-37_ext.xml	UNSAT TT=8.018	UNSAT TT=33.779 CHECKS=249485000 NODES=128725	UNSAT TT=34.525 CHECKS=253644000 NODES=131022	UNSAT TT=161.833	UNSAT TT=703.948 CHECKS=26614600	? (TO) TT=1800.02	UNSAT TT=54.525 ASSIGNMENTS=29038	UNSAT TT=49.666 ASSIGNMENTS=29038	UNSAT TT=17.742 CHECKS=36735900 NODES=55354	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=39.25 ASSIGNMENTS=128725 CHECKS=249485000	UNSAT TT=15.742 ASSIGNMENTS=53553 CHECKS=15553200	UNSAT TT=639.895	UNSAT TT=845.957	UNSAT TT=8.098 ASSIGNMENTS=52115 CHECKS=15230700	UNSAT TT=8.128 ASSIGNMENTS=54442 CHECKS=15308100	UNSAT TT=232.065	UNSAT TT=8.018 ASSIGNMENTS=53348 CHECKS=15242600	UNSAT TT=8.199 ASSIGNMENTS=53553 CHECKS=15553200	UNSAT TT=1373.27	UNSAT TT=124.017 ASSIGNMENTS=112779 CHECKS=97947700	UNSAT TT=524.605	UNSAT TT=744.873
csp/tightness0.65/ normalized-rand-2-40-40-135-650-48_ext.xml	SAT TT=4.948	SAT TT=18.056 CHECKS=121208000 NODES=63108	SAT TT=17.89 CHECKS=121568000 NODES=63286	SAT TT=71.99	SAT TT=123.765 CHECKS=3448400	SAT TT=711.318 CHECKS=28558400	SAT TT=11.572 ASSIGNMENTS=5841	SAT TT=11.21 ASSIGNMENTS=5841	SAT TT=11.238 CHECKS=21011900 NODES=30321	SAT TT=1116.76 CHECKS=8563720000 NODES=34146400	? (TO) TT=1800.05	SAT TT=23.717 ASSIGNMENTS=63108 CHECKS=121208000	SAT TT=24.247 ASSIGNMENTS=63108 CHECKS=121208000	SAT TT=309.114	SAT TT=192.249	SAT TT=5.193 ASSIGNMENTS=32597 CHECKS=10330700	SAT TT=4.948 ASSIGNMENTS=32771 CHECKS=9811360	SAT TT=183.765	SAT TT=6.289 ASSIGNMENTS=38944 CHECKS=12198300	SAT TT=5.041 ASSIGNMENTS=31428 CHECKS=9979300	SAT TT=12.316	SAT TT=44.733 ASSIGNMENTS=37699 CHECKS=40459100	SAT TT=604.339	SAT TT=33.317
csp/tightness0.65/ normalized-rand-2-40-40-135-650-51_ext.xml	SAT TT=1.786	SAT TT=3.816 CHECKS=20231200 NODES=11461	SAT TT=2.973 CHECKS=16095400 NODES=9210	SAT TT=72.34	SAT TT=19.832 CHECKS=717690	SAT TT=225.051 CHECKS=7278590	SAT TT=6.366 ASSIGNMENTS=2820	SAT TT=6.4 ASSIGNMENTS=2820	SAT TT=12.905 CHECKS=23520100 NODES=35499	SAT TT=28.861 CHECKS=211326000 NODES=811907	? (TO) TT=1800.08	SAT TT=10.471 ASSIGNMENTS=11461 CHECKS=20231200	SAT TT=11.386 ASSIGNMENTS=23622 CHECKS=6839540	SAT TT=23.543	SAT TT=74.06	SAT TT=1.786 ASSIGNMENTS=11225 CHECKS=3254760	SAT TT=3.473 ASSIGNMENTS=23352 CHECKS=6419500	SAT TT=108.076	SAT TT=4.373 ASSIGNMENTS=28841 CHECKS=8239800	SAT TT=3.371 ASSIGNMENTS=23622 CHECKS=6839540	SAT TT=63.548	SAT TT=27.804 ASSIGNMENTS=18548 CHECKS=17170200	SAT TT=24.637	SAT TT=16.975
csp/tightness0.65/ normalized-rand-2-40-40-135-650-63_ext.xml	SAT TT=3.281	SAT TT=9.188 CHECKS=61473200 NODES=32338	SAT TT=8.502 CHECKS=61155800 NODES=32217	SAT TT=84.094	SAT TT=365.296 CHECKS=11611100	SAT TT=319.76 CHECKS=10401000	SAT TT=15.907 ASSIGNMENTS=7082	SAT TT=14.832 ASSIGNMENTS=7082	SAT TT=8.279 CHECKS=15091400 NODES=23104	SAT TT=4.377 CHECKS=25078500 NODES=95745	? (TO) TT=1800.02	SAT TT=15.699 ASSIGNMENTS=32338 CHECKS=61473200	SAT TT=16.203 ASSIGNMENTS=32338 CHECKS=61473200	SAT TT=248.752	SAT TT=246.927	SAT TT=5.045 ASSIGNMENTS=34916 CHECKS=10375600	SAT TT=3.281 ASSIGNMENTS=24500 CHECKS=6610420	SAT TT=135.082	SAT TT=3.946 ASSIGNMENTS=26269 CHECKS=7526300	SAT TT=3.705 ASSIGNMENTS=26497 CHECKS=7651220	SAT TT=48.135	SAT TT=35.96 ASSIGNMENTS=35013 CHECKS=32176400	SAT TT=90.365	SAT TT=16.569
csp/tightness0.65/ normalized-rand-2-40-40-135-650-66_ext.xml	UNSAT TT=12.395	UNSAT TT=97.593 CHECKS=818955000 NODES=426501	UNSAT TT=105.006 CHECKS=820469000 NODES=427056	UNSAT TT=272.438	UNSAT TT=1776.62 CHECKS=60706600	? (TO) TT=1800.09	UNSAT TT=66.692 ASSIGNMENTS=39404	UNSAT TT=71.548 ASSIGNMENTS=39404	UNSAT TT=28.161 CHECKS=54912200 NODES=83867	? (TO) TT=1800.08	? (TO) TT=1800.07	UNSAT TT=103.933 ASSIGNMENTS=426501 CHECKS=818955000	UNSAT TT=104.667 ASSIGNMENTS=426501 CHECKS=818955000	UNSAT TT=938.641	UNSAT TT=1187.07	UNSAT TT=13.106 ASSIGNMENTS=85887 CHECKS=25612200	UNSAT TT=12.395 ASSIGNMENTS=82771 CHECKS=23925600	UNSAT TT=510.318	UNSAT TT=13.013 ASSIGNMENTS=85044 CHECKS=25288600	UNSAT TT=12.656 ASSIGNMENTS=83604 CHECKS=24830500	? (TO) TT=1800.15	UNSAT TT=166.349 ASSIGNMENTS=153320 CHECKS=155492000	UNSAT TT=780.584	? (TO) TT=1800.07
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.65/ normalized-rand-2-40-40-135-650-70_ext.xml	SAT TT=3.74	SAT TT=6.515 CHECKS=39004600 NODES=20092	SAT TT=6.443 CHECKS=38539200 NODES=19833	SAT TT=75.686	SAT TT=522.009 CHECKS=21610700	SAT TT=316.111 CHECKS=13090600	SAT TT=21.138 ASSIGNMENTS=11662	SAT TT=21.962 ASSIGNMENTS=11662	SAT TT=12.433 CHECKS=25601600 NODES=34965	SAT TT=901.116 CHECKS=6821140000 NODES=26857200	? (TO) TT=1800	SAT TT=13.481 ASSIGNMENTS=20092 CHECKS=39004600	SAT TT=13.747 ASSIGNMENTS=20092 CHECKS=39004600	SAT TT=367.683	SAT TT=1041.18	SAT TT=3.773 ASSIGNMENTS=24636 CHECKS=7938720	SAT TT=3.74 ASSIGNMENTS=26188 CHECKS=7914870	SAT TT=101.726	SAT TT=3.925 ASSIGNMENTS=23981 CHECKS=7582210	SAT TT=5.622 ASSIGNMENTS=34980 CHECKS=11249900	SAT TT=1060.28	SAT TT=23.759 ASSIGNMENTS=19657 CHECKS=23620900	SAT TT=703.209	SAT TT=393.754
csp/tightness0.65/ normalized-rand-2-40-40-135-650-74_ext.xml	SAT TT=0.696	SAT TT=4.763 CHECKS=30214000 NODES=16828	SAT TT=5.377 CHECKS=31867700 NODES=17500	SAT TT=135.664	SAT TT=152.482 CHECKS=4473940	SAT TT=256.67 CHECKS=10904300	SAT TT=8.117 ASSIGNMENTS=4070	SAT TT=7.993 ASSIGNMENTS=4070	SAT TT=6.192 CHECKS=12181900 NODES=17281	SAT TT=126.41 CHECKS=949446000 NODES=3706440	? (TO) TT=1800	SAT TT=12.828 ASSIGNMENTS=16828 CHECKS=30214000	SAT TT=11.892 ASSIGNMENTS=31349 CHECKS=9701100	SAT TT=20.882	SAT TT=79.775	SAT TT=0.696 ASSIGNMENTS=3793 CHECKS=1182370	SAT TT=3.048 ASSIGNMENTS=22028 CHECKS=6228520	SAT TT=79.84	SAT TT=4.063 ASSIGNMENTS=25123 CHECKS=7521110	SAT TT=5.082 ASSIGNMENTS=31349 CHECKS=9701100	SAT TT=4.806	SAT TT=54.093 ASSIGNMENTS=20066 CHECKS=19911900	SAT TT=77.156	SAT TT=51.743
csp/tightness0.65/ normalized-rand-2-40-40-135-650-79_ext.xml	UNSAT TT=10.703	UNSAT TT=62.675 CHECKS=476677000 NODES=235388	UNSAT TT=62.105 CHECKS=479262000 NODES=236206	? (TO) TT=1800.02	UNSAT TT=916.91 CHECKS=37439700	UNSAT TT=922.389 CHECKS=37548600	UNSAT TT=100.317 ASSIGNMENTS=54949	UNSAT TT=98.776 ASSIGNMENTS=54949	UNSAT TT=26.598 CHECKS=52485700 NODES=73526	? (TO) TT=1800.09	? (TO) TT=1800.09	UNSAT TT=65.003 ASSIGNMENTS=235388 CHECKS=476677000	UNSAT TT=17.318 ASSIGNMENTS=66688 CHECKS=21093200	UNSAT TT=994.242	UNSAT TT=909.427	UNSAT TT=12.316 ASSIGNMENTS=75907 CHECKS=23917500	UNSAT TT=11.34 ASSIGNMENTS=72722 CHECKS=22285200	UNSAT TT=257.749	UNSAT TT=11.479 ASSIGNMENTS=71955 CHECKS=22535800	UNSAT TT=10.703 ASSIGNMENTS=66688 CHECKS=21093200	? (TO) TT=1800.21	UNSAT TT=168.054 ASSIGNMENTS=135627 CHECKS=142091000	UNSAT TT=530.657	UNSAT TT=921.963
csp/tightness0.65/ normalized-rand-2-40-40-135-650-91_ext.xml	SAT TT=0.613	SAT TT=29.855 CHECKS=203585000 NODES=124695	SAT TT=30.049 CHECKS=208693000 NODES=127313	SAT TT=80.451	SAT TT=1353.56 CHECKS=54716600	SAT TT=185.962 CHECKS=7941450	SAT TT=33.515 ASSIGNMENTS=22963	SAT TT=34.139 ASSIGNMENTS=22963	SAT TT=1.888 CHECKS=2189170 NODES=3682	SAT TT=32.003 CHECKS=236824000 NODES=895244	? (TO) TT=1800.09	SAT TT=0.76 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=0.765 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=318.486	SAT TT=231.433	SAT TT=0.794 ASSIGNMENTS=4315 CHECKS=1352920	SAT TT=0.788 ASSIGNMENTS=6099 CHECKS=1330250	SAT TT=378.385	SAT TT=0.613 ASSIGNMENTS=4027 CHECKS=982401	SAT TT=0.736 ASSIGNMENTS=4220 CHECKS=1280630	SAT TT=300.726	SAT TT=1.254 ASSIGNMENTS=1144 CHECKS=937602	SAT TT=72.01	SAT TT=94.016
csp/tightness0.65/ normalized-rand-2-40-40-135-650-96_ext.xml	SAT TT=9.229	SAT TT=63.102 CHECKS=496417000 NODES=255095	SAT TT=67.049 CHECKS=485863000 NODES=250474	SAT TT=625.636	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=88.08 ASSIGNMENTS=50516	SAT TT=81.93 ASSIGNMENTS=50516	SAT TT=9.229 CHECKS=16352000 NODES=23994	? (TO) TT=1800	? (TO) TT=1800.1	SAT TT=70.293 ASSIGNMENTS=255095 CHECKS=496417000	SAT TT=70.185 ASSIGNMENTS=255095 CHECKS=496417000	SAT TT=845.006	SAT TT=1377.13	SAT TT=11.513 ASSIGNMENTS=71651 CHECKS=22762300	SAT TT=11.155 ASSIGNMENTS=72144 CHECKS=22296400	SAT TT=149.001	SAT TT=10.705 ASSIGNMENTS=71976 CHECKS=22626900	SAT TT=10.765 ASSIGNMENTS=71919 CHECKS=22833100	SAT TT=482.87	SAT TT=91.417 ASSIGNMENTS=80426 CHECKS=87527900	SAT TT=1030.9	SAT TT=635.025
csp/tightness0.8/ normalized-rand-2-40-80-103-800-10_ext.xml	SAT TT=1.146	SAT TT=1.454 CHECKS=4874340 NODES=1134	SAT TT=1.649 CHECKS=5154220 NODES=1145	SAT TT=1624.05	SAT TT=12.724 CHECKS=104431	SAT TT=99.945 CHECKS=943372	SAT TT=8.022 ASSIGNMENTS=740	SAT TT=8.286 ASSIGNMENTS=740	SAT TT=3.668 CHECKS=11632000 NODES=4498	? (TO) TT=1800.06	? (TO) TT=1800.02	SAT TT=1.444 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=1.452 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=18.332	SAT TT=16.918	SAT TT=1.146 ASSIGNMENTS=3627 CHECKS=1015140	SAT TT=1.2 ASSIGNMENTS=5164 CHECKS=1017510	SAT TT=18.2	SAT TT=1.249 ASSIGNMENTS=4537 CHECKS=988663	SAT TT=1.523 ASSIGNMENTS=4466 CHECKS=1319020	SAT TT=25.081	SAT TT=13.819 ASSIGNMENTS=3518 CHECKS=12785700	SAT TT=115.677	SAT TT=5.493
csp/tightness0.8/ normalized-rand-2-40-80-103-800-12_ext.xml	SAT TT=0.632	SAT TT=3.749 CHECKS=26443800 NODES=8535	SAT TT=3.74 CHECKS=27829900 NODES=8691	SAT TT=225.054	SAT TT=55.047 CHECKS=724692	SAT TT=19.924 CHECKS=237718	SAT TT=13.147 ASSIGNMENTS=2655	SAT TT=14.357 ASSIGNMENTS=2655	SAT TT=2.4 CHECKS=3766740 NODES=1865	SAT TT=986.632 CHECKS=7995830000 NODES=21285700	? (TO) TT=1800.09	SAT TT=1.125 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=1.139 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=20.202	SAT TT=13.827	SAT TT=1.74 ASSIGNMENTS=6361 CHECKS=1653570	SAT TT=0.955 ASSIGNMENTS=4872 CHECKS=827361	SAT TT=9.335	SAT TT=0.632 ASSIGNMENTS=2838 CHECKS=417431	SAT TT=1.09 ASSIGNMENTS=4013 CHECKS=1010520	SAT TT=49.561	SAT TT=6.971 ASSIGNMENTS=1198 CHECKS=2685680	SAT TT=8.953	SAT TT=36.125
csp/tightness0.8/ normalized-rand-2-40-80-103-800-18_ext.xml	UNSAT TT=1.166	UNSAT TT=5.681 CHECKS=57554800 NODES=9479	UNSAT TT=5.767 CHECKS=57966200 NODES=9540	UNSAT TT=27.667	UNSAT TT=176.381 CHECKS=1585820	UNSAT TT=278.889 CHECKS=2393190	UNSAT TT=10.748 ASSIGNMENTS=758	UNSAT TT=10.661 ASSIGNMENTS=758	UNSAT TT=3.384 CHECKS=11292700 NODES=3483	? (TO) TT=1800.09	? (TO) TT=1800.1	UNSAT TT=1.217 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=1.314 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=31.448	UNSAT TT=51.246	UNSAT TT=1.166 ASSIGNMENTS=3307 CHECKS=1019580	UNSAT TT=1.554 ASSIGNMENTS=6204 CHECKS=1252680	UNSAT TT=32.229	UNSAT TT=1.639 ASSIGNMENTS=5950 CHECKS=1272600	UNSAT TT=1.293 ASSIGNMENTS=3404 CHECKS=1047280	UNSAT TT=17.493	UNSAT TT=19.58 ASSIGNMENTS=4203 CHECKS=21444900	UNSAT TT=38.356	UNSAT TT=31.352
csp/tightness0.8/ normalized-rand-2-40-80-103-800-19_ext.xml	SAT TT=0.579	SAT TT=7.868 CHECKS=65418300 NODES=25820	SAT TT=6.669 CHECKS=53814500 NODES=21977	SAT TT=359.621	SAT TT=142.541 CHECKS=2427760	SAT TT=494.927 CHECKS=7863260	SAT TT=50.317 ASSIGNMENTS=17111	SAT TT=54.889 ASSIGNMENTS=17111	SAT TT=2.578 CHECKS=5062190 NODES=3579	SAT TT=596.273 CHECKS=4333570000 NODES=12240400	? (TO) TT=1800.03	SAT TT=14.698 ASSIGNMENTS=25820 CHECKS=65418300	SAT TT=15.691 ASSIGNMENTS=25820 CHECKS=65418300	SAT TT=96.09	SAT TT=198.966	SAT TT=13.093 ASSIGNMENTS=69911 CHECKS=15692300	SAT TT=0.7 ASSIGNMENTS=4140 CHECKS=585903	SAT TT=672.434	SAT TT=0.579 ASSIGNMENTS=2755 CHECKS=366023	SAT TT=12.321 ASSIGNMENTS=65810 CHECKS=14936000	SAT TT=169.375	SAT TT=7.484 ASSIGNMENTS=4786 CHECKS=7025300	SAT TT=44.396	SAT TT=996.379
csp/tightness0.8/ normalized-rand-2-40-80-103-800-20_ext.xml	UNSAT TT=1.8	UNSAT TT=95.942 CHECKS=1149600000 NODES=223778	UNSAT TT=99.626 CHECKS=1150850000 NODES=223828	UNSAT TT=258.453	UNSAT TT=241.889 CHECKS=2778470	UNSAT TT=310.059 CHECKS=3387450	UNSAT TT=15.127 ASSIGNMENTS=2263	UNSAT TT=15.076 ASSIGNMENTS=2263	UNSAT TT=4.07 CHECKS=12861600 NODES=5303	? (TO) TT=1800.09	? (TO) TT=1800.06	UNSAT TT=99.864 ASSIGNMENTS=223778 CHECKS=1149600000	UNSAT TT=98.887 ASSIGNMENTS=223778 CHECKS=1149600000	UNSAT TT=38.541	UNSAT TT=46.939	UNSAT TT=2.041 ASSIGNMENTS=6814 CHECKS=1852940	UNSAT TT=1.806 ASSIGNMENTS=8158 CHECKS=1687420	UNSAT TT=38.219	UNSAT TT=1.921 ASSIGNMENTS=7844 CHECKS=1711760	UNSAT TT=1.8 ASSIGNMENTS=6142 CHECKS=1648580	UNSAT TT=61.572	UNSAT TT=22.197 ASSIGNMENTS=9621 CHECKS=21726000	UNSAT TT=152.468	UNSAT TT=117.865
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.8/ normalized-rand-2-40-80-103-800-25_ext.xml	UNSAT TT=1.317	UNSAT TT=11.54 CHECKS=121831000 NODES=27326	UNSAT TT=10.697 CHECKS=122205000 NODES=27385	UNSAT TT=426.383	UNSAT TT=376.495 CHECKS=3937530	UNSAT TT=349.865 CHECKS=3891640	UNSAT TT=19.663 ASSIGNMENTS=1932	UNSAT TT=18.331 ASSIGNMENTS=1932	UNSAT TT=3.477 CHECKS=10055600 NODES=4638	? (TO) TT=1800.02	? (TO) TT=1800.04	UNSAT TT=1.43 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=1.445 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=33.749	UNSAT TT=87.546	UNSAT TT=1.326 ASSIGNMENTS=4888 CHECKS=1307410	UNSAT TT=1.511 ASSIGNMENTS=6650 CHECKS=1353690	UNSAT TT=52.635	UNSAT TT=1.524 ASSIGNMENTS=6028 CHECKS=1314430	UNSAT TT=1.317 ASSIGNMENTS=4838 CHECKS=1283050	UNSAT TT=58.156	UNSAT TT=29.435 ASSIGNMENTS=9386 CHECKS=39122100	UNSAT TT=103.931	UNSAT TT=74.42
csp/tightness0.8/ normalized-rand-2-40-80-103-800-27_ext.xml	SAT TT=53.015	SAT TT=753.249 CHECKS=7411610000 NODES=2310980	SAT TT=684.183 CHECKS=7399070000 NODES=2309980	SAT TT=199.058	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=258.663 ASSIGNMENTS=86106	SAT TT=247.694 ASSIGNMENTS=86106	SAT TT=143.474 CHECKS=583305000 NODES=349119	? (TO) TT=1800.02	? (TO) TT=1800	SAT TT=701.114 ASSIGNMENTS=2310980 CHECKS=7411610000	SAT TT=698.427 ASSIGNMENTS=2310980 CHECKS=7411610000	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=53.107 ASSIGNMENTS=239584 CHECKS=65832600	SAT TT=53.015 ASSIGNMENTS=240981 CHECKS=65903200	? (TO) TT=1800.02	SAT TT=59.6 ASSIGNMENTS=287615 CHECKS=78290500	SAT TT=97.933 ASSIGNMENTS=443912 CHECKS=122034000	? (TO) TT=1800.22	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.08
csp/tightness0.8/ normalized-rand-2-40-80-103-800-29_ext.xml	UNSAT TT=3.491	UNSAT TT=24.463 CHECKS=271245000 NODES=59596	UNSAT TT=22.623 CHECKS=269729000 NODES=59403	? (TO) TT=1800.1	UNSAT TT=712.549 CHECKS=7372400	UNSAT TT=728.915 CHECKS=7904310	UNSAT TT=21.199 ASSIGNMENTS=3739	UNSAT TT=22.999 ASSIGNMENTS=3739	UNSAT TT=7.579 CHECKS=29516100 NODES=11771	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=32.33 ASSIGNMENTS=59596 CHECKS=271245000	UNSAT TT=30.218 ASSIGNMENTS=59596 CHECKS=271245000	UNSAT TT=104.756	UNSAT TT=179.973	UNSAT TT=3.565 ASSIGNMENTS=11781 CHECKS=3283790	UNSAT TT=3.607 ASSIGNMENTS=14055 CHECKS=3394220	UNSAT TT=93.999	UNSAT TT=3.63 ASSIGNMENTS=13087 CHECKS=3203870	UNSAT TT=3.491 ASSIGNMENTS=11702 CHECKS=3164870	UNSAT TT=102.674	UNSAT TT=54.718 ASSIGNMENTS=17705 CHECKS=58329700	UNSAT TT=208.743	UNSAT TT=174.39
csp/tightness0.8/ normalized-rand-2-40-80-103-800-3_ext.xml	UNSAT TT=0.871	UNSAT TT=13.132 CHECKS=159175000 NODES=27439	UNSAT TT=13.713 CHECKS=158359000 NODES=27260	UNSAT TT=45.246	UNSAT TT=151.976 CHECKS=1182950	UNSAT TT=82.537 CHECKS=643111	UNSAT TT=8.219 ASSIGNMENTS=318	UNSAT TT=8.562 ASSIGNMENTS=318	UNSAT TT=2.57 CHECKS=6415660 NODES=2113	? (TO) TT=1800.04	? (TO) TT=1800.13	UNSAT TT=0.943 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=0.913 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=20.617	UNSAT TT=25.829	UNSAT TT=0.871 ASSIGNMENTS=2020 CHECKS=614218	UNSAT TT=1.083 ASSIGNMENTS=4834 CHECKS=859058	UNSAT TT=21.187	UNSAT TT=1.067 ASSIGNMENTS=4216 CHECKS=824827	UNSAT TT=0.911 ASSIGNMENTS=2161 CHECKS=640889	UNSAT TT=13.711	UNSAT TT=9.385 ASSIGNMENTS=1851 CHECKS=9116350	UNSAT TT=18.253	UNSAT TT=20.455
csp/tightness0.8/ normalized-rand-2-40-80-103-800-40_ext.xml	UNSAT TT=9.371	UNSAT TT=23.222 CHECKS=267717000 NODES=65285	UNSAT TT=22.544 CHECKS=266338000 NODES=64920	UNSAT TT=644.979	UNSAT TT=1684.12 CHECKS=21260100	? (TO) TT=1800.06	UNSAT TT=56.784 ASSIGNMENTS=12517	UNSAT TT=61.112 ASSIGNMENTS=12517	UNSAT TT=22.304 CHECKS=88047300 NODES=40863	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=29.91 ASSIGNMENTS=65285 CHECKS=267717000	UNSAT TT=32.273 ASSIGNMENTS=65285 CHECKS=267717000	UNSAT TT=884.866	? (TO) TT=1800.03	UNSAT TT=9.371 ASSIGNMENTS=36321 CHECKS=10607500	UNSAT TT=9.851 ASSIGNMENTS=37616 CHECKS=10424200	UNSAT TT=459.854	UNSAT TT=10.381 ASSIGNMENTS=38770 CHECKS=10887900	UNSAT TT=9.446 ASSIGNMENTS=36885 CHECKS=10762600	UNSAT TT=1497.71	UNSAT TT=161.527 ASSIGNMENTS=32038 CHECKS=122084000	UNSAT TT=1160.94	UNSAT TT=1170.43
csp/tightness0.8/ normalized-rand-2-40-80-103-800-52_ext.xml	SAT TT=0.908	SAT TT=288.358 CHECKS=3221640000 NODES=893290	SAT TT=292.547 CHECKS=3221280000 NODES=894611	SAT TT=221.402	SAT TT=555.245 CHECKS=6972770	SAT TT=366.001 CHECKS=4633450	SAT TT=21.765 ASSIGNMENTS=4453	SAT TT=21.479 ASSIGNMENTS=4453	SAT TT=18.013 CHECKS=69757100 NODES=36853	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.908 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=0.968 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=1079.45	SAT TT=880.097	SAT TT=4.372 ASSIGNMENTS=17966 CHECKS=4825380	SAT TT=5.284 ASSIGNMENTS=21906 CHECKS=5309910	SAT TT=32.207	SAT TT=6.903 ASSIGNMENTS=28075 CHECKS=6991600	SAT TT=0.961 ASSIGNMENTS=3077 CHECKS=835991	SAT TT=101.803	SAT TT=82.97 ASSIGNMENTS=28044 CHECKS=75189300	SAT TT=909.583	SAT TT=31.723
csp/tightness0.8/ normalized-rand-2-40-80-103-800-53_ext.xml	UNSAT TT=1.919	UNSAT TT=251.634 CHECKS=2805370000 NODES=731824	UNSAT TT=255.015 CHECKS=2814340000 NODES=733594	? (TO) TT=1800.06	UNSAT TT=346.306 CHECKS=3687060	UNSAT TT=366.982 CHECKS=3619030	UNSAT TT=15.43 ASSIGNMENTS=2365	UNSAT TT=14.958 ASSIGNMENTS=2365	UNSAT TT=5.811 CHECKS=19986200 NODES=8501	? (TO) TT=1800	? (TO) TT=1800.07	UNSAT TT=260.642 ASSIGNMENTS=731824 CHECKS=2805370000	UNSAT TT=241.211 ASSIGNMENTS=731824 CHECKS=2805370000	UNSAT TT=43.695	UNSAT TT=125.161	UNSAT TT=2.357 ASSIGNMENTS=7571 CHECKS=2142820	UNSAT TT=1.919 ASSIGNMENTS=9343 CHECKS=1892160	UNSAT TT=51.992	UNSAT TT=2.177 ASSIGNMENTS=9059 CHECKS=1957520	UNSAT TT=2.258 ASSIGNMENTS=7491 CHECKS=2098610	UNSAT TT=53.171	UNSAT TT=46.388 ASSIGNMENTS=14584 CHECKS=44735700	UNSAT TT=156.995	UNSAT TT=121.437
csp/tightness0.8/ normalized-rand-2-40-80-103-800-59_ext.xml	UNSAT TT=5.223	UNSAT TT=58.415 CHECKS=681008000 NODES=153620	UNSAT TT=54.271 CHECKS=681275000 NODES=153910	UNSAT TT=226.366	UNSAT TT=1785.43 CHECKS=19105800	UNSAT TT=1473.4 CHECKS=16245700	UNSAT TT=33.179 ASSIGNMENTS=6675	UNSAT TT=34.042 ASSIGNMENTS=6675	UNSAT TT=13.342 CHECKS=59120300 NODES=25371	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=65.12 ASSIGNMENTS=153620 CHECKS=681008000	UNSAT TT=61.11 ASSIGNMENTS=153620 CHECKS=681008000	UNSAT TT=198.332	UNSAT TT=1139.76	UNSAT TT=7.453 ASSIGNMENTS=24534 CHECKS=7276250	UNSAT TT=5.223 ASSIGNMENTS=19037 CHECKS=5144750	UNSAT TT=324.005	UNSAT TT=5.33 ASSIGNMENTS=18992 CHECKS=5243020	UNSAT TT=7.374 ASSIGNMENTS=24701 CHECKS=7274790	UNSAT TT=500.733	UNSAT TT=92.639 ASSIGNMENTS=29153 CHECKS=94093500	UNSAT TT=497.565	UNSAT TT=594.634
csp/tightness0.8/ normalized-rand-2-40-80-103-800-64_ext.xml	UNSAT TT=6.442	UNSAT TT=19.133 CHECKS=226752000 NODES=51577	UNSAT TT=20.521 CHECKS=225287000 NODES=51225	UNSAT TT=387.306	? (TO) TT=1800.08	? (TO) TT=1800.02	UNSAT TT=38.735 ASSIGNMENTS=9201	UNSAT TT=39.814 ASSIGNMENTS=9201	UNSAT TT=13.345 CHECKS=54514400 NODES=25027	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=26.856 ASSIGNMENTS=51577 CHECKS=226752000	UNSAT TT=27.309 ASSIGNMENTS=51577 CHECKS=226752000	UNSAT TT=335.394	UNSAT TT=843.317	UNSAT TT=7.112 ASSIGNMENTS=24913 CHECKS=6958560	UNSAT TT=6.442 ASSIGNMENTS=25440 CHECKS=6418090	UNSAT TT=190.947	UNSAT TT=7.336 ASSIGNMENTS=26156 CHECKS=7088920	UNSAT TT=6.764 ASSIGNMENTS=25282 CHECKS=7039350	UNSAT TT=402.326	UNSAT TT=170.184 ASSIGNMENTS=54511 CHECKS=168153000	UNSAT TT=867.416	UNSAT TT=622.721
csp/tightness0.8/ normalized-rand-2-40-80-103-800-66_ext.xml	SAT TT=0.558	SAT TT=48.956 CHECKS=539963000 NODES=136217	SAT TT=46.05 CHECKS=546583000 NODES=137854	SAT TT=38.315	SAT TT=78.075 CHECKS=957819	SAT TT=946.881 CHECKS=12143600	SAT TT=10.335 ASSIGNMENTS=1439	SAT TT=10.225 ASSIGNMENTS=1439	SAT TT=17.74 CHECKS=75495000 NODES=38955	? (TO) TT=1800.1	? (TO) TT=1800.01	SAT TT=0.558 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=0.564 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=175.549	SAT TT=17.067	SAT TT=11.156 ASSIGNMENTS=45498 CHECKS=11444300	SAT TT=1.462 ASSIGNMENTS=6574 CHECKS=1346520	SAT TT=41.222	SAT TT=11.248 ASSIGNMENTS=47337 CHECKS=11358300	SAT TT=0.584 ASSIGNMENTS=1642 CHECKS=458393	SAT TT=39.002	SAT TT=186.139 ASSIGNMENTS=76568 CHECKS=199646000	SAT TT=1018.84	SAT TT=271.827
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.8/ normalized-rand-2-40-80-103-800-68_ext.xml	SAT TT=1.651	SAT TT=13.594 CHECKS=133753000 NODES=36844	SAT TT=12.069 CHECKS=116202000 NODES=32038	? (TO) TT=1800.02	SAT TT=142.163 CHECKS=1795390	SAT TT=258.926 CHECKS=3346700	SAT TT=63.689 ASSIGNMENTS=14635	SAT TT=64.311 ASSIGNMENTS=14635	SAT TT=8.435 CHECKS=33391500 NODES=17639	SAT TT=216.329 CHECKS=1580670000 NODES=4304140	? (TO) TT=1800.1	SAT TT=20.055 ASSIGNMENTS=36844 CHECKS=133753000	SAT TT=20.235 ASSIGNMENTS=36844 CHECKS=133753000	SAT TT=16.896	SAT TT=1186.11	SAT TT=3.315 ASSIGNMENTS=13474 CHECKS=3449860	SAT TT=3.282 ASSIGNMENTS=14946 CHECKS=3398240	SAT TT=55.504	SAT TT=1.651 ASSIGNMENTS=7344 CHECKS=1509120	SAT TT=1.84 ASSIGNMENTS=7115 CHECKS=1879690	SAT TT=47.105	SAT TT=35.969 ASSIGNMENTS=12551 CHECKS=29937500	? (TO) TT=1800.08	SAT TT=432.978
csp/tightness0.8/ normalized-rand-2-40-80-103-800-70_ext.xml	SAT TT=5.446	SAT TT=5.497 CHECKS=47310000 NODES=10314	SAT TT=5.446 CHECKS=48343100 NODES=10706	SAT TT=759.024	SAT TT=168.453 CHECKS=1910140	SAT TT=924.751 CHECKS=11638200	SAT TT=53.5 ASSIGNMENTS=14390	SAT TT=58.867 ASSIGNMENTS=14390	SAT TT=12.098 CHECKS=53588700 NODES=21311	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=12.431 ASSIGNMENTS=10314 CHECKS=47310000	SAT TT=12.692 ASSIGNMENTS=10314 CHECKS=47310000	SAT TT=367.634	? (TO) TT=1800.03	SAT TT=6.161 ASSIGNMENTS=21204 CHECKS=6191930	SAT TT=7.832 ASSIGNMENTS=27678 CHECKS=7652880	SAT TT=113.699	SAT TT=7.276 ASSIGNMENTS=25917 CHECKS=7158860	SAT TT=6.871 ASSIGNMENTS=23723 CHECKS=6831240	SAT TT=334.531	SAT TT=96.811 ASSIGNMENTS=24276 CHECKS=81580200	SAT TT=553.174	SAT TT=1233.58
csp/tightness0.8/ normalized-rand-2-40-80-103-800-78_ext.xml	UNSAT TT=68.507	UNSAT TT=244.678 CHECKS=2586760000 NODES=642417	UNSAT TT=221.776 CHECKS=2525690000 NODES=628790	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=319.451 ASSIGNMENTS=88116	UNSAT TT=317.459 ASSIGNMENTS=88116	UNSAT TT=159.874 CHECKS=719246000 NODES=390325	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=232.83 ASSIGNMENTS=642417 CHECKS=2586760000	UNSAT TT=243.115 ASSIGNMENTS=642417 CHECKS=2586760000	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=70.617 ASSIGNMENTS=334380 CHECKS=85242100	UNSAT TT=68.507 ASSIGNMENTS=333199 CHECKS=84437500	? (TO) TT=1800.1	UNSAT TT=74.303 ASSIGNMENTS=333391 CHECKS=84617700	UNSAT TT=77.286 ASSIGNMENTS=347332 CHECKS=88263500	? (TO) TT=1800.19	UNSAT TT=1601.43 ASSIGNMENTS=611665 CHECKS=1771870000	? (TO) TT=1800.02	? (TO) TT=1800.07
csp/tightness0.8/ normalized-rand-2-40-80-103-800-7_ext.xml	SAT TT=0.4	SAT TT=19.068 CHECKS=219500000 NODES=51888	SAT TT=19.029 CHECKS=221003000 NODES=51920	SAT TT=1521.05	SAT TT=161.565 CHECKS=1281270	SAT TT=67.749 CHECKS=520826	SAT TT=5.414 ASSIGNMENTS=57	SAT TT=5.237 ASSIGNMENTS=57	SAT TT=1.966 CHECKS=1699440 NODES=766	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.403 ASSIGNMENTS=924 CHECKS=240012	SAT TT=0.4 ASSIGNMENTS=924 CHECKS=240012	SAT TT=19.702	SAT TT=16.205	SAT TT=0.563 ASSIGNMENTS=1395 CHECKS=358778	SAT TT=0.666 ASSIGNMENTS=3678 CHECKS=494878	SAT TT=2.412	SAT TT=0.67 ASSIGNMENTS=2936 CHECKS=439463	SAT TT=0.417 ASSIGNMENTS=924 CHECKS=240012	SAT TT=12.416	SAT TT=0.592 ASSIGNMENTS=77 CHECKS=203125	SAT TT=21.938	SAT TT=5.854
csp/tightness0.8/ normalized-rand-2-40-80-103-800-80_ext.xml	SAT TT=0.836	SAT TT=18.899 CHECKS=216847000 NODES=40895	SAT TT=19.062 CHECKS=216831000 NODES=40836	? (TO) TT=1800.07	SAT TT=133.197 CHECKS=1214460	SAT TT=350.397 CHECKS=3398660	SAT TT=8.793 ASSIGNMENTS=765	SAT TT=8.804 ASSIGNMENTS=765	SAT TT=2.93 CHECKS=6699580 NODES=2511	SAT TT=383.186 CHECKS=3086380000 NODES=7851690	? (TO) TT=1800.06	SAT TT=0.915 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=0.918 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=16.273	SAT TT=13.71	SAT TT=0.893 ASSIGNMENTS=2317 CHECKS=687610	SAT TT=1.241 ASSIGNMENTS=5300 CHECKS=1008780	SAT TT=34.429	SAT TT=1.304 ASSIGNMENTS=4827 CHECKS=973814	SAT TT=0.836 ASSIGNMENTS=2387 CHECKS=693937	SAT TT=15.737	SAT TT=7.765 ASSIGNMENTS=2090 CHECKS=8890990	SAT TT=35.724	SAT TT=14.168
csp/tightness0.8/ normalized-rand-2-40-80-103-800-83_ext.xml	UNSAT TT=2.005	UNSAT TT=98.035 CHECKS=1147030000 NODES=218148	UNSAT TT=98.474 CHECKS=1152310000 NODES=218967	UNSAT TT=173.602	UNSAT TT=412.799 CHECKS=3886780	UNSAT TT=390.665 CHECKS=3534430	UNSAT TT=14.906 ASSIGNMENTS=2435	UNSAT TT=14.732 ASSIGNMENTS=2435	UNSAT TT=5.716 CHECKS=20167300 NODES=6804	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=97.312 ASSIGNMENTS=218148 CHECKS=1147030000	UNSAT TT=96.857 ASSIGNMENTS=218148 CHECKS=1147030000	UNSAT TT=41.519	UNSAT TT=125.422	UNSAT TT=2.398 ASSIGNMENTS=7018 CHECKS=2083480	UNSAT TT=2.02 ASSIGNMENTS=7823 CHECKS=1846380	UNSAT TT=107.039	UNSAT TT=2.13 ASSIGNMENTS=7418 CHECKS=1870410	UNSAT TT=2.005 ASSIGNMENTS=5798 CHECKS=1757310	UNSAT TT=38.151	UNSAT TT=44.278 ASSIGNMENTS=7185 CHECKS=27893000	UNSAT TT=137.177	UNSAT TT=103.519
csp/tightness0.8/ normalized-rand-2-40-80-103-800-87_ext.xml	UNSAT TT=4.94	UNSAT TT=39.63 CHECKS=455654000 NODES=96048	UNSAT TT=39.689 CHECKS=456290000 NODES=96252	UNSAT TT=438.328	UNSAT TT=903.515 CHECKS=9473270	UNSAT TT=874.617 CHECKS=9017280	UNSAT TT=31.577 ASSIGNMENTS=6763	UNSAT TT=31.794 ASSIGNMENTS=6763	UNSAT TT=12.045 CHECKS=47368800 NODES=20418	? (TO) TT=1800.04	? (TO) TT=1800.08	UNSAT TT=44.211 ASSIGNMENTS=96048 CHECKS=455654000	UNSAT TT=44.06 ASSIGNMENTS=96048 CHECKS=455654000	UNSAT TT=164.245	UNSAT TT=507.189	UNSAT TT=5.922 ASSIGNMENTS=18377 CHECKS=5483730	UNSAT TT=4.94 ASSIGNMENTS=18055 CHECKS=4749080	UNSAT TT=207.054	UNSAT TT=5.042 ASSIGNMENTS=17755 CHECKS=4857890	UNSAT TT=5.91 ASSIGNMENTS=18870 CHECKS=5574300	UNSAT TT=220.212	UNSAT TT=94.299 ASSIGNMENTS=29704 CHECKS=92039000	UNSAT TT=527.342	UNSAT TT=452.813
csp/tightness0.8/ normalized-rand-2-40-80-103-800-88_ext.xml	SAT TT=1.215	SAT TT=2.115 CHECKS=9927840 NODES=2142	SAT TT=2.002 CHECKS=10181300 NODES=2168	SAT TT=90.808	SAT TT=355.853 CHECKS=3631400	SAT TT=107.778 CHECKS=1136260	SAT TT=14.753 ASSIGNMENTS=2380	SAT TT=15.752 ASSIGNMENTS=2380	SAT TT=2.515 CHECKS=5173550 NODES=2197	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=1.221 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=1.219 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=17.947	SAT TT=540.703	SAT TT=1.54 ASSIGNMENTS=4894 CHECKS=1364860	SAT TT=3.406 ASSIGNMENTS=13606 CHECKS=3401380	SAT TT=24.003	SAT TT=1.816 ASSIGNMENTS=6876 CHECKS=1593080	SAT TT=1.215 ASSIGNMENTS=3747 CHECKS=1048980	SAT TT=6.72	SAT TT=27.834 ASSIGNMENTS=9806 CHECKS=28851300	SAT TT=56.885	SAT TT=278.711
csp/tightness0.8/ normalized-rand-2-40-80-103-800-8_ext.xml	SAT TT=1.009	SAT TT=1.048 CHECKS=753216 NODES=250	SAT TT=1.009 CHECKS=584462 NODES=152	SAT TT=34.411	SAT TT=36.706 CHECKS=369244	SAT TT=298.831 CHECKS=3308940	SAT TT=7.947 ASSIGNMENTS=788	SAT TT=7.884 ASSIGNMENTS=788	SAT TT=5.769 CHECKS=22785700 NODES=9653	SAT TT=1751.89 CHECKS=13871100000 NODES=37552300	? (TO) TT=1800.07	SAT TT=8.821 ASSIGNMENTS=250 CHECKS=753216	SAT TT=8.678 ASSIGNMENTS=250 CHECKS=753216	SAT TT=41.765	SAT TT=150.065	SAT TT=2.755 ASSIGNMENTS=9249 CHECKS=2553310	SAT TT=1.863 ASSIGNMENTS=8691 CHECKS=1864680	SAT TT=70.249	SAT TT=1.458 ASSIGNMENTS=6330 CHECKS=1343550	SAT TT=2.764 ASSIGNMENTS=9092 CHECKS=2511920	SAT TT=22.932	SAT TT=46.07 ASSIGNMENTS=14735 CHECKS=45048000	SAT TT=226.085	SAT TT=70.015
csp/tightness0.8/ normalized-rand-2-40-80-103-800-94_ext.xml	UNSAT TT=8.811	UNSAT TT=93.702 CHECKS=1050230000 NODES=262059	UNSAT TT=93.381 CHECKS=1053410000 NODES=263638	? (TO) TT=1800.08	? (TO) TT=1800.06	UNSAT TT=1482.3 CHECKS=17996400	UNSAT TT=72.66 ASSIGNMENTS=15672	UNSAT TT=79.213 ASSIGNMENTS=15672	UNSAT TT=20.341 CHECKS=88322200 NODES=36860	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=93.998 ASSIGNMENTS=262059 CHECKS=1050230000	UNSAT TT=94.293 ASSIGNMENTS=262059 CHECKS=1050230000	UNSAT TT=477.199	UNSAT TT=971.779	UNSAT TT=10.09 ASSIGNMENTS=34045 CHECKS=9981010	UNSAT TT=8.811 ASSIGNMENTS=30998 CHECKS=8737280	UNSAT TT=1094.44	UNSAT TT=10.849 ASSIGNMENTS=38542 CHECKS=10769000	UNSAT TT=10.735 ASSIGNMENTS=37561 CHECKS=10823600	UNSAT TT=1281.88	UNSAT TT=611.056 ASSIGNMENTS=241844 CHECKS=625266000	UNSAT TT=980.026	UNSAT TT=1083.25
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-11_ext.xml	UNSAT TT=0.713	UNSAT TT=314.839 CHECKS=5692960000 NODES=569937	UNSAT TT=319.869 CHECKS=5698370000 NODES=570251	UNSAT TT=157.045	UNSAT TT=212.516 CHECKS=346816	UNSAT TT=229.288 CHECKS=352287	UNSAT TT=45.233 ASSIGNMENTS=147	UNSAT TT=41.633 ASSIGNMENTS=147	UNSAT TT=3.099 CHECKS=8634910 NODES=737	? (TO) TT=1800	? (TO) TT=1800.05	UNSAT TT=0.779 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=0.781 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=44.15	UNSAT TT=29.717	UNSAT TT=0.713 ASSIGNMENTS=674 CHECKS=160694	UNSAT TT=1.743 ASSIGNMENTS=4121 CHECKS=534783	UNSAT TT=18.716	UNSAT TT=3.409 ASSIGNMENTS=6857 CHECKS=888524	UNSAT TT=0.718 ASSIGNMENTS=686 CHECKS=158250	UNSAT TT=49.536	UNSAT TT=9.715 ASSIGNMENTS=850 CHECKS=9762720	UNSAT TT=39.192	UNSAT TT=41.942
csp/tightness0.9/ normalized-rand-2-40-180-84-900-16_ext.xml	UNSAT TT=15.493	UNSAT TT=22.24 CHECKS=347445000 NODES=38062	UNSAT TT=22.931 CHECKS=347449000 NODES=37997	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.05	UNSAT TT=1090.27 ASSIGNMENTS=84368	UNSAT TT=1066.78 ASSIGNMENTS=84368	UNSAT TT=34.892 CHECKS=309271000 NODES=33383	? (TO) TT=1800.09	? (TO) TT=1800.04	UNSAT TT=30.659 ASSIGNMENTS=38062 CHECKS=347445000	UNSAT TT=30.261 ASSIGNMENTS=38062 CHECKS=347445000	UNSAT TT=985.753	? (TO) TT=1800.04	UNSAT TT=15.493 ASSIGNMENTS=27713 CHECKS=7006960	UNSAT TT=16.299 ASSIGNMENTS=28940 CHECKS=6902440	UNSAT TT=1225.68	UNSAT TT=17.783 ASSIGNMENTS=31433 CHECKS=7074910	UNSAT TT=16.474 ASSIGNMENTS=27873 CHECKS=7039320	UNSAT TT=741.981	UNSAT TT=286.411 ASSIGNMENTS=35144 CHECKS=337401000	? (TO) TT=1800	? (TO) TT=1800.06
csp/tightness0.9/ normalized-rand-2-40-180-84-900-24_ext.xml	SAT TT=0.326	SAT TT=1.336 CHECKS=1575340 NODES=202	SAT TT=1.272 CHECKS=1250840 NODES=117	SAT TT=7.067	SAT TT=15.941 CHECKS=34752	SAT TT=13.055 CHECKS=19037	SAT TT=39.847 ASSIGNMENTS=61	SAT TT=39.902 ASSIGNMENTS=61	SAT TT=2.804 CHECKS=1516680 NODES=186	SAT TT=1119.69 CHECKS=8586650000 NODES=14299700	? (TO) TT=1800.09	SAT TT=0.41 ASSIGNMENTS=194 CHECKS=44555	SAT TT=0.425 ASSIGNMENTS=194 CHECKS=44555	SAT TT=36.543	SAT TT=26.082	SAT TT=0.326 ASSIGNMENTS=94 CHECKS=22573	SAT TT=1.292 ASSIGNMENTS=3544 CHECKS=435880	SAT TT=3.958	SAT TT=2.818 ASSIGNMENTS=5894 CHECKS=737160	SAT TT=0.394 ASSIGNMENTS=194 CHECKS=44555	SAT TT=5.505	SAT TT=1.251 ASSIGNMENTS=91 CHECKS=602695	SAT TT=7.636	SAT TT=15.062
csp/tightness0.9/ normalized-rand-2-40-180-84-900-25_ext.xml	UNSAT TT=0.996	UNSAT TT=54.297 CHECKS=876965000 NODES=69088	UNSAT TT=52.369 CHECKS=871186000 NODES=68673	UNSAT TT=26.083	UNSAT TT=284.368 CHECKS=414123	UNSAT TT=259.056 CHECKS=415823	UNSAT TT=51.592 ASSIGNMENTS=170	UNSAT TT=51.518 ASSIGNMENTS=170	UNSAT TT=3.473 CHECKS=11491100 NODES=809	? (TO) TT=1800.01	? (TO) TT=1800.01	UNSAT TT=1.01 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=1.02 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=39.219	UNSAT TT=27.804	UNSAT TT=0.996 ASSIGNMENTS=911 CHECKS=230559	UNSAT TT=1.837 ASSIGNMENTS=4234 CHECKS=562320	UNSAT TT=85.185	UNSAT TT=4.278 ASSIGNMENTS=7305 CHECKS=1021140	UNSAT TT=1.027 ASSIGNMENTS=924 CHECKS=237477	UNSAT TT=15.622	UNSAT TT=14.995 ASSIGNMENTS=890 CHECKS=16814900	UNSAT TT=38.381	UNSAT TT=32.106
csp/tightness0.9/ normalized-rand-2-40-180-84-900-27_ext.xml	UNSAT TT=199.617	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.09	UNSAT TT=890.75 ASSIGNMENTS=82091	UNSAT TT=960.478 ASSIGNMENTS=82091	UNSAT TT=376.677 CHECKS=3741860000 NODES=456619	? (TO) TT=1800.01	? (TO) TT=1800.04	UNSAT TT=1242.23 ASSIGNMENTS=82091	UNSAT TT=461.099 ASSIGNMENTS=479097 CHECKS=113392000	? (TO) TT=1800.07	? (TO) TT=1800.05	UNSAT TT=200.722 ASSIGNMENTS=473910 CHECKS=112119000	UNSAT TT=207.352 ASSIGNMENTS=471236 CHECKS=111065000	? (TO) TT=1800.07	UNSAT TT=199.617 ASSIGNMENTS=475776 CHECKS=112089000	UNSAT TT=215.45 ASSIGNMENTS=479097 CHECKS=113392000	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.14
csp/tightness0.9/ normalized-rand-2-40-180-84-900-28_ext.xml	UNSAT TT=1.071	UNSAT TT=14.549 CHECKS=252327000 NODES=19994	UNSAT TT=14.628 CHECKS=252618000 NODES=19936	UNSAT TT=253.088	UNSAT TT=278.296 CHECKS=469348	UNSAT TT=261.22 CHECKS=457203	UNSAT TT=51.318 ASSIGNMENTS=181	UNSAT TT=51.121 ASSIGNMENTS=181	UNSAT TT=3.856 CHECKS=15065300 NODES=1432	? (TO) TT=1800.06	? (TO) TT=1800.02	UNSAT TT=1.184 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=1.186 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=46.09	UNSAT TT=31.621	UNSAT TT=1.16 ASSIGNMENTS=1362 CHECKS=279786	UNSAT TT=2.128 ASSIGNMENTS=5150 CHECKS=649988	UNSAT TT=43.668	UNSAT TT=4.103 ASSIGNMENTS=7468 CHECKS=1057510	UNSAT TT=1.071 ASSIGNMENTS=1366 CHECKS=287383	UNSAT TT=12.843	UNSAT TT=20.057 ASSIGNMENTS=1089 CHECKS=17372500	UNSAT TT=23.759	UNSAT TT=23.286
csp/tightness0.9/ normalized-rand-2-40-180-84-900-29_ext.xml	UNSAT TT=2.001	UNSAT TT=32.047 CHECKS=514884000 NODES=36721	UNSAT TT=32.547 CHECKS=514481000 NODES=36652	? (TO) TT=1800.08	UNSAT TT=740.909 CHECKS=1230620	UNSAT TT=727.301 CHECKS=1259520	UNSAT TT=54.996 ASSIGNMENTS=593	UNSAT TT=60.189 ASSIGNMENTS=593	UNSAT TT=5.309 CHECKS=25826800 NODES=2013	? (TO) TT=1800.04	? (TO) TT=1800.05	UNSAT TT=39.666 ASSIGNMENTS=36721 CHECKS=514884000	UNSAT TT=39.841 ASSIGNMENTS=36721 CHECKS=514884000	UNSAT TT=65.949	UNSAT TT=63.471	UNSAT TT=2.353 ASSIGNMENTS=2583 CHECKS=665644	UNSAT TT=3.002 ASSIGNMENTS=5371 CHECKS=956554	UNSAT TT=162.191	UNSAT TT=4.84 ASSIGNMENTS=8102 CHECKS=1368110	UNSAT TT=2.001 ASSIGNMENTS=2242 CHECKS=606160	UNSAT TT=47.241	UNSAT TT=30.279 ASSIGNMENTS=2322 CHECKS=33801000	UNSAT TT=86.016	UNSAT TT=72.974
csp/tightness0.9/ normalized-rand-2-40-180-84-900-2_ext.xml	UNSAT TT=3.9	UNSAT TT=6.649 CHECKS=88737400 NODES=7321	UNSAT TT=6.808 CHECKS=89505200 NODES=7333	? (TO) TT=1800.08	UNSAT TT=1291.26 CHECKS=2535860	UNSAT TT=1303.36 CHECKS=2575010	UNSAT TT=79.635 ASSIGNMENTS=2210	UNSAT TT=74.105 ASSIGNMENTS=2210	UNSAT TT=8.667 CHECKS=61847900 NODES=5601	? (TO) TT=1800.07	? (TO) TT=1800.08	UNSAT TT=14.974 ASSIGNMENTS=7321 CHECKS=88737400	UNSAT TT=14.932 ASSIGNMENTS=7321 CHECKS=88737400	UNSAT TT=125.894	UNSAT TT=311.435	UNSAT TT=4.39 ASSIGNMENTS=5748 CHECKS=1528310	UNSAT TT=4.276 ASSIGNMENTS=7811 CHECKS=1634790	UNSAT TT=183.602	UNSAT TT=6.105 ASSIGNMENTS=10383 CHECKS=1913870	UNSAT TT=3.9 ASSIGNMENTS=5700 CHECKS=1504240	UNSAT TT=97.362	UNSAT TT=92.649 ASSIGNMENTS=7483 CHECKS=91032400	UNSAT TT=211.8	UNSAT TT=260.523
csp/tightness0.9/ normalized-rand-2-40-180-84-900-35_ext.xml	UNSAT TT=3.057	UNSAT TT=6.593 CHECKS=89679500 NODES=6945	UNSAT TT=6.011 CHECKS=87833600 NODES=6714	? (TO) TT=1800.05	UNSAT TT=793.705 CHECKS=1467660	UNSAT TT=860.92 CHECKS=1513900	UNSAT TT=121.755 ASSIGNMENTS=4428	UNSAT TT=121.594 ASSIGNMENTS=4428	UNSAT TT=6.795 CHECKS=42666000 NODES=3628	? (TO) TT=1800	? (TO) TT=1800.03	UNSAT TT=14.438 ASSIGNMENTS=6945 CHECKS=89679500	UNSAT TT=14.268 ASSIGNMENTS=6945 CHECKS=89679500	UNSAT TT=145.775	UNSAT TT=103.776	UNSAT TT=3.227 ASSIGNMENTS=4171 CHECKS=1132900	UNSAT TT=3.304 ASSIGNMENTS=6742 CHECKS=1310730	UNSAT TT=165.312	UNSAT TT=6.596 ASSIGNMENTS=11590 CHECKS=2143320	UNSAT TT=3.057 ASSIGNMENTS=3734 CHECKS=1020140	UNSAT TT=84.306	UNSAT TT=47.046 ASSIGNMENTS=2790 CHECKS=47208000	UNSAT TT=293.578	UNSAT TT=271.67
csp/tightness0.9/ normalized-rand-2-40-180-84-900-40_ext.xml	UNSAT TT=5.525	UNSAT TT=160.064 CHECKS=2791510000 NODES=266315	UNSAT TT=158.754 CHECKS=2789250000 NODES=266048	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=126.404 ASSIGNMENTS=4700	UNSAT TT=137.608 ASSIGNMENTS=4700	UNSAT TT=12.278 CHECKS=89963400 NODES=10033	? (TO) TT=1800.07	? (TO) TT=1800.07	UNSAT TT=181.952 ASSIGNMENTS=266315 CHECKS=2791510000	UNSAT TT=181.968 ASSIGNMENTS=266315 CHECKS=2791510000	UNSAT TT=425.151	? (TO) TT=1800	UNSAT TT=5.951 ASSIGNMENTS=10796 CHECKS=2662890	UNSAT TT=6.488 ASSIGNMENTS=12684 CHECKS=2930820	UNSAT TT=285.834	UNSAT TT=9.108 ASSIGNMENTS=16552 CHECKS=3657740	UNSAT TT=5.525 ASSIGNMENTS=10005 CHECKS=2462960	UNSAT TT=731.147	UNSAT TT=156.628 ASSIGNMENTS=16819 CHECKS=170627000	UNSAT TT=750.8	UNSAT TT=732.718
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-43_ext.xml	UNSAT TT=1.04	UNSAT TT=14.761 CHECKS=247485000 NODES=28820	UNSAT TT=16.025 CHECKS=247949000 NODES=28793	? (TO) TT=1800.07	UNSAT TT=281.022 CHECKS=488973	UNSAT TT=267.509 CHECKS=465787	UNSAT TT=48.464 ASSIGNMENTS=371	UNSAT TT=46.684 ASSIGNMENTS=371	UNSAT TT=4.411 CHECKS=18868200 NODES=1777	? (TO) TT=1800.05	? (TO) TT=1800.08	UNSAT TT=1.057 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=1.056 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=59.397	UNSAT TT=103.072	UNSAT TT=1.04 ASSIGNMENTS=1288 CHECKS=286777	UNSAT TT=3.655 ASSIGNMENTS=7071 CHECKS=1324390	UNSAT TT=37.204	UNSAT TT=4.469 ASSIGNMENTS=8585 CHECKS=1306120	UNSAT TT=1.113 ASSIGNMENTS=1338 CHECKS=288827	UNSAT TT=61.861	UNSAT TT=17.428 ASSIGNMENTS=1771 CHECKS=20229100	UNSAT TT=64.999	UNSAT TT=105.468
csp/tightness0.9/ normalized-rand-2-40-180-84-900-45_ext.xml	UNSAT TT=1.308	UNSAT TT=14.456 CHECKS=240873000 NODES=19683	UNSAT TT=14.844 CHECKS=241481000 NODES=19674	UNSAT TT=32.307	UNSAT TT=580.318 CHECKS=895959	UNSAT TT=570.998 CHECKS=900796	UNSAT TT=53.207 ASSIGNMENTS=382	UNSAT TT=53.528 ASSIGNMENTS=382	UNSAT TT=4.51 CHECKS=19088300 NODES=1825	? (TO) TT=1800.01	? (TO) TT=1800.05	UNSAT TT=1.326 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=1.368 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=43.328	UNSAT TT=45.47	UNSAT TT=1.313 ASSIGNMENTS=1708 CHECKS=346988	UNSAT TT=2.03 ASSIGNMENTS=4664 CHECKS=656212	UNSAT TT=67.801	UNSAT TT=4.005 ASSIGNMENTS=7620 CHECKS=1026180	UNSAT TT=1.308 ASSIGNMENTS=1701 CHECKS=348564	UNSAT TT=15.798	UNSAT TT=26.418 ASSIGNMENTS=2425 CHECKS=33811600	UNSAT TT=59.625	UNSAT TT=69.758
csp/tightness0.9/ normalized-rand-2-40-180-84-900-48_ext.xml	SAT TT=3.998	SAT TT=4.367 CHECKS=44720500 NODES=4482	SAT TT=3.998 CHECKS=44511400 NODES=4388	SAT TT=481.941	SAT TT=520.058 CHECKS=1457680	SAT TT=782.003 CHECKS=2345850	SAT TT=69.813 ASSIGNMENTS=2969	SAT TT=76.804 ASSIGNMENTS=2969	SAT TT=28.827 CHECKS=261271000 NODES=30520	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=11.679 ASSIGNMENTS=4482 CHECKS=44720500	SAT TT=12.242 ASSIGNMENTS=4482 CHECKS=44720500	SAT TT=61.862	SAT TT=233.298	SAT TT=10.519 ASSIGNMENTS=19423 CHECKS=4915870	SAT TT=11.838 ASSIGNMENTS=23821 CHECKS=5535890	SAT TT=1280.42	SAT TT=14.221 ASSIGNMENTS=29699 CHECKS=6553980	SAT TT=10.029 ASSIGNMENTS=19702 CHECKS=4979920	SAT TT=59.558	SAT TT=273.369 ASSIGNMENTS=36542 CHECKS=285848000	? (TO) TT=1800.1	SAT TT=888.547
csp/tightness0.9/ normalized-rand-2-40-180-84-900-4_ext.xml	UNSAT TT=1.393	UNSAT TT=13.2 CHECKS=204730000 NODES=14449	UNSAT TT=13.116 CHECKS=205855000 NODES=14504	UNSAT TT=34.805	UNSAT TT=691.106 CHECKS=1234650	UNSAT TT=659.929 CHECKS=1273540	UNSAT TT=51.595 ASSIGNMENTS=229	UNSAT TT=53.438 ASSIGNMENTS=229	UNSAT TT=5.075 CHECKS=29691800 NODES=2227	? (TO) TT=1800.03	? (TO) TT=1800.03	UNSAT TT=1.53 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=1.393 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=48.598	UNSAT TT=38.56	UNSAT TT=1.516 ASSIGNMENTS=1699 CHECKS=420606	UNSAT TT=2.159 ASSIGNMENTS=4676 CHECKS=670650	UNSAT TT=96.244	UNSAT TT=4.347 ASSIGNMENTS=7964 CHECKS=1155450	UNSAT TT=1.535 ASSIGNMENTS=1662 CHECKS=415490	UNSAT TT=17.478	UNSAT TT=42.39 ASSIGNMENTS=1920 CHECKS=30550800	UNSAT TT=40.096	UNSAT TT=45.56
csp/tightness0.9/ normalized-rand-2-40-180-84-900-52_ext.xml	SAT TT=11.041	SAT TT=63.535 CHECKS=1089030000 NODES=121710	SAT TT=61.532 CHECKS=1077700000 NODES=120544	? (TO) TT=1800.05	SAT TT=733.03 CHECKS=1918180	SAT TT=434.212 CHECKS=1024550	SAT TT=64.205 ASSIGNMENTS=1539	SAT TT=64.053 ASSIGNMENTS=1539	SAT TT=59.69 CHECKS=524471000 NODES=62436	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=74.484 ASSIGNMENTS=121710 CHECKS=1089030000	SAT TT=74.87 ASSIGNMENTS=121710 CHECKS=1089030000	SAT TT=559.358	SAT TT=67.269	SAT TT=35.432 ASSIGNMENTS=56139 CHECKS=14694900	SAT TT=26.885 ASSIGNMENTS=51035 CHECKS=13159800	SAT TT=254.319	SAT TT=11.041 ASSIGNMENTS=21592 CHECKS=4791240	SAT TT=20.59 ASSIGNMENTS=33033 CHECKS=8814930	? (TO) TT=1800.15	SAT TT=140.837 ASSIGNMENTS=17931 CHECKS=169497000	? (TO) TT=1800.09	SAT TT=1282.3
csp/tightness0.9/ normalized-rand-2-40-180-84-900-61_ext.xml	SAT TT=0.428	SAT TT=1.385 CHECKS=1432800 NODES=228	SAT TT=1.311 CHECKS=1862570 NODES=222	SAT TT=9.958	SAT TT=65.868 CHECKS=228275	SAT TT=64.751 CHECKS=255476	SAT TT=40.839 ASSIGNMENTS=58	SAT TT=40.894 ASSIGNMENTS=58	SAT TT=3.701 CHECKS=11636900 NODES=1930	SAT TT=591.486 CHECKS=5014820000 NODES=7217080	? (TO) TT=1800.06	SAT TT=0.47 ASSIGNMENTS=417 CHECKS=73682	SAT TT=0.457 ASSIGNMENTS=417 CHECKS=73682	SAT TT=41.312	SAT TT=26.016	SAT TT=0.428 ASSIGNMENTS=318 CHECKS=67120	SAT TT=0.565 ASSIGNMENTS=903 CHECKS=109088	SAT TT=8.404	SAT TT=2.887 ASSIGNMENTS=5944 CHECKS=731140	SAT TT=0.449 ASSIGNMENTS=417 CHECKS=73682	SAT TT=9.007	SAT TT=9.284 ASSIGNMENTS=1677 CHECKS=8812940	SAT TT=28.34	SAT TT=48.979
csp/tightness0.9/ normalized-rand-2-40-180-84-900-63_ext.xml	UNSAT TT=4.392	UNSAT TT=81.2 CHECKS=1398200000 NODES=109127	UNSAT TT=84.978 CHECKS=1398830000 NODES=108982	UNSAT TT=323.842	UNSAT TT=1407.72 CHECKS=3464190	UNSAT TT=1407.51 CHECKS=3484660	UNSAT TT=93.031 ASSIGNMENTS=3296	UNSAT TT=92.924 ASSIGNMENTS=3296	UNSAT TT=11.036 CHECKS=84012700 NODES=8668	? (TO) TT=1800.04	? (TO) TT=1800.1	UNSAT TT=101.574 ASSIGNMENTS=109127 CHECKS=1398200000	UNSAT TT=100.076 ASSIGNMENTS=109127 CHECKS=1398200000	UNSAT TT=171.335	UNSAT TT=609.669	UNSAT TT=4.392 ASSIGNMENTS=7724 CHECKS=1884140	UNSAT TT=5.016 ASSIGNMENTS=9954 CHECKS=2067740	UNSAT TT=204.886	UNSAT TT=7.128 ASSIGNMENTS=12640 CHECKS=2432900	UNSAT TT=5.024 ASSIGNMENTS=7957 CHECKS=1941630	UNSAT TT=577.875	UNSAT TT=165.574 ASSIGNMENTS=11964 CHECKS=149260000	UNSAT TT=446.259	UNSAT TT=495.818
csp/tightness0.9/ normalized-rand-2-40-180-84-900-68_ext.xml	SAT TT=0.488	SAT TT=1.356 CHECKS=2532180 NODES=327	SAT TT=1.634 CHECKS=3662060 NODES=394	SAT TT=10.686	SAT TT=393.989 CHECKS=1378710	SAT TT=126.078 CHECKS=406777	SAT TT=39.588 ASSIGNMENTS=95	SAT TT=37.704 ASSIGNMENTS=95	SAT TT=3.424 CHECKS=6915540 NODES=1002	? (TO) TT=1800.02	? (TO) TT=1800.01	SAT TT=0.598 ASSIGNMENTS=632 CHECKS=159340	SAT TT=0.602 ASSIGNMENTS=632 CHECKS=159340	SAT TT=43.909	SAT TT=78.16	SAT TT=0.488 ASSIGNMENTS=444 CHECKS=104833	SAT TT=1.727 ASSIGNMENTS=4785 CHECKS=686225	SAT TT=12.641	SAT TT=2.997 ASSIGNMENTS=6328 CHECKS=796250	SAT TT=0.591 ASSIGNMENTS=632 CHECKS=159340	SAT TT=14.659	SAT TT=10.146 ASSIGNMENTS=851 CHECKS=4037240	SAT TT=405.921	SAT TT=144.812
csp/tightness0.9/ normalized-rand-2-40-180-84-900-72_ext.xml	SAT TT=0.831	SAT TT=10.651 CHECKS=149932000 NODES=17291	SAT TT=10.945 CHECKS=151028000 NODES=17347	SAT TT=21.182	SAT TT=21.831 CHECKS=40528	SAT TT=104.832 CHECKS=336216	SAT TT=44.318 ASSIGNMENTS=586	SAT TT=44.663 ASSIGNMENTS=586	SAT TT=4.668 CHECKS=17744400 NODES=2456	? (TO) TT=1800.05	? (TO) TT=1800.04	SAT TT=18.339 ASSIGNMENTS=17291 CHECKS=149932000	SAT TT=18.504 ASSIGNMENTS=17291 CHECKS=149932000	SAT TT=44.847	SAT TT=209.094	SAT TT=2.113 ASSIGNMENTS=3974 CHECKS=912340	SAT TT=1.565 ASSIGNMENTS=4135 CHECKS=567728	SAT TT=472.672	SAT TT=0.831 ASSIGNMENTS=1225 CHECKS=153476	SAT TT=2.238 ASSIGNMENTS=4312 CHECKS=988044	SAT TT=149.296	SAT TT=11.994 ASSIGNMENTS=1149 CHECKS=6836740	SAT TT=456.133	SAT TT=106.891
csp/tightness0.9/ normalized-rand-2-40-180-84-900-76_ext.xml	UNSAT TT=4.922	UNSAT TT=45.369 CHECKS=732269000 NODES=66287	UNSAT TT=45.16 CHECKS=730616000 NODES=66040	? (TO) TT=1800.06	UNSAT TT=1785.46 CHECKS=3900550	UNSAT TT=1571.03 CHECKS=3573340	UNSAT TT=71.816 ASSIGNMENTS=1970	UNSAT TT=71.431 ASSIGNMENTS=1970	UNSAT TT=10.096 CHECKS=72080000 NODES=5987	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=52.58 ASSIGNMENTS=66287 CHECKS=732269000	UNSAT TT=52.547 ASSIGNMENTS=66287 CHECKS=732269000	UNSAT TT=166.332	UNSAT TT=971.285	UNSAT TT=5.579 ASSIGNMENTS=6935 CHECKS=2066750	UNSAT TT=4.922 ASSIGNMENTS=9838 CHECKS=2101120	UNSAT TT=202.769	UNSAT TT=6.384 ASSIGNMENTS=11976 CHECKS=2275050	UNSAT TT=6.034 ASSIGNMENTS=8098 CHECKS=2430060	UNSAT TT=331.78	UNSAT TT=112.657 ASSIGNMENTS=8444 CHECKS=127594000	UNSAT TT=1426.5	UNSAT TT=1114.87
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	Concrete + CSP4J - WMC Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/tightness0.9/ normalized-rand-2-40-180-84-900-79_ext.xml	UNSAT TT=2.754	UNSAT TT=159.681 CHECKS=2659890000 NODES=182861	UNSAT TT=146.574 CHECKS=2640610000 NODES=181325	UNSAT TT=65.079	UNSAT TT=1291.62 CHECKS=2549020	UNSAT TT=648.633 CHECKS=1461950	UNSAT TT=58.123 ASSIGNMENTS=676	UNSAT TT=57.528 ASSIGNMENTS=676	UNSAT TT=9.505 CHECKS=72990000 NODES=5722	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=172.08 ASSIGNMENTS=182861 CHECKS=2659890000	UNSAT TT=167.602 ASSIGNMENTS=182861 CHECKS=2659890000	UNSAT TT=72.321	UNSAT TT=68.279	UNSAT TT=2.901 ASSIGNMENTS=3557 CHECKS=1078670	UNSAT TT=3.145 ASSIGNMENTS=5835 CHECKS=1153620	UNSAT TT=183.526	UNSAT TT=4.618 ASSIGNMENTS=8796 CHECKS=1497970	UNSAT TT=2.754 ASSIGNMENTS=3740 CHECKS=1108640	UNSAT TT=36.423	UNSAT TT=96.746 ASSIGNMENTS=6289 CHECKS=99246700	UNSAT TT=517.985	UNSAT TT=307.51
csp/tightness0.9/ normalized-rand-2-40-180-84-900-80_ext.xml	UNSAT TT=3.974	UNSAT TT=50.224 CHECKS=855439000 NODES=69668	UNSAT TT=49.92 CHECKS=857833000 NODES=69877	UNSAT TT=574.272	UNSAT TT=1271.64 CHECKS=2729500	UNSAT TT=1284.72 CHECKS=2932790	UNSAT TT=58.206 ASSIGNMENTS=1354	UNSAT TT=63.269 ASSIGNMENTS=1354	UNSAT TT=9.476 CHECKS=68278100 NODES=6301	? (TO) TT=1800.07	? (TO) TT=1800	UNSAT TT=57.172 ASSIGNMENTS=69668 CHECKS=855439000	UNSAT TT=59.386 ASSIGNMENTS=69668 CHECKS=855439000	UNSAT TT=96.681	UNSAT TT=377.746	UNSAT TT=4.328 ASSIGNMENTS=6009 CHECKS=1733950	UNSAT TT=3.974 ASSIGNMENTS=7598 CHECKS=1575290	UNSAT TT=110.914	UNSAT TT=5.734 ASSIGNMENTS=10520 CHECKS=1903800	UNSAT TT=4.951 ASSIGNMENTS=6148 CHECKS=1777340	UNSAT TT=58.56	UNSAT TT=103.494 ASSIGNMENTS=7768 CHECKS=102430000	UNSAT TT=374.199	UNSAT TT=430.285
csp/tightness0.9/ normalized-rand-2-40-180-84-900-8_ext.xml	SAT TT=0.737	SAT TT=1.159 CHECKS=338410 NODES=81	SAT TT=1.203 CHECKS=815258 NODES=77	SAT TT=8.941	SAT TT=32.047 CHECKS=73738	SAT TT=423.407 CHECKS=1367890	SAT TT=37.778 ASSIGNMENTS=68	SAT TT=40.417 ASSIGNMENTS=68	SAT TT=3.321 CHECKS=6476090 NODES=964	? (TO) TT=1800.01	? (TO) TT=1800	SAT TT=0.754 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=0.737 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=41.482	SAT TT=40.945	SAT TT=0.771 ASSIGNMENTS=1172 CHECKS=236580	SAT TT=1.306 ASSIGNMENTS=3797 CHECKS=484710	SAT TT=79.696	SAT TT=3.405 ASSIGNMENTS=7602 CHECKS=1052690	SAT TT=0.785 ASSIGNMENTS=1201 CHECKS=241911	SAT TT=35.639	SAT TT=6.735 ASSIGNMENTS=910 CHECKS=6642070	SAT TT=12.157	SAT TT=304.633
csp/tightness0.9/ normalized-rand-2-40-180-84-900-91_ext.xml	SAT TT=0.354	SAT TT=2.726 CHECKS=26497700 NODES=2486	SAT TT=2.908 CHECKS=26916900 NODES=2459	SAT TT=16.584	SAT TT=13.865 CHECKS=19349	SAT TT=18.032 CHECKS=22827	SAT TT=41.069 ASSIGNMENTS=90	SAT TT=38.181 ASSIGNMENTS=90	SAT TT=2.587 CHECKS=284009 NODES=63	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=0.363 ASSIGNMENTS=163 CHECKS=34597	SAT TT=0.403 ASSIGNMENTS=163 CHECKS=34597	SAT TT=36.486	SAT TT=25.449	SAT TT=1.818 ASSIGNMENTS=3015 CHECKS=690912	SAT TT=1.856 ASSIGNMENTS=4887 CHECKS=747376	SAT TT=34.495	SAT TT=3.774 ASSIGNMENTS=7696 CHECKS=1126120	SAT TT=0.354 ASSIGNMENTS=163 CHECKS=34597	SAT TT=54.833	SAT TT=2.462 ASSIGNMENTS=254 CHECKS=1353100	SAT TT=13.283	SAT TT=276.205
csp/tightness0.9/ normalized-rand-2-40-180-84-900-93_ext.xml	UNSAT TT=0.849	UNSAT TT=15.801 CHECKS=255638000 NODES=23545	UNSAT TT=15.903 CHECKS=257350000 NODES=23599	UNSAT TT=540.106	UNSAT TT=296.629 CHECKS=424731	UNSAT TT=274.433 CHECKS=422385	UNSAT TT=47.431 ASSIGNMENTS=116	UNSAT TT=47.369 ASSIGNMENTS=116	UNSAT TT=3.686 CHECKS=10178300 NODES=957	? (TO) TT=1800	? (TO) TT=1800.02	UNSAT TT=0.955 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=0.982 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=42.265	UNSAT TT=26.639	UNSAT TT=0.849 ASSIGNMENTS=1028 CHECKS=203804	UNSAT TT=1.779 ASSIGNMENTS=4400 CHECKS=541788	UNSAT TT=20.28	UNSAT TT=3.883 ASSIGNMENTS=7445 CHECKS=962060	UNSAT TT=0.945 ASSIGNMENTS=899 CHECKS=206021	UNSAT TT=16.068	UNSAT TT=13.337 ASSIGNMENTS=837 CHECKS=13493000	UNSAT TT=20.84	UNSAT TT=26.419

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	Concrete + CPS4J 2008-05-30	Concrete + CSP4J - Tabu Engine 2008-05-30	cpHydra k_10	cpHydra k_40	galac E	galac M	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	spider 2008-06-14	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	303	303	276	218	232	289	288	292	217	308	302	194	191	316	315	222	312	317	186	271	218	211
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	303	303	276	218	232	289	288	292	217	308	302	194	191	316	315	222	312	317	186	271	218	211
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	6	12	44	0	0	0	0	2	63	5	5	1	0	47	58	0	49	52	0	3	1	2
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0