CSP 2008 Competition: results by benchmark

Results by benchmark for category global constraints (GLOBAL), subcategory boolean problems

This page displays the results of the different solvers for each benchmark for category global constraints (GLOBAL), subcategory boolean problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
cpHydra k_10
cpHydra k_40
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-43s-smv.xml	UNSAT TT=111.955	? TT=0.929	? TT=0.8	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	? (problem) TT=1.593	? (problem) TT=3.653	? (TO) TT=1800.09	? (problem) TT=1474.75	? (problem) TT=1.591	? TT=1.845	UNSAT TT=111.955	UNSAT TT=238.32
csp/pseudoGLB/ normalized-army12-21bt.xml		? TT=0.621	? TT=0.65	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? TT=0.818	? (TO) TT=1800.06	? (TO) TT=1800.14
csp/pseudoGLB/ normalized-army12-21ls.xml		? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=0.819	? (TO) TT=1800.01	? (TO) TT=1800.1
csp/pseudoGLB/ normalized-army13-24ls.xml		? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=0.828	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/pseudoGLB/ normalized-army9-12ls.xml	SAT TT=2.98	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=955.134	SAT TT=1169.67 CHECKS=451769000	? (TO) TT=1800.06	SAT TT=1739.74 ASSIGNMENTS=11510000	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=142.661	SAT TT=4.743 ASSIGNMENTS=15281 CHECKS=3547570	? (TO) TT=1800.03	? TT=0.77	SAT TT=23.531	SAT TT=2.98
csp/pseudoGLB/ normalized-cache-inv10-ucl.xml	UNSAT TT=5.679	? TT=0.936	? TT=0.974	UNSAT TT=10.151	UNSAT TT=16.192 CHECKS=1935330	UNSAT TT=16.564 CHECKS=2361740	UNSAT TT=10.917 ASSIGNMENTS=0	UNSAT TT=14.308 ASSIGNMENTS=0	? (problem) TT=18.937	UNSAT TT=29.304 ASSIGNMENTS=0	? (problem) TT=94.054	? (problem) TT=226.705	UNSAT TT=5.679	? (problem) TT=458.7	? (problem) TT=10.137	? TT=2.548	UNSAT TT=7.162	UNSAT TT=7.04
csp/pseudoGLB/ normalized-cache-inv12-ucl.xml	UNSAT TT=24.393	? TT=1.61	? TT=1.54	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.2	? (TO) TT=1800.13	? (problem) TT=31.146	? (TO) TT=1800.08	? (problem) TT=99.343	? (problem) TT=114.222	UNSAT TT=1514.22	? (TO) TT=1800.1	? (problem) TT=16.763	? TT=3.667	UNSAT TT=24.393	UNSAT TT=25.602
csp/pseudoGLB/ normalized-chnl10-15-pb-cnf-cr.xml	UNSAT TT=0.074	UNSAT TT=1.9 CHECKS=68173 NODES=19735	UNSAT TT=2.331 CHECKS=108997 NODES=25607	? (TO) TT=1800.1	UNSAT TT=0.074 CHECKS=7852	UNSAT TT=0.104 CHECKS=17083	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=50.777	? (TO) TT=1800.09	? (TO) TT=1800.08	? TT=0.804	UNSAT TT=16.295	UNSAT TT=6.202
csp/pseudoGLB/ normalized-chnl10-20-pb-cnf-cr.xml	UNSAT TT=0.105	UNSAT TT=3.153 CHECKS=75102 NODES=35388	UNSAT TT=3.496 CHECKS=92593 NODES=39340	? (TO) TT=1800.02	UNSAT TT=0.106 CHECKS=10219	UNSAT TT=0.105 CHECKS=8507	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	UNSAT TT=61.773	? (TO) TT=1800.1	? (TO) TT=1800.09	? TT=0.763	UNSAT TT=20.808	UNSAT TT=7.023
csp/pseudoGLB/ normalized-chnl15-20-pb-cnf-cr.xml	UNSAT TT=0.391	UNSAT TT=60.912 CHECKS=1960670 NODES=769275	UNSAT TT=140.354 CHECKS=6238600 NODES=1722070	? (TO) TT=1800.02	UNSAT TT=0.462 CHECKS=85632	UNSAT TT=0.391 CHECKS=66820	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.04	? TT=0.819	? (TO) TT=1800.1	? (TO) TT=1800.11
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-chnl15-25-pb-cnf-cr.xml	UNSAT TT=0.63	UNSAT TT=123.762 CHECKS=3394620 NODES=1394070	UNSAT TT=223.337 CHECKS=6403000 NODES=2443880	? (TO) TT=1800.1	UNSAT TT=0.673 CHECKS=124985	UNSAT TT=0.63 CHECKS=121942	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=0.877	? (TO) TT=1800.12	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-chnl35-40-pb-cnf-cr.xml	UNSAT TT=14.277	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.08	UNSAT TT=14.277 CHECKS=1842180	UNSAT TT=28.227 CHECKS=2505810	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.03	? TT=1.597	? (TO) TT=1800.09	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl35-45-pb-cnf-cr.xml	UNSAT TT=19.312	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.04	UNSAT TT=19.312 CHECKS=2267900	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.06	? TT=1.669	? (TO) TT=1800.1	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-chnl40-45-pb-cnf-cr.xml	UNSAT TT=27.412	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	UNSAT TT=27.412 CHECKS=3209810	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? TT=1.858	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl40-50-pb-cnf-cr.xml		? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? TT=1.939	? (TO) TT=1800.06	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-chnl50-60-pb-cnf-cr.xml		? (TO) TT=1800.1	? (TO) TT=1800.2	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=2.53	? (TO) TT=1800.03	? (TO) TT=1800.06
csp/pseudoGLB/ normalized-dbst-v30-e350-d15-mw10-3.PB06.xml	SAT TT=32.668	? (MO) TT=21.624	? (MO) TT=20.626	SAT TT=882.268	? TT=24.447	? TT=22.253	? (MO) TT=56.845	? (MO) TT=72.231	? (problem) TT=126.527	SAT TT=1102.15 ASSIGNMENTS=761 CHECKS=2641290	SAT TT=69.859 ASSIGNMENTS=1143 CHECKS=26800700	SAT TT=364.402 ASSIGNMENTS=144336 CHECKS=165586000	? (MO) TT=215.65	SAT TT=96.513 ASSIGNMENTS=3292 CHECKS=52623000	SAT TT=32.668 ASSIGNMENTS=761 CHECKS=2641290	? TT=1.082	? (MO) TT=189.01	? (MO) TT=361.134
csp/pseudoGLB/ normalized-elf-rf7-ucl.xml	UNSAT TT=1.461	? TT=0.704	? TT=0.832	? (TO) TT=1800.02	UNSAT TT=2.549 CHECKS=1589780	UNSAT TT=2.456 CHECKS=1551410	UNSAT TT=2.745 ASSIGNMENTS=760	UNSAT TT=2.497 ASSIGNMENTS=46	UNSAT TT=8.874 ASSIGNMENTS=760	UNSAT TT=9.328 ASSIGNMENTS=760	? (problem) TT=0.248	? (problem) TT=1.442	UNSAT TT=1.461	? (problem) TT=396.465	? (problem) TT=0.255	? TT=1.034	UNSAT TT=2.755	UNSAT TT=4.226
csp/pseudoGLB/ normalized-fpga10-10-sat-pb-cnf-cr.xml	SAT TT=0.064	SAT TT=10.956 CHECKS=2516440 NODES=298884	SAT TT=7.515 CHECKS=2083110 NODES=174218	SAT TT=1794.12	SAT TT=0.129 CHECKS=29530	SAT TT=0.124 CHECKS=27874	SAT TT=4.62 ASSIGNMENTS=63895	SAT TT=0.638 ASSIGNMENTS=66	SAT TT=62.499 ASSIGNMENTS=1174710 CHECKS=56932200	SAT TT=63.247 ASSIGNMENTS=1174710 CHECKS=56932200	? (TO) TT=1800.06	SAT TT=494.505 ASSIGNMENTS=9836430 CHECKS=515575000	SAT TT=19.716	SAT TT=0.064 ASSIGNMENTS=1110 CHECKS=38055	SAT TT=50.565 ASSIGNMENTS=1174710 CHECKS=56932200	? TT=0.728	SAT TT=1.125	SAT TT=1.177
csp/pseudoGLB/ normalized-fpga11-9-sat-pb-cnf-cr.xml	SAT TT=0.621	SAT TT=95.93 CHECKS=31372800 NODES=2720840	SAT TT=71.956 CHECKS=23961200 NODES=2007370	SAT TT=893.445	SAT TT=0.621 CHECKS=267981	SAT TT=0.773 CHECKS=347038	SAT TT=9.134 ASSIGNMENTS=135001	SAT TT=1.547 ASSIGNMENTS=5805	SAT TT=519.224 ASSIGNMENTS=12547100 CHECKS=538253000	SAT TT=499.08 ASSIGNMENTS=12547100 CHECKS=538253000	? (TO) TT=1800.05	SAT TT=50.819 ASSIGNMENTS=1146160 CHECKS=54569500	SAT TT=1627.88	SAT TT=2.363 ASSIGNMENTS=20286 CHECKS=2193560	SAT TT=511.315 ASSIGNMENTS=12547100 CHECKS=538253000	? TT=0.753	SAT TT=0.95	SAT TT=0.971
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-fpga13-13-sat-pb-cnf-cr.xml	SAT TT=0.477	? (TO) TT=1800.15	SAT TT=1294.69 CHECKS=405977000 NODES=26011500	? (TO) TT=1800.1	SAT TT=0.519 CHECKS=142055	SAT TT=0.477 CHECKS=140126	SAT TT=51.261 ASSIGNMENTS=697509	SAT TT=0.763 ASSIGNMENTS=115	? (TO) TT=1800.05	SAT TT=1717.79 ASSIGNMENTS=697509	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.08	SAT TT=0.562 ASSIGNMENTS=4592 CHECKS=314745	? (TO) TT=1800.1	? TT=0.721	SAT TT=9.116	SAT TT=1.284
csp/pseudoGLB/ normalized-fpga14-12-sat-pb-cnf-cr.xml	SAT TT=0.826	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT TT=898.458	SAT TT=1.024 CHECKS=341240	SAT TT=17.139 CHECKS=7053220	SAT TT=181.628 ASSIGNMENTS=2638800	SAT TT=0.826 ASSIGNMENTS=580	SAT TT=1064.92 ASSIGNMENTS=17986500 CHECKS=970322000	SAT TT=1071.92 ASSIGNMENTS=17986500 CHECKS=970322000	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.11	SAT TT=1353.62 ASSIGNMENTS=6150600 CHECKS=1158530000	SAT TT=1057.32 ASSIGNMENTS=17986500 CHECKS=970322000	? TT=0.785	? (TO) TT=1800.1	SAT TT=1.311
csp/pseudoGLB/ normalized-fpga14-13-sat-pb-cnf-cr.xml	SAT TT=0.66	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=1786.83	SAT TT=0.789 CHECKS=232522	SAT TT=0.66 CHECKS=184982	SAT TT=577.847 ASSIGNMENTS=7181960	SAT TT=0.97 ASSIGNMENTS=134	SAT TT=1768.25 ASSIGNMENTS=25845000 CHECKS=1496540000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=316.671 ASSIGNMENTS=2019240 CHECKS=185447000	? (TO) TT=1800.05	? TT=0.799	SAT TT=13.375	SAT TT=1.381
csp/pseudoGLB/ normalized-fpga14-14-sat-pb-cnf-cr.xml	SAT TT=0.702	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.06	SAT TT=0.74 CHECKS=199492	SAT TT=0.702 CHECKS=186245	SAT TT=493.404 ASSIGNMENTS=6039580	SAT TT=0.979 ASSIGNMENTS=134	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=17.844 ASSIGNMENTS=105858 CHECKS=8282440	? (TO) TT=1800.03	? TT=0.787	SAT TT=18.902	SAT TT=1.545
csp/pseudoGLB/ normalized-fpga20-20-sat-pb-cnf-cr.xml	SAT TT=1.067	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=6.187 CHECKS=1542100	SAT TT=898.037 CHECKS=178471000	? (TO) TT=1800.06	SAT TT=1.067 ASSIGNMENTS=281	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? TT=0.838	? (TO) TT=1800.04	SAT TT=2.656
csp/pseudoGLB/ normalized-fpga25-24-sat-pb-cnf-cr.xml	SAT TT=3.997	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=24.412 CHECKS=5427660	? (TO) TT=1800.1	? (TO) TT=1800.05	SAT TT=11.213 ASSIGNMENTS=33636	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.1	? TT=0.938	? (TO) TT=1800	SAT TT=3.997
csp/pseudoGLB/ normalized-fpga25-25-sat-pb-cnf-cr.xml	SAT TT=1.421	? (TO) TT=1800.19	? (TO) TT=1800.16	SAT TT=1344.02	SAT TT=23.048 CHECKS=5355780	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=1.421 ASSIGNMENTS=445	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.03	? TT=0.92	? (TO) TT=1800.08	SAT TT=5.048
csp/pseudoGLB/ normalized-fpga30-30-sat-pb-cnf-cr.xml	SAT TT=2.156	? (TO) TT=1800.12	? (TO) TT=1800.18	SAT TT=1345.22	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT TT=2.156 ASSIGNMENTS=646	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.08	? TT=1.023	? (TO) TT=1800.06	SAT TT=6.45
csp/pseudoGLB/ normalized-fpga35-34-sat-pb-cnf-cr.xml	SAT TT=10.776	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=81.418 ASSIGNMENTS=135627	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.01	? TT=1.264	? (TO) TT=1800.07	SAT TT=10.776
csp/pseudoGLB/ normalized-ooo-rf8-ucl.xml	UNSAT TT=8.423	? TT=0.918	? TT=0.872	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.04	? (TO) TT=1800.02	? (problem) TT=1.535	? (problem) TT=12.738	UNSAT TT=483.595	? (problem) TT=170.813	? (problem) TT=1.555	? TT=2.403	UNSAT TT=8.423	UNSAT TT=14.45
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-ooo-tag12-ucl.xml	UNSAT TT=45.558	? TT=1.408	? TT=1.49	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.2	? (TO) TT=1800.01	? (TO) TT=1800.06	? (problem) TT=4.722	? (problem) TT=34.524	? (TO) TT=1800.06	? (problem) TT=1760.55	? (problem) TT=4.759	? TT=3.558	UNSAT TT=45.558	UNSAT TT=55.36
csp/pseudoGLB/ normalized-pigeon-cardinality-105-100.xml		? (TO) TT=1800.15	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.15	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.11	? TT=3.219	? (TO) TT=1800.03	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-pigeon-cardinality-15-10.xml	UNSAT TT=0.05	UNSAT TT=1.32 CHECKS=57416 NODES=15550	UNSAT TT=1.427 CHECKS=46460 NODES=18649	UNSAT TT=464.795	UNSAT TT=0.05 CHECKS=9362	UNSAT TT=0.055 CHECKS=10353	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.04	UNSAT TT=33.916	? (TO) TT=1800.07	? (TO) TT=1800.05	? TT=0.704	UNSAT TT=81.191	UNSAT TT=361.502
csp/pseudoGLB/ normalized-pigeon-cardinality-25-20.xml	UNSAT TT=0.765	UNSAT TT=1371.69 CHECKS=99863900 NODES=22092500	? (TO) TT=1800.17	? (TO) TT=1800.04	UNSAT TT=0.765 CHECKS=137091	UNSAT TT=0.807 CHECKS=145695	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=0.826	? (TO) TT=1800.11	? (TO) TT=1800.07
csp/pseudoGLB/ normalized-pigeon-cardinality-55-50.xml		? (TO) TT=1800.07	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=1.504	? (TO) TT=1800.02	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-pigeon-cardinality-71-70.xml		? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? TT=2.257	? (TO) TT=1800.03	? (TO) TT=1800.09
csp/pseudoGLB/ normalized-pigeon-cardinality-75-70.xml		? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.01	? TT=2.517	? (TO) TT=1800.07	? (TO) TT=1800.01
csp/pseudoGLB/ normalized-pigeon-cardinality-95-90.xml		? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=2.502	? (TO) TT=1800.02	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-pigeon-clauses-45-40.xml		? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.09	? TT=1.291	? (TO) TT=1800.09	? (TO) TT=1800.07
csp/pseudoGLB/ normalized-pigeon-clauses-65-60.xml		? (MO) TT=22.846	? (MO) TT=22.743	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.41	? (TO) TT=1800.3	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? TT=2.079	? (TO) TT=1800.04	? (TO) TT=1800.04
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-pigeon-clauses-71-70.xml		? (MO) TT=11.702	? (MO) TT=9.477	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.25	? (TO) TT=1800.7	? (MO) TT=1594.71	? (MO) TT=1101.75	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.14	? (TO) TT=1800.09	? TT=2.291	? (TO) TT=1800.08	? (TO) TT=1800.09
csp/pseudoGLB/ normalized-pigeon-clauses-91-90.xml		? (MO) TT=18.266	? (MO) TT=20.523	? (TO) TT=1800.09	? TT=23.043	? TT=22.428	? (problem) TT=291.593	? (MO) TT=76.881	? (TO) TT=1800.03	? (problem) TT=1539.62	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.19	? (TO) TT=1800.1	? TT=2.494	? (TO) TT=1800.05	? (TO) TT=1800.05
csp/pseudoGLB/ normalized-pigeon-clauses-95-90.xml		? (MO) TT=21.777	? (MO) TT=21.308	? (TO) TT=1800.06	? TT=24.517	? TT=22.257	? (problem) TT=265.636	? (problem) TT=270.813	? (problem) TT=1591.42	? (problem) TT=1087.55	? (TO) TT=1800.15	? (TO) TT=1800.13	? (exit code) TT=82.039	? (TO) TT=1800.15	? (TO) TT=1800.12	? TT=2.491	? (TO) TT=1800.08	? (MO) TT=6.298
csp/pseudoGLB/ normalized-ppp:1-9-16-19.xml	SAT TT=1429.89	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.05	? (TO) TT=1800.11	? (exit code) TT=15.662	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=1.975	SAT TT=1429.89	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-reduced-cuww2.xml	SAT TT=0.01	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=0.038	SAT TT=3.747 CHECKS=189255	SAT TT=5.059 CHECKS=270004	SAT TT=0.877 ASSIGNMENTS=6983	SAT TT=0.441 ASSIGNMENTS=51	SAT TT=0.127 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.117 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.117 ASSIGNMENTS=1525 CHECKS=16736	SAT TT=0.019 ASSIGNMENTS=424 CHECKS=1793	SAT TT=0.347	SAT TT=0.016 ASSIGNMENTS=202 CHECKS=1272	SAT TT=0.01 ASSIGNMENTS=57 CHECKS=203	? TT=0.654	? TT=1478.16	? TT=466.925
csp/pseudoGLB/ normalized-reduced-prob10.xml	SAT TT=0.015	? (TO) TT=1800.07	? (TO) TT=1800.11	SAT TT=0.038	SAT TT=0.084 CHECKS=2024	SAT TT=0.085 CHECKS=2008	SAT TT=0.426 ASSIGNMENTS=132	SAT TT=0.474 ASSIGNMENTS=171	SAT TT=0.027 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.026 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.015 ASSIGNMENTS=131 CHECKS=728	SAT TT=0.018 ASSIGNMENTS=223 CHECKS=815	SAT TT=0.328	SAT TT=0.017 ASSIGNMENTS=175 CHECKS=1035	SAT TT=0.024 ASSIGNMENTS=296 CHECKS=1834	? TT=0.697	? TT=895.488	? TT=912.307
csp/pseudoGLB/ normalized-reduced-prob1.xml	SAT TT=0.017	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=0.034	SAT TT=0.107 CHECKS=3642	SAT TT=0.106 CHECKS=3622	SAT TT=0.469 ASSIGNMENTS=197	SAT TT=0.517 ASSIGNMENTS=198	SAT TT=0.032 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.031 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.02 ASSIGNMENTS=197 CHECKS=1549	SAT TT=0.021 ASSIGNMENTS=377 CHECKS=1658	SAT TT=0.32	SAT TT=0.033 ASSIGNMENTS=468 CHECKS=3104	SAT TT=0.017 ASSIGNMENTS=258 CHECKS=1304	? TT=0.704	? TT=801.198	? TT=787.216
csp/pseudoGLB/ normalized-reduced-prob3.xml	SAT TT=0.019	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=0.035	SAT TT=0.231 CHECKS=14987	SAT TT=0.228 CHECKS=15344	SAT TT=0.519 ASSIGNMENTS=1451	SAT TT=0.656 ASSIGNMENTS=1904	SAT TT=0.031 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.032 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.019 ASSIGNMENTS=301 CHECKS=2409	SAT TT=0.133 ASSIGNMENTS=5835 CHECKS=28841	SAT TT=0.299	SAT TT=0.027 ASSIGNMENTS=610 CHECKS=4245	SAT TT=0.067 ASSIGNMENTS=1650 CHECKS=12596	? TT=0.702	? TT=241.347	? TT=243.218
csp/pseudoGLB/ normalized-reduced-prob4.xml	SAT TT=0.015	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=0.035	SAT TT=0.13 CHECKS=4198	SAT TT=0.232 CHECKS=7880	SAT TT=0.474 ASSIGNMENTS=220	SAT TT=0.555 ASSIGNMENTS=101	SAT TT=0.034 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.031 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.02 ASSIGNMENTS=220 CHECKS=1808	SAT TT=0.029 ASSIGNMENTS=691 CHECKS=3029	SAT TT=0.363	SAT TT=0.029 ASSIGNMENTS=345 CHECKS=2850	SAT TT=0.015 ASSIGNMENTS=123 CHECKS=791	? TT=0.683	? TT=332.609	? TT=327.75
csp/pseudoGLB/ normalized-robin10.xml	SAT TT=7.256	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=24.253 ASSIGNMENTS=60110	SAT TT=10.722 ASSIGNMENTS=8653	SAT TT=27.081 ASSIGNMENTS=11347 CHECKS=4560900	SAT TT=27.189 ASSIGNMENTS=11347 CHECKS=4560900	SAT TT=29.481 ASSIGNMENTS=15635 CHECKS=7028610	SAT TT=844.801 ASSIGNMENTS=568788 CHECKS=217775000	SAT TT=1532.03	SAT TT=1397.68 ASSIGNMENTS=819382 CHECKS=346444000	SAT TT=19.454 ASSIGNMENTS=11347 CHECKS=4560900	? TT=1.235	SAT TT=7.256	SAT TT=47.115
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-robin12.xml	SAT TT=53.734	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.05	SAT TT=280.36 ASSIGNMENTS=399560	? (TO) TT=1800.14	? (TO) TT=1800.01	SAT TT=1189.42 ASSIGNMENTS=399560	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.06	? TT=1.929	SAT TT=53.734	SAT TT=543.542
csp/pseudoGLB/ normalized-robin16.xml		? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1819.67	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=3.264	? (TO) TT=1800.07	? (TO) TT=1800.04
csp/pseudoGLB/ normalized-t2001-13queen13-1110966688.xml	UNSAT TT=2.307	UNSAT TT=1395.12 CHECKS=292605000 NODES=42673900	UNSAT TT=229.203 CHECKS=51231100 NODES=7317180	UNSAT TT=9.488	UNSAT TT=290.62 CHECKS=22616200	UNSAT TT=300.481 CHECKS=21755200	UNSAT TT=13.914 ASSIGNMENTS=117121	UNSAT TT=28.806 ASSIGNMENTS=251948	UNSAT TT=85.92 ASSIGNMENTS=275090 CHECKS=25961000	UNSAT TT=1311.56 ASSIGNMENTS=42673900 CHECKS=292605000	UNSAT TT=30.105 ASSIGNMENTS=109917 CHECKS=9123780	UNSAT TT=22.303 ASSIGNMENTS=98767 CHECKS=7364380	UNSAT TT=2.307	UNSAT TT=58.422 ASSIGNMENTS=213355 CHECKS=16719700	UNSAT TT=79.272 ASSIGNMENTS=275090 CHECKS=25961000	? TT=0.723	UNSAT TT=24.139	UNSAT TT=30.996
csp/pseudoGLB/ normalized-t2001-13queen13-1110967523.xml	UNSAT TT=3.314	UNSAT TT=465.664 CHECKS=84608400 NODES=15260200	UNSAT TT=1083.03 CHECKS=230575000 NODES=34998500	UNSAT TT=11.908	UNSAT TT=298.003 CHECKS=22902500	UNSAT TT=145.048 CHECKS=9546150	UNSAT TT=44.334 ASSIGNMENTS=441003	UNSAT TT=40.513 ASSIGNMENTS=335533	UNSAT TT=156.586 ASSIGNMENTS=486776 CHECKS=45075400	UNSAT TT=506.596 ASSIGNMENTS=15260200 CHECKS=84608400	UNSAT TT=47.977 ASSIGNMENTS=194708 CHECKS=14772000	UNSAT TT=41.11 ASSIGNMENTS=179201 CHECKS=13735900	UNSAT TT=3.314	UNSAT TT=137.075 ASSIGNMENTS=516401 CHECKS=39724300	UNSAT TT=147.742 ASSIGNMENTS=486776 CHECKS=45075400	? TT=0.744	UNSAT TT=48.603	UNSAT TT=63.647
csp/pseudoGLB/ normalized-t2001-13queen13-1110968898.xml	UNSAT TT=2.48	UNSAT TT=807.428 CHECKS=141797000 NODES=26679200	UNSAT TT=304.532 CHECKS=54367000 NODES=9896390	UNSAT TT=11.469	UNSAT TT=255.713 CHECKS=21956900	UNSAT TT=204.766 CHECKS=14577300	UNSAT TT=25.927 ASSIGNMENTS=222762	UNSAT TT=40.825 ASSIGNMENTS=327491	UNSAT TT=98.231 ASSIGNMENTS=289749 CHECKS=27446900	UNSAT TT=823.616 ASSIGNMENTS=26679200 CHECKS=141797000	UNSAT TT=43.5 ASSIGNMENTS=168219 CHECKS=13152700	UNSAT TT=33.372 ASSIGNMENTS=139025 CHECKS=10895000	UNSAT TT=2.48	UNSAT TT=87.122 ASSIGNMENTS=373447 CHECKS=26537900	UNSAT TT=90.092 ASSIGNMENTS=289749 CHECKS=27446900	? TT=0.746	UNSAT TT=38.77	UNSAT TT=43.165
csp/pseudoGLB/ normalized-t2001-13queen13-1110969577.xml	UNSAT TT=2.413	UNSAT TT=662.843 CHECKS=119791000 NODES=19731700	UNSAT TT=758.389 CHECKS=153063000 NODES=22348100	UNSAT TT=7.672	UNSAT TT=265.654 CHECKS=21691800	UNSAT TT=136.159 CHECKS=8752900	UNSAT TT=26.754 ASSIGNMENTS=226749	UNSAT TT=30.924 ASSIGNMENTS=243695	UNSAT TT=93.765 ASSIGNMENTS=286366 CHECKS=25823600	UNSAT TT=625.594 ASSIGNMENTS=19731700 CHECKS=119791000	UNSAT TT=22.554 ASSIGNMENTS=82058 CHECKS=6767800	UNSAT TT=21.953 ASSIGNMENTS=92616 CHECKS=6742640	UNSAT TT=2.413	UNSAT TT=95.782 ASSIGNMENTS=361527 CHECKS=27320100	UNSAT TT=78.812 ASSIGNMENTS=286366 CHECKS=25823600	? TT=0.73	UNSAT TT=30.983	UNSAT TT=37.033
csp/pseudoGLB/ normalized-t2001-13queen13-1110970631.xml	UNSAT TT=2.765	UNSAT TT=1101.25 CHECKS=233661000 NODES=33202400	UNSAT TT=227.236 CHECKS=41533900 NODES=6734240	UNSAT TT=8.462	UNSAT TT=332.019 CHECKS=24128200	UNSAT TT=285.776 CHECKS=17160200	UNSAT TT=33.716 ASSIGNMENTS=296808	UNSAT TT=28.484 ASSIGNMENTS=244600	UNSAT TT=112.491 ASSIGNMENTS=387780 CHECKS=32023400	UNSAT TT=1028.66 ASSIGNMENTS=33202400 CHECKS=233661000	UNSAT TT=39.239 ASSIGNMENTS=167989 CHECKS=11979000	UNSAT TT=34.286 ASSIGNMENTS=155012 CHECKS=10595100	UNSAT TT=2.765	UNSAT TT=120.876 ASSIGNMENTS=490107 CHECKS=34302200	UNSAT TT=103.883 ASSIGNMENTS=387780 CHECKS=32023400	? TT=0.712	UNSAT TT=25.678	UNSAT TT=32.205
csp/pseudoGLB/ normalized-t2001-13queen13-1110972763.xml	UNSAT TT=3.706	UNSAT TT=946.865 CHECKS=170204000 NODES=28873700	UNSAT TT=904.206 CHECKS=177285000 NODES=28596300	UNSAT TT=11.471	UNSAT TT=217.396 CHECKS=14979000	UNSAT TT=497.301 CHECKS=38525800	UNSAT TT=13.869 ASSIGNMENTS=118057	UNSAT TT=30.018 ASSIGNMENTS=238012	UNSAT TT=69.284 ASSIGNMENTS=217209 CHECKS=20270500	UNSAT TT=879.271 ASSIGNMENTS=28873700 CHECKS=170204000	UNSAT TT=34.942 ASSIGNMENTS=131599 CHECKS=10574600	UNSAT TT=25.919 ASSIGNMENTS=103639 CHECKS=7922360	UNSAT TT=3.706	UNSAT TT=123.827 ASSIGNMENTS=469763 CHECKS=35484000	UNSAT TT=62.248 ASSIGNMENTS=217209 CHECKS=20270500	? TT=0.738	UNSAT TT=31.463	UNSAT TT=36.494
csp/pseudoGLB/ normalized-t2001-13queen13-1110972958.xml	SAT TT=0.457	SAT TT=175.997 CHECKS=31677500 NODES=5341920	SAT TT=431.39 CHECKS=94251000 NODES=12843600	SAT TT=6.314	SAT TT=18.533 CHECKS=1228020	SAT TT=22.251 CHECKS=1549060	SAT TT=16.61 ASSIGNMENTS=139594	SAT TT=3.01 ASSIGNMENTS=16536	SAT TT=7.494 ASSIGNMENTS=1312 CHECKS=132791	SAT TT=170.292 ASSIGNMENTS=5341920 CHECKS=31677500	SAT TT=41.337 ASSIGNMENTS=162503 CHECKS=13497600	SAT TT=24.241 ASSIGNMENTS=100804 CHECKS=8059580	SAT TT=3.452	SAT TT=7.019 ASSIGNMENTS=28745 CHECKS=1989630	SAT TT=0.457 ASSIGNMENTS=1312 CHECKS=132791	? TT=0.724	SAT TT=19.718	SAT TT=30.023
csp/pseudoGLB/ normalized-t2001-13queen13-1110973670.xml	UNSAT TT=2.747	UNSAT TT=1259.18 CHECKS=265073000 NODES=39310300	UNSAT TT=1094.69 CHECKS=241123000 NODES=32724500	UNSAT TT=13.079	UNSAT TT=265.448 CHECKS=20769400	UNSAT TT=190.481 CHECKS=13205900	UNSAT TT=25.014 ASSIGNMENTS=210721	UNSAT TT=38.805 ASSIGNMENTS=348239	UNSAT TT=60.172 ASSIGNMENTS=158900 CHECKS=15713000	UNSAT TT=1206.59 ASSIGNMENTS=39310300 CHECKS=265073000	UNSAT TT=22.753 ASSIGNMENTS=88517 CHECKS=7358070	UNSAT TT=15.226 ASSIGNMENTS=62836 CHECKS=4994090	UNSAT TT=2.747	UNSAT TT=153.655 ASSIGNMENTS=662250 CHECKS=46548000	UNSAT TT=52.91 ASSIGNMENTS=158900 CHECKS=15713000	? TT=0.744	UNSAT TT=29.467	UNSAT TT=47.967
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1110975607.xml	UNSAT TT=1.907	UNSAT TT=315.152 CHECKS=77290800 NODES=10162000	UNSAT TT=211.581 CHECKS=35757300 NODES=6276880	UNSAT TT=11.892	UNSAT TT=117.815 CHECKS=7250890	UNSAT TT=286.032 CHECKS=17730200	UNSAT TT=10.53 ASSIGNMENTS=86346	UNSAT TT=27.954 ASSIGNMENTS=238556	UNSAT TT=56.879 ASSIGNMENTS=156452 CHECKS=14813800	UNSAT TT=325.434 ASSIGNMENTS=10162000 CHECKS=77290800	UNSAT TT=22.05 ASSIGNMENTS=88367 CHECKS=7052390	UNSAT TT=13.762 ASSIGNMENTS=60699 CHECKS=4162810	UNSAT TT=1.907	UNSAT TT=90.262 ASSIGNMENTS=359097 CHECKS=25640500	UNSAT TT=45.874 ASSIGNMENTS=156452 CHECKS=14813800	? TT=0.72	UNSAT TT=19.868	UNSAT TT=25.341
csp/pseudoGLB/ normalized-t2001-13queen13-1110976730.xml	UNSAT TT=7.307	UNSAT TT=867.439 CHECKS=146101000 NODES=28151600	UNSAT TT=763.369 CHECKS=152851000 NODES=23281900	UNSAT TT=11.182	UNSAT TT=871.176 CHECKS=74821200	UNSAT TT=485.946 CHECKS=38417900	UNSAT TT=26.964 ASSIGNMENTS=224839	UNSAT TT=38.423 ASSIGNMENTS=337438	UNSAT TT=325.652 ASSIGNMENTS=1160150 CHECKS=97597000	UNSAT TT=887.441 ASSIGNMENTS=28151600 CHECKS=146101000	UNSAT TT=72.51 ASSIGNMENTS=291373 CHECKS=22181100	UNSAT TT=60.103 ASSIGNMENTS=252358 CHECKS=19689600	UNSAT TT=7.307	UNSAT TT=169.358 ASSIGNMENTS=651168 CHECKS=48911500	UNSAT TT=316.725 ASSIGNMENTS=1160150 CHECKS=97597000	? TT=0.747	UNSAT TT=58.235	UNSAT TT=88.155
csp/pseudoGLB/ normalized-t2001-13queen13-1110976935.xml	UNSAT TT=2.841	UNSAT TT=236.513 CHECKS=47953100 NODES=7544040	UNSAT TT=653.411 CHECKS=125229000 NODES=21035900	UNSAT TT=11.79	UNSAT TT=187.841 CHECKS=13658600	UNSAT TT=293.467 CHECKS=21472100	UNSAT TT=14.392 ASSIGNMENTS=117566	UNSAT TT=53.06 ASSIGNMENTS=447053	UNSAT TT=116.975 ASSIGNMENTS=375027 CHECKS=33285600	UNSAT TT=239.683 ASSIGNMENTS=7544040 CHECKS=47953100	UNSAT TT=32.766 ASSIGNMENTS=121612 CHECKS=9970130	UNSAT TT=23.352 ASSIGNMENTS=98157 CHECKS=7092340	UNSAT TT=2.841	UNSAT TT=96.12 ASSIGNMENTS=390558 CHECKS=27418300	UNSAT TT=100.686 ASSIGNMENTS=375027 CHECKS=33285600	? TT=0.72	UNSAT TT=32.704	UNSAT TT=36.483
csp/pseudoGLB/ normalized-t2001-13queen13-1110977464.xml	SAT TT=2.312	SAT TT=178.225 CHECKS=27265700 NODES=5327440	SAT TT=803.016 CHECKS=138050000 NODES=24512800	SAT TT=2.312	SAT TT=189.985 CHECKS=16862800	SAT TT=149.717 CHECKS=11310000	SAT TT=31.03 ASSIGNMENTS=271875	SAT TT=5.844 ASSIGNMENTS=40056	SAT TT=70.314 ASSIGNMENTS=205435 CHECKS=19199300	SAT TT=170.211 ASSIGNMENTS=5327440 CHECKS=27265700	SAT TT=15.998 ASSIGNMENTS=59643 CHECKS=4854110	SAT TT=19.767 ASSIGNMENTS=86817 CHECKS=6570960	SAT TT=2.362	SAT TT=23.29 ASSIGNMENTS=104584 CHECKS=7079100	SAT TT=63.021 ASSIGNMENTS=205435 CHECKS=19199300	? TT=0.695	SAT TT=14.773	SAT TT=32.946
csp/pseudoGLB/ normalized-t2001-13queen13-1111212923.xml	UNSAT TT=4.294	UNSAT TT=578.644 CHECKS=106337000 NODES=19015400	UNSAT TT=251.131 CHECKS=41066500 NODES=7604240	UNSAT TT=8.673	UNSAT TT=376.384 CHECKS=28001700	UNSAT TT=482.075 CHECKS=36170300	UNSAT TT=17.773 ASSIGNMENTS=160627	UNSAT TT=40.477 ASSIGNMENTS=326001	UNSAT TT=132.923 ASSIGNMENTS=500784 CHECKS=40872700	UNSAT TT=582.02 ASSIGNMENTS=19015400 CHECKS=106337000	UNSAT TT=48.756 ASSIGNMENTS=201462 CHECKS=15055400	UNSAT TT=37.423 ASSIGNMENTS=152267 CHECKS=11484100	UNSAT TT=4.294	UNSAT TT=80.049 ASSIGNMENTS=291113 CHECKS=22871400	UNSAT TT=133.954 ASSIGNMENTS=500784 CHECKS=40872700	? TT=0.739	UNSAT TT=28.165	UNSAT TT=33.94
csp/pseudoGLB/ normalized-t2001-13queen13-1111213670.xml	UNSAT TT=2.469	UNSAT TT=421.74 CHECKS=89258400 NODES=13635700	? (TO) TT=1800.07	UNSAT TT=9.997	UNSAT TT=146.614 CHECKS=8783090	UNSAT TT=298.953 CHECKS=18687800	UNSAT TT=15.184 ASSIGNMENTS=112336	UNSAT TT=41.704 ASSIGNMENTS=329741	UNSAT TT=92.497 ASSIGNMENTS=280918 CHECKS=25829200	UNSAT TT=427.657 ASSIGNMENTS=13635700 CHECKS=89258400	UNSAT TT=28.871 ASSIGNMENTS=112855 CHECKS=8829930	UNSAT TT=21.167 ASSIGNMENTS=87347 CHECKS=6455680	UNSAT TT=2.469	UNSAT TT=69.761 ASSIGNMENTS=284668 CHECKS=19964000	UNSAT TT=84.507 ASSIGNMENTS=280918 CHECKS=25829200	? TT=0.709	UNSAT TT=20.686	UNSAT TT=38.525
csp/pseudoGLB/ normalized-t2001-13queen13-1111217374.xml	SAT TT=0.936	SAT TT=91.962 CHECKS=17509700 NODES=2835970	SAT TT=848.461 CHECKS=202373000 NODES=26024700	SAT TT=1.459	SAT TT=34.147 CHECKS=2858820	SAT TT=17.003 CHECKS=1483850	SAT TT=3.217 ASSIGNMENTS=19611	SAT TT=9.199 ASSIGNMENTS=75279	SAT TT=59.504 ASSIGNMENTS=152331 CHECKS=16018500	SAT TT=94.62 ASSIGNMENTS=2835970 CHECKS=17509700	SAT TT=6.57 ASSIGNMENTS=22384 CHECKS=1981250	SAT TT=4.149 ASSIGNMENTS=22752 CHECKS=1291760	SAT TT=0.936	SAT TT=23.987 ASSIGNMENTS=92135 CHECKS=6753460	SAT TT=51.784 ASSIGNMENTS=152331 CHECKS=16018500	? TT=0.744	SAT TT=2.641	SAT TT=5.706
csp/pseudoGLB/ normalized-t2001-13queen13-1111219348.xml	UNSAT TT=3.272	UNSAT TT=619.328 CHECKS=110378000 NODES=20147400	UNSAT TT=757.213 CHECKS=129516000 NODES=22396400	UNSAT TT=9.78	UNSAT TT=382.321 CHECKS=31484900	UNSAT TT=514.205 CHECKS=35984000	UNSAT TT=17.508 ASSIGNMENTS=158596	UNSAT TT=42.42 ASSIGNMENTS=351131	UNSAT TT=87.812 ASSIGNMENTS=282151 CHECKS=26144700	UNSAT TT=622.441 ASSIGNMENTS=20147400 CHECKS=110378000	UNSAT TT=40.787 ASSIGNMENTS=147054 CHECKS=12316600	UNSAT TT=27.29 ASSIGNMENTS=116625 CHECKS=9019550	UNSAT TT=3.272	UNSAT TT=74.082 ASSIGNMENTS=284619 CHECKS=21213700	UNSAT TT=86.662 ASSIGNMENTS=282151 CHECKS=26144700	? TT=0.719	UNSAT TT=26.66	UNSAT TT=40.928
csp/pseudoGLB/ normalized-t2001-13queen13-1111220019.xml	UNSAT TT=2.606	UNSAT TT=850.313 CHECKS=153641000 NODES=25432100	UNSAT TT=339.153 CHECKS=63063900 NODES=10715100	UNSAT TT=10.076	UNSAT TT=234.144 CHECKS=18832000	UNSAT TT=289.69 CHECKS=19822600	UNSAT TT=18.85 ASSIGNMENTS=168426	UNSAT TT=37.818 ASSIGNMENTS=307871	UNSAT TT=111.744 ASSIGNMENTS=364091 CHECKS=34111300	UNSAT TT=792.91 ASSIGNMENTS=25432100 CHECKS=153641000	UNSAT TT=34.952 ASSIGNMENTS=139124 CHECKS=11319000	UNSAT TT=27.71 ASSIGNMENTS=105706 CHECKS=8443160	UNSAT TT=2.606	UNSAT TT=102.656 ASSIGNMENTS=385536 CHECKS=29327800	UNSAT TT=112.567 ASSIGNMENTS=364091 CHECKS=34111300	? TT=0.698	UNSAT TT=28.286	UNSAT TT=39.71
csp/pseudoGLB/ normalized-t2001-13queen13-1111221203.xml	UNSAT TT=5.056	? (TO) TT=1800.12	UNSAT TT=714.867 CHECKS=156838000 NODES=23018000	UNSAT TT=9.805	UNSAT TT=197.623 CHECKS=14966600	UNSAT TT=298.528 CHECKS=21528600	UNSAT TT=19.492 ASSIGNMENTS=169305	UNSAT TT=37.037 ASSIGNMENTS=321796	UNSAT TT=145.937 ASSIGNMENTS=478174 CHECKS=43187900	UNSAT TT=1650.62 ASSIGNMENTS=478174 CHECKS=43187900	UNSAT TT=38.553 ASSIGNMENTS=159067 CHECKS=12667600	UNSAT TT=23.757 ASSIGNMENTS=94395 CHECKS=7362220	UNSAT TT=5.056	UNSAT TT=201.693 ASSIGNMENTS=863676 CHECKS=62983300	UNSAT TT=130.875 ASSIGNMENTS=478174 CHECKS=43187900	? TT=0.695	UNSAT TT=29.767	UNSAT TT=42.449
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t2001-13queen13-1111221953.xml	SAT TT=1.121	SAT TT=815.181 CHECKS=167403000 NODES=24725800	SAT TT=1051.76 CHECKS=232429000 NODES=34804100	SAT TT=2.227	SAT TT=42.228 CHECKS=2876040	SAT TT=99.973 CHECKS=6552900	SAT TT=15.983 ASSIGNMENTS=144314	SAT TT=6.885 ASSIGNMENTS=50427	SAT TT=38.313 ASSIGNMENTS=116881 CHECKS=10359200	SAT TT=761.786 ASSIGNMENTS=24725800 CHECKS=167403000	SAT TT=15.691 ASSIGNMENTS=62768 CHECKS=4828570	SAT TT=25.639 ASSIGNMENTS=115226 CHECKS=8498340	SAT TT=1.121	SAT TT=86.655 ASSIGNMENTS=373039 CHECKS=26555100	SAT TT=31.261 ASSIGNMENTS=116881 CHECKS=10359200	? TT=0.74	SAT TT=18.772	SAT TT=24.478
csp/pseudoGLB/ normalized-t2001-13queen13-1111222257.xml	UNSAT TT=3.572	UNSAT TT=541.872 CHECKS=141824000 NODES=17127900	UNSAT TT=217.918 CHECKS=42128600 NODES=6325690	UNSAT TT=10.844	UNSAT TT=460.617 CHECKS=32281100	UNSAT TT=175.951 CHECKS=10974400	UNSAT TT=27.195 ASSIGNMENTS=231727	UNSAT TT=29.513 ASSIGNMENTS=234927	UNSAT TT=141.93 ASSIGNMENTS=498882 CHECKS=40872400	UNSAT TT=542.019 ASSIGNMENTS=17127900 CHECKS=141824000	UNSAT TT=39.228 ASSIGNMENTS=156121 CHECKS=11974200	UNSAT TT=29.185 ASSIGNMENTS=129318 CHECKS=9669900	UNSAT TT=3.572	UNSAT TT=160.529 ASSIGNMENTS=651460 CHECKS=46139700	UNSAT TT=133.692 ASSIGNMENTS=498882 CHECKS=40872400	? TT=0.753	UNSAT TT=34.774	UNSAT TT=52.299
csp/pseudoGLB/ normalized-t2001-13queen13-1111223696.xml	SAT TT=2.078	SAT TT=418.793 CHECKS=70335300 NODES=12727400	SAT TT=315.09 CHECKS=56445600 NODES=9574350	SAT TT=9.372	SAT TT=260.432 CHECKS=24771600	SAT TT=100.07 CHECKS=8269320	SAT TT=22.556 ASSIGNMENTS=193925	SAT TT=36.1 ASSIGNMENTS=321701	SAT TT=70.358 ASSIGNMENTS=203071 CHECKS=19264700	SAT TT=392.463 ASSIGNMENTS=12727400 CHECKS=70335300	SAT TT=27.492 ASSIGNMENTS=100830 CHECKS=8391310	SAT TT=17.532 ASSIGNMENTS=70447 CHECKS=5413610	SAT TT=2.078	SAT TT=29.185 ASSIGNMENTS=111237 CHECKS=8320770	SAT TT=62.624 ASSIGNMENTS=203071 CHECKS=19264700	? TT=0.724	SAT TT=28.967	SAT TT=14.543
csp/pseudoGLB/ normalized-t2001-13queen13-1111224929.xml	UNSAT TT=2.957	UNSAT TT=893 CHECKS=156141000 NODES=27261000	UNSAT TT=253.894 CHECKS=49371200 NODES=8173050	UNSAT TT=8.713	UNSAT TT=354.677 CHECKS=27179700	UNSAT TT=534.185 CHECKS=38775600	UNSAT TT=15.287 ASSIGNMENTS=124013	UNSAT TT=37.408 ASSIGNMENTS=326373	UNSAT TT=90.139 ASSIGNMENTS=287871 CHECKS=24733000	UNSAT TT=829.991 ASSIGNMENTS=27261000 CHECKS=156141000	UNSAT TT=42.515 ASSIGNMENTS=174672 CHECKS=13027200	UNSAT TT=21.216 ASSIGNMENTS=88768 CHECKS=6516630	UNSAT TT=2.957	UNSAT TT=72.117 ASSIGNMENTS=294074 CHECKS=22311900	UNSAT TT=80.514 ASSIGNMENTS=287871 CHECKS=24733000	? TT=0.778	UNSAT TT=32.794	UNSAT TT=45.381
csp/pseudoGLB/ normalized-t2001-13queen13-1111225605.xml	UNSAT TT=2.269	UNSAT TT=830.743 CHECKS=172297000 NODES=25212600	UNSAT TT=556.406 CHECKS=90406600 NODES=16748100	UNSAT TT=13.094	UNSAT TT=156.222 CHECKS=10537400	UNSAT TT=158.544 CHECKS=10802100	UNSAT TT=26.5 ASSIGNMENTS=232145	UNSAT TT=41.018 ASSIGNMENTS=345385	UNSAT TT=243.416 ASSIGNMENTS=862578 CHECKS=71927200	UNSAT TT=778.095 ASSIGNMENTS=25212600 CHECKS=172297000	UNSAT TT=49.631 ASSIGNMENTS=215979 CHECKS=15922400	UNSAT TT=40.538 ASSIGNMENTS=166295 CHECKS=12457900	UNSAT TT=2.269	UNSAT TT=122.296 ASSIGNMENTS=487018 CHECKS=35058500	UNSAT TT=234.683 ASSIGNMENTS=862578 CHECKS=71927200	? TT=0.746	UNSAT TT=31.741	UNSAT TT=48.853
csp/pseudoGLB/ normalized-t2001-13queen13-1111227012.xml	UNSAT TT=3.181	UNSAT TT=1215.03 CHECKS=257188000 NODES=39454100	UNSAT TT=365.201 CHECKS=67181400 NODES=11805900	UNSAT TT=14.949	UNSAT TT=170.863 CHECKS=13074400	UNSAT TT=210.478 CHECKS=13660800	UNSAT TT=26.236 ASSIGNMENTS=236305	UNSAT TT=42.141 ASSIGNMENTS=345556	UNSAT TT=121.632 ASSIGNMENTS=379073 CHECKS=34249100	UNSAT TT=1212.87 ASSIGNMENTS=39454100 CHECKS=257188000	UNSAT TT=41.231 ASSIGNMENTS=155660 CHECKS=12402900	UNSAT TT=27.631 ASSIGNMENTS=105344 CHECKS=8428350	UNSAT TT=3.181	UNSAT TT=93.034 ASSIGNMENTS=364291 CHECKS=28646800	UNSAT TT=109.399 ASSIGNMENTS=379073 CHECKS=34249100	? TT=0.757	UNSAT TT=30.022	UNSAT TT=41.012
csp/pseudoGLB/ normalized-t3002-11tsp11-1900546417.xml	UNSAT TT=46.892	? (TO) TT=1800.16	? (TO) TT=1800.07	UNSAT TT=46.892	UNSAT TT=94.524 CHECKS=51553600	UNSAT TT=183.385 CHECKS=102580000	? (TO) TT=1800.09	UNSAT TT=1068.55 ASSIGNMENTS=1516120	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.1	UNSAT TT=296.807	? (TO) TT=1800.11	? (TO) TT=1800.06	? TT=0.756	UNSAT TT=73.918	UNSAT TT=313.859
csp/pseudoGLB/ normalized-t3002-11tsp11-1900547334.xml	SAT TT=1.32	? (TO) TT=1800.13	? (TO) TT=1800.1	SAT TT=1.32	SAT TT=36.588 CHECKS=20939900	SAT TT=244.496 CHECKS=141593000	SAT TT=64.73 ASSIGNMENTS=111326	SAT TT=8.895 ASSIGNMENTS=10824	SAT TT=153.557 ASSIGNMENTS=121355 CHECKS=115262000	SAT TT=222.558 ASSIGNMENTS=121355 CHECKS=115262000	SAT TT=44.082 ASSIGNMENTS=31743 CHECKS=33322200	SAT TT=30.897 ASSIGNMENTS=44489 CHECKS=23345400	SAT TT=10.689	? (TO) TT=1800.08	SAT TT=131.782 ASSIGNMENTS=121355 CHECKS=115262000	? TT=0.722	SAT TT=14.206	SAT TT=2.342
csp/pseudoGLB/ normalized-t3002-11tsp11-1900548667.xml	UNSAT TT=80.213	? (TO) TT=1800.1	? (TO) TT=1800.12	UNSAT TT=80.213	UNSAT TT=516.526 CHECKS=314721000	UNSAT TT=495.449 CHECKS=326349000	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.04	UNSAT TT=340.752	? (TO) TT=1800.09	? (TO) TT=1800.06	? TT=0.711	UNSAT TT=574.458	? (TO) TT=1800.15
csp/pseudoGLB/ normalized-t3002-11tsp11-1900552423.xml	UNSAT TT=7.67	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=15.29	UNSAT TT=50.061 CHECKS=26353700	UNSAT TT=82.146 CHECKS=41514900	UNSAT TT=1743.39 ASSIGNMENTS=2829690	UNSAT TT=260.052 ASSIGNMENTS=308752	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=71.335	? (TO) TT=1800.06	? (TO) TT=1800.05	? TT=0.764	UNSAT TT=10.548	UNSAT TT=7.67
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t3002-11tsp11-1900553812.xml	UNSAT TT=22.858	? (TO) TT=1800.08	? (TO) TT=1800.13	UNSAT TT=22.858	UNSAT TT=162.932 CHECKS=97722600	UNSAT TT=164.232 CHECKS=93450400	? (TO) TT=1800.16	UNSAT TT=367.973 ASSIGNMENTS=483236	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.1	UNSAT TT=124.449	? (TO) TT=1800.01	? (TO) TT=1800.08	? TT=0.747	UNSAT TT=32.462	UNSAT TT=35.765
csp/pseudoGLB/ normalized-t3002-11tsp11-1900554375.xml	SAT TT=0.622	? (TO) TT=1800.11	? (TO) TT=1800.13	SAT TT=0.622	SAT TT=33.045 CHECKS=18847900	SAT TT=22.327 CHECKS=11754400	SAT TT=4.544 ASSIGNMENTS=5138	SAT TT=2.73 ASSIGNMENTS=1436	SAT TT=33.476 ASSIGNMENTS=21600 CHECKS=19812600	SAT TT=103.783 ASSIGNMENTS=21600 CHECKS=19812600	SAT TT=17.707 ASSIGNMENTS=12482 CHECKS=13035100	SAT TT=1.665 ASSIGNMENTS=23172 CHECKS=1248240	SAT TT=1.312	SAT TT=400.388 ASSIGNMENTS=219327 CHECKS=227804000	SAT TT=25.359 ASSIGNMENTS=21600 CHECKS=19812600	? TT=0.738	SAT TT=2.472	SAT TT=2.817
csp/pseudoGLB/ normalized-t3002-11tsp11-1900557362.xml	UNSAT TT=24.335	? (TO) TT=1800.11	? (TO) TT=1800.1	UNSAT TT=25.842	UNSAT TT=199.509 CHECKS=105983000	UNSAT TT=165.031 CHECKS=84785700	? (TO) TT=1800.15	UNSAT TT=508.382 ASSIGNMENTS=638722	? (TO) TT=1800.05	? (TO) TT=1800.02	UNSAT TT=1507.99 ASSIGNMENTS=963493 CHECKS=1152120000	? (TO) TT=1800.02	UNSAT TT=135.562	? (TO) TT=1800.05	? (TO) TT=1800.08	? TT=0.784	UNSAT TT=24.335	UNSAT TT=29.676
csp/pseudoGLB/ normalized-t3002-11tsp11-1900557957.xml	UNSAT TT=23.761	? (TO) TT=1800.14	? (TO) TT=1800.06	UNSAT TT=23.761	UNSAT TT=165.718 CHECKS=87657000	UNSAT TT=162.824 CHECKS=89186300	? (TO) TT=1800.13	UNSAT TT=537.426 ASSIGNMENTS=614827	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.06	UNSAT TT=118.278	? (TO) TT=1800.11	? (TO) TT=1800.08	? TT=0.772	UNSAT TT=50.867	UNSAT TT=62.735
csp/pseudoGLB/ normalized-t3002-11tsp11-1900558739.xml	UNSAT TT=66.887	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=66.887	UNSAT TT=341.284 CHECKS=203221000	UNSAT TT=172.118 CHECKS=96406400	? (TO) TT=1800.09	UNSAT TT=1121.82 ASSIGNMENTS=1663200	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.05	UNSAT TT=376.814	? (TO) TT=1800.03	? (TO) TT=1800.05	? TT=0.781	UNSAT TT=121.954	UNSAT TT=444.378
csp/pseudoGLB/ normalized-t3002-11tsp11-1900563801.xml	UNSAT TT=11.179	? (TO) TT=1800.09	? (TO) TT=1800.05	UNSAT TT=27.548	UNSAT TT=171.847 CHECKS=98278800	UNSAT TT=173.828 CHECKS=95197000	? (TO) TT=1800.14	UNSAT TT=571.85 ASSIGNMENTS=841057	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.02	UNSAT TT=165.728	? (TO) TT=1800.11	? (TO) TT=1800.04	? TT=0.741	UNSAT TT=11.179	UNSAT TT=14.532
csp/pseudoGLB/ normalized-t3002-11tsp11-1900564824.xml	UNSAT TT=4.41	? (TO) TT=1800.07	? (TO) TT=1800.12	UNSAT TT=11.609	UNSAT TT=31.209 CHECKS=15806100	UNSAT TT=35.803 CHECKS=18246000	UNSAT TT=1447.4 ASSIGNMENTS=2290220	UNSAT TT=192.131 ASSIGNMENTS=224062	? (TO) TT=1800.08	? (TO) TT=1800.01	UNSAT TT=1534.6 ASSIGNMENTS=1060560 CHECKS=1208050000	? (TO) TT=1800.08	UNSAT TT=66.013	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=0.726	UNSAT TT=6.631	UNSAT TT=4.41
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567135.xml	UNSAT TT=17.68	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=17.68	UNSAT TT=158.165 CHECKS=85594400	UNSAT TT=133.222 CHECKS=74166600	? (TO) TT=1800.07	UNSAT TT=353.995 ASSIGNMENTS=432837	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.09	UNSAT TT=105.229	? (TO) TT=1800.06	? (TO) TT=1800.06	? TT=0.722	UNSAT TT=67.607	UNSAT TT=37.04
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567939.xml	SAT TT=2.981	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=2.981	SAT TT=55.034 CHECKS=30321700	SAT TT=43.328 CHECKS=25307900	SAT TT=37.627 ASSIGNMENTS=61286	SAT TT=6.49 ASSIGNMENTS=6225	SAT TT=20.616 ASSIGNMENTS=9748 CHECKS=10108800	SAT TT=92.288 ASSIGNMENTS=9748 CHECKS=10108800	SAT TT=77.482 ASSIGNMENTS=56270 CHECKS=59424300	SAT TT=212.365 ASSIGNMENTS=158951 CHECKS=161022000	SAT TT=13.888	? (TO) TT=1800.09	SAT TT=12.416 ASSIGNMENTS=9748 CHECKS=10108800	? TT=0.758	SAT TT=12.363	SAT TT=3.944
csp/pseudoGLB/ normalized-t3002-11tsp11-1900567985.xml	UNSAT TT=48.857	? (TO) TT=1800.11	? (TO) TT=1800.04	UNSAT TT=48.857	UNSAT TT=278.531 CHECKS=158680000	UNSAT TT=292.8 CHECKS=176722000	? (TO) TT=1800.12	UNSAT TT=1234 ASSIGNMENTS=2001800	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=295.08	? (TO) TT=1800.05	? (TO) TT=1800.1	? TT=0.751	UNSAT TT=424.173	UNSAT TT=1260.95
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/pseudoGLB/ normalized-t3002-11tsp11-1900568186.xml	UNSAT TT=20.823	? (TO) TT=1800.15	? (TO) TT=1800.05	UNSAT TT=25.147	UNSAT TT=68.975 CHECKS=36788800	UNSAT TT=153.007 CHECKS=86740400	? (TO) TT=1800.18	UNSAT TT=479.841 ASSIGNMENTS=597933	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.09	UNSAT TT=360.674	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=0.77	UNSAT TT=24.834	UNSAT TT=20.823
csp/pseudoGLB/ normalized-t3002-11tsp11-1900571132.xml	UNSAT TT=17.747	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=17.747	UNSAT TT=60.103 CHECKS=30804300	UNSAT TT=143.449 CHECKS=83064400	? (TO) TT=1800.12	UNSAT TT=392.769 ASSIGNMENTS=542227	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=184.982	? (TO) TT=1800.02	? (TO) TT=1800.12	? TT=0.768	UNSAT TT=131.288	UNSAT TT=308.01
csp/pseudoGLB/ normalized-t3002-11tsp11-1900574974.xml	SAT TT=1.044	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=1.044	SAT TT=101.19 CHECKS=62030200	SAT TT=39.339 CHECKS=21447200	SAT TT=6.383 ASSIGNMENTS=8256	SAT TT=3.652 ASSIGNMENTS=2646	SAT TT=103.725 ASSIGNMENTS=73903 CHECKS=74223500	SAT TT=164.417 ASSIGNMENTS=73903 CHECKS=74223500	SAT TT=8.508 ASSIGNMENTS=6526 CHECKS=6864300	SAT TT=47.244 ASSIGNMENTS=54954 CHECKS=36593600	SAT TT=1.771	SAT TT=128.627 ASSIGNMENTS=92027 CHECKS=74474000	SAT TT=85.626 ASSIGNMENTS=73903 CHECKS=74223500	? TT=0.767	SAT TT=2.234	SAT TT=3.593
csp/pseudoGLB/ normalized-t3002-11tsp11-1900577000.xml	SAT TT=0.672	? (TO) TT=1800.11	? (TO) TT=1800.1	SAT TT=0.672	SAT TT=2.204 CHECKS=983785	SAT TT=2.565 CHECKS=1207450	SAT TT=4.14 ASSIGNMENTS=5601	SAT TT=6.659 ASSIGNMENTS=6783	SAT TT=25.477 ASSIGNMENTS=14838 CHECKS=13885100	SAT TT=97.507 ASSIGNMENTS=14838 CHECKS=13885100	SAT TT=6.068 ASSIGNMENTS=3863 CHECKS=4421220	SAT TT=20.175 ASSIGNMENTS=36253 CHECKS=16557500	SAT TT=1.453	SAT TT=105.301 ASSIGNMENTS=68075 CHECKS=58506000	SAT TT=16.42 ASSIGNMENTS=14838 CHECKS=13885100	? TT=0.754	SAT TT=2.454	SAT TT=2.902
csp/pseudoGLB/ normalized-t3002-11tsp11-1900581320.xml	UNSAT TT=68.163	? (TO) TT=1800.1	? (TO) TT=1800.15	UNSAT TT=68.163	UNSAT TT=409.189 CHECKS=236780000	UNSAT TT=337.257 CHECKS=215240000	? (TO) TT=1800.1	UNSAT TT=1639.69 ASSIGNMENTS=2295010	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.03	UNSAT TT=228.716	? (TO) TT=1800.02	? (TO) TT=1800.03	? TT=0.746	UNSAT TT=157.179	UNSAT TT=610.537
csp/pseudoGLB/ normalized-t3002-11tsp11-1900582300.xml	UNSAT TT=36.179	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=36.179	UNSAT TT=320.386 CHECKS=179921000	UNSAT TT=170.167 CHECKS=101153000	? (TO) TT=1800.1	UNSAT TT=924.592 ASSIGNMENTS=1187980	? (TO) TT=1800	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	UNSAT TT=368.068	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=0.759	UNSAT TT=234.664	UNSAT TT=1048.78
csp/pseudoGLB/ normalized-t3002-11tsp11-1900667195.xml	UNSAT TT=58.39	? (TO) TT=1800.16	? (TO) TT=1800.1	UNSAT TT=58.39	UNSAT TT=290.787 CHECKS=166515000	UNSAT TT=288.327 CHECKS=167466000	? (TO) TT=1800.13	UNSAT TT=1055.34 ASSIGNMENTS=1574200	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.09	UNSAT TT=414.94	? (TO) TT=1800.1	? (TO) TT=1800.11	? TT=0.76	UNSAT TT=301.402	UNSAT TT=1208.67
csp/pseudoGLB/ normalized-t3002-11tsp11-1900669309.xml	SAT TT=1.464	? (TO) TT=1800.12	? (TO) TT=1800.14	SAT TT=1.775	SAT TT=202.179 CHECKS=111687000	SAT TT=161.644 CHECKS=99966300	SAT TT=963.755 ASSIGNMENTS=1386870	SAT TT=6.695 ASSIGNMENTS=7417	SAT TT=409.665 ASSIGNMENTS=250295 CHECKS=322789000	SAT TT=458.808 ASSIGNMENTS=250295 CHECKS=322789000	SAT TT=307.179 ASSIGNMENTS=236395 CHECKS=241430000	SAT TT=138.266 ASSIGNMENTS=114042 CHECKS=106529000	SAT TT=1.464	? (TO) TT=1800.04	SAT TT=413.488 ASSIGNMENTS=250295 CHECKS=322789000	? TT=0.785	SAT TT=8.231	SAT TT=16.669
csp/pseudoGLB/ normalized-t3002-11tsp11-1900670167.xml	UNSAT TT=28.063	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=28.063	UNSAT TT=221.32 CHECKS=128018000	UNSAT TT=165.476 CHECKS=97778100	? (TO) TT=1800.06	UNSAT TT=610.177 ASSIGNMENTS=826004	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.06	UNSAT TT=380.37	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=0.721	UNSAT TT=48.458	UNSAT TT=80.025
csp/pseudoGLB/ normalized-t3002-11tsp11-1900670675.xml	UNSAT TT=18.83	? (TO) TT=1800.05	? (TO) TT=1800.13	UNSAT TT=47.774	UNSAT TT=369.455 CHECKS=221959000	UNSAT TT=286.296 CHECKS=186882000	UNSAT TT=994.817 ASSIGNMENTS=1445220	UNSAT TT=991.233 ASSIGNMENTS=1617340	? (TO) TT=1800.05	? (TO) TT=1800.07	UNSAT TT=1413.28 ASSIGNMENTS=924734 CHECKS=1074270000	? (TO) TT=1800.1	UNSAT TT=121.462	? (TO) TT=1800.02	? (TO) TT=1800.06	? TT=0.767	UNSAT TT=18.83	UNSAT TT=21.459

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	31	31	63	74	69	49	66	41	44	40	39	64	41	40	66	70
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	31	31	63	74	69	49	66	41	44	40	39	64	41	40	66	70
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	18	7	6	0	4	0	0	2	0	25	1	5	10	6
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0