CSP 2008 Competition: results by benchmark

Results by benchmark for category global constraints (GLOBAL), subcategory real world problems

This page displays the results of the different solvers for each benchmark for category global constraints (GLOBAL), subcategory real world problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC
Abscon 112v4 ESAC
bpsolver 2008-06-27
casper zao
casper zito
choco2_dwdeg 2008-06-26
choco2_impwdeg 2008-06-26
cpHydra k_10
cpHydra k_40
MDG-noprobe 2008-06-27
MDG-probe 2008-06-27
Minion/Tailor 2008-07-04
Mistral-option 1.314
Mistral-prime 1.313
SAT4J CSP 2008-06-13
Sugar v1.13+minisat
Sugar v1.13+picosat

Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5561.xml	UNSAT TT=0.284	? (TO) TT=1800.16	? (TO) TT=1800.11	UNSAT TT=0.284	UNSAT TT=11.406 CHECKS=7114500	UNSAT TT=8.056 CHECKS=3302880	UNSAT TT=11.558 ASSIGNMENTS=38275	? (TO) TT=1800.12	UNSAT TT=0.689 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.772 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.71 ASSIGNMENTS=10816 CHECKS=466154	? (exit code) TT=0.406	UNSAT TT=2.365 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.386 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.214	? TT=306.179	? TT=282.416
csp/CabinetStart1/ normalized-cabinet-5562.xml	UNSAT TT=0.291	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=0.291	UNSAT TT=12.538 CHECKS=7450330	UNSAT TT=8.038 CHECKS=3304980	UNSAT TT=12.619 ASSIGNMENTS=38275	? (TO) TT=1800.07	UNSAT TT=0.732 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.73 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.781 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.697 ASSIGNMENTS=10368 CHECKS=459846	? (exit code) TT=0.543	UNSAT TT=2.522 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.579 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.164	? (TO) TT=286.024	? TT=305.102
csp/CabinetStart1/ normalized-cabinet-5563.xml	UNSAT TT=0.268	? (TO) TT=1800.14	? (TO) TT=1800.15	UNSAT TT=0.268	UNSAT TT=11.552 CHECKS=7146360	UNSAT TT=8.675 CHECKS=3324820	UNSAT TT=12.489 ASSIGNMENTS=38275	? (TO) TT=1800.07	UNSAT TT=0.697 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.688 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.782 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.706 ASSIGNMENTS=10512 CHECKS=461168	? (exit code) TT=0.387	UNSAT TT=2.518 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.55 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.426	? TT=282.761	? TT=302.893
csp/CabinetStart1/ normalized-cabinet-5564.xml	UNSAT TT=0.29	? (TO) TT=1800.09	? (TO) TT=1800.08	UNSAT TT=0.29	UNSAT TT=11.323 CHECKS=7123220	UNSAT TT=8.055 CHECKS=3295750	UNSAT TT=11.598 ASSIGNMENTS=38275	? (TO) TT=1800.14	UNSAT TT=0.696 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.694 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.724 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.706 ASSIGNMENTS=11376 CHECKS=504429	? (exit code) TT=0.372	UNSAT TT=2.367 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.391 ASSIGNMENTS=28555 CHECKS=1785950	? TT=2.83	? TT=294.244	? TT=284.202
csp/CabinetStart1/ normalized-cabinet-5565.xml	UNSAT TT=0.289	? (MO) TT=1.135	? (TO) TT=1800.11	UNSAT TT=0.289	UNSAT TT=11.441 CHECKS=7124910	UNSAT TT=7.967 CHECKS=3289840	UNSAT TT=12.569 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.683 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.682 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.785 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.715 ASSIGNMENTS=10925 CHECKS=469228	? (exit code) TT=0.389	UNSAT TT=2.54 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.554 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.247	? TT=283.717	? TT=306.186
csp/CabinetStart1/ normalized-cabinet-5566.xml	UNSAT TT=0.287	? (TO) TT=1800.09	? (TO) TT=1800.14	UNSAT TT=0.287	UNSAT TT=12.568 CHECKS=7429590	UNSAT TT=8.695 CHECKS=3282580	UNSAT TT=12.547 ASSIGNMENTS=38275	? (TO) TT=1800.1	UNSAT TT=0.692 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.734 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.724 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.644 ASSIGNMENTS=10666 CHECKS=457138	? (exit code) TT=0.502	UNSAT TT=2.361 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.565 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.27	? TT=283.275	? TT=305.846
csp/CabinetStart1/ normalized-cabinet-5567.xml	UNSAT TT=0.269	? (TO) TT=1800.1	? (TO) TT=1800.15	UNSAT TT=0.269	UNSAT TT=11.37 CHECKS=7121260	UNSAT TT=8.224 CHECKS=3318140	UNSAT TT=11.614 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.697 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.692 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.726 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.702 ASSIGNMENTS=10857 CHECKS=498040	? (exit code) TT=0.471	UNSAT TT=2.393 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.399 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.673	? TT=305.484	? (TO) TT=286.193
csp/CabinetStart1/ normalized-cabinet-5568.xml	UNSAT TT=0.288	? (TO) TT=1800.1	? (TO) TT=1800.1	UNSAT TT=0.288	UNSAT TT=12.211 CHECKS=7116520	UNSAT TT=8.676 CHECKS=3297890	UNSAT TT=11.558 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.736 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.734 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.776 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.666 ASSIGNMENTS=10190 CHECKS=441920	? (exit code) TT=0.47	UNSAT TT=2.53 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.585 ASSIGNMENTS=28555 CHECKS=1785950	? TT=2.971	? TT=304.841	? TT=305.267
csp/CabinetStart1/ normalized-cabinet-5569.xml	UNSAT TT=0.269	? (TO) TT=1800.11	? (TO) TT=1800.13	UNSAT TT=0.269	UNSAT TT=12.502 CHECKS=7437300	UNSAT TT=8.69 CHECKS=3292880	UNSAT TT=13.861 ASSIGNMENTS=38275	? (TO) TT=1800.1	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.742 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.774 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.694 ASSIGNMENTS=10495 CHECKS=457235	? (exit code) TT=0.498	UNSAT TT=2.551 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.578 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.318	? TT=293.134	? TT=304.502
csp/CabinetStart1/ normalized-cabinet-5570.xml	UNSAT TT=0.27	? (TO) TT=1800.12	? (TO) TT=1800.1	UNSAT TT=0.27	UNSAT TT=12.398 CHECKS=7111560	UNSAT TT=8.672 CHECKS=3297890	UNSAT TT=11.529 ASSIGNMENTS=38275	? (TO) TT=1800.08	UNSAT TT=0.685 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.688 ASSIGNMENTS=8892 CHECKS=473596	UNSAT TT=0.774 ASSIGNMENTS=9645 CHECKS=515909	UNSAT TT=0.623 ASSIGNMENTS=9716 CHECKS=412116	? (exit code) TT=0.383	UNSAT TT=2.547 ASSIGNMENTS=49235 CHECKS=1626360	UNSAT TT=2.396 ASSIGNMENTS=28555 CHECKS=1785950	? TT=3.221	? TT=285.791	? TT=307.043
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5571.xml	UNSAT TT=0.292	? (TO) TT=1800.13	? (TO) TT=1800.12	UNSAT TT=0.292	UNSAT TT=11.817 CHECKS=7455390	UNSAT TT=8.059 CHECKS=3302380	UNSAT TT=12.004 ASSIGNMENTS=39462	? (TO) TT=1800.09	UNSAT TT=0.669 ASSIGNMENTS=8441 CHECKS=466270	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466270	UNSAT TT=0.672 ASSIGNMENTS=9066 CHECKS=447718	UNSAT TT=0.79 ASSIGNMENTS=12450 CHECKS=570527	? (exit code) TT=0.373	UNSAT TT=2.667 ASSIGNMENTS=78487 CHECKS=1811980	UNSAT TT=2.745 ASSIGNMENTS=34187 CHECKS=2035180	? TT=3.452	? TT=325.627	? TT=308.704
csp/CabinetStart1/ normalized-cabinet-5572.xml	UNSAT TT=0.269	? (TO) TT=1800.08	? (TO) TT=1800.08	UNSAT TT=0.269	UNSAT TT=11.692 CHECKS=7450440	UNSAT TT=8.136 CHECKS=3322040	UNSAT TT=12.087 ASSIGNMENTS=39460	? (TO) TT=1800.15	UNSAT TT=0.664 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.771 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.788 ASSIGNMENTS=12596 CHECKS=555689	? (exit code) TT=0.484	UNSAT TT=2.645 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.117 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.011	? TT=289.438	? TT=307.678
csp/CabinetStart1/ normalized-cabinet-5573.xml	UNSAT TT=0.271	? (TO) TT=1800.07	? (MO) TT=0.96	UNSAT TT=0.271	UNSAT TT=12.588 CHECKS=7455190	UNSAT TT=8.488 CHECKS=3270480	UNSAT TT=12.024 ASSIGNMENTS=39462	? (TO) TT=1800.06	UNSAT TT=0.722 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.723 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.729 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.607 ASSIGNMENTS=9751 CHECKS=436963	? (exit code) TT=0.403	UNSAT TT=2.849 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.359 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.06	? TT=313	? TT=286.233
csp/CabinetStart1/ normalized-cabinet-5574.xml	UNSAT TT=0.287	? (TO) TT=1800.05	? (TO) TT=1800.05	UNSAT TT=0.287	UNSAT TT=12.553 CHECKS=7432830	UNSAT TT=8.511 CHECKS=3276460	UNSAT TT=12.668 ASSIGNMENTS=39462	? (TO) TT=1800.09	UNSAT TT=0.668 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.673 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.725 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.718 ASSIGNMENTS=11044 CHECKS=514701	? (exit code) TT=0.377	UNSAT TT=2.865 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.366 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.157	? TT=303.073	? TT=284.079
csp/CabinetStart1/ normalized-cabinet-5575.xml	UNSAT TT=0.291	? (TO) TT=1800.08	? (TO) TT=1800.11	UNSAT TT=0.291	UNSAT TT=12.684 CHECKS=7461890	UNSAT TT=8.661 CHECKS=3294400	UNSAT TT=12.711 ASSIGNMENTS=39462	? (TO) TT=1800.14	UNSAT TT=0.678 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.672 ASSIGNMENTS=8441 CHECKS=466394	UNSAT TT=0.781 ASSIGNMENTS=9925 CHECKS=518843	UNSAT TT=0.726 ASSIGNMENTS=11115 CHECKS=478572	? (exit code) TT=0.482	UNSAT TT=2.854 ASSIGNMENTS=78487 CHECKS=1812240	UNSAT TT=3.341 ASSIGNMENTS=41547 CHECKS=2288640	? TT=3.205	? TT=698.232	? TT=308.5
csp/CabinetStart1/ normalized-cabinet-5576.xml	UNSAT TT=0.269	? (TO) TT=1800.12	? (TO) TT=1800.14	UNSAT TT=0.269	UNSAT TT=11.758 CHECKS=7454600	UNSAT TT=8.632 CHECKS=3298300	UNSAT TT=12.766 ASSIGNMENTS=40031	? (TO) TT=1800.15	UNSAT TT=0.85 ASSIGNMENTS=10710 CHECKS=537435	UNSAT TT=0.849 ASSIGNMENTS=10710 CHECKS=537435	UNSAT TT=0.686 ASSIGNMENTS=8731 CHECKS=451879	UNSAT TT=0.798 ASSIGNMENTS=11218 CHECKS=535326	? (exit code) TT=0.445	UNSAT TT=2.085 ASSIGNMENTS=38593 CHECKS=1326990	UNSAT TT=3.111 ASSIGNMENTS=36670 CHECKS=2147730	? TT=3.144	? TT=288.126	? TT=303.94
csp/CabinetStart1/ normalized-cabinet-5577.xml	UNSAT TT=0.29	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=0.29	UNSAT TT=12.673 CHECKS=7443820	UNSAT TT=8.069 CHECKS=3287870	UNSAT TT=12.009 ASSIGNMENTS=40201	? (TO) TT=1800.11	UNSAT TT=0.823 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.823 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.692 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.693 ASSIGNMENTS=10364 CHECKS=461392	? (exit code) TT=0.447	UNSAT TT=2.355 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=1.912 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.428	? TT=302.09	? TT=307.88
csp/CabinetStart1/ normalized-cabinet-5578.xml	UNSAT TT=0.29	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=0.29	UNSAT TT=12.659 CHECKS=7457420	UNSAT TT=8.547 CHECKS=3270660	UNSAT TT=11.635 ASSIGNMENTS=39137	? (TO) TT=1800.07	UNSAT TT=0.759 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.822 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.644 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.611 ASSIGNMENTS=10517 CHECKS=442125	? (exit code) TT=0.393	UNSAT TT=2.324 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=2.038 ASSIGNMENTS=25517 CHECKS=1413600	? TT=2.991	? TT=289.782	? TT=307.153
csp/CabinetStart1/ normalized-cabinet-5579.xml	UNSAT TT=0.272	? (TO) TT=1800.12	? (TO) TT=1800.12	UNSAT TT=0.272	UNSAT TT=11.841 CHECKS=7447800	UNSAT TT=8.682 CHECKS=3291720	UNSAT TT=11.9 ASSIGNMENTS=40137	? (TO) TT=1800.15	UNSAT TT=0.82 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.816 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.687 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.792 ASSIGNMENTS=11906 CHECKS=529763	? (exit code) TT=0.401	UNSAT TT=2.363 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=2.053 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.202	? TT=286.458	? TT=309.661
csp/CabinetStart1/ normalized-cabinet-5580.xml	UNSAT TT=0.27	? (TO) TT=1800.14	? (TO) TT=1800.16	UNSAT TT=0.27	UNSAT TT=11.838 CHECKS=7430890	UNSAT TT=8.113 CHECKS=3291660	UNSAT TT=11.958 ASSIGNMENTS=39267	? (TO) TT=1800.17	UNSAT TT=0.762 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.756 ASSIGNMENTS=10301 CHECKS=519830	UNSAT TT=0.637 ASSIGNMENTS=8811 CHECKS=455213	UNSAT TT=0.645 ASSIGNMENTS=11030 CHECKS=461402	? (exit code) TT=0.376	UNSAT TT=2.168 ASSIGNMENTS=34962 CHECKS=1517420	UNSAT TT=1.922 ASSIGNMENTS=25517 CHECKS=1413600	? TT=3.037	? TT=286.938	? TT=287.011
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5581.xml	SAT TT=0.025	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.061	SAT TT=10.84 CHECKS=6305790	SAT TT=6.716 CHECKS=1948630	SAT TT=6.965 ASSIGNMENTS=6049	? (TO) TT=1800.14	SAT TT=0.043 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.034 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.036 ASSIGNMENTS=159 CHECKS=6886	? (exit code) TT=0.506	SAT TT=0.806 ASSIGNMENTS=19526 CHECKS=497102	SAT TT=0.025 ASSIGNMENTS=16 CHECKS=1481	? TT=3.049	? TT=300.825	? TT=290.904
csp/CabinetStart1/ normalized-cabinet-5582.xml	SAT TT=0.023	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT TT=0.061	SAT TT=10.616 CHECKS=6301260	SAT TT=7.053 CHECKS=1939440	SAT TT=7.574 ASSIGNMENTS=6052	? (TO) TT=1800.07	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.063 ASSIGNMENTS=755 CHECKS=29306	? (exit code) TT=0.459	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=2.908	? TT=308.122	? TT=289.31
csp/CabinetStart1/ normalized-cabinet-5583.xml	SAT TT=0.026	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.063	SAT TT=11.338 CHECKS=6297920	SAT TT=7.08 CHECKS=1945670	SAT TT=6.896 ASSIGNMENTS=6049	? (TO) TT=1800.15	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.033 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=171 CHECKS=6827	? (exit code) TT=0.402	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.007	? (TO) TT=279.433	? (TO) TT=282.599
csp/CabinetStart1/ normalized-cabinet-5584.xml	SAT TT=0.023	? (TO) TT=1800.17	? (TO) TT=1800.12	SAT TT=0.06	SAT TT=10.619 CHECKS=6302680	SAT TT=6.57 CHECKS=1941980	SAT TT=6.889 ASSIGNMENTS=6049	SAT TT=1207.97 ASSIGNMENTS=963829	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=264 CHECKS=10386	? (exit code) TT=0.497	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=2.836	? TT=309.925	? TT=289.202
csp/CabinetStart1/ normalized-cabinet-5585.xml	SAT TT=0.026	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=0.064	SAT TT=11.508 CHECKS=6334000	SAT TT=6.572 CHECKS=1941020	SAT TT=7.55 ASSIGNMENTS=6049	SAT TT=1543.41 ASSIGNMENTS=1698160	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=170 CHECKS=6878	? (exit code) TT=0.494	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.105	? TT=344.632	? TT=309.957
csp/CabinetStart1/ normalized-cabinet-5586.xml	SAT TT=0.024	? (TO) TT=1800.14	? (TO) TT=1800.16	SAT TT=0.062	SAT TT=11.575 CHECKS=6312880	SAT TT=7.05 CHECKS=1935290	SAT TT=7.794 ASSIGNMENTS=6049	SAT TT=911.331 ASSIGNMENTS=1400040	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.044 ASSIGNMENTS=294 CHECKS=12512	? (exit code) TT=0.383	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.024 ASSIGNMENTS=17 CHECKS=1476	? TT=3.413	? TT=537.529	? TT=310.182
csp/CabinetStart1/ normalized-cabinet-5587.xml	SAT TT=0.024	? (TO) TT=1800.16	? (TO) TT=1800.08	SAT TT=0.059	SAT TT=11.335 CHECKS=6293510	SAT TT=6.54 CHECKS=1952360	SAT TT=7.58 ASSIGNMENTS=6049	? (TO) TT=1800.1	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.024 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=68 CHECKS=3386	? (exit code) TT=0.402	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.028 ASSIGNMENTS=17 CHECKS=1476	? TT=3.155	? TT=292.916	? TT=287.529
csp/CabinetStart1/ normalized-cabinet-5588.xml	SAT TT=0.025	? (TO) TT=1800.12	? (TO) TT=1800.07	SAT TT=0.06	SAT TT=11.481 CHECKS=6314090	SAT TT=7.168 CHECKS=1925680	SAT TT=7.646 ASSIGNMENTS=6049	? (TO) TT=1800.13	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=162 CHECKS=7229	? (exit code) TT=0.503	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.08	? TT=290.288	? TT=310.364
csp/CabinetStart1/ normalized-cabinet-5589.xml	SAT TT=0.026	? (TO) TT=1800.18	? (TO) TT=1800.14	SAT TT=0.065	SAT TT=10.887 CHECKS=6320890	SAT TT=6.478 CHECKS=1931750	SAT TT=8.227 ASSIGNMENTS=6049	? (TO) TT=1800.09	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=37 CHECKS=2134	? (exit code) TT=0.401	SAT TT=0.042 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.121	? TT=282.97	? TT=310.92
csp/CabinetStart1/ normalized-cabinet-5590.xml	SAT TT=0.022	? (TO) TT=1800.13	? (TO) TT=1800.15	SAT TT=0.065	SAT TT=11.475 CHECKS=6288070	SAT TT=7.027 CHECKS=1958730	SAT TT=7.533 ASSIGNMENTS=6049	SAT TT=41.465 ASSIGNMENTS=27035	SAT TT=0.044 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.022 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.033 ASSIGNMENTS=85 CHECKS=3407	? (exit code) TT=0.493	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.025 ASSIGNMENTS=17 CHECKS=1476	? TT=3.22	? TT=291.099	? TT=288.976
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/CabinetStart1/ normalized-cabinet-5591.xml	SAT TT=0.023	? (TO) TT=1800.08	? (TO) TT=1800.17	SAT TT=0.064	SAT TT=11.674 CHECKS=6306340	SAT TT=6.903 CHECKS=1908830	SAT TT=7.377 ASSIGNMENTS=6049	SAT TT=40.046 ASSIGNMENTS=27004	SAT TT=0.04 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.036 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.06 ASSIGNMENTS=635 CHECKS=22805	? (exit code) TT=0.376	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.216	? TT=307.996	? TT=311.433
csp/CabinetStart1/ normalized-cabinet-5592.xml	SAT TT=0.023	? (TO) TT=1800.14	? (TO) TT=1800.1	SAT TT=0.059	SAT TT=12.522 CHECKS=6318360	SAT TT=7.207 CHECKS=1934820	SAT TT=7.373 ASSIGNMENTS=6049	? (TO) TT=1800.14	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=169 CHECKS=6990	? (exit code) TT=0.401	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.26	? TT=514.882	? TT=301.651
csp/CabinetStart1/ normalized-cabinet-5593.xml	SAT TT=0.026	? (TO) TT=1800.16	? (TO) TT=1800.17	SAT TT=0.063	SAT TT=6.926 CHECKS=1932440	SAT TT=7.21 CHECKS=1956130	SAT TT=7.13 ASSIGNMENTS=6049	? (TO) TT=1800.07	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.031 ASSIGNMENTS=79 CHECKS=3763	? (exit code) TT=0.408	SAT TT=0.039 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=1476	? TT=3.208	? TT=289.768	? TT=300.662
csp/CabinetStart1/ normalized-cabinet-5594.xml	SAT TT=0.029	? (TO) TT=1800.14	? (TO) TT=1800.12	SAT TT=0.065	SAT TT=10.877 CHECKS=6309110	SAT TT=7.098 CHECKS=1943840	SAT TT=6.89 ASSIGNMENTS=6049	SAT TT=815.095 ASSIGNMENTS=961156	SAT TT=0.035 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.029 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.035 ASSIGNMENTS=165 CHECKS=6524	? (exit code) TT=0.394	SAT TT=0.046 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.031 ASSIGNMENTS=17 CHECKS=1476	? TT=3.718	? TT=278.632	? TT=288.086
csp/CabinetStart1/ normalized-cabinet-5595.xml	SAT TT=0.026	? (TO) TT=1800.07	? (TO) TT=1800.14	SAT TT=0.062	SAT TT=10.823 CHECKS=6292590	SAT TT=6.472 CHECKS=1928350	SAT TT=7.368 ASSIGNMENTS=6049	? (TO) TT=1800.09	SAT TT=0.043 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.042 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.046 ASSIGNMENTS=412 CHECKS=16340	? (exit code) TT=0.436	SAT TT=0.038 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.033 ASSIGNMENTS=17 CHECKS=1476	? TT=3.199	? TT=306.01	? TT=293.023
csp/CabinetStart1/ normalized-cabinet-5596.xml	SAT TT=0.023	? (TO) TT=1800.19	? (TO) TT=1800.17	SAT TT=0.057	SAT TT=7.023 CHECKS=1945790	SAT TT=1.208 CHECKS=601531	SAT TT=6.983 ASSIGNMENTS=6049	? (TO) TT=1800.11	SAT TT=0.053 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.057 ASSIGNMENTS=354 CHECKS=13900	? (exit code) TT=0.392	SAT TT=0.048 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=3.613	? TT=294.481	? TT=286.281
csp/CabinetStart1/ normalized-cabinet-5597.xml	SAT TT=0.025	? (TO) TT=1800.15	? (TO) TT=1800.09	SAT TT=0.062	SAT TT=11.502 CHECKS=6298900	SAT TT=7.221 CHECKS=1943420	SAT TT=7.587 ASSIGNMENTS=6049	? (TO) TT=1800.17	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.025 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.028 ASSIGNMENTS=70 CHECKS=3418	? (exit code) TT=0.415	SAT TT=0.035 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=2.8	? TT=289.985	? TT=315.195
csp/CabinetStart1/ normalized-cabinet-5598.xml	SAT TT=0.026	? (TO) TT=1800.18	? (TO) TT=1800.16	SAT TT=0.058	SAT TT=11.634 CHECKS=6316010	SAT TT=7.012 CHECKS=1933150	SAT TT=7.603 ASSIGNMENTS=6049	? (TO) TT=1800.09	SAT TT=0.042 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.039 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.026 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.034 ASSIGNMENTS=123 CHECKS=6207	? (exit code) TT=0.493	SAT TT=0.041 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.026 ASSIGNMENTS=17 CHECKS=1476	? TT=3.169	? TT=302.984	? TT=312.256
csp/CabinetStart1/ normalized-cabinet-5599.xml	SAT TT=0.023	? (MO) TT=0.908	? (TO) TT=1800.1	SAT TT=0.062	SAT TT=6.721 CHECKS=1957880	SAT TT=7.037 CHECKS=1944160	SAT TT=6.911 ASSIGNMENTS=6049	? (TO) TT=1800.15	SAT TT=0.044 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.038 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.023 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.044 ASSIGNMENTS=313 CHECKS=12973	? (exit code) TT=0.424	SAT TT=0.035 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.023 ASSIGNMENTS=17 CHECKS=1476	? TT=3.312	? TT=293.623	? TT=311.925
csp/CabinetStart1/ normalized-cabinet-5600.xml	SAT TT=0.027	? (TO) TT=1800.15	? (TO) TT=1800.15	SAT TT=0.059	SAT TT=10.735 CHECKS=6302160	SAT TT=6.938 CHECKS=1922710	SAT TT=7.531 ASSIGNMENTS=6049	? (TO) TT=1800.11	SAT TT=0.041 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.027 ASSIGNMENTS=13 CHECKS=1476	SAT TT=0.037 ASSIGNMENTS=196 CHECKS=7555	? (exit code) TT=0.489	SAT TT=0.037 ASSIGNMENTS=95 CHECKS=4624	SAT TT=0.027 ASSIGNMENTS=17 CHECKS=1476	? TT=3.24	? TT=310.159	? TT=312.2
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet02/ normalized-patat-02-comp-10.xml	SAT TT=134.588	? (TO) TT=1800.18	? (TO) TT=1800.24	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.24	? (TO) TT=1800.15	SAT TT=692.986 ASSIGNMENTS=84246 CHECKS=1344450000	SAT TT=1293.95 ASSIGNMENTS=84246 CHECKS=1344450000	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT TT=710.655 ASSIGNMENTS=84246 CHECKS=1344450000	? (TO) TT=1800.22	? (TO) TT=1800.26	SAT TT=134.588
csp/compet02/ normalized-patat-02-comp-11.xml	SAT TT=77.463	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.09	SAT TT=259.776 ASSIGNMENTS=138287 CHECKS=555645000	SAT TT=839.563 ASSIGNMENTS=138287 CHECKS=555645000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.07	SAT TT=265.54 ASSIGNMENTS=138287 CHECKS=555645000	? (TO) TT=1800.22	? (TO) TT=1800.1	SAT TT=77.463
csp/compet02/ normalized-patat-02-comp-12.xml	SAT TT=26.185	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	SAT TT=36.579 ASSIGNMENTS=6853 CHECKS=54223200	SAT TT=613.154 ASSIGNMENTS=6853 CHECKS=54223200	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=122.375 ASSIGNMENTS=35475 CHECKS=242051000	SAT TT=26.185 ASSIGNMENTS=6853 CHECKS=54223200	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=79.482
csp/compet02/ normalized-patat-02-comp-13.xml	SAT TT=87.969	SAT TT=1327.07 CHECKS=808815000 NODES=92749	SAT TT=1467.43 CHECKS=752048000 NODES=77379	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.18	SAT TT=135.36 ASSIGNMENTS=58873 CHECKS=262448000	SAT TT=723.911 ASSIGNMENTS=58873 CHECKS=262448000	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=1390.29 ASSIGNMENTS=463455 CHECKS=2779750000	SAT TT=126.682 ASSIGNMENTS=58873 CHECKS=262448000	? (TO) TT=1800.23	? (TO) TT=1800.12	SAT TT=87.969
csp/compet02/ normalized-patat-02-comp-14.xml	SAT TT=58.726	? (TO) TT=1800.18	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.19	SAT TT=64.249 ASSIGNMENTS=4674 CHECKS=114248000	SAT TT=647.87 ASSIGNMENTS=4674 CHECKS=114248000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=940.265 ASSIGNMENTS=140527 CHECKS=2066530000	SAT TT=58.726 ASSIGNMENTS=4674 CHECKS=114248000	SAT TT=1437.58	SAT TT=1250	SAT TT=108.1
csp/compet02/ normalized-patat-02-comp-15.xml	SAT TT=35.759	SAT TT=1137.45 CHECKS=753690000 NODES=58620	SAT TT=1291.45 CHECKS=944055000 NODES=61033	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=44.948 ASSIGNMENTS=8509 CHECKS=78292300	SAT TT=622.022 ASSIGNMENTS=8509 CHECKS=78292300	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=1538.51 ASSIGNMENTS=692073 CHECKS=3505520000	SAT TT=35.759 ASSIGNMENTS=8509 CHECKS=78292300	SAT TT=571.687	SAT TT=117.464	SAT TT=74.036
csp/compet02/ normalized-patat-02-comp-16.xml	SAT TT=93.319	? (TO) TT=1800.16	? (TO) TT=1800.14	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.08	SAT TT=593.586 ASSIGNMENTS=113917 CHECKS=1175080000	SAT TT=1134.15 ASSIGNMENTS=113917 CHECKS=1175080000	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.03	SAT TT=572.637 ASSIGNMENTS=113917 CHECKS=1175080000	? (TO) TT=1800.16	? (TO) TT=1800.13	SAT TT=93.319
csp/compet02/ normalized-patat-02-comp-17.xml	SAT TT=4.208	SAT TT=4.208 CHECKS=203750 NODES=701	SAT TT=7.197 CHECKS=753287 NODES=1321	? (TO) TT=1800.02	SAT TT=551.247 CHECKS=56347400	SAT TT=35.985 CHECKS=15863600	? (TO) TT=1800.16	? (TO) TT=1800.11	SAT TT=19.105 ASSIGNMENTS=35191 CHECKS=17468500	SAT TT=11.934 ASSIGNMENTS=700 CHECKS=203676	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.09	SAT TT=12.793 ASSIGNMENTS=35191 CHECKS=17468500	SAT TT=48.554	SAT TT=21.29	SAT TT=58.944
csp/compet02/ normalized-patat-02-comp-18.xml	SAT TT=58.771	SAT TT=642.684 CHECKS=265005000 NODES=87433	SAT TT=812.173 CHECKS=353601000 NODES=117232	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.18	? (TO) TT=1800.1	SAT TT=98.957 ASSIGNMENTS=82584 CHECKS=200948000	SAT TT=671.211 ASSIGNMENTS=82584 CHECKS=200948000	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=974.014 ASSIGNMENTS=1046680 CHECKS=2463870000	SAT TT=87.382 ASSIGNMENTS=82584 CHECKS=200948000	? (TO) TT=1800.26	? (TO) TT=1800.07	SAT TT=58.771
csp/compet02/ normalized-patat-02-comp-19.xml	SAT TT=121.312	? (TO) TT=1800.21	? (TO) TT=1800.19	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.46	SAT TT=131.284 ASSIGNMENTS=20467 CHECKS=234105000	SAT TT=716.911 ASSIGNMENTS=20467 CHECKS=234105000	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=1202.43 ASSIGNMENTS=217261 CHECKS=2546930000	SAT TT=121.312 ASSIGNMENTS=20467 CHECKS=234105000	? (TO) TT=1800.22	? (TO) TT=1800.2	SAT TT=152.128
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet02/ normalized-patat-02-comp-1.xml	SAT TT=80.874	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.13	SAT TT=219.409 ASSIGNMENTS=104575 CHECKS=454103000	SAT TT=795.316 ASSIGNMENTS=104575 CHECKS=454103000	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=194.779 ASSIGNMENTS=104575 CHECKS=454103000	? (TO) TT=1800.21	SAT TT=604.875	SAT TT=80.874
csp/compet02/ normalized-patat-02-comp-20.xml	SAT TT=115.765	? (TO) TT=1800.16	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.16	SAT TT=390.815 ASSIGNMENTS=42542 CHECKS=765043000	SAT TT=946.44 ASSIGNMENTS=42542 CHECKS=765043000	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=393.952 ASSIGNMENTS=42542 CHECKS=765043000	? (TO) TT=1800.38	SAT TT=1340.7	SAT TT=115.765
csp/compet02/ normalized-patat-02-comp-2.xml	SAT TT=53.35	SAT TT=808.007 CHECKS=299921000 NODES=57280	SAT TT=627.033 CHECKS=203021000 NODES=40232	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.15	SAT TT=58.378 ASSIGNMENTS=24100 CHECKS=111248000	SAT TT=644.269 ASSIGNMENTS=24100 CHECKS=111248000	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.05	SAT TT=1213.83 ASSIGNMENTS=359442 CHECKS=2406700000	SAT TT=53.35 ASSIGNMENTS=24100 CHECKS=111248000	? (TO) TT=1800.23	SAT TT=534.13	SAT TT=64.55
csp/compet02/ normalized-patat-02-comp-3.xml	SAT TT=82.25	? (TO) TT=1800.15	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.2	SAT TT=183.08 ASSIGNMENTS=60977 CHECKS=335861000	SAT TT=750.984 ASSIGNMENTS=60977 CHECKS=335861000	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.08	SAT TT=894.441 ASSIGNMENTS=319269 CHECKS=1890540000	SAT TT=151.029 ASSIGNMENTS=60977 CHECKS=335861000	? (TO) TT=1800.19	? (TO) TT=1800.14	SAT TT=82.25
csp/compet02/ normalized-patat-02-comp-4.xml	SAT TT=96.841	? (TO) TT=1800.18	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.11	SAT TT=96.841 ASSIGNMENTS=16165 CHECKS=196125000	SAT TT=687.867 ASSIGNMENTS=16165 CHECKS=196125000	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT TT=97.039 ASSIGNMENTS=16165 CHECKS=196125000	? (TO) TT=1800.24	SAT TT=941.351	SAT TT=105.118
csp/compet02/ normalized-patat-02-comp-5.xml	SAT TT=19.167	SAT TT=506.75 CHECKS=359389000 NODES=46435	SAT TT=543.617 CHECKS=374466000 NODES=55990	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=27.08 ASSIGNMENTS=5744 CHECKS=43689400	SAT TT=485.644 ASSIGNMENTS=46427 CHECKS=359389000	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=179.91 ASSIGNMENTS=91967 CHECKS=387997000	SAT TT=19.167 ASSIGNMENTS=5744 CHECKS=43689400	SAT TT=290.227	SAT TT=25.382	SAT TT=61.555
csp/compet02/ normalized-patat-02-comp-6.xml	SAT TT=118.276	? (TO) TT=1800.23	? (MO) TT=11.965	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.18	SAT TT=203.776 ASSIGNMENTS=24672 CHECKS=382082000	SAT TT=769.533 ASSIGNMENTS=24672 CHECKS=382082000	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=1246.69 ASSIGNMENTS=194898 CHECKS=2565580000	SAT TT=178.667 ASSIGNMENTS=24672 CHECKS=382082000	? (TO) TT=1800.15	SAT TT=1389.13	SAT TT=118.276
csp/compet02/ normalized-patat-02-comp-7.xml	SAT TT=28.608	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=43.295 ASSIGNMENTS=9034 CHECKS=61085600	SAT TT=619.01 ASSIGNMENTS=9034 CHECKS=61085600	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.06	SAT TT=668.211 ASSIGNMENTS=185111 CHECKS=1327920000	SAT TT=28.608 ASSIGNMENTS=9034 CHECKS=61085600	SAT TT=1261.71	SAT TT=1345.61	SAT TT=105.455
csp/compet02/ normalized-patat-02-comp-8.xml	SAT TT=111.339	? (TO) TT=1800.18	? (TO) TT=1800.22	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.1	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=502.63 ASSIGNMENTS=139601 CHECKS=890948000	SAT TT=1038.26 ASSIGNMENTS=139601 CHECKS=890948000	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=433.424 ASSIGNMENTS=139601 CHECKS=890948000	? (TO) TT=1800.21	? (TO) TT=1800.21	SAT TT=111.339
csp/compet02/ normalized-patat-02-comp-9.xml	SAT TT=108.522	? (TO) TT=1800.13	? (TO) TT=1800.18	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.56	SAT TT=139.079 ASSIGNMENTS=39218 CHECKS=264211000	SAT TT=709.006 ASSIGNMENTS=39218 CHECKS=264211000	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT TT=1619.29 ASSIGNMENTS=139259 CHECKS=3226830000	SAT TT=121.335 ASSIGNMENTS=39218 CHECKS=264211000	? (TO) TT=1802.2	? (TO) TT=1800.12	SAT TT=108.522
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet08/ normalized-patat-08-comp-10.xml	SAT TT=1.68	SAT TT=40.109 CHECKS=4472790 NODES=4074	SAT TT=11.868 CHECKS=1821520 NODES=400	? (TO) TT=1800.1	SAT TT=54.27 CHECKS=4875970	SAT TT=20.187 CHECKS=3019170	? (TO) TT=1800.16	? (TO) TT=1800.17	SAT TT=1.716 ASSIGNMENTS=495 CHECKS=1177090	SAT TT=2.055 ASSIGNMENTS=495 CHECKS=1177090	SAT TT=2.025 ASSIGNMENTS=583 CHECKS=1493780	SAT TT=19.867 ASSIGNMENTS=62294 CHECKS=27272000	? (TO) TT=1800.09	SAT TT=419.434 ASSIGNMENTS=74541 CHECKS=336582000	SAT TT=1.68 ASSIGNMENTS=495 CHECKS=1177120	SAT TT=273.877	SAT TT=86.484	SAT TT=112.281
csp/compet08/ normalized-patat-08-comp-11.xml	SAT TT=6.158	SAT TT=31.406 CHECKS=4692210 NODES=2919	SAT TT=35.457 CHECKS=6886030 NODES=2919	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.32	? (TO) TT=1800.14	SAT TT=14.402 ASSIGNMENTS=1941 CHECKS=8182670	SAT TT=36.168 ASSIGNMENTS=2919 CHECKS=4692210	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT TT=37.738 ASSIGNMENTS=16959 CHECKS=52534400	SAT TT=6.158 ASSIGNMENTS=1941 CHECKS=8182670	SAT TT=416.181	SAT TT=91.105	SAT TT=120.096
csp/compet08/ normalized-patat-08-comp-12.xml	SAT TT=70.648	SAT TT=375.454 CHECKS=102136000 NODES=25564	SAT TT=242.452 CHECKS=69648000 NODES=13641	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.2	SAT TT=92.454 ASSIGNMENTS=17376 CHECKS=132872000	SAT TT=344.985 ASSIGNMENTS=25564 CHECKS=102136000	? (TO) TT=1800.11	SAT TT=96.854 ASSIGNMENTS=48703 CHECKS=142565000	? (TO) TT=1800.05	SAT TT=70.648 ASSIGNMENTS=25904 CHECKS=118730000	SAT TT=88.791 ASSIGNMENTS=17376 CHECKS=132872000	? (TO) TT=1800.1	SAT TT=172.851	SAT TT=137.686
csp/compet08/ normalized-patat-08-comp-13.xml	SAT TT=11.438	SAT TT=110.813 CHECKS=26200300 NODES=10815	SAT TT=208.905 CHECKS=59178400 NODES=19170	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.45	SAT TT=21.316 ASSIGNMENTS=3472 CHECKS=15885400	SAT TT=113.58 ASSIGNMENTS=10815 CHECKS=26200300	? (TO) TT=1800.03	SAT TT=65.153 ASSIGNMENTS=45129 CHECKS=104727000	? (TO) TT=1800.08	SAT TT=59.829 ASSIGNMENTS=27896 CHECKS=97781400	SAT TT=11.438 ASSIGNMENTS=3472 CHECKS=15885400	SAT TT=1191.88	SAT TT=91.213	SAT TT=138.781
csp/compet08/ normalized-patat-08-comp-14.xml	SAT TT=143.661	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT TT=726.095 ASSIGNMENTS=72370 CHECKS=201719000	SAT TT=733.155 ASSIGNMENTS=72370 CHECKS=201719000	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.11	SAT TT=233.838 ASSIGNMENTS=143690 CHECKS=283600000	SAT TT=143.661 ASSIGNMENTS=72370 CHECKS=201719000	? (TO) TT=1800.18	? (TO) TT=1800.03	SAT TT=168.193
csp/compet08/ normalized-patat-08-comp-15.xml	SAT TT=0.982	SAT TT=4.43 CHECKS=40242 NODES=1027	SAT TT=10.326 CHECKS=237524 NODES=4484	SAT TT=0.982	SAT TT=372.537 CHECKS=80784700	SAT TT=92.412 CHECKS=18466700	SAT TT=146.961 ASSIGNMENTS=1213	? (TO) TT=1800.06	SAT TT=11.373 ASSIGNMENTS=1027 CHECKS=40242	SAT TT=10.65 ASSIGNMENTS=1027 CHECKS=40242	SAT TT=9.839 ASSIGNMENTS=5948 CHECKS=12719200	SAT TT=5.814 ASSIGNMENTS=25245 CHECKS=6592620	? (TO) TT=1800.08	SAT TT=11.281 ASSIGNMENTS=9916 CHECKS=11706100	SAT TT=1.044 ASSIGNMENTS=690 CHECKS=1105840	SAT TT=16.013	SAT TT=43.605	SAT TT=44.627
csp/compet08/ normalized-patat-08-comp-16.xml		? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.26	? TT=129.916	? TT=144.883
csp/compet08/ normalized-patat-08-comp-1.xml		? (TO) TT=1800.19	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.19	? TT=236.659	? TT=215.385
csp/compet08/ normalized-patat-08-comp-2.xml		? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.01	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.09
csp/compet08/ normalized-patat-08-comp-3.xml	SAT TT=21.456	? (TO) TT=1800.09	SAT TT=170.485 CHECKS=14354600 NODES=16755	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.1	SAT TT=29.066 ASSIGNMENTS=4645 CHECKS=27233800	SAT TT=607.954 ASSIGNMENTS=4645 CHECKS=27233800	? (TO) TT=1800.02	SAT TT=35.024 ASSIGNMENTS=25346 CHECKS=35904700	? (TO) TT=1800.11	SAT TT=58.951 ASSIGNMENTS=19407 CHECKS=79247000	SAT TT=21.456 ASSIGNMENTS=4645 CHECKS=27233800	SAT TT=135.524	SAT TT=94.946	SAT TT=138.493
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/compet08/ normalized-patat-08-comp-4.xml	SAT TT=133.767	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.18	SAT TT=1052.03 ASSIGNMENTS=173060 CHECKS=1164580000	SAT TT=1663.61 ASSIGNMENTS=173060 CHECKS=1164580000	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=1100.25 ASSIGNMENTS=173060 CHECKS=1164580000	? (TO) TT=1800.18	? (TO) TT=1800.03	SAT TT=133.767
csp/compet08/ normalized-patat-08-comp-5.xml	SAT TT=57.047	? (TO) TT=1800.21	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.12	SAT TT=66.263 ASSIGNMENTS=8100 CHECKS=90123900	SAT TT=651.429 ASSIGNMENTS=8100 CHECKS=90123900	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	SAT TT=794.575 ASSIGNMENTS=115106 CHECKS=1203800000	SAT TT=57.047 ASSIGNMENTS=8100 CHECKS=90123900	? (TO) TT=1800.19	SAT TT=474.855	SAT TT=178.162
csp/compet08/ normalized-patat-08-comp-6.xml	SAT TT=148.249	? (TO) TT=1800.13	SAT TT=1327.2 CHECKS=392426000 NODES=69848	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.49	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT TT=1402.25 ASSIGNMENTS=194941 CHECKS=2063610000	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=148.249
csp/compet08/ normalized-patat-08-comp-7.xml	SAT TT=7.703	SAT TT=27.343 CHECKS=972732 NODES=10794	SAT TT=258.025 CHECKS=15164400 NODES=121326	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=88.107 CHECKS=22813100	SAT TT=240.311 ASSIGNMENTS=3580	? (TO) TT=1800.12	SAT TT=34.978 ASSIGNMENTS=10794 CHECKS=972732	SAT TT=33.434 ASSIGNMENTS=10794 CHECKS=972732	SAT TT=7.703 ASSIGNMENTS=3699 CHECKS=10423400	SAT TT=365.843 ASSIGNMENTS=163208 CHECKS=406517000	? (TO) TT=1800.04	SAT TT=35.498 ASSIGNMENTS=17617 CHECKS=33312300	SAT TT=29.984 ASSIGNMENTS=12717 CHECKS=42440800	SAT TT=20.636	SAT TT=37.686	SAT TT=47.454
csp/compet08/ normalized-patat-08-comp-8.xml	SAT TT=0.885	SAT TT=6.316 CHECKS=71895 NODES=1793	SAT TT=5.707 CHECKS=80973 NODES=419	? (TO) TT=1800.1	SAT TT=14.183 CHECKS=1449550	SAT TT=25.981 CHECKS=6206090	? (TO) TT=1800.12	? (TO) TT=1800.11	SAT TT=12.312 ASSIGNMENTS=1793 CHECKS=71895	SAT TT=12.602 ASSIGNMENTS=1793 CHECKS=71895	SAT TT=5.669 ASSIGNMENTS=5469 CHECKS=5811230	SAT TT=6.128 ASSIGNMENTS=29278 CHECKS=8316910	? (TO) TT=1800.04	SAT TT=6.125 ASSIGNMENTS=8113 CHECKS=4643160	SAT TT=0.885 ASSIGNMENTS=742 CHECKS=672528	SAT TT=17.614	SAT TT=33.727	SAT TT=46.678
csp/compet08/ normalized-patat-08-comp-9.xml		? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.26	? TT=449.991	? TT=467.154
csp/medium/ normalized-patat-02-medium-1.xml	SAT TT=128.007	? (TO) TT=1800.14	? (TO) TT=1800.17	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.2	? (TO) TT=1800.15	SAT TT=1738.73 ASSIGNMENTS=250470 CHECKS=3520620000	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1692.09 ASSIGNMENTS=250470 CHECKS=3520620000	? (TO) TT=1800.14	? (TO) TT=1800.09	SAT TT=128.007
csp/medium/ normalized-patat-02-medium-2.xml	SAT TT=102.676	? (TO) TT=1800.23	? (TO) TT=1800.17	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.21	? (TO) TT=1800.11	SAT TT=115.198 ASSIGNMENTS=14243 CHECKS=219525000	SAT TT=703.06 ASSIGNMENTS=14243 CHECKS=219525000	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=102.676 ASSIGNMENTS=14243 CHECKS=219525000	? (TO) TT=1800.13	? (TO) TT=1800.23	SAT TT=120.645
csp/medium/ normalized-patat-02-medium-3.xml	SAT TT=121.831	? (TO) TT=1800.19	? (TO) TT=1800.19	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.15	? (TO) TT=1800.2	SAT TT=187.465 ASSIGNMENTS=20329 CHECKS=365668000	SAT TT=777.083 ASSIGNMENTS=20329 CHECKS=365668000	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	SAT TT=166.621 ASSIGNMENTS=20329 CHECKS=365668000	? (TO) TT=1800.12	? (TO) TT=1800.26	SAT TT=121.831
csp/medium/ normalized-patat-02-medium-4.xml	SAT TT=118.807	? (TO) TT=1800.17	? (TO) TT=1800.23	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.2	SAT TT=1008.44 ASSIGNMENTS=187436 CHECKS=2144250000	SAT TT=1560.57 ASSIGNMENTS=187436 CHECKS=2144250000	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=965.629 ASSIGNMENTS=187436 CHECKS=2144250000	? (TO) TT=1800.17	? (TO) TT=1800.03	SAT TT=118.807
Bench name	Best results on this instance	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Minion/Tailor 2008-07-04	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
csp/medium/ normalized-patat-02-medium-5.xml	SAT TT=93.899	? (TO) TT=1800.19	? (TO) TT=1800.2	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.12	SAT TT=407.486 ASSIGNMENTS=185341 CHECKS=887187000	SAT TT=997.173 ASSIGNMENTS=185341 CHECKS=887187000	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.03	? (TO) TT=1800.03	SAT TT=383.096 ASSIGNMENTS=185341 CHECKS=887187000	? (TO) TT=1802.23	? (TO) TT=1800.15	SAT TT=93.899
csp/small/ normalized-patat-02-small-1.xml	SAT TT=2.246	SAT TT=2.246 CHECKS=248439 NODES=200	SAT TT=3.548 CHECKS=1261610 NODES=200	? (TO) TT=1800.04	SAT TT=6.719 CHECKS=235929	SAT TT=18.548 CHECKS=9720380	? (TO) TT=1800.06	SAT TT=34.303 ASSIGNMENTS=153	SAT TT=9.454 ASSIGNMENTS=200 CHECKS=248434	SAT TT=9.822 ASSIGNMENTS=200 CHECKS=248434	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	SAT TT=3.509 ASSIGNMENTS=9656 CHECKS=4751710	SAT TT=484.021 ASSIGNMENTS=1830860 CHECKS=974192000	SAT TT=33.558	SAT TT=3.436	SAT TT=7.659
csp/small/ normalized-patat-02-small-2.xml	SAT TT=0.125	SAT TT=2.165 CHECKS=154858 NODES=200	SAT TT=2.061 CHECKS=169805 NODES=0	SAT TT=0.412	SAT TT=5.269 CHECKS=214990	SAT TT=0.382 CHECKS=121917	SAT TT=3.772 ASSIGNMENTS=167	SAT TT=16.793 ASSIGNMENTS=156	SAT TT=0.138 ASSIGNMENTS=158 CHECKS=66591	SAT TT=0.143 ASSIGNMENTS=158 CHECKS=66591	SAT TT=0.125 ASSIGNMENTS=158 CHECKS=66591	SAT TT=2.046 ASSIGNMENTS=33407 CHECKS=8528350	? (TO) TT=1800.06	SAT TT=0.831 ASSIGNMENTS=3613 CHECKS=1547600	SAT TT=0.126 ASSIGNMENTS=139 CHECKS=66615	SAT TT=24.257	SAT TT=3.723	SAT TT=8.377
csp/small/ normalized-patat-02-small-3.xml	SAT TT=0.659	SAT TT=2.772 CHECKS=513869 NODES=201	SAT TT=3.337 CHECKS=1094460 NODES=201	? (TO) TT=1800.12	SAT TT=7.484 CHECKS=222639	SAT TT=16.811 CHECKS=10235300	? (TO) TT=1800.14	SAT TT=39.457 ASSIGNMENTS=211	SAT TT=9.753 ASSIGNMENTS=200 CHECKS=512913	SAT TT=9.783 ASSIGNMENTS=200 CHECKS=512913	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=4.437 ASSIGNMENTS=8774 CHECKS=4579590	SAT TT=0.659 ASSIGNMENTS=2590 CHECKS=1915760	SAT TT=53.908	SAT TT=3.583	SAT TT=7.228
csp/small/ normalized-patat-02-small-4.xml	SAT TT=4.585	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=25.632 CHECKS=7305160	SAT TT=20.977 CHECKS=11513500	? (TO) TT=1800.16	SAT TT=68.478 ASSIGNMENTS=2523	SAT TT=426.806 ASSIGNMENTS=600158 CHECKS=285535000	SAT TT=985.394 ASSIGNMENTS=600158 CHECKS=285535000	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.04	SAT TT=226.958 ASSIGNMENTS=600158 CHECKS=285535000	SAT TT=105.211	SAT TT=4.585	SAT TT=7.664
csp/small/ normalized-patat-02-small-5.xml	SAT TT=0.864	SAT TT=26.032 CHECKS=18919200 NODES=23758	SAT TT=28.841 CHECKS=20000100 NODES=23853	? (TO) TT=1800.02	SAT TT=8.955 CHECKS=299335	SAT TT=18.581 CHECKS=9147290	? (TO) TT=1800.11	SAT TT=43.203 ASSIGNMENTS=167	SAT TT=88.955 ASSIGNMENTS=51260 CHECKS=40277400	SAT TT=57.561 ASSIGNMENTS=51260 CHECKS=40277400	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=5.275 ASSIGNMENTS=9112 CHECKS=5625750	SAT TT=0.864 ASSIGNMENTS=2302 CHECKS=1525810	SAT TT=72.073	SAT TT=5.685	SAT TT=11.379

Some statistics...

	Abscon 112v4 AC	Abscon 112v4 ESAC	bpsolver 2008-06-27	casper zao	casper zito	choco2_dwdeg 2008-06-26	choco2_impwdeg 2008-06-26	cpHydra k_10	cpHydra k_40	MDG-noprobe 2008-06-27	MDG-probe 2008-06-27	Mistral-option 1.314	Mistral-prime 1.313	SAT4J CSP 2008-06-13	Sugar v1.13+minisat	Sugar v1.13+picosat
Number of times the solver is able to give the best known answer	17	19	42	49	50	43	11	81	80	45	48	67	81	17	24	42
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	17	19	42	49	50	43	11	81	80	45	48	67	81	17	24	42
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	2	0	21	0	0	0	0	1	0	17	0	1	27	0	1	17
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0