CSP 2009 Competition: results by benchmark

Results by benchmark for category alldiff (Alldiff)

This page displays the results of the different solvers for each benchmark for category alldiff (Alldiff)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC (complete)
Abscon 112v4 ESAC (complete)
bpsolver 09 (complete)
Choco2.1.1 2009-06-10 (complete)
Choco2.1.1b 2009-07-16 (complete)
Concrete 2009-07-14 (complete)
Concrete DC 2009-07-14 (complete)
Mistral 1.545 (complete)
SAT4J CSP 2.1.1 (complete)
Sugar v1.14.6+minisat (complete)
Sugar v1.14.6+picosat (complete)

Bench name	Best results on this instance	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-17_glb.xml	SAT TT=0.013	SAT TT=0.792	SAT TT=0.869	SAT TT=0.05	SAT TT=0.919	SAT TT=0.873	SAT TT=0.949	SAT TT=6.287	SAT TT=0.013	SAT TT=1.068	SAT TT=1.108	SAT TT=1.148
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-35_glb.xml	SAT TT=0.022	SAT TT=0.766	SAT TT=0.8	SAT TT=0.042	SAT TT=0.892	SAT TT=0.831	SAT TT=0.943	SAT TT=1.473	SAT TT=0.022	SAT TT=0.808	SAT TT=1.136	SAT TT=1.236
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-52_glb.xml	SAT TT=0.018	SAT TT=0.813	SAT TT=0.884	SAT TT=0.079	SAT TT=0.949	SAT TT=0.895	SAT TT=0.944	SAT TT=1.69	SAT TT=0.018	SAT TT=1.035	SAT TT=1.169	SAT TT=1.273
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-56_glb.xml	SAT TT=0.042	SAT TT=0.855	SAT TT=0.848	SAT TT=0.047	SAT TT=0.948	SAT TT=0.989	SAT TT=1.005	SAT TT=1.583	SAT TT=0.042	SAT TT=1.13	SAT TT=1.163	SAT TT=1.229
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-57_glb.xml	SAT TT=0.032	SAT TT=0.818	SAT TT=0.926	SAT TT=0.047	SAT TT=0.772	SAT TT=0.794	SAT TT=0.982	SAT TT=2.124	SAT TT=0.032	SAT TT=0.902	SAT TT=1.17	SAT TT=1.433
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-63_glb.xml	SAT TT=0.014	SAT TT=0.871	SAT TT=0.955	SAT TT=0.045	SAT TT=0.707	SAT TT=0.731	SAT TT=1.016	SAT TT=2.493	SAT TT=0.014	SAT TT=0.917	SAT TT=1.134	SAT TT=1.203
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-78_glb.xml	SAT TT=0.024	SAT TT=0.827	SAT TT=0.809	SAT TT=0.044	SAT TT=0.524	SAT TT=0.558	SAT TT=0.961	SAT TT=1.225	SAT TT=0.024	SAT TT=1.217	SAT TT=1.143	SAT TT=1.181
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-79_glb.xml	SAT TT=0.03	SAT TT=0.811	SAT TT=0.891	SAT TT=0.045	SAT TT=0.819	SAT TT=0.846	SAT TT=0.885	SAT TT=3.237	SAT TT=0.03	SAT TT=0.867	SAT TT=1.272	SAT TT=1.154
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-83_glb.xml	SAT TT=0.023	SAT TT=0.864	SAT TT=0.892	SAT TT=0.045	SAT TT=0.843	SAT TT=0.879	SAT TT=0.925	SAT TT=1.515	SAT TT=0.023	SAT TT=1.233	SAT TT=1.172	SAT TT=1.225
csp/bqwh-15-106_glb/ normalized-bqwh-15-106-90_glb.xml	SAT TT=0.034	SAT TT=0.852	SAT TT=0.873	SAT TT=0.044	SAT TT=0.836	SAT TT=0.797	SAT TT=0.974	SAT TT=2.422	SAT TT=0.034	SAT TT=0.85	SAT TT=1.087	SAT TT=1.128
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-17_glb.xml	SAT TT=0.064	SAT TT=1.115	SAT TT=1.089	SAT TT=0.07	SAT TT=0.712	SAT TT=0.746	SAT TT=1.721	SAT TT=5.679	SAT TT=0.064	SAT TT=1.345	SAT TT=1.254	SAT TT=1.326
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-21_glb.xml	SAT TT=0.145	SAT TT=1.119	SAT TT=0.887	SAT TT=0.668	SAT TT=0.904	SAT TT=0.891	SAT TT=1.155	SAT TT=5.472	SAT TT=0.145	SAT TT=1.25	SAT TT=1.279	SAT TT=1.307
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-23_glb.xml	SAT TT=0.056	SAT TT=1.086	SAT TT=1.004	SAT TT=0.056	SAT TT=0.715	SAT TT=0.688	SAT TT=1.063	SAT TT=2.698	SAT TT=0.374	SAT TT=1.201	SAT TT=1.488	SAT TT=1.347
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-38_glb.xml	SAT TT=0.272	SAT TT=1.076	SAT TT=1.458	SAT TT=0.272	SAT TT=1.099	SAT TT=1.182	SAT TT=1.013	SAT TT=2.792	SAT TT=0.804	SAT TT=1.328	SAT TT=1.223	SAT TT=1.363
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-5_glb.xml	SAT TT=0.117	SAT TT=2.199	SAT TT=1.016	SAT TT=0.322	SAT TT=1.12	SAT TT=1.131	SAT TT=1.521	SAT TT=2.718	SAT TT=0.117	SAT TT=1.412	SAT TT=1.272	SAT TT=1.602
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-62_glb.xml	SAT TT=0.058	SAT TT=1.389	SAT TT=0.991	SAT TT=0.058	SAT TT=1.14	SAT TT=1.071	SAT TT=1.228	SAT TT=2.525	SAT TT=0.095	SAT TT=1.18	SAT TT=1.392	SAT TT=1.355
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-65_glb.xml	SAT TT=0.135	SAT TT=0.836	SAT TT=1.224	SAT TT=0.135	SAT TT=0.735	SAT TT=0.716	SAT TT=2.233	SAT TT=4.695	SAT TT=0.684	SAT TT=1.188	SAT TT=1.417	SAT TT=1.337
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-73_glb.xml	SAT TT=0.218	SAT TT=1.394	SAT TT=1.452	SAT TT=0.711	SAT TT=1.244	SAT TT=1.224	SAT TT=2.032	SAT TT=3.432	SAT TT=0.218	SAT TT=1.782	SAT TT=1.372	SAT TT=1.598
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-74_glb.xml	SAT TT=0.027	SAT TT=1.111	SAT TT=0.994	SAT TT=4.763	SAT TT=1.123	SAT TT=1.036	SAT TT=1.378	SAT TT=2.394	SAT TT=0.027	SAT TT=1.422	SAT TT=1.284	SAT TT=1.327
csp/bqwh-18-141_glb/ normalized-bqwh-18-141-76_glb.xml	SAT TT=0.181	SAT TT=0.979	SAT TT=1.611	SAT TT=0.181	SAT TT=1.165	SAT TT=1.106	SAT TT=1.007	SAT TT=4.259	SAT TT=0.545	SAT TT=1.24	SAT TT=1.303	SAT TT=1.568
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/compet02/ normalized-patat-02-comp-10.xml	SAT TT=125.758	? (TO) TT=1800.14	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.17	SAT TT=125.758
csp/compet02/ normalized-patat-02-comp-11.xml	SAT TT=65.374	? (TO) TT=1800.17	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.09	SAT TT=65.374	? (TO) TT=1800.29	? (TO) TT=1800.08	SAT TT=76.826
csp/compet02/ normalized-patat-02-comp-12.xml	SAT TT=43.561	? (TO) TT=1800.13	? (TO) TT=1800.23	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.06	SAT TT=43.561	? (TO) TT=1800.33	? (TO) TT=1800.07	SAT TT=77.566
csp/compet02/ normalized-patat-02-comp-13.xml	SAT TT=83.048	SAT TT=1295.63	SAT TT=1450.94	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.05	? (TO) TT=1800.09	SAT TT=99.489	? (TO) TT=1800.36	? (TO) TT=1800.11	SAT TT=83.048
csp/compet02/ normalized-patat-02-comp-14.xml	SAT TT=104.91	? (TO) TT=1800.11	SAT TT=1601.53	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.08	SAT TT=155.555	SAT TT=1757.28	SAT TT=464.562	SAT TT=104.91
csp/compet02/ normalized-patat-02-comp-15.xml	SAT TT=80.284	SAT TT=1112.88	SAT TT=1271.99	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=91.885	SAT TT=719.119	SAT TT=377.563	SAT TT=80.284
csp/compet02/ normalized-patat-02-comp-16.xml	SAT TT=98.933	? (TO) TT=1800.17	? (TO) TT=1800.21	? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.01	SAT TT=207.516	? (TO) TT=1800.18	? (TO) TT=1800.12	SAT TT=98.933
csp/compet02/ normalized-patat-02-comp-17.xml	SAT TT=0.598	SAT TT=4.197	SAT TT=7.305	? (TO) TT=1800.06	SAT TT=118.625	SAT TT=101.647	? (TO) TT=1800.1	? (TO) TT=1800	SAT TT=0.598	SAT TT=54.785	SAT TT=21.468	SAT TT=54.657
csp/compet02/ normalized-patat-02-comp-18.xml	SAT TT=37.567	SAT TT=632.064	? (MO) TT=5.71	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.09	SAT TT=37.567	? (TO) TT=1800.37	? (TO) TT=1800.01	SAT TT=56.474
csp/compet02/ normalized-patat-02-comp-19.xml	SAT TT=149.487	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800	SAT TT=297.758	? (TO) TT=1800.13	? (MO) TT=1661.21	SAT TT=149.487
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/compet02/ normalized-patat-02-comp-1.xml	SAT TT=68.035	? (TO) TT=1800.21	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.03	SAT TT=68.035	? (TO) TT=1800.34	SAT TT=908.51	SAT TT=81.832
csp/compet02/ normalized-patat-02-comp-20.xml	SAT TT=109.014	? (TO) TT=1800.16	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.19	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800	SAT TT=141.142	? (TO) TT=1800.16	SAT TT=1074.25	SAT TT=109.014
csp/compet02/ normalized-patat-02-comp-2.xml	SAT TT=63.816	SAT TT=742.12	SAT TT=509.76	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.04	SAT TT=186.724	? (TO) TT=1800.34	SAT TT=660.532	SAT TT=63.816
csp/compet02/ normalized-patat-02-comp-3.xml	SAT TT=78.075	? (TO) TT=1800.23	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=135.683	? (TO) TT=1800.17	? (TO) TT=1800.07	SAT TT=78.075
csp/compet02/ normalized-patat-02-comp-4.xml	SAT TT=58.62	? (TO) TT=1800.21	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=58.62	? (TO) TT=1800.33	SAT TT=965.11	SAT TT=102.104
csp/compet02/ normalized-patat-02-comp-5.xml	SAT TT=10.612	SAT TT=466.811	SAT TT=507.381	? (TO) TT=1800.09	? (TO) TT=1800.15	? (TO) TT=1800.13	SAT TT=654.831	? (TO) TT=1800.08	SAT TT=10.612	SAT TT=374.735	SAT TT=24.266	SAT TT=61.587
csp/compet02/ normalized-patat-02-comp-6.xml	SAT TT=53.119	? (TO) TT=1800.15	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=53.119	? (TO) TT=1800.14	? (TO) TT=1800.21	SAT TT=111.098
csp/compet02/ normalized-patat-02-comp-7.xml	SAT TT=71.4	? (TO) TT=1800.13	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.22	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT TT=71.4	SAT TT=1538.06	SAT TT=1546.22	SAT TT=102.008
csp/compet02/ normalized-patat-02-comp-8.xml	SAT TT=91.414	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.21	? (TO) TT=1800.04	? (TO) TT=1800.01	SAT TT=91.414	? (TO) TT=1800.17	? (TO) TT=1800.19	SAT TT=108.54
csp/compet02/ normalized-patat-02-comp-9.xml	SAT TT=97.3	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.07	SAT TT=97.3	? (TO) TT=1800.29	? (TO) TT=1800.11	SAT TT=98.371
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/compet08/ normalized-patat-08-comp-10.xml	SAT TT=1.078	SAT TT=38.603	SAT TT=11.772	? (TO) TT=1800.02	SAT TT=254.593	SAT TT=264.167	SAT TT=91.012	SAT TT=429.196	SAT TT=1.078	SAT TT=374.759	SAT TT=89.568	SAT TT=111.072
csp/compet08/ normalized-patat-08-comp-11.xml	SAT TT=7.884	SAT TT=31.213	SAT TT=33.79	? (TO) TT=1800.07	SAT TT=579.458	SAT TT=335.232	SAT TT=144.843	SAT TT=588.942	SAT TT=7.884	SAT TT=486.878	SAT TT=82.837	SAT TT=145.865
csp/compet08/ normalized-patat-08-comp-12.xml	SAT TT=23.135	SAT TT=347.934	SAT TT=244.406	? (TO) TT=1800.08	SAT TT=1492.89	? (TO) TT=1800.1	SAT TT=1735.75	? (TO) TT=1800	SAT TT=23.135	? (TO) TT=1800.15	SAT TT=303.713	SAT TT=142.876
csp/compet08/ normalized-patat-08-comp-13.xml	SAT TT=8.715	SAT TT=107.267	SAT TT=205.104	? (TO) TT=1800.11	SAT TT=817.547	SAT TT=1318.24	? (TO) TT=1800.05	? (TO) TT=1800.05	SAT TT=8.715	SAT TT=1644.39	SAT TT=91.398	SAT TT=131.588
csp/compet08/ normalized-patat-08-comp-14.xml	SAT TT=105.254	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.08	SAT TT=1754.57	SAT TT=478.394	SAT TT=840.116	? (TO) TT=1800.04	SAT TT=105.254
csp/compet08/ normalized-patat-08-comp-15.xml	SAT TT=0.407	SAT TT=4.357	SAT TT=10.12	? (TO) TT=1800.07	SAT TT=91.962	SAT TT=102.957	SAT TT=9.442	SAT TT=113.367	SAT TT=0.407	SAT TT=15.837	SAT TT=38.365	SAT TT=45.498
csp/compet08/ normalized-patat-08-comp-16.xml		? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.21	? (TO) TT=1800.23	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.27	? TT=142.055	? TT=161.274
csp/compet08/ normalized-patat-08-comp-1.xml		? (TO) TT=1800.2	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.44	? TT=241.74	? TT=236.727
csp/compet08/ normalized-patat-08-comp-2.xml		? (TO) TT=1800.17	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.09
csp/compet08/ normalized-patat-08-comp-3.xml	SAT TT=7.293	? (TO) TT=1800.15	SAT TT=166.783	? (TO) TT=1800.03	SAT TT=923.378	SAT TT=361.278	SAT TT=150.379	SAT TT=450.495	SAT TT=7.293	SAT TT=150.531	SAT TT=416.45	SAT TT=138.968
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/compet08/ normalized-patat-08-comp-4.xml	SAT TT=132.468	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	SAT TT=478.49	SAT TT=248.053	SAT TT=805.396	SAT TT=132.468	? (TO) TT=1800.47	SAT TT=1765.38	SAT TT=1045.62
csp/compet08/ normalized-patat-08-comp-5.xml	SAT TT=328.151	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.18	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.14	SAT TT=421.811	SAT TT=328.151
csp/compet08/ normalized-patat-08-comp-6.xml	SAT TT=116.03	? (TO) TT=1800.18	SAT TT=1318.21	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.07	SAT TT=116.03	SAT TT=156.986
csp/compet08/ normalized-patat-08-comp-7.xml	SAT TT=5.033	SAT TT=26.91	SAT TT=272.302	? (TO) TT=1800.12	SAT TT=105.058	SAT TT=176.512	SAT TT=50.691	SAT TT=219.603	SAT TT=5.033	SAT TT=25.811	SAT TT=117.002	SAT TT=61.795
csp/compet08/ normalized-patat-08-comp-8.xml	SAT TT=0.495	SAT TT=6.005	SAT TT=5.315	? (TO) TT=1800.1	SAT TT=98.134	SAT TT=100.276	SAT TT=25.388	SAT TT=123.351	SAT TT=0.495	SAT TT=19.142	SAT TT=36.632	SAT TT=47.439
csp/compet08/ normalized-patat-08-comp-9.xml		? (TO) TT=1800.23	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.35	? TT=552.91	? TT=563.859
csp/costasArray/ normalized-costasArray-10.xml	SAT TT=0.009	SAT TT=0.831	SAT TT=0.945	SAT TT=0.036	SAT TT=1.137	SAT TT=1.212	SAT TT=1.284	SAT TT=4.314	SAT TT=0.009	SAT TT=2.908	SAT TT=0.953	SAT TT=1.021
csp/costasArray/ normalized-costasArray-11.xml	SAT TT=0.019	SAT TT=1.041	SAT TT=1.044	SAT TT=0.062	SAT TT=1.421	SAT TT=1.54	SAT TT=1.327	SAT TT=7.711	SAT TT=0.019	SAT TT=3.595	SAT TT=1.13	SAT TT=1.314
csp/costasArray/ normalized-costasArray-12.xml	SAT TT=0.013	SAT TT=1.395	SAT TT=1.176	SAT TT=0.05	SAT TT=1.989	SAT TT=2.093	SAT TT=1.666	SAT TT=19.738	SAT TT=0.013	SAT TT=6.479	SAT TT=1.19	SAT TT=2.138
csp/costasArray/ normalized-costasArray-13.xml	SAT TT=0.086	SAT TT=3.522	SAT TT=1.679	SAT TT=0.086	SAT TT=3.483	SAT TT=3.518	SAT TT=3.055	SAT TT=28.64	SAT TT=0.113	SAT TT=12.822	SAT TT=1.904	SAT TT=1.83
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/costasArray/ normalized-costasArray-14.xml	SAT TT=0.196	SAT TT=1.358	SAT TT=1.953	SAT TT=0.196	SAT TT=6.571	SAT TT=8.943	SAT TT=2.942	SAT TT=127.593	SAT TT=0.663	SAT TT=11.229	SAT TT=2.372	SAT TT=7.703
csp/costasArray/ normalized-costasArray-15.xml	SAT TT=2.038	SAT TT=101.212	SAT TT=17.552	SAT TT=6.654	SAT TT=10.139	SAT TT=11.177	SAT TT=17.508	SAT TT=178.954	SAT TT=2.038	SAT TT=70.869	SAT TT=16.212	SAT TT=15.108
csp/costasArray/ normalized-costasArray-16.xml	SAT TT=3.112	SAT TT=40.859	SAT TT=329.336	SAT TT=3.112	SAT TT=24.099	SAT TT=6.11	SAT TT=61.591	SAT TT=892.701	SAT TT=7.567	SAT TT=530.6	SAT TT=381.815	SAT TT=36.012
csp/costasArray/ normalized-costasArray-17.xml	SAT TT=35.778	SAT TT=596.264	SAT TT=1450.62	SAT TT=145.97	SAT TT=216.625	SAT TT=162.049	SAT TT=131.831	? (TO) TT=1800.01	SAT TT=35.778	SAT TT=301.253	SAT TT=1430.55	SAT TT=520.327
csp/costasArray/ normalized-costasArray-18.xml	SAT TT=63.832	? (TO) TT=1800.13	? (TO) TT=1800.16	SAT TT=63.832	SAT TT=1409.68	? (TO) TT=1800.04	SAT TT=201.55	? (TO) TT=1800.08	SAT TT=384.884	? (TO) TT=1800.44	? (TO) TT=1800.06	? (TO) TT=1800.05
csp/costasArray/ normalized-costasArray-19.xml		? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800.35	? (TO) TT=1800.04	? (TO) TT=1800.14
csp/costasArray/ normalized-costasArray-20.xml		? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.41	? (TO) TT=1800.07	? (TO) TT=1800.04
csp/latinSquare/ normalized-latinSquare-dg-10_all.xml	UNSAT TT=1.163	? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.31	UNSAT TT=1.163	UNSAT TT=1.528
csp/latinSquare/ normalized-latinSquare-dg-11_all.xml	SAT TT=1.349	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.39	SAT TT=1.349	? (TO) TT=1800.05
csp/latinSquare/ normalized-latinSquare-dg-12_all.xml	UNSAT TT=1.66	? (TO) TT=1800.13	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.39	UNSAT TT=1.66	UNSAT TT=2.477
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/latinSquare/ normalized-latinSquare-dg-3_all.xml	UNSAT TT=0.007	UNSAT TT=0.658	UNSAT TT=0.639	UNSAT TT=0.026	UNSAT TT=0.408	UNSAT TT=0.393	UNSAT TT=0.859	UNSAT TT=0.835	UNSAT TT=0.007	UNSAT TT=0.526	UNSAT TT=0.565	UNSAT TT=0.58
csp/latinSquare/ normalized-latinSquare-dg-4_all.xml	UNSAT TT=0.007	UNSAT TT=0.625	UNSAT TT=0.67	UNSAT TT=0.027	UNSAT TT=0.407	UNSAT TT=0.444	UNSAT TT=0.87	UNSAT TT=0.875	UNSAT TT=0.007	UNSAT TT=0.525	UNSAT TT=0.592	UNSAT TT=0.593
csp/latinSquare/ normalized-latinSquare-dg-5_all.xml	SAT TT=0.006	SAT TT=0.681	SAT TT=0.635	SAT TT=0.028	SAT TT=0.575	SAT TT=0.537	SAT TT=0.85	SAT TT=1.022	SAT TT=0.006	SAT TT=0.521	SAT TT=0.73	SAT TT=0.889
csp/latinSquare/ normalized-latinSquare-dg-6_all.xml	UNSAT TT=0.034	UNSAT TT=0.823	UNSAT TT=0.807	UNSAT TT=0.174	UNSAT TT=0.731	UNSAT TT=0.742	UNSAT TT=1.017	UNSAT TT=1.347	UNSAT TT=0.034	UNSAT TT=1.044	UNSAT TT=0.787	UNSAT TT=0.798
csp/latinSquare/ normalized-latinSquare-dg-7_all.xml	SAT TT=0.01	SAT TT=0.781	SAT TT=0.812	SAT TT=0.037	SAT TT=0.766	SAT TT=0.791	SAT TT=0.916	SAT TT=1.334	SAT TT=0.01	SAT TT=0.744	SAT TT=0.936	SAT TT=1.015
csp/latinSquare/ normalized-latinSquare-dg-8_all.xml	UNSAT TT=1.014	UNSAT TT=676.746	UNSAT TT=727.935	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.3	UNSAT TT=1.014	UNSAT TT=1.044
csp/latinSquare/ normalized-latinSquare-dg-9_all.xml	UNSAT TT=1.077	? (TO) TT=1800.06	? (TO) TT=1800.15	? (TO) TT=1800.03	? (TO) TT=1800.22	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.28	UNSAT TT=1.077	UNSAT TT=1.291
csp/medium/ normalized-patat-02-medium-1.xml	SAT TT=111.921	? (TO) TT=1800.16	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.14	? (TO) TT=1800.19	? (TO) TT=1800.07	? (TO) TT=1800.05	SAT TT=111.921	? (TO) TT=1800.17	? (TO) TT=1800.15	SAT TT=118.562
csp/medium/ normalized-patat-02-medium-2.xml	SAT TT=130.19	? (TO) TT=1800.24	? (TO) TT=1800.15	? (TO) TT=1800.1	? (TO) TT=1800.16	? (TO) TT=1800.23	? (TO) TT=1800.05	? (TO) TT=1800.08	SAT TT=149.475	? (TO) TT=1800.15	? (TO) TT=1800.21	SAT TT=130.19
csp/medium/ normalized-patat-02-medium-3.xml	SAT TT=129.188	? (TO) TT=1800.18	? (TO) TT=1800.25	? (TO) TT=1800.09	? (TO) TT=1800.17	? (TO) TT=1800.23	? (TO) TT=1800.02	? (TO) TT=1800.06	SAT TT=330.821	? (TO) TT=1800.2	? (TO) TT=1800.26	SAT TT=129.188
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/medium/ normalized-patat-02-medium-4.xml	SAT TT=85.367	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.2	? (TO) TT=1800.15	? (TO) TT=1800.06	? (TO) TT=1800.04	SAT TT=85.367	? (TO) TT=1800.14	? (TO) TT=1800.13	SAT TT=130.727
csp/medium/ normalized-patat-02-medium-5.xml	SAT TT=96.766	? (TO) TT=1800.18	? (TO) TT=1800.19	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT TT=298.172	? (TO) TT=1800.21	? (TO) TT=1800.17	SAT TT=96.766
csp/nengfa/ normalized-protein.xml	SAT TT=6.158	SAT TT=1144.29	SAT TT=566.633	SAT TT=1518.17	SAT TT=15.139	SAT TT=83.87	SAT TT=306.502	? (TO) TT=1800.04	SAT TT=140.489	SAT TT=548.303	SAT TT=6.158	SAT TT=9.074
csp/nengfa/ normalized-queens2.xml	SAT TT=0.119	SAT TT=3.809	SAT TT=5.726	SAT TT=0.508	SAT TT=24.782	SAT TT=27.549	SAT TT=11.964	? (TO) TT=1800.09	SAT TT=0.119	SAT TT=17.821	SAT TT=18.349	SAT TT=37.224
csp/nengfa/ normalized-sudoku368.xml	SAT TT=0.23	SAT TT=2.873	SAT TT=16.489	SAT TT=9.315	SAT TT=1.405	SAT TT=1.294	SAT TT=8.309	SAT TT=31.425	SAT TT=0.23	SAT TT=2.593	SAT TT=3.78	SAT TT=4.337
csp/ortholatin/ normalized-ortholatin-10.xml		? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.31	? (TO) TT=1800.09	? (TO) TT=1800.06
csp/ortholatin/ normalized-ortholatin-15.xml		? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.07	? (exit code) TT=105.992	? (TO) TT=1800.16	? (TO) TT=1800.05
csp/ortholatin/ normalized-ortholatin-20.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=769.744	? (TO) TT=1800.09	? TT=103.831	? (MO) TT=157.479	? (MO) TT=350.66
csp/ortholatin/ normalized-ortholatin-2.xml	UNSAT TT=0.007	UNSAT TT=0.624	UNSAT TT=0.632	UNSAT TT=0.026	UNSAT TT=0.433	UNSAT TT=0.419	UNSAT TT=0.833	UNSAT TT=0.857	UNSAT TT=0.007	UNSAT TT=0.507	UNSAT TT=0.515	UNSAT TT=0.551
csp/ortholatin/ normalized-ortholatin-5.xml	SAT TT=0.013	SAT TT=2.865	SAT TT=0.758	SAT TT=1.69	SAT TT=1.269	SAT TT=1.183	SAT TT=0.958	SAT TT=2.629	SAT TT=0.013	SAT TT=1.571	SAT TT=1.235	SAT TT=1.213
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/ortholatin/ normalized-ortholatin-6.xml		? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.5	? (TO) TT=1800.13	? (TO) TT=1800.08
csp/ortholatin/ normalized-ortholatin-7.xml	SAT TT=9.426	SAT TT=81.926	SAT TT=9.426	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.12	SAT TT=32.843	SAT TT=43.202	SAT TT=1207.39	SAT TT=734.884	SAT TT=57.359	SAT TT=435.392
csp/ortholatin/ normalized-ortholatin-8.xml	SAT TT=8.902	SAT TT=859.944	? (TO) TT=1800.11	SAT TT=8.902	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.34	? (TO) TT=1800.02	? (TO) TT=1800.1
csp/ortholatin/ normalized-ortholatin-9.xml		? (TO) TT=1800.16	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.4	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/pigeons_glb/ normalized-pigeons-10_ext.xml	UNSAT TT=0.008	UNSAT TT=0.591	UNSAT TT=0.593	UNSAT TT=0.023	UNSAT TT=0.392	UNSAT TT=0.351	UNSAT TT=0.77	UNSAT TT=0.863	UNSAT TT=0.008	UNSAT TT=6.656	UNSAT TT=0.365	UNSAT TT=0.385
csp/pigeons_glb/ normalized-pigeons-11_ext.xml	UNSAT TT=0.007	UNSAT TT=0.592	UNSAT TT=0.583	UNSAT TT=0.025	UNSAT TT=0.38	UNSAT TT=0.353	UNSAT TT=0.864	UNSAT TT=0.844	UNSAT TT=0.007	UNSAT TT=69.245	UNSAT TT=0.362	UNSAT TT=0.36
csp/pigeons_glb/ normalized-pigeons-12_ext.xml	UNSAT TT=0.006	UNSAT TT=0.594	UNSAT TT=0.582	UNSAT TT=0.025	UNSAT TT=0.346	UNSAT TT=0.356	UNSAT TT=0.777	UNSAT TT=0.875	UNSAT TT=0.006	UNSAT TT=1119.68	UNSAT TT=0.398	UNSAT TT=0.392
csp/pigeons_glb/ normalized-pigeons-13_ext.xml	UNSAT TT=0.005	UNSAT TT=0.587	UNSAT TT=0.621	UNSAT TT=0.026	UNSAT TT=0.353	UNSAT TT=0.372	UNSAT TT=0.838	UNSAT TT=0.861	UNSAT TT=0.005	? (TO) TT=1800.33	UNSAT TT=0.391	UNSAT TT=0.402
csp/pigeons_glb/ normalized-pigeons-14_ext.xml	UNSAT TT=0.006	UNSAT TT=0.648	UNSAT TT=0.616	UNSAT TT=0.026	UNSAT TT=0.35	UNSAT TT=0.358	UNSAT TT=0.856	UNSAT TT=0.783	UNSAT TT=0.006	? (TO) TT=1800.33	UNSAT TT=0.381	UNSAT TT=0.402
csp/pigeons_glb/ normalized-pigeons-15_ext.xml	UNSAT TT=0.007	UNSAT TT=0.581	UNSAT TT=0.628	UNSAT TT=0.026	UNSAT TT=0.408	UNSAT TT=0.352	UNSAT TT=0.865	UNSAT TT=0.868	UNSAT TT=0.007	? (TO) TT=1800.37	UNSAT TT=0.412	UNSAT TT=0.403
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/pigeons_glb/ normalized-pigeons-18_ext.xml	UNSAT TT=0.007	UNSAT TT=0.625	UNSAT TT=0.602	UNSAT TT=0.025	UNSAT TT=0.347	UNSAT TT=0.402	UNSAT TT=0.778	UNSAT TT=0.843	UNSAT TT=0.007	? (TO) TT=1800.27	UNSAT TT=0.407	UNSAT TT=0.465
csp/pigeons_glb/ normalized-pigeons-20_ext.xml	UNSAT TT=0.006	UNSAT TT=0.605	UNSAT TT=0.637	UNSAT TT=0.025	UNSAT TT=0.368	UNSAT TT=0.38	UNSAT TT=0.814	UNSAT TT=0.781	UNSAT TT=0.006	? (TO) TT=1800.39	UNSAT TT=0.505	UNSAT TT=0.417
csp/pigeons_glb/ normalized-pigeons-25_ext.xml	UNSAT TT=0.009	UNSAT TT=0.615	UNSAT TT=0.63	UNSAT TT=0.028	UNSAT TT=0.368	UNSAT TT=0.362	UNSAT TT=0.807	UNSAT TT=0.856	UNSAT TT=0.009	? (TO) TT=1800.32	UNSAT TT=0.579	UNSAT TT=0.621
csp/pigeons_glb/ normalized-pigeons-30_ext.xml	UNSAT TT=0.007	UNSAT TT=0.633	UNSAT TT=0.621	UNSAT TT=0.025	UNSAT TT=0.359	UNSAT TT=0.363	UNSAT TT=0.844	UNSAT TT=0.817	UNSAT TT=0.007	? (TO) TT=1800.27	UNSAT TT=0.55	UNSAT TT=0.527
csp/pigeons_glb/ normalized-pigeons-35_ext.xml	UNSAT TT=0.008	UNSAT TT=0.644	UNSAT TT=0.657	UNSAT TT=0.027	UNSAT TT=0.361	UNSAT TT=0.39	UNSAT TT=0.943	UNSAT TT=0.866	UNSAT TT=0.008	? (TO) TT=1800.32	UNSAT TT=0.58	UNSAT TT=0.735
csp/pigeons_glb/ normalized-pigeons-40_ext.xml	UNSAT TT=0.008	UNSAT TT=0.632	UNSAT TT=0.642	UNSAT TT=0.026	UNSAT TT=0.42	UNSAT TT=0.396	UNSAT TT=0.8	UNSAT TT=0.904	UNSAT TT=0.008	? (TO) TT=1800.36	UNSAT TT=0.745	UNSAT TT=0.594
csp/pigeons_glb/ normalized-pigeons-45_ext.xml	UNSAT TT=0.01	UNSAT TT=0.624	UNSAT TT=0.64	UNSAT TT=0.026	UNSAT TT=0.364	UNSAT TT=0.368	UNSAT TT=0.87	UNSAT TT=0.85	UNSAT TT=0.01	? (TO) TT=1800.45	UNSAT TT=0.563	UNSAT TT=0.746
csp/pigeons_glb/ normalized-pigeons-50_ext.xml	UNSAT TT=0.008	UNSAT TT=0.646	UNSAT TT=0.644	UNSAT TT=0.028	UNSAT TT=0.371	UNSAT TT=0.373	UNSAT TT=0.825	UNSAT TT=0.831	UNSAT TT=0.008	? (TO) TT=1800.32	UNSAT TT=0.611	UNSAT TT=0.599
csp/pigeons_glb/ normalized-pigeons-5_ext.xml	UNSAT TT=0.021	UNSAT TT=0.594	UNSAT TT=0.607	UNSAT TT=0.026	UNSAT TT=0.378	UNSAT TT=0.397	UNSAT TT=0.806	UNSAT TT=0.866	UNSAT TT=0.021	UNSAT TT=0.513	UNSAT TT=0.354	UNSAT TT=0.35
csp/pigeons_glb/ normalized-pigeons-6_ext.xml	UNSAT TT=0.006	UNSAT TT=0.596	UNSAT TT=0.621	UNSAT TT=0.026	UNSAT TT=0.348	UNSAT TT=0.371	UNSAT TT=0.824	UNSAT TT=0.855	UNSAT TT=0.006	UNSAT TT=0.544	UNSAT TT=0.339	UNSAT TT=0.369
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/pigeons_glb/ normalized-pigeons-7_ext.xml	UNSAT TT=0.008	UNSAT TT=0.575	UNSAT TT=0.614	UNSAT TT=0.023	UNSAT TT=0.351	UNSAT TT=0.349	UNSAT TT=0.829	UNSAT TT=0.842	UNSAT TT=0.008	UNSAT TT=0.803	UNSAT TT=0.338	UNSAT TT=0.37
csp/pigeons_glb/ normalized-pigeons-8_ext.xml	UNSAT TT=0.006	UNSAT TT=0.593	UNSAT TT=0.647	UNSAT TT=0.025	UNSAT TT=0.341	UNSAT TT=0.384	UNSAT TT=0.776	UNSAT TT=0.798	UNSAT TT=0.006	UNSAT TT=1.047	UNSAT TT=0.378	UNSAT TT=0.348
csp/pigeons_glb/ normalized-pigeons-9_ext.xml	UNSAT TT=0.006	UNSAT TT=0.577	UNSAT TT=0.588	UNSAT TT=0.025	UNSAT TT=0.373	UNSAT TT=0.405	UNSAT TT=0.769	UNSAT TT=0.874	UNSAT TT=0.006	UNSAT TT=2.071	UNSAT TT=0.378	UNSAT TT=0.382
csp/small/ normalized-patat-02-small-1.xml	SAT TT=0.179	SAT TT=2.262	SAT TT=3.877	? (TO) TT=1800.09	SAT TT=23.178	SAT TT=25.585	SAT TT=53.199	SAT TT=767.024	SAT TT=0.179	SAT TT=39.981	SAT TT=3.347	SAT TT=7.111
csp/small/ normalized-patat-02-small-2.xml	SAT TT=0.128	SAT TT=1.984	SAT TT=2.116	SAT TT=0.425	SAT TT=30.319	SAT TT=26.348	SAT TT=4.937	SAT TT=80.303	SAT TT=0.128	SAT TT=31.86	SAT TT=3.609	SAT TT=8.232
csp/small/ normalized-patat-02-small-3.xml	SAT TT=0.183	SAT TT=2.644	SAT TT=3.444	? (TO) TT=1800.11	SAT TT=28.429	SAT TT=29.245	SAT TT=141.491	SAT TT=1609.8	SAT TT=0.183	SAT TT=65.186	SAT TT=3.839	SAT TT=7.708
csp/small/ normalized-patat-02-small-4.xml	SAT TT=0.243	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.09	SAT TT=13.032	SAT TT=13.465	SAT TT=1180.73	SAT TT=710.101	SAT TT=0.243	SAT TT=131.706	SAT TT=4.316	SAT TT=7.553
csp/small/ normalized-patat-02-small-5.xml	SAT TT=0.214	SAT TT=25.976	SAT TT=27.13	? (TO) TT=1800.07	SAT TT=18.573	SAT TT=17.764	SAT TT=70.285	SAT TT=752.991	SAT TT=0.214	SAT TT=79.314	SAT TT=4.276	SAT TT=10.188

Statistics		Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
Number of times the solver is able to give the best known answer		77	78	60	72	71	73	68	98	65	88	104
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	1	10	0	0	0	0	75	0	7	14