CSP 2009 Competition: results by benchmark

Results by benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory academic problems

This page displays the results of the different solvers for each benchmark for category n-ary constraints in intension (N-ARY-INT), subcategory academic problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 112v4 AC (complete)
Abscon 112v4 ESAC (complete)
bpsolver 09 (complete)
Choco2.1.1 2009-06-10 (complete)
Choco2.1.1b 2009-07-16 (complete)
Concrete 2009-07-14 (complete)
Concrete DC 2009-07-14 (complete)
Mistral 1.545 (complete)
pcs 0.3.2 (complete)
pcs-restart 0.3.2 (complete)
SAT4J CSP 2.1.1 (complete)
Sugar v1.14.6+minisat (complete)
Sugar v1.14.6+picosat (complete)

Bench name	Best results on this instance	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/allIntervalSeries/ normalized-series-10.xml	SAT TT=0.012	SAT TT=0.97	SAT TT=0.942	SAT TT=0.038	SAT TT=0.73	SAT TT=0.855	SAT TT=1.761	SAT TT=1.62	SAT TT=0.012	SAT TT=0.025	SAT TT=0.033	SAT TT=2.423	SAT TT=0.703	SAT TT=0.749
csp/allIntervalSeries/ normalized-series-11.xml	SAT TT=0.012	SAT TT=1.571	SAT TT=0.914	SAT TT=0.041	SAT TT=0.925	SAT TT=1.02	SAT TT=1.615	SAT TT=2.161	SAT TT=0.012	SAT TT=0.111	SAT TT=0.057	SAT TT=2.776	SAT TT=1.001	SAT TT=0.964
csp/allIntervalSeries/ normalized-series-12.xml	SAT TT=0.013	SAT TT=1.189	SAT TT=2.351	SAT TT=0.042	SAT TT=0.829	SAT TT=0.88	SAT TT=2.395	SAT TT=2.682	SAT TT=0.013	SAT TT=0.067	SAT TT=0.047	SAT TT=2.904	SAT TT=0.803	SAT TT=0.801
csp/allIntervalSeries/ normalized-series-13.xml	SAT TT=0.013	SAT TT=9.234	SAT TT=2.265	SAT TT=0.044	SAT TT=0.941	SAT TT=1.157	SAT TT=8.867	SAT TT=22.009	SAT TT=0.013	SAT TT=0.072	SAT TT=0.071	SAT TT=12.22	SAT TT=3.56	SAT TT=1.919
csp/allIntervalSeries/ normalized-series-14.xml	SAT TT=0.014	SAT TT=9.788	SAT TT=9.749	SAT TT=0.051	SAT TT=1	SAT TT=1.031	SAT TT=42.454	SAT TT=114.155	SAT TT=0.014	SAT TT=0.06	SAT TT=0.357	SAT TT=7.979	SAT TT=0.872	SAT TT=1.809
csp/allIntervalSeries/ normalized-series-15.xml	SAT TT=0.019	SAT TT=63.963	SAT TT=69.101	SAT TT=0.055	SAT TT=1.111	SAT TT=1.204	SAT TT=985.659	SAT TT=76.097	SAT TT=0.019	SAT TT=0.082	SAT TT=0.061	SAT TT=321.699	SAT TT=25.375	SAT TT=23.607
csp/allIntervalSeries/ normalized-series-18.xml	SAT TT=0.068	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT TT=0.068	SAT TT=9.381	SAT TT=1.591	? (TO) TT=1800.03	? (TO) TT=1800.07	SAT TT=0.401	SAT TT=0.07	SAT TT=0.479	? (TO) TT=1800.66	SAT TT=828.16	SAT TT=227.454
csp/allIntervalSeries/ normalized-series-20.xml	SAT TT=0.059	? (TO) TT=1800.14	SAT TT=323.711	SAT TT=0.075	SAT TT=10.556	SAT TT=2.581	? (TO) TT=1800.08	? (TO) TT=1800.01	SAT TT=0.059	SAT TT=0.092	SAT TT=0.099	? (TO) TT=1800.5	? (TO) TT=1800.11	? (TO) TT=1800.09
csp/allIntervalSeries/ normalized-series-25.xml	SAT TT=0.107	? (TO) TT=1800.09	? (TO) TT=1800.09	SAT TT=0.107	SAT TT=62.227	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	SAT TT=5.063	SAT TT=0.264	SAT TT=0.201	? (TO) TT=1800.57	? (TO) TT=1800.01	? (TO) TT=1800.09
csp/allIntervalSeries/ normalized-series-35.xml	SAT TT=0.206	? (TO) TT=1800.12	? (TO) TT=1800.1	SAT TT=0.206	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=10.075	SAT TT=0.315	? (TO) TT=1800.52	? (TO) TT=1800.06	? (TO) TT=1800.13
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/allIntervalSeries/ normalized-series-45.xml	SAT TT=0.396	? (TO) TT=1800.07	? (TO) TT=1800.12	SAT TT=0.396	? (TO) TT=1800.09	SAT TT=110.274	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.09	? (MO) TT=857.41	SAT TT=84.436	? (TO) TT=1800.3	? (TO) TT=1800.03	? (TO) TT=1800.01
csp/allIntervalSeries/ normalized-series-50.xml	SAT TT=0.524	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT TT=0.524	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=15.305	SAT TT=15.391	? (TO) TT=1800.34	? (TO) TT=1800.1	? (TO) TT=1800.03
csp/allIntervalSeries/ normalized-series-6.xml	SAT TT=0.008	SAT TT=0.71	SAT TT=0.766	SAT TT=0.03	SAT TT=0.605	SAT TT=0.625	SAT TT=1.158	SAT TT=1.232	SAT TT=0.008	SAT TT=0.025	SAT TT=0.017	SAT TT=0.962	SAT TT=0.584	SAT TT=0.588
csp/allIntervalSeries/ normalized-series-70.xml	SAT TT=1.31	? (TO) TT=1800.14	? (TO) TT=1800.15	SAT TT=1.31	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.06	SAT TT=360.754	SAT TT=170.008	SAT TT=6.138	? TT=73.483	? (TO) TT=1800.02	? (TO) TT=1800.03
csp/allIntervalSeries/ normalized-series-9.xml	SAT TT=0.01	SAT TT=0.849	SAT TT=0.893	SAT TT=0.037	SAT TT=0.751	SAT TT=0.767	SAT TT=1.316	SAT TT=1.467	SAT TT=0.01	SAT TT=0.025	SAT TT=0.036	SAT TT=2.013	SAT TT=0.723	SAT TT=0.702
csp/chessboardColoration/ normalized-cc-10-10-2.xml	UNSAT TT=1.476	UNSAT TT=2.65	UNSAT TT=2.782	UNSAT TT=6.079	UNSAT TT=16.828	UNSAT TT=17.173	UNSAT TT=8.386	UNSAT TT=8.584	UNSAT TT=1.476	UNSAT TT=10.637	UNSAT TT=23.082	UNSAT TT=4.277	UNSAT TT=2.424	UNSAT TT=2.885
csp/chessboardColoration/ normalized-cc-10-10-3.xml	SAT TT=26.295	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=221.51	? (TO) TT=1800.01	? (TO) TT=1800.03	SAT TT=91.589	? (TO) TT=1800.1	? (TO) TT=1800.06	SAT TT=26.295	SAT TT=44.679	SAT TT=148.922
csp/chessboardColoration/ normalized-cc-12-12-2.xml	UNSAT TT=2.503	UNSAT TT=4.552	UNSAT TT=4.737	UNSAT TT=46.094	UNSAT TT=24.283	UNSAT TT=31.136	UNSAT TT=16.02	UNSAT TT=15.931	UNSAT TT=2.503	UNSAT TT=33.702	UNSAT TT=23.11	UNSAT TT=5.406	UNSAT TT=3.48	UNSAT TT=4.609
csp/chessboardColoration/ normalized-cc-12-12-3.xml		? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.19	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.71	? (TO) TT=1800.02	? (TO) TT=1800.06
csp/chessboardColoration/ normalized-cc-15-15-2.xml	UNSAT TT=4.4	UNSAT TT=9.964	UNSAT TT=10.514	UNSAT TT=228.05	UNSAT TT=59.808	UNSAT TT=174.372	UNSAT TT=52.455	UNSAT TT=62.021	UNSAT TT=4.4	UNSAT TT=44.044	UNSAT TT=60.562	UNSAT TT=8.171	UNSAT TT=7.394	UNSAT TT=10.17
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/chessboardColoration/ normalized-cc-15-15-3.xml		? (MO) TT=6.548	? (TO) TT=1800.14	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.68	? (TO) TT=1800.09	? (TO) TT=1800.02
csp/chessboardColoration/ normalized-cc-25-25-2.xml	UNSAT TT=21.167	? (MO) TT=48.387	? (MO) TT=45.208	? (TO) TT=1800.09	? (problem) TT=116.175	UNSAT TT=696.042	UNSAT TT=1460.97	UNSAT TT=1530.86	UNSAT TT=21.167	UNSAT TT=297.332	UNSAT TT=603.909	UNSAT TT=24.127	? (MO) TT=9.59	? (MO) TT=10.43
csp/chessboardColoration/ normalized-cc-25-25-3.xml		? (MO) TT=45.55	? (MO) TT=50.007	? (TO) TT=1800.13	? (problem) TT=118.45	? (TO) TT=1800.23	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.75	? (MO) TT=9.72	? (MO) TT=9.585
csp/chessboardColoration/ normalized-cc-5-5-3.xml	SAT TT=0.019	SAT TT=0.882	SAT TT=0.916	SAT TT=0.074	SAT TT=0.723	SAT TT=0.74	SAT TT=1.38	SAT TT=1.393	SAT TT=0.019	SAT TT=0.039	SAT TT=0.038	SAT TT=1.303	SAT TT=0.869	SAT TT=0.93
csp/chessboardColoration/ normalized-cc-6-6-2.xml	UNSAT TT=0.189	UNSAT TT=1.143	UNSAT TT=1.057	UNSAT TT=0.189	UNSAT TT=3.388	UNSAT TT=3.52	UNSAT TT=2.809	UNSAT TT=2.857	UNSAT TT=0.43	UNSAT TT=15.914	UNSAT TT=15.732	UNSAT TT=2.133	UNSAT TT=1.211	UNSAT TT=1.376
csp/chessboardColoration/ normalized-cc-7-7-2.xml	UNSAT TT=0.295	UNSAT TT=1.429	UNSAT TT=1.365	UNSAT TT=0.295	UNSAT TT=4.86	UNSAT TT=5.398	UNSAT TT=5.17	UNSAT TT=6.948	UNSAT TT=0.671	UNSAT TT=11.42	UNSAT TT=14.493	UNSAT TT=2.234	UNSAT TT=1.29	UNSAT TT=1.5
csp/chessboardColoration/ normalized-cc-8-8-2.xml	UNSAT TT=0.925	UNSAT TT=1.788	UNSAT TT=1.622	UNSAT TT=0.953	UNSAT TT=7.515	UNSAT TT=8.422	UNSAT TT=4.625	UNSAT TT=4.632	UNSAT TT=0.925	UNSAT TT=9.783	UNSAT TT=40.506	UNSAT TT=2.93	UNSAT TT=1.542	UNSAT TT=1.917
csp/chessboardColoration/ normalized-cc-8-8-3.xml	SAT TT=0.062	SAT TT=1.869	SAT TT=2.192	SAT TT=188.269	SAT TT=1.641	SAT TT=1.583	SAT TT=2.226	SAT TT=2.175	SAT TT=0.062	SAT TT=0.563	SAT TT=0.75	SAT TT=3.364	SAT TT=1.798	SAT TT=1.705
csp/chessboardColoration/ normalized-cc-9-9-2.xml	UNSAT TT=1.124	UNSAT TT=2.095	UNSAT TT=2.015	UNSAT TT=1.124	UNSAT TT=9.9	UNSAT TT=11.914	UNSAT TT=10.565	UNSAT TT=11.457	UNSAT TT=1.214	UNSAT TT=7.938	UNSAT TT=23.713	UNSAT TT=3.801	UNSAT TT=2.082	UNSAT TT=2.301
csp/chessboardColoration/ normalized-cc-9-9-3.xml	SAT TT=0.144	SAT TT=7.765	SAT TT=126.238	? (TO) TT=1800.01	SAT TT=4.328	SAT TT=2.062	SAT TT=3.302	SAT TT=3.407	SAT TT=0.144	SAT TT=123.884	SAT TT=196.956	SAT TT=4.509	SAT TT=3.391	SAT TT=3.584
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/golombRulerArity3/ normalized-ruler-17-6-a3.xml	SAT TT=0.011	SAT TT=0.911	SAT TT=1.041	SAT TT=0.048	SAT TT=0.739	SAT TT=0.76	SAT TT=1.371	SAT TT=2.056	SAT TT=0.011	SAT TT=0.023	SAT TT=0.023	SAT TT=4.168	SAT TT=0.745	SAT TT=0.91
csp/golombRulerArity3/ normalized-ruler-17-7-a3.xml	UNSAT TT=0.015	UNSAT TT=0.889	UNSAT TT=0.85	UNSAT TT=0.063	UNSAT TT=0.683	UNSAT TT=0.711	UNSAT TT=1.561	UNSAT TT=2.375	UNSAT TT=0.015	UNSAT TT=0.025	UNSAT TT=0.026	? (TO) TT=1800.59	UNSAT TT=0.905	UNSAT TT=0.96
csp/golombRulerArity3/ normalized-ruler-25-7-a3.xml	SAT TT=0.024	SAT TT=1.181	SAT TT=2.499	SAT TT=0.196	SAT TT=0.921	SAT TT=1.05	SAT TT=1.81	SAT TT=3.504	SAT TT=0.024	SAT TT=0.067	SAT TT=0.28	SAT TT=7.782	SAT TT=0.893	SAT TT=1.066
csp/golombRulerArity3/ normalized-ruler-25-8-a3.xml	UNSAT TT=0.021	UNSAT TT=0.922	UNSAT TT=0.94	UNSAT TT=0.09	UNSAT TT=0.853	UNSAT TT=0.87	UNSAT TT=2.593	UNSAT TT=5.267	UNSAT TT=0.021	UNSAT TT=0.032	UNSAT TT=0.031	UNSAT TT=19.995	UNSAT TT=1.563	UNSAT TT=1.598
csp/golombRulerArity3/ normalized-ruler-34-8-a3.xml	SAT TT=0.35	SAT TT=10.277	SAT TT=20.391	SAT TT=4.508	SAT TT=2.766	SAT TT=1.978	SAT TT=8.004	SAT TT=21.119	SAT TT=4.927	SAT TT=0.35	SAT TT=1.429	SAT TT=146.541	SAT TT=1.818	SAT TT=3.469
csp/golombRulerArity3/ normalized-ruler-34-9-a3.xml	UNSAT TT=0.03	UNSAT TT=1.081	UNSAT TT=1.054	UNSAT TT=0.137	UNSAT TT=0.973	UNSAT TT=0.988	UNSAT TT=4.58	UNSAT TT=22.255	UNSAT TT=0.03	UNSAT TT=0.035	UNSAT TT=0.037	UNSAT TT=336.07	UNSAT TT=4.308	UNSAT TT=5.194
csp/golombRulerArity3/ normalized-ruler-44-10-a3.xml	UNSAT TT=0.04	UNSAT TT=1.258	UNSAT TT=1.216	UNSAT TT=0.212	UNSAT TT=1.074	UNSAT TT=1.037	UNSAT TT=25.48	UNSAT TT=170.91	UNSAT TT=0.04	UNSAT TT=0.049	UNSAT TT=0.052	? (TO) TT=1800.45	UNSAT TT=46.112	UNSAT TT=53.436
csp/golombRulerArity3/ normalized-ruler-44-9-a3.xml	SAT TT=2.94	SAT TT=108.59	SAT TT=278.778	SAT TT=92.062	SAT TT=9.371	SAT TT=5.876	SAT TT=62.157	SAT TT=165.602	SAT TT=27.096	SAT TT=26.514	SAT TT=24.577	? (TO) TT=1800.5	SAT TT=2.94	SAT TT=19.675
csp/golombRulerArity3/ normalized-ruler-55-10-a3.xml	SAT TT=4.19	SAT TT=1550.98	? (TO) TT=1800.06	SAT TT=1349.19	SAT TT=143.983	SAT TT=225.186	SAT TT=415.322	SAT TT=1045.77	SAT TT=1374.01	SAT TT=42.609	SAT TT=136.105	? (TO) TT=1800.37	SAT TT=4.19	SAT TT=317.117
csp/golombRulerArity3/ normalized-ruler-55-11-a3.xml	UNSAT TT=0.088	? (TO) TT=1800.15	? (TO) TT=1800.08	UNSAT TT=0.428	UNSAT TT=1.306	UNSAT TT=1.494	UNSAT TT=223.324	UNSAT TT=1093.93	UNSAT TT=0.238	UNSAT TT=0.222	UNSAT TT=0.088	? (TO) TT=1801.45	UNSAT TT=418.321	UNSAT TT=622.275
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/golombRulerArity3/ normalized-ruler-67-11-a3.xml		? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.28	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.02	? (MO) TT=1034.16	? (MO) TT=1012.76	? TT=157.043	? (TO) TT=1800.04	? (TO) TT=1800.1
csp/golombRulerArity3/ normalized-ruler-67-12-a3.xml	UNSAT TT=1.727	? (TO) TT=1800.11	? (TO) TT=1800.11	UNSAT TT=317.504	UNSAT TT=1.727	UNSAT TT=1.852	UNSAT TT=1515.15	? (TO) TT=1800.01	UNSAT TT=9.452	UNSAT TT=9.507	UNSAT TT=3.994	? TT=135.25	? (TO) TT=1800.08	? (TO) TT=1800.13
csp/golombRulerArity3/ normalized-ruler-70-12-a3.xml	UNSAT TT=2.12	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.09	UNSAT TT=2.24	UNSAT TT=2.12	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.08	UNSAT TT=304.888	UNSAT TT=207.399	? TT=144.582	? (TO) TT=1800.02	? (TO) TT=1800.08
csp/golombRulerArity3/ normalized-ruler-70-13-a3.xml	UNSAT TT=0.106	UNSAT TT=1.753	UNSAT TT=1.626	UNSAT TT=0.879	UNSAT TT=1.459	UNSAT TT=1.474	? (TO) TT=1800.02	? (TO) TT=1800.07	UNSAT TT=0.106	UNSAT TT=0.124	UNSAT TT=0.119	? (TO) TT=1802.2	? (TO) TT=1800.06	? (TO) TT=1800.11
csp/golombRulerArity4/ normalized-ruler-17-6-a4.xml	SAT TT=0.016	SAT TT=0.828	SAT TT=0.85	SAT TT=0.044	SAT TT=0.693	SAT TT=0.744	SAT TT=1.518	SAT TT=1.63	SAT TT=0.016	SAT TT=0.042	SAT TT=0.028	SAT TT=11.728	SAT TT=0.94	SAT TT=1.366
csp/golombRulerArity4/ normalized-ruler-17-7-a4.xml	UNSAT TT=0.076	UNSAT TT=1.191	UNSAT TT=1.192	UNSAT TT=0.076	UNSAT TT=0.975	UNSAT TT=0.991	UNSAT TT=1.779	? TT=1.984	UNSAT TT=0.099	UNSAT TT=0.091	UNSAT TT=0.111	UNSAT TT=24.978	UNSAT TT=1.827	UNSAT TT=2.311
csp/golombRulerArity4/ normalized-ruler-25-7-a4.xml	SAT TT=0.059	SAT TT=0.992	SAT TT=1.06	SAT TT=0.064	SAT TT=0.879	SAT TT=1.091	SAT TT=3.642	SAT TT=4.367	SAT TT=0.059	SAT TT=0.132	SAT TT=0.078	SAT TT=95.793	SAT TT=1.751	SAT TT=6.462
csp/golombRulerArity4/ normalized-ruler-25-8-a4.xml	UNSAT TT=0.376	UNSAT TT=3.48	UNSAT TT=2.961	UNSAT TT=0.376	UNSAT TT=2.246	UNSAT TT=2.174	UNSAT TT=3.867	UNSAT TT=5.103	UNSAT TT=1.027	UNSAT TT=0.838	UNSAT TT=0.741	UNSAT TT=178.695	UNSAT TT=11.446	UNSAT TT=19.736
csp/golombRulerArity4/ normalized-ruler-34-8-a4.xml	SAT TT=0.122	SAT TT=1.285	SAT TT=1.51	SAT TT=0.122	SAT TT=7.426	SAT TT=7.23	SAT TT=20.568	SAT TT=10.419	SAT TT=2.864	SAT TT=1.387	SAT TT=1.581	SAT TT=652.566	SAT TT=8.359	SAT TT=46.628
csp/golombRulerArity4/ normalized-ruler-34-9-a4.xml	UNSAT TT=4.181	UNSAT TT=28.874	UNSAT TT=27.509	UNSAT TT=4.181	UNSAT TT=9.921	UNSAT TT=6.249	UNSAT TT=20.567	UNSAT TT=30.57	UNSAT TT=8.74	UNSAT TT=7.011	UNSAT TT=8.746	UNSAT TT=1182.14	UNSAT TT=160.345	UNSAT TT=266.622
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/golombRulerArity4/ normalized-ruler-44-10-a4.xml	UNSAT TT=38.44	UNSAT TT=258.869	UNSAT TT=140.876	UNSAT TT=52.131	UNSAT TT=38.44	UNSAT TT=128.052	UNSAT TT=157.57	UNSAT TT=160.629	UNSAT TT=144.362	UNSAT TT=53.143	UNSAT TT=65.057	? (TO) TT=1802.15	UNSAT TT=1555.57	? (TO) TT=1800.05
csp/golombRulerArity4/ normalized-ruler-44-9-a4.xml	SAT TT=0.642	SAT TT=7.27	SAT TT=5.003	SAT TT=0.642	SAT TT=8.431	SAT TT=16.604	SAT TT=198.184	SAT TT=205.364	SAT TT=22.322	SAT TT=79.296	SAT TT=57.674	? (TO) TT=1801.09	SAT TT=168.725	SAT TT=228.916
csp/golombRulerArity4/ normalized-ruler-55-10-a4.xml	SAT TT=5.902	SAT TT=23.176	SAT TT=10.223	SAT TT=5.902	SAT TT=7.24	SAT TT=297.308	SAT TT=163.424	SAT TT=375.062	SAT TT=246.135	SAT TT=153.431	SAT TT=251.505	? (TO) TT=1802.22	SAT TT=1122.19	? (TO) TT=1800.06
csp/golombRulerArity4/ normalized-ruler-55-11-a4.xml	UNSAT TT=396.794	? (TO) TT=1800.11	UNSAT TT=1561.16	UNSAT TT=646.59	UNSAT TT=982.383	UNSAT TT=1232.94	UNSAT TT=1716.97	UNSAT TT=1072.02	? (TO) TT=1800.04	UNSAT TT=396.794	UNSAT TT=817.121	? (TO) TT=1802.23	? (TO) TT=1800.14	? (TO) TT=1800.1
csp/golombRulerArity4/ normalized-ruler-67-11-a4.xml		? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.23	? (MO) TT=53.044	? (TO) TT=1800.12
csp/golombRulerArity4/ normalized-ruler-67-12-a4.xml	UNSAT TT=1335.87	? (TO) TT=1800.11	? (TO) TT=1800.14	UNSAT TT=1335.87	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.17	? (TO) TT=1800.14	? (TO) TT=1800.15	? (MO) TT=68.83	? (MO) TT=295.04
csp/golombRulerArity4/ normalized-ruler-70-12-a4.xml		? (TO) TT=1800.16	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.16	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.2	? (MO) TT=83.8	? (MO) TT=299.79
csp/golombRulerArity4/ normalized-ruler-70-13-a4.xml		? (TO) TT=1800.15	? (TO) TT=1800.18	? (TO) TT=1800.03	? (TO) TT=1800.15	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1802.13	? (MO) TT=103.32	? (MO) TT=316.962
csp/nengfa/ normalized-block.xml	UNSAT TT=3.204	? (TO) TT=1800.16	? (TO) TT=1800.16	UNSAT TT=1581.01	? (TO) TT=1800.18	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.08	UNSAT TT=119.695	UNSAT TT=187.33	UNSAT TT=20.34	UNSAT TT=3.204	UNSAT TT=3.47
csp/nengfa/ normalized-pack.xml	SAT TT=36.248	SAT TT=954.341	SAT TT=1028.47	SAT TT=39.616	SAT TT=424.1	SAT TT=578.504	? (TO) TT=1800.07	? (TO) TT=1800.1	SAT TT=355.89	SAT TT=1615.87	SAT TT=1234.85	? TT=164.647	SAT TT=103.246	SAT TT=36.248
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/nengfa/ normalized-radi.xml	SAT TT=0.075	SAT TT=293.172	SAT TT=311.38	SAT TT=7.896	SAT TT=1.471	SAT TT=1.58	SAT TT=171.112	? (TO) TT=1800.09	SAT TT=0.075	SAT TT=0.362	SAT TT=0.076	? TT=128.45	SAT TT=1.168	SAT TT=1.576
csp/nengfa/ normalized-schur.xml	SAT TT=4.611	SAT TT=4.611	SAT TT=7.822	SAT TT=17.318	SAT TT=544.12	SAT TT=37.585	SAT TT=14.336	SAT TT=15.314	SAT TT=23.788	SAT TT=71.984	SAT TT=62.31	SAT TT=19.107	SAT TT=28.142	SAT TT=9.291
csp/ramsey3/ normalized-ramsey-10-3.xml	SAT TT=0.01	SAT TT=0.898	SAT TT=0.897	SAT TT=0.06	SAT TT=0.746	SAT TT=0.764	SAT TT=1.305	SAT TT=1.413	SAT TT=0.01	SAT TT=0.054	SAT TT=0.109	SAT TT=1.316	SAT TT=0.987	SAT TT=0.88
csp/ramsey3/ normalized-ramsey-13-3.xml	SAT TT=0.019	SAT TT=1.059	SAT TT=1.06	SAT TT=1.394	SAT TT=1.001	SAT TT=0.944	SAT TT=1.514	SAT TT=1.577	SAT TT=0.019	SAT TT=3.224	SAT TT=5.256	SAT TT=1.64	SAT TT=1.347	SAT TT=1.173
csp/ramsey3/ normalized-ramsey-15-3.xml	SAT TT=0.164	SAT TT=109.795	SAT TT=48.043	? (TO) TT=1800.01	SAT TT=2.177	SAT TT=4.765	SAT TT=2.449	SAT TT=2.501	SAT TT=0.164	SAT TT=23.186	SAT TT=113.709	SAT TT=2.497	SAT TT=1.598	SAT TT=6.529
csp/ramsey3/ normalized-ramsey-16-3.xml	SAT TT=0.1	SAT TT=93.227	? (TO) TT=1800.08	SAT TT=1691.42	SAT TT=4.935	SAT TT=1.849	SAT TT=2.024	SAT TT=2.008	SAT TT=0.1	SAT TT=175.123	? TT=1244.9	SAT TT=2.71	SAT TT=2.547	SAT TT=6.345
csp/ramsey3/ normalized-ramsey-17-3.xml		? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.01	? TT=1210.75	? TT=1296.02	? (TO) TT=1800.41	? (TO) TT=1800.08	? (TO) TT=1800.08
csp/ramsey3/ normalized-ramsey-18-3.xml		? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=1060.78	? TT=1318.74	? (TO) TT=1800.57	? (TO) TT=1800.13	? (TO) TT=1800.09
csp/ramsey3/ normalized-ramsey-20-3.xml		? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.06	? TT=1196.81	? TT=1196.74	? (TO) TT=1800.48	? (TO) TT=1800.15	? (TO) TT=1800.14
csp/ramsey3/ normalized-ramsey-25-3.xml		? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.08	? (TO) TT=1800.05	? TT=1459.85	? TT=1474.89	? (TO) TT=1800.59	? (TO) TT=1800.09	? (TO) TT=1800.06
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/ramsey4/ normalized-ramsey-25-4.xml	SAT TT=0.131	SAT TT=2.846	SAT TT=4.361	SAT TT=76.03	SAT TT=2.317	SAT TT=2.353	SAT TT=3.472	SAT TT=3.603	SAT TT=0.131	SAT TT=253.503	SAT TT=259.506	SAT TT=4.757	SAT TT=11.486	SAT TT=18.636
csp/ramsey4/ normalized-ramsey-30-4.xml	SAT TT=0.256	SAT TT=1502.48	SAT TT=6.282	? (TO) TT=1800.05	SAT TT=5.29	SAT TT=6.361	SAT TT=5.998	SAT TT=7.154	SAT TT=0.256	SAT TT=961.915	SAT TT=829.693	SAT TT=6.569	SAT TT=36.262	SAT TT=277.471
csp/ramsey4/ normalized-ramsey-32-4.xml	SAT TT=1.734	SAT TT=40.701	? (TO) TT=1800.12	? (TO) TT=1800.06	SAT TT=9.178	SAT TT=16.069	SAT TT=8.565	SAT TT=10.277	SAT TT=1.734	? (TO) TT=1800.12	? (TO) TT=1800.13	SAT TT=9.282	SAT TT=36.421	SAT TT=611.932
csp/ramsey4/ normalized-ramsey-33-4.xml	SAT TT=2.698	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT TT=21.627	SAT TT=13.381	SAT TT=11.118	SAT TT=13.347	SAT TT=2.698	SAT TT=1412.96	? (TO) TT=1800.12	SAT TT=29.123	SAT TT=66.83	SAT TT=843.975
csp/ramsey4/ normalized-ramsey-34-4.xml	SAT TT=12.649	? (TO) TT=1800.13	? (TO) TT=1800.17	? (TO) TT=1800.08	SAT TT=242.68	SAT TT=231.357	SAT TT=31.721	SAT TT=34.898	SAT TT=12.649	? (TO) TT=1800.12	? (TO) TT=1800.04	SAT TT=161.866	SAT TT=356.627	SAT TT=1009.79
csp/ramsey4/ normalized-ramsey-35-4.xml	SAT TT=24.329	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT TT=1284.95	SAT TT=1282.13	SAT TT=24.329	SAT TT=26.226	SAT TT=223.151	? (TO) TT=1800.11	? (TO) TT=1800.08	SAT TT=809.741	SAT TT=772.973	? (TO) TT=1800.09
csp/ramsey4/ normalized-ramsey-38-4.xml		? (TO) TT=1800.16	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.18	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.65	? (TO) TT=1800	? (TO) TT=1800.05
csp/ramsey4/ normalized-ramsey-45-4.xml		? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.16	? (TO) TT=1800.12	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.36	? (TO) TT=1800.16	? (TO) TT=1800.07
csp/schurrLemma/ normalized-lemma-100-9-mod.xml	UNSAT TT=0.129	? (TO) TT=1800.16	? (TO) TT=1800.1	UNSAT TT=3.497	? (TO) TT=1800.17	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800	UNSAT TT=0.557	UNSAT TT=0.129	UNSAT TT=0.132	UNSAT TT=341.24	UNSAT TT=6.31	UNSAT TT=17.244
csp/schurrLemma/ normalized-lemma-12-9-mod.xml	UNSAT TT=0.008	UNSAT TT=27.726	UNSAT TT=27.23	UNSAT TT=0.033	UNSAT TT=58.478	UNSAT TT=56.202	UNSAT TT=25.281	UNSAT TT=27.208	UNSAT TT=0.008	UNSAT TT=0.018	UNSAT TT=0.015	UNSAT TT=399.745	UNSAT TT=1.065	UNSAT TT=2.118
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/schurrLemma/ normalized-lemma-15-9-mod.xml	UNSAT TT=0.01	UNSAT TT=33.069	UNSAT TT=32.968	UNSAT TT=0.038	UNSAT TT=73.558	UNSAT TT=83.575	UNSAT TT=42.549	UNSAT TT=43.147	UNSAT TT=0.01	UNSAT TT=0.016	UNSAT TT=0.018	UNSAT TT=306.768	UNSAT TT=1.207	UNSAT TT=4.511
csp/schurrLemma/ normalized-lemma-20-9-mod.xml	UNSAT TT=0.01	UNSAT TT=63.492	UNSAT TT=64.348	UNSAT TT=0.05	UNSAT TT=144.577	UNSAT TT=126.545	UNSAT TT=70.439	UNSAT TT=80.645	UNSAT TT=0.01	UNSAT TT=0.021	UNSAT TT=0.017	UNSAT TT=463.23	UNSAT TT=1.305	UNSAT TT=5.197
csp/schurrLemma/ normalized-lemma-23-3.xml	SAT TT=0.055	SAT TT=1.046	SAT TT=0.823	SAT TT=0.055	SAT TT=0.922	SAT TT=0.919	SAT TT=1.404	SAT TT=1.427	SAT TT=0.055	SAT TT=1.407	SAT TT=3.738	SAT TT=1.7	SAT TT=1.037	SAT TT=0.884
csp/schurrLemma/ normalized-lemma-24-3.xml	UNSAT TT=0.091	UNSAT TT=1.685	UNSAT TT=1.642	UNSAT TT=0.091	UNSAT TT=2.371	UNSAT TT=3.017	UNSAT TT=2.016	UNSAT TT=2.005	UNSAT TT=0.272	UNSAT TT=10.194	UNSAT TT=10.724	UNSAT TT=2.05	UNSAT TT=1.113	UNSAT TT=1.348
csp/schurrLemma/ normalized-lemma-30-9-mod.xml	UNSAT TT=0.019	UNSAT TT=144.44	UNSAT TT=147.037	UNSAT TT=0.1	UNSAT TT=311.66	UNSAT TT=316.753	UNSAT TT=211.204	UNSAT TT=194.807	UNSAT TT=0.019	UNSAT TT=0.026	UNSAT TT=0.026	UNSAT TT=370.234	UNSAT TT=2.562	UNSAT TT=4.443
csp/schurrLemma/ normalized-lemma-50-9-mod.xml	UNSAT TT=0.043	UNSAT TT=465.384	UNSAT TT=476.163	UNSAT TT=0.319	UNSAT TT=974.97	UNSAT TT=993.221	UNSAT TT=677.445	UNSAT TT=724.889	UNSAT TT=0.048	UNSAT TT=0.046	UNSAT TT=0.043	UNSAT TT=519.481	UNSAT TT=2.992	UNSAT TT=6.287
csp/schurrLemma/ normalized-lemma-66-4.xml	SAT TT=1.577	SAT TT=1.577	? (TO) TT=1800.09	SAT TT=1672.72	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.07	? TT=980.808	? TT=1113.95	? (TO) TT=1800.5	? (TO) TT=1800.06	? (TO) TT=1800.1
csp/schurrLemma/ normalized-lemma-67-4.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.06	? TT=989.824	? TT=982.231	? (TO) TT=1800.95	? (TO) TT=1800.06	? (TO) TT=1800.07
csp/socialGolfers/ normalized-socialGolfer-10-4-8.xml		? (TO) TT=1800.07	? (TO) TT=1800.18	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.18	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.02	? (TO) TT=1800.18	? (TO) TT=1800.17	? TT=160.058	? (TO) TT=1800.09	? (TO) TT=1800.01
csp/socialGolfers/ normalized-socialGolfer-6-3-5.xml	SAT TT=4.054	? (TO) TT=1800.08	SAT TT=645.431	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1783.88	? (TO) TT=1800.06	SAT TT=246.918	SAT TT=22.271	SAT TT=318.365	SAT TT=250.818	SAT TT=1635	SAT TT=4.054	SAT TT=104.63
Bench name	Best results	Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
csp/socialGolfers/ normalized-socialGolfer-6-3-6.xml	SAT TT=0.685	SAT TT=10.936	SAT TT=965.31	? (TO) TT=1800.02	SAT TT=6.479	SAT TT=5.569	SAT TT=25.069	SAT TT=209.256	SAT TT=0.685	SAT TT=1.474	SAT TT=1.694	? TT=175.545	SAT TT=15.652	SAT TT=3.187
csp/socialGolfers/ normalized-socialGolfer-6-3-7.xml	SAT TT=0.965	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.03	SAT TT=6.351	SAT TT=5.821	SAT TT=53.155	SAT TT=523.672	SAT TT=0.965	SAT TT=3.063	SAT TT=1.34	? TT=748.443	SAT TT=16.59	SAT TT=4.732
csp/socialGolfers/ normalized-socialGolfer-6-3-8.xml	SAT TT=0.993	SAT TT=51.912	? (TO) TT=1800.07	? (TO) TT=1800.03	SAT TT=17.61	SAT TT=8.585	SAT TT=110.286	SAT TT=1103.99	SAT TT=0.993	SAT TT=2.802	SAT TT=2.516	? TT=201.861	SAT TT=179.533	SAT TT=8.653
csp/socialGolfers/ normalized-socialGolfer-6-4-5.xml		? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.16	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.08	? (MO) TT=739.052	? (MO) TT=819.323	? TT=170.381	? (TO) TT=1800.07	? (TO) TT=1800.05
csp/socialGolfers/ normalized-socialGolfer-6-4-6.xml		? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.09	? (MO) TT=1066.35	? (MO) TT=1031.55	? TT=217.406	? (TO) TT=1800.02	? (TO) TT=1800.02
csp/socialGolfers/ normalized-socialGolfer-6-4-8.xml	SAT TT=8.743	SAT TT=274.602	SAT TT=1619.44	? (TO) TT=1800.02	SAT TT=56.583	SAT TT=159.512	? (TO) TT=1800.01	? (TO) TT=1800.01	SAT TT=8.743	SAT TT=21.702	SAT TT=17.093	? TT=192.016	SAT TT=72.663	SAT TT=17.351
csp/socialGolfers/ normalized-socialGolfer-7-4-8.xml	SAT TT=149.625	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.07	SAT TT=149.625	? (TO) TT=1800.17	? (TO) TT=1800.08	? (TO) TT=1800.07	SAT TT=1098.69	? (MO) TT=1718.85	? (TO) TT=1800.21	? TT=207.34	SAT TT=853.606	? (TO) TT=1800.02
csp/socialGolfers/ normalized-socialGolfer-8-4-8.xml		? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.19	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.22	? TT=208.207	? (TO) TT=1800.09	? (TO) TT=1800.09

Statistics		Abscon 112v4 AC (complete)	Abscon 112v4 ESAC (complete)	bpsolver 09 (complete)	Choco2.1.1 2009-06-10 (complete)	Choco2.1.1b 2009-07-16 (complete)	Concrete 2009-07-14 (complete)	Concrete DC 2009-07-14 (complete)	Mistral 1.545 (complete)	pcs 0.3.2 (complete)	pcs-restart 0.3.2 (complete)	SAT4J CSP 2.1.1 (complete)	Sugar v1.14.6+minisat (complete)	Sugar v1.14.6+picosat (complete)
Number of times the solver is able to give the best known answer		58	56	64	69	71	62	60	72	72	71	52	67	63
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		2	0	18	3	1	1	0	45	3	2	1	4	1