CSP 2006 Competition (second round): results by benchmark

Results by benchmark for category binary constraints in intension (2-ARY-INT), subcategory academic problems

This page displays the results of the different solvers for each benchmark for category binary constraints in intension (2-ARY-INT), subcategory academic problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver gave a definitive answer (SAT or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
Abscon 109 ESAC
Abscon 109 AC
BPrologCSPSolver70a 2006-12-13
buggy_2_5 2007-01-08
buggy_2_5_s 2007-01-08
CSP4J - Combo 2006-12-19
CSP4J - MAC 2006-12-19
CSP4J - MAC 2007-01-16
CSPtoSAT+minisat 0.3
galac 1
galacJ beta 1
Mistral 2006-12-04
sat4jCSP 1.7 RC BF3
SAT4JCSP-CACHED 1.7 RC BF3
sugar 0.40
Tramontane 2006-12-04
VALCSP 3.0
VALCSP 3.1

Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
domino/ domino-1000-1000.xml	SAT TT=0.062	SAT TT=14.443 CHECKS=32488760 NODES=0	SAT TT=15.681 CHECKS=32488744 NODES=1000	SAT TT=0.062	SAT TT=49.276	SAT TT=48.898	SAT TT=416.747 NODES=0	SAT TT=415.487 NODES=1000	SAT TT=286.484 CHECKS=1001001 NODES=1000	? (TO) TT=1800.09	? (TO) TT=1800.03	? (problem) TT=97.371	SAT TT=1.574	SAT TT=1005.15	SAT TT=88.347	SAT TT=7.219	SAT TT=1.611	? (MO) TT=8.566	? (MO) TT=9.021
domino/ domino-1000-100.xml	SAT TT=0.06	SAT TT=1.611 CHECKS=8219805 NODES=0	SAT TT=1.72 CHECKS=8217805 NODES=1000	SAT TT=0.06	SAT TT=1.762	SAT TT=1.715	SAT TT=7.399 NODES=0	SAT TT=7.703 NODES=1000	SAT TT=6.577 CHECKS=101001 NODES=1000	? (TO) TT=1800.08	SAT TT=97.947	SAT TT=13.645	SAT TT=0.191	SAT TT=15.169	SAT TT=5.929	SAT TT=1.927	SAT TT=0.18	SAT TT=2.317 CHECKS=348350000 NODES=1000	SAT TT=2.249 CHECKS=348350000 NODES=1000
domino/ domino-1000-200.xml	SAT TT=0.058	SAT TT=2.273 CHECKS=52335209 NODES=0	SAT TT=2.682 CHECKS=52331209 NODES=1000	SAT TT=0.058	SAT TT=4.117	SAT TT=4.124	SAT TT=22.12 NODES=0	SAT TT=21.86 NODES=1000	SAT TT=15.596 CHECKS=201001 NODES=1000	? (TO) TT=1800.08	SAT TT=416.958	? (problem) TT=77.684	SAT TT=0.291	SAT TT=45.859	SAT TT=9.407	SAT TT=2.39	SAT TT=0.268	SAT TT=13.536 CHECKS=2726700000 NODES=1000	SAT TT=13.824 CHECKS=2726700000 NODES=1000
domino/ domino-1000-300.xml	SAT TT=0.061	SAT TT=3.937 CHECKS=165488511 NODES=0	SAT TT=4.222 CHECKS=165483511 NODES=1000	SAT TT=0.061	SAT TT=7.64	SAT TT=7.286	SAT TT=42.725 NODES=0	SAT TT=42.885 NODES=1000	SAT TT=29.426 CHECKS=301001 NODES=1000	? (TO) TT=1800.08	? (MO) TT=0	? (problem) TT=100.607	SAT TT=0.4	SAT TT=92.408	SAT TT=13.821	SAT TT=3.041	SAT TT=0.407	SAT TT=45.3 CHECKS=9135050000 NODES=1000	SAT TT=47.367 CHECKS=9135050000 NODES=1000
domino/ domino-1000-500.xml	SAT TT=0.062	SAT TT=11.827 CHECKS=718380017 NODES=0	SAT TT=11.566 CHECKS=718372017 NODES=1000	SAT TT=0.062	SAT TT=16.322	SAT TT=15.691	SAT TT=107.655 NODES=0	SAT TT=112.266 NODES=1000	SAT TT=76.051 CHECKS=501001 NODES=1000	? (TO) TT=1800.06	? (TO) TT=1800.05	? (problem) TT=92.54	SAT TT=0.677	SAT TT=256.006	SAT TT=26.818	SAT TT=3.65	SAT TT=0.668	? (MO) TT=9.297	? (MO) TT=9.289
domino/ domino-1000-800.xml	SAT TT=0.064	SAT TT=10.791 CHECKS=21070669 NODES=0	SAT TT=10.943 CHECKS=21070656 NODES=1000	SAT TT=0.064	SAT TT=35.628	SAT TT=35.191	SAT TT=261.822 NODES=0	SAT TT=282.071 NODES=1000	SAT TT=185.393 CHECKS=801001 NODES=1000	? (TO) TT=1800.07	? (TO) TT=1800.01	? (problem) TT=92.71	SAT TT=1.16	SAT TT=639.161	SAT TT=58.94	SAT TT=6	SAT TT=1.181	? (MO) TT=9.129	? (MO) TT=8.916
domino/ domino-100-100.xml	SAT TT=0.022	SAT TT=0.776 CHECKS=821805 NODES=0	SAT TT=0.769 CHECKS=821605 NODES=100	SAT TT=0.022	SAT TT=0.215	SAT TT=0.207	SAT TT=1.136 NODES=0	SAT TT=1.124 NODES=100	SAT TT=0.989 CHECKS=10101 NODES=100	? (TO) TT=1800.08	SAT TT=10.801	SAT TT=2.366	SAT TT=0.028	SAT TT=3.371	SAT TT=2.767	SAT TT=0.642	SAT TT=0.028	SAT TT=0.213 CHECKS=34835100 NODES=100	SAT TT=0.208 CHECKS=34835100 NODES=100
domino/ domino-100-200.xml	SAT TT=0.022	SAT TT=0.828 CHECKS=5232809 NODES=0	SAT TT=0.855 CHECKS=5232409 NODES=100	SAT TT=0.022	SAT TT=0.409	SAT TT=0.415	SAT TT=2.406 NODES=0	SAT TT=2.387 NODES=100	SAT TT=1.996 CHECKS=20101 NODES=100	? (TO) TT=1800.07	SAT TT=37.684	SAT TT=5.263	SAT TT=0.034	SAT TT=6.349	SAT TT=3.009	SAT TT=0.099	SAT TT=0.032	SAT TT=1.424 CHECKS=272670000 NODES=100	SAT TT=1.403 CHECKS=272670000 NODES=100
domino/ domino-100-300.xml	SAT TT=0.021	SAT TT=1.089 CHECKS=16547511 NODES=0	SAT TT=1.052 CHECKS=16547011 NODES=100	SAT TT=0.021	SAT TT=0.715	SAT TT=0.7	SAT TT=4.324 NODES=0	SAT TT=4.67 NODES=100	SAT TT=3.423 CHECKS=30101 NODES=100	? (TO) TT=1800.03	SAT TT=85.83	SAT TT=8.842	SAT TT=0.038	SAT TT=12.371	SAT TT=3.68	SAT TT=0.61	SAT TT=0.037	SAT TT=4.682 CHECKS=913505000 NODES=100	SAT TT=4.661 CHECKS=913505000 NODES=100
domino/ domino-2000-2000.xml	SAT TT=0.109	SAT TT=98.684 CHECKS=256673840 NODES=0	SAT TT=104.363 CHECKS=256673808 NODES=2000	SAT TT=0.109	SAT TT=332.369	SAT TT=332.516	? TT=15.022	? TT=15.174	? TT=14.394	? (MO) TT=9.741	? (TO) TT=1800.01	? (problem) TT=65.968	SAT TT=66.631	? (MO) TT=4.949	? (MO) TT=7.93	SAT TT=31.98	SAT TT=63.503	? (MO) TT=8.208	? (MO) TT=8.473
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
domino/ domino-3000-3000.xml	SAT TT=0.159	SAT TT=348.046 CHECKS=853302295 NODES=0	SAT TT=390.004 CHECKS=853302248 NODES=3000	SAT TT=0.159	SAT TT=1192.41	SAT TT=1130.81	? TT=9.823	? TT=8.558	? TT=8.598	? (MO) TT=5	? (TO) TT=1800.03	? (MO) TT=0.028	SAT TT=200.62	? (MO) TT=11.786	? (MO) TT=17.324	? (MO) TT=24.89	SAT TT=191.379	? (MO) TT=6.536	? (MO) TT=6.961
domino/ domino-300-100.xml	SAT TT=0.029	SAT TT=0.941 CHECKS=2465805 NODES=0	SAT TT=1.017 CHECKS=2465205 NODES=300	SAT TT=0.029	SAT TT=0.543	SAT TT=0.527	SAT TT=2.733 NODES=0	SAT TT=2.636 NODES=300	SAT TT=2.363 CHECKS=30301 NODES=300	? (TO) TT=1800.08	SAT TT=29.12	SAT TT=4.621	SAT TT=0.06	SAT TT=6.228	SAT TT=3.238	SAT TT=1.12	SAT TT=0.062	SAT TT=0.695 CHECKS=104505000 NODES=300	SAT TT=0.655 CHECKS=104505000 NODES=300
domino/ domino-300-200.xml	SAT TT=0.027	SAT TT=1.171 CHECKS=15700009 NODES=0	SAT TT=1.245 CHECKS=15698809 NODES=300	SAT TT=0.027	SAT TT=1.251	SAT TT=1.244	SAT TT=6.598 NODES=0	SAT TT=6.502 NODES=300	SAT TT=5.09 CHECKS=60301 NODES=300	? (TO) TT=1800.06	SAT TT=112.676	SAT TT=12.725	SAT TT=0.091	SAT TT=16.647	SAT TT=5.359	SAT TT=1.286	SAT TT=0.091	SAT TT=4.114 CHECKS=818010000 NODES=300	SAT TT=4.245 CHECKS=818010000 NODES=300
domino/ domino-300-300.xml	SAT TT=0.032	SAT TT=1.669 CHECKS=49645511 NODES=0	SAT TT=1.691 CHECKS=49644011 NODES=300	SAT TT=0.032	SAT TT=2.093	SAT TT=2.168	SAT TT=13.319 NODES=0	SAT TT=13.53 NODES=300	SAT TT=9.538 CHECKS=90301 NODES=300	? (TO) TT=1800.03	SAT TT=262.708	? (problem) TT=105.66	SAT TT=0.121	SAT TT=29.713	SAT TT=6.202	SAT TT=1.217	SAT TT=0.131	SAT TT=15.011 CHECKS=2740520000 NODES=300	SAT TT=14.495 CHECKS=2740520000 NODES=300
domino/ domino-5000-5000.xml	SAT TT=0.244	? TT=9.496	? TT=10.843	SAT TT=0.244	? (MO) TT=0.079	? (MO) TT=0.081	? TT=4.146	? TT=4.258	? TT=4.016	Signal TT=6.543	? (TO) TT=1800.07	? (problem) TT=22.297	SAT TT=851.89	? TT=4.746	? TT=4.724	? (MO) TT=51.38	SAT TT=839.297	? (MO) TT=2.402	? (exit code) TT=2.357
domino/ domino-500-100.xml	SAT TT=0.039	SAT TT=1.173 CHECKS=4109805 NODES=0	SAT TT=1.146 CHECKS=4108805 NODES=500	SAT TT=0.039	SAT TT=0.9	SAT TT=0.896	SAT TT=4.301 NODES=0	SAT TT=4.29 NODES=500	SAT TT=3.342 CHECKS=50501 NODES=500	? (TO) TT=1800.04	SAT TT=50.282	SAT TT=7.909	SAT TT=0.098	SAT TT=8.924	SAT TT=4.374	SAT TT=1.143	SAT TT=0.095	SAT TT=1.208 CHECKS=174175000 NODES=500	SAT TT=1.154 CHECKS=174175000 NODES=500
domino/ domino-500-200.xml	SAT TT=0.039	SAT TT=1.593 CHECKS=26167209 NODES=0	SAT TT=1.592 CHECKS=26165209 NODES=500	SAT TT=0.039	SAT TT=1.991	SAT TT=2.04	SAT TT=11.144 NODES=0	SAT TT=11.047 NODES=500	SAT TT=8.102 CHECKS=100501 NODES=500	? (TO) TT=1800.04	SAT TT=188.507	SAT TT=51.64	SAT TT=0.145	SAT TT=24.057	SAT TT=6.075	SAT TT=1.34	SAT TT=0.145	SAT TT=7.087 CHECKS=1363350000 NODES=500	SAT TT=6.774 CHECKS=1363350000 NODES=500
domino/ domino-500-300.xml	SAT TT=0.039	SAT TT=2.337 CHECKS=82743511 NODES=0	SAT TT=2.261 CHECKS=82741011 NODES=500	SAT TT=0.039	SAT TT=3.57	SAT TT=3.411	SAT TT=21.637 NODES=0	SAT TT=20.721 NODES=500	SAT TT=15.452 CHECKS=150501 NODES=500	? (TO) TT=1800.08	SAT TT=456.727	? (problem) TT=80.791	SAT TT=0.191	SAT TT=46.821	SAT TT=8.257	SAT TT=1.57	SAT TT=0.208	SAT TT=23.141 CHECKS=4567530000 NODES=500	SAT TT=23.514 CHECKS=4567530000 NODES=500
domino/ domino-500-500.xml	SAT TT=0.04	SAT TT=6.088 CHECKS=359188017 NODES=0	SAT TT=5.742 CHECKS=359184017 NODES=500	SAT TT=0.04	SAT TT=7.888	SAT TT=7.397	SAT TT=57.004 NODES=0	SAT TT=58.045 NODES=500	SAT TT=36.25 CHECKS=250501 NODES=500	? (TO) TT=1800.07	? (MO) TT=0	? (problem) TT=101.082	SAT TT=0.332	SAT TT=132.833	SAT TT=14.903	SAT TT=2.2	SAT TT=0.336	SAT TT=132.945 CHECKS=21020900000 NODES=500	SAT TT=131.944 CHECKS=21020900000 NODES=500
domino/ domino-800-100.xml	SAT TT=0.049	SAT TT=1.348 CHECKS=6575805 NODES=0	SAT TT=1.488 CHECKS=6574205 NODES=800	SAT TT=0.049	SAT TT=1.379	SAT TT=1.41	SAT TT=6.248 NODES=0	SAT TT=6.016 NODES=800	SAT TT=5.035 CHECKS=80801 NODES=800	? (TO) TT=1800.06	SAT TT=77.053	SAT TT=10.882	SAT TT=0.152	SAT TT=19.426	SAT TT=4.954	SAT TT=1.36	SAT TT=0.156	SAT TT=1.817 CHECKS=278680000 NODES=800	SAT TT=1.877 CHECKS=278680000 NODES=800
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
domino/ domino-800-200.xml	SAT TT=0.052	SAT TT=2.126 CHECKS=41868009 NODES=0	SAT TT=2.242 CHECKS=41864809 NODES=800	SAT TT=0.052	SAT TT=3.214	SAT TT=3.36	SAT TT=17.848 NODES=0	SAT TT=16.793 NODES=800	SAT TT=12.255 CHECKS=160801 NODES=800	? (TO) TT=1800.09	SAT TT=331.335	? (problem) TT=95.343	SAT TT=0.226	SAT TT=35.526	SAT TT=7.584	SAT TT=2.31	SAT TT=0.229	SAT TT=11.462 CHECKS=2181360000 NODES=800	SAT TT=11.297 CHECKS=2181360000 NODES=800
domino/ domino-800-300.xml	SAT TT=0.051	SAT TT=3.172 CHECKS=132390511 NODES=0	SAT TT=3.318 CHECKS=132386511 NODES=800	SAT TT=0.051	SAT TT=6.622	SAT TT=6.429	SAT TT=32.787 NODES=0	SAT TT=33.979 NODES=800	SAT TT=24.356 CHECKS=240801 NODES=800	? (TO) TT=1800.06	? (MO) TT=0	? (problem) TT=97.941	SAT TT=0.313	SAT TT=83.784	SAT TT=11.42	SAT TT=2.47	SAT TT=0.312	SAT TT=40.355 CHECKS=7308040000 NODES=800	SAT TT=37.14 CHECKS=7308040000 NODES=800
domino/ domino-800-500.xml	SAT TT=0.051	SAT TT=8.76 CHECKS=574703217 NODES=0	SAT TT=9.086 CHECKS=574696817 NODES=800	SAT TT=0.051	SAT TT=13.452	SAT TT=12.967	SAT TT=92.005 NODES=0	SAT TT=85.752 NODES=800	SAT TT=57.852 CHECKS=400801 NODES=800	? (TO) TT=1800.14	? (TO) TT=1800.05	? (problem) TT=98.611	SAT TT=0.548	SAT TT=205.182	SAT TT=23.12	SAT TT=3.44	SAT TT=0.537	SAT TT=203.241 CHECKS=33633400000 NODES=800	SAT TT=201.909 CHECKS=33633400000 NODES=800
domino/ domino-800-800.xml	SAT TT=0.051	SAT TT=8.352 CHECKS=16855469 NODES=0	SAT TT=8.379 CHECKS=16855456 NODES=800	SAT TT=0.051	SAT TT=27.893	SAT TT=29.156	SAT TT=208.477 NODES=0	SAT TT=210.328 NODES=800	SAT TT=140.322 CHECKS=640801 NODES=800	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=112.518	SAT TT=0.931	SAT TT=514.718	SAT TT=49.262	SAT TT=5.021	SAT TT=0.867	? (MO) TT=9.196	? (MO) TT=9.156
knights/ knights-100-25.xml		? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? TT=6.49	? TT=7.39	? TT=7.417	? (TO) TT=1800.08	? (TO) TT=1800.09	? (problem) TT=240.456	? (TO) TT=1800.04	? (exit code) TT=116.593	? (MO) TT=29.227	? (MO) TT=65.04	? (TO) TT=1800.03	? (exit code) TT=1611.52	? (MO) TT=1683.81
knights/ knights-100-5.xml	UNSAT TT=178.28	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	UNSAT TT=309.969	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.01	? (problem) TT=197.19	? (TO) TT=1800.08	? (exit code) TT=119.627	? (MO) TT=29.361	UNSAT TT=178.28	? (TO) TT=1800.04	? (MO) TT=1563.23	? (MO) TT=1576.8
knights/ knights-100-9.xml		? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.09	? TT=6.656	? TT=6.603	? TT=7.508	? (TO) TT=1800.07	? (TO) TT=1800.06	? (problem) TT=237.096	? (TO) TT=1800.08	? (exit code) TT=119.077	? (MO) TT=27.616	? (TO) TT=1800.15	? (TO) TT=1800.11	? (MO) TT=1676.14	? (exit code) TT=1576.59
knights/ knights-10-5.xml	UNSAT TT=0.112	UNSAT TT=0.751 CHECKS=150868 NODES=0	UNSAT TT=0.768 CHECKS=167365 NODES=145	UNSAT TT=61.024	UNSAT TT=0.112	UNSAT TT=0.285	UNSAT TT=0.923 NODES=553	UNSAT TT=0.769 NODES=105	UNSAT TT=0.541 CHECKS=135344 NODES=147	UNSAT TT=638.89	UNSAT TT=1.354	UNSAT TT=0.827	UNSAT TT=0.338	UNSAT TT=3.264	? (MO) TT=3.167	UNSAT TT=0.422	UNSAT TT=0.339	UNSAT TT=0.052 CHECKS=929154 NODES=0	UNSAT TT=0.054 CHECKS=929154 NODES=0
knights/ knights-12-5.xml	UNSAT TT=0.167	UNSAT TT=0.79 CHECKS=429017 NODES=0	UNSAT TT=0.808 CHECKS=471913 NODES=210	UNSAT TT=190.069	UNSAT TT=0.167	UNSAT TT=0.715	UNSAT TT=1.568 NODES=951	UNSAT TT=1.093 NODES=143	UNSAT TT=0.678 CHECKS=274813 NODES=213	? (TO) TT=1800.03	UNSAT TT=1.931	UNSAT TT=0.954	UNSAT TT=0.873	UNSAT TT=4.487	? (MO) TT=3.097	UNSAT TT=0.662	UNSAT TT=1.002	UNSAT TT=0.113 CHECKS=2687730 NODES=0	UNSAT TT=0.109 CHECKS=2687730 NODES=0
knights/ knights-12-9.xml	UNSAT TT=0.565	UNSAT TT=0.836 CHECKS=914351 NODES=0	UNSAT TT=0.861 CHECKS=1094640 NODES=230	? (TO) TT=1800.03	UNSAT TT=0.565	UNSAT TT=1.357	UNSAT TT=7.159 NODES=4257	UNSAT TT=3.466 NODES=155	UNSAT TT=1.204 CHECKS=1316546 NODES=207	? (TO) TT=1800.07	UNSAT TT=2.864	UNSAT TT=1.11	UNSAT TT=3.143	UNSAT TT=6.847	? (MO) TT=3.61	UNSAT TT=111.73	UNSAT TT=2.985	UNSAT TT=0.311 CHECKS=14542300 NODES=0	UNSAT TT=0.291 CHECKS=14542300 NODES=0
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
knights/ knights-15-5.xml	UNSAT TT=0.309	UNSAT TT=0.843 CHECKS=1401486 NODES=0	UNSAT TT=0.843 CHECKS=1532740 NODES=331	UNSAT TT=692.068	UNSAT TT=0.309	UNSAT TT=2.477	UNSAT TT=5.037 NODES=3152	UNSAT TT=2.242 NODES=224	UNSAT TT=0.921 CHECKS=655142 NODES=334	? (TO) TT=1800.02	UNSAT TT=3.401	UNSAT TT=1.241	UNSAT TT=3.533	UNSAT TT=6.182	? (MO) TT=3.238	UNSAT TT=0.319	UNSAT TT=3.493	UNSAT TT=0.325 CHECKS=10090700 NODES=0	UNSAT TT=0.298 CHECKS=10090700 NODES=0
knights/ knights-15-9.xml	UNSAT TT=0.894	UNSAT TT=0.957 CHECKS=3042409 NODES=0	UNSAT TT=0.894 CHECKS=2926520 NODES=283	? (TO) TT=1800.1	UNSAT TT=1.508	UNSAT TT=4.605	UNSAT TT=25.243 NODES=6116	UNSAT TT=8.601 NODES=224	UNSAT TT=1.993 CHECKS=3177827 NODES=313	? (TO) TT=1800.07	UNSAT TT=5.514	UNSAT TT=1.919	UNSAT TT=10.563	UNSAT TT=12.977	? (MO) TT=4.157	UNSAT TT=533.51	UNSAT TT=10.896	UNSAT TT=0.884 CHECKS=53934000 NODES=0	UNSAT TT=0.959 CHECKS=53934000 NODES=0
knights/ knights-20-5.xml	UNSAT TT=0.848	UNSAT TT=1.175 CHECKS=7312284 NODES=0	UNSAT TT=1.136 CHECKS=8032890 NODES=594	? (TO) TT=1800.05	UNSAT TT=0.848	UNSAT TT=12.74	UNSAT TT=19.82 NODES=6068	UNSAT TT=7.903 NODES=405	UNSAT TT=1.987 CHECKS=2014915 NODES=597	? (TO) TT=1800.07	UNSAT TT=8.838	UNSAT TT=2.519	UNSAT TT=21.005	UNSAT TT=14.665	? (MO) TT=3.444	UNSAT TT=1.457	UNSAT TT=21.417	UNSAT TT=1.194 CHECKS=56817300 NODES=0	UNSAT TT=1.219 CHECKS=56817300 NODES=0
knights/ knights-20-9.xml	UNSAT TT=1.424	UNSAT TT=1.424 CHECKS=15586360 NODES=0	UNSAT TT=1.463 CHECKS=16383947 NODES=559	? (TO) TT=1800.1	UNSAT TT=5.692	UNSAT TT=22.604	UNSAT TT=122.037 NODES=19116	UNSAT TT=38.752 NODES=407	UNSAT TT=4.826 CHECKS=9915515 NODES=547	? (TO) TT=1800.02	UNSAT TT=15.106	UNSAT TT=4.141	UNSAT TT=59.293	UNSAT TT=39.542	UNSAT TT=33.588	UNSAT TT=1621.98	UNSAT TT=60.257	UNSAT TT=4.74 CHECKS=297523000 NODES=0	UNSAT TT=4.756 CHECKS=297523000 NODES=0
knights/ knights-25-5.xml	UNSAT TT=1.671	UNSAT TT=1.671 CHECKS=13893445 NODES=0	UNSAT TT=1.74 CHECKS=17055560 NODES=931	? (TO) TT=1800.03	UNSAT TT=1.963	UNSAT TT=49.438	UNSAT TT=64.943 NODES=13563	UNSAT TT=20.514 NODES=643	UNSAT TT=3.918 CHECKS=4835193 NODES=934	? (TO) TT=1800.06	UNSAT TT=19.681	UNSAT TT=5.025	UNSAT TT=84.58	UNSAT TT=36.917	UNSAT TT=39.731	UNSAT TT=2.43	UNSAT TT=77.35	UNSAT TT=3.765 CHECKS=219007000 NODES=0	UNSAT TT=4.143 CHECKS=219007000 NODES=0
knights/ knights-25-9.xml	UNSAT TT=2.283	UNSAT TT=2.283 CHECKS=29334589 NODES=0	UNSAT TT=2.552 CHECKS=38174450 NODES=972	? (TO) TT=1800.03	UNSAT TT=15.941	UNSAT TT=80.756	UNSAT TT=352.99 NODES=27451	UNSAT TT=112.235 NODES=640	UNSAT TT=12.209 CHECKS=23978769 NODES=842	? (TO) TT=1800.06	UNSAT TT=34.827	UNSAT TT=8.953	UNSAT TT=206.566	UNSAT TT=87.688	UNSAT TT=96.624	? (TO) TT=1800.03	UNSAT TT=226.213	UNSAT TT=16.863 CHECKS=1131150000 NODES=0	UNSAT TT=15.911 CHECKS=1131150000 NODES=0
knights/ knights-50-25.xml	UNSAT TT=84.832	UNSAT TT=84.832 CHECKS=5670497666 NODES=0	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=0.004	? (TO) TT=1800.1	UNSAT TT=1610.69 CHECKS=3669076496 NODES=4613	? (TO) TT=1800.09	? (MO) TT=0	? (problem) TT=134.007	? (TO) TT=1800.1	? TT=150.846	? TT=93.354	? (TO) TT=1800.11	? (TO) TT=1800.07	? (MO) TT=432.365	? (MO) TT=403.874
knights/ knights-50-5.xml	UNSAT TT=19.835	UNSAT TT=20.891 CHECKS=828685430 NODES=0	UNSAT TT=126.099 CHECKS=321670245 NODES=4018	? (TO) TT=1800.02	UNSAT TT=19.835	UNSAT TT=846.553	? (TO) TT=1800.1	UNSAT TT=994.181 NODES=2867	UNSAT TT=107.25 CHECKS=75736134 NODES=4050	? (TO) TT=1800.04	UNSAT TT=307.124	? (problem) TT=111.977	? (TO) TT=1800.09	UNSAT TT=799.259	? (MO) TT=45.325	UNSAT TT=22.368	? (TO) TT=1800.09	UNSAT TT=196.653 CHECKS=14606500000 NODES=0	UNSAT TT=206.347 CHECKS=14606500000 NODES=0
knights/ knights-50-9.xml	UNSAT TT=30.945	UNSAT TT=30.945 CHECKS=1745478926 NODES=0	UNSAT TT=1320.46 CHECKS=1433355869 NODES=4668	? (TO) TT=1800.04	UNSAT TT=285.319	UNSAT TT=1133.24	? (TO) TT=1800.09	? (TO) TT=1800.01	UNSAT TT=301.706 CHECKS=383101150 NODES=4074	? (TO) TT=1800.06	? (MO) TT=0	? (problem) TT=111.025	? (TO) TT=1800.05	? TT=135.27	? TT=87.135	? (TO) TT=1800.07	? (TO) TT=1800.01	UNSAT TT=990.807 CHECKS=73707000000 NODES=0	UNSAT TT=994.533 CHECKS=73707000000 NODES=0
knights/ knights-80-25.xml		? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? TT=9.418	? TT=8.568	? TT=8.391	? (TO) TT=1800.1	? (TO) TT=1800.05	? (problem) TT=170.605	? (TO) TT=1800.03	? TT=86.359	? (MO) TT=31.046	? (MO) TT=42.09	? (TO) TT=1800.03	? (MO) TT=996.063	? (MO) TT=1061.99
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
knights/ knights-80-5.xml	UNSAT TT=96.33	UNSAT TT=780.738 CHECKS=830480877 NODES=0	UNSAT TT=1078.25 CHECKS=1052970727 NODES=10241	? (TO) TT=1800.03	UNSAT TT=134.833	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.05	UNSAT TT=1702.49 CHECKS=491949866 NODES=10411	? (TO) TT=1800.07	? (MO) TT=0	? (problem) TT=129.867	? (TO) TT=1800.07	? TT=90.991	? (MO) TT=30.348	UNSAT TT=96.33	? (TO) TT=1800.1	? (MO) TT=992.544	? (MO) TT=1061.95
knights/ knights-80-9.xml		? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.03	? (problem) TT=157.077	? (TO) TT=1800.03	? (exit code) TT=77.814	? (MO) TT=32.037	? (TO) TT=1800.13	? (TO) TT=1800.11	? (MO) TT=1068.39	? (MO) TT=992.117
knights/ knights-8-5.xml	UNSAT TT=0.08	UNSAT TT=0.729 CHECKS=40610 NODES=0	UNSAT TT=0.74 CHECKS=43174 NODES=88	UNSAT TT=16.703	UNSAT TT=0.08	UNSAT TT=0.132	UNSAT TT=0.577 NODES=63	UNSAT TT=0.582 NODES=63	UNSAT TT=0.505 CHECKS=57186 NODES=93	UNSAT TT=68.786	UNSAT TT=0.909	UNSAT TT=0.712	UNSAT TT=0.109	UNSAT TT=3.005	? (MO) TT=4.172	UNSAT TT=0.37	UNSAT TT=0.113	UNSAT TT=0.022 CHECKS=261094 NODES=0	UNSAT TT=0.022 CHECKS=261094 NODES=0
largeQueens/ queens-1000.xml	SAT TT=440.78	? (MO) TT=326.362	? (TO) TT=1800.21	? (conv) TT=0.017	? (MO) TT=6.285	? (MO) TT=6.192	? TT=26.994	? TT=25.883	? TT=26.304	? (TO) TT=1800.16	? (TO) TT=1800.01	? (problem) TT=988.08	? (TO) TT=1800.07	? (MO) TT=200.665	? (MO) TT=34.513	? TT=51.09	SAT TT=440.78	? (MO) TT=179.117	? (MO) TT=190.889
largeQueens/ queens-300.xml	SAT TT=2.585	SAT TT=50.844 CHECKS=100783712 NODES=1014	? (TO) TT=1800.25	SAT TT=2.585	SAT TT=977.416	SAT TT=1210.06	? TT=142.528	? TT=154.315	? TT=90.722	? (TO) TT=1800.1	? (MO) TT=0	? (problem) TT=133.771	? (TO) TT=1800.03	? TT=473.714	? TT=94.757	? (TO) TT=1803.33	SAT TT=15.223	? (MO) TT=85.499	? (MO) TT=84.404
largeQueens/ queens-400.xml	SAT TT=15.568	SAT TT=182.693 CHECKS=530663476 NODES=3197	? (TO) TT=1800.16	? (conv) TT=0.018	? (TO) TT=1800.02	? (TO) TT=1800.08	? TT=81.921	? TT=75.101	? TT=58.659	? (TO) TT=1800.04	? (TO) TT=1800.01	? (problem) TT=172.392	SAT TT=15.568	? TT=289.374	? TT=96.487	? (TO) TT=1803.85	SAT TT=33.54	? (MO) TT=92.699	? (MO) TT=105.268
largeQueens/ queens-500.xml	SAT TT=27.591	SAT TT=385.886 CHECKS=1381863638 NODES=4545	? (TO) TT=1800.14	? (conv) TT=0.017	? (MO) TT=2.107	? (MO) TT=1.574	? TT=50.429	? TT=55.169	? TT=41.85	? (TO) TT=1800.08	? (TO) TT=1800.03	? (problem) TT=242.715	SAT TT=27.591	? TT=245.924	? (exit code) TT=105.246	? (TO) TT=1803.31	SAT TT=85.706	? (MO) TT=117.141	? (MO) TT=117.191
largeQueens/ queens-800.xml	SAT TT=398.828	? (TO) TT=1800.13	? (TO) TT=1800.16	? (conv) TT=0.018	? (MO) TT=4	? (MO) TT=4.096	? TT=32.512	? TT=32.631	? TT=40.756	? (TO) TT=1800.06	? (TO) TT=1800.09	? (problem) TT=573.936	? (TO) TT=1800.06	? (MO) TT=135.988	? (MO) TT=48.002	? TT=360.85	SAT TT=398.828	? (MO) TT=152.029	? (MO) TT=163.737
pigeons/ pigeons-10-ord.xml	UNSAT TT=0.016	UNSAT TT=0.663 CHECKS=701 NODES=0	UNSAT TT=0.65 CHECKS=701 NODES=0	UNSAT TT=0.021	UNSAT TT=0.068	UNSAT TT=0.069	UNSAT TT=0.565 NODES=0	UNSAT TT=0.571 NODES=0	UNSAT TT=0.539 CHECKS=741 NODES=0	UNSAT TT=0.024	UNSAT TT=0.784	UNSAT TT=0.722	UNSAT TT=0.016	UNSAT TT=1.631	UNSAT TT=1.347	UNSAT TT=0.503	UNSAT TT=0.019	UNSAT TT=0.005 CHECKS=2019 NODES=0	UNSAT TT=0.004 CHECKS=2019 NODES=0
pigeons/ pigeons-10.xml	UNSAT TT=0.573	UNSAT TT=1.203 CHECKS=400907 NODES=23324	UNSAT TT=1.31 CHECKS=503040 NODES=28792	UNSAT TT=0.573	UNSAT TT=1.542	UNSAT TT=1.58	UNSAT TT=94.723 NODES=636714	UNSAT TT=13.497 NODES=394476	UNSAT TT=13.722 CHECKS=4568964 NODES=394240	UNSAT TT=9.988	UNSAT TT=3.773	UNSAT TT=531.386	UNSAT TT=1.333	UNSAT TT=26.2	UNSAT TT=24.702	UNSAT TT=0.909	UNSAT TT=2.072	UNSAT TT=0.833 CHECKS=13344400 NODES=260649	UNSAT TT=0.813 CHECKS=13344400 NODES=260649
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
pigeons/ pigeons-11.xml	UNSAT TT=2.159	UNSAT TT=2.159 CHECKS=1511005 NODES=72330	UNSAT TT=2.507 CHECKS=1772409 NODES=84789	UNSAT TT=5.701	UNSAT TT=14.573	UNSAT TT=14.451	UNSAT TT=1020.45 NODES=6691895	UNSAT TT=144.867 NODES=3927314	UNSAT TT=152.723 CHECKS=42484745 NODES=3927314	UNSAT TT=71.452	UNSAT TT=58.39	? (TO) TT=1800.02	UNSAT TT=13.674	UNSAT TT=477.251	UNSAT TT=465.29	UNSAT TT=2.533	UNSAT TT=19.946	UNSAT TT=8.871 CHECKS=133446000 NODES=2606500	UNSAT TT=8.906 CHECKS=133446000 NODES=2606500
pigeons/ pigeons-12.xml	UNSAT TT=3.37	UNSAT TT=5.533 CHECKS=5444631 NODES=219771	UNSAT TT=3.37 CHECKS=3221487 NODES=128112	UNSAT TT=62.245	UNSAT TT=155.479	UNSAT TT=156.294	? (TO) TT=1800.09	UNSAT TT=1537.57 NODES=41936175	UNSAT TT=1670.43 CHECKS=498438421 NODES=41936175	UNSAT TT=957.866	UNSAT TT=1513.78	? (TO) TT=1800.02	UNSAT TT=152.35	? (TO) TT=1800.1	? (TO) TT=1800.16	UNSAT TT=11.586	UNSAT TT=219.499	UNSAT TT=99.92 CHECKS=1467910000 NODES=28671500	UNSAT TT=98.825 CHECKS=1467910000 NODES=28671500
pigeons/ pigeons-13.xml	UNSAT TT=9.144	UNSAT TT=12.639 CHECKS=15546983 NODES=531169	UNSAT TT=9.144 CHECKS=11141844 NODES=395717	UNSAT TT=758.843	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.12	? (TO) TT=1800.13	UNSAT TT=70.44	? (TO) TT=1800.06	UNSAT TT=1115.88 CHECKS=17614900000 NODES=344058000	UNSAT TT=1209.57 CHECKS=17614900000 NODES=344058000
pigeons/ pigeons-14.xml	UNSAT TT=13.966	UNSAT TT=13.966 CHECKS=17292266 NODES=513740	UNSAT TT=38.433 CHECKS=51448195 NODES=1541321	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	UNSAT TT=722.298	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02
pigeons/ pigeons-15.xml	UNSAT TT=74.813	UNSAT TT=127.891 CHECKS=180573567 NODES=4727539	UNSAT TT=74.813 CHECKS=100248532 NODES=2516434	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05
pigeons/ pigeons-16.xml	UNSAT TT=155.669	UNSAT TT=170.919 CHECKS=245301219 NODES=5379467	UNSAT TT=155.669 CHECKS=228337068 NODES=5410514	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.69	? (TO) TT=1800.14	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.03
pigeons/ pigeons-18.xml	UNSAT TT=302.104	UNSAT TT=302.104 CHECKS=405023868 NODES=8265149	? (TO) TT=1800.13	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.2	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.06
pigeons/ pigeons-20-ord.xml	UNSAT TT=0.046	UNSAT TT=0.753 CHECKS=6706 NODES=0	UNSAT TT=0.797 CHECKS=6706 NODES=0	UNSAT TT=4.061	UNSAT TT=0.107	UNSAT TT=0.104	UNSAT TT=1.122 NODES=0	UNSAT TT=1.106 NODES=0	UNSAT TT=1.134 CHECKS=12001 NODES=0	UNSAT TT=5.542	UNSAT TT=1.981	UNSAT TT=1.108	UNSAT TT=0.076	UNSAT TT=3.273	UNSAT TT=2.733	UNSAT TT=0.431	UNSAT TT=0.046	UNSAT TT=0.019 CHECKS=33364 NODES=0	UNSAT TT=0.021 CHECKS=33364 NODES=0
pigeons/ pigeons-20.xml		? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.01	? (TO) TT=1800.03	? (TO) TT=1800.07
pigeons/ pigeons-25.xml		? (TO) TT=1800.11	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.08
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
pigeons/ pigeons-30-ord.xml	UNSAT TT=0.154	UNSAT TT=0.914 CHECKS=24011 NODES=0	UNSAT TT=0.928 CHECKS=24011 NODES=0	UNSAT TT=900.266	UNSAT TT=0.177	UNSAT TT=0.175	UNSAT TT=2.215 NODES=0	UNSAT TT=2.224 NODES=0	UNSAT TT=2.038 CHECKS=60411 NODES=0	UNSAT TT=256.428	UNSAT TT=6.299	UNSAT TT=2.098	UNSAT TT=0.301	UNSAT TT=5.649	UNSAT TT=5.214	UNSAT TT=1.001	UNSAT TT=0.154	UNSAT TT=0.08 CHECKS=169534 NODES=0	UNSAT TT=0.077 CHECKS=169534 NODES=0
pigeons/ pigeons-30.xml		? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.03	? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.01	? (TO) TT=1800.02
pigeons/ pigeons-35.xml		? (TO) TT=1800.13	? (TO) TT=1800.16	? (TO) TT=1800.09	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.12	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.04
pigeons/ pigeons-40-ord.xml	UNSAT TT=0.281	UNSAT TT=0.964 CHECKS=58616 NODES=0	UNSAT TT=1.016 CHECKS=58616 NODES=0	UNSAT TT=912.403	UNSAT TT=0.281	UNSAT TT=0.283	UNSAT TT=4.371 NODES=0	UNSAT TT=3.986 NODES=0	UNSAT TT=3.942 CHECKS=190096 NODES=0	? (TO) TT=1800.1	UNSAT TT=16.867	UNSAT TT=5.073	UNSAT TT=8.696	UNSAT TT=13.175	UNSAT TT=11.213	UNSAT TT=1.2	UNSAT TT=0.336	UNSAT TT=0.236 CHECKS=536029 NODES=0	UNSAT TT=0.235 CHECKS=536029 NODES=0
pigeons/ pigeons-40.xml		? (TO) TT=1800.16	? (TO) TT=1800.17	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.25	? (TO) TT=1800.39	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09
pigeons/ pigeons-45.xml		? (TO) TT=1800.15	? (TO) TT=1800.09	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.08
pigeons/ pigeons-50-ord.xml	UNSAT TT=0.428	UNSAT TT=1.098 CHECKS=116521 NODES=0	UNSAT TT=1.031 CHECKS=116521 NODES=0	? (TO) TT=1800.01	UNSAT TT=0.428	UNSAT TT=0.429	UNSAT TT=6.235 NODES=0	UNSAT TT=6.956 NODES=0	UNSAT TT=6.376 CHECKS=462681 NODES=0	? (TO) TT=1800.03	UNSAT TT=42.394	UNSAT TT=14.276	UNSAT TT=219.911	UNSAT TT=25.484	UNSAT TT=19.875	UNSAT TT=1.38	UNSAT TT=1.519	UNSAT TT=0.605 CHECKS=1308350 NODES=0	UNSAT TT=0.573 CHECKS=1308350 NODES=0
pigeons/ pigeons-50.xml		? (TO) TT=1800.1	? (TO) TT=1800.14	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.2	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.05
pigeons/ pigeons-5.xml	UNSAT TT=0.011	UNSAT TT=0.643 CHECKS=394 NODES=27	UNSAT TT=0.656 CHECKS=357 NODES=24	UNSAT TT=0.019	UNSAT TT=0.057	UNSAT TT=0.058	UNSAT TT=0.396 NODES=23	UNSAT TT=0.368 NODES=28	UNSAT TT=0.396 CHECKS=493 NODES=28	UNSAT TT=0.022	UNSAT TT=0.518	UNSAT TT=0.578	UNSAT TT=0.011	UNSAT TT=0.825	UNSAT TT=0.82	UNSAT TT=0.237	UNSAT TT=0.012	UNSAT TT=0.002 CHECKS=800 NODES=16	UNSAT TT=0.002 CHECKS=800 NODES=16
pigeons/ pigeons-6.xml	UNSAT TT=0.011	UNSAT TT=0.662 CHECKS=1913 NODES=142	UNSAT TT=0.66 CHECKS=1739 NODES=136	UNSAT TT=0.021	UNSAT TT=0.057	UNSAT TT=0.056	UNSAT TT=0.432 NODES=119	UNSAT TT=0.4 NODES=148	UNSAT TT=0.41 CHECKS=1972 NODES=137	UNSAT TT=0.021	UNSAT TT=0.521	UNSAT TT=0.601	UNSAT TT=0.011	UNSAT TT=1.022	UNSAT TT=1.041	UNSAT TT=0.41	? (TO) TT=1800.05	UNSAT TT=0.003 CHECKS=4305 NODES=85	UNSAT TT=0.003 CHECKS=4305 NODES=85
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
pigeons/ pigeons-7.xml	UNSAT TT=0.019	UNSAT TT=0.775 CHECKS=8684 NODES=656	UNSAT TT=0.71 CHECKS=8322 NODES=655	UNSAT TT=0.019	UNSAT TT=0.065	UNSAT TT=0.062	UNSAT TT=0.557 NODES=719	UNSAT TT=0.491 NODES=824	UNSAT TT=0.494 CHECKS=11151 NODES=819	UNSAT TT=0.031	UNSAT TT=0.586	UNSAT TT=0.705	UNSAT TT=0.023	UNSAT TT=1.157	UNSAT TT=1.148	UNSAT TT=0.453	? (TO) TT=1800.05	UNSAT TT=0.004 CHECKS=26340 NODES=516	UNSAT TT=0.004 CHECKS=26340 NODES=516
pigeons/ pigeons-8.xml	UNSAT TT=0.027	UNSAT TT=0.842 CHECKS=40940 NODES=2996	UNSAT TT=0.817 CHECKS=40012 NODES=3035	UNSAT TT=0.027	UNSAT TT=0.089	UNSAT TT=0.084	UNSAT TT=1.971 NODES=12015	UNSAT TT=0.686 NODES=5779	UNSAT TT=0.698 CHECKS=68380 NODES=5779	UNSAT TT=0.158	UNSAT TT=0.651	UNSAT TT=1.546	UNSAT TT=0.029	UNSAT TT=1.803	UNSAT TT=1.427	UNSAT TT=0.293	UNSAT TT=0.041	UNSAT TT=0.014 CHECKS=185171 NODES=3619	UNSAT TT=0.014 CHECKS=185171 NODES=3619
pigeons/ pigeons-9.xml	UNSAT TT=0.081	UNSAT TT=1.035 CHECKS=164152 NODES=11147	UNSAT TT=0.957 CHECKS=149401 NODES=10177	UNSAT TT=0.081	UNSAT TT=0.24	UNSAT TT=0.238	UNSAT TT=11.235 NODES=80075	UNSAT TT=1.844 NODES=44619	UNSAT TT=1.969 CHECKS=495018 NODES=44619	UNSAT TT=1.241	UNSAT TT=1.001	UNSAT TT=17.828	UNSAT TT=0.143	UNSAT TT=3.578	UNSAT TT=3.276	UNSAT TT=0.59	UNSAT TT=0.232	UNSAT TT=0.098 CHECKS=1482530 NODES=28960	UNSAT TT=0.099 CHECKS=1482530 NODES=28960
queenAttacking/ queenAttacking-10.xml		? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=24.894	? (TO) TT=1800.03	? (TO) TT=1800.02	? (MO) TT=93.242	? (exit code) TT=741.228	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.07
queenAttacking/ queenAttacking-11.xml		? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.1	? (MO) TT=40.534	? (TO) TT=0.028	? (TO) TT=1800.08	? TT=340.902	? TT=96.536	? (TO) TT=1800.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.12
queenAttacking/ queenAttacking-12.xml		? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.01	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800	? (TO) TT=1800.03	? (MO) TT=0	? (TO) TT=0.028	? (TO) TT=1800.04	? (MO) TT=218.088	? (MO) TT=117.811	? (TO) TT=1800.16	? (TO) TT=1800.1	? (TO) TT=1800.21	? (TO) TT=1800.21
queenAttacking/ queenAttacking-3.xml	UNSAT TT=0.014	UNSAT TT=0.676 CHECKS=4796 NODES=27	UNSAT TT=0.676 CHECKS=4285 NODES=41	UNSAT TT=0.045	UNSAT TT=0.065	UNSAT TT=0.065	UNSAT TT=0.543 NODES=38	UNSAT TT=0.546 NODES=33	UNSAT TT=0.544 CHECKS=5833 NODES=31	UNSAT TT=0.065	UNSAT TT=0.748	UNSAT TT=0.732	UNSAT TT=0.016	UNSAT TT=1.691	UNSAT TT=2.407	UNSAT TT=0.057	UNSAT TT=0.014	UNSAT TT=0.004 CHECKS=11889 NODES=13	UNSAT TT=0.005 CHECKS=11889 NODES=13
queenAttacking/ queenAttacking-4.xml	UNSAT TT=0.057	UNSAT TT=0.815 CHECKS=102789 NODES=643	UNSAT TT=0.81 CHECKS=94189 NODES=580	UNSAT TT=1575.42	UNSAT TT=0.623	UNSAT TT=0.667	UNSAT TT=1.251 NODES=642	UNSAT TT=1.039 NODES=431	UNSAT TT=0.93 CHECKS=105395 NODES=396	UNSAT TT=5.63	UNSAT TT=0.973	UNSAT TT=0.907	UNSAT TT=0.057	UNSAT TT=3.652	UNSAT TT=2.822	UNSAT TT=1.19	UNSAT TT=0.082	UNSAT TT=0.023 CHECKS=457751 NODES=549	UNSAT TT=0.022 CHECKS=457751 NODES=549
queenAttacking/ queenAttacking-5.xml	SAT TT=0.086	SAT TT=8.802 CHECKS=19636800 NODES=82000	SAT TT=1.47 CHECKS=1428498 NODES=6121	? (TO) TT=1800.04	SAT TT=0.632	SAT TT=0.647	SAT TT=3.605 NODES=2377	SAT TT=1.71 NODES=264	SAT TT=1.651 CHECKS=474914 NODES=612	SAT TT=141.225	SAT TT=2.151	SAT TT=3.06	SAT TT=0.687	? (MO) TT=4.416	? (MO) TT=4.094	SAT TT=2.24	SAT TT=0.086	SAT TT=1.192 CHECKS=37373300 NODES=24782	SAT TT=1.194 CHECKS=37373300 NODES=24782
queenAttacking/ queenAttacking-6.xml	SAT TT=1.746	SAT TT=81.778 CHECKS=257201734 NODES=525871	SAT TT=121.701 CHECKS=374999862 NODES=790044	? (TO) TT=1800.01	SAT TT=39.75	SAT TT=39.87	? (TO) TT=1800.08	SAT TT=94.431 NODES=51197	SAT TT=79.896 CHECKS=41064866 NODES=75303	? (TO) TT=1800.06	SAT TT=13.679	SAT TT=14.199	SAT TT=6.812	SAT TT=101.098	? (MO) TT=3.882	SAT TT=49.63	SAT TT=1.746	SAT TT=3.811 CHECKS=135238000 NODES=39166	SAT TT=3.784 CHECKS=135238000 NODES=39166
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
queenAttacking/ queenAttacking-7.xml	SAT TT=23.412	? (TO) TT=1800.2	? (TO) TT=1800.18	? (TO) TT=1800.06	SAT TT=236.891	SAT TT=240.256	? (TO) TT=1800.06	SAT TT=23.412 NODES=8871	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.02	SAT TT=253.224	SAT TT=916.985	? (TO) TT=1800.12	? (MO) TT=6.203	? (TO) TT=1800.03	SAT TT=496.858	? (TO) TT=1800.1	? (TO) TT=1800.02
queenAttacking/ queenAttacking-8.xml		? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.07	? (TO) TT=1800.04	? (MO) TT=7.295	? (TO) TT=1800.13	? (TO) TT=1800.08	? (MO) TT=21.546	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03
queenAttacking/ queenAttacking-9.xml		? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.03	? (MO) TT=42.746	? (MO) TT=22.069	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.03	? (TO) TT=1800.09
queensKnights/ queensKnights-100-5-add.xml	UNSAT TT=311.288	UNSAT TT=1706.82 CHECKS=1908632461 NODES=0	? (TO) TT=1800.13	? (TO) TT=1800.11	UNSAT TT=311.288	? (TO) TT=1800.11	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.08	? (problem) TT=246.089	? (TO) TT=1800.05	? (MO) TT=143.915	? TT=111.202	? TT=219.99	? (TO) TT=1800.04	? (exit code) TT=86.522	? (MO) TT=90.199
queensKnights/ queensKnights-100-5-mul.xml		? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=0.007	? TT=20.841	? (TO) TT=1800.03	? (TO) TT=1800.04	? (problem) TT=295.087	? (TO) TT=1800.03	? (MO) TT=145.127	? TT=110.24	? TT=220.02	? (TO) TT=1800.02	? (MO) TT=81.186	? (exit code) TT=90.889
queensKnights/ queensKnights-10-5-add.xml	UNSAT TT=0.126	UNSAT TT=0.765 CHECKS=123846 NODES=0	UNSAT TT=1.081 CHECKS=548439 NODES=5385	? (TO) TT=1800.05	UNSAT TT=0.126	UNSAT TT=0.289	UNSAT TT=1.521 NODES=1471	UNSAT TT=1.322 NODES=314	UNSAT TT=0.871 CHECKS=200866 NODES=427	UNSAT TT=754.42	UNSAT TT=1.676	UNSAT TT=1.125	UNSAT TT=4.178	UNSAT TT=3.579	UNSAT TT=4.072	UNSAT TT=0.212	UNSAT TT=1.303	UNSAT TT=0.166 CHECKS=14411200 NODES=107	UNSAT TT=0.171 CHECKS=14411200 NODES=107
queensKnights/ queensKnights-10-5-mul.xml	UNSAT TT=0.383	UNSAT TT=0.837 CHECKS=153638 NODES=0	UNSAT TT=0.923 CHECKS=795442 NODES=663	? (TO) TT=1800.03	UNSAT TT=0.383	UNSAT TT=0.674	UNSAT TT=3.544 NODES=1579	UNSAT TT=2.57 NODES=427	UNSAT TT=1.193 CHECKS=391839 NODES=593	UNSAT TT=719.118	UNSAT TT=1.895	UNSAT TT=1.425	UNSAT TT=18.052	UNSAT TT=4.266	UNSAT TT=4.595	UNSAT TT=0.636	UNSAT TT=2.126	UNSAT TT=0.183 CHECKS=13812600 NODES=35	UNSAT TT=0.19 CHECKS=13812600 NODES=35
queensKnights/ queensKnights-12-5-add.xml	UNSAT TT=0.181	UNSAT TT=0.827 CHECKS=339564 NODES=0	UNSAT TT=4.329 CHECKS=9297348 NODES=106810	? (TO) TT=1800.1	UNSAT TT=0.181	UNSAT TT=0.735	UNSAT TT=3.466 NODES=2790	UNSAT TT=3.848 NODES=990	UNSAT TT=1.246 CHECKS=516553 NODES=992	? (TO) TT=1800.09	UNSAT TT=2.322	UNSAT TT=1.317	UNSAT TT=491.94	UNSAT TT=4.922	UNSAT TT=4.996	UNSAT TT=0.564	UNSAT TT=3.035	UNSAT TT=0.522 CHECKS=60790500 NODES=312	UNSAT TT=0.522 CHECKS=60790500 NODES=312
queensKnights/ queensKnights-12-5-mul.xml	UNSAT TT=0.841	UNSAT TT=0.841 CHECKS=434502 NODES=0	UNSAT TT=0.98 CHECKS=2425436 NODES=1058	? (TO) TT=1800.11	UNSAT TT=0.903	UNSAT TT=1.745	UNSAT TT=12.784 NODES=3283	UNSAT TT=7.461 NODES=986	UNSAT TT=1.92 CHECKS=1145027 NODES=1406	? (TO) TT=1800.04	UNSAT TT=2.648	UNSAT TT=1.637	UNSAT TT=380.558	UNSAT TT=5.655	UNSAT TT=6.073	UNSAT TT=1.14	UNSAT TT=1.701	UNSAT TT=0.507 CHECKS=52228900 NODES=54	UNSAT TT=0.503 CHECKS=52228900 NODES=54
queensKnights/ queensKnights-15-5-add.xml	UNSAT TT=0.328	UNSAT TT=0.892 CHECKS=1085853 NODES=0	? (TO) TT=1800.22	? (TO) TT=1800.07	UNSAT TT=0.328	UNSAT TT=2.49	UNSAT TT=7.155 NODES=3741	UNSAT TT=6.847 NODES=926	UNSAT TT=1.595 CHECKS=947832 NODES=930	? (TO) TT=1800.04	UNSAT TT=3.734	UNSAT TT=1.783	? (TO) TT=1800.03	UNSAT TT=7.348	? (MO) TT=3.8	UNSAT TT=1.397	UNSAT TT=8.387	UNSAT TT=1.981 CHECKS=315674000 NODES=257	UNSAT TT=2.004 CHECKS=315674000 NODES=257
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
queensKnights/ queensKnights-15-5-mul.xml	UNSAT TT=1.003	UNSAT TT=1.003 CHECKS=1356529 NODES=0	UNSAT TT=1.222 CHECKS=6222966 NODES=1298	? (TO) TT=1800.07	UNSAT TT=2.485	UNSAT TT=5.772	UNSAT TT=30.392 NODES=3871	UNSAT TT=17.312 NODES=932	UNSAT TT=2.846 CHECKS=1788220 NODES=1280	? (TO) TT=1800.05	UNSAT TT=4.371	UNSAT TT=2.25	? (TO) TT=1800.07	UNSAT TT=9.399	UNSAT TT=9.582	UNSAT TT=1.63	UNSAT TT=6.702	UNSAT TT=2.116 CHECKS=293977000 NODES=68	UNSAT TT=1.957 CHECKS=293977000 NODES=68
queensKnights/ queensKnights-20-5-add.xml	UNSAT TT=0.897	UNSAT TT=1.2 CHECKS=5566862 NODES=0	? (TO) TT=1800.23	? (TO) TT=1800.05	UNSAT TT=0.897	UNSAT TT=13.528	UNSAT TT=34.113 NODES=15204	UNSAT TT=17.225 NODES=980	UNSAT TT=3.675 CHECKS=2688786 NODES=1273	? (TO) TT=1800.08	UNSAT TT=9.145	UNSAT TT=3.236	? (TO) TT=1800.02	UNSAT TT=18.755	? (MO) TT=4.532	UNSAT TT=2.9	UNSAT TT=64.298	UNSAT TT=22.468 CHECKS=3222630000 NODES=357	UNSAT TT=23.007 CHECKS=3222630000 NODES=357
queensKnights/ queensKnights-20-5-mul.xml	UNSAT TT=1.27	UNSAT TT=1.27 CHECKS=6675749 NODES=0	UNSAT TT=2.727 CHECKS=48578764 NODES=3459	? (TO) TT=1800.02	UNSAT TT=8.825	UNSAT TT=26.574	UNSAT TT=262.001 NODES=16528	UNSAT TT=76.714 NODES=1268	UNSAT TT=6.144 CHECKS=4907271 NODES=1701	? (TO) TT=1800.04	UNSAT TT=10.568	UNSAT TT=3.897	? (TO) TT=1800.04	UNSAT TT=24.908	? (MO) TT=5.074	UNSAT TT=2.62	UNSAT TT=83.015	UNSAT TT=10.606 CHECKS=954189000 NODES=129	UNSAT TT=10.412 CHECKS=954189000 NODES=129
queensKnights/ queensKnights-25-5-add.xml	UNSAT TT=1.762	UNSAT TT=1.762 CHECKS=9492681 NODES=0	UNSAT TT=2.855 CHECKS=40332787 NODES=2294	? (TO) TT=1800.04	UNSAT TT=2.051	UNSAT TT=51.787	UNSAT TT=96.711 NODES=25859	UNSAT TT=81.801 NODES=2226	UNSAT TT=9.01 CHECKS=6711701 NODES=2225	? (TO) TT=1800.08	UNSAT TT=21.528	UNSAT TT=6.176	? (TO) TT=1800.06	UNSAT TT=44.529	UNSAT TT=43.754	UNSAT TT=6.995	UNSAT TT=247.833	UNSAT TT=180.829 CHECKS=19072000000 NODES=451	UNSAT TT=173.318 CHECKS=19072000000 NODES=451
queensKnights/ queensKnights-25-5-mul.xml	UNSAT TT=1.955	UNSAT TT=1.955 CHECKS=9716849 NODES=0	UNSAT TT=3.398 CHECKS=49353389 NODES=2778	? (TO) TT=1800.07	UNSAT TT=23.438	UNSAT TT=81.437	UNSAT TT=698.229 NODES=16697	UNSAT TT=291.326 NODES=2224	UNSAT TT=14.377 CHECKS=11716868 NODES=2224	? (TO) TT=1800.1	UNSAT TT=22.388	UNSAT TT=6.549	? (TO) TT=1800.08	UNSAT TT=55.615	UNSAT TT=61.105	UNSAT TT=5.759	UNSAT TT=162.159	UNSAT TT=49.784 CHECKS=5178820000 NODES=223	UNSAT TT=48.62 CHECKS=5178820000 NODES=223
queensKnights/ queensKnights-50-5-add.xml	UNSAT TT=17.367	UNSAT TT=17.367 CHECKS=557910276 NODES=0	UNSAT TT=689.697 CHECKS=1239702693 NODES=18140	? (TO) TT=1800.06	UNSAT TT=21.28	UNSAT TT=853.738	? (TO) TT=1800.04	? (TO) TT=1800.07	UNSAT TT=349.729 CHECKS=117028142 NODES=12274	? (TO) TT=1800.04	UNSAT TT=327.166	? (problem) TT=117.548	? (TO) TT=1800.1	UNSAT TT=884.701	? (MO) TT=15.922	UNSAT TT=56.04	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.1
queensKnights/ queensKnights-50-5-mul.xml	UNSAT TT=18.837	UNSAT TT=18.837 CHECKS=561542731 NODES=0	UNSAT TT=359.205 CHECKS=866760957 NODES=9549	? (TO) TT=1800.05	UNSAT TT=865.052	UNSAT TT=1639.64	? (TO) TT=1800.03	? (TO) TT=1800.08	UNSAT TT=516.481 CHECKS=193417986 NODES=11580	? (TO) TT=1800.07	UNSAT TT=309.942	? (problem) TT=121.242	? (TO) TT=1800.02	? (exit code) TT=681.777	? (MO) TT=117.036	UNSAT TT=62.19	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.1
queensKnights/ queensKnights-80-5-add.xml	UNSAT TT=135.891	UNSAT TT=759.851 CHECKS=788089841 NODES=0	? (TO) TT=1800.16	? (TO) TT=1800.11	UNSAT TT=135.891	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.08	? (problem) TT=175.606	? (TO) TT=1800.09	? TT=725.634	? TT=97.039	? (MO) TT=98.55	? (TO) TT=1800.01	? (MO) TT=675.536	? (MO) TT=706.707
queensKnights/ queensKnights-80-5-mul.xml	UNSAT TT=738.167	UNSAT TT=738.167 CHECKS=830863236 NODES=0	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	? (TO) TT=1800	? (TO) TT=1800.05	? TT=17.576	? (TO) TT=1800.08	? (TO) TT=1800.04	? (problem) TT=144.822	? (TO) TT=1800.08	? (exit code) TT=673.189	? TT=93.956	? (MO) TT=98.61	? (TO) TT=1800.04	? (exit code) TT=703.82	? (MO) TT=707.247
queensKnights/ queensKnights-8-5-add.xml	UNSAT TT=0.091	UNSAT TT=0.706 CHECKS=34753 NODES=0	UNSAT TT=0.808 CHECKS=65107 NODES=466	? (TO) TT=1800.11	UNSAT TT=0.091	UNSAT TT=0.132	UNSAT TT=0.993 NODES=819	UNSAT TT=0.801 NODES=177	UNSAT TT=0.693 CHECKS=82364 NODES=243	UNSAT TT=73.46	UNSAT TT=1.197	UNSAT TT=0.963	UNSAT TT=0.92	UNSAT TT=3.177	UNSAT TT=2.483	UNSAT TT=0.464	UNSAT TT=0.318	UNSAT TT=0.046 CHECKS=2388320 NODES=68	UNSAT TT=0.046 CHECKS=2388320 NODES=68
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
queensKnights/ queensKnights-8-5-mul.xml	UNSAT TT=0.12	UNSAT TT=0.738 CHECKS=46020 NODES=0	UNSAT TT=0.819 CHECKS=297086 NODES=587	UNSAT TT=1082.77	UNSAT TT=0.184	UNSAT TT=0.261	UNSAT TT=2.002 NODES=1147	UNSAT TT=1.266 NODES=242	UNSAT TT=0.921 CHECKS=153013 NODES=339	UNSAT TT=77.632	UNSAT TT=1.434	UNSAT TT=1.212	UNSAT TT=1.533	UNSAT TT=3.224	UNSAT TT=3.124	UNSAT TT=0.12	UNSAT TT=0.386	UNSAT TT=0.051 CHECKS=2287850 NODES=21	UNSAT TT=0.048 CHECKS=2287850 NODES=21
queens/ queens-100.xml	SAT TT=0.216	SAT TT=2.13 CHECKS=549950 NODES=0	SAT TT=2.472 CHECKS=825198 NODES=170	SAT TT=0.216	SAT TT=1.947	SAT TT=4.235	SAT TT=39.713 NODES=115	SAT TT=58.729 NODES=292	SAT TT=62.756 CHECKS=98418376 NODES=2699	? (TO) TT=1800.09	SAT TT=45.323	SAT TT=12.886	SAT TT=1.312	SAT TT=184.216	? TT=95.325	? TT=199.37	SAT TT=0.576	SAT TT=11.692 CHECKS=20342800 NODES=108	SAT TT=11.697 CHECKS=20342800 NODES=108
queens/ queens-10.xml	SAT TT=0.015	SAT TT=0.686 CHECKS=1994 NODES=17	SAT TT=0.66 CHECKS=891 NODES=16	SAT TT=0.02	SAT TT=0.068	SAT TT=0.074	SAT TT=0.524 NODES=10	SAT TT=0.539 NODES=26	SAT TT=0.564 CHECKS=8088 NODES=31	SAT TT=0.025	SAT TT=1.27	SAT TT=1.324	SAT TT=0.016	SAT TT=1.397	SAT TT=1.458	SAT TT=0.809	SAT TT=0.015	SAT TT=0.006 CHECKS=4071 NODES=12	SAT TT=0.003 CHECKS=4071 NODES=12
queens/ queens-120.xml	SAT TT=0.604	SAT TT=3.347 CHECKS=1626694 NODES=134	SAT TT=2.949 CHECKS=1402544 NODES=207	SAT TT=227.961	SAT TT=13.359	SAT TT=19.316	SAT TT=76.225 NODES=127	SAT TT=130.552 NODES=1009	SAT TT=124.595 CHECKS=204554926 NODES=3247	? (TO) TT=1800.09	SAT TT=76.956	SAT TT=20.212	SAT TT=0.652	? TT=303.539	? TT=88.823	? TT=409.305	SAT TT=0.604	SAT TT=141.926 CHECKS=2295700000 NODES=1018230	SAT TT=132.465 CHECKS=2295700000 NODES=1018230
queens/ queens-12.xml	SAT TT=0.015	SAT TT=0.768 CHECKS=3889 NODES=37	SAT TT=0.796 CHECKS=2587 NODES=27	SAT TT=0.022	SAT TT=0.073	SAT TT=0.073	SAT TT=0.607 NODES=29	SAT TT=0.648 NODES=13	SAT TT=0.601 CHECKS=15775 NODES=13	SAT TT=0.029	SAT TT=1.427	SAT TT=1.452	SAT TT=0.017	SAT TT=1.724	SAT TT=1.705	SAT TT=0.35	SAT TT=0.015	SAT TT=0.006 CHECKS=11701 NODES=28	SAT TT=0.004 CHECKS=11701 NODES=28
queens/ queens-150.xml	SAT TT=1.063	SAT TT=5.841 CHECKS=5242176 NODES=261	SAT TT=4.796 CHECKS=3467236 NODES=249	SAT TT=15.168	SAT TT=5.455	SAT TT=17.191	SAT TT=516.977 NODES=39797	SAT TT=409.356 NODES=5903	SAT TT=320.663 CHECKS=503649733 NODES=8574	? (TO) TT=1800.03	SAT TT=149.339	SAT TT=32.999	SAT TT=1.063	? (MO) TT=386.349	? (exit code) TT=114.238	? TT=994.418	SAT TT=1.07	? (MO) TT=60.867	? (MO) TT=61.772
queens/ queens-15.xml	SAT TT=0.017	SAT TT=0.782 CHECKS=7628 NODES=47	SAT TT=0.729 CHECKS=5925 NODES=46	SAT TT=0.023	SAT TT=0.083	SAT TT=0.088	SAT TT=0.775 NODES=16	SAT TT=0.814 NODES=55	SAT TT=0.751 CHECKS=43335 NODES=55	SAT TT=0.401	SAT TT=1.691	SAT TT=1.512	SAT TT=0.018	SAT TT=2.2	SAT TT=2.299	SAT TT=1.14	SAT TT=0.017	SAT TT=0.009 CHECKS=13562 NODES=15	SAT TT=0.007 CHECKS=13562 NODES=15
queens/ queens-180.xml	SAT TT=4.357	SAT TT=6.99 CHECKS=3749556 NODES=0	SAT TT=7.11 CHECKS=5967691 NODES=286	? (TO) TT=1800.09	SAT TT=9.716	SAT TT=32.324	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=0.004	? (TO) TT=1800.09	SAT TT=244.669	SAT TT=63.031	? (TO) TT=1800.09	? TT=613.768	? (exit code) TT=96.844	? (TO) TT=1803.6	SAT TT=4.357	? (MO) TT=67.232	? (MO) TT=67.787
queens/ queens-200.xml	SAT TT=2.266	SAT TT=16.978 CHECKS=22581776 NODES=730	SAT TT=157.696 CHECKS=189586371 NODES=984	SAT TT=8.079	SAT TT=31.83	SAT TT=67.28	? (TO) TT=0.005	? (TO) TT=0.006	? (TO) TT=0.004	? (TO) TT=1800.09	SAT TT=345.492	? (problem) TT=190.065	SAT TT=2.266	? TT=664.614	? TT=97.758	? (TO) TT=1801.76	SAT TT=2.384	? (MO) TT=81.245	? (MO) TT=74.17
queens/ queens-20.xml	SAT TT=0.024	SAT TT=0.812 CHECKS=4816 NODES=0	SAT TT=0.811 CHECKS=9463 NODES=50	SAT TT=0.024	SAT TT=0.12	SAT TT=0.116	SAT TT=0.982 NODES=23	SAT TT=1.22 NODES=38	SAT TT=1.079 CHECKS=137902 NODES=38	SAT TT=0.229	SAT TT=2.073	SAT TT=1.917	SAT TT=0.025	SAT TT=2.836	SAT TT=3.236	SAT TT=1.967	SAT TT=0.027	SAT TT=0.017 CHECKS=43878 NODES=33	SAT TT=0.018 CHECKS=43878 NODES=33
Bench name	Best results on this instance	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
queens/ queens-30.xml	SAT TT=0.037	SAT TT=0.929 CHECKS=66773 NODES=180	SAT TT=0.944 CHECKS=25330 NODES=79	SAT TT=0.037	SAT TT=0.227	SAT TT=0.25	SAT TT=2.332 NODES=31	SAT TT=2.29 NODES=35	SAT TT=2.42 CHECKS=729606 NODES=35	SAT TT=103.059	SAT TT=3.316	SAT TT=2.569	SAT TT=0.046	SAT TT=4.611	SAT TT=5.191	SAT TT=4.634	SAT TT=0.045	SAT TT=0.078 CHECKS=192330 NODES=46	SAT TT=0.082 CHECKS=192330 NODES=46
queens/ queens-4.xml	SAT TT=0.012	SAT TT=0.625 CHECKS=62 NODES=0	SAT TT=0.673 CHECKS=59 NODES=5	SAT TT=0.018	SAT TT=0.061	SAT TT=0.059	SAT TT=0.36 NODES=8	SAT TT=0.37 NODES=6	SAT TT=0.35 CHECKS=116 NODES=6	SAT TT=0.025	SAT TT=0.929	SAT TT=0.982	SAT TT=0.013	SAT TT=0.77	SAT TT=0.815	SAT TT=0.41	SAT TT=0.012	SAT TT=0.002 CHECKS=133 NODES=4	SAT TT=0.002 CHECKS=133 NODES=4
queens/ queens-50.xml	SAT TT=0.08	SAT TT=1.172 CHECKS=134822 NODES=104	SAT TT=1.167 CHECKS=128180 NODES=154	SAT TT=0.08	SAT TT=0.763	SAT TT=0.897	SAT TT=6.343 NODES=57	SAT TT=6.67 NODES=53	SAT TT=6.481 CHECKS=5868696 NODES=53	? (TO) TT=1800.06	SAT TT=8.215	SAT TT=4.148	SAT TT=0.108	SAT TT=14.073	SAT TT=17.107	SAT TT=33.5	SAT TT=0.12	SAT TT=0.626 CHECKS=1427620 NODES=211	SAT TT=0.641 CHECKS=1427620 NODES=211
queens/ queens-80.xml	SAT TT=0.153	SAT TT=1.864 CHECKS=871411 NODES=241	SAT TT=1.833 CHECKS=416739 NODES=138	SAT TT=0.153	SAT TT=3.41	SAT TT=4.261	SAT TT=20.254 NODES=281	SAT TT=27.943 NODES=238	SAT TT=26.235 CHECKS=39864546 NODES=1149	? (TO) TT=1800.08	SAT TT=25.011	SAT TT=7.849	SAT TT=0.249	SAT TT=75.444	? TT=114.923	? (MO) TT=94.25	SAT TT=0.251	SAT TT=4.45 CHECKS=8449360 NODES=94	SAT TT=4.718 CHECKS=8449360 NODES=94
queens/ queens-8.xml	SAT TT=0.014	SAT TT=0.655 CHECKS=682 NODES=0	SAT TT=0.699 CHECKS=1472 NODES=25	SAT TT=0.019	SAT TT=0.064	SAT TT=0.073	SAT TT=0.454 NODES=9	SAT TT=0.485 NODES=12	SAT TT=0.487 CHECKS=2797 NODES=12	SAT TT=0.016	SAT TT=1.203	SAT TT=1.116	SAT TT=0.024	SAT TT=1.214	SAT TT=1.139	SAT TT=0.55	SAT TT=0.014	SAT TT=0.003 CHECKS=2719 NODES=11	SAT TT=0.003 CHECKS=2719 NODES=11
zhou/ color.xml	UNSAT TT=3.155	UNSAT TT=8.719 CHECKS=3729931 NODES=3419	UNSAT TT=14.428 CHECKS=8059386 NODES=8629	UNSAT TT=3.155	UNSAT TT=351.714	UNSAT TT=390.651	UNSAT TT=123.056 NODES=3223	UNSAT TT=119.019 NODES=2902	UNSAT TT=130.739 CHECKS=3252842 NODES=2999	UNSAT TT=355.173	UNSAT TT=1114.56	UNSAT TT=1111.73	UNSAT TT=14.671	UNSAT TT=65.866	? (MO) TT=12.867	UNSAT TT=6.73	UNSAT TT=27.757	UNSAT TT=21.33 CHECKS=187350000 NODES=5529	UNSAT TT=21.321 CHECKS=187350000 NODES=5529
zhou/ queens1.xml	SAT TT=0.449	SAT TT=3.785 CHECKS=823254 NODES=97	SAT TT=3.408 CHECKS=744328 NODES=178	SAT TT=0.449	SAT TT=2.326	SAT TT=4.364	SAT TT=57.38 NODES=137	SAT TT=96.298 NODES=2597	SAT TT=78.521 CHECKS=83909398 NODES=3759	? (TO) TT=1800.07	? (TO) TT=0.036	? (TO) TT=0.033	Signal TT=1.118	? (MO) TT=427.741	? (exit code) TT=192.37	SAT TT=11.712	Signal TT=1.133	Wrong Cert. TT=21.501 CHECKS=21968600 NODES=96	SAT TT=20.363 CHECKS=17486300 NODES=268
zhou/ route.xml	SAT TT=2.58	SAT TT=37.183 CHECKS=157826 NODES=0	SAT TT=36.178 CHECKS=95922 NODES=78	SAT TT=12.872	SAT TT=2.58	SAT TT=2.741	SAT TT=36.604 NODES=87	SAT TT=37.304 NODES=94	SAT TT=36.195 CHECKS=323018 NODES=93	SAT TT=9.301	? (TO) TT=0.025	? (TO) TT=0.031	Signal TT=2.083	? (MO) TT=9.136	? (MO) TT=3.192	SAT TT=6.264	Signal TT=2.049	SAT TT=0.898 CHECKS=253817 NODES=73	SAT TT=0.909 CHECKS=249353 NODES=74

Some statistics...

	Abscon 109 ESAC	Abscon 109 AC	BPrologCSPSolver70a 2006-12-13	buggy_2_5 2007-01-08	buggy_2_5_s 2007-01-08	CSP4J - Combo 2006-12-19	CSP4J - MAC 2006-12-19	CSP4J - MAC 2007-01-16	CSPtoSAT+minisat 0.3	galac 1	galacJ beta 1	Mistral 2006-12-04	sat4jCSP 1.7 RC BF3	SAT4JCSP-CACHED 1.7 RC BF3	sugar 0.40	Tramontane 2006-12-04	VALCSP 3.0	VALCSP 3.1
Number of times the solver is able to give the best known answer	96	86	61	89	85	73	77	81	29	70	61	74	71	55	78	82	0	0
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	16	5	36	18	0	0	1	0	0	0	0	8	0	0	3	14	0	0