PB'09 competition: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Queens Problems

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Queens Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
BoolVar 2009-04-26 (complete)
bsolo 3.1 (complete)
bsolo 3.1 cl (complete)
bsolo 3.1 pb (complete)
pbclasp 2009-04-24 (complete)
SAT4J Pseudo CP 2.1.1 (complete)
SAT4J Pseudo Resolution 2.1.1 (complete)
SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)
SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
wbo 1.0 (complete)

Bench name	Best results on this instance	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966483.opb	UNSAT TT=0.068	UNSAT TT=4.942	UNSAT TT=35.45	UNSAT TT=33.651	UNSAT TT=0.29	UNSAT TT=1.451	UNSAT TT=8.039	UNSAT TT=4.516	UNSAT TT=0.068	UNSAT TT=0.071	UNSAT TT=7.498
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966688.opb	UNSAT TT=0.278	UNSAT TT=6.672	UNSAT TT=39.131	UNSAT TT=35.227	UNSAT TT=5.305	UNSAT TT=1.387	? (TO) TT=1800.19	UNSAT TT=5.616	UNSAT TT=0.5	UNSAT TT=0.278	UNSAT TT=5.423
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967142.opb	UNSAT TT=3.136	UNSAT TT=14.071	UNSAT TT=124.513	UNSAT TT=104.621	UNSAT TT=70.447	UNSAT TT=3.136	? (TO) TT=1800.19	UNSAT TT=22.92	UNSAT TT=3.6	UNSAT TT=4.157	UNSAT TT=21.773
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967327.opb	SAT TT=0.064 T1=0.05	SAT TT=8.385 T1=8.52	SAT TT=73.787 T1=73.81	SAT TT=6.875 T1=6.88	SAT TT=17.099 T1=17.1	SAT TT=0.064 T1=0.05	SAT TT=14.268 T1=12.35	SAT TT=3.75 T1=3.05	SAT TT=1.507 T1=1.49	SAT TT=3.904 T1=3.89	SAT TT=3.101 T1=3.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967523.opb	UNSAT TT=2.137	UNSAT TT=9.985	UNSAT TT=58.275	UNSAT TT=63.784	UNSAT TT=74.62	UNSAT TT=2.137	? (TO) TT=1801.16	UNSAT TT=9.116	UNSAT TT=2.216	UNSAT TT=2.368	UNSAT TT=10.632
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967729.opb	UNSAT TT=0.161	UNSAT TT=5.534	UNSAT TT=23.22	UNSAT TT=28.319	UNSAT TT=8.979	UNSAT TT=1.332	? (TO) TT=1800.17	UNSAT TT=4.052	UNSAT TT=0.236	UNSAT TT=0.161	UNSAT TT=3.786
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968094.opb	UNSAT TT=0.399	UNSAT TT=6.193	UNSAT TT=57.785	UNSAT TT=36.571	UNSAT TT=1.518	UNSAT TT=1.772	UNSAT TT=82.946	UNSAT TT=6.341	UNSAT TT=0.658	UNSAT TT=0.399	UNSAT TT=8.147
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968431.opb	SAT TT=0.182 T1=0.17	SAT TT=2.126 T1=2.05	SAT TT=10.341 T1=10.34	SAT TT=17.484 T1=17.49	SAT TT=1.147 T1=1.14	SAT TT=1.081 T1=1.07	SAT TT=3.458 T1=1.9	SAT TT=3.176 T1=2.52	SAT TT=0.182 T1=0.17	SAT TT=0.89 T1=0.88	SAT TT=3.574 T1=3.57
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968561.opb	UNSAT TT=1.224	UNSAT TT=7.861	UNSAT TT=65.727	UNSAT TT=53.947	UNSAT TT=21.271	UNSAT TT=2.497	? (TO) TT=1801.06	UNSAT TT=7.028	UNSAT TT=1.943	UNSAT TT=1.224	UNSAT TT=11.125
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968898.opb	UNSAT TT=0.308	UNSAT TT=9.859	UNSAT TT=68.669	UNSAT TT=64.502	UNSAT TT=2.897	UNSAT TT=2.444	? (TO) TT=1801.02	UNSAT TT=8.624	UNSAT TT=0.64	UNSAT TT=0.308	UNSAT TT=7.172
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969170.opb	UNSAT TT=0.041	UNSAT TT=5.885	UNSAT TT=50.207	UNSAT TT=41.769	UNSAT TT=3.481	UNSAT TT=2.076	? (TO) TT=1800.17	UNSAT TT=6.82	UNSAT TT=0.041	UNSAT TT=0.043	UNSAT TT=7.607
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969577.opb	UNSAT TT=0.04	UNSAT TT=4.513	UNSAT TT=42.5	UNSAT TT=43.041	UNSAT TT=3.304	UNSAT TT=1.536	UNSAT TT=1049.87	UNSAT TT=6.631	UNSAT TT=0.04	UNSAT TT=0.047	UNSAT TT=6.78
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969860.opb	UNSAT TT=1.082	UNSAT TT=13.377	UNSAT TT=88.692	UNSAT TT=62.974	UNSAT TT=33.296	UNSAT TT=2.837	? (TO) TT=1800.25	UNSAT TT=15.925	UNSAT TT=1.082	UNSAT TT=2.245	UNSAT TT=12.375
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969933.opb	SAT TT=0.099 T1=0.09	SAT TT=1.205 T1=2.43	SAT TT=5.418 T1=5.41	SAT TT=4.237 T1=4.23	SAT TT=15.521 T1=15.52	SAT TT=0.099 T1=0.09	? (TO) TT=1800.1	SAT TT=3.057 T1=2.36	SAT TT=0.505 T1=0.49	SAT TT=2.22 T1=2.21	SAT TT=1.114 T1=1.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970170.opb	SAT TT=0.575 T1=0.56	SAT TT=8.633 T1=8.55	SAT TT=81.62 T1=81.64	SAT TT=52.212 T1=52.22	SAT TT=16.905 T1=16.9	SAT TT=0.709 T1=0.7	SAT TT=15.131 T1=13.01	SAT TT=2.772 T1=1.98	SAT TT=0.575 T1=0.56	SAT TT=1.385 T1=1.37	SAT TT=19.768 T1=19.86
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970277.opb	SAT TT=0.188 T1=0.18	SAT TT=3.358 T1=3.28	SAT TT=54.118 T1=54.13	SAT TT=53.892 T1=53.9	SAT TT=4.281 T1=4.28	SAT TT=0.188 T1=0.18	? (TO) TT=1800.19	SAT TT=5.487 T1=4.82	SAT TT=1.253 T1=1.24	SAT TT=3.435 T1=3.42	SAT TT=3.657 T1=3.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970444.opb	UNSAT TT=0.108	UNSAT TT=5.463	UNSAT TT=27.007	UNSAT TT=29.198	UNSAT TT=0.54	UNSAT TT=1.361	? (TO) TT=1800.32	UNSAT TT=4.734	UNSAT TT=0.108	UNSAT TT=0.114	UNSAT TT=4.385
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970631.opb	UNSAT TT=0.143	UNSAT TT=6.333	UNSAT TT=44.284	UNSAT TT=34.671	UNSAT TT=1.507	UNSAT TT=1.601	UNSAT TT=28.451	UNSAT TT=6.628	UNSAT TT=0.143	UNSAT TT=0.175	UNSAT TT=5.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971097.opb	SAT TT=0.948 T1=0.94	SAT TT=13.023 T1=12.97	SAT TT=74.31 T1=74.33	SAT TT=88.129 T1=88.17	SAT TT=32.539 T1=32.55	SAT TT=0.948 T1=0.94	? (TO) TT=1800.37	SAT TT=4.557 T1=3.87	SAT TT=3.77 T1=3.76	SAT TT=3.261 T1=3.26	SAT TT=5.13 T1=5.12
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971363.opb	UNSAT TT=0.269	UNSAT TT=9.061	UNSAT TT=54.199	UNSAT TT=48.861	UNSAT TT=9.906	UNSAT TT=1.721	? (TO) TT=1800.35	UNSAT TT=7.272	UNSAT TT=0.505	UNSAT TT=0.269	UNSAT TT=7.176
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971697.opb	UNSAT TT=0.548	UNSAT TT=5.931	UNSAT TT=58.57	UNSAT TT=49.163	UNSAT TT=15.916	UNSAT TT=1.574	? (TO) TT=1800.18	UNSAT TT=7.85	UNSAT TT=1.309	UNSAT TT=0.548	UNSAT TT=9.716
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971766.opb	SAT TT=0.269 T1=0.26	SAT TT=5.704 T1=5.61	SAT TT=81.262 T1=81.28	SAT TT=9.777 T1=9.77	SAT TT=1.329 T1=1.32	SAT TT=0.269 T1=0.26	? (TO) TT=1800.13	SAT TT=5.414 T1=4.39	SAT TT=0.982 T1=0.97	SAT TT=1.446 T1=1.43	SAT TT=4.769 T1=4.76
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972154.opb	UNSAT TT=0.545	UNSAT TT=6.555	UNSAT TT=73.504	UNSAT TT=53.379	UNSAT TT=22.216	UNSAT TT=2.322	? (TO) TT=1800.38	UNSAT TT=9.528	UNSAT TT=0.94	UNSAT TT=0.545	UNSAT TT=10.079
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972763.opb	UNSAT TT=0.328	UNSAT TT=8.968	UNSAT TT=58.913	UNSAT TT=44.93	UNSAT TT=1.296	UNSAT TT=1.601	? (TO) TT=1800.34	UNSAT TT=7.488	UNSAT TT=0.485	UNSAT TT=0.328	UNSAT TT=9.074
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972958.opb	SAT TT=0.762 T1=0.76	SAT TT=5.439 T1=5.36	SAT TT=14.625 T1=14.62	SAT TT=69.335 T1=69.35	SAT TT=0.762 T1=0.76	SAT TT=0.776 T1=0.77	? (TO) TT=1800.21	SAT TT=4.525 T1=3.88	SAT TT=1.669 T1=1.66	SAT TT=6.221 T1=6.21	SAT TT=8.492 T1=4.3
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973163.opb	UNSAT TT=0.118	UNSAT TT=9.769	UNSAT TT=100.569	UNSAT TT=62.515	UNSAT TT=13.948	UNSAT TT=2.842	? (TO) TT=1800.3	UNSAT TT=10.675	UNSAT TT=0.268	UNSAT TT=0.118	UNSAT TT=14.679
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973364.opb	UNSAT TT=0.71	UNSAT TT=4.632	UNSAT TT=35.214	UNSAT TT=22.37	UNSAT TT=3.678	UNSAT TT=1.373	? (TO) TT=1800.18	UNSAT TT=4.466	UNSAT TT=1.113	UNSAT TT=0.71	UNSAT TT=5.757
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973478.opb	SAT TT=0.353 T1=0.34	SAT TT=10.732 T1=10.66	SAT TT=90.907 T1=90.93	SAT TT=53.405 T1=53.42	SAT TT=39.663 T1=39.67	SAT TT=0.353 T1=0.34	SAT TT=386.371 T1=384.22	SAT TT=5.182 T1=4.45	SAT TT=1.264 T1=1.25	SAT TT=4.46 T1=4.45	SAT TT=1.589 T1=1.58
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973670.opb	UNSAT TT=0.885	UNSAT TT=8.159	UNSAT TT=84.482	UNSAT TT=57.337	UNSAT TT=7.31	UNSAT TT=1.8	? (TO) TT=1800.45	UNSAT TT=8.122	UNSAT TT=1.241	UNSAT TT=0.885	UNSAT TT=11.153
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973863.opb	SAT TT=0.223 T1=0.21	SAT TT=4.999 T1=4.92	SAT TT=125.427 T1=125.47	SAT TT=68.477 T1=68.49	SAT TT=39.932 T1=39.93	SAT TT=0.223 T1=0.21	? (TO) TT=1800.13	SAT TT=6.67 T1=5.99	SAT TT=1.444 T1=1.43	SAT TT=4.801 T1=4.79	SAT TT=14.026 T1=14.02
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974180.opb	UNSAT TT=0.485	UNSAT TT=8.035	UNSAT TT=73.836	UNSAT TT=49.367	UNSAT TT=1.448	UNSAT TT=2.629	? (TO) TT=1800.24	UNSAT TT=8.674	UNSAT TT=0.923	UNSAT TT=0.485	UNSAT TT=14.978
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974372.opb	UNSAT TT=0.04	UNSAT TT=5.162	UNSAT TT=45.008	UNSAT TT=30.728	UNSAT TT=0.76	UNSAT TT=1.526	UNSAT TT=26.034	UNSAT TT=4.952	UNSAT TT=0.04	UNSAT TT=0.043	UNSAT TT=6.142
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974553.opb	SAT TT=0.494 T1=0.49	SAT TT=1.907 T1=1.81	SAT TT=7.508 T1=7.51	SAT TT=22.779 T1=22.78	SAT TT=32.509 T1=32.51	SAT TT=0.494 T1=0.49	? (TO) TT=1800.35	SAT TT=1.706 T1=1.12	SAT TT=1.039 T1=1.03	SAT TT=5.521 T1=5.51	SAT TT=4.91 T1=4.91
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975607.opb	UNSAT TT=0.156	UNSAT TT=5.319	UNSAT TT=34.154	UNSAT TT=36.731	UNSAT TT=2.171	UNSAT TT=1.825	? (TO) TT=1800.15	UNSAT TT=4.939	UNSAT TT=0.156	UNSAT TT=0.156	UNSAT TT=6.129
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975678.opb	SAT TT=1.182 T1=1.18	SAT TT=9.047 T1=8.98	SAT TT=71.004 T1=71.02	SAT TT=6.598 T1=6.59	SAT TT=1.182 T1=1.18	SAT TT=2.836 T1=2.83	? (TO) TT=1800.19	SAT TT=4.499 T1=3.81	SAT TT=2.072 T1=2.06	SAT TT=5.57 T1=5.56	SAT TT=7.405 T1=7.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975832.opb	SAT TT=0.43 T1=0.42	SAT TT=7.08 T1=7.01	SAT TT=58.135 T1=58.14	SAT TT=7.857 T1=7.85	SAT TT=18.494 T1=18.49	SAT TT=0.43 T1=0.42	? (TO) TT=1800.2	SAT TT=3.089 T1=2.45	SAT TT=0.994 T1=0.98	SAT TT=3.617 T1=3.6	SAT TT=3.014 T1=3.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975965.opb	UNSAT TT=2.764	UNSAT TT=8.424	UNSAT TT=115.28	UNSAT TT=81.591	UNSAT TT=21.017	UNSAT TT=3.487	? (TO) TT=1800.19	UNSAT TT=12.975	UNSAT TT=2.764	UNSAT TT=2.774	UNSAT TT=16.371
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976157.opb	UNSAT TT=0.039	UNSAT TT=4.851	UNSAT TT=37.748	UNSAT TT=25.178	UNSAT TT=0.584	UNSAT TT=1.83	UNSAT TT=12.629	UNSAT TT=4.702	UNSAT TT=0.039	UNSAT TT=0.042	UNSAT TT=5.308
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976730.opb	UNSAT TT=0.374	UNSAT TT=11.135	UNSAT TT=115.545	UNSAT TT=86.92	UNSAT TT=17.565	UNSAT TT=3.011	? (TO) TT=1800.23	UNSAT TT=13.115	UNSAT TT=0.614	UNSAT TT=0.374	UNSAT TT=19.034
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976735.opb	SAT TT=0.05 T1=0.04	SAT TT=0.984 T1=0.89	SAT TT=3.076 T1=3.07	SAT TT=43.734 T1=43.74	SAT TT=6.656 T1=6.65	SAT TT=0.05 T1=0.04	SAT TT=4.643 T1=2.81	SAT TT=3.546 T1=2.81	SAT TT=0.997 T1=0.98	SAT TT=1.659 T1=1.65	SAT TT=11.912 T1=11.91
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976935.opb	UNSAT TT=0.041	UNSAT TT=4.604	UNSAT TT=45.27	UNSAT TT=31.558	UNSAT TT=1.912	UNSAT TT=1.557	? (TO) TT=1800.26	UNSAT TT=8.732	UNSAT TT=0.041	UNSAT TT=0.044	UNSAT TT=7.417
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977266.opb	SAT TT=1.138 T1=1.13	SAT TT=5.344 T1=5.27	SAT TT=22.613 T1=22.61	SAT TT=34.772 T1=34.79	SAT TT=15.54 T1=15.54	SAT TT=1.369 T1=1.36	SAT TT=5.458 T1=3.64	SAT TT=1.847 T1=1.19	SAT TT=1.138 T1=1.13	SAT TT=3.828 T1=3.82	SAT TT=5.391 T1=5.39
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977273.opb	UNSAT TT=0.759	UNSAT TT=6.605	UNSAT TT=63.055	UNSAT TT=46.13	UNSAT TT=3.441	UNSAT TT=1.449	? (TO) TT=1800.15	UNSAT TT=6.201	UNSAT TT=1.054	UNSAT TT=0.759	UNSAT TT=8.874
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977464.opb	SAT TT=0.739 T1=0.73	SAT TT=8.356 T1=8.28	SAT TT=100.277 T1=100.3	SAT TT=16.983 T1=16.99	SAT TT=22.518 T1=22.52	SAT TT=1.924 T1=1.92	? (TO) TT=1800.13	SAT TT=1.732 T1=1.18	SAT TT=0.739 T1=0.73	SAT TT=2.1 T1=2.09	SAT TT=14.525 T1=14.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977780.opb	UNSAT TT=0.041	UNSAT TT=4.102	UNSAT TT=34.485	UNSAT TT=28.965	UNSAT TT=3.754	UNSAT TT=1.785	UNSAT TT=9.433	UNSAT TT=5.477	UNSAT TT=0.041	UNSAT TT=0.042	UNSAT TT=7.945
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978113.opb	UNSAT TT=2.233	UNSAT TT=8.527	UNSAT TT=92.764	UNSAT TT=64.707	UNSAT TT=30.454	UNSAT TT=2.809	? (TO) TT=1800.19	UNSAT TT=11.134	UNSAT TT=2.552	UNSAT TT=2.233	UNSAT TT=14.346
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978334.opb	UNSAT TT=0.176	UNSAT TT=6.409	UNSAT TT=65.625	UNSAT TT=45.896	UNSAT TT=2.911	UNSAT TT=1.741	UNSAT TT=703.64	UNSAT TT=7.716	UNSAT TT=0.524	UNSAT TT=0.176	UNSAT TT=9.558
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212272.opb	UNSAT TT=0.7	UNSAT TT=9.305	UNSAT TT=64.181	UNSAT TT=50.793	UNSAT TT=19.707	UNSAT TT=1.94	? (TO) TT=1800.13	UNSAT TT=9.43	UNSAT TT=0.7	UNSAT TT=0.783	UNSAT TT=11.223
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212476.opb	UNSAT TT=1.071	UNSAT TT=13.84	UNSAT TT=106.495	UNSAT TT=101.062	UNSAT TT=14.922	UNSAT TT=2.605	? (TO) TT=1800.18	UNSAT TT=12.162	UNSAT TT=1.684	UNSAT TT=1.071	UNSAT TT=18.104
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212923.opb	UNSAT TT=1.22	UNSAT TT=6.363	UNSAT TT=47.377	UNSAT TT=36.559	UNSAT TT=4.252	UNSAT TT=1.605	? (TO) TT=1800.12	UNSAT TT=5.718	UNSAT TT=1.352	UNSAT TT=1.22	UNSAT TT=5.977
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213670.opb	UNSAT TT=0.04	UNSAT TT=6.229	UNSAT TT=44.109	UNSAT TT=37.049	UNSAT TT=3.533	UNSAT TT=1.513	UNSAT TT=10.398	UNSAT TT=7.171	UNSAT TT=0.04	UNSAT TT=0.044	UNSAT TT=7.457
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213868.opb	UNSAT TT=0.817	UNSAT TT=7.252	UNSAT TT=64.577	UNSAT TT=38.492	UNSAT TT=30.178	UNSAT TT=1.818	? (TO) TT=1800.37	UNSAT TT=7.953	UNSAT TT=1.421	UNSAT TT=0.817	UNSAT TT=7.991
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216188.opb	SAT TT=0.581 T1=0.58	SAT TT=2.439 T1=2.36	SAT TT=45.455 T1=45.48	SAT TT=48.782 T1=48.79	SAT TT=0.581 T1=0.58	SAT TT=1.365 T1=1.36	SAT TT=79.023 T1=76.77	SAT TT=4.201 T1=3.48	SAT TT=0.653 T1=0.64	SAT TT=2.177 T1=2.17	SAT TT=11.245 T1=11.24
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216411.opb	UNSAT TT=0.378	UNSAT TT=8.029	UNSAT TT=75.793	UNSAT TT=73.858	UNSAT TT=58.065	UNSAT TT=2.692	UNSAT TT=188.622	UNSAT TT=10.283	UNSAT TT=0.522	UNSAT TT=0.378	UNSAT TT=16.211
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216823.opb	UNSAT TT=1.689	UNSAT TT=6.035	UNSAT TT=57.23	UNSAT TT=36.357	UNSAT TT=4.101	UNSAT TT=1.689	? (TO) TT=1800.15	UNSAT TT=6.587	UNSAT TT=1.905	UNSAT TT=1.82	UNSAT TT=7.649
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216864.opb	SAT TT=1.342 T1=1.33	SAT TT=5.36 T1=5.28	SAT TT=30.793 T1=30.8	SAT TT=17.312 T1=17.31	SAT TT=2.189 T1=2.18	SAT TT=1.53 T1=1.52	SAT TT=2.823 T1=1.54	SAT TT=4.501 T1=3.84	SAT TT=1.781 T1=1.77	SAT TT=1.342 T1=1.33	SAT TT=1.684 T1=1.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217374.opb	SAT TT=0.128 T1=0.12	SAT TT=3.462 T1=3.38	SAT TT=10.506 T1=10.5	SAT TT=3.986 T1=3.98	SAT TT=18.139 T1=18.14	SAT TT=0.128 T1=0.12	? (TO) TT=1800.83	SAT TT=1.169 T1=0.74	SAT TT=1.743 T1=1.73	SAT TT=2.745 T1=2.73	SAT TT=2.03 T1=2.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217380.opb	SAT TT=0.593 T1=0.58	SAT TT=1.863 T1=1.77	SAT TT=82.55 T1=82.57	SAT TT=45.263 T1=45.27	SAT TT=5.052 T1=5.05	SAT TT=0.648 T1=0.65	? (TO) TT=1800.14	SAT TT=2.484 T1=1.78	SAT TT=0.593 T1=0.58	SAT TT=1.046 T1=1.03	SAT TT=11.962 T1=11.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217392.opb	UNSAT TT=0.648	UNSAT TT=6.265	UNSAT TT=47.033	UNSAT TT=37.659	UNSAT TT=5.481	UNSAT TT=1.934	? (TO) TT=1800.52	UNSAT TT=6.383	UNSAT TT=0.76	UNSAT TT=0.648	UNSAT TT=10.282
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217555.opb	UNSAT TT=1.901	UNSAT TT=7.852	UNSAT TT=65.29	UNSAT TT=47.505	UNSAT TT=30.249	UNSAT TT=2.141	? (TO) TT=1800.43	UNSAT TT=8.893	UNSAT TT=1.901	UNSAT TT=1.93	UNSAT TT=12.057
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218024.opb	UNSAT TT=0.039	UNSAT TT=7.974	UNSAT TT=82.321	UNSAT TT=66.199	UNSAT TT=10.462	UNSAT TT=2.053	? (TO) TT=1800.22	UNSAT TT=8.441	UNSAT TT=0.039	UNSAT TT=0.051	UNSAT TT=12.97
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218308.opb	UNSAT TT=1.284	UNSAT TT=18.781	UNSAT TT=120.495	UNSAT TT=127.424	UNSAT TT=58.876	UNSAT TT=3.906	? (TO) TT=1801.05	UNSAT TT=19.859	UNSAT TT=1.284	UNSAT TT=3.944	UNSAT TT=20.182
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218757.opb	UNSAT TT=0.195	UNSAT TT=9.225	UNSAT TT=58.94	UNSAT TT=51.278	UNSAT TT=3.103	UNSAT TT=2.326	? (TO) TT=1800.25	UNSAT TT=7.605	UNSAT TT=0.204	UNSAT TT=0.195	UNSAT TT=10.491
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218955.opb	UNSAT TT=0.377	UNSAT TT=6.951	UNSAT TT=38.386	UNSAT TT=32.449	UNSAT TT=8.746	UNSAT TT=1.873	? (TO) TT=1800.28	UNSAT TT=4.675	UNSAT TT=0.573	UNSAT TT=0.377	UNSAT TT=5.855
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219348.opb	UNSAT TT=1.34	UNSAT TT=8.544	UNSAT TT=65.502	UNSAT TT=50.418	UNSAT TT=1.558	UNSAT TT=1.611	? (TO) TT=1800.28	UNSAT TT=7.28	UNSAT TT=1.854	UNSAT TT=1.34	UNSAT TT=11.337
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219399.opb	SAT TT=0.147 T1=0.14	SAT TT=1.564 T1=1.48	SAT TT=7.011 T1=7.01	SAT TT=36.693 T1=36.7	SAT TT=18.168 T1=18.17	SAT TT=0.147 T1=0.14	SAT TT=4.482 T1=2.73	SAT TT=1.747 T1=1.19	SAT TT=1.926 T1=1.91	SAT TT=2.974 T1=2.96	SAT TT=4.255 T1=4.25
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219799.opb	UNSAT TT=0.808	UNSAT TT=7.049	UNSAT TT=37.537	UNSAT TT=37.361	UNSAT TT=22.763	UNSAT TT=1.905	? (TO) TT=1800.3	UNSAT TT=6.196	UNSAT TT=1.359	UNSAT TT=0.808	UNSAT TT=7.726
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220019.opb	UNSAT TT=0.525	UNSAT TT=10.174	UNSAT TT=60.655	UNSAT TT=55.52	UNSAT TT=2.393	UNSAT TT=2.008	UNSAT TT=7.852	UNSAT TT=8.42	UNSAT TT=1.293	UNSAT TT=0.525	UNSAT TT=10.741
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220546.opb	UNSAT TT=1.386	UNSAT TT=7.158	UNSAT TT=63	UNSAT TT=41.783	UNSAT TT=5.692	UNSAT TT=1.847	? (TO) TT=1800.2	UNSAT TT=7.27	UNSAT TT=1.75	UNSAT TT=1.386	UNSAT TT=10.797
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220767.opb	UNSAT TT=0.436	UNSAT TT=7.626	UNSAT TT=85.784	UNSAT TT=59.52	UNSAT TT=3.442	UNSAT TT=2.122	? (TO) TT=1800.18	UNSAT TT=8.471	UNSAT TT=0.436	UNSAT TT=0.584	UNSAT TT=13.804
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221203.opb	UNSAT TT=1.237	UNSAT TT=7.88	UNSAT TT=67.262	UNSAT TT=40.815	UNSAT TT=15.775	UNSAT TT=1.886	? (TO) TT=1800.18	UNSAT TT=7.046	UNSAT TT=1.775	UNSAT TT=1.237	UNSAT TT=8.563
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221624.opb	UNSAT TT=1.118	UNSAT TT=5.753	UNSAT TT=69.742	UNSAT TT=43.483	UNSAT TT=15.877	UNSAT TT=2.39	? (TO) TT=1800.23	UNSAT TT=7.297	UNSAT TT=1.118	UNSAT TT=1.322	UNSAT TT=12.168
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221953.opb	SAT TT=0.245 T1=0.23	SAT TT=4.895 T1=4.82	SAT TT=54.711 T1=54.72	SAT TT=29.354 T1=29.36	SAT TT=1.41 T1=1.4	SAT TT=0.245 T1=0.23	SAT TT=6.018 T1=4.11	SAT TT=1.534 T1=1.03	SAT TT=0.548 T1=0.53	SAT TT=1.057 T1=1.04	SAT TT=4.086 T1=4.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222080.opb	SAT TT=0.57 T1=0.56	SAT TT=2.943 T1=2.87	SAT TT=66.16 T1=66.17	SAT TT=40.203 T1=40.21	SAT TT=1.979 T1=1.97	SAT TT=1.971 T1=1.96	SAT TT=1009.04 T1=1007.21	SAT TT=3.65 T1=2.99	SAT TT=0.57 T1=0.56	SAT TT=0.608 T1=0.6	SAT TT=3.319 T1=3.31
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222248.opb	SAT TT=0.166 T1=0.16	SAT TT=1.398 T1=1.32	SAT TT=3.395 T1=3.39	SAT TT=33.776 T1=33.78	SAT TT=10.008 T1=10	SAT TT=0.166 T1=0.16	? (TO) TT=1800.09	SAT TT=2.842 T1=2.2	SAT TT=1.2 T1=1.19	SAT TT=1.856 T1=1.84	SAT TT=4.408 T1=4.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222257.opb	UNSAT TT=0.709	UNSAT TT=6.011	UNSAT TT=47.623	UNSAT TT=46.963	UNSAT TT=3.602	UNSAT TT=1.81	? (TO) TT=1800.16	UNSAT TT=7.293	UNSAT TT=0.881	UNSAT TT=0.709	UNSAT TT=12.076
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222539.opb	UNSAT TT=0.062	UNSAT TT=8.309	UNSAT TT=59.371	UNSAT TT=63.339	UNSAT TT=2.557	UNSAT TT=1.966	UNSAT TT=4.303	UNSAT TT=7.42	UNSAT TT=0.065	UNSAT TT=0.062	UNSAT TT=9.766
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223004.opb	UNSAT TT=2.403	UNSAT TT=8.942	UNSAT TT=90.262	UNSAT TT=59.365	UNSAT TT=78.749	UNSAT TT=2.403	? (TO) TT=1800.25	UNSAT TT=12.024	UNSAT TT=2.773	UNSAT TT=5.01	UNSAT TT=11.167
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223220.opb	UNSAT TT=0.367	UNSAT TT=8.7	UNSAT TT=78.603	UNSAT TT=62.621	UNSAT TT=22.873	UNSAT TT=1.798	? (TO) TT=1800.23	UNSAT TT=8.863	UNSAT TT=0.655	UNSAT TT=0.367	UNSAT TT=13.607
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223416.opb	SAT TT=0.704 T1=0.69	SAT TT=1.015 T1=0.93	SAT TT=19.237 T1=19.24	SAT TT=22.172 T1=22.17	SAT TT=4.796 T1=4.79	SAT TT=0.704 T1=0.69	? (TO) TT=1800.37	SAT TT=2.447 T1=1.79	SAT TT=1.02 T1=1.01	SAT TT=2.219 T1=2.21	SAT TT=1.421 T1=1.42
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223596.opb	SAT TT=0.369 T1=0.36	SAT TT=2.498 T1=2.41	SAT TT=29.644 T1=29.65	SAT TT=50.552 T1=50.56	SAT TT=2.497 T1=2.49	SAT TT=0.369 T1=0.36	SAT TT=5.918 T1=4.01	SAT TT=2.44 T1=1.72	SAT TT=1.741 T1=1.73	SAT TT=4.53 T1=4.52	SAT TT=13.062 T1=13.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223689.opb	SAT TT=0.076 T1=0.06	SAT TT=0.935 T1=0.84	SAT TT=26.906 T1=26.91	SAT TT=38.626 T1=38.64	SAT TT=10.937 T1=10.93	SAT TT=0.076 T1=0.06	SAT TT=3.186 T1=1.77	SAT TT=2.247 T1=1.57	SAT TT=1.154 T1=1.14	SAT TT=1.513 T1=1.5	SAT TT=5.583 T1=5.58
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223696.opb	SAT TT=0.569 T1=0.57	SAT TT=2.937 T1=2.87	SAT TT=34.829 T1=34.84	SAT TT=27.627 T1=27.63	SAT TT=32.316 T1=32.32	SAT TT=0.569 T1=0.57	? (TO) TT=1800.16	SAT TT=2.669 T1=1.94	SAT TT=1.904 T1=1.89	SAT TT=2.979 T1=2.97	SAT TT=9.417 T1=9.41
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224059.opb	UNSAT TT=0.041	UNSAT TT=4.442	UNSAT TT=26.926	UNSAT TT=18.328	UNSAT TT=0.255	UNSAT TT=1.246	UNSAT TT=47.715	UNSAT TT=4.055	UNSAT TT=0.041	UNSAT TT=0.043	UNSAT TT=5.648
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224255.opb	UNSAT TT=0.821	UNSAT TT=10.052	UNSAT TT=69.999	UNSAT TT=61.656	UNSAT TT=65.128	UNSAT TT=2.055	? (TO) TT=1800.17	UNSAT TT=8.596	UNSAT TT=0.821	UNSAT TT=1.57	UNSAT TT=10.15
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224451.opb	UNSAT TT=0.475	UNSAT TT=6.155	UNSAT TT=57.128	UNSAT TT=39.936	UNSAT TT=2.182	UNSAT TT=1.826	? (TO) TT=1800.18	UNSAT TT=7.406	UNSAT TT=0.694	UNSAT TT=0.475	UNSAT TT=7.564
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224522.opb	SAT TT=0.357 T1=0.34	SAT TT=4.108 T1=4.03	SAT TT=18.669 T1=18.67	SAT TT=18.444 T1=18.44	SAT TT=3.047 T1=3.04	SAT TT=0.924 T1=0.91	SAT TT=19.382 T1=17.59	SAT TT=3.644 T1=3.22	SAT TT=0.357 T1=0.34	SAT TT=0.698 T1=0.7	SAT TT=4.262 T1=4.26
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224929.opb	UNSAT TT=0.179	UNSAT TT=5.844	UNSAT TT=50.384	UNSAT TT=41.769	UNSAT TT=1.587	UNSAT TT=1.451	UNSAT TT=7.917	UNSAT TT=5.654	UNSAT TT=0.526	UNSAT TT=0.179	UNSAT TT=9.15
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225122.opb	UNSAT TT=0.345	UNSAT TT=4.663	UNSAT TT=38.771	UNSAT TT=36.517	UNSAT TT=1.36	UNSAT TT=1.395	? (TO) TT=1800.24	UNSAT TT=7.019	UNSAT TT=0.833	UNSAT TT=0.345	UNSAT TT=6.708
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225605.opb	UNSAT TT=1.208	UNSAT TT=6.901	UNSAT TT=58.319	UNSAT TT=39.231	UNSAT TT=5.209	UNSAT TT=1.676	? (TO) TT=1800.22	UNSAT TT=7.316	UNSAT TT=1.39	UNSAT TT=1.208	UNSAT TT=11.456
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226062.opb	UNSAT TT=0.992	UNSAT TT=5.868	UNSAT TT=46.039	UNSAT TT=34.065	UNSAT TT=4.459	UNSAT TT=1.256	? (TO) TT=1800.21	UNSAT TT=6.791	UNSAT TT=0.992	UNSAT TT=1.074	UNSAT TT=7.447
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226241.opb	SAT TT=1.218 T1=1.21	SAT TT=3.118 T1=3.03	SAT TT=17.546 T1=17.54	SAT TT=2.387 T1=2.38	SAT TT=48.773 T1=48.78	SAT TT=1.218 T1=1.21	? (TO) TT=1800.19	SAT TT=2.266 T1=1.64	SAT TT=1.49 T1=1.48	SAT TT=3.584 T1=3.57	SAT TT=3.39 T1=3.38
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226284.opb	SAT TT=0.258 T1=0.25	SAT TT=3.471 T1=3.39	SAT TT=12.695 T1=12.69	SAT TT=24.409 T1=24.41	SAT TT=4.071 T1=4.07	SAT TT=0.258 T1=0.25	SAT TT=23.569 T1=21.59	SAT TT=2.452 T1=1.78	SAT TT=0.678 T1=0.67	SAT TT=1.809 T1=1.8	SAT TT=2.686 T1=2.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226368.opb	UNSAT TT=0.086	UNSAT TT=5.278	UNSAT TT=36.563	UNSAT TT=23.328	UNSAT TT=1.377	UNSAT TT=0.915	UNSAT TT=16.679	UNSAT TT=6.003	UNSAT TT=0.09	UNSAT TT=0.086	UNSAT TT=5.605
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226680.opb	UNSAT TT=0.413	UNSAT TT=6.923	UNSAT TT=58.192	UNSAT TT=39.505	UNSAT TT=0.922	UNSAT TT=1.767	? (TO) TT=1800.18	UNSAT TT=5.211	UNSAT TT=0.653	UNSAT TT=0.413	UNSAT TT=11.045
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227012.opb	UNSAT TT=0.705	UNSAT TT=7.037	UNSAT TT=62.683	UNSAT TT=47.299	UNSAT TT=3.514	UNSAT TT=1.878	? (TO) TT=1800.19	UNSAT TT=7.072	UNSAT TT=1.242	UNSAT TT=0.705	UNSAT TT=8.445
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227326.opb	UNSAT TT=0.258	UNSAT TT=5.146	UNSAT TT=37.141	UNSAT TT=19.088	UNSAT TT=1.666	UNSAT TT=1.026	? (TO) TT=1800.17	UNSAT TT=4.33	UNSAT TT=0.618	UNSAT TT=0.258	UNSAT TT=5.385
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227418.opb	SAT TT=0.787 T1=0.77	SAT TT=3.689 T1=3.6	SAT TT=5.162 T1=5.16	SAT TT=14.338 T1=14.34	SAT TT=4.722 T1=4.72	SAT TT=1.17 T1=1.16	? (TO) TT=1800.18	SAT TT=3.15 T1=2.4	SAT TT=0.787 T1=0.77	SAT TT=5.834 T1=5.83	SAT TT=13.06 T1=13.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227861.opb	UNSAT TT=0.115	UNSAT TT=7.402	UNSAT TT=60.628	UNSAT TT=39.386	UNSAT TT=1.417	UNSAT TT=1.692	UNSAT TT=157.019	UNSAT TT=7.054	UNSAT TT=0.143	UNSAT TT=0.115	UNSAT TT=10.787
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111228076.opb	UNSAT TT=0.496	UNSAT TT=9.835	UNSAT TT=78.964	UNSAT TT=92.821	UNSAT TT=3.996	UNSAT TT=2.984	? (TO) TT=1800.31	UNSAT TT=9.795	UNSAT TT=1.218	UNSAT TT=0.496	UNSAT TT=13.106
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14bt.opb	SAT TT=12.376 T1=12.38	SAT TT=726.026 T1=726.53	? TT=1798.01	SAT TT=1795.91 T1=1796.42	SAT TT=1405.69 T1=1406.03	SAT TT=12.376 T1=12.38	? (TO) TT=1800.15	SAT TT=121.88 T1=120.68	SAT TT=1039.86 T1=1040.06	SAT TT=152.361 T1=152.39	SAT TT=741.297 T1=741.42
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14ls.opb	SAT TT=1.629 T1=1.63	SAT TT=5.215 T1=5.13	? TT=1798.01	? TT=1798.02	SAT TT=22.005 T1=22.01	SAT TT=1.629 T1=1.63	SAT TT=225.231 T1=221.34	SAT TT=828.406 T1=826.59	SAT TT=231.436 T1=231.4	SAT TT=188.714 T1=188.7	? (TO) TT=1800.21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17bt.opb	SAT TT=46.967 T1=44.71	SAT TT=508.366 T1=509.34	? TT=1798.02	? TT=1798.04	? TT=1798.01	SAT TT=197.587 T1=197.62	SAT TT=46.967 T1=44.71	? (TO) TT=1800.46	SAT TT=105.481 T1=105.52	SAT TT=964.899 T1=965.12	SAT TT=984.517 T1=984.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17ls.opb	SAT TT=2.368 T1=2.37	SAT TT=3.762 T1=3.66	SAT TT=200.942 T1=201	? TT=1798.01	? TT=1798.03	SAT TT=2.368 T1=2.37	? (TO) TT=1800.25	? (TO) TT=1800.41	SAT TT=614.777 T1=614.75	SAT TT=394.382 T1=394.4	? (TO) TT=1800.33
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21bt.opb		? (TO) TT=1800.14	? TT=1798.02	? TT=1798.02	? TT=1798.01	? (TO) TT=1800.12	? (TO) TT=1800.16	? (TO) TT=1800.58	? TT=1796.34	? (TO) TT=1800.11	? (TO) TT=1800.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21ls.opb	SAT TT=442.746 T1=442.8	SAT TT=442.746 T1=442.8	? TT=1798.02	? TT=1798.02	? TT=1798.13	? (TO) TT=1800.05	? (TO) TT=1800.23	? (TO) TT=1800.45	? (TO) TT=1800.54	? (TO) TT=1800.44	? (TO) TT=1800.38
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24bt.opb		? (TO) TT=1800.14	? TT=1798.03	? TT=1798.01	? TT=1798.04	? (TO) TT=1800.05	? (TO) TT=1800.17	? (TO) TT=1800.51	? TT=1795.99	? (TO) TT=1800.13	? (TO) TT=1800.29
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24ls.opb	SAT TT=411.487 T1=411.59	? (TO) TT=1800.06	? TT=1798.02	? TT=1798.02	? TT=1798.12	SAT TT=411.487 T1=411.59	? (TO) TT=1800.23	? (TO) TT=1800.49	? TT=1799.75	? (TO) TT=1800.42	? (MO) TT=1418.46
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9bt.opb	SAT TT=0.085 T1=0.08	SAT TT=0.586 T1=0.86	SAT TT=7.678 T1=7.68	SAT TT=12.02 T1=12.02	SAT TT=7.494 T1=7.49	SAT TT=0.085 T1=0.08	SAT TT=96.513 T1=93.43	SAT TT=1.41 T1=0.89	SAT TT=20.182 T1=20.17	SAT TT=50.205 T1=50.21	SAT TT=3.365 T1=3.36
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9ls.opb	SAT TT=0.027 T1=0.02	SAT TT=0.616 T1=0.83	SAT TT=0.216 T1=0.21	SAT TT=0.126 T1=0.12	SAT TT=2.077 T1=2.07	SAT TT=0.027 T1=0.02	SAT TT=6.326 T1=3.81	SAT TT=1.236 T1=0.76	SAT TT=7.211 T1=7.2	SAT TT=17.243 T1=17.24	SAT TT=113.626 T1=113.64
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12bt.opb	SAT TT=0.92 T1=0.82	SAT TT=0.92 T1=0.82	SAT TT=13.023 T1=13.02	SAT TT=66.647 T1=66.64	SAT TT=124.698 T1=124.73	SAT TT=2.293 T1=2.29	SAT TT=7.71 T1=6.11	SAT TT=6.132 T1=5.16	SAT TT=110.328 T1=110.36	SAT TT=36.099 T1=36.1	SAT TT=73.654 T1=73.67
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12ls.opb	SAT TT=15.941 T1=15.94	SAT TT=54.306 T1=54.22	SAT TT=118.758 T1=118.79	? TT=1798.01	SAT TT=1581.24 T1=1581.74	SAT TT=15.941 T1=15.94	SAT TT=653.382 T1=647.02	? (TO) TT=1800.36	SAT TT=29.843 T1=29.83	SAT TT=78.212 T1=78.2	SAT TT=405.203 T1=405.27

Statistics		BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
Number of times the solver is able to give the best known answer		109	105	104	106	109	37	105	108	108	106
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		2	0	0	3	31	1	0	29	44	0