PB'11 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Queens Problems

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Queens Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
borg pb-dec-11.04.03 (complete)
bsolo 3.2 (complete)
clasp 2.0-R4191 (complete)
MinisatID 2.4.8 [DEPRECATED] (complete)
MinisatID 2.4.8-gmp [DEPRECATED] (complete)
MinisatID 2.5.2 (fixed) (complete)
MinisatID 2.5.2-gmp (fixed) (complete)
Sat4j CuttingPlanes 2.3.0 (complete)
Sat4j Res//CP 2.3.0 (complete)
Sat4j Resolution 2.3.0 (complete)
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx 2 2011-06-10 (fixed) (complete)
SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx E_2 2011-06-10 (fixed) (complete)
wbo 1.6 (complete)

Bench name	Best results on this instance	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966483.opb	UNSAT TT=0.049	UNSAT TT=6.029	UNSAT TT=25.46	UNSAT TT=0.474	UNSAT TT=49.028	UNSAT TT=92.151	UNSAT TT=4.077	UNSAT TT=20.521	UNSAT TT=3.074	UNSAT TT=5.464	UNSAT TT=4.927	UNSAT TT=0.056	UNSAT TT=0.049	UNSAT TT=0.053	UNSAT TT=0.053	UNSAT TT=1.235
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966688.opb	UNSAT TT=0.122	UNSAT TT=6.302	UNSAT TT=19.52	UNSAT TT=0.694	UNSAT TT=109.754	UNSAT TT=188.464	UNSAT TT=10.952	UNSAT TT=32.165	UNSAT TT=711.899	UNSAT TT=10.986	UNSAT TT=4.919	UNSAT TT=0.138	UNSAT TT=0.122	UNSAT TT=0.127	UNSAT TT=0.126	UNSAT TT=1.904
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967142.opb	UNSAT TT=1.438	UNSAT TT=15.203	UNSAT TT=57.139	UNSAT TT=1.438	UNSAT TT=338.264	UNSAT TT=502.275	UNSAT TT=23.748	UNSAT TT=53.869	? (TO) TT=1800.25	UNSAT TT=38.911	UNSAT TT=19.001	UNSAT TT=1.872	UNSAT TT=1.669	UNSAT TT=1.664	UNSAT TT=1.678	UNSAT TT=7.226
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967327.opb	SAT TT=0.844 T1=0.83	SAT TT=8.752 T1=8.92	SAT TT=29.857 T1=29.85	SAT TT=0.939 T1=0.94	SAT TT=89.96 T1=89.95	SAT TT=159.539 T1=159.53	SAT TT=1.039 T1=1.03	SAT TT=6.445 T1=6.44	SAT TT=7.314 T1=5.91	SAT TT=12.796 T1=6.2	SAT TT=8.91 T1=8.49	SAT TT=0.94 T1=0.93	SAT TT=0.847 T1=0.84	SAT TT=0.844 T1=0.83	SAT TT=0.847 T1=0.84	SAT TT=2.611 T1=2.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967523.opb	UNSAT TT=0.642	UNSAT TT=9.731	UNSAT TT=36.779	UNSAT TT=1.112	UNSAT TT=157.347	UNSAT TT=247.135	UNSAT TT=9.153	UNSAT TT=32.698	? (TO) TT=1800.18	UNSAT TT=29.845	UNSAT TT=13.118	UNSAT TT=0.72	UNSAT TT=0.642	UNSAT TT=0.647	UNSAT TT=0.654	UNSAT TT=3.684
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967729.opb	UNSAT TT=0.1	UNSAT TT=5.431	UNSAT TT=16.913	UNSAT TT=0.587	UNSAT TT=109.903	UNSAT TT=183.784	UNSAT TT=4.092	UNSAT TT=19.819	UNSAT TT=1287.27	UNSAT TT=8.418	UNSAT TT=3.708	UNSAT TT=0.109	UNSAT TT=0.108	UNSAT TT=0.101	UNSAT TT=0.1	UNSAT TT=1.39
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968094.opb	UNSAT TT=0.166	UNSAT TT=6.448	UNSAT TT=31.658	UNSAT TT=0.751	UNSAT TT=60.279	UNSAT TT=122.094	UNSAT TT=10.299	UNSAT TT=35.177	? (TO) TT=1800.22	UNSAT TT=22.641	UNSAT TT=9.75	UNSAT TT=0.182	UNSAT TT=0.174	UNSAT TT=0.167	UNSAT TT=0.166	UNSAT TT=1.954
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968431.opb	SAT TT=0.004 T1=0	SAT TT=2.913 T1=14.49	SAT TT=11.367 T1=11.36	SAT TT=0.004 T1=0	SAT TT=10.066 T1=10.06	SAT TT=19.403 T1=19.4	SAT TT=3.83 T1=3.83	SAT TT=15.578 T1=15.57	SAT TT=1.445 T1=0.59	SAT TT=2.409 T1=0.75	SAT TT=1.623 T1=1.24	SAT TT=0.255 T1=0.25	SAT TT=0.226 T1=0.22	SAT TT=0.231 T1=0.22	SAT TT=0.229 T1=0.22	SAT TT=1.299 T1=1.29
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968561.opb	UNSAT TT=0.301	UNSAT TT=7.784	UNSAT TT=33.11	UNSAT TT=0.945	UNSAT TT=57.407	UNSAT TT=113.361	UNSAT TT=5.37	UNSAT TT=20.991	? (TO) TT=1800.72	UNSAT TT=21.391	UNSAT TT=11.069	UNSAT TT=0.337	UNSAT TT=0.301	UNSAT TT=0.303	UNSAT TT=0.305	UNSAT TT=3.059
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968898.opb	UNSAT TT=0.109	UNSAT TT=7.545	UNSAT TT=34.719	UNSAT TT=0.84	UNSAT TT=108.417	UNSAT TT=192.75	UNSAT TT=8.231	UNSAT TT=27.333	? (TO) TT=1800.19	UNSAT TT=21.418	UNSAT TT=10.614	UNSAT TT=0.124	UNSAT TT=0.109	UNSAT TT=0.115	UNSAT TT=0.114	UNSAT TT=2.372
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969170.opb	UNSAT TT=0.018	UNSAT TT=7.433	UNSAT TT=30.622	UNSAT TT=0.847	UNSAT TT=54.664	UNSAT TT=105.365	UNSAT TT=5.091	UNSAT TT=22.439	UNSAT TT=272.11	UNSAT TT=16.145	UNSAT TT=7.651	UNSAT TT=0.022	UNSAT TT=0.018	UNSAT TT=0.022	UNSAT TT=0.02	UNSAT TT=1.801
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969577.opb	UNSAT TT=0.019	UNSAT TT=6.69	UNSAT TT=23.058	UNSAT TT=0.69	UNSAT TT=97.467	UNSAT TT=157.324	UNSAT TT=5.759	UNSAT TT=26.714	UNSAT TT=34.635	UNSAT TT=12.897	UNSAT TT=6.153	UNSAT TT=0.022	UNSAT TT=0.019	UNSAT TT=0.022	UNSAT TT=0.021	UNSAT TT=1.79
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969860.opb	UNSAT TT=0.645	UNSAT TT=10.89	UNSAT TT=58.024	UNSAT TT=1.141	UNSAT TT=366.399	UNSAT TT=580.31	UNSAT TT=19.912	UNSAT TT=45.144	? (TO) TT=1800.63	UNSAT TT=33.498	UNSAT TT=16.649	UNSAT TT=0.721	UNSAT TT=0.728	UNSAT TT=0.645	UNSAT TT=0.65	UNSAT TT=3.691
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969933.opb	SAT TT=0.003 T1=0	SAT TT=2.044 T1=2.18	SAT TT=1.524 T1=1.52	SAT TT=0.003 T1=0	SAT TT=47.036 T1=47.03	SAT TT=71.19 T1=71.18	SAT TT=1.486 T1=1.48	SAT TT=9.488 T1=9.48	? (TO) TT=1800.19	SAT TT=7.737 T1=3.7	SAT TT=3.49 T1=3.06	SAT TT=0.468 T1=0.46	SAT TT=0.418 T1=0.41	SAT TT=0.421 T1=0.41	SAT TT=0.422 T1=0.41	SAT TT=1.684 T1=1.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970170.opb	SAT TT=0.135 T1=0.13	SAT TT=4.718 T1=4.88	SAT TT=16.18 T1=16.17	SAT TT=1.114 T1=1.11	SAT TT=57.133 T1=57.13	SAT TT=81.777 T1=81.77	SAT TT=1.236 T1=1.23	SAT TT=6.4 T1=6.4	SAT TT=118.733 T1=116.86	SAT TT=14.148 T1=6.71	SAT TT=6.241 T1=5.82	SAT TT=1.617 T1=1.61	SAT TT=1.443 T1=1.43	SAT TT=1.443 T1=1.43	SAT TT=1.456 T1=1.45	SAT TT=0.135 T1=0.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970277.opb	SAT TT=0.376 T1=0.37	SAT TT=0.568 T1=17.43	SAT TT=31.313 T1=31.31	SAT TT=0.749 T1=0.75	SAT TT=8.405 T1=8.4	SAT TT=16.941 T1=16.94	SAT TT=0.376 T1=0.37	SAT TT=2.356 T1=2.35	? (TO) TT=1800.23	SAT TT=8.743 T1=3.77	SAT TT=3.938 T1=3.52	SAT TT=1.141 T1=1.13	SAT TT=1.022 T1=1.01	SAT TT=1.018 T1=1.01	SAT TT=1.029 T1=1.02	SAT TT=2.298 T1=2.29
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970444.opb	UNSAT TT=0.061	UNSAT TT=4.807	UNSAT TT=18.577	UNSAT TT=0.733	UNSAT TT=45.634	UNSAT TT=94.812	UNSAT TT=4.415	UNSAT TT=19.193	? (TO) TT=1800.4	UNSAT TT=11.94	UNSAT TT=5.647	UNSAT TT=0.065	UNSAT TT=0.063	UNSAT TT=0.063	UNSAT TT=0.061	UNSAT TT=1.209
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970631.opb	UNSAT TT=0.079	UNSAT TT=8.27	UNSAT TT=25.141	UNSAT TT=0.603	UNSAT TT=52.307	UNSAT TT=105.699	UNSAT TT=4.402	UNSAT TT=21.623	UNSAT TT=34.821	UNSAT TT=16.188	UNSAT TT=7.693	UNSAT TT=0.091	UNSAT TT=0.079	UNSAT TT=0.085	UNSAT TT=0.083	UNSAT TT=1.81
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971097.opb	SAT TT=0.177 T1=0.17	SAT TT=1.754 T1=1.89	SAT TT=10.274 T1=10.28	SAT TT=0.84 T1=0.84	SAT TT=44.915 T1=44.91	SAT TT=73.763 T1=73.75	SAT TT=14.463 T1=14.46	SAT TT=34.307 T1=34.3	? (TO) TT=1800.21	SAT TT=16.025 T1=8.76	SAT TT=6.235 T1=5.81	SAT TT=1.273 T1=1.26	SAT TT=1.136 T1=1.13	SAT TT=1.142 T1=1.13	SAT TT=1.144 T1=1.13	SAT TT=0.177 T1=0.17
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971363.opb	UNSAT TT=0.111	UNSAT TT=6.745	UNSAT TT=32.416	UNSAT TT=0.785	UNSAT TT=140.196	UNSAT TT=216.547	UNSAT TT=5.538	UNSAT TT=23.807	? (TO) TT=1800.56	UNSAT TT=16.652	UNSAT TT=7.745	UNSAT TT=0.126	UNSAT TT=0.111	UNSAT TT=0.117	UNSAT TT=0.115	UNSAT TT=1.558
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971697.opb	UNSAT TT=0.164	UNSAT TT=6.379	UNSAT TT=38.185	UNSAT TT=0.755	UNSAT TT=157.351	UNSAT TT=228.032	UNSAT TT=7.804	UNSAT TT=26.799	? (TO) TT=1800.42	UNSAT TT=18.97	UNSAT TT=9.113	UNSAT TT=0.186	UNSAT TT=0.164	UNSAT TT=0.171	UNSAT TT=0.169	UNSAT TT=3.099
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971766.opb	SAT TT=0.027 T1=0.02	SAT TT=1.67 T1=2.52	SAT TT=19.242 T1=19.24	SAT TT=0.027 T1=0.02	SAT TT=44.338 T1=44.33	SAT TT=76.933 T1=76.93	SAT TT=0.742 T1=0.74	SAT TT=4.266 T1=4.26	? (TO) TT=1800.24	SAT TT=7.73 T1=3.7	SAT TT=3.426 T1=3.02	SAT TT=0.378 T1=0.37	SAT TT=0.37 T1=0.36	SAT TT=0.338 T1=0.33	SAT TT=0.344 T1=0.33	SAT TT=2.88 T1=2.87
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972154.opb	UNSAT TT=0.19	UNSAT TT=9.476	UNSAT TT=49.712	UNSAT TT=1.163	UNSAT TT=160.418	UNSAT TT=244.268	UNSAT TT=11.218	UNSAT TT=36.003	? (TO) TT=1800.25	UNSAT TT=18.681	UNSAT TT=8.408	UNSAT TT=0.214	UNSAT TT=0.19	UNSAT TT=0.195	UNSAT TT=0.196	UNSAT TT=3.019
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972763.opb	UNSAT TT=0.124	UNSAT TT=9.367	UNSAT TT=35.615	UNSAT TT=0.894	UNSAT TT=101.826	UNSAT TT=174.743	UNSAT TT=9.621	UNSAT TT=28.349	UNSAT TT=296.285	UNSAT TT=22.824	UNSAT TT=10.904	UNSAT TT=0.139	UNSAT TT=0.124	UNSAT TT=0.127	UNSAT TT=0.127	UNSAT TT=2.202
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972958.opb	SAT TT=0.142 T1=0.14	SAT TT=2.676 T1=2.91	SAT TT=40.437 T1=40.43	SAT TT=0.142 T1=0.14	SAT TT=19.188 T1=19.18	SAT TT=35.24 T1=35.24	SAT TT=1.476 T1=1.47	SAT TT=8.006 T1=8	? (TO) TT=1800.58	SAT TT=12.665 T1=6.25	SAT TT=5.926 T1=5.5	SAT TT=0.288 T1=0.28	SAT TT=0.283 T1=0.27	SAT TT=0.26 T1=0.25	SAT TT=0.261 T1=0.25	SAT TT=2.239 T1=2.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973163.opb	UNSAT TT=0.089	UNSAT TT=10.07	UNSAT TT=42.658	UNSAT TT=1.272	UNSAT TT=180.218	UNSAT TT=249.142	UNSAT TT=18.324	UNSAT TT=42.851	? (TO) TT=1800.25	UNSAT TT=29.377	UNSAT TT=14.784	UNSAT TT=0.097	UNSAT TT=0.093	UNSAT TT=0.09	UNSAT TT=0.089	UNSAT TT=3.093
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973364.opb	UNSAT TT=0.181	UNSAT TT=5.205	UNSAT TT=19.663	UNSAT TT=0.638	UNSAT TT=54.687	UNSAT TT=102.728	UNSAT TT=6.229	UNSAT TT=24.147	? (TO) TT=1800.24	UNSAT TT=10.428	UNSAT TT=4.849	UNSAT TT=0.205	UNSAT TT=0.181	UNSAT TT=0.185	UNSAT TT=0.186	UNSAT TT=1.818
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973478.opb	SAT TT=0.208 T1=0.2	SAT TT=4.566 T1=4.68	SAT TT=8.505 T1=8.5	SAT TT=0.208 T1=0.2	SAT TT=62.548 T1=62.54	SAT TT=103.16 T1=103.16	SAT TT=2.294 T1=2.29	SAT TT=11.143 T1=11.14	? (TO) TT=1800.19	SAT TT=14.192 T1=6.74	SAT TT=6.116 T1=5.69	SAT TT=1.128 T1=1.12	SAT TT=1.013 T1=1.01	SAT TT=1.016 T1=1.01	SAT TT=1.024 T1=1.01	SAT TT=1.7 T1=1.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973670.opb	UNSAT TT=0.251	UNSAT TT=10.247	UNSAT TT=36.012	UNSAT TT=0.902	UNSAT TT=158.047	UNSAT TT=246.556	UNSAT TT=7.993	UNSAT TT=27.88	? (TO) TT=1800.79	UNSAT TT=21.405	UNSAT TT=10.383	UNSAT TT=0.284	UNSAT TT=0.251	UNSAT TT=0.256	UNSAT TT=0.254	UNSAT TT=3.916
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973863.opb	SAT TT=0.818 T1=0.82	SAT TT=10.417 T1=10.53	SAT TT=37.724 T1=37.72	SAT TT=0.818 T1=0.82	SAT TT=78.074 T1=78.07	SAT TT=124.504 T1=124.5	SAT TT=9.992 T1=9.99	SAT TT=26.002 T1=26	SAT TT=9.919 T1=8.72	SAT TT=18.438 T1=9.23	SAT TT=13.942 T1=13.48	SAT TT=1.611 T1=1.6	SAT TT=1.446 T1=1.44	SAT TT=1.429 T1=1.42	SAT TT=1.449 T1=1.44	SAT TT=2.574 T1=2.57
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974180.opb	UNSAT TT=0.131	UNSAT TT=10.155	UNSAT TT=39.235	UNSAT TT=0.909	UNSAT TT=137.323	UNSAT TT=230.108	UNSAT TT=8.907	UNSAT TT=33.053	? (TO) TT=1800.17	UNSAT TT=23.243	UNSAT TT=11.077	UNSAT TT=0.149	UNSAT TT=0.131	UNSAT TT=0.136	UNSAT TT=0.135	UNSAT TT=3.761
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974372.opb	UNSAT TT=0.019	UNSAT TT=5.747	UNSAT TT=22.334	UNSAT TT=0.708	UNSAT TT=53.437	UNSAT TT=97.423	UNSAT TT=6.257	UNSAT TT=25.366	UNSAT TT=7.843	UNSAT TT=14.306	UNSAT TT=6.493	UNSAT TT=0.022	UNSAT TT=0.019	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=1.954
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974553.opb	SAT TT=0.059 T1=0.06	SAT TT=1.961 T1=11.67	SAT TT=4.42 T1=4.42	SAT TT=0.059 T1=0.06	SAT TT=7.971 T1=7.97	SAT TT=17.41 T1=17.41	SAT TT=0.979 T1=0.98	SAT TT=5.278 T1=5.27	SAT TT=9.637 T1=8.25	SAT TT=5.201 T1=2.2	SAT TT=2.177 T1=1.75	SAT TT=0.393 T1=0.38	SAT TT=0.349 T1=0.34	SAT TT=0.351 T1=0.34	SAT TT=0.353 T1=0.34	SAT TT=0.913 T1=0.91
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975607.opb	UNSAT TT=0.07	UNSAT TT=4.914	UNSAT TT=17.582	UNSAT TT=0.619	UNSAT TT=95.555	UNSAT TT=168.189	UNSAT TT=4.082	UNSAT TT=19.968	UNSAT TT=61.91	UNSAT TT=12.036	UNSAT TT=5.479	UNSAT TT=0.081	UNSAT TT=0.07	UNSAT TT=0.075	UNSAT TT=0.075	UNSAT TT=1.17
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975678.opb	SAT TT=0.191 T1=0.19	SAT TT=8.032 T1=8.15	SAT TT=48.426 T1=48.44	SAT TT=1.108 T1=1.1	SAT TT=34.117 T1=34.11	SAT TT=56.931 T1=56.93	SAT TT=0.191 T1=0.19	SAT TT=1.371 T1=1.37	? (TO) TT=1800.24	SAT TT=13.143 T1=6.23	SAT TT=6.321 T1=5.89	SAT TT=1.191 T1=1.19	SAT TT=1.187 T1=1.18	SAT TT=1.064 T1=1.05	SAT TT=1.073 T1=1.06	SAT TT=0.642 T1=0.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975832.opb	SAT TT=0.108 T1=0.1	SAT TT=9.45 T1=15.63	SAT TT=12.36 T1=12.36	SAT TT=0.108 T1=0.1	SAT TT=62.511 T1=62.5	SAT TT=106.387 T1=106.38	SAT TT=2.2 T1=2.19	SAT TT=10.668 T1=10.66	SAT TT=16.794 T1=15.32	SAT TT=6.503 T1=2.69	SAT TT=2.96 T1=2.54	SAT TT=1.13 T1=1.12	SAT TT=1.142 T1=1.13	SAT TT=1.015 T1=1	SAT TT=1.014 T1=1	SAT TT=0.313 T1=0.31
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975965.opb	UNSAT TT=0.875	UNSAT TT=11.161	UNSAT TT=60.457	UNSAT TT=1.303	UNSAT TT=332.952	UNSAT TT=481.275	UNSAT TT=13.777	UNSAT TT=39.118	? (TO) TT=1800.3	UNSAT TT=35.974	UNSAT TT=16.238	UNSAT TT=0.977	UNSAT TT=0.954	UNSAT TT=0.875	UNSAT TT=0.882	UNSAT TT=4.351
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976157.opb	UNSAT TT=0.02	UNSAT TT=4.697	UNSAT TT=17.862	UNSAT TT=0.667	UNSAT TT=43.775	UNSAT TT=85.426	UNSAT TT=4.019	UNSAT TT=19.319	UNSAT TT=3.898	UNSAT TT=6.965	UNSAT TT=3.673	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=0.022	UNSAT TT=0.02	UNSAT TT=1.189
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976730.opb	UNSAT TT=0.117	UNSAT TT=10.63	UNSAT TT=44.295	UNSAT TT=1.346	UNSAT TT=322.267	UNSAT TT=479.606	UNSAT TT=9.152	UNSAT TT=32.482	? (TO) TT=1800.16	UNSAT TT=32.583	UNSAT TT=15.277	UNSAT TT=0.129	UNSAT TT=0.127	UNSAT TT=0.119	UNSAT TT=0.117	UNSAT TT=4.008
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976735.opb	SAT TT=0.077 T1=0.07	SAT TT=4.909 T1=5.07	SAT TT=21.941 T1=21.94	SAT TT=0.077 T1=0.07	SAT TT=20.784 T1=20.78	SAT TT=36.214 T1=36.21	SAT TT=0.561 T1=0.56	SAT TT=3.194 T1=3.19	? (TO) TT=1800.32	SAT TT=3.336 T1=1.18	SAT TT=1.202 T1=0.84	SAT TT=0.317 T1=0.31	SAT TT=0.284 T1=0.28	SAT TT=0.286 T1=0.28	SAT TT=0.289 T1=0.28	SAT TT=1.536 T1=1.53
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976935.opb	UNSAT TT=0.02	UNSAT TT=7.227	UNSAT TT=24.832	UNSAT TT=0.772	UNSAT TT=115.695	UNSAT TT=201.162	UNSAT TT=11.432	UNSAT TT=38.91	? (TO) TT=1800.18	UNSAT TT=16.259	UNSAT TT=7.859	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=2.655
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977266.opb	SAT TT=0.27 T1=0.27	SAT TT=7.459 T1=7.53	SAT TT=38.288 T1=38.28	SAT TT=0.27 T1=0.27	SAT TT=18.356 T1=18.35	SAT TT=37.646 T1=37.64	SAT TT=4.608 T1=4.6	SAT TT=17.521 T1=17.52	SAT TT=3.667 T1=2.26	SAT TT=6.257 T1=2.68	SAT TT=2.941 T1=2.5	SAT TT=0.992 T1=0.98	SAT TT=0.985 T1=0.98	SAT TT=0.886 T1=0.88	SAT TT=0.894 T1=0.88	SAT TT=0.862 T1=0.86
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977273.opb	UNSAT TT=0.243	UNSAT TT=7.917	UNSAT TT=29.818	UNSAT TT=0.942	UNSAT TT=162.692	UNSAT TT=248.047	UNSAT TT=6.307	UNSAT TT=24.826	? (TO) TT=1800.5	UNSAT TT=20.962	UNSAT TT=10.234	UNSAT TT=0.273	UNSAT TT=0.243	UNSAT TT=0.247	UNSAT TT=0.247	UNSAT TT=2.399
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977464.opb	SAT TT=0.379 T1=0.37	SAT TT=10.967 T1=11.07	SAT TT=50.048 T1=50.04	SAT TT=1.108 T1=1.11	SAT TT=22.83 T1=22.82	SAT TT=42.866 T1=42.86	SAT TT=9.499 T1=9.49	SAT TT=31.417 T1=31.41	SAT TT=1007.66 T1=1005.75	SAT TT=10.84 T1=5.23	SAT TT=4.982 T1=4.56	SAT TT=0.423 T1=0.42	SAT TT=0.379 T1=0.37	SAT TT=0.382 T1=0.37	SAT TT=0.382 T1=0.37	SAT TT=6.647 T1=6.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977780.opb	UNSAT TT=0.019	UNSAT TT=5.552	UNSAT TT=26.148	UNSAT TT=0.564	UNSAT TT=44.366	UNSAT TT=93.559	UNSAT TT=5.3	UNSAT TT=26.934	UNSAT TT=3.593	UNSAT TT=6.544	UNSAT TT=5.215	UNSAT TT=0.021	UNSAT TT=0.019	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=1.745
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978113.opb	UNSAT TT=0.703	UNSAT TT=11.863	UNSAT TT=69.81	UNSAT TT=1.273	UNSAT TT=374.718	UNSAT TT=595.418	UNSAT TT=22.416	UNSAT TT=55.701	? (TO) TT=1800.2	UNSAT TT=32.018	UNSAT TT=15.766	UNSAT TT=0.791	UNSAT TT=0.703	UNSAT TT=0.708	UNSAT TT=0.712	UNSAT TT=4.613
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978334.opb	UNSAT TT=0.099	UNSAT TT=7.965	UNSAT TT=32.973	UNSAT TT=0.945	UNSAT TT=167.061	UNSAT TT=242.065	UNSAT TT=9.396	UNSAT TT=28.103	UNSAT TT=9.265	UNSAT TT=17.824	UNSAT TT=9.924	UNSAT TT=0.113	UNSAT TT=0.099	UNSAT TT=0.103	UNSAT TT=0.103	UNSAT TT=2.762
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212272.opb	UNSAT TT=0.278	UNSAT TT=11.149	UNSAT TT=38.435	UNSAT TT=0.992	UNSAT TT=175.171	UNSAT TT=288.407	UNSAT TT=9.608	UNSAT TT=32.163	? (TO) TT=1800.22	UNSAT TT=28.539	UNSAT TT=13.682	UNSAT TT=0.315	UNSAT TT=0.278	UNSAT TT=0.283	UNSAT TT=0.282	UNSAT TT=2.572
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212476.opb	UNSAT TT=0.336	UNSAT TT=9.325	UNSAT TT=48.658	UNSAT TT=1.061	UNSAT TT=126.014	UNSAT TT=224.096	UNSAT TT=12.116	UNSAT TT=35.596	? (TO) TT=1800.37	UNSAT TT=24.844	UNSAT TT=11.713	UNSAT TT=0.336	UNSAT TT=0.336	UNSAT TT=0.341	UNSAT TT=0.34	UNSAT TT=3.699
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212923.opb	UNSAT TT=0.54	UNSAT TT=7.591	UNSAT TT=22.746	UNSAT TT=0.645	UNSAT TT=48.886	UNSAT TT=101.888	UNSAT TT=6.001	UNSAT TT=23.084	? (TO) TT=1800.24	UNSAT TT=15.331	UNSAT TT=7.448	UNSAT TT=0.605	UNSAT TT=0.54	UNSAT TT=0.543	UNSAT TT=0.548	UNSAT TT=2.051
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213670.opb	UNSAT TT=0.019	UNSAT TT=6.065	UNSAT TT=21.619	UNSAT TT=0.728	UNSAT TT=53.662	UNSAT TT=101.062	UNSAT TT=5.119	UNSAT TT=24.729	? (TO) TT=1800.53	UNSAT TT=15.54	UNSAT TT=7.426	UNSAT TT=0.022	UNSAT TT=0.019	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=1.782
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213868.opb	UNSAT TT=0.223	UNSAT TT=7.916	UNSAT TT=39.497	UNSAT TT=0.857	UNSAT TT=130.303	UNSAT TT=220.447	UNSAT TT=6.215	UNSAT TT=24.399	? (TO) TT=1800.32	UNSAT TT=18.38	UNSAT TT=8.512	UNSAT TT=0.249	UNSAT TT=0.243	UNSAT TT=0.224	UNSAT TT=0.223	UNSAT TT=2.893
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216188.opb	SAT TT=0.242 T1=0.24	SAT TT=3.849 T1=3.96	SAT TT=8.134 T1=8.13	SAT TT=0.242 T1=0.24	SAT TT=93.397 T1=93.39	SAT TT=148.847 T1=148.84	SAT TT=4.702 T1=4.7	SAT TT=22.719 T1=22.71	? (TO) TT=1800.25	SAT TT=7.538 T1=3.2	SAT TT=3.549 T1=3.15	SAT TT=0.828 T1=0.82	SAT TT=0.744 T1=0.74	SAT TT=0.744 T1=0.73	SAT TT=0.75 T1=0.74	SAT TT=1.52 T1=1.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216411.opb	UNSAT TT=0.109	UNSAT TT=9.73	UNSAT TT=36.307	UNSAT TT=0.999	UNSAT TT=117.17	UNSAT TT=225.758	UNSAT TT=15.398	UNSAT TT=39.126	? (TO) TT=1800.22	UNSAT TT=31.219	UNSAT TT=14.651	UNSAT TT=0.121	UNSAT TT=0.118	UNSAT TT=0.11	UNSAT TT=0.109	UNSAT TT=3.292
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216823.opb	UNSAT TT=0.427	UNSAT TT=6.899	UNSAT TT=31.422	UNSAT TT=0.761	UNSAT TT=120.714	UNSAT TT=224.262	UNSAT TT=11.236	UNSAT TT=32.713	? (TO) TT=1800.21	UNSAT TT=14.377	UNSAT TT=6.254	UNSAT TT=0.476	UNSAT TT=0.472	UNSAT TT=0.427	UNSAT TT=0.43	UNSAT TT=2.762
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216864.opb	SAT TT=0.341 T1=0.34	SAT TT=6.409 T1=6.47	SAT TT=21.404 T1=21.4	SAT TT=0.341 T1=0.34	SAT TT=20.285 T1=20.28	SAT TT=38.265 T1=38.26	SAT TT=0.761 T1=0.76	SAT TT=4.7 T1=4.69	SAT TT=1.241 T1=0.52	SAT TT=2.505 T1=1.17	SAT TT=3.539 T1=3.13	SAT TT=0.45 T1=0.44	SAT TT=0.4 T1=0.39	SAT TT=0.406 T1=0.4	SAT TT=0.404 T1=0.39	SAT TT=1.77 T1=1.76
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217374.opb	SAT TT=0.099 T1=0.09	SAT TT=1.027 T1=7.25	SAT TT=14.522 T1=14.52	SAT TT=0.25 T1=0.25	SAT TT=1.086 T1=1.08	SAT TT=2.245 T1=2.24	SAT TT=0.099 T1=0.09	SAT TT=0.617 T1=0.61	? (TO) TT=1800.24	SAT TT=2.418 T1=1.19	SAT TT=0.857 T1=0.51	SAT TT=0.398 T1=0.39	SAT TT=0.356 T1=0.35	SAT TT=0.358 T1=0.35	SAT TT=0.36 T1=0.35	SAT TT=1.247 T1=1.24
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217380.opb	SAT TT=0.135 T1=0.13	SAT TT=5.893 T1=17.45	SAT TT=32.756 T1=32.75	SAT TT=0.395 T1=0.39	SAT TT=0.697 T1=0.69	SAT TT=1.739 T1=1.73	SAT TT=0.135 T1=0.13	SAT TT=0.834 T1=0.83	? (TO) TT=1800.21	SAT TT=4.017 T1=1.68	SAT TT=1.571 T1=1.19	SAT TT=1.692 T1=1.69	SAT TT=1.507 T1=1.5	SAT TT=1.505 T1=1.5	SAT TT=1.526 T1=1.52	SAT TT=0.355 T1=0.35
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217392.opb	UNSAT TT=0.167	UNSAT TT=7.692	UNSAT TT=29.983	UNSAT TT=0.718	UNSAT TT=99.477	UNSAT TT=161.671	UNSAT TT=10.454	UNSAT TT=34.256	? (TO) TT=1800.25	UNSAT TT=15.249	UNSAT TT=6.938	UNSAT TT=0.19	UNSAT TT=0.167	UNSAT TT=0.171	UNSAT TT=0.17	UNSAT TT=2.204
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217555.opb	UNSAT TT=0.706	UNSAT TT=8.098	UNSAT TT=33.301	UNSAT TT=1.018	UNSAT TT=182.999	UNSAT TT=249.271	UNSAT TT=11.602	UNSAT TT=39.982	? (TO) TT=1800.24	UNSAT TT=27.475	UNSAT TT=14.808	UNSAT TT=0.792	UNSAT TT=0.706	UNSAT TT=0.709	UNSAT TT=0.721	UNSAT TT=2.273
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218024.opb	UNSAT TT=0.02	UNSAT TT=9.889	UNSAT TT=36.173	UNSAT TT=0.918	UNSAT TT=98.35	UNSAT TT=176.078	UNSAT TT=7.398	UNSAT TT=31.483	? (TO) TT=1800.24	UNSAT TT=23.117	UNSAT TT=11.423	UNSAT TT=0.023	UNSAT TT=0.02	UNSAT TT=0.022	UNSAT TT=0.022	UNSAT TT=2.735
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218308.opb	UNSAT TT=0.436	UNSAT TT=16.543	UNSAT TT=84.691	UNSAT TT=1.708	UNSAT TT=422.273	UNSAT TT=595.501	UNSAT TT=22.045	UNSAT TT=53.711	? (TO) TT=1800.34	UNSAT TT=45.066	UNSAT TT=22.153	UNSAT TT=0.486	UNSAT TT=0.436	UNSAT TT=0.439	UNSAT TT=0.442	UNSAT TT=5.264
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218757.opb	UNSAT TT=0.079	UNSAT TT=9.999	UNSAT TT=32.351	UNSAT TT=1.086	UNSAT TT=75.598	UNSAT TT=139.643	UNSAT TT=9.781	UNSAT TT=30.833	? (TO) TT=1800.21	UNSAT TT=23.04	UNSAT TT=10.715	UNSAT TT=0.09	UNSAT TT=0.079	UNSAT TT=0.084	UNSAT TT=0.083	UNSAT TT=1.993
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218955.opb	UNSAT TT=0.099	UNSAT TT=5.558	UNSAT TT=19.529	UNSAT TT=0.694	UNSAT TT=140.298	UNSAT TT=235.559	UNSAT TT=6.722	UNSAT TT=27.547	? (TO) TT=1800.15	UNSAT TT=12.943	UNSAT TT=5.843	UNSAT TT=0.099	UNSAT TT=0.099	UNSAT TT=0.104	UNSAT TT=0.101	UNSAT TT=1.434
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219348.opb	UNSAT TT=0.362	UNSAT TT=8.077	UNSAT TT=29.287	UNSAT TT=0.755	UNSAT TT=119.854	UNSAT TT=201.58	UNSAT TT=9.38	UNSAT TT=29.196	? (TO) TT=1800.23	UNSAT TT=14.138	UNSAT TT=6.961	UNSAT TT=0.405	UNSAT TT=0.362	UNSAT TT=0.366	UNSAT TT=0.367	UNSAT TT=2.589
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219399.opb	SAT TT=0.108 T1=0.1	SAT TT=1.59 T1=13.43	SAT TT=4.693 T1=4.69	SAT TT=0.108 T1=0.1	SAT TT=18.688 T1=18.68	SAT TT=34.548 T1=34.54	SAT TT=0.561 T1=0.56	SAT TT=3.409 T1=3.4	SAT TT=76.909 T1=75.44	SAT TT=6.165 T1=2.69	SAT TT=2.465 T1=2.06	SAT TT=0.327 T1=0.32	SAT TT=0.295 T1=0.29	SAT TT=0.296 T1=0.29	SAT TT=0.3 T1=0.29	SAT TT=0.563 T1=0.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219799.opb	UNSAT TT=0.221	UNSAT TT=8.472	UNSAT TT=29.832	UNSAT TT=0.677	UNSAT TT=91.538	UNSAT TT=159.912	UNSAT TT=5.49	UNSAT TT=25.651	UNSAT TT=1067.35	UNSAT TT=12.558	UNSAT TT=5.721	UNSAT TT=0.249	UNSAT TT=0.221	UNSAT TT=0.226	UNSAT TT=0.226	UNSAT TT=1.967
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220019.opb	UNSAT TT=0.145	UNSAT TT=8.79	UNSAT TT=29.502	UNSAT TT=1	UNSAT TT=133.968	UNSAT TT=204.859	UNSAT TT=8.909	UNSAT TT=29.981	UNSAT TT=4.847	UNSAT TT=7.721	UNSAT TT=10.879	UNSAT TT=0.167	UNSAT TT=0.145	UNSAT TT=0.151	UNSAT TT=0.151	UNSAT TT=3.296
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220546.opb	UNSAT TT=0.348	UNSAT TT=8.697	UNSAT TT=33.133	UNSAT TT=0.854	UNSAT TT=134.995	UNSAT TT=226.301	UNSAT TT=8.338	UNSAT TT=27.415	? (TO) TT=1800.25	UNSAT TT=17.145	UNSAT TT=7.956	UNSAT TT=0.396	UNSAT TT=0.348	UNSAT TT=0.354	UNSAT TT=0.354	UNSAT TT=2.871
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220767.opb	UNSAT TT=0.114	UNSAT TT=8.981	UNSAT TT=47.234	UNSAT TT=1.059	UNSAT TT=128.763	UNSAT TT=206.612	UNSAT TT=13.244	UNSAT TT=37.459	? (TO) TT=1800.22	UNSAT TT=29.654	UNSAT TT=13.584	UNSAT TT=0.129	UNSAT TT=0.114	UNSAT TT=0.119	UNSAT TT=0.118	UNSAT TT=2.821
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221203.opb	UNSAT TT=0.346	UNSAT TT=9.476	UNSAT TT=30.127	UNSAT TT=0.836	UNSAT TT=164.211	UNSAT TT=245.514	UNSAT TT=9.029	UNSAT TT=27.912	? (TO) TT=1800.25	UNSAT TT=29.097	UNSAT TT=13.286	UNSAT TT=0.387	UNSAT TT=0.346	UNSAT TT=0.352	UNSAT TT=0.354	UNSAT TT=2.692
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221624.opb	UNSAT TT=0.447	UNSAT TT=8.633	UNSAT TT=31.549	UNSAT TT=0.963	UNSAT TT=148.653	UNSAT TT=229.328	UNSAT TT=9.341	UNSAT TT=29.283	? (TO) TT=1800.44	UNSAT TT=24.139	UNSAT TT=11.131	UNSAT TT=0.509	UNSAT TT=0.447	UNSAT TT=0.453	UNSAT TT=0.453	UNSAT TT=2.809
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221953.opb	SAT TT=0.322 T1=0.32	SAT TT=4.213 T1=5.47	SAT TT=7.775 T1=7.77	SAT TT=0.322 T1=0.32	SAT TT=69.197 T1=69.19	SAT TT=107.755 T1=107.76	SAT TT=2.336 T1=2.33	SAT TT=11.404 T1=11.4	SAT TT=9.891 T1=8.58	SAT TT=8.001 T1=3.69	SAT TT=3.504 T1=3.09	SAT TT=0.475 T1=0.47	SAT TT=0.418 T1=0.41	SAT TT=0.423 T1=0.42	SAT TT=0.428 T1=0.42	SAT TT=0.96 T1=0.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222080.opb	SAT TT=0.138 T1=0.13	SAT TT=3.179 T1=7.06	SAT TT=11.533 T1=11.53	SAT TT=0.189 T1=0.18	SAT TT=9.358 T1=9.35	SAT TT=18.35 T1=18.34	SAT TT=1.341 T1=1.34	SAT TT=7.966 T1=7.96	SAT TT=248.397 T1=247.07	SAT TT=16.632 T1=7.83	SAT TT=7.851 T1=7.45	SAT TT=0.157 T1=0.15	SAT TT=0.138 T1=0.13	SAT TT=0.144 T1=0.13	SAT TT=0.143 T1=0.13	SAT TT=3.401 T1=3.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222248.opb	SAT TT=0.013 T1=0.01	SAT TT=1.965 T1=2.29	SAT TT=13.279 T1=13.27	SAT TT=0.013 T1=0.01	SAT TT=10.211 T1=10.21	SAT TT=22.324 T1=22.32	SAT TT=0.344 T1=0.34	SAT TT=2.1 T1=2.09	? (TO) TT=1800.27	SAT TT=4.926 T1=2.2	SAT TT=1.88 T1=1.49	SAT TT=1.175 T1=1.17	SAT TT=1.049 T1=1.04	SAT TT=1.047 T1=1.04	SAT TT=1.064 T1=1.05	SAT TT=2.408 T1=2.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222257.opb	UNSAT TT=0.163	UNSAT TT=7.586	UNSAT TT=29.313	UNSAT TT=0.9	UNSAT TT=127.339	UNSAT TT=237.106	UNSAT TT=7.448	UNSAT TT=27.718	? (TO) TT=1800.21	UNSAT TT=22.583	UNSAT TT=10.858	UNSAT TT=0.179	UNSAT TT=0.173	UNSAT TT=0.164	UNSAT TT=0.163	UNSAT TT=2.922
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222539.opb	UNSAT TT=0.044	UNSAT TT=7.59	UNSAT TT=39.242	UNSAT TT=0.898	UNSAT TT=86.508	UNSAT TT=153.786	UNSAT TT=9.032	UNSAT TT=31.887	UNSAT TT=2.012	UNSAT TT=3.349	UNSAT TT=10.464	UNSAT TT=0.051	UNSAT TT=0.044	UNSAT TT=0.049	UNSAT TT=0.048	UNSAT TT=2.953
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223004.opb	UNSAT TT=0.988	UNSAT TT=8.641	UNSAT TT=38.009	UNSAT TT=0.988	UNSAT TT=234.593	UNSAT TT=354.787	UNSAT TT=9.747	UNSAT TT=28.532	? (TO) TT=1800.19	UNSAT TT=23.837	UNSAT TT=11.733	UNSAT TT=1.719	UNSAT TT=1.538	UNSAT TT=1.535	UNSAT TT=1.551	UNSAT TT=3.001
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223220.opb	UNSAT TT=0.103	UNSAT TT=7.902	UNSAT TT=33.695	UNSAT TT=0.926	UNSAT TT=161.336	UNSAT TT=245.683	UNSAT TT=7.876	UNSAT TT=26.704	? (TO) TT=1800.26	UNSAT TT=18.429	UNSAT TT=7.927	UNSAT TT=0.119	UNSAT TT=0.103	UNSAT TT=0.11	UNSAT TT=0.108	UNSAT TT=2.637
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223416.opb	SAT TT=0.115 T1=0.11	SAT TT=2.601 T1=2.73	SAT TT=22.401 T1=22.4	SAT TT=0.115 T1=0.11	SAT TT=24.81 T1=24.81	SAT TT=44.952 T1=44.95	SAT TT=0.24 T1=0.24	SAT TT=1.502 T1=1.5	SAT TT=169.218 T1=167.7	SAT TT=5.628 T1=2.2	SAT TT=2.284 T1=1.86	SAT TT=0.522 T1=0.52	SAT TT=0.465 T1=0.46	SAT TT=0.469 T1=0.46	SAT TT=0.47 T1=0.46	SAT TT=1.989 T1=1.98
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223596.opb	SAT TT=0.528 T1=0.53	SAT TT=3.281 T1=3.51	SAT TT=30.124 T1=30.12	SAT TT=0.528 T1=0.53	SAT TT=5.835 T1=5.83	SAT TT=11.905 T1=11.9	SAT TT=6.058 T1=6.05	SAT TT=20.773 T1=20.77	? (TO) TT=1800.18	SAT TT=14.809 T1=7.25	SAT TT=6.893 T1=6.47	SAT TT=1.539 T1=1.53	SAT TT=1.558 T1=1.55	SAT TT=1.368 T1=1.36	SAT TT=1.377 T1=1.37	SAT TT=4.711 T1=4.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223689.opb	SAT TT=0.247 T1=0.24	SAT TT=2.04 T1=2.45	SAT TT=40.299 T1=40.29	SAT TT=0.344 T1=0.34	SAT TT=16.768 T1=16.76	SAT TT=30.104 T1=30.1	SAT TT=0.247 T1=0.24	SAT TT=1.671 T1=1.67	SAT TT=1.545 T1=0.62	SAT TT=2.695 T1=1.18	SAT TT=1.562 T1=1.19	SAT TT=0.617 T1=0.61	SAT TT=0.625 T1=0.62	SAT TT=0.55 T1=0.54	SAT TT=0.561 T1=0.55	SAT TT=1.791 T1=1.79
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223696.opb	SAT TT=0.313 T1=0.31	SAT TT=6.741 T1=6.98	SAT TT=29.184 T1=29.18	SAT TT=0.313 T1=0.31	SAT TT=19.547 T1=19.54	SAT TT=41.027 T1=41.02	SAT TT=2.1 T1=2.09	SAT TT=9.654 T1=9.65	? (TO) TT=1800.22	SAT TT=16.154 T1=7.84	SAT TT=7.825 T1=7.38	SAT TT=1.053 T1=1.04	SAT TT=0.937 T1=0.93	SAT TT=0.941 T1=0.93	SAT TT=0.943 T1=0.93	SAT TT=1.954 T1=1.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224059.opb	UNSAT TT=0.02	UNSAT TT=4.715	UNSAT TT=17.911	UNSAT TT=0.564	UNSAT TT=57.351	UNSAT TT=111.725	UNSAT TT=3.844	UNSAT TT=18.789	UNSAT TT=3.109	UNSAT TT=5.378	UNSAT TT=5.412	UNSAT TT=0.021	UNSAT TT=0.02	UNSAT TT=0.022	UNSAT TT=0.021	UNSAT TT=1.371
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224255.opb	UNSAT TT=0.336	UNSAT TT=7.935	UNSAT TT=37.477	UNSAT TT=0.916	UNSAT TT=154.694	UNSAT TT=244.754	UNSAT TT=10.898	UNSAT TT=30.719	? (TO) TT=1800.27	UNSAT TT=18.93	UNSAT TT=8.481	UNSAT TT=0.375	UNSAT TT=0.336	UNSAT TT=0.34	UNSAT TT=0.339	UNSAT TT=2.085
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224451.opb	UNSAT TT=0.16	UNSAT TT=7.486	UNSAT TT=24.963	UNSAT TT=0.919	UNSAT TT=59.676	UNSAT TT=106.265	UNSAT TT=6.866	UNSAT TT=24.888	? (TO) TT=1800.3	UNSAT TT=16.688	UNSAT TT=8.197	UNSAT TT=0.177	UNSAT TT=0.175	UNSAT TT=0.161	UNSAT TT=0.16	UNSAT TT=2.204
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224522.opb	SAT TT=0.04 T1=0.04	SAT TT=4.413 T1=4.66	SAT TT=5.517 T1=5.51	SAT TT=0.04 T1=0.04	SAT TT=17.054 T1=17.05	SAT TT=32.354 T1=32.35	SAT TT=0.652 T1=0.65	SAT TT=4.498 T1=4.49	SAT TT=5.426 T1=4.27	SAT TT=9.838 T1=4.71	SAT TT=4.554 T1=4.15	SAT TT=0.25 T1=0.24	SAT TT=0.222 T1=0.21	SAT TT=0.226 T1=0.22	SAT TT=0.226 T1=0.22	SAT TT=1.203 T1=1.2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224929.opb	UNSAT TT=0.078	UNSAT TT=7.118	UNSAT TT=29.637	UNSAT TT=0.747	UNSAT TT=64.211	UNSAT TT=114.08	UNSAT TT=7.32	UNSAT TT=27.74	UNSAT TT=14.319	UNSAT TT=20.278	UNSAT TT=9.432	UNSAT TT=0.086	UNSAT TT=0.081	UNSAT TT=0.08	UNSAT TT=0.078	UNSAT TT=2.258
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225122.opb	UNSAT TT=0.109	UNSAT TT=5.559	UNSAT TT=21.721	UNSAT TT=0.62	UNSAT TT=156.491	UNSAT TT=251.908	UNSAT TT=5.701	UNSAT TT=23.52	? (TO) TT=1800.27	UNSAT TT=9.608	UNSAT TT=4.311	UNSAT TT=0.124	UNSAT TT=0.109	UNSAT TT=0.115	UNSAT TT=0.113	UNSAT TT=1.666
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225605.opb	UNSAT TT=0.557	UNSAT TT=6.237	UNSAT TT=27.061	UNSAT TT=0.871	UNSAT TT=83.184	UNSAT TT=140.339	UNSAT TT=11.912	UNSAT TT=32.68	? (TO) TT=1800.22	UNSAT TT=20.087	UNSAT TT=9.616	UNSAT TT=0.623	UNSAT TT=0.557	UNSAT TT=0.559	UNSAT TT=0.564	UNSAT TT=1.708
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226062.opb	UNSAT TT=0.223	UNSAT TT=7.607	UNSAT TT=25.415	UNSAT TT=0.643	UNSAT TT=55.049	UNSAT TT=101.083	UNSAT TT=6.514	UNSAT TT=27.028	? (TO) TT=1800.23	UNSAT TT=15.367	UNSAT TT=7.233	UNSAT TT=0.25	UNSAT TT=0.223	UNSAT TT=0.227	UNSAT TT=0.227	UNSAT TT=2.217
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226241.opb	SAT TT=0.042 T1=0.04	SAT TT=2.297 T1=2.68	SAT TT=21.343 T1=21.34	SAT TT=0.042 T1=0.04	SAT TT=28.933 T1=28.93	SAT TT=51.37 T1=51.36	SAT TT=1.718 T1=1.71	SAT TT=8.821 T1=8.82	SAT TT=48.176 T1=46.79	SAT TT=11.921 T1=5.7	SAT TT=5.435 T1=5.04	SAT TT=1.278 T1=1.27	SAT TT=1.302 T1=1.29	SAT TT=1.145 T1=1.14	SAT TT=1.148 T1=1.14	SAT TT=0.557 T1=0.55
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226284.opb	SAT TT=0.221 T1=0.22	SAT TT=0.986 T1=7.28	SAT TT=15.098 T1=15.09	SAT TT=0.221 T1=0.22	SAT TT=25.548 T1=25.54	SAT TT=44.708 T1=44.7	SAT TT=2.145 T1=2.14	SAT TT=11.734 T1=11.73	SAT TT=155.049 T1=153.63	SAT TT=6.828 T1=3.19	SAT TT=3.082 T1=2.57	SAT TT=0.297 T1=0.29	SAT TT=0.265 T1=0.26	SAT TT=0.268 T1=0.26	SAT TT=0.268 T1=0.26	SAT TT=2.587 T1=2.58
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226368.opb	UNSAT TT=0.053	UNSAT TT=5.004	UNSAT TT=17.389	UNSAT TT=0.636	UNSAT TT=37.003	UNSAT TT=77.75	UNSAT TT=7.089	UNSAT TT=25.737	UNSAT TT=4.532	UNSAT TT=7.683	UNSAT TT=5.65	UNSAT TT=0.061	UNSAT TT=0.053	UNSAT TT=0.058	UNSAT TT=0.057	UNSAT TT=1.338
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226680.opb	UNSAT TT=0.178	UNSAT TT=7.024	UNSAT TT=39.276	UNSAT TT=0.754	UNSAT TT=224.136	UNSAT TT=343.2	UNSAT TT=6.022	UNSAT TT=25.999	? (TO) TT=1800.66	UNSAT TT=17.212	UNSAT TT=7.947	UNSAT TT=0.197	UNSAT TT=0.195	UNSAT TT=0.179	UNSAT TT=0.178	UNSAT TT=1.591
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227012.opb	UNSAT TT=0.191	UNSAT TT=8.164	UNSAT TT=36.244	UNSAT TT=0.857	UNSAT TT=131.588	UNSAT TT=216.01	UNSAT TT=6.339	UNSAT TT=25.436	? (TO) TT=1800.27	UNSAT TT=18.132	UNSAT TT=8.748	UNSAT TT=0.216	UNSAT TT=0.191	UNSAT TT=0.195	UNSAT TT=0.196	UNSAT TT=2.556
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227326.opb	UNSAT TT=0.103	UNSAT TT=4.582	UNSAT TT=15.149	UNSAT TT=0.494	UNSAT TT=94.503	UNSAT TT=157.045	UNSAT TT=5.96	UNSAT TT=22.755	? (TO) TT=1800.23	UNSAT TT=9.219	UNSAT TT=4.191	UNSAT TT=0.118	UNSAT TT=0.103	UNSAT TT=0.108	UNSAT TT=0.108	UNSAT TT=1.086
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227418.opb	SAT TT=0.086 T1=0.08	SAT TT=7.775 T1=19.59	SAT TT=31.584 T1=31.58	SAT TT=0.086 T1=0.08	SAT TT=27.961 T1=27.96	SAT TT=47.637 T1=47.63	SAT TT=1.075 T1=1.07	SAT TT=5.149 T1=5.14	SAT TT=2.279 T1=1.11	SAT TT=3.909 T1=1.68	SAT TT=12.011 T1=11.57	SAT TT=1.017 T1=1.01	SAT TT=0.913 T1=0.9	SAT TT=0.916 T1=0.91	SAT TT=0.913 T1=0.9	SAT TT=1.002 T1=1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227861.opb	UNSAT TT=0.06	UNSAT TT=8.234	UNSAT TT=37.619	UNSAT TT=0.781	UNSAT TT=146.27	UNSAT TT=234.865	UNSAT TT=9.227	UNSAT TT=33.023	? (TO) TT=1800.27	UNSAT TT=22.473	UNSAT TT=10.311	UNSAT TT=0.07	UNSAT TT=0.06	UNSAT TT=0.066	UNSAT TT=0.064	UNSAT TT=2.491
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111228076.opb	UNSAT TT=0.185	UNSAT TT=9.343	UNSAT TT=45.318	UNSAT TT=1.13	UNSAT TT=160.139	UNSAT TT=232.064	UNSAT TT=14.704	UNSAT TT=36.931	? (TO) TT=1800.39	UNSAT TT=30.739	UNSAT TT=14.54	UNSAT TT=0.205	UNSAT TT=0.205	UNSAT TT=0.185	UNSAT TT=0.185	UNSAT TT=3.877
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14bt.opb	SAT TT=1.292 T1=1.29	SAT TT=41.02 T1=56.45	SAT TT=270.125 T1=270.11	SAT TT=1.292 T1=1.29	SAT TT=1494.21 T1=1494.16	? (TO) TT=1800.09	SAT TT=130.773 T1=130.76	SAT TT=316.341 T1=316.32	SAT TT=14.628 T1=13.16	SAT TT=27.792 T1=13.3	SAT TT=306.297 T1=305.56	SAT TT=148.751 T1=148.75	SAT TT=149.121 T1=149.11	SAT TT=148.558 T1=148.54	SAT TT=148.983 T1=148.97	SAT TT=44.12 T1=44.12
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14ls.opb	SAT TT=0.418 T1=0.41	SAT TT=50.854 T1=68.48	SAT TT=400.043 T1=400.03	SAT TT=0.418 T1=0.41	SAT TT=142.397 T1=142.39	SAT TT=626.377 T1=626.38	SAT TT=92.581 T1=92.57	SAT TT=227.969 T1=227.96	SAT TT=776.172 T1=772.82	SAT TT=97.846 T1=49.24	SAT TT=43.956 T1=43.39	SAT TT=699.221 T1=699.19	SAT TT=708.553 T1=708.52	SAT TT=702.61 T1=702.59	SAT TT=708.327 T1=708.3	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17bt.opb	SAT TT=40.66 T1=40.65	SAT TT=200.522 T1=215.39	? TT=1798.01	SAT TT=40.66 T1=40.65	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.32	SAT TT=1024.52 T1=531.31	SAT TT=438.114 T1=436.82	SAT TT=859.131 T1=859.09	SAT TT=954.648 T1=954.62	SAT TT=953.27 T1=953.22	SAT TT=868.202 T1=868.17	SAT TT=1082.88 T1=1082.92
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17ls.opb	SAT TT=7.388 T1=7.39	SAT TT=57.136 T1=73.28	SAT TT=7.388 T1=7.39	SAT TT=14.291 T1=14.28	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT TT=233.901 T1=231.8	SAT TT=544.383 T1=282.77	? (TO) TT=1800.1	? (TO) TT=1800.05	? TT=1797.07	? (TO) TT=1800.06	? TT=1797.06	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21bt.opb		? (TO) TT=1800.04	? TT=1798.01	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.28	? (TO) TT=1800.29	? (TO) TT=1800.13	? (TO) TT=1800.05	? TT=1797.07	? (TO) TT=1800.07	? TT=1797.06	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21ls.opb	SAT TT=64.997 T1=64.99	? (TO) TT=1800.04	? TT=1798.01	SAT TT=64.997 T1=64.99	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.23	? (TO) TT=1800.19	? (TO) TT=1800.12	? (TO) TT=1800.08	? TT=1797.07	? TT=1799.99	? TT=1797.07	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24bt.opb	SAT TT=976.778 T1=976.75	? (TO) TT=1800.07	? TT=1798.01	SAT TT=976.778 T1=976.75	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.29	? (TO) TT=1800.19	? (TO) TT=1800.08	? (TO) TT=1800.06	? TT=1797.05	? (TO) TT=1800.07	? TT=1797.06	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24ls.opb	SAT TT=125.497 T1=132.86	SAT TT=125.497 T1=132.86	? TT=1798.01	SAT TT=165.419 T1=165.42	? (TO) TT=1800.07	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.3	? (TO) TT=1800.15	? (TO) TT=1800.13	? (TO) TT=1800.06	? TT=1797.04	? (TO) TT=1800.06	? TT=1797.05	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9bt.opb	SAT TT=0.004 T1=0	SAT TT=29.224 T1=52.32	SAT TT=2.457 T1=2.45	SAT TT=0.004 T1=0	SAT TT=4.23 T1=4.23	SAT TT=19.272 T1=19.27	SAT TT=0.398 T1=0.39	SAT TT=1.626 T1=1.62	SAT TT=4.281 T1=2.82	SAT TT=6.481 T1=2.77	SAT TT=2.632 T1=2.14	SAT TT=14.297 T1=14.28	SAT TT=14.571 T1=14.56	SAT TT=13.069 T1=13.07	SAT TT=13.107 T1=13.09	SAT TT=1.205 T1=1.2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9ls.opb	SAT TT=0.03 T1=0.03	SAT TT=4.481 T1=20.11	SAT TT=0.145 T1=0.14	SAT TT=0.03 T1=0.03	SAT TT=1.054 T1=1.05	SAT TT=5.148 T1=5.14	SAT TT=0.509 T1=0.5	SAT TT=1.889 T1=1.88	SAT TT=2.881 T1=1.58	SAT TT=2.288 T1=1.22	SAT TT=0.794 T1=0.49	SAT TT=0.062 T1=0.05	SAT TT=0.059 T1=0.05	SAT TT=0.064 T1=0.05	SAT TT=0.063 T1=0.05	SAT TT=0.743 T1=0.74
Bench name	Best results	borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12bt.opb	SAT TT=0.035 T1=0.03	SAT TT=13.579 T1=38.1	SAT TT=100.969 T1=100.96	SAT TT=0.035 T1=0.03	SAT TT=168.89 T1=168.88	SAT TT=692.242 T1=692.22	SAT TT=38.591 T1=38.59	SAT TT=108.81 T1=108.8	? (TO) TT=1800.28	SAT TT=21.598 T1=10.27	SAT TT=9.853 T1=9.07	SAT TT=201.278 T1=201.26	SAT TT=225.885 T1=225.86	SAT TT=202.249 T1=202.23	SAT TT=223.033 T1=223.01	SAT TT=5.806 T1=5.8
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12ls.opb	SAT TT=0.694 T1=0.69	SAT TT=12.509 T1=36.63	? TT=1798	SAT TT=0.694 T1=0.69	SAT TT=151.413 T1=151.4	SAT TT=779.741 T1=779.78	SAT TT=244.592 T1=244.58	SAT TT=510.269 T1=510.25	SAT TT=34.086 T1=32.41	SAT TT=65.435 T1=32.93	SAT TT=167.72 T1=166.98	SAT TT=29.459 T1=29.45	SAT TT=29.808 T1=29.8	SAT TT=29.54 T1=29.53	SAT TT=29.833 T1=29.82	SAT TT=60.076 T1=60.07

Statistics		borg pb-dec-11.04.03 (complete)	bsolo 3.2 (complete)	clasp 2.0-R4191 (complete)	MinisatID 2.4.8 [DEPRECATED] (complete)	MinisatID 2.4.8-gmp [DEPRECATED] (complete)	MinisatID 2.5.2 (fixed) (complete)	MinisatID 2.5.2-gmp (fixed) (complete)	Sat4j CuttingPlanes 2.3.0 (complete)	Sat4j Res//CP 2.3.0 (complete)	Sat4j Resolution 2.3.0 (complete)	SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx 2 2011-06-10 (fixed) (complete)	SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)	SCIP spx E_2 2011-06-10 (fixed) (complete)	wbo 1.6 (complete)
Number of times the solver is able to give the best known answer		109	106	111	0	0	106	106	42	108	107	107	107	107	107	106
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		1	1	33	0	0	5	0	0	0	0	2	53	4	14	2