PB'06 evaluation: results by benchmark

Results by benchmark for category no optimisation, small integers (SATUNSAT-SMALLINT), subcategory Handmade, subsubcategory Queens Problems

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers (SATUNSAT-SMALLINT), subcategory Handmade, subsubcategory Queens Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
absconPseudo 1
bsolo 2006/05
glpPB 0.2
minisat+ 1.14
PBS 4.1L
PB-smodels 1.28
PB-smodels 1.31
Pueblo 1.3
Pueblo 1.4
SAT4JPSEUDO 2006.2
SAT4JPSEUDO 2006.2 Heuristics
wildcat-rnp 0.8.0
wildcat-skc 0.8.0

Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966483.opb	UNSAT TT=0.057	UNSAT TT=14.16	UNSAT TT=39.23	UNSAT TT=0.057	UNSAT TT=263.893	UNSAT TT=14.969	UNSAT TT=28.856	UNSAT TT=2.393	UNSAT TT=5.641	UNSAT TT=30.367	UNSAT TT=11.425	UNSAT TT=12.336	? (TO) TT=1800.76	? (TO) TT=1800.75
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966688.opb	UNSAT TT=0.091	UNSAT TT=18.367	UNSAT TT=61.376	UNSAT TT=0.091	UNSAT TT=252.398	UNSAT TT=15.257	UNSAT TT=45.976	UNSAT TT=3.665	UNSAT TT=6.381	UNSAT TT=7.994	? (TO) TT=1800.57	? (TO) TT=1800.28	? (TO) TT=1800.71	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967142.opb	UNSAT TT=1.945	UNSAT TT=28.354	UNSAT TT=148.429	UNSAT TT=1.945	UNSAT TT=506.77	UNSAT TT=51.59	UNSAT TT=51.931	UNSAT TT=5.16	UNSAT TT=14.017	UNSAT TT=4.005	? (TO) TT=1800.56	? (TO) TT=1800.92	? (TO) TT=1800.76	? (TO) TT=1800.6
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967327.opb	SAT TT=0.187 T1=0.19	SAT TT=14.743 T1=14.16	SAT TT=21.401 T1=21.41	SAT TT=0.592 T1=0.59	SAT TT=59.802 T1=59.82	SAT TT=12.452 T1=12.45	SAT TT=4.591 T1=4.58	SAT TT=0.492 T1=0.48	SAT TT=7.259 T1=7.26	SAT TT=2.867 T1=2.86	? (TO) TT=1800.15	? (TO) TT=1800.53	SAT TT=0.187 T1=0.19	SAT TT=0.961 T1=0.96
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967523.opb	UNSAT TT=1.005	UNSAT TT=19.208	UNSAT TT=101.304	UNSAT TT=1.005	UNSAT TT=394.351	UNSAT TT=33.687	UNSAT TT=51.614	UNSAT TT=4.46	UNSAT TT=7.183	UNSAT TT=24.437	? (TO) TT=1800.64	? (TO) TT=1800.67	? (TO) TT=1800.59	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967729.opb	UNSAT TT=0.059	UNSAT TT=16.765	UNSAT TT=35.472	UNSAT TT=0.059	UNSAT TT=310.685	UNSAT TT=10.717	UNSAT TT=28.473	UNSAT TT=2.701	UNSAT TT=5.193	UNSAT TT=60.506	UNSAT TT=13.746	UNSAT TT=13.74	? (TO) TT=1800.57	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968094.opb	UNSAT TT=0.102	UNSAT TT=15.454	UNSAT TT=53.078	UNSAT TT=0.102	UNSAT TT=399.569	UNSAT TT=16.249	UNSAT TT=50.297	UNSAT TT=3.287	UNSAT TT=5.752	UNSAT TT=6.175	? (TO) TT=1801.47	? (TO) TT=1801.05	? (TO) TT=1800.63	? (TO) TT=1800.67
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968431.opb	SAT TT=0.014 T1=0.01	SAT TT=13.171 T1=12.46	SAT TT=18.959 T1=18.96	SAT TT=0.271 T1=0.27	SAT TT=78.424 T1=78.45	SAT TT=4.124 T1=4.12	SAT TT=11.341 T1=11.33	SAT TT=2.423 T1=2.42	SAT TT=2.674 T1=2.67	SAT TT=47.348 T1=47.36	SAT TT=89.16 T1=87.46	SAT TT=93.477 T1=91.64	SAT TT=0.014 T1=0.01	SAT TT=0.03 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968561.opb	UNSAT TT=0.56	UNSAT TT=21.767	UNSAT TT=59.184	UNSAT TT=0.56	UNSAT TT=279.486	UNSAT TT=33.969	UNSAT TT=47.544	UNSAT TT=3.212	UNSAT TT=8.974	UNSAT TT=31.479	? (TO) TT=1800.89	? (TO) TT=1800.93	? (TO) TT=1800.55	? (TO) TT=1800.63
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968898.opb	UNSAT TT=0.067	UNSAT TT=14.991	UNSAT TT=79.295	UNSAT TT=0.067	UNSAT TT=201.157	UNSAT TT=22.981	UNSAT TT=48.992	UNSAT TT=3.692	UNSAT TT=5.976	UNSAT TT=8.111	? (TO) TT=1800.93	? (TO) TT=1800.3	? (TO) TT=1800.55	? (TO) TT=1800.19
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969170.opb	UNSAT TT=0.016	UNSAT TT=18.524	UNSAT TT=42.899	UNSAT TT=0.016	UNSAT TT=363.648	UNSAT TT=18.716	UNSAT TT=47.144	UNSAT TT=4.368	UNSAT TT=5.698	UNSAT TT=14.006	? (TO) TT=1800.2	? (TO) TT=1800.79	? (TO) TT=1800.57	? (TO) TT=1800.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969577.opb	UNSAT TT=0.013	UNSAT TT=17.769	UNSAT TT=59.919	UNSAT TT=0.013	UNSAT TT=304.877	UNSAT TT=14.985	UNSAT TT=48.296	UNSAT TT=3.3	UNSAT TT=7.636	UNSAT TT=47.109	? (TO) TT=1800.46	? (TO) TT=1800.77	? (TO) TT=1800.65	? (TO) TT=1800.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969860.opb	UNSAT TT=0.798	UNSAT TT=31.883	UNSAT TT=98.976	UNSAT TT=0.798	UNSAT TT=529.529	UNSAT TT=30.773	UNSAT TT=49.346	UNSAT TT=4.809	UNSAT TT=9.346	UNSAT TT=1.455	? (TO) TT=1800.65	? (TO) TT=1800.49	? (TO) TT=1800.62	? (TO) TT=1800.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969933.opb	SAT TT=0.011 T1=0.01	SAT TT=15.817 T1=15.09	SAT TT=30.276 T1=30.28	SAT TT=0.402 T1=0.4	SAT TT=33.317 T1=33.33	SAT TT=2.658 T1=2.66	SAT TT=0.327 T1=0.33	SAT TT=2.435 T1=2.42	SAT TT=1.868 T1=1.86	SAT TT=21.868 T1=21.87	SAT TT=464.792 T1=462.9	SAT TT=482.199 T1=480.21	SAT TT=0.019 T1=0.01	SAT TT=0.011 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970170.opb	SAT TT=0.047 T1=0.05	SAT TT=23.501 T1=22.89	SAT TT=79.146 T1=79.22	SAT TT=0.509 T1=0.51	SAT TT=73.809 T1=73.83	SAT TT=12.952 T1=12.95	SAT TT=12.545 T1=12.54	SAT TT=4.2 T1=4.18	SAT TT=2.652 T1=2.65	SAT TT=10.939 T1=11	? (TO) TT=1801.02	? (TO) TT=1800.48	SAT TT=0.047 T1=0.05	SAT TT=0.079 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970277.opb	SAT TT=0.009 T1=0.01	SAT TT=6.63 T1=5.85	SAT TT=10.281 T1=10.3	SAT TT=0.458 T1=0.46	SAT TT=54.779 T1=54.79	SAT TT=15.48 T1=15.48	SAT TT=25.929 T1=25.98	SAT TT=1.864 T1=1.85	SAT TT=1.018 T1=1.02	SAT TT=4.881 T1=4.88	? (TO) TT=1800.63	? (TO) TT=1800.5	SAT TT=0.009 T1=0.01	SAT TT=0.013 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970444.opb	UNSAT TT=0.062	UNSAT TT=20.324	UNSAT TT=30.859	UNSAT TT=0.062	UNSAT TT=729.707	UNSAT TT=15.065	UNSAT TT=46.136	UNSAT TT=3.161	UNSAT TT=7.793	UNSAT TT=4.232	? (TO) TT=1800.2	? (TO) TT=1800.97	? (TO) TT=1800.72	? (TO) TT=1800.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970631.opb	UNSAT TT=0.068	UNSAT TT=15.345	UNSAT TT=60.124	UNSAT TT=0.068	UNSAT TT=318.483	UNSAT TT=20.43	UNSAT TT=29.919	UNSAT TT=2.969	UNSAT TT=6.361	UNSAT TT=46.583	? (TO) TT=1800.19	? (TO) TT=1800.19	? (TO) TT=1800.67	? (TO) TT=1800.77
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971097.opb	SAT TT=0.127 T1=0.12	SAT TT=23.508 T1=22.85	SAT TT=52.122 T1=52.13	SAT TT=0.282 T1=0.28	SAT TT=190.665 T1=190.77	SAT TT=40.987 T1=40.99	SAT TT=4.857 T1=4.85	SAT TT=4.378 T1=4.37	SAT TT=7.855 T1=7.85	SAT TT=2.077 T1=2.07	? (TO) TT=1800.96	? (TO) TT=1800.4	SAT TT=0.127 T1=0.12	SAT TT=0.187 T1=0.18
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971363.opb	UNSAT TT=0.087	UNSAT TT=22.904	UNSAT TT=50.792	UNSAT TT=0.087	UNSAT TT=198.113	UNSAT TT=19.574	UNSAT TT=50.969	UNSAT TT=3.772	UNSAT TT=8.868	UNSAT TT=3.522	? (TO) TT=1800.68	? (TO) TT=1800.32	? (TO) TT=1800.71	? (TO) TT=1800.56
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971697.opb	UNSAT TT=0.246	UNSAT TT=20.068	UNSAT TT=54.794	UNSAT TT=0.246	UNSAT TT=302.443	UNSAT TT=18.711	UNSAT TT=50.375	UNSAT TT=3.626	UNSAT TT=9.188	UNSAT TT=21.755	? (TO) TT=1800.83	? (TO) TT=1800.99	? (TO) TT=1800.57	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971766.opb	SAT TT=0.03 T1=0.02	SAT TT=11.813 T1=11.22	SAT TT=79.265 T1=79.28	SAT TT=1.185 T1=1.18	SAT TT=53.41 T1=53.42	SAT TT=4.382 T1=4.38	SAT TT=5.707 T1=5.73	SAT TT=0.426 T1=0.42	SAT TT=2.618 T1=2.62	SAT TT=4.112 T1=4.11	? (TO) TT=1800.95	? (TO) TT=1800.92	SAT TT=0.03 T1=0.02	SAT TT=0.144 T1=0.14
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972154.opb	UNSAT TT=0.178	UNSAT TT=20.472	UNSAT TT=113.573	UNSAT TT=0.178	UNSAT TT=431.141	UNSAT TT=34.393	UNSAT TT=47.525	UNSAT TT=4.015	UNSAT TT=9.493	UNSAT TT=19.911	? (TO) TT=1800.6	? (TO) TT=1800.88	? (TO) TT=1800.7	? (TO) TT=1800.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972763.opb	UNSAT TT=0.181	UNSAT TT=26.255	UNSAT TT=71.663	UNSAT TT=0.181	UNSAT TT=562.437	UNSAT TT=23.588	UNSAT TT=49.849	UNSAT TT=3.637	UNSAT TT=8.828	UNSAT TT=3.057	? (TO) TT=1801.01	? (TO) TT=1800.23	? (TO) TT=1800.56	? (TO) TT=1800.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972958.opb	SAT TT=0.013 T1=0.01	SAT TT=21.771 T1=21.11	SAT TT=4.008 T1=4.01	SAT TT=0.149 T1=0.15	SAT TT=64.657 T1=64.67	SAT TT=2.891 T1=2.89	SAT TT=0.73 T1=0.72	SAT TT=1.43 T1=1.42	SAT TT=4.325 T1=4.33	SAT TT=3.086 T1=3.09	? (TO) TT=1800.74	? (TO) TT=1800.6	SAT TT=0.114 T1=0.11	SAT TT=0.013 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973163.opb	UNSAT TT=0.055	UNSAT TT=17.186	UNSAT TT=118.026	UNSAT TT=0.055	UNSAT TT=492.48	UNSAT TT=40.942	UNSAT TT=48.173	UNSAT TT=4.256	UNSAT TT=10.153	UNSAT TT=8.249	? (TO) TT=1800.47	? (TO) TT=1800.91	? (TO) TT=1800.35	? (TO) TT=1800.31
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973364.opb	UNSAT TT=0.264	UNSAT TT=27.383	UNSAT TT=38.614	UNSAT TT=0.264	UNSAT TT=233.835	UNSAT TT=21.766	UNSAT TT=44.782	UNSAT TT=3.706	UNSAT TT=3.962	UNSAT TT=12.891	? (TO) TT=1800.48	? (TO) TT=1800.38	? (TO) TT=1800.63	? (TO) TT=1800.5
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973478.opb	SAT TT=0.025 T1=0.02	SAT TT=15.129 T1=14.5	SAT TT=15.6 T1=15.67	SAT TT=0.195 T1=0.19	SAT TT=34.251 T1=34.26	SAT TT=13.77 T1=13.77	SAT TT=2.54 T1=2.56	SAT TT=1.256 T1=1.25	SAT TT=2.937 T1=2.94	SAT TT=15.815 T1=15.81	? (TO) TT=1800.86	? (TO) TT=1800.77	SAT TT=0.025 T1=0.02	SAT TT=0.259 T1=0.26
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973670.opb	UNSAT TT=0.386	UNSAT TT=15.036	UNSAT TT=64.381	UNSAT TT=0.386	UNSAT TT=502.19	UNSAT TT=26.694	UNSAT TT=46.021	UNSAT TT=3.128	UNSAT TT=7.897	UNSAT TT=10.78	? (TO) TT=1801	? (TO) TT=1800.4	? (TO) TT=1800.65	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973863.opb	SAT TT=0.015 T1=0.01	SAT TT=14.988 T1=14.35	SAT TT=133.378 T1=133.39	SAT TT=0.29 T1=0.29	SAT TT=134.545 T1=134.58	SAT TT=26.167 T1=26.17	SAT TT=13.614 T1=13.71	SAT TT=2.986 T1=2.97	SAT TT=7.609 T1=7.61	SAT TT=2.083 T1=2.08	? (TO) TT=1800.41	? (TO) TT=1800.46	SAT TT=0.039 T1=0.04	SAT TT=0.015 T1=0.01
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974180.opb	UNSAT TT=0.245	UNSAT TT=22.293	UNSAT TT=104.53	UNSAT TT=0.245	UNSAT TT=442.197	UNSAT TT=28.494	UNSAT TT=47.532	UNSAT TT=4.261	UNSAT TT=9.564	UNSAT TT=6.533	? (TO) TT=1800.84	? (TO) TT=1800.57	? (TO) TT=1800.74	? (TO) TT=1800.45
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974372.opb	UNSAT TT=0.013	UNSAT TT=20.186	UNSAT TT=38.444	UNSAT TT=0.013	UNSAT TT=349.48	UNSAT TT=17.006	UNSAT TT=45.285	UNSAT TT=3.633	UNSAT TT=5.922	UNSAT TT=8.878	UNSAT TT=9.188	UNSAT TT=8.925	? (TO) TT=1800.51	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974553.opb	SAT TT=0.028 T1=0.03	SAT TT=11.757 T1=11.14	SAT TT=38.446 T1=38.51	SAT TT=1.247 T1=1.24	SAT TT=51.956 T1=51.97	SAT TT=4.61 T1=4.61	SAT TT=6.106 T1=6.09	SAT TT=0.426 T1=0.43	SAT TT=0.336 T1=0.34	SAT TT=2.89 T1=2.89	? (TO) TT=1800.29	? (TO) TT=1800.26	SAT TT=0.028 T1=0.03	SAT TT=0.049 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975607.opb	UNSAT TT=0.086	UNSAT TT=15.806	UNSAT TT=45.428	UNSAT TT=0.086	UNSAT TT=141.029	UNSAT TT=11.763	UNSAT TT=47.996	UNSAT TT=3.248	UNSAT TT=6.313	UNSAT TT=16.353	? (TO) TT=1800.82	? (TO) TT=1800.77	? (TO) TT=1800.52	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975678.opb	SAT TT=0.086 T1=0.08	SAT TT=24.268 T1=23.53	SAT TT=4.483 T1=4.48	SAT TT=0.721 T1=0.73	SAT TT=6.331 T1=6.33	SAT TT=25.007 T1=25.01	SAT TT=3.011 T1=3	SAT TT=1.295 T1=1.29	SAT TT=9.853 T1=9.86	SAT TT=30.885 T1=30.89	? (TO) TT=1800.72	? (TO) TT=1800.36	SAT TT=0.11 T1=0.11	SAT TT=0.086 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975832.opb	SAT TT=0.014 T1=0.01	SAT TT=11.591 T1=10.91	SAT TT=12.253 T1=12.26	SAT TT=0.032 T1=0.03	SAT TT=94.491 T1=94.51	SAT TT=33.335 T1=33.34	SAT TT=6.814 T1=6.8	SAT TT=2.514 T1=2.51	SAT TT=2.009 T1=2.01	SAT TT=1.666 T1=1.66	? (TO) TT=1800.49	? (TO) TT=1800.97	SAT TT=0.142 T1=0.14	SAT TT=0.014 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975965.opb	UNSAT TT=0.943	UNSAT TT=19.98	UNSAT TT=115.211	UNSAT TT=0.943	UNSAT TT=456.219	UNSAT TT=65.424	UNSAT TT=51.385	UNSAT TT=4.828	UNSAT TT=12.944	UNSAT TT=4.572	? (TO) TT=1800.38	? (TO) TT=1801.02	? (TO) TT=1800.63	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976157.opb	UNSAT TT=0.015	UNSAT TT=14.442	UNSAT TT=41.746	UNSAT TT=0.015	UNSAT TT=243.254	UNSAT TT=16.682	UNSAT TT=29.841	UNSAT TT=3.643	UNSAT TT=6.12	UNSAT TT=19.776	? (TO) TT=1800.47	? (TO) TT=1800.38	? (TO) TT=1800.54	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976730.opb	UNSAT TT=0.155	UNSAT TT=26.216	UNSAT TT=100.623	UNSAT TT=0.155	UNSAT TT=226.562	UNSAT TT=39.948	UNSAT TT=52.855	UNSAT TT=4.529	UNSAT TT=10.457	UNSAT TT=13.102	? (TO) TT=1800.51	? (TO) TT=1800.17	? (TO) TT=1800.56	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976735.opb	SAT TT=0.032 T1=0.03	SAT TT=3.554 T1=2.95	SAT TT=13.378 T1=13.38	SAT TT=0.27 T1=0.27	SAT TT=1.177 T1=1.17	SAT TT=0.964 T1=0.96	SAT TT=5.502 T1=5.49	SAT TT=0.459 T1=0.44	SAT TT=1.06 T1=1.06	SAT TT=1.213 T1=1.21	? (TO) TT=1801.01	? (TO) TT=1800.73	SAT TT=0.103 T1=0.1	SAT TT=0.032 T1=0.03
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976935.opb	UNSAT TT=0.015	UNSAT TT=17.463	UNSAT TT=63.695	UNSAT TT=0.015	UNSAT TT=161.817	UNSAT TT=26.02	UNSAT TT=49.043	UNSAT TT=3.704	UNSAT TT=9.297	UNSAT TT=4.109	UNSAT TT=8.475	UNSAT TT=8.209	? (TO) TT=1800.52	? (TO) TT=1800.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977266.opb	SAT TT=0.128 T1=0.13	SAT TT=22.911 T1=22.27	SAT TT=3.133 T1=3.15	SAT TT=0.978 T1=0.98	SAT TT=1.431 T1=1.43	SAT TT=14.774 T1=14.77	SAT TT=5.685 T1=5.68	SAT TT=1.324 T1=1.32	SAT TT=1.973 T1=1.97	SAT TT=1.464 T1=1.46	? (TO) TT=1800.53	? (TO) TT=1800.71	SAT TT=0.346 T1=0.34	SAT TT=0.128 T1=0.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977273.opb	UNSAT TT=0.253	UNSAT TT=17.857	UNSAT TT=60.149	UNSAT TT=0.253	UNSAT TT=328.774	UNSAT TT=22.167	UNSAT TT=46.848	UNSAT TT=4.021	UNSAT TT=8.719	UNSAT TT=8.352	? (TO) TT=1800.82	? (TO) TT=1800.81	? (TO) TT=1800.52	? (TO) TT=1800.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977464.opb	SAT TT=0.084 T1=0.08	SAT TT=7.399 T1=6.81	SAT TT=5.499 T1=5.53	SAT TT=0.324 T1=0.32	SAT TT=29.593 T1=29.6	SAT TT=11.815 T1=11.81	SAT TT=12.067 T1=12.06	SAT TT=0.772 T1=0.77	SAT TT=1.293 T1=1.29	SAT TT=11.836 T1=11.84	SAT TT=1464.15 T1=1460.38	SAT TT=1596.17 T1=1592.3	SAT TT=0.084 T1=0.08	SAT TT=0.317 T1=0.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977780.opb	UNSAT TT=0.013	UNSAT TT=10.915	UNSAT TT=38.868	UNSAT TT=0.013	UNSAT TT=600.238	UNSAT TT=12.514	UNSAT TT=30.584	UNSAT TT=2.784	UNSAT TT=5.932	UNSAT TT=41.343	? (TO) TT=1800.41	? (TO) TT=1800.4	? (TO) TT=1800.7	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978113.opb	UNSAT TT=1.252	UNSAT TT=19.495	UNSAT TT=108.712	UNSAT TT=1.252	UNSAT TT=258.678	UNSAT TT=46.369	UNSAT TT=51.939	UNSAT TT=4.656	UNSAT TT=14.03	Signal TT=32.984	? (TO) TT=1801.04	? (TO) TT=1800.2	? (TO) TT=1800.56	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978334.opb	UNSAT TT=0.09	UNSAT TT=14.459	UNSAT TT=66.568	UNSAT TT=0.09	UNSAT TT=525.535	UNSAT TT=20.863	UNSAT TT=45.515	UNSAT TT=3.424	UNSAT TT=8.536	UNSAT TT=10.999	? (TO) TT=1800.42	? (TO) TT=1800.44	? (TO) TT=1800.63	? (TO) TT=1800.42
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212272.opb	UNSAT TT=0.132	UNSAT TT=24.261	UNSAT TT=65.767	UNSAT TT=0.132	UNSAT TT=244.906	UNSAT TT=39.302	UNSAT TT=49.519	UNSAT TT=4.491	UNSAT TT=9.852	UNSAT TT=15.08	? (TO) TT=1800.85	? (TO) TT=1800.62	? (TO) TT=1800.64	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212476.opb	UNSAT TT=0.366	UNSAT TT=29.857	UNSAT TT=98.392	UNSAT TT=0.366	UNSAT TT=267.668	UNSAT TT=34.357	UNSAT TT=53.491	UNSAT TT=4.913	UNSAT TT=13.207	UNSAT TT=10.048	? (TO) TT=1800.88	? (TO) TT=1800.83	? (TO) TT=1800.74	? (TO) TT=1800.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212923.opb	UNSAT TT=0.475	UNSAT TT=26.092	UNSAT TT=50.818	UNSAT TT=0.475	UNSAT TT=528.288	UNSAT TT=20.816	UNSAT TT=48.846	UNSAT TT=3.776	UNSAT TT=8.301	UNSAT TT=14.945	? (TO) TT=1800.4	? (TO) TT=1800.12	? (TO) TT=1800.7	? (TO) TT=1800.52
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213670.opb	UNSAT TT=0.016	UNSAT TT=17.032	UNSAT TT=40.866	UNSAT TT=0.016	UNSAT TT=244.369	UNSAT TT=19.021	UNSAT TT=46.853	UNSAT TT=3.94	UNSAT TT=5.597	UNSAT TT=15.9	UNSAT TT=8.247	UNSAT TT=7.886	? (TO) TT=1800.56	? (TO) TT=1800.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213868.opb	UNSAT TT=0.498	UNSAT TT=20.939	UNSAT TT=79.177	UNSAT TT=0.498	UNSAT TT=684.107	UNSAT TT=19.83	UNSAT TT=49.176	UNSAT TT=4.29	UNSAT TT=8.946	UNSAT TT=21.357	? (TO) TT=1800.18	? (TO) TT=1800.12	? (TO) TT=1800.61	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216188.opb	SAT TT=0.023 T1=0.02	SAT TT=19.448 T1=18.72	SAT TT=19.424 T1=19.43	SAT TT=0.217 T1=0.21	SAT TT=161.039 T1=161.08	SAT TT=3.605 T1=3.6	SAT TT=5.732 T1=5.73	SAT TT=3.009 T1=3	SAT TT=0.036 T1=0.04	SAT TT=12.217 T1=12.22	? (TO) TT=1800.38	? (TO) TT=1800.7	SAT TT=0.023 T1=0.02	SAT TT=0.043 T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216411.opb	UNSAT TT=0.117	UNSAT TT=22.611	UNSAT TT=62.98	UNSAT TT=0.117	UNSAT TT=367.114	UNSAT TT=25.814	UNSAT TT=46.491	UNSAT TT=4.478	UNSAT TT=9.456	UNSAT TT=14.849	? (TO) TT=1800.71	? (TO) TT=1800.2	? (TO) TT=1800.05	? (TO) TT=1800.15
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216823.opb	UNSAT TT=0.633	UNSAT TT=24.509	UNSAT TT=47	UNSAT TT=0.633	UNSAT TT=512.956	UNSAT TT=21.493	UNSAT TT=46.628	UNSAT TT=3.899	UNSAT TT=7.356	UNSAT TT=20.393	? (TO) TT=1800.37	? (TO) TT=1800.95	? (TO) TT=1800.31	? (TO) TT=1800.43
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216864.opb	SAT TT=0.045 T1=0.04	SAT TT=11.514 T1=10.84	SAT TT=23.578 T1=23.58	SAT TT=0.299 T1=0.3	SAT TT=49.85 T1=49.86	SAT TT=6.622 T1=6.62	SAT TT=5.492 T1=5.48	SAT TT=2.627 T1=2.62	SAT TT=2.041 T1=2.04	SAT TT=19.383 T1=19.39	SAT TT=724.203 T1=720.46	SAT TT=839.613 T1=836.28	SAT TT=0.045 T1=0.04	SAT TT=0.062 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217374.opb	SAT TT=0.016 T1=0.02	SAT TT=3.465 T1=2.77	SAT TT=0.162 T1=0.17	SAT TT=0.506 T1=0.51	SAT TT=5.051 T1=5.05	SAT TT=11.566 T1=11.57	SAT TT=0.644 T1=0.63	SAT TT=0.229 T1=0.22	SAT TT=1.762 T1=1.76	SAT TT=0.714 T1=0.71	SAT TT=8.929 T1=7.48	SAT TT=8.909 T1=7.53	SAT TT=0.051 T1=0.05	SAT TT=0.016 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217380.opb	SAT TT=0.078 T1=0.07	SAT TT=15.208 T1=14.48	SAT TT=36.581 T1=36.58	SAT TT=0.238 T1=0.24	SAT TT=15.409 T1=15.41	SAT TT=8.504 T1=8.5	SAT TT=2.378 T1=2.42	SAT TT=2.232 T1=2.22	SAT TT=0.465 T1=0.46	SAT TT=3.082 T1=3.08	? (TO) TT=1800.95	? (TO) TT=1800.35	SAT TT=0.11 T1=0.11	SAT TT=0.078 T1=0.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217392.opb	UNSAT TT=0.231	UNSAT TT=15.67	UNSAT TT=55.591	UNSAT TT=0.231	UNSAT TT=212.804	UNSAT TT=19.087	UNSAT TT=46.09	UNSAT TT=3.52	UNSAT TT=8.504	UNSAT TT=24.346	? (TO) TT=1800.17	? (TO) TT=1801.04	? (TO) TT=1800.7	? (TO) TT=1800.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217555.opb	UNSAT TT=0.458	UNSAT TT=17.567	UNSAT TT=105.713	UNSAT TT=0.458	UNSAT TT=300.005	UNSAT TT=32.367	UNSAT TT=50.188	UNSAT TT=3.967	UNSAT TT=9.168	UNSAT TT=38.181	? (TO) TT=1800.26	? (TO) TT=1800.5	? (TO) TT=1800.7	? (TO) TT=1800.6
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218024.opb	UNSAT TT=0.015	UNSAT TT=19.158	UNSAT TT=81.199	UNSAT TT=0.015	UNSAT TT=288.651	UNSAT TT=26.67	UNSAT TT=49.318	UNSAT TT=4.205	UNSAT TT=6.061	UNSAT TT=24.845	? (TO) TT=1800.68	? (TO) TT=1801.12	? (TO) TT=1800.53	? (TO) TT=1800.46
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218308.opb	UNSAT TT=0.763	UNSAT TT=28.586	UNSAT TT=174.195	UNSAT TT=0.763	UNSAT TT=515.096	UNSAT TT=85.156	UNSAT TT=50.163	UNSAT TT=4.851	UNSAT TT=13.377	UNSAT TT=4.76	? (TO) TT=1800.66	? (TO) TT=1800.16	? (TO) TT=1800.7	? (TO) TT=1800.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218757.opb	UNSAT TT=0.038	UNSAT TT=18.603	UNSAT TT=78.34	UNSAT TT=0.038	UNSAT TT=329.235	UNSAT TT=30.09	UNSAT TT=46.03	UNSAT TT=3.418	UNSAT TT=9.038	UNSAT TT=29.595	? (TO) TT=1800.35	? (TO) TT=1800.94	? (TO) TT=1800.61	? (TO) TT=1800.48
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218955.opb	UNSAT TT=0.111	UNSAT TT=24.177	UNSAT TT=33.43	UNSAT TT=0.111	UNSAT TT=627.133	UNSAT TT=18.409	UNSAT TT=47.434	UNSAT TT=4.286	UNSAT TT=6.134	UNSAT TT=22.866	UNSAT TT=129.198	UNSAT TT=130.1	? (TO) TT=1800.66	? (TO) TT=1800.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219348.opb	UNSAT TT=0.694	UNSAT TT=24.302	UNSAT TT=45.978	UNSAT TT=0.694	UNSAT TT=351.14	UNSAT TT=19.541	UNSAT TT=47.13	UNSAT TT=3.489	UNSAT TT=8.269	UNSAT TT=11.345	? (TO) TT=1800.27	? (TO) TT=1800.12	? (TO) TT=1800.71	? (TO) TT=1800.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219399.opb	SAT TT=0.016 T1=0.01	SAT TT=3.045 T1=2.35	SAT TT=5.31 T1=5.32	SAT TT=0.41 T1=0.41	SAT TT=60.798 T1=60.81	SAT TT=3.343 T1=3.34	SAT TT=0.074 T1=0.06	SAT TT=1.902 T1=1.89	SAT TT=0.953 T1=0.95	SAT TT=2.788 T1=2.79	SAT TT=12.321 T1=11.04	SAT TT=12.191 T1=10.92	SAT TT=0.016 T1=0.01	SAT TT=0.031 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219799.opb	UNSAT TT=0.302	UNSAT TT=19.974	UNSAT TT=59.931	UNSAT TT=0.302	UNSAT TT=438.558	UNSAT TT=22.803	UNSAT TT=44.951	UNSAT TT=3.268	UNSAT TT=8.524	UNSAT TT=56.165	? (TO) TT=1800.28	? (TO) TT=1800.44	? (TO) TT=1800.65	? (TO) TT=1800.61
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220019.opb	UNSAT TT=0.095	UNSAT TT=17.402	UNSAT TT=83.248	UNSAT TT=0.095	UNSAT TT=327.085	UNSAT TT=26.655	UNSAT TT=45.267	UNSAT TT=3.218	UNSAT TT=7.677	UNSAT TT=19.972	? (TO) TT=1800.29	? (TO) TT=1800.87	? (TO) TT=1800.79	? (TO) TT=1800.62
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220546.opb	UNSAT TT=0.44	UNSAT TT=21.136	UNSAT TT=76.072	UNSAT TT=0.44	UNSAT TT=308.831	UNSAT TT=20.668	UNSAT TT=45.793	UNSAT TT=3.76	UNSAT TT=6.452	UNSAT TT=37.83	? (TO) TT=1800.85	? (TO) TT=1801.12	? (TO) TT=1800.66	? (TO) TT=1800.55
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220767.opb	UNSAT TT=0.108	UNSAT TT=20.118	UNSAT TT=88.219	UNSAT TT=0.108	UNSAT TT=528.689	UNSAT TT=22.971	UNSAT TT=46.992	UNSAT TT=3.698	UNSAT TT=8.985	UNSAT TT=4.757	? (TO) TT=1800.7	? (TO) TT=1800.57	? (TO) TT=1800.56	? (TO) TT=1800.74
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221203.opb	UNSAT TT=0.356	UNSAT TT=23.778	UNSAT TT=59.011	UNSAT TT=0.356	UNSAT TT=147.24	UNSAT TT=27.285	UNSAT TT=50.22	UNSAT TT=3.857	UNSAT TT=9.586	UNSAT TT=6.185	? (TO) TT=1800.7	? (TO) TT=1800.44	? (TO) TT=1800.68	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221624.opb	UNSAT TT=0.29	UNSAT TT=18.015	UNSAT TT=97.181	UNSAT TT=0.29	UNSAT TT=627.496	UNSAT TT=25.497	UNSAT TT=50.417	UNSAT TT=3.599	UNSAT TT=9.218	UNSAT TT=19.22	? (TO) TT=1800.91	? (TO) TT=1800.19	? (TO) TT=1800.69	? (TO) TT=1800.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221953.opb	SAT TT=0.048 T1=0.05	SAT TT=6.125 T1=5.4	SAT TT=2.076 T1=2.1	SAT TT=0.181 T1=0.18	SAT TT=77.582 T1=77.6	SAT TT=9.72 T1=9.72	SAT TT=17.167 T1=17.2	SAT TT=2.9 T1=2.89	SAT TT=2.523 T1=2.52	SAT TT=36.009 T1=36.02	? (TO) TT=1800.76	? (TO) TT=1800.32	SAT TT=0.096 T1=0.09	SAT TT=0.048 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222080.opb	SAT TT=0.019 T1=0.02	SAT TT=7.763 T1=7	SAT TT=42.831 T1=42.84	SAT TT=0.145 T1=0.14	SAT TT=130.086 T1=130.12	SAT TT=12.418 T1=12.42	SAT TT=7.524 T1=7.56	SAT TT=3.13 T1=3.12	SAT TT=0.745 T1=0.74	SAT TT=8.029 T1=8.03	SAT TT=479.369 T1=477.89	SAT TT=484.99 T1=483.15	SAT TT=0.019 T1=0.02	SAT TT=0.019 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222248.opb	SAT TT=0.015 T1=0.01	SAT TT=3.918 T1=3.41	SAT TT=26.286 T1=26.29	SAT TT=0.769 T1=0.77	SAT TT=5.593 T1=5.59	SAT TT=11.298 T1=11.3	SAT TT=8.826 T1=8.81	SAT TT=4.08 T1=4.07	SAT TT=2.151 T1=2.15	SAT TT=1.455 T1=1.46	SAT TT=48.698 T1=46.9	SAT TT=46.602 T1=44.84	SAT TT=0.03 T1=0.03	SAT TT=0.015 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222257.opb	UNSAT TT=0.243	UNSAT TT=22.714	UNSAT TT=52.865	UNSAT TT=0.243	UNSAT TT=334.535	UNSAT TT=24.362	UNSAT TT=49.329	UNSAT TT=3.542	UNSAT TT=8.695	UNSAT TT=33.535	? (TO) TT=1800.96	? (TO) TT=1800.79	? (TO) TT=1800.6	? (TO) TT=1800.5
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222539.opb	UNSAT TT=0.026	UNSAT TT=21.267	UNSAT TT=49.331	UNSAT TT=0.026	UNSAT TT=505.069	UNSAT TT=19.667	UNSAT TT=48.974	UNSAT TT=3.862	UNSAT TT=8.425	UNSAT TT=18.916	? (TO) TT=1800.08	? (TO) TT=1800.14	? (TO) TT=1800.48	? (TO) TT=1800.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223004.opb	UNSAT TT=2.095	UNSAT TT=24.53	UNSAT TT=81.584	UNSAT TT=2.095	UNSAT TT=530.254	UNSAT TT=25.505	UNSAT TT=50.513	UNSAT TT=3.508	UNSAT TT=9.781	UNSAT TT=39.101	? (TO) TT=1800.58	? (TO) TT=1800.56	? (TO) TT=1800.52	? (TO) TT=1800.55
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223220.opb	UNSAT TT=0.087	UNSAT TT=20.242	UNSAT TT=70.324	UNSAT TT=0.087	UNSAT TT=560.479	UNSAT TT=34.725	UNSAT TT=46.127	UNSAT TT=4.22	UNSAT TT=9.67	UNSAT TT=23.158	? (TO) TT=1801.04	? (TO) TT=1801.06	? (TO) TT=1800.69	? (TO) TT=1800.57
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223416.opb	SAT TT=0.062 T1=0.06	SAT TT=11.336 T1=10.68	SAT TT=10.222 T1=10.22	SAT TT=0.12 T1=0.12	SAT TT=215.23 T1=215.29	SAT TT=7.648 T1=7.65	SAT TT=6.039 T1=6.03	SAT TT=2.685 T1=2.7	SAT TT=2.458 T1=2.45	SAT TT=13.06 T1=13.06	SAT TT=19.327 T1=17.76	SAT TT=19.134 T1=17.61	SAT TT=0.062 T1=0.06	SAT TT=0.071 T1=0.07
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223596.opb	SAT TT=0.039 T1=0.04	SAT TT=3.015 T1=2.31	SAT TT=63.225 T1=63.23	SAT TT=0.659 T1=0.65	SAT TT=69.322 T1=69.35	SAT TT=23.339 T1=23.34	SAT TT=36.338 T1=36.34	SAT TT=0.729 T1=0.72	SAT TT=2.152 T1=2.15	SAT TT=7.527 T1=7.53	? (TO) TT=1800.5	? (TO) TT=1800.45	SAT TT=0.039 T1=0.04	SAT TT=0.042 T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223689.opb	SAT TT=0.013 T1=0.01	SAT TT=4.234 T1=3.65	SAT TT=3.681 T1=3.7	SAT TT=0.566 T1=0.57	SAT TT=3.614 T1=3.61	SAT TT=0.141 T1=0.14	SAT TT=4.747 T1=4.74	SAT TT=0.988 T1=0.98	SAT TT=1.584 T1=1.58	SAT TT=0.331 T1=0.33	SAT TT=6.055 T1=4.8	SAT TT=6.47 T1=5.08	SAT TT=0.03 T1=0.02	SAT TT=0.013 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223696.opb	SAT TT=0.015 T1=0.01	SAT TT=16.234 T1=15.58	SAT TT=11.655 T1=11.67	SAT TT=0.092 T1=0.09	SAT TT=178.586 T1=178.63	SAT TT=20.59 T1=20.59	SAT TT=3.581 T1=3.56	SAT TT=2.154 T1=2.14	SAT TT=2.869 T1=2.87	SAT TT=11.593 T1=11.59	? (TO) TT=1800.46	? (TO) TT=1800.34	SAT TT=0.015 T1=0.01	SAT TT=0.083 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224059.opb	UNSAT TT=0.018	UNSAT TT=14.211	UNSAT TT=42.256	UNSAT TT=0.018	UNSAT TT=230.872	UNSAT TT=11.992	UNSAT TT=29.202	UNSAT TT=2.898	UNSAT TT=2.588	UNSAT TT=31.571	? (TO) TT=1800.43	? (TO) TT=1800.34	? (TO) TT=1800.6	? (TO) TT=1800.42
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224255.opb	UNSAT TT=0.585	UNSAT TT=19.314	UNSAT TT=65.827	UNSAT TT=0.585	UNSAT TT=423.239	UNSAT TT=20.265	UNSAT TT=47.05	UNSAT TT=3.33	UNSAT TT=9.064	UNSAT TT=34.4	? (TO) TT=1800.68	? (TO) TT=1800.74	? (TO) TT=1800.68	? (TO) TT=1800.44
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224451.opb	UNSAT TT=0.161	UNSAT TT=18.288	UNSAT TT=59.73	UNSAT TT=0.161	UNSAT TT=309.637	UNSAT TT=20.93	UNSAT TT=30.96	UNSAT TT=2.939	UNSAT TT=8.779	UNSAT TT=48.799	? (TO) TT=1800.95	? (TO) TT=1800.89	? (TO) TT=1800.74	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224522.opb	SAT TT=0.03 T1=0.03	SAT TT=12.98 T1=12.34	SAT TT=0.291 T1=0.3	SAT TT=0.181 T1=0.18	SAT TT=28.408 T1=28.41	SAT TT=10.718 T1=10.72	SAT TT=14.742 T1=14.76	SAT TT=2.759 T1=2.75	SAT TT=3.222 T1=3.22	SAT TT=21.549 T1=21.55	SAT TT=274.591 T1=273.08	SAT TT=274.955 T1=273.31	SAT TT=0.03 T1=0.03	SAT TT=0.291 T1=0.29
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224929.opb	UNSAT TT=0.045	UNSAT TT=21.613	UNSAT TT=52.165	UNSAT TT=0.045	UNSAT TT=275.256	UNSAT TT=18.601	UNSAT TT=46.2	UNSAT TT=3.69	UNSAT TT=5.872	UNSAT TT=11.991	? (TO) TT=1801.04	? (TO) TT=1801.07	? (TO) TT=1800.2	? (TO) TT=1800.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225122.opb	UNSAT TT=0.183	UNSAT TT=20.456	UNSAT TT=57.844	UNSAT TT=0.183	UNSAT TT=453.118	UNSAT TT=23.269	UNSAT TT=44.26	UNSAT TT=3.291	UNSAT TT=5.7	UNSAT TT=17.655	? (TO) TT=1800.45	? (TO) TT=1801.06	? (TO) TT=1800.54	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225605.opb	UNSAT TT=0.607	UNSAT TT=21.027	UNSAT TT=62.677	UNSAT TT=0.607	UNSAT TT=363.1	UNSAT TT=21.691	UNSAT TT=48.745	UNSAT TT=3.478	UNSAT TT=8.708	UNSAT TT=21.508	? (TO) TT=1801.12	? (TO) TT=1800.99	? (TO) TT=1800.67	? (TO) TT=1800.66
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226062.opb	UNSAT TT=0.458	UNSAT TT=19.001	UNSAT TT=45.081	UNSAT TT=0.458	UNSAT TT=487.759	UNSAT TT=21.193	UNSAT TT=46.007	UNSAT TT=3.205	UNSAT TT=8.04	UNSAT TT=2.923	? (TO) TT=1800.9	? (TO) TT=1800.54	? (TO) TT=1800.68	? (TO) TT=1800.67
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226241.opb	SAT TT=0.036 T1=0.03	SAT TT=10.395 T1=9.72	SAT TT=10.454 T1=10.46	SAT TT=0.058 T1=0.06	SAT TT=25.492 T1=25.49	SAT TT=16.831 T1=16.83	SAT TT=0.201 T1=0.21	SAT TT=1.066 T1=1.05	SAT TT=2.899 T1=2.9	SAT TT=5.082 T1=5.08	? (TO) TT=1800.45	? (TO) TT=1800.14	SAT TT=0.048 T1=0.05	SAT TT=0.036 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226284.opb	SAT TT=0.017 T1=0.02	SAT TT=11.613 T1=10.72	SAT TT=33.896 T1=33.93	SAT TT=0.207 T1=0.21	SAT TT=134.437 T1=134.47	SAT TT=21.69 T1=21.69	SAT TT=1.637 T1=1.63	SAT TT=0.665 T1=0.65	SAT TT=1.309 T1=1.31	SAT TT=3.905 T1=3.9	SAT TT=51.258 T1=49.53	SAT TT=50.919 T1=49.17	SAT TT=0.017 T1=0.02	SAT TT=0.032 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226368.opb	UNSAT TT=0.077	UNSAT TT=20.741	UNSAT TT=57.036	UNSAT TT=0.077	UNSAT TT=232.943	UNSAT TT=14.464	UNSAT TT=28.595	UNSAT TT=3.236	UNSAT TT=5.761	UNSAT TT=15.293	? (TO) TT=1800.94	? (TO) TT=1800.68	? (TO) TT=1800.57	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226680.opb	UNSAT TT=0.129	UNSAT TT=21.336	UNSAT TT=67.789	UNSAT TT=0.129	UNSAT TT=345.836	UNSAT TT=17.652	UNSAT TT=48.737	UNSAT TT=4.063	UNSAT TT=8.571	UNSAT TT=11.455	? (TO) TT=1800.19	? (TO) TT=1801.12	? (TO) TT=1800.65	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227012.opb	UNSAT TT=0.112	UNSAT TT=26.752	UNSAT TT=83.844	UNSAT TT=0.112	UNSAT TT=342.033	UNSAT TT=24.704	UNSAT TT=47.059	UNSAT TT=3.757	UNSAT TT=8.647	UNSAT TT=0.364	? (TO) TT=1801.04	? (TO) TT=1801.06	? (TO) TT=1800.68	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227326.opb	UNSAT TT=0.151	UNSAT TT=19.656	UNSAT TT=34.86	UNSAT TT=0.151	UNSAT TT=295.871	UNSAT TT=14.461	UNSAT TT=28.936	UNSAT TT=3.277	UNSAT TT=5.956	UNSAT TT=21.051	? (TO) TT=1800.81	? (TO) TT=1800.65	? (TO) TT=1800.67	? (TO) TT=1800.44
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227418.opb	SAT TT=0.245 T1=0.25	SAT TT=21.636 T1=20.94	SAT TT=48.623 T1=48.63	SAT TT=0.389 T1=0.39	SAT TT=283.867 T1=283.96	SAT TT=23.818 T1=23.82	SAT TT=22.724 T1=22.85	SAT TT=1.947 T1=1.94	SAT TT=2.119 T1=2.12	SAT TT=1.395 T1=1.41	? (TO) TT=1800.48	? (TO) TT=1800.26	SAT TT=0.245 T1=0.25	SAT TT=0.402 T1=0.4
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227861.opb	UNSAT TT=0.098	UNSAT TT=16.156	UNSAT TT=70.856	UNSAT TT=0.098	UNSAT TT=316.942	UNSAT TT=32.125	UNSAT TT=48.568	UNSAT TT=3.528	UNSAT TT=7.857	UNSAT TT=41.321	? (TO) TT=1801.08	? (TO) TT=1800.71	? (TO) TT=1800.48	? (TO) TT=1800.44
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111228076.opb	UNSAT TT=0.241	UNSAT TT=24.716	UNSAT TT=96.63	UNSAT TT=0.241	UNSAT TT=390.979	UNSAT TT=45.966	UNSAT TT=46.616	UNSAT TT=4.081	UNSAT TT=9.386	UNSAT TT=44.306	? (TO) TT=1800.17	? (TO) TT=1800.52	? (TO) TT=1800.62	? (TO) TT=1800.57
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14bt.opb	SAT TT=1.466 T1=1.46	SAT TT=40.831 T1=39.75	SAT TT=18.512 T1=18.52	? (TO) TT=1800.56	? (TO) TT=1800.58	SAT TT=92.678 T1=92.7	SAT TT=4.331 T1=4.32	SAT TT=9.747 T1=9.72	SAT TT=23.202 T1=23.2	SAT TT=374.775 T1=374.9	? (TO) TT=1801.08	? (TO) TT=1800.87	SAT TT=1.466 T1=1.46	SAT TT=2.138 T1=2.14
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14ls.opb	SAT TT=0.235 T1=0.23	SAT TT=593.978 T1=593.56	SAT TT=237.792 T1=237.84	? (TO) TT=1800.71	SAT TT=169.308 T1=169.35	SAT TT=2.635 T1=2.63	SAT TT=1.016 T1=1.08	SAT TT=39.829 T1=39.81	SAT TT=28.415 T1=28.42	? (TO) TT=1800.47	SAT TT=1269.53 T1=1258.4	SAT TT=1269.47 T1=1258.34	SAT TT=2.92 T1=2.92	SAT TT=0.235 T1=0.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17bt.opb	SAT TT=4.347 T1=4.35	SAT TT=98.126 T1=97.5	SAT TT=6.968 T1=7	? (TO) TT=1800.66	? (TO) TT=1800.46	SAT TT=31.537 T1=31.54	SAT TT=417.747 T1=417.84	SAT TT=11.904 T1=11.87	? (TO) TT=1800.61	? (TO) TT=1800.64	? (TO) TT=1800.27	? (TO) TT=1801.01	SAT TT=4.347 T1=4.35	SAT TT=68.014 T1=68.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17ls.opb	SAT TT=0.744 T1=0.74	SAT TT=1654.64 T1=1654.49	SAT TT=296.293 T1=296.4	? (TO) TT=1800.72	? (TO) TT=1800.48	SAT TT=29.217 T1=29.22	SAT TT=7.863 T1=7.87	SAT TT=103.715 T1=103.75	? (TO) TT=1800.62	? (TO) TT=1800.59	? (TO) TT=1800.36	? (TO) TT=1800.32	SAT TT=46.596 T1=46.63	SAT TT=0.744 T1=0.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21bt.opb	SAT TT=0.167 T1=0.17	? (TO) TT=1800.34	? TT=1800.01	? (TO) TT=1800.66	? (TO) TT=1800.63	? (TO) TT=1800.69	? (TO) TT=1800.76	? (TO) TT=1800.69	? (TO) TT=1800.7	? (TO) TT=1800.64	? (TO) TT=1800.34	? (TO) TT=1800.44	SAT TT=0.167 T1=0.17	? (TO) TT=1800.53
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21ls.opb	SAT TT=0.456 T1=0.45	? (TO) TT=1800.53	? TT=1800.01	? (TO) TT=1800.67	? (TO) TT=1800.65	? (TO) TT=1800.81	SAT TT=3.425 T1=3.52	? (TO) TT=1800.5	? (TO) TT=1800.62	? (TO) TT=1800.68	? (TO) TT=1800.36	? (TO) TT=1800.45	? (TO) TT=1800.49	SAT TT=0.456 T1=0.45
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24bt.opb	SAT TT=1.787 T1=1.79	? (TO) TT=1800.56	SAT TT=296.744 T1=296.86	? (TO) TT=1800.72	? (TO) TT=1800.46	? (TO) TT=1800.54	? (TO) TT=1800.59	SAT TT=143.018 T1=143.02	? (TO) TT=1800.66	? (TO) TT=1800.68	? (TO) TT=1800.91	? (TO) TT=1801.02	SAT TT=1.787 T1=1.79	SAT TT=7.084 T1=7.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24ls.opb	SAT TT=0.85 T1=0.86	? (TO) TT=1800.41	SAT TT=1244.77 T1=1245.1	? (TO) TT=1800.69	? (TO) TT=1800.54	SAT TT=1320.05 T1=1320.36	SAT TT=282.507 T1=282.61	SAT TT=1054.36 T1=1054.67	? (TO) TT=1800.52	? (TO) TT=1800.56	SAT TT=3.12 T1=2.15	SAT TT=2.966 T1=2.1	SAT TT=0.85 T1=0.86	SAT TT=2.002 T1=2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9bt.opb	SAT TT=0.046 T1=0.04	SAT TT=2.264 T1=1.7	SAT TT=1.47 T1=1.49	? (TO) TT=1800.64	SAT TT=0.208 T1=0.2	SAT TT=0.046 T1=0.04	SAT TT=0.144 T1=0.14	SAT TT=0.119 T1=0.09	SAT TT=1.084 T1=1.08	SAT TT=0.951 T1=0.95	SAT TT=7.627 T1=6.55	SAT TT=7.771 T1=6.68	SAT TT=0.096 T1=0.09	SAT TT=2.744 T1=2.74
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9ls.opb	SAT TT=0.054 T1=0.05	SAT TT=3.801 T1=3.19	SAT TT=0.24 T1=0.27	? (TO) TT=1800.66	SAT TT=0.298 T1=0.3	SAT TT=0.054 T1=0.05	SAT TT=0.877 T1=0.89	SAT TT=0.082 T1=0.06	SAT TT=0.631 T1=0.63	SAT TT=0.969 T1=0.97	SAT TT=4.114 T1=3.16	SAT TT=4.339 T1=3.28	SAT TT=55.957 T1=55.97	SAT TT=1.749 T1=1.75
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12bt.opb	SAT TT=1.233 T1=1.2	SAT TT=85.157 T1=84.51	SAT TT=3.618 T1=3.62	? (TO) TT=1800.7	SAT TT=60.345 T1=60.36	SAT TT=2.024 T1=2.04	SAT TT=58.966 T1=59.03	SAT TT=1.233 T1=1.2	SAT TT=18.726 T1=18.73	SAT TT=13.461 T1=13.46	SAT TT=779.009 T1=772.18	SAT TT=773.086 T1=766.38	SAT TT=2.864 T1=2.86	SAT TT=9.548 T1=9.55
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12ls.opb	SAT TT=0.169 T1=0.17	SAT TT=94.95 T1=94.27	SAT TT=0.209 T1=0.23	? (TO) TT=1800.72	SAT TT=10.711 T1=10.71	SAT TT=6.897 T1=6.89	SAT TT=9.906 T1=9.88	SAT TT=3.656 T1=3.64	SAT TT=11.773 T1=11.77	SAT TT=101.994 T1=102.03	SAT TT=29.386 T1=28.12	SAT TT=29.367 T1=27.36	SAT TT=0.169 T1=0.17	SAT TT=2.083 T1=2.08

Some statistics...

	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
Number of times the solver is able to give the best known answer	108	110	100	105	109	110	110	106	104	24	24	43	43
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	108	110	100	105	109	110	110	106	104	24	24	43	43
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	68	0	2	0	1	0	0	0	0	25	16
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	2	0	1	0	0	0	0	26	19