PB'07 evaluation: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (SATUNSAT-SMALLINT-LIN), subcategory Handmade, subsubcategory Queens Problems

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (SATUNSAT-SMALLINT-LIN), subcategory Handmade, subsubcategory Queens Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
absconPseudo 102
bsolo 3.0.16
bsolo 3.0.17
glpPB 0.2
minisat+ 1.14
oree 0.1.2 alpha
PB-clasp 2007-03-23
PB-clasp 2007-04-10
PBS4 2007-03-23
PBS4_v2 2007-03-23
Pueblo 1.4
sat4jPseudoCP 2007-03-23
sat4jPseudoCPClause 2007-03-23
SAT4JPseudoResolution 2007-03-23
wildcat-rnp 2007-03-21
wildcat-skc 2007-03-21

Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966483.opb	UNSAT TT=0.064	UNSAT TT=17.394	UNSAT TT=26.754	UNSAT TT=26.709	UNSAT TT=0.064	UNSAT TT=268.528	? (TO) TT=1800.23	UNSAT TT=31.951	UNSAT TT=2.514	UNSAT TT=15.496	UNSAT TT=15.428	UNSAT TT=30.334	UNSAT TT=113.278	UNSAT TT=12.69	UNSAT TT=4.648	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966688.opb	UNSAT TT=0.09	UNSAT TT=21.738	UNSAT TT=37.31	UNSAT TT=40.159	UNSAT TT=0.09	UNSAT TT=249.732	? (TO) TT=1800.22	UNSAT TT=44.626	UNSAT TT=4.132	UNSAT TT=16.814	UNSAT TT=16.787	UNSAT TT=7.96	? (TO) TT=1800.21	? (TO) TT=1800.2	UNSAT TT=6.199	? (TO) TT=1800.07	? (TO) TT=1800.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967142.opb	UNSAT TT=1.939	UNSAT TT=37.214	UNSAT TT=95.374	UNSAT TT=94.736	UNSAT TT=1.939	UNSAT TT=507.906	? (TO) TT=1800.14	UNSAT TT=94.109	UNSAT TT=5.516	UNSAT TT=52.079	UNSAT TT=52.052	UNSAT TT=4.002	? (TO) TT=1800.32	? (TO) TT=1800.18	UNSAT TT=23.098	? (TO) TT=1800.08	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967327.opb	SAT TT=0.058 T1=0.01	SAT TT=16.913 T1=16.9	SAT TT=29.449 T1=29.37	SAT TT=29.547 T1=29.48	SAT TT=0.554 T1=0.48	SAT TT=60.412 T1=60.38	? (TO) TT=1800.14	SAT TT=53.598 T1=53.57	SAT TT=1.28 T1=1.17	SAT TT=12.839 T1=12.78	SAT TT=12.76 T1=12.68	SAT TT=2.849 T1=2.81	? (TO) TT=1800.15	? (TO) TT=1800.21	SAT TT=1.951 T1=1.84	SAT TT=0.072 T1=0.03	SAT TT=0.058 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967523.opb	UNSAT TT=1.071	UNSAT TT=23.322	UNSAT TT=58.069	UNSAT TT=58.063	UNSAT TT=1.071	UNSAT TT=393.38	? (TO) TT=1800.22	UNSAT TT=71.309	UNSAT TT=5.849	UNSAT TT=34.23	UNSAT TT=34.092	UNSAT TT=22.834	? (TO) TT=1800.13	? (TO) TT=1800.13	UNSAT TT=15.088	? (TO) TT=1800.06	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967729.opb	UNSAT TT=0.058	UNSAT TT=20.65	UNSAT TT=31.398	UNSAT TT=31.283	UNSAT TT=0.058	UNSAT TT=328.846	? (TO) TT=1800.12	UNSAT TT=38.158	UNSAT TT=1.943	UNSAT TT=11.222	UNSAT TT=11.195	UNSAT TT=60.288	UNSAT TT=22.696	UNSAT TT=12.218	UNSAT TT=6.242	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968094.opb	UNSAT TT=0.106	UNSAT TT=17.244	UNSAT TT=43.554	UNSAT TT=43.355	UNSAT TT=0.106	UNSAT TT=408.786	? (TO) TT=1800.09	UNSAT TT=53.811	UNSAT TT=3.477	UNSAT TT=16.77	UNSAT TT=16.785	UNSAT TT=6.142	? (TO) TT=1800.14	UNSAT TT=816.833	UNSAT TT=7.995	? (TO) TT=1800.11	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968431.opb	SAT TT=0.011 T1=0	SAT TT=14.323 T1=14.28	SAT TT=24.253 T1=24.18	SAT TT=25.767 T1=25.68	SAT TT=0.274 T1=0.19	SAT TT=79.547 T1=79.46	SAT TT=1479.67 T1=1479.64	SAT TT=36.702 T1=36.64	SAT TT=0.206 T1=0	SAT TT=4.343 T1=4.29	SAT TT=4.34 T1=4.3	SAT TT=50.928 T1=50.87	SAT TT=78.774 T1=78.66	SAT TT=5.181 T1=5.13	SAT TT=1.791 T1=1.68	SAT TT=0.011 T1=0	SAT TT=0.045 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968561.opb	UNSAT TT=0.556	UNSAT TT=27.535	UNSAT TT=40.57	UNSAT TT=40.235	UNSAT TT=0.556	UNSAT TT=281.664	? (TO) TT=1800.11	UNSAT TT=59.33	UNSAT TT=4.078	UNSAT TT=34.661	UNSAT TT=34.518	UNSAT TT=29.45	? (TO) TT=1800.15	? (TO) TT=1800.14	UNSAT TT=10.433	? (TO) TT=1800.06	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968898.opb	UNSAT TT=0.066	UNSAT TT=17.845	UNSAT TT=54.686	UNSAT TT=54.823	UNSAT TT=0.066	UNSAT TT=205.519	? (TO) TT=1800.13	UNSAT TT=60.156	UNSAT TT=4.894	UNSAT TT=25.372	UNSAT TT=25.041	UNSAT TT=8.02	? (TO) TT=1800.2	? (TO) TT=1800.19	UNSAT TT=11.266	? (TO) TT=1800.05	? (TO) TT=1800.1
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969170.opb	UNSAT TT=0.017	UNSAT TT=23.199	UNSAT TT=42.266	UNSAT TT=41.914	UNSAT TT=0.017	UNSAT TT=362.458	? (TO) TT=1800.15	UNSAT TT=53.982	UNSAT TT=4.151	UNSAT TT=20.553	UNSAT TT=20.449	UNSAT TT=15.018	UNSAT TT=164.804	UNSAT TT=279.886	UNSAT TT=7.677	? (TO) TT=1800.02	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969577.opb	UNSAT TT=0.014	UNSAT TT=21.705	UNSAT TT=35.243	UNSAT TT=35.162	UNSAT TT=0.014	UNSAT TT=306.967	? (TO) TT=1800.12	UNSAT TT=51.936	UNSAT TT=3.775	UNSAT TT=16.169	UNSAT TT=16.123	UNSAT TT=47.144	? (TO) TT=1800.24	UNSAT TT=518.972	UNSAT TT=8.129	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969860.opb	UNSAT TT=0.803	UNSAT TT=38.771	UNSAT TT=65.947	UNSAT TT=65.775	UNSAT TT=0.803	UNSAT TT=526.977	? (TO) TT=1800.25	UNSAT TT=82.163	UNSAT TT=6.085	UNSAT TT=33.316	UNSAT TT=33.29	UNSAT TT=1.462	? (TO) TT=1800.12	? (TO) TT=1800.21	UNSAT TT=14.139	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969933.opb	SAT TT=0.02 T1=0	SAT TT=19.313 T1=19.21	SAT TT=18.148 T1=18.08	SAT TT=18.414 T1=18.39	SAT TT=0.401 T1=0.39	SAT TT=33.892 T1=33.78	SAT TT=73.461 T1=73.37	SAT TT=14.445 T1=14.38	SAT TT=0.081 T1=0	SAT TT=2.786 T1=2.69	SAT TT=2.803 T1=2.69	SAT TT=23.42 T1=23.38	SAT TT=5.239 T1=5.17	SAT TT=766.992 T1=766.86	SAT TT=3.779 T1=3.7	SAT TT=0.02 T1=0	SAT TT=0.041 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970170.opb	SAT TT=0.079 T1=0	SAT TT=29.121 T1=29.09	SAT TT=33.527 T1=33.47	SAT TT=33.524 T1=33.48	SAT TT=0.512 T1=0.49	SAT TT=70.073 T1=69.97	? (TO) TT=1800.14	SAT TT=16.266 T1=16.18	SAT TT=1.792 T1=1.68	SAT TT=13.244 T1=13.19	SAT TT=13.257 T1=13.19	SAT TT=11.659 T1=11.59	? (TO) TT=1800.15	? (TO) TT=1800.16	SAT TT=8.678 T1=8.64	SAT TT=0.321 T1=0.29	SAT TT=0.079 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970277.opb	SAT TT=0.057 T1=0.01	SAT TT=7.154 T1=7.1	SAT TT=40.74 T1=40.67	SAT TT=40.797 T1=40.77	SAT TT=0.461 T1=0.39	SAT TT=53.96 T1=53.89	SAT TT=1191.7 T1=1191.66	SAT TT=45.467 T1=45.37	SAT TT=3.056 T1=2.97	SAT TT=15.93 T1=15.89	SAT TT=15.888 T1=15.78	SAT TT=5.263 T1=5.19	? (TO) TT=1800.22	SAT TT=1199.98 T1=1199.81	SAT TT=2.766 T1=2.68	SAT TT=0.057 T1=0.01	SAT TT=0.267 T1=0.19
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970444.opb	UNSAT TT=0.064	UNSAT TT=24.585	UNSAT TT=29.686	UNSAT TT=29.682	UNSAT TT=0.064	UNSAT TT=730.927	? (TO) TT=1800.08	UNSAT TT=44.989	UNSAT TT=2.624	UNSAT TT=16.588	UNSAT TT=16.526	UNSAT TT=4.226	? (TO) TT=1800.09	? (TO) TT=1800.18	UNSAT TT=5.984	? (TO) TT=1800.11	? (TO) TT=1800.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970631.opb	UNSAT TT=0.068	UNSAT TT=17.185	UNSAT TT=44.014	UNSAT TT=44.032	UNSAT TT=0.068	UNSAT TT=319.355	? (TO) TT=1800.26	UNSAT TT=46.779	UNSAT TT=2.31	UNSAT TT=21.103	UNSAT TT=19.66	UNSAT TT=46.3	? (TO) TT=1800.13	UNSAT TT=198.354	UNSAT TT=8.789	? (TO) TT=1800.03	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971097.opb	SAT TT=0.082 T1=0	SAT TT=28.814 T1=28.78	SAT TT=12.686 T1=12.59	SAT TT=12.762 T1=12.69	SAT TT=0.286 T1=0.19	SAT TT=201.363 T1=201.34	? (TO) TT=1800.11	SAT TT=56.082 T1=55.97	SAT TT=1.399 T1=1.27	SAT TT=41.46 T1=41.38	SAT TT=41.353 T1=41.28	SAT TT=2.045 T1=1.98	? (TO) TT=1800.26	? (TO) TT=1800.17	SAT TT=7.134 T1=7.11	SAT TT=0.082 T1=0.04	SAT TT=0.101 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971363.opb	UNSAT TT=0.092	UNSAT TT=27.159	UNSAT TT=50.425	UNSAT TT=49.489	UNSAT TT=0.092	UNSAT TT=197.048	? (TO) TT=1800.16	UNSAT TT=53.014	UNSAT TT=4.742	UNSAT TT=20.228	UNSAT TT=20.12	UNSAT TT=3.826	? (TO) TT=1800.16	? (TO) TT=1800.13	UNSAT TT=6.203	? (TO) TT=1800.09	? (TO) TT=1800.1
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971697.opb	UNSAT TT=0.231	UNSAT TT=24.718	UNSAT TT=34.728	UNSAT TT=34.509	UNSAT TT=0.231	UNSAT TT=313.798	? (TO) TT=1800.19	UNSAT TT=50.899	UNSAT TT=4.638	UNSAT TT=19.217	UNSAT TT=17.952	UNSAT TT=23.381	? (TO) TT=1800.14	? (TO) TT=1800.26	UNSAT TT=8.782	? (TO) TT=1800.12	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971766.opb	SAT TT=0.025 T1=0	SAT TT=13.167 T1=13.13	SAT TT=10.189 T1=10.16	SAT TT=10.005 T1=9.98	SAT TT=1.187 T1=1.09	SAT TT=53.538 T1=53.47	? (TO) TT=1800.13	SAT TT=25.531 T1=25.43	SAT TT=1.225 T1=1.18	SAT TT=4.561 T1=4.49	SAT TT=4.82 T1=4.79	SAT TT=4.191 T1=4.17	? (TO) TT=1800.23	? (TO) TT=1800.14	SAT TT=2.024 T1=1.9	SAT TT=0.025 T1=0	SAT TT=0.032 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972154.opb	UNSAT TT=0.169	UNSAT TT=23.307	UNSAT TT=66.535	UNSAT TT=65.73	UNSAT TT=0.169	UNSAT TT=431.516	? (TO) TT=1800.14	UNSAT TT=74.324	UNSAT TT=4.31	UNSAT TT=37.386	UNSAT TT=37.295	UNSAT TT=19.892	? (TO) TT=1800.18	? (TO) TT=1800.18	UNSAT TT=13.366	? (TO) TT=1800.08	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972763.opb	UNSAT TT=0.182	UNSAT TT=32.677	UNSAT TT=46.912	UNSAT TT=48.253	UNSAT TT=0.182	UNSAT TT=552.343	? (TO) TT=1800.14	UNSAT TT=54.865	UNSAT TT=3.122	UNSAT TT=24.07	UNSAT TT=23.895	UNSAT TT=3.064	? (TO) TT=1800.2	? (TO) TT=1800.11	UNSAT TT=8.681	? (TO) TT=1800.08	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972958.opb	SAT TT=0.026 T1=0	SAT TT=27.534 T1=27.43	SAT TT=55.636 T1=55.56	SAT TT=56.128 T1=56.07	SAT TT=0.151 T1=0.09	SAT TT=71.959 T1=71.86	SAT TT=852.004 T1=851.95	SAT TT=40.436 T1=40.35	SAT TT=1.02 T1=0.98	SAT TT=3.023 T1=2.99	SAT TT=3.223 T1=3.19	SAT TT=3.135 T1=3.09	? (TO) TT=1800.15	? (TO) TT=1800.18	SAT TT=16.035 T1=16	SAT TT=0.026 T1=0	SAT TT=0.123 T1=0.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973163.opb	UNSAT TT=0.057	UNSAT TT=19.236	UNSAT TT=63.644	UNSAT TT=63.849	UNSAT TT=0.057	UNSAT TT=483.289	? (TO) TT=1800.1	UNSAT TT=93.038	UNSAT TT=4.719	UNSAT TT=44.515	UNSAT TT=44.266	UNSAT TT=8.253	? (TO) TT=1800.22	? (TO) TT=1800.2	UNSAT TT=15.732	? (TO) TT=1800.05	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973364.opb	UNSAT TT=0.244	UNSAT TT=33.258	UNSAT TT=40.708	UNSAT TT=43.083	UNSAT TT=0.244	UNSAT TT=249.912	? (TO) TT=1800.07	UNSAT TT=42.512	UNSAT TT=2.58	UNSAT TT=22.311	UNSAT TT=22.235	UNSAT TT=12.92	? (TO) TT=1800.23	? (TO) TT=1800.21	UNSAT TT=4.969	? (TO) TT=1800.1	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973478.opb	SAT TT=0.195 T1=0.09	SAT TT=18.571 T1=18.53	SAT TT=39.242 T1=39.18	SAT TT=38.949 T1=38.85	SAT TT=0.195 T1=0.09	SAT TT=36.314 T1=36.29	SAT TT=1618.27 T1=1618.19	SAT TT=6.678 T1=6.58	SAT TT=1.514 T1=1.48	SAT TT=15.181 T1=15.09	SAT TT=15.1 T1=15.08	SAT TT=15.821 T1=15.78	SAT TT=29.455 T1=29.32	? (TO) TT=1800.24	SAT TT=7.379 T1=7.33	SAT TT=0.239 T1=0.19	SAT TT=0.219 T1=0.19
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973670.opb	UNSAT TT=0.383	UNSAT TT=19.266	UNSAT TT=50.224	UNSAT TT=50.932	UNSAT TT=0.383	UNSAT TT=493.744	? (TO) TT=1800.22	UNSAT TT=62.065	UNSAT TT=3.996	UNSAT TT=27.267	UNSAT TT=27.164	UNSAT TT=10.809	? (TO) TT=1800.18	? (TO) TT=1800.21	UNSAT TT=13.061	? (TO) TT=1800.06	? (TO) TT=1800.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973863.opb	SAT TT=0.092 T1=0	SAT TT=17.404 T1=17.31	SAT TT=1.612 T1=1.59	SAT TT=1.614 T1=1.59	SAT TT=0.294 T1=0.19	SAT TT=144.239 T1=144.14	? (TO) TT=1800.06	SAT TT=45.962 T1=45.86	SAT TT=0.704 T1=0	SAT TT=26.749 T1=26.68	SAT TT=26.634 T1=26.59	SAT TT=4.089 T1=1.99	? (TO) TT=1800.21	SAT TT=60.773 T1=60.72	SAT TT=5.924 T1=5.84	SAT TT=0.092 T1=0.06	SAT TT=0.103 T1=0.1
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974180.opb	UNSAT TT=0.242	UNSAT TT=27.027	UNSAT TT=53.328	UNSAT TT=52.864	UNSAT TT=0.242	UNSAT TT=443.126	? (TO) TT=1800.26	UNSAT TT=68.363	UNSAT TT=3.995	UNSAT TT=31.142	UNSAT TT=30.987	UNSAT TT=6.551	? (TO) TT=1800.23	? (TO) TT=1800.21	UNSAT TT=12.808	? (TO) TT=1800.09	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974372.opb	UNSAT TT=0.012	UNSAT TT=26.611	UNSAT TT=43.668	UNSAT TT=40.898	UNSAT TT=0.012	UNSAT TT=355.044	? (TO) TT=1800.17	UNSAT TT=51.265	UNSAT TT=2.211	UNSAT TT=17.658	UNSAT TT=17.582	UNSAT TT=8.231	UNSAT TT=8.271	UNSAT TT=7.183	UNSAT TT=8.289	? (TO) TT=1800.07	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974553.opb	SAT TT=0.015 T1=0	SAT TT=14.017 T1=14	SAT TT=64.313 T1=64.27	SAT TT=64.334 T1=64.24	SAT TT=1.331 T1=1.29	SAT TT=51.01 T1=50.98	SAT TT=4.427 T1=4.39	SAT TT=1.016 T1=0.99	SAT TT=0.171 T1=0	SAT TT=5.127 T1=5.09	SAT TT=4.935 T1=4.88	SAT TT=3.125 T1=3.09	? (TO) TT=1800.15	? (TO) TT=1800.14	SAT TT=0.975 T1=0.85	SAT TT=0.015 T1=0	SAT TT=0.019 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975607.opb	UNSAT TT=0.087	UNSAT TT=18.53	UNSAT TT=29.919	UNSAT TT=30.265	UNSAT TT=0.087	UNSAT TT=139.242	? (TO) TT=1800.03	UNSAT TT=38.018	UNSAT TT=2.261	UNSAT TT=12.251	UNSAT TT=12.173	UNSAT TT=16.409	? (TO) TT=1800.19	UNSAT TT=129.84	UNSAT TT=5.726	? (TO) TT=1800.1	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975678.opb	SAT TT=0.141 T1=0.09	SAT TT=27.937 T1=27.87	SAT TT=36.471 T1=36.38	SAT TT=36.618 T1=36.6	SAT TT=0.774 T1=0.69	SAT TT=6.393 T1=6.29	SAT TT=1326.26 T1=1326.22	SAT TT=83.057 T1=82.95	SAT TT=3.34 T1=3.29	SAT TT=25.638 T1=25.59	SAT TT=25.588 T1=25.49	SAT TT=29.248 T1=29.17	? (TO) TT=1800.21	? (TO) TT=1800.15	SAT TT=13.52 T1=13.48	SAT TT=0.141 T1=0.09	SAT TT=1.335 T1=1.29
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975832.opb	SAT TT=0.029 T1=0	SAT TT=13.769 T1=13.73	SAT TT=4.862 T1=4.79	SAT TT=4.847 T1=4.79	SAT TT=0.029 T1=0	SAT TT=95.607 T1=95.56	SAT TT=10.736 T1=10.69	SAT TT=12.539 T1=12.48	SAT TT=0.378 T1=0	SAT TT=33.798 T1=33.78	SAT TT=33.673 T1=33.58	SAT TT=1.652 T1=1.59	? (TO) TT=1800.12	? (TO) TT=1800.27	SAT TT=1.409 T1=1.34	SAT TT=0.301 T1=0.19	SAT TT=0.112 T1=0.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975965.opb	UNSAT TT=0.941	UNSAT TT=26.47	UNSAT TT=101.635	UNSAT TT=102.558	UNSAT TT=0.941	UNSAT TT=455.333	? (TO) TT=1800.16	UNSAT TT=101.404	UNSAT TT=6.501	UNSAT TT=65.878	UNSAT TT=65.611	UNSAT TT=4.564	? (TO) TT=1800.15	? (TO) TT=1800.22	UNSAT TT=19.244	? (TO) TT=1800.03	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976157.opb	UNSAT TT=0.016	UNSAT TT=17.123	UNSAT TT=38.477	UNSAT TT=38.257	UNSAT TT=0.016	UNSAT TT=242.038	? (TO) TT=1800.15	UNSAT TT=44.792	UNSAT TT=1.996	UNSAT TT=17.209	UNSAT TT=17.165	UNSAT TT=19.749	UNSAT TT=11.908	UNSAT TT=8.994	UNSAT TT=5.4	? (TO) TT=1800.05	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976730.opb	UNSAT TT=0.152	UNSAT TT=33.379	UNSAT TT=68.5	UNSAT TT=67.198	UNSAT TT=0.152	UNSAT TT=241.178	? (TO) TT=1800.36	UNSAT TT=97.322	UNSAT TT=5.255	UNSAT TT=40.679	UNSAT TT=40.619	UNSAT TT=13.125	? (TO) TT=1800.17	? (TO) TT=1800.26	UNSAT TT=21.337	? (TO) TT=1800.05	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976735.opb	SAT TT=0.027 T1=0	SAT TT=2.808 T1=2.75	SAT TT=32.611 T1=32.58	SAT TT=31.442 T1=31.36	SAT TT=0.276 T1=0.19	SAT TT=1.156 T1=1.1	SAT TT=607.005 T1=606.93	SAT TT=10.708 T1=10.67	SAT TT=0.242 T1=0	SAT TT=1.892 T1=0.89	SAT TT=0.929 T1=0.89	SAT TT=1.212 T1=1.19	? (TO) TT=1800.23	? (TO) TT=1800.13	SAT TT=2.362 T1=2.25	SAT TT=0.052 T1=0.04	SAT TT=0.027 T1=0
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976935.opb	UNSAT TT=0.017	UNSAT TT=20.801	UNSAT TT=62.668	UNSAT TT=62.412	UNSAT TT=0.017	UNSAT TT=162.218	? (TO) TT=1800.05	UNSAT TT=55.929	UNSAT TT=3.51	UNSAT TT=28.423	UNSAT TT=28.265	UNSAT TT=4.418	UNSAT TT=63.605	UNSAT TT=40.327	UNSAT TT=9.418	? (TO) TT=1800.09	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977266.opb	SAT TT=0.074 T1=0	SAT TT=28.181 T1=28.13	SAT TT=14.91 T1=14.89	SAT TT=14.818 T1=14.77	SAT TT=0.972 T1=0.88	SAT TT=1.432 T1=1.39	SAT TT=120.251 T1=120.15	SAT TT=38.85 T1=38.77	SAT TT=0.639 T1=0	SAT TT=16.153 T1=16.09	SAT TT=16.085 T1=15.99	SAT TT=1.454 T1=1.39	? (TO) TT=1800.17	SAT TT=644.944 T1=644.86	SAT TT=1.797 T1=1.7	SAT TT=0.074 T1=0	SAT TT=0.165 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977273.opb	UNSAT TT=0.257	UNSAT TT=21.148	UNSAT TT=45.33	UNSAT TT=45.773	UNSAT TT=0.257	UNSAT TT=336.366	? (TO) TT=1800.18	UNSAT TT=51.019	UNSAT TT=3.421	UNSAT TT=22.585	UNSAT TT=22.495	UNSAT TT=8.308	? (TO) TT=1800.14	UNSAT TT=402.645	UNSAT TT=8.941	? (TO) TT=1800.04	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977464.opb	SAT TT=0.069 T1=0	SAT TT=7.451 T1=7.41	SAT TT=45.964 T1=45.87	SAT TT=46.082 T1=45.97	SAT TT=0.325 T1=0.29	SAT TT=29.274 T1=29.18	? (TO) TT=1800.18	SAT TT=11.876 T1=11.77	SAT TT=0.23 T1=0	SAT TT=12.24 T1=12.19	SAT TT=11.408 T1=11.39	SAT TT=11.886 T1=11.79	SAT TT=39.753 T1=39.66	? (TO) TT=1800.21	SAT TT=3.233 T1=3.21	SAT TT=0.069 T1=0.04	SAT TT=0.078 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977780.opb	UNSAT TT=0.016	UNSAT TT=12.28	UNSAT TT=27.085	UNSAT TT=27.378	UNSAT TT=0.016	UNSAT TT=585.942	? (TO) TT=1800.3	UNSAT TT=44.739	UNSAT TT=2.774	UNSAT TT=13.904	UNSAT TT=13.895	UNSAT TT=41.36	UNSAT TT=569.712	UNSAT TT=115.488	UNSAT TT=5.683	? (TO) TT=1800.06	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978113.opb	UNSAT TT=1.253	UNSAT TT=23.04	UNSAT TT=68.309	UNSAT TT=71.45	UNSAT TT=1.253	UNSAT TT=264.603	? (TO) TT=1800.2	UNSAT TT=102.349	UNSAT TT=5.475	UNSAT TT=43.791	UNSAT TT=46.697	Signal TT=33.032	? (TO) TT=1800.15	? (TO) TT=1800.16	UNSAT TT=20.661	? (TO) TT=1800.09	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978334.opb	UNSAT TT=0.098	UNSAT TT=17.866	UNSAT TT=36.554	UNSAT TT=38.351	UNSAT TT=0.098	UNSAT TT=521.749	? (TO) TT=1800.13	UNSAT TT=56.985	UNSAT TT=3.652	UNSAT TT=21.563	UNSAT TT=21.467	UNSAT TT=11.06	? (TO) TT=1800.16	UNSAT TT=355.597	UNSAT TT=8.772	? (TO) TT=1800.05	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212272.opb	UNSAT TT=0.141	UNSAT TT=29.514	UNSAT TT=65.363	UNSAT TT=64.605	UNSAT TT=0.141	UNSAT TT=268.256	? (TO) TT=1800.11	UNSAT TT=73.533	UNSAT TT=4.506	UNSAT TT=39.884	UNSAT TT=39.725	UNSAT TT=15.149	? (TO) TT=1800.17	? (TO) TT=1800.15	UNSAT TT=11.873	? (TO) TT=1800.06	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212476.opb	UNSAT TT=0.371	UNSAT TT=34.575	UNSAT TT=59.305	UNSAT TT=58.592	UNSAT TT=0.371	UNSAT TT=268.449	? (TO) TT=1800.27	UNSAT TT=81.154	UNSAT TT=6.076	UNSAT TT=34.727	UNSAT TT=34.667	UNSAT TT=10.013	? (TO) TT=1800.14	? (TO) TT=1800.17	UNSAT TT=15.713	? (TO) TT=1800.04	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212923.opb	UNSAT TT=0.479	UNSAT TT=32.421	UNSAT TT=37.832	UNSAT TT=37.79	UNSAT TT=0.479	UNSAT TT=536.448	? (TO) TT=1800.18	UNSAT TT=46.156	UNSAT TT=2.766	UNSAT TT=21.266	UNSAT TT=21.191	UNSAT TT=14.94	? (TO) TT=1800.15	? (TO) TT=1800.19	UNSAT TT=6.442	? (TO) TT=1800.11	? (TO) TT=1800.04
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213670.opb	UNSAT TT=0.016	UNSAT TT=19.839	UNSAT TT=64.64	UNSAT TT=64.741	UNSAT TT=0.016	UNSAT TT=241.774	? (TO) TT=1800.26	UNSAT TT=52.734	UNSAT TT=2.885	UNSAT TT=18.872	UNSAT TT=19.619	UNSAT TT=17.062	? (TO) TT=1800.15	UNSAT TT=11.373	UNSAT TT=6.454	? (TO) TT=1800.08	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213868.opb	UNSAT TT=0.495	UNSAT TT=26.754	UNSAT TT=65.647	UNSAT TT=65.358	UNSAT TT=0.495	UNSAT TT=642.267	? (TO) TT=1800.15	UNSAT TT=68.501	UNSAT TT=6.05	UNSAT TT=20.401	UNSAT TT=20.341	UNSAT TT=22.723	UNSAT TT=737.231	? (TO) TT=1800.19	UNSAT TT=10.17	? (TO) TT=1800.08	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216188.opb	SAT TT=0.082 T1=0.03	SAT TT=24.591 T1=24.51	SAT TT=7.804 T1=7.79	SAT TT=7.753 T1=7.69	SAT TT=0.219 T1=0.19	SAT TT=170.622 T1=170.55	? (TO) TT=1800.12	SAT TT=59.617 T1=59.56	SAT TT=4.086 T1=1.98	SAT TT=4.002 T1=3.99	SAT TT=3.987 T1=3.89	SAT TT=12.212 T1=12.19	? (TO) TT=1800.17	? (TO) TT=1800.17	SAT TT=2.415 T1=2.4	SAT TT=0.082 T1=0.03	SAT TT=0.648 T1=0.59
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216411.opb	UNSAT TT=0.115	UNSAT TT=28.888	UNSAT TT=43.833	UNSAT TT=44.087	UNSAT TT=0.115	UNSAT TT=361.299	? (TO) TT=1800.13	UNSAT TT=62.336	UNSAT TT=3.991	UNSAT TT=26.442	UNSAT TT=26.353	UNSAT TT=14.876	? (TO) TT=1800.12	UNSAT TT=27.603	UNSAT TT=14.677	? (TO) TT=1800.08	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216823.opb	UNSAT TT=0.628	UNSAT TT=28.124	UNSAT TT=44.02	UNSAT TT=43.993	UNSAT TT=0.628	UNSAT TT=535.578	? (TO) TT=1800.23	UNSAT TT=57.535	UNSAT TT=2.997	UNSAT TT=21.955	UNSAT TT=21.918	UNSAT TT=20.384	? (TO) TT=1800.18	? (TO) TT=1800.15	UNSAT TT=11.141	? (TO) TT=1800.1	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216864.opb	SAT TT=0.011 T1=0	SAT TT=13.486 T1=13.4	SAT TT=11.588 T1=11.57	SAT TT=12.408 T1=12.38	SAT TT=0.3 T1=0.19	SAT TT=49.012 T1=48.98	? (TO) TT=1800.16	SAT TT=28.38 T1=28.26	SAT TT=2.159 T1=2.08	SAT TT=6.836 T1=6.79	SAT TT=6.82 T1=6.78	SAT TT=20.774 T1=20.67	? (TO) TT=1800.23	SAT TT=1575.71 T1=1575.56	SAT TT=2.408 T1=2.29	SAT TT=0.011 T1=0	SAT TT=0.088 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217374.opb	SAT TT=0.03 T1=0	SAT TT=2.423 T1=2.32	SAT TT=18.238 T1=18.2	SAT TT=18.138 T1=18.09	SAT TT=0.544 T1=0.49	SAT TT=5.069 T1=4.99	SAT TT=253.092 T1=253	SAT TT=1.489 T1=1.38	SAT TT=0.263 T1=0	SAT TT=11.854 T1=11.79	SAT TT=11.862 T1=11.79	SAT TT=0.715 T1=0.69	SAT TT=203.111 T1=202.97	? (TO) TT=1800.2	SAT TT=1.723 T1=1.56	SAT TT=0.03 T1=0	SAT TT=0.047 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217380.opb	SAT TT=0.088 T1=0.01	SAT TT=17.764 T1=17.67	SAT TT=43.172 T1=43.06	SAT TT=45.643 T1=45.57	SAT TT=0.24 T1=0.19	SAT TT=14.998 T1=14.88	SAT TT=28.306 T1=28.28	SAT TT=1.426 T1=1.37	SAT TT=1.395 T1=1.28	SAT TT=8.749 T1=8.69	SAT TT=8.764 T1=8.7	SAT TT=3.249 T1=3.14	? (TO) TT=1800.15	SAT TT=760.728 T1=760.63	SAT TT=3.709 T1=3.68	SAT TT=0.224 T1=0.2	SAT TT=0.088 T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217392.opb	UNSAT TT=0.231	UNSAT TT=17.352	UNSAT TT=40.617	UNSAT TT=40.17	UNSAT TT=0.231	UNSAT TT=211.037	? (TO) TT=1800.24	UNSAT TT=41.994	UNSAT TT=4.494	UNSAT TT=21.006	UNSAT TT=20.895	UNSAT TT=24.333	UNSAT TT=1527.68	? (TO) TT=1800.17	UNSAT TT=9.758	? (TO) TT=1800.03	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217555.opb	UNSAT TT=0.459	UNSAT TT=21.773	UNSAT TT=44.812	UNSAT TT=45.209	UNSAT TT=0.459	UNSAT TT=300.582	? (TO) TT=1800.15	UNSAT TT=66.446	UNSAT TT=5.285	UNSAT TT=32.969	UNSAT TT=32.931	UNSAT TT=35.685	? (TO) TT=1800.2	? (TO) TT=1800.16	UNSAT TT=18.552	? (TO) TT=1800.04	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218024.opb	UNSAT TT=0.016	UNSAT TT=23.519	UNSAT TT=50.234	UNSAT TT=49.932	UNSAT TT=0.016	UNSAT TT=264.956	? (TO) TT=1800.06	UNSAT TT=66.167	UNSAT TT=6.065	UNSAT TT=27.509	UNSAT TT=27.299	UNSAT TT=24.96	UNSAT TT=5.945	UNSAT TT=6.318	UNSAT TT=11.944	? (TO) TT=1800.02	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218308.opb	UNSAT TT=0.764	UNSAT TT=35.661	UNSAT TT=127.785	UNSAT TT=127.178	UNSAT TT=0.764	UNSAT TT=504.963	? (TO) TT=1800.1	UNSAT TT=110.116	UNSAT TT=7.46	UNSAT TT=85.167	UNSAT TT=84.69	UNSAT TT=5.127	? (TO) TT=1800.21	? (TO) TT=1800.14	UNSAT TT=31.426	? (TO) TT=1800.09	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218757.opb	UNSAT TT=0.038	UNSAT TT=22.68	UNSAT TT=44.687	UNSAT TT=44.393	UNSAT TT=0.038	UNSAT TT=331.201	? (TO) TT=1800.21	UNSAT TT=70.338	UNSAT TT=4.115	UNSAT TT=30.791	UNSAT TT=30.659	UNSAT TT=29.541	? (TO) TT=1800.25	? (TO) TT=1800.23	UNSAT TT=10.816	? (TO) TT=1800.06	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218955.opb	UNSAT TT=0.113	UNSAT TT=29.449	UNSAT TT=37.792	UNSAT TT=37.735	UNSAT TT=0.113	UNSAT TT=625.241	? (TO) TT=1800.16	UNSAT TT=45.896	UNSAT TT=2.845	UNSAT TT=18.94	UNSAT TT=17.63	UNSAT TT=22.86	UNSAT TT=143.727	UNSAT TT=1113.95	UNSAT TT=7.268	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219348.opb	UNSAT TT=0.695	UNSAT TT=29.819	UNSAT TT=43.983	UNSAT TT=44.315	UNSAT TT=0.695	UNSAT TT=345.318	? (TO) TT=1800.13	UNSAT TT=53.047	UNSAT TT=4.287	UNSAT TT=21.527	UNSAT TT=20.049	UNSAT TT=12.106	? (TO) TT=1800.23	? (TO) TT=1800.23	UNSAT TT=14.805	? (TO) TT=1800.04	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219399.opb	SAT TT=0.047 T1=0.02	SAT TT=2.028 T1=1.91	SAT TT=3.422 T1=3.39	SAT TT=3.454 T1=3.39	SAT TT=0.409 T1=0.39	SAT TT=64.394 T1=64.37	? (TO) TT=1800.08	SAT TT=12.377 T1=12.27	SAT TT=1.301 T1=1.18	SAT TT=3.7 T1=3.59	SAT TT=3.696 T1=3.59	SAT TT=2.998 T1=2.99	? (TO) TT=1800.17	SAT TT=11.612 T1=11.51	SAT TT=1.132 T1=1.01	SAT TT=0.047 T1=0.02	SAT TT=0.06 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219799.opb	UNSAT TT=0.304	UNSAT TT=24.4	UNSAT TT=46.926	UNSAT TT=47.216	UNSAT TT=0.304	UNSAT TT=433.897	? (TO) TT=1800.08	UNSAT TT=52.451	UNSAT TT=3.401	UNSAT TT=23.5	UNSAT TT=23.212	UNSAT TT=56.128	? (TO) TT=1800.13	? (TO) TT=1800.2	UNSAT TT=7.83	? (TO) TT=1800.03	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220019.opb	UNSAT TT=0.096	UNSAT TT=21.985	UNSAT TT=46.839	UNSAT TT=46.652	UNSAT TT=0.096	UNSAT TT=325.095	? (TO) TT=1800.28	UNSAT TT=63.268	UNSAT TT=4.27	UNSAT TT=25.687	UNSAT TT=27.26	UNSAT TT=21.283	? (TO) TT=1800.19	? (TO) TT=1800.14	UNSAT TT=12.846	? (TO) TT=1800.06	? (TO) TT=1800.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220546.opb	UNSAT TT=0.442	UNSAT TT=27.378	UNSAT TT=37.494	UNSAT TT=37.238	UNSAT TT=0.442	UNSAT TT=310.571	? (TO) TT=1800.17	UNSAT TT=57.041	UNSAT TT=4.19	UNSAT TT=21.255	UNSAT TT=22.558	UNSAT TT=37.822	? (TO) TT=1800.13	? (TO) TT=1800.19	UNSAT TT=12.462	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220767.opb	UNSAT TT=0.109	UNSAT TT=24.617	UNSAT TT=56.075	UNSAT TT=55.974	UNSAT TT=0.109	UNSAT TT=532.886	? (TO) TT=1800.15	UNSAT TT=65.066	UNSAT TT=5.888	UNSAT TT=23.848	UNSAT TT=22.264	UNSAT TT=4.775	? (TO) TT=1800.13	? (TO) TT=1800.17	UNSAT TT=13.886	? (TO) TT=1800.09	? (TO) TT=1800.05
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221203.opb	UNSAT TT=0.356	UNSAT TT=30.607	UNSAT TT=28.809	UNSAT TT=28.893	UNSAT TT=0.356	UNSAT TT=146.256	? (TO) TT=1800.07	UNSAT TT=58.91	UNSAT TT=3.529	UNSAT TT=27.807	UNSAT TT=27.642	UNSAT TT=6.268	? (TO) TT=1800.24	? (TO) TT=1800.17	UNSAT TT=9.429	? (TO) TT=1800.05	? (TO) TT=1800.01
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221624.opb	UNSAT TT=0.293	UNSAT TT=21.38	UNSAT TT=52.86	UNSAT TT=52.287	UNSAT TT=0.293	UNSAT TT=631.288	? (TO) TT=1800.19	UNSAT TT=54.874	UNSAT TT=7.397	UNSAT TT=26.155	UNSAT TT=26.022	UNSAT TT=19.248	? (TO) TT=1800.21	? (TO) TT=1800.32	UNSAT TT=13.461	? (TO) TT=1800.08	? (TO) TT=1800.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221953.opb	SAT TT=0.181 T1=0	SAT TT=6.496 T1=6.42	SAT TT=23.65 T1=23.58	SAT TT=23.359 T1=23.28	SAT TT=0.181 T1=0.09	SAT TT=77.139 T1=77.07	SAT TT=48.77 T1=48.69	SAT TT=33.676 T1=33.55	SAT TT=0.769 T1=0	SAT TT=10.097 T1=9.99	SAT TT=10.047 T1=9.99	SAT TT=38.534 T1=38.48	? (TO) TT=1800.14	? (TO) TT=1800.19	SAT TT=2.43 T1=2.4	SAT TT=0.215 T1=0.19	SAT TT=0.645 T1=0.59
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222080.opb	SAT TT=0.045 T1=0	SAT TT=8.433 T1=8.4	SAT TT=8.611 T1=8.56	SAT TT=8.813 T1=8.79	SAT TT=0.145 T1=0.09	SAT TT=129.39 T1=129.35	SAT TT=618.876 T1=618.77	SAT TT=33.065 T1=32.94	SAT TT=2.435 T1=2.36	SAT TT=12.863 T1=12.78	SAT TT=12.852 T1=12.79	SAT TT=8.006 T1=7.99	SAT TT=189.614 T1=189.57	SAT TT=50.239 T1=50.17	SAT TT=3.824 T1=3.75	SAT TT=0.045 T1=0	SAT TT=0.092 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222248.opb	SAT TT=0.023 T1=0	SAT TT=3.383 T1=3.32	SAT TT=5.623 T1=5.59	SAT TT=5.591 T1=5.57	SAT TT=0.77 T1=0.69	SAT TT=5.559 T1=5.49	? (TO) TT=1800.3	SAT TT=27.038 T1=26.98	SAT TT=0.349 T1=0	SAT TT=11.581 T1=11.48	SAT TT=11.481 T1=11.38	SAT TT=1.563 T1=1.49	SAT TT=30.648 T1=30.55	? (TO) TT=1800.29	SAT TT=1.389 T1=1.29	SAT TT=0.024 T1=0	SAT TT=0.023 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222257.opb	UNSAT TT=0.229	UNSAT TT=28.757	UNSAT TT=40.401	UNSAT TT=40.318	UNSAT TT=0.229	UNSAT TT=353.528	? (TO) TT=1800.09	UNSAT TT=52.811	UNSAT TT=3.394	UNSAT TT=25.187	UNSAT TT=25.11	UNSAT TT=33.547	? (TO) TT=1800.17	? (TO) TT=1800.24	UNSAT TT=8.69	? (TO) TT=1800.05	? (TO) TT=1800.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222539.opb	UNSAT TT=0.025	UNSAT TT=26.415	UNSAT TT=42.939	UNSAT TT=43.275	UNSAT TT=0.025	UNSAT TT=500.024	? (TO) TT=1800.19	UNSAT TT=71.845	UNSAT TT=4.992	UNSAT TT=20.234	UNSAT TT=18.959	UNSAT TT=20.32	UNSAT TT=519.633	? (TO) TT=1800.22	UNSAT TT=8.9	? (TO) TT=1800.07	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223004.opb	UNSAT TT=1.966	UNSAT TT=31.577	UNSAT TT=59.461	UNSAT TT=58.744	UNSAT TT=1.966	UNSAT TT=528.608	? (TO) TT=1800.09	UNSAT TT=63.65	UNSAT TT=5.345	UNSAT TT=27.777	UNSAT TT=27.696	UNSAT TT=42.079	? (TO) TT=1800.16	? (TO) TT=1800.2	UNSAT TT=13.109	? (TO) TT=1800.01	? (TO) TT=1800.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223220.opb	UNSAT TT=0.09	UNSAT TT=26.17	UNSAT TT=57.311	UNSAT TT=56.651	UNSAT TT=0.09	UNSAT TT=553.548	? (TO) TT=1800.28	UNSAT TT=71.06	UNSAT TT=4.649	UNSAT TT=35.432	UNSAT TT=35.334	UNSAT TT=24.749	? (TO) TT=1800.17	? (TO) TT=1800.16	UNSAT TT=10.349	? (TO) TT=1800.03	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223416.opb	SAT TT=0.027 T1=0	SAT TT=13.493 T1=13.42	SAT TT=29.237 T1=29.19	SAT TT=29.287 T1=29.22	SAT TT=0.12 T1=0.09	SAT TT=213.287 T1=213.26	SAT TT=888.597 T1=888.5	SAT TT=18.686 T1=18.57	SAT TT=1.307 T1=1.18	SAT TT=7.966 T1=7.89	SAT TT=7.902 T1=7.88	SAT TT=13.02 T1=12.99	SAT TT=6.101 T1=6.05	SAT TT=473.747 T1=473.63	SAT TT=1.301 T1=1.22	SAT TT=0.027 T1=0	SAT TT=0.082 T1=0.07
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223596.opb	SAT TT=0.015 T1=0	SAT TT=1.935 T1=1.82	SAT TT=91.85 T1=91.76	SAT TT=91.659 T1=91.65	SAT TT=0.651 T1=0.59	SAT TT=69.93 T1=69.87	? (TO) TT=1800.1	SAT TT=82.119 T1=82.05	SAT TT=5.157 T1=5.06	SAT TT=23.78 T1=23.68	SAT TT=23.717 T1=23.69	SAT TT=7.527 T1=7.48	? (TO) TT=1800.14	? (TO) TT=1800.17	SAT TT=5.19 T1=5.16	SAT TT=0.209 T1=0.19	SAT TT=0.015 T1=0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223689.opb	SAT TT=0.016 T1=0	SAT TT=3.763 T1=3.7	SAT TT=44.241 T1=44.18	SAT TT=44.644 T1=44.57	SAT TT=0.572 T1=0.5	SAT TT=3.837 T1=3.79	SAT TT=1105.87 T1=1105.82	SAT TT=4.11 T1=4.06	SAT TT=0.856 T1=0	SAT TT=0.147 T1=0.09	SAT TT=0.147 T1=0.09	SAT TT=0.359 T1=0.29	? (TO) TT=1800.16	SAT TT=4.519 T1=4.36	SAT TT=1.762 T1=1.73	SAT TT=0.016 T1=0	SAT TT=0.101 T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223696.opb	SAT TT=0.061 T1=0.04	SAT TT=17.442 T1=17.42	SAT TT=64.706 T1=64.67	SAT TT=64.143 T1=64.07	SAT TT=0.093 T1=0.05	SAT TT=178.231 T1=178.14	? (TO) TT=1800.13	SAT TT=24.091 T1=23.97	SAT TT=2.414 T1=2.37	SAT TT=21.016 T1=20.99	SAT TT=20.933 T1=20.89	SAT TT=11.584 T1=11.49	SAT TT=16.308 T1=16.19	? (TO) TT=1800.21	SAT TT=5.068 T1=5.02	SAT TT=0.061 T1=0.04	SAT TT=0.061 T1=0.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224059.opb	UNSAT TT=0.013	UNSAT TT=17.96	UNSAT TT=23.136	UNSAT TT=23.348	UNSAT TT=0.013	UNSAT TT=227.421	UNSAT TT=1652.45	UNSAT TT=38.628	UNSAT TT=2.429	UNSAT TT=12.473	UNSAT TT=12.444	UNSAT TT=32.273	? (TO) TT=1800.24	UNSAT TT=9.934	UNSAT TT=5.295	? (TO) TT=1800.07	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224255.opb	UNSAT TT=0.59	UNSAT TT=23.422	UNSAT TT=44.951	UNSAT TT=44.336	UNSAT TT=0.59	UNSAT TT=433.019	? (TO) TT=1800.05	UNSAT TT=59.878	UNSAT TT=4.074	UNSAT TT=20.841	UNSAT TT=20.731	UNSAT TT=32.642	? (TO) TT=1800.2	? (TO) TT=1800.15	UNSAT TT=8.111	? (TO) TT=1800.07	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224451.opb	UNSAT TT=0.161	UNSAT TT=21.082	UNSAT TT=48.83	UNSAT TT=49.101	UNSAT TT=0.161	UNSAT TT=331.553	? (TO) TT=1800.21	UNSAT TT=49.188	UNSAT TT=3.377	UNSAT TT=21.514	UNSAT TT=21.476	UNSAT TT=48.774	? (TO) TT=1800.25	? (TO) TT=1800.13	UNSAT TT=7.561	? (TO) TT=1800.08	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224522.opb	SAT TT=0.184 T1=0.09	SAT TT=16.071 T1=16	SAT TT=34.08 T1=33.98	SAT TT=34.022 T1=33.99	SAT TT=0.184 T1=0.09	SAT TT=28.304 T1=28.28	SAT TT=881.203 T1=881.16	SAT TT=10.087 T1=9.97	SAT TT=1.395 T1=1.27	SAT TT=11.848 T1=11.78	SAT TT=11.847 T1=11.79	SAT TT=23.175 T1=23.06	? (TO) TT=1800.13	SAT TT=11.002 T1=10.9	SAT TT=3.361 T1=3.31	SAT TT=0.226 T1=0.19	SAT TT=0.514 T1=0.49
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224929.opb	UNSAT TT=0.046	UNSAT TT=27.159	UNSAT TT=35.308	UNSAT TT=35.032	UNSAT TT=0.046	UNSAT TT=275.286	? (TO) TT=1800.32	UNSAT TT=45.474	UNSAT TT=3.079	UNSAT TT=20.478	UNSAT TT=20.378	UNSAT TT=12.053	? (TO) TT=1800.2	UNSAT TT=933.336	UNSAT TT=9.267	? (TO) TT=1800.04	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225122.opb	UNSAT TT=0.185	UNSAT TT=22.741	UNSAT TT=46.476	UNSAT TT=46.289	UNSAT TT=0.185	UNSAT TT=455.048	? (TO) TT=1800.13	UNSAT TT=45.204	UNSAT TT=4.15	UNSAT TT=23.857	UNSAT TT=22.461	UNSAT TT=18.963	? (TO) TT=1800.12	? (TO) TT=1800.24	UNSAT TT=6.003	? (TO) TT=1800.08	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225605.opb	UNSAT TT=0.604	UNSAT TT=26.428	UNSAT TT=43.5	UNSAT TT=43.596	UNSAT TT=0.604	UNSAT TT=363.442	? (TO) TT=1800.12	UNSAT TT=55.831	UNSAT TT=4.737	UNSAT TT=22.253	UNSAT TT=22.203	UNSAT TT=23.007	? (TO) TT=1800.13	? (TO) TT=1800.22	UNSAT TT=11.964	? (TO) TT=1800.04	? (TO) TT=1800.09
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226062.opb	UNSAT TT=0.433	UNSAT TT=24.307	UNSAT TT=54.74	UNSAT TT=54.775	UNSAT TT=0.433	UNSAT TT=483.42	? (TO) TT=1800.07	UNSAT TT=48.279	UNSAT TT=4.074	UNSAT TT=21.63	UNSAT TT=21.567	UNSAT TT=2.861	? (TO) TT=1800.19	? (TO) TT=1800.21	UNSAT TT=7.981	? (TO) TT=1800.05	? (TO) TT=1800.04
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226241.opb	SAT TT=0.057 T1=0	SAT TT=11.844 T1=11.8	SAT TT=17.333 T1=17.26	SAT TT=17.255 T1=17.18	SAT TT=0.057 T1=0	SAT TT=26.839 T1=26.79	? (TO) TT=1800.34	SAT TT=38.853 T1=38.77	SAT TT=1.472 T1=1.34	SAT TT=18.33 T1=18.28	SAT TT=18.293 T1=18.19	SAT TT=5.1 T1=5.09	? (TO) TT=1800.21	SAT TT=26.304 T1=26.23	SAT TT=2.381 T1=2.33	SAT TT=0.058 T1=0.02	SAT TT=0.249 T1=0.2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226284.opb	SAT TT=0.011 T1=0	SAT TT=12.727 T1=12.68	SAT TT=29.661 T1=29.57	SAT TT=31.362 T1=31.28	SAT TT=0.208 T1=0.19	SAT TT=134.063 T1=133.95	? (TO) TT=1800.12	SAT TT=0.183 T1=0	SAT TT=2.662 T1=2.58	SAT TT=23.837 T1=23.78	SAT TT=23.808 T1=23.79	SAT TT=4.194 T1=4.09	SAT TT=4.723 T1=4.68	SAT TT=2.089 T1=1.99	SAT TT=11.356 T1=11.34	SAT TT=0.011 T1=0	SAT TT=0.133 T1=0.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226368.opb	UNSAT TT=0.078	UNSAT TT=25.383	UNSAT TT=20.78	UNSAT TT=20.702	UNSAT TT=0.078	UNSAT TT=231.05	? (TO) TT=1800.11	UNSAT TT=40.386	UNSAT TT=2.563	UNSAT TT=13.967	UNSAT TT=14.885	UNSAT TT=15.333	UNSAT TT=1054.13	UNSAT TT=106.167	UNSAT TT=5.745	? (TO) TT=1800.08	? (TO) TT=1800.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226680.opb	UNSAT TT=0.142	UNSAT TT=25.513	UNSAT TT=40.087	UNSAT TT=42.067	UNSAT TT=0.142	UNSAT TT=347.653	? (TO) TT=1800.21	UNSAT TT=65.585	UNSAT TT=2.603	UNSAT TT=18.157	UNSAT TT=18.105	UNSAT TT=11.474	? (TO) TT=1800.21	UNSAT TT=217.739	UNSAT TT=7.762	? (TO) TT=1800.1	? (TO) TT=1800.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227012.opb	UNSAT TT=0.113	UNSAT TT=33.075	UNSAT TT=39.808	UNSAT TT=39.351	UNSAT TT=0.113	UNSAT TT=370.39	? (TO) TT=1800.36	UNSAT TT=65.866	UNSAT TT=3.707	UNSAT TT=25.183	UNSAT TT=25.159	UNSAT TT=0.365	? (TO) TT=1800.18	? (TO) TT=1800.2	UNSAT TT=12.153	? (TO) TT=1800.03	? (TO) TT=1800.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227326.opb	UNSAT TT=0.142	UNSAT TT=24.157	UNSAT TT=33.722	UNSAT TT=33.243	UNSAT TT=0.142	UNSAT TT=316.906	UNSAT TT=1331.17	UNSAT TT=35.561	UNSAT TT=2.048	UNSAT TT=14.859	UNSAT TT=14.824	UNSAT TT=21.048	? (TO) TT=1800.18	? (TO) TT=1800.17	UNSAT TT=5.027	? (TO) TT=1800.01	? (TO) TT=1800.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227418.opb	SAT TT=0.353 T1=0.29	SAT TT=26.037 T1=25.96	SAT TT=43.723 T1=43.66	SAT TT=43.188 T1=43.16	SAT TT=0.394 T1=0.29	SAT TT=272.723 T1=272.63	? (TO) TT=1800.19	SAT TT=48.967 T1=48.87	SAT TT=1.16 T1=1.08	SAT TT=24.205 T1=24.18	SAT TT=24.225 T1=24.19	SAT TT=1.491 T1=1.39	? (TO) TT=1800.21	? (TO) TT=1800.2	SAT TT=14.971 T1=14.93	SAT TT=0.353 T1=0.29	SAT TT=0.394 T1=0.29
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227861.opb	UNSAT TT=0.101	UNSAT TT=18.166	UNSAT TT=60.142	UNSAT TT=60.107	UNSAT TT=0.101	UNSAT TT=319.834	? (TO) TT=1800.08	UNSAT TT=59.586	UNSAT TT=4.181	UNSAT TT=34.911	UNSAT TT=34.817	UNSAT TT=41.288	? (TO) TT=1800.2	UNSAT TT=1354.51	UNSAT TT=8.647	? (TO) TT=1800.09	? (TO) TT=1800.05
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111228076.opb	UNSAT TT=0.242	UNSAT TT=30.24	UNSAT TT=69.924	UNSAT TT=68.664	UNSAT TT=0.242	UNSAT TT=387.163	? (TO) TT=1800.09	UNSAT TT=80.09	UNSAT TT=5.734	UNSAT TT=46.568	UNSAT TT=46.328	UNSAT TT=44.401	? (TO) TT=1800.2	? (TO) TT=1800.21	UNSAT TT=14.276	? (TO) TT=1800.11	? (TO) TT=1800.08
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14bt.opb	SAT TT=0.657 T1=0	SAT TT=55.256 T1=55.14	SAT TT=104.782 T1=104.75	SAT TT=104.837 T1=104.74	? (TO) TT=1800.11	SAT TT=1769 T1=1768.9	? (TO) TT=1800.18	SAT TT=6.984 T1=6.89	SAT TT=0.657 T1=0	SAT TT=93.114 T1=93.06	SAT TT=89.068 T1=89.03	SAT TT=374.342 T1=374.29	? (TO) TT=1800.2	? (TO) TT=1800.16	SAT TT=8.407 T1=8.29	SAT TT=1.176 T1=1.09	SAT TT=8.701 T1=8.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army10.14ls.opb	SAT TT=0.198 T1=0	SAT TT=766.66 T1=766.55	? TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.06	SAT TT=168.093 T1=168.05	SAT TT=0.66 T1=0.6	SAT TT=0.198 T1=0	SAT TT=89.2 T1=89.07	SAT TT=2.685 T1=2.59	SAT TT=2.688 T1=2.6	? (TO) TT=1800.09	? (TO) TT=1800.16	? (TO) TT=1800.17	SAT TT=1716.74 T1=1716.61	SAT TT=46.678 T1=46.58	SAT TT=0.439 T1=0.39
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17bt.opb	SAT TT=1.995 T1=1.89	SAT TT=129.491 T1=129.39	? TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.54	SAT TT=792.014 T1=791.94	SAT TT=25.392 T1=25.34	SAT TT=33.814 T1=33.78	SAT TT=33.813 T1=33.78	? (TO) TT=1800.03	? (TO) TT=1800.2	SAT TT=31.046 T1=30.91	SAT TT=54.652 T1=54.59	SAT TT=1.995 T1=1.89	SAT TT=6.552 T1=6.49
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army11.17ls.opb	SAT TT=1.753 T1=1.69	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.02	? (TO) TT=1800.05	? (TO) TT=1800.4	SAT TT=678.479 T1=678.44	SAT TT=43.882 T1=43.75	SAT TT=32.283 T1=32.18	SAT TT=32.259 T1=32.18	? (TO) TT=1800.04	? (TO) TT=1800.11	? (TO) TT=1800.21	? (TO) TT=1800.16	SAT TT=308.555 T1=308.51	SAT TT=1.753 T1=1.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21bt.opb	SAT TT=11.766 T1=11.69	? (TO) TT=1800.16	? TT=1800.02	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.25	? (TO) TT=1800.03	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.14	? (TO) TT=1800.04	? (TO) TT=1800.15	? (TO) TT=1800.19	? (TO) TT=1800.19	SAT TT=11.766 T1=11.69	SAT TT=450.651 T1=450.57
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army12.21ls.opb	SAT TT=9.925 T1=9.89	? (TO) TT=1800.14	? TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.19	? (TO) TT=1800.25	? (TO) TT=1800.13	SAT TT=1622.81 T1=1622.71	SAT TT=9.925 T1=9.89
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24bt.opb	SAT TT=2.945 T1=2.89	? (TO) TT=1800.07	? TT=1800.02	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.3	? (TO) TT=1800.09	SAT TT=87.016 T1=86.96	? (TO) TT=1800.14	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.19	? (TO) TT=1800.22	? (TO) TT=1800.18	SAT TT=2.945 T1=2.89	SAT TT=32.868 T1=32.78
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army13.24ls.opb	SAT TT=0.156 T1=0.09	? (TO) TT=1800.08	? TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.44	SAT TT=1132.15 T1=1132.09	? (TO) TT=1800.14	SAT TT=1413.32 T1=1413.25	SAT TT=1413.52 T1=1413.44	? (TO) TT=1800.06	? (TO) TT=1800.18	? (TO) TT=1800.26	? (TO) TT=1800.2	SAT TT=0.156 T1=0.09	SAT TT=2.045 T1=1.99
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9bt.opb	SAT TT=0.049 T1=0	SAT TT=1.205 T1=1.13	SAT TT=5.16 T1=5.09	SAT TT=5.144 T1=5.08	? (TO) TT=1800.09	SAT TT=0.219 T1=0.19	SAT TT=0.92 T1=0.89	SAT TT=0.323 T1=0.3	SAT TT=0.1 T1=0	SAT TT=0.049 T1=0.02	SAT TT=0.049 T1=0.03	SAT TT=0.956 T1=0.89	SAT TT=6.098 T1=5.98	SAT TT=113.845 T1=113.78	SAT TT=1.233 T1=1.16	SAT TT=0.106 T1=0.09	SAT TT=6.171 T1=6.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army8.9ls.opb	SAT TT=0.058 T1=0	SAT TT=3.286 T1=3.23	SAT TT=38.107 T1=38.06	SAT TT=40.144 T1=40.08	? (TO) TT=1800.1	SAT TT=0.296 T1=0.19	SAT TT=11.182 T1=11.09	SAT TT=0.137 T1=0	SAT TT=0.177 T1=0	SAT TT=0.059 T1=0	SAT TT=0.058 T1=0	SAT TT=0.968 T1=0.89	SAT TT=1364.46 T1=1364.3	SAT TT=3.187 T1=2.96	SAT TT=0.921 T1=0.83	SAT TT=5.241 T1=5.19	SAT TT=0.228 T1=0.2
Bench name	Best results on this instance	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12bt.opb	SAT TT=0.468 T1=0	SAT TT=112.157 T1=112.07	SAT TT=216.359 T1=216.31	SAT TT=215.602 T1=215.54	? (TO) TT=1800.04	SAT TT=59.995 T1=59.96	? (TO) TT=1800.42	SAT TT=3.929 T1=3.89	SAT TT=0.468 T1=0	SAT TT=2.205 T1=2.09	SAT TT=2.223 T1=2.19	SAT TT=13.385 T1=13.29	SAT TT=10.764 T1=10.68	? (TO) TT=1800.11	SAT TT=325.092 T1=324.96	SAT TT=1.226 T1=1.19	SAT TT=8.459 T1=8.39
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/prestwich/armies/ normalized-army9.12ls.opb	SAT TT=0.124 T1=0.09	SAT TT=125.787 T1=125.68	? TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800.07	SAT TT=10.677 T1=10.59	? (TO) TT=1800.17	SAT TT=3.663 T1=3.59	SAT TT=9.832 T1=9.79	SAT TT=6.694 T1=6.6	SAT TT=7.082 T1=6.99	SAT TT=108.788 T1=108.77	? (TO) TT=1800.13	? (TO) TT=1800.2	SAT TT=12.737 T1=12.68	SAT TT=0.124 T1=0.09	SAT TT=0.701 T1=0.59

Some statistics...

	absconPseudo 102	bsolo 3.0.16	bsolo 3.0.17	glpPB 0.2	minisat+ 1.14	oree 0.1.2 alpha	PB-clasp 2007-03-23	PB-clasp 2007-04-10	PBS4 2007-03-23	PBS4_v2 2007-03-23	Pueblo 1.4	sat4jPseudoCP 2007-03-23	sat4jPseudoCPClause 2007-03-23	SAT4JPseudoResolution 2007-03-23	wildcat-rnp 2007-03-21	wildcat-skc 2007-03-21
Number of times the solver is able to give the best known answer	107	104	104	100	106	22	109	109	109	109	104	26	39	107	44	44
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	107	104	104	100	106	22	109	109	109	109	104	26	39	107	44	44
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	0	73	0	0	1	2	1	2	0	0	0	0	26	9
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	5	0	0	3	16	1	1	0	0	0	0	24	15