PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category no optimisation, small integers, non linear constraints (DEC-SMALLINT-NLC)

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, non linear constraints (DEC-SMALLINT-NLC)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (dec) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: borg-pb 10.05.30 (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: borg pb-dec-11.04.03 (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench name	Best results on this instance	bsolo 3.2 (complete)	clasp 2.0.6-R5325 (dec) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: borg-pb 10.05.30 (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: borg pb-dec-11.04.03 (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_3_40.opb		? TT=1797.9	? (TO) TT=1800.02	? (problem) TT=0.025	? (TO) TT=1800.13	? (problem) TT=0.024	? (TO) TT=1800.1	? (problem) TT=0.019	? (TO) TT=1800.09	? (problem) TT=0.019	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.11	? TT=879.894	? (TO) TT=1800.02	? TT=0.483	? TT=1798.01	? (TO) TT=1800.07	? (TO) TT=1800.21	No Cert. TT=1.871	? (TO) TT=1800.4	? (TO) TT=1800.02	? TT=1789.74	? (MO) TT=1677.67	? (TO) TT=1800.12	? TT=1796.75	? TT=0.004	? (problem) TT=0.019	? (problem) TT=0.024	? TT=1799.89	? TT=1799.47	? (TO) TT=1800.08	? (TO) TT=1800.87	? (TO) TT=1800.01	? TT=1796.74	? TT=1796.77	? TT=1796.71	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=1799.47	? TT=1799.85
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_10_4_15.opb	SAT TT=0.034 T1=0.03	SAT TT=0.609 T1=0.6	SAT TT=1.31 T1=1.31	? (problem) TT=0.021	SAT TT=0.377 T1=0.37	? (problem) TT=0.019	SAT TT=0.368 T1=0.36	? (problem) TT=0.018	SAT TT=0.365 T1=0.36	? (problem) TT=0.018	SAT TT=0.361 T1=0.36	SAT TT=13.698 T1=13.7	SAT TT=0.145 T1=0.14	SAT TT=0.178 T1=0.16	SAT TT=0.034 T1=0.03	? TT=0.503	SAT TT=0.194 T1=0.19	SAT TT=1.055 T1=0.53	SAT TT=2.293 T1=2.28	SAT TT=214.911 T1=203.98	SAT TT=0.077 T1=0.07	SAT TT=3.084 T1=1.36	SAT TT=3.078 T1=3.07	SAT TT=0.58 T1=0.63	SAT TT=2.974 T1=1.3	SAT TT=0.113 T1=0.1	? TT=0.006	? (problem) TT=0.019	? (problem) TT=0.018	SAT TT=1.272 T1=1.26	SAT TT=0.039 T1=0.03	SAT TT=3.198 T1=1.31	SAT TT=17.151 T1=16.34	SAT TT=0.794 T1=0.4	SAT TT=2.398 T1=2.38	SAT TT=0.136 T1=0.12	SAT TT=1.274 T1=1.26	SAT TT=0.038 T1=0.03	SAT TT=0.039 T1=0.03	SAT TT=0.04 T1=0.03	SAT TT=0.04 T1=0.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_2_15.opb	SAT TT=93.697 T1=93.7	? TT=1798.01	? (TO) TT=1800.02	? (problem) TT=0.035	? (TO) TT=1800.11	? (problem) TT=0.033	? (TO) TT=1800	? (problem) TT=0.03	? (TO) TT=1800.08	? (problem) TT=0.028	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.02	? TT=0.963	? TT=1798.01	? (TO) TT=1800.49	SAT TT=242.334 T1=242.34	No Cert. TT=1.393	? (TO) TT=1800.3	? (TO) TT=1800.91	SAT TT=1422.08 T1=1422.32	? (MO) TT=1670.57	? (TO) TT=1800.07	SAT TT=93.697 T1=93.7	? TT=0.005	? (problem) TT=0.03	? (problem) TT=0.031	? TT=1799.83	? TT=1799.52	? (TO) TT=1800.09	? (TO) TT=1800.04	SAT TT=1703.21 T1=1696.27	SAT TT=928.589 T1=928.73	SAT TT=408.956 T1=408.99	SAT TT=801.607 T1=801.72	? (TO) TT=1800.03	? (TO) TT=1800.02	? TT=1799.9	? TT=1799.47
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_100_25_5_40.opb	UNSAT TT=17.053	? TT=1798.02	? (TO) TT=1800.03	? (problem) TT=0.032	? (TO) TT=1800.13	? (problem) TT=0.027	? (TO) TT=1800	? (problem) TT=0.029	? (TO) TT=1800.09	? (problem) TT=0.03	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.1	? TT=701.138	? (TO) TT=1800.02	? TT=0.986	? TT=1798.05	? (TO) TT=1800.09	UNSAT TT=113.261	No Cert. TT=111.843	UNSAT TT=122.26	? (TO) TT=1800.29	UNSAT TT=624.514	UNSAT TT=1188.46	? (TO) TT=1800.16	UNSAT TT=17.053	? TT=0.008	? (problem) TT=0.032	? (problem) TT=0.031	? TT=1799.94	? TT=1799.87	? (TO) TT=1800.79	? (TO) TT=1800.74	? (TO) TT=1800.09	UNSAT TT=314.555	UNSAT TT=17.546	UNSAT TT=482.132	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=1799.82	? TT=1799.47
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_3_5.opb	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.003	? (problem) TT=0.003	UNSAT TT=0.031	? (problem) TT=0.004	UNSAT TT=0.027	? (problem) TT=0.007	UNSAT TT=0.023	? (problem) TT=0.004	UNSAT TT=0.022	UNSAT TT=0.006	UNSAT TT=0.011	UNSAT TT=0.023	UNSAT TT=0.003	? TT=0.114	UNSAT TT=0.002	UNSAT TT=0.354	UNSAT TT=0.027	No Cert. TT=0.898	UNSAT TT=0.016	UNSAT TT=0.635	UNSAT TT=0.046	UNSAT TT=0.547	UNSAT TT=0.575	UNSAT TT=0.041	? TT=0.005	? (problem) TT=0.003	? (problem) TT=0.003	UNSAT TT=0.003	UNSAT TT=0.002	UNSAT TT=0.546	UNSAT TT=0.283	UNSAT TT=0.305	UNSAT TT=0.047	UNSAT TT=0.041	UNSAT TT=0.031	UNSAT TT=0.013	UNSAT TT=0.013	UNSAT TT=0.001	UNSAT TT=0.001
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_4_5.opb	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.003	? (problem) TT=0.005	UNSAT TT=0.038	? (problem) TT=0.003	UNSAT TT=0.027	? (problem) TT=0.004	UNSAT TT=0.024	? (problem) TT=0.004	UNSAT TT=0.026	UNSAT TT=0.008	UNSAT TT=0.011	UNSAT TT=0.02	UNSAT TT=0.003	? TT=0.104	UNSAT TT=0.002	UNSAT TT=0.355	UNSAT TT=0.024	No Cert. TT=1.046	UNSAT TT=0.018	UNSAT TT=0.584	UNSAT TT=0.044	UNSAT TT=0.541	UNSAT TT=0.594	UNSAT TT=0.036	? TT=0.004	? (problem) TT=0.004	? (problem) TT=0.002	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.413	UNSAT TT=0.285	UNSAT TT=0.325	UNSAT TT=0.045	UNSAT TT=0.059	UNSAT TT=0.023	UNSAT TT=0.013	UNSAT TT=0.014	UNSAT TT=0.002	UNSAT TT=0.002
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/ dbsg/normalized-dbsg_10_4_4_8.opb	UNSAT TT=0.001	UNSAT TT=0.003	UNSAT TT=0.002	? (problem) TT=0.002	UNSAT TT=0.028	? (problem) TT=0.003	UNSAT TT=0.022	? (problem) TT=0.003	UNSAT TT=0.018	? (problem) TT=0.003	UNSAT TT=0.019	UNSAT TT=0.003	UNSAT TT=0.006	UNSAT TT=0.019	UNSAT TT=0.003	? TT=0.11	UNSAT TT=0.001	UNSAT TT=0.164	UNSAT TT=0.015	UNSAT TT=0.846	UNSAT TT=0.007	UNSAT TT=0.214	UNSAT TT=0.018	UNSAT TT=0.484	UNSAT TT=0.201	UNSAT TT=0.022	? TT=0.005	? (problem) TT=0.003	? (problem) TT=0.003	UNSAT TT=0.002	UNSAT TT=0.003	UNSAT TT=0.194	UNSAT TT=0.165	UNSAT TT=0.184	UNSAT TT=0.013	UNSAT TT=0.016	UNSAT TT=0.018	UNSAT TT=0.004	UNSAT TT=0.004	UNSAT TT=0.001	UNSAT TT=0.002
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_1_15.opb	SAT TT=0.031 T1=0.03	SAT TT=1.209 T1=1.2	SAT TT=0.031 T1=0.03	? (problem) TT=0.046	SAT TT=0.581 T1=0.58	? (problem) TT=0.053	? (problem) TT=0.498	? (problem) TT=0.043	? (problem) TT=0.48	? (problem) TT=0.044	? (problem) TT=0.489	? (TO) TT=1800.1	SAT TT=0.277 T1=0.27	SAT TT=0.349 T1=0.32	SAT TT=0.083 T1=0.08	? TT=0.864	SAT TT=0.324 T1=0.32	SAT TT=1.704 T1=0.96	SAT TT=3.045 T1=3.02	SAT TT=215.13 T1=204.15	SAT TT=0.147 T1=0.13	SAT TT=1.494 T1=1.67	SAT TT=1.263 T1=1.24	SAT TT=0.672 T1=0.73	SAT TT=1.625 T1=0.92	SAT TT=28.974 T1=28.96	? TT=0.008	? (problem) TT=0.041	? (problem) TT=0.043	SAT TT=0.17 T1=0.16	SAT TT=0.68 T1=0.67	SAT TT=1.653 T1=0.9	SAT TT=48.096 T1=45.81	SAT TT=1.594 T1=0.67	SAT TT=0.698 T1=0.67	SAT TT=26.993 T1=26.99	SAT TT=0.584 T1=0.56	SAT TT=0.084 T1=0.08	SAT TT=0.082 T1=0.08	SAT TT=0.669 T1=0.66	SAT TT=0.67 T1=0.66
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_2_40.opb	SAT TT=0.085 T1=0.08	SAT TT=61.651 T1=61.64	SAT TT=132.301 T1=132.32	? (problem) TT=0.044	SAT TT=0.837 T1=0.83	? (problem) TT=0.044	SAT TT=0.794 T1=0.79	? (problem) TT=0.047	SAT TT=0.765 T1=0.76	? (problem) TT=0.047	SAT TT=0.792 T1=0.79	? (TO) TT=1800.08	SAT TT=1.284 T1=1.28	SAT TT=38.939 T1=38.91	SAT TT=852.979 T1=853.12	? TT=0.876	SAT TT=5.02 T1=5.01	SAT TT=3.904 T1=3.12	SAT TT=9.919 T1=9.91	No Cert. TT=1.876	SAT TT=0.395 T1=0.38	SAT TT=22.722 T1=11.69	SAT TT=17.795 T1=17.78	SAT TT=0.684 T1=0.75	SAT TT=17.031 T1=7.97	SAT TT=71.371 T1=71.37	? TT=0.005	? (problem) TT=0.044	? (problem) TT=0.05	SAT TT=102.86 T1=102.95	SAT TT=277.095 T1=277.15	SAT TT=12.862 T1=5.4	? (TO) TT=1800.54	SAT TT=1.842 T1=0.8	SAT TT=14.307 T1=14.29	SAT TT=19.092 T1=19.08	SAT TT=3.791 T1=3.77	SAT TT=0.085 T1=0.08	SAT TT=0.085 T1=0.08	SAT TT=274.497 T1=274.55	SAT TT=263.587 T1=263.62
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_10_4_40.opb	SAT TT=0.084 T1=0.08	SAT TT=2.547 T1=2.54	SAT TT=149.193 T1=149.22	? (problem) TT=0.048	SAT TT=0.963 T1=0.96	? (problem) TT=0.045	SAT TT=0.937 T1=0.93	? (problem) TT=0.043	SAT TT=0.936 T1=0.93	? (problem) TT=0.046	SAT TT=0.911 T1=0.91	? (TO) TT=1800.09	SAT TT=1.863 T1=1.86	SAT TT=1.156 T1=1.06	SAT TT=0.508 T1=0.51	? TT=0.915	SAT TT=1.556 T1=1.55	SAT TT=6.983 T1=6.09	SAT TT=16.31 T1=16.28	SAT TT=219.506 T1=209.74	SAT TT=0.489 T1=0.48	SAT TT=9.355 T1=4.66	SAT TT=15.733 T1=15.71	SAT TT=0.67 T1=1.04	SAT TT=8.772 T1=3.92	SAT TT=66.869 T1=66.87	? TT=0.006	? (problem) TT=0.044	? (problem) TT=0.049	SAT TT=650.548 T1=650.59	SAT TT=292.06 T1=292.21	SAT TT=8.084 T1=3.44	? (TO) TT=1800.57	SAT TT=2.246 T1=1.23	SAT TT=13.205 T1=13.18	SAT TT=13.45 T1=13.44	SAT TT=33.356 T1=33.35	SAT TT=0.084 T1=0.08	SAT TT=0.088 T1=0.09	SAT TT=292.5 T1=292.54	SAT TT=291.456 T1=291.51
Bench name	Best results	bsolo 3.2 (complete)	clasp 2.0.6-R5325 (dec) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: borg-pb 10.05.30 (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: borg pb-dec-11.04.03 (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_2_40.opb		? TT=1799.17	? (TO) TT=1800.01	? (problem) TT=0.07	? (TO) TT=1800.02	? (problem) TT=0.074	? (TO) TT=1800.03	? (problem) TT=0.07	? (TO) TT=1800.02	? (problem) TT=0.069	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? TT=1.734	? TT=1798.02	? (TO) TT=1800.04	? (TO) TT=1800.28	? TT=670.387	? (TO) TT=1800.02	? (TO) TT=1801.08	? TT=1789.8	? (MO) TT=1672.86	? (TO) TT=1800.28	? TT=1796.78	? TT=0.009	? (problem) TT=0.066	? (problem) TT=0.072	? TT=1799.81	? TT=1799.76	? (TO) TT=1800.01	? (TO) TT=1800.84	? (TO) TT=1800.51	? TT=1796.77	? TT=1796.73	? TT=1796.78	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=1799.48	? TT=1799.4
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_3_15.opb	SAT TT=0.209 T1=0.2	SAT TT=18.464 T1=18.48	SAT TT=2.665 T1=2.66	? (problem) TT=0.07	SAT TT=0.766 T1=0.76	? (problem) TT=0.065	SAT TT=0.76 T1=0.75	? (problem) TT=0.07	SAT TT=0.724 T1=0.72	? (problem) TT=0.066	SAT TT=0.734 T1=0.73	? (TO) TT=1800.02	SAT TT=0.612 T1=0.6	SAT TT=0.857 T1=0.79	SAT TT=0.277 T1=0.27	? TT=1.772	SAT TT=4.533 T1=4.53	SAT TT=3.733 T1=2.84	SAT TT=8.663 T1=8.62	No Cert. TT=25.753	SAT TT=0.677 T1=0.62	SAT TT=9.873 T1=5.06	SAT TT=9.771 T1=9.73	SAT TT=0.933 T1=0.97	SAT TT=8.633 T1=3.58	SAT TT=17.467 T1=17.44	? TT=0.007	? (problem) TT=0.063	? (problem) TT=0.073	SAT TT=0.376 T1=0.37	SAT TT=0.326 T1=0.32	SAT TT=9.023 T1=3.22	SAT TT=768.89 T1=762.67	SAT TT=2.305 T1=0.92	SAT TT=8.762 T1=8.71	SAT TT=0.373 T1=0.35	SAT TT=1.89 T1=1.85	SAT TT=0.209 T1=0.2	SAT TT=0.21 T1=0.2	SAT TT=0.317 T1=0.31	SAT TT=0.33 T1=0.32
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_5_15.opb	SAT TT=0.186 T1=0.18	SAT TT=18.689 T1=18.69	SAT TT=3.251 T1=3.25	? (problem) TT=0.072	SAT TT=0.743 T1=0.74	? (problem) TT=0.063	SAT TT=0.703 T1=0.69	? (problem) TT=0.061	SAT TT=0.675 T1=0.67	? (problem) TT=0.064	SAT TT=0.699 T1=0.69	? (TO) TT=1800.07	SAT TT=0.775 T1=0.77	SAT TT=0.763 T1=0.72	SAT TT=0.297 T1=0.3	? TT=1.814	SAT TT=4.276 T1=4.27	SAT TT=3.713 T1=2.74	SAT TT=7.619 T1=7.57	SAT TT=216.767 T1=207.27	SAT TT=0.472 T1=0.42	SAT TT=13.262 T1=7.29	SAT TT=14.683 T1=14.65	SAT TT=0.984 T1=1.8	SAT TT=10.613 T1=4.62	SAT TT=41.425 T1=41.4	? TT=0.009	? (problem) TT=0.061	? (problem) TT=0.067	SAT TT=0.236 T1=0.23	SAT TT=0.226 T1=0.21	SAT TT=8.401 T1=3.11	SAT TT=31.379 T1=30	SAT TT=2.293 T1=0.92	SAT TT=10.019 T1=9.98	SAT TT=0.549 T1=0.52	SAT TT=5.436 T1=5.38	SAT TT=0.194 T1=0.19	SAT TT=0.186 T1=0.18	SAT TT=0.225 T1=0.21	SAT TT=0.225 T1=0.21
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_200_25_5_40.opb		? TT=1798.01	? (TO) TT=1800.01	? (problem) TT=0.063	? (TO) TT=1800.07	? (problem) TT=0.065	? (TO) TT=1800.09	? (problem) TT=0.064	? (TO) TT=1800	? (problem) TT=0.072	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.11	? TT=1.804	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.26	? TT=670.877	? (TO) TT=1800.04	? (TO) TT=1800.99	? TT=1789.93	? (MO) TT=1620.27	? (TO) TT=1800.55	? TT=1796.77	? TT=0.005	? (problem) TT=0.065	? (problem) TT=0.069	? TT=1799.52	? TT=1799.48	? (TO) TT=1800.69	? (TO) TT=1800.4	? (TO) TT=1800.09	? TT=1796.8	? TT=1796.78	? TT=1796.79	? (TO) TT=1800.03	? (TO) TT=1800.06	? TT=1799.51	? TT=1799.9
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_1_80.opb	SAT TT=0.231 T1=0.23	SAT TT=312.613 T1=312.76	SAT TT=64.436 T1=64.46	? (problem) TT=0.129	SAT TT=2.747 T1=2.74	? (problem) TT=0.127	SAT TT=3.019 T1=3.01	? (problem) TT=0.125	SAT TT=2.796 T1=2.79	? (problem) TT=0.134	SAT TT=2.779 T1=2.77	? (TO) TT=1800.08	SAT TT=2.541 T1=2.53	SAT TT=15.855 T1=15.77	SAT TT=0.357 T1=0.35	? TT=2.264	SAT TT=312.464 T1=312.62	SAT TT=10.043 T1=8.88	SAT TT=49.404 T1=49.36	No Cert. TT=6.834	SAT TT=0.706 T1=0.64	SAT TT=32.918 T1=17.2	SAT TT=41.92 T1=41.89	SAT TT=32.494 T1=32.5	SAT TT=31.07 T1=15.18	SAT TT=497.164 T1=497.22	? TT=0.008	? (problem) TT=0.128	? (problem) TT=0.13	SAT TT=1418.78 T1=1419.25	SAT TT=108.34 T1=108.44	SAT TT=17.612 T1=7.65	? (TO) TT=1800.39	SAT TT=2.864 T1=1.28	SAT TT=82.925 T1=82.89	SAT TT=527.623 T1=527.69	SAT TT=7.355 T1=7.3	SAT TT=0.231 T1=0.23	SAT TT=0.255 T1=0.25	SAT TT=113.657 T1=113.68	SAT TT=106.1 T1=106.11
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_2_15.opb	SAT TT=0.026 T1=0.02	SAT TT=3.69 T1=3.69	SAT TT=0.026 T1=0.02	? (problem) TT=0.124	SAT TT=4.092 T1=4.11	? (problem) TT=0.142	SAT TT=3.91 T1=3.91	? (problem) TT=0.12	SAT TT=3.953 T1=3.95	? (problem) TT=0.119	SAT TT=4.278 T1=4.27	? (TO) TT=1800.06	SAT TT=1.711 T1=1.7	SAT TT=9.71 T1=9.63	SAT TT=0.339 T1=0.34	? TT=2.245	SAT TT=0.915 T1=0.91	SAT TT=5.494 T1=4.43	SAT TT=0.373 T1=0.33	SAT TT=218.45 T1=208.49	SAT TT=0.508 T1=0.44	SAT TT=3.451 T1=3.08	SAT TT=0.279 T1=0.24	SAT TT=2.403 T1=2.36	SAT TT=2.687 T1=1.12	SAT TT=0.466 T1=0.44	? TT=0.006	? (problem) TT=0.143	? (problem) TT=0.132	SAT TT=2.013 T1=2.01	SAT TT=1.912 T1=1.91	SAT TT=4.041 T1=1.65	SAT TT=136.153 T1=133.22	SAT TT=2.774 T1=1.24	SAT TT=0.389 T1=0.46	SAT TT=0.396 T1=0.36	SAT TT=1.302 T1=1.25	SAT TT=0.247 T1=0.24	SAT TT=0.254 T1=0.25	SAT TT=1.908 T1=1.9	SAT TT=1.908 T1=1.9
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_3_80.opb	SAT TT=0.229 T1=0.22	? TT=1798.01	SAT TT=107.642 T1=107.66	? (problem) TT=0.128	SAT TT=2.94 T1=2.93	? (problem) TT=0.129	SAT TT=2.849 T1=2.84	? (problem) TT=0.125	SAT TT=2.546 T1=2.53	? (problem) TT=0.129	SAT TT=2.858 T1=2.85	? (TO) TT=1800.05	SAT TT=13.648 T1=13.64	SAT TT=17.593 T1=17.53	SAT TT=0.436 T1=0.43	? TT=2.265	? TT=1798.18	SAT TT=5.424 T1=4.25	SAT TT=54.744 T1=54.7	No Cert. TT=4.207	SAT TT=0.812 T1=0.75	SAT TT=33.908 T1=17.2	SAT TT=48.568 T1=48.55	SAT TT=31.71 T1=31.72	SAT TT=34.38 T1=16.66	SAT TT=665.251 T1=665.32	? TT=0.008	? (problem) TT=0.125	? (problem) TT=0.137	SAT TT=525.603 T1=525.62	SAT TT=244.163 T1=244.21	SAT TT=18.34 T1=8.13	SAT TT=1672.65 T1=1593.7	SAT TT=2.705 T1=1.14	SAT TT=81.601 T1=81.56	SAT TT=639.281 T1=639.36	SAT TT=6.896 T1=6.82	SAT TT=0.235 T1=0.23	SAT TT=0.229 T1=0.22	SAT TT=244.005 T1=243.99	SAT TT=240.61 T1=240.71
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_10_5_80.opb	SAT TT=0.249 T1=0.24	? TT=1798.01	SAT TT=90.955 T1=90.97	? (problem) TT=0.133	SAT TT=2.649 T1=2.64	? (problem) TT=0.125	SAT TT=2.555 T1=2.75	? (problem) TT=0.124	SAT TT=2.552 T1=2.55	? (problem) TT=0.131	SAT TT=2.322 T1=2.31	? (TO) TT=1800.03	SAT TT=12.39 T1=12.38	SAT TT=25.481 T1=25.4	SAT TT=0.42 T1=0.41	? TT=2.333	? TT=1798.05	SAT TT=10.292 T1=9.12	SAT TT=52.06 T1=52.05	No Cert. TT=22.407	SAT TT=0.557 T1=0.49	SAT TT=39.678 T1=20.1	SAT TT=66.19 T1=66.17	SAT TT=10.266 T1=10.27	SAT TT=29.569 T1=14.66	SAT TT=575.572 T1=575.64	? TT=0.012	? (problem) TT=0.124	? (problem) TT=0.125	SAT TT=150.04 T1=150.12	? TT=1799.53	SAT TT=16.25 T1=7.12	? (TO) TT=1800.04	SAT TT=3.572 T1=1.95	SAT TT=85.651 T1=85.62	SAT TT=589.344 T1=589.41	SAT TT=8.395 T1=8.34	SAT TT=0.249 T1=0.24	SAT TT=0.257 T1=0.25	? TT=1800.01	? TT=1800.03
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_3_80.opb		? TT=1798.13	? (TO) TT=1800.1	? (problem) TT=0.196	? (TO) TT=1800.12	? (problem) TT=0.178	? (TO) TT=1800.05	? (problem) TT=0.178	? (TO) TT=1800.08	? (problem) TT=0.186	? (TO) TT=1800.06	? (TO) TT=1800.16	? (TO) TT=1800.1	? TT=296.432	? (TO) TT=1800.06	? TT=9.575	? TT=1798.06	? TT=1491.66	? TT=1796.52	No Cert. TT=6.985	? (TO) TT=1800.11	? (TO) TT=1800.17	? TT=1789.91	? (MO) TT=1665.4	? (TO) TT=1800.11	? TT=1796.82	? TT=0.008	? (problem) TT=0.181	? (problem) TT=0.176	? TT=1799.4	? TT=1799.77	? (TO) TT=1800.09	? (TO) TT=1800.69	? (TO) TT=1800.03	? TT=1796.83	? TT=1796.79	? TT=1796.87	? (TO) TT=1800.1	? (TO) TT=1800.02	? TT=1799.86	? TT=1799.42
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_5_15.opb	SAT TT=0.093 T1=0.09	SAT TT=70.063 T1=70.07	SAT TT=0.093 T1=0.09	? (problem) TT=0.176	SAT TT=3.82 T1=4.14	? (problem) TT=0.164	SAT TT=3.692 T1=3.67	? (problem) TT=0.166	SAT TT=3.307 T1=3.3	? (problem) TT=0.173	SAT TT=3.719 T1=3.71	SAT TT=132.632 T1=132.66	SAT TT=3.036 T1=3.02	SAT TT=4.769 T1=4.56	SAT TT=1.423 T1=1.42	? TT=9.594	SAT TT=12.236 T1=12.23	SAT TT=18.462 T1=17.05	SAT TT=4.307 T1=4.17	No Cert. TT=5.704	SAT TT=1.421 T1=1.1	SAT TT=14.671 T1=14.22	SAT TT=19.09 T1=19	SAT TT=3.648 T1=2.35	SAT TT=3.554 T1=1.41	SAT TT=618.504 T1=618.56	? TT=0.007	? (problem) TT=0.166	? (problem) TT=0.169	SAT TT=2.306 T1=2.3	SAT TT=2.157 T1=2.15	SAT TT=4.233 T1=1.45	SAT TT=306.129 T1=301.2	SAT TT=3.843 T1=2.03	SAT TT=26.773 T1=26.67	SAT TT=280.737 T1=280.73	SAT TT=3.735 T1=3.62	SAT TT=0.629 T1=0.62	SAT TT=0.579 T1=0.57	SAT TT=2.155 T1=2.14	SAT TT=2.154 T1=2.14
Bench name	Best results	bsolo 3.2 (complete)	clasp 2.0.6-R5325 (dec) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: borg-pb 10.05.30 (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: borg pb-dec-11.04.03 (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_25_5_80.opb		? TT=1798	? (TO) TT=1800.09	? (problem) TT=0.185	? (TO) TT=1800.12	? (problem) TT=0.18	? (TO) TT=1800.05	? (problem) TT=0.18	? (TO) TT=1800.09	? (problem) TT=0.182	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? TT=588.674	? (TO) TT=1800.09	? TT=9.703	? TT=1798.06	? (exit code) TT=1024.36	? TT=1796.92	No Cert. TT=16.933	? (TO) TT=1800.06	? (TO) TT=1800.03	? TT=1789.87	? (MO) TT=1661.52	? (TO) TT=1800.14	? TT=1796.8	? TT=0.007	? (problem) TT=0.18	? (problem) TT=0.179	? TT=1799.81	? TT=1799.46	? (TO) TT=1800.71	? (TO) TT=1807.68	? (TO) TT=1800.75	? TT=1796.83	? TT=1796.8	? TT=1796.88	? (TO) TT=1800.1	? (TO) TT=1800.1	? TT=1799.81	? TT=1799.94
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_4_15.opb	SAT TT=1.278 T1=1.27	SAT TT=179.401 T1=179.42	SAT TT=8.914 T1=8.9	? (problem) TT=0.303	SAT TT=3.002 T1=3.12	? (problem) TT=0.292	SAT TT=3.177 T1=3.16	? (problem) TT=0.289	SAT TT=2.998 T1=3.15	? (problem) TT=0.292	SAT TT=2.981 T1=2.96	? (TO) TT=1800.11	SAT TT=9.272 T1=9.25	SAT TT=7.732 T1=7.3	SAT TT=6.273 T1=6.26	? TT=90.2	SAT TT=179.373 T1=179.39	SAT TT=131.19 T1=129.64	SAT TT=97.452 T1=97.14	? TT=670.039	SAT TT=5.628 T1=3.97	SAT TT=115.316 T1=114.17	SAT TT=94.362 T1=94.07	SAT TT=6.8 T1=7.36	SAT TT=3.481 T1=1.58	SAT TT=228.218 T1=228.16	? TT=0.009	? (problem) TT=0.28	? (problem) TT=0.291	SAT TT=3.539 T1=3.53	SAT TT=13.249 T1=13.26	SAT TT=4.739 T1=1.89	SAT TT=984.01 T1=979.82	SAT TT=4.092 T1=2.05	SAT TT=74.527 T1=74.28	SAT TT=248.499 T1=248.43	SAT TT=34.483 T1=34.22	SAT TT=1.278 T1=1.27	SAT TT=1.337 T1=1.33	SAT TT=12.576 T1=12.58	SAT TT=12.317 T1=12.33
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_500_60_5_15.opb	SAT TT=1.222 T1=1.21	SAT TT=179.392 T1=179.43	SAT TT=13.812 T1=13.8	? (problem) TT=0.302	SAT TT=3.971 T1=3.96	? (problem) TT=0.3	SAT TT=4.338 T1=4.4	? (problem) TT=0.286	SAT TT=4.029 T1=4.12	? (problem) TT=0.291	SAT TT=4.036 T1=4.15	? (TO) TT=1800.1	SAT TT=7.125 T1=7.1	SAT TT=7.72 T1=7.28	SAT TT=6.273 T1=6.26	? TT=92.36	SAT TT=179.349 T1=179.37	SAT TT=133.54 T1=132	SAT TT=53.156 T1=52.94	? TT=672.918	SAT TT=4.827 T1=3.13	SAT TT=164.45 T1=163.39	SAT TT=118.291 T1=118.05	SAT TT=7.349 T1=7.25	SAT TT=3.513 T1=1.57	SAT TT=415.978 T1=415.94	? TT=0.008	? (problem) TT=0.288	? (problem) TT=0.294	SAT TT=6.053 T1=6.05	SAT TT=3.945 T1=4.03	SAT TT=4.862 T1=1.91	SAT TT=435.29 T1=431.85	SAT TT=4.214 T1=2.14	SAT TT=91.793 T1=91.55	SAT TT=235.167 T1=235.12	SAT TT=39.769 T1=39.5	SAT TT=1.222 T1=1.21	SAT TT=1.326 T1=1.31	SAT TT=3.822 T1=3.92	SAT TT=3.663 T1=3.64
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_1_15.opb	UNSAT TT=1448.34	? (TO) TT=1800.12	? (TO) TT=1800.01	? (problem) TT=0.008	? (TO) TT=1800.13	? (problem) TT=0.009	? (TO) TT=1800.09	? (problem) TT=0.008	? (TO) TT=1800.09	? (problem) TT=0.009	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.03	? TT=0.334	? TT=1798	? (TO) TT=1800.68	? (TO) TT=1800.23	No Cert. TT=41.172	UNSAT TT=1448.34	? (TO) TT=1800.12	? TT=1789.74	? (MO) TT=1687.49	? (TO) TT=1800.16	? TT=1796.7	? TT=0.005	? (problem) TT=0.011	? (problem) TT=0.009	? TT=1799.42	? TT=1799.51	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.58	? TT=1796.74	? TT=1796.86	? TT=1796.75	? (TO) TT=1800.06	? (TO) TT=1800.09	? TT=1799.61	? TT=1799.82
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_2_5.opb	SAT TT=0.004 T1=0	SAT TT=0.25 T1=0.25	SAT TT=0.004 T1=0	? (problem) TT=0.008	SAT TT=0.166 T1=0.16	? (problem) TT=0.011	SAT TT=0.158 T1=0.15	? (problem) TT=0.009	SAT TT=0.155 T1=0.15	? (problem) TT=0.009	SAT TT=0.156 T1=0.15	SAT TT=6.863 T1=6.86	SAT TT=0.058 T1=0.05	SAT TT=0.09 T1=0.07	SAT TT=0.016 T1=0.01	? TT=0.333	SAT TT=0.066 T1=0.06	SAT TT=0.656 T1=0.34	SAT TT=0.104 T1=0.09	No Cert. TT=1.109	SAT TT=0.035 T1=0.03	SAT TT=0.554 T1=1.25	SAT TT=0.139 T1=0.13	SAT TT=0.522 T1=0.58	SAT TT=0.513 T1=0.74	SAT TT=0.074 T1=0.06	? TT=0.005	? (problem) TT=0.009	? (problem) TT=0.008	SAT TT=0.005 T1=0.01	SAT TT=0.005 T1=0.01	SAT TT=0.563 T1=0.74	SAT TT=1.194 T1=0.66	SAT TT=0.564 T1=0.31	SAT TT=0.358 T1=0.35	SAT TT=0.111 T1=0.1	SAT TT=0.083 T1=0.07	SAT TT=0.02 T1=0.02	SAT TT=0.019 T1=0.01	SAT TT=0.005 T1=0.01	SAT TT=0.007 T1=0.01
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_3_15.opb	UNSAT TT=1448.56	? TT=1798.01	? (TO) TT=1800.03	? (problem) TT=0.011	? (TO) TT=1800.13	? (problem) TT=0.013	? (TO) TT=1800.06	? (problem) TT=0.009	? (TO) TT=1800.08	? (problem) TT=0.009	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.02	? TT=0.323	? TT=1798.01	? (TO) TT=1800.57	? (TO) TT=1800.25	? TT=671.901	UNSAT TT=1448.56	? (TO) TT=1800.12	? TT=1789.74	? (MO) TT=1687.16	? (TO) TT=1800.04	? TT=1796.8	? TT=0.005	? (problem) TT=0.008	? (problem) TT=0.011	? (TO) TT=1800.04	? TT=1799.42	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.05	? TT=1796.76	? TT=1796.76	UNSAT TT=1536.8	? (TO) TT=1800.07	? (TO) TT=1800.04	? TT=1799.83	? TT=1799.38
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_3_5.opb	SAT TT=0.005 T1=0	SAT TT=0.241 T1=0.24	SAT TT=0.005 T1=0	? (problem) TT=0.006	SAT TT=0.162 T1=0.16	? (problem) TT=0.008	SAT TT=0.152 T1=0.15	? (problem) TT=0.007	SAT TT=0.154 T1=0.15	? (problem) TT=0.009	SAT TT=0.153 T1=0.15	SAT TT=48.752 T1=48.77	SAT TT=0.068 T1=0.06	SAT TT=0.089 T1=0.08	SAT TT=0.015 T1=0.01	? TT=0.345	SAT TT=0.065 T1=0.06	SAT TT=0.715 T1=0.37	SAT TT=0.114 T1=0.1	No Cert. TT=0.925	SAT TT=0.033 T1=0.03	SAT TT=0.585 T1=1.25	SAT TT=0.192 T1=0.18	SAT TT=0.535 T1=1.37	SAT TT=0.534 T1=0.76	SAT TT=0.077 T1=0.07	? TT=0.005	? (problem) TT=0.009	? (problem) TT=0.009	SAT TT=0.007 T1=0.01	SAT TT=0.005 T1=0.01	SAT TT=0.533 T1=0.76	SAT TT=0.794 T1=0.49	SAT TT=0.585 T1=0.33	SAT TT=0.551 T1=0.54	SAT TT=0.094 T1=0.08	SAT TT=0.082 T1=0.07	SAT TT=0.02 T1=0.02	SAT TT=0.022 T1=0.02	SAT TT=0.006 T1=0.01	SAT TT=0.006 T1=0.01
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_10_5_15.opb	UNSAT TT=1561.61	? TT=1798.01	? (TO) TT=1800.03	? (problem) TT=0.008	? (TO) TT=1800.12	? (problem) TT=0.011	? (TO) TT=1800.1	? (problem) TT=0.008	? (TO) TT=1800.08	? (problem) TT=0.009	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.02	? (TO) TT=1800.04	? (TO) TT=1800.1	? TT=0.315	? TT=1798.01	? (TO) TT=1800.27	? (TO) TT=1800.33	No Cert. TT=1.157	UNSAT TT=1561.61	? (TO) TT=1801.19	? TT=1789.75	? (MO) TT=1687.56	? (TO) TT=1801	? TT=1796.76	? TT=0.008	? (problem) TT=0.01	? (problem) TT=0.011	? (TO) TT=1800.43	? TT=1799.95	? (TO) TT=1800.04	? (TO) TT=1800.06	? (TO) TT=1800.48	? TT=1796.76	? TT=1796.76	? TT=1796.72	? (TO) TT=1800.07	? (TO) TT=1800.09	? TT=1799.95	? TT=1799.54
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_3_15.opb	UNSAT TT=0.835	UNSAT TT=245.466	UNSAT TT=10.779	? (problem) TT=0.014	UNSAT TT=27.828	? (problem) TT=0.015	UNSAT TT=28.05	? (problem) TT=0.014	UNSAT TT=29.25	? (problem) TT=0.013	UNSAT TT=27.66	? (TO) TT=1800.03	UNSAT TT=11.291	UNSAT TT=30.261	UNSAT TT=7.145	? TT=0.676	UNSAT TT=154.437	UNSAT TT=302.33	UNSAT TT=8.532	UNSAT TT=438.522	UNSAT TT=12.902	UNSAT TT=88.172	UNSAT TT=51.652	UNSAT TT=14.5	UNSAT TT=85.001	UNSAT TT=0.835	? TT=0.006	? (problem) TT=0.014	? (problem) TT=0.015	UNSAT TT=1040.63	UNSAT TT=787.39	UNSAT TT=59.116	UNSAT TT=29.753	UNSAT TT=43.108	UNSAT TT=21.498	UNSAT TT=1.095	UNSAT TT=27.036	UNSAT TT=409.303	UNSAT TT=425.136	UNSAT TT=845.612	UNSAT TT=843.49
normalized-PB07/SATUNSAT-SMALLINT-NLC/ submittedPB07/manquinho/dbsg/ normalized-dbsg_50_25_5_15.opb	UNSAT TT=0.743	UNSAT TT=339.693	UNSAT TT=10.669	? (problem) TT=0.014	UNSAT TT=24.499	? (problem) TT=0.016	UNSAT TT=24.26	? (problem) TT=0.014	UNSAT TT=24.51	? (problem) TT=0.015	UNSAT TT=24.35	? (TO) TT=1800.04	UNSAT TT=17.291	UNSAT TT=32.317	UNSAT TT=7.033	? TT=0.676	UNSAT TT=345.558	UNSAT TT=776.17	UNSAT TT=8.144	UNSAT TT=437.671	UNSAT TT=13.288	UNSAT TT=56.267	UNSAT TT=40.638	UNSAT TT=15.546	UNSAT TT=55.886	UNSAT TT=0.743	? TT=0.009	? (problem) TT=0.014	? (problem) TT=0.012	UNSAT TT=1130	UNSAT TT=832.39	UNSAT TT=40.147	UNSAT TT=27.93	UNSAT TT=54.594	UNSAT TT=24.403	UNSAT TT=0.756	UNSAT TT=28.352	UNSAT TT=565.021	UNSAT TT=541.678	UNSAT TT=706.539	UNSAT TT=807.97

Statistics		bsolo 3.2 (complete)	clasp 2.0.6-R5325 (dec) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: borg-pb 10.05.30 (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: borg pb-dec-11.04.03 (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
Number of times the solver is able to give the best known answer		18	20	0	20	0	19	0	19	0	19	7	20	20	20	0	18	20	22	8	24	20	22	21	20	22	0	0	0	20	19	20	16	21	22	22	23	20	20	19	19
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	5	0	0	0	0	0	0	0	0	0	0	0	1	0	2	0	0	0	3	0	0	0	0	4	0	0	0	0	1	0	0	0	0	0	0	7	3	3	1