PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Weighted Dominating Set

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Weighted Dominating Set

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (opt) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench name	Best results on this instance	bsolo 3.2 (complete)	clasp 2.0.6-R5325 (opt) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_10.opb.PB06.opb	SAT f=188 TT=1796.77 T1=862.48	SAT f=213 TT=1798.01 T1=33.21	SAT (TO) f=204 TT=1800.02 T1=1349.75	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.08	SAT (TO) f=219 TT=1800.07 T1=19.06	SAT (TO) f=216 TT=1800.06 T1=869.15	SAT (TO) f=210 TT=1800.15 T1=1132.92	SAT f=211 TT=1783 T1=286.34	? (exit code) TT=669.88	SAT f=213 TT=1798.01 T1=31.78	SAT (TO) f=214 TT=1800.09 T1=131.78	SAT (TO) f=188 TT=1800.05 T1=349.4	? (TO) TT=1800.28	SAT (TO) f=207 TT=1800.59 T1=874.48	SAT f=191 TT=1789.77 T1=148.47	SAT (TO) f=208 TT=1800.15 T1=59.51	SAT f=188 TT=1796.77 T1=862.48	SAT (TO) f=217 TT=1800.05 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.13	SAT (TO) f=214 TT=1800.12 T1=900.31	SAT (TO) f=214 TT=1800.19 T1=900.31	SAT (TO) f=219 TT=1800.01 T1=496.97	SAT (TO) f=223 TT=1800.66 T1=0.23	SAT (TO) f=213 TT=1800.09 T1=117.61	SAT f=191 TT=1796.76 T1=143.89	SAT f=191 TT=1796.76 T1=145.2	SAT f=189 TT=1796.75 T1=118.74	? (TO) TT=1800.08	? (TO) TT=1800.09	? TT=1799.57	? TT=1799.85
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_11.opb.PB06.opb	SAT f=189 TT=1796.73 T1=93.71	SAT f=218 TT=1798 T1=200.37	SAT (TO) f=207 TT=1800.06 T1=1715.07	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.11	SAT (TO) f=225 TT=1800.07 T1=11.85	SAT (TO) f=213 TT=1800.06 T1=9.33	SAT (TO) f=208 TT=1802.12 T1=0.17	SAT f=214 TT=1783.01 T1=136.94	SAT (TO) f=215 TT=1800.01 T1=313.03	SAT f=214 TT=1798.01 T1=97.35	SAT (TO) f=214 TT=1800.06 T1=518.2	SAT (TO) f=188 TT=1800.05 T1=458.45	? (TO) TT=1800.06	SAT (TO) f=212 TT=1801.28 T1=194.56	SAT f=191 TT=1789.78 T1=259.32	SAT (TO) f=211 TT=1800.67 T1=38.64	SAT f=191 TT=1796.75 T1=152.17	SAT (TO) f=220 TT=1800.03 T1=1800.4	? (TO) TT=1800.07	? (TO) TT=1800.09	SAT (TO) f=216 TT=1800.41 T1=900.31	SAT (TO) f=216 TT=1800.45 T1=900.31	SAT (TO) f=219 TT=1800.12 T1=133.23	SAT (TO) f=227 TT=1800.66 T1=0.26	SAT (TO) f=214 TT=1800.39 T1=669.89	SAT f=189 TT=1796.73 T1=207.92	SAT f=189 TT=1796.77 T1=208.29	SAT f=189 TT=1796.75 T1=93.71	? (TO) TT=1800.1	? (TO) TT=1800.06	? TT=1799.75	? TT=1799.85
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_12.opb.PB06.opb	SAT f=183 TT=1789.75 T1=746.25	SAT f=212 TT=1798.01 T1=1787.16	SAT (TO) f=200 TT=1800.02 T1=1565.3	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT (TO) f=215 TT=1800.08 T1=28.67	SAT (TO) f=210 TT=1800.04 T1=167.65	SAT (TO) f=209 TT=1800.19 T1=0.31	SAT f=208 TT=1783.01 T1=1039.16	SAT (TO) f=208 TT=1800.01 T1=86.24	SAT f=212 TT=1798.69 T1=222.28	SAT (TO) f=213 TT=1800.09 T1=42.88	SAT (TO) f=183 TT=1800.04 T1=350.63	? (TO) TT=1800.31	SAT (TO) f=206 TT=1800.68 T1=646.44	SAT f=183 TT=1789.75 T1=746.25	SAT (TO) f=205 TT=1800.95 T1=64.01	SAT f=185 TT=1796.76 T1=52.42	SAT (TO) f=210 TT=1800.05 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.13	SAT (TO) f=207 TT=1800.1 T1=900.31	SAT (TO) f=207 TT=1800.05 T1=900.31	SAT (TO) f=214 TT=1800.13 T1=516.31	SAT (TO) f=217 TT=1800.65 T1=0.73	SAT (TO) f=209 TT=1800.08 T1=215.05	SAT f=184 TT=1796.75 T1=1700.3	SAT f=184 TT=1796.76 T1=1746.3	SAT f=185 TT=1796.78 T1=186.76	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=1799.5	? TT=1799.56
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_13.opb.PB06.opb	SAT f=188 TT=1796.75 T1=221.82	SAT f=220 TT=1798 T1=123.2	SAT (TO) f=206 TT=1800.02 T1=1034.95	? (TO) TT=1800.13	? (TO) TT=1800.14	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.09	? (TO) TT=1800.1	SAT (TO) f=227 TT=1800.07 T1=0.27	SAT (TO) f=222 TT=1800.07 T1=26.47	SAT (TO) f=218 TT=1802.11 T1=3.06	SAT f=213 TT=1783.01 T1=266.96	SAT (TO) f=218 TT=1800.09 T1=1836.13	SAT f=218 TT=1798 T1=256.27	SAT (TO) f=215 TT=1800.03 T1=1286.1	SAT (TO) f=192 TT=1800.08 T1=1735.88	? (TO) TT=1800.28	SAT (TO) f=214 TT=1800.68 T1=199.66	SAT f=193 TT=1789.76 T1=279.37	SAT (TO) f=212 TT=1800.15 T1=579.96	SAT f=190 TT=1796.76 T1=259.77	SAT (TO) f=219 TT=1800.09 T1=1800.5	? (TO) TT=1800.09	? (TO) TT=1800.08	SAT (TO) f=216 TT=1800.16 T1=900.41	SAT (TO) f=216 TT=1800.13 T1=900.31	SAT (TO) f=219 TT=1800.13 T1=551.46	SAT (TO) f=222 TT=1800.02 T1=0.31	SAT (TO) f=212 TT=1800.05 T1=102.12	SAT f=188 TT=1796.75 T1=225.44	SAT f=188 TT=1796.75 T1=221.82	SAT f=193 TT=1796.74 T1=339.75	? (TO) TT=1800.11	? (TO) TT=1800.02	? TT=1799.85	? TT=1799.84
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_14.opb.PB06.opb	SAT f=189 TT=1789.75 T1=414.17	SAT f=217 TT=1798 T1=46.38	SAT (TO) f=206 TT=1800.03 T1=307.58	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.12	? (TO) TT=1800.08	SAT (TO) f=224 TT=1800.08 T1=3.74	SAT (TO) f=219 TT=1800.06 T1=10.5	SAT (TO) f=213 TT=1802.05 T1=0.21	SAT f=213 TT=1783 T1=1041.14	SAT (TO) f=213 TT=1800.01 T1=874.97	SAT f=216 TT=1798 T1=633.55	SAT (TO) f=217 TT=1800.06 T1=56.3	SAT (TO) f=188 TT=1800.08 T1=823.15	? (TO) TT=1800.02	SAT (TO) f=211 TT=1800.17 T1=133.22	SAT f=189 TT=1789.75 T1=414.17	SAT (TO) f=211 TT=1800.16 T1=59.7	SAT f=189 TT=1796.75 T1=447.24	SAT (TO) f=214 TT=1800.04 T1=1800.4	? (TO) TT=1800.14	? (TO) TT=1800.08	SAT (TO) f=213 TT=1800.14 T1=900.31	SAT (TO) f=213 TT=1800.05 T1=900.31	SAT (TO) f=217 TT=1800.48 T1=530.28	SAT (TO) f=223 TT=1800.52 T1=0.27	SAT (TO) f=212 TT=1800.05 T1=587.79	SAT f=192 TT=1796.77 T1=681.74	SAT f=192 TT=1796.77 T1=682.09	SAT f=191 TT=1796.74 T1=288.59	? (TO) TT=1800.02	? (TO) TT=1800.02	? TT=1799.48	? TT=1799.56
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_15.opb.PB06.opb	SAT f=192 TT=1789.74 T1=395.21	SAT f=216 TT=1798.01 T1=342.44	SAT (TO) f=207 TT=1800.03 T1=327.6	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.04	? (TO) TT=1800.11	SAT (TO) f=225 TT=1800.06 T1=196.68	SAT (TO) f=221 TT=1800.04 T1=123.47	SAT (TO) f=216 TT=1802.09 T1=194.11	SAT f=213 TT=1783.01 T1=1492.62	SAT (TO) f=216 TT=1800.02 T1=1585.54	SAT f=217 TT=1798 T1=751.33	SAT (TO) f=216 TT=1800.01 T1=541.1	SAT f=193 TT=1797.94 T1=336.22	? (TO) TT=1800.03	SAT (TO) f=212 TT=1800.11 T1=143.76	SAT f=192 TT=1789.74 T1=395.21	SAT (TO) f=212 TT=1800.13 T1=534.71	SAT f=195 TT=1796.74 T1=431.17	SAT (TO) f=218 TT=1800.02 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.05	SAT (TO) f=217 TT=1800.5 T1=900.31	SAT (TO) f=217 TT=1800.09 T1=900.31	SAT (TO) f=218 TT=1801.67 T1=162.86	SAT (TO) f=231 TT=1800.02 T1=0.33	SAT (TO) f=214 TT=1800.06 T1=1210.06	SAT f=194 TT=1796.77 T1=656.37	SAT f=194 TT=1796.77 T1=650.94	SAT f=196 TT=1796.77 T1=79.37	? (TO) TT=1800.11	? (TO) TT=1800.01	? TT=1799.45	? TT=1799.89
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_16.opb.PB06.opb	SAT f=188 TT=1796.76 T1=228.22	SAT f=217 TT=1798 T1=766.5	SAT (TO) f=206 TT=1800.03 T1=1666.4	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.08	SAT (TO) f=226 TT=1800.06 T1=8.65	SAT (TO) f=219 TT=1800.06 T1=1040.92	SAT (TO) f=214 TT=1802.11 T1=0.1	SAT f=215 TT=1783 T1=113.31	SAT (TO) f=215 TT=1800.99 T1=424.49	SAT f=218 TT=1798.01 T1=192.8	SAT (TO) f=218 TT=1800.09 T1=239.09	SAT (TO) f=193 TT=1800.07 T1=111.89	? (TO) TT=1800.25	SAT (TO) f=212 TT=1801.34 T1=725.94	SAT f=191 TT=1789.76 T1=653.31	SAT (TO) f=212 TT=1801.51 T1=721.17	SAT f=188 TT=1796.76 T1=1156.78	SAT (TO) f=219 TT=1800.04 T1=1800.4	? (TO) TT=1800.11	? (TO) TT=1800.11	SAT (TO) f=216 TT=1800.42 T1=900.31	SAT (TO) f=216 TT=1800.44 T1=900.31	SAT (TO) f=222 TT=1800.44 T1=136.01	SAT (TO) f=230 TT=1800.06 T1=0.25	SAT (TO) f=213 TT=1800.02 T1=151.22	SAT f=192 TT=1796.75 T1=382.03	SAT f=192 TT=1796.76 T1=380.8	SAT f=188 TT=1796.77 T1=228.22	? (TO) TT=1800.02	? (TO) TT=1800.1	? TT=1799.37	? TT=1799.76
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_17.opb.PB06.opb	SAT f=193 TT=1796.77 T1=1045.64	SAT f=219 TT=1798.01 T1=1203.84	SAT (TO) f=211 TT=1800.03 T1=679.79	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.11	SAT (TO) f=230 TT=1800.07 T1=1364.95	SAT (TO) f=222 TT=1800.06 T1=5.31	SAT (TO) f=215 TT=1802.12 T1=242.64	SAT f=219 TT=1783.01 T1=0.64	SAT (TO) f=221 TT=1800.52 T1=198.94	SAT f=222 TT=1798.05 T1=209.26	SAT (TO) f=220 TT=1800.01 T1=1298.97	SAT (TO) f=195 TT=1800.06 T1=1181.76	? (TO) TT=1800.03	SAT (TO) f=217 TT=1801.14 T1=49.6	SAT f=199 TT=1789.75 T1=196.13	SAT (TO) f=217 TT=1800.28 T1=915.52	SAT f=197 TT=1796.78 T1=254.15	SAT (TO) f=220 TT=1800.08 T1=1800.4	? (TO) TT=1800.07	? (TO) TT=1800.08	SAT (TO) f=220 TT=1800.56 T1=900.31	SAT (TO) f=220 TT=1800.63 T1=900.31	SAT (TO) f=227 TT=1800.52 T1=341.1	SAT (TO) f=236 TT=1800.07 T1=0.29	SAT (TO) f=218 TT=1800.63 T1=781.94	SAT f=198 TT=1796.76 T1=1324.09	SAT f=198 TT=1796.76 T1=1320.19	SAT f=193 TT=1796.77 T1=1045.64	? (TO) TT=1800.01	? (TO) TT=1800.02	? TT=1799.71	? TT=1799.37
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_18.opb.PB06.opb	SAT f=190 TT=1796.74 T1=364.69	SAT f=217 TT=1798 T1=1764.45	SAT (TO) f=206 TT=1800.02 T1=307.66	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.06	SAT (TO) f=224 TT=1800.08 T1=186.33	SAT (TO) f=216 TT=1800.03 T1=1226.47	SAT (TO) f=214 TT=1802.06 T1=140.56	SAT f=215 TT=1783.01 T1=1.72	SAT (TO) f=218 TT=1800.53 T1=26.77	SAT f=219 TT=1798 T1=1718	SAT (TO) f=214 TT=1800.91 T1=309.62	SAT (TO) f=191 TT=1800.07 T1=362.13	? (TO) TT=1800.1	SAT (TO) f=210 TT=1800.02 T1=342.43	SAT f=191 TT=1789.74 T1=246.09	SAT (TO) f=209 TT=1800.18 T1=766.81	SAT f=190 TT=1796.77 T1=364.69	SAT (TO) f=216 TT=1800.03 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.08	SAT (TO) f=216 TT=1800.5 T1=900.31	SAT (TO) f=216 TT=1800.42 T1=900.31	SAT (TO) f=219 TT=1800.12 T1=117.85	SAT (TO) f=224 TT=1801.07 T1=0.59	SAT (TO) f=212 TT=1800.01 T1=1773.14	SAT f=190 TT=1796.74 T1=1636.15	SAT f=190 TT=1796.76 T1=1630.13	SAT f=194 TT=1796.75 T1=270.3	? (TO) TT=1800.1	? (TO) TT=1800.08	? TT=1799.54	? TT=1799.54
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_19.opb.PB06.opb	SAT f=184 TT=1796.77 T1=136.57	SAT f=211 TT=1798.01 T1=109.8	SAT (TO) f=200 TT=1800.02 T1=177.97	? (TO) TT=1800.12	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.03	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT (TO) f=217 TT=1800.07 T1=461.16	SAT (TO) f=208 TT=1800.07 T1=866.86	SAT (TO) f=205 TT=1802.08 T1=613.19	SAT f=208 TT=1783.01 T1=0.34	SAT (TO) f=211 TT=1800.07 T1=284.98	SAT f=210 TT=1798 T1=332.37	SAT (TO) f=211 TT=1800.68 T1=82.3	SAT f=189 TT=1797.46 T1=252.51	? (TO) TT=1800.1	SAT (TO) f=205 TT=1800.09 T1=212.87	SAT f=187 TT=1789.75 T1=581.28	SAT (TO) f=203 TT=1800.49 T1=212.9	SAT f=188 TT=1796.76 T1=480	SAT (TO) f=213 TT=1800.03 T1=1800.4	? (TO) TT=1800.01	? (TO) TT=1800.15	SAT (TO) f=209 TT=1800.49 T1=900.31	SAT (TO) f=209 TT=1800.51 T1=900.31	? (TO) TT=1802.15	SAT (TO) f=223 TT=1800.09 T1=0.24	SAT (TO) f=209 TT=1800.09 T1=6.04	SAT f=186 TT=1796.74 T1=209.12	SAT f=186 TT=1796.75 T1=209.74	SAT f=184 TT=1796.77 T1=136.57	? (TO) TT=1800.02	? (TO) TT=1800.11	? TT=1799.52	? TT=1799.45
Bench name	Best results	bsolo 3.2 (complete)	clasp 2.0.6-R5325 (opt) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_20.opb.PB06.opb	SAT f=189 TT=1796.76 T1=534.5	SAT f=213 TT=1798 T1=270.87	SAT (TO) f=204 TT=1800.02 T1=741.58	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.03	? (TO) TT=1800.06	? (TO) TT=1800.11	? (TO) TT=1800.05	SAT (TO) f=221 TT=1800.07 T1=173.78	SAT (TO) f=223 TT=1800.07 T1=0.28	SAT (TO) f=213 TT=1802.11 T1=0.6	SAT f=210 TT=1783.01 T1=586.82	SAT (TO) f=213 TT=1800.05 T1=641.02	SAT f=214 TT=1798.01 T1=950.25	SAT (TO) f=212 TT=1800.58 T1=1028.85	SAT (TO) f=189 TT=1800.06 T1=858.46	? (TO) TT=1800.05	SAT (TO) f=208 TT=1800.16 T1=738.37	SAT f=190 TT=1789.77 T1=128.5	SAT (TO) f=208 TT=1800.29 T1=661.02	SAT f=189 TT=1796.76 T1=534.5	SAT (TO) f=219 TT=1800.06 T1=1800.4	? (TO) TT=1800.08	? (TO) TT=1800.11	SAT (TO) f=212 TT=1800.02 T1=900.31	SAT (TO) f=212 TT=1800.39 T1=900.31	SAT (TO) f=216 TT=1800.63 T1=808.01	SAT (TO) f=226 TT=1800.07 T1=0.25	SAT (TO) f=213 TT=1800.08 T1=27.64	SAT f=190 TT=1796.75 T1=417.31	SAT f=190 TT=1796.73 T1=416.7	SAT f=191 TT=1796.75 T1=986.53	? (TO) TT=1800.11	? (TO) TT=1800.02	? TT=1799.61	? (TO) TT=1800.1
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_21.opb.PB06.opb	SAT f=189 TT=1789.75 T1=543.85	SAT f=218 TT=1798 T1=280.79	SAT (TO) f=207 TT=1800.11 T1=164.95	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.13	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.03	SAT (TO) f=224 TT=1800.07 T1=105.42	SAT (TO) f=222 TT=1800.07 T1=140.31	SAT (TO) f=215 TT=1802.03 T1=1.97	SAT f=216 TT=1783.01 T1=1317.87	SAT (TO) f=216 TT=1801.23 T1=436.63	SAT f=215 TT=1798 T1=1000.05	SAT (TO) f=216 TT=1800.07 T1=109.58	SAT (TO) f=195 TT=1800.09 T1=524.22	? (TO) TT=1800.15	SAT (TO) f=214 TT=1800.77 T1=33.27	SAT f=189 TT=1789.75 T1=543.85	SAT (TO) f=211 TT=1800.09 T1=28.06	SAT f=194 TT=1796.76 T1=1589.66	SAT (TO) f=220 TT=1800.03 T1=1800.4	? (TO) TT=1800.13	? (TO) TT=1800.13	SAT (TO) f=217 TT=1800.11 T1=900.41	SAT (TO) f=217 TT=1800.42 T1=900.31	SAT (TO) f=221 TT=1800.74 T1=34.13	SAT (TO) f=232 TT=1800.1 T1=0.28	SAT (TO) f=213 TT=1800.51 T1=1685.9	SAT f=194 TT=1796.74 T1=403.96	SAT f=194 TT=1796.76 T1=401.63	SAT f=194 TT=1796.76 T1=899.44	? (TO) TT=1800.02	? (TO) TT=1800.09	? TT=1799.54	? TT=1799.78
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_22.opb.PB06.opb	SAT f=186 TT=1789.77 T1=1527.66	SAT f=214 TT=1798.01 T1=92.62	SAT (TO) f=204 TT=1800.01 T1=817.48	? (TO) TT=1800.13	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.02	SAT (TO) f=223 TT=1800.05 T1=0.28	SAT (TO) f=217 TT=1800.03 T1=115.7	SAT (TO) f=211 TT=1802.09 T1=108.37	SAT f=211 TT=1783.01 T1=260.91	? (exit code) TT=627.927	SAT f=212 TT=1798 T1=97.86	SAT (TO) f=214 TT=1800.57 T1=720.86	SAT (TO) f=187 TT=1800.04 T1=613.65	? (TO) TT=1800.39	SAT (TO) f=211 TT=1801.51 T1=79.89	SAT f=186 TT=1789.77 T1=1527.66	SAT (TO) f=208 TT=1800.12 T1=213.16	SAT f=187 TT=1796.75 T1=193.04	SAT (TO) f=215 TT=1800.08 T1=1800.4	? (TO) TT=1800.09	? (TO) TT=1800.15	SAT (TO) f=211 TT=1800.06 T1=900.31	SAT (TO) f=211 TT=1800.19 T1=900.31	SAT (TO) f=220 TT=1800.06 T1=7.26	SAT (TO) f=223 TT=1800.08 T1=0.23	SAT (TO) f=209 TT=1800.73 T1=654.09	SAT f=191 TT=1796.77 T1=409.93	SAT f=191 TT=1796.77 T1=409.32	SAT f=189 TT=1796.77 T1=215.61	? (TO) TT=1800.11	? (TO) TT=1800.03	? TT=1799.55	? TT=1799.5
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_23.opb.PB06.opb	SAT f=193 TT=1789.76 T1=548.98	SAT f=223 TT=1798.01 T1=677.48	SAT (TO) f=210 TT=1800.02 T1=1794.73	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.12	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.02	? (TO) TT=1800.07	SAT (TO) f=226 TT=1800.08 T1=83.66	SAT (TO) f=224 TT=1800.04 T1=62.28	SAT (TO) f=216 TT=1802.05 T1=2.51	SAT f=218 TT=1783.01 T1=689.7	? (exit code) TT=1111.43	SAT f=223 TT=1798 T1=599.25	SAT (TO) f=222 TT=1800.07 T1=856.38	SAT (TO) f=192 TT=1800.04 T1=126.25	? (TO) TT=1800.09	SAT (TO) f=219 TT=1801.4 T1=76.81	SAT f=193 TT=1789.76 T1=548.98	SAT (TO) f=216 TT=1800.18 T1=953.76	SAT f=194 TT=1796.75 T1=256.68	SAT (TO) f=227 TT=1800.02 T1=1800.4	? (TO) TT=1800.14	? (TO) TT=1800.14	SAT (TO) f=220 TT=1800.06 T1=900.31	SAT (TO) f=220 TT=1800.42 T1=900.31	SAT (TO) f=223 TT=1800.8 T1=401.15	SAT (TO) f=232 TT=1800.72 T1=0.31	SAT (TO) f=218 TT=1800.06 T1=812.78	SAT f=195 TT=1796.76 T1=126.23	SAT f=195 TT=1796.77 T1=124.74	SAT f=196 TT=1796.75 T1=277.41	? (TO) TT=1800.03	? (TO) TT=1800.02	? TT=1799.6	? TT=1799.58
normalized-PB06/OPT-SMALLINT/submitted-PB06/ liu/domset/ normalized-domset_v500_e2000_w30_mw19_24.opb.PB06.opb	SAT f=190 TT=1796.75 T1=184.35	SAT f=219 TT=1798 T1=218.85	SAT (TO) f=208 TT=1800.06 T1=955.02	? (TO) TT=1800.12	? (TO) TT=1800.13	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.06	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.1	SAT (TO) f=222 TT=1800.08 T1=0.26	SAT (TO) f=221 TT=1800.04 T1=230.08	SAT (TO) f=218 TT=1802.09 T1=66.55	SAT f=218 TT=1783 T1=52.82	SAT (TO) f=219 TT=1800.04 T1=1618.93	SAT f=221 TT=1798.01 T1=3.23	SAT (TO) f=218 TT=1800.91 T1=353.74	SAT (TO) f=191 TT=1800.05 T1=733.1	? (TO) TT=1800.16	SAT (TO) f=216 TT=1800.58 T1=17.29	SAT f=191 TT=1789.75 T1=702.58	SAT (TO) f=216 TT=1800.7 T1=37.35	SAT f=191 TT=1796.75 T1=251.64	SAT (TO) f=221 TT=1800.03 T1=1800.4	? (TO) TT=1800.14	? (TO) TT=1800.07	SAT (TO) f=218 TT=1800.49 T1=900.31	SAT (TO) f=218 TT=1800.42 T1=900.31	SAT (TO) f=219 TT=1800.06 T1=253.4	SAT (TO) f=220 TT=1800.02 T1=1.37	SAT (TO) f=214 TT=1800.09 T1=1572.49	SAT f=190 TT=1796.75 T1=185.08	SAT f=190 TT=1796.75 T1=184.35	SAT f=191 TT=1796.77 T1=652.99	? (TO) TT=1800.11	? (TO) TT=1800.02	? TT=1799.82	? TT=1799.86

Statistics		bsolo 3.2 (complete)	clasp 2.0.6-R5325 (opt) (complete)	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	PB07: bsolo 3.0.17 (complete)	PB07: minisat+ 1.14 (complete)	PB07: PB-clasp 2007-04-10 (complete)	PB07: Pueblo 1.4 (incomplete)	PB07: SAT4JPseudoResolution 2007-03-23 (complete)	PB09: bsolo 3.1 (complete)	PB09: SAT4J Pseudo Resolution 2.1.1 (complete)	PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	PB10: pb_cplex 2010-06-29 (complete)	PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)	PB11: Sat4j Res//CP 2.3.0 (complete)	PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)	PB12: minisatp 1.0-2-g022594c (complete)	pb2sat 2012-05-19 (complete)	pb2satCp2 2012-05-19 (complete)	pwbo 2.0 (complete)	pwbo 2.02 (complete)	SAT 4j PB RES // CP 2.3.2 Snapshot (complete)	Sat 4j PB Resolution 2.3.2 Snapshot (complete)	SAT4J PB specific settings 2.3.2 snapshot (complete)	SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)	SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)	SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)	toysat 2012-05-17 (complete)	toysat 2012-06-01 (complete)	wbo 1.7 (complete)	wbo 1.72 (complete)
Number of times the solver is able to give the best known answer		0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	6	0	5	0	0	0	0	0	0	0	0	4	4	4	0	0	0	0
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	6	0	3	0	0	0	0	0	0	0	0	4	2	2	0	0	0	0