PB'12 competition: WBO track: results by benchmark

Results by benchmark for category only soft constraints, big integers, linear constraints (SOFT-BIGINT-LIN)

This page displays the results of the different solvers for each benchmark for category only soft constraints, big integers, linear constraints (SOFT-BIGINT-LIN)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
Sat4j PB 2012-05-28 (complete)
toysat 2012-05-17 (complete)
wbo2sat 2012-05-19 (complete)
wbo2satCp2 2012-05-19 (complete)

Bench name	Best results on this instance	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	Sat4j PB 2012-05-28 (complete)	toysat 2012-05-17 (complete)	wbo2sat 2012-05-19 (complete)	wbo2satCp2 2012-05-19 (complete)
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-tlan3.ucl--soft-0-100-0.wbo	MOPT f=1 TT=7.693 T1=5.82	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.06	? (TO) TT=1800.09	OPTIMUM f=1 TT=7.693 T1=5.82	OPTIMUM f=1 TT=374.725 T1=374.63	? (TO) TT=1800.1	? (TO) TT=1800.1
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl--soft-0-100-0.wbo	MSAT f=1 TT=1800.56 T1=593.29	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.01	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.07	MSAT (TO) f=1 TT=1800.56 T1=593.29	? (exit code) TT=5.961	? (TO) TT=1800.04	? (TO) TT=1800.01
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl--soft-0-100-0.wbo	MOPT f=1 TT=132.125 T1=115.8	? (TO) TT=1800.02	? (TO) TT=1800.01	? (TO) TT=1800.04	? (TO) TT=1800	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.04	OPTIMUM f=1 TT=132.125 T1=115.8	? (exit code) TT=6.567	? (TO) TT=1800.02	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Icl2arity.ucl--soft-0-100-0.wbo	MOPT f=1 TT=8.753 T1=5.4	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.06	OPTIMUM f=1 TT=8.753 T1=5.4	OPTIMUM f=1 TT=647.99 T1=635.47	? (TO) TT=1800.09	? (TO) TT=1800.04
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv10.ucl--soft-0-100-0.wbo	MOPT f=2 TT=4.124 T1=1.09	? (TO) TT=1800.13	? (TO) TT=1800.08	? (TO) TT=1800.13	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.11	? (TO) TT=1800.17	? (TO) TT=1800.04	OPTIMUM f=2 TT=4.124 T1=1.09	OPTIMUM f=2 TT=99.467 T1=88.64	? (TO) TT=1800.13	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv12.ucl--soft-0-100-0.wbo	MOPT f=1 TT=20.229 T1=17.31	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.09	? (TO) TT=1800.13	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.13	OPTIMUM f=1 TT=20.229 T1=17.31	OPTIMUM f=1 TT=886.247 T1=823.26	? (TO) TT=1800.13	? (TO) TT=1800.08
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv14.ucl--soft-0-100-0.wbo	MOPT f=1 TT=1590.86 T1=32.98	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.06	? (TO) TT=1800.1	OPTIMUM f=1 TT=1590.86 T1=32.98	? (exit code) TT=4.795	? (TO) TT=1800.08	? (TO) TT=1800.06
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl--soft-0-100-0.wbo	MOPT f=1 TT=3.913 T1=2.39	? (TO) TT=1800.07	? (TO) TT=1800.11	? (TO) TT=1800.02	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.14	? (TO) TT=1811.22	? (TO) TT=1800.04	OPTIMUM f=1 TT=3.913 T1=2.39	OPTIMUM f=1 TT=59.671 T1=58.26	? (TO) TT=1800.13	? (TO) TT=1800.08
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-dlx1c.rwmem.ucl--soft-0-100-0.wbo	MOPT f=1 TT=4.133 T1=2.4	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.1	OPTIMUM f=1 TT=4.133 T1=2.4	OPTIMUM f=1 TT=87.194 T1=85.3	? (TO) TT=1800.04	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf10.ucl--soft-0-100-0.wbo	MOPT f=1 TT=36.778 T1=32.73	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.02	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.07	OPTIMUM f=1 TT=36.778 T1=32.73	? (exit code) TT=4.458	? (TO) TT=1800.04	? (TO) TT=1800.08
Bench name	Best results	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	Sat4j PB 2012-05-28 (complete)	toysat 2012-05-17 (complete)	wbo2sat 2012-05-19 (complete)	wbo2satCp2 2012-05-19 (complete)
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf9.ucl--soft-0-100-0.wbo	MOPT f=1 TT=3.503 T1=1.61	? (TO) TT=1800.04	? (TO) TT=1800.08	? (TO) TT=1800.03	? (TO) TT=1800.1	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.05	? (TO) TT=1800.12	OPTIMUM f=1 TT=3.503 T1=1.61	OPTIMUM f=1 TT=464.948 T1=463.16	? (TO) TT=1800.01	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.burch_dill.8.accl.ucl--soft-0-100-0.wbo	MOPT f=1 TT=210.34 T1=5.49	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.12	OPTIMUM f=1 TT=210.34 T1=5.49	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.03
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.RobRegValid_bar.ucl--soft-0-100-0.wbo	MOPT f=1 TT=37.797 T1=10.02	? (TO) TT=1800.05	? (TO) TT=1800.05	? (TO) TT=1800.08	? (TO) TT=1800.09	? (TO) TT=1800.07	? (TO) TT=1800.05	? (TO) TT=1801.77	? (TO) TT=1800.01	OPTIMUM f=1 TT=37.797 T1=10.02	? (exit code) TT=4.261	? (TO) TT=1800.08	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl--soft-0-100-0.wbo	MSAT f=1 TT=1800.09 T1=226.98	? (TO) TT=1800.03	? (problem) TT=7.147	? (TO) TT=1800.03	? (problem) TT=6.402	? (TO) TT=1800.1	? (problem) TT=6.485	? (TO) TT=1800.05	? (problem) TT=7.051	MSAT (TO) f=1 TT=1800.09 T1=226.98	? (exit code) TT=8.4	? (TO) TT=1800.05	? (TO) TT=1800.02
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl--soft-0-100-0.wbo	MOPT f=1 TT=1098.93 T1=85.8	? (TO) TT=1800.02	? (TO) TT=1800.06	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800.06	? (TO) TT=1800.06	? (TO) TT=1800.09	OPTIMUM f=1 TT=1098.93 T1=85.8	? (exit code) TT=6.16	? (TO) TT=1800.07	? (TO) TT=1800.04
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf10.ucl--soft-0-100-0.wbo	MOPT f=1 TT=22.771 T1=4.8	? (TO) TT=1800.12	? (TO) TT=1800.05	? (TO) TT=1800.01	? (TO) TT=1800.06	? (TO) TT=1800.07	? (TO) TT=1800.08	? (TO) TT=1800.02	? (TO) TT=1800.13	OPTIMUM f=1 TT=22.771 T1=4.8	OPTIMUM f=1 TT=511.534 T1=376.01	? (TO) TT=1800.05	? (TO) TT=1800.1
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf9.ucl--soft-0-100-0.wbo	MOPT f=1 TT=5.473 T1=0.97	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800	? (TO) TT=1800.11	? (TO) TT=1800.07	? (TO) TT=1800.09	? (TO) TT=1800.01	? (TO) TT=1800.16	OPTIMUM f=1 TT=5.473 T1=0.97	OPTIMUM f=1 TT=172.226 T1=143.13	? (TO) TT=1800.06	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag10.ucl--soft-0-100-0.wbo	MOPT f=1 TT=4.753 T1=1.68	? (TO) TT=1800.03	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.07	? (TO) TT=1800.04	OPTIMUM f=1 TT=4.753 T1=1.68	OPTIMUM f=1 TT=134.091 T1=90.42	? (TO) TT=1800.09	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag12.ucl--soft-0-100-0.wbo	MOPT f=1 TT=31.129 T1=3.45	? (TO) TT=1800.07	OPTIMUM f=1 TT=1303.58 T1=1302.62	? (TO) TT=1800.02	OPTIMUM f=1 TT=1001.94 T1=1002.97	? (TO) TT=1800.05	? (TO) TT=1800.03	? (TO) TT=1800.09	? (TO) TT=1800.05	OPTIMUM f=1 TT=31.129 T1=3.45	OPTIMUM f=1 TT=695.773 T1=492.5	? (TO) TT=1800.02	? (TO) TT=1800.08
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag14.ucl--soft-0-100-0.wbo	MOPT f=1 TT=62.304 T1=16.9	? (TO) TT=1800.04	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.1	? (TO) TT=1800.1	OPTIMUM f=1 TT=118.302 T1=106.04	? (TO) TT=1800.04	OPTIMUM f=1 TT=123.495 T1=117.82	OPTIMUM f=1 TT=62.304 T1=16.9	? (TO) TT=1800.11	? (TO) TT=1800.1	? (TO) TT=1800.07
Bench name	Best results	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	Sat4j PB 2012-05-28 (complete)	toysat 2012-05-17 (complete)	wbo2sat 2012-05-19 (complete)	wbo2satCp2 2012-05-19 (complete)
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.unbounded.all.ucl--soft-0-100-0.wbo	MOPT f=1 TT=433.58 T1=77.66	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.02	? (TO) TT=1800.1	? (MO) TT=139.45	? (TO) TT=1800.02	? (MO) TT=139.48	OPTIMUM f=1 TT=433.58 T1=77.66	? (exit code) TT=6.465	? (TO) TT=1800.06	? (TO) TT=1800
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12013_1-unsat--soft-0-100-0.wbo	MSAT f=5230 TT=1800.84 T1=1797.04	? (TO) TT=1800.08	? (problem) TT=2.561	? (TO) TT=1800.02	? (problem) TT=2.779	? (TO) TT=1800.09	? (problem) TT=2.662	? (TO) TT=1800.1	? (problem) TT=2.741	MSAT (TO) f=5230 TT=1800.84 T1=1797.04	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.08
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12015_3-unsat--soft-0-100-0.wbo	MOPT f=3 TT=615.221 T1=615.31	? (TO) TT=1800.1	? (problem) TT=2.355	? (TO) TT=1800.05	? (problem) TT=2.566	? (TO) TT=1800.09	? (problem) TT=2.49	? (TO) TT=1800.02	? (problem) TT=2.438	MSAT (TO) f=240 TT=1800.02 T1=1795.33	OPTIMUM f=3 TT=615.221 T1=615.31	? (TO) TT=1800.03	? (TO) TT=1800.04
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12023_3-unsat--soft-0-100-0.wbo	MOPT f=7 TT=3.204 T1=1.31	Wrong Opt. f=8 TT=25.236 T1=25.39	OPTIMUM f=7 TT=69.537 T1=69.07	Wrong Opt. f=8 TT=23.101 T1=23.27	OPTIMUM f=7 TT=71.915 T1=71.68	Wrong Opt. f=8 TT=250.421 T1=250.04	OPTIMUM f=7 TT=440.358 T1=439.98	? (TO) TT=1800.24	? (TO) TT=1800.08	OPTIMUM f=7 TT=3.204 T1=1.31	OPTIMUM f=7 TT=872.12 T1=871.79	Wrong Opt. f=8 TT=1187.09 T1=1186.39	Wrong Opt. f=8 TT=1604.94 T1=1604.27
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12026_5-unsat--soft-0-100-0.wbo	MSAT f=8040 TT=1800.06 T1=1794.54	? (TO) TT=1800.01	? (problem) TT=1.936	? (TO) TT=1800.09	? (problem) TT=1.969	? (TO) TT=1800.02	? (problem) TT=1.934	? (TO) TT=1800.05	? (problem) TT=1.954	MSAT (TO) f=8040 TT=1800.06 T1=1794.54	? (TO) TT=1800.12	? (TO) TT=1800.08	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12027_7-unsat--soft-0-100-0.wbo	MSAT f=3602 TT=1801.16 T1=1.9	? (TO) TT=1800.06	? (problem) TT=1.947	? (TO) TT=1800.02	? (problem) TT=1.85	? (TO) TT=1800.05	? (problem) TT=1.813	? (TO) TT=1800.09	? (problem) TT=1.845	MSAT (TO) f=3602 TT=1801.16 T1=1.9	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12041_4-unsat--soft-0-100-0.wbo	MOPT f=1 TT=54.67 T1=51.68	? (TO) TT=1800.08	? (TO) TT=1800.1	? (TO) TT=1800.08	? (TO) TT=1800.05	? (TO) TT=1800.07	? (TO) TT=1800	? (TO) TT=1800.13	? (TO) TT=1800.04	OPTIMUM f=1 TT=54.67 T1=51.68	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.05
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j1205_1-unsat--soft-0-100-0.wbo	MOPT f=3 TT=3.004 T1=1.28	? (TO) TT=1800.09	? (TO) TT=1800.08	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.11	? (TO) TT=1800.06	? (TO) TT=1800.25	? (TO) TT=1800.08	OPTIMUM f=3 TT=3.004 T1=1.28	OPTIMUM f=3 TT=675.921 T1=675.63	? (TO) TT=1800.03	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6010_2-unsat--soft-0-100-0.wbo	MOPT f=9 TT=2.254 T1=0.89	? (TO) TT=1800.13	OPTIMUM f=9 TT=28.711 T1=28.69	? (TO) TT=1800.05	OPTIMUM f=9 TT=29.331 T1=29.32	? (TO) TT=1800.06	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.04	OPTIMUM f=9 TT=2.254 T1=0.89	OPTIMUM f=9 TT=70.391 T1=70.3	OPTIMUM f=9 TT=156.29 T1=156.96	OPTIMUM f=9 TT=121.348 T1=121.74
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6027_4-unsat--soft-0-100-0.wbo	MOPT f=6 TT=2.213 T1=0.88	OPTIMUM f=6 TT=10.143 T1=9.48	OPTIMUM f=6 TT=7.607 T1=7.12	OPTIMUM f=6 TT=11.243 T1=10.56	OPTIMUM f=6 TT=7.625 T1=7.16	OPTIMUM f=6 TT=9.901 T1=9.56	OPTIMUM f=6 TT=7.353 T1=7.1	OPTIMUM f=6 TT=10.471 T1=9.84	OPTIMUM f=6 TT=7.946 T1=7.44	OPTIMUM f=6 TT=2.213 T1=0.88	OPTIMUM f=6 TT=70.404 T1=70.29	OPTIMUM f=6 TT=1148.71 T1=1148.37	OPTIMUM f=6 TT=1172.9 T1=1172.68
Bench name	Best results	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	Sat4j PB 2012-05-28 (complete)	toysat 2012-05-17 (complete)	wbo2sat 2012-05-19 (complete)	wbo2satCp2 2012-05-19 (complete)
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6030_9-unsat--soft-0-100-0.wbo	MOPT f=1 TT=2.584 T1=1.03	? (TO) TT=1800.13	? (problem) TT=1.621	? (TO) TT=1800.09	? (problem) TT=1.727	? (TO) TT=1800.13	? (problem) TT=1.635	? (TO) TT=1800.07	? (problem) TT=1.65	OPTIMUM f=1 TT=2.584 T1=1.03	OPTIMUM f=1 TT=202.526 T1=202.35	? (TO) TT=1800.13	? (TO) TT=1800.06
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j603_2-unsat--soft-0-100-0.wbo	MOPT f=4 TT=2.114 T1=0.84	OPTIMUM f=4 TT=10.394 T1=9.17	OPTIMUM f=4 TT=2.317 T1=2.14	OPTIMUM f=4 TT=10.096 T1=8.93	OPTIMUM f=4 TT=2.358 T1=2.2	OPTIMUM f=4 TT=9.794 T1=9.17	OPTIMUM f=4 TT=2.238 T1=2.15	OPTIMUM f=4 TT=10.674 T1=9.45	OPTIMUM f=4 TT=2.341 T1=2.18	OPTIMUM f=4 TT=2.114 T1=0.84	OPTIMUM f=4 TT=86.351 T1=86.24	OPTIMUM f=4 TT=128.783 T1=127.57	OPTIMUM f=4 TT=114.235 T1=113.02
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6033_2-unsat--soft-0-100-0.wbo	MOPT f=20 TT=2.374 T1=0.91	? (TO) TT=1800.12	? (TO) TT=1800.11	? (TO) TT=1800.05	? (TO) TT=1800.1	? (TO) TT=1800.1	? (TO) TT=1800.06	? (TO) TT=1800.13	? (TO) TT=1800.22	OPTIMUM f=20 TT=2.374 T1=0.91	OPTIMUM f=20 TT=227.496 T1=227.36	? (TO) TT=1800.06	? (TO) TT=1800.13
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j605_10-unsat--soft-0-100-0.wbo	MSAT f=637 TT=1800.61 T1=1795.54	? (TO) TT=1800.15	? (TO) TT=1800.08	? (TO) TT=1800.11	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.07	? (TO) TT=1800.12	? (TO) TT=1800.13	MSAT (TO) f=637 TT=1800.61 T1=1795.54	? (TO) TT=1800.1	? (TO) TT=1800.13	? (TO) TT=1800.14
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j605_1-unsat--soft-0-100-0.wbo	MOPT f=1 TT=94.01 T1=89.95	? (TO) TT=1800.07	? (TO) TT=1800.07	? (TO) TT=1800.13	? (TO) TT=1800.09	? (TO) TT=1800.14	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.08	OPTIMUM f=1 TT=94.01 T1=89.95	? (TO) TT=1800.01	? (TO) TT=1800.1	? (TO) TT=1800.08
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j606_1-unsat--soft-0-100-0.wbo	MOPT f=13 TT=2.404 T1=0.94	OPTIMUM f=13 TT=168.749 T1=168.58	OPTIMUM f=13 TT=196.344 T1=196.05	OPTIMUM f=13 TT=209.678 T1=209.95	OPTIMUM f=13 TT=195.301 T1=195.05	? (TO) TT=1800.09	? (TO) TT=1800.12	? (TO) TT=1800.34	? (TO) TT=1800.21	OPTIMUM f=13 TT=2.404 T1=0.94	OPTIMUM f=13 TT=64.726 T1=64.59	OPTIMUM f=13 TT=579.547 T1=579.38	OPTIMUM f=13 TT=567.44 T1=567.37
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9010_6-unsat--soft-0-100-0.wbo	MOPT f=5 TT=2.718 T1=1.11	? (TO) TT=1800.09	? (problem) TT=2.043	? (TO) TT=1800.13	? (problem) TT=1.967	? (TO) TT=1800.07	? (problem) TT=1.946	? (TO) TT=1800.01	? (problem) TT=1.949	OPTIMUM f=5 TT=2.718 T1=1.11	OPTIMUM f=5 TT=370.942 T1=370.77	? (TO) TT=1800.12	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9012_2-unsat--soft-0-100-0.wbo	MOPT f=9 TT=2.504 T1=1.02	OPTIMUM f=9 TT=49.754 T1=51.93	? (problem) TT=2.094	OPTIMUM f=9 TT=50.238 T1=52.54	? (problem) TT=2.137	OPTIMUM f=9 TT=237.945 T1=237.99	? (problem) TT=2	OPTIMUM f=9 TT=189.27 T1=189.1	? (problem) TT=2.012	OPTIMUM f=9 TT=2.504 T1=1.02	OPTIMUM f=9 TT=214.689 T1=214.5	OPTIMUM f=9 TT=43.434 T1=43.11	OPTIMUM f=9 TT=41.915 T1=41.68
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9014_1-unsat--soft-0-100-0.wbo	MOPT f=2 TT=2.813 T1=1.19	? (TO) TT=1800.1	? (problem) TT=2.22	? (TO) TT=1800.1	? (problem) TT=2.304	? (TO) TT=1800.1	? (problem) TT=2.191	? (TO) TT=1800	? (problem) TT=2.338	OPTIMUM f=2 TT=2.813 T1=1.19	OPTIMUM f=2 TT=352.957 T1=352.77	? (TO) TT=1800.02	? (TO) TT=1800.05
/SOFT-BIGINT-LIN/PB10/oliveras/ j90/ normalized-j9015_10-unsat--soft-0-100-0.wbo	MOPT f=11 TT=2.593 T1=1.01	? (TO) TT=1800.12	? (problem) TT=2.223	? (TO) TT=1800.08	? (problem) TT=2.163	? (TO) TT=1800.07	? (problem) TT=2.147	? (TO) TT=1800.09	? (problem) TT=2.211	OPTIMUM f=11 TT=2.593 T1=1.01	OPTIMUM f=11 TT=261.784 T1=261.62	? (TO) TT=1800.04	? (TO) TT=1800.07
Bench name	Best results	npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	Sat4j PB 2012-05-28 (complete)	toysat 2012-05-17 (complete)	wbo2sat 2012-05-19 (complete)	wbo2satCp2 2012-05-19 (complete)
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9028_2-unsat--soft-0-100-0.wbo	MOPT f=8 TT=2.584 T1=1.06	OPTIMUM f=8 TT=38.956 T1=40.18	? (problem) TT=2.372	OPTIMUM f=8 TT=38.342 T1=38.45	? (problem) TT=2.094	OPTIMUM f=8 TT=37.626 T1=37.76	? (problem) TT=1.983	OPTIMUM f=8 TT=37.867 T1=37	? (problem) TT=2.046	OPTIMUM f=8 TT=2.584 T1=1.06	OPTIMUM f=8 TT=266.718 T1=266.51	OPTIMUM f=8 TT=43.296 T1=40.95	OPTIMUM f=8 TT=43.311 T1=41.11
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j903_10-unsat--soft-0-100-0.wbo	MOPT f=8 TT=2.364 T1=0.89	OPTIMUM f=8 TT=299.3 T1=299.17	OPTIMUM f=8 TT=298.202 T1=297.66	OPTIMUM f=8 TT=301.821 T1=302.33	OPTIMUM f=8 TT=368.973 T1=368.42	? (TO) TT=1800.03	? (TO) TT=1800.05	? (TO) TT=1800.18	? (TO) TT=1800.08	OPTIMUM f=8 TT=2.364 T1=0.89	OPTIMUM f=8 TT=173.62 T1=173.46	OPTIMUM f=8 TT=478.723 T1=478.39	OPTIMUM f=8 TT=409.954 T1=409.76
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9035_1-unsat--soft-0-100-0.wbo	MOPT f=8 TT=2.894 T1=1.15	? (TO) TT=1800.11	? (TO) TT=1800.04	? (TO) TT=1800.1	? (TO) TT=1800.09	? (TO) TT=1800.09	? (TO) TT=1800.03	? (TO) TT=1800.04	? (TO) TT=1800.33	OPTIMUM f=8 TT=2.894 T1=1.15	OPTIMUM f=8 TT=515.881 T1=515.53	? (TO) TT=1800.12	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9039_3-unsat--soft-0-100-0.wbo	MOPT f=23 TT=2.735 T1=1.11	OPTIMUM f=23 TT=18.736 T1=15.56	? (problem) TT=1.539	OPTIMUM f=23 TT=21.714 T1=18.2	? (problem) TT=1.521	OPTIMUM f=23 TT=18.996 T1=18.4	? (problem) TT=1.543	OPTIMUM f=23 TT=16.604 T1=15.1	? (problem) TT=1.554	OPTIMUM f=23 TT=2.735 T1=1.11	OPTIMUM f=23 TT=375.045 T1=374.83	? (TO) TT=1800.09	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9048_1-unsat--soft-0-100-0.wbo	MOPT f=18 TT=2.674 T1=1.1	? (TO) TT=1800.03	? (problem) TT=2.794	? (TO) TT=1800.04	? (problem) TT=2.847	? (TO) TT=1800.01	? (problem) TT=2.566	? (TO) TT=1511.46	? (problem) TT=2.525	OPTIMUM f=18 TT=2.674 T1=1.1	OPTIMUM f=18 TT=361.062 T1=360.87	? (TO) TT=1800.04	? (TO) TT=1800.02
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j907_8-unsat--soft-0-100-0.wbo	MOPT f=11 TT=2.324 T1=0.94	OPTIMUM f=11 TT=21.944 T1=21.92	? (problem) TT=1.409	OPTIMUM f=11 TT=22.077 T1=23.69	? (problem) TT=1.439	OPTIMUM f=11 TT=427.959 T1=427.68	? (problem) TT=1.363	? (TO) TT=1800.05	? (problem) TT=1.366	OPTIMUM f=11 TT=2.324 T1=0.94	OPTIMUM f=11 TT=149.39 T1=149.19	OPTIMUM f=11 TT=107.392 T1=107.54	OPTIMUM f=11 TT=84.439 T1=84.59

Statistics		npSolver 1.0 (complete)	npSolver 1.0 (fixed) (complete)	npSolver inc (complete)	npSolver inc (fixed) (complete)	npSolver inc-topDown (complete)	npSolver inc-topDown (fixed) (complete)	npSolver inc-topdown-quickBound (complete)	npSolver inc-topdown-quickBound (fixed) (complete)	Sat4j PB 2012-05-28 (complete)	toysat 2012-05-17 (complete)	wbo2sat 2012-05-19 (complete)	wbo2satCp2 2012-05-19 (complete)
Number of times the solver is able to give the best known answer		0	7	0	7	0	4	5	3	45	30	0	0
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	0	0	0	0	0	0	0	45	1	0	0