PB'10 competition: WBO track: results by benchmark

Results by benchmark for category only soft constraints, big integers, linear constraints (SOFT-BIGINT-LIN)

This page displays the results of the different solvers for each benchmark for category only soft constraints, big integers, linear constraints (SOFT-BIGINT-LIN)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
PB/CT 0.1 (complete)
PB/CT 0.1 fixed (complete)
SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)
SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
SAT4J PB Resolution 2.2.0 2010-05-26 (complete)
SAT4J PB Resolution 2.2.1 (complete)
SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)

Bench name	Best results on this instance	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SAT4J PB Resolution 2.2.1 (complete)	SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-tlan3.ucl--soft-0-100-0.wbo	MOPT f=1 TT=104.609 T1=101.19	Signal TT=0.525	MSAT (TO) f=5713 TT=1800.08 T1=1639.97	MSAT (TO) f=1108 TT=1800.23 T1=1778.52	Wrong Opt. f=55 TT=219.184 T1=205.28	Wrong Opt. f=55 TT=90.147 T1=86.08	OPTIMUM f=1 TT=104.609 T1=101.19	? (TO) TT=1800.12
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache-ibm-q-full.all.ucl--soft-0-100-0.wbo	MSAT f=882 TT=1800.31 T1=1652.64	Signal TT=1.59	MSAT (TO) f=14053 TT=1800.12 T1=1785.24	MSAT (TO) f=1057 TT=1800.29 T1=1796.12	MSAT (TO) f=1057 TT=1800.24 T1=1782.82	MSAT (TO) f=950 TT=1800.53 T1=1783.49	MSAT (TO) f=882 TT=1800.31 T1=1652.64	? (TO) TT=1800.16
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Ic22arity.ucl--soft-0-100-0.wbo	MSAT f=484 TT=1800.3 T1=1630.76	Signal TT=1.774	MSAT (TO) f=23506 TT=1800.19 T1=1740.17	MSAT (TO) f=1539 TT=1800.26 T1=1782.63	MSAT (TO) f=1539 TT=1800.31 T1=1730.52	MSAT (TO) f=597 TT=1800.33 T1=1781.33	MSAT (TO) f=484 TT=1800.3 T1=1630.76	? (TO) TT=1800.16
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-cache-ibm-q-unbounded.Icl2arity.ucl--soft-0-100-0.wbo	MOPT f=1 TT=148.553 T1=144.35	Signal TT=0.44	MSAT (TO) f=5441 TT=1800.09 T1=1674.04	MSAT (TO) f=878 TT=1800.27 T1=1778.73	Wrong Opt. f=13 TT=337.709 T1=323.35	Wrong Opt. f=13 TT=117.511 T1=113.42	OPTIMUM f=1 TT=148.553 T1=144.35	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv10.ucl--soft-0-100-0.wbo	MOPT f=2 TT=10.819 T1=6.49	Signal TT=0.153	MSAT (TO) f=438 TT=1800.06 T1=1798.69	MSAT (TO) f=1663 TT=1800.18 T1=1773.32	Wrong Opt. f=29 TT=10.235 T1=10.14	Wrong Opt. f=29 TT=6.929 T1=5.08	OPTIMUM f=2 TT=10.819 T1=6.49	? (TO) TT=1800.1
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv12.ucl--soft-0-100-0.wbo	MOPT f=1 TT=143.574 T1=134.17	Signal TT=0.447	MSAT (TO) f=3716 TT=1800.09 T1=1785.27	MSAT (TO) f=518 TT=1800.28 T1=1775.22	MSAT (TO) f=837 TT=1800.27 T1=1236.03	Wrong Opt. f=2 TT=188.289 T1=184.21	OPTIMUM f=1 TT=143.574 T1=134.17	? (TO) TT=1800.13
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv14.ucl--soft-0-100-0.wbo	MSAT f=188 TT=1800.33 T1=1445.77	Signal TT=1.078	MSAT (TO) f=6229 TT=1800.11 T1=417.14	MSAT (TO) f=2444 TT=1800.25 T1=1787.72	MSAT (TO) f=2444 TT=1800.29 T1=1755.72	MSAT (TO) f=1 TT=1800.29 T1=1785.83	MSAT (TO) f=188 TT=1800.33 T1=1445.77	? (TO) TT=1800.14
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-dlx1c.rwmem1.ucl--soft-0-100-0.wbo	MOPT f=1 TT=38.104 T1=36.19	Signal TT=0.138	MSAT (TO) f=1707 TT=1800.07 T1=1796.03	MSAT (TO) f=695 TT=1800.19 T1=1771.72	OPTIMUM f=1 TT=119.371 T1=118.17	OPTIMUM f=1 TT=12.39 T1=10.39	OPTIMUM f=1 TT=38.104 T1=36.19	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-dlx1c.rwmem.ucl--soft-0-100-0.wbo	MOPT f=1 TT=60.12 T1=58.01	Signal TT=0.16	MSAT (TO) f=2348 TT=1800.07 T1=1774.36	Wrong Opt. f=2 TT=571.864 T1=562.91	Wrong Opt. f=2 TT=131.596 T1=129.46	Wrong Opt. f=2 TT=12.341 T1=10.37	OPTIMUM f=1 TT=60.12 T1=58.01	MSAT (TO) f=22099 TT=1800.11 T1=1799.96
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf10.ucl--soft-0-100-0.wbo	MOPT f=1 TT=1731.75 T1=1723.49	Signal TT=0.996	MSAT (TO) f=14771 TT=1800.13 T1=1395.23	MSAT (TO) f=3113 TT=1800.26 T1=1788.53	MSAT (TO) f=106 TT=1800.26 T1=1042.71	OPTIMUM f=1 TT=689.067 T1=680.52	OPTIMUM f=1 TT=1731.75 T1=1723.49	? (TO) TT=1800.13
Bench name	Best results	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SAT4J PB Resolution 2.2.1 (complete)	SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf9.ucl--soft-0-100-0.wbo	MOPT f=1 TT=43.116 T1=40.15	Signal TT=0.366	MSAT (TO) f=7423 TT=1800.06 T1=1313.17	OPTIMUM f=1 TT=1097.48 T1=1085.03	OPTIMUM f=1 TT=44.417 T1=41.78	OPTIMUM f=1 TT=40.876 T1=37.89	OPTIMUM f=1 TT=43.116 T1=40.15	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.burch_dill.8.accl.ucl--soft-0-100-0.wbo	MSAT f=358 TT=1800.32 T1=1792.52	Signal TT=0.404	MSAT (TO) f=6638 TT=1800.08 T1=1797.82	MSAT (TO) f=224 TT=1800.24 T1=1781.52	MSAT (TO) f=53 TT=1800.3 T1=1639.26	OPTIMUM f=1 TT=1683.95 T1=1260.67	MSAT (TO) f=358 TT=1800.32 T1=1792.52	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.RobRegValid_bar.ucl--soft-0-100-0.wbo	MOPT f=1 TT=503.381 T1=421.81	Signal TT=1.896	MSAT (TO) f=13159 TT=1800.11 T1=1424.4	MSAT (TO) f=1675 TT=1800.23 T1=1785.42	MSAT (TO) f=1675 TT=1800.2 T1=1765.12	MSAT (TO) f=770 TT=1800.33 T1=1780.64	OPTIMUM f=1 TT=503.381 T1=421.81	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB06/web/uclid_pb_benchmarks/ normalized-ooo.ex.br.mem.Src1Valid_Src1ValidBar.ucl--soft-0-100-0.wbo	MSAT f=3422 TT=1800.07 T1=831.68	Signal TT=2.176	? (TO) TT=1800.15	MSAT (TO) f=1856 TT=1800.33 T1=1791.12	MSAT (TO) f=5773 TT=1800.3 T1=184.94	MSAT (TO) f=1718 TT=1800.4 T1=1779.04	MSAT (TO) f=3422 TT=1800.07 T1=831.68	? (TO) TT=1802.16
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.ex.mem.LdValue.ucl--soft-0-100-0.wbo	MSAT f=3456 TT=1800.31 T1=1593.49	Signal TT=1.507	MSAT (TO) f=45633 TT=1800.13 T1=1793.36	MSAT (TO) f=2178 TT=1800.28 T1=1788.42	MSAT (TO) f=1197 TT=1800.35 T1=1704.62	MSAT (TO) f=758 TT=1800.37 T1=1782.13	MSAT (TO) f=3456 TT=1800.31 T1=1593.49	? (TO) TT=1800.15
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf10.ucl--soft-0-100-0.wbo	MOPT f=1 TT=228.704 T1=215.05	Signal TT=0.313	MSAT (TO) f=5446 TT=1800.09 T1=1659.79	MSAT (TO) f=217 TT=1800.25 T1=1770.62	MSAT (TO) f=1068 TT=1800.35 T1=1747.94	OPTIMUM f=1 TT=124.783 T1=109.93	OPTIMUM f=1 TT=228.704 T1=215.05	? (TO) TT=1800.08
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf9.ucl--soft-0-100-0.wbo	MOPT f=1 TT=39.406 T1=35.36	Signal TT=0.198	MSAT (TO) f=3611 TT=1800.09 T1=1755.55	MSAT (TO) f=393 TT=1800.32 T1=1336.32	OPTIMUM f=1 TT=327.329 T1=300.89	OPTIMUM f=1 TT=84.628 T1=81.63	OPTIMUM f=1 TT=39.406 T1=35.36	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag10.ucl--soft-0-100-0.wbo	MOPT f=1 TT=41.179 T1=39.16	Signal TT=0.175	MSAT (TO) f=611 TT=1800.08 T1=1799	Wrong Opt. f=10 TT=616.71 T1=605.76	Wrong Opt. f=10 TT=45.052 T1=54.9	Wrong Opt. f=10 TT=23.14 T1=21	OPTIMUM f=1 TT=41.179 T1=39.16	MSAT (TO) f=26174 TT=1800.11 T1=1799.92
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag12.ucl--soft-0-100-0.wbo	MOPT f=1 TT=203.451 T1=199.19	Signal TT=0.357	MSAT (TO) f=4357 TT=1800.08 T1=1757.4	MSAT (TO) f=1199 TT=1800.28 T1=1782.33	Wrong Opt. f=10 TT=385.364 T1=305.47	Wrong Opt. f=10 TT=344.321 T1=339.8	OPTIMUM f=1 TT=203.451 T1=199.19	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag14.ucl--soft-0-100-0.wbo	MSAT f=1712 TT=1800.3 T1=1766.07	Signal TT=0.708	MSAT (TO) f=9558 TT=1800.08 T1=1787.55	MSAT (TO) f=3048 TT=1800.25 T1=1788.02	MSAT (TO) f=1827 TT=1800.3 T1=1684.83	MSAT (TO) f=4 TT=1800.24 T1=1787.74	MSAT (TO) f=1712 TT=1800.3 T1=1766.07	? (TO) TT=1800.11
Bench name	Best results	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SAT4J PB Resolution 2.2.1 (complete)	SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)
/SOFT-BIGINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.unbounded.all.ucl--soft-0-100-0.wbo	MSAT f=919 TT=1800.31 T1=1789.73	Signal TT=1.637	MSAT (TO) f=50994 TT=1800.14 T1=1790.67	MSAT (TO) f=3056 TT=1800.28 T1=1781.52	MSAT (TO) f=3252 TT=1800.25 T1=1316.75	MSAT (TO) f=1374 TT=1800.36 T1=1781.93	MSAT (TO) f=919 TT=1800.31 T1=1789.73	? (TO) TT=1800.16
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12013_1-unsat--soft-0-100-0.wbo	MSAT f=2882 TT=1800.29 T1=14	Signal TT=0.564	MSAT (TO) f=118920 TT=1800.11 T1=78.82	MSAT (TO) f=6532 TT=1800.25 T1=1790.62	MSAT (TO) f=3588 TT=1800.27 T1=916.18	MSAT (TO) f=3042 TT=1800.35 T1=1322.77	MSAT (TO) f=2882 TT=1800.29 T1=14	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12015_3-unsat--soft-0-100-0.wbo	MSAT f=1701 TT=1800.24 T1=1454.09	Signal TT=0.402	MSAT (TO) f=105415 TT=1800.11 T1=42.2	MSAT (TO) f=5365 TT=1800.21 T1=1785.62	OPTIMUM f=3 TT=132.921 T1=121.11	OPTIMUM f=3 TT=80 T1=76.7	MSAT (TO) f=1701 TT=1800.24 T1=1454.09	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12023_3-unsat--soft-0-100-0.wbo	MOPT f=7 TT=8.587 T1=6.25	Signal TT=0.444	MSAT (TO) f=57234 TT=1800.1 T1=1794.55	Wrong Opt. f=64 TT=8.091 T1=5.77	Wrong Opt. f=64 TT=12.625 T1=8.44	Wrong Opt. f=64 TT=10.186 T1=7.39	OPTIMUM f=7 TT=8.587 T1=6.25	? (TO) TT=1800.12
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12026_5-unsat--soft-0-100-0.wbo	MSAT f=3203 TT=1800.34 T1=10.15	Signal TT=0.631	MSAT (TO) f=132462 TT=1800.14 T1=111.53	MSAT (TO) f=7084 TT=1800.32 T1=10.31	MSAT (TO) f=4035 TT=1800.27 T1=1550.68	MSAT (TO) f=3183 TT=1800.36 T1=1793	MSAT (TO) f=3203 TT=1800.34 T1=10.15	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12027_7-unsat--soft-0-100-0.wbo	MSAT f=1224 TT=1800.25 T1=7.28	Signal TT=0.533	MSAT (TO) f=126970 TT=1800.11 T1=74.77	MSAT (TO) f=5392 TT=1800.3 T1=20.45	MSAT (TO) f=3291 TT=1800.25 T1=1296.3	MSAT (TO) f=1620 TT=1800.37 T1=1784.25	MSAT (TO) f=1224 TT=1800.25 T1=7.28	? (TO) TT=1800.12
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j12041_4-unsat--soft-0-100-0.wbo	MOPT f=1 TT=1532.52 T1=1528.35	Signal TT=0.541	MSAT (TO) f=77342 TT=1800.09 T1=1020.13	MSAT (TO) f=222 TT=1800.31 T1=8.25	MSAT (TO) f=1005 TT=1800.29 T1=212.98	Wrong Opt. f=35 TT=190.053 T1=185.43	OPTIMUM f=1 TT=1532.52 T1=1528.35	? (TO) TT=1800.1
/SOFT-BIGINT-LIN/PB10/oliveras/ j120/ normalized-j1205_1-unsat--soft-0-100-0.wbo	MOPT f=3 TT=7.074 T1=4.78	Signal TT=0.394	MSAT (TO) f=45356 TT=1800.12 T1=1454.61	Wrong Opt. f=40 TT=7.3 T1=4.9	Wrong Opt. f=40 TT=10.983 T1=7.18	Wrong Opt. f=40 TT=8.791 T1=6.17	OPTIMUM f=3 TT=7.074 T1=4.78	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6010_2-unsat--soft-0-100-0.wbo	MOPT f=9 TT=3.214 T1=1.37	Signal TT=0.152	MSAT (TO) f=36793 TT=1800.07 T1=1188.01	Wrong Opt. f=71 TT=2.951 T1=1.37	Wrong Opt. f=71 TT=4.732 T1=2.4	Wrong Opt. f=71 TT=3.276 T1=1.53	OPTIMUM f=9 TT=3.214 T1=1.37	MSAT f=17843 TT=1798 T1=1797.65
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6027_4-unsat--soft-0-100-0.wbo	MOPT f=6 TT=3.155 T1=1.37	Signal TT=0.143	MSAT (TO) f=29870 TT=1800.05 T1=1247.65	Wrong Opt. f=12 TT=2.902 T1=1.33	Wrong Opt. f=12 TT=4.804 T1=2.4	Wrong Opt. f=12 TT=3.209 T1=1.54	OPTIMUM f=6 TT=3.155 T1=1.37	MSAT f=17714 TT=1799.15 T1=1798.79
Bench name	Best results	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SAT4J PB Resolution 2.2.1 (complete)	SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6030_9-unsat--soft-0-100-0.wbo	MOPT f=1 TT=4.258 T1=2.22	Signal TT=0.267	MSAT (TO) f=50648 TT=1800.07 T1=16.86	Wrong Opt. f=96 TT=4.275 T1=2.29	Wrong Opt. f=96 TT=6.656 T1=3.55	Wrong Opt. f=96 TT=4.829 T1=2.65	OPTIMUM f=1 TT=4.258 T1=2.22	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j603_2-unsat--soft-0-100-0.wbo	MOPT f=4 TT=3.056 T1=1.41	Signal TT=0.147	MSAT (TO) f=15069 TT=1800.08 T1=1361.28	Wrong Opt. f=91 TT=2.864 T1=1.4	Wrong Opt. f=91 TT=5.135 T1=2.55	Wrong Opt. f=91 TT=3.324 T1=1.65	OPTIMUM f=4 TT=3.056 T1=1.41	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j6033_2-unsat--soft-0-100-0.wbo	MOPT f=20 TT=4.067 T1=2.25	Signal TT=0.258	MSAT (TO) f=26532 TT=1800.08 T1=43.96	Wrong Opt. f=35 TT=3.943 T1=2.23	Wrong Opt. f=35 TT=5.717 T1=3.57	Wrong Opt. f=35 TT=4.989 T1=2.75	OPTIMUM f=20 TT=4.067 T1=2.25	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j605_10-unsat--soft-0-100-0.wbo	MSAT f=135 TT=1800.33 T1=1390.77	Signal TT=0.191	MSAT (TO) f=41727 TT=1800.08 T1=1420.75	MSAT (TO) f=2051 TT=1800.28 T1=1777.72	MSAT (TO) f=145 TT=1800.22 T1=1196.43	Wrong Opt. f=138 TT=557.817 T1=174.29	MSAT (TO) f=135 TT=1800.33 T1=1390.77	? (TO) TT=1800.07
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j605_1-unsat--soft-0-100-0.wbo	MOPT f=1 TT=281.443 T1=278.68	Signal TT=0.17	MSAT (TO) f=35653 TT=1800.06 T1=49.52	MSAT (TO) f=5138 TT=1800.16 T1=2.06	Wrong Opt. f=14 TT=320.044 T1=297.58	Wrong Opt. f=14 TT=58.972 T1=56.43	OPTIMUM f=1 TT=281.443 T1=278.68	? (TO) TT=1800.06
/SOFT-BIGINT-LIN/PB10/ oliveras/j60/ normalized-j606_1-unsat--soft-0-100-0.wbo	MOPT f=13 TT=3.072 T1=1.33	Signal TT=0.131	MSAT (TO) f=26948 TT=1800.07 T1=1210.1	Wrong Opt. f=71 TT=4.212 T1=1.72	Wrong Opt. f=71 TT=5.758 T1=2.38	Wrong Opt. f=71 TT=3.187 T1=1.5	OPTIMUM f=13 TT=3.072 T1=1.33	MSAT f=17460 TT=1797.53 T1=1797.2
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9010_6-unsat--soft-0-100-0.wbo	MOPT f=5 TT=5.1 T1=3.1	Signal TT=0.325	MSAT (TO) f=85420 TT=1800.13 T1=1035.56	Wrong Opt. f=43 TT=5.307 T1=3.38	Wrong Opt. f=43 TT=9.258 T1=5.1	Wrong Opt. f=43 TT=6.54 T1=4.05	OPTIMUM f=5 TT=5.1 T1=3.1	? (TO) TT=1800.1
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9012_2-unsat--soft-0-100-0.wbo	MOPT f=9 TT=4.162 T1=2.29	Signal TT=0.249	MSAT (TO) f=28290 TT=1800.07 T1=1445.9	Wrong Opt. f=49 TT=4.162 T1=2.34	Wrong Opt. f=49 TT=6.217 T1=3.64	Wrong Opt. f=49 TT=4.889 T1=2.74	OPTIMUM f=9 TT=4.162 T1=2.29	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9014_1-unsat--soft-0-100-0.wbo	MOPT f=2 TT=5.246 T1=3.05	Signal TT=0.357	MSAT (TO) f=74392 TT=1800.11 T1=23.66	Wrong Opt. f=11 TT=5.674 T1=3.36	Wrong Opt. f=11 TT=8.514 T1=4.76	Wrong Opt. f=11 TT=6.263 T1=3.87	OPTIMUM f=2 TT=5.246 T1=3.05	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB10/oliveras/ j90/ normalized-j9015_10-unsat--soft-0-100-0.wbo	MOPT f=11 TT=4.481 T1=2.49	Signal TT=0.28	MSAT (TO) f=74911 TT=1800.09 T1=1297.82	Wrong Opt. f=87 TT=4.592 T1=2.59	Wrong Opt. f=87 TT=7.43 T1=4.04	Wrong Opt. f=87 TT=5.447 T1=3.18	OPTIMUM f=11 TT=4.481 T1=2.49	? (TO) TT=1800.1
Bench name	Best results	PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SAT4J PB Resolution 2.2.1 (complete)	SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9028_2-unsat--soft-0-100-0.wbo	MOPT f=8 TT=4.49 T1=2.51	Signal TT=0.274	MSAT (TO) f=49556 TT=1800.1 T1=889.08	Wrong Opt. f=25 TT=4.38 T1=2.54	Wrong Opt. f=25 TT=6.962 T1=4.23	Wrong Opt. f=25 TT=5.427 T1=3.17	OPTIMUM f=8 TT=4.49 T1=2.51	? (TO) TT=1800.11
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j903_10-unsat--soft-0-100-0.wbo	MOPT f=8 TT=3.893 T1=1.93	Signal TT=0.206	MSAT (TO) f=20897 TT=1800.11 T1=1363.81	Wrong Opt. f=14 TT=3.878 T1=1.95	Wrong Opt. f=14 TT=5.824 T1=3.31	Wrong Opt. f=14 TT=4.731 T1=2.42	OPTIMUM f=8 TT=3.893 T1=1.93	? (TO) TT=1800.13
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9035_1-unsat--soft-0-100-0.wbo	MOPT f=8 TT=6.01 T1=3.7	Signal TT=0.339	MSAT (TO) f=32818 TT=1800.08 T1=1230.97	Wrong Opt. f=21 TT=6.186 T1=3.73	Wrong Opt. f=21 TT=9.504 T1=5.89	Wrong Opt. f=21 TT=7.513 T1=4.78	OPTIMUM f=8 TT=6.01 T1=3.7	? (TO) TT=1800.09
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9039_3-unsat--soft-0-100-0.wbo	MOPT f=23 TT=5.017 T1=2.98	Signal TT=0.298	MSAT (TO) f=65567 TT=1800.12 T1=618.55	Wrong Opt. f=98 TT=5.149 T1=3.11	Wrong Opt. f=98 TT=7.984 T1=4.67	Wrong Opt. f=98 TT=6.193 T1=3.81	OPTIMUM f=23 TT=5.017 T1=2.98	? (TO) TT=1800.1
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j9048_1-unsat--soft-0-100-0.wbo	MOPT f=18 TT=4.972 T1=2.96	Signal TT=0.357	MSAT (TO) f=60376 TT=1800.1 T1=103.06	Wrong Opt. f=91 TT=4.873 T1=2.97	Wrong Opt. f=91 TT=7.427 T1=4.7	Wrong Opt. f=91 TT=6.24 T1=3.77	OPTIMUM f=18 TT=4.972 T1=2.96	? (TO) TT=1800.14
/SOFT-BIGINT-LIN/PB10/ oliveras/j90/ normalized-j907_8-unsat--soft-0-100-0.wbo	MOPT f=11 TT=3.756 T1=1.86	Signal TT=0.207	MSAT (TO) f=30916 TT=1800.08 T1=1021.06	Wrong Opt. f=94 TT=3.747 T1=1.89	Wrong Opt. f=94 TT=5.552 T1=3.12	Wrong Opt. f=94 TT=4.359 T1=2.41	OPTIMUM f=11 TT=3.756 T1=1.86	? (TO) TT=1800.07

Statistics		PB/CT 0.1 (complete)	PB/CT 0.1 fixed (complete)	SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)	SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)	SAT4J PB Resolution 2.2.0 2010-05-26 (complete)	SAT4J PB Resolution 2.2.1 (complete)	SCIPclp SCIP 1.2.1.3 with Clp 1.11.1 (Release Version) as LP solver (complete)
Number of times the solver is able to give the best known answer		0	0	0	0	0	46	0
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		0	0	0	0	0	46	0