PB'16 competition: WBO track: results by benchmark

Results by benchmark for category only soft constraints, small integers, linear constraints (SOFT-SMALLINT-LIN)

This page displays the results of the different solvers for each benchmark for category only soft constraints, small integers, linear constraints (SOFT-SMALLINT-LIN)

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance
text	the solver was ended by a signal
text	the solver gave an incomplete answer
text	the solver was disqualified in the category
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
NaPS 1.02 (complete)
Sat4j PB 2.3.6 Res+CP PB16 (complete)
Sat4j PB 2.3.6 Resolution PB16 (complete)
toysat 2016-05-02 (complete)

Bench name	Best results on this instance	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl10_11_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=9 TT=0.364 T1=0.64	OPTIMUM f=9 TT=1.323 T1=1.32	OPTIMUM f=9 TT=0.364 T1=0.64	OPTIMUM f=9 TT=1015.91 T1=38.53	OPTIMUM f=9 TT=1381.81 T1=1382.32
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl10_15_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=6 TT=0.463 T1=1.15	OPTIMUM f=6 TT=1.334 T1=1.33	OPTIMUM f=6 TT=0.463 T1=1.15	MSAT (TO) f=6 TT=1800.85 T1=2.32	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl10_20_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=7 TT=0.577 T1=0.58	OPTIMUM f=7 TT=1.187 T1=1.18	OPTIMUM f=7 TT=0.577 T1=1.18	MSAT (TO) f=7 TT=1800.57 T1=0.58	OPTIMUM f=7 TT=1779.18 T1=1779.69
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl15_16_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=8 TT=0.903 T1=0.66	MSAT (TO) f=13 TT=1800.02 T1=1800.3	OPTIMUM f=8 TT=0.903 T1=0.66	MSAT (TO) f=8 TT=1800.47 T1=1.16	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl15_20_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=17 TT=0.752 T1=1.17	MSAT (TO) f=23 TT=1800.02 T1=1800.3	OPTIMUM f=17 TT=0.752 T1=1.17	MSAT (TO) f=17 TT=1800.75 T1=4.87	? (TO) TT=1800.02
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl15_25_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=10 TT=1.156 T1=1.19	OPTIMUM f=10 TT=1506.6 T1=1506.84	OPTIMUM f=10 TT=1.156 T1=1.19	MSAT (TO) f=10 TT=1800.05 T1=2.88	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl20_21_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=2 TT=1.276 T1=1.2	MSAT (TO) f=2 TT=1800.01 T1=1800.3	OPTIMUM f=2 TT=1.276 T1=1.2	MSAT (TO) f=2 TT=1800.86 T1=4.6	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl20_25_pb.cnf.cr--soft-0-100-0.wbo	MSAT f=10 TT=1800 T1=1.23	MSAT (TO) f=15 TT=1800.02 T1=1800.3	MSAT (TO) f=10 TT=1800.94 T1=1.23	MSAT (TO) f=10 TT=1800 T1=9.93	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl20_30_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=9 TT=1.414 T1=1.21	MSAT (TO) f=9 TT=1800.02 T1=1800.3	OPTIMUM f=9 TT=1.414 T1=1.21	MSAT (TO) f=9 TT=1800.07 T1=13.57	? (TO) TT=1800.08
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl30_31_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=5 TT=2.395 T1=1.23	MSAT (TO) f=7 TT=1800.02 T1=1800.3	OPTIMUM f=5 TT=2.395 T1=1.23	MSAT (TO) f=5 TT=1800.08 T1=43.19	? (TO) TT=1800.1
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl30_35_pb.cnf.cr--soft-0-100-0.wbo	MSAT f=7 TT=1800.01 T1=1.25	MSAT (TO) f=8 TT=1800.02 T1=1800.3	MSAT (TO) f=7 TT=1800.81 T1=1.25	MSAT (TO) f=7 TT=1800.01 T1=4.84	? (TO) TT=1800.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl30_40_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=10 TT=2.373 T1=1.26	MSAT (TO) f=12 TT=1800.02 T1=1800.3	OPTIMUM f=10 TT=2.373 T1=1.26	MSAT (TO) f=10 TT=1800.08 T1=73.13	? (TO) TT=1800.03
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl35_36_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=5 TT=3.173 T1=1.77	MSAT (TO) f=7 TT=1800.11 T1=1800.4	OPTIMUM f=5 TT=3.173 T1=1.77	MSAT (TO) f=5 TT=1800.02 T1=34.23	? (TO) TT=1800.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl35_40_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=8 TT=2.763 T1=1.27	MSAT (TO) f=10 TT=1800.11 T1=1800.4	OPTIMUM f=8 TT=2.763 T1=1.27	MSAT (TO) f=8 TT=1800.09 T1=35.74	? (TO) TT=1800.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl35_45_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=10 TT=2.493 T1=1.78	MSAT (TO) f=13 TT=1800.02 T1=1800.4	OPTIMUM f=10 TT=2.493 T1=1.78	MSAT (TO) f=10 TT=1800.76 T1=196.81	? (TO) TT=1800.08
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl40_41_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=5 TT=3.352 T1=1.79	MSAT (TO) f=5 TT=1800.11 T1=1800.4	OPTIMUM f=5 TT=3.352 T1=1.79	MSAT (TO) f=5 TT=1800.06 T1=62.72	? (TO) TT=1800.05
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl40_45_pb.cnf.cr--soft-0-100-0.wbo	MSAT f=4 TT=1800.02 T1=1.79	MSAT (TO) f=4 TT=1800.02 T1=1800.3	MSAT (TO) f=4 TT=1800.07 T1=1.79	MSAT (TO) f=4 TT=1800.05 T1=199.05	? (TO) TT=1800.05
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl40_50_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=6 TT=3.263 T1=1.82	MSAT (TO) f=7 TT=1800.07 T1=1800.4	OPTIMUM f=6 TT=3.263 T1=1.82	MSAT (TO) f=6 TT=1800.06 T1=700.04	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl50_51_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=3 TT=6.133 T1=2.84	MSAT (TO) f=4 TT=1800.02 T1=1800.3	OPTIMUM f=3 TT=6.133 T1=2.84	MSAT (TO) f=3 TT=1800 T1=149.96	? (TO) TT=1800.06
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl50_55_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=6 TT=3.42 T1=1.34	MSAT (TO) f=6 TT=1800.11 T1=1800.4	OPTIMUM f=6 TT=3.42 T1=1.34	MSAT (TO) f=6 TT=1800.01 T1=780.77	? (TO) TT=1800.05
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB05/ aloul/FPGA_SAT05/ normalized-chnl50_60_pb.cnf.cr--soft-0-100-0.wbo	MOPT f=3 TT=3.883 T1=1.84	MSAT (TO) f=4 TT=1800.1 T1=1800.4	OPTIMUM f=3 TT=3.883 T1=1.84	MSAT (TO) f=3 TT=1800.05 T1=426.13	? (TO) TT=1800.01
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900544484--soft-0-100-0.wbo	MOPT f=1 TT=10.893 T1=7.79	OPTIMUM f=1 TT=29.995 T1=29.87	MSAT (TO) f=64 TT=1800.91 T1=19.58	OPTIMUM f=1 TT=10.893 T1=7.79	OPTIMUM f=1 TT=126.359 T1=126.31
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900545610--soft-0-100-0.wbo	MOPT f=1 TT=15.512 T1=5.22	OPTIMUM f=1 TT=28.09 T1=27.97	OPTIMUM f=1 TT=40.31 T1=27.4	OPTIMUM f=1 TT=15.512 T1=5.22	OPTIMUM f=1 TT=123.026 T1=122.98
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900546076--soft-0-100-0.wbo	MOPT f=3 TT=25.693 T1=21.41	OPTIMUM f=3 TT=43.708 T1=43.58	MSAT (TO) f=17 TT=1800.01 T1=1774.12	OPTIMUM f=3 TT=31.05 T1=29.14	OPTIMUM f=3 TT=25.693 T1=21.41
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900546417--soft-0-100-0.wbo	MOPT f=1 TT=31.95 T1=4.61	OPTIMUM f=1 TT=36.979 T1=36.84	MSAT (TO) f=35 TT=1800.08 T1=18.14	OPTIMUM f=1 TT=31.95 T1=4.61	OPTIMUM f=1 TT=179.68 T1=179.65
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900547389--soft-0-100-0.wbo	MOPT f=1 TT=50.61 T1=42.7	OPTIMUM f=1 TT=50.983 T1=50.82	MSAT (TO) f=33 TT=1800.73 T1=1765.92	OPTIMUM f=1 TT=50.61 T1=42.7	OPTIMUM f=1 TT=83.745 T1=83.7
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900548667--soft-0-100-0.wbo	MOPT f=1 TT=111.764 T1=3.99	OPTIMUM f=1 TT=111.764 T1=111.57	MSAT (TO) f=10 TT=1800.09 T1=1787.21	OPTIMUM f=1 TT=114.73 T1=3.99	? (TO) TT=1800.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900550006--soft-0-100-0.wbo	MOPT f=1 TT=60.796 T1=5.78	OPTIMUM f=1 TT=60.796 T1=60.66	MSAT (TO) f=8 TT=1800.83 T1=1776.22	OPTIMUM f=1 TT=81.82 T1=5.78	OPTIMUM f=1 TT=802.61 T1=802.68
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900550720--soft-0-100-0.wbo	MOPT f=1 TT=18.881 T1=6.73	OPTIMUM f=1 TT=65.752 T1=65.59	MSAT (TO) f=15 TT=1800.55 T1=935.8	OPTIMUM f=1 TT=18.881 T1=6.73	OPTIMUM f=1 TT=353.109 T1=353.1
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900551347--soft-0-100-0.wbo	MOPT f=2 TT=23.78 T1=20.31	OPTIMUM f=2 TT=53.633 T1=53.48	MSAT (TO) f=564 TT=1800 T1=1.41	OPTIMUM f=2 TT=23.78 T1=20.31	OPTIMUM f=2 TT=94.408 T1=90.02
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900551864--soft-0-100-0.wbo	MOPT f=1 TT=11.422 T1=8.5	OPTIMUM f=1 TT=33.495 T1=33.32	MSAT (TO) f=4 TT=1800.03 T1=1783.43	OPTIMUM f=1 TT=11.422 T1=8.5	OPTIMUM f=1 TT=28.235 T1=28.19
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900552288--soft-0-100-0.wbo	MOPT f=1 TT=26.87 T1=5.09	OPTIMUM f=1 TT=46.933 T1=46.81	MSAT (TO) f=16 TT=1800.66 T1=1776.52	OPTIMUM f=1 TT=26.87 T1=5.09	OPTIMUM f=1 TT=72.691 T1=72.64
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900552423--soft-0-100-0.wbo	MOPT f=5 TT=26.067 T1=23.83	OPTIMUM f=5 TT=40.357 T1=40.2	MSAT (TO) f=6 TT=1800.97 T1=1776.72	OPTIMUM f=5 TT=27.47 T1=23.83	OPTIMUM f=5 TT=26.067 T1=26
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900552735--soft-0-100-0.wbo	MOPT f=4 TT=80.036 T1=79.94	OPTIMUM f=4 TT=80.036 T1=79.94	MSAT (TO) f=42 TT=1800.61 T1=1763.52	OPTIMUM f=4 TT=86.16 T1=80.82	OPTIMUM f=4 TT=182.394 T1=156.71
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900553647--soft-0-100-0.wbo	MOPT f=1 TT=29.649 T1=11.56	OPTIMUM f=1 TT=30.833 T1=30.7	MSAT (TO) f=45 TT=1800.01 T1=1786.52	OPTIMUM f=1 TT=29.649 T1=11.56	OPTIMUM f=1 TT=106.863 T1=106.81
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900553812--soft-0-100-0.wbo	MOPT f=3 TT=18.922 T1=14.53	OPTIMUM f=3 TT=49.447 T1=49.26	MSAT (TO) f=22 TT=1800.21 T1=1777.01	OPTIMUM f=3 TT=18.922 T1=14.53	OPTIMUM f=3 TT=48.267 T1=48.2
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900554072--soft-0-100-0.wbo	MOPT f=1 TT=12.231 T1=10.1	OPTIMUM f=1 TT=49.694 T1=49.52	MSAT (TO) f=22 TT=1800.76 T1=20.7	OPTIMUM f=1 TT=12.231 T1=10.1	OPTIMUM f=1 TT=45.21 T1=45.17
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900554420--soft-0-100-0.wbo	MOPT f=1 TT=21.271 T1=12.17	OPTIMUM f=1 TT=23.067 T1=22.95	MSAT (TO) f=3 TT=1800.77 T1=1770.12	OPTIMUM f=1 TT=21.271 T1=12.17	OPTIMUM f=1 TT=34.877 T1=34.84
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900556231--soft-0-100-0.wbo	MOPT f=1 TT=21.72 T1=18.9	OPTIMUM f=1 TT=42.241 T1=42.08	MSAT (TO) f=47 TT=1800.55 T1=298.14	OPTIMUM f=1 TT=21.72 T1=18.9	OPTIMUM f=1 TT=137.064 T1=137.03
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900557362--soft-0-100-0.wbo	MOPT f=5 TT=39.238 T1=30.92	OPTIMUM f=5 TT=129.139 T1=128.99	OPTIMUM f=5 TT=101.829 T1=59.96	OPTIMUM f=5 TT=39.238 T1=36.72	OPTIMUM f=5 TT=60.184 T1=30.92
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900557574--soft-0-100-0.wbo	MOPT f=6 TT=41.448 T1=26.22	OPTIMUM f=6 TT=71.725 T1=71.59	MSAT (TO) f=49 TT=1800.74 T1=27.25	OPTIMUM f=6 TT=41.448 T1=26.22	OPTIMUM f=6 TT=166.374 T1=75.73
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900557957--soft-0-100-0.wbo	MOPT f=3 TT=48.586 T1=43.91	OPTIMUM f=3 TT=87.82 T1=87.63	MSAT (TO) f=8 TT=1800.78 T1=591.08	OPTIMUM f=3 TT=48.586 T1=43.91	OPTIMUM f=3 TT=132.449 T1=91.75
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900558106--soft-0-100-0.wbo	MOPT f=7 TT=19.29 T1=11.37	OPTIMUM f=7 TT=54.68 T1=54.52	OPTIMUM f=7 TT=50.977 T1=47.09	OPTIMUM f=7 TT=19.29 T1=11.37	OPTIMUM f=7 TT=59.942 T1=32.15
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900558739--soft-0-100-0.wbo	MOPT f=1 TT=26.871 T1=17	OPTIMUM f=1 TT=52.555 T1=52.42	MSAT (TO) f=10 TT=1800.43 T1=1325.1	OPTIMUM f=1 TT=26.871 T1=17	OPTIMUM f=1 TT=146.476 T1=146.43
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900559676--soft-0-100-0.wbo	MOPT f=1 TT=41.88 T1=20.46	OPTIMUM f=1 TT=63.737 T1=63.62	MSAT (TO) f=48 TT=1800.03 T1=36.21	OPTIMUM f=1 TT=41.88 T1=20.46	OPTIMUM f=1 TT=793.179 T1=793.34
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900561288--soft-0-100-0.wbo	MOPT f=1 TT=85.81 T1=11.11	OPTIMUM f=1 TT=103.013 T1=102.89	MSAT (TO) f=15 TT=1800 T1=1784.22	OPTIMUM f=1 TT=85.81 T1=11.11	? (TO) TT=1800.05
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900562192--soft-0-100-0.wbo	MOPT f=1 TT=9.085 T1=6.23	OPTIMUM f=1 TT=32.014 T1=31.89	MSAT (TO) f=28 TT=1800.06 T1=1764.01	OPTIMUM f=1 TT=9.085 T1=6.23	OPTIMUM f=1 TT=181.984 T1=181.95
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900563250--soft-0-100-0.wbo	MOPT f=1 TT=30.45 T1=6.29	OPTIMUM f=1 TT=66.479 T1=66.3	MSAT (TO) f=19 TT=1800.03 T1=23.77	OPTIMUM f=1 TT=30.45 T1=6.29	OPTIMUM f=1 TT=307.05 T1=307.03
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900563801--soft-0-100-0.wbo	MOPT f=1 TT=15.891 T1=13.12	OPTIMUM f=1 TT=46.719 T1=46.57	MSAT (TO) f=10 TT=1800.75 T1=16.08	OPTIMUM f=1 TT=15.891 T1=13.12	OPTIMUM f=1 TT=16.705 T1=16.68
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900564281--soft-0-100-0.wbo	MOPT f=2 TT=25.82 T1=21.83	OPTIMUM f=2 TT=52.766 T1=52.63	MSAT (TO) f=30 TT=1800.61 T1=1774.42	OPTIMUM f=2 TT=25.82 T1=21.83	OPTIMUM f=2 TT=34.378 T1=25.55
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900564824--soft-0-100-0.wbo	MOPT f=8 TT=50.06 T1=41.91	OPTIMUM f=8 TT=52.249 T1=52.07	MSAT (TO) f=39 TT=1800.01 T1=1785.95	OPTIMUM f=8 TT=50.06 T1=41.91	OPTIMUM f=8 TT=119.814 T1=71.93
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900565534--soft-0-100-0.wbo	MOPT f=1 TT=16.732 T1=5.36	OPTIMUM f=1 TT=38.086 T1=37.95	MSAT (TO) f=42 TT=1800.06 T1=19.59	OPTIMUM f=1 TT=16.732 T1=5.36	OPTIMUM f=1 TT=72.744 T1=72.69
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900566157--soft-0-100-0.wbo	MOPT f=1 TT=30.709 T1=28.85	OPTIMUM f=1 TT=30.859 T1=30.72	MSAT (TO) f=10 TT=1800.7 T1=137.38	OPTIMUM f=1 TT=30.709 T1=28.85	OPTIMUM f=1 TT=134.835 T1=134.8
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900567024--soft-0-100-0.wbo	MOPT f=3 TT=17.533 T1=14.05	OPTIMUM f=3 TT=39.56 T1=39.38	MSAT (TO) f=23 TT=1800.08 T1=1780.01	OPTIMUM f=3 TT=17.533 T1=14.05	OPTIMUM f=3 TT=38.648 T1=35.58
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900567135--soft-0-100-0.wbo	MOPT f=1 TT=27.766 T1=27.65	OPTIMUM f=1 TT=27.766 T1=27.65	MSAT (TO) f=8 TT=1800.06 T1=1757.12	OPTIMUM f=1 TT=35.14 T1=32.12	OPTIMUM f=1 TT=68.38 T1=68.32
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900567985--soft-0-100-0.wbo	MOPT f=1 TT=69.801 T1=7.57	OPTIMUM f=1 TT=69.801 T1=69.63	MSAT (TO) f=24 TT=1800.72 T1=1780.32	OPTIMUM f=1 TT=86.33 T1=7.57	OPTIMUM f=1 TT=1138.77 T1=1139.01
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900568186--soft-0-100-0.wbo	MOPT f=3 TT=29.72 T1=25.96	OPTIMUM f=3 TT=47.519 T1=47.36	MSAT (TO) f=28 TT=1800.08 T1=24.59	OPTIMUM f=3 TT=29.72 T1=25.96	OPTIMUM f=3 TT=52.496 T1=32.92
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900568706--soft-0-100-0.wbo	MOPT f=1 TT=13.093 T1=10.61	OPTIMUM f=1 TT=45.196 T1=45.03	MSAT (TO) f=25 TT=1800.85 T1=1789.41	OPTIMUM f=1 TT=13.093 T1=10.61	OPTIMUM f=1 TT=66.006 T1=65.94
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900569834--soft-0-100-0.wbo	MOPT f=4 TT=59.724 T1=46.44	OPTIMUM f=4 TT=61.811 T1=61.67	MSAT (TO) f=30 TT=1800.04 T1=29.27	OPTIMUM f=4 TT=59.724 T1=46.44	OPTIMUM f=4 TT=228.866 T1=170.82
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900570242--soft-0-100-0.wbo	MOPT f=5 TT=69.958 T1=69.67	OPTIMUM f=5 TT=69.958 T1=69.82	OPTIMUM f=5 TT=145.692 T1=89.53	OPTIMUM f=5 TT=84.119 T1=80.88	OPTIMUM f=5 TT=88.855 T1=69.67
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900571132--soft-0-100-0.wbo	MOPT f=1 TT=17.68 T1=11.63	OPTIMUM f=1 TT=34.285 T1=34.15	OPTIMUM f=1 TT=39.959 T1=33.01	OPTIMUM f=1 TT=17.68 T1=11.63	OPTIMUM f=1 TT=154.978 T1=154.94
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900571761--soft-0-100-0.wbo	MOPT f=2 TT=26.01 T1=17.58	OPTIMUM f=2 TT=72.669 T1=72.5	MSAT (TO) f=32 TT=1801.08 T1=1794.58	OPTIMUM f=2 TT=26.01 T1=17.58	OPTIMUM f=2 TT=179.043 T1=179
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900573137--soft-0-100-0.wbo	MOPT f=1 TT=18.151 T1=14.17	OPTIMUM f=1 TT=51.786 T1=51.62	MSAT (TO) f=19 TT=1800.17 T1=23.51	OPTIMUM f=1 TT=18.151 T1=14.17	OPTIMUM f=1 TT=106.262 T1=106.22
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900573901--soft-0-100-0.wbo	MOPT f=1 TT=16.021 T1=9.88	OPTIMUM f=1 TT=50.372 T1=50.24	MSAT (TO) f=12 TT=1800.61 T1=1771.03	OPTIMUM f=1 TT=16.021 T1=9.88	OPTIMUM f=1 TT=201.766 T1=201.76
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900574864--soft-0-100-0.wbo	MOPT f=1 TT=13.323 T1=4.93	OPTIMUM f=1 TT=29.536 T1=29.43	OPTIMUM f=1 TT=26.815 T1=13.67	OPTIMUM f=1 TT=13.323 T1=4.93	OPTIMUM f=1 TT=104.602 T1=104.58
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900575442--soft-0-100-0.wbo	MOPT f=1 TT=15.572 T1=10.17	OPTIMUM f=1 TT=33.711 T1=33.57	MSAT (TO) f=3 TT=1800.24 T1=1703.74	OPTIMUM f=1 TT=15.572 T1=10.17	OPTIMUM f=1 TT=40.161 T1=40.13
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900576151--soft-0-100-0.wbo	MOPT f=1 TT=26.15 T1=5.52	OPTIMUM f=1 TT=61.072 T1=60.88	MSAT (TO) f=38 TT=1800.54 T1=1772.51	OPTIMUM f=1 TT=26.15 T1=5.52	OPTIMUM f=1 TT=161.124 T1=161.1
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900576360--soft-0-100-0.wbo	MOPT f=2 TT=23.761 T1=18.29	OPTIMUM f=2 TT=55.432 T1=55.3	MSAT (TO) f=6 TT=1800.09 T1=120.21	OPTIMUM f=2 TT=23.761 T1=18.29	OPTIMUM f=2 TT=113.683 T1=110.34
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900576927--soft-0-100-0.wbo	MOPT f=1 TT=48.21 T1=5.19	OPTIMUM f=1 TT=61.326 T1=61.21	OPTIMUM f=1 TT=176.067 T1=107.68	OPTIMUM f=1 TT=48.21 T1=5.19	OPTIMUM f=1 TT=1483.83 T1=1484.14
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900577940--soft-0-100-0.wbo	MOPT f=1 TT=28.08 T1=9.74	OPTIMUM f=1 TT=59.46 T1=59.33	MSAT (TO) f=8 TT=1800.67 T1=1582.16	OPTIMUM f=1 TT=28.08 T1=9.74	OPTIMUM f=1 TT=860.988 T1=861.11
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900579996--soft-0-100-0.wbo	MOPT f=1 TT=57.126 T1=10.79	OPTIMUM f=1 TT=57.126 T1=56.97	OPTIMUM f=1 TT=140.142 T1=29.74	OPTIMUM f=1 TT=110.767 T1=10.79	OPTIMUM f=1 TT=698.957 T1=699
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900581320--soft-0-100-0.wbo	MOPT f=1 TT=21.071 T1=3.58	OPTIMUM f=1 TT=48.188 T1=48.04	OPTIMUM f=1 TT=32.318 T1=25.68	OPTIMUM f=1 TT=21.071 T1=3.58	OPTIMUM f=1 TT=288.222 T1=288.2
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900582300--soft-0-100-0.wbo	MOPT f=1 TT=19.742 T1=15.35	OPTIMUM f=1 TT=76.399 T1=76.22	MSAT (TO) f=8 TT=1800.8 T1=30.93	OPTIMUM f=1 TT=19.742 T1=15.35	OPTIMUM f=1 TT=220.138 T1=220.1
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900583053--soft-0-100-0.wbo	MOPT f=1 TT=32.42 T1=7.84	OPTIMUM f=1 TT=75.211 T1=75.1	MSAT (TO) f=18 TT=1800.04 T1=25.61	OPTIMUM f=1 TT=32.42 T1=7.84	OPTIMUM f=1 TT=874.985 T1=875.19
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900584106--soft-0-100-0.wbo	MOPT f=7 TT=47.81 T1=18.4	OPTIMUM f=7 TT=114.612 T1=114.49	MSAT (TO) f=22 TT=1800.09 T1=1780.42	OPTIMUM f=7 TT=47.81 T1=18.4	OPTIMUM f=7 TT=297.765 T1=297.81
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900584219--soft-0-100-0.wbo	MOPT f=2 TT=29.619 T1=26.85	OPTIMUM f=2 TT=62.064 T1=61.94	MSAT (TO) f=13 TT=1800.03 T1=1771.62	OPTIMUM f=2 TT=29.619 T1=26.85	OPTIMUM f=2 TT=33.133 T1=29.49
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900667195--soft-0-100-0.wbo	MOPT f=1 TT=38.03 T1=9.47	OPTIMUM f=1 TT=66.919 T1=66.78	MSAT (TO) f=45 TT=1800.8 T1=18.06	OPTIMUM f=1 TT=38.03 T1=9.47	? (TO) TT=1800.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900669797--soft-0-100-0.wbo	MOPT f=1 TT=36.35 T1=31.58	OPTIMUM f=1 TT=47.831 T1=47.71	OPTIMUM f=1 TT=52.178 T1=42.84	OPTIMUM f=1 TT=36.35 T1=31.58	OPTIMUM f=1 TT=56.707 T1=56.65
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900670167--soft-0-100-0.wbo	MOPT f=1 TT=22.37 T1=20.49	OPTIMUM f=1 TT=37.894 T1=37.74	OPTIMUM f=1 TT=64.303 T1=64.09	OPTIMUM f=1 TT=22.37 T1=20.49	OPTIMUM f=1 TT=40.667 T1=40.62
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900670234--soft-0-100-0.wbo	MOPT f=1 TT=77.832 T1=14.76	OPTIMUM f=1 TT=77.832 T1=77.72	MSAT (TO) f=39 TT=1800.66 T1=24.67	OPTIMUM f=1 TT=146.312 T1=14.76	OPTIMUM f=1 TT=331.318 T1=331.31
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ namasivayam/tsp/ normalized-t3002.11tsp11.1900670675--soft-0-100-0.wbo	MOPT f=2 TT=15.762 T1=5.33	OPTIMUM f=2 TT=31.81 T1=31.68	MSAT (TO) f=10 TT=1800.09 T1=82.23	OPTIMUM f=2 TT=15.762 T1=5.33	OPTIMUM f=2 TT=23.694 T1=14.58
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966483--soft-0-100-0.wbo	MOPT f=19 TT=3.804 T1=3.8	OPTIMUM f=19 TT=3.804 T1=3.8	OPTIMUM f=19 TT=50.845 T1=58.4	OPTIMUM f=19 TT=20.33 T1=18.36	OPTIMUM f=19 TT=36.608 T1=16.56
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110966688--soft-0-100-0.wbo	MOPT f=9 TT=7.195 T1=5.67	OPTIMUM f=9 TT=7.195 T1=7.19	OPTIMUM f=9 TT=21.051 T1=27.8	OPTIMUM f=9 TT=7.813 T1=5.67	OPTIMUM f=9 TT=21.428 T1=13.99
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967142--soft-0-100-0.wbo	MOPT f=9 TT=17.037 T1=11.72	OPTIMUM f=9 TT=17.037 T1=17.04	OPTIMUM f=9 TT=24.531 T1=32.79	OPTIMUM f=9 TT=17.25 T1=11.72	OPTIMUM f=9 TT=67.42 T1=32.8
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967523--soft-0-100-0.wbo	MOPT f=3 TT=7.84 T1=7.84	OPTIMUM f=3 TT=7.84 T1=7.84	OPTIMUM f=3 TT=33.558 T1=50.87	OPTIMUM f=3 TT=12.192 T1=9.08	OPTIMUM f=3 TT=31.919 T1=24.44
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110967729--soft-0-100-0.wbo	MOPT f=10 TT=6.634 T1=6.63	OPTIMUM f=10 TT=6.634 T1=6.63	OPTIMUM f=10 TT=24.85 T1=37.84	OPTIMUM f=10 TT=8.662 T1=6.99	OPTIMUM f=10 TT=29.862 T1=29.8
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968094--soft-0-100-0.wbo	MOPT f=9 TT=6.272 T1=6.27	OPTIMUM f=9 TT=6.272 T1=6.27	OPTIMUM f=9 TT=27.269 T1=35.93	OPTIMUM f=9 TT=10.811 T1=9.24	OPTIMUM f=9 TT=32.124 T1=30.56
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968561--soft-0-100-0.wbo	MOPT f=3 TT=7.704 T1=7.7	OPTIMUM f=3 TT=7.704 T1=7.7	OPTIMUM f=3 TT=24.65 T1=41.1	OPTIMUM f=3 TT=15.493 T1=12.39	OPTIMUM f=3 TT=36.887 T1=25.62
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110968898--soft-0-100-0.wbo	MOPT f=3 TT=6.746 T1=6.74	OPTIMUM f=3 TT=6.746 T1=6.74	OPTIMUM f=3 TT=19.191 T1=35.45	OPTIMUM f=3 TT=13.901 T1=11.47	OPTIMUM f=3 TT=17.961 T1=14.16
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969170--soft-0-100-0.wbo	MOPT f=17 TT=9.743 T1=9.74	OPTIMUM f=17 TT=9.743 T1=9.74	OPTIMUM f=17 TT=61.874 T1=62.86	OPTIMUM f=17 TT=18.892 T1=16.59	OPTIMUM f=17 TT=49.804 T1=32
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969577--soft-0-100-0.wbo	MOPT f=4 TT=5.388 T1=5.38	OPTIMUM f=4 TT=5.388 T1=5.38	OPTIMUM f=4 TT=32.649 T1=47.52	OPTIMUM f=4 TT=14.462 T1=13.01	OPTIMUM f=4 TT=19.856 T1=17.9
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110969860--soft-0-100-0.wbo	MOPT f=1 TT=4.267 T1=4.26	OPTIMUM f=1 TT=4.267 T1=4.26	OPTIMUM f=1 TT=28.409 T1=47.99	OPTIMUM f=1 TT=13.411 T1=11.18	OPTIMUM f=1 TT=40.395 T1=40.35
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970444--soft-0-100-0.wbo	MOPT f=8 TT=8.149 T1=7.78	OPTIMUM f=8 TT=8.149 T1=8.14	MSAT (TO) f=21 TT=1801.12 T1=1821.32	OPTIMUM f=8 TT=9.783 T1=7.78	OPTIMUM f=8 TT=32.221 T1=22.65
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110970631--soft-0-100-0.wbo	MOPT f=16 TT=10.435 T1=10.43	OPTIMUM f=16 TT=10.435 T1=10.43	OPTIMUM f=16 TT=34.82 T1=50.15	OPTIMUM f=16 TT=16.922 T1=14.64	OPTIMUM f=16 TT=28.272 T1=23.97
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971363--soft-0-100-0.wbo	MOPT f=4 TT=8.89 T1=7.92	OPTIMUM f=4 TT=8.89 T1=8.88	MSAT (TO) f=14 TT=1800.47 T1=1742.96	OPTIMUM f=4 TT=9.705 T1=7.92	OPTIMUM f=4 TT=27.742 T1=21.63
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110971697--soft-0-100-0.wbo	MOPT f=1 TT=2.983 T1=2.98	OPTIMUM f=1 TT=2.983 T1=2.98	OPTIMUM f=1 TT=96.539 T1=100.68	OPTIMUM f=1 TT=9.214 T1=7.18	OPTIMUM f=1 TT=10.67 T1=10.61
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972154--soft-0-100-0.wbo	MOPT f=1 TT=3.564 T1=3.56	OPTIMUM f=1 TT=3.564 T1=3.56	OPTIMUM f=1 TT=24.828 T1=46.39	OPTIMUM f=1 TT=9.462 T1=7.1	OPTIMUM f=1 TT=16.022 T1=15.96
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110972763--soft-0-100-0.wbo	MOPT f=1 TT=6.377 T1=6.37	OPTIMUM f=1 TT=6.377 T1=6.37	MSAT (TO) f=1 TT=1800.01 T1=117.73	OPTIMUM f=1 TT=18.05 T1=16.36	OPTIMUM f=1 TT=38.276 T1=38.23
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973163--soft-0-100-0.wbo	MOPT f=16 TT=14.596 T1=14.59	OPTIMUM f=16 TT=14.596 T1=14.59	OPTIMUM f=16 TT=49.458 T1=55.78	OPTIMUM f=16 TT=22.623 T1=20.43	OPTIMUM f=16 TT=73.75 T1=38.92
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973364--soft-0-100-0.wbo	MOPT f=2 TT=3.272 T1=3.27	OPTIMUM f=2 TT=3.272 T1=3.27	OPTIMUM f=2 TT=24.009 T1=57.97	OPTIMUM f=2 TT=9.862 T1=8.55	OPTIMUM f=2 TT=21.573 T1=20.27
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110973670--soft-0-100-0.wbo	MOPT f=1 TT=4.642 T1=4.64	OPTIMUM f=1 TT=4.642 T1=4.64	OPTIMUM f=1 TT=26.77 T1=41.29	OPTIMUM f=1 TT=9.373 T1=7.47	OPTIMUM f=1 TT=26.173 T1=26.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974180--soft-0-100-0.wbo	MOPT f=1 TT=5.986 T1=5.98	OPTIMUM f=1 TT=5.986 T1=5.98	OPTIMUM f=1 TT=38.769 T1=59.46	OPTIMUM f=1 TT=19.352 T1=17.86	OPTIMUM f=1 TT=28.561 T1=28.5
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110974372--soft-0-100-0.wbo	MOPT f=36 TT=16.471 T1=7.24	OPTIMUM f=36 TT=38.576 T1=38.58	OPTIMUM f=36 TT=48.337 T1=50.02	OPTIMUM f=36 TT=16.471 T1=7.24	OPTIMUM f=36 TT=70.853 T1=27.97
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975607--soft-0-100-0.wbo	MOPT f=9 TT=4.172 T1=4.17	OPTIMUM f=9 TT=4.172 T1=4.17	OPTIMUM f=9 TT=31.732 T1=40.49	OPTIMUM f=9 TT=9.605 T1=7.66	OPTIMUM f=9 TT=19.652 T1=9.57
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110975965--soft-0-100-0.wbo	MOPT f=1 TT=5.484 T1=5.48	OPTIMUM f=1 TT=5.484 T1=5.48	OPTIMUM f=1 TT=25.913 T1=27.39	OPTIMUM f=1 TT=11.061 T1=7.78	OPTIMUM f=1 TT=39.624 T1=39.57
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976157--soft-0-100-0.wbo	MOPT f=9 TT=3.831 T1=3.82	OPTIMUM f=9 TT=3.831 T1=3.82	OPTIMUM f=9 TT=27.93 T1=38.4	OPTIMUM f=9 TT=11.54 T1=9.6	OPTIMUM f=9 TT=20.51 T1=20.46
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976730--soft-0-100-0.wbo	MOPT f=10 TT=13.823 T1=5.11	OPTIMUM f=10 TT=25.039 T1=25.04	OPTIMUM f=10 TT=33.259 T1=26.13	OPTIMUM f=10 TT=13.823 T1=5.11	OPTIMUM f=10 TT=71.409 T1=27.05
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110976935--soft-0-100-0.wbo	MOPT f=2 TT=4.652 T1=4.65	OPTIMUM f=2 TT=4.652 T1=4.65	OPTIMUM f=2 TT=529.064 T1=75.69	OPTIMUM f=2 TT=14.512 T1=12.05	OPTIMUM f=2 TT=20.073 T1=17.37
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977273--soft-0-100-0.wbo	MOPT f=1 TT=5.425 T1=5.42	OPTIMUM f=1 TT=5.425 T1=5.42	OPTIMUM f=1 TT=44.328 T1=57.03	OPTIMUM f=1 TT=20.371 T1=18.82	OPTIMUM f=1 TT=33.183 T1=33.12
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110977780--soft-0-100-0.wbo	MOPT f=10 TT=5.42 T1=5.41	OPTIMUM f=10 TT=5.42 T1=5.41	MSAT (TO) f=10 TT=1801.16 T1=72.82	OPTIMUM f=10 TT=15.591 T1=14.02	OPTIMUM f=10 TT=28.03 T1=13.29
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978113--soft-0-100-0.wbo	MOPT f=9 TT=9.505 T1=5.14	OPTIMUM f=9 TT=13.39 T1=13.39	OPTIMUM f=9 TT=282.762 T1=280.9	OPTIMUM f=9 TT=9.505 T1=5.14	OPTIMUM f=9 TT=33.47 T1=33.41
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1110978334--soft-0-100-0.wbo	MOPT f=9 TT=9.985 T1=9.98	OPTIMUM f=9 TT=9.985 T1=9.98	OPTIMUM f=9 TT=27.109 T1=35.8	OPTIMUM f=9 TT=12.961 T1=11.04	OPTIMUM f=9 TT=40.315 T1=30.06
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212272--soft-0-100-0.wbo	MOPT f=5 TT=7.476 T1=7.47	OPTIMUM f=5 TT=7.476 T1=7.47	MSAT (TO) f=5 TT=1800.09 T1=48.89	OPTIMUM f=5 TT=19.091 T1=16.94	OPTIMUM f=5 TT=31.451 T1=28.94
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212476--soft-0-100-0.wbo	MOPT f=2 TT=12.682 T1=10.89	OPTIMUM f=2 TT=14.737 T1=14.73	MSAT (TO) f=2 TT=1800.63 T1=1817.51	OPTIMUM f=2 TT=12.682 T1=10.89	OPTIMUM f=2 TT=46.44 T1=39.53
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111212923--soft-0-100-0.wbo	MOPT f=3 TT=7.829 T1=7.82	OPTIMUM f=3 TT=7.829 T1=7.82	OPTIMUM f=3 TT=32.069 T1=38.8	OPTIMUM f=3 TT=11.703 T1=9.78	OPTIMUM f=3 TT=27.502 T1=27.44
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213670--soft-0-100-0.wbo	MOPT f=10 TT=17.583 T1=9.11	OPTIMUM f=10 TT=17.583 T1=17.58	OPTIMUM f=10 TT=45.466 T1=56.71	OPTIMUM f=10 TT=23.021 T1=20.68	OPTIMUM f=10 TT=41.027 T1=9.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111213868--soft-0-100-0.wbo	MOPT f=2 TT=5.422 T1=5.42	OPTIMUM f=2 TT=5.422 T1=5.42	OPTIMUM f=2 TT=40.468 T1=50.04	OPTIMUM f=2 TT=14.462 T1=12.56	OPTIMUM f=2 TT=16.584 T1=14.81
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216411--soft-0-100-0.wbo	MOPT f=2 TT=6.293 T1=6.29	OPTIMUM f=2 TT=6.293 T1=6.29	MSAT (TO) f=2 TT=1800.04 T1=50.51	OPTIMUM f=2 TT=11.022 T1=9.07	OPTIMUM f=2 TT=28.289 T1=27.01
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111216823--soft-0-100-0.wbo	MOPT f=1 TT=5.153 T1=5.15	OPTIMUM f=1 TT=5.153 T1=5.15	MSAT (TO) f=1 TT=1800.02 T1=46.01	OPTIMUM f=1 TT=12.442 T1=11.11	OPTIMUM f=1 TT=19.381 T1=19.32
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217392--soft-0-100-0.wbo	MOPT f=2 TT=4.272 T1=4.27	OPTIMUM f=2 TT=4.272 T1=4.27	MSAT (TO) f=2 TT=1800.02 T1=44.06	OPTIMUM f=2 TT=14.911 T1=13.42	OPTIMUM f=2 TT=31.378 T1=28.5
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111217555--soft-0-100-0.wbo	MOPT f=1 TT=5.682 T1=5.68	OPTIMUM f=1 TT=5.682 T1=5.68	OPTIMUM f=1 TT=51.456 T1=50.72	OPTIMUM f=1 TT=19.9 T1=17.52	OPTIMUM f=1 TT=21.669 T1=21.61
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218024--soft-0-100-0.wbo	MOPT f=10 TT=14.155 T1=4.56	OPTIMUM f=10 TT=14.155 T1=14.16	OPTIMUM f=10 TT=38.789 T1=48.4	OPTIMUM f=10 TT=14.212 T1=4.56	OPTIMUM f=10 TT=50.425 T1=12.16
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218308--soft-0-100-0.wbo	MOPT f=1 TT=8.609 T1=8.6	OPTIMUM f=1 TT=8.609 T1=8.6	MSAT (TO) f=4 TT=1800 T1=53.67	OPTIMUM f=1 TT=12.803 T1=10.09	OPTIMUM f=1 TT=37.57 T1=37.51
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218757--soft-0-100-0.wbo	MOPT f=20 TT=12.359 T1=9.87	OPTIMUM f=20 TT=12.359 T1=12.35	OPTIMUM f=20 TT=29.78 T1=36.17	OPTIMUM f=20 TT=14.39 T1=9.87	OPTIMUM f=20 TT=51.327 T1=49.44
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111218955--soft-0-100-0.wbo	MOPT f=9 TT=7.869 T1=7.86	OPTIMUM f=9 TT=7.869 T1=7.86	OPTIMUM f=9 TT=37.108 T1=41.29	OPTIMUM f=9 TT=11.432 T1=9.48	OPTIMUM f=9 TT=20.583 T1=13.54
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219348--soft-0-100-0.wbo	MOPT f=2 TT=5.778 T1=5.66	OPTIMUM f=2 TT=5.778 T1=5.77	OPTIMUM f=2 TT=19.852 T1=46.86	OPTIMUM f=2 TT=8.943 T1=5.66	OPTIMUM f=2 TT=14.504 T1=10.77
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111219799--soft-0-100-0.wbo	MOPT f=9 TT=7.224 T1=6.77	OPTIMUM f=9 TT=7.224 T1=7.23	OPTIMUM f=9 TT=20.73 T1=36.39	OPTIMUM f=9 TT=8.882 T1=6.77	OPTIMUM f=9 TT=24.528 T1=23.06
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220019--soft-0-100-0.wbo	MOPT f=2 TT=3.44 T1=3.44	OPTIMUM f=2 TT=3.44 T1=3.44	OPTIMUM f=2 TT=36.321 T1=53.95	OPTIMUM f=2 TT=12.712 T1=11.44	OPTIMUM f=2 TT=20.274 T1=17.24
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220546--soft-0-100-0.wbo	MOPT f=2 TT=3.645 T1=3.64	OPTIMUM f=2 TT=3.645 T1=3.64	OPTIMUM f=2 TT=20.891 T1=24.37	OPTIMUM f=2 TT=8.674 T1=7.19	OPTIMUM f=2 TT=39.717 T1=32.59
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111220767--soft-0-100-0.wbo	MOPT f=3 TT=8.029 T1=8.02	OPTIMUM f=3 TT=8.029 T1=8.02	OPTIMUM f=3 TT=23.64 T1=39.39	OPTIMUM f=3 TT=13.411 T1=8.51	OPTIMUM f=3 TT=52.544 T1=37.35
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221203--soft-0-100-0.wbo	MOPT f=1 TT=3.125 T1=3.12	OPTIMUM f=1 TT=3.125 T1=3.12	OPTIMUM f=1 TT=23.659 T1=25.38	OPTIMUM f=1 TT=11.821 T1=10.43	OPTIMUM f=1 TT=28.886 T1=28.82
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111221624--soft-0-100-0.wbo	MOPT f=2 TT=5.229 T1=4.74	OPTIMUM f=2 TT=5.229 T1=5.23	OPTIMUM f=2 TT=18.501 T1=39.88	OPTIMUM f=2 TT=8.064 T1=4.74	OPTIMUM f=2 TT=26.413 T1=18.52
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222257--soft-0-100-0.wbo	MOPT f=3 TT=10.893 T1=10.89	OPTIMUM f=3 TT=10.893 T1=10.89	MSAT (TO) f=3 TT=1800.09 T1=66.02	OPTIMUM f=3 TT=22.402 T1=21.05	OPTIMUM f=3 TT=40.324 T1=34.06
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111222539--soft-0-100-0.wbo	MOPT f=2 TT=5.759 T1=5.75	OPTIMUM f=2 TT=5.759 T1=5.75	MSAT (TO) f=56 TT=1800.43 T1=1812.92	OPTIMUM f=2 TT=15.061 T1=13.3	OPTIMUM f=2 TT=19.519 T1=18.03
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223004--soft-0-100-0.wbo	MOPT f=1 TT=3.703 T1=3.7	OPTIMUM f=1 TT=3.703 T1=3.7	MSAT (TO) f=2 TT=1800.98 T1=1817.22	OPTIMUM f=1 TT=8.484 T1=5.67	OPTIMUM f=1 TT=33.476 T1=33.42
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111223220--soft-0-100-0.wbo	MOPT f=1 TT=5.741 T1=5.74	OPTIMUM f=1 TT=5.741 T1=5.74	MSAT (TO) f=3 TT=1801.12 T1=1806.01	OPTIMUM f=1 TT=21.101 T1=19.44	OPTIMUM f=1 TT=28.426 T1=28.37
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224059--soft-0-100-0.wbo	MOPT f=9 TT=5.493 T1=5.49	OPTIMUM f=9 TT=5.493 T1=5.49	OPTIMUM f=9 TT=25.441 T1=49.86	OPTIMUM f=9 TT=8.604 T1=6.83	OPTIMUM f=9 TT=30.445 T1=30.39
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224255--soft-0-100-0.wbo	MOPT f=1 TT=3.39 T1=3.38	OPTIMUM f=1 TT=3.39 T1=3.38	OPTIMUM f=1 TT=32.868 T1=46.23	OPTIMUM f=1 TT=13.862 T1=11.5	OPTIMUM f=1 TT=15.945 T1=15.88
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224451--soft-0-100-0.wbo	MOPT f=9 TT=6.377 T1=6.37	OPTIMUM f=9 TT=6.377 T1=6.37	OPTIMUM f=9 TT=32.509 T1=44.9	OPTIMUM f=9 TT=15.962 T1=14.05	OPTIMUM f=9 TT=37.03 T1=25.07
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111224929--soft-0-100-0.wbo	MOPT f=8 TT=9.12 T1=7.35	OPTIMUM f=8 TT=9.12 T1=9.11	OPTIMUM f=8 TT=26.471 T1=38.71	OPTIMUM f=8 TT=10.083 T1=7.35	OPTIMUM f=8 TT=33.424 T1=30.59
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225122--soft-0-100-0.wbo	MOPT f=2 TT=5.68 T1=5.67	OPTIMUM f=2 TT=5.68 T1=5.67	MSAT (TO) f=2 TT=1800.04 T1=214.06	OPTIMUM f=2 TT=21.952 T1=20.48	OPTIMUM f=2 TT=30.249 T1=29.89
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111225605--soft-0-100-0.wbo	MOPT f=2 TT=4.784 T1=4.78	OPTIMUM f=2 TT=4.784 T1=4.78	OPTIMUM f=2 TT=30.278 T1=50.86	OPTIMUM f=2 TT=8.782 T1=6.87	OPTIMUM f=2 TT=23.773 T1=19.26
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226062--soft-0-100-0.wbo	MOPT f=3 TT=6.338 T1=6.33	OPTIMUM f=3 TT=6.338 T1=6.33	OPTIMUM f=3 TT=36.538 T1=57.87	OPTIMUM f=3 TT=17.9 T1=15.84	OPTIMUM f=3 TT=33.636 T1=24.4
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226368--soft-0-100-0.wbo	MOPT f=1 TT=3.306 T1=3.3	OPTIMUM f=1 TT=3.306 T1=3.3	OPTIMUM f=1 TT=40.108 T1=51.09	OPTIMUM f=1 TT=18.371 T1=16.86	OPTIMUM f=1 TT=28.037 T1=27.98
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111226680--soft-0-100-0.wbo	MOPT f=3 TT=6.73 T1=6.73	OPTIMUM f=3 TT=6.73 T1=6.73	OPTIMUM f=3 TT=15.723 T1=26.28	OPTIMUM f=3 TT=12.86 T1=9.65	OPTIMUM f=3 TT=24.304 T1=24.25
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227012--soft-0-100-0.wbo	MOPT f=5 TT=6.373 T1=6.37	OPTIMUM f=5 TT=6.373 T1=6.37	MSAT (TO) f=5 TT=1800.44 T1=1822.51	OPTIMUM f=5 TT=14.591 T1=12.84	OPTIMUM f=5 TT=28.123 T1=17.37
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227326--soft-0-100-0.wbo	MOPT f=2 TT=2.132 T1=2.12	OPTIMUM f=2 TT=2.132 T1=2.12	OPTIMUM f=2 TT=23.618 T1=45.42	OPTIMUM f=2 TT=9.493 T1=7.67	OPTIMUM f=2 TT=13.237 T1=10.55
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111227861--soft-0-100-0.wbo	MOPT f=7 TT=7.276 T1=7.27	OPTIMUM f=7 TT=7.276 T1=7.27	MSAT (TO) f=31 TT=1800.23 T1=1812.31	OPTIMUM f=7 TT=14.652 T1=10.95	OPTIMUM f=7 TT=45.991 T1=45.93
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/wnqueen/ normalized-t2001.13queen13.1111228076--soft-0-100-0.wbo	MOPT f=3 TT=9.088 T1=8.58	OPTIMUM f=3 TT=9.088 T1=9.08	OPTIMUM f=3 TT=58.249 T1=69.39	OPTIMUM f=3 TT=11.802 T1=8.58	OPTIMUM f=3 TT=45.961 T1=24.68
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-101-100--soft-0-100-0.wbo	MOPT f=1 TT=25.891 T1=14.88	MSAT (TO) f=1 TT=1800.09 T1=1800.4	OPTIMUM f=1 TT=25.891 T1=14.88	MSAT (TO) f=1 TT=1800.06 T1=1221.39	? (TO) TT=1800.04
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-105-100--soft-0-100-0.wbo	MOPT f=1 TT=2.873 T1=1.37	MSAT (TO) f=1 TT=1800.08 T1=1800.5	OPTIMUM f=1 TT=2.873 T1=1.37	MSAT (TO) f=3 TT=1801.1 T1=1652.78	? (TO) TT=1800.16
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-11-10--soft-0-100-0.wbo	MOPT f=1 TT=0.315 T1=0.28	OPTIMUM f=1 TT=0.538 T1=0.53	OPTIMUM f=1 TT=0.315 T1=0.63	OPTIMUM f=1 TT=340.69 T1=0.28	OPTIMUM f=1 TT=587.621 T1=587.64
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-15-10--soft-0-100-0.wbo	MOPT f=2 TT=0.224 T1=0.69	OPTIMUM f=2 TT=0.694 T1=0.69	OPTIMUM f=2 TT=0.224 T1=1.14	OPTIMUM f=2 TT=684.01 T1=683.39	? (TO) TT=1800.08
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-21-20--soft-0-100-0.wbo	MOPT f=1 TT=0.882 T1=0.66	MSAT (TO) f=1 TT=1800.02 T1=1800.3	OPTIMUM f=1 TT=0.882 T1=0.66	MSAT (TO) f=2 TT=1800.68 T1=3.17	? (TO) TT=1800.1
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-25-20--soft-0-100-0.wbo	MOPT f=4 TT=0.374 T1=1.18	MSAT (TO) f=5 TT=1800.02 T1=1800.3	OPTIMUM f=4 TT=0.374 T1=1.18	MSAT (TO) f=4 TT=1800.02 T1=2.94	? (TO) TT=1800.03
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-31-30--soft-0-100-0.wbo	MOPT f=1 TT=1.655 T1=0.7	MSAT (TO) f=1 TT=1800.02 T1=1800.3	OPTIMUM f=1 TT=1.655 T1=0.7	MSAT (TO) f=1 TT=1800.9 T1=5.53	? (TO) TT=1800.09
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-35-30--soft-0-100-0.wbo	MSAT f=3 TT=1800.03 T1=1.22	MSAT (TO) f=4 TT=1800.02 T1=1800.3	MSAT (TO) f=3 TT=1800.95 T1=1.22	MSAT (TO) f=3 TT=1800.03 T1=1.49	? (TO) TT=1800.08
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-41-40--soft-0-100-0.wbo	MSAT f=1 TT=1800.02 T1=0.73	MSAT (TO) f=1 TT=1800.02 T1=1800.3	MSAT (TO) f=1 TT=1800.92 T1=0.73	MSAT (TO) f=1 TT=1800.03 T1=194.46	? (TO) TT=1800.02
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-45-40--soft-0-100-0.wbo	MOPT f=3 TT=1.044 T1=1.23	MSAT (TO) f=4 TT=1800.02 T1=1800.3	OPTIMUM f=3 TT=1.044 T1=1.23	MSAT (TO) f=3 TT=1800 T1=12.08	? (TO) TT=1800.1
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-51-50--soft-0-100-0.wbo	MOPT f=1 TT=2.955 T1=1.26	MSAT (TO) f=1 TT=1800.02 T1=1800.3	OPTIMUM f=1 TT=2.955 T1=1.26	MSAT (TO) f=1 TT=1800.03 T1=31.27	? (TO) TT=1800.08
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-55-50--soft-0-100-0.wbo	MOPT f=2 TT=1.354 T1=1.27	MSAT (TO) f=2 TT=1800.02 T1=1800.3	OPTIMUM f=2 TT=1.354 T1=1.27	MSAT (TO) f=2 TT=1800.03 T1=13.34	? (TO) TT=1800.04
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-61-60--soft-0-100-0.wbo	MOPT f=1 TT=3.574 T1=1.8	MSAT (TO) f=1 TT=1800.11 T1=1800.4	OPTIMUM f=1 TT=3.574 T1=1.8	MSAT (TO) f=1 TT=1800.74 T1=85.24	? (TO) TT=1800.02
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-65-60--soft-0-100-0.wbo	MOPT f=1 TT=2.013 T1=0.8	MSAT (TO) f=1 TT=1800.11 T1=1800.4	OPTIMUM f=1 TT=2.013 T1=0.8	MSAT (TO) f=1 TT=1800.04 T1=1.87	? (TO) TT=1800.11
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-71-70--soft-0-100-0.wbo	MOPT f=1 TT=5.783 T1=2.41	MSAT (TO) f=1 TT=1800.04 T1=1800.3	OPTIMUM f=1 TT=5.783 T1=2.41	MSAT (TO) f=1 TT=1800.03 T1=53.39	? (TO) TT=1800.04
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-75-70--soft-0-100-0.wbo	MOPT f=1 TT=2.394 T1=1.33	MSAT (TO) f=1 TT=1800.1 T1=1800.5	OPTIMUM f=1 TT=2.394 T1=1.33	MSAT (TO) f=1 TT=1800.09 T1=18.07	? (TO) TT=1800.06
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-81-80--soft-0-100-0.wbo	MSAT f=1 TT=1800.02 T1=3.84	MSAT (TO) f=1 TT=1800.02 T1=1800.3	MSAT (TO) f=1 TT=1800.05 T1=3.84	MSAT (TO) f=1 TT=1800.92 T1=5.64	? (TO) TT=1800.12
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-85-80--soft-0-100-0.wbo	MOPT f=1 TT=2.464 T1=1.35	MSAT (TO) f=1 TT=1800.07 T1=1800.4	OPTIMUM f=1 TT=2.464 T1=1.35	MSAT (TO) f=3 TT=1800.83 T1=161.86	? (TO) TT=1800.05
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-91-90--soft-0-100-0.wbo	MOPT f=1 TT=15.752 T1=8.4	MSAT (TO) f=1 TT=1800.08 T1=1800.5	OPTIMUM f=1 TT=15.752 T1=8.4	MSAT (TO) f=2 TT=1800.02 T1=17.17	? (TO) TT=1800.1
/SOFT-SMALLINT-LIN/PB06/submitted-PB06/ roussel/ normalized-pigeon-cardinality-95-90--soft-0-100-0.wbo	MOPT f=1 TT=2.773 T1=1.35	MSAT (TO) f=1 TT=1800.04 T1=1800.3	OPTIMUM f=1 TT=2.773 T1=1.35	MSAT (TO) f=1 TT=1800.04 T1=38.01	? (TO) TT=1800.09
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-22s.smv--soft-0-100-0.wbo	MOPT f=1 TT=2.964 T1=1.15	OPTIMUM f=1 TT=241.627 T1=240.49	OPTIMUM f=1 TT=10.122 T1=7.11	OPTIMUM f=1 TT=2.964 T1=1.15	OPTIMUM f=1 TT=3.44 T1=3.4
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-25s.smv--soft-0-100-0.wbo	MOPT f=1 TT=2.436 T1=1.07	OPTIMUM f=1 TT=177.639 T1=176.5	OPTIMUM f=1 TT=5.573 T1=3.35	OPTIMUM f=1 TT=2.763 T1=1.07	OPTIMUM f=1 TT=2.436 T1=2.4
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-37s.smv--soft-0-100-0.wbo	MOPT f=1 TT=0.713 T1=0.41	OPTIMUM f=1 TT=36.548 T1=36.33	OPTIMUM f=1 TT=1.504 T1=0.88	OPTIMUM f=1 TT=1.254 T1=0.41	OPTIMUM f=1 TT=0.713 T1=0.69
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-43s.smv--soft-0-100-0.wbo	MOPT f=1 TT=2.625 T1=0.98	OPTIMUM f=1 TT=103.557 T1=102.98	OPTIMUM f=1 TT=7.014 T1=4.74	OPTIMUM f=1 TT=2.625 T1=0.98	OPTIMUM f=1 TT=3.168 T1=3.17
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-44s.smv--soft-0-100-0.wbo	MOPT f=2 TT=0.195 T1=0.18	OPTIMUM f=2 TT=3.2 T1=3.18	OPTIMUM f=2 TT=1.284 T1=0.77	OPTIMUM f=2 TT=0.835 T1=0.29	OPTIMUM f=2 TT=0.195 T1=0.18
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-46s.smv--soft-0-100-0.wbo	MOPT f=1 TT=0.971 T1=0.66	OPTIMUM f=1 TT=37.216 T1=37	OPTIMUM f=1 TT=3.342 T1=1.95	OPTIMUM f=1 TT=1.834 T1=0.66	OPTIMUM f=1 TT=0.971 T1=0.95
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-floppy1-2.ucl--soft-0-100-0.wbo	MOPT f=2 TT=0.123 T1=0.12	OPTIMUM f=2 TT=0.953 T1=0.95	OPTIMUM f=2 TT=3.235 T1=1.18	OPTIMUM f=2 TT=0.574 T1=0.28	OPTIMUM f=2 TT=0.123 T1=0.12
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-floppy1-3.ucl--soft-0-100-0.wbo	MOPT f=4 TT=0.072 T1=0.06	OPTIMUM f=4 TT=1 T1=0.99	OPTIMUM f=4 TT=0.534 T1=0.71	OPTIMUM f=4 TT=0.344 T1=0.21	OPTIMUM f=4 TT=0.072 T1=0.06
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-floppy1-4.ucl--soft-0-100-0.wbo	MOPT f=18 TT=0.067 T1=0.06	OPTIMUM f=18 TT=1.035 T1=1.03	OPTIMUM f=18 TT=0.393 T1=0.69	OPTIMUM f=18 TT=0.283 T1=0.19	OPTIMUM f=18 TT=0.067 T1=0.06
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-floppy1-6.ucl--soft-0-100-0.wbo	MOPT f=1 TT=0.372 T1=0.31	OPTIMUM f=1 TT=6.805 T1=6.78	OPTIMUM f=1 TT=1.944 T1=0.79	OPTIMUM f=1 TT=0.863 T1=0.31	OPTIMUM f=1 TT=0.372 T1=0.35
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-floppy1-7.ucl--soft-0-100-0.wbo	MOPT f=1 TT=1.024 T1=0.98	OPTIMUM f=1 TT=102.754 T1=102.58	OPTIMUM f=1 TT=8.332 T1=8.57	OPTIMUM f=1 TT=3.233 T1=1.83	OPTIMUM f=1 TT=1.024 T1=0.98
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-floppy1-8.ucl--soft-0-100-0.wbo	MOPT f=1 TT=1.243 T1=1.21	OPTIMUM f=1 TT=142.692 T1=142.42	OPTIMUM f=1 TT=9.103 T1=10.66	OPTIMUM f=1 TT=4.325 T1=2.77	OPTIMUM f=1 TT=1.243 T1=1.21
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-blast-tlan2.ucl--soft-0-100-0.wbo	MOPT f=1 TT=0.929 T1=0.64	OPTIMUM f=1 TT=53.22 T1=52.98	OPTIMUM f=1 TT=3.344 T1=1.42	OPTIMUM f=1 TT=1.504 T1=0.64	OPTIMUM f=1 TT=0.929 T1=0.9
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-cache.inv8.ucl--soft-0-100-0.wbo	MOPT f=16 TT=0.608 T1=0.59	OPTIMUM f=16 TT=34.045 T1=33.81	OPTIMUM f=16 TT=3.422 T1=1.47	OPTIMUM f=16 TT=1.573 T1=0.64	OPTIMUM f=16 TT=0.608 T1=0.59
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-dlx1c.ucl--soft-0-100-0.wbo	MOPT f=1 TT=3.783 T1=1.68	OPTIMUM f=1 TT=213.368 T1=211.98	OPTIMUM f=1 TT=13.791 T1=20.25	OPTIMUM f=1 TT=3.783 T1=1.68	OPTIMUM f=1 TT=4.667 T1=4.63
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf6.ucl--soft-0-100-0.wbo	MOPT f=2 TT=0.02 T1=0.02	OPTIMUM f=2 TT=0.02 T1=0.02	OPTIMUM f=2 TT=0.205 T1=0.65	OPTIMUM f=2 TT=0.184 T1=0.14	OPTIMUM f=2 TT=0.033 T1=0.03
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf7.ucl--soft-0-100-0.wbo	MOPT f=1 TT=0.455 T1=0.44	OPTIMUM f=1 TT=14.924 T1=14.83	OPTIMUM f=1 TT=1.975 T1=1.39	OPTIMUM f=1 TT=1.275 T1=0.53	OPTIMUM f=1 TT=0.455 T1=0.44
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-elf.rf8.ucl--soft-0-100-0.wbo	MOPT f=1 TT=2.643 T1=1	OPTIMUM f=1 TT=294.87 T1=292.91	OPTIMUM f=1 TT=5.413 T1=1.77	OPTIMUM f=1 TT=2.643 T1=1	OPTIMUM f=1 TT=2.989 T1=2.95
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.burch_dill.2.accl.ucl--soft-0-100-0.wbo	MOPT f=1 TT=4.274 T1=1.56	OPTIMUM f=1 TT=46.729 T1=46.44	OPTIMUM f=1 TT=9.004 T1=8.72	OPTIMUM f=1 TT=4.274 T1=1.56	OPTIMUM f=1 TT=19.542 T1=19.52
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.burch_dill.3.accl.ucl--soft-0-100-0.wbo	MOPT f=1 TT=6.193 T1=1.25	OPTIMUM f=1 TT=241.979 T1=240.77	OPTIMUM f=1 TT=16.573 T1=6.51	OPTIMUM f=1 TT=6.193 T1=1.25	OPTIMUM f=1 TT=78.361 T1=78.33
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.burch_dill.4.accl.ucl--soft-0-100-0.wbo	MOPT f=1 TT=3.125 T1=1.51	OPTIMUM f=1 TT=136.785 T1=135.92	OPTIMUM f=1 TT=6.453 T1=6.42	OPTIMUM f=1 TT=3.125 T1=1.51	OPTIMUM f=1 TT=3.9 T1=3.88
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf6.ucl--soft-0-100-0.wbo	MOPT f=1 TT=0.733 T1=0.64	OPTIMUM f=1 TT=61.648 T1=61.26	OPTIMUM f=1 TT=2.752 T1=1.46	OPTIMUM f=1 TT=1.532 T1=0.64	OPTIMUM f=1 TT=0.733 T1=0.71
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf7.ucl--soft-0-100-0.wbo	MOPT f=1 TT=2.12 T1=1.15	OPTIMUM f=1 TT=76.704 T1=76.19	OPTIMUM f=1 TT=7.991 T1=12.98	OPTIMUM f=1 TT=2.764 T1=1.15	OPTIMUM f=1 TT=2.12 T1=2.09
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.rf8.ucl--soft-0-100-0.wbo	MOPT f=1 TT=6.694 T1=4.39	OPTIMUM f=1 TT=192.988 T1=191.66	OPTIMUM f=1 TT=12.203 T1=9.29	OPTIMUM f=1 TT=6.694 T1=4.39	OPTIMUM f=1 TT=13.374 T1=13.33
/SOFT-SMALLINT-LIN/PB06/web/ uclid_pb_benchmarks/ normalized-ooo.tag8.ucl--soft-0-100-0.wbo	MOPT f=1 TT=3.273 T1=1.78	OPTIMUM f=1 TT=72.062 T1=71.59	OPTIMUM f=1 TT=122.005 T1=12.4	OPTIMUM f=1 TT=3.273 T1=1.78	OPTIMUM f=1 TT=9.206 T1=9.17
/SOFT-SMALLINT-LIN/PB10/ oliveras/j30/ normalized-j301_4-unsat--soft-0-100-0.wbo	MOPT f=8 TT=1.426 T1=0.64	OPTIMUM f=8 TT=59.528 T1=59.09	OPTIMUM f=8 TT=5.883 T1=1.08	OPTIMUM f=8 TT=1.664 T1=0.64	OPTIMUM f=8 TT=1.426 T1=1.6
/SOFT-SMALLINT-LIN/PB10/ oliveras/j30/ normalized-j3029_8-unsat--soft-0-100-0.wbo	MOPT f=2 TT=1122.14 T1=1113.09	MSAT f=44 TT=452.141 T1=451.66	MSAT (TO) f=50 TT=1800.34 T1=939.22	OPTIMUM f=2 TT=1122.14 T1=1113.09	OPTIMUM f=2 TT=1740.24 T1=1740.59
/SOFT-SMALLINT-LIN/PB10/ oliveras/j30/ normalized-j3041_4-unsat--soft-0-100-0.wbo	MOPT f=4 TT=10.618 T1=9.94	MSAT f=100 TT=265.388 T1=264.88	MSAT (TO) f=58 TT=1800.02 T1=664.14	OPTIMUM f=4 TT=27.799 T1=25.54	OPTIMUM f=4 TT=10.618 T1=9.94
/SOFT-SMALLINT-LIN/PB10/ oliveras/j30/ normalized-j3046_4-unsat--soft-0-100-0.wbo	MOPT f=1 TT=2.183 T1=0.83	OPTIMUM f=1 TT=231.598 T1=230.1	OPTIMUM f=1 TT=4.714 T1=1.83	OPTIMUM f=1 TT=2.183 T1=0.83	OPTIMUM f=1 TT=3.582 T1=3.51
/SOFT-SMALLINT-LIN/PB10/ oliveras/j30/ normalized-j308_1-unsat--soft-0-100-0.wbo	MOPT f=19 TT=1.131 T1=0.57	OPTIMUM f=19 TT=43.273 T1=42.94	OPTIMUM f=19 TT=3.533 T1=1	OPTIMUM f=19 TT=1.362 T1=0.57	OPTIMUM f=19 TT=1.131 T1=1.09
/SOFT-SMALLINT-LIN/PB10/ oliveras/j30/ normalized-j309_10-unsat--soft-0-100-0.wbo	MOPT f=1 TT=11.041 T1=9.25	OPTIMUM f=1 TT=107.702 T1=106.99	OPTIMUM f=1 TT=1361.61 T1=1332.68	OPTIMUM f=1 TT=11.041 T1=9.25	OPTIMUM f=1 TT=25.884 T1=25.83
Bench name	Best results	NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
/SOFT-SMALLINT-LIN/PB10/ oliveras/j60/ normalized-j602_7-unsat--soft-0-100-0.wbo	MOPT f=1 TT=1.705 T1=0.67	OPTIMUM f=1 TT=194.912 T1=193.28	OPTIMUM f=1 TT=3.353 T1=1.21	OPTIMUM f=1 TT=1.705 T1=0.67	OPTIMUM f=1 TT=2.273 T1=2.22

Statistics		NaPS 1.02 (complete)	Sat4j PB 2.3.6 Res+CP PB16 (complete)	Sat4j PB 2.3.6 Resolution PB16 (complete)	toysat 2016-05-02 (complete)
Number of times the solver is able to give the best known answer		167	133	169	160
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		76	41	73	20