PB'06 evaluation: results by benchmark

Results by benchmark for category no optimisation, small integers (SATUNSAT-SMALLINT), subcategory Handmade, subsubcategory Traveling Salesperson Problem

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers (SATUNSAT-SMALLINT), subcategory Handmade, subsubcategory Traveling Salesperson Problem

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
absconPseudo 1
bsolo 2006/05
glpPB 0.2
minisat+ 1.14
PBS 4.1L
PB-smodels 1.28
PB-smodels 1.31
Pueblo 1.3
Pueblo 1.4
SAT4JPSEUDO 2006.2
SAT4JPSEUDO 2006.2 Heuristics
wildcat-rnp 0.8.0
wildcat-skc 0.8.0

Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900544463.opb	SAT TT=0.232 T1=0.23	SAT TT=18.506 T1=17.82	SAT TT=3.029 T1=3.04	SAT TT=168.677 T1=168.72	SAT TT=13.203 T1=13.21	SAT TT=0.662 T1=0.66	SAT TT=2.175 T1=2.07	SAT TT=1.462 T1=1.39	SAT TT=0.28 T1=0.28	SAT TT=9.322 T1=9.32	? (TO) TT=1800.45	? (TO) TT=1800.62	SAT TT=0.232 T1=0.23	SAT TT=1.135 T1=1.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900544484.opb	UNSAT TT=53.964	? (TO) TT=1800.33	? TT=1800.11	? (TO) TT=1800.72	UNSAT TT=53.964	UNSAT TT=451.544	UNSAT TT=372.806	UNSAT TT=246.828	UNSAT TT=146.735	UNSAT TT=167.034	? (TO) TT=1800.63	? (TO) TT=1800.43	? (TO) TT=1800.99	? (TO) TT=1800.59
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900545610.opb	UNSAT TT=393.116	? (TO) TT=1800.57	? TT=1800.09	? (TO) TT=1800.63	UNSAT TT=393.33	UNSAT TT=1315.52	UNSAT TT=619.936	UNSAT TT=393.116	UNSAT TT=405.828	UNSAT TT=577.173	? (TO) TT=1800.99	? (TO) TT=1800.24	? (TO) TT=1800.65	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900546076.opb	UNSAT TT=7.354	? (TO) TT=1800.59	? TT=1800.08	? (TO) TT=1800.52	UNSAT TT=7.354	UNSAT TT=199.896	UNSAT TT=374.557	UNSAT TT=277.616	UNSAT TT=113.162	UNSAT TT=75.351	? (TO) TT=1800.26	? (TO) TT=1800.52	? (TO) TT=1800.64	? (TO) TT=1800.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900546417.opb	UNSAT TT=319.072	? (TO) TT=1800.57	? TT=1800.07	? (TO) TT=1800.65	UNSAT TT=896.256	UNSAT TT=1540.66	UNSAT TT=571.418	UNSAT TT=367.312	UNSAT TT=363.172	UNSAT TT=319.072	? (TO) TT=1800.51	? (TO) TT=1800.18	? (TO) TT=1800.65	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547334.opb	SAT TT=1.059 T1=1.06	SAT TT=124.558 T1=123.75	SAT TT=95.998 T1=96.02	SAT TT=245.649 T1=245.71	SAT TT=5.432 T1=5.44	SAT TT=27.763 T1=27.76	SAT TT=1.663 T1=1.56	SAT TT=4.527 T1=4.45	SAT TT=7.694 T1=7.69	SAT TT=11.991 T1=11.99	? (TO) TT=1800.34	? (TO) TT=1800.81	SAT TT=1.152 T1=1.15	SAT TT=1.059 T1=1.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547353.opb	SAT TT=1.37 T1=1.37	SAT TT=6.013 T1=5.21	SAT TT=40.645 T1=40.66	SAT TT=347.957 T1=348.04	SAT TT=11.296 T1=11.29	SAT TT=8.229 T1=8.22	SAT TT=2.116 T1=2.02	SAT TT=16.467 T1=16.4	SAT TT=6.343 T1=6.34	SAT TT=3.839 T1=3.84	? (TO) TT=1800.31	? (TO) TT=1801.01	SAT TT=1.37 T1=1.37	SAT TT=5.063 T1=5.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547389.opb	UNSAT TT=168.826	? (TO) TT=1800.54	? TT=1800.07	? (TO) TT=1800.59	? (TO) TT=1800.71	UNSAT TT=1517.07	UNSAT TT=354.474	UNSAT TT=323.335	UNSAT TT=168.826	UNSAT TT=257.361	? (TO) TT=1800.1	? (TO) TT=1800.79	? (TO) TT=1800.65	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547416.opb	SAT TT=0.198 T1=0.19	SAT TT=6.74 T1=5.89	SAT TT=20.815 T1=20.83	SAT TT=67.8 T1=67.81	SAT TT=33.083 T1=33.09	SAT TT=1.754 T1=1.75	SAT TT=0.443 T1=0.35	SAT TT=12.172 T1=12.11	SAT TT=0.531 T1=0.53	SAT TT=5.543 T1=5.54	? (TO) TT=1801.06	? (TO) TT=1800.98	SAT TT=0.198 T1=0.19	SAT TT=0.318 T1=0.31
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547427.opb	SAT TT=0.052 T1=0.05	SAT TT=3.411 T1=2.78	SAT TT=1.212 T1=1.22	SAT TT=672.428 T1=672.6	SAT TT=16.735 T1=16.75	SAT TT=0.745 T1=0.74	SAT TT=1.017 T1=0.92	SAT TT=2.77 T1=2.7	SAT TT=0.052 T1=0.05	SAT TT=0.412 T1=0.41	SAT TT=57.425 T1=55.86	SAT TT=59.816 T1=58.22	SAT TT=0.588 T1=0.59	SAT TT=0.283 T1=0.28
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547461.opb	SAT TT=0.823 T1=0.82	SAT TT=11.431 T1=10.77	SAT TT=26.242 T1=26.25	SAT TT=578.802 T1=578.82	SAT TT=32.701 T1=32.71	SAT TT=9.207 T1=9.21	SAT TT=2.63 T1=2.53	SAT TT=6.837 T1=6.77	SAT TT=0.823 T1=0.82	SAT TT=14.037 T1=14.04	? (TO) TT=1800.54	? (TO) TT=1800.77	SAT TT=1.235 T1=1.23	SAT TT=9.641 T1=9.64
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900548667.opb	UNSAT TT=460.04	? (TO) TT=1800.5	? TT=1800.19	? (TO) TT=1800.61	? (TO) TT=1800.64	? (TO) TT=1800.66	UNSAT TT=989.112	UNSAT TT=460.04	UNSAT TT=622.503	UNSAT TT=792.701	? (TO) TT=1801	? (TO) TT=1800.34	? (TO) TT=1800.66	? (TO) TT=1800.62
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900549974.opb	SAT TT=1.686 T1=1.68	SAT TT=67.236 T1=66.57	SAT TT=9.333 T1=9.33	SAT TT=556.624 T1=556.79	SAT TT=12.657 T1=12.66	SAT TT=8.638 T1=8.63	SAT TT=3.604 T1=3.52	SAT TT=2.01 T1=1.95	SAT TT=6.587 T1=6.59	SAT TT=17.443 T1=17.45	SAT TT=1364.01 T1=1350.44	SAT TT=1339.81 T1=1326.38	SAT TT=2.795 T1=2.79	SAT TT=1.686 T1=1.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900550006.opb	UNSAT TT=447.969	? (TO) TT=1800.53	? TT=1800.07	? (TO) TT=1800.59	? (TO) TT=1800.63	? (TO) TT=1800.5	UNSAT TT=596.052	UNSAT TT=447.969	UNSAT TT=453.706	UNSAT TT=738.495	? (TO) TT=1800.77	? (TO) TT=1801.17	? (TO) TT=1800.54	? (TO) TT=1800.57
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900550720.opb	UNSAT TT=401.539	? (TO) TT=1800.67	? TT=1800.1	? (TO) TT=1800.59	UNSAT TT=590.466	? (TO) TT=1800.54	UNSAT TT=612.407	UNSAT TT=401.539	UNSAT TT=413.066	UNSAT TT=623.918	? (TO) TT=1800.71	? (TO) TT=1800.64	? (TO) TT=1800.66	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900551347.opb	UNSAT TT=133.997	? (TO) TT=1800.92	? TT=1800.07	? (TO) TT=1800.61	UNSAT TT=689.924	UNSAT TT=413.637	UNSAT TT=335.593	UNSAT TT=276.011	UNSAT TT=156.725	UNSAT TT=133.997	? (TO) TT=1800.34	? (TO) TT=1800.61	? (TO) TT=1800.7	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900551864.opb	UNSAT TT=111.863	? (TO) TT=1800.7	? TT=1800.07	? (TO) TT=1800.64	UNSAT TT=176.964	UNSAT TT=412.432	UNSAT TT=567.168	UNSAT TT=350.353	UNSAT TT=164.682	UNSAT TT=111.863	? (TO) TT=1800.78	? (TO) TT=1800.92	? (TO) TT=1800.53	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552288.opb	UNSAT TT=113.471	? (TO) TT=1800.67	? TT=1800.07	? (TO) TT=1800.48	UNSAT TT=113.471	UNSAT TT=1164.91	UNSAT TT=349.831	UNSAT TT=284.788	UNSAT TT=255.284	UNSAT TT=175.151	? (TO) TT=1800.39	? (TO) TT=1800.61	? (TO) TT=1800.47	? (TO) TT=1800.49
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552311.opb	SAT TT=0.25 T1=0.25	SAT TT=9.924 T1=9.12	SAT TT=1.285 T1=1.29	SAT TT=17.76 T1=17.76	SAT TT=8.725 T1=8.73	SAT TT=0.25 T1=0.25	SAT TT=4.37 T1=4.28	SAT TT=4.762 T1=4.69	SAT TT=5.54 T1=5.54	SAT TT=0.786 T1=0.78	SAT TT=498.89 T1=493.99	SAT TT=492.489 T1=487.44	SAT TT=0.641 T1=0.64	SAT TT=2.617 T1=2.62
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552423.opb	UNSAT TT=10.504	? (TO) TT=1800.66	? TT=1800.08	? (TO) TT=1800.71	UNSAT TT=10.504	UNSAT TT=30.5	UNSAT TT=207.333	UNSAT TT=212.588	UNSAT TT=74.096	UNSAT TT=17.433	? (TO) TT=1800.77	? (TO) TT=1800.2	? (TO) TT=1800.56	? (TO) TT=1800.44
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552735.opb	UNSAT TT=62.879	? (TO) TT=1800.45	? TT=1800.08	? (TO) TT=1800.72	UNSAT TT=62.879	UNSAT TT=1321.49	UNSAT TT=347.231	UNSAT TT=257.22	UNSAT TT=187.506	UNSAT TT=169.345	? (TO) TT=1801.06	? (TO) TT=1801.13	? (TO) TT=1800.49	? (TO) TT=1800.49
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553606.opb	SAT TT=1.108 T1=1.11	SAT TT=105.791 T1=105.06	SAT TT=33.973 T1=33.98	SAT TT=1370.63 T1=1371.03	SAT TT=22.046 T1=22.05	SAT TT=1.108 T1=1.11	SAT TT=5.881 T1=5.78	SAT TT=1.258 T1=1.18	SAT TT=13.42 T1=13.42	SAT TT=11.106 T1=11.11	SAT TT=1230.73 T1=1218.12	SAT TT=1202.03 T1=1190.21	SAT TT=2.296 T1=2.29	SAT TT=2.035 T1=2.03
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553644.opb	SAT TT=0.059 T1=0.06	SAT TT=71.384 T1=70.54	SAT TT=4.285 T1=4.28	SAT TT=24.649 T1=24.65	SAT TT=0.739 T1=0.74	SAT TT=0.123 T1=0.12	SAT TT=0.657 T1=0.56	SAT TT=0.658 T1=0.59	SAT TT=1.208 T1=1.21	SAT TT=0.234 T1=0.23	? (TO) TT=1800.51	? (TO) TT=1800.31	SAT TT=0.074 T1=0.07	SAT TT=0.059 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553647.opb	UNSAT TT=197.463	? (TO) TT=1800.5	? TT=1800.08	? (TO) TT=1800.45	UNSAT TT=402.836	UNSAT TT=1541.76	UNSAT TT=388.485	UNSAT TT=308.961	UNSAT TT=197.463	UNSAT TT=426.715	? (TO) TT=1800.22	? (TO) TT=1800.61	? (TO) TT=1800.51	? (TO) TT=1800.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553812.opb	UNSAT TT=41.542	? (TO) TT=1800.99	? TT=1800.07	? (TO) TT=1800.59	UNSAT TT=41.542	UNSAT TT=353.362	UNSAT TT=338.743	UNSAT TT=346.608	UNSAT TT=147.304	UNSAT TT=68.229	? (TO) TT=1800.36	? (TO) TT=1800.51	? (TO) TT=1800.68	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554067.opb	SAT TT=0.111 T1=0.11	SAT TT=33.003 T1=32.08	SAT TT=22.243 T1=22.26	SAT TT=208.485 T1=208.54	SAT TT=2.774 T1=2.77	SAT TT=0.762 T1=0.76	SAT TT=2.27 T1=2.17	SAT TT=3.877 T1=3.8	SAT TT=0.788 T1=0.78	SAT TT=1.776 T1=1.78	SAT TT=517.604 T1=511.47	SAT TT=524.458 T1=518.92	SAT TT=0.111 T1=0.11	SAT TT=1.813 T1=1.81
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554072.opb	UNSAT TT=82.728	? (TO) TT=1800.62	? TT=1800.1	? (TO) TT=1800.66	UNSAT TT=82.728	UNSAT TT=549.362	UNSAT TT=366.935	UNSAT TT=322.315	UNSAT TT=159.565	UNSAT TT=189.844	? (TO) TT=1800.69	? (TO) TT=1800.37	? (TO) TT=1800.48	? (TO) TT=1800.72
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554154.opb	SAT TT=0.078 T1=0.08	SAT TT=19.314 T1=18.54	SAT TT=8.817 T1=8.84	SAT TT=43.271 T1=43.28	SAT TT=0.855 T1=0.86	SAT TT=0.078 T1=0.08	SAT TT=0.592 T1=0.5	SAT TT=3.506 T1=3.43	SAT TT=3.906 T1=3.91	SAT TT=5.853 T1=5.85	SAT TT=665.497 T1=658.87	SAT TT=662.261 T1=655.62	SAT TT=0.549 T1=0.55	SAT TT=0.086 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554373.opb	SAT TT=0.108 T1=0.11	SAT TT=9.676 T1=8.9	SAT TT=0.681 T1=0.78	SAT TT=162.898 T1=162.94	SAT TT=0.529 T1=0.53	SAT TT=0.781 T1=0.78	SAT TT=0.904 T1=0.81	SAT TT=0.706 T1=0.63	SAT TT=0.362 T1=0.36	SAT TT=0.452 T1=0.45	SAT TT=441.657 T1=436.84	SAT TT=452.691 T1=447.87	SAT TT=0.425 T1=0.42	SAT TT=0.108 T1=0.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554375.opb	SAT TT=0.104 T1=0.1	SAT TT=2.734 T1=1.92	SAT TT=9.185 T1=9.19	SAT TT=108.829 T1=108.86	SAT TT=10.606 T1=10.61	SAT TT=2.448 T1=2.45	SAT TT=0.743 T1=0.65	SAT TT=1.462 T1=1.39	SAT TT=0.559 T1=0.56	SAT TT=4.088 T1=4.09	? (TO) TT=1800.8	? (TO) TT=1800.66	SAT TT=0.104 T1=0.1	SAT TT=0.132 T1=0.13
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554389.opb	SAT TT=0.064 T1=0.06	SAT TT=5.367 T1=4.37	SAT TT=3.081 T1=3.08	SAT TT=31.121 T1=31.13	SAT TT=14.375 T1=14.38	SAT TT=0.253 T1=0.25	SAT TT=0.409 T1=0.31	SAT TT=0.874 T1=0.8	SAT TT=0.234 T1=0.23	SAT TT=0.145 T1=0.14	SAT TT=903.362 T1=894.53	SAT TT=906.983 T1=898.31	SAT TT=0.068 T1=0.17	SAT TT=0.064 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554420.opb	UNSAT TT=209.615	? (TO) TT=1800.62	? TT=1800.12	? (TO) TT=1800.63	UNSAT TT=209.615	UNSAT TT=638.019	UNSAT TT=612.314	UNSAT TT=376.007	UNSAT TT=246.618	UNSAT TT=235.052	? (TO) TT=1800.92	? (TO) TT=1800.64	? (TO) TT=1800.63	? (TO) TT=1800.76
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900556231.opb	UNSAT TT=199.53	? (TO) TT=1800.63	? TT=1800.07	? (TO) TT=1800.55	UNSAT TT=463.562	UNSAT TT=928.762	UNSAT TT=355.779	UNSAT TT=342.803	UNSAT TT=199.53	UNSAT TT=363.59	? (TO) TT=1800.53	? (TO) TT=1800.76	? (TO) TT=1800.56	? (TO) TT=1800.19
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557362.opb	UNSAT TT=21.753	? (TO) TT=1800.47	? TT=1800.06	? (TO) TT=1800.61	UNSAT TT=21.753	UNSAT TT=476.229	UNSAT TT=354.314	UNSAT TT=330.011	UNSAT TT=157.105	UNSAT TT=63.562	? (TO) TT=1800.85	? (TO) TT=1800.5	? (TO) TT=1800.61	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557413.opb	SAT TT=0.527 T1=0.53	SAT TT=13.86 T1=13.16	SAT TT=12.668 T1=12.68	SAT TT=60.592 T1=60.61	SAT TT=38.24 T1=38.25	SAT TT=0.527 T1=0.53	SAT TT=2.877 T1=2.79	SAT TT=4.634 T1=4.57	SAT TT=7.951 T1=7.95	SAT TT=2.982 T1=2.98	? (TO) TT=1800.99	? (TO) TT=1800.61	SAT TT=3.907 T1=3.9	SAT TT=4.303 T1=4.3
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557568.opb	SAT TT=0.014 T1=0.01	SAT TT=6.802 T1=5.97	SAT TT=0.693 T1=0.69	SAT TT=7.331 T1=7.37	SAT TT=5.575 T1=5.57	SAT TT=0.032 T1=0.03	SAT TT=0.766 T1=0.68	SAT TT=1.778 T1=1.72	SAT TT=0.043 T1=0.04	SAT TT=0.352 T1=0.35	SAT TT=43.555 T1=41.91	SAT TT=43.6 T1=42.16	SAT TT=0.014 T1=0.01	SAT TT=0.13 T1=0.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557574.opb	UNSAT TT=156.705	? (TO) TT=1800.67	? TT=1800.08	? (TO) TT=1800.6	UNSAT TT=441.224	UNSAT TT=471.956	UNSAT TT=382.955	UNSAT TT=372.416	UNSAT TT=266.24	UNSAT TT=156.705	? (TO) TT=1800.76	? (TO) TT=1800.64	? (TO) TT=1800.68	? (TO) TT=1800.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557957.opb	UNSAT TT=81.777	? (TO) TT=1800.68	? TT=1800.07	? (TO) TT=1800.75	UNSAT TT=81.777	UNSAT TT=744.904	UNSAT TT=387.522	UNSAT TT=313.869	UNSAT TT=146.421	UNSAT TT=122.355	? (TO) TT=1800.77	? (TO) TT=1800.69	? (TO) TT=1800.7	? (TO) TT=1800.55
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900558106.opb	UNSAT TT=49.928	? (TO) TT=1800.72	? TT=1800.07	UNSAT TT=1622.99	UNSAT TT=96.169	UNSAT TT=137.485	UNSAT TT=195.678	UNSAT TT=175.407	UNSAT TT=110.3	UNSAT TT=49.928	? (TO) TT=1800.92	? (TO) TT=1800.79	? (TO) TT=1800.67	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900558739.opb	UNSAT TT=240.165	? (TO) TT=1800.52	? TT=1800.07	? (TO) TT=1800.71	UNSAT TT=269.51	UNSAT TT=1399.82	UNSAT TT=623.74	UNSAT TT=478.56	UNSAT TT=240.165	UNSAT TT=275.223	? (TO) TT=1800.96	? (TO) TT=1800.29	? (TO) TT=1800.53	? (TO) TT=1800.7
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559365.opb	SAT TT=1.259 T1=1.16	SAT TT=3.249 T1=2.32	SAT TT=1.715 T1=1.72	SAT TT=52.252 T1=52.27	SAT TT=8.08 T1=8.08	SAT TT=2.387 T1=2.38	SAT TT=1.259 T1=1.16	SAT TT=2.348 T1=2.27	SAT TT=8.749 T1=8.76	SAT TT=13.439 T1=13.47	? (TO) TT=1800.68	? (TO) TT=1800.52	SAT TT=1.519 T1=1.52	SAT TT=1.348 T1=1.34
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559416.opb	SAT TT=0.475 T1=0.47	SAT TT=101.192 T1=100.44	SAT TT=48.009 T1=48.11	SAT TT=584.113 T1=584.3	SAT TT=150.824 T1=150.87	SAT TT=0.99 T1=0.99	SAT TT=2.609 T1=2.52	SAT TT=16.588 T1=16.52	SAT TT=5.113 T1=5.11	SAT TT=38.243 T1=38.25	? (TO) TT=1800.63	? (TO) TT=1801.02	SAT TT=0.475 T1=0.47	SAT TT=2.974 T1=2.97
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559641.opb	SAT TT=0.224 T1=0.22	SAT TT=14.16 T1=13.38	SAT TT=7.065 T1=7.07	SAT TT=50.726 T1=50.74	SAT TT=16.257 T1=16.26	SAT TT=0.556 T1=0.55	SAT TT=2.173 T1=2.08	SAT TT=6.43 T1=6.36	SAT TT=4.175 T1=4.18	SAT TT=18.85 T1=18.85	SAT TT=1005.92 T1=996.47	SAT TT=1018.65 T1=1009.03	SAT TT=0.224 T1=0.22	SAT TT=0.519 T1=0.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559676.opb	UNSAT TT=524.97	? (TO) TT=1800.68	? TT=1800.07	? (TO) TT=1800.71	? (TO) TT=1800.7	? (TO) TT=1800.72	UNSAT TT=978.409	UNSAT TT=524.97	UNSAT TT=639.575	UNSAT TT=950.409	? (TO) TT=1800.91	? (TO) TT=1800.67	? (TO) TT=1800.44	? (TO) TT=1800.67
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561288.opb	UNSAT TT=405.378	? (TO) TT=1800.55	? TT=1800.07	? (TO) TT=1800.64	? (TO) TT=1800.58	? (TO) TT=1800.72	UNSAT TT=978.591	UNSAT TT=520.672	UNSAT TT=405.378	UNSAT TT=651.045	? (TO) TT=1800.4	? (TO) TT=1800.96	? (TO) TT=1800.61	? (TO) TT=1800.53
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561384.opb	SAT TT=0.067 T1=0.06	SAT TT=14.027 T1=13.36	SAT TT=2.94 T1=2.95	SAT TT=21.879 T1=21.88	SAT TT=0.228 T1=0.23	SAT TT=0.083 T1=0.08	SAT TT=2.068 T1=1.97	SAT TT=2.027 T1=1.95	SAT TT=0.384 T1=0.38	SAT TT=2.681 T1=2.68	SAT TT=92.12 T1=90.26	SAT TT=92.145 T1=90.31	SAT TT=0.067 T1=0.06	SAT TT=0.12 T1=0.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561389.opb	SAT TT=0.189 T1=0.19	SAT TT=25.11 T1=24.24	SAT TT=28.991 T1=29	SAT TT=97.573 T1=97.6	SAT TT=23.128 T1=23.13	SAT TT=4.481 T1=4.48	SAT TT=0.761 T1=0.66	SAT TT=1.23 T1=1.21	SAT TT=1.292 T1=1.29	SAT TT=3.121 T1=3.12	? (TO) TT=1800.45	? (TO) TT=1800.38	SAT TT=0.189 T1=0.19	SAT TT=0.515 T1=0.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900562192.opb	UNSAT TT=163.645	? (TO) TT=1800.59	? TT=1800.07	? (TO) TT=1800.72	UNSAT TT=361.321	UNSAT TT=747.514	UNSAT TT=214.435	UNSAT TT=268.171	UNSAT TT=163.645	UNSAT TT=199.741	? (TO) TT=1800.79	? (TO) TT=1801.04	? (TO) TT=1800.66	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900563250.opb	UNSAT TT=367.788	? (TO) TT=1800.58	? TT=1800.07	? (TO) TT=1800.71	UNSAT TT=977.792	? (TO) TT=1800.7	UNSAT TT=638.79	UNSAT TT=372.404	UNSAT TT=367.788	UNSAT TT=532.964	? (TO) TT=1800.77	? (TO) TT=1800.65	? (TO) TT=1800.71	? (TO) TT=1800.73
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900563801.opb	UNSAT TT=52.078	? (TO) TT=1800.64	? TT=1800.1	? (TO) TT=1800.58	UNSAT TT=52.078	UNSAT TT=340.272	UNSAT TT=372.336	UNSAT TT=287.265	UNSAT TT=118.289	UNSAT TT=214.92	? (TO) TT=1800.99	? (TO) TT=1800.26	? (TO) TT=1800.69	? (TO) TT=1800.54
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564281.opb	UNSAT TT=93.786	? (TO) TT=1800.61	? TT=1800.08	? (TO) TT=1800.49	UNSAT TT=156.939	UNSAT TT=498.288	UNSAT TT=373.535	UNSAT TT=330.999	UNSAT TT=156.745	UNSAT TT=93.786	? (TO) TT=1800.52	? (TO) TT=1800.54	? (TO) TT=1800.71	? (TO) TT=1800.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564822.opb	SAT TT=0.05 T1=0.05	SAT TT=2.828 T1=2.23	SAT TT=0.853 T1=0.86	SAT TT=46.914 T1=46.92	SAT TT=0.99 T1=0.98	SAT TT=0.274 T1=0.27	SAT TT=0.402 T1=0.3	SAT TT=0.864 T1=0.78	SAT TT=0.107 T1=0.11	SAT TT=0.23 T1=0.23	SAT TT=99.206 T1=97.33	SAT TT=97.196 T1=95.34	SAT TT=0.05 T1=0.05	SAT TT=0.077 T1=0.07
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564824.opb	UNSAT TT=8.928	? (TO) TT=1800.57	? TT=1800.12	UNSAT TT=1777.09	UNSAT TT=68.717	UNSAT TT=24.491	UNSAT TT=205.726	UNSAT TT=186.076	UNSAT TT=43.297	UNSAT TT=8.928	? (TO) TT=1800.65	? (TO) TT=1800.66	? (TO) TT=1800.71	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900565527.opb	SAT TT=0.078 T1=0.08	SAT TT=78.343 T1=77.63	SAT TT=2.402 T1=2.4	SAT TT=343.596 T1=343.68	SAT TT=1.674 T1=1.68	SAT TT=2.083 T1=2.08	SAT TT=0.595 T1=0.5	SAT TT=4.746 T1=4.67	SAT TT=0.078 T1=0.08	SAT TT=3.219 T1=3.22	? (TO) TT=1800.81	? (TO) TT=1800.58	SAT TT=1.83 T1=1.83	SAT TT=0.227 T1=0.22
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900565534.opb	UNSAT TT=302.405	? (TO) TT=1800.44	? TT=1800.09	? (TO) TT=1800.66	UNSAT TT=302.405	UNSAT TT=1479.77	UNSAT TT=565.147	UNSAT TT=331.368	UNSAT TT=348.679	UNSAT TT=309.29	? (TO) TT=1800.97	? (TO) TT=1800.5	? (TO) TT=1800.66	? (TO) TT=1800.6
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566151.opb	SAT TT=0.03 T1=0.03	SAT TT=2.285 T1=1.51	SAT TT=0.734 T1=0.74	SAT TT=4.744 T1=4.74	SAT TT=4.184 T1=4.18	SAT TT=0.03 T1=0.03	SAT TT=0.879 T1=0.78	SAT TT=0.278 T1=0.21	SAT TT=0.16 T1=0.16	SAT TT=1.622 T1=1.62	SAT TT=25.706 T1=24.28	SAT TT=25.04 T1=23.74	SAT TT=0.049 T1=0.05	SAT TT=0.106 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566157.opb	UNSAT TT=101.42	? (TO) TT=1800.73	? TT=1800.06	? (TO) TT=1800.73	? (TO) TT=1800.5	UNSAT TT=413.265	UNSAT TT=208.701	UNSAT TT=210.774	UNSAT TT=101.42	UNSAT TT=133.794	? (TO) TT=1800.11	? (TO) TT=1800.19	? (TO) TT=1800.63	? (TO) TT=1800.5
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566263.opb	SAT TT=0.065 T1=0.06	SAT TT=2.043 T1=1.41	SAT TT=2.267 T1=2.27	SAT TT=91.259 T1=91.28	SAT TT=0.799 T1=0.8	SAT TT=0.889 T1=0.89	SAT TT=1.593 T1=1.5	SAT TT=5.645 T1=5.58	SAT TT=0.364 T1=0.36	SAT TT=6.967 T1=6.97	SAT TT=61.574 T1=59.82	SAT TT=64.423 T1=62.82	SAT TT=0.135 T1=0.13	SAT TT=0.065 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566270.opb	SAT TT=0.039 T1=0.04	SAT TT=11.67 T1=10.91	SAT TT=19.74 T1=19.77	SAT TT=68.116 T1=68.13	SAT TT=19.605 T1=19.61	SAT TT=2.006 T1=2	SAT TT=0.918 T1=0.82	SAT TT=36.635 T1=36.64	SAT TT=0.697 T1=0.7	SAT TT=20.216 T1=20.22	SAT TT=637.639 T1=631.17	SAT TT=635.514 T1=629.24	SAT TT=0.039 T1=0.04	SAT TT=0.25 T1=0.25
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567003.opb	SAT TT=1.445 T1=1.35	SAT TT=60.706 T1=59.9	SAT TT=38.119 T1=38.13	SAT TT=806.127 T1=806.34	SAT TT=3.274 T1=3.27	SAT TT=2.224 T1=2.22	SAT TT=1.445 T1=1.35	SAT TT=1.48 T1=1.4	SAT TT=1.67 T1=1.67	SAT TT=17.567 T1=17.57	? (TO) TT=1800.63	? (TO) TT=1800.78	SAT TT=2.642 T1=2.64	SAT TT=10.918 T1=10.92
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567024.opb	UNSAT TT=31.029	? (TO) TT=1800.53	? TT=1800.07	? (TO) TT=1800.58	UNSAT TT=31.029	UNSAT TT=690.442	UNSAT TT=235.301	UNSAT TT=260.046	UNSAT TT=159.245	UNSAT TT=202.78	? (TO) TT=1800.62	? (TO) TT=1800.69	? (TO) TT=1800.78	? (TO) TT=1800.68
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567135.opb	UNSAT TT=113.649	? (TO) TT=1800.5	? TT=1800.09	? (TO) TT=1800.71	? (TO) TT=1800.52	UNSAT TT=358.232	UNSAT TT=238.053	UNSAT TT=274.831	UNSAT TT=113.649	UNSAT TT=128.439	? (TO) TT=1800.69	? (TO) TT=1801.01	? (TO) TT=1800.47	? (TO) TT=1800.58
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567939.opb	SAT TT=0.212 T1=0.21	SAT TT=158.333 T1=157.34	SAT TT=4.921 T1=4.93	SAT TT=43.429 T1=43.44	SAT TT=11.219 T1=11.23	SAT TT=0.212 T1=0.21	SAT TT=3.995 T1=3.89	SAT TT=10.27 T1=10.2	SAT TT=2.914 T1=2.91	SAT TT=2.374 T1=2.37	? (TO) TT=1800.78	? (TO) TT=1800.17	SAT TT=4.425 T1=4.43	SAT TT=3.137 T1=3.13
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567985.opb	UNSAT TT=424.074	? (TO) TT=1800.65	? TT=1800.07	? (TO) TT=1800.66	UNSAT TT=1061.57	? (TO) TT=1800.16	UNSAT TT=597.832	UNSAT TT=424.074	UNSAT TT=579.246	UNSAT TT=588.393	? (TO) TT=1800.65	? (TO) TT=1800.76	? (TO) TT=1800.65	? (TO) TT=1800.65
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568186.opb	UNSAT TT=122.765	? (TO) TT=1800.41	? TT=1800.11	? (TO) TT=1800.66	UNSAT TT=445.999	UNSAT TT=340.001	UNSAT TT=354.529	UNSAT TT=303.551	UNSAT TT=125.386	UNSAT TT=122.765	? (TO) TT=1800.65	? (TO) TT=1801.02	? (TO) TT=1800.47	? (TO) TT=1800.66
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568706.opb	UNSAT TT=36.405	? (TO) TT=1800.65	? TT=1800.08	? (TO) TT=1800.46	UNSAT TT=36.405	UNSAT TT=976.16	UNSAT TT=376.685	UNSAT TT=317.454	UNSAT TT=245.014	UNSAT TT=151.715	? (TO) TT=1800.33	? (TO) TT=1800.64	? (TO) TT=1800.74	? (TO) TT=1800.5
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568952.opb	SAT TT=0.501 T1=0.5	SAT TT=109.633 T1=109.34	SAT TT=5.056 T1=5.08	SAT TT=237.058 T1=237.13	SAT TT=105.263 T1=105.35	SAT TT=4.766 T1=4.76	SAT TT=13.627 T1=13.54	SAT TT=7.406 T1=7.34	SAT TT=0.501 T1=0.5	SAT TT=48.147 T1=48.16	? (TO) TT=1800.2	? (TO) TT=1800.58	SAT TT=5.889 T1=5.89	SAT TT=1.252 T1=1.25
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900569834.opb	UNSAT TT=84.936	? (TO) TT=1800.64	? TT=1800.08	? (TO) TT=1800.46	UNSAT TT=84.936	UNSAT TT=747.347	UNSAT TT=388.563	UNSAT TT=320.915	UNSAT TT=180.817	UNSAT TT=215.726	? (TO) TT=1800.36	? (TO) TT=1800.48	? (TO) TT=1800.71	? (TO) TT=1800.63
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900570242.opb	UNSAT TT=136.072	? (TO) TT=1800.41	? TT=1800.07	? (TO) TT=1800.57	UNSAT TT=188.992	UNSAT TT=446.949	UNSAT TT=223.013	UNSAT TT=286.087	UNSAT TT=166.541	UNSAT TT=136.072	? (TO) TT=1800.58	? (TO) TT=1800.26	? (TO) TT=1800.58	? (TO) TT=1800.58
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571131.opb	SAT TT=0.251 T1=0.25	SAT TT=2.066 T1=1.52	SAT TT=3.343 T1=3.35	SAT TT=87.611 T1=87.63	SAT TT=0.643 T1=0.64	SAT TT=0.47 T1=0.47	SAT TT=2.523 T1=2.43	SAT TT=0.404 T1=0.32	SAT TT=0.339 T1=0.34	SAT TT=0.662 T1=0.66	SAT TT=86.166 T1=84.28	SAT TT=85.024 T1=83.32	SAT TT=0.313 T1=0.31	SAT TT=0.251 T1=0.25
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571132.opb	UNSAT TT=224.076	? (TO) TT=1800.54	? TT=1800.1	? (TO) TT=1800.75	UNSAT TT=1163.53	UNSAT TT=1198.63	UNSAT TT=336.717	UNSAT TT=275.923	UNSAT TT=224.076	UNSAT TT=348.289	? (TO) TT=1800.29	? (TO) TT=1800.75	? (TO) TT=1800.56	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571761.opb	UNSAT TT=266.04	? (TO) TT=1800.37	? TT=1800.16	? (TO) TT=1800.56	UNSAT TT=1508.17	UNSAT TT=1613.02	UNSAT TT=395.431	UNSAT TT=312.958	UNSAT TT=266.04	UNSAT TT=350.466	? (TO) TT=1800.36	? (TO) TT=1800.56	? (TO) TT=1800.55	? (TO) TT=1800.63
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900573137.opb	UNSAT TT=203.591	? (TO) TT=1800.48	? TT=1800.12	? (TO) TT=1800.47	UNSAT TT=203.591	UNSAT TT=1789.53	UNSAT TT=569.755	UNSAT TT=309.547	UNSAT TT=263.055	UNSAT TT=319.034	? (TO) TT=1800.38	? (TO) TT=1800.72	? (TO) TT=1800.69	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900573901.opb	UNSAT TT=242.265	? (TO) TT=1800.44	? TT=1800.13	? (TO) TT=1800.56	UNSAT TT=993.162	UNSAT TT=1391.53	UNSAT TT=611.941	UNSAT TT=358.301	UNSAT TT=242.265	UNSAT TT=318.573	? (TO) TT=1800.81	? (TO) TT=1800.7	? (TO) TT=1800.7	? (TO) TT=1800.65
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574864.opb	UNSAT TT=176.512	? (TO) TT=1800.39	? TT=1800.12	? (TO) TT=1800.66	UNSAT TT=202.099	UNSAT TT=599.645	UNSAT TT=582.801	UNSAT TT=359.615	UNSAT TT=181.357	UNSAT TT=176.512	? (TO) TT=1801.15	? (TO) TT=1800.16	? (TO) TT=1800.61	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574948.opb	SAT TT=0.091 T1=0.09	SAT TT=23.707 T1=22.78	SAT TT=0.903 T1=0.9	SAT TT=94.858 T1=94.88	SAT TT=7.304 T1=7.31	SAT TT=0.631 T1=0.63	SAT TT=0.551 T1=0.46	SAT TT=1.425 T1=1.38	SAT TT=0.349 T1=0.35	SAT TT=3.829 T1=3.83	? (TO) TT=1800.79	? (TO) TT=1800.68	SAT TT=0.091 T1=0.09	SAT TT=0.621 T1=0.62
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574974.opb	SAT TT=0.129 T1=0.13	SAT TT=9.955 T1=9.08	SAT TT=15.238 T1=15.25	SAT TT=35.095 T1=35.1	SAT TT=4 T1=4	SAT TT=0.302 T1=0.3	SAT TT=1.654 T1=1.56	SAT TT=0.876 T1=0.8	SAT TT=0.129 T1=0.13	SAT TT=1.884 T1=1.88	SAT TT=1433.97 T1=1419.81	SAT TT=1476.95 T1=1462.26	SAT TT=0.235 T1=0.23	SAT TT=0.758 T1=0.76
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900575442.opb	UNSAT TT=62.937	? (TO) TT=1800.57	? TT=1800.08	? (TO) TT=1800.58	UNSAT TT=62.937	UNSAT TT=579.854	UNSAT TT=593.828	UNSAT TT=349.872	UNSAT TT=122	UNSAT TT=263.132	? (TO) TT=1800.3	? (TO) TT=1800.85	? (TO) TT=1800.64	? (TO) TT=1800.57
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576151.opb	UNSAT TT=306.305	? (TO) TT=1800.61	? TT=1800.07	? (TO) TT=1800.68	UNSAT TT=306.305	? (TO) TT=1800.75	UNSAT TT=602.86	UNSAT TT=315.699	UNSAT TT=308.854	UNSAT TT=564.304	? (TO) TT=1800.92	? (TO) TT=1800.3	? (TO) TT=1800.61	? (TO) TT=1800.67
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576360.opb	UNSAT TT=167.145	? (TO) TT=1800.64	? TT=1800.09	? (TO) TT=1800.74	UNSAT TT=281.747	UNSAT TT=709.003	UNSAT TT=350.9	UNSAT TT=273.468	UNSAT TT=171.704	UNSAT TT=167.145	? (TO) TT=1800.52	? (TO) TT=1801.07	? (TO) TT=1800.45	? (TO) TT=1800.62
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576918.opb	SAT TT=0.17 T1=0.17	SAT TT=5.21 T1=4.46	SAT TT=4.948 T1=5.02	SAT TT=207.952 T1=208.01	SAT TT=5.418 T1=5.42	SAT TT=1.572 T1=1.57	SAT TT=1.599 T1=1.5	SAT TT=2.845 T1=2.76	SAT TT=0.17 T1=0.17	SAT TT=0.678 T1=0.68	? (TO) TT=1800.36	? (TO) TT=1800.15	SAT TT=0.554 T1=0.55	SAT TT=0.312 T1=0.31
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576927.opb	UNSAT TT=329.405	? (TO) TT=1800.52	? TT=1800.07	? (TO) TT=1800.71	UNSAT TT=879.993	? (TO) TT=1800.72	UNSAT TT=640.689	UNSAT TT=378.698	UNSAT TT=407.351	UNSAT TT=329.405	? (TO) TT=1800.34	? (TO) TT=1800.13	? (TO) TT=1800.65	? (TO) TT=1800.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900577000.opb	SAT TT=0.037 T1=0.04	SAT TT=2.623 T1=1.88	SAT TT=0.674 T1=0.67	SAT TT=256.025 T1=256.09	SAT TT=12.569 T1=12.57	SAT TT=0.731 T1=0.73	SAT TT=1.488 T1=1.39	SAT TT=1.183 T1=1.11	SAT TT=0.042 T1=0.04	SAT TT=0.579 T1=0.58	? (TO) TT=1800.66	? (TO) TT=1800.16	SAT TT=0.037 T1=0.04	SAT TT=0.668 T1=0.67
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900577940.opb	UNSAT TT=395.406	? (TO) TT=1800.35	? TT=1800.1	? (TO) TT=1800.7	UNSAT TT=655.091	? (TO) TT=1800.54	UNSAT TT=660.247	UNSAT TT=431.645	UNSAT TT=395.406	UNSAT TT=577.87	? (TO) TT=1800.46	? (TO) TT=1800.62	? (TO) TT=1800.56	? (TO) TT=1800.56
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900579996.opb	UNSAT TT=315.989	? (TO) TT=1800.43	? TT=1800.08	? (TO) TT=1800.44	UNSAT TT=573.39	? (TO) TT=1800.6	UNSAT TT=624.653	UNSAT TT=315.989	UNSAT TT=405.988	UNSAT TT=590.221	? (TO) TT=1800.58	? (TO) TT=1800.43	? (TO) TT=1800.49	? (TO) TT=1800.48
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900581320.opb	UNSAT TT=368.384	? (TO) TT=1800.47	? TT=1800.08	? (TO) TT=1800.71	? (TO) TT=1800.5	UNSAT TT=1423.71	UNSAT TT=676.372	UNSAT TT=410.783	UNSAT TT=368.384	UNSAT TT=391.647	? (TO) TT=1800.35	? (TO) TT=1800.35	? (TO) TT=1800.62	? (TO) TT=1800.26
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900581321.opb	SAT TT=0.022 T1=0.02	SAT TT=14.17 T1=13.34	SAT TT=1.367 T1=1.38	SAT TT=82.056 T1=82.08	SAT TT=0.386 T1=0.38	SAT TT=0.097 T1=0.09	SAT TT=0.721 T1=0.64	SAT TT=0.55 T1=0.48	SAT TT=0.08 T1=0.08	SAT TT=0.316 T1=0.31	SAT TT=19.395 T1=17.86	SAT TT=19.841 T1=18.18	SAT TT=0.06 T1=0.06	SAT TT=0.022 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900582300.opb	UNSAT TT=378.354	? (TO) TT=1800.6	? TT=1800.08	? (TO) TT=1800.56	UNSAT TT=1016.84	? (TO) TT=1800.74	UNSAT TT=593.17	UNSAT TT=422.084	UNSAT TT=378.354	UNSAT TT=466.282	? (TO) TT=1800.2	? (TO) TT=1800.87	? (TO) TT=1800.66	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900582376.opb	SAT TT=0.091 T1=0.09	SAT TT=111.959 T1=111.15	SAT TT=193.711 T1=193.76	SAT TT=25.735 T1=25.74	SAT TT=13.361 T1=13.37	SAT TT=0.091 T1=0.09	SAT TT=3.28 T1=3.18	SAT TT=7.983 T1=7.91	SAT TT=4.653 T1=4.65	SAT TT=4.753 T1=4.75	? (TO) TT=1800.17	? (TO) TT=1800.47	SAT TT=1.489 T1=1.49	SAT TT=2.93 T1=2.93
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900583053.opb	UNSAT TT=340.375	? (TO) TT=1800.36	? TT=1800.1	? (TO) TT=1800.7	UNSAT TT=1060.71	? (TO) TT=1800.5	UNSAT TT=670.968	UNSAT TT=445.082	UNSAT TT=340.375	UNSAT TT=727.191	? (TO) TT=1800.27	? (TO) TT=1800.57	? (TO) TT=1800.73	? (TO) TT=1800.51
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900584106.opb	UNSAT TT=93.111	? (TO) TT=1800.52	? TT=1800.13	? (TO) TT=1800.58	UNSAT TT=105.026	UNSAT TT=351.212	UNSAT TT=338.539	UNSAT TT=278.164	UNSAT TT=172.006	UNSAT TT=93.111	UNSAT TT=1171.17	UNSAT TT=1165.96	? (TO) TT=1800.56	? (TO) TT=1800.65
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900584219.opb	UNSAT TT=192.491	? (TO) TT=1800.63	? TT=1800.1	? (TO) TT=1800.64	UNSAT TT=1367.61	UNSAT TT=1455.05	UNSAT TT=373.594	UNSAT TT=349.59	UNSAT TT=192.491	UNSAT TT=239.297	? (TO) TT=1800.21	? (TO) TT=1800.51	? (TO) TT=1800.7	? (TO) TT=1800.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900667195.opb	UNSAT TT=415.278	? (TO) TT=1800.69	? TT=1800.1	? (TO) TT=1800.49	UNSAT TT=572.389	? (TO) TT=1800.73	UNSAT TT=676.113	UNSAT TT=431.33	UNSAT TT=415.278	UNSAT TT=526.995	? (TO) TT=1800.9	? (TO) TT=1801.01	? (TO) TT=1800.7	? (TO) TT=1800.7
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669299.opb	SAT TT=0.214 T1=0.21	SAT TT=8.158 T1=7.3	SAT TT=4.608 T1=4.61	SAT TT=325.802 T1=325.88	SAT TT=0.237 T1=0.24	SAT TT=0.711 T1=0.7	SAT TT=1.845 T1=1.75	SAT TT=1.022 T1=0.95	SAT TT=3.412 T1=3.41	SAT TT=9.203 T1=9.2	SAT TT=10.144 T1=8.82	SAT TT=10.054 T1=8.61	SAT TT=0.61 T1=0.61	SAT TT=0.214 T1=0.21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669309.opb	SAT TT=4.872 T1=4.87	SAT TT=7.895 T1=7.08	SAT TT=288.262 T1=288.36	SAT TT=338.092 T1=338.17	SAT TT=39.79 T1=39.8	SAT TT=7.001 T1=7	SAT TT=5.198 T1=5.12	SAT TT=36.819 T1=36.76	SAT TT=5.526 T1=5.53	SAT TT=42.098 T1=42.11	? (TO) TT=1800.38	? (TO) TT=1800.45	SAT TT=4.872 T1=4.87	SAT TT=6.54 T1=6.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669797.opb	UNSAT TT=76.28	? (TO) TT=1800.42	? TT=1800.08	? (TO) TT=1800.51	UNSAT TT=76.28	UNSAT TT=1326.9	UNSAT TT=392.017	UNSAT TT=331.925	UNSAT TT=228.094	UNSAT TT=229.51	? (TO) TT=1800.2	? (TO) TT=1801.13	? (TO) TT=1800.61	? (TO) TT=1800.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670167.opb	UNSAT TT=33.798	? (TO) TT=1800.6	? TT=1800.1	? (TO) TT=1800.65	UNSAT TT=33.798	UNSAT TT=1763.5	UNSAT TT=368.77	UNSAT TT=332.67	UNSAT TT=275.056	UNSAT TT=244.353	? (TO) TT=1800.81	? (TO) TT=1800.2	? (TO) TT=1800.65	? (TO) TT=1800.69
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670234.opb	UNSAT TT=411.582	? (TO) TT=1800.69	? TT=1800.07	? (TO) TT=1800.52	? (TO) TT=1800.65	? (TO) TT=1800.62	UNSAT TT=683.186	UNSAT TT=411.582	UNSAT TT=425.121	UNSAT TT=626.544	? (TO) TT=1800.84	? (TO) TT=1800.61	? (TO) TT=1800.7	? (TO) TT=1800.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670675.opb	UNSAT TT=55.049	? (TO) TT=1800.57	? TT=1800.08	? (TO) TT=1800.51	UNSAT TT=55.049	UNSAT TT=405.542	UNSAT TT=577.357	UNSAT TT=399.609	UNSAT TT=169.537	UNSAT TT=196.066	? (TO) TT=1800.27	? (TO) TT=1800.76	? (TO) TT=1800.7	? (TO) TT=1800.71
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670756.opb	SAT TT=0.162 T1=0.16	SAT TT=11.176 T1=10.31	SAT TT=3.947 T1=3.95	SAT TT=100.555 T1=100.58	SAT TT=14.239 T1=14.24	SAT TT=2.161 T1=2.16	SAT TT=1.037 T1=0.94	SAT TT=6.279 T1=6.21	SAT TT=1.146 T1=1.15	SAT TT=0.162 T1=0.16	? (TO) TT=1800.99	? (TO) TT=1801.03	SAT TT=0.22 T1=0.22	SAT TT=3.097 T1=3.1

Some statistics...

	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
Number of times the solver is able to give the best known answer	40	40	42	91	85	100	100	100	100	20	20	40	40
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	40	40	42	91	85	100	100	100	100	20	20	40	40
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	0	21	7	2	8	24	14	0	0	15	9
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	7	2	0	7	1	0	0	15	10