PB'09 competition: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Traveling Salesperson Problem

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Traveling Salesperson Problem

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
BoolVar 2009-04-26 (complete)
bsolo 3.1 (complete)
bsolo 3.1 cl (complete)
bsolo 3.1 pb (complete)
pbclasp 2009-04-24 (complete)
SAT4J Pseudo CP 2.1.1 (complete)
SAT4J Pseudo Resolution 2.1.1 (complete)
SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)
SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
wbo 1.0 (complete)

Bench name	Best results on this instance	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900544463.opb	SAT TT=0.102 T1=0.1	SAT TT=3.871 T1=3.77	SAT TT=5.657 T1=5.65	SAT TT=19.571 T1=19.57	SAT TT=236.099 T1=236.15	SAT TT=0.856 T1=0.84	? (TO) TT=1800.28	SAT TT=1.838 T1=1.12	SAT TT=48.957 T1=48.95	SAT TT=11.273 T1=11.26	SAT TT=0.102 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900544484.opb	UNSAT TT=14.456	UNSAT TT=38.121	UNSAT TT=922.091	UNSAT TT=1095.5	? (TO) TT=1800.12	UNSAT TT=18.928	? (TO) TT=1800.27	UNSAT TT=14.456	UNSAT TT=827.841	UNSAT TT=1224.85	UNSAT TT=190.943
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900545610.opb	UNSAT TT=43.563	UNSAT TT=94.44	? TT=1798	? TT=1798	? TT=1798.01	UNSAT TT=43.563	? (TO) TT=1800.29	UNSAT TT=61.582	UNSAT TT=1219.75	UNSAT TT=925.669	UNSAT TT=531.003
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900546076.opb	UNSAT TT=5.181	UNSAT TT=13.221	UNSAT TT=884.914	UNSAT TT=702.559	? (TO) TT=1800.05	UNSAT TT=5.181	? (TO) TT=1800.26	UNSAT TT=5.394	UNSAT TT=296.1	UNSAT TT=589.905	UNSAT TT=20.613
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900546417.opb	UNSAT TT=35.212	UNSAT TT=103.069	? TT=1798	UNSAT TT=1751.7	? TT=1798.02	UNSAT TT=35.212	? (TO) TT=1800.22	UNSAT TT=64.476	UNSAT TT=938.282	UNSAT TT=1734.02	UNSAT TT=382.073
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547334.opb	SAT TT=0.853 T1=0.75	SAT TT=0.853 T1=0.75	SAT TT=5.363 T1=5.36	SAT TT=14.603 T1=14.6	SAT TT=40.297 T1=40.3	SAT TT=2.488 T1=2.48	? (TO) TT=1800.3	SAT TT=1.834 T1=1.1	SAT TT=46.892 T1=46.88	SAT TT=36.791 T1=36.78	SAT TT=1.808 T1=1.81
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547353.opb	SAT TT=0.432 T1=0.42	SAT TT=4.155 T1=4.04	SAT TT=4.08 T1=4.08	SAT TT=22.481 T1=22.48	SAT TT=308.762 T1=308.88	SAT TT=0.432 T1=0.42	? (TO) TT=1800.27	SAT TT=3.688 T1=2.24	SAT TT=47.167 T1=47.17	SAT TT=22.5 T1=22.49	SAT TT=1.326 T1=1.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547389.opb	UNSAT TT=22.394	UNSAT TT=80.742	UNSAT TT=1351.29	UNSAT TT=1352.14	? TT=1798.01	UNSAT TT=58.48	? (TO) TT=1800.2	UNSAT TT=22.394	UNSAT TT=719.054	UNSAT TT=768.311	UNSAT TT=283.87
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547416.opb	SAT TT=0.125 T1=0.11	SAT TT=5.6 T1=5.48	SAT TT=10.852 T1=10.85	SAT TT=6.421 T1=6.42	SAT TT=166.62 T1=166.66	SAT TT=0.125 T1=0.11	? (TO) TT=1800.31	SAT TT=7.521 T1=6.58	SAT TT=38.17 T1=38.16	SAT TT=51.609 T1=51.6	SAT TT=1.342 T1=1.33
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547427.opb	SAT TT=0.049 T1=0.03	SAT TT=0.748 T1=0.64	SAT TT=2.734 T1=2.73	SAT TT=7.566 T1=7.57	SAT TT=54.935 T1=54.95	SAT TT=0.049 T1=0.03	? (TO) TT=1800.24	SAT TT=1.917 T1=1.25	SAT TT=5.923 T1=5.91	SAT TT=21.671 T1=21.67	SAT TT=0.691 T1=0.68
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900547461.opb	SAT TT=2.21 T1=1.5	SAT TT=7.325 T1=7.22	SAT TT=47.987 T1=48	SAT TT=102.178 T1=102.2	SAT TT=52.622 T1=52.63	SAT TT=2.21 T1=2.19	? (TO) TT=1800.26	SAT TT=2.293 T1=1.5	SAT TT=205.956 T1=205.99	SAT TT=134.148 T1=134.17	SAT TT=6.95 T1=6.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900548667.opb	UNSAT TT=109.527	UNSAT TT=315.409	? TT=1798	? TT=1798	? TT=1798.02	UNSAT TT=109.527	? (TO) TT=1800.25	UNSAT TT=571.209	? (TO) TT=1800.09	UNSAT TT=1305.04	UNSAT TT=1608.34
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900549974.opb	SAT TT=0.462 T1=0.44	SAT TT=1.084 T1=0.99	SAT TT=12.175 T1=12.17	SAT TT=11.771 T1=11.77	SAT TT=206.512 T1=206.58	SAT TT=0.462 T1=0.44	? (TO) TT=1800.26	SAT TT=5.339 T1=4.43	SAT TT=16.41 T1=16.4	SAT TT=139.03 T1=138.99	SAT TT=3.53 T1=3.53
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900550006.opb	UNSAT TT=82.294	UNSAT TT=154.029	? TT=1798	? TT=1798.01	? TT=1798.01	UNSAT TT=82.294	? (TO) TT=1800.3	UNSAT TT=248.617	UNSAT TT=1047.96	UNSAT TT=1608.48	UNSAT TT=727.953
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900550720.opb	UNSAT TT=58.321	UNSAT TT=121.776	? TT=1798.01	? TT=1798	? TT=1798.04	UNSAT TT=58.321	? (TO) TT=1800.37	UNSAT TT=122.76	UNSAT TT=1130.27	UNSAT TT=880.71	UNSAT TT=635.658
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900551347.opb	UNSAT TT=7.484	UNSAT TT=18.325	UNSAT TT=765.807	UNSAT TT=1143.75	? (TO) TT=1800.07	UNSAT TT=7.484	? (TO) TT=1800.31	UNSAT TT=8.05	UNSAT TT=551.688	UNSAT TT=231.735	UNSAT TT=168.456
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900551864.opb	UNSAT TT=8.625	UNSAT TT=26.188	UNSAT TT=1613.45	UNSAT TT=1131.34	? TT=1798.04	UNSAT TT=9.283	? (TO) TT=1800.23	UNSAT TT=8.625	UNSAT TT=469.865	UNSAT TT=826.419	UNSAT TT=75.549
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552288.opb	UNSAT TT=19.466	UNSAT TT=69.034	? TT=1798	UNSAT TT=1037.8	? TT=1798.02	UNSAT TT=43.045	? (TO) TT=1800.25	UNSAT TT=19.466	UNSAT TT=915.302	UNSAT TT=752.612	UNSAT TT=448.902
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552311.opb	SAT TT=0.4 T1=0.38	SAT TT=1.779 T1=1.96	SAT TT=5.045 T1=5.04	SAT TT=2.068 T1=2.06	SAT TT=256.623 T1=256.69	SAT TT=0.4 T1=0.38	SAT TT=239.692 T1=235.87	SAT TT=6.687 T1=5.37	SAT TT=46.836 T1=46.83	SAT TT=54.224 T1=54.22	SAT TT=0.552 T1=0.55
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552423.opb	UNSAT TT=1.738	UNSAT TT=4.3	UNSAT TT=376.655	UNSAT TT=392.67	UNSAT TT=1489.27	UNSAT TT=1.738	? (TO) TT=1800.31	UNSAT TT=3.134	UNSAT TT=184.64	UNSAT TT=82.149	UNSAT TT=4.411
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900552735.opb	UNSAT TT=22.072	UNSAT TT=40.558	? TT=1798	UNSAT TT=1545.21	? (TO) TT=1800.08	UNSAT TT=22.072	? (TO) TT=1800.27	UNSAT TT=33.36	UNSAT TT=703.066	UNSAT TT=727.355	UNSAT TT=310.581
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553606.opb	SAT TT=2.311 T1=2.29	SAT TT=6.164 T1=6.05	SAT TT=25.514 T1=25.52	SAT TT=14.16 T1=14.16	SAT TT=752.91 T1=753.1	SAT TT=2.311 T1=2.29	? (TO) TT=1800.21	SAT TT=3.788 T1=2.91	SAT TT=49.974 T1=49.99	SAT TT=72.703 T1=72.68	SAT TT=2.418 T1=2.41
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553644.opb	SAT TT=0.052 T1=0.04	SAT TT=1.546 T1=1.43	SAT TT=3.121 T1=3.12	SAT TT=10.753 T1=10.75	SAT TT=23.361 T1=23.36	SAT TT=0.052 T1=0.04	SAT TT=943.885 T1=932.93	SAT TT=2.282 T1=1.43	SAT TT=16.366 T1=16.35	SAT TT=8.556 T1=8.55	SAT TT=0.513 T1=0.51
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553647.opb	UNSAT TT=18.903	UNSAT TT=105.131	UNSAT TT=1334.05	? TT=1798	? (TO) TT=1800.08	UNSAT TT=47.719	? (TO) TT=1800.26	UNSAT TT=18.903	UNSAT TT=1081.37	UNSAT TT=755.554	UNSAT TT=267.303
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900553812.opb	UNSAT TT=8.883	UNSAT TT=29.167	UNSAT TT=1011.51	UNSAT TT=1512.69	? TT=1798.02	UNSAT TT=18.665	? (TO) TT=1800.3	UNSAT TT=8.883	UNSAT TT=745.03	UNSAT TT=791.701	UNSAT TT=171.772
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554067.opb	SAT TT=0.239 T1=0.23	SAT TT=1.082 T1=0.97	SAT TT=7.145 T1=7.14	SAT TT=1.215 T1=1.21	SAT TT=1.802 T1=1.8	SAT TT=0.239 T1=0.23	? (TO) TT=1800.36	SAT TT=2.803 T1=1.59	SAT TT=20.733 T1=20.72	SAT TT=35.794 T1=35.79	SAT TT=1.526 T1=1.52
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554072.opb	UNSAT TT=8.109	UNSAT TT=45.027	UNSAT TT=1165.79	UNSAT TT=686.089	? (TO) TT=1800.02	UNSAT TT=22.25	? (TO) TT=1800.3	UNSAT TT=8.109	UNSAT TT=630.541	UNSAT TT=1332.52	UNSAT TT=195.579
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554154.opb	SAT TT=0.205 T1=0.19	SAT TT=0.806 T1=0.69	SAT TT=5.69 T1=5.69	SAT TT=11.699 T1=11.7	SAT TT=1.037 T1=1.03	SAT TT=0.205 T1=0.19	? (TO) TT=1800.21	SAT TT=2.142 T1=1.32	SAT TT=17.127 T1=17.12	SAT TT=17.207 T1=17.19	SAT TT=1.906 T1=1.9
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554373.opb	SAT TT=0.061 T1=0.06	SAT TT=0.836 T1=0.74	SAT TT=2.391 T1=2.39	SAT TT=1.907 T1=1.9	SAT TT=2.928 T1=2.92	SAT TT=0.206 T1=0.19	SAT TT=131.4 T1=128.39	SAT TT=2.456 T1=1.68	SAT TT=6.062 T1=6.04	SAT TT=6.991 T1=6.98	SAT TT=0.061 T1=0.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554375.opb	SAT TT=0.034 T1=0.03	SAT TT=0.972 T1=0.86	SAT TT=8.093 T1=8.09	SAT TT=11.342 T1=11.34	SAT TT=73.159 T1=73.18	SAT TT=0.207 T1=0.19	? (TO) TT=1800.27	SAT TT=1.753 T1=1.11	SAT TT=21.338 T1=21.32	SAT TT=21.833 T1=21.82	SAT TT=0.034 T1=0.03
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554389.opb	SAT TT=0.205 T1=0.2	SAT TT=0.819 T1=1.03	SAT TT=0.261 T1=0.26	SAT TT=0.205 T1=0.2	SAT TT=23.461 T1=23.46	SAT TT=0.528 T1=0.52	SAT TT=74.499 T1=71.81	SAT TT=1.841 T1=1.05	SAT TT=6.814 T1=6.79	SAT TT=17.02 T1=17.01	SAT TT=0.375 T1=0.37
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900554420.opb	UNSAT TT=9.184	UNSAT TT=16.597	UNSAT TT=1353.07	UNSAT TT=1473.86	? TT=1798.76	UNSAT TT=17.787	? (TO) TT=1800.27	UNSAT TT=9.184	UNSAT TT=839.865	UNSAT TT=1109.58	UNSAT TT=188.348
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900556231.opb	UNSAT TT=36.178	UNSAT TT=125.614	? TT=1798	UNSAT TT=1682.97	? (TO) TT=1800.11	UNSAT TT=36.178	? (TO) TT=1800.24	UNSAT TT=36.261	UNSAT TT=702.624	UNSAT TT=842.021	UNSAT TT=434.432
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557362.opb	UNSAT TT=11.966	UNSAT TT=18.459	UNSAT TT=1293.21	UNSAT TT=1303.34	? TT=1798.01	UNSAT TT=11.966	? (TO) TT=1800.24	UNSAT TT=13.102	UNSAT TT=363.853	UNSAT TT=308.715	UNSAT TT=218.283
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557413.opb	SAT TT=0.322 T1=0.32	SAT TT=1.568 T1=1.46	SAT TT=56.61 T1=56.62	SAT TT=35.348 T1=35.34	SAT TT=49.238 T1=49.25	SAT TT=3.609 T1=3.6	SAT TT=1003.37 T1=992.41	SAT TT=7.56 T1=6.52	SAT TT=257.914 T1=257.98	SAT TT=39.673 T1=39.67	SAT TT=0.322 T1=0.32
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557568.opb	SAT TT=0.021 T1=0.02	SAT TT=0.804 T1=0.99	SAT TT=2.147 T1=2.14	SAT TT=0.197 T1=0.19	SAT TT=11.768 T1=12.02	SAT TT=0.058 T1=0.04	? (TO) TT=1800.32	SAT TT=2.462 T1=1.37	SAT TT=12.579 T1=12.59	SAT TT=8.394 T1=8.82	SAT TT=0.021 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557574.opb	UNSAT TT=5.246	UNSAT TT=34.022	UNSAT TT=1693.68	UNSAT TT=1499.07	? TT=1798.01	UNSAT TT=5.261	? (TO) TT=1800.34	UNSAT TT=5.246	UNSAT TT=261.914	UNSAT TT=639.44	UNSAT TT=255.403
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900557957.opb	UNSAT TT=22.354	UNSAT TT=45.174	UNSAT TT=1677.81	UNSAT TT=1464.18	? TT=1799.42	UNSAT TT=22.354	? (TO) TT=1800.25	UNSAT TT=25.787	UNSAT TT=728.19	UNSAT TT=489.867	UNSAT TT=361.969
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900558106.opb	UNSAT TT=8.606	UNSAT TT=9.288	UNSAT TT=477.426	UNSAT TT=605.826	? TT=1798.01	UNSAT TT=9.082	? (TO) TT=1800.24	UNSAT TT=8.606	UNSAT TT=511.817	UNSAT TT=434.241	UNSAT TT=160.788
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900558739.opb	UNSAT TT=45.88	UNSAT TT=85.251	? TT=1798.01	UNSAT TT=1655.87	? TT=1798.01	UNSAT TT=83.599	? (TO) TT=1800.26	UNSAT TT=45.88	UNSAT TT=1233.29	UNSAT TT=1060.89	UNSAT TT=472.513
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559365.opb	SAT TT=0.318 T1=0.3	SAT TT=0.808 T1=0.7	SAT TT=11.076 T1=11.07	SAT TT=1.219 T1=1.21	SAT TT=10.689 T1=10.69	SAT TT=0.318 T1=0.3	? (TO) TT=1800.28	SAT TT=2.831 T1=1.97	SAT TT=134.384 T1=134.4	SAT TT=124.973 T1=124.99	SAT TT=2.484 T1=2.48
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559416.opb	SAT TT=0.423 T1=0.4	SAT TT=1.494 T1=1.39	SAT TT=93.771 T1=93.79	SAT TT=1.343 T1=1.34	SAT TT=381.516 T1=381.64	SAT TT=0.423 T1=0.4	? (TO) TT=1800.22	SAT TT=3.385 T1=1.99	SAT TT=403.89 T1=403.97	SAT TT=11.503 T1=11.49	SAT TT=3.268 T1=3.26
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559641.opb	SAT TT=0.383 T1=0.37	SAT TT=2.722 T1=2.62	SAT TT=1.058 T1=1.05	SAT TT=1.631 T1=1.62	SAT TT=342.059 T1=342.16	SAT TT=0.383 T1=0.37	SAT TT=46.43 T1=44.05	SAT TT=1.34 T1=0.84	SAT TT=74.364 T1=74.36	SAT TT=10.216 T1=10.2	SAT TT=0.54 T1=0.54
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900559676.opb	UNSAT TT=103.874	UNSAT TT=247.585	? TT=1798	? TT=1798.01	? (TO) TT=1800.12	UNSAT TT=103.874	? (TO) TT=1800.22	UNSAT TT=177.605	UNSAT TT=1432.1	UNSAT TT=1198.22	UNSAT TT=933.33
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561288.opb	UNSAT TT=151.416	UNSAT TT=337.78	? TT=1798	? TT=1798	? TT=1798.02	UNSAT TT=151.416	? (TO) TT=1800.28	UNSAT TT=564.915	UNSAT TT=1611.4	UNSAT TT=1662.2	UNSAT TT=993.302
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561384.opb	SAT TT=0.084 T1=0.08	SAT TT=1.021 T1=0.92	SAT TT=2.989 T1=2.98	SAT TT=3.475 T1=3.47	SAT TT=15.679 T1=15.68	SAT TT=0.125 T1=0.11	? (TO) TT=1800.31	SAT TT=4.071 T1=3.19	SAT TT=12.042 T1=12.02	SAT TT=19.878 T1=19.86	SAT TT=0.084 T1=0.08
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900561389.opb	SAT TT=1.069 T1=1.06	SAT TT=2.378 T1=2.27	SAT TT=24.943 T1=24.94	SAT TT=15.436 T1=15.43	SAT TT=666.065 T1=666.93	SAT TT=1.069 T1=1.06	? (TO) TT=1800.28	SAT TT=14.631 T1=13.61	SAT TT=36.097 T1=36.11	SAT TT=7.122 T1=7.28	SAT TT=1.845 T1=1.84
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900562192.opb	UNSAT TT=34.574	UNSAT TT=44.152	UNSAT TT=1538.16	UNSAT TT=1002.55	? TT=1798.25	UNSAT TT=34.574	? (TO) TT=1800.31	UNSAT TT=66.85	UNSAT TT=855.705	UNSAT TT=905.19	UNSAT TT=339.001
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900563250.opb	UNSAT TT=35.444	UNSAT TT=121.141	? TT=1798.01	? TT=1798	? TT=1799.93	UNSAT TT=49.809	? (TO) TT=1800.29	UNSAT TT=35.444	UNSAT TT=1082.91	UNSAT TT=1365.8	UNSAT TT=494.423
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900563801.opb	UNSAT TT=4.198	UNSAT TT=16.934	UNSAT TT=1405.36	UNSAT TT=921.982	? TT=1798.04	UNSAT TT=7.47	? (TO) TT=1800.29	UNSAT TT=4.198	UNSAT TT=480.892	UNSAT TT=587.477	UNSAT TT=97.87
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564281.opb	UNSAT TT=6.871	UNSAT TT=24.449	UNSAT TT=953.322	UNSAT TT=878.678	? TT=1798.07	UNSAT TT=7.22	? (TO) TT=1800.3	UNSAT TT=6.871	UNSAT TT=629.541	UNSAT TT=854.533	UNSAT TT=153.756
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564822.opb	SAT TT=0.084 T1=0.07	SAT TT=0.942 T1=0.83	SAT TT=0.561 T1=0.56	SAT TT=0.652 T1=0.65	SAT TT=34.474 T1=34.48	SAT TT=0.084 T1=0.07	? (TO) TT=1800.36	SAT TT=2.1 T1=1.31	SAT TT=3.817 T1=3.8	SAT TT=7.255 T1=7.24	SAT TT=0.12 T1=0.11
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900564824.opb	UNSAT TT=0.627	UNSAT TT=3.385	UNSAT TT=399.632	UNSAT TT=250.569	UNSAT TT=603.682	UNSAT TT=0.627	? (TO) TT=1800.3	UNSAT TT=2.611	UNSAT TT=362.681	UNSAT TT=108.048	UNSAT TT=7.546
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900565527.opb	SAT TT=0.281 T1=0.27	SAT TT=0.991 T1=0.89	SAT TT=20.161 T1=20.43	SAT TT=16.051 T1=16.05	SAT TT=216.298 T1=216.38	SAT TT=0.281 T1=0.27	? (TO) TT=1800.23	SAT TT=3.825 T1=2.41	SAT TT=17.299 T1=17.28	SAT TT=39.978 T1=40.58	SAT TT=1.384 T1=1.38
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900565534.opb	UNSAT TT=16.531	UNSAT TT=98.522	? TT=1798.02	UNSAT TT=1289.04	? (TO) TT=1800.12	UNSAT TT=57.002	? (TO) TT=1800.32	UNSAT TT=16.531	UNSAT TT=1379.22	UNSAT TT=1576.52	UNSAT TT=686.95
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566151.opb	SAT TT=0.209 T1=0.19	SAT TT=1.049 T1=0.95	SAT TT=2.719 T1=2.71	SAT TT=1.47 T1=1.47	SAT TT=43.694 T1=43.7	SAT TT=0.209 T1=0.19	? (TO) TT=1800.23	SAT TT=2.383 T1=1.61	SAT TT=36.454 T1=36.45	SAT TT=7.211 T1=7.19	SAT TT=0.216 T1=0.21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566157.opb	UNSAT TT=25.911	UNSAT TT=31.712	UNSAT TT=593.822	UNSAT TT=504.651	UNSAT TT=1631.15	UNSAT TT=25.911	? (TO) TT=1800.25	UNSAT TT=35.097	UNSAT TT=534.363	UNSAT TT=490.315	UNSAT TT=130.412
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566263.opb	SAT TT=0.1 T1=0.09	SAT TT=0.782 T1=0.66	SAT TT=7.437 T1=7.43	SAT TT=30.799 T1=30.8	SAT TT=14.755 T1=14.75	SAT TT=0.104 T1=0.09	? (TO) TT=1800.23	SAT TT=2.258 T1=1.53	SAT TT=12.714 T1=12.69	SAT TT=7.649 T1=7.63	SAT TT=0.1 T1=0.1
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900566270.opb	SAT TT=0.163 T1=0.15	SAT TT=1.158 T1=1.05	SAT TT=6.281 T1=6.28	SAT TT=10.008 T1=10.01	SAT TT=113.327 T1=113.35	SAT TT=0.163 T1=0.15	? (TO) TT=1800.22	SAT TT=5.888 T1=4.99	SAT TT=8.473 T1=8.46	SAT TT=25.324 T1=25.31	SAT TT=1.382 T1=1.38
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567003.opb	SAT TT=0.129 T1=0.12	SAT TT=4.133 T1=4.02	SAT TT=9.866 T1=9.86	SAT TT=12.788 T1=12.79	SAT TT=332.795 T1=332.92	SAT TT=0.129 T1=0.12	? (TO) TT=1800.29	SAT TT=11.542 T1=10.63	SAT TT=354.999 T1=355.08	SAT TT=19.684 T1=19.68	SAT TT=10.858 T1=10.85
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567024.opb	UNSAT TT=6.953	UNSAT TT=23.362	UNSAT TT=1197.48	UNSAT TT=835.43	? TT=1798.09	UNSAT TT=8.351	? (TO) TT=1800.21	UNSAT TT=6.953	UNSAT TT=1022.7	UNSAT TT=306.646	UNSAT TT=224.375
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567135.opb	UNSAT TT=7.84	UNSAT TT=20.283	UNSAT TT=574.386	UNSAT TT=633.739	? (TO) TT=1800.09	UNSAT TT=14.716	? (TO) TT=1800.24	UNSAT TT=7.84	UNSAT TT=450.857	UNSAT TT=501.631	UNSAT TT=163.138
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567939.opb	SAT TT=0.119 T1=0.1	SAT TT=1.575 T1=1.47	SAT TT=20.334 T1=20.33	SAT TT=10.572 T1=10.57	SAT TT=1083.37 T1=1083.73	SAT TT=0.119 T1=0.1	? (TO) TT=1800.22	SAT TT=1.759 T1=1.12	SAT TT=111.558 T1=111.56	SAT TT=250.488 T1=250.52	SAT TT=1.421 T1=1.42
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900567985.opb	UNSAT TT=112.264	UNSAT TT=205.595	? TT=1798.01	? TT=1798	? (TO) TT=1800.1	UNSAT TT=112.264	? (TO) TT=1800.3	UNSAT TT=197.852	UNSAT TT=1435.08	UNSAT TT=1700.74	UNSAT TT=1399.06
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568186.opb	UNSAT TT=4.484	UNSAT TT=5.427	UNSAT TT=1155.14	UNSAT TT=827.967	? (TO) TT=1800.06	UNSAT TT=9.699	? (TO) TT=1800.29	UNSAT TT=4.484	UNSAT TT=354.932	UNSAT TT=462.229	UNSAT TT=181.733
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568706.opb	UNSAT TT=15.475	UNSAT TT=43.054	UNSAT TT=1580.58	UNSAT TT=1354.18	? (TO) TT=1800.06	UNSAT TT=15.475	? (TO) TT=1800.3	UNSAT TT=16.777	UNSAT TT=846.969	UNSAT TT=618.904	UNSAT TT=285.059
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900568952.opb	SAT TT=0.425 T1=0.41	SAT TT=1.219 T1=1.11	SAT TT=70.573 T1=70.6	SAT TT=55.558 T1=55.57	SAT TT=845.152 T1=845.36	SAT TT=0.425 T1=0.41	? (TO) TT=1800.36	SAT TT=5.421 T1=4.51	SAT TT=178.666 T1=178.69	SAT TT=66.693 T1=66.69	SAT TT=1.226 T1=1.22
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900569834.opb	UNSAT TT=6.777	UNSAT TT=48.134	? TT=1798	UNSAT TT=1138.11	? TT=1798.01	UNSAT TT=27.619	? (TO) TT=1800.25	UNSAT TT=6.777	UNSAT TT=581.507	UNSAT TT=591.327	UNSAT TT=532.193
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900570242.opb	UNSAT TT=6.631	UNSAT TT=15.977	UNSAT TT=1244.1	UNSAT TT=880.905	? (TO) TT=1800.09	UNSAT TT=6.631	? (TO) TT=1800.27	UNSAT TT=8.199	UNSAT TT=604.846	UNSAT TT=369.545	UNSAT TT=214.586
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571131.opb	SAT TT=0.095 T1=0.08	SAT TT=1.665 T1=1.56	SAT TT=1.302 T1=1.3	SAT TT=0.427 T1=0.42	SAT TT=235.948 T1=236.02	SAT TT=0.095 T1=0.08	SAT TT=18.03 T1=15.44	SAT TT=2.393 T1=1.34	SAT TT=5.441 T1=5.42	SAT TT=28.761 T1=28.75	SAT TT=0.138 T1=0.13
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571132.opb	UNSAT TT=48.621	UNSAT TT=67.177	UNSAT TT=1507.32	UNSAT TT=981.044	? TT=1798.04	UNSAT TT=48.621	? (TO) TT=1800.31	UNSAT TT=92.722	UNSAT TT=864.191	UNSAT TT=1088.12	UNSAT TT=538.407
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900571761.opb	UNSAT TT=34.713	UNSAT TT=88.304	? TT=1798	? TT=1798	? TT=1798.03	UNSAT TT=46.979	? (TO) TT=1800.3	UNSAT TT=34.713	UNSAT TT=831.872	UNSAT TT=962.992	UNSAT TT=467.125
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900573137.opb	UNSAT TT=23.869	UNSAT TT=139.926	? TT=1798	UNSAT TT=1266.45	? TT=1799.46	UNSAT TT=44.966	? (TO) TT=1800.27	UNSAT TT=23.869	UNSAT TT=1035.09	UNSAT TT=1775.93	UNSAT TT=530.101
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900573901.opb	UNSAT TT=18.171	UNSAT TT=168.658	UNSAT TT=1683.02	UNSAT TT=1349.99	? (TO) TT=1800.12	UNSAT TT=37.731	? (TO) TT=1800.27	UNSAT TT=18.171	? (TO) TT=1800.07	UNSAT TT=1022.15	UNSAT TT=337.158
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574864.opb	UNSAT TT=17.408	UNSAT TT=80.568	UNSAT TT=1630.62	UNSAT TT=1260.02	? (TO) TT=1800.07	UNSAT TT=20.791	? (TO) TT=1800.33	UNSAT TT=17.408	UNSAT TT=886.364	UNSAT TT=874.059	UNSAT TT=231.661
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574948.opb	SAT TT=0.065 T1=0.05	SAT TT=1.311 T1=1.22	SAT TT=4.827 T1=4.82	SAT TT=1.964 T1=1.96	SAT TT=17.141 T1=17.14	SAT TT=0.065 T1=0.05	? (TO) TT=1800.26	SAT TT=1.815 T1=1.15	SAT TT=5.649 T1=5.63	SAT TT=6.44 T1=6.42	SAT TT=0.097 T1=0.09
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900574974.opb	SAT TT=0.116 T1=0.1	SAT TT=1.344 T1=1.25	SAT TT=6.617 T1=6.61	SAT TT=7.422 T1=7.42	SAT TT=230.764 T1=230.85	SAT TT=0.116 T1=0.1	? (TO) TT=1800.23	SAT TT=1.489 T1=0.96	SAT TT=6.551 T1=6.53	SAT TT=8.695 T1=8.68	SAT TT=0.24 T1=0.23
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900575442.opb	UNSAT TT=8.278	UNSAT TT=50.435	UNSAT TT=1086.24	UNSAT TT=1037.54	? TT=1798.03	UNSAT TT=20.114	? (TO) TT=1800.26	UNSAT TT=8.278	UNSAT TT=733.927	UNSAT TT=639.983	UNSAT TT=273.151
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576151.opb	UNSAT TT=100.466	UNSAT TT=131.031	? TT=1798	? TT=1798	? (TO) TT=1800.1	UNSAT TT=100.466	? (TO) TT=1800.26	UNSAT TT=117.105	UNSAT TT=1058.76	UNSAT TT=833.206	UNSAT TT=647.266
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576360.opb	UNSAT TT=15.199	UNSAT TT=60.303	UNSAT TT=1096.27	UNSAT TT=619.405	? (TO) TT=1800.08	UNSAT TT=26.824	? (TO) TT=1800.29	UNSAT TT=15.199	UNSAT TT=922.644	UNSAT TT=726.981	UNSAT TT=309.158
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576918.opb	SAT TT=0.265 T1=0.26	SAT TT=1.133 T1=1.02	SAT TT=1.277 T1=1.27	SAT TT=13.324 T1=13.32	SAT TT=54.927 T1=54.94	SAT TT=0.826 T1=0.81	? (TO) TT=1800.25	SAT TT=2 T1=1.32	SAT TT=40.878 T1=40.88	SAT TT=17.06 T1=17.05	SAT TT=0.265 T1=0.26
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900576927.opb	UNSAT TT=72.721	UNSAT TT=168.709	? TT=1798	? TT=1798	? TT=1798.01	UNSAT TT=72.721	? (TO) TT=1800.25	UNSAT TT=251.702	UNSAT TT=1616.15	UNSAT TT=897.949	UNSAT TT=734.424
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900577000.opb	SAT TT=0.101 T1=0.09	SAT TT=0.766 T1=0.65	SAT TT=8.539 T1=8.54	SAT TT=3.898 T1=3.89	SAT TT=99.353 T1=99.39	SAT TT=0.101 T1=0.09	SAT TT=274.91 T1=270.71	SAT TT=3.065 T1=1.9	SAT TT=38.348 T1=38.35	SAT TT=28.18 T1=28.17	SAT TT=0.2 T1=0.2
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900577940.opb	UNSAT TT=62.789	UNSAT TT=295.28	? TT=1798.01	? TT=1798	? TT=1798.05	UNSAT TT=62.789	? (TO) TT=1800.32	UNSAT TT=636.85	UNSAT TT=1400.18	? (TO) TT=1800.17	UNSAT TT=1260.6
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900579996.opb	UNSAT TT=105.271	UNSAT TT=105.271	? TT=1798	? TT=1798	? TT=1798.01	UNSAT TT=120.119	? (TO) TT=1800.23	UNSAT TT=255.229	UNSAT TT=1514.53	UNSAT TT=1633.32	UNSAT TT=912.457
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900581320.opb	UNSAT TT=26.935	UNSAT TT=134.572	? TT=1798	? TT=1798.01	? (TO) TT=1800.07	UNSAT TT=43.429	? (TO) TT=1800.34	UNSAT TT=26.935	UNSAT TT=762.54	UNSAT TT=1510.68	UNSAT TT=592.837
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900581321.opb	SAT TT=0.028 T1=0.02	SAT TT=0.747 T1=0.65	SAT TT=1.336 T1=1.33	SAT TT=1.794 T1=1.79	SAT TT=24.48 T1=24.49	SAT TT=0.103 T1=0.09	SAT TT=20.712 T1=18.5	SAT TT=1.316 T1=0.8	SAT TT=3.716 T1=3.7	SAT TT=7.06 T1=7.04	SAT TT=0.028 T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900582300.opb	UNSAT TT=43.212	UNSAT TT=130.667	? TT=1798	UNSAT TT=1702.93	? TT=1798.03	UNSAT TT=52.449	? (TO) TT=1800.3	UNSAT TT=43.212	UNSAT TT=913.24	UNSAT TT=1356.98	UNSAT TT=1019.6
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900582376.opb	SAT TT=1.711 T1=1.7	SAT TT=2.305 T1=2.2	SAT TT=22.052 T1=22.05	SAT TT=35.112 T1=35.12	SAT TT=49.201 T1=49.22	SAT TT=1.711 T1=1.7	? (TO) TT=1800.24	SAT TT=4.336 T1=3.47	SAT TT=310.19 T1=310.42	SAT TT=83.337 T1=83.34	SAT TT=1.785 T1=1.78
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900583053.opb	UNSAT TT=70.012	UNSAT TT=187.464	? TT=1798.01	? TT=1798	? TT=1798.05	UNSAT TT=70.012	? (TO) TT=1800.32	UNSAT TT=178.362	UNSAT TT=913.771	UNSAT TT=1067.67	UNSAT TT=855.297
Bench name	Best results	BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900584106.opb	UNSAT TT=6.636	UNSAT TT=19.077	UNSAT TT=906.984	UNSAT TT=744.675	? TT=1798.22	UNSAT TT=6.636	? (TO) TT=1800.23	UNSAT TT=6.669	UNSAT TT=377.615	UNSAT TT=273.2	UNSAT TT=154.547
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900584219.opb	UNSAT TT=12.02	UNSAT TT=73.51	UNSAT TT=1724.92	UNSAT TT=1461.22	? (TO) TT=1800.04	UNSAT TT=33.35	? (TO) TT=1800.26	UNSAT TT=12.02	UNSAT TT=845.969	UNSAT TT=653.827	UNSAT TT=699.535
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900667195.opb	UNSAT TT=67.013	UNSAT TT=162.923	? TT=1798	? TT=1798	? TT=1798.02	UNSAT TT=67.013	? (TO) TT=1800.31	UNSAT TT=247.228	UNSAT TT=1175.18	? (TO) TT=1800.14	UNSAT TT=493.955
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669299.opb	SAT TT=0.224 T1=0.22	SAT TT=3.321 T1=3.21	SAT TT=4.695 T1=4.69	SAT TT=4.428 T1=4.42	SAT TT=131.783 T1=131.81	SAT TT=0.352 T1=0.34	? (TO) TT=1800.31	SAT TT=3.187 T1=1.89	SAT TT=23.574 T1=23.56	SAT TT=23.513 T1=23.5	SAT TT=0.224 T1=0.22
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669309.opb	SAT TT=1.611 T1=1.6	SAT TT=12.869 T1=12.8	SAT TT=74.953 T1=74.97	SAT TT=10.547 T1=10.55	SAT TT=739.207 T1=739.42	SAT TT=1.611 T1=1.6	? (TO) TT=1800.32	SAT TT=4.283 T1=3.37	SAT TT=7.133 T1=7.11	SAT TT=167.556 T1=167.58	SAT TT=7.142 T1=7.14
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900669797.opb	UNSAT TT=13.958	UNSAT TT=77.775	? TT=1798	UNSAT TT=1106.47	? (TO) TT=1800.04	UNSAT TT=25.293	? (TO) TT=1800.22	UNSAT TT=13.958	UNSAT TT=909.398	UNSAT TT=910.534	UNSAT TT=367.965
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670167.opb	UNSAT TT=15.024	UNSAT TT=33.791	? TT=1798	UNSAT TT=1262.85	? TT=1798.01	UNSAT TT=17.481	? (TO) TT=1800.3	UNSAT TT=15.024	UNSAT TT=453.615	UNSAT TT=849.573	UNSAT TT=449.115
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670234.opb	UNSAT TT=88.612	UNSAT TT=282.666	? TT=1798.01	? TT=1798.03	? TT=1798.01	UNSAT TT=123.555	? (TO) TT=1800.28	UNSAT TT=88.612	UNSAT TT=1398.78	UNSAT TT=1333.86	UNSAT TT=1044.21
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670675.opb	UNSAT TT=5.852	UNSAT TT=49.194	UNSAT TT=828.734	UNSAT TT=1540.38	? (TO) TT=1800.12	UNSAT TT=10.475	? (TO) TT=1800.31	UNSAT TT=5.852	UNSAT TT=344.601	UNSAT TT=425.519	UNSAT TT=184.505
normalized-PB06/SATUNSAT-SMALLINT/ submitted-PB06/namasivayam/tsp/ normalized-t3002.11tsp11.1900670756.opb	SAT TT=0.066 T1=0.06	SAT TT=0.983 T1=1.23	SAT TT=8.832 T1=8.83	SAT TT=14.26 T1=14.26	SAT TT=56.508 T1=56.52	SAT TT=0.246 T1=0.23	? (TO) TT=1800.21	SAT TT=3.42 T1=2.06	SAT TT=3.143 T1=3.12	SAT TT=30.411 T1=30.4	SAT TT=0.066 T1=0.06

Statistics		BoolVar 2009-04-26 (complete)	bsolo 3.1 (complete)	bsolo 3.1 cl (complete)	bsolo 3.1 pb (complete)	pbclasp 2009-04-24 (complete)	SAT4J Pseudo CP 2.1.1 (complete)	SAT4J Pseudo Resolution 2.1.1 (complete)	SCIPclp SCIP 1.1.0.7 with CLP 1.8.2 (complete)	SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)	wbo 1.0 (complete)
Number of times the solver is able to give the best known answer		100	72	82	43	100	9	100	98	98	100
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)		2	0	1	0	54	0	32	0	0	11