PB'06 evaluation: results by benchmark

Results by benchmark for category optimisation, small integers (OPT-SMALLINT), subcategory Handmade, subsubcategory Numerical Problems

This page displays the results of the different solvers for each benchmark for category optimisation, small integers (OPT-SMALLINT), subcategory Handmade, subsubcategory Numerical Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell example	Meaning
Answer	Solver result
f=...	value of the objective function for the model reported by the solver
TT=...	Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
T1=...	Time to get the best model (T1): this is the wall clock time (in seconds) ellapsed when the solver found its best model. This time is obtained from the 'o lines'. It is useful to compare both complete and incomplete solvers. It doesn't take into account the time to prove optimality of the solution.

Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

Abbreviation	Meaning
f=...	Value of the objective function
TO	Time Out
MO	Mem. Out (out of memory)

Meaning of the different colors:

Color	Meaning
text	the solver cannot handle this instance
text	the solver gave no answer
text	the solver could give an answer (SAT)
text	the solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
text	the solver performed better than the other ones on that instance (complete solvers point of view)
text	the solver performed better than the other ones on that instance (incomplete solvers point of view)
text	the solver was ended by a signal or other problem
text	the solver gave an incomplete answer
text	the solver gave a wrong answer

For better readability, you may choose to hide some solvers:
absconPseudo 1
bsolo 2006/05
glpPB 0.2
minisat+ 1.14
PBS 4.1L
PB-smodels 1.28
PB-smodels 1.31
Pueblo 1.3
Pueblo 1.4
SAT4JPSEUDO 2006.2
SAT4JPSEUDO 2006.2 Heuristics
wildcat-rnp 0.8.0
wildcat-skc 0.8.0

Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_10.opb	OPT f=55 TT=1671.99 T1=452.64	? (TO) TT=1800.27	SAT f=61 TT=1800.09 T1=793.09	? (TO) TT=1800.5	SAT (TO) f=61 TT=1800.12 T1=1445.4	? (TO) TT=1800.53	? (TO) TT=1800.98	SAT (TO) f=105 TT=1800.08 T1=557.38	SAT f=55 TT=1782.74 T1=452.64	OPT f=55 TT=1671.99 T1=587.45	SAT (TO) f=63 TT=1800.42 T1=563.04	SAT (TO) f=62 TT=1801.03 T1=297.62	? (TO) TT=1800.51	? (TO) TT=1800.63
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_11.opb	SAT f=74 TT=1782.73 T1=1481.44	? (TO) TT=1800.83	SAT f=83 TT=1800.09 T1=369.01	? (TO) TT=1800.56	SAT (TO) f=120 TT=1800.63 T1=1403.06	? (TO) TT=1800.54	? (TO) TT=1800.12	? (TO) TT=1800.19	SAT f=75 TT=1782.73 T1=1671.8	SAT f=74 TT=1782.73 T1=1481.44	SAT (TO) f=91 TT=1800.36 T1=1133.57	SAT (TO) f=94 TT=1800.46 T1=1385.11	? (TO) TT=1800.69	? (TO) TT=1800.61
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_12.opb	SAT f=91 TT=1782.73 T1=329.09	? (TO) TT=1800.5	SAT f=108 TT=1800.06 T1=1055.15	? (TO) TT=1800.64	SAT (TO) f=117 TT=1800.78 T1=1694.31	? (TO) TT=1800.72	? (TO) TT=1800.3	? (TO) TT=1800.43	SAT f=91 TT=1782.73 T1=329.09	SAT f=91 TT=1782.73 T1=892.91	SAT (TO) f=111 TT=1801.1 T1=1156.59	SAT (TO) f=113 TT=1801.13 T1=701.97	? (TO) TT=1800.59	? (TO) TT=1800.66
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_13.opb	SAT f=123 TT=1782.74 T1=249.96	? (TO) TT=1800.15	SAT f=178 TT=1800.12 T1=1768.3	? (TO) TT=1800.66	? (TO) TT=1800.67	? (TO) TT=1800.58	? (TO) TT=1800.76	? (TO) TT=1800.68	SAT f=125 TT=1782.74 T1=787.84	SAT f=123 TT=1782.74 T1=249.96	SAT (TO) f=191 TT=1800.2 T1=1589.92	SAT (TO) f=189 TT=1800.58 T1=1217.65	? (TO) TT=1800.59	? (TO) TT=1800.86
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_14.opb	SAT f=144 TT=1782.74 T1=1633.1	? (TO) TT=1800.2	SAT f=182 TT=1800.06 T1=625.6	? (TO) TT=1800.74	? (TO) TT=1800.53	? (TO) TT=1800.6	? (TO) TT=1800.11	? (TO) TT=1800.12	SAT f=150 TT=1782.74 T1=1359.11	SAT f=144 TT=1782.74 T1=1633.1	SAT (TO) f=183 TT=1800.24 T1=1713.92	SAT (TO) f=213 TT=1801.17 T1=265.4	? (TO) TT=1800.73	? (TO) TT=1800.63
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_15.opb	SAT f=179 TT=1782.74 T1=1350.24	? (TO) TT=1800.31	SAT f=209 TT=1800.09 T1=1775.51	? (TO) TT=1800.53	? (TO) TT=1800.74	? (TO) TT=1800.56	? (TO) TT=1800.5	? (TO) TT=1800.47	SAT f=193 TT=1782.74 T1=559.19	SAT f=179 TT=1782.74 T1=1350.24	SAT (TO) f=212 TT=1800.63 T1=1013.88	? (TO) TT=1800.48	? (TO) TT=1800.78	? (TO) TT=1800.25
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_16.opb	SAT f=222 TT=1782.74 T1=828.84	? (TO) TT=1800.42	? TT=1800.07	? (TO) TT=1800.59	? (TO) TT=1800.7	? (TO) TT=1800.73	? (TO) TT=1800.33	? (TO) TT=1800.14	SAT f=222 TT=1782.74 T1=828.84	SAT f=222 TT=1782.74 T1=1595.36	? (TO) TT=1800.54	? (TO) TT=1800.96	? (TO) TT=1800.74	? (TO) TT=1800.81
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_17.opb	SAT f=263 TT=1782.75 T1=1572.21	? (TO) TT=1801.03	? TT=1800.04	? (TO) TT=1800.61	? (TO) TT=1800.7	? (TO) TT=1800.58	? (TO) TT=1800.1	? (TO) TT=1800.02	SAT f=263 TT=1782.75 T1=1572.21	SAT f=264 TT=1782.75 T1=1265.08	? (TO) TT=1800.98	? (TO) TT=1801.11	? (TO) TT=1800.85	? (TO) TT=1800.83
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_18.opb	SAT f=303 TT=1782.74 T1=120.63	? (TO) TT=1800.75	? TT=1800.02	? (TO) TT=1800.63	? (TO) TT=1800.57	? (TO) TT=1800.82	? (TO) TT=1800.1	? (TO) TT=1800.04	SAT f=303 TT=1782.74 T1=120.63	SAT f=311 TT=1782.75 T1=1608.4	? (TO) TT=1800.22	? (TO) TT=1801.07	? (TO) TT=1800.78	? (TO) TT=1800.8
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_19.opb		? (TO) TT=1801.14	? TT=1800.06	? (TO) TT=1800.72	? (TO) TT=1800.65	? (TO) TT=1800.74	? (TO) TT=1800.12	? (TO) TT=1800.19	? (TO) TT=1800.57	? (TO) TT=1800.74	? (TO) TT=1800.44	? (TO) TT=1800.89	? (TO) TT=1800.98	? (TO) TT=1800.75
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/bounded_golomb_rulers/ normalized-bogr_20.opb	SAT f=398 TT=1782.75 T1=619.63	? TT=18.186	? TT=1800.04	? (TO) TT=1800.5	? (TO) TT=1800.58	? (TO) TT=1800.77	? (TO) TT=1800.43	? (TO) TT=1800.41	SAT f=398 TT=1782.75 T1=619.63	? (TO) TT=1800.73	? (TO) TT=1800.58	? (TO) TT=1800.57	? (TO) TT=1801.06	? (TO) TT=1800.96
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_4.opb	OPT f=6 TT=0.003 T1=0	OPT f=6 TT=1.134 T1=0.76	OPT f=6 TT=0.01 T1=0.02	OPT f=6 TT=0.025 T1=0.02	OPT f=6 TT=0.027 T1=0.03	OPT f=6 TT=0.003 T1=0	OPT f=6 TT=0.051 T1=0.04	OPT f=6 TT=0.045 T1=0.03	OPT f=6 TT=0.004 T1=0	OPT f=6 TT=0.006 T1=0	OPT f=6 TT=0.895 T1=0.56	OPT f=6 TT=0.318 T1=0.28	SAT (TO) f=6 TT=1800.65 T1=8.3	SAT (TO) f=6 TT=1800.67 T1=133.01
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_5.opb	OPT f=11 TT=0.008 T1=0	OPT f=11 TT=1.239 T1=0.88	OPT f=11 TT=0.049 T1=0.04	OPT f=11 TT=1.54 T1=1.54	OPT f=11 TT=0.129 T1=0.11	OPT f=11 TT=0.008 T1=0	OPT f=11 TT=0.084 T1=0.06	OPT f=11 TT=0.098 T1=0.07	OPT f=11 TT=0.011 T1=0.01	OPT f=11 TT=0.009 T1=0.01	OPT f=11 TT=1.852 T1=0.92	OPT f=11 TT=1.541 T1=0.84	SAT (TO) f=11 TT=1800.64 T1=306.2	SAT (TO) f=11 TT=1800.66 T1=192.55
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_6.opb	OPT f=17 TT=0.048 T1=0.02	OPT f=17 TT=2.697 T1=1.88	OPT f=17 TT=0.504 T1=0.2	OPT f=17 TT=35.824 T1=35.83	OPT f=17 TT=1.023 T1=0.88	OPT f=17 TT=0.048 T1=0.02	OPT f=17 TT=0.676 T1=0.6	OPT f=17 TT=0.404 T1=0.38	OPT f=17 TT=0.056 T1=0.04	OPT f=17 TT=0.081 T1=0.06	OPT f=17 TT=3.414 T1=1.69	OPT f=17 TT=2.747 T1=1.44	SAT (TO) f=25 TT=1800.56 T1=1704.45	SAT (TO) f=21 TT=1800.59 T1=372.12
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_7.opb	OPT f=25 TT=0.727 T1=0.21	OPT f=25 TT=12.767 T1=11.6	OPT f=25 TT=4.321 T1=1.49	OPT f=25 TT=1632.24 T1=1632.71	OPT f=25 TT=11.592 T1=4.41	OPT f=25 TT=0.727 T1=0.28	OPT f=25 TT=8.423 T1=5.82	OPT f=25 TT=8.896 T1=5.66	OPT f=25 TT=1.155 T1=0.21	OPT f=25 TT=1.097 T1=0.26	OPT f=25 TT=26.491 T1=2.33	OPT f=25 TT=18.751 T1=3.23	SAT (TO) f=47 TT=1800.71 T1=1800.79	SAT (TO) f=33 TT=1800.72 T1=1694.62
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_8.opb	OPT f=34 TT=13.03 T1=2.45	OPT f=34 TT=451.992 T1=451.29	OPT f=34 TT=36.721 T1=20.48	? (TO) TT=1800.64	OPT f=34 TT=69.767 T1=8.49	OPT f=34 TT=13.173 T1=9.29	OPT f=34 TT=209.912 T1=151.97	OPT f=34 TT=265.173 T1=190.43	OPT f=34 TT=13.03 T1=4.42	OPT f=34 TT=15.311 T1=2.45	OPT f=34 TT=1413.09 T1=101.34	SAT (TO) f=34 TT=1800.67 T1=52.24	SAT (TO) f=83 TT=1800.53 T1=101.92	SAT (TO) f=70 TT=1800.58 T1=1738.17
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ bounded_golomb_rulers/normalized-bogr_9.opb	OPT f=44 TT=182.509 T1=49.72	? (TO) TT=1800.77	OPT f=44 TT=638.965 T1=384.77	? (TO) TT=1800.65	SAT (TO) f=44 TT=1800.57 T1=1042.47	OPT f=44 TT=182.509 T1=136.68	? (TO) TT=1800.92	SAT (TO) f=56 TT=1800.84 T1=183.49	OPT f=44 TT=216.971 T1=135.23	OPT f=44 TT=239.156 T1=49.72	SAT (TO) f=44 TT=1800.98 T1=1660.81	SAT (TO) f=46 TT=1800.48 T1=220.88	SAT (TO) f=81 TT=1800.57 T1=713.54	? (TO) TT=1800.43
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_10.opb	OPT f=55 TT=1576.15 T1=405.41	? (TO) TT=1800.41	SAT f=66 TT=1800.02 T1=36.19	? (TO) TT=1800.63	SAT (TO) f=62 TT=1800.48 T1=1420.2	? (TO) TT=1800.47	? (TO) TT=1801	SAT (TO) f=79 TT=1800.98 T1=1668.42	SAT f=58 TT=1782.73 T1=1341.15	OPT f=55 TT=1576.15 T1=405.41	SAT (TO) f=67 TT=1800.48 T1=1296.81	SAT (TO) f=66 TT=1800.36 T1=1519.43	? (TO) TT=1800.73	? (TO) TT=1800.67
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_11.opb	SAT f=75 TT=1782.73 T1=140.31	? (TO) TT=1800.35	SAT f=99 TT=1800.14 T1=94.08	? (TO) TT=1800.65	? (TO) TT=1800.83	? (TO) TT=1800.72	? (TO) TT=1800.22	? (TO) TT=1800.31	SAT f=75 TT=1782.73 T1=476.3	SAT f=75 TT=1782.74 T1=140.31	SAT (TO) f=93 TT=1800.94 T1=1191.9	SAT (TO) f=93 TT=1800.38 T1=280.98	? (TO) TT=1800.63	? (TO) TT=1800.58
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_12.opb	SAT f=95 TT=1782.74 T1=507	? (TO) TT=1800.09	SAT (TO) f=165 TT=1800.63 T1=124.7	? (TO) TT=1800.6	SAT (TO) f=115 TT=1800.62 T1=1505.06	? (TO) TT=1800.67	? (TO) TT=1800.34	SAT (TO) f=201 TT=1800.52 T1=715.95	SAT f=97 TT=1782.73 T1=590.02	SAT f=95 TT=1782.74 T1=507	SAT (TO) f=130 TT=1801.04 T1=1080.51	SAT (TO) f=119 TT=1800.42 T1=1319.1	? (TO) TT=1800.7	? (TO) TT=1800.63
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_13.opb	SAT f=118 TT=1782.74 T1=1413.91	? (TO) TT=1800.12	SAT f=133 TT=1800.1 T1=819.74	? (TO) TT=1800.47	? (TO) TT=1800.68	? (TO) TT=1800.76	? (TO) TT=1800.71	SAT (TO) f=216 TT=1800.55 T1=704.94	SAT f=122 TT=1782.74 T1=599.45	SAT f=118 TT=1782.74 T1=1413.91	SAT (TO) f=152 TT=1800.68 T1=1015.88	SAT (TO) f=154 TT=1800.39 T1=1322.04	? (TO) TT=1800.73	? (TO) TT=1800.65
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_14.opb	SAT f=142 TT=1782.74 T1=1026.49	? (TO) TT=1801.03	SAT f=170 TT=1800.06 T1=513.93	? (TO) TT=1800.57	? (TO) TT=1800.74	? (TO) TT=1800.58	? (TO) TT=1800.28	? (TO) TT=1800.19	SAT f=142 TT=1782.74 T1=1026.49	SAT f=152 TT=1782.74 T1=1740.09	SAT (TO) f=188 TT=1800.88 T1=444.29	SAT (TO) f=191 TT=1800.7 T1=1265.93	? (TO) TT=1800.74	? (TO) TT=1800.69
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_15.opb	SAT f=176 TT=1782.75 T1=1338.98	? (TO) TT=1800.77	SAT f=216 TT=1800.06 T1=1418.37	? (TO) TT=1800.63	? (TO) TT=1800.61	? (TO) TT=1800.78	? (TO) TT=1800.7	? (TO) TT=1800.67	SAT f=190 TT=1782.74 T1=562.16	SAT f=176 TT=1782.75 T1=1338.98	? (TO) TT=1801.01	SAT (TO) f=220 TT=1800.33 T1=540.11	? (TO) TT=1800.81	? (TO) TT=1800.79
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_16.opb	SAT f=223 TT=1782.75 T1=1556.18	? (TO) TT=1800.57	SAT f=411 TT=1800.09 T1=1260.48	? (TO) TT=1800.45	SAT (TO) f=255 TT=1800.66 T1=1755.59	? (TO) TT=1800.52	? (TO) TT=1800.64	? (TO) TT=1800.45	SAT f=223 TT=1782.76 T1=1598.78	SAT f=223 TT=1782.75 T1=1556.18	SAT (TO) f=250 TT=1800.47 T1=1196.09	? (TO) TT=1800.36	? (TO) TT=1800.75	? (TO) TT=1800.52
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_17.opb	SAT f=262 TT=1782.74 T1=1741.16	? (TO) TT=1800.84	? TT=1800.03	? (TO) TT=1800.52	? (TO) TT=1800.43	? (TO) TT=1800.6	? (TO) TT=1800.11	? (TO) TT=1800.37	SAT f=262 TT=1782.74 T1=1741.16	SAT f=272 TT=1782.74 T1=1631.68	? (TO) TT=1800.2	? (TO) TT=1800.96	? (TO) TT=1800.81	? (TO) TT=1800.64
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_18.opb		? (TO) TT=1800.35	? TT=1800.11	? (TO) TT=1800.57	? (TO) TT=1800.42	? (TO) TT=1800.58	? (TO) TT=1800.19	? (TO) TT=1800.15	? (TO) TT=1800.73	? (TO) TT=1800.53	? (TO) TT=1800.32	? (TO) TT=1800.98	? (TO) TT=1800.95	? (TO) TT=1800.81
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_19.opb	SAT f=355 TT=1782.75 T1=851.3	? (TO) TT=1800.23	? TT=1800.09	? (TO) TT=1800.66	? (TO) TT=1800.34	? (TO) TT=1800.58	? (TO) TT=1800.45	? (TO) TT=1800.31	? (TO) TT=1800.54	SAT f=355 TT=1782.75 T1=851.3	? (TO) TT=1800.49	? (TO) TT=1800.63	? (TO) TT=1800.89	? (TO) TT=1800.89
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_20.opb		? TT=17.243	? TT=1800.02	? (TO) TT=1800.61	? (TO) TT=1800.37	? (TO) TT=1800.68	? (TO) TT=1800.04	? (TO) TT=1801	? (TO) TT=1800.61	? (TO) TT=1800.61	? (TO) TT=1801.01	? (TO) TT=1801.04	? (TO) TT=1800.9	? (TO) TT=1800.84
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_4.opb	OPT f=6 TT=0.003 T1=0	OPT f=6 TT=0.931 T1=0.7	OPT f=6 TT=0.026 T1=0.03	OPT f=6 TT=0.026 T1=0.02	OPT f=6 TT=0.027 T1=0.02	OPT f=6 TT=0.003 T1=0	OPT f=6 TT=0.052 T1=0.04	OPT f=6 TT=0.047 T1=0.04	OPT f=6 TT=0.006 T1=0	OPT f=6 TT=0.006 T1=0	OPT f=6 TT=1.418 T1=0.81	OPT f=6 TT=0.692 T1=0.39	SAT (TO) f=6 TT=1800.45 T1=95.91	SAT (TO) f=6 TT=1800.56 T1=79.44
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_5.opb	OPT f=11 TT=0.011 T1=0.01	OPT f=11 TT=1.333 T1=0.94	OPT f=11 TT=0.174 T1=0.08	OPT f=11 TT=0.516 T1=0.51	OPT f=11 TT=0.231 T1=0.18	OPT f=11 TT=0.013 T1=0.01	OPT f=11 TT=0.078 T1=0.06	OPT f=11 TT=0.084 T1=0.06	OPT f=11 TT=0.013 T1=0.01	OPT f=11 TT=0.011 T1=0.01	OPT f=11 TT=2.351 T1=1.26	OPT f=11 TT=2.187 T1=1.05	SAT (TO) f=11 TT=1800.69 T1=269.25	SAT (TO) f=11 TT=1800.7 T1=230.05
Bench name	Best results on this instance	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_6.opb	OPT f=17 TT=0.07 T1=0.01	OPT f=17 TT=2.275 T1=1.59	OPT f=17 TT=2.08 T1=1.58	OPT f=17 TT=10.834 T1=10.83	OPT f=17 TT=1.658 T1=1.16	OPT f=17 TT=0.07 T1=0.01	OPT f=17 TT=0.458 T1=0.37	OPT f=17 TT=0.485 T1=0.35	OPT f=17 TT=0.1 T1=0.03	OPT f=17 TT=0.094 T1=0.03	OPT f=17 TT=4.833 T1=2.22	OPT f=17 TT=5.067 T1=2.66	SAT (TO) f=25 TT=1800.67 T1=1102.74	SAT (TO) f=21 TT=1800.67 T1=1005.23
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_7.opb	OPT f=25 TT=0.929 T1=0.07	OPT f=25 TT=16.144 T1=15.26	OPT f=25 TT=8.039 T1=6.11	OPT f=25 TT=687.405 T1=687.46	OPT f=25 TT=16.609 T1=6.45	OPT f=25 TT=0.929 T1=0.43	OPT f=25 TT=9.07 T1=7.51	OPT f=25 TT=9.495 T1=6.22	OPT f=25 TT=1.907 T1=0.5	OPT f=25 TT=1.347 T1=0.07	OPT f=25 TT=57.323 T1=9.03	OPT f=25 TT=46.269 T1=7.29	SAT (TO) f=41 TT=1800.52 T1=1620.45	SAT (TO) f=37 TT=1800.72 T1=1755.59
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_8.opb	OPT f=34 TT=11.329 T1=2.06	OPT f=34 TT=337.321 T1=336.24	OPT f=34 TT=937.768 T1=24.29	? (TO) TT=1800.47	OPT f=34 TT=71.228 T1=14.29	OPT f=34 TT=11.329 T1=3.88	OPT f=34 TT=375.078 T1=320.83	OPT f=34 TT=366.545 T1=318.01	OPT f=34 TT=14.539 T1=2.06	OPT f=34 TT=17.714 T1=4.87	SAT (TO) f=34 TT=1800.59 T1=86.94	SAT (TO) f=34 TT=1800.58 T1=412.05	SAT (TO) f=82 TT=1800.72 T1=505.18	? (TO) TT=1800.71
normalized-PB06/OPT-SMALLINT/ submitted-PB06/manquiho/ golomb-rulers/normalized-OGR_9.opb	OPT f=44 TT=177.232 T1=58.96	? (TO) TT=1800.29	SAT f=49 TT=1800.1 T1=256.23	? (TO) TT=1800.64	SAT (TO) f=44 TT=1800.64 T1=1012.12	OPT f=44 TT=230.986 T1=187.94	? (TO) TT=1800.99	SAT (TO) f=45 TT=1800.8 T1=1529.7	OPT f=44 TT=213.427 T1=58.96	OPT f=44 TT=177.232 T1=120.21	SAT (TO) f=49 TT=1800.25 T1=274.34	SAT (TO) f=49 TT=1800.8 T1=1146.12	? (TO) TT=1800.67	? (TO) TT=1800.68

Some statistics...

	absconPseudo 1	bsolo 2006/05	glpPB 0.2	minisat+ 1.14	PBS 4.1L	PB-smodels 1.28	PB-smodels 1.31	Pueblo 1.3	Pueblo 1.4	SAT4JPSEUDO 2006.2	SAT4JPSEUDO 2006.2 Heuristics	wildcat-rnp 0.8.0	wildcat-skc 0.8.0
Number of times the solver is able to give the best known answer	10	11	8	10	12	10	10	21	26	9	8	0	0
Number of times the solver is able to give the best known answer from an incomplete solver point of view (i.e. without considering optimality proof)	10	11	8	12	12	10	10	22	26	11	10	4	4
Number of times the solver is the best solver from a complete solver point of view (i.e. best known answer and best TT time)	0	0	0	0	9	0	0	9	15	0	0	0	0
Number of times the solver is the best solver from an incomplete solver point of view (i.e. best known answer and best T1 time)	0	0	0	0	6	0	0	14	17	0	0	0	0