PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Numerical Problems

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Numerical Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (opt) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench nameBest results
on this
instance
bsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_10.opb
OPT
f=55
TT=334.51
T1=86.91
SAT
f=55
TT=1798
T1=136.54
OPT
f=55
TT=1413.88
T1=258.19
? (problem)

TT=30.231

? (TO)

TT=1800.1

? (problem)

TT=29.95

? (TO)

TT=1800.11

? (problem)

TT=29.24

? (TO)

TT=1800.13

? (problem)

TT=28.41

? (TO)

TT=1800.09

SAT (TO)
f=55
TT=1800.05
T1=703.71
SAT (TO)
f=60
TT=1800.1
T1=1088
OPT
f=55
TT=842.843
T1=246.78
OPT
f=55
TT=888.355
T1=314.99
OPT
f=55
TT=924.69
T1=571.6
SAT
f=59
TT=1798
T1=310.53
OPT
f=55
TT=1464.92
T1=308.02
? (TO)

TT=1800.26

? (TO)

TT=1800.38

SAT (TO)
f=55
TT=1800.16
T1=830.82
SAT
f=85
TT=1789.86
T1=656.78
OPT
f=55
TT=1567.43
T1=521.76
SAT
f=77
TT=1796.84
T1=553.8
SAT (TO)
f=61
TT=1800.08
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.04

OPT
f=55
TT=1716.62
T1=858.3
SAT (TO)
f=55
TT=1800.05
T1=900.21
OPT
f=55
TT=1037.03
T1=282.39
OPT
f=55
TT=334.51
T1=86.91
SAT
f=60
TT=108.19
T1=106.89
?

TT=1797.02

?

TT=1796.88

SAT
f=97
TT=1796.91
T1=359.38
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.67

?

TT=1799.91

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_11.opb
SAT
f=72
TT=1800.01
T1=511.06
SAT
f=76
TT=1798
T1=1204.68
SAT (TO)
f=74
TT=1800.03
T1=835.41
? (problem)

TT=49.23

? (TO)

TT=1800.06

? (problem)

TT=49.63

? (TO)

TT=1800.08

? (problem)

TT=49.58

? (TO)

TT=1800.09

? (problem)

TT=46.35

? (TO)

TT=1800.05

SAT (TO)
f=74
TT=1800.05
T1=1237.34
SAT (TO)
f=82
TT=1800.09
T1=1697.69
SAT (TO)
f=74
TT=1802.07
T1=899.13
SAT
f=74
TT=1783
T1=755.27
SAT (TO)
f=74
TT=1800.08
T1=1026.93
SAT
f=77
TT=1798
T1=1125.34
SAT (TO)
f=75
TT=1800.56
T1=540.34
? (TO)

TT=1800.2

? (TO)

TT=1800.09

SAT (TO)
f=77
TT=1800.14
T1=43.56
?

TT=1789.82

SAT (TO)
f=76
TT=1800.48
T1=900.5
?

TT=1797.2

SAT (TO)
f=81
TT=1800.1
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.01

SAT (TO)
f=76
TT=1800.12
T1=900.31
SAT (TO)
f=77
TT=1800.2
T1=900.31
SAT (TO)
f=74
TT=1800.02
T1=435.06
SAT (TO)
f=72
TT=1800.01
T1=511.06
SAT (TO)
f=72
TT=1800.04
T1=1701.17
?

TT=1797

?

TT=1797.04

?

TT=1797.15

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.67

?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_12.opb
SAT
f=91
TT=1783
T1=416.14
SAT
f=95
TT=1798.02
T1=893.28
SAT (TO)
f=95
TT=1800.03
T1=522.99
? (problem)

TT=95.784

? (TO)

TT=1800.13

? (problem)

TT=91.912

? (TO)

TT=1800.08

? (problem)

TT=92.44

? (TO)

TT=1800.08

? (problem)

TT=90.93

? (TO)

TT=1800.03

SAT (TO)
f=99
TT=1800.03
T1=1185.7
SAT (TO)
f=104
TT=1800.08
T1=1210.97
SAT (TO)
f=97
TT=1802.12
T1=844.45
SAT
f=91
TT=1783
T1=416.14
SAT (TO)
f=98
TT=1800.01
T1=1623.56
SAT
f=97
TT=1798.01
T1=1549.02
SAT (TO)
f=99
TT=1800.25
T1=948.67
?

TT=1799.93

? (TO)

TT=1800.36

SAT (TO)
f=100
TT=1800.77
T1=709
?

TT=1789.83

SAT (TO)
f=98
TT=1800.67
T1=393.69
?

TT=1796.89

SAT (TO)
f=98
TT=1800.11
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.05

SAT (TO)
f=100
TT=1800.51
T1=900.31
SAT (TO)
f=95
TT=1800.16
T1=900.31
SAT (TO)
f=95
TT=1800.01
T1=213.88
SAT (TO)
f=92
TT=1800.02
T1=306.91
SAT (TO)
f=96
TT=1800.43
T1=1601.7
?

TT=1796.87

?

TT=1796.92

?

TT=1796.85

? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.63

?

TT=1799.62

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_13.opb
SAT
f=119
TT=1798
T1=1223.6
SAT
f=119
TT=1798
T1=1597.89
SAT (TO)
f=120
TT=1800.03
T1=858.03
? (problem)

TT=136.417

? (TO)

TT=1800.06

? (problem)

TT=128.45

? (TO)

TT=1800.05

? (problem)

TT=124.96

? (TO)

TT=1800.08

? (problem)

TT=126.34

? (TO)

TT=1800.08

SAT (TO)
f=122
TT=1800.02
T1=1762.72
SAT (TO)
f=166
TT=1800.09
T1=1416.42
SAT (TO)
f=128
TT=1802.12
T1=1495.2
SAT
f=120
TT=1783.01
T1=787.53
SAT (TO)
f=125
TT=1800.1
T1=1413.75
SAT
f=119
TT=1798.01
T1=110.8
SAT (TO)
f=123
TT=1800.28
T1=1582.25
?

TT=1796.74

? (TO)

TT=1800.27

SAT (TO)
f=129
TT=1800.89
T1=551.15
?

TT=1789.8

SAT (TO)
f=125
TT=1800.01
T1=224.01
?

TT=1796.88

SAT (TO)
f=166
TT=1800.06
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.06

SAT (TO)
f=124
TT=1800.48
T1=900.31
SAT (TO)
f=126
TT=1800.13
T1=900.31
SAT (TO)
f=124
TT=1800.66
T1=415.59
SAT (TO)
f=119
TT=1800.1
T1=1223.6
SAT (TO)
f=120
TT=1800.06
T1=1748.99
?

TT=1796.8

?

TT=1796.86

?

TT=1796.91

? (TO)

TT=1800.01

? (TO)

TT=1800.01

?

TT=1799.98

?

TT=1800.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_14.opb
SAT
f=142
TT=1783.01
T1=1368.05
SAT
f=159
TT=1798.01
T1=446.92
SAT (TO)
f=153
TT=1800.03
T1=518.02
? (problem)

TT=191.643

? (TO)

TT=1800.05

? (problem)

TT=184.86

? (TO)

TT=1800.07

? (problem)

TT=178.97

? (TO)

TT=1800.06

? (problem)

TT=180.1

? (TO)

TT=1800.09

SAT (TO)
f=160
TT=1800.1
T1=1569.26
? (TO)

TT=1800.09

SAT (TO)
f=154
TT=1802.15
T1=1259.18
SAT
f=142
TT=1783.01
T1=1368.05
SAT (TO)
f=155
TT=1800.03
T1=1671.66
SAT
f=153
TT=1798.01
T1=1173.28
SAT (TO)
f=157
TT=1800.39
T1=753.01
? (TO)

TT=1800.18

? (TO)

TT=1800.1

SAT (TO)
f=153
TT=1800.12
T1=848.72
?

TT=1789.79

SAT (TO)
f=148
TT=1800.16
T1=394.32
?

TT=1796.81

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.1

SAT (TO)
f=156
TT=1800.05
T1=900.31
SAT (TO)
f=156
TT=1800.08
T1=900.31
SAT (TO)
f=148
TT=1800.11
T1=329.87
SAT (TO)
f=149
TT=1800.02
T1=1730.78
SAT
f=154
TT=1097.78
T1=1095.38
?

TT=1796.87

?

TT=1796.82

?

TT=1796.84

? (TO)

TT=1800.01

? (TO)

TT=1800.09

?

TT=1799.62

?

TT=1796.64

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_15.opb
SAT
f=178
TT=1798.05
T1=152.28
SAT
f=178
TT=1798.05
T1=152.28
SAT (TO)
f=182
TT=1800.11
T1=1670.34
? (MO)

TT=221.53

? (TO)

TT=1800.01

? (MO)

TT=225.45

? (TO)

TT=1800.07

? (MO)

TT=218.08

? (TO)

TT=1800.01

? (MO)

TT=219.03

? (TO)

TT=1800.03

SAT (TO)
f=191
TT=1800.09
T1=230.59
? (TO)

TT=1800.09

SAT (TO)
f=194
TT=1802.13
T1=929.01
SAT
f=179
TT=1783.01
T1=540.78
SAT (TO)
f=191
TT=1800.63
T1=1529.96
SAT
f=187
TT=1798.03
T1=624.28
SAT (TO)
f=191
TT=1800.39
T1=1525.28
?

TT=1798.84

? (TO)

TT=1800.31

SAT (TO)
f=198
TT=1800.18
T1=434.06
?

TT=1789.8

SAT (TO)
f=185
TT=1800.62
T1=851.94
?

TT=1796.86

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.01

SAT (TO)
f=199
TT=1800.06
T1=900.31
SAT (TO)
f=196
TT=1800.08
T1=900.31
SAT (TO)
f=191
TT=1800.02
T1=815.48
SAT (TO)
f=184
TT=1800.4
T1=978.85
SAT (TO)
f=188
TT=1800.08
T1=1544.35
?

TT=1796.85

?

TT=1796.83

?

TT=1796.77

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.61

?

TT=1799.98

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_16.opb
SAT
f=214
TT=1800.03
T1=1726.92
SAT (TO)
f=220
TT=1800.14
T1=1621.96
SAT (TO)
f=223
TT=1800.02
T1=1615.92
? (MO)

TT=130.18

? (TO)

TT=1800.06

? (MO)

TT=125.7

? (TO)

TT=1800.07

? (MO)

TT=126.27

? (TO)

TT=1800.08

? (MO)

TT=128.01

? (TO)

TT=1800.02

SAT (TO)
f=235
TT=1800.06
T1=999.42
? (TO)

TT=1800.07

SAT (TO)
f=222
TT=1802.14
T1=1589.03
SAT
f=217
TT=1783.01
T1=1555.18
SAT (TO)
f=234
TT=1800.07
T1=1584.86
SAT
f=239
TT=1798.01
T1=967.77
? (TO)

TT=1800.02

?

TT=1797.28

? (TO)

TT=1800.1

SAT (TO)
f=226
TT=1800.22
T1=82.02
?

TT=1789.84

SAT (TO)
f=229
TT=1800.17
T1=287.9
?

TT=1796.8

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.09

SAT (TO)
f=242
TT=1800.17
T1=900.41
SAT (TO)
f=240
TT=1800.51
T1=900.41
SAT (TO)
f=224
TT=1800.82
T1=154.81
SAT (TO)
f=214
TT=1800.03
T1=1726.92
SAT (TO)
f=221
TT=1800.08
T1=1670.11
?

TT=1796.83

?

TT=1796.85

?

TT=1796.82

? (TO)

TT=1800.11

? (TO)

TT=1800.12

?

TT=1800.02

?

TT=1799.63

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_17.opb
SAT
f=256
TT=1783.01
T1=1667.91
SAT
f=269
TT=1798.02
T1=528.7
SAT (TO)
f=271
TT=1800.03
T1=207
? (MO)

TT=178.01

? (TO)

TT=1800.03

? (MO)

TT=181.7

? (TO)

TT=1800.01

? (MO)

TT=181.86

? (TO)

TT=1800.05

? (MO)

TT=179.4

? (TO)

TT=1800.01

SAT (TO)
f=263
TT=1800.1
T1=420.63
? (TO)

TT=1800.07

SAT (TO)
f=285
TT=1802.05
T1=1401.96
SAT
f=256
TT=1783.01
T1=1667.91
? (TO)

TT=1800.37

SAT
f=278
TT=1798.01
T1=626.38
SAT (TO)
f=288
TT=1800.08
T1=1303.87
?

TT=1795.63

? (TO)

TT=1800.24

SAT (TO)
f=261
TT=1800.24
T1=642.01
?

TT=1789.84

SAT (TO)
f=280
TT=1800.53
T1=699.55
?

TT=1796.89

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.08

SAT (TO)
f=282
TT=1800.12
T1=900.41
SAT (TO)
f=281
TT=1800.09
T1=900.41
SAT (TO)
f=264
TT=1800.58
T1=374.2
SAT (TO)
f=267
TT=1800.05
T1=987.39
SAT (TO)
f=280
TT=1800.03
T1=922.36
?

TT=1796.9

?

TT=1796.9

?

TT=1796.87

? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.69

?

TT=1799.67

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_18.opb
SAT
f=299
TT=1783.01
T1=1365.34
SAT
f=316
TT=1798.01
T1=1011.73
? (TO)

TT=1800.03

? (problem)

TT=195.851

? (TO)

TT=1800.05

? (problem)

TT=192.91

? (TO)

TT=1800.09

? (problem)

TT=202.295

? (TO)

TT=1800.09

? (problem)

TT=192.283

? (TO)

TT=1800.08

SAT (TO)
f=312
TT=1800.05
T1=1564.74
? (TO)

TT=1800.03

? (TO)

TT=1802.12

SAT
f=299
TT=1783.01
T1=1365.34
SAT (TO)
f=317
TT=1800.1
T1=1123.16
SAT
f=322
TT=1798.01
T1=60.37
? (TO)

TT=1800.89

?

TT=1794.85

? (TO)

TT=1800.16

? (TO)

TT=1800.17

?

TT=1789.89

SAT (TO)
f=305
TT=1800.07
T1=779.32
?

TT=1796.85

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.19

SAT (TO)
f=315
TT=1800.55
T1=900.51
SAT (TO)
f=305
TT=1800.03
T1=694.75
SAT (TO)
f=320
TT=1800.09
T1=950.16
? (TO)

TT=1800.03

?

TT=1796.91

?

TT=1796.86

?

TT=1796.89

? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.65

?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_19.opb
SAT
f=345
TT=1800.11
T1=685.82
?

TT=1798.01

? (TO)

TT=1800.11

? (problem)

TT=266.587

? (TO)

TT=1800.05

? (problem)

TT=266.064

? (TO)

TT=1800

? (problem)

TT=272.808

? (TO)

TT=1800.01

? (problem)

TT=263.043

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1802.14

? (TO)

TT=1800.1

? (TO)

TT=1800.07

SAT
f=360
TT=1798.02
T1=113.05
? (TO)

TT=1800.05

?

TT=1793.89

? (TO)

TT=1800.3

? (TO)

TT=1800.06

?

TT=1789.99

SAT (TO)
f=345
TT=1800.11
T1=685.82
?

TT=1796.94

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.53

? (TO)

TT=1800.01

?

TT=1796.94

?

TT=1796.93

?

TT=1797.04

? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.67

?

TT=1800.03

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_20.opb
SAT
f=392
TT=1783.03
T1=1472.65
SAT
f=398
TT=1798.03
T1=823.7
? (TO)

TT=1800.02

? (MO)

TT=275.08

? (TO)

TT=1800.03

? (MO)

TT=277.71

? (TO)

TT=1800.09

? (MO)

TT=276.89

? (TO)

TT=1800.02

? (MO)

TT=278.31

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.11

? (TO)

TT=1802.12

SAT
f=392
TT=1783.03
T1=1472.65
? (TO)

TT=1800.1

?

TT=1798.01

? (TO)

TT=1800

?

TT=1795.79

? (TO)

TT=1800.19

? (TO)

TT=1800.45

?

TT=1790

? (TO)

TT=1800.16

?

TT=1796.92

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.53

? (TO)

TT=1800.55

? (TO)

TT=1800.55

? (TO)

TT=1800.45

? (TO)

TT=1800.05

?

TT=1796.96

?

TT=1796.99

?

TT=1796.9

? (TO)

TT=1800.1

? (TO)

TT=1800.01

?

TT=1799.69

?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_4.opb
OPT
f=6
TT=0.001
T1=0
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.303
T1=0.27
OPT
f=6
TT=0.11
T1=0.09
? (problem)

TT=0.2

OPT
f=6
TT=0.076
T1=0.07
? (problem)

TT=0.2

OPT
f=6
TT=0.072
T1=0.07
? (problem)

TT=0.198

? (TO)

TT=1800.05

OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.014
T1=0.01
OPT
f=6
TT=0.045
T1=0.03
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.149
T1=0.15
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.174
T1=0.16
OPT
f=6
TT=0.014
T1=0.01
OPT
f=6
TT=0.008
T1=0.01
OPT
f=6
TT=0.184
T1=1.16
OPT
f=6
TT=0.03
T1=0.02
OPT
f=6
TT=0.197
T1=0.68
OPT
f=6
TT=0.046
T1=0.03
OPT
f=6
TT=0.007
T1=0
OPT
f=6
TT=0.06
T1=0.04
OPT
f=6
TT=0.073
T1=0.06
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.195
T1=0.66
OPT
f=6
TT=0.163
T1=0.14
SAT
f=13
TT=0.236
T1=0.18
OPT
f=6
TT=0.035
T1=0.02
OPT
f=6
TT=0.039
T1=0.03
OPT
f=6
TT=0.039
T1=0.03
OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.005
T1=0
OPT
f=6
TT=0.001
T1=0
OPT
f=6
TT=0.001
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_5.opb
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=0.017
T1=0.01
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=1.052
T1=0.99
OPT
f=11
TT=0.323
T1=0.3
? (problem)

TT=0.607

OPT
f=11
TT=0.252
T1=0.25
? (problem)

TT=0.602

OPT
f=11
TT=0.237
T1=0.24
? (problem)

TT=0.61

? (TO)

TT=1800.09

OPT
f=11
TT=0.02
T1=0.02
OPT
f=11
TT=0.064
T1=0.05
OPT
f=11
TT=0.066
T1=0.06
OPT
f=11
TT=0.005
T1=0
OPT
f=11
TT=0.334
T1=0.22
OPT
f=11
TT=0.014
T1=0.01
OPT
f=11
TT=0.312
T1=0.2
OPT
f=11
TT=0.552
T1=0.52
OPT
f=11
TT=0.067
T1=0.08
OPT
f=11
TT=0.435
T1=1.17
OPT
f=11
TT=0.06
T1=0.05
OPT
f=11
TT=0.574
T1=0.71
OPT
f=11
TT=0.393
T1=0.36
OPT
f=11
TT=0.026
T1=0.02
OPT
f=11
TT=0.265
T1=0.23
OPT
f=11
TT=0.3
T1=0.26
OPT
f=11
TT=0.003
T1=0
OPT
f=11
TT=0.004
T1=0.01
OPT
f=11
TT=0.614
T1=0.7
OPT
f=11
TT=0.274
T1=0.18
SAT
f=11
TT=0.324
T1=0.22
OPT
f=11
TT=0.06
T1=0.05
OPT
f=11
TT=0.085
T1=0.07
OPT
f=11
TT=0.505
T1=0.44
OPT
f=11
TT=0.019
T1=0.01
OPT
f=11
TT=0.022
T1=0.02
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_6.opb
OPT
f=17
TT=0.011
T1=0.01
OPT
f=17
TT=0.043
T1=0.02
OPT
f=17
TT=0.011
T1=0.01
OPT
f=17
TT=4.742
T1=3.52
OPT
f=17
TT=0.535
T1=0.4
OPT
f=17
TT=4.687
T1=3.5
OPT
f=17
TT=0.487
T1=0.39
OPT
f=17
TT=3.761
T1=3.55
OPT
f=17
TT=0.426
T1=0.39
? (TO)

TT=1800.38

? (TO)

TT=1800.07

OPT
f=17
TT=0.042
T1=0.03
OPT
f=17
TT=0.526
T1=0.44
OPT
f=17
TT=0.181
T1=0.15
OPT
f=17
TT=0.047
T1=0.03
OPT
f=17
TT=0.634
T1=0.35
OPT
f=17
TT=0.038
T1=0.02
OPT
f=17
TT=0.834
T1=0.39
OPT
f=17
TT=3.337
T1=2.8
OPT
f=17
TT=2.2
T1=0.95
OPT
f=17
TT=1.499
T1=2.26
OPT
f=17
TT=2.443
T1=1.35
OPT
f=17
TT=0.953
T1=1.24
OPT
f=17
TT=2.265
T1=1.57
OPT
f=17
TT=0.297
T1=0.29
OPT
f=17
TT=1.066
T1=0.64
OPT
f=17
TT=0.877
T1=0.71
OPT
f=17
TT=0.064
T1=0.02
OPT
f=17
TT=0.064
T1=0.02
OPT
f=17
TT=1.684
T1=1.76
OPT
f=17
TT=0.596
T1=0.32
SAT
f=30
TT=0.534
T1=0.29
OPT
f=17
TT=1.73
T1=1.35
OPT
f=17
TT=1.736
T1=1.34
OPT
f=17
TT=2.427
T1=2.12
OPT
f=17
TT=0.218
T1=0.13
OPT
f=17
TT=0.231
T1=0.13
OPT
f=17
TT=0.043
T1=0.03
OPT
f=17
TT=0.035
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_7.opb
OPT
f=25
TT=0.174
T1=0.1
OPT
f=25
TT=0.632
T1=0.17
OPT
f=25
TT=0.174
T1=0.1
OPT
f=25
TT=23.991
T1=17.99
OPT
f=25
TT=2.622
T1=1.26
OPT
f=25
TT=26.361
T1=21.45
OPT
f=25
TT=2.473
T1=1.2
OPT
f=25
TT=21.708
T1=17.97
OPT
f=25
TT=2.197
T1=1.71
OPT
f=25
TT=19.7
T1=16.81
OPT
f=25
TT=2.733
T1=2.27
OPT
f=25
TT=0.57
T1=0.18
OPT
f=25
TT=4.106
T1=1.69
OPT
f=25
TT=0.666
T1=0.35
OPT
f=25
TT=0.661
T1=0.15
OPT
f=25
TT=1.614
T1=0.99
OPT
f=25
TT=0.417
T1=0.08
OPT
f=25
TT=1.835
T1=0.83
OPT
f=25
TT=24.869
T1=6.29
OPT
f=25
TT=101.4
T1=37.01
OPT
f=25
TT=3.894
T1=3.33
OPT
f=25
TT=34.762
T1=14.99
OPT
f=25
TT=2.566
T1=1.32
OPT
f=25
TT=17.177
T1=16.78
OPT
f=25
TT=3.193
T1=3.19
OPT
f=25
TT=6.465
T1=2.85
OPT
f=25
TT=12.252
T1=10.24
OPT
f=25
TT=0.489
T1=0.24
OPT
f=25
TT=0.507
T1=0.25
OPT
f=25
TT=2.936
T1=1.32
OPT
f=25
TT=1.094
T1=0.46
SAT
f=25
TT=1.303
T1=0.51
OPT
f=25
TT=34.531
T1=12.39
OPT
f=25
TT=34.285
T1=12.3
OPT
f=25
TT=14.155
T1=14.14
OPT
f=25
TT=3.475
T1=0.87
OPT
f=25
TT=3.428
T1=0.85
OPT
f=25
TT=0.606
T1=0.6
OPT
f=25
TT=0.607
T1=0.6
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_8.opb
OPT
f=34
TT=4.034
T1=0.58
OPT
f=34
TT=11.233
T1=1.58
OPT
f=34
TT=4.034
T1=0.58
OPT
f=34
TT=174.217
T1=126.76
OPT
f=34
TT=22.955
T1=4.39
OPT
f=34
TT=150.755
T1=133.83
OPT
f=34
TT=22.962
T1=4.45
OPT
f=34
TT=68.679
T1=43.86
OPT
f=34
TT=13.392
T1=6.6
OPT
f=34
TT=80.611
T1=55.44
? (TO)

TT=1800.43

OPT
f=34
TT=11.175
T1=4.09
OPT
f=34
TT=20.558
T1=3.17
OPT
f=34
TT=5.807
T1=1.48
OPT
f=34
TT=8.604
T1=1.38
OPT
f=34
TT=19.424
T1=5.83
OPT
f=34
TT=11.255
T1=1.41
OPT
f=34
TT=11.664
T1=4.14
OPT
f=34
TT=301.255
T1=143.19
? (TO)

TT=1800.39

OPT
f=34
TT=26.972
T1=22.41
OPT
f=34
TT=686.858
T1=621.02
OPT
f=34
TT=10.629
T1=1.4
OPT
f=34
TT=263.271
T1=107.43
OPT
f=34
TT=21.708
T1=21.7
OPT
f=34
TT=47.44
T1=23
OPT
f=34
TT=35.122
T1=19.39
OPT
f=34
TT=8.063
T1=4.04
OPT
f=34
TT=7.973
T1=3.99
OPT
f=34
TT=12.831
T1=8.89
OPT
f=34
TT=5.632
T1=2.07
SAT
f=35
TT=2.075
T1=1.16
OPT
f=34
TT=189.9
T1=183.5
OPT
f=34
TT=183.395
T1=177.25
OPT
f=34
TT=167.309
T1=160.1
OPT
f=34
TT=41.554
T1=4.14
OPT
f=34
TT=41.663
T1=4.1
OPT
f=34
TT=11.242
T1=11.26
OPT
f=34
TT=11.25
T1=11.28
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_9.opb
OPT
f=44
TT=36.61
T1=3.43
OPT
f=44
TT=242.678
T1=151.27
OPT
f=44
TT=92.423
T1=3.43
OPT
f=44
TT=1633.59
T1=1636.06
OPT
f=44
TT=966.098
T1=966.28
OPT
f=44
TT=1726.11
T1=1726.65
OPT
f=44
TT=788.733
T1=788.91
OPT
f=44
TT=1257.78
T1=999.58
OPT
f=44
TT=377.018
T1=254.88
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=44
TT=213.913
T1=13.08
OPT
f=44
TT=800.526
T1=311.71
OPT
f=44
TT=82.585
T1=41.43
OPT
f=44
TT=136.733
T1=28.37
OPT
f=44
TT=62
T1=14.66
OPT
f=44
TT=165.987
T1=90.65
OPT
f=44
TT=115.36
T1=33.11
SAT (TO)
f=56
TT=1800.28
T1=1607.49
? (TO)

TT=1800.23

OPT
f=44
TT=262.075
T1=98.48
SAT
f=68
TT=1789.86
T1=1712.82
OPT
f=44
TT=112.839
T1=26.58
SAT
f=52
TT=1796.95
T1=1175.4
OPT
f=44
TT=884.463
T1=884.62
OPT
f=44
TT=1577.51
T1=1263.2
OPT
f=44
TT=1042.47
T1=754.62
OPT
f=44
TT=142.669
T1=71.33
OPT
f=44
TT=113.14
T1=56.67
OPT
f=44
TT=100.149
T1=43.09
OPT
f=44
TT=36.61
T1=18.31
SAT
f=44
TT=39.898
T1=15.62
SAT
f=50
TT=1797.19
T1=1209.95
SAT
f=50
TT=1797.26
T1=1209.31
SAT
f=51
TT=1797.05
T1=400.12
OPT
f=44
TT=645.339
T1=71.43
OPT
f=44
TT=662.431
T1=70.13
OPT
f=44
TT=174.36
T1=174.4
OPT
f=44
TT=179.29
T1=179.31
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_10.opb
OPT
f=55
TT=350.209
T1=101.61
SAT
f=55
TT=1798.01
T1=1573.94
OPT
f=55
TT=1761.62
T1=258.66
? (problem)

TT=32.445

? (TO)

TT=1800.06

? (problem)

TT=30.53

? (TO)

TT=1800.04

? (problem)

TT=32.31

? (TO)

TT=1800.06

? (problem)

TT=31.22

? (TO)

TT=1800.03

SAT (TO)
f=55
TT=1800.06
T1=700.08
SAT (TO)
f=59
TT=1800.11
T1=1270.67
OPT
f=55
TT=584.573
T1=170.42
OPT
f=55
TT=858.664
T1=225.02
OPT
f=55
TT=1077.03
T1=645.67
SAT
f=58
TT=1798
T1=427.81
OPT
f=55
TT=1745.88
T1=546.86
SAT (TO)
f=87
TT=1800.19
T1=542.64
? (TO)

TT=1800.09

SAT (TO)
f=55
TT=1800.17
T1=748.02
SAT
f=85
TT=1789.93
T1=382.24
OPT
f=55
TT=1364.64
T1=252.08
?

TT=1796.95

SAT (TO)
f=60
TT=1800.06
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.02

SAT (TO)
f=55
TT=1800.19
T1=900.31
SAT (TO)
f=55
TT=1800.42
T1=900.21
OPT
f=55
TT=841.026
T1=103.25
OPT
f=55
TT=350.209
T1=101.61
SAT
f=63
TT=37.8
T1=36.46
?

TT=1796.78

?

TT=1796.83

SAT
f=94
TT=1796.86
T1=551.77
? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1799.57

?

TT=1799.6

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_11.opb
SAT
f=72
TT=1800.02
T1=658.92
SAT
f=76
TT=1798
T1=984.07
SAT (TO)
f=72
TT=1800.03
T1=996.2
? (problem)

TT=46.728

? (TO)

TT=1800.09

? (problem)

TT=44.69

? (TO)

TT=1800.08

? (problem)

TT=45.62

? (TO)

TT=1800.08

? (problem)

TT=45.6

? (TO)

TT=1800.09

SAT (TO)
f=76
TT=1800.02
T1=358.81
SAT (TO)
f=94
TT=1800.09
T1=1740.41
SAT (TO)
f=74
TT=1802.07
T1=1384.84
SAT
f=74
TT=1783
T1=948.45
SAT (TO)
f=76
TT=1800.1
T1=1461.22
SAT
f=77
TT=1798
T1=576.35
SAT (TO)
f=74
TT=1800.1
T1=736.51
? (TO)

TT=1800.22

? (TO)

TT=1800.13

SAT (TO)
f=77
TT=1800.83
T1=898.02
?

TT=1789.78

SAT (TO)
f=76
TT=1800.21
T1=415.19
?

TT=1796.81

SAT (TO)
f=81
TT=1800.08
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.02

SAT (TO)
f=74
TT=1800.6
T1=900.31
SAT (TO)
f=74
TT=1800.15
T1=900.31
SAT (TO)
f=74
TT=1800.59
T1=136.88
SAT (TO)
f=72
TT=1800.02
T1=658.92
SAT (TO)
f=75
TT=1800.06
T1=717.4
?

TT=1796.84

?

TT=1796.82

?

TT=1796.93

? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.62

?

TT=1800.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_12.opb
SAT
f=94
TT=1800.17
T1=418.01
SAT
f=96
TT=1798.01
T1=573.56
SAT (TO)
f=98
TT=1800.03
T1=1587.12
? (problem)

TT=99.95

? (TO)

TT=1800.1

? (problem)

TT=94.91

? (TO)

TT=1800.04

? (problem)

TT=96.42

? (TO)

TT=1800.08

? (problem)

TT=93.61

? (TO)

TT=1800.05

SAT (TO)
f=99
TT=1800.05
T1=968.39
SAT (TO)
f=99
TT=1800.07
T1=1579.15
SAT (TO)
f=96
TT=1800.07
T1=1023.11
SAT
f=95
TT=1783.01
T1=249.05
SAT (TO)
f=101
TT=1800.01
T1=1544.01
SAT (TO)
f=99
TT=1800.2
T1=1742.1
SAT (TO)
f=99
TT=1800.13
T1=1708.9
? (TO)

TT=1800.18

? (TO)

TT=1800.2

SAT (TO)
f=99
TT=1800.15
T1=760.28
?

TT=1789.79

SAT (TO)
f=97
TT=1800.15
T1=250.13
?

TT=1796.83

SAT (TO)
f=104
TT=1800.03
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.08

SAT (TO)
f=95
TT=1800.18
T1=900.31
SAT (TO)
f=98
TT=1800.16
T1=900.31
SAT (TO)
f=94
TT=1800.17
T1=418.01
SAT (TO)
f=95
TT=1800.03
T1=1779.3
SAT (TO)
f=97
TT=1800.09
T1=845.78
?

TT=1796.81

?

TT=1796.89

?

TT=1796.9

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.63

?

TT=1800.07

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_13.opb
SAT
f=117
TT=1800.48
T1=1108.52
SAT
f=122
TT=1798.01
T1=1645.51
SAT (TO)
f=118
TT=1800.03
T1=1631.62
? (problem)

TT=144.809

? (TO)

TT=1800.01

? (problem)

TT=133.95

? (TO)

TT=1800

? (problem)

TT=138.39

? (TO)

TT=1800.09

? (problem)

TT=134.43

? (TO)

TT=1800.05

SAT (TO)
f=126
TT=1800.08
T1=1309.66
? (TO)

TT=1800.08

SAT (TO)
f=123
TT=1802.1
T1=1211.53
SAT
f=118
TT=1783.01
T1=662.29
SAT (TO)
f=128
TT=1800.06
T1=1145.41
SAT
f=129
TT=1798.01
T1=423.62
SAT (TO)
f=125
TT=1801.2
T1=739.9
? (TO)

TT=1800.21

? (TO)

TT=1800.42

SAT (TO)
f=129
TT=1800.79
T1=450.87
?

TT=1789.82

SAT (TO)
f=123
TT=1800.32
T1=801.59
?

TT=1796.86

SAT (TO)
f=165
TT=1800.07
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.02

SAT (TO)
f=128
TT=1800.48
T1=900.31
SAT (TO)
f=121
TT=1800.08
T1=900.31
SAT (TO)
f=123
TT=1800.43
T1=524.03
SAT (TO)
f=117
TT=1800.48
T1=1108.52
SAT
f=121
TT=1433.13
T1=1430.98
?

TT=1796.63

?

TT=1796.82

?

TT=1796.87

? (TO)

TT=1800.11

? (TO)

TT=1800.01

?

TT=1799.63

?

TT=1800.01

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_14.opb
SAT
f=144
TT=1800.02
T1=1661.54
SAT
f=155
TT=1798.01
T1=1198.01
SAT (TO)
f=144
TT=1800.02
T1=1661.54
? (problem)

TT=201.018

? (TO)

TT=1800.06

? (problem)

TT=187.5

? (TO)

TT=1800.05

? (problem)

TT=192.71

? (TO)

TT=1800.08

? (problem)

TT=187.39

? (TO)

TT=1800.09

SAT (TO)
f=157
TT=1800.1
T1=478.06
? (TO)

TT=1800.09

SAT (TO)
f=159
TT=1802.08
T1=382
SAT
f=149
TT=1783.01
T1=1141.38
SAT (TO)
f=156
TT=1800.39
T1=1633.43
SAT
f=150
TT=1798
T1=1550.02
SAT (TO)
f=155
TT=1800.01
T1=1740.41
? (TO)

TT=1800.2

? (TO)

TT=1800.11

SAT (TO)
f=163
TT=1800.31
T1=818.36
?

TT=1789.81

SAT (TO)
f=151
TT=1800.08
T1=91.22
?

TT=1796.84

? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.09

SAT (TO)
f=156
TT=1800.46
T1=900.31
SAT (TO)
f=161
TT=1800.51
T1=900.31
SAT (TO)
f=151
TT=1800.52
T1=862.34
SAT (TO)
f=146
TT=1800.08
T1=692.56
SAT (TO)
f=156
TT=1800.02
T1=1613.57
?

TT=1796.87

?

TT=1796.82

?

TT=1796.84

? (TO)

TT=1800.09

? (TO)

TT=1800.02

?

TT=1799.65

?

TT=1799.66

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_15.opb
SAT
f=176
TT=1783.01
T1=571.05
SAT
f=199
TT=1798
T1=1469.28
SAT (TO)
f=187
TT=1800.03
T1=869.5
? (MO)

TT=223.07

? (TO)

TT=1800.08

? (MO)

TT=221.32

? (TO)

TT=1800.05

? (MO)

TT=225.25

? (TO)

TT=1800.01

? (MO)

TT=231.64

? (TO)

TT=1800.08

SAT (TO)
f=190
TT=1800.08
T1=1524.84
? (TO)

TT=1800.07

SAT (TO)
f=189
TT=1802.07
T1=1441.81
SAT
f=176
TT=1783.01
T1=571.05
SAT (TO)
f=213
TT=1800.01
T1=1564.59
SAT
f=192
TT=1798.01
T1=181.02
SAT (TO)
f=199
TT=1800.07
T1=1599.16
?

TT=1799.29

? (TO)

TT=1800.21

SAT (TO)
f=202
TT=1800.18
T1=285.14
?

TT=1789.78

SAT (TO)
f=187
TT=1800.13
T1=444.2
?

TT=1796.79

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.07

SAT (TO)
f=193
TT=1800.07
T1=900.31
SAT (TO)
f=196
TT=1800.42
T1=900.31
SAT (TO)
f=185
TT=1800.78
T1=644.56
SAT (TO)
f=179
TT=1800.03
T1=1249.49
SAT (TO)
f=196
TT=1800.63
T1=1540.14
?

TT=1796.83

?

TT=1796.81

?

TT=1796.8

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.63

?

TT=1799.66

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_16.opb
SAT
f=210
TT=1800.02
T1=431.08
SAT
f=228
TT=1798
T1=1645.9
SAT (TO)
f=210
TT=1800.02
T1=431.08
? (MO)

TT=184.73

? (TO)

TT=1800.02

? (MO)

TT=187.39

? (TO)

TT=1800.08

? (MO)

TT=188.41

? (TO)

TT=1800.06

? (MO)

TT=185.88

? (TO)

TT=1800.01

SAT (TO)
f=223
TT=1800.08
T1=214.62
SAT (TO)
f=234
TT=1800.08
T1=1664.6
SAT (TO)
f=247
TT=1802.13
T1=336.9
SAT
f=223
TT=1783.01
T1=679.57
SAT (TO)
f=239
TT=1800.09
T1=1132.05
SAT
f=226
TT=1798
T1=1001.19
? (TO)

TT=1800.06

?

TT=1797.71

? (TO)

TT=1800.08

SAT (TO)
f=241
TT=1801.2
T1=85.08
?

TT=1789.8

SAT (TO)
f=233
TT=1800.13
T1=825.75
?

TT=1796.84

SAT (TO)
f=236
TT=1800.05
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.06

SAT (TO)
f=238
TT=1800.19
T1=900.41
SAT (TO)
f=244
TT=1800.18
T1=900.41
SAT (TO)
f=234
TT=1800.05
T1=317.09
SAT (TO)
f=220
TT=1800.54
T1=1450.48
SAT (TO)
f=252
TT=1800.04
T1=1479.31
?

TT=1796.83

?

TT=1796.83

?

TT=1796.85

? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.67

?

TT=1799.66

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_17.opb
SAT
f=260
TT=1800.2
T1=703.53
SAT
f=278
TT=1798.02
T1=68.56
SAT (TO)
f=270
TT=1800.03
T1=1520.54
? (problem)

TT=183.167

? (TO)

TT=1800.07

? (problem)

TT=180.46

? (TO)

TT=1800.09

? (problem)

TT=188.118

? (TO)

TT=1800.08

? (problem)

TT=182.634

? (TO)

TT=1800.07

SAT (TO)
f=270
TT=1800.05
T1=1656.93
? (TO)

TT=1800.07

? (TO)

TT=1802.11

SAT
f=266
TT=1783.01
T1=740.67
? (TO)

TT=1800.08

SAT
f=266
TT=1798.01
T1=609.86
SAT (TO)
f=277
TT=1800.09
T1=750.49
?

TT=1797.2

? (TO)

TT=1800.08

SAT (TO)
f=275
TT=1800.11
T1=802.02
?

TT=1789.81

SAT (TO)
f=281
TT=1800.17
T1=702.44
?

TT=1796.84

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800

? (TO)

TT=1800.06

SAT (TO)
f=276
TT=1800.4
T1=900.41
SAT (TO)
f=260
TT=1800.2
T1=703.53
SAT (TO)
f=264
TT=1800.04
T1=1395.13
SAT (TO)
f=332
TT=1800.08
T1=1750.11
?

TT=1796.86

?

TT=1796.86

?

TT=1796.85

? (TO)

TT=1800.1

? (TO)

TT=1800.01

?

TT=1799.66

?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_18.opb
SAT
f=307
TT=1800.21
T1=823.27
SAT
f=321
TT=1798.01
T1=85.59
SAT (TO)
f=322
TT=1800.11
T1=1281.49
? (problem)

TT=237.21

? (TO)

TT=1800.02

? (problem)

TT=235.62

? (TO)

TT=1800.04

? (problem)

TT=240.886

? (TO)

TT=1800.03

? (problem)

TT=237.393

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1802.12

SAT
f=312
TT=1783.01
T1=1120.7
? (TO)

TT=1800.75

?

TT=1798.01

? (TO)

TT=1801.24

?

TT=1796.85

? (TO)

TT=1800.4

? (TO)

TT=1800.17

?

TT=1789.83

SAT (TO)
f=314
TT=1800.08
T1=276.1
?

TT=1796.9

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.54

SAT (TO)
f=313
TT=1800.2
T1=900.71
SAT (TO)
f=307
TT=1800.21
T1=823.27
SAT (TO)
f=315
TT=1800.89
T1=1447.45
? (TO)

TT=1800.09

?

TT=1796.87

?

TT=1796.99

?

TT=1796.84

? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.97

?

TT=1799.63

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_19.opb
SAT
f=355
TT=1783.01
T1=351.63
?

TT=1798.01

? (TO)

TT=1800.02

? (MO)

TT=276.75

? (TO)

TT=1800.03

? (MO)

TT=282.98

? (TO)

TT=1800.02

? (MO)

TT=279.36

? (TO)

TT=1800.02

? (MO)

TT=277.55

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1802.13

SAT
f=355
TT=1783.01
T1=351.63
? (TO)

TT=1800.07

SAT
f=352
TT=1798.01
T1=193.11
? (TO)

TT=1800.56

?

TT=1796.14

? (TO)

TT=1800.21

? (TO)

TT=1800.83

?

TT=1790.04

? (TO)

TT=1800.18

?

TT=1796.96

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.46

SAT (TO)
f=357
TT=1800.1
T1=1779.35
? (TO)

TT=1800.78

?

TT=1796.85

?

TT=1797

?

TT=1796.9

? (TO)

TT=1800.11

? (TO)

TT=1800.09

?

TT=1799.64

?

TT=1800.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_20.opb




?

TT=1798.01

? (TO)

TT=1800.02

? (MO)

TT=278.9

? (TO)

TT=1800.01

? (MO)

TT=278.97

? (TO)

TT=1800.1

? (MO)

TT=278.51

? (TO)

TT=1800.07

? (MO)

TT=276.45

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1802.14

? (TO)

TT=1800.02

? (TO)

TT=1800.07

?

TT=1798.01

? (TO)

TT=1800.34

?

TT=1795.29

? (TO)

TT=1800.27

? (TO)

TT=1800.08

?

TT=1789.91

? (TO)

TT=1800.61

?

TT=1796.94

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.42

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.05

?

TT=1796.91

?

TT=1796.91

?

TT=1796.99

? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.63

?

TT=1799.63

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_4.opb
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.516
T1=0.45
OPT
f=6
TT=0.12
T1=0.09
OPT
f=6
TT=0.467
T1=0.43
OPT
f=6
TT=0.09
T1=0.08
OPT
f=6
TT=0.448
T1=0.64
OPT
f=6
TT=0.087
T1=0.08
? (TO)

TT=1800.01

? (TO)

TT=1800.27

OPT
f=6
TT=0.005
T1=0
OPT
f=6
TT=0.017
T1=0.01
OPT
f=6
TT=0.062
T1=0.11
OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.204
T1=0.16
OPT
f=6
TT=0.003
T1=0
OPT
f=6
TT=0.224
T1=0.14
OPT
f=6
TT=0.151
T1=0.14
OPT
f=6
TT=0.026
T1=0.02
OPT
f=6
TT=0.286
T1=2.17
OPT
f=6
TT=0.034
T1=0.02
OPT
f=6
TT=0.264
T1=1.17
OPT
f=6
TT=0.149
T1=0.14
OPT
f=6
TT=0.008
T1=0
OPT
f=6
TT=0.141
T1=0.11
OPT
f=6
TT=0.186
T1=0.16
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.285
T1=1.16
OPT
f=6
TT=0.192
T1=0.16
SAT
f=9
TT=0.233
T1=0.16
OPT
f=6
TT=0.044
T1=0.03
OPT
f=6
TT=0.048
T1=0.04
OPT
f=6
TT=0.126
T1=0.12
OPT
f=6
TT=0.008
T1=0
OPT
f=6
TT=0.007
T1=0
OPT
f=6
TT=0.003
T1=0
OPT
f=6
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_5.opb
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=0.012
T1=0.01
OPT
f=11
TT=0.004
T1=0
OPT
f=11
TT=1.413
T1=1.41
OPT
f=11
TT=0.37
T1=0.33
OPT
f=11
TT=1.14
T1=1.13
OPT
f=11
TT=0.298
T1=0.28
OPT
f=11
TT=1.098
T1=1.05
OPT
f=11
TT=0.281
T1=0.27
OPT
f=11
TT=1.272
T1=1.16
? (TO)

TT=1800.04

OPT
f=11
TT=0.011
T1=0.01
OPT
f=11
TT=0.119
T1=0.09
OPT
f=11
TT=0.082
T1=0.1
OPT
f=11
TT=0.008
T1=0
OPT
f=11
TT=0.354
T1=0.21
OPT
f=11
TT=0.01
T1=0
OPT
f=11
TT=0.365
T1=0.21
OPT
f=11
TT=0.518
T1=0.47
OPT
f=11
TT=0.248
T1=0.14
OPT
f=11
TT=0.525
T1=2.18
OPT
f=11
TT=0.555
T1=0.46
OPT
f=11
TT=0.533
T1=1.21
OPT
f=11
TT=0.545
T1=0.49
OPT
f=11
TT=0.062
T1=0.06
OPT
f=11
TT=0.436
T1=0.37
OPT
f=11
TT=0.452
T1=0.39
OPT
f=11
TT=0.003
T1=0
OPT
f=11
TT=0.003
T1=0
OPT
f=11
TT=0.505
T1=1.18
OPT
f=11
TT=0.345
T1=0.21
SAT
f=11
TT=0.374
T1=0.23
OPT
f=11
TT=0.321
T1=0.3
OPT
f=11
TT=0.368
T1=0.35
OPT
f=11
TT=0.484
T1=0.43
OPT
f=11
TT=0.043
T1=0.03
OPT
f=11
TT=0.035
T1=0.02
OPT
f=11
TT=0.002
T1=0.01
OPT
f=11
TT=0.002
T1=0.01
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_6.opb
OPT
f=17
TT=0.02
T1=0.01
OPT
f=17
TT=0.076
T1=0.03
OPT
f=17
TT=0.02
T1=0.02
OPT
f=17
TT=15.655
T1=8.29
OPT
f=17
TT=0.814
T1=0.72
OPT
f=17
TT=12.607
T1=6.95
OPT
f=17
TT=0.527
T1=0.48
OPT
f=17
TT=8.151
T1=6.56
OPT
f=17
TT=0.489
T1=0.42
OPT
f=17
TT=12.753
T1=10.89
? (TO)

TT=1800.03

OPT
f=17
TT=0.063
T1=0.03
OPT
f=17
TT=0.821
T1=0.57
OPT
f=17
TT=0.337
T1=0.3
OPT
f=17
TT=0.056
T1=0.01
OPT
f=17
TT=0.774
T1=0.4
OPT
f=17
TT=0.077
T1=0.02
OPT
f=17
TT=0.916
T1=0.42
OPT
f=17
TT=2.806
T1=1.61
OPT
f=17
TT=3.179
T1=1.2
OPT
f=17
TT=2.013
T1=5.22
OPT
f=17
TT=3.639
T1=2.48
OPT
f=17
TT=1.254
T1=2.27
OPT
f=17
TT=1.906
T1=1.28
OPT
f=17
TT=0.538
T1=0.53
OPT
f=17
TT=2.838
T1=3.4
OPT
f=17
TT=2.62
T1=1.99
OPT
f=17
TT=0.086
T1=0.03
OPT
f=17
TT=0.086
T1=0.04
OPT
f=17
TT=2.524
T1=2.75
OPT
f=17
TT=0.754
T1=0.37
SAT
f=17
TT=0.795
T1=0.34
OPT
f=17
TT=2.357
T1=2.13
OPT
f=17
TT=2.549
T1=2.29
OPT
f=17
TT=2.972
T1=2.74
OPT
f=17
TT=0.374
T1=0.21
OPT
f=17
TT=0.349
T1=0.19
OPT
f=17
TT=0.075
T1=0.07
OPT
f=17
TT=0.074
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_7.opb
OPT
f=25
TT=0.36
T1=0.04
OPT
f=25
TT=0.838
T1=0.2
OPT
f=25
TT=0.36
T1=0.22
OPT
f=25
TT=38.464
T1=38.47
OPT
f=25
TT=4.703
T1=3.33
OPT
f=25
TT=31.11
T1=31.38
OPT
f=25
TT=3.371
T1=2.25
OPT
f=25
TT=18.624
T1=12.91
OPT
f=25
TT=2.461
T1=1.09
OPT
f=25
TT=39.464
T1=31.87
? (TO)

TT=1800.07

OPT
f=25
TT=0.807
T1=0.14
OPT
f=25
TT=6.069
T1=2.57
OPT
f=25
TT=0.786
T1=0.25
OPT
f=25
TT=0.812
T1=0.04
OPT
f=25
TT=2.245
T1=1.19
OPT
f=25
TT=0.71
T1=0.17
OPT
f=25
TT=2.263
T1=0.59
OPT
f=25
TT=27.846
T1=10.27
OPT
f=25
TT=25.079
T1=8.87
OPT
f=25
TT=5.214
T1=5.33
OPT
f=25
TT=46.813
T1=16.67
OPT
f=25
TT=3.583
T1=2.3
OPT
f=25
TT=33.034
T1=16.32
OPT
f=25
TT=4.568
T1=4.56
OPT
f=25
TT=17.434
T1=17.56
OPT
f=25
TT=16.371
T1=11.2
OPT
f=25
TT=0.808
T1=0.4
OPT
f=25
TT=0.767
T1=0.38
OPT
f=25
TT=4.154
T1=7.32
OPT
f=25
TT=1.523
T1=0.58
OPT
f=25
TT=1.675
T1=0.56
OPT
f=25
TT=33.477
T1=14.68
OPT
f=25
TT=37.21
T1=16.37
OPT
f=25
TT=19.296
T1=10.55
OPT
f=25
TT=4.005
T1=0.35
OPT
f=25
TT=3.524
T1=0.46
OPT
f=25
TT=138.53
T1=138.61
OPT
f=25
TT=146.101
T1=146.09
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_8.opb
OPT
f=34
TT=5.91
T1=0.7
OPT
f=34
TT=13.825
T1=4.37
OPT
f=34
TT=5.91
T1=0.7
OPT
f=34
TT=894.519
T1=901.52
OPT
f=34
TT=34.03
T1=22.26
OPT
f=34
TT=582.624
T1=582.89
OPT
f=34
TT=29.518
T1=29.52
OPT
f=34
TT=342.197
T1=272.8
OPT
f=34
TT=21.351
T1=15.51
? (TO)

TT=1800.29

? (TO)

TT=1800.19

OPT
f=34
TT=11.268
T1=0.97
OPT
f=34
TT=22.926
T1=5.06
OPT
f=34
TT=7.486
T1=2.08
OPT
f=34
TT=10.186
T1=2.79
OPT
f=34
TT=10.912
T1=5.77
OPT
f=34
TT=9.984
T1=1.2
OPT
f=34
TT=14.583
T1=8.02
OPT
f=34
TT=994.92
T1=856.58
OPT
f=34
TT=1444.14
T1=451.63
OPT
f=34
TT=29.442
T1=14.41
OPT
f=34
TT=864.73
T1=625.91
OPT
f=34
TT=15.664
T1=8.02
OPT
f=34
TT=856.626
T1=766.16
OPT
f=34
TT=16.766
T1=16.77
OPT
f=34
TT=94.292
T1=55.8
OPT
f=34
TT=102.836
T1=66.42
OPT
f=34
TT=8.264
T1=4.13
OPT
f=34
TT=8.863
T1=4.44
OPT
f=34
TT=12.071
T1=5.44
OPT
f=34
TT=7.183
T1=3.97
SAT
f=34
TT=5.763
T1=1.62
OPT
f=34
TT=155.615
T1=152.92
OPT
f=34
TT=172.903
T1=169.87
OPT
f=34
TT=613.539
T1=311.35
OPT
f=34
TT=80.239
T1=14.8
OPT
f=34
TT=80.866
T1=14.89
OPT
f=34
TT=10.032
T1=10.05
OPT
f=34
TT=10.042
T1=10.04
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_9.opb
OPT
f=44
TT=43.227
T1=3.96
OPT
f=44
TT=278.323
T1=88.69
OPT
f=44
TT=108.305
T1=3.96
? (TO)

TT=1800.08

OPT
f=44
TT=566.614
T1=148.19
? (TO)

TT=1800.1

OPT
f=44
TT=507.559
T1=133.98
OPT
f=44
TT=1131.02
T1=502.9
OPT
f=44
TT=407.666
T1=298.35
? (TO)

TT=1800.06

? (TO)

TT=1800.02

OPT
f=44
TT=229.032
T1=72.88
OPT
f=44
TT=1087.42
T1=292.7
OPT
f=44
TT=83.722
T1=36.21
OPT
f=44
TT=109.169
T1=74.02
OPT
f=44
TT=86.53
T1=57.88
OPT
f=44
TT=195.456
T1=47.75
OPT
f=44
TT=119.61
T1=16.39
SAT (TO)
f=64
TT=1800.23
T1=941.69
? (TO)

TT=1800.25

OPT
f=44
TT=257.517
T1=83.5
SAT
f=56
TT=1789.84
T1=740.25
OPT
f=44
TT=128.974
T1=43.57
SAT
f=96
TT=1796.86
T1=701.83
OPT
f=44
TT=900.35
T1=900.51
OPT
f=44
TT=1089.25
T1=492.86
OPT
f=44
TT=1021.76
T1=724.91
OPT
f=44
TT=165.257
T1=82.64
OPT
f=44
TT=130.086
T1=65.06
OPT
f=44
TT=107.528
T1=26.12
OPT
f=44
TT=43.227
T1=19.95
SAT
f=47
TT=14.51
T1=13.53
SAT
f=68
TT=1796.94
T1=528.81
SAT
f=68
TT=1796.89
T1=550.25
SAT
f=47
TT=1796.89
T1=1129.52
OPT
f=44
TT=744.674
T1=66.1
OPT
f=44
TT=733.76
T1=67.51
?

TT=1799.6

?

TT=1799.96




Statisticsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
Number of times the solver is able to give the best known answer141711129121012510121421140140912101510121212012171901010101212011
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
211000000000007000000010000013800000002