PB'11 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Numerical Problems

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Numerical Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
borg pb-opt-11.04.03 (complete)
bsolo 3.2 (complete)
clasp 2.0-R4191 (complete)
MinisatID 2.4.8 [DEPRECATED] (complete)
MinisatID 2.4.8-gmp [DEPRECATED] (complete)
MinisatID 2.5.2 (fixed) (complete)
MinisatID 2.5.2-gmp (fixed) (complete)
pwbo 1.1 (complete)
Sat4j CuttingPlanes 2.3.0 (complete)
Sat4j Res//CP 2.3.0 (complete)
Sat4j Resolution 2.3.0 (complete)
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx 2 2011-06-10 (fixed) (complete)
SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx E_2 2011-06-10 (fixed) (complete)
wbo 1.6 (complete)

Bench nameBest results
on this
instance		borg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_10.opb 		OPT
f=55
TT=633.683
T1=121.22
 ? (MO)

TT=149.73

 SAT
f=55
TT=1798.01
T1=121.22
 OPT
f=55
TT=665.518
T1=529.11
 ? (TO)
f=60
TT=1800.09
T1=239.25
 ? (TO)
f=61
TT=1800.07
T1=872.66
 ? (TO)
f=55
TT=1800.05
T1=1800
 ? (TO)
f=60
TT=1800.09
T1=1800
 SAT (TO)
f=55
TT=1800.23
T1=439.26
 SAT (TO)
f=65
TT=1800.39
T1=740.86
 OPT
f=55
TT=1423.41
T1=396.56
 OPT
f=55
TT=633.683
T1=348.58
 SAT (TO)
f=78
TT=1800.08
T1=343.08
 SAT
f=77
TT=1797.33
T1=562.63
 SAT (TO)
f=78
TT=1800.08
T1=341
 SAT
f=77
TT=1797.3
T1=622.68
 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_11.opb 		SAT
f=74
TT=1800.07
T1=700
 ? (MO)

TT=146.59

 SAT
f=76
TT=1798.01
T1=1036.51
 SAT (TO)
f=74
TT=1800.07
T1=963.85
 ? (TO)
f=76
TT=1800.06
T1=1790.51
 ? (TO)
f=81
TT=1800.05
T1=1771.57
 ? (TO)
f=75
TT=1800.05
T1=1800
 ? (TO)
f=77
TT=1800.07
T1=1800
 SAT (TO)
f=76
TT=1800.21
T1=900.11
 SAT (TO)
f=94
TT=1800.37
T1=1373.21
 SAT (TO)
f=74
TT=1800.35
T1=800.98
 SAT (TO)
f=74
TT=1800.11
T1=700
 SAT (TO)
f=113
TT=1800.08
T1=885.16
 ?

TT=1797.47

 ? (TO)

TT=1800.05

 ?

TT=1797.5

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_12.opb 		SAT
f=93
TT=1800.2
T1=900.11
 ? (MO)

TT=95.77

 SAT
f=95
TT=1798.01
T1=838.8
 SAT (TO)
f=97
TT=1800.05
T1=87.8
 ? (TO)
f=99
TT=1800.07
T1=947.63
 ? (TO)
f=109
TT=1800.08
T1=683.38
 ? (TO)
f=98
TT=1800.06
T1=1800
 ? (TO)
f=106
TT=1800.08
T1=1800
 SAT (TO)
f=93
TT=1800.2
T1=900.11
 SAT (TO)
f=103
TT=1800.37
T1=917.62
 SAT (TO)
f=96
TT=1800.37
T1=708.45
 SAT (TO)
f=97
TT=1800.14
T1=1024.67
 ? (TO)

TT=1800.22

 ?

TT=1797.21

 ? (TO)

TT=1800.05

 ?

TT=1797.21

 ? (TO)

TT=1800.1
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_13.opb 		SAT
f=121
TT=1800.13
T1=834.18
 ? (MO)

TT=104.28

 SAT
f=125
TT=1798.03
T1=1725.56
 SAT (TO)
f=123
TT=1800.07
T1=542.14
 ? (TO)
f=127
TT=1800.09
T1=1200.59
 ? (TO)
f=138
TT=1800.07
T1=986.41
 ? (TO)
f=124
TT=1800.05
T1=1800
 ? (TO)
f=131
TT=1800.08
T1=1800
 SAT (TO)
f=131
TT=1800.19
T1=900.11
 SAT (TO)
f=155
TT=1800.4
T1=691.99
 SAT (TO)
f=125
TT=1800.31
T1=231.45
 SAT (TO)
f=121
TT=1800.13
T1=834.18
 ? (TO)

TT=1800.09

 ?

TT=1797.24

 ? (TO)

TT=1800.21

 ?

TT=1797.22

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_14.opb 		SAT
f=148
TT=1800.18
T1=373.91
 ? (MO)

TT=101.12

 SAT
f=159
TT=1798.02
T1=486.76
 SAT (TO)
f=151
TT=1800.05
T1=1152.04
 ? (TO)
f=155
TT=1800.06
T1=1250.51
 ? (TO)
f=171
TT=1800.04
T1=1243.89
 ? (TO)
f=157
TT=1800.04
T1=1800
 ? (TO)
f=183
TT=1800.05
T1=1800
 SAT (TO)
f=159
TT=1800.13
T1=900.11
 SAT (TO)
f=206
TT=1800.35
T1=664.26
 SAT (TO)
f=148
TT=1800.34
T1=431.47
 SAT (TO)
f=148
TT=1800.18
T1=373.91
 ? (TO)

TT=1800.07

 ?

TT=1797.16

 ? (TO)

TT=1800.09

 ?

TT=1797.15

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_15.opb 		SAT
f=174
TT=1800.19
T1=1438.22
 ? (MO)

TT=99.56

 SAT
f=178
TT=1798.02
T1=160.48
 SAT (TO)
f=190
TT=1800.11
T1=969.54
 ? (TO)
f=204
TT=1800.13
T1=1534.57
 ? (TO)

TT=1800.07

 ? (TO)
f=187
TT=1800.05
T1=1800
 ? (TO)
f=213
TT=1800.04
T1=1800
 SAT (TO)
f=204
TT=1800.1
T1=900.11
 SAT (TO)
f=213
TT=1800.37
T1=1678.9
 SAT (TO)
f=187
TT=1800.33
T1=242.16
 SAT (TO)
f=174
TT=1800.19
T1=1438.22
 ? (TO)

TT=1800.07

 ?

TT=1797.19

 ? (TO)

TT=1800.18

 ?

TT=1797.21

 ? (TO)

TT=1800.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_16.opb 		SAT
f=217
TT=1800.16
T1=1670.32
 ? (MO)

TT=98.71

 SAT
f=220
TT=1798.02
T1=1470.2
 SAT (TO)
f=223
TT=1800.07
T1=1195.94
 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.07

 ? (TO)
f=235
TT=1800.05
T1=1800
 ? (TO)

TT=1800.07

 SAT (TO)
f=249
TT=1800.04
T1=900.11
 ? (TO)

TT=1800.24

 SAT (TO)
f=229
TT=1800.41
T1=252.1
 SAT (TO)
f=217
TT=1800.16
T1=1670.32
 ? (TO)

TT=1800.08

 ?

TT=1797.2

 ? (TO)

TT=1800.07

 ?

TT=1797.36

 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_17.opb 		SAT
f=263
TT=1800.19
T1=1039.72
 ? (MO)

TT=102.01

 SAT
f=269
TT=1798.03
T1=574.68
 SAT (TO)
f=344
TT=1800.11
T1=915.46
 ? (TO)
f=287
TT=1800.04
T1=1341.62
 ? (TO)

TT=1800.06

 ? (TO)
f=287
TT=1800.06
T1=1800
 ? (TO)

TT=1800.07

 SAT (TO)
f=265
TT=1800.15
T1=900.21
 ? (TO)

TT=1800.31

 SAT (TO)
f=280
TT=1800.46
T1=640.12
 SAT (TO)
f=263
TT=1800.19
T1=1039.72
 ? (TO)

TT=1800.2

 ?

TT=1797.24

 ? (TO)

TT=1800.34

 ?

TT=1797.19

 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_18.opb 		SAT
f=305
TT=1800.22
T1=604.83
 ? (MO)

TT=102.12

 SAT
f=316
TT=1798.03
T1=1234.66
 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.04

 ? (TO)
f=322
TT=1800.06
T1=1800
 ? (TO)

TT=1800.07

 SAT (TO)
f=322
TT=1800.08
T1=900.21
 ? (TO)

TT=1800.27

 SAT (TO)
f=305
TT=1800.48
T1=817.69
 SAT (TO)
f=305
TT=1800.22
T1=604.83
 ? (TO)

TT=1800.07

 ?

TT=1797.44

 ? (TO)

TT=1800.07

 ?

TT=1797.21

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_19.opb 		SAT
f=341
TT=1800.23
T1=1580.93
 ? (MO)

TT=103.23

 ? (TO)

TT=1800.08

 SAT (TO)
f=357
TT=1800.05
T1=903.97
 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.06

 SAT (TO)
f=354
TT=1800.22
T1=900.41
 ? (TO)

TT=1800.33

 SAT (TO)
f=345
TT=1800.64
T1=570.83
 SAT (TO)
f=341
TT=1800.23
T1=1580.93
 ? (TO)

TT=1800.27

 ?

TT=1797.22

 ? (TO)

TT=1800.5

 ?

TT=1797.26

 ? (TO)

TT=1800.05
Bench nameBest resultsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_20.opb 		SAT
f=398
TT=1798.04
T1=721.53
 ? (MO)

TT=98.87

 SAT
f=398
TT=1798.04
T1=721.53
 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.29

 ? (TO)

TT=1800.25

 ? (TO)

TT=1800.17

 ? (TO)

TT=1800.5

 ?

TT=1797.23

 ? (TO)

TT=1800.44

 ?

TT=1797.21

 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_4.opb 		OPT
f=6
TT=0.001
T1=0
 OPT
f=6
TT=0.541
T1=0.75
 OPT
f=6
TT=0.002
T1=0
 OPT
f=6
TT=0.001
T1=0
 OPT
f=6
TT=0.004
T1=0
 OPT
f=6
TT=0.022
T1=0.02
 OPT
f=6
TT=0.005
T1=0
 OPT
f=6
TT=0.021
T1=0.02
 OPT
f=6
TT=0.002
T1=0
 OPT
f=6
TT=0.195
T1=0.17
 OPT
f=6
TT=0.189
T1=0.65
 OPT
f=6
TT=0.18
T1=0.15
 OPT
f=6
TT=0.032
T1=0.02
 OPT
f=6
TT=0.032
T1=0.02
 OPT
f=6
TT=0.037
T1=0.02
 OPT
f=6
TT=0.036
T1=0.02
 SAT
f=6
TT=0.001
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_5.opb 		OPT
f=11
TT=0.003
T1=0
 OPT
f=11
TT=0.468
T1=0.62
 OPT
f=11
TT=0.014
T1=0.01
 OPT
f=11
TT=0.003
T1=0
 OPT
f=11
TT=0.015
T1=0.01
 OPT
f=11
TT=0.102
T1=0.09
 OPT
f=11
TT=0.015
T1=0.01
 OPT
f=11
TT=0.1
T1=0.1
 OPT
f=11
TT=0.005
T1=0
 OPT
f=11
TT=0.477
T1=0.26
 OPT
f=11
TT=0.529
T1=0.69
 OPT
f=11
TT=0.267
T1=0.19
 OPT
f=11
TT=0.407
T1=0.38
 OPT
f=11
TT=0.411
T1=0.38
 OPT
f=11
TT=0.371
T1=0.34
 OPT
f=11
TT=0.413
T1=0.38
 OPT
f=11
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_6.opb 		OPT
f=17
TT=0.011
T1=0.01
 OPT
f=17
TT=0.527
T1=0.74
 OPT
f=17
TT=0.045
T1=0.02
 OPT
f=17
TT=0.011
T1=0.01
 OPT
f=17
TT=0.14
T1=0.04
 OPT
f=17
TT=1.327
T1=0.31
 OPT
f=17
TT=0.091
T1=0.09
 OPT
f=17
TT=0.724
T1=0.72
 OPT
f=17
TT=0.037
T1=0.02
 OPT
f=17
TT=1.351
T1=0.6
 OPT
f=17
TT=1.583
T1=1.25
 OPT
f=17
TT=0.621
T1=0.33
 OPT
f=17
TT=2.249
T1=1.55
 OPT
f=17
TT=2.304
T1=1.59
 OPT
f=17
TT=2.248
T1=1.55
 OPT
f=17
TT=2.3
T1=1.59
 OPT
f=17
TT=0.033
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_7.opb 		OPT
f=25
TT=0.178
T1=0.16
 OPT
f=25
TT=0.699
T1=0.9
 OPT
f=25
TT=0.629
T1=0.16
 OPT
f=25
TT=0.178
T1=0.17
 OPT
f=25
TT=3.006
T1=0.32
 OPT
f=25
TT=30.266
T1=2.99
 OPT
f=25
TT=0.935
T1=0.93
 OPT
f=25
TT=7.347
T1=7.34
 OPT
f=25
TT=0.559
T1=0.28
 OPT
f=25
TT=7.653
T1=5.96
 OPT
f=25
TT=2.616
T1=1.81
 OPT
f=25
TT=1.28
T1=0.43
 OPT
f=25
TT=16.881
T1=16.47
 OPT
f=25
TT=17.111
T1=16.7
 OPT
f=25
TT=16.883
T1=16.47
 OPT
f=25
TT=18.136
T1=17.69
 OPT
f=25
TT=0.716
T1=0.72
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_8.opb 		OPT
f=34
TT=2.289
T1=1.2
 OPT
f=34
TT=2.877
T1=3.11
 OPT
f=34
TT=11.169
T1=1.57
 OPT
f=34
TT=2.289
T1=1.2
 OPT
f=34
TT=106.223
T1=2.65
 OPT
f=34
TT=1144.09
T1=26.85
 OPT
f=34
TT=12.172
T1=12.17
 OPT
f=34
TT=108.365
T1=108.36
 OPT
f=34
TT=11.292
T1=5.65
 OPT
f=34
TT=360.22
T1=154.68
 OPT
f=34
TT=12.922
T1=6.93
 OPT
f=34
TT=6.486
T1=3.27
 OPT
f=34
TT=278.177
T1=229.98
 OPT
f=34
TT=257.846
T1=103.53
 OPT
f=34
TT=245.928
T1=114.09
 OPT
f=34
TT=258.407
T1=104.08
 OPT
f=34
TT=12.599
T1=12.59
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_9.opb 		OPT
f=44
TT=46.199
T1=22.16
 OPT
f=44
TT=32.686
T1=32.62
 OPT
f=44
TT=256.748
T1=154.42
 OPT
f=44
TT=46.199
T1=46.19
 ? (TO)
f=44
TT=1800.08
T1=111.55
 ? (TO)
f=44
TT=1800.07
T1=1106.03
 OPT
f=44
TT=298.358
T1=298.35
 ? (TO)
f=44
TT=1800.05
T1=1800
 Signal

TT=6.014

 SAT (TO)
f=45
TT=1800.28
T1=218.15
 OPT
f=44
TT=134.657
T1=40.22
 OPT
f=44
TT=49.984
T1=22.16
 SAT (TO)
f=49
TT=1800.08
T1=466.06
 SAT
f=52
TT=1797.29
T1=1276.55
 SAT (TO)
f=48
TT=1800.07
T1=664.57
 SAT
f=52
TT=1797.31
T1=1280.47
 OPT
f=44
TT=176.947
T1=176.95
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_10.opb 		OPT
f=55
TT=513.807
T1=29.81
 ? (MO)

TT=285.93

 SAT
f=55
TT=1798.01
T1=1389.78
 OPT
f=55
TT=513.807
T1=29.81
 ? (TO)
f=55
TT=1800.07
T1=448.58
 ? (TO)
f=60
TT=1800.05
T1=485.68
 ? (TO)
f=55
TT=1800.05
T1=1800
 ? (TO)
f=62
TT=1800.07
T1=1800
 Signal

TT=57.584

 SAT (TO)
f=65
TT=1800.34
T1=1451.81
 OPT
f=55
TT=1505.02
T1=429.12
 OPT
f=55
TT=633.15
T1=230.28
 SAT (TO)
f=94
TT=1800.11
T1=171.85
 ?

TT=1797.37

 SAT (TO)
f=94
TT=1800.04
T1=158.35
 ?

TT=1797.35

 ? (TO)

TT=1800.11
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_11.opb 		SAT
f=74
TT=1800.06
T1=394.28
 ? (MO)

TT=288.85

 SAT
f=76
TT=1798.01
T1=1107.86
 SAT (TO)
f=74
TT=1800.06
T1=394.28
 ? (TO)
f=77
TT=1800.07
T1=1743.65
 ? (TO)
f=80
TT=1800.07
T1=653.04
 ? (TO)
f=74
TT=1800.06
T1=1800
 ? (TO)
f=80
TT=1800.06
T1=1800
 SAT (TO)
f=75
TT=1800.07
T1=900.01
 SAT (TO)
f=89
TT=1800.27
T1=1043.38
 SAT (TO)
f=76
TT=1800.41
T1=425.36
 SAT (TO)
f=74
TT=1800.07
T1=1269.69
 ? (TO)

TT=1800.07

 ?

TT=1797.17

 ? (TO)

TT=1800.09

 ?

TT=1797.17

 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_12.opb 		SAT
f=91
TT=1800.14
T1=1154.85
 ? (MO)

TT=97.05

 SAT
f=96
TT=1798.02
T1=480.47
 SAT (TO)
f=96
TT=1800.07
T1=1461.94
 ? (TO)
f=102
TT=1800.08
T1=1148.85
 ? (TO)
f=110
TT=1800.06
T1=1623.67
 ? (TO)
f=97
TT=1800.06
T1=1800
 ? (TO)
f=104
TT=1800.06
T1=1800
 SAT (TO)
f=94
TT=1800.1
T1=900.31
 SAT (TO)
f=108
TT=1800.27
T1=972.13
 SAT (TO)
f=97
TT=1800.46
T1=261.82
 SAT (TO)
f=91
TT=1800.14
T1=1154.85
 ? (TO)

TT=1800.07

 ?

TT=1797.19

 ?

TT=1799.64

 ?

TT=1797.16

 ? (TO)

TT=1800.09
Bench nameBest resultsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_13.opb 		SAT
f=122
TT=1798.02
T1=999.63
 ? (MO)

TT=95.4

 SAT
f=122
TT=1798.02
T1=1426.42
 SAT (TO)
f=127
TT=1800.07
T1=1333.76
 ? (TO)
f=128
TT=1800.07
T1=1422.23
 ? (TO)
f=134
TT=1800.09
T1=1678.24
 ? (TO)
f=124
TT=1800.09
T1=1800
 ? (TO)
f=136
TT=1800.08
T1=1800
 SAT (TO)
f=125
TT=1800.22
T1=690.17
 SAT (TO)
f=130
TT=1800.35
T1=504.07
 SAT (TO)
f=123
TT=1800.4
T1=823.95
 SAT (TO)
f=122
TT=1800.14
T1=999.63
 ? (TO)

TT=1800.07

 ?

TT=1797.2

 ? (TO)

TT=1800.05

 ?

TT=1797.17

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_14.opb 		SAT
f=151
TT=1800.12
T1=88.39
 ? (MO)

TT=99.66

 SAT
f=155
TT=1798.02
T1=1366.02
 SAT (TO)
f=157
TT=1800.05
T1=1436.54
 ? (TO)
f=161
TT=1800.08
T1=1711.18
 ? (TO)
f=186
TT=1800.05
T1=1351.54
 ? (TO)
f=156
TT=1800.05
T1=1800
 ? (TO)
f=163
TT=1800.09
T1=1800
 SAT (TO)
f=168
TT=1800.16
T1=900.11
 SAT (TO)
f=189
TT=1800.34
T1=1512.69
 SAT (TO)
f=151
TT=1800.4
T1=94.27
 SAT (TO)
f=151
TT=1800.12
T1=88.39
 ? (TO)

TT=1800.07

 ?

TT=1797.18

 ? (TO)

TT=1800.08

 ?

TT=1797.18

 ? (TO)

TT=1800.12
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_15.opb 		SAT
f=185
TT=1800.12
T1=1170.45
 ? (MO)

TT=96.77

 SAT
f=199
TT=1798.02
T1=1566.87
 SAT (TO)
f=197
TT=1800.04
T1=989.09
 ? (TO)
f=191
TT=1800.07
T1=1667.94
 ? (TO)

TT=1800.07

 ? (TO)
f=196
TT=1800.05
T1=1800
 ? (TO)
f=221
TT=1800.06
T1=1800
 SAT (TO)
f=195
TT=1800.12
T1=900.11
 ? (TO)

TT=1800.27

 SAT (TO)
f=187
TT=1800.45
T1=436.92
 SAT (TO)
f=185
TT=1800.12
T1=1170.45
 ? (TO)

TT=1800.07

 ?

TT=1797.15

 ? (TO)

TT=1800.13

 ?

TT=1797.11

 ? (TO)

TT=1800.13
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_16.opb 		SAT
f=221
TT=1798.02
T1=1648.68
 ? (MO)

TT=240.45

 SAT
f=221
TT=1798.02
T1=1648.68
 SAT (TO)
f=231
TT=1800.07
T1=592.63
 ? (TO)
f=244
TT=1800.07
T1=964.05
 ? (TO)

TT=1800.05

 ? (TO)
f=236
TT=1800.06
T1=1800
 ? (TO)
f=246
TT=1800.05
T1=1800
 Signal

TT=1130.26

 ? (TO)

TT=1800.25

 SAT (TO)
f=233
TT=1800.56
T1=814.99
 SAT (TO)
f=231
TT=1800.17
T1=1253.25
 ? (TO)

TT=1800.06

 ?

TT=1797.18

 ? (TO)

TT=1800.15

 ?

TT=1797.17

 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_17.opb 		SAT
f=263
TT=1800.22
T1=1322.04
 ? (MO)

TT=147.1

 SAT
f=278
TT=1798.03
T1=68
 SAT (TO)
f=275
TT=1800.08
T1=739.04
 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.08

 SAT (TO)
f=288
TT=1800.12
T1=900.21
 ? (TO)

TT=1800.31

 SAT (TO)
f=281
TT=1800.47
T1=601.47
 SAT (TO)
f=263
TT=1800.22
T1=1322.04
 ? (TO)

TT=1800.07

 ?

TT=1797.19

 ? (TO)

TT=1800.09

 ?

TT=1797.2

 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_18.opb 		SAT
f=310
TT=1800.22
T1=1116.12
 ? (MO)

TT=101.81

 SAT
f=321
TT=1798.03
T1=90.64
 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.12

 ? (TO)
f=306
TT=1800.06
T1=1800
 ? (TO)

TT=1800.05

 SAT (TO)
f=322
TT=1800.23
T1=676.67
 ? (TO)

TT=1800.33

 SAT (TO)
f=314
TT=1800.67
T1=281.9
 SAT (TO)
f=310
TT=1800.22
T1=1116.12
 ? (TO)

TT=1800.25

 ?

TT=1797.25

 ? (TO)

TT=1800.12

 ?

TT=1797.18

 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_19.opb



? (MO)

TT=104.31

 ?

TT=1798.03

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.17

 ? (TO)

TT=1800.28

 ? (TO)

TT=1800.29

 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.26

 ?

TT=1797.21

 ? (TO)

TT=1800.23

 ?

TT=1797.54

 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_20.opb



? (MO)

TT=106.46

 ?

TT=1798.03

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.2

 ? (TO)

TT=1800.35

 ? (TO)

TT=1800.42

 ? (TO)

TT=1800.18

 ? (TO)

TT=1800.37

 ?

TT=1797.26

 ? (TO)

TT=1800.08

 ?

TT=1797.36

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_4.opb 		OPT
f=6
TT=0.002
T1=0
 OPT
f=6
TT=0.648
T1=0.9
 OPT
f=6
TT=0.003
T1=0
 OPT
f=6
TT=0.002
T1=0
 OPT
f=6
TT=0.006
T1=0
 OPT
f=6
TT=0.038
T1=0.03
 OPT
f=6
TT=0.006
T1=0
 OPT
f=6
TT=0.038
T1=0.03
 OPT
f=6
TT=0.006
T1=0
 OPT
f=6
TT=0.237
T1=0.17
 OPT
f=6
TT=0.271
T1=1.15
 OPT
f=6
TT=0.194
T1=0.16
 OPT
f=6
TT=0.144
T1=0.13
 OPT
f=6
TT=0.144
T1=0.13
 OPT
f=6
TT=0.149
T1=0.14
 OPT
f=6
TT=0.165
T1=0.15
 OPT
f=6
TT=0.002
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_5.opb 		OPT
f=11
TT=0.004
T1=0
 OPT
f=11
TT=0.456
T1=0.98
 OPT
f=11
TT=0.011
T1=0
 OPT
f=11
TT=0.004
T1=0
 OPT
f=11
TT=0.02
T1=0.01
 OPT
f=11
TT=0.166
T1=0.13
 OPT
f=11
TT=0.02
T1=0.01
 OPT
f=11
TT=0.117
T1=0.11
 OPT
f=11
TT=0.011
T1=0
 OPT
f=11
TT=0.606
T1=0.29
 OPT
f=11
TT=0.681
T1=1.2
 OPT
f=11
TT=0.32
T1=0.22
 OPT
f=11
TT=0.535
T1=0.49
 OPT
f=11
TT=0.603
T1=0.54
 OPT
f=11
TT=0.538
T1=0.48
 OPT
f=11
TT=0.546
T1=0.49
 OPT
f=11
TT=0.011
T1=0.01
Bench nameBest resultsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_6.opb 		OPT
f=17
TT=0.02
T1=0.01
 OPT
f=17
TT=0.496
T1=0.54
 OPT
f=17
TT=0.076
T1=0.02
 OPT
f=17
TT=0.02
T1=0.01
 OPT
f=17
TT=0.363
T1=0.14
 OPT
f=17
TT=3.927
T1=1.48
 OPT
f=17
TT=0.101
T1=0.1
 OPT
f=17
TT=0.715
T1=0.71
 OPT
f=17
TT=0.068
T1=0.03
 OPT
f=17
TT=2.436
T1=0.95
 OPT
f=17
TT=1.138
T1=2.27
 OPT
f=17
TT=0.797
T1=0.38
 OPT
f=17
TT=1.875
T1=1.26
 OPT
f=17
TT=1.902
T1=1.28
 OPT
f=17
TT=1.875
T1=1.26
 OPT
f=17
TT=1.908
T1=1.28
 OPT
f=17
TT=0.066
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_7.opb 		OPT
f=25
TT=0.254
T1=0.06
 OPT
f=25
TT=0.848
T1=1.01
 OPT
f=25
TT=0.786
T1=0.19
 OPT
f=25
TT=0.254
T1=0.06
 OPT
f=25
TT=7.959
T1=0.74
 OPT
f=25
TT=78.034
T1=7.09
 OPT
f=25
TT=0.966
T1=0.96
 OPT
f=25
TT=7.26
T1=7.25
 OPT
f=25
TT=0.716
T1=0.08
 OPT
f=25
TT=8.342
T1=1.83
 OPT
f=25
TT=3.82
T1=2.31
 OPT
f=25
TT=1.644
T1=0.59
 OPT
f=25
TT=37.848
T1=29.98
 OPT
f=25
TT=32.856
T1=16.29
 OPT
f=25
TT=41.269
T1=32.6
 OPT
f=25
TT=36.755
T1=18.17
 OPT
f=25
TT=43.645
T1=43.64
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_8.opb 		OPT
f=34
TT=4.156
T1=3.24
 OPT
f=34
TT=4.843
T1=4.89
 OPT
f=34
TT=13.378
T1=4.35
 OPT
f=34
TT=4.156
T1=4.15
 OPT
f=34
TT=169.86
T1=22.85
 OPT
f=34
TT=1697.4
T1=226.35
 OPT
f=34
TT=20.194
T1=20.19
 OPT
f=34
TT=171.021
T1=171.01
 OPT
f=34
TT=8.424
T1=3.24
 OPT
f=34
TT=237.365
T1=76.82
 OPT
f=34
TT=17.349
T1=8.94
 OPT
f=34
TT=7.22
T1=4.35
 OPT
f=34
TT=1126.36
T1=936.41
 OPT
f=34
TT=1006.86
T1=820.61
 OPT
f=34
TT=973.374
T1=964.07
 OPT
f=34
TT=898.988
T1=803.23
 OPT
f=34
TT=10.615
T1=10.61
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_9.opb 		OPT
f=44
TT=53.794
T1=19.68
 ? (MO)

TT=149.02

 OPT
f=44
TT=262.339
T1=86.93
 OPT
f=44
TT=53.794
T1=37.4
 ? (TO)
f=44
TT=1800.11
T1=98.04
 ? (TO)
f=44
TT=1800.1
T1=949.57
 OPT
f=44
TT=612.771
T1=612.74
 ? (TO)
f=45
TT=1800.05
T1=1800
 OPT
f=44
TT=153.868
T1=19.87
 SAT (TO)
f=46
TT=1800.28
T1=727.96
 OPT
f=44
TT=111.848
T1=19.68
 OPT
f=44
TT=62.721
T1=28
 SAT (TO)
f=96
TT=1800.04
T1=725.88
 SAT
f=96
TT=1797.23
T1=682.98
 SAT (TO)
f=96
TT=1800.08
T1=731.34
 SAT
f=96
TT=1797.25
T1=752.21
 ? (TO)

TT=1800.12



Statisticsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
Number of times the solver is able to give the best known answer015161010121012101829101001010
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)		031500001041500002