PB'11 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory MPS to OPB

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory MPS to OPB

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
borg pb-opt-11.04.03 (complete)
bsolo 3.2 (complete)
clasp 2.0-R4191 (complete)
MinisatID 2.4.8 [DEPRECATED] (complete)
MinisatID 2.4.8-gmp [DEPRECATED] (complete)
MinisatID 2.5.2 (fixed) (complete)
MinisatID 2.5.2-gmp (fixed) (complete)
pwbo 1.1 (complete)
Sat4j CuttingPlanes 2.3.0 (complete)
Sat4j Res//CP 2.3.0 (complete)
Sat4j Resolution 2.3.0 (complete)
SCIP spx SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx 2 2011-06-10 (fixed) (complete)
SCIP spx E SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED] (complete)
SCIP spx E_2 2011-06-10 (fixed) (complete)
wbo 1.6 (complete)

Bench nameBest results
on this
instance		borg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-10teams.opb 		OPT
f=904
TT=8.879
T1=8.86
 OPT
f=904
TT=19.498
T1=32.66
 SAT
f=920
TT=1798.02
T1=1707.96
 SAT (TO)
f=914
TT=1800.07
T1=18.82
 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.04

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.05

 SAT (TO)
f=922
TT=1800.07
T1=43.48
 SAT (TO)
f=926
TT=1800.37
T1=117.62
 SAT (TO)
f=916
TT=1800.29
T1=112.98
 SAT (TO)
f=910
TT=1800.17
T1=886.49
 OPT
f=904
TT=8.879
T1=8.86
 OPT
f=904
TT=8.998
T1=8.98
 OPT
f=904
TT=8.844
T1=8.82
 OPT
f=904
TT=9.03
T1=9.01
 ? (TO)

TT=1800.13
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-fast0507.opb 		OPT
f=174
TT=1794.28
T1=929.66
 ? (TO)

TT=1800.07

 SAT
f=215
TT=1798.02
T1=1598.21
 SAT (TO)
f=254
TT=1800.08
T1=0.14
 ? (TO)
f=345
TT=1800.08
T1=1800.01
 ? (TO)
f=347
TT=1800.08
T1=1800.01
 ? (TO)
f=344
TT=1800.09
T1=1800
 ? (TO)
f=345
TT=1800.09
T1=1800
 SAT (TO)
f=307
TT=1800.43
T1=1.36
 SAT (TO)
f=258
TT=1800.26
T1=1035.77
 SAT (TO)
f=253
TT=1800.46
T1=164.34
 SAT (TO)
f=253
TT=1800.21
T1=6.93
 ? (TO)

TT=1800.1

 SAT
f=174
TT=1797.36
T1=929.66
 ? (TO)

TT=1800.1

 OPT
f=174
TT=1794.28
T1=1114.27
 ? (TO)

TT=1800.25
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-manna81.opb 		OPT
f=-13164
TT=100.978
T1=100.88
 Wrong Opt.
f=-13157
TT=120.573
T1=149.58
 SAT
f=-11464
TT=1798.05
T1=640.69
 SAT (TO)
f=-11167
TT=1800.09
T1=0.14
 ? (TO)
f=-10627
TT=1800.09
T1=1800.01
 ? (TO)
f=-7466
TT=1800.13
T1=1800.12
 ? (TO)
f=-1606
TT=1800.08
T1=1800
 ? (TO)
f=-1203
TT=1800.08
T1=1800
 SAT (TO)
f=-735
TT=1800.5
T1=898.89
 SAT (TO)
f=-11504
TT=1800.35
T1=869.38
 SAT (TO)
f=-11530
TT=1800.53
T1=35.01
 SAT (TO)
f=-11530
TT=1800.29
T1=24.79
 OPT
f=-13164
TT=104.861
T1=104.77
 OPT
f=-13164
TT=109.502
T1=109.4
 OPT
f=-13164
TT=136.503
T1=136.38
 OPT
f=-13164
TT=100.978
T1=100.88
 ? (TO)

TT=1800.4
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mzzv11.opb 		OPT
f=-10859
TT=816.194
T1=635.3
 ? (MO)

TT=391.06

 SAT
f=-8906
TT=1798.03
T1=1748.91
 OPT
f=-10859
TT=1075.05
T1=1073.72
 ? (TO)
f=-5338
TT=1800.08
T1=1800.02
 ? (TO)
f=-5265
TT=1800.05
T1=1800.01
 ? (TO)
f=-6800
TT=1800.08
T1=1800
 ? (TO)
f=-6800
TT=1800.07
T1=1800
 SAT (TO)
f=-8234
TT=1800.14
T1=900.11
 SAT (TO)
f=-9089
TT=1800.5
T1=571.73
 SAT (TO)
f=-10405
TT=1800.38
T1=462.59
 OPT
f=-10859
TT=971.144
T1=967.52
 OPT
f=-10859
TT=862.831
T1=660.3
 OPT
f=-10859
TT=816.511
T1=635.65
 OPT
f=-10859
TT=865.056
T1=662.28
 OPT
f=-10859
TT=816.194
T1=635.3
 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mzzv42z.opb 		OPT
f=-10270
TT=72.894
T1=48.89
 ? (MO)

TT=341.79

 SAT
f=-9476
TT=1798.02
T1=1760.97
 OPT
f=-10270
TT=160.386
T1=152.32
 ? (TO)
f=-8993
TT=1800.07
T1=1800.02
 ? (TO)
f=-8993
TT=1800.11
T1=1800.01
 ? (TO)
f=-10112
TT=1800.06
T1=1800
 ? (TO)
f=-10076
TT=1800.06
T1=1800
 SAT (TO)
f=-9300
TT=1800.12
T1=900.11
 SAT (TO)
f=-9805
TT=1800.38
T1=586.27
 OPT
f=-10270
TT=156.497
T1=72.47
 OPT
f=-10270
TT=72.894
T1=48.89
 OPT
f=-10270
TT=159.555
T1=159.42
 OPT
f=-10270
TT=254.289
T1=254.16
 OPT
f=-10270
TT=159.23
T1=159.1
 OPT
f=-10270
TT=254.013
T1=253.88
 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-net12.opb 		OPT
f=214
TT=6.229
T1=2.08
 OPT
f=214
TT=16.503
T1=34.97
 OPT
f=214
TT=6.48
T1=2.08
 OPT
f=214
TT=10.786
T1=9
 ? (TO)
f=337
TT=1800.11
T1=1800.02
 ? (TO)
f=337
TT=1800.12
T1=1800.01
 OPT
f=214
TT=180.245
T1=180.19
 OPT
f=214
TT=719.975
T1=719.91
 OPT
f=214
TT=11.033
T1=3.79
 SAT (TO)
f=214
TT=1800.47
T1=522.2
 OPT
f=214
TT=10.727
T1=4.8
 OPT
f=214
TT=6.229
T1=3.92
 ? (TO)

TT=1800.52

 ?

TT=1797.49

 ? (TO)

TT=1800.53

 ?

TT=1797.46

 ? (TO)

TT=1800.12
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-opt1217.opb 		SAT
f=-16384
TT=1800.08
T1=0.05
 ? (MO)

TT=204.23

 SAT
f=-14335
TT=1798.01
T1=0.55
 SAT (TO)
f=-6144
TT=1800.08
T1=746.34
 ? (TO)
f=-16383
TT=1800.07
T1=1800.01
 ? (TO)
f=-16383
TT=1800.11
T1=1800.11
 ? (TO)
f=-15359
TT=1800.07
T1=1800
 ? (TO)
f=-14335
TT=1800.06
T1=1800
 SAT (TO)
f=-16384
TT=1800.08
T1=43.51
 SAT (TO)
f=-16384
TT=1800.22
T1=1481.64
 SAT (TO)
f=-12288
TT=1800.25
T1=919.07
 ? (TO)

TT=1800.1

 SAT (TO)
f=-16384
TT=1800.18
T1=0.05
 SAT (TO)
f=-16384
TT=1800.16
T1=0.05
 SAT (TO)
f=-16384
TT=1800.18
T1=0.06
 SAT (TO)
f=-16384
TT=1800.11
T1=0.05
 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-p2756.opb 		OPT
f=3124
TT=1.777
T1=1.76
 OPT
f=3124
TT=3.231
T1=16.4
 SAT
f=3694
TT=1798.04
T1=434.8
 SAT (TO)
f=4170
TT=1800.08
T1=141.23
 ? (TO)
f=3458
TT=1800.05
T1=1800.01
 ? (TO)
f=3721
TT=1800.06
T1=1800.02
 ? (TO)
f=3509
TT=1800.04
T1=1800
 ? (TO)
f=4979
TT=1800.04
T1=1800
 SAT (TO)
f=3952
TT=1800.22
T1=723.09
 SAT (TO)
f=3695
TT=1800.25
T1=386.39
 SAT (TO)
f=3638
TT=1800.29
T1=832.74
 SAT (TO)
f=4020
TT=1800.18
T1=1189.99
 OPT
f=3124
TT=1.787
T1=1.77
 OPT
f=3124
TT=1.788
T1=1.77
 OPT
f=3124
TT=1.781
T1=1.76
 OPT
f=3124
TT=1.777
T1=1.76
 ? (TO)

TT=1800.1
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-protfold.opb 		SAT
f=-26
TT=1800.08
T1=577.5
 ? (MO)

TT=668.24

 SAT
f=-23
TT=1798.05
T1=1136.31
 SAT (TO)
f=-26
TT=1800.08
T1=577.5
 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.05

 ? (TO)
f=-19
TT=1800.06
T1=1800
 ? (TO)
f=-19
TT=1800.04
T1=1800
 SAT (TO)
f=-19
TT=1800.08
T1=900.01
 SAT (TO)
f=-22
TT=1800.32
T1=1339.11
 SAT (TO)
f=-25
TT=1800.4
T1=754.01
 SAT (TO)
f=-26
TT=1800.17
T1=977
 ? (TO)

TT=1800.08

 ?

TT=1797.08

 ? (TO)

TT=1800.07

 ?

TT=1797.17

 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-seymour.opb 		SAT
f=425
TT=1797.08
T1=1180.63
 ? (MO)

TT=197.81

 SAT
f=461
TT=1798.14
T1=31.13
 SAT (TO)
f=491
TT=1800.07
T1=0.01
 ? (TO)
f=466
TT=1800.08
T1=1800.02
 ? (TO)
f=466
TT=1800.06
T1=1800.01
 ? (TO)
f=466
TT=1800.06
T1=1800
 ? (TO)
f=466
TT=1800.09
T1=1800
 SAT (TO)
f=465
TT=1800.26
T1=0.4
 SAT (TO)
f=480
TT=1800.32
T1=1153.62
 SAT (TO)
f=481
TT=1800.32
T1=924.97
 SAT (TO)
f=489
TT=1800.15
T1=115.21
 SAT (TO)
f=425
TT=1800.09
T1=1180.63
 SAT
f=425
TT=1797.08
T1=1298.65
 SAT (TO)
f=425
TT=1800.05
T1=1543.27
 SAT
f=425
TT=1797.08
T1=1551.19
 ? (TO)

TT=1800.1
Bench nameBest resultsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-mitre.opb 		OPT
f=7677
TT=8.158
T1=8.11
 OPT
f=7677
TT=6.613
T1=20.17
 SAT
f=8863
TT=1798.06
T1=13.42
 SAT (TO)
f=8621
TT=1800.08
T1=4.66
 ? (TO)
f=9333
TT=1800.08
T1=1800.02
 ? (TO)
f=9382
TT=1800.07
T1=1800.01
 ? (TO)
f=9329
TT=1800.09
T1=1800
 ? (TO)
f=9329
TT=1800.07
T1=1800
 SAT (TO)
f=9209
TT=1800.41
T1=27.01
 SAT (TO)
f=7726
TT=1800.31
T1=10.79
 SAT (TO)
f=7726
TT=1800.4
T1=12.15
 SAT (TO)
f=8060
TT=1800.23
T1=16.95
 OPT
f=7677
TT=8.158
T1=8.11
 OPT
f=7677
TT=8.866
T1=8.81
 OPT
f=7677
TT=8.107
T1=8.06
 OPT
f=7677
TT=8.856
T1=8.8
 ? (TO)

TT=1800.29
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-bm23.opb 		OPT
f=34
TT=0.035
T1=0.03
 OPT
f=34
TT=0.817
T1=33.73
 OPT
f=34
TT=0.288
T1=0.2
 OPT
f=34
TT=0.035
T1=0.03
 OPT
f=34
TT=0.22
T1=0.05
 OPT
f=34
TT=1.401
T1=0.33
 OPT
f=34
TT=0.358
T1=0.35
 OPT
f=34
TT=1.506
T1=1.5
 OPT
f=34
TT=0.484
T1=0.24
 OPT
f=34
TT=2.044
T1=0.78
 OPT
f=34
TT=0.957
T1=1.65
 OPT
f=34
TT=0.635
T1=0.24
 OPT
f=34
TT=0.167
T1=0.12
 OPT
f=34
TT=0.166
T1=0.12
 OPT
f=34
TT=0.162
T1=0.11
 OPT
f=34
TT=0.176
T1=0.12
 ? (TO)

TT=1800.06
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-cracpb1.opb 		OPT
f=22199
TT=0.339
T1=0.33
 OPT
f=22199
TT=1.102
T1=35.4
 SAT
f=56943
TT=1798.02
T1=390.32
 SAT (TO)
f=39983
TT=1800.1
T1=458.56
 ? (TO)
f=62077
TT=1800.09
T1=1800.11
 ? (TO)
f=91903
TT=1800.08
T1=1800.01
 ? (TO)
f=60062
TT=1800.06
T1=1800
 ? (TO)
f=73221
TT=1800.05
T1=1800
 SAT (TO)
f=107820
TT=1800.23
T1=301.23
 SAT (TO)
f=44236
TT=1800.3
T1=3.87
 SAT (TO)
f=50613
TT=1800.2
T1=108.78
 SAT (TO)
f=109306
TT=1800.16
T1=829.29
 OPT
f=22199
TT=0.341
T1=0.33
 OPT
f=22199
TT=0.339
T1=0.33
 OPT
f=22199
TT=0.345
T1=0.33
 OPT
f=22199
TT=0.341
T1=0.33
 ? (TO)

TT=1800.13
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-diamond.opb 		UNSAT

TT=0

 UNSAT

TT=0.9

 UNSAT

TT=0.001

 UNSAT

TT=0.003

 UNSAT

TT=0.001

 UNSAT

TT=0

 UNSAT

TT=0.001

 UNSAT

TT=0.001

 UNSAT

TT=0

 UNSAT

TT=0.154

 UNSAT

TT=0.158

 UNSAT

TT=0.154

 UNSAT

TT=0.01

 UNSAT

TT=0.009

 UNSAT

TT=0.012

 UNSAT

TT=0.013

 UNSAT

TT=0.001
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-l152lav.opb 		OPT
f=4722
TT=4.676
T1=4.18
 OPT
f=4722
TT=5.333
T1=36.94
 SAT
f=4891
TT=1798.05
T1=1757.19
 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.04

 ? (TO)

TT=1800.25

 ? (TO)

TT=1800.21

 ? (TO)

TT=1800.36

 ? (TO)

TT=1800.14

 OPT
f=4722
TT=4.676
T1=4.18
 OPT
f=4722
TT=5.306
T1=4.77
 OPT
f=4722
TT=4.672
T1=4.17
 OPT
f=4722
TT=4.771
T1=4.29
 ? (TO)

TT=1800.12
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-lp4l.opb 		OPT
f=2967
TT=0.321
T1=0.29
 OPT
f=2967
TT=0.941
T1=30.93
 SAT
f=3096
TT=1798.07
T1=354.25
 SAT (TO)
f=4120
TT=1800.06
T1=1499.68
 ? (TO)
f=3701
TT=1800.07
T1=1800.01
 ? (TO)
f=3951
TT=1800.05
T1=1800.02
 ? (TO)
f=3782
TT=1800.06
T1=1800
 ? (TO)
f=3961
TT=1800.07
T1=1800
 SAT (TO)
f=4057
TT=1800.08
T1=90.91
 SAT (TO)
f=3904
TT=1800.29
T1=559.12
 SAT (TO)
f=4044
TT=1800.65
T1=153.2
 SAT (TO)
f=3849
TT=1800.15
T1=1487.64
 OPT
f=2967
TT=0.328
T1=0.29
 OPT
f=2967
TT=0.321
T1=0.29
 OPT
f=2967
TT=0.337
T1=0.3
 OPT
f=2967
TT=0.358
T1=0.32
 ? (TO)

TT=1800.08
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-lseu.opb 		OPT
f=1120
TT=0.302
T1=0.25
 OPT
f=1120
TT=0.88
T1=29.67
 OPT
f=1120
TT=209.166
T1=182.61
 OPT
f=1120
TT=8.657
T1=1.8
 OPT
f=1120
TT=323.086
T1=7.14
 ? (TO)
f=1120
TT=1800.07
T1=1800.01
 OPT
f=1120
TT=224.399
T1=224.39
 OPT
f=1120
TT=680.933
T1=680.91
 OPT
f=1120
TT=71.436
T1=3.93
 OPT
f=1120
TT=532.253
T1=268.01
 OPT
f=1120
TT=336.509
T1=12.22
 OPT
f=1120
TT=208.196
T1=48.96
 OPT
f=1120
TT=0.302
T1=0.25
 OPT
f=1120
TT=0.302
T1=0.25
 OPT
f=1120
TT=0.304
T1=0.25
 OPT
f=1120
TT=0.305
T1=0.25
 ? (TO)

TT=1800.06
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod008.opb 		OPT
f=307
TT=0.737
T1=0.05
 OPT
f=307
TT=1.597
T1=31.47
 OPT
f=307
TT=1462.38
T1=1285.48
 SAT (TO)
f=307
TT=1800.06
T1=0.93
 ? (TO)
f=309
TT=1800.06
T1=1800.01
 ? (TO)
f=319
TT=1800.06
T1=1800.01
 ? (TO)
f=326
TT=1800.07
T1=1800
 ? (TO)
f=326
TT=1800.05
T1=1800
 SAT (TO)
f=310
TT=1800.04
T1=180.3
 OPT
f=307
TT=465.492
T1=12.57
 OPT
f=307
TT=1041.19
T1=14.24
 SAT (TO)
f=307
TT=1800.07
T1=21.77
 OPT
f=307
TT=0.853
T1=0.06
 OPT
f=307
TT=0.737
T1=0.05
 OPT
f=307
TT=0.775
T1=0.05
 OPT
f=307
TT=0.805
T1=0.06
 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod010.opb 		OPT
f=6548
TT=1.154
T1=1.14
 Wrong Cert.

TT=1.949

 SAT
f=6645
TT=1798.16
T1=1576.13
 SAT (TO)
f=8211
TT=1800.12
T1=9.29
 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.1

 SAT (TO)
f=7901
TT=1800.23
T1=711.54
 SAT (TO)
f=7901
TT=1800.23
T1=810.99
 ? (TO)

TT=1800.06

 OPT
f=6548
TT=1.185
T1=1.17
 OPT
f=6548
TT=1.154
T1=1.14
 OPT
f=6548
TT=1.182
T1=1.16
 OPT
f=6548
TT=1.258
T1=1.24
 ? (TO)

TT=1800.12
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0033.opb 		OPT
f=3089
TT=0.006
T1=0
 Wrong Cert.

TT=0.668

 OPT
f=3089
TT=0.058
T1=0.02
 OPT
f=3089
TT=0.006
T1=0
 OPT
f=3089
TT=0.051
T1=0.01
 OPT
f=3089
TT=0.291
T1=0.06
 OPT
f=3089
TT=0.018
T1=0.01
 OPT
f=3089
TT=0.09
T1=0.09
 OPT
f=3089
TT=0.01
T1=0
 OPT
f=3089
TT=0.509
T1=0.22
 OPT
f=3089
TT=0.684
T1=1.14
 OPT
f=3089
TT=0.391
T1=0.15
 OPT
f=3089
TT=0.045
T1=0.02
 OPT
f=3089
TT=0.049
T1=0.02
 OPT
f=3089
TT=0.048
T1=0.02
 OPT
f=3089
TT=0.051
T1=0.03
 ? (TO)

TT=1800.09
Bench nameBest resultsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0040.opb 		OPT
f=62027
TT=0.006
T1=0
 OPT
f=62027
TT=0.8
T1=30.1
 OPT
f=62027
TT=0.027
T1=0.02
 OPT
f=62027
TT=5.2
T1=0
 OPT
f=62027
TT=10.665
T1=1.38
 OPT
f=62027
TT=63.774
T1=6.96
 OPT
f=62027
TT=7.409
T1=7.4
 OPT
f=62027
TT=26.981
T1=26.98
 OPT
f=62027
TT=0.01
T1=0
 OPT
f=62027
TT=0.446
T1=0.15
 OPT
f=62027
TT=0.982
T1=1.65
 OPT
f=62027
TT=19.194
T1=0.18
 OPT
f=62027
TT=0.029
T1=0.02
 OPT
f=62027
TT=0.03
T1=0.02
 OPT
f=62027
TT=0.032
T1=0.02
 OPT
f=62027
TT=0.035
T1=0.03
 OPT
f=62027
TT=0.006
T1=0
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0201.opb 		OPT
f=1523
TT=1.444
T1=0.04
 OPT
f=1523
TT=2.516
T1=34.24
 OPT
f=1523
TT=19.795
T1=17.81
 OPT
f=1523
TT=602.668
T1=0.04
 ? (TO)
f=1571
TT=1800.1
T1=1800.01
 ? (TO)
f=1575
TT=1800.1
T1=1800.11
 ? (TO)
f=1523
TT=1800.06
T1=1800
 ? (TO)
f=1543
TT=1800.05
T1=1800
 SAT (TO)
f=1523
TT=1800.07
T1=900.01
 SAT (TO)
f=1559
TT=1800.27
T1=788.05
 SAT (TO)
f=1523
TT=1800.14
T1=2.24
 SAT (TO)
f=1523
TT=1800.14
T1=0.29
 OPT
f=1523
TT=1.444
T1=0.85
 OPT
f=1523
TT=1.448
T1=0.85
 OPT
f=1523
TT=1.425
T1=0.84
 OPT
f=1523
TT=1.445
T1=0.84
 ? (TO)

TT=1800.12
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0548.opb 		OPT
f=8691
TT=0.279
T1=0.27
 OPT
f=8691
TT=0.971
T1=30.35
 ?

TT=1798

 SAT (TO)
f=35532
TT=1800.08
T1=1409.34
 ? (TO)
f=10578
TT=1800.06
T1=1800.01
 ? (TO)
f=11076
TT=1800.09
T1=1800.01
 ? (TO)
f=10706
TT=1800.09
T1=1800.1
 ? (TO)
f=12006
TT=1800.06
T1=1800
 SAT (TO)
f=32678
TT=1800.07
T1=711.23
 SAT (TO)
f=10087
TT=1800.26
T1=0.76
 SAT (TO)
f=10087
TT=1800.34
T1=3.24
 SAT (TO)
f=40591
TT=1800.06
T1=1134.5
 OPT
f=8691
TT=0.279
T1=0.27
 OPT
f=8691
TT=0.312
T1=0.3
 OPT
f=8691
TT=0.284
T1=0.27
 OPT
f=8691
TT=0.312
T1=0.3
 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-sentoy.opb 		OPT
f=-7772
TT=0.318
T1=0.03
 OPT
f=-7772
TT=4.509
T1=37.37
 OPT
f=-7772
TT=39.823
T1=39.8
 OPT
f=-7772
TT=0.594
T1=0.15
 OPT
f=-7772
TT=50.52
T1=12.39
 OPT
f=-7772
TT=406.225
T1=99.06
 OPT
f=-7772
TT=25.401
T1=25.4
 OPT
f=-7772
TT=115.969
T1=115.96
 OPT
f=-7772
TT=154.629
T1=77.56
 OPT
f=-7772
TT=2.02
T1=0.56
 OPT
f=-7772
TT=2.996
T1=2.21
 OPT
f=-7772
TT=2.379
T1=0.28
 OPT
f=-7772
TT=0.318
T1=0.04
 OPT
f=-7772
TT=0.32
T1=0.03
 OPT
f=-7772
TT=0.32
T1=0.04
 OPT
f=-7772
TT=0.324
T1=0.04
 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-stein45.opb 		OPT
f=30
TT=16.412
T1=0.39
 OPT
f=30
TT=66.496
T1=98.35
 OPT
f=30
TT=155.568
T1=1.99
 OPT
f=30
TT=18.568
T1=0.39
 OPT
f=30
TT=361.699
T1=12.57
 ? (TO)
f=30
TT=1800.05
T1=1800.01
 OPT
f=30
TT=826.44
T1=826.42
 ? (TO)
f=30
TT=1800.05
T1=1800
 OPT
f=30
TT=125.687
T1=25.58
 SAT (TO)
f=30
TT=1800.29
T1=0.48
 OPT
f=30
TT=195.404
T1=2.18
 OPT
f=30
TT=85.659
T1=0.53
 OPT
f=30
TT=16.412
T1=1
 OPT
f=30
TT=16.627
T1=1
 OPT
f=30
TT=16.431
T1=1.01
 OPT
f=30
TT=16.609
T1=1.01
 ? (TO)

TT=1800.11
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos10.opb 		OPT
f=-1135
TT=1.073
T1=0.88
 OPT
f=-1135
TT=121.212
T1=156.32
 OPT
f=-1135
TT=9.773
T1=9.7
 OPT
f=-1135
TT=1.073
T1=0.88
 OPT
f=-1135
TT=218.485
T1=64.28
 OPT
f=-1135
TT=638.157
T1=129.76
 OPT
f=-1135
TT=5.705
T1=5.69
 OPT
f=-1135
TT=36.053
T1=36.03
 OPT
f=-1135
TT=4.865
T1=2.33
 OPT
f=-1135
TT=812.026
T1=276.57
 OPT
f=-1135
TT=11.377
T1=13.4
 OPT
f=-1135
TT=4.123
T1=2.53
 OPT
f=-1135
TT=26.884
T1=26.74
 OPT
f=-1135
TT=25.842
T1=25.72
 OPT
f=-1135
TT=24.524
T1=24.4
 OPT
f=-1135
TT=25.892
T1=25.76
 ? (TO)

TT=1800.13
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos16.opb 		SAT
f=114
TT=1800.07
T1=566.69
 ? (MO)

TT=242.26

 SAT
f=118
TT=1798
T1=8.09
 SAT (TO)
f=114
TT=1800.07
T1=694.82
 ? (TO)
f=114
TT=1800.09
T1=1800.01
 ? (TO)
f=114
TT=1800.06
T1=1800.02
 ? (TO)
f=114
TT=1800.05
T1=1800
 ? (TO)
f=114
TT=1800.05
T1=1800
 SAT (TO)
f=117
TT=1800.07
T1=900.01
 SAT (TO)
f=117
TT=1800.24
T1=154.59
 SAT (TO)
f=114
TT=1800.31
T1=566.69
 SAT (TO)
f=114
TT=1800.17
T1=1734.97
 ? (TO)

TT=1800.08

 ?

TT=1797.29

 ? (TO)

TT=1800.08

 ?

TT=1797.43

 ? (TO)

TT=1800.07
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos18.opb 		OPT
f=16
TT=0.094
T1=0.02
 OPT
f=16
TT=50.981
T1=84.61
 OPT
f=16
TT=0.804
T1=0.2
 OPT
f=16
TT=0.094
T1=0.02
 OPT
f=16
TT=0.317
T1=0.13
 OPT
f=16
TT=1.474
T1=0.57
 OPT
f=16
TT=0.388
T1=0.38
 OPT
f=16
TT=1.667
T1=1.66
 OPT
f=16
TT=0.177
T1=0.04
 OPT
f=16
TT=4.673
T1=1.29
 OPT
f=16
TT=2.634
T1=2.46
 OPT
f=16
TT=1.509
T1=0.52
 OPT
f=16
TT=144.653
T1=31.74
 OPT
f=16
TT=168.501
T1=31.73
 OPT
f=16
TT=157.799
T1=34.54
 OPT
f=16
TT=183.981
T1=34.61
 OPT
f=16
TT=0.736
T1=0.73
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos19.opb 		SAT
f=-8
TT=1800.32
T1=76.86
 ? (MO)

TT=213.55

 SAT
f=-3
TT=1798.19
T1=188.7
 SAT (TO)
f=-8
TT=1800.32
T1=76.86
 ? (TO)
f=-2
TT=1800.4
T1=1800.02
 ? (TO)
f=-2
TT=1800.44
T1=1800.01
 ? (TO)
f=-27
TT=1800.38
T1=1800
 ? (TO)
f=-4
TT=1800.43
T1=1800
 SAT (TO)
f=-4
TT=1800.44
T1=902.81
 ? (TO)

TT=1800.29

 ? (TO)

TT=1800.43

 ? (TO)

TT=1800.32

 ? (TO)

TT=1802.33

 ? (TO)

TT=1800.25

 ? (TO)

TT=1802.24

 ? (TO)

TT=1802.24

 ? (TO)

TT=1800.13
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos1.opb 		OPT
f=19
TT=2.755
T1=0.66
 OPT
f=19
TT=1.797
T1=37.11
 SAT
f=23
TT=1798.01
T1=487.44
 SAT (TO)
f=35
TT=1800.1
T1=0.01
 ? (TO)
f=24
TT=1800.05
T1=1800.02
 ? (TO)
f=24
TT=1800.02
T1=1800.01
 ? (TO)
f=26
TT=1800.06
T1=1800
 ? (TO)
f=26
TT=1800.06
T1=1800
 OPT
f=19
TT=301.531
T1=50.03
 SAT (TO)
f=21
TT=1800.26
T1=291.41
 SAT (TO)
f=21
TT=1800.22
T1=72.87
 SAT (TO)
f=21
TT=1800.17
T1=60.67
 OPT
f=19
TT=2.835
T1=0.68
 OPT
f=19
TT=2.755
T1=0.66
 OPT
f=19
TT=2.814
T1=0.68
 OPT
f=19
TT=3.014
T1=0.72
 ? (TO)

TT=1800.09
Bench nameBest resultsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos5.opb 		SAT
f=15360
TT=1798.1
T1=24.01
 ? (MO)

TT=575.65

 SAT
f=17408
TT=1798.01
T1=0.18
 SAT (TO)
f=19968
TT=1800.11
T1=1606.71
 ? (TO)
f=16192
TT=1800.03
T1=1800.02
 ? (TO)
f=16356
TT=1800.06
T1=1800.01
 ? (TO)
f=16138
TT=1800.03
T1=1800
 ? (TO)
f=16456
TT=1800.08
T1=1800
 SAT (TO)
f=16384
TT=1800.06
T1=674.4
 SAT (TO)
f=16384
TT=1800.26
T1=1553.93
 SAT (TO)
f=16384
TT=1800.34
T1=107.55
 SAT (TO)
f=16384
TT=1800.08
T1=112.25
 SAT (TO)
f=15360
TT=1800.08
T1=24.74
 SAT
f=15360
TT=1798.18
T1=26.48
 SAT (TO)
f=15360
TT=1800.05
T1=23.26
 SAT
f=15360
TT=1798.1
T1=24.01
 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos8.opb 		OPT
f=-3719
TT=0.468
T1=0.41
 OPT
f=-3719
TT=16.097
T1=51.07
 OPT
f=-3719
TT=8.064
T1=8.05
 OPT
f=-3719
TT=0.468
T1=0.41
 OPT
f=-3719
TT=92.618
T1=80.14
 OPT
f=-3719
TT=183.123
T1=158.5
 OPT
f=-3719
TT=4.816
T1=4.8
 OPT
f=-3719
TT=28.572
T1=28.55
 OPT
f=-3719
TT=3.017
T1=1.55
 OPT
f=-3719
TT=36.597
T1=28.65
 OPT
f=-3719
TT=5.754
T1=6.78
 OPT
f=-3719
TT=3
T1=1.75
 OPT
f=-3719
TT=12.638
T1=12.51
 OPT
f=-3719
TT=13.285
T1=13.17
 OPT
f=-3719
TT=12.469
T1=12.34
 OPT
f=-3719
TT=14.59
T1=14.45
 ? (TO)

TT=1800.14



Statisticsborg
pb-opt-11.04.03
(complete)		bsolo
3.2
(complete)		clasp
2.0-R4191
(complete)		MinisatID
2.4.8 [DEPRECATED]
(complete)		MinisatID
2.4.8-gmp [DEPRECATED]
(complete)		MinisatID
2.5.2 (fixed)
(complete)		MinisatID
2.5.2-gmp (fixed)
(complete)		pwbo
1.1
(complete)		Sat4j CuttingPlanes
2.3.0
(complete)		Sat4j Res//CP
2.3.0
(complete)		Sat4j Resolution
2.3.0
(complete)		SCIP spx
SCIP 2.0.1.4. with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx 2
2011-06-10 (fixed)
(complete)		SCIP spx E
SCIP 2.0.1.4b with SoPlex 1.5.0.4 [DEPRECATED]
(complete)		SCIP spx E_2
2011-06-10 (fixed)
(complete)		wbo
1.6
(complete)
Number of times the solver is able to give the best known answer0131710811101311141527270283
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)		0080100211498071