PB'10 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory MPS to OPB

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory MPS to OPB

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 Card (complete)
bsolo 3.2 Cl (complete)
pb_cplex 2010-06-29 (complete)
PB/CT 0.1 (complete)
PB/CT 0.1 fixed (complete)
PBPASSolver 2010-06-13 (complete)
SAT4J PB CuttingPlanes 2.2.0 2010-05-26 (complete)
SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
SAT4J PB Resolution 2.2.0 2010-05-26 (complete)
SCIPclp SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver (complete)
SCIPnone SCIP 1.2.1.2 without any LP solver (complete)
SCIPspx SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
wbo 1.4b (complete)
wbo 1.4b (fixed) (complete)

Bench nameBest results
on this
instance		bsolo
3.2 Card
(complete)		bsolo
3.2 Cl
(complete)		pb_cplex
2010-06-29
(complete)		PB/CT
0.1
(complete)		PB/CT
0.1 fixed
(complete)		PBPASSolver
2010-06-13
(complete)		SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		wbo
1.4b
(complete)		wbo
1.4b (fixed)
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-10teams.opb 		OPT
f=904
TT=54.722
T1=39.56
 SAT
f=964
TT=1798.02
T1=103.65
 SAT
f=980
TT=1798.01
T1=1220.87
 OPT
f=904
TT=58.885
T1=39.56
 ? (TO)

TT=1800.11

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.01

 SAT (TO)
f=926
TT=1800.33
T1=275.81
 SAT (TO)
f=918
TT=1800.56
T1=313.33
 SAT (TO)
f=918
TT=1800.19
T1=270.62
 OPT
f=904
TT=94.144
T1=94.15
 SAT (TO)
f=1048
TT=1802.23
T1=395.46
 OPT
f=904
TT=57.341
T1=57.32
 OPT
f=904
TT=54.722
T1=54.71
 ? (TO)

TT=1800.19

 ? (TO)

TT=1800.15
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-fast0507.opb 		SAT
f=176
TT=1790.37
T1=41.4
 SAT
f=308
TT=1798.4
T1=624.19
 SAT
f=307
TT=1798.12
T1=186
 ? (TO)

TT=1800.09

 SAT (TO)
f=276
TT=1800.15
T1=9.61
 SAT (TO)
f=276
TT=1800.19
T1=9.37
 ? (MO)

TT=15.74

 SAT (TO)
f=259
TT=1800.45
T1=118.13
 SAT (TO)
f=253
TT=1800.7
T1=459.2
 SAT (TO)
f=253
TT=1800.7
T1=14.3
 SAT (TO)
f=184
TT=1801.15
T1=32.25
 SAT (TO)
f=341
TT=1800.83
T1=1332.88
 SAT (TO)
f=176
TT=1801.12
T1=42.3
 SAT
f=176
TT=1790.37
T1=41.4
 ? (TO)

TT=1800.17

 ? (TO)

TT=1800.2
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-manna81.opb 		OPT
f=-13164
TT=47.754
T1=47.53
 SAT
f=-11464
TT=1798.15
T1=1206.11
 SAT
f=-11464
TT=1798.12
T1=437.18
 SAT
f=-13164
TT=84.969
T1=69.16
 SAT (MO)
f=-11627
TT=783.132
T1=23.82
 SAT (MO)
f=-11738
TT=792.868
T1=71.48
 ? (TO)

TT=1800.07

 SAT (TO)
f=-11504
TT=1800.47
T1=1269.58
 SAT (TO)
f=-11570
TT=1800.69
T1=66.08
 SAT (TO)
f=-11570
TT=1800.48
T1=42.84
 OPT
f=-13164
TT=47.754
T1=47.53
 SAT (TO)
f=0
TT=1800.47
T1=0.41
 OPT
f=-13164
TT=227.25
T1=227.06
 OPT
f=-13164
TT=201.195
T1=201.06
 Wrong Opt.
f=-224
TT=183.346
T1=183.48
 ? (MO)

TT=213.14
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mzzv11.opb 		OPT
f=-10859
TT=187.313
T1=154
 SAT
f=-8775
TT=1798.05
T1=1790.69
 SAT
f=-8374
TT=1798.04
T1=1709.02
 OPT
f=-10859
TT=187.313
T1=154
 Wrong UNSAT

TT=12.031

 ? (TO)

TT=1800.16

 ? (MO)

TT=35.08

 SAT (TO)
f=-9089
TT=1800.45
T1=1099.37
 SAT (TO)
f=-10619
TT=1800.81
T1=877.57
 SAT (TO)
f=-10765
TT=1800.28
T1=1725.3
 ? (TO)

TT=1802.13

 ? (TO)

TT=1800.96

 ? (TO)

TT=1801.3

 ?

TT=1790.48

 Wrong Opt.
f=-6240
TT=180.84
T1=180.9
 ? (TO)

TT=1800.2
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mzzv42z.opb 		OPT
f=-10270
TT=59.375
T1=44.86
 SAT
f=-9395
TT=1798.03
T1=1788.3
 SAT
f=-9350
TT=1798.06
T1=1741.63
 OPT
f=-10270
TT=59.375
T1=44.86
 Wrong UNSAT

TT=13.391

 ? (TO)

TT=1800.15

 ? (MO)

TT=19.09

 SAT (TO)
f=-9805
TT=1800.49
T1=1254.62
 SAT (TO)
f=-10270
TT=1800.45
T1=989.68
 OPT
f=-10270
TT=397.753
T1=344.45
 ? (TO)

TT=1802.06

 ? (TO)

TT=1800.76

 ? (TO)

TT=1802

 ?

TT=1789.86

 Wrong Opt.
f=-8335
TT=180.899
T1=180.97
 ? (TO)

TT=1800.12
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-net12.opb 		OPT
f=214
TT=13.999
T1=4.22
 OPT
f=214
TT=15.158
T1=4.22
 OPT
f=214
TT=13.999
T1=4.46
 ? (TO)

TT=1800.12

 ? (MO)

TT=26.416

 ? (MO)

TT=24.383

 ? (MO)

TT=15.1

 SAT (TO)
f=214
TT=1800.75
T1=1191.58
 OPT
f=214
TT=39.599
T1=13.18
 OPT
f=214
TT=21.818
T1=9.65
 SAT (TO)
f=296
TT=1801.94
T1=1305.92
 OPT
f=214
TT=1329.05
T1=1229.66
 ? (TO)

TT=1802.08

 ?

TT=1790.4

 OPT
f=214
TT=6.956
T1=3.51
 OPT
f=214
TT=6.957
T1=3.51
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-opt1217.opb 		SAT
f=-16384
TT=1792.69
T1=1.58
 SAT
f=-14335
TT=1798.03
T1=1.05
 SAT
f=-12287
TT=1798.02
T1=0.06
 ? (TO)

TT=1800.04

 SAT (TO)
f=-14336
TT=1800.05
T1=1372.93
 SAT (TO)
f=-14336
TT=1800.03
T1=6.43
 ? (TO)

TT=1800.1

 SAT (TO)
f=-12288
TT=1800.21
T1=1662.07
 ? (TO)

TT=1804.07

 ? (TO)

TT=1800.19

 SAT (TO)
f=-16384
TT=1802.13
T1=3.63
 SAT (TO)
f=-16383
TT=1802.17
T1=1765.85
 SAT (TO)
f=-16384
TT=1802.13
T1=1.66
 SAT
f=-16384
TT=1792.69
T1=1.58
 Wrong UNSAT

TT=181.408

 ? (TO)

TT=1800.14
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-p2756.opb 		OPT
f=3124
TT=3.119
T1=2.73
 SAT
f=3694
TT=1798.07
T1=837.25
 SAT
f=3701
TT=1798.27
T1=506.73
 OPT
f=3124
TT=3.119
T1=2.73
 SAT (TO)
f=3953
TT=1800.02
T1=1790.92
 SAT (TO)
f=4178
TT=1800.07
T1=1647.3
 ? (TO)

TT=1800.08

 SAT (TO)
f=3695
TT=1800.23
T1=777.57
 SAT (TO)
f=3840
TT=1800.58
T1=790.84
 SAT (TO)
f=3886
TT=1800.27
T1=1445.82
 OPT
f=3124
TT=5.157
T1=5.12
 SAT (TO)
f=6383
TT=1802.11
T1=993.19
 OPT
f=3124
TT=5.72
T1=5.68
 OPT
f=3124
TT=5.138
T1=5.1
 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.09
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-protfold.opb 		SAT
f=-25
TT=1800.24
T1=659.5
 SAT
f=-22
TT=1798.04
T1=1279.36
 SAT
f=-22
TT=1798.24
T1=342.2
 ? (TO)

TT=1800.2

 SAT (TO)
f=-19
TT=1800.06
T1=190.2
 SAT (TO)
f=-18
TT=1800.12
T1=241.16
 ? (TO)

TT=1800.11

 SAT (TO)
f=-21
TT=1800.28
T1=1070.75
 SAT (TO)
f=-25
TT=1800.48
T1=724.02
 SAT (TO)
f=-25
TT=1800.24
T1=659.5
 ? (TO)

TT=1800.23

 SAT (TO)
f=-20
TT=1802.15
T1=1080.15
 ? (TO)

TT=1802.03

 SAT
f=-16
TT=1789.64
T1=1200.19
 Wrong Opt.
f=-15
TT=182.737
T1=182.77
 ? (TO)

TT=1800.21
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-seymour.opb 		SAT
f=425
TT=1789.68
T1=1256.11
 SAT
f=461
TT=1798.02
T1=61.09
 SAT
f=461
TT=1798.24
T1=61.46
 ? (TO)

TT=1800.04

 SAT (TO)
f=485
TT=1800.11
T1=1311.69
 SAT (TO)
f=485
TT=1800.05
T1=1299.41
 ? (TO)

TT=1800.09

 SAT (TO)
f=481
TT=1800.37
T1=1238.55
 SAT (TO)
f=477
TT=1802.19
T1=355.98
 SAT (TO)
f=490
TT=1800.29
T1=0.97
 SAT (TO)
f=480
TT=1800.17
T1=0.36
 SAT (TO)
f=503
TT=1800.07
T1=573.96
 SAT (TO)
f=480
TT=1800.11
T1=0.37
 SAT
f=425
TT=1789.68
T1=1256.11
 ? (MO)

TT=1374.88

 ? (MO)

TT=1299.26
Bench nameBest resultsbsolo
3.2 Card
(complete)		bsolo
3.2 Cl
(complete)		pb_cplex
2010-06-29
(complete)		PB/CT
0.1
(complete)		PB/CT
0.1 fixed
(complete)		PBPASSolver
2010-06-13
(complete)		SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		wbo
1.4b
(complete)		wbo
1.4b (fixed)
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-mitre.opb 		OPT
f=7677
TT=26.299
T1=25.25
 SAT
f=8863
TT=1798.14
T1=29.58
 SAT
f=8956
TT=1798.17
T1=23.22
 OPT
f=7677
TT=26.299
T1=25.25
 Wrong UNSAT

TT=4.553

 SAT (TO)
f=9140
TT=1800.11
T1=1151.81
 ? (TO)

TT=1800.05

 SAT (TO)
f=7726
TT=1800.52
T1=21.53
 SAT (TO)
f=7694
TT=1800.66
T1=25.15
 SAT (TO)
f=7699
TT=1800.43
T1=270.92
 OPT
f=7677
TT=29
T1=28.91
 ? (TO)

TT=1801.09

 OPT
f=7677
TT=44.708
T1=44.62
 OPT
f=7677
TT=43.978
T1=43.87
 Wrong Opt.
f=9340
TT=185.634
T1=185.55
 ? (MO)

TT=339.434
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-bm23.opb 		OPT
f=34
TT=0.09
T1=0.07
 OPT
f=34
TT=0.604
T1=0.43
 OPT
f=34
TT=0.472
T1=0.29
 OPT
f=34
TT=0.09
T1=0.07
 Wrong UNSAT

TT=0.067

 OPT
f=34
TT=1.077
T1=0.79
 ? (TO)

TT=1800.02

 OPT
f=34
TT=5.438
T1=2.37
 OPT
f=34
TT=5.162
T1=3.28
 OPT
f=34
TT=2.109
T1=0.77
 OPT
f=34
TT=0.574
T1=0.39
 OPT
f=34
TT=1.351
T1=1.34
 OPT
f=34
TT=0.532
T1=0.39
 OPT
f=34
TT=0.509
T1=0.37
 OPT
f=34
TT=0.174
T1=0.1
 OPT
f=34
TT=0.173
T1=0.1
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-cracpb1.opb 		OPT
f=22199
TT=0.503
T1=0.5
 SAT
f=56943
TT=1798.04
T1=902.93
 SAT
f=56503
TT=1798.04
T1=495.48
 OPT
f=22199
TT=0.503
T1=0.5
 Wrong UNSAT

TT=0.421

 SAT (TO)
f=114288
TT=1800.03
T1=1151.26
 ? (TO)

TT=1800.08

 SAT (TO)
f=44236
TT=1800.29
T1=7.76
 SAT (TO)
f=51501
TT=1803.69
T1=232.43
 SAT (TO)
f=102616
TT=1800.21
T1=591.67
 OPT
f=22199
TT=0.703
T1=0.69
 ? (TO)

TT=1802.15

 OPT
f=22199
TT=0.632
T1=0.61
 OPT
f=22199
TT=0.569
T1=0.55
 ? (TO)

TT=1800.18

 ? (TO)

TT=1800.1
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-diamond.opb 		UNSAT

TT=0.001

 UNSAT

TT=0.001

 UNSAT

TT=0.002

 UNSAT

TT=0.01

 UNSAT

TT=0.003

 UNSAT

TT=0.003

 UNSAT

TT=0.011

 UNSAT

TT=0.307

 UNSAT

TT=0.322

 UNSAT

TT=0.297

 UNSAT

TT=0.024

 UNSAT

TT=0.024

 UNSAT

TT=0.025

 UNSAT

TT=0.025

 UNSAT

TT=0.001

 UNSAT

TT=0.001
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-l152lav.opb 		OPT
f=4722
TT=5.138
T1=4.45
 ?

TT=1798.1

 ?

TT=1798.17

 OPT
f=4722
TT=5.138
T1=4.45
 Wrong UNSAT

TT=1.053

 ? (TO)

TT=1800.03

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.15

 ? (TO)

TT=1800.26

 ? (TO)

TT=1800.22

 OPT
f=4722
TT=9.319
T1=7.57
 ? (TO)

TT=1802.15

 OPT
f=4722
TT=16.941
T1=16.77
 OPT
f=4722
TT=16.027
T1=15.86
 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.13
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-lp4l.opb 		OPT
f=2967
TT=0.558
T1=0.45
 SAT
f=3096
TT=1798.31
T1=773.98
 SAT
f=3103
TT=1798.13
T1=960.47
 OPT
f=2967
TT=0.795
T1=0.79
 Wrong UNSAT

TT=0.492

 SAT (TO)
f=4332
TT=1800.12
T1=1160.45
 ? (TO)

TT=1800.03

 SAT (TO)
f=3904
TT=1800.28
T1=1250.18
 SAT (TO)
f=3977
TT=1800.52
T1=362.11
 SAT (TO)
f=3915
TT=1800.25
T1=1337.13
 OPT
f=2967
TT=0.558
T1=0.45
 SAT (TO)
f=4250
TT=1802.15
T1=1342.08
 OPT
f=2967
TT=0.775
T1=0.68
 OPT
f=2967
TT=0.741
T1=0.64
 ? (TO)

TT=1800.19

 ? (TO)

TT=1800.11
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-lseu.opb 		OPT
f=1120
TT=0.149
T1=0.11
 OPT
f=1120
TT=430.952
T1=376.89
 OPT
f=1120
TT=433.2
T1=350.26
 OPT
f=1120
TT=0.149
T1=0.11
 Wrong UNSAT

TT=0.03

 OPT
f=1120
TT=869.305
T1=29.05
 ? (TO)

TT=1800.03

 SAT (TO)
f=1120
TT=1800.26
T1=988.14
 OPT
f=1120
TT=811.613
T1=36.51
 OPT
f=1120
TT=446.682
T1=27.01
 OPT
f=1120
TT=1.613
T1=1.41
 SAT (TO)
f=1169
TT=1802.16
T1=1635.93
 OPT
f=1120
TT=0.916
T1=0.69
 OPT
f=1120
TT=0.911
T1=0.75
 OPT
f=1120
TT=103.394
T1=9.15
 OPT
f=1120
TT=102.047
T1=9.17
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod008.opb 		OPT
f=307
TT=0.335
T1=0.12
 SAT
f=372
TT=1798.01
T1=9.34
 OPT
f=307
TT=333.266
T1=47.58
 OPT
f=307
TT=0.335
T1=0.28
 SAT (TO)
f=428
TT=1800.05
T1=1672.04
 SAT (TO)
f=320
TT=1800.07
T1=689.33
 ? (TO)

TT=1800.01

 OPT
f=307
TT=1506.71
T1=22.1
 OPT
f=307
TT=1592.21
T1=15.55
 SAT (TO)
f=307
TT=1800.24
T1=11.8
 OPT
f=307
TT=1.949
T1=0.13
 SAT (TO)
f=307
TT=1802.22
T1=561.78
 OPT
f=307
TT=1.798
T1=0.13
 OPT
f=307
TT=1.711
T1=0.12
 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.1
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod010.opb 		OPT
f=6548
TT=3.651
T1=3.6
 SAT (TO)
f=6688
TT=1800.14
T1=225.76
 ? (TO)

TT=1800.18

 OPT
f=6548
TT=4.16
T1=4.14
 Wrong UNSAT

TT=1.208

 ? (TO)

TT=1800.03

 ? (TO)

TT=1800.05

 SAT (TO)
f=7901
TT=1800.3
T1=1409.51
 SAT (TO)
f=7989
TT=1800.51
T1=515.61
 ? (TO)

TT=1800.21

 OPT
f=6548
TT=3.651
T1=3.6
 ? (TO)

TT=1802.12

 OPT
f=6548
TT=4.372
T1=4.34
 OPT
f=6548
TT=4.116
T1=4.08
 ? (TO)

TT=1800.16

 ? (TO)

TT=1800.11
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0033.opb 		OPT
f=3089
TT=0.039
T1=0.01
 OPT
f=3089
TT=0.127
T1=0.06
 OPT
f=3089
TT=0.094
T1=0.04
 OPT
f=3089
TT=0.039
T1=0.03
 Wrong UNSAT

TT=0.011

 OPT
f=3089
TT=0.09
T1=0.01
 ? (TO)

TT=1800.01

 OPT
f=3089
TT=1.315
T1=0.47
 OPT
f=3089
TT=1.233
T1=2.3
 OPT
f=3089
TT=0.985
T1=0.31
 OPT
f=3089
TT=0.142
T1=0.12
 OPT
f=3089
TT=0.173
T1=0.12
 OPT
f=3089
TT=0.142
T1=0.13
 OPT
f=3089
TT=0.132
T1=0.12
 OPT
f=3089
TT=0.013
T1=0
 OPT
f=3089
TT=0.014
T1=0.01
Bench nameBest resultsbsolo
3.2 Card
(complete)		bsolo
3.2 Cl
(complete)		pb_cplex
2010-06-29
(complete)		PB/CT
0.1
(complete)		PB/CT
0.1 fixed
(complete)		PBPASSolver
2010-06-13
(complete)		SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		wbo
1.4b
(complete)		wbo
1.4b (fixed)
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0040.opb 		OPT
f=62027
TT=0.013
T1=0.01
 OPT
f=62027
TT=0.054
T1=0.04
 OPT
f=62027
TT=0.052
T1=0.04
 OPT
f=62027
TT=0.013
T1=0.01
 Wrong Opt.
f=62567
TT=0.267
T1=0.18
 OPT
f=62027
TT=182.738
T1=16.3
 ? (TO)

TT=1800.02

 OPT
f=62027
TT=1.194
T1=0.31
 OPT
f=62027
TT=1.124
T1=3.59
 OPT
f=62027
TT=47.856
T1=0.26
 OPT
f=62027
TT=0.131
T1=0.12
 SAT (TO)
f=62027
TT=1800.19
T1=142.75
 OPT
f=62027
TT=0.132
T1=0.12
 OPT
f=62027
TT=0.107
T1=0.09
 OPT
f=62027
TT=36.777
T1=33.62
 OPT
f=62027
TT=35.482
T1=32.41
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0201.opb 		OPT
f=1523
TT=0.31
T1=0.25
 OPT
f=1523
TT=38.295
T1=34.43
 OPT
f=1523
TT=48.102
T1=41.95
 OPT
f=1523
TT=0.31
T1=0.25
 SAT (TO)
f=1533
TT=1800.02
T1=819.57
 SAT (TO)
f=1523
TT=1800.04
T1=159.98
 ? (TO)

TT=1800.07

 SAT (TO)
f=1561
TT=1800.19
T1=0.65
 ? (TO)

TT=1803.87

 SAT (TO)
f=1523
TT=1800.15
T1=1.7
 OPT
f=1523
TT=2.557
T1=1.78
 SAT (TO)
f=1575
TT=1802.15
T1=941.93
 OPT
f=1523
TT=3.723
T1=2.94
 OPT
f=1523
TT=3.58
T1=2.82
 ? (TO)

TT=1800.19

 ? (TO)

TT=1800.16
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0548.opb 		OPT
f=8691
TT=0.141
T1=0.14
 ?

TT=1798.01

 ?

TT=1798

 OPT
f=8691
TT=0.141
T1=0.14
 Wrong UNSAT

TT=0.171

 SAT (TO)
f=26908
TT=1800.1
T1=1477.74
 ? (TO)

TT=1800.03

 SAT (TO)
f=10087
TT=1800.2
T1=1.92
 No Cert.

TT=1803.77

 SAT (TO)
f=49302
TT=1800.2
T1=270.48
 OPT
f=8691
TT=0.713
T1=0.7
 SAT (TO)
f=13048
TT=1802.18
T1=1681.02
 OPT
f=8691
TT=0.769
T1=0.75
 OPT
f=8691
TT=0.719
T1=0.7
 ? (TO)

TT=1800.22

 ? (TO)

TT=1800.23
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-sentoy.opb 		OPT
f=-7772
TT=0.127
T1=0.11
 OPT
f=-7772
TT=79.025
T1=79
 OPT
f=-7772
TT=76.674
T1=76.63
 OPT
f=-7772
TT=0.127
T1=0.11
 Wrong Opt.
f=-7668
TT=26.222
T1=20.6
 OPT
f=-7772
TT=241.141
T1=182.91
 ? (TO)

TT=1800.04

 OPT
f=-7772
TT=5.431
T1=1.55
 OPT
f=-7772
TT=5.695
T1=4.41
 OPT
f=-7772
TT=6.878
T1=0.91
 OPT
f=-7772
TT=1.085
T1=0.36
 OPT
f=-7772
TT=76.241
T1=42.43
 OPT
f=-7772
TT=1.059
T1=0.36
 OPT
f=-7772
TT=1.012
T1=0.33
 Wrong Opt.
f=-7607
TT=180.519
T1=180.57
 ? (TO)

TT=1800.11
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-stein45.opb 		OPT
f=30
TT=23.553
T1=0.18
 OPT
f=30
TT=335.041
T1=4.3
 OPT
f=30
TT=288.323
T1=4.26
 OPT
f=30
TT=23.553
T1=13.74
 OPT
f=30
TT=1205.6
T1=0.18
 OPT
f=30
TT=1203.77
T1=0.18
 ? (TO)

TT=1800.08

 SAT (TO)
f=30
TT=1800.3
T1=1.5
 OPT
f=30
TT=371.484
T1=4.38
 OPT
f=30
TT=171.903
T1=0.7
 OPT
f=30
TT=73.932
T1=2.35
 SAT (TO)
f=30
TT=1801.41
T1=92.91
 OPT
f=30
TT=44.382
T1=4.62
 OPT
f=30
TT=43.963
T1=8.04
 OPT
f=30
TT=1121.26
T1=0.03
 OPT
f=30
TT=1103.59
T1=0.03
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos10.opb 		OPT
f=-1135
TT=12.038
T1=8.72
 OPT
f=-1135
TT=27.349
T1=27.21
 OPT
f=-1135
TT=27.015
T1=26.95
 OPT
f=-1135
TT=45.146
T1=44.37
 OPT
f=-1135
TT=59.047
T1=54.41
 OPT
f=-1135
TT=57.444
T1=53.42
 ? (MO)

TT=13.48

 OPT
f=-1135
TT=1776.86
T1=602.72
 OPT
f=-1135
TT=43.364
T1=47.28
 OPT
f=-1135
TT=12.038
T1=8.72
 OPT
f=-1135
TT=70.562
T1=70.27
 OPT
f=-1135
TT=53.451
T1=50.72
 OPT
f=-1135
TT=63.613
T1=63.35
 OPT
f=-1135
TT=72.226
T1=71.7
 OPT
f=-1135
TT=15.888
T1=15.88
 OPT
f=-1135
TT=15.158
T1=14.2
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos16.opb 		SAT
f=114
TT=1800.49
T1=31.91
 SAT
f=118
TT=1798.01
T1=20.07
 SAT
f=116
TT=1798.01
T1=1638.07
 ? (TO)

TT=1800.08

 SAT (TO)
f=114
TT=1800.07
T1=1518.07
 SAT (TO)
f=116
TT=1800.07
T1=303.13
 ? (TO)

TT=1800.03

 SAT (TO)
f=117
TT=1800.26
T1=460.41
 SAT (TO)
f=114
TT=1800.49
T1=31.91
 SAT (TO)
f=116
TT=1800.26
T1=728.06
 ? (TO)

TT=1800.37

 ? (TO)

TT=1802.12

 ? (TO)

TT=1800.23

 ?

TT=1789.74

 ? (TO)

TT=1800.15

 ? (TO)

TT=1800.18
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos18.opb 		OPT
f=16
TT=1.183
T1=0.25
 OPT
f=16
TT=1.524
T1=0.37
 OPT
f=16
TT=1.496
T1=0.25
 OPT
f=16
TT=573.103
T1=317.26
 OPT
f=16
TT=1.217
T1=0.63
 OPT
f=16
TT=1.183
T1=0.61
 ? (TO)

TT=1800.02

 OPT
f=16
TT=10.041
T1=3.45
 OPT
f=16
TT=7.066
T1=7.15
 OPT
f=16
TT=2.937
T1=1.66
 OPT
f=16
TT=694.107
T1=684.57
 OPT
f=16
TT=19.119
T1=5.05
 OPT
f=16
TT=36.962
T1=26.45
 OPT
f=16
TT=447.137
T1=162.64
 OPT
f=16
TT=0.301
T1=0.13
 OPT
f=16
TT=0.286
T1=0.13
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos19.opb 		SAT
f=-3
TT=1798.31
T1=195.86
 SAT
f=-3
TT=1798.31
T1=196.73
 SAT
f=-3
TT=1798.31
T1=195.86
 ? (MO)

TT=365.6

 ? (MO)

TT=29.35

 ? (MO)

TT=27.461

 ? (MO)

TT=14.77

 ? (TO)

TT=1800.35

 ? (TO)

TT=1800.94

 ? (TO)

TT=1800.23

 ? (MO)

TT=17.928

 ? (MO)

TT=18.736

 ? (MO)

TT=18.822

 ? (MO)

TT=17.765

 ? (TO)

TT=1800.22

 ? (TO)

TT=1800.2
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos1.opb 		OPT
f=19
TT=2.376
T1=2.33
 SAT
f=23
TT=1798.02
T1=1315.96
 SAT
f=24
TT=1798.02
T1=997.39
 OPT
f=19
TT=6.294
T1=3.77
 SAT (TO)
f=30
TT=1800.08
T1=1000.09
 SAT (TO)
f=28
TT=1800.07
T1=1399.93
 ? (TO)

TT=1800.09

 SAT (TO)
f=21
TT=1800.38
T1=624.65
 SAT (TO)
f=21
TT=1803.55
T1=471.59
 SAT (TO)
f=20
TT=1800.25
T1=1270.73
 OPT
f=19
TT=24.664
T1=24.63
 ? (TO)

TT=1802.17

 OPT
f=19
TT=2.376
T1=2.33
 OPT
f=19
TT=2.935
T1=2.88
 ? (TO)

TT=1800.24

 ? (TO)

TT=1800.21
Bench nameBest resultsbsolo
3.2 Card
(complete)		bsolo
3.2 Cl
(complete)		pb_cplex
2010-06-29
(complete)		PB/CT
0.1
(complete)		PB/CT
0.1 fixed
(complete)		PBPASSolver
2010-06-13
(complete)		SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		wbo
1.4b
(complete)		wbo
1.4b (fixed)
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos5.opb 		SAT
f=15360
TT=1570.6
T1=176.66
 SAT
f=17408
TT=1798.01
T1=0.35
 SAT
f=17408
TT=1798.01
T1=0.35
 SAT
f=15360
TT=1570.6
T1=940.49
 SAT (TO)
f=16387
TT=1800.04
T1=1426.21
 SAT (TO)
f=16998
TT=1800.11
T1=1719.23
 ? (TO)

TT=1800.05

 SAT (TO)
f=17269
TT=1800.26
T1=1309.22
 ? (TO)

TT=1803.99

 SAT (TO)
f=16384
TT=1800.25
T1=571.24
 SAT (TO)
f=15360
TT=1800.75
T1=403.31
 SAT (TO)
f=17408
TT=1802.23
T1=59.83
 SAT (TO)
f=15360
TT=1800.61
T1=201.53
 SAT
f=15360
TT=1790.05
T1=176.66
 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.1
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos8.opb 		OPT
f=-3719
TT=8.227
T1=5.69
 OPT
f=-3719
TT=24.64
T1=24.63
 OPT
f=-3719
TT=24.539
T1=24.53
 OPT
f=-3719
TT=92.962
T1=92.11
 OPT
f=-3719
TT=69.37
T1=64.38
 OPT
f=-3719
TT=68.517
T1=63.5
 ? (MO)

TT=14.31

 OPT
f=-3719
TT=73.146
T1=57.13
 OPT
f=-3719
TT=18.465
T1=18.12
 OPT
f=-3719
TT=8.227
T1=5.69
 OPT
f=-3719
TT=43.333
T1=43.06
 OPT
f=-3719
TT=42.424
T1=42.12
 OPT
f=-3719
TT=43.572
T1=43.31
 OPT
f=-3719
TT=41.539
T1=41.25
 OPT
f=-3719
TT=12.974
T1=12.96
 OPT
f=-3719
TT=12.414
T1=12.3



Statisticsbsolo
3.2 Card
(complete)		bsolo
3.2 Cl
(complete)		pb_cplex
2010-06-29
(complete)		PB/CT
0.1
(complete)		PB/CT
0.1 fixed
(complete)		PBPASSolver
2010-06-13
(complete)		SAT4J PB CuttingPlanes
2.2.0 2010-05-26
(complete)		SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		SAT4J PB Resolution
2.2.0 2010-05-26
(complete)		SCIPclp
SCIP 1.2.1.2 with Clp 1.11.1 (Release Version) as LP solver
(complete)		SCIPnone
SCIP 1.2.1.2 without any LP solver
(complete)		SCIPspx
SCIP 1.2.1.2 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		wbo
1.4b
(complete)		wbo
1.4b (fixed)
(complete)
Number of times the solver is able to give the best known answer131424010091413248252600
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)		2216010023301400