PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Routing

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Routing

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (opt) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench nameBest results
on this
instance
bsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-1pb.opb
OPT
f=36
TT=0.003
T1=0
OPT
f=36
TT=0.01
T1=0.01
OPT
f=36
TT=0.006
T1=0
OPT
f=36
TT=0.146
T1=0.04
OPT
f=36
TT=0.156
T1=0.05
OPT
f=36
TT=0.109
T1=0.04
OPT
f=36
TT=0.105
T1=0.04
OPT
f=36
TT=0.056
T1=0.04
OPT
f=36
TT=0.055
T1=0.04
OPT
f=36
TT=0.059
T1=0.04
OPT
f=36
TT=0.059
T1=0.04
OPT
f=36
TT=0.019
T1=0.01
OPT
f=36
TT=0.09
T1=0.04
OPT
f=36
TT=0.074
T1=0.05
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.483
T1=0.25
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.573
T1=0.22
OPT
f=36
TT=0.037
T1=0.03
OPT
f=36
TT=0.019
T1=0.01
OPT
f=36
TT=0.875
T1=1.2
OPT
f=36
TT=0.033
T1=0.03
OPT
f=36
TT=0.833
T1=0.71
OPT
f=36
TT=0.04
T1=0.03
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.109
T1=0.02
OPT
f=36
TT=0.043
T1=0.02
OPT
f=36
TT=0.003
T1=0.01
OPT
f=36
TT=0.004
T1=0.01
OPT
f=36
TT=0.802
T1=0.73
OPT
f=36
TT=0.495
T1=0.25
OPT
f=36
TT=0.575
T1=0.29
OPT
f=36
TT=0.044
T1=0.03
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.042
T1=0.03
OPT
f=36
TT=0.047
T1=0.02
OPT
f=36
TT=0.042
T1=0.02
OPT
f=36
TT=0.003
T1=0.01
OPT
f=36
TT=0.003
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-2pb.opb
OPT
f=36
TT=0.005
T1=0
OPT
f=36
TT=0.01
T1=0.01
OPT
f=36
TT=0.005
T1=0
OPT
f=36
TT=0.154
T1=0.06
OPT
f=36
TT=0.168
T1=0.06
OPT
f=36
TT=0.12
T1=0.05
OPT
f=36
TT=0.107
T1=0.05
OPT
f=36
TT=0.072
T1=0.06
OPT
f=36
TT=0.063
T1=0.05
OPT
f=36
TT=0.071
T1=0.05
OPT
f=36
TT=0.066
T1=0.05
OPT
f=36
TT=0.017
T1=0.01
OPT
f=36
TT=0.102
T1=0.03
OPT
f=36
TT=0.074
T1=0.05
OPT
f=36
TT=0.013
T1=0
OPT
f=36
TT=0.574
T1=0.25
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.606
T1=0.27
OPT
f=36
TT=0.042
T1=0.03
OPT
f=36
TT=0.022
T1=0.02
OPT
f=36
TT=0.994
T1=1.2
OPT
f=36
TT=0.035
T1=0.03
OPT
f=36
TT=0.864
T1=0.72
OPT
f=36
TT=0.046
T1=0.04
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.121
T1=0.02
OPT
f=36
TT=0.048
T1=0.02
OPT
f=36
TT=0.044
T1=0.01
OPT
f=36
TT=0.044
T1=0.01
OPT
f=36
TT=0.834
T1=0.73
OPT
f=36
TT=0.624
T1=0.31
OPT
f=36
TT=0.633
T1=0.31
OPT
f=36
TT=0.054
T1=0.04
OPT
f=36
TT=0.052
T1=0.04
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.061
T1=0.05
OPT
f=36
TT=0.061
T1=0.04
OPT
f=36
TT=0.023
T1=0.01
OPT
f=36
TT=0.024
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-3pb.opb
OPT
f=36
TT=0.004
T1=0
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.015
T1=0
OPT
f=36
TT=0.156
T1=0.04
OPT
f=36
TT=0.173
T1=0.05
OPT
f=36
TT=0.125
T1=0.04
OPT
f=36
TT=0.122
T1=0.04
OPT
f=36
TT=0.058
T1=0.04
OPT
f=36
TT=0.067
T1=0.04
OPT
f=36
TT=0.062
T1=0.04
OPT
f=36
TT=0.064
T1=0.04
OPT
f=36
TT=0.018
T1=0.02
OPT
f=36
TT=0.13
T1=0.02
OPT
f=36
TT=0.07
T1=0.04
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.635
T1=0.29
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.645
T1=0.3
OPT
f=36
TT=0.039
T1=0.03
OPT
f=36
TT=0.021
T1=0.02
OPT
f=36
TT=1.274
T1=1.21
OPT
f=36
TT=0.036
T1=0.03
OPT
f=36
TT=0.963
T1=0.74
OPT
f=36
TT=0.046
T1=0.04
OPT
f=36
TT=0.072
T1=0.07
OPT
f=36
TT=0.135
T1=0.02
OPT
f=36
TT=0.053
T1=0.02
OPT
f=36
TT=0.043
T1=0.01
OPT
f=36
TT=0.043
T1=0.01
OPT
f=36
TT=1.254
T1=0.72
OPT
f=36
TT=0.625
T1=0.31
OPT
f=36
TT=0.646
T1=0.24
OPT
f=36
TT=0.041
T1=0.03
OPT
f=36
TT=0.046
T1=0.04
OPT
f=36
TT=0.051
T1=0.04
OPT
f=36
TT=0.117
T1=0.04
OPT
f=36
TT=0.116
T1=0.04
OPT
f=36
TT=0.023
T1=0.01
OPT
f=36
TT=0.004
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-4pb.opb
OPT
f=36
TT=0.003
T1=0
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.017
T1=0
OPT
f=36
TT=0.18
T1=0.04
OPT
f=36
TT=0.17
T1=0.05
OPT
f=36
TT=0.137
T1=0.04
OPT
f=36
TT=0.113
T1=0.04
OPT
f=36
TT=0.061
T1=0.04
OPT
f=36
TT=0.065
T1=0.04
OPT
f=36
TT=0.064
T1=0.04
OPT
f=36
TT=0.061
T1=0.04
OPT
f=36
TT=0.019
T1=0.01
OPT
f=36
TT=0.105
T1=0.02
OPT
f=36
TT=0.073
T1=0.05
OPT
f=36
TT=0.011
T1=0
OPT
f=36
TT=0.634
T1=0.2
OPT
f=36
TT=0.008
T1=0
OPT
f=36
TT=0.664
T1=0.23
OPT
f=36
TT=0.038
T1=0.03
OPT
f=36
TT=0.02
T1=0.01
OPT
f=36
TT=1.385
T1=1.21
OPT
f=36
TT=0.031
T1=0.02
OPT
f=36
TT=1.234
T1=0.72
OPT
f=36
TT=0.042
T1=0.03
OPT
f=36
TT=0.057
T1=0.05
OPT
f=36
TT=0.148
T1=0.02
OPT
f=36
TT=0.053
T1=0.02
OPT
f=36
TT=0.004
T1=0.01
OPT
f=36
TT=0.003
T1=0.01
OPT
f=36
TT=1.225
T1=0.72
OPT
f=36
TT=0.604
T1=0.21
OPT
f=36
TT=0.613
T1=0.21
OPT
f=36
TT=0.04
T1=0.03
OPT
f=36
TT=0.05
T1=0.04
OPT
f=36
TT=0.045
T1=0.03
OPT
f=36
TT=0.121
T1=0.02
OPT
f=36
TT=0.121
T1=0.02
OPT
f=36
TT=0.004
T1=0.01
OPT
f=36
TT=0.004
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-5pb.opb
OPT
f=34
TT=0.003
T1=0
OPT
f=34
TT=0.014
T1=0.01
OPT
f=34
TT=0.02
T1=0
OPT
f=34
TT=0.2
T1=0.04
OPT
f=34
TT=0.178
T1=0.05
OPT
f=34
TT=0.158
T1=0.04
OPT
f=34
TT=0.138
T1=0.04
OPT
f=34
TT=0.074
T1=0.04
OPT
f=34
TT=0.071
T1=0.04
OPT
f=34
TT=0.072
T1=0.04
OPT
f=34
TT=0.07
T1=0.04
OPT
f=34
TT=0.02
T1=0.02
OPT
f=34
TT=0.177
T1=0.01
OPT
f=34
TT=0.125
T1=0.07
OPT
f=34
TT=0.036
T1=0
OPT
f=34
TT=0.614
T1=0.21
OPT
f=34
TT=0.014
T1=0.01
OPT
f=34
TT=0.664
T1=0.21
OPT
f=34
TT=0.038
T1=0.03
OPT
f=34
TT=0.019
T1=0.02
OPT
f=34
TT=1.334
T1=1.19
OPT
f=34
TT=0.035
T1=0.03
OPT
f=34
TT=1.243
T1=0.72
OPT
f=34
TT=0.043
T1=0.03
OPT
f=34
TT=0.106
T1=0.1
OPT
f=34
TT=0.147
T1=0.01
OPT
f=34
TT=0.058
T1=0.02
OPT
f=34
TT=0.003
T1=0.01
OPT
f=34
TT=0.023
T1=0.01
OPT
f=34
TT=1.314
T1=0.71
OPT
f=34
TT=0.644
T1=0.2
OPT
f=34
TT=0.664
T1=0.29
OPT
f=34
TT=0.04
T1=0.03
OPT
f=34
TT=0.04
T1=0.03
OPT
f=34
TT=0.048
T1=0.04
OPT
f=34
TT=0.203
T1=0.02
OPT
f=34
TT=0.19
T1=0.02
OPT
f=34
TT=0.004
T1=0.01
OPT
f=34
TT=0.003
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-10pb.opb
OPT
f=70
TT=0.078
T1=0.04
OPT
f=70
TT=0.078
T1=0.07
OPT
f=70
TT=0.203
T1=0.1
OPT
f=70
TT=1.523
T1=1.21
OPT
f=70
TT=1.406
T1=1.29
OPT
f=70
TT=1.44
T1=1.15
OPT
f=70
TT=1.271
T1=1
OPT
f=70
TT=0.58
T1=0.27
OPT
f=70
TT=0.629
T1=0.37
OPT
f=70
TT=0.58
T1=0.27
OPT
f=70
TT=0.645
T1=0.38
OPT
f=70
TT=0.416
T1=0.41
OPT
f=70
TT=3.884
T1=2.9
OPT
f=70
TT=0.982
T1=0.4
OPT
f=70
TT=0.206
T1=0.04
OPT
f=70
TT=1.517
T1=0.63
OPT
f=70
TT=0.077
T1=0.07
OPT
f=70
TT=1.625
T1=0.71
OPT
f=70
TT=0.102
T1=0.09
OPT
f=70
TT=0.148
T1=0.14
OPT
f=70
TT=3.823
T1=2.31
OPT
f=70
TT=0.088
T1=0.08
OPT
f=70
TT=3.094
T1=1.32
OPT
f=70
TT=0.11
T1=0.1
OPT
f=70
TT=2.59
T1=2.6
OPT
f=70
TT=1.986
T1=1.77
OPT
f=70
TT=0.531
T1=0.2
OPT
f=70
TT=0.169
T1=0.08
OPT
f=70
TT=0.169
T1=0.08
OPT
f=70
TT=3.043
T1=1.32
OPT
f=70
TT=1.524
T1=0.64
OPT
f=70
TT=1.604
T1=0.72
OPT
f=70
TT=0.374
T1=0.36
OPT
f=70
TT=0.386
T1=0.37
OPT
f=70
TT=0.243
T1=0.23
OPT
f=70
TT=2.474
T1=0.7
OPT
f=70
TT=2.475
T1=0.7
OPT
f=70
TT=0.09
T1=0.08
OPT
f=70
TT=0.09
T1=0.08
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-1pb.opb
OPT
f=62
TT=0.068
T1=0.06
OPT
f=62
TT=0.153
T1=0.14
OPT
f=62
TT=324.629
T1=2.14
OPT
f=62
TT=8.919
T1=3.73
OPT
f=62
TT=7.052
T1=4.28
OPT
f=62
TT=9.429
T1=3.94
OPT
f=62
TT=6.99
T1=4.2
OPT
f=62
TT=3.062
T1=2.7
OPT
f=62
TT=4.325
T1=1.56
OPT
f=62
TT=3.034
T1=2.66
OPT
f=62
TT=4.578
T1=1.76
OPT
f=62
TT=0.237
T1=0.23
OPT
f=62
TT=24.167
T1=22.24
SAT (TO)
f=62
TT=1802.1
T1=20.43
OPT
f=62
TT=10.403
T1=2.24
OPT
f=62
TT=225.733
T1=5.26
OPT
f=62
TT=0.145
T1=0.14
OPT
f=62
TT=1024.88
T1=5.7
OPT
f=62
TT=0.382
T1=0.37
OPT
f=62
TT=0.108
T1=0.1
OPT
f=62
TT=1096.49
T1=15.31
OPT
f=62
TT=0.103
T1=0.09
OPT
f=62
TT=892.736
T1=5.34
OPT
f=62
TT=0.108
T1=0.09
OPT
f=62
TT=10.954
T1=10.95
OPT
f=62
TT=10.14
T1=2.25
OPT
f=62
TT=4.215
T1=1.76
OPT
f=62
TT=0.128
T1=0.06
OPT
f=62
TT=0.127
T1=0.06
OPT
f=62
TT=632.552
T1=33.65
OPT
f=62
TT=197.725
T1=1.35
OPT
f=62
TT=233.528
T1=3.07
OPT
f=62
TT=0.989
T1=0.97
OPT
f=62
TT=1.059
T1=1.04
OPT
f=62
TT=0.897
T1=0.88
? (TO)

TT=1800.1

? (TO)

TT=1800.09

OPT
f=62
TT=0.067
T1=0.06
OPT
f=62
TT=0.068
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-2pb.opb
OPT
f=64
TT=0.066
T1=0.06
OPT
f=64
TT=136.795
T1=60.88
OPT
f=64
TT=27.091
T1=7.17
OPT
f=64
TT=6.776
T1=6.77
OPT
f=64
TT=7.075
T1=5.41
OPT
f=64
TT=6.627
T1=6.62
OPT
f=64
TT=6.94
T1=5.27
OPT
f=64
TT=6.827
T1=5.84
OPT
f=64
TT=5.067
T1=3.4
OPT
f=64
TT=6.51
T1=5.53
OPT
f=64
TT=5.203
T1=3.49
OPT
f=64
TT=271.14
T1=39.54
OPT
f=64
TT=63.878
T1=62.52
OPT
f=64
TT=387.758
T1=58.3
OPT
f=64
TT=26.86
T1=3.52
OPT
f=64
TT=338.45
T1=103.35
OPT
f=64
TT=156.172
T1=141.15
OPT
f=64
TT=158.21
T1=32.94
OPT
f=64
TT=0.336
T1=0.32
OPT
f=64
TT=0.126
T1=0.12
OPT
f=64
TT=155.382
T1=28.42
OPT
f=64
TT=1.077
T1=1.06
OPT
f=64
TT=171.539
T1=34.12
OPT
f=64
TT=0.692
T1=0.67
OPT
f=64
TT=16.218
T1=16.22
OPT
f=64
TT=9.159
T1=9.15
OPT
f=64
TT=11.867
T1=9.44
OPT
f=64
TT=0.128
T1=0.06
OPT
f=64
TT=0.127
T1=0.06
OPT
f=64
TT=133.895
T1=13.95
OPT
f=64
TT=43.456
T1=6.09
OPT
f=64
TT=63.443
T1=17.82
OPT
f=64
TT=0.535
T1=0.52
OPT
f=64
TT=0.636
T1=0.62
OPT
f=64
TT=0.467
T1=0.45
OPT
f=64
TT=677.882
T1=41.78
OPT
f=64
TT=682.207
T1=42.9
OPT
f=64
TT=0.067
T1=0.06
OPT
f=64
TT=0.066
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-3pb.opb
OPT
f=62
TT=0.066
T1=0.06
OPT
f=62
TT=86.475
T1=74.7
OPT
f=62
TT=23.894
T1=18.54
OPT
f=62
TT=24.965
T1=4.9
OPT
f=62
TT=7.777
T1=1.97
OPT
f=62
TT=24.851
T1=5.09
OPT
f=62
TT=7.671
T1=1.91
OPT
f=62
TT=15.124
T1=8.99
OPT
f=62
TT=9.22
T1=4.85
OPT
f=62
TT=14.492
T1=8.61
OPT
f=62
TT=9.359
T1=4.53
OPT
f=62
TT=594.328
T1=37.51
OPT
f=62
TT=66.859
T1=66.7
OPT
f=62
TT=692.284
T1=55.38
OPT
f=62
TT=12.991
T1=3.24
OPT
f=62
TT=272.99
T1=177.21
OPT
f=62
TT=957.988
T1=781.41
OPT
f=62
TT=126.13
T1=26.96
OPT
f=62
TT=0.217
T1=0.21
OPT
f=62
TT=0.107
T1=0.11
OPT
f=62
TT=257.884
T1=76.17
OPT
f=62
TT=0.213
T1=0.2
OPT
f=62
TT=172.818
T1=80.19
OPT
f=62
TT=0.271
T1=0.26
OPT
f=62
TT=42.575
T1=42.58
OPT
f=62
TT=22.379
T1=6.44
OPT
f=62
TT=25.25
T1=14.99
OPT
f=62
TT=0.127
T1=0.08
OPT
f=62
TT=0.128
T1=0.06
OPT
f=62
TT=158.08
T1=46.92
OPT
f=62
TT=60.084
T1=30.88
OPT
f=62
TT=51.816
T1=26.98
OPT
f=62
TT=0.263
T1=0.25
OPT
f=62
TT=0.262
T1=0.25
OPT
f=62
TT=0.162
T1=0.15
OPT
f=62
TT=1215.32
T1=100.72
OPT
f=62
TT=1226.94
T1=107.2
OPT
f=62
TT=0.066
T1=0.06
OPT
f=62
TT=0.066
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-4pb.opb
OPT
f=60
TT=0.067
T1=0.06
OPT
f=60
TT=0.3
T1=0.29
OPT
f=60
TT=226.774
T1=11.31
OPT
f=60
TT=2.733
T1=2.43
OPT
f=60
TT=2.712
T1=2.01
OPT
f=60
TT=2.639
T1=2.42
OPT
f=60
TT=2.568
T1=2.03
OPT
f=60
TT=3.803
T1=3.44
OPT
f=60
TT=2.957
T1=2.23
OPT
f=60
TT=3.731
T1=3.48
OPT
f=60
TT=2.81
T1=2.13
OPT
f=60
TT=0.06
T1=0.06
OPT
f=60
TT=31.444
T1=30.87
OPT
f=60
TT=1602.99
T1=203.01
OPT
f=60
TT=7.682
T1=3.59
OPT
f=60
TT=310.09
T1=31.42
OPT
f=60
TT=0.275
T1=0.27
OPT
f=60
TT=1014.07
T1=48.45
OPT
f=60
TT=0.609
T1=0.59
OPT
f=60
TT=0.11
T1=0.1
OPT
f=60
TT=324.945
T1=28.33
OPT
f=60
TT=0.488
T1=0.47
OPT
f=60
TT=780.52
T1=46.99
OPT
f=60
TT=1.977
T1=1.97
OPT
f=60
TT=15.456
T1=15.45
OPT
f=60
TT=2.684
T1=1.31
OPT
f=60
TT=4.362
T1=3.47
OPT
f=60
TT=0.127
T1=0.06
OPT
f=60
TT=0.128
T1=0.06
OPT
f=60
TT=518.384
T1=33.93
OPT
f=60
TT=164.4
T1=18.53
OPT
f=60
TT=207.332
T1=26.93
OPT
f=60
TT=0.104
T1=0.09
OPT
f=60
TT=0.094
T1=0.08
OPT
f=60
TT=0.102
T1=0.09
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=60
TT=0.067
T1=0.06
OPT
f=60
TT=0.067
T1=0.06
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-5pb.opb
OPT
f=60
TT=0.067
T1=0.06
OPT
f=60
TT=12.054
T1=12.05
OPT
f=60
TT=43.12
T1=29.16
OPT
f=60
TT=2.677
T1=1.84
OPT
f=60
TT=4.968
T1=2.57
OPT
f=60
TT=2.606
T1=1.79
OPT
f=60
TT=4.83
T1=2.46
OPT
f=60
TT=5.413
T1=4.79
OPT
f=60
TT=6.688
T1=4.22
OPT
f=60
TT=5.442
T1=4.81
OPT
f=60
TT=6.487
T1=4.13
OPT
f=60
TT=1.258
T1=1.25
OPT
f=60
TT=16.247
T1=15.87
OPT
f=60
TT=1067.78
T1=466.11
OPT
f=60
TT=30.996
T1=29.58
OPT
f=60
TT=293.128
T1=149.75
OPT
f=60
TT=39.531
T1=39.53
OPT
f=60
TT=157.41
T1=71.52
OPT
f=60
TT=0.161
T1=0.15
OPT
f=60
TT=0.108
T1=0.1
OPT
f=60
TT=256.335
T1=70.73
OPT
f=60
TT=0.262
T1=0.25
OPT
f=60
TT=208.763
T1=66.91
OPT
f=60
TT=0.204
T1=0.19
OPT
f=60
TT=13.821
T1=13.82
OPT
f=60
TT=2.115
T1=0.64
OPT
f=60
TT=5.43
T1=4.98
OPT
f=60
TT=0.128
T1=0.06
OPT
f=60
TT=0.128
T1=0.06
OPT
f=60
TT=251.928
T1=73.6
OPT
f=60
TT=50.195
T1=29.09
OPT
f=60
TT=85.061
T1=61.9
OPT
f=60
TT=0.224
T1=0.21
OPT
f=60
TT=0.221
T1=0.2
OPT
f=60
TT=0.127
T1=0.11
? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=60
TT=0.068
T1=0.06
OPT
f=60
TT=0.067
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-6pb.opb
OPT
f=66
TT=0.067
T1=0.06
OPT
f=66
TT=26.241
T1=5.44
OPT
f=66
TT=5.982
T1=1.01
OPT
f=66
TT=8.532
T1=6.67
OPT
f=66
TT=3.822
T1=1.89
OPT
f=66
TT=8.481
T1=6.61
OPT
f=66
TT=3.725
T1=2.13
OPT
f=66
TT=6.148
T1=4.82
OPT
f=66
TT=1.496
T1=0.81
OPT
f=66
TT=5.845
T1=4.55
OPT
f=66
TT=1.504
T1=0.81
OPT
f=66
TT=104.131
T1=9.97
OPT
f=66
TT=7.582
T1=6
OPT
f=66
TT=82.071
T1=11.49
OPT
f=66
TT=2.552
T1=0.86
OPT
f=66
TT=10.37
T1=3.48
OPT
f=66
TT=38.779
T1=17.13
OPT
f=66
TT=13.312
T1=2.87
OPT
f=66
TT=0.172
T1=0.12
OPT
f=66
TT=0.118
T1=0.12
OPT
f=66
TT=25.729
T1=7.31
OPT
f=66
TT=0.331
T1=0.13
OPT
f=66
TT=24.291
T1=5.83
OPT
f=66
TT=0.331
T1=0.32
OPT
f=66
TT=5.098
T1=5.09
OPT
f=66
TT=11.353
T1=10.42
OPT
f=66
TT=3.44
T1=2.51
OPT
f=66
TT=0.127
T1=0.06
OPT
f=66
TT=0.127
T1=0.06
OPT
f=66
TT=33.598
T1=2.8
OPT
f=66
TT=11.221
T1=1.45
OPT
f=66
TT=10.872
T1=2.02
OPT
f=66
TT=0.34
T1=0.33
OPT
f=66
TT=0.354
T1=0.34
OPT
f=66
TT=0.208
T1=0.19
OPT
f=66
TT=178.334
T1=21.32
OPT
f=66
TT=178.533
T1=21.97
OPT
f=66
TT=0.067
T1=0.06
OPT
f=66
TT=0.067
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-7pb.opb
OPT
f=64
TT=0.068
T1=0.06
OPT
f=64
TT=11.807
T1=7.94
OPT
f=64
TT=3.539
T1=2.32
OPT
f=64
TT=5.454
T1=4.36
OPT
f=64
TT=4.303
T1=3.44
OPT
f=64
TT=5.372
T1=4.28
OPT
f=64
TT=4.165
T1=3.33
OPT
f=64
TT=4.977
T1=4.01
OPT
f=64
TT=2.165
T1=1.32
OPT
f=64
TT=4.799
T1=3.71
OPT
f=64
TT=2.158
T1=1.43
SAT (TO)
f=64
TT=1800.11
T1=25.63
OPT
f=64
TT=18.391
T1=17.9
OPT
f=64
TT=51.921
T1=16.01
OPT
f=64
TT=1.936
T1=0.83
OPT
f=64
TT=6.413
T1=2.91
OPT
f=64
TT=8.7
T1=5.1
OPT
f=64
TT=6.762
T1=3.37
OPT
f=64
TT=0.208
T1=0.2
OPT
f=64
TT=0.103
T1=0.1
OPT
f=64
TT=14.292
T1=6.32
OPT
f=64
TT=0.258
T1=0.25
OPT
f=64
TT=17.441
T1=8.35
OPT
f=64
TT=0.245
T1=0.23
OPT
f=64
TT=9.705
T1=9.7
OPT
f=64
TT=3.089
T1=3.09
OPT
f=64
TT=2.875
T1=2.14
OPT
f=64
TT=0.128
T1=0.06
OPT
f=64
TT=0.128
T1=0.06
OPT
f=64
TT=18.307
T1=5.32
OPT
f=64
TT=7.254
T1=2.2
OPT
f=64
TT=7.343
T1=2.62
OPT
f=64
TT=0.297
T1=0.28
OPT
f=64
TT=0.294
T1=0.28
OPT
f=64
TT=0.185
T1=0.17
OPT
f=64
TT=198.387
T1=38.26
OPT
f=64
TT=197.236
T1=37.79
OPT
f=64
TT=0.068
T1=0.06
OPT
f=64
TT=0.068
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-8pb.opb
OPT
f=36
TT=0.034
T1=0.02
OPT
f=36
TT=9.013
T1=9.01
OPT
f=36
TT=206.285
T1=200.96
OPT
f=36
TT=0.393
T1=0.28
OPT
f=36
TT=0.445
T1=0.27
OPT
f=36
TT=0.341
T1=0.23
OPT
f=36
TT=0.355
T1=0.22
OPT
f=36
TT=0.271
T1=0.21
OPT
f=36
TT=0.939
T1=0.88
OPT
f=36
TT=0.272
T1=0.21
OPT
f=36
TT=0.932
T1=0.88
OPT
f=36
TT=0.091
T1=0.09
OPT
f=36
TT=2.548
T1=2.47
SAT (TO)
f=36
TT=1802.11
T1=559.5
OPT
f=36
TT=4.527
T1=3.83
OPT
f=36
TT=221.73
T1=90.01
OPT
f=36
TT=15.845
T1=15.84
OPT
f=36
TT=713.826
T1=362.82
OPT
f=36
TT=0.067
T1=0.06
OPT
f=36
TT=0.054
T1=0.05
OPT
f=36
TT=152.732
T1=56.8
OPT
f=36
TT=0.057
T1=0.05
OPT
f=36
TT=144.123
T1=26.54
OPT
f=36
TT=0.074
T1=0.06
OPT
f=36
TT=1.585
T1=1.58
OPT
f=36
TT=0.255
T1=0.03
OPT
f=36
TT=0.113
T1=0.03
OPT
f=36
TT=0.066
T1=0.02
OPT
f=36
TT=0.066
T1=0.02
OPT
f=36
TT=159.122
T1=7.8
OPT
f=36
TT=57.29
T1=18.15
OPT
f=36
TT=107.298
T1=66.46
OPT
f=36
TT=0.235
T1=0.22
OPT
f=36
TT=0.192
T1=0.18
OPT
f=36
TT=0.091
T1=0.08
? (TO)

TT=1800.11

? (TO)

TT=1800.02

OPT
f=36
TT=0.035
T1=0.02
OPT
f=36
TT=0.034
T1=0.02
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-9pb.opb
OPT
f=68
TT=0.15
T1=0.14
OPT
f=68
TT=1.631
T1=1.61
OPT
f=68
TT=1.828
T1=0.68
OPT
f=68
TT=7.372
T1=5.96
OPT
f=68
TT=5.447
T1=2.65
OPT
f=68
TT=7.321
T1=5.97
OPT
f=68
TT=5.131
T1=2.36
OPT
f=68
TT=2.422
T1=1.63
OPT
f=68
TT=3.985
T1=3.13
OPT
f=68
TT=2.393
T1=1.6
OPT
f=68
TT=3.909
T1=2.9
SAT (TO)
f=68
TT=1800.1
T1=6.14
OPT
f=68
TT=19.257
T1=13.4
OPT
f=68
TT=25.644
T1=2.79
OPT
f=68
TT=1.67
T1=0.46
OPT
f=68
TT=7.543
T1=2.21
OPT
f=68
TT=1.612
T1=1.59
OPT
f=68
TT=5.292
T1=3.27
OPT
f=68
TT=0.7
T1=0.69
OPT
f=68
TT=0.15
T1=0.15
OPT
f=68
TT=10.996
T1=4.35
OPT
f=68
TT=0.421
T1=0.41
OPT
f=68
TT=9.913
T1=2.33
OPT
f=68
TT=0.264
T1=0.25
OPT
f=68
TT=10.465
T1=10.46
OPT
f=68
TT=13.321
T1=6.15
OPT
f=68
TT=6.698
T1=3.22
OPT
f=68
TT=0.58
T1=0.29
OPT
f=68
TT=0.29
T1=0.14
OPT
f=68
TT=12.352
T1=3.41
OPT
f=68
TT=4.573
T1=2.42
OPT
f=68
TT=4.353
T1=1.52
OPT
f=68
TT=0.426
T1=0.41
OPT
f=68
TT=0.4
T1=0.38
OPT
f=68
TT=0.226
T1=0.21
OPT
f=68
TT=67.86
T1=32.17
OPT
f=68
TT=68.951
T1=33.15
OPT
f=68
TT=0.398
T1=0.39
OPT
f=68
TT=0.378
T1=0.37



Statisticsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
Number of times the solver is able to give the best known answer1515151515151515151501513151501501515151515151515015151501515151111015
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
110000000000000000100000000100000000011