PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category all categories

This page displays the results of the different solvers for each benchmark for category all categories

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (dec) (complete)
clasp 2.0.6-R5325 (opt) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: borg-pb 10.05.30 (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: borg pb-dec-11.04.03 (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
PBPASSolver-CARD.DP 2012-05-28 (complete)
PBPASSolver-CARD.SN 2012-05-28 (complete)
pwbo 2.0 (complete)
pwbo 2.0 (complete)
pwbo 2.0 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
pwbo 2.02 (complete)
pwbo 2.02 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)
wbo 1.72 (complete)

Bench nameBest results
on this
instance
bsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/heinz/
normalized-neos808444.opb
SAT
TT=0.165
T1=0.16
SAT
TT=1.697
T1=1.7
SAT
TT=0.165
T1=0.16
No data? (problem)
TT=0.658

SAT
TT=2.056
T1=2.16
? (problem)
TT=0.674

? (problem)
TT=2.15

? (problem)
TT=0.662

? (problem)
TT=2.14

? (problem)
TT=0.657

? (problem)
TT=1.95

SAT
TT=1.386
T1=1.38
SAT
TT=277.724
T1=277.76
SAT
TT=7.78
T1=7.62
SAT
TT=1.885
T1=1.88
SAT
TT=2.584
T1=1.34
SAT
TT=1.521
T1=1.51
SAT
TT=2.794
T1=1.42
?
TT=1795.72

SAT
TT=1.622
T1=1.69
? (TO)
TT=1800.11

SAT
TT=4.124
T1=1.79
?
TT=1789.84

SAT
TT=50.643
T1=52.19
SAT
TT=4.084
T1=2
?
TT=1796.86

SAT
TT=315.131
T1=315.18
? (problem)
TT=0.606

? (problem)
TT=0.641

? (TO)
TT=1800

? (TO)
TT=1800.07

SAT
TT=0.425
T1=0.41
No dataNo dataNo dataNo dataSAT
TT=0.415
T1=0.4
No dataNo dataSAT
TT=4.712
T1=2.06
SAT
TT=2.294
T1=1.06
SAT
TT=4.103
T1=2.58
SAT
TT=1548.42
T1=1548.55
SAT
TT=1556.93
T1=1557.08
?
TT=1796.91

SAT
TT=2.968
T1=3.06
SAT
TT=2.908
T1=3.03
SAT
TT=0.402
T1=0.39
No dataNo dataSAT
TT=0.354
T1=0.34
/DEC-SMALLINT-LIN/heinz/
normalized-neos-820146.opb



?
TT=1798

? (TO)
TT=1800.02

No data? (problem)
TT=0.185

? (TO)
TT=1800.13

? (problem)
TT=0.195

? (TO)
TT=1800.1

? (problem)
TT=0.18

? (TO)
TT=1800.08

? (problem)
TT=0.174

? (TO)
TT=1800.09

? (TO)
TT=1800.02

? (TO)
TT=1800.03

? (TO)
TT=1800.09

? (TO)
TT=1800.02

? (TO)
TT=1800.03

?
TT=1798

? (TO)
TT=1800.08

? (TO)
TT=1801.97

? (TO)
TT=1800.06

? (TO)
TT=1800.33

? (TO)
TT=1801.04

?
TT=1789.83

? (MO)
TT=388.5

? (TO)
TT=1800.15

?
TT=1796.82

? (TO)
TT=1800.02

? (problem)
TT=0.164

? (problem)
TT=0.17

? (TO)
TT=1800.11

? (TO)
TT=1800

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.96

No dataNo data? (TO)
TT=1800.01

? (TO)
TT=1800.01

? (TO)
TT=1800.1

?
TT=1796.85

?
TT=1796.82

?
TT=1796.75

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1799.61

No dataNo data?
TT=1799.58

/DEC-SMALLINT-LIN/heinz/
normalized-neos-820157.opb



?
TT=1798

? (TO)
TT=1800.03

No data? (problem)
TT=0.009

? (TO)
TT=1800.12

? (problem)
TT=0.012

? (TO)
TT=1800.08

? (problem)
TT=0.008

? (TO)
TT=1800.08

? (problem)
TT=0.01

? (TO)
TT=1800.08

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.03

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1798.01

? (TO)
TT=1800.07

? (TO)
TT=1800.06

? (TO)
TT=1800.13

? (TO)
TT=1800.21

? (TO)
TT=1800.62

?
TT=1789.77

? (MO)
TT=380.25

? (TO)
TT=1800.15

?
TT=1796.78

? (TO)
TT=1800.02

? (problem)
TT=0.009

? (problem)
TT=0.009

? (TO)
TT=1800

? (TO)
TT=1800.08

?
TT=1799.98

No dataNo dataNo dataNo data?
TT=1799.86

No dataNo data? (TO)
TT=1800.94

? (TO)
TT=1800.02

? (TO)
TT=1800.08

?
TT=1796.77

?
TT=1796.76

?
TT=1796.78

? (TO)
TT=1800.1

? (TO)
TT=1800.01

?
TT=1799.93

No dataNo data?
TT=1799.63

/DEC-SMALLINT-LIN/heinz/
normalized-neos-849702.opb
SAT
TT=4.784
T1=4.06
SAT
TT=566.087
T1=566.32
SAT
TT=152.936
T1=152.96
No data? (problem)
TT=0.065

SAT
TT=78.078
T1=78.09
? (problem)
TT=0.061

? (problem)
TT=76.04

? (problem)
TT=0.061

? (problem)
TT=75.66

? (problem)
TT=0.061

? (problem)
TT=79.97

SAT
TT=1169.36
T1=1169.85
SAT
TT=794.849
T1=795.07
SAT
TT=26.389
T1=26.37
SAT
TT=35.484
T1=35.49
SAT
TT=4.784
T1=4.06
SAT
TT=977.272
T1=977.64
SAT
TT=42.427
T1=41.72
SAT
TT=833.204
T1=833.33
SAT
TT=10.691
T1=11.48
? (TO)
TT=1800.36

SAT
TT=257.147
T1=132.93
SAT
TT=1100.5
T1=1100.65
SAT
TT=21.455
T1=21.35
SAT
TT=43.658
T1=21.4
SAT
TT=345.517
T1=345.56
SAT
TT=327.46
T1=327.69
? (problem)
TT=0.061

? (problem)
TT=0.063

? (TO)
TT=1800.01

SAT
TT=510.488
T1=508.06
SAT
TT=55.47
T1=55.54
No dataNo dataNo dataNo dataSAT
TT=129.49
T1=129.51
No dataNo dataSAT
TT=76.353
T1=38.68
SAT
TT=51.547
T1=50.43
SAT
TT=24.421
T1=22.89
SAT
TT=938.062
T1=938.2
SAT
TT=1219.05
T1=1219.22
SAT
TT=1199.95
T1=1200.13
SAT
TT=268.72
T1=268.79
SAT
TT=284.786
T1=284.84
SAT
TT=124.04
T1=124.18
No dataNo dataSAT
TT=111.65
T1=111.74
/DEC-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1096.cudf.paranoid.opb
SAT
TT=0
T1=0
SAT
TT=0.001
T1=0
SAT
TT=0.002
T1=0
No data? (problem)
TT=0.001

SAT
TT=0.028
T1=0.02
? (problem)
TT=0.001

SAT
TT=0.018
T1=0.01
? (problem)
TT=0.002

SAT
TT=0.017
T1=0.01
? (problem)
TT=0.002

SAT
TT=0.016
T1=0.03
SAT
TT=0.001
T1=0
SAT
TT=0
T1=0
SAT
TT=0.013
T1=0.03
SAT
TT=0.002
T1=0
SAT
TT=0.124
T1=0.12
SAT
TT=0
T1=0
SAT
TT=0.125
T1=0.12
SAT
TT=0.009
T1=0
SAT
TT=0.748
T1=1.97
SAT
TT=0.003
T1=0
SAT
TT=0.156
T1=1.14
SAT
TT=0.012
T1=0
SAT
TT=0.473
T1=0.55
SAT
TT=0.165
T1=0.64
SAT
TT=0.015
T1=0.01
SAT
TT=0.003
T1=0
? (problem)
TT=0.001

? (problem)
TT=0.002

SAT
TT=0.066
T1=0.12
SAT
TT=0.062
T1=0.12
SAT
TT=0.001
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.003
T1=0
No dataNo dataSAT
TT=0.163
T1=0.62
SAT
TT=0.143
T1=0.13
SAT
TT=0.187
T1=0.13
SAT
TT=0.011
T1=0
SAT
TT=0.011
T1=0.01
SAT
TT=0.009
T1=0
SAT
TT=0.001
T1=0
SAT
TT=0.002
T1=0
SAT
TT=0.001
T1=0
No dataNo dataSAT
TT=0.001
T1=0
/DEC-SMALLINT-LIN/lopes/
normalized-101.opb
UNSAT
TT=79.04

?
TT=1798.01

UNSAT
TT=79.04

No data? (problem)
TT=1.635

UNSAT
TT=200.008

? (problem)
TT=1.607

UNSAT
TT=207.54

? (problem)
TT=1.636

UNSAT
TT=191.27

? (problem)
TT=1.613

UNSAT
TT=197.81

? (TO)
TT=1800.07

UNSAT
TT=263.7

UNSAT
TT=130.823

UNSAT
TT=531.069

UNSAT
TT=1125.36

?
TT=1798.01

? (TO)
TT=1800.32

?
TT=1795.29

UNSAT
TT=1017.77

? (TO)
TT=1800.04

UNSAT
TT=925.944

?
TT=1790.22

UNSAT
TT=291.312

UNSAT
TT=360.31

? (TO)
TT=1802.03

UNSAT
TT=1504.1

? (problem)
TT=1.514

? (problem)
TT=1.53

? (MO)
TT=373.05

? (MO)
TT=340.29

UNSAT
TT=261.33

No dataNo dataNo dataNo dataUNSAT
TT=282.485

No dataNo dataUNSAT
TT=648.247

UNSAT
TT=369.36

UNSAT
TT=1103.83

?
TT=1797.51

?
TT=1797.33

?
TT=1797.29

? (TO)
TT=1800.06

? (TO)
TT=1800.04

UNSAT
TT=257.226

No dataNo dataUNSAT
TT=272.98

/DEC-SMALLINT-LIN/lopes/
normalized-107.opb
SAT
TT=7.837
T1=7.81
SAT
TT=51.427
T1=51.43
SAT
TT=29.773
T1=29.77
No data? (problem)
TT=2.119

SAT
TT=7.837
T1=7.81
? (problem)
TT=2.101

? (problem)
TT=8.29

? (problem)
TT=2.093

? (problem)
TT=7.67

? (problem)
TT=2.107

? (problem)
TT=7.83

SAT
TT=42.051
T1=42.05
SAT
TT=23.141
T1=23.13
SAT
TT=48.954
T1=47.88
SAT
TT=13.175
T1=13.18
SAT
TT=53.108
T1=49.87
SAT
TT=39.841
T1=39.86
SAT
TT=43.985
T1=41.02
?
TT=1794.1

SAT
TT=61.132
T1=59.87
? (TO)
TT=1800.17

SAT
TT=61.277
T1=29.9
?
TT=1790.09

SAT
TT=184.237
T1=184.7
SAT
TT=29.23
T1=14.92
?
TT=1797.1

SAT
TT=13.661
T1=13.64
? (problem)
TT=1.979

? (problem)
TT=1.991

? (MO)
TT=365.24

? (MO)
TT=332.75

SAT
TT=11.301
T1=11.32
No dataNo dataNo dataNo dataSAT
TT=9.433
T1=9.41
No dataNo dataSAT
TT=55.376
T1=27.72
SAT
TT=18.74
T1=17.42
SAT
TT=43.776
T1=41.83
?
TT=1797.32

?
TT=1797.29

?
TT=1797.14

SAT
TT=134.036
T1=134.02
SAT
TT=111.325
T1=111.34
SAT
TT=10.692
T1=10.7
No dataNo dataSAT
TT=10.119
T1=10.13
/DEC-SMALLINT-LIN/lopes/
normalized-112.opb



?
TT=1798.14

? (TO)
TT=1800.06

No data? (problem)
TT=6.917

? (TO)
TT=1800.05

? (problem)
TT=6.954

? (TO)
TT=1800

? (problem)
TT=6.894

? (TO)
TT=1800.03

? (problem)
TT=6.912

? (TO)
TT=1800.05

? (TO)
TT=1800.04

? (TO)
TT=1800.04

? (TO)
TT=1800.05

? (TO)
TT=1800.02

? (TO)
TT=1800.08

?
TT=1798.03

? (TO)
TT=1800.74

? (TO)
TT=1802.04

? (TO)
TT=1800.02

?
TT=1799.5

? (TO)
TT=1800.12

?
TT=1792.26

? (MO)
TT=322.9

? (TO)
TT=1800.75

? (TO)
TT=1802.06

? (TO)
TT=1800.09

? (problem)
TT=6.505

? (problem)
TT=6.538

? (MO)
TT=373.24

? (MO)
TT=426.05

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.51

No dataNo data? (TO)
TT=1800.08

? (TO)
TT=1800.02

? (TO)
TT=1800.03

? (TO)
TT=1802.07

? (TO)
TT=1800.14

? (TO)
TT=1802.05

? (TO)
TT=1800.04

? (TO)
TT=1800.02

?
TT=1799.51

No dataNo data?
TT=1799.93

/DEC-SMALLINT-LIN/lopes/
normalized-116.opb



? (TO)
TT=1800.09

? (TO)
TT=1800.08

No data? (problem)
TT=9.25

? (TO)
TT=1800.11

? (problem)
TT=9.252

? (TO)
TT=1800.1

? (problem)
TT=9.506

? (TO)
TT=1800.01

? (problem)
TT=9.248

? (TO)
TT=1800.02

? (TO)
TT=1800.08

? (TO)
TT=1800.12

? (TO)
TT=1800.05

? (TO)
TT=1800.07

? (TO)
TT=1800.05

?
TT=1798.17

? (TO)
TT=1800.07

? (TO)
TT=1802.11

? (TO)
TT=1800.05

?
TT=1799.95

? (TO)
TT=1800.86

?
TT=1795.62

? (MO)
TT=344.31

? (TO)
TT=1800.8

? (TO)
TT=1800.04

? (TO)
TT=1800.08

? (problem)
TT=8.749

? (problem)
TT=8.775

? (MO)
TT=491.42

? (MO)
TT=368.27

?
TT=1799.82

No dataNo dataNo dataNo data?
TT=1799.44

No dataNo data? (TO)
TT=1800.12

? (TO)
TT=1800.7

? (TO)
TT=1800.86

? (TO)
TT=1800.12

? (TO)
TT=1800.15

? (TO)
TT=1802.09

? (TO)
TT=1800.08

? (TO)
TT=1800.15

?
TT=1799.76

No dataNo data?
TT=1799.47

/DEC-SMALLINT-LIN/lopes/
normalized-117.opb
SAT
TT=4.809
T1=4.95
SAT
TT=58.099
T1=58.1
SAT
TT=4.809
T1=4.95
No data? (problem)
TT=2.103

SAT
TT=16.525
T1=16.48
? (problem)
TT=2.111

? (problem)
TT=16.39

? (problem)
TT=2.098

? (problem)
TT=15.63

? (problem)
TT=2.107

? (problem)
TT=16.23

SAT
TT=36.775
T1=36.78
SAT
TT=24.569
T1=24.57
SAT
TT=89.969
T1=88.85
SAT
TT=20.124
T1=20.12
SAT
TT=76.09
T1=72.5
SAT
TT=61.487
T1=61.49
SAT
TT=64.215
T1=60.82
?
TT=1793.83

SAT
TT=51.816
T1=50.74
?
TT=1799.05

SAT
TT=184.665
T1=91.27
?
TT=1790.06

SAT
TT=142.037
T1=142.85
SAT
TT=72.951
T1=36.96
?
TT=1797.49

SAT
TT=14.252
T1=14.24
? (problem)
TT=1.99

? (problem)
TT=2.101

? (MO)
TT=381.43

? (MO)
TT=419.78

SAT
TT=19.886
T1=19.87
No dataNo dataNo dataNo dataSAT
TT=19.329
T1=19.32
No dataNo dataSAT
TT=60.464
T1=30.29
SAT
TT=20.02
T1=18.23
SAT
TT=50.787
T1=48.69
?
TT=1797.2

?
TT=1797.38

?
TT=1797.5

SAT
TT=108.917
T1=108.93
SAT
TT=129.271
T1=129.3
SAT
TT=20.17
T1=20.2
No dataNo dataSAT
TT=18.147
T1=18.14
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/lopes/
normalized-120.opb



?
TT=1798.02

? (TO)
TT=1800.06

No data? (problem)
TT=10.274

? (TO)
TT=1800.04

? (problem)
TT=10.19

? (TO)
TT=1800.09

? (problem)
TT=10.252

? (TO)
TT=1800.03

? (problem)
TT=10.351

? (TO)
TT=1653.38

? (TO)
TT=1800.04

? (TO)
TT=1800.11

? (TO)
TT=1800.03

? (TO)
TT=1800.08

? (TO)
TT=1800.06

?
TT=1798.03

? (TO)
TT=1800.12

? (TO)
TT=1802.07

? (TO)
TT=1800.12

? (TO)
TT=1800.02

? (TO)
TT=1800.45

?
TT=1793.74

? (MO)
TT=479.72

? (TO)
TT=1800.04

? (TO)
TT=1802.24

? (TO)
TT=1800.11

? (problem)
TT=9.7

? (problem)
TT=9.696

? (MO)
TT=469.14

? (MO)
TT=339.45

?
TT=1799.48

No dataNo dataNo dataNo data?
TT=1799.55

No dataNo data? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.61

? (TO)
TT=1802.15

? (TO)
TT=1802.13

? (TO)
TT=1802.08

? (TO)
TT=1800.15

? (TO)
TT=1800.11

?
TT=1799.51

No dataNo data?
TT=1799.68

/DEC-SMALLINT-LIN/lopes/
normalized-122.opb



?
TT=1798.04

? (TO)
TT=1800.09

No data? (problem)
TT=10.281

? (TO)
TT=1800.07

? (problem)
TT=10.261

? (TO)
TT=1800.05

? (problem)
TT=10.276

? (TO)
TT=1800.07

? (problem)
TT=10.295

? (TO)
TT=1800.07

? (TO)
TT=1800.05

? (TO)
TT=1800.1

? (TO)
TT=1800.08

? (TO)
TT=1800.05

? (TO)
TT=1800.09

?
TT=1798.09

? (TO)
TT=1800.93

? (TO)
TT=1802.08

? (TO)
TT=1800.08

?
TT=1799.72

? (TO)
TT=1800.19

?
TT=1795.97

? (MO)
TT=491.88

? (TO)
TT=1800.02

? (TO)
TT=1802.09

? (TO)
TT=1800.02

? (problem)
TT=9.688

? (problem)
TT=9.647

? (MO)
TT=472.02

? (MO)
TT=432.6

?
TT=1799.51

No dataNo dataNo dataNo data?
TT=1799.49

No dataNo data? (TO)
TT=1800.65

? (TO)
TT=1800.01

? (TO)
TT=1800.02

? (TO)
TT=1802.1

? (TO)
TT=1800.15

? (TO)
TT=1802.11

? (TO)
TT=1800.09

? (TO)
TT=1800.12

?
TT=1799.85

No dataNo data?
TT=1799.89

/DEC-SMALLINT-LIN/lopes/
normalized-123.opb



?
TT=1798.03

? (TO)
TT=1800.07

No data? (problem)
TT=7.941

? (TO)
TT=1800.05

? (problem)
TT=7.915

? (TO)
TT=1800.05

? (problem)
TT=8.074

? (TO)
TT=1800.01

? (problem)
TT=7.839

? (TO)
TT=1800.02

? (TO)
TT=1800.09

? (TO)
TT=1800.02

? (TO)
TT=1800.08

? (TO)
TT=1800.06

? (TO)
TT=1800.52

?
TT=1798.02

? (TO)
TT=1800.24

? (TO)
TT=1801.62

? (TO)
TT=1800.04

?
TT=1799.66

? (TO)
TT=1801.16

? (TO)
TT=1802.07

? (MO)
TT=335.02

? (TO)
TT=1800.7

? (TO)
TT=1800.07

? (TO)
TT=1800.01

? (problem)
TT=7.407

? (problem)
TT=7.37

? (MO)
TT=472.19

? (MO)
TT=367.15

?
TT=1799.76

No dataNo dataNo dataNo data?
TT=1799.48

No dataNo data? (TO)
TT=1800.12

? (TO)
TT=1800.76

? (TO)
TT=1800.09

? (TO)
TT=1802.05

? (TO)
TT=1800.04

? (TO)
TT=1802.07

? (TO)
TT=1800.03

? (TO)
TT=1800.05

?
TT=1799.53

No dataNo data?
TT=1799.86

/DEC-SMALLINT-LIN/lopes/
normalized-129.opb



?
TT=1798.21

? (TO)
TT=1800.1

No data? (problem)
TT=10.323

? (TO)
TT=1800.08

? (problem)
TT=10.254

? (TO)
TT=1800.04

? (problem)
TT=10.257

? (TO)
TT=1800.07

? (problem)
TT=10.292

? (TO)
TT=1800.03

? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1800.09

? (TO)
TT=1800.49

? (TO)
TT=1800.6

?
TT=1798.03

? (TO)
TT=1800.47

? (TO)
TT=1802.06

? (TO)
TT=1800.08

?
TT=1799.7

? (TO)
TT=1800.15

?
TT=1794.79

? (MO)
TT=487.6

? (TO)
TT=1800.04

? (TO)
TT=1800.09

? (TO)
TT=1800.02

? (problem)
TT=9.649

? (problem)
TT=9.632

? (MO)
TT=404.54

? (MO)
TT=379.87

?
TT=1799.81

No dataNo dataNo dataNo data?
TT=1799.42

No dataNo data? (TO)
TT=1800.58

? (TO)
TT=1800.86

? (TO)
TT=1800.04

? (TO)
TT=1802.06

? (TO)
TT=1802.14

? (TO)
TT=1802.15

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.47

No dataNo data?
TT=1799.49

/DEC-SMALLINT-LIN/lopes/
normalized-137.opb



? (TO)
TT=1800.1

? (TO)
TT=1800.08

No data? (problem)
TT=10.281

? (TO)
TT=1800.02

? (problem)
TT=10.34

? (TO)
TT=1800.05

? (problem)
TT=10.246

? (TO)
TT=1800.02

? (problem)
TT=10.266

? (TO)
TT=1706.31

? (TO)
TT=1800.04

? (TO)
TT=1800.11

? (TO)
TT=1800.01

? (TO)
TT=1800.12

? (TO)
TT=1800.07

?
TT=1798.03

? (TO)
TT=1801.54

? (TO)
TT=1802.09

? (TO)
TT=1800.02

?
TT=1799.75

? (TO)
TT=1800.08

?
TT=1793.01

? (MO)
TT=488.5

? (TO)
TT=1800.79

?
TT=1799.95

? (TO)
TT=1800.04

? (problem)
TT=9.717

? (problem)
TT=9.642

? (MO)
TT=370.77

? (MO)
TT=366.02

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo data? (TO)
TT=1800.08

? (TO)
TT=1800.92

? (TO)
TT=1800.89

? (TO)
TT=1800.17

? (TO)
TT=1800.07

? (TO)
TT=1802.08

? (TO)
TT=1800.16

? (TO)
TT=1800.1

?
TT=1799.55

No dataNo data?
TT=1799.56

/DEC-SMALLINT-LIN/lopes/
normalized-146.opb



?
TT=1798.03

? (TO)
TT=1800.07

No data? (problem)
TT=10.286

? (TO)
TT=1800.08

? (problem)
TT=20.495

? (TO)
TT=1800.02

? (problem)
TT=10.409

? (TO)
TT=1800.04

? (problem)
TT=10.312

? (TO)
TT=1800.09

? (TO)
TT=1800.11

? (TO)
TT=1800.12

?
TT=745.401

? (TO)
TT=1800.12

? (TO)
TT=1800.08

?
TT=1798.05

? (TO)
TT=1800.09

? (TO)
TT=1802.07

? (TO)
TT=1800.04

?
TT=1799.65

? (TO)
TT=1800.98

?
TT=1794.21

? (MO)
TT=478.98

? (TO)
TT=1800.16

? (TO)
TT=1802.05

? (TO)
TT=1800.04

? (problem)
TT=9.672

? (problem)
TT=9.634

? (MO)
TT=360.63

? (MO)
TT=366.16

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.59

No dataNo data? (TO)
TT=1800.12

? (TO)
TT=1800.06

? (TO)
TT=1800.04

? (TO)
TT=1800.05

? (TO)
TT=1800.14

? (TO)
TT=1802.06

? (TO)
TT=1800.06

? (TO)
TT=1800.05

?
TT=1799.62

No dataNo data?
TT=1799.48

/DEC-SMALLINT-LIN/lopes/
normalized-153.opb



?
TT=1798.01

? (TO)
TT=1800.08

No data? (problem)
TT=11.748

? (TO)
TT=1800.01

? (problem)
TT=11.721

? (TO)
TT=1800.05

? (problem)
TT=11.721

? (TO)
TT=1800.04

? (problem)
TT=11.692

? (TO)
TT=1800.04

? (TO)
TT=1800.07

? (TO)
TT=1800.08

? (TO)
TT=1800.04

? (TO)
TT=1800.03

? (TO)
TT=1800.07

?
TT=1798.08

? (TO)
TT=1800.65

? (TO)
TT=1802.12

? (TO)
TT=1800.07

?
TT=1800.02

? (TO)
TT=1800.05

?
TT=1795.12

? (MO)
TT=501.16

? (TO)
TT=1800.09

? (TO)
TT=1802.09

? (TO)
TT=1800.05

? (problem)
TT=11.087

? (problem)
TT=11.039

? (MO)
TT=392.4

? (MO)
TT=339.1

?
TT=1799.77

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo data? (TO)
TT=1800.87

? (TO)
TT=1801.03

? (TO)
TT=1800.62

? (TO)
TT=1802.1

? (TO)
TT=1802.09

? (TO)
TT=1800.1

? (TO)
TT=1800.05

? (TO)
TT=1800.07

?
TT=1799.55

No dataNo data?
TT=1799.49

/DEC-SMALLINT-LIN/lopes/
normalized-164.opb
SAT
TT=97.538
T1=97.58
SAT
TT=215.398
T1=215.46
SAT
TT=228.226
T1=228.27
No data? (problem)
TT=5.683

? (TO)
TT=1800.09

? (problem)
TT=5.618

? (TO)
TT=1800.04

? (problem)
TT=5.621

? (TO)
TT=1800.06

? (problem)
TT=5.647

? (TO)
TT=1800.07

SAT
TT=194.712
T1=194.75
SAT
TT=149.645
T1=149.66
SAT
TT=477.725
T1=474.42
SAT
TT=97.538
T1=97.58
SAT
TT=402.753
T1=384.7
SAT
TT=202.565
T1=202.63
SAT
TT=426.658
T1=407.16
?
TT=1797.26

SAT
TT=1050.17
T1=997.85
?
TT=1799.38

? (TO)
TT=1800.75

?
TT=1798.21

? (MO)
TT=258.19

SAT
TT=473.502
T1=240.04
? (TO)
TT=1800.04

SAT
TT=103.069
T1=103.05
? (problem)
TT=5.326

? (problem)
TT=5.358

? (MO)
TT=356.64

? (MO)
TT=411.02

SAT
TT=202.15
T1=202.26
No dataNo dataNo dataNo dataSAT
TT=159.93
T1=160.03
No dataNo dataSAT
TT=700.867
T1=353.12
SAT
TT=363.17
T1=360.28
SAT
TT=415.42
T1=412.72
?
TT=1797.98

?
TT=1799.07

? (TO)
TT=1800.04

? (TO)
TT=1800.03

? (TO)
TT=1800.08

SAT
TT=189.63
T1=189.75
No dataNo dataSAT
TT=184.239
T1=184.26
/DEC-SMALLINT-LIN/lopes/
normalized-167.opb



?
TT=1798.1

? (TO)
TT=1800.1

No data? (problem)
TT=22.951

? (problem)
TT=114.416

? (problem)
TT=22.758

? (problem)
TT=117.338

? (problem)
TT=22.876

? (problem)
TT=115.995

? (problem)
TT=22.822

? (problem)
TT=119.512

? (TO)
TT=1800.11

? (TO)
TT=1800.02

? (TO)
TT=1800.06

? (TO)
TT=1800.02

? (TO)
TT=1800.06

?
TT=1798.1

? (TO)
TT=1800.06

? (TO)
TT=1802.13

? (TO)
TT=1800.09

? (TO)
TT=1800.01

? (TO)
TT=1800.17

?
TT=1795.88

? (MO)
TT=503.57

? (TO)
TT=1800.18

? (TO)
TT=1802.17

? (TO)
TT=1800.08

? (problem)
TT=21.565

? (problem)
TT=21.778

? (MO)
TT=391.66

? (MO)
TT=395.28

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.83

No dataNo data? (TO)
TT=1800.12

? (TO)
TT=1800.65

? (TO)
TT=1800.09

? (TO)
TT=1802.18

? (TO)
TT=1802.26

? (TO)
TT=1802.18

? (TO)
TT=1800.25

? (TO)
TT=1800.16

?
TT=1799.61

No dataNo data?
TT=1799.6

/DEC-SMALLINT-LIN/lopes/
normalized-170.opb
SAT
TT=58.491
T1=58.48
SAT
TT=208.766
T1=208.78
SAT
TT=335.331
T1=335.39
No data? (problem)
TT=5.676

? (TO)
TT=1800.09

? (problem)
TT=5.626

? (TO)
TT=1800.08

? (problem)
TT=5.635

? (TO)
TT=1800.08

? (problem)
TT=5.615

? (TO)
TT=1800.1

SAT
TT=195.895
T1=195.91
SAT
TT=120.969
T1=121
SAT
TT=428.298
T1=425.02
SAT
TT=116.215
T1=116.24
SAT
TT=447.786
T1=429.39
SAT
TT=210.126
T1=210.18
SAT
TT=423.06
T1=403.17
?
TT=1798.42

SAT
TT=1092.25
T1=1036.43
?
TT=1800.09

SAT
TT=1334.19
T1=656.78
?
TT=1791.98

? (MO)
TT=255.6

SAT
TT=510.998
T1=258.29
?
TT=1799.7

SAT
TT=93.129
T1=93.11
? (problem)
TT=5.331

? (problem)
TT=5.316

? (MO)
TT=393.76

? (MO)
TT=336.57

SAT
TT=82.07
T1=82.12
No dataNo dataNo dataNo dataSAT
TT=58.491
T1=58.48
No dataNo dataSAT
TT=666.065
T1=336.18
SAT
TT=265.95
T1=263.17
SAT
TT=427.57
T1=424.64
? (TO)
TT=1800.1

? (TO)
TT=1800.03

?
TT=1798.13

SAT
TT=1681.44
T1=1681.7
SAT
TT=1704.3
T1=1704.58
SAT
TT=66.57
T1=66.59
No dataNo dataSAT
TT=77.18
T1=77.2
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/lopes/
normalized-172.opb



?
TT=1798.06

? (TO)
TT=1800.05

No data? (problem)
TT=60.669

? (problem)
TT=179.702

? (problem)
TT=60.591

? (problem)
TT=181.303

? (problem)
TT=60.619

? (problem)
TT=181.522

? (problem)
TT=60.79

? (problem)
TT=183.797

? (TO)
TT=1800.1

? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.02

? (TO)
TT=1800.01

?
TT=1798.02

? (TO)
TT=1800.08

? (TO)
TT=1802.43

? (TO)
TT=1800.06

? (exit code)
TT=114.872

?
TT=1092.81

? (MO)
TT=1474.68

? (MO)
TT=330.69

? (TO)
TT=1800.54

Signal
TT=140.845

? (TO)
TT=1800.01

? (problem)
TT=57.219

? (problem)
TT=57.469

? (MO)
TT=839.76

? (MO)
TT=823.75

?
TT=1799.45

No dataNo dataNo dataNo data?
TT=1799.44

No dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.11

? (TO)
TT=1800.09

Signal
TT=334.683

Signal
TT=270.785

? (exit code)
TT=1415.54

? (TO)
TT=1800.5

? (TO)
TT=1800.53

?
TT=1799.44

No dataNo data?
TT=1799.44

/DEC-SMALLINT-LIN/lopes/
normalized-175.opb



?
TT=1798.02

? (TO)
TT=1800.01

No data? (problem)
TT=52.061

? (problem)
TT=170.029

? (problem)
TT=52.148

? (problem)
TT=172.433

? (problem)
TT=51.965

? (problem)
TT=166.323

? (problem)
TT=51.978

? (problem)
TT=172.284

? (TO)
TT=1800.08

? (TO)
TT=1800.07

?
TT=1402.12

? (TO)
TT=1800.09

? (TO)
TT=1800.48

?
TT=1798.09

? (TO)
TT=1800.03

? (TO)
TT=1802.49

? (TO)
TT=1800.01

? (exit code)
TT=159.583

?
TT=940.53

? (TO)
TT=1802.41

? (MO)
TT=296.71

? (TO)
TT=1800.46

? (MO)
TT=1045.26

? (TO)
TT=1800.09

? (problem)
TT=49.335

? (problem)
TT=49.206

? (MO)
TT=530.53

? (MO)
TT=515.24

?
TT=1799.86

No dataNo dataNo dataNo data?
TT=1799.88

No dataNo data? (TO)
TT=1800.54

? (TO)
TT=1800.22

? (TO)
TT=1800

? (MO)
TT=244.226

? (MO)
TT=214.305

Signal
TT=580.846

? (TO)
TT=1800.46

? (TO)
TT=1800.39

?
TT=1799.46

No dataNo data?
TT=1799.28

/DEC-SMALLINT-LIN/lopes/
normalized-180.opb



?
TT=1798.1

? (TO)
TT=1800.08

No data? (problem)
TT=67.371

? (MO)
TT=80.09

? (problem)
TT=67.332

? (MO)
TT=85.27

? (problem)
TT=67.747

? (MO)
TT=81.67

? (problem)
TT=67.752

? (MO)
TT=81.99

? (TO)
TT=1800.03

? (TO)
TT=1800.14

? (TO)
TT=1800.03

? (TO)
TT=1800.11

? (TO)
TT=1800.41

?
TT=1798.14

? (TO)
TT=1800.03

? (TO)
TT=1802.45

? (TO)
TT=1800.07

? (exit code)
TT=58.291

? (exit code)
TT=1259.07

? (MO)
TT=146.36

? (MO)
TT=328.99

? (TO)
TT=1800.06

? (exit code)
TT=141.561

? (TO)
TT=1800.02

? (problem)
TT=63.7

? (problem)
TT=64.715

? (MO)
TT=929.49

? (MO)
TT=647.2

?
TT=1799.46

No dataNo dataNo dataNo data?
TT=1799.81

No dataNo data? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1800.09

? (exit code)
TT=362.002

? (exit code)
TT=261.592

? (exit code)
TT=654.007

? (TO)
TT=1800.56

? (TO)
TT=1800.57

?
TT=1799.38

No dataNo data?
TT=1799.2

/DEC-SMALLINT-LIN/lopes/
normalized-185.opb
SAT
TT=2.537
T1=2.53
SAT
TT=460.003
T1=460.14
SAT
TT=98.462
T1=98.47
No data? (problem)
TT=0.367

SAT
TT=23.318
T1=23.31
? (problem)
TT=0.364

SAT
TT=22.973
T1=22.96
? (problem)
TT=0.363

SAT
TT=23.143
T1=23.18
? (problem)
TT=0.363

SAT
TT=22.897
T1=22.89
SAT
TT=222.706
T1=222.78
SAT
TT=2.537
T1=2.53
SAT
TT=1186.56
T1=1186.56
SAT
TT=19.424
T1=19.42
? (TO)
TT=1800.24

SAT
TT=534.63
T1=534.79
SAT
TT=24.671
T1=23.24
?
TT=1794.97

SAT
TT=68.597
T1=65.55
? (TO)
TT=1800.02

SAT
TT=71.924
T1=35.71
?
TT=1789.84

SAT
TT=103.436
T1=106.67
SAT
TT=14.283
T1=6.81
?
TT=1797.03

SAT
TT=6.947
T1=6.94
? (problem)
TT=0.342

? (problem)
TT=0.34

SAT
TT=791.139
T1=789.24
SAT
TT=361.032
T1=358.82
SAT
TT=27.396
T1=27.39
No dataNo dataNo dataNo dataSAT
TT=21.966
T1=21.97
No dataNo dataSAT
TT=96.52
T1=48.45
SAT
TT=154.35
T1=152.91
SAT
TT=42.599
T1=41.42
?
TT=1796.9

?
TT=1796.85

?
TT=1796.86

SAT
TT=1026.4
T1=1026.57
SAT
TT=830.425
T1=830.67
SAT
TT=23.172
T1=23.17
No dataNo dataSAT
TT=22.438
T1=22.44
/DEC-SMALLINT-LIN/lopes/
normalized-20.opb
SAT
TT=204.343
T1=104.45
?
TT=1798.03

SAT
TT=619.509
T1=619.62
No data? (problem)
TT=1.855

SAT
TT=660.835
T1=661.67
? (problem)
TT=1.845

SAT
TT=667.766
T1=673.31
? (problem)
TT=1.851

SAT
TT=689.002
T1=689.07
? (problem)
TT=1.848

SAT
TT=660.285
T1=661.27
? (TO)
TT=1800.13

SAT
TT=401.203
T1=401.31
? (TO)
TT=1800.09

?
TT=1790.78

? (TO)
TT=1800.59

?
TT=1798

? (TO)
TT=1801

?
TT=1794.7

? (TO)
TT=1800.09

?
TT=1799.16

SAT
TT=1781.42
T1=887.04
?
TT=1790.13

? (MO)
TT=305.69

SAT
TT=1641.77
T1=826.74
?
TT=1797.31

SAT
TT=738.8
T1=739.09
? (problem)
TT=1.746

? (problem)
TT=1.745

? (MO)
TT=365

? (MO)
TT=342.3

?
TT=1799.95

No dataNo dataNo dataNo data?
TT=1799.59

No dataNo dataSAT
TT=204.343
T1=104.45
? (TO)
TT=1800.42

? (TO)
TT=1800.56

?
TT=1797.46

?
TT=1797.36

?
TT=1797.21

? (TO)
TT=1800.05

? (TO)
TT=1800.09

?
TT=1799.64

No dataNo data?
TT=1799.49

/DEC-SMALLINT-LIN/lopes/
normalized-21.opb
UNSAT
TT=949.823

?
TT=1798.07

UNSAT
TT=1318.9

No data? (problem)
TT=1.465

UNSAT
TT=1693.82

? (problem)
TT=1.484

? (TO)
TT=1800.04

? (problem)
TT=1.451

UNSAT
TT=1699

? (problem)
TT=1.454

UNSAT
TT=1705.68

? (TO)
TT=1800.1

UNSAT
TT=979.232

UNSAT
TT=949.823

? (TO)
TT=1800.03

? (TO)
TT=1800.08

?
TT=1798.03

? (TO)
TT=1800.9

?
TT=1794.37

? (TO)
TT=1800.05

?
TT=1799.05

? (TO)
TT=1801.12

?
TT=1790.17

? (MO)
TT=301.18

? (TO)
TT=1800.65

?
TT=1797.13

UNSAT
TT=1752.14

? (problem)
TT=1.367

? (problem)
TT=1.36

? (TO)
TT=1800.03

UNSAT
TT=1492.85

?
TT=1799.59

No dataNo dataNo dataNo dataUNSAT
TT=1729.43

No dataNo data? (TO)
TT=1800.74

? (TO)
TT=1800.05

? (TO)
TT=1800.07

?
TT=1797.12

?
TT=1797.92

?
TT=1797.2

? (exit code)
TT=1609.84

? (TO)
TT=1800.07

?
TT=1799.56

No dataNo dataUNSAT
TT=1688.97

/DEC-SMALLINT-LIN/lopes/
normalized-31.opb
SAT
TT=203.957
T1=203.95
?
TT=1798.05

SAT
TT=342.334
T1=342.41
No data? (problem)
TT=1.869

SAT
TT=220.213
T1=220.35
? (problem)
TT=1.845

SAT
TT=220.575
T1=220.56
? (problem)
TT=1.853

SAT
TT=211.392
T1=211.38
? (problem)
TT=1.853

SAT
TT=203.957
T1=203.95
? (TO)
TT=1800.12

SAT
TT=860.642
T1=860.85
SAT
TT=1381.37
T1=1380.64
SAT
TT=427.169
T1=427.27
? (TO)
TT=1800.39

?
TT=1798.01

? (TO)
TT=1800.29

?
TT=1796.83

? (TO)
TT=1800.03

?
TT=1799.19

? (TO)
TT=1801.13

?
TT=1797.06

? (MO)
TT=307.86

? (TO)
TT=1800.19

?
TT=1797.19

SAT
TT=331.747
T1=331.84
? (problem)
TT=1.744

? (problem)
TT=1.753

? (MO)
TT=373.92

? (MO)
TT=351.3

SAT
TT=339.964
T1=340.01
No dataNo dataNo dataNo dataSAT
TT=301.68
T1=301.87
No dataNo data? (TO)
TT=1800.16

SAT
TT=649.91
T1=646.97
? (TO)
TT=1800.02

?
TT=1797.34

?
TT=1797.33

?
TT=1797.33

? (TO)
TT=1800.04

? (TO)
TT=1800.08

SAT
TT=334.314
T1=334.36
No dataNo dataSAT
TT=361.28
T1=361.42
/DEC-SMALLINT-LIN/lopes/
normalized-47.opb



?
TT=1798.02

? (TO)
TT=1800.02

No data? (problem)
TT=2.061

? (TO)
TT=1800.08

? (problem)
TT=2.075

? (TO)
TT=1800.06

? (problem)
TT=2.05

? (TO)
TT=1800.08

? (problem)
TT=2.061

? (TO)
TT=1800.09

? (TO)
TT=1800.05

? (TO)
TT=1800.03

? (TO)
TT=1800.05

? (TO)
TT=1800.09

? (TO)
TT=1800.05

?
TT=1798.17

? (TO)
TT=1801.09

?
TT=1794.66

? (TO)
TT=1800.06

?
TT=1799

? (TO)
TT=1801.15

?
TT=1790.61

? (MO)
TT=273.68

? (TO)
TT=1800.75

?
TT=1797.38

? (TO)
TT=1800.04

? (problem)
TT=1.938

? (problem)
TT=1.94

? (MO)
TT=398.44

? (MO)
TT=359.12

?
TT=1799.56

No dataNo dataNo dataNo data?
TT=1799.48

No dataNo data? (TO)
TT=1800.11

? (TO)
TT=1800.53

? (TO)
TT=1800.61

?
TT=1797.65

?
TT=1797.29

?
TT=1797.3

? (TO)
TT=1800.1

? (TO)
TT=1800.06

?
TT=1799.49

No dataNo data?
TT=1799.81

/DEC-SMALLINT-LIN/lopes/
normalized-48.opb
SAT
TT=155.412
T1=155.45
?
TT=1798.15

SAT
TT=155.412
T1=155.45
No data? (problem)
TT=2.049

SAT
TT=331.619
T1=332.22
? (problem)
TT=2.043

SAT
TT=350.011
T1=350.01
? (problem)
TT=2.045

SAT
TT=315.238
T1=315.26
? (problem)
TT=2.041

SAT
TT=320.168
T1=320.17
? (TO)
TT=1800.06

SAT
TT=417.023
T1=417.06
? (TO)
TT=1800.08

? (TO)
TT=1800.04

? (TO)
TT=1800.04

Wrong UNSAT
TT=1012.77

? (TO)
TT=1800.23

?
TT=1794.5

? (TO)
TT=1800.12

? (TO)
TT=1800.02

? (TO)
TT=1801.23

?
TT=1793.56

? (MO)
TT=350.83

? (TO)
TT=1800.1

?
TT=1797.38

? (TO)
TT=1800.09

? (problem)
TT=1.918

? (problem)
TT=1.922

? (MO)
TT=372.79

? (MO)
TT=332.23

SAT
TT=834.481
T1=834.62
No dataNo dataNo dataNo dataSAT
TT=874.495
T1=874.48
No dataNo data? (TO)
TT=1800.1

SAT
TT=691.271
T1=687.77
? (TO)
TT=1800.62

?
TT=1797.4

?
TT=1797.45

?
TT=1797.52

? (TO)
TT=1800.02

? (TO)
TT=1800.07

SAT
TT=870.672
T1=870.75
No dataNo dataSAT
TT=927.239
T1=927.4
/DEC-SMALLINT-LIN/lopes/
normalized-61.opb



?
TT=1798.07

? (TO)
TT=1800.1

No data? (problem)
TT=2.056

? (TO)
TT=1800.06

? (problem)
TT=2.067

? (TO)
TT=1800.08

? (problem)
TT=2.062

? (TO)
TT=1800.05

? (problem)
TT=2.067

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.03

?
TT=1430.02

? (TO)
TT=1800.12

? (TO)
TT=1800.59

?
TT=1798.03

? (TO)
TT=1800.26

?
TT=1799.61

? (TO)
TT=1800.11

?
TT=1799.1

? (TO)
TT=1800.91

?
TT=1791.18

? (MO)
TT=362.55

? (TO)
TT=1800.61

?
TT=1797.36

? (TO)
TT=1800.11

? (problem)
TT=1.953

? (problem)
TT=1.928

? (MO)
TT=361.08

? (MO)
TT=337.96

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.82

No dataNo data? (TO)
TT=1800.12

? (TO)
TT=1800.03

? (TO)
TT=1800.64

?
TT=1797.74

?
TT=1797.31

?
TT=1797.67

? (TO)
TT=1800.11

? (TO)
TT=1800.07

?
TT=1799.59

No dataNo data?
TT=1799.51

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/lopes/
normalized-70.opb



?
TT=1798

? (TO)
TT=1800.09

No data? (problem)
TT=2.599

? (TO)
TT=1800.07

? (problem)
TT=2.618

? (TO)
TT=1800.08

? (problem)
TT=2.596

? (TO)
TT=1800.06

? (problem)
TT=2.59

? (TO)
TT=1800.04

? (TO)
TT=1800.04

? (TO)
TT=1800.12

? (TO)
TT=1800.08

? (TO)
TT=1800.06

? (TO)
TT=1800.02

?
TT=1798.01

? (TO)
TT=1800.32

?
TT=1799.26

? (TO)
TT=1800

?
TT=1799.18

? (TO)
TT=1800.17

?
TT=1790.51

? (MO)
TT=422.44

? (TO)
TT=1800.01

? (TO)
TT=1801.47

? (TO)
TT=1800.05

? (problem)
TT=2.433

? (problem)
TT=2.438

? (MO)
TT=403.8

? (MO)
TT=433.39

?
TT=1799.83

No dataNo dataNo dataNo data?
TT=1799.81

No dataNo data? (TO)
TT=1800.06

? (TO)
TT=1800.04

? (TO)
TT=1800.04

?
TT=1797.76

?
TT=1797.64

?
TT=1797.41

? (TO)
TT=1800.03

? (TO)
TT=1800.08

?
TT=1799.53

No dataNo data?
TT=1799.59

/DEC-SMALLINT-LIN/lopes/
normalized-73.opb



?
TT=1798.11

? (TO)
TT=1800.11

No data? (problem)
TT=1.613

? (TO)
TT=1800.1

? (problem)
TT=1.604

? (TO)
TT=1800.1

? (problem)
TT=1.611

? (TO)
TT=1800.08

? (problem)
TT=1.631

? (TO)
TT=1800.08

? (TO)
TT=1800.09

? (TO)
TT=1800.02

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.41

?
TT=1798.02

? (TO)
TT=1800.29

?
TT=1794.51

? (TO)
TT=1800.13

?
TT=1799.09

? (TO)
TT=1800.48

?
TT=1796.65

? (MO)
TT=297.84

? (TO)
TT=1800.2

?
TT=1797.25

? (TO)
TT=1800.08

? (problem)
TT=1.515

? (problem)
TT=1.514

? (MO)
TT=397.12

? (MO)
TT=333.65

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.81

No dataNo data? (TO)
TT=1800.64

? (TO)
TT=1800.1

? (TO)
TT=1800.62

?
TT=1797.48

?
TT=1797.34

?
TT=1797.3

? (TO)
TT=1800.05

? (TO)
TT=1800.04

?
TT=1799.88

No dataNo data?
TT=1799.57

/DEC-SMALLINT-LIN/lopes/
normalized-76.opb
SAT
TT=1408.44
T1=1408.76
?
TT=1798.06

? (TO)
TT=1800.11

No data? (problem)
TT=2.596

? (TO)
TT=1800.03

? (problem)
TT=2.598

? (TO)
TT=1800.08

? (problem)
TT=2.592

? (TO)
TT=1800.09

? (problem)
TT=2.62

? (TO)
TT=1800.05

? (TO)
TT=1800.04

SAT
TT=1408.44
T1=1408.76
? (TO)
TT=1800.03

? (TO)
TT=1800.05

? (TO)
TT=1800.1

?
TT=1798.02

? (TO)
TT=1800.29

?
TT=1795.48

? (TO)
TT=1800.02

?
TT=1799.25

? (TO)
TT=1800.05

?
TT=1794.19

? (MO)
TT=420.57

? (TO)
TT=1800.17

?
TT=1797.45

? (TO)
TT=1800.07

? (problem)
TT=2.473

? (problem)
TT=2.466

? (MO)
TT=483.55

? (MO)
TT=334.42

?
TT=1799.58

No dataNo dataNo dataNo data?
TT=1799.57

No dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.63

? (TO)
TT=1800.57

?
TT=1798.04

?
TT=1797.96

?
TT=1797.94

? (TO)
TT=1800.14

? (TO)
TT=1800.07

?
TT=1799.95

No dataNo data?
TT=1799.52

/DEC-SMALLINT-LIN/lopes/
normalized-91.opb



?
TT=1798.02

? (TO)
TT=1800.1

No data? (problem)
TT=2.058

? (TO)
TT=1800.08

? (problem)
TT=2.046

? (TO)
TT=1800.06

? (problem)
TT=2.059

? (TO)
TT=1800.08

? (problem)
TT=2.053

? (TO)
TT=1800.01

? (TO)
TT=1800.02

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.12

? (TO)
TT=1800.43

?
TT=1798.01

? (TO)
TT=1800.41

?
TT=1794.87

? (TO)
TT=1800.09

?
TT=1799.29

? (TO)
TT=1800.8

?
TT=1790.49

? (MO)
TT=363.45

? (TO)
TT=1800.2

?
TT=1797.21

? (TO)
TT=1800.07

? (problem)
TT=1.938

? (problem)
TT=1.939

? (MO)
TT=385.61

? (MO)
TT=333.04

?
TT=1799.52

No dataNo dataNo dataNo data?
TT=1799.87

No dataNo data? (TO)
TT=1800.16

? (TO)
TT=1800.04

? (TO)
TT=1800.07

?
TT=1797.5

?
TT=1797.48

?
TT=1797.36

? (TO)
TT=1800.1

? (TO)
TT=1800.1

?
TT=1799.54

No dataNo data?
TT=1799.5

/DEC-SMALLINT-LIN/lopes/
normalized-99.opb
UNSAT
TT=28.096

?
TT=1798

UNSAT
TT=51.173

No data? (problem)
TT=1.608

UNSAT
TT=77.172

? (problem)
TT=1.61

UNSAT
TT=80.25

? (problem)
TT=1.607

UNSAT
TT=81.15

? (problem)
TT=1.608

UNSAT
TT=78.19

? (TO)
TT=1800.08

UNSAT
TT=152.147

UNSAT
TT=36.734

UNSAT
TT=28.096

? (TO)
TT=1800.1

?
TT=1798.05

? (TO)
TT=1800.27

?
TT=1794.63

UNSAT
TT=28.244

?
TT=1799.06

UNSAT
TT=1153.44

?
TT=1793.17

? (MO)
TT=305.44

UNSAT
TT=521.635

?
TT=1797.22

UNSAT
TT=462.905

? (problem)
TT=1.52

? (problem)
TT=1.512

? (MO)
TT=362.77

? (MO)
TT=331.09

UNSAT
TT=201.26

No dataNo dataNo dataNo dataUNSAT
TT=171.714

No dataNo dataUNSAT
TT=640.79

UNSAT
TT=367.12

UNSAT
TT=878.92

?
TT=1797.4

?
TT=1797.43

?
TT=1797.22

? (TO)
TT=1800.04

? (TO)
TT=1800.09

UNSAT
TT=196.33

No dataNo dataUNSAT
TT=171.629

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12028_8-sat.opb
SAT
TT=33.288
T1=15.38
SAT
TT=825.744
T1=825.96
SAT
TT=74.57
T1=74.57
No data? (problem)
TT=0.605

SAT
TT=170.874
T1=170.88
? (problem)
TT=0.618

? (problem)
TT=160.02

? (problem)
TT=0.585

? (problem)
TT=169.96

? (problem)
TT=0.588

? (problem)
TT=142.6

? (TO)
TT=1800.07

? (TO)
TT=1800.11

SAT
TT=156.515
T1=156.17
SAT
TT=889.576
T1=889.74
SAT
TT=308.99
T1=306.14
SAT
TT=254.032
T1=254.05
SAT
TT=150.79
T1=148.35
?
TT=1794.15

SAT
TT=47.354
T1=46.55
? (TO)
TT=1800.21

SAT
TT=582.517
T1=291.61
?
TT=1789.84

SAT
TT=313.161
T1=312.83
SAT
TT=471.153
T1=236.85
?
TT=1796.87

? (TO)
TT=1800.1

? (problem)
TT=0.619

? (problem)
TT=0.587

? (TO)
TT=1800.03

? (TO)
TT=1800.05

SAT
TT=50.07
T1=50.13
No dataNo dataNo dataNo dataSAT
TT=80.38
T1=80.47
No dataNo dataSAT
TT=33.288
T1=15.38
SAT
TT=166.569
T1=164.22
SAT
TT=158.65
T1=156.76
?
TT=1796.84

?
TT=1796.86

?
TT=1796.89

SAT
TT=339.646
T1=339.74
SAT
TT=300.275
T1=300.33
SAT
TT=75.48
T1=75.56
No dataNo dataSAT
TT=75.591
T1=75.69
/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12032_3-unsat.opb
UNSAT
TT=282.212

?
TT=1798.01

? (TO)
TT=1800.09

No data? (problem)
TT=1.058

? (TO)
TT=1800.1

? (problem)
TT=1.163

? (TO)
TT=1800.07

? (problem)
TT=1.058

? (TO)
TT=1800.06

? (problem)
TT=1.08

? (TO)
TT=1800.06

? (TO)
TT=1800.04

? (TO)
TT=1800.12

? (TO)
TT=1800.1

? (TO)
TT=1800.04

? (TO)
TT=1800.03

?
TT=1798.02

? (TO)
TT=1800.29

UNSAT
TT=539.464

? (TO)
TT=1800.01

UNSAT
TT=1379.99

? (TO)
TT=1801.21

UNSAT
TT=547.274

UNSAT
TT=1576.3

? (TO)
TT=1800.12

UNSAT
TT=428.668

? (TO)
TT=1800.09

? (problem)
TT=1.102

? (problem)
TT=1.103

? (TO)
TT=1800.03

? (TO)
TT=1800.02

?
TT=1799.8

No dataNo dataNo dataNo data?
TT=1799.92

No dataNo data? (TO)
TT=1800.78

? (TO)
TT=1800.02

? (TO)
TT=1800.08

UNSAT
TT=315.275

UNSAT
TT=282.212

UNSAT
TT=532.083

? (TO)
TT=1800.07

? (TO)
TT=1800.05

?
TT=1799.47

No dataNo data?
TT=1799.53

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12035_4-sat.opb
SAT
TT=0.077
T1=0.06
SAT
TT=0.813
T1=0.81
SAT
TT=0.077
T1=0.06
No data? (problem)
TT=1.168

SAT
TT=15.373
T1=15.35
? (problem)
TT=1.283

? (problem)
TT=15.08

? (problem)
TT=1.191

? (problem)
TT=13.27

? (problem)
TT=1.12

? (problem)
TT=12.92

SAT
TT=0.845
T1=0.84
SAT
TT=39.293
T1=19.69
SAT
TT=3.48
T1=3.12
SAT
TT=4.666
T1=4.66
SAT
TT=2.485
T1=1.14
SAT
TT=0.85
T1=0.84
SAT
TT=2.263
T1=1.03
SAT
TT=222.555
T1=222.48
SAT
TT=1.703
T1=1.82
SAT
TT=24.424
T1=23.74
SAT
TT=4.384
T1=2.13
?
TT=1790.28

SAT
TT=1.866
T1=1.95
SAT
TT=3.704
T1=1.56
?
TT=1796.84

SAT
TT=15.894
T1=15.89
? (problem)
TT=1.253

? (problem)
TT=1.154

? (TO)
TT=1800.06

? (TO)
TT=1800.04

SAT
TT=0.304
T1=0.29
No dataNo dataNo dataNo dataSAT
TT=0.299
T1=0.28
No dataNo dataSAT
TT=4.353
T1=1.7
SAT
TT=2.254
T1=1.04
SAT
TT=2.264
T1=1.08
SAT
TT=160.926
T1=160.83
SAT
TT=159.007
T1=158.91
SAT
TT=294.864
T1=294.79
SAT
TT=1.647
T1=1.62
SAT
TT=1.64
T1=1.61
SAT
TT=0.279
T1=0.26
No dataNo dataSAT
TT=0.283
T1=0.27
/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12038_3-sat.opb



?
TT=1798.07

? (TO)
TT=1800.09

No data? (problem)
TT=2.117

? (TO)
TT=1800.04

? (problem)
TT=2.064

? (TO)
TT=1803.97

? (problem)
TT=2.132

? (TO)
TT=1800.04

? (problem)
TT=2.007

? (TO)
TT=1800.04

? (TO)
TT=1800.1

? (TO)
TT=1800.1

? (TO)
TT=1800.01

? (TO)
TT=1800.05

? (TO)
TT=1800.37

?
TT=1798.01

? (TO)
TT=1800.54

?
TT=1794.58

? (TO)
TT=1800.09

?
TT=1798.82

? (TO)
TT=1801.21

?
TT=1791.27

? (MO)
TT=1530.96

? (TO)
TT=1800.13

? (TO)
TT=1801

? (TO)
TT=1800.07

? (problem)
TT=2.087

? (problem)
TT=2.029

? (TO)
TT=1800.07

? (TO)
TT=1800.1

?
TT=1799.49

No dataNo dataNo dataNo data?
TT=1799.46

No dataNo data? (TO)
TT=1800.72

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1797.06

?
TT=1797.05

?
TT=1797.14

? (TO)
TT=1800.02

? (TO)
TT=1800.07

?
TT=1799.56

No dataNo data?
TT=1799.44

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12038_7-unsat.opb
UNSAT
TT=17.631

?
TT=1798

? (TO)
TT=1800.1

No data? (problem)
TT=1.828

? (TO)
TT=1800.09

? (problem)
TT=1.835

? (TO)
TT=1800.09

? (problem)
TT=1.775

? (TO)
TT=1800.05

? (problem)
TT=1.826

? (TO)
TT=1800.05

? (TO)
TT=1800.03

? (TO)
TT=1800.05

? (TO)
TT=1800.06

? (TO)
TT=1800.05

? (TO)
TT=1800.47

?
TT=1798.01

? (TO)
TT=1800.28

UNSAT
TT=25.507

? (TO)
TT=1800.01

UNSAT
TT=324.23

? (TO)
TT=1801.16

UNSAT
TT=24.639

UNSAT
TT=332.538

? (TO)
TT=1800.03

UNSAT
TT=17.631

? (TO)
TT=1800.05

? (problem)
TT=1.858

? (problem)
TT=1.8

? (TO)
TT=1800.01

? (TO)
TT=1800.04

?
TT=1799.51

No dataNo dataNo dataNo data?
TT=1799.84

No dataNo data? (TO)
TT=1800.69

? (TO)
TT=1800.09

? (TO)
TT=1800.45

UNSAT
TT=21.651

UNSAT
TT=22.647

UNSAT
TT=25.428

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1799.81

No dataNo data?
TT=1799.51

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12039_7-sat.opb



?
TT=1798.02

? (TO)
TT=1800.1

No data? (problem)
TT=1.962

? (TO)
TT=1800.09

? (problem)
TT=1.865

? (TO)
TT=1800.05

? (problem)
TT=2.104

? (TO)
TT=1800.04

? (problem)
TT=1.74

? (TO)
TT=1800.07

? (TO)
TT=1800.07

? (TO)
TT=1800.08

? (TO)
TT=1800.07

? (TO)
TT=1800.02

? (TO)
TT=1800.06

?
TT=1798.01

? (TO)
TT=1800.09

?
TT=1794.24

? (TO)
TT=1800.09

? (TO)
TT=1800.34

? (TO)
TT=1800.83

?
TT=1789.85

? (MO)
TT=344.29

? (TO)
TT=1800.72

?
TT=1796.88

? (TO)
TT=1800.07

? (problem)
TT=1.96

? (problem)
TT=1.85

? (TO)
TT=1800.02

? (TO)
TT=1800.05

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo data? (TO)
TT=1800.62

? (TO)
TT=1800.31

? (TO)
TT=1800.52

?
TT=1796.88

?
TT=1796.93

?
TT=1796.88

? (TO)
TT=1800.05

? (TO)
TT=1800.04

?
TT=1799.87

No dataNo data?
TT=1799.88

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12046_2-sat.opb



?
TT=1798.01

? (TO)
TT=1800.02

No data? (problem)
TT=0.87

? (TO)
TT=1800.11

? (problem)
TT=0.886

? (TO)
TT=1800.08

? (problem)
TT=0.856

? (TO)
TT=1800.08

? (problem)
TT=0.903

? (TO)
TT=1800.05

? (TO)
TT=1800.12

? (TO)
TT=1800.07

?
TT=1783.68

? (TO)
TT=1800.08

? (TO)
TT=1800.01

?
TT=1798.06

? (TO)
TT=1800.35

?
TT=1794.67

? (TO)
TT=1800.04

?
TT=1799.03

? (TO)
TT=1800.04

?
TT=1790.36

? (MO)
TT=938.84

? (TO)
TT=1800.73

?
TT=1797.22

? (TO)
TT=1800.07

? (problem)
TT=0.848

? (problem)
TT=0.837

? (TO)
TT=1800.05

? (TO)
TT=1800.08

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.49

No dataNo data? (TO)
TT=1800.66

? (TO)
TT=1800.92

? (TO)
TT=1800.46

?
TT=1797.86

?
TT=1797.7

?
TT=1797.63

? (TO)
TT=1800.08

? (TO)
TT=1800.08

?
TT=1799.55

No dataNo data?
TT=1799.58

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12047_6-sat.opb



?
TT=1798.03

? (TO)
TT=1800.02

No data? (problem)
TT=0.703

? (TO)
TT=1800.12

? (problem)
TT=0.703

? (TO)
TT=1800.08

? (problem)
TT=0.708

? (TO)
TT=1800.05

? (problem)
TT=0.676

? (TO)
TT=1800.06

? (TO)
TT=1800.04

? (TO)
TT=1800.03

? (TO)
TT=1800.12

? (TO)
TT=1800.03

? (TO)
TT=1800.48

?
TT=1798.01

? (TO)
TT=1800.4

?
TT=1794.5

? (TO)
TT=1800.09

?
TT=1798.8

? (TO)
TT=1800.77

?
TT=1793.25

? (MO)
TT=1627.55

? (TO)
TT=1800.75

?
TT=1796.95

? (TO)
TT=1800.07

? (problem)
TT=0.674

? (problem)
TT=0.672

? (TO)
TT=1800.03

? (TO)
TT=1800.08

?
TT=1799.5

No dataNo dataNo dataNo data?
TT=1799.57

No dataNo data? (TO)
TT=1800.03

? (TO)
TT=1800.44

? (TO)
TT=1800.01

?
TT=1796.96

?
TT=1797.04

?
TT=1796.99

? (TO)
TT=1800.08

? (TO)
TT=1800.07

?
TT=1799.55

No dataNo data?
TT=1799.52

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j1204_7-sat.opb
SAT
TT=0.055
T1=0.04
SAT
TT=0.543
T1=0.54
SAT
TT=0.055
T1=0.04
No data? (problem)
TT=0.292

SAT
TT=2.499
T1=2.49
? (problem)
TT=0.295

? (problem)
TT=4.969

? (problem)
TT=0.29

? (problem)
TT=2.502

? (problem)
TT=0.293

? (problem)
TT=2.321

SAT
TT=0.481
T1=0.47
SAT
TT=0.935
T1=0.92
SAT
TT=2.535
T1=2.27
SAT
TT=2.698
T1=2.69
SAT
TT=2.105
T1=0.89
SAT
TT=0.559
T1=0.55
SAT
TT=1.984
T1=0.78
SAT
TT=44.123
T1=44.03
SAT
TT=1.515
T1=1.63
SAT
TT=0.962
T1=0.52
SAT
TT=2.533
T1=1.77
SAT
TT=3.52
T1=3.45
SAT
TT=1.408
T1=1.49
SAT
TT=3.024
T1=1.37
SAT
TT=3.683
T1=3.58
SAT
TT=0.149
T1=0.22
? (problem)
TT=0.276

? (problem)
TT=0.285

SAT
TT=134.101
T1=129.96
SAT
TT=122.187
T1=118.73
SAT
TT=0.189
T1=0.17
No dataNo dataNo dataNo dataSAT
TT=0.179
T1=0.17
No dataNo dataSAT
TT=3.544
T1=1.49
SAT
TT=2.054
T1=0.85
SAT
TT=1.863
T1=0.83
SAT
TT=3.503
T1=3.4
SAT
TT=3.725
T1=3.63
SAT
TT=80.514
T1=80.43
SAT
TT=1.076
T1=1.05
SAT
TT=1.07
T1=1.05
SAT
TT=0.173
T1=0.16
No dataNo dataSAT
TT=0.178
T1=0.17
/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12048_4-unsat.opb
UNSAT
TT=33.915

?
TT=1797.9

UNSAT
TT=159.529

No data? (problem)
TT=0.672

UNSAT
TT=618.611

? (problem)
TT=0.696

UNSAT
TT=594.05

? (problem)
TT=0.679

UNSAT
TT=646.05

? (problem)
TT=0.701

UNSAT
TT=709.93

? (TO)
TT=1800.06

? (TO)
TT=1800.04

?
TT=47.186

? (TO)
TT=1800.06

? (TO)
TT=1800.52

?
TT=1798.01

UNSAT
TT=1082.26

UNSAT
TT=48.307

? (TO)
TT=1800.03

UNSAT
TT=341.934

? (TO)
TT=1800.05

UNSAT
TT=51.365

UNSAT
TT=577.842

UNSAT
TT=1771.48

UNSAT
TT=33.915

? (TO)
TT=1800.11

? (problem)
TT=0.7

? (problem)
TT=0.748

? (TO)
TT=1800.04

? (TO)
TT=1800

UNSAT
TT=663.42

No dataNo dataNo dataNo dataUNSAT
TT=788.644

No dataNo dataUNSAT
TT=1362.11

? (TO)
TT=1800.08

UNSAT
TT=554.01

UNSAT
TT=44

UNSAT
TT=43.775

UNSAT
TT=59.251

? (TO)
TT=1800.03

? (TO)
TT=1800.08

UNSAT
TT=797.504

No dataNo dataUNSAT
TT=709.6

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12049_6-unsat.opb
UNSAT
TT=0.033

UNSAT
TT=0.278

UNSAT
TT=0.033

No data? (problem)
TT=0.831

UNSAT
TT=1.059

? (problem)
TT=0.818

UNSAT
TT=1.037

? (problem)
TT=0.793

UNSAT
TT=0.998

? (problem)
TT=0.775

UNSAT
TT=1.002

UNSAT
TT=0.3

UNSAT
TT=0.57

?
TT=1.633

UNSAT
TT=4.451

UNSAT
TT=1.368

UNSAT
TT=0.3

UNSAT
TT=0.965

UNSAT
TT=2.744

UNSAT
TT=0.612

UNSAT
TT=0.695

UNSAT
TT=1.85

UNSAT
TT=2.688

UNSAT
TT=2.096

UNSAT
TT=1.304

UNSAT
TT=2.975

UNSAT
TT=0.077

? (problem)
TT=0.867

? (problem)
TT=0.788

UNSAT
TT=262.16

UNSAT
TT=226.48

UNSAT
TT=0.255

No dataNo dataNo dataNo dataUNSAT
TT=0.239

No dataNo dataUNSAT
TT=1.953

UNSAT
TT=1.073

UNSAT
TT=0.996

UNSAT
TT=2.726

UNSAT
TT=2.549

UNSAT
TT=2.507

UNSAT
TT=1.884

UNSAT
TT=1.882

UNSAT
TT=0.227

No dataNo dataUNSAT
TT=0.233

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j1205_3-unsat.opb
UNSAT
TT=0.016

UNSAT
TT=0.139

UNSAT
TT=0.016

No data? (problem)
TT=0.261

UNSAT
TT=0.324

? (problem)
TT=0.279

UNSAT
TT=0.307

? (problem)
TT=0.269

UNSAT
TT=0.302

? (problem)
TT=0.264

UNSAT
TT=0.316

UNSAT
TT=0.153

UNSAT
TT=0.266

UNSAT
TT=2.217

UNSAT
TT=1.229

UNSAT
TT=1.215

UNSAT
TT=0.127

UNSAT
TT=0.875

UNSAT
TT=1.247

UNSAT
TT=0.671

UNSAT
TT=0.279

UNSAT
TT=1.243

UNSAT
TT=1.352

UNSAT
TT=1.243

UNSAT
TT=1.456

UNSAT
TT=1.389

UNSAT
TT=0.038

? (problem)
TT=0.296

? (problem)
TT=0.252

UNSAT
TT=100.512

UNSAT
TT=75.345

UNSAT
TT=0.111

No dataNo dataNo dataNo dataUNSAT
TT=0.112

No dataNo dataUNSAT
TT=1.594

UNSAT
TT=0.886

UNSAT
TT=0.844

UNSAT
TT=1.217

UNSAT
TT=1.013

UNSAT
TT=1.094

UNSAT
TT=0.873

UNSAT
TT=0.916

UNSAT
TT=0.115

No dataNo dataUNSAT
TT=0.107

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j12059_3-unsat.opb
UNSAT
TT=0.027

UNSAT
TT=0.281

UNSAT
TT=0.027

No data? (problem)
TT=1.817

UNSAT
TT=2.176

? (problem)
TT=1.87

UNSAT
TT=2.183

? (problem)
TT=1.823

UNSAT
TT=2.097

? (problem)
TT=1.958

UNSAT
TT=2.092

UNSAT
TT=0.298

UNSAT
TT=0.478

UNSAT
TT=3.968

UNSAT
TT=3.097

UNSAT
TT=1.216

UNSAT
TT=0.28

UNSAT
TT=0.965

UNSAT
TT=2.354

UNSAT
TT=0.641

UNSAT
TT=1.057

UNSAT
TT=1.785

UNSAT
TT=2.52

UNSAT
TT=1.909

UNSAT
TT=1.215

UNSAT
TT=2.872

UNSAT
TT=0.068

? (problem)
TT=2.202

? (problem)
TT=1.83

UNSAT
TT=556.684

UNSAT
TT=338.688

UNSAT
TT=0.239

No dataNo dataNo dataNo dataUNSAT
TT=0.221

No dataNo dataUNSAT
TT=1.735

UNSAT
TT=1.244

UNSAT
TT=0.923

UNSAT
TT=2.426

UNSAT
TT=2.29

UNSAT
TT=2.443

UNSAT
TT=1.632

UNSAT
TT=1.645

UNSAT
TT=0.229

No dataNo dataUNSAT
TT=0.229

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j1206_6-sat.opb



?
TT=1798.01

? (TO)
TT=1800.11

No data? (problem)
TT=0.698

? (TO)
TT=1800.06

? (problem)
TT=0.676

? (TO)
TT=1800.06

? (problem)
TT=0.685

? (TO)
TT=1800.07

? (problem)
TT=0.695

? (TO)
TT=1800.08

? (TO)
TT=1800.07

? (TO)
TT=1800.09

? (TO)
TT=1800.13

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1798.03

? (TO)
TT=1800.3

? (TO)
TT=1802.02

? (TO)
TT=1800.09

?
TT=1798.95

? (TO)
TT=1800.13

?
TT=1790.31

? (MO)
TT=984.28

? (TO)
TT=1800.21

? (TO)
TT=1802.03

? (TO)
TT=1800.08

? (problem)
TT=0.698

? (problem)
TT=0.735

? (TO)
TT=1800.04

? (TO)
TT=1800.08

?
TT=1799.52

No dataNo dataNo dataNo data?
TT=1799.78

No dataNo data? (TO)
TT=1800.14

? (TO)
TT=1800.52

? (TO)
TT=1800.01

?
TT=1797.48

?
TT=1797.4

?
TT=1797.4

? (TO)
TT=1800.07

? (TO)
TT=1800.08

?
TT=1799.56

No dataNo data?
TT=1799.55

/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j1206_8-unsat.opb
UNSAT
TT=20.43

UNSAT
TT=1217.87

UNSAT
TT=20.43

No data? (problem)
TT=0.62

UNSAT
TT=104.129

? (problem)
TT=0.604

UNSAT
TT=125.85

? (problem)
TT=0.644

UNSAT
TT=104.065

? (problem)
TT=0.614

UNSAT
TT=107.65

? (TO)
TT=1800.03

? (TO)
TT=1800.09

UNSAT
TT=63.779

UNSAT
TT=379.117

UNSAT
TT=99.42

UNSAT
TT=1490.12

UNSAT
TT=59.444

UNSAT
TT=233.107

UNSAT
TT=41.484

?
TT=1798.95

UNSAT
TT=134.645

UNSAT
TT=491.422

UNSAT
TT=34.075

UNSAT
TT=120.484

UNSAT
TT=155.177

? (TO)
TT=1800.12

? (problem)
TT=0.602

? (problem)
TT=0.633

? (TO)
TT=1800.05

? (TO)
TT=1800.08

UNSAT
TT=40.205

No dataNo dataNo dataNo dataUNSAT
TT=42.27

No dataNo dataUNSAT
TT=151.84

UNSAT
TT=94.57

UNSAT
TT=54.728

UNSAT
TT=121.594

UNSAT
TT=123.135

UNSAT
TT=160.75

UNSAT
TT=510.253

UNSAT
TT=622.524

UNSAT
TT=40.09

No dataNo dataUNSAT
TT=39.613

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
oliveras/j120/
normalized-j1208_6-sat.opb
SAT
TT=19.772
T1=18.15
SAT
TT=690.059
T1=690.26
SAT
TT=45.627
T1=45.62
No data? (problem)
TT=0.536

? (TO)
TT=1800.1

? (problem)
TT=0.614

? (TO)
TT=1800.06

? (problem)
TT=0.565

? (TO)
TT=1800.06

? (problem)
TT=0.513

? (TO)
TT=1800.07

? (TO)
TT=1800.02

? (TO)
TT=1800.09

SAT
TT=399.214
T1=399.04
SAT
TT=35.312
T1=35.32
SAT
TT=19.772
T1=18.15
SAT
TT=165.615
T1=165.67
SAT
TT=31.501
T1=29.79
?
TT=1794.51

SAT
TT=376.683
T1=359.04
? (TO)
TT=1800.07

SAT
TT=1495.63
T1=748.75
?
TT=1789.83

SAT
TT=475.102
T1=474.47
SAT
TT=1158.61
T1=583.06
?
TT=1797.4

? (TO)
TT=1800.1

? (problem)
TT=0.534

? (problem)
TT=0.524

? (TO)
TT=1800.07

? (TO)
TT=1800.02

SAT
TT=974.557
T1=974.63
No dataNo dataNo dataNo dataSAT
TT=78.48
T1=78.55
No dataNo dataSAT
TT=105.767
T1=53.15
SAT
TT=297.699
T1=294.85
SAT
TT=74.174
T1=72.46
?
TT=1796.84

?
TT=1796.86

?
TT=1796.83

SAT
TT=289.529
T1=289.57
SAT
TT=310.338
T1=310.38
SAT
TT=74.88
T1=74.94
No dataNo dataSAT
TT=69.11
T1=69.12
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3011_9-unsat.opb
UNSAT
TT=0.006

UNSAT
TT=0.034

UNSAT
TT=0.006

No data? (problem)
TT=0.113

UNSAT
TT=0.131

? (problem)
TT=0.115

UNSAT
TT=0.123

? (problem)
TT=0.111

UNSAT
TT=0.121

? (problem)
TT=0.124

UNSAT
TT=0.123

UNSAT
TT=0.039

UNSAT
TT=0.064

UNSAT
TT=0.535

UNSAT
TT=0.125

UNSAT
TT=0.705

UNSAT
TT=0.032

UNSAT
TT=0.585

UNSAT
TT=0.285

UNSAT
TT=0.615

UNSAT
TT=0.078

UNSAT
TT=0.665

UNSAT
TT=0.278

UNSAT
TT=0.639

UNSAT
TT=0.683

UNSAT
TT=0.316

UNSAT
TT=0.011

? (problem)
TT=0.102

? (problem)
TT=0.122

UNSAT
TT=53.172

UNSAT
TT=50.475

UNSAT
TT=0.028

No dataNo dataNo dataNo dataUNSAT
TT=0.034

No dataNo dataUNSAT
TT=0.743

UNSAT
TT=0.605

UNSAT
TT=0.592

UNSAT
TT=0.271

UNSAT
TT=0.266

UNSAT
TT=0.273

UNSAT
TT=0.225

UNSAT
TT=0.244

UNSAT
TT=0.028

No dataNo dataUNSAT
TT=0.029

/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3017_6-sat.opb
SAT
TT=0.012
T1=0.01
SAT
TT=0.045
T1=0.05
SAT
TT=0.012
T1=0.01
No data? (problem)
TT=0.367

SAT
TT=0.172
T1=0.16
? (problem)
TT=0.368

? (problem)
TT=0.183

? (problem)
TT=0.397

? (problem)
TT=0.16

? (problem)
TT=0.377

? (problem)
TT=0.159

SAT
TT=0.048
T1=0.04
SAT
TT=0.155
T1=0.15
SAT
TT=0.505
T1=0.44
SAT
TT=0.169
T1=0.16
SAT
TT=1.095
T1=0.49
SAT
TT=0.046
T1=0.04
SAT
TT=0.896
T1=0.44
SAT
TT=0.515
T1=0.5
SAT
TT=0.759
T1=0.91
SAT
TT=0.103
T1=0.08
SAT
TT=1.393
T1=1.49
SAT
TT=0.493
T1=0.48
SAT
TT=0.645
T1=0.74
SAT
TT=1.773
T1=0.99
SAT
TT=0.58
T1=0.55
SAT
TT=0.025
T1=0.02
? (problem)
TT=0.336

? (problem)
TT=0.359

SAT
TT=16.485
T1=15.96
SAT
TT=13.274
T1=12.94
SAT
TT=0.025
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.027
T1=0.03
No dataNo dataSAT
TT=1.775
T1=1.03
SAT
TT=0.943
T1=0.44
SAT
TT=0.826
T1=0.44
SAT
TT=0.63
T1=0.6
SAT
TT=0.591
T1=0.57
SAT
TT=0.571
T1=0.54
SAT
TT=0.2
T1=0.29
SAT
TT=0.22
T1=0.21
SAT
TT=0.024
T1=0.03
No dataNo dataSAT
TT=0.025
T1=0.03
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3024_2-sat.opb
SAT
TT=0.013
T1=0.01
SAT
TT=0.045
T1=0.05
SAT
TT=0.013
T1=0.01
No data? (problem)
TT=0.166

SAT
TT=0.757
T1=0.75
? (problem)
TT=0.169

? (problem)
TT=0.725

? (problem)
TT=0.165

? (problem)
TT=0.698

? (problem)
TT=0.174

? (problem)
TT=0.7

SAT
TT=0.056
T1=0.05
SAT
TT=0.164
T1=0.16
SAT
TT=0.475
T1=0.43
SAT
TT=0.15
T1=0.15
SAT
TT=1.074
T1=0.49
SAT
TT=0.046
T1=0.04
SAT
TT=0.893
T1=0.44
SAT
TT=0.454
T1=0.43
SAT
TT=0.747
T1=0.94
SAT
TT=0.098
T1=0.08
SAT
TT=1.464
T1=1.53
SAT
TT=0.405
T1=0.39
SAT
TT=0.668
T1=0.75
SAT
TT=1.143
T1=0.97
SAT
TT=0.483
T1=0.46
SAT
TT=0.024
T1=0.02
? (problem)
TT=0.171

? (problem)
TT=0.157

SAT
TT=35.011
T1=33.81
SAT
TT=32.737
T1=31.78
SAT
TT=0.03
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.025
T1=0.03
No dataNo dataSAT
TT=1.784
T1=1.05
SAT
TT=0.973
T1=0.47
SAT
TT=0.834
T1=0.43
SAT
TT=0.519
T1=0.49
SAT
TT=0.555
T1=0.53
SAT
TT=0.694
T1=0.67
SAT
TT=0.195
T1=0.19
SAT
TT=0.211
T1=0.2
SAT
TT=0.023
T1=0.03
No dataNo dataSAT
TT=0.025
T1=0.03
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3024_3-sat.opb
SAT
TT=0.014
T1=0.01
SAT
TT=0.059
T1=0.06
SAT
TT=0.014
T1=0.01
No data? (problem)
TT=1.549

SAT
TT=1.103
T1=1.1
? (problem)
TT=1.558

? (problem)
TT=1.056

? (problem)
TT=1.528

? (problem)
TT=1.061

? (problem)
TT=1.543

? (problem)
TT=1.054

SAT
TT=0.063
T1=0.09
SAT
TT=0.186
T1=0.18
SAT
TT=0.568
T1=0.5
SAT
TT=0.194
T1=0.19
SAT
TT=1.154
T1=0.51
SAT
TT=0.06
T1=0.05
SAT
TT=0.956
T1=0.47
SAT
TT=0.573
T1=0.55
SAT
TT=0.818
T1=0.95
SAT
TT=0.121
T1=0.19
SAT
TT=1.475
T1=1.55
SAT
TT=0.576
T1=0.56
SAT
TT=0.654
T1=0.76
SAT
TT=1.835
T1=1.05
SAT
TT=0.68
T1=0.65
SAT
TT=0.029
T1=0.02
? (problem)
TT=1.466

? (problem)
TT=1.487

SAT
TT=54.845
T1=53.02
SAT
TT=49.793
T1=48.3
SAT
TT=0.029
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.03
T1=0.04
No dataNo dataSAT
TT=1.862
T1=1.13
SAT
TT=1.054
T1=0.47
SAT
TT=0.845
T1=0.46
SAT
TT=0.619
T1=0.59
SAT
TT=0.662
T1=0.63
SAT
TT=0.673
T1=0.64
SAT
TT=0.231
T1=0.22
SAT
TT=0.249
T1=0.24
SAT
TT=0.028
T1=0.03
No dataNo dataSAT
TT=0.03
T1=0.03
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3024_5-sat.opb
SAT
TT=0.01
T1=0.01
SAT
TT=0.045
T1=0.05
SAT
TT=0.01
T1=0.01
No data? (problem)
TT=0.152

SAT
TT=0.93
T1=0.92
? (problem)
TT=0.168

? (problem)
TT=0.899

? (problem)
TT=0.15

? (problem)
TT=0.895

? (problem)
TT=0.155

? (problem)
TT=0.895

SAT
TT=0.055
T1=0.05
SAT
TT=0.138
T1=0.13
SAT
TT=0.424
T1=0.37
SAT
TT=0.122
T1=0.12
SAT
TT=0.955
T1=0.46
SAT
TT=0.047
T1=0.04
SAT
TT=0.804
T1=0.4
SAT
TT=0.457
T1=0.44
SAT
TT=0.743
T1=0.87
SAT
TT=0.092
T1=0.08
SAT
TT=1.293
T1=1.51
SAT
TT=0.417
T1=0.41
SAT
TT=0.605
T1=0.7
SAT
TT=1.134
T1=0.97
SAT
TT=0.491
T1=0.47
SAT
TT=0.022
T1=0.02
? (problem)
TT=0.162

? (problem)
TT=0.148

SAT
TT=32.197
T1=31.21
SAT
TT=29.918
T1=29.16
SAT
TT=0.025
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.022
T1=0.02
No dataNo dataSAT
TT=1.744
T1=1.01
SAT
TT=0.903
T1=0.43
SAT
TT=0.854
T1=0.42
SAT
TT=0.545
T1=0.52
SAT
TT=0.511
T1=0.49
SAT
TT=0.578
T1=0.55
SAT
TT=0.17
T1=0.17
SAT
TT=0.185
T1=0.18
SAT
TT=0.021
T1=0.02
No dataNo dataSAT
TT=0.021
T1=0.02
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3025_10-sat.opb
SAT
TT=0.017
T1=0.02
SAT
TT=0.165
T1=0.16
SAT
TT=0.017
T1=0.02
No data? (problem)
TT=0.075

SAT
TT=1.041
T1=1.04
? (problem)
TT=0.076

? (problem)
TT=1.01

? (problem)
TT=0.077

? (problem)
TT=0.99

? (problem)
TT=0.076

? (problem)
TT=0.98

SAT
TT=0.161
T1=0.16
SAT
TT=0.231
T1=0.23
SAT
TT=0.498
T1=0.44
SAT
TT=0.166
T1=0.16
SAT
TT=1.664
T1=0.69
SAT
TT=0.167
T1=0.16
SAT
TT=1.285
T1=0.6
SAT
TT=64.383
T1=64.37
SAT
TT=0.761
T1=0.9
SAT
TT=18.787
T1=8.45
SAT
TT=2.624
T1=1.54
SAT
TT=2
T1=1.98
SAT
TT=0.69
T1=0.81
SAT
TT=1.873
T1=0.97
SAT
TT=48.227
T1=48.2
SAT
TT=0.052
T1=0.05
? (problem)
TT=0.072

? (problem)
TT=0.083

SAT
TT=72.667
T1=70.69
SAT
TT=62.914
T1=61.16
SAT
TT=0.05
T1=0.04
No dataNo dataNo dataNo dataSAT
TT=0.046
T1=0.04
No dataNo dataSAT
TT=2.754
T1=1.15
SAT
TT=1.572
T1=0.75
SAT
TT=1.264
T1=0.57
SAT
TT=1.548
T1=1.51
SAT
TT=1.36
T1=1.33
SAT
TT=4.085
T1=4.06
SAT
TT=0.259
T1=0.25
SAT
TT=0.259
T1=0.25
SAT
TT=0.047
T1=0.04
No dataNo dataSAT
TT=0.047
T1=0.04
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3030_6-sat.opb
SAT
TT=0.02
T1=0.01
SAT
TT=0.117
T1=0.11
SAT
TT=0.02
T1=0.01
No data? (problem)
TT=0.148

SAT
TT=1.593
T1=1.77
? (problem)
TT=0.144

? (problem)
TT=1.59

? (problem)
TT=0.145

? (problem)
TT=1.489

? (problem)
TT=0.14

? (problem)
TT=1.482

SAT
TT=0.138
T1=0.13
SAT
TT=0.318
T1=0.31
SAT
TT=0.536
T1=0.48
SAT
TT=0.204
T1=0.2
SAT
TT=1.903
T1=0.77
SAT
TT=0.117
T1=0.11
SAT
TT=1.604
T1=0.71
SAT
TT=47.12
T1=47.11
SAT
TT=0.773
T1=0.92
SAT
TT=1.673
T1=1.65
SAT
TT=2.654
T1=1.55
SAT
TT=1.222
T1=1.21
SAT
TT=0.659
T1=0.75
SAT
TT=3.323
T1=1.21
SAT
TT=27.854
T1=27.83
SAT
TT=0.084
T1=0.08
? (problem)
TT=0.137

? (problem)
TT=0.15

SAT
TT=89.737
T1=86.7
SAT
TT=85.911
T1=83.33
SAT
TT=0.049
T1=0.04
No dataNo dataNo dataNo dataSAT
TT=0.049
T1=0.04
No dataNo dataSAT
TT=3.791
T1=1.27
SAT
TT=1.673
T1=0.71
SAT
TT=1.402
T1=0.62
SAT
TT=0.871
T1=0.84
SAT
TT=0.958
T1=0.93
SAT
TT=27.446
T1=27.43
SAT
TT=0.252
T1=0.25
SAT
TT=0.27
T1=0.26
SAT
TT=0.048
T1=0.04
No dataNo dataSAT
TT=0.051
T1=0.04
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3042_5-unsat.opb
UNSAT
TT=0.005

UNSAT
TT=0.024

UNSAT
TT=0.005

No data? (problem)
TT=0.092

UNSAT
TT=0.109

? (problem)
TT=0.096

UNSAT
TT=0.107

? (problem)
TT=0.09

UNSAT
TT=0.101

? (problem)
TT=0.09

UNSAT
TT=0.099

UNSAT
TT=0.028

UNSAT
TT=0.056

UNSAT
TT=0.443

UNSAT
TT=0.096

UNSAT
TT=0.683

UNSAT
TT=0.025

UNSAT
TT=0.554

UNSAT
TT=0.213

UNSAT
TT=0.614

UNSAT
TT=0.063

UNSAT
TT=0.644

UNSAT
TT=0.21

UNSAT
TT=0.627

UNSAT
TT=0.673

UNSAT
TT=0.235

UNSAT
TT=0.01

? (problem)
TT=0.099

? (problem)
TT=0.102

UNSAT
TT=42.689

UNSAT
TT=38.931

UNSAT
TT=0.027

No dataNo dataNo dataNo dataUNSAT
TT=0.025

No dataNo dataUNSAT
TT=0.725

UNSAT
TT=0.562

UNSAT
TT=0.584

UNSAT
TT=0.203

UNSAT
TT=0.203

UNSAT
TT=0.204

UNSAT
TT=0.179

UNSAT
TT=0.193

UNSAT
TT=0.022

No dataNo dataUNSAT
TT=0.023

/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3043_8-sat.opb
SAT
TT=0.012
T1=0.01
SAT
TT=0.046
T1=0.04
SAT
TT=0.012
T1=0.01
No data? (problem)
TT=0.122

SAT
TT=1.065
T1=1.06
? (problem)
TT=0.111

? (problem)
TT=1.017

? (problem)
TT=0.109

? (problem)
TT=1.049

? (problem)
TT=0.115

? (problem)
TT=0.994

SAT
TT=0.049
T1=0.04
SAT
TT=0.183
T1=0.18
SAT
TT=0.541
T1=0.48
SAT
TT=0.177
T1=0.17
SAT
TT=1.203
T1=0.53
SAT
TT=0.047
T1=0.04
SAT
TT=1.025
T1=0.5
SAT
TT=1.063
T1=1.04
SAT
TT=0.764
T1=0.92
SAT
TT=0.139
T1=0.12
SAT
TT=1.844
T1=1.54
SAT
TT=0.586
T1=0.57
SAT
TT=0.692
T1=0.78
SAT
TT=1.983
T1=1.12
SAT
TT=0.631
T1=0.6
SAT
TT=0.028
T1=0.02
? (problem)
TT=0.109

? (problem)
TT=0.106

SAT
TT=71.352
T1=68.81
SAT
TT=67.245
T1=65.05
SAT
TT=0.029
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.03
T1=0.03
No dataNo dataSAT
TT=1.925
T1=1.18
SAT
TT=1.083
T1=0.49
SAT
TT=0.903
T1=0.46
SAT
TT=0.569
T1=0.54
SAT
TT=0.611
T1=0.59
SAT
TT=0.515
T1=0.49
SAT
TT=0.229
T1=0.22
SAT
TT=0.247
T1=0.24
SAT
TT=0.029
T1=0.03
No dataNo dataSAT
TT=0.028
T1=0.03
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j3046_4-unsat.opb
UNSAT
TT=0.013

UNSAT
TT=0.036

UNSAT
TT=0.013

No data? (problem)
TT=0.135

UNSAT
TT=1.3

? (problem)
TT=0.147

UNSAT
TT=1.323

? (problem)
TT=0.134

UNSAT
TT=1.247

? (problem)
TT=0.142

UNSAT
TT=1.256

UNSAT
TT=0.048

UNSAT
TT=0.224

UNSAT
TT=0.55

UNSAT
TT=0.185

UNSAT
TT=1.264

UNSAT
TT=0.037

UNSAT
TT=1.106

UNSAT
TT=1.381

UNSAT
TT=0.617

UNSAT
TT=0.136

UNSAT
TT=1.973

UNSAT
TT=0.662

UNSAT
TT=0.705

UNSAT
TT=2.433

UNSAT
TT=0.712

UNSAT
TT=0.036

? (problem)
TT=0.137

? (problem)
TT=0.141

UNSAT
TT=82.412

UNSAT
TT=73.646

UNSAT
TT=0.035

No dataNo dataNo dataNo dataUNSAT
TT=0.032

No dataNo dataUNSAT
TT=2.532

UNSAT
TT=1.165

UNSAT
TT=1.154

UNSAT
TT=0.726

UNSAT
TT=0.682

UNSAT
TT=0.611

UNSAT
TT=0.249

UNSAT
TT=0.262

UNSAT
TT=0.03

No dataNo dataUNSAT
TT=0.03

/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j307_10-sat.opb
SAT
TT=0.011
T1=0.01
SAT
TT=0.091
T1=0.09
SAT
TT=0.011
T1=0.01
No data? (problem)
TT=1.054

SAT
TT=0.712
T1=0.71
? (problem)
TT=1.05

? (problem)
TT=0.689

? (problem)
TT=1.038

? (problem)
TT=0.677

? (problem)
TT=1.048

? (problem)
TT=0.676

SAT
TT=0.085
T1=0.08
SAT
TT=0.14
T1=0.14
SAT
TT=0.396
T1=0.34
SAT
TT=0.113
T1=0.11
SAT
TT=0.965
T1=0.46
SAT
TT=0.092
T1=0.09
SAT
TT=0.735
T1=0.41
SAT
TT=0.888
T1=0.87
SAT
TT=0.736
T1=0.89
SAT
TT=0.127
T1=0.11
SAT
TT=1.243
T1=1.47
SAT
TT=0.417
T1=0.41
SAT
TT=0.635
T1=0.72
SAT
TT=1.074
T1=0.95
SAT
TT=0.479
T1=0.46
SAT
TT=0.024
T1=0.02
? (problem)
TT=0.993

? (problem)
TT=1.016

SAT
TT=26.518
T1=25.72
SAT
TT=24.132
T1=23.53
SAT
TT=0.025
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.021
T1=0.02
No dataNo dataSAT
TT=1.695
T1=1
SAT
TT=0.783
T1=0.41
SAT
TT=0.804
T1=0.42
SAT
TT=0.519
T1=0.49
SAT
TT=0.436
T1=0.41
SAT
TT=0.564
T1=0.54
SAT
TT=0.161
T1=0.16
SAT
TT=0.163
T1=0.3
SAT
TT=0.02
T1=0.02
No dataNo dataSAT
TT=0.022
T1=0.02
/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j307_9-unsat.opb
UNSAT
TT=0.01

UNSAT
TT=0.026

UNSAT
TT=0.01

No data? (problem)
TT=1.285

UNSAT
TT=0.17

? (problem)
TT=1.364

UNSAT
TT=0.166

? (problem)
TT=1.269

UNSAT
TT=0.161

? (problem)
TT=1.259

UNSAT
TT=0.159

UNSAT
TT=0.031

UNSAT
TT=0.148

UNSAT
TT=0.461

UNSAT
TT=0.147

UNSAT
TT=0.974

UNSAT
TT=0.027

UNSAT
TT=0.756

UNSAT
TT=0.397

UNSAT
TT=0.662

UNSAT
TT=0.063

UNSAT
TT=1.224

UNSAT
TT=0.373

UNSAT
TT=0.614

UNSAT
TT=1.013

UNSAT
TT=0.444

UNSAT
TT=0.022

? (problem)
TT=1.272

? (problem)
TT=1.243

UNSAT
TT=19.505

UNSAT
TT=16.198

UNSAT
TT=0.029

No dataNo dataNo dataNo dataUNSAT
TT=0.024

No dataNo dataUNSAT
TT=1.585

UNSAT
TT=0.843

UNSAT
TT=0.734

UNSAT
TT=0.411

UNSAT
TT=0.427

UNSAT
TT=0.461

UNSAT
TT=0.187

UNSAT
TT=0.188

UNSAT
TT=0.023

No dataNo dataUNSAT
TT=0.025

/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j308_6-unsat.opb
UNSAT
TT=0.005

UNSAT
TT=0.019

UNSAT
TT=0.005

No data? (problem)
TT=0.07

UNSAT
TT=0.079

? (problem)
TT=0.071

UNSAT
TT=0.077

? (problem)
TT=0.067

UNSAT
TT=0.074

? (problem)
TT=0.07

UNSAT
TT=0.074

UNSAT
TT=0.023

UNSAT
TT=0.043

UNSAT
TT=0.36

UNSAT
TT=0.073

UNSAT
TT=0.584

UNSAT
TT=0.019

UNSAT
TT=0.506

UNSAT
TT=0.167

UNSAT
TT=0.622

UNSAT
TT=0.046

UNSAT
TT=0.574

UNSAT
TT=0.165

UNSAT
TT=0.615

UNSAT
TT=0.584

UNSAT
TT=0.185

UNSAT
TT=0.008

? (problem)
TT=0.063

? (problem)
TT=0.056

UNSAT
TT=17.962

UNSAT
TT=16.215

UNSAT
TT=0.023

No dataNo dataNo dataNo dataUNSAT
TT=0.019

No dataNo dataUNSAT
TT=0.593

UNSAT
TT=0.534

UNSAT
TT=0.514

UNSAT
TT=0.173

UNSAT
TT=0.15

UNSAT
TT=0.172

UNSAT
TT=0.139

UNSAT
TT=0.14

UNSAT
TT=0.018

No dataNo dataUNSAT
TT=0.02

/DEC-SMALLINT-LIN/
oliveras/j30/
normalized-j309_6-sat.opb
SAT
TT=0.017
T1=0.01
SAT
TT=0.167
T1=0.16
SAT
TT=0.017
T1=0.01
No data? (problem)
TT=0.08

SAT
TT=0.955
T1=0.95
? (problem)
TT=0.079

? (problem)
TT=0.9

? (problem)
TT=0.073

? (problem)
TT=0.91

? (problem)
TT=0.076

? (problem)
TT=0.9

SAT
TT=0.149
T1=0.18
SAT
TT=0.255
T1=0.25
SAT
TT=0.497
T1=0.44
SAT
TT=0.212
T1=0.21
SAT
TT=1.765
T1=0.77
SAT
TT=0.17
T1=0.16
SAT
TT=1.307
T1=0.61
SAT
TT=98.325
T1=98.33
SAT
TT=0.777
T1=1.12
SAT
TT=30.094
T1=12.26
SAT
TT=2.894
T1=1.54
SAT
TT=2.613
T1=2.6
SAT
TT=0.662
T1=0.77
SAT
TT=2.075
T1=0.97
SAT
TT=74.762
T1=74.75
SAT
TT=0.059
T1=0.05
? (problem)
TT=0.075

? (problem)
TT=0.085

SAT
TT=74.569
T1=72.48
SAT
TT=64.662
T1=62.87
SAT
TT=0.061
T1=0.05
No dataNo dataNo dataNo dataSAT
TT=0.056
T1=0.05
No dataNo dataSAT
TT=3.372
T1=1.15
SAT
TT=1.604
T1=0.68
SAT
TT=1.472
T1=0.64
SAT
TT=1.688
T1=1.65
SAT
TT=1.924
T1=1.89
SAT
TT=30.974
T1=30.94
SAT
TT=0.344
T1=0.34
SAT
TT=0.367
T1=0.36
SAT
TT=0.056
T1=0.05
No dataNo dataSAT
TT=0.057
T1=0.05
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6010_7-unsat.opb
UNSAT
TT=0.009

UNSAT
TT=0.064

UNSAT
TT=0.009

No data? (problem)
TT=0.344

UNSAT
TT=0.39

? (problem)
TT=0.342

UNSAT
TT=0.375

? (problem)
TT=0.329

UNSAT
TT=0.376

? (problem)
TT=0.337

UNSAT
TT=0.379

UNSAT
TT=0.081

UNSAT
TT=0.138

UNSAT
TT=1.098

UNSAT
TT=0.365

UNSAT
TT=0.925

UNSAT
TT=0.067

UNSAT
TT=0.695

UNSAT
TT=0.557

UNSAT
TT=0.651

UNSAT
TT=0.182

UNSAT
TT=0.984

UNSAT
TT=0.628

UNSAT
TT=0.847

UNSAT
TT=0.943

UNSAT
TT=0.618

UNSAT
TT=0.019

? (problem)
TT=0.337

? (problem)
TT=0.353

UNSAT
TT=78.227

UNSAT
TT=87.905

UNSAT
TT=0.059

No dataNo dataNo dataNo dataUNSAT
TT=0.064

No dataNo dataUNSAT
TT=1.145

UNSAT
TT=0.733

UNSAT
TT=0.705

UNSAT
TT=0.525

UNSAT
TT=0.534

UNSAT
TT=0.528

UNSAT
TT=0.452

UNSAT
TT=0.49

UNSAT
TT=0.056

No dataNo dataUNSAT
TT=0.058

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6014_2-sat.opb
SAT
TT=0.026
T1=0.02
SAT
TT=0.247
T1=0.24
SAT
TT=0.026
T1=0.02
No data? (problem)
TT=0.465

SAT
TT=6.854
T1=6.85
? (problem)
TT=0.498

? (problem)
TT=6.63

? (problem)
TT=0.478

? (problem)
TT=6.7

? (problem)
TT=0.482

? (problem)
TT=6.7

SAT
TT=0.249
T1=0.25
SAT
TT=1.054
T1=1.04
SAT
TT=1.102
T1=0.99
SAT
TT=0.554
T1=0.55
SAT
TT=2.164
T1=0.85
SAT
TT=0.247
T1=0.24
SAT
TT=1.926
T1=0.81
SAT
TT=67.444
T1=67.42
SAT
TT=0.913
T1=1.02
SAT
TT=4.893
T1=4.82
SAT
TT=3.604
T1=1.89
SAT
TT=2.996
T1=2.96
SAT
TT=0.893
T1=1.38
SAT
TT=3.392
T1=1.21
SAT
TT=2.092
T1=2.05
SAT
TT=0.459
T1=0.45
? (problem)
TT=0.473

? (problem)
TT=0.481

SAT
TT=943.29
T1=937.42
SAT
TT=524.055
T1=519.53
SAT
TT=0.091
T1=0.08
No dataNo dataNo dataNo dataSAT
TT=0.096
T1=0.08
No dataNo dataSAT
TT=3.804
T1=1.27
SAT
TT=1.964
T1=0.8
SAT
TT=1.734
T1=0.73
SAT
TT=1.453
T1=1.41
SAT
TT=1.662
T1=1.61
SAT
TT=50.39
T1=50.36
SAT
TT=0.466
T1=0.46
SAT
TT=0.471
T1=0.46
SAT
TT=0.094
T1=0.08
No dataNo dataSAT
TT=0.09
T1=0.08
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6016_10-unsat.opb
UNSAT
TT=0.008

UNSAT
TT=0.067

UNSAT
TT=0.008

No data? (problem)
TT=0.717

UNSAT
TT=0.77

? (problem)
TT=0.672

UNSAT
TT=0.762

? (problem)
TT=0.692

UNSAT
TT=0.759

? (problem)
TT=0.673

UNSAT
TT=0.761

UNSAT
TT=0.078

UNSAT
TT=0.133

UNSAT
TT=1.102

UNSAT
TT=0.361

UNSAT
TT=0.924

UNSAT
TT=0.07

UNSAT
TT=0.697

UNSAT
TT=0.533

UNSAT
TT=0.641

UNSAT
TT=0.23

UNSAT
TT=0.975

UNSAT
TT=0.601

UNSAT
TT=0.881

UNSAT
TT=0.913

UNSAT
TT=0.591

UNSAT
TT=0.021

? (problem)
TT=0.723

? (problem)
TT=0.707

UNSAT
TT=105.396

UNSAT
TT=89.621

UNSAT
TT=0.061

No dataNo dataNo dataNo dataUNSAT
TT=0.065

No dataNo dataUNSAT
TT=1.103

UNSAT
TT=0.735

UNSAT
TT=0.715

UNSAT
TT=0.552

UNSAT
TT=0.492

UNSAT
TT=0.5

UNSAT
TT=0.459

UNSAT
TT=0.48

UNSAT
TT=0.063

No dataNo dataUNSAT
TT=0.06

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j601_8-unsat.opb
UNSAT
TT=0.022

UNSAT
TT=0.064

UNSAT
TT=0.022

No data? (problem)
TT=0.938

UNSAT
TT=0.213

? (problem)
TT=0.908

UNSAT
TT=0.204

? (problem)
TT=0.952

UNSAT
TT=0.206

? (problem)
TT=0.924

UNSAT
TT=0.204

UNSAT
TT=0.08

UNSAT
TT=0.34

UNSAT
TT=1.147

UNSAT
TT=0.647

UNSAT
TT=1.075

UNSAT
TT=0.067

UNSAT
TT=1.005

UNSAT
TT=1.05

UNSAT
TT=0.647

UNSAT
TT=0.146

UNSAT
TT=2.103

UNSAT
TT=1.08

UNSAT
TT=0.871

UNSAT
TT=1.396

UNSAT
TT=1.115

UNSAT
TT=0.053

? (problem)
TT=0.879

? (problem)
TT=0.88

UNSAT
TT=35.696

UNSAT
TT=32.161

UNSAT
TT=0.057

No dataNo dataNo dataNo dataUNSAT
TT=0.064

No dataNo dataUNSAT
TT=1.824

UNSAT
TT=1.325

UNSAT
TT=1.014

UNSAT
TT=1.17

UNSAT
TT=1.129

UNSAT
TT=1.087

UNSAT
TT=0.457

UNSAT
TT=0.465

UNSAT
TT=0.055

No dataNo dataUNSAT
TT=0.057

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6020_9-sat.opb
SAT
TT=0.026
T1=0.02
SAT
TT=0.153
T1=0.15
SAT
TT=0.026
T1=0.02
No data? (problem)
TT=0.685

SAT
TT=0.946
T1=0.94
? (problem)
TT=0.694

? (problem)
TT=0.905

? (problem)
TT=0.728

? (problem)
TT=0.889

? (problem)
TT=0.707

? (problem)
TT=0.872

SAT
TT=0.147
T1=0.14
SAT
TT=0.36
T1=0.35
SAT
TT=1.187
T1=1.07
SAT
TT=0.699
T1=0.69
SAT
TT=1.394
T1=0.61
SAT
TT=0.156
T1=0.15
SAT
TT=1.174
T1=0.57
SAT
TT=3.187
T1=3.15
SAT
TT=0.998
T1=1.09
SAT
TT=0.316
T1=0.22
SAT
TT=2.134
T1=1.73
SAT
TT=1.345
T1=1.3
SAT
TT=0.892
T1=1.13
SAT
TT=3.023
T1=1.09
SAT
TT=1.348
T1=1.31
SAT
TT=0.057
T1=0.05
? (problem)
TT=0.67

? (problem)
TT=0.679

SAT
TT=38.064
T1=36.68
SAT
TT=40.428
T1=40.2
SAT
TT=0.081
T1=0.07
No dataNo dataNo dataNo dataSAT
TT=0.08
T1=0.07
No dataNo dataSAT
TT=2.415
T1=1.31
SAT
TT=1.546
T1=0.64
SAT
TT=1.404
T1=0.63
SAT
TT=1.284
T1=1.24
SAT
TT=1.46
T1=1.41
SAT
TT=1.705
T1=1.66
SAT
TT=0.49
T1=0.48
SAT
TT=0.484
T1=0.47
SAT
TT=0.078
T1=0.07
No dataNo dataSAT
TT=0.08
T1=0.07
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6027_9-unsat.opb
UNSAT
TT=0.01

UNSAT
TT=0.075

UNSAT
TT=0.01

No data? (problem)
TT=0.389

UNSAT
TT=0.468

? (problem)
TT=0.405

UNSAT
TT=0.474

? (problem)
TT=0.402

UNSAT
TT=0.471

? (problem)
TT=0.424

UNSAT
TT=0.472

UNSAT
TT=0.084

UNSAT
TT=0.155

UNSAT
TT=1.275

UNSAT
TT=0.457

UNSAT
TT=0.955

UNSAT
TT=0.078

UNSAT
TT=0.744

UNSAT
TT=0.671

UNSAT
TT=0.609

UNSAT
TT=0.213

UNSAT
TT=1.072

UNSAT
TT=0.751

UNSAT
TT=0.93

UNSAT
TT=0.963

UNSAT
TT=0.756

UNSAT
TT=0.022

? (problem)
TT=0.404

? (problem)
TT=0.422

UNSAT
TT=87.622

UNSAT
TT=103.391

UNSAT
TT=0.068

No dataNo dataNo dataNo dataUNSAT
TT=0.072

No dataNo dataUNSAT
TT=1.173

UNSAT
TT=0.776

UNSAT
TT=0.744

UNSAT
TT=0.672

UNSAT
TT=0.626

UNSAT
TT=0.636

UNSAT
TT=0.535

UNSAT
TT=0.543

UNSAT
TT=0.069

No dataNo dataUNSAT
TT=0.066

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6028_7-sat.opb
SAT
TT=0.028
T1=0.02
SAT
TT=0.202
T1=0.2
SAT
TT=0.028
T1=0.02
No data? (problem)
TT=0.543

SAT
TT=5.717
T1=5.71
? (problem)
TT=0.555

? (problem)
TT=5.47

? (problem)
TT=0.684

? (problem)
TT=4.87

? (problem)
TT=0.531

? (problem)
TT=5.48

SAT
TT=0.189
T1=0.18
SAT
TT=0.624
T1=0.62
SAT
TT=1.293
T1=1.15
SAT
TT=0.725
T1=0.72
SAT
TT=1.654
T1=0.65
SAT
TT=0.206
T1=0.2
SAT
TT=1.493
T1=0.61
SAT
TT=1.19
T1=1.16
SAT
TT=1.009
T1=1.13
SAT
TT=0.391
T1=0.29
SAT
TT=2.553
T1=1.79
SAT
TT=1.23
T1=1.18
SAT
TT=0.89
T1=0.98
SAT
TT=2.064
T1=1.17
SAT
TT=1.253
T1=1.21
SAT
TT=0.136
T1=0.13
? (problem)
TT=0.551

? (problem)
TT=0.621

SAT
TT=119.64
T1=114.24
SAT
TT=105.52
T1=101.12
SAT
TT=0.105
T1=0.09
No dataNo dataNo dataNo dataSAT
TT=0.097
T1=0.08
No dataNo dataSAT
TT=2.885
T1=1.4
SAT
TT=1.565
T1=0.64
SAT
TT=1.694
T1=0.67
SAT
TT=1.218
T1=1.17
SAT
TT=1.325
T1=1.28
SAT
TT=1.907
T1=1.86
SAT
TT=0.559
T1=0.55
SAT
TT=0.564
T1=0.55
SAT
TT=0.096
T1=0.08
No dataNo dataSAT
TT=0.098
T1=0.08
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6028_9-unsat.opb
UNSAT
TT=0.01

UNSAT
TT=0.073

UNSAT
TT=0.01

No data? (problem)
TT=0.55

UNSAT
TT=0.561

? (problem)
TT=0.495

UNSAT
TT=0.548

? (problem)
TT=0.468

UNSAT
TT=0.549

? (problem)
TT=0.466

UNSAT
TT=0.545

UNSAT
TT=0.088

UNSAT
TT=0.149

UNSAT
TT=1.23

UNSAT
TT=0.438

UNSAT
TT=0.943

UNSAT
TT=0.075

UNSAT
TT=0.743

UNSAT
TT=0.628

UNSAT
TT=0.613

UNSAT
TT=0.205

UNSAT
TT=1.075

UNSAT
TT=0.707

UNSAT
TT=0.896

UNSAT
TT=0.974

UNSAT
TT=0.711

UNSAT
TT=0.021

? (problem)
TT=0.473

? (problem)
TT=0.474

UNSAT
TT=87.375

UNSAT
TT=104.599

UNSAT
TT=0.07

No dataNo dataNo dataNo dataUNSAT
TT=0.071

No dataNo dataUNSAT
TT=1.173

UNSAT
TT=0.763

UNSAT
TT=0.755

UNSAT
TT=0.597

UNSAT
TT=0.617

UNSAT
TT=0.637

UNSAT
TT=0.513

UNSAT
TT=0.524

UNSAT
TT=0.062

No dataNo dataUNSAT
TT=0.065

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6029_8-unsat.opb
UNSAT
TT=1646.31

?
TT=1798.01

UNSAT
TT=1752.6

No data? (problem)
TT=0.501

? (TO)
TT=1800.12

? (problem)
TT=0.473

? (TO)
TT=1800.09

? (problem)
TT=0.457

? (TO)
TT=1800.08

? (problem)
TT=0.457

? (TO)
TT=1800.08

? (TO)
TT=1800.02

? (TO)
TT=1800.11

? (TO)
TT=1800.05

? (TO)
TT=1800.09

? (TO)
TT=1800.06

?
TT=1798.01

? (TO)
TT=1801.05

?
TT=1794.49

? (TO)
TT=1800.07

? (TO)
TT=1800.02

? (TO)
TT=1800.52

?
TT=1790.42

? (MO)
TT=526.59

? (TO)
TT=1800.12

?
TT=1796.78

? (TO)
TT=1800.06

? (problem)
TT=0.491

? (problem)
TT=0.48

? (TO)
TT=1800.01

? (TO)
TT=1800.06

?
TT=1799.53

No dataNo dataNo dataNo data?
TT=1799.55

No dataNo data? (TO)
TT=1800.19

? (TO)
TT=1800.08

UNSAT
TT=1646.31

?
TT=1796.8

?
TT=1796.81

?
TT=1796.78

? (TO)
TT=1800.1

? (TO)
TT=1800.08

?
TT=1799.57

No dataNo data?
TT=1799.52

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6030_8-sat.opb
SAT
TT=0.027
T1=0.02
SAT
TT=0.126
T1=0.12
SAT
TT=0.027
T1=0.02
No data? (problem)
TT=0.464

SAT
TT=5.201
T1=5.19
? (problem)
TT=0.506

? (problem)
TT=4.93

? (problem)
TT=0.465

? (problem)
TT=4.96

? (problem)
TT=0.477

? (problem)
TT=5

SAT
TT=0.144
T1=0.14
SAT
TT=0.669
T1=0.77
SAT
TT=1.091
T1=0.97
SAT
TT=0.55
T1=0.55
SAT
TT=2.075
T1=0.81
SAT
TT=0.129
T1=0.12
SAT
TT=1.854
T1=0.77
SAT
TT=26.735
T1=26.71
SAT
TT=0.885
T1=1.01
SAT
TT=0.566
T1=0.5
SAT
TT=3.553
T1=1.89
SAT
TT=1.65
T1=1.62
SAT
TT=0.869
T1=0.93
SAT
TT=3.114
T1=1.17
SAT
TT=1.212
T1=1.18
SAT
TT=0.2
T1=0.19
? (problem)
TT=0.55

? (problem)
TT=0.466

SAT
TT=133.338
T1=127.67
SAT
TT=119.268
T1=114.85
SAT
TT=0.081
T1=0.07
No dataNo dataNo dataNo dataSAT
TT=0.086
T1=0.08
No dataNo dataSAT
TT=2.765
T1=1.28
SAT
TT=1.675
T1=0.65
SAT
TT=1.523
T1=0.64
SAT
TT=1.248
T1=1.21
SAT
TT=1.423
T1=1.38
SAT
TT=21.621
T1=21.59
SAT
TT=0.464
T1=0.45
SAT
TT=0.471
T1=0.46
SAT
TT=0.084
T1=0.08
No dataNo dataSAT
TT=0.079
T1=0.07
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6032_1-unsat.opb
UNSAT
TT=0.01

UNSAT
TT=0.071

UNSAT
TT=0.01

No data? (problem)
TT=0.789

UNSAT
TT=0.878

? (problem)
TT=0.799

UNSAT
TT=0.868

? (problem)
TT=0.79

UNSAT
TT=0.864

? (problem)
TT=0.766

UNSAT
TT=0.871

UNSAT
TT=0.08

UNSAT
TT=0.151

UNSAT
TT=1.179

UNSAT
TT=0.397

UNSAT
TT=0.923

UNSAT
TT=0.073

UNSAT
TT=0.726

UNSAT
TT=0.596

UNSAT
TT=0.647

UNSAT
TT=0.233

UNSAT
TT=1.023

UNSAT
TT=0.671

UNSAT
TT=0.868

UNSAT
TT=0.954

UNSAT
TT=0.668

UNSAT
TT=0.021

? (problem)
TT=0.943

? (problem)
TT=0.917

UNSAT
TT=136.481

UNSAT
TT=112.875

UNSAT
TT=0.064

No dataNo dataNo dataNo dataUNSAT
TT=0.07

No dataNo dataUNSAT
TT=1.174

UNSAT
TT=0.794

UNSAT
TT=0.753

UNSAT
TT=0.564

UNSAT
TT=0.557

UNSAT
TT=0.563

UNSAT
TT=0.491

UNSAT
TT=0.531

UNSAT
TT=0.066

No dataNo dataUNSAT
TT=0.063

/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6040_10-sat.opb
SAT
TT=0.027
T1=0.02
SAT
TT=0.25
T1=0.24
SAT
TT=0.027
T1=0.02
No data? (problem)
TT=0.232

SAT
TT=3.959
T1=3.95
? (problem)
TT=0.226

? (problem)
TT=3.85

? (problem)
TT=0.23

? (problem)
TT=3.604

? (problem)
TT=0.243

? (problem)
TT=3.757

SAT
TT=0.225
T1=0.22
SAT
TT=0.461
T1=0.45
SAT
TT=1.278
T1=1.14
SAT
TT=0.714
T1=0.71
SAT
TT=1.574
T1=0.62
SAT
TT=0.256
T1=0.25
SAT
TT=1.374
T1=0.59
SAT
TT=1.308
T1=1.27
SAT
TT=0.995
T1=1.1
SAT
TT=0.352
T1=0.26
SAT
TT=2.353
T1=1.72
SAT
TT=1.609
T1=1.56
SAT
TT=0.909
T1=1.27
SAT
TT=1.884
T1=1.11
SAT
TT=1.422
T1=1.38
SAT
TT=0.072
T1=0.07
? (problem)
TT=0.217

? (problem)
TT=0.218

SAT
TT=102.258
T1=98.34
SAT
TT=91.159
T1=88.13
SAT
TT=0.086
T1=0.08
No dataNo dataNo dataNo dataSAT
TT=0.086
T1=0.08
No dataNo dataSAT
TT=2.714
T1=1.33
SAT
TT=1.563
T1=0.63
SAT
TT=1.523
T1=0.64
SAT
TT=1.298
T1=1.25
SAT
TT=1.486
T1=1.43
SAT
TT=2.465
T1=2.45
SAT
TT=0.525
T1=0.51
SAT
TT=0.519
T1=0.51
SAT
TT=0.094
T1=0.08
No dataNo dataSAT
TT=0.095
T1=0.08
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6040_3-sat.opb
SAT
TT=0.025
T1=0.02
SAT
TT=0.134
T1=0.13
SAT
TT=0.025
T1=0.02
No data? (problem)
TT=0.267

SAT
TT=4.442
T1=4.44
? (problem)
TT=0.285

? (problem)
TT=4.32

? (problem)
TT=0.253

? (problem)
TT=7.72

? (problem)
TT=0.255

? (problem)
TT=4.42

SAT
TT=0.135
T1=0.13
SAT
TT=0.388
T1=0.38
SAT
TT=1.218
T1=1.08
SAT
TT=0.66
T1=0.66
SAT
TT=1.564
T1=0.61
SAT
TT=0.139
T1=0.13
SAT
TT=1.343
T1=0.58
SAT
TT=1.1
T1=1.07
SAT
TT=0.943
T1=1.19
SAT
TT=0.304
T1=0.22
SAT
TT=2.434
T1=1.75
SAT
TT=3.27
T1=3.23
SAT
TT=0.907
T1=1
SAT
TT=1.973
T1=1.1
SAT
TT=1.245
T1=1.2
SAT
TT=0.06
T1=0.05
? (problem)
TT=0.249

? (problem)
TT=0.265

SAT
TT=101.332
T1=98.04
SAT
TT=90.746
T1=87.85
SAT
TT=0.083
T1=0.07
No dataNo dataNo dataNo dataSAT
TT=0.083
T1=0.07
No dataNo dataSAT
TT=2.704
T1=1.3
SAT
TT=1.394
T1=0.63
SAT
TT=1.554
T1=0.64
SAT
TT=1.264
T1=1.22
SAT
TT=1.268
T1=1.23
SAT
TT=1.47
T1=1.43
SAT
TT=0.502
T1=0.49
SAT
TT=0.525
T1=0.51
SAT
TT=0.081
T1=0.07
No dataNo dataSAT
TT=0.083
T1=0.07
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6042_2-sat.opb
SAT
TT=0.026
T1=0.02
SAT
TT=0.183
T1=0.18
SAT
TT=0.026
T1=0.02
No data? (problem)
TT=0.315

SAT
TT=4.331
T1=4.56
? (problem)
TT=0.313

? (problem)
TT=4.022

? (problem)
TT=0.297

? (problem)
TT=4.1

? (problem)
TT=0.313

? (problem)
TT=4.14

SAT
TT=0.191
T1=0.19
SAT
TT=0.567
T1=0.56
SAT
TT=1.211
T1=1.08
SAT
TT=0.635
T1=0.63
SAT
TT=1.616
T1=0.67
SAT
TT=0.186
T1=0.18
SAT
TT=1.414
T1=0.6
SAT
TT=53.403
T1=53.38
SAT
TT=1.008
T1=2.25
SAT
TT=1.116
T1=1.03
SAT
TT=2.852
T1=1.83
SAT
TT=2.814
T1=2.78
SAT
TT=0.949
T1=1.79
SAT
TT=2.214
T1=1.1
SAT
TT=1.494
T1=1.45
SAT
TT=0.116
T1=0.11
? (problem)
TT=0.366

? (problem)
TT=0.329

SAT
TT=108.889
T1=103.95
SAT
TT=122.631
T1=118.89
SAT
TT=0.094
T1=0.08
No dataNo dataNo dataNo dataSAT
TT=0.099
T1=0.09
No dataNo dataSAT
TT=2.934
T1=1.36
SAT
TT=1.755
T1=0.67
SAT
TT=1.504
T1=0.67
SAT
TT=1.734
T1=1.69
SAT
TT=1.668
T1=1.62
SAT
TT=25.28
T1=25.25
SAT
TT=0.499
T1=0.49
SAT
TT=0.528
T1=0.52
SAT
TT=0.092
T1=0.08
No dataNo dataSAT
TT=0.094
T1=0.08
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j6043_4-sat.opb
SAT
TT=0.028
T1=0.02
SAT
TT=0.143
T1=0.14
SAT
TT=0.028
T1=0.02
No data? (problem)
TT=0.403

SAT
TT=4.481
T1=4.47
? (problem)
TT=0.409

? (problem)
TT=4.597

? (problem)
TT=0.394

? (problem)
TT=4.567

? (problem)
TT=0.401

? (problem)
TT=4.76

SAT
TT=0.155
T1=0.15
SAT
TT=0.478
T1=0.47
SAT
TT=1.323
T1=1.18
SAT
TT=0.744
T1=0.74
SAT
TT=1.705
T1=0.68
SAT
TT=0.146
T1=0.14
SAT
TT=1.564
T1=0.63
SAT
TT=2.767
T1=2.73
SAT
TT=1.01
T1=1.21
SAT
TT=0.386
T1=0.29
SAT
TT=2.535
T1=1.71
SAT
TT=1.463
T1=1.43
SAT
TT=0.961
T1=1.03
SAT
TT=2.423
T1=1.19
SAT
TT=1.42
T1=1.38
SAT
TT=0.072
T1=0.07
? (problem)
TT=0.446

? (problem)
TT=0.429

SAT
TT=156.523
T1=151.83
SAT
TT=133.507
T1=129.35
SAT
TT=0.092
T1=0.08
No dataNo dataNo dataNo dataSAT
TT=0.107
T1=0.09
No dataNo dataSAT
TT=3.163
T1=1.39
SAT
TT=1.776
T1=0.72
SAT
TT=1.583
T1=0.66
SAT
TT=1.502
T1=1.46
SAT
TT=1.417
T1=1.37
SAT
TT=3.034
T1=2.99
SAT
TT=0.559
T1=0.55
SAT
TT=0.587
T1=0.67
SAT
TT=0.097
T1=0.09
No dataNo dataSAT
TT=0.1
T1=0.08
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
oliveras/j60/
normalized-j607_4-unsat.opb
UNSAT
TT=0.009

UNSAT
TT=0.056

UNSAT
TT=0.009

No data? (problem)
TT=0.205

UNSAT
TT=0.24

? (problem)
TT=0.203

UNSAT
TT=0.229

? (problem)
TT=0.201

UNSAT
TT=0.226

? (problem)
TT=0.213

UNSAT
TT=0.228

UNSAT
TT=0.064

UNSAT
TT=0.118

UNSAT
TT=0.962

UNSAT
TT=0.312

UNSAT
TT=0.884

UNSAT
TT=0.057

UNSAT
TT=0.665

UNSAT
TT=0.505

UNSAT
TT=0.813

UNSAT
TT=0.139

UNSAT
TT=0.935

UNSAT
TT=0.524

UNSAT
TT=0.787

UNSAT
TT=0.903

UNSAT
TT=0.528

UNSAT
TT=0.022

? (problem)
TT=0.194

? (problem)
TT=0.213

UNSAT
TT=54.19

UNSAT
TT=54.53

UNSAT
TT=0.051

No dataNo dataNo dataNo dataUNSAT
TT=0.05

No dataNo dataUNSAT
TT=0.997

UNSAT
TT=0.723

UNSAT
TT=0.683

UNSAT
TT=0.452

UNSAT
TT=0.445

UNSAT
TT=0.48

UNSAT
TT=0.403

UNSAT
TT=0.399

UNSAT
TT=0.049

No dataNo dataUNSAT
TT=0.05

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9010_10-unsat.opb
UNSAT
TT=0.013

UNSAT
TT=0.117

UNSAT
TT=0.013

No data? (problem)
TT=0.636

UNSAT
TT=0.797

? (problem)
TT=0.585

UNSAT
TT=0.803

? (problem)
TT=0.615

UNSAT
TT=0.774

? (problem)
TT=0.774

UNSAT
TT=0.775

UNSAT
TT=0.132

UNSAT
TT=0.211

UNSAT
TT=1.834

UNSAT
TT=0.834

UNSAT
TT=1.143

UNSAT
TT=0.113

UNSAT
TT=0.824

UNSAT
TT=0.935

UNSAT
TT=0.604

UNSAT
TT=0.346

UNSAT
TT=1.213

UNSAT
TT=1.023

UNSAT
TT=1.175

UNSAT
TT=1.164

UNSAT
TT=1.121

UNSAT
TT=0.029

? (problem)
TT=0.606

? (problem)
TT=0.698

UNSAT
TT=138.731

UNSAT
TT=110.126

UNSAT
TT=0.105

No dataNo dataNo dataNo dataUNSAT
TT=0.094

No dataNo dataUNSAT
TT=1.538

UNSAT
TT=0.985

UNSAT
TT=0.794

UNSAT
TT=0.929

UNSAT
TT=0.901

UNSAT
TT=0.881

UNSAT
TT=0.766

UNSAT
TT=0.804

UNSAT
TT=0.095

No dataNo dataUNSAT
TT=0.102

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9014_1-unsat.opb
UNSAT
TT=0.017

UNSAT
TT=0.147

UNSAT
TT=0.017

No data? (problem)
TT=1.137

UNSAT
TT=1.333

? (problem)
TT=1.271

UNSAT
TT=1.325

? (problem)
TT=1.147

UNSAT
TT=1.344

? (problem)
TT=1.179

UNSAT
TT=1.297

UNSAT
TT=0.158

UNSAT
TT=0.254

UNSAT
TT=2.255

UNSAT
TT=1.124

UNSAT
TT=1.208

UNSAT
TT=0.144

UNSAT
TT=0.865

UNSAT
TT=1.239

UNSAT
TT=0.563

UNSAT
TT=0.539

UNSAT
TT=1.223

UNSAT
TT=1.353

UNSAT
TT=1.305

UNSAT
TT=1.354

UNSAT
TT=1.489

UNSAT
TT=0.036

? (problem)
TT=1.199

? (problem)
TT=1.126

UNSAT
TT=246.069

UNSAT
TT=250.436

UNSAT
TT=0.13

No dataNo dataNo dataNo dataUNSAT
TT=0.12

No dataNo dataUNSAT
TT=1.593

UNSAT
TT=0.913

UNSAT
TT=0.855

UNSAT
TT=1.27

UNSAT
TT=1.197

UNSAT
TT=1.342

UNSAT
TT=0.968

UNSAT
TT=0.988

UNSAT
TT=0.123

No dataNo dataUNSAT
TT=0.119

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9015_7-unsat.opb
UNSAT
TT=0.014

UNSAT
TT=0.135

UNSAT
TT=0.014

No data? (problem)
TT=1.246

UNSAT
TT=1.305

? (problem)
TT=1.465

UNSAT
TT=1.274

? (problem)
TT=1.285

UNSAT
TT=1.317

? (problem)
TT=1.413

UNSAT
TT=1.268

UNSAT
TT=0.142

UNSAT
TT=0.233

UNSAT
TT=2.071

UNSAT
TT=0.98

UNSAT
TT=1.186

UNSAT
TT=0.133

UNSAT
TT=0.833

UNSAT
TT=1.077

UNSAT
TT=0.598

UNSAT
TT=0.498

UNSAT
TT=1.225

UNSAT
TT=1.173

UNSAT
TT=1.206

UNSAT
TT=1.324

UNSAT
TT=1.281

UNSAT
TT=0.036

? (problem)
TT=1.335

? (problem)
TT=1.3

UNSAT
TT=281.011

UNSAT
TT=190.866

UNSAT
TT=0.122

No dataNo dataNo dataNo dataUNSAT
TT=0.11

No dataNo dataUNSAT
TT=1.579

UNSAT
TT=0.905

UNSAT
TT=0.844

UNSAT
TT=1.103

UNSAT
TT=1.036

UNSAT
TT=1.07

UNSAT
TT=0.862

UNSAT
TT=0.872

UNSAT
TT=0.11

No dataNo dataUNSAT
TT=0.116

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9016_7-sat.opb
SAT
TT=0.039
T1=0.03
SAT
TT=0.272
T1=0.27
SAT
TT=0.039
T1=0.03
No data? (problem)
TT=1.439

SAT
TT=9.717
T1=9.71
? (problem)
TT=1.449

? (problem)
TT=9.62

? (problem)
TT=1.554

? (problem)
TT=10.6

? (problem)
TT=1.401

? (problem)
TT=9.27

SAT
TT=0.258
T1=0.26
SAT
TT=1.22
T1=1.21
SAT
TT=1.679
T1=1.51
SAT
TT=1.1
T1=1.09
SAT
TT=1.944
T1=0.83
SAT
TT=0.278
T1=0.27
SAT
TT=1.664
T1=0.65
SAT
TT=19.029
T1=18.98
SAT
TT=1.066
T1=1.13
SAT
TT=0.69
T1=0.53
SAT
TT=2.314
T1=1.75
SAT
TT=57.963
T1=57.92
SAT
TT=1.173
T1=1.26
SAT
TT=2.385
T1=1.25
SAT
TT=35.355
T1=35.28
SAT
TT=0.363
T1=0.35
? (problem)
TT=1.383

? (problem)
TT=1.572

SAT
TT=278.973
T1=264.1
SAT
TT=215.965
T1=204.8
SAT
TT=0.131
T1=0.12
No dataNo dataNo dataNo dataSAT
TT=0.13
T1=0.12
No dataNo dataSAT
TT=3.663
T1=1.6
SAT
TT=1.714
T1=0.71
SAT
TT=1.584
T1=0.7
SAT
TT=19.774
T1=19.7
SAT
TT=41.48
T1=20.73
SAT
TT=2.775
T1=2.7
SAT
TT=0.723
T1=0.71
SAT
TT=0.777
T1=0.76
SAT
TT=0.135
T1=0.12
No dataNo dataSAT
TT=0.134
T1=0.12
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j901_6-sat.opb
SAT
TT=0.042
T1=0.03
SAT
TT=0.65
T1=0.64
SAT
TT=0.042
T1=0.03
No data? (problem)
TT=0.163

SAT
TT=1.184
T1=1.32
? (problem)
TT=0.167

? (problem)
TT=1.106

? (problem)
TT=0.181

? (problem)
TT=1.175

? (problem)
TT=0.175

? (problem)
TT=1.112

SAT
TT=0.527
T1=0.52
SAT
TT=0.643
T1=0.63
SAT
TT=1.754
T1=1.58
SAT
TT=1.352
T1=1.35
SAT
TT=1.864
T1=0.82
SAT
TT=0.62
T1=0.61
SAT
TT=1.923
T1=0.82
SAT
TT=219.939
T1=219.93
SAT
TT=1.116
T1=1.21
SAT
TT=6.598
T1=6.39
SAT
TT=2.643
T1=1.7
SAT
TT=4.666
T1=4.59
SAT
TT=1.17
T1=1.23
SAT
TT=2.918
T1=1.24
SAT
TT=74.409
T1=74.33
SAT
TT=0.128
T1=0.12
? (problem)
TT=0.155

? (problem)
TT=0.165

SAT
TT=88.026
T1=85.54
SAT
TT=81.915
T1=79.98
SAT
TT=0.128
T1=0.11
No dataNo dataNo dataNo dataSAT
TT=0.128
T1=0.11
No dataNo dataSAT
TT=3.383
T1=1.34
SAT
TT=2.064
T1=0.85
SAT
TT=1.793
T1=0.79
SAT
TT=3.595
T1=3.51
SAT
TT=3.786
T1=3.71
SAT
TT=87.496
T1=87.44
SAT
TT=0.813
T1=0.8
SAT
TT=0.798
T1=0.78
SAT
TT=0.132
T1=0.12
No dataNo dataSAT
TT=0.133
T1=0.12
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j902_5-sat.opb
SAT
TT=0.055
T1=0.04
SAT
TT=0.665
T1=0.66
SAT
TT=0.055
T1=0.04
No data? (problem)
TT=0.264

SAT
TT=2.085
T1=2.08
? (problem)
TT=0.268

? (problem)
TT=1.99

? (problem)
TT=0.25

? (problem)
TT=2.06

? (problem)
TT=0.293

? (problem)
TT=2.01

SAT
TT=0.529
T1=0.52
SAT
TT=0.808
T1=0.8
SAT
TT=2.389
T1=2.14
SAT
TT=2.349
T1=2.34
SAT
TT=1.833
T1=0.81
SAT
TT=0.641
T1=0.63
SAT
TT=1.804
T1=0.75
SAT
TT=3.073
T1=3
SAT
TT=1.313
T1=1.44
SAT
TT=0.874
T1=0.49
SAT
TT=2.424
T1=1.78
SAT
TT=115.391
T1=115.31
SAT
TT=1.404
T1=1.5
SAT
TT=2.644
T1=1.33
SAT
TT=59.549
T1=59.46
SAT
TT=0.139
T1=0.13
? (problem)
TT=0.242

? (problem)
TT=0.256

SAT
TT=135.427
T1=131.75
SAT
TT=99.589
T1=96.47
SAT
TT=0.18
T1=0.16
No dataNo dataNo dataNo dataSAT
TT=0.17
T1=0.16
No dataNo dataSAT
TT=2.943
T1=1.41
SAT
TT=1.915
T1=0.8
SAT
TT=1.715
T1=0.79
SAT
TT=3.507
T1=3.4
SAT
TT=3.645
T1=3.55
SAT
TT=11.131
T1=11.02
SAT
TT=0.991
T1=0.98
SAT
TT=1.009
T1=0.99
SAT
TT=0.174
T1=0.16
No dataNo dataSAT
TT=0.169
T1=0.15
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9038_3-unsat.opb
UNSAT
TT=0.043

UNSAT
TT=0.206

UNSAT
TT=0.043

No data? (problem)
TT=0.438

UNSAT
TT=5.348

? (problem)
TT=0.419

UNSAT
TT=5.6

? (problem)
TT=0.426

UNSAT
TT=5.166

? (problem)
TT=0.452

UNSAT
TT=5.37

UNSAT
TT=0.213

UNSAT
TT=0.807

UNSAT
TT=2.388

UNSAT
TT=2.054

UNSAT
TT=1.867

UNSAT
TT=0.219

UNSAT
TT=1.655

UNSAT
TT=63.808

UNSAT
TT=0.638

UNSAT
TT=0.95

UNSAT
TT=2.466

UNSAT
TT=3.705

UNSAT
TT=1.342

UNSAT
TT=3.073

UNSAT
TT=3.26

UNSAT
TT=0.146

? (problem)
TT=0.441

? (problem)
TT=0.439

UNSAT
TT=139.409

UNSAT
TT=136.644

UNSAT
TT=0.17

No dataNo dataNo dataNo dataUNSAT
TT=0.158

No dataNo dataUNSAT
TT=3.295

UNSAT
TT=1.804

UNSAT
TT=1.684

UNSAT
TT=3.278

UNSAT
TT=3.006

UNSAT
TT=3.177

UNSAT
TT=0.927

UNSAT
TT=0.968

UNSAT
TT=0.163

No dataNo dataUNSAT
TT=0.158

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9040_1-sat.opb
SAT
TT=0.053
T1=0.04
SAT
TT=0.486
T1=0.48
SAT
TT=0.053
T1=0.04
No data? (problem)
TT=0.572

SAT
TT=5.175
T1=5.8
? (problem)
TT=0.601

? (problem)
TT=4.95

? (problem)
TT=0.569

? (problem)
TT=4.89

? (problem)
TT=0.574

? (problem)
TT=4.88

SAT
TT=0.422
T1=0.42
SAT
TT=1.895
T1=0.99
SAT
TT=2.532
T1=2.26
SAT
TT=2.349
T1=2.34
SAT
TT=2.014
T1=0.85
SAT
TT=0.479
T1=0.47
SAT
TT=1.855
T1=0.78
SAT
TT=37.931
T1=37.87
SAT
TT=1.321
T1=1.38
SAT
TT=0.867
T1=0.52
SAT
TT=2.413
T1=1.85
SAT
TT=57.583
T1=57.52
SAT
TT=1.435
T1=1.49
SAT
TT=2.894
T1=1.46
SAT
TT=3.459
T1=3.36
SAT
TT=0.198
T1=0.19
? (problem)
TT=0.604

? (problem)
TT=0.588

SAT
TT=155.641
T1=148.71
SAT
TT=151.971
T1=146.45
SAT
TT=0.179
T1=0.16
No dataNo dataNo dataNo dataSAT
TT=0.18
T1=0.16
No dataNo dataSAT
TT=3.194
T1=1.57
SAT
TT=1.993
T1=0.84
SAT
TT=1.834
T1=0.85
SAT
TT=3.136
T1=3.04
SAT
TT=3.237
T1=3.15
SAT
TT=3.987
T1=3.91
SAT
TT=1.061
T1=1.04
SAT
TT=1.071
T1=1.05
SAT
TT=0.184
T1=0.17
No dataNo dataSAT
TT=0.185
T1=0.17
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9040_1-unsat.opb
UNSAT
TT=0.019

UNSAT
TT=0.142

UNSAT
TT=0.019

No data? (problem)
TT=0.569

UNSAT
TT=0.689

? (problem)
TT=0.556

UNSAT
TT=0.682

? (problem)
TT=0.567

UNSAT
TT=0.658

? (problem)
TT=0.57

UNSAT
TT=0.661

UNSAT
TT=0.159

UNSAT
TT=0.311

UNSAT
TT=2.45

UNSAT
TT=1.432

UNSAT
TT=1.256

UNSAT
TT=0.151

UNSAT
TT=0.876

UNSAT
TT=1.46

UNSAT
TT=0.566

UNSAT
TT=0.354

UNSAT
TT=1.283

UNSAT
TT=1.571

UNSAT
TT=1.345

UNSAT
TT=1.493

UNSAT
TT=1.77

UNSAT
TT=0.042

? (problem)
TT=0.594

? (problem)
TT=0.63

UNSAT
TT=121.716

UNSAT
TT=145.133

UNSAT
TT=0.124

No dataNo dataNo dataNo dataUNSAT
TT=0.125

No dataNo dataUNSAT
TT=1.655

UNSAT
TT=1.162

UNSAT
TT=0.853

UNSAT
TT=1.593

UNSAT
TT=1.425

UNSAT
TT=1.595

UNSAT
TT=1.022

UNSAT
TT=1.028

UNSAT
TT=0.13

No dataNo dataUNSAT
TT=0.124

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9042_4-sat.opb
SAT
TT=0.058
T1=0.05
SAT
TT=0.585
T1=0.58
SAT
TT=0.058
T1=0.05
No data? (problem)
TT=0.71

SAT
TT=7.351
T1=7.34
? (problem)
TT=0.712

? (problem)
TT=7.14

? (problem)
TT=0.707

? (problem)
TT=6.27

? (problem)
TT=0.727

? (problem)
TT=6.22

SAT
TT=0.506
T1=0.5
SAT
TT=1.74
T1=1.73
SAT
TT=2.813
T1=2.5
SAT
TT=2.71
T1=2.77
SAT
TT=2.243
T1=0.96
SAT
TT=0.613
T1=0.6
SAT
TT=2.323
T1=1.02
SAT
TT=164.065
T1=164.03
SAT
TT=1.341
T1=1.43
SAT
TT=15.483
T1=15.09
SAT
TT=2.814
T1=1.87
SAT
TT=7.989
T1=7.91
SAT
TT=1.525
T1=1.59
SAT
TT=3.223
T1=1.5
SAT
TT=243.262
T1=243.21
SAT
TT=0.717
T1=0.7
? (problem)
TT=0.833

? (problem)
TT=0.727

SAT
TT=692.369
T1=680.35
SAT
TT=626.402
T1=616.9
SAT
TT=0.198
T1=0.19
No dataNo dataNo dataNo dataSAT
TT=0.195
T1=0.19
No dataNo dataSAT
TT=4.165
T1=1.61
SAT
TT=2.427
T1=0.98
SAT
TT=2.143
T1=0.9
SAT
TT=5.875
T1=5.79
SAT
TT=6.467
T1=6.37
SAT
TT=116.54
T1=116.46
SAT
TT=1.155
T1=1.14
SAT
TT=1.216
T1=1.19
SAT
TT=0.201
T1=0.19
No dataNo dataSAT
TT=0.205
T1=0.19
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9045_1-sat.opb



?
TT=1798.02

? (TO)
TT=1800.1

No data? (problem)
TT=1.092

? (TO)
TT=1800.11

? (problem)
TT=1.19

? (TO)
TT=1800.01

? (problem)
TT=1.127

? (TO)
TT=1800.04

? (problem)
TT=1.068

? (TO)
TT=1800.07

? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.05

? (TO)
TT=1800.04

? (TO)
TT=1800.06

?
TT=1798

? (TO)
TT=1801.17

?
TT=1793.93

? (TO)
TT=1800.08

?
TT=1798.88

? (TO)
TT=1800.1

?
TT=1789.88

? (MO)
TT=1528.07

? (TO)
TT=1800.91

?
TT=1796.98

? (TO)
TT=1800.1

? (problem)
TT=1.083

? (problem)
TT=1.124

? (TO)
TT=1800.03

? (TO)
TT=1800.06

?
TT=1799.9

No dataNo dataNo dataNo data?
TT=1799.76

No dataNo data? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.58

?
TT=1797.07

?
TT=1796.99

?
TT=1796.95

? (TO)
TT=1800.06

? (TO)
TT=1800.09

?
TT=1799.56

No dataNo data?
TT=1799.42

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j9048_9-sat.opb
SAT
TT=0.051
T1=0.04
SAT
TT=0.4
T1=0.39
SAT
TT=0.051
T1=0.04
No data? (problem)
TT=1.503

SAT
TT=9.503
T1=9.54
? (problem)
TT=1.453

? (problem)
TT=10.19

? (problem)
TT=1.517

? (problem)
TT=8.9

? (problem)
TT=1.526

? (problem)
TT=8.87

SAT
TT=0.352
T1=0.35
SAT
TT=1.363
T1=1.35
SAT
TT=2.516
T1=2.25
SAT
TT=2.107
T1=2.1
SAT
TT=1.995
T1=0.87
SAT
TT=0.39
T1=0.38
SAT
TT=1.943
T1=0.81
SAT
TT=2.595
T1=2.54
SAT
TT=1.32
T1=1.37
SAT
TT=1.004
T1=0.7
SAT
TT=2.504
T1=1.9
SAT
TT=47.867
T1=47.81
SAT
TT=1.398
T1=1.54
SAT
TT=3.175
T1=1.54
SAT
TT=2.979
T1=2.89
SAT
TT=0.362
T1=0.35
? (problem)
TT=1.521

? (problem)
TT=1.433

SAT
TT=340.947
T1=320.55
SAT
TT=275.178
T1=260.4
SAT
TT=0.183
T1=0.17
No dataNo dataNo dataNo dataSAT
TT=0.183
T1=0.17
No dataNo dataSAT
TT=3.304
T1=1.61
SAT
TT=2.204
T1=0.9
SAT
TT=1.796
T1=0.83
SAT
TT=17.917
T1=17.85
SAT
TT=18.124
T1=18.05
SAT
TT=3.562
T1=3.49
SAT
TT=1.058
T1=1.04
SAT
TT=1.117
T1=1.1
SAT
TT=0.189
T1=0.17
No dataNo dataSAT
TT=0.187
T1=0.17
/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j905_6-unsat.opb
UNSAT
TT=0.261

UNSAT
TT=4.048

UNSAT
TT=0.261

No data? (problem)
TT=0.32

UNSAT
TT=3.734

? (problem)
TT=0.314

UNSAT
TT=3.66

? (problem)
TT=0.307

UNSAT
TT=3.86

? (problem)
TT=0.362

UNSAT
TT=3.63

UNSAT
TT=11.464

UNSAT
TT=22.077

UNSAT
TT=2.596

UNSAT
TT=3.353

UNSAT
TT=3.294

UNSAT
TT=3.936

UNSAT
TT=3.683

UNSAT
TT=6.989

UNSAT
TT=1.004

UNSAT
TT=454.251

UNSAT
TT=7.282

UNSAT
TT=7.408

UNSAT
TT=1.604

UNSAT
TT=7.302

UNSAT
TT=7.654

UNSAT
TT=17.097

? (problem)
TT=0.382

? (problem)
TT=0.321

? (TO)
TT=1800.03

? (TO)
TT=1800.06

UNSAT
TT=0.503

No dataNo dataNo dataNo dataUNSAT
TT=0.492

No dataNo dataUNSAT
TT=6.794

UNSAT
TT=2.964

UNSAT
TT=2.684

UNSAT
TT=10.73

UNSAT
TT=11.015

UNSAT
TT=16.066

UNSAT
TT=5.718

UNSAT
TT=5.851

UNSAT
TT=0.491

No dataNo dataUNSAT
TT=0.508

/DEC-SMALLINT-LIN/
oliveras/j90/
normalized-j908_8-unsat.opb
UNSAT
TT=0.012

UNSAT
TT=0.098

UNSAT
TT=0.012

No data? (problem)
TT=0.592

UNSAT
TT=0.635

? (problem)
TT=0.565

UNSAT
TT=0.618

? (problem)
TT=0.579

UNSAT
TT=0.615

? (problem)
TT=0.632

UNSAT
TT=0.615

UNSAT
TT=0.113

UNSAT
TT=0.191

UNSAT
TT=1.6

UNSAT
TT=0.686

UNSAT
TT=0.984

UNSAT
TT=0.095

UNSAT
TT=0.783

UNSAT
TT=0.821

UNSAT
TT=0.572

UNSAT
TT=0.24

UNSAT
TT=1.164

UNSAT
TT=0.835

UNSAT
TT=1.047

UNSAT
TT=1.093

UNSAT
TT=0.972

UNSAT
TT=0.032

? (problem)
TT=0.651

? (problem)
TT=0.631

UNSAT
TT=82.316

UNSAT
TT=72.71

UNSAT
TT=0.083

No dataNo dataNo dataNo dataUNSAT
TT=0.081

No dataNo dataUNSAT
TT=1.477

UNSAT
TT=0.826

UNSAT
TT=0.796

UNSAT
TT=0.769

UNSAT
TT=0.791

UNSAT
TT=0.849

UNSAT
TT=0.641

UNSAT
TT=0.648

UNSAT
TT=0.085

No dataNo dataUNSAT
TT=0.086

/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K65.opb
UNSAT
TT=312.531

?
TT=1798.01

UNSAT
TT=312.531

No data? (problem)
TT=0.044

UNSAT
TT=816.95

? (problem)
TT=0.046

UNSAT
TT=796.71

? (problem)
TT=0.04

UNSAT
TT=792.24

? (problem)
TT=0.041

UNSAT
TT=818.73

? (TO)
TT=1800.13

? (TO)
TT=1800.1

UNSAT
TT=597.702

? (TO)
TT=1800.01

? (TO)
TT=1800.54

?
TT=1798.12

? (TO)
TT=1800.78

?
TT=1796.25

? (TO)
TT=1800.07

? (TO)
TT=1800.04

? (TO)
TT=1800.01

?
TT=1789.76

? (MO)
TT=1071.34

? (TO)
TT=1800.15

?
TT=1796.76

? (TO)
TT=1800.09

? (problem)
TT=0.04

? (problem)
TT=0.038

? (TO)
TT=1800.1

UNSAT
TT=1181.8

?
TT=1799.62

No dataNo dataNo dataNo data?
TT=1799.64

No dataNo data? (TO)
TT=1800.73

? (TO)
TT=1800.52

UNSAT
TT=1730.31

?
TT=1796.76

?
TT=1796.75

?
TT=1796.74

? (TO)
TT=1800.09

? (TO)
TT=1800.02

?
TT=1799.96

No dataNo data?
TT=1799.95

/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K66.opb
UNSAT
TT=871.544

?
TT=1798.04

? (TO)
TT=1800.03

No data? (problem)
TT=0.046

UNSAT
TT=1518.19

? (problem)
TT=0.044

UNSAT
TT=1517.3

? (problem)
TT=0.041

UNSAT
TT=1582.81

? (problem)
TT=0.042

UNSAT
TT=1523.7

? (TO)
TT=1800.1

? (TO)
TT=1800.11

UNSAT
TT=871.544

? (TO)
TT=1800.02

? (TO)
TT=1800.08

?
TT=1798.05

? (TO)
TT=1800.31

?
TT=1796.28

? (TO)
TT=1800.06

? (TO)
TT=1800.34

? (TO)
TT=1800.07

?
TT=1789.76

? (MO)
TT=1078.27

? (TO)
TT=1800.2

?
TT=1796.76

? (TO)
TT=1800.08

? (problem)
TT=0.043

? (problem)
TT=0.04

? (TO)
TT=1800.09

? (TO)
TT=1800.03

?
TT=1800.02

No dataNo dataNo dataNo data?
TT=1799.6

No dataNo data? (TO)
TT=1800.14

? (TO)
TT=1800.61

? (TO)
TT=1800.64

?
TT=1796.75

?
TT=1796.77

?
TT=1796.75

? (TO)
TT=1800.1

? (TO)
TT=1800.09

?
TT=1799.58

No dataNo data?
TT=1799.82

/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K67.opb
SAT
TT=29.518
T1=29.52
?
TT=1798.03

SAT
TT=62.499
T1=62.51
No data? (problem)
TT=0.043

SAT
TT=475.608
T1=475.68
? (problem)
TT=0.045

SAT
TT=484.005
T1=484.19
? (problem)
TT=0.046

SAT
TT=474.163
T1=474.24
? (problem)
TT=0.043

SAT
TT=488.065
T1=488.13
? (TO)
TT=1800.06

? (TO)
TT=1800.11

SAT
TT=943.132
T1=943.28
? (TO)
TT=1800.1

? (TO)
TT=1800.08

?
TT=1798.08

? (TO)
TT=1800.72

?
TT=1796.41

SAT
TT=1127.61
T1=1077.28
? (TO)
TT=1800.39

? (TO)
TT=1800.12

?
TT=1789.94

SAT
TT=92.784
T1=93.48
SAT
TT=864.86
T1=444.49
?
TT=1796.78

SAT
TT=1075.33
T1=1075.53
? (problem)
TT=0.04

? (problem)
TT=0.04

SAT
TT=881.594
T1=881.35
SAT
TT=471.937
T1=471.6
SAT
TT=29.518
T1=29.52
No dataNo dataNo dataNo data?
TT=1799.58

No dataNo dataSAT
TT=1357.53
T1=697.48
? (TO)
TT=1800.01

SAT
TT=739
T1=736.73
?
TT=1796.76

?
TT=1796.77

?
TT=1796.76

? (TO)
TT=1800.08

? (TO)
TT=1800.09

?
TT=1799.85

No dataNo data?
TT=1799.6

/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K68.opb
SAT
TT=15.973
T1=14.95
?
TT=1798

SAT
TT=104.871
T1=104.89
No data? (problem)
TT=0.042

SAT
TT=45.575
T1=45.58
? (problem)
TT=0.048

SAT
TT=44.811
T1=44.82
? (problem)
TT=0.042

SAT
TT=46.746
T1=46.75
? (problem)
TT=0.045

SAT
TT=44.978
T1=44.99
? (TO)
TT=1800.06

SAT
TT=74.675
T1=74.68
SAT
TT=63.163
T1=63.15
? (TO)
TT=1800.11

? (TO)
TT=1800.03

?
TT=1798.01

SAT
TT=1370.44
T1=1368.6
?
TT=1797.58

SAT
TT=884.602
T1=843.45
? (TO)
TT=1800.26

SAT
TT=1398.93
T1=719.92
?
TT=1789.87

? (MO)
TT=1075.11

? (TO)
TT=1800.18

?
TT=1796.75

SAT
TT=1019.93
T1=1020.13
? (problem)
TT=0.042

? (problem)
TT=0.044

SAT
TT=459.154
T1=458.81
SAT
TT=319.132
T1=318.92
SAT
TT=599.73
T1=599.93
No dataNo dataNo dataNo dataSAT
TT=153.63
T1=153.76
No dataNo data? (TO)
TT=1800.2

SAT
TT=15.973
T1=14.95
SAT
TT=181.68
T1=180.38
?
TT=1796.76

?
TT=1796.74

?
TT=1796.75

? (TO)
TT=1800.1

? (TO)
TT=1800.08

SAT
TT=154.83
T1=154.96
No dataNo dataSAT
TT=150.95
T1=151.06
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K69.opb
SAT
TT=20.35
T1=19.38
SAT
TT=1015.58
T1=1015.97
SAT
TT=27.154
T1=27.15
No data? (problem)
TT=0.049

SAT
TT=63.115
T1=63.13
? (problem)
TT=0.047

SAT
TT=67.638
T1=67.65
? (problem)
TT=0.045

SAT
TT=64.111
T1=64.12
? (problem)
TT=0.049

SAT
TT=62.575
T1=62.58
? (TO)
TT=1800.04

SAT
TT=808.164
T1=808.31
SAT
TT=34.037
T1=34.02
SAT
TT=77.017
T1=77.03
SAT
TT=209.64
T1=208.21
?
TT=1798.21

SAT
TT=62.32
T1=61.6
?
TT=1796.39

SAT
TT=59.894
T1=58.53
? (TO)
TT=1800.02

SAT
TT=782.374
T1=412.08
?
TT=1790.21

SAT
TT=72.112
T1=72.08
SAT
TT=610.38
T1=314.49
?
TT=1796.76

SAT
TT=111.446
T1=111.46
? (problem)
TT=0.043

? (problem)
TT=0.04

SAT
TT=479.597
T1=479.2
SAT
TT=309.893
T1=309.53
SAT
TT=586.12
T1=586.33
No dataNo dataNo dataNo dataSAT
TT=860.11
T1=860.31
No dataNo dataSAT
TT=113.336
T1=57.01
SAT
TT=20.35
T1=19.38
SAT
TT=119.816
T1=118.5
?
TT=1796.77

?
TT=1796.79

?
TT=1796.75

? (TO)
TT=1800.1

? (TO)
TT=1800.11

SAT
TT=867.66
T1=867.97
No dataNo dataSAT
TT=839.48
T1=839.78
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K70.opb
SAT
TT=10.811
T1=9.94
SAT
TT=11.415
T1=11.41
SAT
TT=21.075
T1=21.07
No data? (problem)
TT=0.045

SAT
TT=33.083
T1=33.09
? (problem)
TT=0.048

? (problem)
TT=33.74

? (problem)
TT=0.046

? (problem)
TT=33

? (problem)
TT=0.044

? (problem)
TT=33.93

? (TO)
TT=1800.06

SAT
TT=199.486
T1=199.51
SAT
TT=16.936
T1=16.94
SAT
TT=52.928
T1=52.93
SAT
TT=507.16
T1=505.49
?
TT=1798.02

SAT
TT=518.61
T1=517.42
?
TT=1795.76

SAT
TT=20.475
T1=20.82
? (TO)
TT=1800.4

SAT
TT=154.331
T1=77.47
?
TT=1789.76

SAT
TT=473.72
T1=471.02
SAT
TT=191.025
T1=96.52
?
TT=1796.75

SAT
TT=47.287
T1=47.29
? (problem)
TT=0.042

? (problem)
TT=0.04

SAT
TT=694.235
T1=693.76
SAT
TT=243.112
T1=242.93
SAT
TT=28.979
T1=28.98
No dataNo dataNo dataNo dataSAT
TT=1556.94
T1=1557.34
No dataNo dataSAT
TT=580.437
T1=300.16
SAT
TT=10.811
T1=9.94
SAT
TT=134.943
T1=133.54
?
TT=1796.76

?
TT=1796.77

?
TT=1796.75

? (TO)
TT=1800.1

? (TO)
TT=1800.11

SAT
TT=1547.43
T1=1547.8
No dataNo dataSAT
TT=1622.77
T1=1623.19
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K71.opb
SAT
TT=5.157
T1=5.15
?
TT=1798.04

SAT
TT=11.408
T1=11.4
No data? (problem)
TT=0.046

SAT
TT=62.986
T1=63
? (problem)
TT=0.046

SAT
TT=61.985
T1=61.99
? (problem)
TT=0.049

SAT
TT=62.535
T1=62.54
? (problem)
TT=0.048

SAT
TT=62.071
T1=62.07
? (TO)
TT=1800.15

SAT
TT=74.39
T1=74.41
SAT
TT=37.734
T1=37.71
SAT
TT=1385.57
T1=1385.79
SAT
TT=436.04
T1=434.57
SAT
TT=429.904
T1=429.93
SAT
TT=64.565
T1=63.82
?
TT=1796.28

SAT
TT=34.13
T1=32.72
? (TO)
TT=1800.09

SAT
TT=61.913
T1=30.38
?
TT=1790.14

SAT
TT=60.274
T1=61.05
SAT
TT=119.147
T1=59.62
?
TT=1796.77

SAT
TT=5.157
T1=5.15
? (problem)
TT=0.043

? (problem)
TT=0.043

SAT
TT=470.27
T1=469.93
SAT
TT=275.559
T1=275.23
SAT
TT=21.287
T1=21.29
No dataNo dataNo dataNo dataSAT
TT=20.491
T1=20.54
No dataNo dataSAT
TT=133.324
T1=67.79
SAT
TT=48.885
T1=47.63
SAT
TT=76.428
T1=37.28
?
TT=1796.74

?
TT=1796.77

?
TT=1796.75

? (TO)
TT=1800.07

? (TO)
TT=1800.09

SAT
TT=20.938
T1=20.99
No dataNo dataSAT
TT=22.18
T1=22.23
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K72.opb
SAT
TT=4.824
T1=4.82
SAT
TT=1215.56
T1=1216.02
SAT
TT=7.616
T1=7.61
No data? (problem)
TT=0.047

SAT
TT=4.824
T1=4.82
? (problem)
TT=0.048

SAT
TT=4.838
T1=4.94
? (problem)
TT=0.045

SAT
TT=4.824
T1=4.82
? (problem)
TT=0.049

SAT
TT=4.837
T1=4.83
? (TO)
TT=1800.11

SAT
TT=17.954
T1=17.95
SAT
TT=20.145
T1=20.12
SAT
TT=15.974
T1=15.97
SAT
TT=365.108
T1=363.33
SAT
TT=104.129
T1=104.13
SAT
TT=92.891
T1=92.11
?
TT=1796.54

SAT
TT=14.199
T1=13.72
? (TO)
TT=1800.23

SAT
TT=115.985
T1=57.37
?
TT=1789.94

SAT
TT=285.941
T1=286.24
SAT
TT=49.127
T1=23.98
?
TT=1796.83

SAT
TT=15.507
T1=15.5
? (problem)
TT=0.044

? (problem)
TT=0.043

SAT
TT=647.161
T1=646.84
SAT
TT=174.393
T1=173.83
SAT
TT=7.259
T1=7.27
No dataNo dataNo dataNo dataSAT
TT=44.29
T1=44.39
No dataNo dataSAT
TT=144.832
T1=73.66
SAT
TT=36.547
T1=34.97
SAT
TT=41.43
T1=40.28
?
TT=1796.77

?
TT=1796.77

?
TT=1796.76

SAT
TT=250.31
T1=250.38
SAT
TT=245.475
T1=245.53
SAT
TT=43.57
T1=43.67
No dataNo dataSAT
TT=42.08
T1=42.19
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K73.opb
SAT
TT=1.467
T1=1.46
SAT
TT=190.132
T1=190.14
SAT
TT=1.467
T1=1.46
No data? (problem)
TT=0.046

SAT
TT=27.19
T1=27.19
? (problem)
TT=0.047

SAT
TT=27.334
T1=27.33
? (problem)
TT=0.047

SAT
TT=27.495
T1=27.49
? (problem)
TT=0.047

SAT
TT=27.04
T1=27.05
SAT
TT=182.345
T1=182.35
SAT
TT=25.255
T1=25.25
SAT
TT=34.605
T1=34.58
SAT
TT=16.919
T1=16.92
SAT
TT=13.973
T1=13.16
SAT
TT=48.692
T1=48.69
SAT
TT=24.172
T1=23.41
?
TT=1796.2

SAT
TT=24.978
T1=25.14
? (TO)
TT=1800.42

SAT
TT=55.567
T1=27.43
?
TT=1789.76

SAT
TT=52.489
T1=53.27
SAT
TT=96.25
T1=48.46
?
TT=1796.76

SAT
TT=6.106
T1=6.1
? (problem)
TT=0.044

? (problem)
TT=0.042

SAT
TT=455.169
T1=454.85
SAT
TT=215.803
T1=215.43
SAT
TT=115.079
T1=115.08
No dataNo dataNo dataNo dataSAT
TT=495.46
T1=495.67
No dataNo dataSAT
TT=252.846
T1=129.87
SAT
TT=10.753
T1=9.78
SAT
TT=44.338
T1=43.32
?
TT=1796.76

?
TT=1796.77

?
TT=1796.76

? (TO)
TT=1800.09

? (TO)
TT=1800.06

SAT
TT=477.76
T1=477.93
No dataNo dataSAT
TT=487.66
T1=487.88
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K74.opb
SAT
TT=6.533
T1=6.37
SAT
TT=374.308
T1=374.44
SAT
TT=7.525
T1=7.52
No data? (problem)
TT=0.047

SAT
TT=26.676
T1=26.68
? (problem)
TT=0.048

SAT
TT=26.565
T1=26.56
? (problem)
TT=0.045

SAT
TT=26.71
T1=26.71
? (problem)
TT=0.053

SAT
TT=26.966
T1=26.96
SAT
TT=141.943
T1=141.94
SAT
TT=9.387
T1=9.38
SAT
TT=12.974
T1=12.94
SAT
TT=102.362
T1=102.38
SAT
TT=37.89
T1=37.13
SAT
TT=17.065
T1=17.06
SAT
TT=100.79
T1=100.14
?
TT=1796.59

SAT
TT=6.533
T1=6.37
? (TO)
TT=1800.19

SAT
TT=74.294
T1=37.41
?
TT=1789.77

SAT
TT=58.57
T1=58.58
SAT
TT=26.358
T1=13
?
TT=1796.76

SAT
TT=22.11
T1=22.1
? (problem)
TT=0.046

? (problem)
TT=0.043

SAT
TT=366.606
T1=366.12
SAT
TT=156.843
T1=156.5
SAT
TT=10.732
T1=10.72
No dataNo dataNo dataNo dataSAT
TT=48.15
T1=48.21
No dataNo dataSAT
TT=74.303
T1=37.34
SAT
TT=16.721
T1=15.39
SAT
TT=30.788
T1=29.85
?
TT=1796.78

?
TT=1796.77

?
TT=1796.76

SAT
TT=308.605
T1=308.67
SAT
TT=311.693
T1=311.74
SAT
TT=48.58
T1=48.65
No dataNo dataSAT
TT=47.78
T1=47.83
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K75.opb
SAT
TT=2.216
T1=2.21
SAT
TT=69.858
T1=69.9
SAT
TT=6.428
T1=6.43
No data? (problem)
TT=0.048

SAT
TT=2.258
T1=2.25
? (problem)
TT=0.05

SAT
TT=2.216
T1=2.21
? (problem)
TT=0.047

SAT
TT=2.226
T1=2.22
? (problem)
TT=0.05

SAT
TT=2.31
T1=2.31
SAT
TT=173.658
T1=173.66
SAT
TT=6.011
T1=6.01
SAT
TT=7.31
T1=7.28
SAT
TT=103.069
T1=103.09
SAT
TT=27.38
T1=26.59
SAT
TT=52.013
T1=52.01
SAT
TT=79.543
T1=78.76
?
TT=1796.01

SAT
TT=25.573
T1=25.68
? (TO)
TT=1800.17

SAT
TT=55.488
T1=27.4
?
TT=1789.76

SAT
TT=71.642
T1=72.32
SAT
TT=39.088
T1=19.42
?
TT=1796.76

SAT
TT=37.336
T1=37.34
? (problem)
TT=0.046

? (problem)
TT=0.044

SAT
TT=447.021
T1=446.59
SAT
TT=162.102
T1=161.67
SAT
TT=6.232
T1=6.22
No dataNo dataNo dataNo dataSAT
TT=8.281
T1=8.3
No dataNo dataSAT
TT=19.242
T1=8.9
SAT
TT=15.462
T1=14.51
SAT
TT=55.95
T1=54.89
?
TT=1796.76

?
TT=1796.77

?
TT=1796.76

SAT
TT=128.41
T1=128.45
SAT
TT=129.226
T1=129.26
SAT
TT=7.789
T1=7.78
No dataNo dataSAT
TT=8.105
T1=8.12
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K76.opb
SAT
TT=1.827
T1=1.31
SAT
TT=32.827
T1=32.82
SAT
TT=2.473
T1=2.47
No data? (problem)
TT=0.048

SAT
TT=1.842
T1=1.83
? (problem)
TT=0.05

SAT
TT=1.827
T1=1.82
? (problem)
TT=0.048

SAT
TT=1.83
T1=1.83
? (problem)
TT=0.048

SAT
TT=1.839
T1=1.83
SAT
TT=51.483
T1=51.48
SAT
TT=16.794
T1=16.79
SAT
TT=7.414
T1=7.38
SAT
TT=11.672
T1=11.67
SAT
TT=14.653
T1=13.9
SAT
TT=67.942
T1=67.93
SAT
TT=56.325
T1=55.61
?
TT=1795.97

SAT
TT=7.04
T1=7.89
? (TO)
TT=1800.03

SAT
TT=17.611
T1=8.39
?
TT=1789.84

SAT
TT=50.951
T1=50.95
SAT
TT=43.459
T1=20.97
?
TT=1796.87

SAT
TT=5.16
T1=5.16
? (problem)
TT=0.045

? (problem)
TT=0.045

SAT
TT=392.502
T1=391.95
SAT
TT=199.766
T1=199.2
SAT
TT=24.109
T1=24.11
No dataNo dataNo dataNo dataSAT
TT=6.105
T1=6.11
No dataNo dataSAT
TT=18.73
T1=8.45
SAT
TT=2.016
T1=1.31
SAT
TT=32.371
T1=30.98
?
TT=1796.79

?
TT=1796.78

?
TT=1796.75

SAT
TT=475.051
T1=475.17
SAT
TT=468.839
T1=468.93
SAT
TT=5.962
T1=5.97
No dataNo dataSAT
TT=5.735
T1=5.74
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K77.opb
SAT
TT=0.872
T1=0.87
SAT
TT=94.731
T1=94.81
SAT
TT=7.018
T1=7.01
No data? (problem)
TT=0.047

SAT
TT=1.942
T1=1.94
? (problem)
TT=0.05

SAT
TT=1.894
T1=1.89
? (problem)
TT=0.05

SAT
TT=2.01
T1=2
? (problem)
TT=0.047

SAT
TT=1.904
T1=1.9
SAT
TT=4.622
T1=4.62
SAT
TT=18.277
T1=18.27
SAT
TT=10.752
T1=10.71
SAT
TT=1.056
T1=1.05
SAT
TT=15.754
T1=14.97
SAT
TT=17.867
T1=17.86
SAT
TT=25.732
T1=24.98
?
TT=1795.81

SAT
TT=6.305
T1=6.19
? (TO)
TT=1800.27

SAT
TT=50.895
T1=25.54
?
TT=1790.14

SAT
TT=52.634
T1=53.34
SAT
TT=15.773
T1=7.41
?
TT=1796.56

SAT
TT=6.257
T1=6.25
? (problem)
TT=0.048

? (problem)
TT=0.048

SAT
TT=463.874
T1=463.42
SAT
TT=139.597
T1=139.27
SAT
TT=12.653
T1=12.68
No dataNo dataNo dataNo dataSAT
TT=0.872
T1=0.87
No dataNo dataSAT
TT=5.285
T1=1.91
SAT
TT=8.972
T1=7.66
SAT
TT=25.1
T1=24.23
?
TT=1796.76

?
TT=1796.74

?
TT=1796.76

SAT
TT=163.461
T1=163.52
SAT
TT=171.444
T1=171.46
SAT
TT=0.942
T1=0.93
No dataNo dataSAT
TT=0.962
T1=0.95
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K78.opb
SAT
TT=0.503
T1=0.49
SAT
TT=13.583
T1=13.58
SAT
TT=5.554
T1=5.55
No data? (problem)
TT=0.05

SAT
TT=5.044
T1=5.01
? (problem)
TT=0.05

SAT
TT=4.996
T1=4.99
? (problem)
TT=0.048

SAT
TT=4.919
T1=4.92
? (problem)
TT=0.053

SAT
TT=5.034
T1=5.03
SAT
TT=144.934
T1=144.93
SAT
TT=19.716
T1=19.72
SAT
TT=4.626
T1=4.59
SAT
TT=3.98
T1=3.98
SAT
TT=11.834
T1=11.07
SAT
TT=15.25
T1=15.24
SAT
TT=23.43
T1=22.7
?
TT=1795.72

SAT
TT=4.289
T1=4.24
? (TO)
TT=1800.03

SAT
TT=50.46
T1=25.38
?
TT=1789.77

SAT
TT=53.347
T1=54.01
SAT
TT=18.069
T1=8.45
?
TT=1796.77

SAT
TT=20.055
T1=20.05
? (problem)
TT=0.046

? (problem)
TT=0.046

SAT
TT=399.318
T1=398.66
SAT
TT=147.367
T1=146.88
SAT
TT=0.503
T1=0.49
No dataNo dataNo dataNo dataSAT
TT=5.322
T1=5.33
No dataNo dataSAT
TT=10.183
T1=4.42
SAT
TT=3.672
T1=2.81
SAT
TT=20.452
T1=19.21
?
TT=1796.77

?
TT=1796.78

?
TT=1796.75

SAT
TT=163.821
T1=163.86
SAT
TT=167.092
T1=167.13
SAT
TT=5.552
T1=5.56
No dataNo dataSAT
TT=5.311
T1=5.32
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K79.opb
SAT
TT=1.833
T1=1.27
SAT
TT=16.264
T1=16.26
SAT
TT=1.86
T1=1.85
No data? (problem)
TT=0.051

SAT
TT=1.885
T1=1.88
? (problem)
TT=0.052

SAT
TT=1.879
T1=1.87
? (problem)
TT=0.049

SAT
TT=1.921
T1=1.92
? (problem)
TT=0.055

SAT
TT=1.834
T1=1.83
SAT
TT=6.78
T1=6.78
SAT
TT=28.884
T1=28.88
SAT
TT=2.984
T1=2.95
SAT
TT=12.078
T1=12.08
SAT
TT=16.743
T1=15.97
SAT
TT=9.453
T1=9.45
SAT
TT=17.219
T1=16.44
?
TT=1795.92

SAT
TT=2.67
T1=2.74
? (TO)
TT=1800.18

SAT
TT=35.898
T1=17.39
?
TT=1789.77

SAT
TT=53.049
T1=53.74
SAT
TT=12.142
T1=5.41
?
TT=1796.78

SAT
TT=9.427
T1=9.42
? (problem)
TT=0.048

? (problem)
TT=0.047

SAT
TT=437.89
T1=437.38
SAT
TT=173.574
T1=173.07
SAT
TT=1.833
T1=1.82
No dataNo dataNo dataNo dataSAT
TT=2.863
T1=2.86
No dataNo dataSAT
TT=10.143
T1=4.39
SAT
TT=2.015
T1=1.27
SAT
TT=17.511
T1=16.7
?
TT=1796.78

?
TT=1796.78

?
TT=1796.78

SAT
TT=15.233
T1=15.23
SAT
TT=15.886
T1=15.88
SAT
TT=2.703
T1=2.7
No dataNo dataSAT
TT=2.963
T1=2.96
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/sroussel/
ShortestPathBA/
normalized-BeauxArts_K80.opb
SAT
TT=0.478
T1=0.43
SAT
TT=13.16
T1=13.15
SAT
TT=4.252
T1=4.25
No data? (problem)
TT=0.05

SAT
TT=1.407
T1=1.4
? (problem)
TT=0.053

SAT
TT=1.397
T1=1.39
? (problem)
TT=0.052

SAT
TT=1.412
T1=1.41
? (problem)
TT=0.051

SAT
TT=1.405
T1=1.4
SAT
TT=7.828
T1=7.82
SAT
TT=6.732
T1=6.72
SAT
TT=0.478
T1=0.43
SAT
TT=3.416
T1=3.41
SAT
TT=14.772
T1=14.02
SAT
TT=10.195
T1=10.19
SAT
TT=8.492
T1=7.73
?
TT=1795.76

SAT
TT=3.842
T1=4.82
? (TO)
TT=1800.24

SAT
TT=15.993
T1=7.39
?
TT=1789.99

SAT
TT=53.59
T1=53.59
SAT
TT=17.411
T1=7.9
?
TT=1796.77

SAT
TT=2.484
T1=2.48
? (problem)
TT=0.048

? (problem)
TT=0.046

SAT
TT=510.534
T1=509.87
SAT
TT=131.675
T1=131.18
SAT
TT=2.515
T1=2.5
No dataNo dataNo dataNo dataSAT
TT=2.674
T1=2.67
No dataNo dataSAT
TT=10.322
T1=4.44
SAT
TT=4.963
T1=4.13
SAT
TT=18.401
T1=17.43
?
TT=1796.76

?
TT=1796.76

?
TT=1796.75

SAT
TT=92.726
T1=92.75
SAT
TT=92.745
T1=92.77
SAT
TT=2.884
T1=2.88
No dataNo dataSAT
TT=2.964
T1=3.09
/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K125.opb



?
TT=1798.16

? (TO)
TT=1800.01

No data? (problem)
TT=0.18

? (TO)
TT=1800.03

? (problem)
TT=0.175

? (TO)
TT=1800.03

? (problem)
TT=0.178

? (TO)
TT=1800.06

? (problem)
TT=0.178

? (TO)
TT=1800.08

? (TO)
TT=1800.11

? (TO)
TT=1800.04

? (TO)
TT=1800.09

? (TO)
TT=1800.1

? (TO)
TT=1800.02

?
TT=1798.41

? (TO)
TT=1800.69

?
TT=1793.13

? (TO)
TT=1800.01

?
TT=1798.82

? (TO)
TT=1800.78

?
TT=1789.8

? (MO)
TT=282.54

? (TO)
TT=1800.07

?
TT=1797.24

? (TO)
TT=1800.08

? (problem)
TT=0.174

? (problem)
TT=0.168

? (TO)
TT=1800.08

? (TO)
TT=1800.07

?
TT=1799.9

No dataNo dataNo dataNo data?
TT=1799.95

No dataNo data? (TO)
TT=1800.85

? (TO)
TT=1800.1

? (TO)
TT=1800.03

?
TT=1797.51

?
TT=1797.21

?
TT=1796.84

? (TO)
TT=1800.02

? (TO)
TT=1800.05

?
TT=1799.6

No dataNo data?
TT=1799.61

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K126.opb



?
TT=1798.04

? (TO)
TT=1800.02

No data? (problem)
TT=0.18

? (TO)
TT=1800.1

? (problem)
TT=0.182

? (TO)
TT=1800.09

? (problem)
TT=0.182

? (TO)
TT=1800.07

? (problem)
TT=0.178

? (TO)
TT=1800.11

? (TO)
TT=1800.13

? (TO)
TT=1800.1

? (TO)
TT=1800.07

? (TO)
TT=1800.01

? (TO)
TT=1800.42

?
TT=1798.04

? (TO)
TT=1800.28

?
TT=1794.58

? (TO)
TT=1800.01

?
TT=1798.9

? (TO)
TT=1800.96

?
TT=1790.96

? (MO)
TT=282.84

? (TO)
TT=1800.2

?
TT=1797.8

? (TO)
TT=1800.03

? (problem)
TT=0.173

? (problem)
TT=0.183

? (TO)
TT=1800.02

? (TO)
TT=1800.02

?
TT=1799.61

No dataNo dataNo dataNo data?
TT=1799.99

No dataNo data? (TO)
TT=1800.2

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1796.84

?
TT=1796.87

?
TT=1796.8

? (TO)
TT=1800.04

? (TO)
TT=1800.05

?
TT=1799.63

No dataNo data?
TT=1799.61

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K128.opb



?
TT=1798.01

? (TO)
TT=1800.03

No data? (problem)
TT=0.195

? (TO)
TT=1800.08

? (problem)
TT=0.178

? (TO)
TT=1800.07

? (problem)
TT=0.182

? (TO)
TT=1800.08

? (problem)
TT=0.19

? (TO)
TT=1800.08

? (TO)
TT=1800.2

? (TO)
TT=1800.04

? (TO)
TT=1800.08

? (TO)
TT=1800.08

? (TO)
TT=1800.01

?
TT=1798.04

? (TO)
TT=1800.85

?
TT=1793.48

? (TO)
TT=1800.09

?
TT=1798.83

? (TO)
TT=1800.45

?
TT=1789.8

? (MO)
TT=285.14

? (TO)
TT=1800.1

? (TO)
TT=1800.52

? (TO)
TT=1800.09

? (problem)
TT=0.181

? (problem)
TT=0.174

? (TO)
TT=1800.06

? (TO)
TT=1800.05

?
TT=1799.93

No dataNo dataNo dataNo data?
TT=1799.61

No dataNo data? (TO)
TT=1800.21

? (TO)
TT=1800.05

? (TO)
TT=1800.03

?
TT=1796.89

?
TT=1796.84

?
TT=1796.84

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.41

No dataNo data?
TT=1799.58

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K129.opb



?
TT=1798.47

? (TO)
TT=1800.12

No data? (problem)
TT=0.187

? (TO)
TT=1800.12

? (problem)
TT=0.179

? (TO)
TT=1800.06

? (problem)
TT=0.186

? (TO)
TT=1800.06

? (problem)
TT=0.187

? (TO)
TT=1800.03

? (TO)
TT=1800.12

? (TO)
TT=1800.01

? (TO)
TT=1800.04

? (TO)
TT=1800.08

? (TO)
TT=1800.89

?
TT=1798.02

? (TO)
TT=1801.32

?
TT=1793.05

? (TO)
TT=1800.01

?
TT=1798.8

? (TO)
TT=1800.17

?
TT=1789.84

? (MO)
TT=283.81

? (TO)
TT=1800.84

?
TT=1797.88

? (TO)
TT=1800.08

? (problem)
TT=0.181

? (problem)
TT=0.182

? (TO)
TT=1800.02

? (TO)
TT=1800.08

?
TT=1799.52

No dataNo dataNo dataNo data?
TT=1799.96

No dataNo data? (TO)
TT=1800.64

? (TO)
TT=1800.4

? (TO)
TT=1800.09

?
TT=1796.96

?
TT=1796.84

?
TT=1796.84

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.5

No dataNo data?
TT=1799.76

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K131.opb



?
TT=1798.01

? (TO)
TT=1800.1

No data? (problem)
TT=0.188

? (TO)
TT=1800.07

? (problem)
TT=0.187

? (TO)
TT=1800.1

? (problem)
TT=0.188

? (TO)
TT=1800.04

? (problem)
TT=0.188

? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1800.12

? (TO)
TT=1800.04

? (TO)
TT=1800.1

? (TO)
TT=1800.03

?
TT=1798.07

? (TO)
TT=1801.6

?
TT=1792.91

? (TO)
TT=1800.05

?
TT=1798.81

? (TO)
TT=1800.82

?
TT=1789.84

? (MO)
TT=289.38

? (TO)
TT=1800.81

?
TT=1796.84

? (TO)
TT=1800.09

? (problem)
TT=0.183

? (problem)
TT=0.184

? (TO)
TT=1800.1

? (TO)
TT=1800.05

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.93

No dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.1

? (TO)
TT=1800.6

?
TT=1796.82

?
TT=1796.84

?
TT=1796.87

? (TO)
TT=1800.04

? (TO)
TT=1800.05

?
TT=1799.52

No dataNo data?
TT=1799.53

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K132.opb



?
TT=1798.01

? (TO)
TT=1800.1

No data? (problem)
TT=0.189

? (TO)
TT=1800.07

? (problem)
TT=0.187

? (TO)
TT=1800.1

? (problem)
TT=0.188

? (TO)
TT=1800.02

? (problem)
TT=0.188

? (TO)
TT=1800.08

? (TO)
TT=1800.06

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.11

? (TO)
TT=1800.78

?
TT=1798.06

? (TO)
TT=1800.54

?
TT=1794.17

? (TO)
TT=1800.01

?
TT=1798.82

? (TO)
TT=1801.14

?
TT=1789.97

? (MO)
TT=285.72

? (TO)
TT=1800.1

? (TO)
TT=1802.11

? (TO)
TT=1800.02

? (problem)
TT=0.179

? (problem)
TT=0.174

? (TO)
TT=1800.04

? (TO)
TT=1800.03

?
TT=1799.56

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo data? (TO)
TT=1800.69

? (TO)
TT=1800.06

? (TO)
TT=1800.52

?
TT=1796.9

?
TT=1796.83

?
TT=1796.84

? (TO)
TT=1800.02

? (TO)
TT=1800.02

?
TT=1799.58

No dataNo data?
TT=1799.58

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K133.opb



?
TT=1798.05

? (TO)
TT=1800.1

No data? (problem)
TT=0.193

? (TO)
TT=1800.06

? (problem)
TT=0.191

? (TO)
TT=1800.07

? (problem)
TT=0.204

? (TO)
TT=1800.05

? (problem)
TT=0.191

? (TO)
TT=1800.02

? (TO)
TT=1800.16

? (TO)
TT=1800.06

? (TO)
TT=1800.06

? (TO)
TT=1800.1

? (TO)
TT=1800.41

?
TT=1798.02

? (TO)
TT=1800.64

?
TT=1793.58

? (TO)
TT=1800.07

?
TT=1798.76

? (TO)
TT=1800.08

?
TT=1790.1

? (MO)
TT=286.64

? (TO)
TT=1800.03

?
TT=1796.85

? (TO)
TT=1800.03

? (problem)
TT=0.182

? (problem)
TT=0.19

? (TO)
TT=1800

? (TO)
TT=1800.07

?
TT=1799.61

No dataNo dataNo dataNo data?
TT=1799.53

No dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.1

? (TO)
TT=1800.06

?
TT=1796.8

?
TT=1796.87

?
TT=1796.83

? (TO)
TT=1800.05

? (TO)
TT=1800.02

?
TT=1799.54

No dataNo data?
TT=1799.61

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K138.opb



?
TT=1798.04

? (TO)
TT=1800.1

No data? (problem)
TT=0.203

? (TO)
TT=1800.05

? (problem)
TT=0.194

? (TO)
TT=1800.09

? (problem)
TT=0.196

? (TO)
TT=1800.09

? (problem)
TT=0.198

? (TO)
TT=1800.1

? (TO)
TT=1800.04

? (TO)
TT=1800.07

? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1800.77

?
TT=1798.08

? (TO)
TT=1800.02

?
TT=1793.02

? (TO)
TT=1800.06

?
TT=1798.86

? (TO)
TT=1800.05

?
TT=1790.02

? (MO)
TT=288.15

? (TO)
TT=1800.06

? (TO)
TT=1802.01

? (TO)
TT=1800

? (problem)
TT=0.193

? (problem)
TT=0.19

? (TO)
TT=1800.09

? (TO)
TT=1800.03

?
TT=1799.96

No dataNo dataNo dataNo data?
TT=1799.97

No dataNo data? (TO)
TT=1800.76

? (TO)
TT=1800.06

? (TO)
TT=1800.1

?
TT=1797.05

?
TT=1796.94

?
TT=1796.88

? (TO)
TT=1800.04

? (TO)
TT=1800.07

?
TT=1799.61

No dataNo data?
TT=1799.97

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K139.opb



?
TT=1798.01

? (TO)
TT=1800.1

No data? (problem)
TT=0.201

? (TO)
TT=1800.04

? (problem)
TT=0.199

? (TO)
TT=1800.07

? (problem)
TT=0.202

? (TO)
TT=1800.06

? (problem)
TT=0.203

? (TO)
TT=1800.01

? (TO)
TT=1800.16

? (TO)
TT=1800.07

? (TO)
TT=1800.14

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1798.08

? (TO)
TT=1801.26

?
TT=1793.57

? (TO)
TT=1800.03

?
TT=1798.92

? (TO)
TT=1800.06

?
TT=1789.8

? (MO)
TT=283.65

? (TO)
TT=1800.21

?
TT=1796.83

? (TO)
TT=1800.06

? (problem)
TT=0.192

? (problem)
TT=0.194

? (TO)
TT=1800.06

? (TO)
TT=1800.09

?
TT=1799.95

No dataNo dataNo dataNo data?
TT=1799.98

No dataNo data? (TO)
TT=1800.19

? (TO)
TT=1800.82

? (TO)
TT=1800.82

?
TT=1796.92

?
TT=1796.85

?
TT=1796.85

? (TO)
TT=1800.09

? (TO)
TT=1800.03

?
TT=1799.61

No dataNo data?
TT=1799.9

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K140.opb



?
TT=1798.01

? (TO)
TT=1800.11

No data? (problem)
TT=0.208

? (TO)
TT=1800.02

? (problem)
TT=0.197

? (TO)
TT=1800.07

? (problem)
TT=0.203

? (TO)
TT=1800.07

? (problem)
TT=0.196

? (TO)
TT=1800.08

? (TO)
TT=1800.12

? (TO)
TT=1800.07

? (TO)
TT=1800.06

? (TO)
TT=1800.01

? (TO)
TT=1800.03

?
TT=1798.15

? (TO)
TT=1800.88

?
TT=1793.13

? (TO)
TT=1800.02

?
TT=1798.86

? (TO)
TT=1800.17

?
TT=1789.85

? (MO)
TT=290.08

? (TO)
TT=1800.14

?
TT=1798.38

? (TO)
TT=1800.04

? (problem)
TT=0.195

? (problem)
TT=0.192

? (TO)
TT=1800.05

? (TO)
TT=1800.01

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.59

No dataNo data? (TO)
TT=1800.19

? (TO)
TT=1800.09

? (TO)
TT=1800.52

?
TT=1796.83

?
TT=1796.87

?
TT=1797

? (TO)
TT=1800.04

? (TO)
TT=1800.05

?
TT=1799.53

No dataNo data?
TT=1799.57

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K141.opb



?
TT=1798.04

? (TO)
TT=1800.11

No data? (problem)
TT=0.205

? (TO)
TT=1800.13

? (problem)
TT=0.196

? (TO)
TT=1800.04

? (problem)
TT=0.2

? (TO)
TT=1800.04

? (problem)
TT=0.202

? (TO)
TT=1800.02

? (TO)
TT=1800.11

? (TO)
TT=1800.11

? (TO)
TT=1800.12

? (TO)
TT=1800.08

? (TO)
TT=1801.13

?
TT=1798.07

? (TO)
TT=1800.24

?
TT=1793.69

? (TO)
TT=1800.04

?
TT=1798.87

? (TO)
TT=1800.09

?
TT=1789.83

? (MO)
TT=286.89

? (TO)
TT=1800.08

?
TT=1798.17

? (TO)
TT=1800.03

? (problem)
TT=0.194

? (problem)
TT=0.191

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1799.78

No dataNo dataNo dataNo data?
TT=1799.88

No dataNo data? (TO)
TT=1800.77

? (TO)
TT=1800.01

? (TO)
TT=1800.67

?
TT=1796.88

?
TT=1796.89

?
TT=1796.86

? (TO)
TT=1800.08

? (TO)
TT=1800.03

?
TT=1799.61

No dataNo data?
TT=1799.51

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K143.opb



?
TT=1798.03

? (TO)
TT=1800.1

No data? (problem)
TT=0.202

? (TO)
TT=1800.04

? (problem)
TT=0.196

? (TO)
TT=1800.04

? (problem)
TT=0.2

? (TO)
TT=1800.08

? (problem)
TT=0.209

? (TO)
TT=1800.06

? (TO)
TT=1800.23

? (TO)
TT=1800.1

? (TO)
TT=1800.09

? (TO)
TT=1800.04

? (TO)
TT=1800.01

?
TT=1798.05

? (TO)
TT=1800.73

?
TT=1792.88

? (TO)
TT=1800.11

?
TT=1798.77

? (TO)
TT=1800.09

?
TT=1792.73

? (MO)
TT=283.32

? (TO)
TT=1800.11

?
TT=1798.1

? (TO)
TT=1800.03

? (problem)
TT=0.197

? (problem)
TT=0.193

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.56

No dataNo data? (TO)
TT=1800.14

? (TO)
TT=1800.74

? (TO)
TT=1800.02

?
TT=1796.86

?
TT=1796.89

?
TT=1796.95

? (TO)
TT=1800.04

? (TO)
TT=1800.04

?
TT=1799.59

No dataNo data?
TT=1799.55

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K148.opb



?
TT=1798.14

? (TO)
TT=1800.01

No data? (problem)
TT=0.213

? (TO)
TT=1800.04

? (problem)
TT=0.205

? (TO)
TT=1800.03

? (problem)
TT=0.213

? (TO)
TT=1800.1

? (problem)
TT=0.206

? (TO)
TT=1800.08

? (TO)
TT=1800.2

? (TO)
TT=1800.09

? (TO)
TT=1800.12

? (TO)
TT=1800.11

? (TO)
TT=1800.19

?
TT=1798.04

? (TO)
TT=1800.77

?
TT=1794.58

? (TO)
TT=1800.03

?
TT=1798.79

? (TO)
TT=1800.93

?
TT=1790.01

? (MO)
TT=287.81

? (TO)
TT=1800.05

?
TT=1797.35

? (TO)
TT=1800.04

? (problem)
TT=0.207

? (problem)
TT=0.198

? (TO)
TT=1800.05

? (TO)
TT=1800.09

?
TT=1799.49

No dataNo dataNo dataNo data?
TT=1799.82

No dataNo data? (TO)
TT=1800.78

? (TO)
TT=1800.03

? (TO)
TT=1800.67

?
TT=1796.84

?
TT=1796.83

?
TT=1796.85

? (TO)
TT=1800.04

? (TO)
TT=1800.05

?
TT=1799.52

No dataNo data?
TT=1799.85

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K152.opb



?
TT=1798.04

? (TO)
TT=1800.03

No data? (problem)
TT=0.216

? (TO)
TT=1800.07

? (problem)
TT=0.229

? (TO)
TT=1800.1

? (problem)
TT=0.215

? (TO)
TT=1800.07

? (problem)
TT=0.213

? (TO)
TT=1800.03

? (TO)
TT=1800.07

? (TO)
TT=1800.04

? (TO)
TT=1800.05

? (TO)
TT=1800.1

? (TO)
TT=1800.62

?
TT=1798.11

? (TO)
TT=1800.07

?
TT=1796.54

? (TO)
TT=1800.09

?
TT=1798.83

? (TO)
TT=1800.08

?
TT=1792.59

? (MO)
TT=285.46

? (TO)
TT=1800.15

?
TT=1796.87

? (TO)
TT=1800.02

? (problem)
TT=0.212

? (problem)
TT=0.204

? (TO)
TT=1800.03

? (TO)
TT=1800.02

?
TT=1799.56

No dataNo dataNo dataNo data?
TT=1799.97

No dataNo data? (TO)
TT=1800.19

? (TO)
TT=1800.1

? (TO)
TT=1800.01

?
TT=1796.88

?
TT=1796.84

?
TT=1796.85

? (TO)
TT=1800.02

? (TO)
TT=1800.06

?
TT=1799.57

No dataNo data?
TT=1799.98

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K156.opb



?
TT=1798

? (TO)
TT=1800.06

No data? (problem)
TT=0.223

? (TO)
TT=1800.13

? (problem)
TT=0.223

? (TO)
TT=1800.08

? (problem)
TT=0.216

? (TO)
TT=1800.1

? (problem)
TT=0.222

? (TO)
TT=1800.06

? (TO)
TT=1800.19

? (TO)
TT=1800.05

? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1800.03

?
TT=1798.01

? (TO)
TT=1800.95

?
TT=1793.5

? (TO)
TT=1800.08

?
TT=1798.93

? (TO)
TT=1800.14

?
TT=1789.82

? (MO)
TT=289.64

? (TO)
TT=1800.13

?
TT=1796.86

? (TO)
TT=1800.06

? (problem)
TT=0.217

? (problem)
TT=0.213

? (TO)
TT=1800.1

? (TO)
TT=1800.02

?
TT=1799.56

No dataNo dataNo dataNo data?
TT=1799.53

No dataNo data? (TO)
TT=1801.14

? (TO)
TT=1800.05

? (TO)
TT=1800.09

?
TT=1796.85

?
TT=1796.89

?
TT=1797.21

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1799.5

No dataNo data?
TT=1799.52

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K160.opb



?
TT=1798.01

? (TO)
TT=1800.11

No data? (problem)
TT=0.23

? (TO)
TT=1800.01

? (problem)
TT=0.225

? (TO)
TT=1800.08

? (problem)
TT=0.25

? (TO)
TT=1800.1

? (problem)
TT=0.229

? (TO)
TT=1800.06

? (TO)
TT=1800.12

? (TO)
TT=1800.1

? (TO)
TT=1800.05

? (TO)
TT=1800.09

? (TO)
TT=1800.09

?
TT=1798.05

? (TO)
TT=1800.53

?
TT=1795.86

? (TO)
TT=1800.02

?
TT=1798.86

? (TO)
TT=1800.14

?
TT=1789.86

? (MO)
TT=284.31

? (TO)
TT=1800.09

?
TT=1797.72

? (TO)
TT=1800.1

? (problem)
TT=0.221

? (problem)
TT=0.222

? (TO)
TT=1800.09

? (TO)
TT=1800.04

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.92

No dataNo data? (TO)
TT=1800.04

? (TO)
TT=1800.07

? (TO)
TT=1800.58

?
TT=1796.9

?
TT=1796.88

?
TT=1796.85

? (TO)
TT=1800.04

? (TO)
TT=1800.04

?
TT=1799.61

No dataNo data?
TT=1799.51

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K163.opb



?
TT=1798.01

? (TO)
TT=1800.11

No data? (problem)
TT=0.233

? (TO)
TT=1800.09

? (problem)
TT=0.232

? (TO)
TT=1800.05

? (problem)
TT=0.23

? (TO)
TT=1800.06

? (problem)
TT=0.231

? (TO)
TT=1800.02

? (TO)
TT=1800.2

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.08

? (TO)
TT=1800.66

?
TT=1798.03

? (TO)
TT=1800.25

?
TT=1795.77

? (TO)
TT=1800.1

?
TT=1798.81

? (TO)
TT=1800.12

?
TT=1789.82

? (MO)
TT=285.94

? (TO)
TT=1800.15

? (TO)
TT=1801.39

? (TO)
TT=1800.02

? (problem)
TT=0.226

? (problem)
TT=0.222

? (TO)
TT=1800.06

? (TO)
TT=1800.07

?
TT=1799.94

No dataNo dataNo dataNo data?
TT=1799.51

No dataNo data? (TO)
TT=1800.14

? (TO)
TT=1800.13

? (TO)
TT=1800.01

?
TT=1796.86

?
TT=1796.92

?
TT=1796.79

? (TO)
TT=1800.1

? (TO)
TT=1800.08

?
TT=1799.91

No dataNo data?
TT=1799.55

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K164.opb



?
TT=1798.02

? (TO)
TT=1800.1

No data? (problem)
TT=0.233

? (TO)
TT=1800.01

? (problem)
TT=0.233

? (TO)
TT=1800.02

? (problem)
TT=0.237

? (TO)
TT=1800.05

? (problem)
TT=0.233

? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.12

? (TO)
TT=1800.05

? (TO)
TT=1800.6

?
TT=1798.03

? (TO)
TT=1800.05

?
TT=1793.11

? (TO)
TT=1800.09

?
TT=1798.76

? (TO)
TT=1800.75

?
TT=1789.87

? (MO)
TT=285.46

? (TO)
TT=1800.11

? (TO)
TT=1802.02

? (TO)
TT=1800.05

? (problem)
TT=0.229

? (problem)
TT=0.225

? (TO)
TT=1800

? (TO)
TT=1800.03

?
TT=1799.86

No dataNo dataNo dataNo data?
TT=1799.84

No dataNo data? (TO)
TT=1800.85

? (TO)
TT=1800.07

? (TO)
TT=1800.57

?
TT=1796.89

?
TT=1796.91

?
TT=1796.83

? (TO)
TT=1800.02

? (TO)
TT=1800.04

?
TT=1799.53

No dataNo data?
TT=1799.94

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K167.opb



?
TT=1798.01

? (TO)
TT=1800.1

No data? (problem)
TT=0.248

? (TO)
TT=1800.09

? (problem)
TT=0.246

? (TO)
TT=1800.06

? (problem)
TT=0.239

? (TO)
TT=1800.01

? (problem)
TT=0.231

? (TO)
TT=1800.05

? (TO)
TT=1800.12

? (TO)
TT=1800.09

? (TO)
TT=1800.11

? (TO)
TT=1800.01

? (TO)
TT=1800.07

?
TT=1798.04

? (TO)
TT=1800.91

?
TT=1793.96

? (TO)
TT=1800.03

?
TT=1798.8

? (TO)
TT=1800.03

?
TT=1789.85

? (MO)
TT=288.09

? (TO)
TT=1800.72

? (TO)
TT=1802.27

? (TO)
TT=1800.02

? (problem)
TT=0.227

? (problem)
TT=0.229

? (TO)
TT=1800.02

? (TO)
TT=1800.04

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.53

No dataNo data? (TO)
TT=1800.15

? (TO)
TT=1800.67

? (TO)
TT=1800.09

?
TT=1797.08

?
TT=1796.94

?
TT=1796.9

? (TO)
TT=1800.03

? (TO)
TT=1800.04

?
TT=1799.59

No dataNo data?
TT=1799.55

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K168.opb



?
TT=1798.01

? (TO)
TT=1800.04

No data? (problem)
TT=0.246

? (TO)
TT=1800.04

? (problem)
TT=0.232

? (TO)
TT=1800.04

? (problem)
TT=0.238

? (TO)
TT=1800.56

? (problem)
TT=0.252

? (TO)
TT=1800.03

? (TO)
TT=1800.13

? (TO)
TT=1800.06

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1798.03

? (TO)
TT=1801.16

?
TT=1793.18

? (TO)
TT=1800.1

?
TT=1798.8

? (TO)
TT=1800.11

?
TT=1789.85

? (MO)
TT=285.9

? (TO)
TT=1800.18

?
TT=1798.41

? (TO)
TT=1800.05

? (problem)
TT=0.229

? (problem)
TT=0.224

? (TO)
TT=1800.09

? (TO)
TT=1800.06

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.94

No dataNo data? (TO)
TT=1800.76

? (TO)
TT=1800.75

? (TO)
TT=1800.01

?
TT=1797

?
TT=1796.88

?
TT=1796.86

? (TO)
TT=1800.03

? (TO)
TT=1800.03

?
TT=1799.52

No dataNo data?
TT=1799.89

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K175.opb



?
TT=1798.01

? (TO)
TT=1800.11

No data? (problem)
TT=0.248

? (TO)
TT=1800.12

? (problem)
TT=0.247

? (TO)
TT=1800.09

? (problem)
TT=0.26

? (TO)
TT=1800.02

? (problem)
TT=0.251

? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1800.12

? (TO)
TT=1800.06

? (TO)
TT=1800.1

? (TO)
TT=1800.09

?
TT=1798.02

? (TO)
TT=1800.71

?
TT=1793

? (TO)
TT=1800.03

?
TT=1798.81

? (TO)
TT=1800.89

?
TT=1791.36

? (MO)
TT=287.74

? (TO)
TT=1800.11

?
TT=1796.89

? (TO)
TT=1800.08

? (problem)
TT=0.243

? (problem)
TT=0.24

? (TO)
TT=1800.03

? (TO)
TT=1800.07

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.53

No dataNo data? (TO)
TT=1800.03

? (TO)
TT=1800.74

? (TO)
TT=1800.61

?
TT=1796.97

?
TT=1796.95

?
TT=1796.9

? (TO)
TT=1800.08

? (TO)
TT=1800.04

?
TT=1799.55

No dataNo data?
TT=1799.54

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K176.opb



?
TT=1798.01

? (TO)
TT=1800.02

No data? (problem)
TT=0.256

? (TO)
TT=1800.02

? (problem)
TT=0.252

? (TO)
TT=1800.02

? (problem)
TT=0.252

? (TO)
TT=1800.1

? (problem)
TT=0.252

? (TO)
TT=1800.02

? (TO)
TT=1800.17

? (TO)
TT=1800.07

? (TO)
TT=1800.03

? (TO)
TT=1800.1

? (TO)
TT=1800.61

?
TT=1798.04

? (TO)
TT=1800.23

?
TT=1794.35

? (TO)
TT=1800.03

?
TT=1798.83

? (TO)
TT=1800.1

?
TT=1792.07

? (MO)
TT=286.02

? (TO)
TT=1800.02

? (TO)
TT=1802.11

? (TO)
TT=1800.11

? (problem)
TT=0.247

? (problem)
TT=0.244

? (TO)
TT=1800.07

? (TO)
TT=1800.08

?
TT=1799.86

No dataNo dataNo dataNo data?
TT=1799.82

No dataNo data? (TO)
TT=1800.11

? (TO)
TT=1800.67

? (TO)
TT=1800.64

?
TT=1796.91

?
TT=1796.92

?
TT=1796.96

? (TO)
TT=1800.09

? (TO)
TT=1800.04

?
TT=1799.47

No dataNo data?
TT=1799.54

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K177.opb



?
TT=1798.02

? (TO)
TT=1800.11

No data? (problem)
TT=0.256

? (TO)
TT=1800.07

? (problem)
TT=0.246

? (TO)
TT=1800.05

? (problem)
TT=0.292

? (TO)
TT=1800.04

? (problem)
TT=0.256

? (TO)
TT=1800.1

? (TO)
TT=1800.06

? (TO)
TT=1800.09

? (TO)
TT=1800.04

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1798.03

? (TO)
TT=1800.96

?
TT=1793.9

? (TO)
TT=1800

?
TT=1798.85

? (TO)
TT=1800.96

?
TT=1793.97

? (MO)
TT=283.86

? (TO)
TT=1800.06

?
TT=1796.83

? (TO)
TT=1800.11

? (problem)
TT=0.253

? (problem)
TT=0.246

? (TO)
TT=1800

? (TO)
TT=1800.01

?
TT=1799.5

No dataNo dataNo dataNo data?
TT=1799.89

No dataNo data? (TO)
TT=1800.04

? (TO)
TT=1800.06

? (TO)
TT=1800.09

?
TT=1796.92

?
TT=1797.08

?
TT=1796.86

? (TO)
TT=1800.1

? (TO)
TT=1800.05

?
TT=1799.83

No dataNo data?
TT=1799.95

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K180.opb



?
TT=1798.04

? (TO)
TT=1800.12

No data? (problem)
TT=0.266

? (TO)
TT=1800.08

? (problem)
TT=0.256

? (TO)
TT=1800.1

? (problem)
TT=0.271

? (TO)
TT=1800.04

? (problem)
TT=0.265

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.08

? (TO)
TT=1800.07

? (TO)
TT=1800.11

? (TO)
TT=1801

?
TT=1798.06

? (TO)
TT=1800.87

?
TT=1792.98

? (TO)
TT=1800.04

?
TT=1798.81

? (TO)
TT=1800.15

?
TT=1792.64

? (MO)
TT=288.77

? (TO)
TT=1800.07

?
TT=1799.36

? (TO)
TT=1800.1

? (problem)
TT=0.258

? (problem)
TT=0.248

? (TO)
TT=1800.02

? (TO)
TT=1800.03

?
TT=1799.8

No dataNo dataNo dataNo data?
TT=1799.82

No dataNo data? (TO)
TT=1800.67

? (TO)
TT=1800.01

? (TO)
TT=1800.03

?
TT=1796.96

?
TT=1797.08

?
TT=1796.95

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1799.57

No dataNo data?
TT=1799.9

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K181.opb



?
TT=1798

? (TO)
TT=1800.1

No data? (problem)
TT=0.257

? (TO)
TT=1800.01

? (problem)
TT=0.263

? (TO)
TT=1800.07

? (problem)
TT=0.257

? (TO)
TT=1800.09

? (problem)
TT=0.265

? (TO)
TT=1800.09

? (TO)
TT=1800.13

? (TO)
TT=1800.07

? (TO)
TT=1800.04

? (TO)
TT=1800.11

? (TO)
TT=1800.05

?
TT=1798.02

? (TO)
TT=1800.95

?
TT=1793.17

? (TO)
TT=1800.08

?
TT=1798.8

? (TO)
TT=1800.88

?
TT=1790

? (MO)
TT=286.44

? (TO)
TT=1800.18

? (TO)
TT=1802.11

? (TO)
TT=1800.02

? (problem)
TT=0.25

? (problem)
TT=0.253

? (TO)
TT=1800.07

? (TO)
TT=1800.07

?
TT=1799.53

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo data? (TO)
TT=1800.72

? (TO)
TT=1800.55

? (TO)
TT=1800.59

?
TT=1796.96

?
TT=1796.91

?
TT=1797.09

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1799.54

No dataNo data?
TT=1799.82

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K183.opb



?
TT=1798.03

? (TO)
TT=1800.02

No data? (problem)
TT=0.255

? (TO)
TT=1800.1

? (problem)
TT=0.299

? (TO)
TT=1800.07

? (problem)
TT=0.267

? (TO)
TT=1800.03

? (problem)
TT=0.258

? (TO)
TT=1800.1

? (TO)
TT=1800.15

? (TO)
TT=1800.07

? (TO)
TT=1800.03

? (TO)
TT=1800.11

? (TO)
TT=1800.06

?
TT=1798.02

? (TO)
TT=1800.66

?
TT=1798.28

? (TO)
TT=1800.03

?
TT=1799.12

? (TO)
TT=1800.14

?
TT=1789.86

? (MO)
TT=285.82

? (TO)
TT=1800.04

? (TO)
TT=1802.02

? (TO)
TT=1800.05

? (problem)
TT=0.257

? (problem)
TT=0.254

? (TO)
TT=1800.07

? (TO)
TT=1800.04

?
TT=1799.53

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo data? (TO)
TT=1800.15

? (TO)
TT=1800.77

? (TO)
TT=1800.09

?
TT=1796.99

?
TT=1796.99

?
TT=1796.95

? (TO)
TT=1800.11

? (TO)
TT=1800.03

?
TT=1799.57

No dataNo data?
TT=1799.5

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K192.opb



?
TT=1798.01

? (TO)
TT=1800.02

No data? (problem)
TT=0.295

? (TO)
TT=1800.03

? (problem)
TT=0.271

? (TO)
TT=1800.02

? (problem)
TT=0.272

? (TO)
TT=1800.02

? (problem)
TT=0.272

? (TO)
TT=1800.01

? (TO)
TT=1800.08

? (TO)
TT=1800.04

? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1801.22

?
TT=1798.01

? (TO)
TT=1800.77

?
TT=1793.4

? (TO)
TT=1800.05

?
TT=1798.77

? (TO)
TT=1800.15

?
TT=1790.98

? (MO)
TT=287.29

? (TO)
TT=1800.18

?
TT=1796.86

? (TO)
TT=1800.06

? (problem)
TT=0.271

? (problem)
TT=0.265

? (TO)
TT=1800.09

? (TO)
TT=1800.1

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.44

No dataNo data? (TO)
TT=1800.65

? (TO)
TT=1800.05

? (TO)
TT=1800.04

?
TT=1796.98

?
TT=1796.87

?
TT=1796.95

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.89

No dataNo data?
TT=1799.56

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K196.opb



?
TT=1798.06

? (TO)
TT=1800.1

No data? (problem)
TT=0.283

? (TO)
TT=1800.01

? (problem)
TT=0.282

? (TO)
TT=1800.08

? (problem)
TT=0.279

? (TO)
TT=1800.06

? (problem)
TT=0.28

? (TO)
TT=1800.01

? (TO)
TT=1800.05

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.1

? (TO)
TT=1800.09

?
TT=1798.01

? (TO)
TT=1801.03

?
TT=1795.14

? (TO)
TT=1800.08

?
TT=1798.81

? (TO)
TT=1800.08

?
TT=1789.86

? (MO)
TT=339.69

? (TO)
TT=1800.03

? (TO)
TT=1802.02

? (TO)
TT=1800.06

? (problem)
TT=0.276

? (problem)
TT=0.284

? (TO)
TT=1800.06

? (TO)
TT=1800.08

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo data? (TO)
TT=1800.16

? (TO)
TT=1800

? (TO)
TT=1800.09

?
TT=1797.01

?
TT=1796.92

?
TT=1796.96

? (TO)
TT=1800.11

? (TO)
TT=1800.03

?
TT=1799.44

No dataNo data?
TT=1799.5

/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K199.opb



?
TT=1798

? (TO)
TT=1800.11

No data? (problem)
TT=0.287

? (TO)
TT=1800.08

? (problem)
TT=0.277

? (TO)
TT=1800.09

? (problem)
TT=0.28

? (TO)
TT=1800.08

? (problem)
TT=0.278

? (TO)
TT=1800.06

? (TO)
TT=1800.06

? (TO)
TT=1800.1

? (TO)
TT=1800.07

? (TO)
TT=1800.09

? (TO)
TT=1800.64

?
TT=1798.02

? (TO)
TT=1800.78

?
TT=1792.9

? (TO)
TT=1800.09

?
TT=1798.84

? (TO)
TT=1800.93

?
TT=1791.25

? (MO)
TT=338.59

? (TO)
TT=1800.03

?
TT=1796.84

? (TO)
TT=1800.05

? (problem)
TT=0.279

? (problem)
TT=0.271

? (TO)
TT=1800.11

? (TO)
TT=1800.05

?
TT=1799.45

No dataNo dataNo dataNo data?
TT=1799.91

No dataNo data? (TO)
TT=1800.7

? (TO)
TT=1800.99

? (TO)
TT=1800.05

?
TT=1796.9

?
TT=1796.88

?
TT=1797.01

? (TO)
TT=1800.03

? (TO)
TT=1800.05

?
TT=1799.92

No dataNo data?
TT=1799.46

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/
sroussel/
ShortestPathNG/normalized-NG_K200.opb



?
TT=1798.02

? (TO)
TT=1800.02

No data? (problem)
TT=0.292

? (TO)
TT=1800.08

? (problem)
TT=0.288

? (TO)
TT=1800.09

? (problem)
TT=0.283

? (TO)
TT=1800.05

? (problem)
TT=0.279

? (TO)
TT=1800.1

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.08

? (TO)
TT=1800.05

? (TO)
TT=1800.82

?
TT=1798.01

? (TO)
TT=1801.2

?
TT=1793.03

? (TO)
TT=1800.07

?
TT=1798.92

? (TO)
TT=1800.04

?
TT=1789.91

? (MO)
TT=336.09

? (TO)
TT=1800.8

? (TO)
TT=1802.02

? (TO)
TT=1800.08

? (problem)
TT=0.272

? (problem)
TT=0.292

? (TO)
TT=1800.05

? (TO)
TT=1800.08

?
TT=1799.83

No dataNo dataNo dataNo data?
TT=1799.47

No dataNo data? (TO)
TT=1800.03

? (TO)
TT=1800.09

? (TO)
TT=1800.61

?
TT=1797.11

?
TT=1796.92

?
TT=1797.12

? (TO)
TT=1800.03

? (TO)
TT=1800.03

?
TT=1799.58

No dataNo data?
TT=1799.46

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K100.opb
SAT
TT=200.867
T1=200.9
?
TT=1798.01

SAT
TT=200.867
T1=200.9
No data? (problem)
TT=0.086

SAT
TT=1173.36
T1=1173.64
? (problem)
TT=0.082

? (problem)
TT=1097.46

? (problem)
TT=0.084

? (problem)
TT=1102.95

? (problem)
TT=0.079

? (problem)
TT=1181.11

? (TO)
TT=1800.11

? (TO)
TT=1800.05

? (TO)
TT=1800.09

? (TO)
TT=1800.1

? (TO)
TT=1800.09

?
TT=1798.02

? (TO)
TT=1801.28

?
TT=1795.07

? (TO)
TT=1800.05

? (TO)
TT=1800.1

? (TO)
TT=1801.13

?
TT=1789.79

? (MO)
TT=615.95

? (TO)
TT=1800.13

?
TT=1796.78

? (TO)
TT=1800.02

? (problem)
TT=0.079

? (problem)
TT=0.077

? (TO)
TT=1800.07

SAT
TT=1152.25
T1=1151.44
SAT
TT=1149.28
T1=1149.68
No dataNo dataNo dataNo dataSAT
TT=443.32
T1=443.58
No dataNo data? (TO)
TT=1800.72

SAT
TT=1094.69
T1=1076.85
? (TO)
TT=1800.64

?
TT=1796.77

?
TT=1796.77

?
TT=1796.77

? (TO)
TT=1800.07

? (TO)
TT=1800.08

SAT
TT=443.24
T1=443.44
No dataNo dataSAT
TT=434.63
T1=434.8
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K101.opb
SAT
TT=198.533
T1=198.58
?
TT=1798.01

SAT
TT=260.331
T1=260.37
No data? (problem)
TT=0.087

SAT
TT=977.442
T1=977.62
? (problem)
TT=0.08

SAT
TT=966.608
T1=966.82
? (problem)
TT=0.08

SAT
TT=971.724
T1=971.93
? (problem)
TT=0.081

SAT
TT=899.637
T1=899.81
? (TO)
TT=1800.05

SAT
TT=1235.69
T1=1235.96
? (TO)
TT=1800.12

SAT
TT=198.533
T1=198.58
? (TO)
TT=1800.05

?
TT=1798.01

? (TO)
TT=1801.32

?
TT=1794.33

? (TO)
TT=1800.05

? (TO)
TT=1800.07

? (TO)
TT=1800.04

?
TT=1789.79

? (MO)
TT=617.43

? (TO)
TT=1800.07

?
TT=1796.78

? (TO)
TT=1800.03

? (problem)
TT=0.081

? (problem)
TT=0.079

? (TO)
TT=1800.01

SAT
TT=1550.72
T1=1549.96
?
TT=1799.61

No dataNo dataNo dataNo data?
TT=1799.57

No dataNo data? (TO)
TT=1800.1

SAT
TT=450.196
T1=445.37
? (TO)
TT=1800.07

?
TT=1796.79

?
TT=1796.79

?
TT=1796.78

? (TO)
TT=1800.05

? (TO)
TT=1800.02

?
TT=1799.6

No dataNo data?
TT=1799.89

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K102.opb
SAT
TT=213.965
T1=214
?
TT=1798.02

SAT
TT=213.965
T1=214
No data? (problem)
TT=0.084

SAT
TT=1122.64
T1=1122.9
? (problem)
TT=0.09

SAT
TT=1154.93
T1=1155.13
? (problem)
TT=0.08

SAT
TT=1225.31
T1=1225.53
? (problem)
TT=0.08

SAT
TT=1152.89
T1=1153.12
? (TO)
TT=1800.14

? (TO)
TT=1800.06

SAT
TT=1724.49
T1=1724.79
SAT
TT=389.391
T1=389.46
? (TO)
TT=1800.87

SAT
TT=1017.15
T1=1017.38
? (TO)
TT=1800.3

?
TT=1795.38

? (TO)
TT=1800.05

? (TO)
TT=1800.19

SAT
TT=956.459
T1=485.32
?
TT=1789.96

? (MO)
TT=613.54

? (TO)
TT=1800.1

?
TT=1796.75

SAT
TT=1251.99
T1=1252.27
? (problem)
TT=0.078

? (problem)
TT=0.077

? (TO)
TT=1800.05

SAT
TT=1041.48
T1=1040.66
SAT
TT=397.97
T1=398.1
No dataNo dataNo dataNo dataSAT
TT=302.766
T1=302.89
No dataNo data? (TO)
TT=1800.03

SAT
TT=321.71
T1=318.59
? (TO)
TT=1800.09

?
TT=1796.79

?
TT=1796.77

?
TT=1796.79

? (TO)
TT=1800.09

? (TO)
TT=1800.04

SAT
TT=276.51
T1=276.62
No dataNo dataSAT
TT=283.056
T1=283.11
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K103.opb
SAT
TT=170.657
T1=168.24
SAT
TT=1190.56
T1=1191.01
SAT
TT=221.862
T1=221.9
No data? (problem)
TT=0.087

SAT
TT=212.164
T1=212.2
? (problem)
TT=0.089

SAT
TT=211.983
T1=212.02
? (problem)
TT=0.086

SAT
TT=212.484
T1=212.52
? (problem)
TT=0.084

SAT
TT=214.086
T1=214.12
? (TO)
TT=1800.14

SAT
TT=895.646
T1=895.86
SAT
TT=1150.35
T1=1150.53
? (TO)
TT=1800.1

? (TO)
TT=1800.58

?
TT=1798.04

? (TO)
TT=1800.79

?
TT=1794.02

? (TO)
TT=1800.01

? (TO)
TT=1800.39

SAT
TT=1497.89
T1=763.13
?
TT=1789.78

? (MO)
TT=616.08

SAT
TT=877.722
T1=447.56
?
TT=1796.77

? (TO)
TT=1800.08

? (problem)
TT=0.092

? (problem)
TT=0.085

? (TO)
TT=1800.07

? (TO)
TT=1800.01

SAT
TT=367.501
T1=367.56
No dataNo dataNo dataNo data?
TT=1799.82

No dataNo data? (TO)
TT=1800.19

SAT
TT=170.657
T1=168.24
SAT
TT=820.64
T1=817.51
?
TT=1796.77

?
TT=1796.81

?
TT=1796.77

? (TO)
TT=1800.04

? (TO)
TT=1800.08

?
TT=1799.58

No dataNo data?
TT=1799.94

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K104.opb
SAT
TT=92.024
T1=92.04
?
TT=1798

SAT
TT=92.024
T1=92.04
No data? (problem)
TT=0.086

SAT
TT=665.932
T1=666.06
? (problem)
TT=0.084

SAT
TT=711.023
T1=711.16
? (problem)
TT=0.085

SAT
TT=663.613
T1=663.8
? (problem)
TT=0.082

SAT
TT=675.249
T1=675.36
? (TO)
TT=1800.07

? (TO)
TT=1800.03

SAT
TT=871.97
T1=872.09
? (TO)
TT=1800.08

? (TO)
TT=1800.02

?
TT=1798.04

? (TO)
TT=1800.23

?
TT=1795.33

? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1801.14

?
TT=1789.77

? (MO)
TT=615.68

SAT
TT=1617.85
T1=834.03
?
TT=1796.77

? (TO)
TT=1800.05

? (problem)
TT=0.084

? (problem)
TT=0.078

? (TO)
TT=1800.08

? (TO)
TT=1800.07

SAT
TT=529.65
T1=529.86
No dataNo dataNo dataNo dataSAT
TT=441.03
T1=441.23
No dataNo dataSAT
TT=1433.91
T1=735.52
SAT
TT=878.4
T1=865.43
SAT
TT=550.1
T1=547.75
?
TT=1796.78

?
TT=1796.8

?
TT=1796.8

? (TO)
TT=1800.06

? (TO)
TT=1800.04

SAT
TT=412.66
T1=412.8
No dataNo dataSAT
TT=426.02
T1=426.24
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K105.opb
SAT
TT=235.677
T1=235.71
SAT
TT=1388.04
T1=1388.46
SAT
TT=235.677
T1=235.71
No data? (problem)
TT=0.09

SAT
TT=290.925
T1=290.99
? (problem)
TT=0.085

SAT
TT=296.79
T1=296.84
? (problem)
TT=0.083

SAT
TT=303.732
T1=303.77
? (problem)
TT=0.084

SAT
TT=287.12
T1=287.17
? (TO)
TT=1800.15

? (TO)
TT=1800.05

?
TT=328.734

? (TO)
TT=1800.11

? (TO)
TT=1800.4

SAT
TT=1175.34
T1=1175.77
? (TO)
TT=1800.26

?
TT=1794.77

? (TO)
TT=1800.08

? (TO)
TT=1800.24

? (TO)
TT=1800.19

?
TT=1789.79

? (MO)
TT=614.72

SAT
TT=995.314
T1=507.4
?
TT=1796.91

SAT
TT=1122.19
T1=1122.47
? (problem)
TT=0.084

? (problem)
TT=0.082

? (TO)
TT=1800.08

SAT
TT=1107.7
T1=1106.8
SAT
TT=1491.94
T1=1492.37
No dataNo dataNo dataNo dataSAT
TT=381.98
T1=382.05
No dataNo dataSAT
TT=1650.4
T1=843.62
SAT
TT=713.436
T1=703.4
SAT
TT=1237.47
T1=1232.55
?
TT=1796.86

?
TT=1796.78

?
TT=1796.77

? (TO)
TT=1800.1

? (TO)
TT=1800.09

SAT
TT=402.87
T1=403.02
No dataNo dataSAT
TT=383.25
T1=383.44
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K106.opb
SAT
TT=143.74
T1=143.85
SAT
TT=1768.96
T1=1769.64
SAT
TT=202.113
T1=202.14
No data? (problem)
TT=0.086

SAT
TT=307.012
T1=307.34
? (problem)
TT=0.087

SAT
TT=292.841
T1=292.89
? (problem)
TT=0.092

SAT
TT=297.706
T1=297.75
? (problem)
TT=0.084

SAT
TT=302.284
T1=302.32
? (TO)
TT=1800.08

? (TO)
TT=1800.02

SAT
TT=1171.05
T1=1171.22
? (TO)
TT=1800.12

? (TO)
TT=1800.08

SAT
TT=725.23
T1=725.26
? (TO)
TT=1800.09

?
TT=1794.54

SAT
TT=1088.34
T1=1037.45
? (TO)
TT=1800.26

SAT
TT=1365.12
T1=692.69
?
TT=1790.11

? (MO)
TT=611.38

? (TO)
TT=1800.77

?
TT=1796.78

? (TO)
TT=1800.07

? (problem)
TT=0.088

? (problem)
TT=0.085

? (TO)
TT=1800.09

SAT
TT=1229.9
T1=1229
SAT
TT=143.74
T1=143.85
No dataNo dataNo dataNo data?
TT=1799.95

No dataNo dataSAT
TT=552.381
T1=283.53
SAT
TT=473.971
T1=469.49
? (TO)
TT=1800.51

?
TT=1796.8

?
TT=1796.8

?
TT=1796.83

? (TO)
TT=1800.09

? (TO)
TT=1800.03

?
TT=1799.96

No dataNo data?
TT=1799.53

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K107.opb
SAT
TT=100.583
T1=100.6
?
TT=1798.18

SAT
TT=100.583
T1=100.6
No data? (problem)
TT=0.087

SAT
TT=290.676
T1=290.74
? (problem)
TT=0.088

SAT
TT=308.627
T1=308.67
? (problem)
TT=0.084

SAT
TT=308.344
T1=308.38
? (problem)
TT=0.085

SAT
TT=306.46
T1=306.51
? (TO)
TT=1800.07

SAT
TT=1444.6
T1=1444.92
SAT
TT=567.933
T1=568.08
SAT
TT=588.948
T1=589.06
? (TO)
TT=1800.01

?
TT=1798.07

? (TO)
TT=1800.08

?
TT=1794.95

? (TO)
TT=1800.05

? (TO)
TT=1800.12

? (TO)
TT=1800.78

?
TT=1789.79

? (MO)
TT=616

? (TO)
TT=1800.13

?
TT=1796.78

SAT
TT=780.063
T1=780.26
? (problem)
TT=0.092

? (problem)
TT=0.083

? (TO)
TT=1800.03

SAT
TT=861.84
T1=860.77
SAT
TT=1378.77
T1=1379.1
No dataNo dataNo dataNo dataSAT
TT=759
T1=759.27
No dataNo dataSAT
TT=240.027
T1=122.32
SAT
TT=588.72
T1=580.14
? (TO)
TT=1800.1

?
TT=1796.79

?
TT=1796.79

?
TT=1796.8

? (TO)
TT=1800.08

? (TO)
TT=1800.07

SAT
TT=731
T1=731.21
No dataNo dataSAT
TT=747.687
T1=747.73
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K108.opb
SAT
TT=105.854
T1=105.87
?
TT=1798

SAT
TT=105.854
T1=105.87
No data? (problem)
TT=0.086

SAT
TT=342.541
T1=342.6
? (problem)
TT=0.088

SAT
TT=365.339
T1=365.4
? (problem)
TT=0.084

SAT
TT=343.159
T1=343.22
? (problem)
TT=0.087

SAT
TT=346.196
T1=346.26
? (TO)
TT=1800.1

SAT
TT=909.791
T1=909.98
SAT
TT=202.913
T1=202.9
SAT
TT=349.171
T1=349.24
? (TO)
TT=1800.08

SAT
TT=642.952
T1=643.14
? (TO)
TT=1800.62

?
TT=1795.18

? (TO)
TT=1800.08

? (TO)
TT=1800.16

SAT
TT=734.423
T1=372.31
?
TT=1789.78

? (MO)
TT=615.45

SAT
TT=628.77
T1=319.59
?
TT=1797.2

? (TO)
TT=1800.03

? (problem)
TT=0.089

? (problem)
TT=0.08

? (TO)
TT=1800.03

SAT
TT=825.447
T1=824.46
SAT
TT=1082.49
T1=1082.58
No dataNo dataNo dataNo dataSAT
TT=681.34
T1=681.66
No dataNo dataSAT
TT=1514.32
T1=781.9
SAT
TT=158.12
T1=155.74
? (TO)
TT=1800.51

?
TT=1796.77

?
TT=1796.78

?
TT=1796.8

? (TO)
TT=1800.07

? (TO)
TT=1800.09

SAT
TT=684
T1=684.24
No dataNo dataSAT
TT=640.88
T1=641.11
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K109.opb
SAT
TT=28.715
T1=28.71
?
TT=1798.02

SAT
TT=28.715
T1=28.71
No data? (problem)
TT=0.094

SAT
TT=332.598
T1=332.75
? (problem)
TT=0.092

SAT
TT=356.416
T1=356.47
? (problem)
TT=0.089

SAT
TT=335.888
T1=335.94
? (problem)
TT=0.087

SAT
TT=335.031
T1=335.1
? (TO)
TT=1800.09

SAT
TT=1008.65
T1=1008.87
SAT
TT=277.497
T1=277.52
SAT
TT=112.592
T1=112.62
? (TO)
TT=1800.07

?
TT=1798.03

? (TO)
TT=1800.59

?
TT=1794.77

? (TO)
TT=1800.06

? (TO)
TT=1800.33

? (TO)
TT=1800.14

?
TT=1789.77

? (MO)
TT=614.51

? (TO)
TT=1800.21

?
TT=1796.77

SAT
TT=610.136
T1=610.32
? (problem)
TT=0.086

? (problem)
TT=0.083

? (TO)
TT=1800.02

SAT
TT=864.097
T1=863.05
SAT
TT=1431.86
T1=1432.27
No dataNo dataNo dataNo dataSAT
TT=241.56
T1=241.71
No dataNo dataSAT
TT=878.62
T1=452.26
SAT
TT=453.44
T1=448.61
? (TO)
TT=1800.07

?
TT=1796.8

?
TT=1796.76

?
TT=1796.78

? (TO)
TT=1800.01

? (TO)
TT=1800.05

SAT
TT=241.43
T1=241.52
No dataNo dataSAT
TT=232.994
T1=233.02
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K80.opb



?
TT=1798

? (TO)
TT=1800.02

No data? (problem)
TT=0.068

? (TO)
TT=1800.05

? (problem)
TT=0.062

? (TO)
TT=1800.01

? (problem)
TT=0.066

? (TO)
TT=1800.03

? (problem)
TT=0.063

? (TO)
TT=1800

? (TO)
TT=1800.12

? (TO)
TT=1800.06

? (TO)
TT=1800.11

? (TO)
TT=1800.09

? (TO)
TT=1800.04

?
TT=1798.1

? (TO)
TT=1800.29

?
TT=1795.94

? (TO)
TT=1800.01

? (TO)
TT=1800.06

? (TO)
TT=1800.05

?
TT=1789.96

? (MO)
TT=627.09

? (TO)
TT=1800.89

?
TT=1796.76

? (TO)
TT=1800.06

? (problem)
TT=0.062

? (problem)
TT=0.061

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1799.62

No dataNo dataNo dataNo data?
TT=1799.83

No dataNo data? (TO)
TT=1800.94

? (TO)
TT=1800.46

? (TO)
TT=1800.06

?
TT=1796.77

?
TT=1796.76

?
TT=1796.77

? (TO)
TT=1800.06

? (TO)
TT=1800.06

?
TT=1799.96

No dataNo data?
TT=1799.59

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K81.opb



?
TT=1798.08

? (TO)
TT=1800.02

No data? (problem)
TT=0.071

? (TO)
TT=1800.1

? (problem)
TT=0.069

? (TO)
TT=1800.01

? (problem)
TT=0.067

? (TO)
TT=1800.07

? (problem)
TT=0.064

? (TO)
TT=1800.02

? (TO)
TT=1800.12

? (TO)
TT=1800.07

? (TO)
TT=1800.12

? (TO)
TT=1800.09

? (TO)
TT=1800.52

?
TT=1798.01

? (TO)
TT=1800.25

?
TT=1795.36

? (TO)
TT=1800.06

? (TO)
TT=1800.12

? (TO)
TT=1800.2

?
TT=1789.77

? (MO)
TT=662

? (TO)
TT=1800.01

?
TT=1796.77

? (TO)
TT=1800.04

? (problem)
TT=0.072

? (problem)
TT=0.062

? (TO)
TT=1800.04

? (TO)
TT=1800.11

?
TT=1799.61

No dataNo dataNo dataNo data?
TT=1799.86

No dataNo data? (TO)
TT=1800.03

? (TO)
TT=1800.01

? (TO)
TT=1800.1

?
TT=1796.78

?
TT=1796.79

?
TT=1796.78

? (TO)
TT=1800.02

? (TO)
TT=1800.06

?
TT=1799.58

No dataNo data?
TT=1799.62

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K82.opb



?
TT=1798.03

? (TO)
TT=1800.03

No data? (problem)
TT=0.069

? (TO)
TT=1800.05

? (problem)
TT=0.065

? (TO)
TT=1800.08

? (problem)
TT=0.066

? (TO)
TT=1800.08

? (problem)
TT=0.065

? (TO)
TT=1800.01

? (TO)
TT=1800.07

? (TO)
TT=1800.07

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.09

?
TT=1798.05

? (TO)
TT=1800.28

?
TT=1794.79

? (TO)
TT=1800.02

? (TO)
TT=1800.2

? (TO)
TT=1800.16

?
TT=1789.77

? (MO)
TT=624.97

? (TO)
TT=1800.07

?
TT=1796.76

? (TO)
TT=1800.06

? (problem)
TT=0.074

? (problem)
TT=0.063

? (TO)
TT=1800.1

? (TO)
TT=1800.15

?
TT=1799.64

No dataNo dataNo dataNo data?
TT=1799.98

No dataNo data? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1800.07

?
TT=1796.77

?
TT=1796.78

?
TT=1796.75

? (TO)
TT=1800.01

? (TO)
TT=1800.09

?
TT=1799.59

No dataNo data?
TT=1799.64

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K83.opb



?
TT=1798.11

? (TO)
TT=1800.11

No data? (problem)
TT=0.068

? (TO)
TT=1800.11

? (problem)
TT=0.068

? (TO)
TT=1800

? (problem)
TT=0.066

? (TO)
TT=1800.03

? (problem)
TT=0.067

? (TO)
TT=1800.07

? (TO)
TT=1800.08

? (TO)
TT=1800.06

? (TO)
TT=1800.14

? (TO)
TT=1800.11

? (TO)
TT=1800.94

?
TT=1798.15

? (TO)
TT=1800.87

?
TT=1794.53

? (TO)
TT=1800.06

? (TO)
TT=1800.05

? (TO)
TT=1800.08

?
TT=1790.11

? (MO)
TT=630.17

? (TO)
TT=1800.1

?
TT=1796.78

? (TO)
TT=1800.04

? (problem)
TT=0.07

? (problem)
TT=0.063

? (TO)
TT=1800.02

? (TO)
TT=1800.04

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.57

No dataNo data? (TO)
TT=1800.03

? (TO)
TT=1800.79

? (TO)
TT=1800.61

?
TT=1796.82

?
TT=1796.77

?
TT=1796.76

? (TO)
TT=1800.1

? (TO)
TT=1800.11

?
TT=1799.6

No dataNo data?
TT=1799.84

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K84.opb



?
TT=1798.05

? (TO)
TT=1800.02

No data? (problem)
TT=0.071

? (TO)
TT=1800.04

? (problem)
TT=0.07

? (TO)
TT=1800.01

? (problem)
TT=0.066

? (TO)
TT=1800.08

? (problem)
TT=0.068

? (TO)
TT=1800.03

? (TO)
TT=1800.05

? (TO)
TT=1800.08

? (TO)
TT=1800.04

? (TO)
TT=1800.1

? (TO)
TT=1800.05

?
TT=1798.04

? (TO)
TT=1801.08

?
TT=1795.02

? (TO)
TT=1800.05

? (TO)
TT=1800.25

? (TO)
TT=1800.84

?
TT=1789.79

? (MO)
TT=1028.61

? (TO)
TT=1800.2

?
TT=1796.96

? (TO)
TT=1800.06

? (problem)
TT=0.068

? (problem)
TT=0.066

? (TO)
TT=1800.02

? (TO)
TT=1800.03

?
TT=1799.58

No dataNo dataNo dataNo data?
TT=1799.61

No dataNo data? (TO)
TT=1800.79

? (TO)
TT=1800.1

? (TO)
TT=1800.84

?
TT=1796.77

?
TT=1796.77

?
TT=1796.79

? (TO)
TT=1800.02

? (TO)
TT=1800.05

?
TT=1799.61

No dataNo data?
TT=1799.59

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K85.opb



?
TT=1798.11

? (TO)
TT=1800.02

No data? (problem)
TT=0.077

? (TO)
TT=1800.03

? (problem)
TT=0.068

? (TO)
TT=1800.03

? (problem)
TT=0.067

? (TO)
TT=1800.01

? (problem)
TT=0.067

? (TO)
TT=1800.06

? (TO)
TT=1800.14

? (TO)
TT=1800.07

? (TO)
TT=1800.04

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1798.15

? (TO)
TT=1800.25

?
TT=1794.71

? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.17

?
TT=1789.78

? (MO)
TT=617.13

? (TO)
TT=1800.08

?
TT=1796.78

? (TO)
TT=1800.07

? (problem)
TT=0.07

? (problem)
TT=0.068

? (TO)
TT=1800.04

? (TO)
TT=1800.12

?
TT=1800

No dataNo dataNo dataNo data?
TT=1799.56

No dataNo data? (TO)
TT=1800.82

? (TO)
TT=1800.94

? (TO)
TT=1800.09

?
TT=1796.77

?
TT=1796.76

?
TT=1796.76

? (TO)
TT=1800.04

? (TO)
TT=1800.08

?
TT=1799.6

No dataNo data?
TT=1799.57

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K86.opb



?
TT=1798.08

? (TO)
TT=1800.03

No data? (problem)
TT=0.071

? (TO)
TT=1800.14

? (problem)
TT=0.071

? (TO)
TT=1800.01

? (problem)
TT=0.072

? (TO)
TT=1800

? (problem)
TT=0.068

? (TO)
TT=1800.11

? (TO)
TT=1800.17

? (TO)
TT=1800.08

? (TO)
TT=1800.05

? (TO)
TT=1800.1

? (TO)
TT=1800.65

?
TT=1798.06

? (TO)
TT=1800.32

?
TT=1794.75

? (TO)
TT=1800.02

? (TO)
TT=1800.36

? (TO)
TT=1800.7

?
TT=1789.78

? (MO)
TT=611.57

? (TO)
TT=1800.79

?
TT=1796.78

? (TO)
TT=1800.04

? (problem)
TT=0.07

? (problem)
TT=0.067

? (TO)
TT=1800.02

? (TO)
TT=1800.05

?
TT=1799.8

No dataNo dataNo dataNo data?
TT=1800.03

No dataNo data? (TO)
TT=1800.15

? (TO)
TT=1800.81

? (TO)
TT=1800.06

?
TT=1796.76

?
TT=1796.79

?
TT=1796.77

? (TO)
TT=1800.07

? (TO)
TT=1800.04

?
TT=1799.89

No dataNo data?
TT=1799.61

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K87.opb



?
TT=1798.05

? (TO)
TT=1800.11

No data? (problem)
TT=0.075

? (TO)
TT=1800.02

? (problem)
TT=0.075

? (TO)
TT=1800.07

? (problem)
TT=0.073

? (TO)
TT=1800.09

? (problem)
TT=0.07

? (TO)
TT=1800.08

? (TO)
TT=1800.08

? (TO)
TT=1800.06

?
TT=314.87

? (TO)
TT=1800.03

? (TO)
TT=1800.06

?
TT=1798.12

? (TO)
TT=1800.66

?
TT=1794.84

? (TO)
TT=1800.01

? (TO)
TT=1800.08

? (TO)
TT=1800.75

?
TT=1789.77

? (MO)
TT=613.95

? (TO)
TT=1800.04

?
TT=1796.77

? (TO)
TT=1800.02

? (problem)
TT=0.067

? (problem)
TT=0.067

? (TO)
TT=1800.08

? (TO)
TT=1800.08

?
TT=1799.63

No dataNo dataNo dataNo data?
TT=1799.56

No dataNo data? (TO)
TT=1800.17

? (TO)
TT=1800.64

? (TO)
TT=1800.03

?
TT=1796.75

?
TT=1796.79

?
TT=1796.77

? (TO)
TT=1800.11

? (TO)
TT=1800.11

?
TT=1799.52

No dataNo data?
TT=1799.61

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K88.opb



?
TT=1798.01

? (TO)
TT=1800.1

No data? (problem)
TT=0.071

? (TO)
TT=1800.14

? (problem)
TT=0.075

? (TO)
TT=1800.1

? (problem)
TT=0.07

? (TO)
TT=1800.02

? (problem)
TT=0.07

? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1800.06

?
TT=731.153

?
TT=1799.35

? (TO)
TT=1800.68

?
TT=1798.05

? (TO)
TT=1800.31

?
TT=1795.08

? (TO)
TT=1800.05

? (TO)
TT=1800.32

? (TO)
TT=1800.12

?
TT=1789.77

? (MO)
TT=613.45

? (TO)
TT=1800.04

?
TT=1796.77

? (TO)
TT=1800.01

? (problem)
TT=0.07

? (problem)
TT=0.067

? (TO)
TT=1800.09

? (TO)
TT=1800.02

?
TT=1799.99

No dataNo dataNo dataNo data?
TT=1799.63

No dataNo data? (TO)
TT=1800.06

? (TO)
TT=1800.09

? (TO)
TT=1800.05

?
TT=1796.76

?
TT=1796.81

?
TT=1796.74

? (TO)
TT=1800.05

? (TO)
TT=1800.03

?
TT=1799.63

No dataNo data?
TT=1800.01

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K89.opb



?
TT=1798.06

? (TO)
TT=1800.12

No data? (problem)
TT=0.073

? (TO)
TT=1800.02

? (problem)
TT=0.07

? (TO)
TT=1800.01

? (problem)
TT=0.073

? (TO)
TT=1800.06

? (problem)
TT=0.071

? (TO)
TT=1800.01

? (TO)
TT=1800.16

? (TO)
TT=1800.06

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1801.13

?
TT=1798.04

? (TO)
TT=1800.25

?
TT=1794.46

? (TO)
TT=1800.12

? (TO)
TT=1800.26

? (TO)
TT=1800.05

?
TT=1790.09

? (MO)
TT=614.33

? (TO)
TT=1800.08

?
TT=1796.78

? (TO)
TT=1800.04

? (problem)
TT=0.073

? (problem)
TT=0.067

? (TO)
TT=1800.03

? (TO)
TT=1800.1

?
TT=1799.82

No dataNo dataNo dataNo data?
TT=1799.97

No dataNo data? (TO)
TT=1800.79

? (TO)
TT=1801.01

? (TO)
TT=1800.03

?
TT=1796.79

?
TT=1796.79

?
TT=1796.74

? (TO)
TT=1800.03

? (TO)
TT=1800.11

?
TT=1799.83

No dataNo data?
TT=1799.6

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K90.opb



?
TT=1798.08

? (TO)
TT=1800.03

No data? (problem)
TT=0.082

? (TO)
TT=1800.09

? (problem)
TT=0.081

? (TO)
TT=1800.07

? (problem)
TT=0.075

? (TO)
TT=1800.02

? (problem)
TT=0.077

? (TO)
TT=1800.07

? (TO)
TT=1800.08

? (TO)
TT=1800.04

?
TT=475.602

? (TO)
TT=1800.11

? (TO)
TT=1800.89

?
TT=1798.09

? (TO)
TT=1800.27

?
TT=1795.49

? (TO)
TT=1800.07

? (TO)
TT=1800.31

? (TO)
TT=1801.01

?
TT=1789.78

? (MO)
TT=616.73

? (TO)
TT=1800.78

?
TT=1796.77

? (TO)
TT=1800.05

? (problem)
TT=0.07

? (problem)
TT=0.071

? (TO)
TT=1800

? (TO)
TT=1800.03

?
TT=1799.63

No dataNo dataNo dataNo data?
TT=1799.64

No dataNo data? (TO)
TT=1800.18

? (TO)
TT=1800.01

? (TO)
TT=1800.55

?
TT=1796.75

?
TT=1796.77

?
TT=1796.77

? (TO)
TT=1800.06

? (TO)
TT=1800.11

?
TT=1799.61

No dataNo data?
TT=1799.58

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K91.opb



?
TT=1798.16

? (TO)
TT=1800.12

No data? (problem)
TT=0.082

? (TO)
TT=1800.14

? (problem)
TT=0.078

? (TO)
TT=1800.07

? (problem)
TT=0.072

? (TO)
TT=1800.02

? (problem)
TT=0.071

? (TO)
TT=1800.1

? (TO)
TT=1800.21

? (TO)
TT=1800.05

? (TO)
TT=1800.13

? (TO)
TT=1800.01

? (TO)
TT=1800.94

?
TT=1798.01

? (TO)
TT=1801.32

?
TT=1794.48

? (TO)
TT=1800.04

? (TO)
TT=1800.33

? (TO)
TT=1800.11

?
TT=1789.76

? (MO)
TT=615.17

? (TO)
TT=1800.57

?
TT=1796.76

? (TO)
TT=1800.03

? (problem)
TT=0.074

? (problem)
TT=0.07

? (TO)
TT=1800.04

? (TO)
TT=1800.09

?
TT=1799.95

No dataNo dataNo dataNo data?
TT=1799.62

No dataNo data? (TO)
TT=1800.71

? (TO)
TT=1800.72

? (TO)
TT=1800.04

?
TT=1796.78

?
TT=1796.81

?
TT=1796.75

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1799.6

No dataNo data?
TT=1799.96

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K92.opb
SAT
TT=900.986
T1=901.13
?
TT=1798.08

SAT
TT=900.986
T1=901.13
No data? (problem)
TT=0.085

? (TO)
TT=1800.06

? (problem)
TT=0.076

? (TO)
TT=1800.09

? (problem)
TT=0.072

? (TO)
TT=1800.04

? (problem)
TT=0.072

? (TO)
TT=1800.02

? (TO)
TT=1800.12

? (TO)
TT=1800.06

? (TO)
TT=1800.04

? (TO)
TT=1800.1

? (TO)
TT=1800.05

?
TT=1798.03

? (TO)
TT=1800.31

?
TT=1796.05

? (TO)
TT=1800.04

? (TO)
TT=1800.28

? (TO)
TT=1800.71

?
TT=1789.9

? (MO)
TT=654.25

? (TO)
TT=1800.84

?
TT=1796.78

? (TO)
TT=1800.09

? (problem)
TT=0.079

? (problem)
TT=0.072

? (TO)
TT=1800.06

? (TO)
TT=1800.09

?
TT=1799.57

No dataNo dataNo dataNo dataSAT
TT=1783.6
T1=1784.1
No dataNo data? (TO)
TT=1800.12

? (TO)
TT=1800.08

? (TO)
TT=1800.67

?
TT=1796.77

?
TT=1796.78

?
TT=1796.78

? (TO)
TT=1800.04

? (TO)
TT=1800.06

SAT
TT=1722.19
T1=1722.67
No dataNo dataSAT
TT=1765.92
T1=1765.96
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K93.opb
SAT
TT=510.634
T1=510.8
?
TT=1798.01

SAT
TT=1345.66
T1=1345.89
No data? (problem)
TT=0.075

SAT
TT=510.634
T1=510.8
? (problem)
TT=0.076

SAT
TT=539.837
T1=539.95
? (problem)
TT=0.078

SAT
TT=513.34
T1=513.44
? (problem)
TT=0.073

SAT
TT=512.819
T1=512.89
? (TO)
TT=1800.16

? (TO)
TT=1800.05

? (TO)
TT=1800.12

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1798.08

? (TO)
TT=1800.65

?
TT=1794.6

? (TO)
TT=1800.09

? (TO)
TT=1800.02

? (TO)
TT=1800.14

?
TT=1789.92

? (MO)
TT=615.22

? (TO)
TT=1800.07

?
TT=1796.78

? (TO)
TT=1800.04

? (problem)
TT=0.072

? (problem)
TT=0.069

? (TO)
TT=1800.08

? (TO)
TT=1800.1

?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1800.02

No dataNo data? (TO)
TT=1800.06

? (TO)
TT=1800.62

? (TO)
TT=1800.08

?
TT=1796.78

?
TT=1796.77

?
TT=1796.78

? (TO)
TT=1800.08

? (TO)
TT=1800.08

?
TT=1799.55

No dataNo data?
TT=1799.57

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K94.opb
SAT
TT=1099.94
T1=1083.83
?
TT=1798

? (TO)
TT=1800.03

No data? (problem)
TT=0.084

SAT
TT=1746.83
T1=1747.29
? (problem)
TT=0.08

SAT
TT=1774.83
T1=1775.19
? (problem)
TT=0.075

? (TO)
TT=1800.09

? (problem)
TT=0.074

SAT
TT=1756.88
T1=1757.34
? (TO)
TT=1800.17

? (TO)
TT=1800.07

? (TO)
TT=1800.09

? (TO)
TT=1800.1

? (TO)
TT=1800.66

?
TT=1798.02

? (TO)
TT=1800.25

?
TT=1794.81

? (TO)
TT=1800.04

? (TO)
TT=1800.03

? (TO)
TT=1800.62

?
TT=1789.78

? (MO)
TT=610.59

? (TO)
TT=1800.21

?
TT=1796.79

? (TO)
TT=1800.03

? (problem)
TT=0.078

? (problem)
TT=0.073

? (TO)
TT=1800.02

? (TO)
TT=1800.08

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.83

No dataNo data? (TO)
TT=1800.02

SAT
TT=1099.94
T1=1083.83
? (TO)
TT=1800.07

?
TT=1796.8

?
TT=1796.79

?
TT=1796.78

? (TO)
TT=1800.08

? (TO)
TT=1800.06

?
TT=1799.53

No dataNo data?
TT=1799.59

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K95.opb
SAT
TT=389.31
T1=389.37
?
TT=1798.08

SAT
TT=389.31
T1=389.37
No data? (problem)
TT=0.078

SAT
TT=1139.5
T1=1139.74
? (problem)
TT=0.085

SAT
TT=1206.97
T1=1207.24
? (problem)
TT=0.078

SAT
TT=1125.95
T1=1126.19
? (problem)
TT=0.076

SAT
TT=1125.15
T1=1125.38
? (TO)
TT=1800.2

? (TO)
TT=1800.06

? (TO)
TT=1800.13

? (TO)
TT=1800.02

? (TO)
TT=1800.08

?
TT=1798.06

? (TO)
TT=1801.61

?
TT=1795.09

? (TO)
TT=1800.03

? (TO)
TT=1800.4

? (TO)
TT=1800.21

?
TT=1789.77

? (MO)
TT=617.17

? (TO)
TT=1800.13

?
TT=1796.77

? (TO)
TT=1800.04

? (problem)
TT=0.083

? (problem)
TT=0.073

? (TO)
TT=1800

? (TO)
TT=1800.07

?
TT=1799.62

No dataNo dataNo dataNo data?
TT=1799.79

No dataNo data? (TO)
TT=1800.86

SAT
TT=1365.15
T1=1343.83
? (TO)
TT=1800.05

?
TT=1796.79

?
TT=1796.79

?
TT=1796.82

? (TO)
TT=1800.11

? (TO)
TT=1800.09

?
TT=1799.63

No dataNo data?
TT=1799.58

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K96.opb
SAT
TT=568.277
T1=568.37
?
TT=1798

SAT
TT=568.277
T1=568.37
No data? (problem)
TT=0.081

SAT
TT=1434.48
T1=1434.8
? (problem)
TT=0.076

SAT
TT=1443.21
T1=1443.58
? (problem)
TT=0.081

SAT
TT=1435.53
T1=1435.84
? (problem)
TT=0.076

SAT
TT=1535.85
T1=1536.16
? (TO)
TT=1800.08

? (TO)
TT=1800.06

? (TO)
TT=1800.08

? (TO)
TT=1800.11

? (TO)
TT=1800.04

?
TT=1798.02

? (TO)
TT=1801.21

?
TT=1794.38

? (TO)
TT=1800.07

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1789.78

? (MO)
TT=613.74

? (TO)
TT=1800.06

?
TT=1797.08

? (TO)
TT=1800.03

? (problem)
TT=0.077

? (problem)
TT=0.075

? (TO)
TT=1800.06

? (TO)
TT=1800.04

?
TT=1799.98

No dataNo dataNo dataNo data?
TT=1799.62

No dataNo data? (TO)
TT=1800.05

? (TO)
TT=1800.04

? (TO)
TT=1800.63

?
TT=1796.79

?
TT=1796.8

?
TT=1796.77

? (TO)
TT=1800.12

? (TO)
TT=1800.05

?
TT=1799.6

No dataNo data?
TT=1799.92

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K97.opb
SAT
TT=650.612
T1=650.72
?
TT=1798.02

SAT
TT=650.612
T1=650.72
No data? (problem)
TT=0.084

? (TO)
TT=1800.08

? (problem)
TT=0.086

? (TO)
TT=1800.08

? (problem)
TT=0.08

? (TO)
TT=1800.08

? (problem)
TT=0.077

? (TO)
TT=1800.06

? (TO)
TT=1800.15

? (TO)
TT=1800.02

? (TO)
TT=1800.1

? (TO)
TT=1800.09

? (TO)
TT=1800.8

?
TT=1798.06

? (TO)
TT=1800.02

?
TT=1795.16

? (TO)
TT=1800.09

? (TO)
TT=1800.23

? (TO)
TT=1800.11

?
TT=1790.53

? (MO)
TT=613.38

? (TO)
TT=1800.06

?
TT=1796.77

? (TO)
TT=1800.1

? (problem)
TT=0.085

? (problem)
TT=0.074

? (TO)
TT=1800.02

? (TO)
TT=1800.1

?
TT=1799.97

No dataNo dataNo dataNo data?
TT=1799.6

No dataNo data? (TO)
TT=1800.01

SAT
TT=1639.07
T1=1618.85
? (TO)
TT=1800.07

?
TT=1796.79

?
TT=1796.79

?
TT=1796.77

? (TO)
TT=1800.08

? (TO)
TT=1800.05

?
TT=1799.64

No dataNo data?
TT=1799.99

/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K98.opb
SAT
TT=165.396
T1=165.46
?
TT=1798.03

SAT
TT=348.675
T1=348.73
No data? (problem)
TT=0.086

SAT
TT=728.556
T1=728.73
? (problem)
TT=0.081

SAT
TT=728.565
T1=728.71
? (problem)
TT=0.078

SAT
TT=729.309
T1=729.45
? (problem)
TT=0.078

SAT
TT=730.643
T1=730.8
? (TO)
TT=1800.22

? (TO)
TT=1800.06

SAT
TT=840.572
T1=840.68
? (TO)
TT=1800.07

? (TO)
TT=1800.44

?
TT=1798.04

? (TO)
TT=1800.26

?
TT=1794.61

? (TO)
TT=1800.02

? (TO)
TT=1800.31

SAT
TT=797.083
T1=404.32
?
TT=1790.07

? (MO)
TT=609.97

? (TO)
TT=1800.79

?
TT=1796.95

SAT
TT=165.396
T1=165.46
? (problem)
TT=0.081

? (problem)
TT=0.078

? (TO)
TT=1800.01

? (TO)
TT=1800.09

?
TT=1799.61

No dataNo dataNo dataNo dataSAT
TT=571.8
T1=572
No dataNo data? (TO)
TT=1801.69

SAT
TT=737.352
T1=726.55
? (TO)
TT=1800.05

?
TT=1796.79

?
TT=1796.77

?
TT=1796.77

? (TO)
TT=1800.12

? (TO)
TT=1800.11

SAT
TT=553.83
T1=554.08
No dataNo dataSAT
TT=553.71
T1=553.93
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/DEC-SMALLINT-LIN/sroussel/
ShortestPathTate/
normalized-TateBritain_K99.opb
SAT
TT=341.971
T1=342.02
?
TT=1798

SAT
TT=341.971
T1=342.02
No data? (problem)
TT=0.083

SAT
TT=1598.47
T1=1598.86
? (problem)
TT=0.084

SAT
TT=1497.4
T1=1497.71
? (problem)
TT=0.082

SAT
TT=1476.84
T1=1477.14
? (problem)
TT=0.082

SAT
TT=1583.64
T1=1583.97
? (TO)
TT=1800.12

SAT
TT=1463.83
T1=1464.15
? (TO)
TT=1800.07

? (TO)
TT=1800.07

? (TO)
TT=1800.15

?
TT=1798.03

? (TO)
TT=1800.88

?
TT=1794.64

? (TO)
TT=1800.03

? (TO)
TT=1800.09

SAT
TT=1165.37
T1=594.53
?
TT=1789.83

? (MO)
TT=617.29

? (TO)
TT=1800.03

?
TT=1797.02

SAT
TT=777.575
T1=777.73
? (problem)
TT=0.079

? (problem)
TT=0.076

? (TO)
TT=1800.05

SAT
TT=1505.03
T1=1504.22
?
TT=1799.59

No dataNo dataNo dataNo data?
TT=1799.93

No dataNo data? (TO)
TT=1800.83

SAT
TT=442.12
T1=437.58
? (TO)
TT=1800.54

?
TT=1796.76

?
TT=1796.8

?
TT=1796.8

? (TO)
TT=1800.06

? (TO)
TT=1800.03

?
TT=1799.6

No dataNo data?
TT=1799.94

normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-blend.opb
OPT
f=0
TT=78.661
T1=0.37
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800

? (TO)

TT=1800.02

? (TO)

TT=1800.06

SAT (TO)
f=0
TT=1800.04
T1=0.15
SAT (TO)
f=2542922221368
TT=1800.08
T1=1779.96
No dataNo data? (exit code)

TT=1203.33

No data? (TO)

TT=1801.14

No dataNo dataNo dataOPT
f=0
TT=267.804
T1=1.41
SAT
f=0
TT=1792
T1=0.03
No dataOPT
f=0
TT=1126.5
T1=0.95
No dataSAT (TO)
f=2500775267180
TT=1800.08
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3231332497982
TT=1800.16
T1=8.5
? (TO)

TT=1800.04

OPT
f=0
TT=78.661
T1=0.37
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-brandy.opb
UNSAT

TT=0.052

No dataNo dataNo data? (TO)

TT=1800.02

UNSAT

TT=135.448

? (TO)

TT=1800.08

UNSAT

TT=136.81

? (TO)

TT=1800.02

UNSAT

TT=136.62

? (TO)

TT=1800.01

UNSAT

TT=135.09

UNSAT

TT=0.068

UNSAT

TT=1.09

No dataNo dataUNSAT

TT=1.134

No dataUNSAT

TT=1.054

No dataNo dataNo dataUNSAT

TT=1.335

UNSAT

TT=0.123

No dataUNSAT

TT=1.595

No dataUNSAT

TT=0.052

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.474

UNSAT

TT=0.946

UNSAT

TT=0.954

No dataNo dataNo data? (TO)

TT=1800.02

UNSAT

TT=0.54

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-degen3.opb




No dataNo dataNo data? (MO)

TT=270.66

? (problem)

TT=122.11

? (MO)

TT=281.66

? (problem)

TT=121.724

? (MO)

TT=271.99

? (problem)

TT=124.043

? (MO)

TT=290.36

? (problem)

TT=122.131

? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.72

?

TT=1789.98

No data? (TO)

TT=1800.07

No data? (TO)

TT=1800.09

? (problem)

TT=143.501

? (problem)

TT=149.411

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-modszk1.opb




No dataNo dataNo data? (problem)

TT=182.532

? (TO)

TT=1800.01

? (problem)

TT=178.111

? (TO)

TT=1800.08

? (problem)

TT=201.488

? (TO)

TT=1800.07

? (problem)

TT=197.718

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo data? (TO)

TT=1800.09

No data? (TO)

TT=1800.74

No dataNo dataNo data? (TO)

TT=1801.66

UNSAT

TT=1.38

No data? (TO)

TT=1800.55

No data? (TO)

TT=1800.07

? (MO)

TT=171.02

? (MO)

TT=171.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.17

? (TO)

TT=1800.71

? (TO)

TT=1800.36

No dataNo dataNo data? (TO)

TT=1800.07

UNSAT

TT=108.833

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-scagr25.opb
UNSAT

TT=0.045

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.09

UNSAT

TT=0.079

UNSAT

TT=0.613

No dataNo dataUNSAT

TT=1.443

No dataUNSAT

TT=1.534

No dataNo dataNo dataUNSAT

TT=2.053

UNSAT

TT=0.164

No dataUNSAT

TT=1.905

No dataUNSAT

TT=0.045

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=2.034

UNSAT

TT=1.135

UNSAT

TT=1.104

No dataNo dataNo data? (TO)

TT=1800.11

UNSAT

TT=23.079

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-scagr7.opb
UNSAT

TT=0.013

No dataNo dataNo data? (TO)

TT=1800.03

UNSAT

TT=15.026

? (TO)

TT=1800.02

UNSAT

TT=14.37

? (TO)

TT=1800.01

UNSAT

TT=14.311

? (TO)

TT=1800.02

UNSAT

TT=13.861

UNSAT

TT=0.025

UNSAT

TT=0.152

No dataNo dataUNSAT

TT=1.055

No dataUNSAT

TT=1.035

No dataNo dataNo dataUNSAT

TT=1.533

UNSAT

TT=0.054

No dataUNSAT

TT=1.605

No dataUNSAT

TT=0.013

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.633

UNSAT

TT=0.834

UNSAT

TT=0.762

No dataNo dataNo data? (TO)

TT=1800.01

UNSAT

TT=1.723

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/mps-v2-20-10/
ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-scorpion.opb




No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.05

Signal

TT=362.06

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.61

UNSAT

TT=1.552

No data? (TO)

TT=1800.14

No data? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo data? (exit code)

TT=619.622

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-seba.opb
SAT
f=20367073880
TT=1800.19
T1=46.9
No dataNo dataNo data? (problem)

TT=336.761

? (TO)

TT=1800.08

? (problem)

TT=323.521

? (TO)

TT=1800.08

? (problem)

TT=340.111

? (TO)

TT=1800

? (problem)

TT=326.933

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.2

SAT
f=17916854142
TT=1789.84
T1=1790.02
No dataSAT (TO)
f=20367073880
TT=1800.19
T1=46.9
No data? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=20480665600
TT=1800.03
T1=25.44
SAT (TO)
f=23171349459
TT=1800.04
T1=1118.62
? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-share1b.opb
UNSAT

TT=0.375

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.03

UNSAT

TT=0.043

UNSAT

TT=0.65

No dataNo dataUNSAT

TT=1.018

No dataUNSAT

TT=1.034

No dataNo dataNo dataUNSAT

TT=1.396

UNSAT

TT=0.087

No dataUNSAT

TT=1.6

No dataUNSAT

TT=0.375

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.523

UNSAT

TT=0.804

UNSAT

TT=0.806

No dataNo dataNo data? (TO)

TT=1800.11

UNSAT

TT=0.36

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-ship04s.opb
UNSAT

TT=0.776

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

UNSAT

TT=0.218

UNSAT

TT=2.782

No dataNo dataUNSAT

TT=1.068

No dataUNSAT

TT=0.776

No dataNo dataNo dataUNSAT

TT=0.915

UNSAT

TT=0.478

No dataUNSAT

TT=1.075

No dataUNSAT

TT=1.45

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.107

UNSAT

TT=0.905

UNSAT

TT=0.924

No dataNo dataNo dataUNSAT

TT=238.442

UNSAT

TT=231.717

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/
data/normalized-mps-v2-20-10-wood1p.opb




No dataNo dataNo data? (problem)

TT=0.431

? (problem)

TT=0.454

? (problem)

TT=0.412

? (problem)

TT=0.441

? (problem)

TT=0.405

? (problem)

TT=0.439

? (problem)

TT=0.427

? (problem)

TT=0.453

?

TT=1.572

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.86

No dataNo dataNo data? (TO)

TT=1800.1

UNSAT

TT=489.368

No data? (TO)

TT=1800.62

No data? (TO)

TT=1800.08

? (problem)

TT=0.389

? (problem)

TT=0.386

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.59

? (TO)

TT=1800.1

? (TO)

TT=1800

No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/ftp.netlib.org/lp/data/
normalized-mps-v2-20-10-woodw.opb
UNSAT

TT=2.952

No dataNo dataNo data? (TO)

TT=1800.02

? (problem)

TT=197.5

? (TO)

TT=1800.01

? (problem)

TT=196.805

? (TO)

TT=1800.01

? (problem)

TT=195.967

? (TO)

TT=1800.08

? (problem)

TT=198.825

UNSAT

TT=2.315

UNSAT

TT=72.945

No dataNo dataUNSAT

TT=9.282

No dataUNSAT

TT=10.392

No dataNo dataNo dataUNSAT

TT=16.352

UNSAT

TT=3.7

No dataUNSAT

TT=15.341

No dataUNSAT

TT=2.952

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=12.911

UNSAT

TT=5.893

UNSAT

TT=5.531

No dataNo dataNo dataUNSAT

TT=1009.2

UNSAT

TT=634.41

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-a1c1s1.opb




No dataNo dataNo data? (MO)

TT=200.14

? (MO)

TT=131.39

? (MO)

TT=217.96

? (MO)

TT=130.74

? (MO)

TT=203.29

? (MO)

TT=129.14

? (MO)

TT=225.8

? (MO)

TT=128.63

? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.22

No dataNo dataNo data? (TO)

TT=1801.02

UNSAT

TT=39.114

No data? (TO)

TT=1800.89

No data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1800.04

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mkc.opb
SAT
f=-147500
TT=1800.09
T1=1552.77
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.03

Signal

TT=774.688

? (TO)

TT=1800.07

No dataNo dataNo Cert.

TT=838.9

No data? (exit code)

TT=1126.76

No dataNo dataNo data? (TO)

TT=1800.17

SAT
f=0
TT=1789.71
T1=0.06
No data? (TO)

TT=1800.53

No dataSAT (TO)
f=0
TT=1800
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-120625
TT=1800.95
T1=0.89
SAT (TO)
f=-128625
TT=1800.83
T1=0.94
SAT (TO)
f=-147500
TT=1800.09
T1=1552.77
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-nsrand-ipx.opb
SAT
f=1205862294
TT=1800.56
T1=95.44
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.07

SAT (TO)
f=1207959552
TT=1800.11
T1=5.78
? (TO)

TT=1800.08

No dataNo dataSAT (TO)
f=1340014445
TT=1800.51
T1=1681.67
No dataSAT (TO)
f=1205862294
TT=1800.56
T1=95.44
No dataNo dataNo dataSAT (TO)
f=1207959552
TT=1800.12
T1=155.82
SAT
f=1133706240
TT=1789.85
T1=1017.42
No dataSAT (TO)
f=1207959552
TT=1800.07
T1=31.97
No data? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=1613627391
TT=1800.29
T1=936.44
SAT (TO)
f=1612709887
TT=1800.04
T1=81.78
SAT (TO)
f=1207959552
TT=1800.07
T1=0.88
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-rout.opb
SAT
f=1074949888
TT=1800.85
T1=1558.79
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800

SAT (TO)
f=1075346944
TT=1800.04
T1=516.64
SAT (TO)
f=1075131904
TT=1800.11
T1=579.87
No dataNo dataNo Cert.

TT=1802.06

No dataSAT (TO)
f=1074949888
TT=1800.85
T1=1558.79
No dataNo dataNo dataSAT (TO)
f=1075062528
TT=1800.11
T1=450.91
Wrong Cert.

TT=922.547

No dataSAT (TO)
f=1075070720
TT=1800.49
T1=898.22
No dataSAT (TO)
f=1075079936
TT=1800.07
T1=1800.5
? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=1075005952
TT=1800.67
T1=555.37
SAT (TO)
f=1075059456
TT=1800.01
T1=1213.7
SAT (TO)
f=1074999808
TT=1800.09
T1=992.85
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-qnet1.opb
UNSAT

TT=0.09

No dataNo dataNo data? (TO)

TT=1800.02

UNSAT

TT=2.053

? (TO)

TT=1800.02

UNSAT

TT=1.825

? (TO)

TT=1800.02

UNSAT

TT=1.81

? (TO)

TT=1800.02

UNSAT

TT=1.862

UNSAT

TT=0.021

UNSAT

TT=0.97

No dataNo dataUNSAT

TT=1.617

No dataUNSAT

TT=1.443

No dataNo dataNo dataUNSAT

TT=2.923

UNSAT

TT=0.088

No dataUNSAT

TT=3.265

No dataUNSAT

TT=0.09

? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=2.464

UNSAT

TT=1.193

UNSAT

TT=0.663

No dataNo dataNo dataUNSAT

TT=1.781

UNSAT

TT=1.757

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-misc06.opb




No dataNo dataNo data? (TO)

TT=1800.02

? (problem)

TT=0.073

? (TO)

TT=1800.02

? (problem)

TT=0.077

? (TO)

TT=1800.09

? (problem)

TT=0.082

? (TO)

TT=1800.02

? (problem)

TT=0.075

?

TT=0.13

Signal

TT=493.904

No dataNo data? (exit code)

TT=1065.98

No data? (TO)

TT=1800.23

No dataNo dataNo data? (TO)

TT=1800.19

UNSAT

TT=0.835

No data? (TO)

TT=1800.18

No data? (MO)

TT=657.29

? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod013.opb
SAT
f=29890560
TT=1800.19
T1=814.89
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.1

SAT (TO)
f=44219296
TT=1800.08
T1=15.3
SAT (TO)
f=43475091
TT=1800.1
T1=610.76
No dataNo dataSAT (TO)
f=33049600
TT=1800.02
T1=0.52
No dataSAT (TO)
f=32737280
TT=1800.37
T1=934.4
No dataNo dataNo dataSAT (TO)
f=31406080
TT=1801.29
T1=91.38
OPT
f=28769280
TT=25.834
T1=23.69
No dataSAT (TO)
f=29890560
TT=1800.19
T1=814.89
No dataSAT (TO)
f=37876336
TT=1800.08
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=32537600
TT=1800.13
T1=2.81
SAT (TO)
f=31749120
TT=1800.07
T1=1657.24
SAT (TO)
f=32179200
TT=1800.6
T1=1564.79
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-rgn.opb
SAT
f=893264
TT=1800.06
T1=1723.84
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.06

SAT (TO)
f=893264
TT=1800.06
T1=1723.84
No dataNo data? (TO)

TT=1800.46

No data? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1801.09

?

TT=1790.08

No data? (TO)

TT=1800.18

No dataSAT (TO)
f=1089124
TT=1800.03
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.85

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/plato.asu.edu/pub/fctp/
normalized-mps-v2-20-10-n370a.opb
SAT
f=10179070629
TT=1800.32
T1=36.12
No dataNo dataNo data? (TO)

TT=1800.02

? (problem)

TT=99.445

? (TO)

TT=1800.02

? (problem)

TT=100.779

? (TO)

TT=1800.01

? (problem)

TT=100.778

? (TO)

TT=1800.01

? (problem)

TT=98.35

Signal

TT=521.333

? (TO)

TT=1800.08

No dataNo dataSAT (TO)
f=10588553132
TT=1804.16
T1=31.47
No dataSAT (TO)
f=10179070629
TT=1800.32
T1=36.12
No dataNo dataNo data? (TO)

TT=1801.03

Wrong UNSAT

TT=1331.15

No dataSAT (TO)
f=14718324449
TT=1800.51
T1=261.36
No data? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=30868248806
TT=1800.87
T1=58.35
? (TO)

TT=1800

SAT (TO)
f=21327862917
TT=1800.43
T1=30.78
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/fctp/
normalized-mps-v2-20-10-ran12x21.opb
SAT
f=5516295
TT=1800.71
T1=22.28
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.08

SAT (TO)
f=10333602
TT=1800.09
T1=249.66
SAT (TO)
f=26538369
TT=1800.07
T1=1735.43
No dataNo dataSAT (TO)
f=6105088
TT=1800.01
T1=1.51
No dataSAT (TO)
f=7033876
TT=1800.88
T1=1.81
No dataNo dataNo dataSAT (TO)
f=6473725
TT=1800.16
T1=58.63
Wrong Opt.
f=5789071
TT=1236.73
T1=469.38
No dataSAT (TO)
f=5516295
TT=1800.71
T1=22.28
No dataSAT (TO)
f=23672838
TT=1800.09
T1=1800.5
? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=9441250
TT=1800.6
T1=42.86
SAT (TO)
f=14851421
TT=1800.06
T1=0.79
SAT (TO)
f=10481249
TT=1800.59
T1=54.89
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos11.opb
OPT
f=9216
TT=192.164
T1=14.93
No dataNo dataNo data? (MO)

TT=194.62

? (TO)

TT=1800.06

? (MO)

TT=196.41

? (TO)

TT=1800.08

? (MO)

TT=204.55

? (TO)

TT=1800.14

? (MO)

TT=206.33

? (TO)

TT=1800.11

SAT (TO)
f=9216
TT=1800.05
T1=640.06
OPT
f=9216
TT=489.615
T1=444.75
No dataNo dataOPT
f=9216
TT=225.89
T1=46.43
No dataOPT
f=9216
TT=277.852
T1=58.36
No dataNo dataNo dataOPT
f=9216
TT=387.355
T1=25.67
SAT
f=10240
TT=1789.79
T1=1591.56
No dataOPT
f=9216
TT=194.344
T1=14.93
No dataOPT
f=9216
TT=225.383
T1=225.43
? (TO)

TT=1800.08

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=11264
TT=1800.09
T1=12.43
OPT
f=9216
TT=218.78
T1=43.81
OPT
f=9216
TT=192.164
T1=27.68
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-bg512142.opb
SAT
f=15026065169129
TT=1800.74
T1=2.97
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.04

No dataNo data? (TO)

TT=1801.72

No data? (TO)

TT=1800.63

No dataNo dataNo data? (TO)

TT=1800.12

Wrong UNSAT

TT=124.741

No data? (TO)

TT=1800.05

No data? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=22148925268443
TT=1800.08
T1=2.69
SAT (TO)
f=15026065169129
TT=1800.74
T1=2.97
? (TO)

TT=1800.92

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-blp-ic98.opb
SAT
f=1090626176
TT=1800.08
T1=594.5
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.09

Signal

TT=811.356

Signal

TT=243.661

No dataNo data? (TO)

TT=1800.44

No data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.9

?

TT=1789.87

No data? (TO)

TT=1800.15

No data? (MO)

TT=372.75

? (TO)

TT=1800.05

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1800.07

SAT (TO)
f=1090626176
TT=1800.08
T1=594.5
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/
mps-v2-20-10/plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-sp98ic.opb
SAT
f=3860756214
TT=1800.01
T1=363.4
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.01

SAT (TO)
f=4618416110
TT=1800.15
T1=914.95
SAT (TO)
f=116514206638
TT=1800.1
T1=232.1
No dataNo dataSAT (TO)
f=4026056741
TT=1800.07
T1=2.37
No dataSAT (TO)
f=4026056741
TT=1800.07
T1=2.54
No dataNo dataNo dataSAT (TO)
f=3860756214
TT=1800.01
T1=363.4
SAT
f=2897121594
TT=1789.89
T1=1790.05
No dataSAT (TO)
f=3897566335
TT=1800.09
T1=3.39
No dataSAT (TO)
f=102092345218
TT=1800.07
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3897566335
TT=1800.48
T1=52.48
SAT (TO)
f=3897566335
TT=1800.07
T1=60.69
SAT (TO)
f=5639465843
TT=1800.83
T1=1.11
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/mps-v2-20-10/
plato.asu.edu/pub/unibo/
normalized-mps-v2-20-10-usAbbrv.8.25_70.opb
SAT
f=123904
TT=1800.02
T1=169.89
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.04

Signal

TT=1677.12

SAT (TO)
f=125952
TT=1800.03
T1=1538.16
No dataNo dataSAT (TO)
f=124928
TT=1800.77
T1=1416.3
No dataSAT (TO)
f=125952
TT=1800.84
T1=576.74
No dataNo dataNo dataSAT (TO)
f=126976
TT=1800.45
T1=962.53
SAT
f=189440
TT=1789.86
T1=1304.21
No dataSAT (TO)
f=128000
TT=1800.13
T1=793.67
No dataSAT (TO)
f=125952
TT=1800.07
T1=1800.4
? (TO)

TT=1800.01

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=123904
TT=1800.02
T1=556.84
SAT (TO)
f=123904
TT=1800.03
T1=169.89
SAT (TO)
f=124928
TT=1800
T1=453.19
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=120-sizeP=61-sizeQ=120-883133839.opb
OPT
f=1
TT=1.375
T1=0.65
No dataNo dataNo data? (problem)

TT=0.066

? (problem)

TT=0.053

? (problem)

TT=0.06

? (problem)

TT=0.05

? (problem)

TT=0.058

? (problem)

TT=0.058

? (problem)

TT=0.061

? (problem)

TT=0.053

?

TT=0.003

? (TO)

TT=1800.05

No dataNo dataOPT
f=1
TT=1.375
T1=0.66
No dataOPT
f=1
TT=1.533
T1=0.65
No dataNo dataNo dataOPT
f=1
TT=1.975
T1=1.61
?

TT=0.73

No dataOPT
f=1
TT=2.045
T1=1.14
No dataOPT
f=1
TT=27.84
T1=27.84
? (problem)

TT=0.057

? (problem)

TT=0.058

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=2.193
T1=1.2
OPT
f=1
TT=1.494
T1=0.65
OPT
f=1
TT=634.12
T1=624.78
No dataNo dataNo dataOPT
f=1
TT=5.145
T1=3.32
OPT
f=1
TT=4.512
T1=2.86
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=140-sizeP=71-sizeQ=140-217105354-max.opb
SAT
f=-7
TT=1800.36
T1=257.78
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.001

?

TT=0.002

? (TO)

TT=1800.04

No dataNo data?

TT=1050.74

No data? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=-1
TT=1800.62
T1=698.77
Wrong Cert.

TT=0.72

No dataSAT (TO)
f=-2
TT=1800.84
T1=244.83
No data? (TO)

TT=1800.1

? (problem)

TT=0.002

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-2
TT=1800.15
T1=72.69
? (TO)

TT=1800.05

SAT (TO)
f=-7
TT=1800.36
T1=257.78
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=160-sizeP=81-sizeQ=160-451332552.opb
OPT
f=1
TT=1.625
T1=0.79
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

?

TT=0.001

? (TO)

TT=1800.11

No dataNo dataOPT
f=1
TT=1.625
T1=0.89
No dataOPT
f=1
TT=1.752
T1=0.83
No dataNo dataNo dataOPT
f=1
TT=2.524
T1=1.77
Wrong UNSAT

TT=0.95

No dataOPT
f=1
TT=2.473
T1=1.26
No dataOPT
f=1
TT=74.49
T1=74.51
? (problem)

TT=0.001

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=2.785
T1=1.37
OPT
f=1
TT=1.663
T1=0.79
? (TO)

TT=1800.27

No dataNo dataNo dataOPT
f=1
TT=20.835
T1=12.43
OPT
f=1
TT=20.704
T1=12.35
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554-max.opb
SAT
f=-1
TT=1800.69
T1=155.46
No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.005

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

?

TT=0.001

? (TO)

TT=1800.06

No dataNo data?

TT=1265.36

No data? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.21

Wrong Cert.

TT=1.225

No dataSAT (TO)
f=-1
TT=1800.69
T1=553.02
No data? (TO)

TT=1800.08

? (problem)

TT=0.002

? (problem)

TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1
TT=1800.75
T1=155.46
? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=180-sizeP=91-sizeQ=180-348768554.opb
OPT
f=1
TT=1.853
T1=0.88
No dataNo dataNo data? (problem)

TT=0.003

? (problem)

TT=0.004

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.004

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.002

?

TT=0.001

? (TO)

TT=1800.09

No dataNo dataOPT
f=1
TT=1.866
T1=1.04
No dataOPT
f=1
TT=2.074
T1=0.99
No dataNo dataNo dataOPT
f=1
TT=2.954
T1=1.82
Wrong UNSAT

TT=1.214

No dataOPT
f=1
TT=2.946
T1=1.37
No data? (TO)

TT=1800.08

? (problem)

TT=0.003

? (problem)

TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=2.775
T1=1.41
OPT
f=1
TT=1.853
T1=0.88
? (TO)

TT=1800.05

No dataNo dataNo dataOPT
f=1
TT=37.95
T1=22.37
OPT
f=1
TT=39.313
T1=23.06
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=200-sizeP=101-sizeQ=200-410184650-max.opb




No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.002

?

TT=0.002

? (TO)

TT=1800.03

No dataNo data?

TT=1399.84

No data? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.08

Wrong Cert.

TT=1.613

No data? (TO)

TT=1800.54

No data? (TO)

TT=1800.07

? (problem)

TT=0

? (problem)

TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.59

? (TO)

TT=1800.02

? (TO)

TT=1800.45

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=200-sizeP=101-sizeQ=200-864124249.opb
OPT
f=1
TT=1.965
T1=0.97
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.001

?

TT=0.003

OPT
f=1
TT=838.247
T1=838.49
No dataNo dataOPT
f=1
TT=2.314
T1=1.24
No dataOPT
f=1
TT=2.192
T1=1.12
No dataNo dataNo dataOPT
f=1
TT=3.483
T1=1.95
Wrong UNSAT

TT=1.496

No dataOPT
f=1
TT=3.103
T1=1.34
No data? (TO)

TT=1800.01

? (problem)

TT=0.001

? (problem)

TT=0.004

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=2.905
T1=1.49
OPT
f=1
TT=1.965
T1=0.97
? (TO)

TT=1800.06

No dataNo dataNo dataOPT
f=1
TT=69.99
T1=41.18
OPT
f=1
TT=71.171
T1=41.67
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=20-sizeP=11-sizeQ=20-900543-max.opb
OPT
f=-1281
TT=0.063
T1=0.06
No dataNo dataNo dataOPT
f=-1281
TT=548.36
T1=242.24
OPT
f=-1281
TT=1.104
T1=0.41
OPT
f=-1281
TT=503.729
T1=239.23
OPT
f=-1281
TT=1.024
T1=0.4
OPT
f=-1281
TT=64.009
T1=38.19
OPT
f=-1281
TT=0.479
T1=0.4
OPT
f=-1281
TT=170.02
T1=145.32
OPT
f=-1281
TT=0.514
T1=0.4
OPT
f=-1281
TT=0.178
T1=0.13
OPT
f=-1281
TT=0.121
T1=0.12
No dataNo dataOPT
f=-1281
TT=0.744
T1=0.44
No dataOPT
f=-1281
TT=1.034
T1=0.58
No dataNo dataNo dataOPT
f=-1281
TT=3.284
T1=2.19
OPT
f=-1281
TT=1.195
T1=1.18
No dataOPT
f=-1281
TT=1.264
T1=1.21
No dataOPT
f=-1281
TT=0.063
T1=0.06
OPT
f=-1281
TT=377.851
T1=25.91
OPT
f=-1281
TT=158.215
T1=139.96
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=-1281
TT=1.352
T1=1.2
OPT
f=-1281
TT=0.646
T1=0.35
SAT
f=-1281
TT=0.886
T1=0.45
No dataNo dataNo dataOPT
f=-1281
TT=0.934
T1=0.56
OPT
f=-1281
TT=0.925
T1=0.56
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=220-sizeP=111-sizeQ=220-229130880.opb
OPT
f=1
TT=2.203
T1=1.1
No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.002

?

TT=0.001

? (TO)

TT=1800.15

No dataNo dataOPT
f=1
TT=2.825
T1=1.53
No dataOPT
f=1
TT=2.675
T1=1.43
No dataNo dataNo dataOPT
f=1
TT=4.094
T1=2.02
Wrong UNSAT

TT=1.802

No dataOPT
f=1
TT=4.184
T1=2.1
No data? (TO)

TT=1800.06

? (problem)

TT=0.005

? (problem)

TT=0.004

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=3.544
T1=1.67
OPT
f=1
TT=2.203
T1=1.1
? (TO)

TT=1800.04

No dataNo dataNo dataOPT
f=1
TT=123.724
T1=70.87
OPT
f=1
TT=126.24
T1=73.27
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=220-sizeP=111-sizeQ=220-687342390-max.opb




No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

?

TT=0.001

? (TO)

TT=1800.06

No dataNo data?

TT=738.351

No data?

TT=1654.04

No dataNo dataNo data? (TO)

TT=1801.28

Wrong Cert.

TT=1.816

No data? (TO)

TT=1800.16

No data? (TO)

TT=1800.05

? (problem)

TT=0.002

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.16

? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=280-sizeP=141-sizeQ=280-254810631-max.opb




No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.001

?

TT=0.001

? (TO)

TT=1800.11

No dataNo data?

TT=1144.83

No data? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.03

Wrong Cert.

TT=2.957

No data? (TO)

TT=1800.06

No data? (exit code)

TT=12.745

? (problem)

TT=0.002

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.61

? (TO)

TT=1800.08

? (TO)

TT=1800.59

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=280-sizeP=141-sizeQ=280-999529433.opb
OPT
f=1
TT=2.814
T1=1.52
No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0

? (problem)

TT=0.002

? (problem)

TT=0

?

TT=0.001

? (TO)

TT=1800.07

No dataNo dataOPT
f=1
TT=4.123
T1=2.57
No dataOPT
f=1
TT=4.494
T1=2.58
No dataNo dataNo dataOPT
f=1
TT=7.393
T1=3.43
Wrong UNSAT

TT=2.903

No dataOPT
f=1
TT=7.184
T1=2.92
No data? (exit code)

TT=13.007

? (problem)

TT=0.003

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=4.292
T1=2.16
OPT
f=1
TT=2.814
T1=1.52
? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=1
TT=400.254
T1=229.42
OPT
f=1
TT=401.431
T1=229.34
No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=300-sizeP=151-sizeQ=300-692949159-max.opb




No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.005

? (problem)

TT=0.003

? (problem)

TT=0

? (problem)

TT=0.003

? (problem)

TT=0.001

?

TT=0.005

? (TO)

TT=1800.06

No dataNo data? (exit code)

TT=1629.83

No data? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.31

Wrong Cert.

TT=4.583

No data? (TO)

TT=1800.06

No data? (exit code)

TT=16.487

? (problem)

TT=0.003

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.53

? (TO)

TT=1800.75

? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=340-sizeP=171-sizeQ=340-700380480.opb
OPT
f=1
TT=4.586
T1=2.72
No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.002

?

TT=0.001

Signal

TT=88.708

No dataNo dataOPT
f=1
TT=6.974
T1=4.51
No dataOPT
f=1
TT=8.023
T1=4.55
No dataNo dataNo dataOPT
f=1
TT=13.852
T1=5.04
Wrong UNSAT

TT=4.312

No dataOPT
f=1
TT=13.344
T1=5.05
No data? (exit code)

TT=27.063

? (problem)

TT=0.001

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=5.634
T1=2.72
OPT
f=1
TT=4.586
T1=2.9
? (TO)

TT=1800.35

No dataNo dataNo dataOPT
f=1
TT=956.918
T1=548.48
OPT
f=1
TT=950.38
T1=541.93
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=360-sizeP=181-sizeQ=360-770414132.opb
OPT
f=1
TT=5.463
T1=3.35
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.004

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.004

? (problem)

TT=0.002

? (problem)

TT=0.004

? (problem)

TT=0.001

?

TT=0.001

Signal

TT=111.446

No dataNo dataOPT
f=1
TT=8.484
T1=5.77
No dataOPT
f=1
TT=9.707
T1=5.64
No dataNo dataNo dataOPT
f=1
TT=16.852
T1=6.27
Wrong UNSAT

TT=4.862

No dataOPT
f=1
TT=17.242
T1=6.87
No data? (exit code)

TT=33.953

? (problem)

TT=0.001

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=6.504
T1=3.35
OPT
f=1
TT=5.463
T1=3.38
? (TO)

TT=1800.07

No dataNo dataNo dataOPT
f=1
TT=1299.97
T1=744.5
OPT
f=1
TT=1397.79
T1=789.98
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=380-sizeP=191-sizeQ=380-376320478.opb
OPT
f=1
TT=4.882
T1=2.91
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.001

?

TT=0.002

Signal

TT=137.541

No dataNo dataOPT
f=1
TT=9.683
T1=6.45
No dataOPT
f=1
TT=11.072
T1=6.39
No dataNo dataNo dataOPT
f=1
TT=20.026
T1=7.74
Wrong UNSAT

TT=7.307

No dataOPT
f=1
TT=18.981
T1=6.91
No data? (exit code)

TT=43.024

? (problem)

TT=0.002

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=8.213
T1=4.16
OPT
f=1
TT=4.882
T1=2.91
? (TO)

TT=1800.03

No dataNo dataNo dataOPT
f=1
TT=1665.53
T1=939.98
OPT
f=1
TT=1504.42
T1=853.44
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=380-sizeP=191-sizeQ=380-765568612.opb
OPT
f=1
TT=4.622
T1=2.8
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

?

TT=0.005

Signal

TT=140.786

No dataNo dataOPT
f=1
TT=9.941
T1=6.83
No dataOPT
f=1
TT=10.92
T1=6.3
No dataNo dataNo dataOPT
f=1
TT=19.762
T1=7.51
Wrong UNSAT

TT=5.417

No dataOPT
f=1
TT=19.983
T1=7.47
No data? (exit code)

TT=43.057

? (problem)

TT=0.002

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=8.123
T1=4.14
OPT
f=1
TT=4.622
T1=2.8
? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=1
TT=1756.86
T1=994.37
OPT
f=1
TT=1538.06
T1=876.46
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=40-sizeP=21-sizeQ=40-289612555-max.opb
OPT
f=-18535
TT=886.746
T1=5.12
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.12

SAT (TO)
f=-1
TT=1800.07
T1=0.05
OPT
f=-18535
TT=1075.56
T1=667.85
No dataNo dataSAT
f=-1685
TT=1594.43
T1=63.84
No dataSAT (TO)
f=-3707
TT=1800.79
T1=854.71
No dataNo dataNo dataSAT (TO)
f=-11
TT=1800.01
T1=558.41
Wrong Cert.

TT=18.335

No dataSAT (TO)
f=-5
TT=1800.19
T1=118
No dataOPT
f=-18535
TT=886.746
T1=886.9
? (TO)

TT=1800.12

? (TO)

TT=1800.16

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-18535
TT=1800.09
T1=23.37
? (TO)

TT=1800.52

SAT (TO)
f=-18535
TT=1800.09
T1=5.12
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=420-sizeP=211-sizeQ=420-348698641.opb
OPT
f=1
TT=6.145
T1=4.32
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.001

?

TT=0.003

Signal

TT=208.232

No dataNo dataOPT
f=1
TT=13.363
T1=8.84
No dataOPT
f=1
TT=14.702
T1=8.73
No dataNo dataNo dataOPT
f=1
TT=27.4
T1=10.14
Wrong UNSAT

TT=6.738

No dataOPT
f=1
TT=26.37
T1=9.3
No data? (exit code)

TT=69.058

? (problem)

TT=0.002

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=8.174
T1=4.44
OPT
f=1
TT=6.145
T1=4.32
? (TO)

TT=1800.57

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=420-sizeP=211-sizeQ=420-802270006.opb
OPT
f=1
TT=6.503
T1=4.47
No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.004

?

TT=0.002

Signal

TT=209.138

No dataNo dataOPT
f=1
TT=13.603
T1=9.13
No dataOPT
f=1
TT=15.112
T1=8.94
No dataNo dataNo dataOPT
f=1
TT=27.559
T1=9.96
Wrong UNSAT

TT=6.617

No dataOPT
f=1
TT=26.649
T1=9.41
No data? (exit code)

TT=65.322

? (problem)

TT=0.004

? (problem)

TT=0.004

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=7.835
T1=4.47
OPT
f=1
TT=6.503
T1=4.82
? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=440-sizeP=221-sizeQ=440-726468498-max.opb




No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

?

TT=0.004

Signal

TT=251.829

No dataNo data?

TT=1486.29

No data? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.09

Wrong Cert.

TT=7.817

No data? (TO)

TT=1800.03

No data? (exit code)

TT=80.867

? (problem)

TT=0.003

? (problem)

TT=0.005

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.5

? (TO)

TT=1800.53

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.12

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129-max.opb




No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0

? (problem)

TT=0.001

?

TT=0.002

Signal

TT=301.694

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.19

Wrong Cert.

TT=8.061

No data? (TO)

TT=1800.56

No data? (exit code)

TT=98.672

? (problem)

TT=0.002

? (problem)

TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.16

? (TO)

TT=1800.22

? (TO)

TT=1800.39

No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=460-sizeP=231-sizeQ=460-367423129.opb
OPT
f=1
TT=6.272
T1=4.3
No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.003

?

TT=0.001

Signal

TT=303.917

No dataNo dataOPT
f=1
TT=18.38
T1=12.45
No dataOPT
f=1
TT=19.933
T1=11.43
No dataNo dataNo dataOPT
f=1
TT=40.93
T1=14.7
Wrong UNSAT

TT=10.754

No dataOPT
f=1
TT=36.877
T1=12.96
No data? (exit code)

TT=98.34

? (problem)

TT=0.001

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=10.811
T1=6.11
OPT
f=1
TT=6.272
T1=4.3
? (TO)

TT=1800.58

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=480-sizeP=241-sizeQ=480-57455727-max.opb




No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.004

? (problem)

TT=0.003

? (problem)

TT=0.002

?

TT=0.002

Signal

TT=362.333

No dataNo data? (exit code)

TT=1278.91

No data? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.17

Wrong Cert.

TT=8.761

No data? (TO)

TT=1800.17

No data? (exit code)

TT=121.345

? (problem)

TT=0.002

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.17

? (TO)

TT=1800

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=480-sizeP=241-sizeQ=480-896328136.opb
OPT
f=1
TT=7.754
T1=5.65
No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.002

? (problem)

TT=0.001

? (problem)

TT=0

? (problem)

TT=0.001

?

TT=0.001

Signal

TT=362.934

No dataNo dataOPT
f=1
TT=21.202
T1=14.48
No dataOPT
f=1
TT=24.273
T1=14.64
No dataNo dataNo dataOPT
f=1
TT=41.707
T1=14.2
Wrong UNSAT

TT=17.274

No dataOPT
f=1
TT=45.457
T1=16
No data? (exit code)

TT=120.758

? (problem)

TT=0.002

? (problem)

TT=0.003

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=12.862
T1=7.06
OPT
f=1
TT=7.754
T1=5.65
? (TO)

TT=1800.44

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=500-sizeP=251-sizeQ=500-280035866-max.opb




No dataNo dataNo data? (problem)

TT=0.001

? (problem)

TT=0.001

? (problem)

TT=0.003

? (problem)

TT=0.001

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0

? (problem)

TT=0.002

?

TT=0.004

Signal

TT=440.197

No dataNo data?

TT=1057.62

No data? (TO)

TT=1800.47

No dataNo dataNo data? (TO)

TT=1800.83

Wrong Cert.

TT=10.121

No data? (TO)

TT=1800.19

No data? (exit code)

TT=149.666

? (problem)

TT=0.001

? (problem)

TT=0.002

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=500-sizeP=251-sizeQ=500-293748522-max.opb




No dataNo dataNo data? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.002

? (problem)

TT=0.003

? (problem)

TT=0.001

? (problem)

TT=0.001

?

TT=0.001

Signal

TT=429.177

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.2

Wrong Cert.

TT=9.523

No data? (TO)

TT=1800.09

No data? (exit code)

TT=146.259

? (problem)

TT=0.003

? (problem)

TT=0.001

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.48

? (TO)

TT=1800.37

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=60-sizeP=31-sizeQ=60-472296155.opb
OPT
f=1
TT=0.36
T1=0.26
No dataNo dataNo data? (problem)

TT=0.016

? (problem)

TT=0.014

? (problem)

TT=0.019

? (problem)

TT=0.017

? (problem)

TT=0.016

? (problem)

TT=0.016

? (problem)

TT=0.017

? (problem)

TT=0.016

?

TT=0.014

? (TO)

TT=1800.11

No dataNo dataOPT
f=1
TT=1.345
T1=0.52
No dataOPT
f=1
TT=0.985
T1=0.42
No dataNo dataNo dataOPT
f=1
TT=1.883
T1=1.55
Wrong UNSAT

TT=1.277

No dataOPT
f=1
TT=1.836
T1=1.04
No dataOPT
f=1
TT=92.928
T1=92.96
? (problem)

TT=0.016

? (problem)

TT=0.015

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=1
TT=1.985
T1=1.13
OPT
f=1
TT=0.824
T1=0.37
OPT
f=1
TT=106.83
T1=104.03
No dataNo dataNo dataOPT
f=1
TT=0.36
T1=0.26
OPT
f=1
TT=0.363
T1=0.26
No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=80-sizeP=41-sizeQ=80-505615378-max.opb
SAT
f=-66
TT=1800.02
T1=297.27
No dataNo dataNo data? (problem)

TT=0.027

? (problem)

TT=0.026

? (problem)

TT=0.027

? (problem)

TT=0.024

? (problem)

TT=0.029

? (problem)

TT=0.023

? (problem)

TT=0.026

? (problem)

TT=0.024

?

TT=0.023

? (TO)

TT=1800.08

No dataNo data? (exit code)

TT=711.67

No data? (TO)

TT=1800.46

No dataNo dataNo dataSAT (TO)
f=-2
TT=1800.08
T1=7.57
Wrong Cert.

TT=0.284

No dataSAT (TO)
f=-2
TT=1800.14
T1=7.59
No data? (TO)

TT=1800.05

? (problem)

TT=0.025

? (problem)

TT=0.027

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-2
TT=1800.2
T1=3.66
? (TO)

TT=1801.43

SAT (TO)
f=-66
TT=1800.02
T1=297.27
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/OPT-BIGINT/submitted-PB06/
roussel/factor/
normalized-factor-sizeN=80-sizeP=41-sizeQ=80-898154415-max.opb
SAT
f=-6589
TT=1800.91
T1=1523.99
No dataNo dataNo data? (problem)

TT=0.027

? (problem)

TT=0.024

? (problem)

TT=0.028

? (problem)

TT=0.024

? (problem)

TT=0.028

? (problem)

TT=0.028

? (problem)

TT=0.029

? (problem)

TT=0.024

?

TT=0.024

? (TO)

TT=1800.06

No dataNo data? (exit code)

TT=645.64

No data? (TO)

TT=1800.68

No dataNo dataNo data? (TO)

TT=1800.18

Wrong Cert.

TT=0.35

No data? (TO)

TT=1800.08

No data? (TO)

TT=1800.07

? (problem)

TT=0.026

? (problem)

TT=0.027

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.19

? (TO)

TT=1800.07

SAT (TO)
f=-6589
TT=1800.91
T1=1523.99
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
normalized-PB06/OPT-MEDINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-gt2.opb
OPT
f=21166
TT=4.313
T1=3.22
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.01

? (TO)

TT=1800.35

SAT (TO)
f=21166
TT=1800.01
T1=273.84
SAT (TO)
f=64860
TT=1800.12
T1=584.68
No dataNo data? (TO)

TT=1800.06

No dataSAT (TO)
f=107340
TT=1800.04
T1=1060.64
No dataNo dataNo dataOPT
f=21166
TT=4.393
T1=6.21
OPT
f=21166
TT=0.686
T1=0.67
No dataOPT
f=21166
TT=4.313
T1=3.22
No dataSAT (TO)
f=60195
TT=1800
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=21166
TT=6.023
T1=4.21
SAT (TO)
f=25652
TT=1800.01
T1=1393.67
SAT (TO)
f=247501
TT=1800.06
T1=1109.48
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/OPT-MEDINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-air03.opb
SAT
f=199987
TT=1800.08
T1=1359.36
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.08

SAT (TO)
f=247744
TT=1800.05
T1=1571.42
SAT (TO)
f=296312
TT=1800.09
T1=1431.73
No dataNo dataNo Cert.

TT=270.04

No dataSAT (TO)
f=225993
TT=1800.02
T1=891.72
No dataNo dataNo dataSAT (TO)
f=200105
TT=1800.7
T1=450.27
OPT
f=170080
TT=19.051
T1=18.99
No dataSAT (TO)
f=200394
TT=1800.03
T1=156.86
No dataSAT (TO)
f=307057
TT=1800.03
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=200394
TT=1800.18
T1=36.03
SAT (TO)
f=213885
TT=1800.05
T1=199.98
SAT (TO)
f=199987
TT=1800.08
T1=1359.36
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-MEDINT/mps-v2-20-10/
plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-seymour1.opb
SAT
f=471080
TT=1800.2
T1=201.56
No dataNo dataNo data? (MO)

TT=311.22

? (TO)

TT=1800

? (MO)

TT=301.41

? (TO)

TT=1800.08

? (MO)

TT=303.92

? (TO)

TT=1800.04

? (MO)

TT=298.82

? (TO)

TT=1800.1

Signal

TT=1607.44

SAT (TO)
f=1008256
TT=1800.06
T1=137.33
No dataNo dataSAT (TO)
f=471086
TT=1800.42
T1=1.36
No dataSAT (TO)
f=471086
TT=1800.05
T1=1.33
No dataNo dataNo dataSAT (TO)
f=471080
TT=1800.75
T1=201.56
SAT
f=444370
TT=1789.87
T1=978.33
No dataSAT (TO)
f=471080
TT=1800.2
T1=203.77
No dataSAT (TO)
f=1008256
TT=1800.04
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=471083
TT=1800.65
T1=56.93
SAT (TO)
f=471086
TT=1800.59
T1=1.03
SAT (TO)
f=495616
TT=1800.08
T1=1.15
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
normalized-PB06/OPT-MEDINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
course-ass/normalized-ws97-3.opb
SAT
f=3052
TT=1800.16
T1=165.06
No dataNo dataNo data? (TO)

TT=1800.15

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=61080
TT=1800.08
T1=0.07
? (TO)

TT=1800.09

No dataNo data? (exit code)

TT=323.87

No dataSAT (TO)
f=25072
TT=1800.1
T1=0.77
No dataNo dataNo dataSAT (TO)
f=3060
TT=1801.25
T1=302.3
OPT
f=3031
TT=1.932
T1=1.91
No dataSAT (TO)
f=3059
TT=1800.4
T1=771.07
No data? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3052
TT=1800.16
T1=165.06
SAT (TO)
f=3072
TT=1800.06
T1=0.59
SAT (TO)
f=56089
TT=1800.03
T1=26.34
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-fast0507.opb
OPT
f=174
TT=1166.64
T1=663.2
SAT
f=215
TT=1798.02
T1=1675.57
No data? (TO)

TT=1800

? (TO)

TT=1800.13

? (TO)

TT=1800.14

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1801.88

? (TO)

TT=1800.11

SAT (TO)
f=176
TT=1800.1
T1=1187.55
Signal

TT=3.631

SAT (TO)
f=340
TT=1802.09
T1=195.47
SAT
f=318
TT=1783.02
T1=73.76
SAT (TO)
f=259
TT=1803.9
T1=7.53
SAT
f=215
TT=1798.03
T1=1715.43
SAT (TO)
f=259
TT=1800.1
T1=5.12
SAT
f=175
TT=1794.25
T1=616.98
No dataOPT
f=174
TT=1166.64
T1=663.2
SAT (TO)
f=253
TT=1800.84
T1=158.41
SAT
f=176
TT=1790.12
T1=15.27
No dataSAT (TO)
f=253
TT=1800.74
T1=199.75
SAT
f=174
TT=1797.27
T1=1139.8
No Cert.

TT=1800.03

? (TO)

TT=1800.15

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=307
TT=1800.49
T1=900.41
No dataNo dataSAT (TO)
f=307
TT=1800.59
T1=900.51
No dataNo dataNo dataSAT (TO)
f=259
TT=1800.14
T1=97.4
SAT (TO)
f=259
TT=1801.27
T1=1.35
SAT (TO)
f=363
TT=1800.1
T1=1.44
SAT
f=176
TT=1797.21
T1=388.49
SAT
f=176
TT=1797.22
T1=382.85
SAT
f=176
TT=1797.09
T1=375.28
? (TO)

TT=1800.01

? (TO)

TT=1800.11

?

TT=1799.89

No dataNo data?

TT=1799.69

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-manna81.opb
OPT
f=-13164
TT=75.406
T1=26.81
SAT
f=-11464
TT=1798.04
T1=615.11
No dataSAT (TO)
f=-11688
TT=1800.07
T1=42.13
? (TO)

TT=1800.14

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.07

Signal

TT=366.985

SAT (TO)
f=-8204
TT=1800.14
T1=0.61
? (TO)

TT=1800.09

SAT
f=-358
TT=1783.24
T1=1783.49
No Cert.

TT=247.886

Signal

TT=857.661

? (exit code)

TT=192.8

OPT
f=-13164
TT=189.716
T1=189.67
No dataSAT
f=-13164
TT=42.268
T1=26.81
SAT (TO)
f=-11570
TT=1800.8
T1=31.97
OPT
f=-13164
TT=75.406
T1=75.35
No dataSAT (TO)
f=-11530
TT=1800.05
T1=31.54
OPT
f=-13164
TT=101.093
T1=101.04
SAT (TO)
f=-8204
TT=1800.09
T1=1800.6
? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=-11525
TT=1800.39
T1=900.31
No dataNo dataSAT (TO)
f=-11525
TT=1800.48
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-11521
TT=1800.13
T1=71.87
SAT (TO)
f=-10909
TT=1800.09
T1=0.9
SAT (TO)
f=-11493
TT=1800.02
T1=38.81
OPT
f=-13164
TT=173.379
T1=173.32
OPT
f=-13164
TT=172.777
T1=172.71
OPT
f=-13164
TT=175.34
T1=175.28
? (TO)

TT=1800.01

? (TO)

TT=1800.05

?

TT=1799.92

No dataNo data?

TT=1799.99

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mzzv11.opb
OPT
f=-10859
TT=76.86
T1=68.69
SAT
f=-8919
TT=1798.02
T1=1787.85
No dataOPT
f=-10859
TT=76.86
T1=76.27
? (TO)

TT=1800.07

OPT
f=-10859
TT=680.895
T1=602.67
? (TO)

TT=1800.12

? (problem)

TT=2.75

? (TO)

TT=1800.08

? (problem)

TT=2.75

? (TO)

TT=1800.36

? (problem)

TT=2.75

SAT (TO)
f=-8089
TT=1800.07
T1=1651.68
SAT (TO)
f=-8820
TT=1800.08
T1=1713.41
? (TO)

TT=1800.07

SAT
f=-5329
TT=1783.01
T1=1783.28
OPT
f=-10859
TT=1725.16
T1=1753.86
SAT
f=-8700
TT=1798.01
T1=1708.56
OPT
f=-10859
TT=1370.57
T1=1234.32
SAT
f=-10449
TT=1793.26
T1=1748.63
No dataOPT
f=-10859
TT=116.025
T1=68.69
SAT (TO)
f=-10765
TT=1800.11
T1=819.18
?

TT=1790.26

No dataSAT (TO)
f=-10405
TT=1800.06
T1=399.17
OPT
f=-10859
TT=836.177
T1=648.64
SAT (TO)
f=-6329
TT=1800.09
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=-7944
TT=1800.01
T1=900.31
No dataNo dataSAT (TO)
f=-8136
TT=1800.17
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-10674
TT=1800.71
T1=82.67
OPT
f=-10859
TT=98.23
T1=93.89
SAT (TO)
f=-9050
TT=1800.03
T1=1695.76
OPT
f=-10859
TT=981.397
T1=927.61
OPT
f=-10859
TT=992.414
T1=936.78
OPT
f=-10859
TT=687.9
T1=585.43
? (TO)

TT=1800.11

? (TO)

TT=1800.01

?

TT=1799.98

No dataNo data?

TT=1799.96

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-mzzv42z.opb
OPT
f=-10270
TT=26.399
T1=18.18
SAT
f=-9476
TT=1798.1
T1=1655.87
No dataOPT
f=-10270
TT=26.399
T1=18.18
? (TO)

TT=1800.06

OPT
f=-10270
TT=239.96
T1=196.64
? (TO)

TT=1800.02

? (problem)

TT=3.18

? (TO)

TT=1800.07

? (problem)

TT=3.17

? (TO)

TT=1800.09

? (problem)

TT=3

SAT (TO)
f=-9340
TT=1800.04
T1=1787.38
SAT (TO)
f=-9830
TT=1800.07
T1=1765.47
? (TO)

TT=1800.05

SAT
f=-9215
TT=1783.01
T1=1783.29
OPT
f=-10270
TT=305.47
T1=301.68
SAT
f=-9476
TT=1798.03
T1=1761.97
OPT
f=-10270
TT=208.901
T1=195.24
OPT
f=-10270
TT=1079.33
T1=1079.37
No dataOPT
f=-10270
TT=39.987
T1=27.16
OPT
f=-10270
TT=355.549
T1=199.36
SAT
f=-10130
TT=1789.86
T1=1754.17
No dataOPT
f=-10270
TT=137.695
T1=65
OPT
f=-10270
TT=265.669
T1=265.57
SAT (TO)
f=-9610
TT=1800.02
T1=1800.4
OPT
f=-10270
TT=1381.59
T1=1211.6
? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=-9410
TT=1800.18
T1=900.41
No dataNo dataSAT (TO)
f=-9467
TT=1800.08
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-10255
TT=1800.03
T1=110.01
OPT
f=-10270
TT=104.88
T1=83.87
SAT (TO)
f=-9570
TT=1800.03
T1=1754.73
SAT
f=-10250
TT=1796.88
T1=1675.37
SAT
f=-10250
TT=1796.85
T1=1658.92
SAT
f=-10250
TT=1796.85
T1=1651.25
? (TO)

TT=1800.09

? (TO)

TT=1800.02

?

TT=1799.53

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-net12.opb
OPT
f=214
TT=6.829
T1=2.28
OPT
f=214
TT=7.467
T1=2.28
No dataOPT
f=214
TT=6.829
T1=3.46
? (problem)

TT=789.363

? (TO)

TT=1800.04

? (problem)

TT=774.191

? (TO)

TT=1800

? (problem)

TT=775.063

? (TO)

TT=1800.04

? (problem)

TT=760.826

? (TO)

TT=1800.03

OPT
f=214
TT=7.061
T1=2.3
? (TO)

TT=1800.04

SAT (TO)
f=214
TT=1802.09
T1=1788.15
OPT
f=214
TT=22.573
T1=16.79
OPT
f=214
TT=15.512
T1=11.65
OPT
f=214
TT=9.357
T1=2.08
OPT
f=214
TT=17.56
T1=12.79
?

TT=1797.39

No data? (TO)

TT=1800.2

OPT
f=214
TT=17.682
T1=4.23
?

TT=1790.03

No dataOPT
f=214
TT=10.473
T1=5
?

TT=1797.09

? (TO)

TT=1800.11

? (problem)

TT=633.335

? (problem)

TT=636.477

No dataNo dataNo dataOPT
f=214
TT=7.626
T1=4.1
No dataNo dataOPT
f=214
TT=10.484
T1=5.53
No dataNo dataNo dataOPT
f=214
TT=25.26
T1=11.84
OPT
f=214
TT=9.622
T1=5.47
OPT
f=214
TT=9.984
T1=6.27
?

TT=1797.09

?

TT=1797.13

?

TT=1797.29

OPT
f=214
TT=46.409
T1=29.16
OPT
f=214
TT=42.362
T1=26.93
?

TT=1799.53

No dataNo data?

TT=1799.52

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-p2756.opb
OPT
f=3124
TT=1.663
T1=1.2
SAT
f=3694
TT=1798.09
T1=438
No dataSAT (TO)
f=3731
TT=1800.02
T1=1792.29
? (TO)

TT=1800.01

? (problem)

TT=512.51

? (TO)

TT=1800.01

? (problem)

TT=566.84

? (TO)

TT=1800.04

? (problem)

TT=434.48

? (TO)

TT=1800.08

? (problem)

TT=6.92

SAT (TO)
f=5407
TT=1800.1
T1=310.41
SAT (TO)
f=64559
TT=1800.02
T1=295.02
SAT (TO)
f=4138
TT=1802.06
T1=1640.5
SAT
f=17727
TT=1783.01
T1=1.71
SAT (TO)
f=3842
TT=1800.46
T1=176.69
SAT
f=3925
TT=1798.04
T1=1245.8
SAT (TO)
f=4102
TT=1800.85
T1=577.62
OPT
f=3124
TT=2
T1=1.98
No dataOPT
f=3124
TT=1.663
T1=1.2
SAT (TO)
f=3853
TT=1800.82
T1=804.69
OPT
f=3124
TT=2.24
T1=2.22
No dataSAT (TO)
f=3703
TT=1800.21
T1=876
OPT
f=3124
TT=1.881
T1=1.86
SAT (TO)
f=78115
TT=1800.08
T1=1800.61
? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=3635
TT=1800.16
T1=900.31
No dataNo dataSAT (TO)
f=3618
TT=1800.13
T1=900.31
No dataNo dataNo dataSAT (TO)
f=3831
TT=1800.44
T1=1061.88
SAT (TO)
f=3968
TT=1800.09
T1=1729.01
SAT (TO)
f=5745
TT=1800.05
T1=1707.22
OPT
f=3124
TT=2.158
T1=2.14
OPT
f=3124
TT=2.393
T1=2.37
OPT
f=3124
TT=2.321
T1=2.3
? (TO)

TT=1800.02

? (TO)

TT=1800.03

?

TT=1799.59

No dataNo data?

TT=1799.52

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-protfold.opb
SAT
f=-28
TT=1800.03
T1=1760.37
SAT
f=-23
TT=1798.02
T1=1206.14
No dataSAT (TO)
f=-28
TT=1800.03
T1=1760.37
? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.06

SAT (TO)
f=-23
TT=1800.1
T1=517.06
SAT (TO)
f=-24
TT=1800.11
T1=126.97
? (TO)

TT=1800.03

SAT
f=-21
TT=1783.01
T1=1783.29
SAT (TO)
f=-24
TT=1800.02
T1=1148.5
SAT
f=-22
TT=1798.07
T1=1.76
SAT (TO)
f=-25
TT=1801.08
T1=745.31
?

TT=1797.09

No data? (TO)

TT=1800.22

SAT (TO)
f=-25
TT=1800.66
T1=350.2
SAT
f=-19
TT=1789.75
T1=1783.9
No dataSAT (TO)
f=-25
TT=1800.19
T1=744.55
?

TT=1796.81

SAT (TO)
f=-24
TT=1800.08
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=-25
TT=1800.54
T1=900.41
No dataNo dataSAT (TO)
f=-24
TT=1800.09
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-24
TT=1801.73
T1=916.83
SAT (TO)
f=-24
TT=1800.01
T1=465.6
SAT (TO)
f=-26
TT=1800.62
T1=1130.36
SAT
f=-18
TT=1796.74
T1=155.06
SAT
f=-18
TT=1796.76
T1=155.21
?

TT=1796.76

? (TO)

TT=1800.11

? (TO)

TT=1800.07

?

TT=1799.54

No dataNo data?

TT=1799.48

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib2003/
normalized-mps-v2-20-10-seymour.opb
SAT
f=425
TT=1789.74
T1=215.71
SAT
f=461
TT=1798.02
T1=28.78
No dataSAT (TO)
f=483
TT=1800.11
T1=564.15
? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.14

? (TO)

TT=1800.14

? (TO)

TT=1800.09

? (TO)

TT=1800.07

SAT (TO)
f=434
TT=1800.02
T1=1533.03
SAT (TO)
f=466
TT=1800.05
T1=0.17
SAT (TO)
f=481
TT=1802.07
T1=0.48
SAT
f=492
TT=1783.01
T1=64.73
? (exit code)

TT=703.53

SAT
f=461
TT=1798.06
T1=28.83
SAT (TO)
f=490
TT=1800
T1=0.39
SAT
f=425
TT=1797.99
T1=710.98
No data? (TO)

TT=1800.02

SAT (TO)
f=481
TT=1800.89
T1=820.34
SAT
f=425
TT=1789.74
T1=461
No dataSAT (TO)
f=481
TT=1800.18
T1=962.22
SAT
f=425
TT=1796.74
T1=1537.51
SAT (TO)
f=466
TT=1800.06
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=464
TT=1800.38
T1=900.31
No dataNo dataSAT (TO)
f=465
TT=1800.02
T1=900.31
No dataNo dataNo dataSAT (TO)
f=481
TT=1800.55
T1=317.79
SAT (TO)
f=490
TT=1800.06
T1=0.36
SAT (TO)
f=484
TT=1800.1
T1=0.37
SAT
f=425
TT=1796.76
T1=218.48
SAT
f=425
TT=1796.76
T1=215.71
SAT
f=426
TT=1796.75
T1=471.81
? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.49

No dataNo data?

TT=1799.47

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib3/
normalized-mps-v2-20-10-mitre.opb
OPT
f=7677
TT=5.933
T1=5.88
SAT
f=8863
TT=1798.03
T1=13.56
No dataSAT (TO)
f=8933
TT=1800.09
T1=1708.25
? (problem)

TT=103.642

? (TO)

TT=1800.13

? (problem)

TT=89.9

? (TO)

TT=1800.04

? (problem)

TT=90.27

? (TO)

TT=1800.08

? (problem)

TT=89.1

? (TO)

TT=1800.07

Signal

TT=1347.16

SAT (TO)
f=9253
TT=1800.08
T1=1186.1
? (TO)

TT=1694.13

SAT
f=8008
TT=1783.01
T1=1783.32
No Cert.

TT=831.797

SAT
f=8967
TT=1798.08
T1=13.47
? (exit code)

TT=451.056

OPT
f=7677
TT=13.681
T1=13.63
No dataOPT
f=7677
TT=10.558
T1=9.61
SAT (TO)
f=7680
TT=1800.11
T1=15.1
OPT
f=7677
TT=16.121
T1=16.07
No dataSAT (TO)
f=7709
TT=1800.2
T1=12.24
OPT
f=7677
TT=9.778
T1=9.7
SAT (TO)
f=9101
TT=1800.03
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=9280
TT=1800.8
T1=900.41
No dataNo dataSAT (TO)
f=9250
TT=1800.33
T1=900.41
No dataNo dataNo dataSAT (TO)
f=7767
TT=1800.11
T1=3.7
SAT (TO)
f=7743
TT=1800.08
T1=2.39
SAT (TO)
f=9648
TT=1800.74
T1=1712.6
OPT
f=7677
TT=24.458
T1=24.4
OPT
f=7677
TT=25.78
T1=25.72
OPT
f=7677
TT=5.933
T1=5.88
? (TO)

TT=1800.06

? (TO)

TT=1800.07

?

TT=1799.8

No dataNo data? (TO)

TT=1800.43

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-bm23.opb
OPT
f=34
TT=0.024
T1=0.02
OPT
f=34
TT=0.298
T1=0.21
No dataOPT
f=34
TT=0.024
T1=0.02
OPT
f=34
TT=4.741
T1=3.7
OPT
f=34
TT=0.822
T1=0.82
OPT
f=34
TT=3.391
T1=3.21
OPT
f=34
TT=0.753
T1=0.59
OPT
f=34
TT=1.683
T1=1.36
OPT
f=34
TT=0.719
T1=0.68
OPT
f=34
TT=1.802
T1=1.47
OPT
f=34
TT=0.821
T1=0.78
OPT
f=34
TT=0.624
T1=0.62
OPT
f=34
TT=3.115
T1=2.65
OPT
f=34
TT=0.091
T1=0.05
OPT
f=34
TT=0.047
T1=0.03
OPT
f=34
TT=0.644
T1=0.38
OPT
f=34
TT=0.219
T1=0.13
OPT
f=34
TT=0.834
T1=0.32
OPT
f=34
TT=0.145
T1=0.09
No dataOPT
f=34
TT=0.026
T1=0.03
OPT
f=34
TT=1.593
T1=3.13
OPT
f=34
TT=0.226
T1=0.16
No dataOPT
f=34
TT=1.284
T1=1.65
OPT
f=34
TT=0.164
T1=0.11
OPT
f=34
TT=2.746
T1=2.74
OPT
f=34
TT=1.739
T1=2.36
OPT
f=34
TT=1.302
T1=0.79
No dataNo dataNo dataOPT
f=34
TT=0.842
T1=0.42
No dataNo dataOPT
f=34
TT=0.511
T1=0.25
No dataNo dataNo dataOPT
f=34
TT=1.643
T1=2.15
OPT
f=34
TT=0.666
T1=0.28
OPT
f=34
TT=0.844
T1=0.45
OPT
f=34
TT=0.185
T1=0.13
OPT
f=34
TT=0.213
T1=0.16
OPT
f=34
TT=0.147
T1=0.1
OPT
f=34
TT=0.699
T1=0.42
OPT
f=34
TT=0.72
T1=0.44
?

TT=1799.58

No dataNo data?

TT=1799.76

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-cracpb1.opb
OPT
f=22199
TT=0.203
T1=0.25
SAT
f=56943
TT=1798
T1=372.86
No dataSAT (TO)
f=26372
TT=1800.03
T1=717.04
? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.06

OPT
f=22199
TT=0.52
T1=0.5
SAT (TO)
f=57945
TT=1800.05
T1=1186
SAT (TO)
f=43373
TT=1800.09
T1=896.1
SAT
f=118356
TT=1783
T1=1069.42
SAT (TO)
f=50958
TT=1800.59
T1=4.54
SAT
f=47122
TT=1798.01
T1=870.62
? (exit code)

TT=934.72

OPT
f=22199
TT=0.172
T1=0.16
No dataOPT
f=22199
TT=0.203
T1=0.84
SAT (TO)
f=45222
TT=1800.52
T1=395.49
OPT
f=22199
TT=0.264
T1=0.25
No dataSAT (TO)
f=40666
TT=1800.88
T1=94.01
OPT
f=22199
TT=0.347
T1=0.34
SAT (TO)
f=44375
TT=1800.02
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=82343
TT=1800.09
T1=900.31
No dataNo dataSAT (TO)
f=103143
TT=1800.12
T1=900.31
No dataNo dataNo dataSAT (TO)
f=40027
TT=1800.9
T1=11.91
SAT (TO)
f=69260
TT=1800.95
T1=13.62
SAT (TO)
f=35997
TT=1800.04
T1=780.66
OPT
f=22199
TT=0.597
T1=0.58
OPT
f=22199
TT=0.706
T1=0.69
OPT
f=22199
TT=0.342
T1=0.33
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.85

No dataNo data?

TT=1799.84

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-diamond.opb
UNSAT

TT=0

UNSAT

TT=0.001

No dataUNSAT

TT=0.003

UNSAT

TT=0.019

UNSAT

TT=0.03

UNSAT

TT=0.01

UNSAT

TT=0.018

UNSAT

TT=0.008

UNSAT

TT=0.017

UNSAT

TT=0.01

UNSAT

TT=0.015

UNSAT

TT=0.001

UNSAT

TT=0

? (TO)

TT=1800.05

UNSAT

TT=0.001

UNSAT

TT=0.115

UNSAT

TT=0.001

UNSAT

TT=0.123

UNSAT

TT=0.009

No dataUNSAT

TT=0.003

UNSAT

TT=0.155

UNSAT

TT=0.011

No dataUNSAT

TT=0.156

UNSAT

TT=0.013

UNSAT

TT=0.003

UNSAT

TT=0.005

UNSAT

TT=0.004

No dataNo dataNo dataUNSAT

TT=0.002

No dataNo dataUNSAT

TT=0.002

No dataNo dataNo dataUNSAT

TT=0.154

UNSAT

TT=0.145

UNSAT

TT=0.165

UNSAT

TT=0.009

UNSAT

TT=0.01

UNSAT

TT=0.01

UNSAT

TT=0.002

UNSAT

TT=0.002

UNSAT

TT=0.002

No dataNo dataUNSAT

TT=0.001

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-l152lav.opb
OPT
f=4722
TT=3.049
T1=1.93
SAT
f=4891
TT=1798.02
T1=1736.09
No data? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1802.1

? (TO)

TT=1800.02

? (exit code)

TT=743.98

SAT
f=4745
TT=1798
T1=1537.93
? (TO)

TT=1800.47

OPT
f=4722
TT=5.005
T1=4.71
No dataOPT
f=4722
TT=3.049
T1=1.93
? (TO)

TT=1801.32

OPT
f=4722
TT=7.266
T1=7.19
No data? (TO)

TT=1800.68

OPT
f=4722
TT=4.77
T1=4.28
? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.19

No dataNo data? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1800.02

? (TO)

TT=1800.34

OPT
f=4722
TT=6.051
T1=5.77
OPT
f=4722
TT=5.915
T1=5.65
OPT
f=4722
TT=3.365
T1=2.89
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.49

No dataNo data?

TT=1799.33

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-lp4l.opb
OPT
f=2967
TT=0.209
T1=0.18
SAT
f=3096
TT=1798.02
T1=363.34
No dataSAT (TO)
f=3788
TT=1800.11
T1=325.15
? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.06

OPT
f=2967
TT=3.071
T1=0.58
SAT (TO)
f=3659
TT=1800.11
T1=1156.8
SAT (TO)
f=3696
TT=1902.5
T1=366.35
SAT
f=4224
TT=1783.01
T1=1603.75
SAT
f=3964
TT=491.42
T1=84.19
SAT
f=3097
TT=1798.02
T1=294.2
SAT (TO)
f=4062
TT=1800.09
T1=272.44
OPT
f=2967
TT=0.236
T1=0.2
No dataOPT
f=2967
TT=0.316
T1=0.31
SAT (TO)
f=3647
TT=1800.63
T1=387.6
OPT
f=2967
TT=0.322
T1=0.28
No dataSAT (TO)
f=3979
TT=1800.17
T1=233.38
OPT
f=2967
TT=0.332
T1=0.3
SAT (TO)
f=3722
TT=1800.07
T1=1800.5
? (TO)

TT=1800.13

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=4000
TT=1800.05
T1=900.61
No dataNo dataSAT (TO)
f=4017
TT=1800.1
T1=900.31
No dataNo dataNo dataSAT (TO)
f=3859
TT=1800.53
T1=806.65
SAT (TO)
f=4018
TT=1800.05
T1=0.4
SAT (TO)
f=3700
TT=1800.05
T1=1170.43
OPT
f=2967
TT=0.625
T1=0.59
OPT
f=2967
TT=0.629
T1=0.59
OPT
f=2967
TT=0.209
T1=0.18
? (TO)

TT=1800.02

? (TO)

TT=1800.03

?

TT=1799.57

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-lseu.opb
OPT
f=1120
TT=0.171
T1=0.08
OPT
f=1120
TT=217.281
T1=189.96
No dataOPT
f=1120
TT=7.404
T1=5.8
OPT
f=1120
TT=636.511
T1=398.94
OPT
f=1120
TT=593.847
T1=420.56
OPT
f=1120
TT=473.639
T1=311.13
OPT
f=1120
TT=358.642
T1=347.35
OPT
f=1120
TT=465.22
T1=328.98
OPT
f=1120
TT=739.306
T1=724.74
? (TO)

TT=1800.29

? (TO)

TT=1800.39

OPT
f=1120
TT=18.455
T1=5.51
OPT
f=1120
TT=63.342
T1=54.79
OPT
f=1120
TT=133.456
T1=71.64
OPT
f=1120
TT=270.587
T1=229.31
OPT
f=1120
TT=130.77
T1=36.64
OPT
f=1120
TT=214.632
T1=163.23
OPT
f=1120
TT=289.67
T1=120.56
OPT
f=1120
TT=0.264
T1=0.23
No dataOPT
f=1120
TT=0.171
T1=0.08
OPT
f=1120
TT=408.702
T1=16.13
OPT
f=1120
TT=0.396
T1=0.32
No dataOPT
f=1120
TT=522.317
T1=58.57
OPT
f=1120
TT=0.307
T1=0.25
OPT
f=1120
TT=50.195
T1=50.2
OPT
f=1120
TT=807.457
T1=157.47
OPT
f=1120
TT=181.61
T1=64.16
No dataNo dataNo dataOPT
f=1120
TT=203.34
T1=101.71
No dataNo dataOPT
f=1120
TT=141.133
T1=70.57
No dataNo dataNo dataOPT
f=1120
TT=41.719
T1=13.17
OPT
f=1120
TT=17.502
T1=4.57
OPT
f=1120
TT=28.97
T1=16.09
OPT
f=1120
TT=0.391
T1=0.3
OPT
f=1120
TT=0.399
T1=0.3
OPT
f=1120
TT=0.37
T1=0.26
OPT
f=1120
TT=187.278
T1=171.37
OPT
f=1120
TT=184.038
T1=168.39
?

TT=1799.66

No dataNo data?

TT=1799.97

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod008.opb
OPT
f=307
TT=0.306
T1=0.03
OPT
f=307
TT=1378.3
T1=1214.56
No dataSAT (TO)
f=307
TT=1800.03
T1=4.35
? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.31

? (TO)

TT=1800.4

OPT
f=307
TT=9.424
T1=0.01
SAT (TO)
f=333
TT=1800.04
T1=1471.64
SAT (TO)
f=310
TT=1800.14
T1=248.43
SAT
f=602
TT=1783.01
T1=0.02
SAT (TO)
f=313
TT=1800.04
T1=1186.59
OPT
f=307
TT=410.366
T1=191.17
SAT (TO)
f=307
TT=1800.57
T1=359.14
OPT
f=307
TT=0.415
T1=0.25
No dataOPT
f=307
TT=0.306
T1=0.18
OPT
f=307
TT=370.47
T1=8.19
OPT
f=307
TT=0.843
T1=0.06
No dataOPT
f=307
TT=836.866
T1=14.73
OPT
f=307
TT=0.736
T1=0.05
SAT (TO)
f=356
TT=1800.01
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=313
TT=1800.03
T1=900.21
No dataNo dataSAT (TO)
f=309
TT=1800.04
T1=900.21
No dataNo dataNo dataOPT
f=307
TT=1293.12
T1=2.76
SAT (TO)
f=307
TT=1800.88
T1=1281.21
SAT (TO)
f=327
TT=1800.04
T1=1728.58
OPT
f=307
TT=0.712
T1=0.14
OPT
f=307
TT=0.893
T1=0.33
OPT
f=307
TT=0.59
T1=0.03
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1800

No dataNo data?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-mod010.opb
OPT
f=6548
TT=0.592
T1=0.48
SAT (TO)
f=6576
TT=1800.12
T1=1780.61
No data? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1802.07

? (TO)

TT=1800.02

? (exit code)

TT=746.34

?

TT=1798.02

? (TO)

TT=1800.86

OPT
f=6548
TT=1.469
T1=1.38
No dataOPT
f=6548
TT=1.621
T1=1.61
SAT (TO)
f=7901
TT=1800.62
T1=757.07
OPT
f=6548
TT=1.602
T1=1.59
No dataSAT (TO)
f=7901
TT=1800.05
T1=795.67
OPT
f=6548
TT=1.162
T1=1.14
? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.42

No dataNo data? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=7984
TT=1800.08
T1=897.88
? (TO)

TT=1800.07

? (TO)

TT=1800.08

OPT
f=6548
TT=2.455
T1=2.44
OPT
f=6548
TT=2.681
T1=2.66
OPT
f=6548
TT=0.592
T1=0.48
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.77

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0040.opb
OPT
f=62027
TT=0.002
T1=0
OPT
f=62027
TT=0.026
T1=0.02
No dataOPT
f=62027
TT=9.862
T1=0
OPT
f=62027
TT=1.904
T1=1.58
OPT
f=62027
TT=1.067
T1=1.07
OPT
f=62027
TT=1.786
T1=1.67
OPT
f=62027
TT=0.996
T1=1
OPT
f=62027
TT=1.243
T1=1.13
OPT
f=62027
TT=0.672
T1=0.56
OPT
f=62027
TT=1.281
T1=1.16
OPT
f=62027
TT=0.688
T1=0.57
OPT
f=62027
TT=0.033
T1=0.03
OPT
f=62027
TT=35.513
T1=33.9
OPT
f=62027
TT=6.037
T1=2.65
OPT
f=62027
TT=4.848
T1=4.81
OPT
f=62027
TT=16.681
T1=0.14
OPT
f=62027
TT=0.025
T1=0.02
OPT
f=62027
TT=20.84
T1=0.15
OPT
f=62027
TT=0.017
T1=0.01
No dataOPT
f=62027
TT=0.005
T1=0
OPT
f=62027
TT=0.795
T1=3.13
OPT
f=62027
TT=0.039
T1=0.03
No dataOPT
f=62027
TT=0.875
T1=1.66
OPT
f=62027
TT=0.035
T1=0.03
OPT
f=62027
TT=5.194
T1=5.19
OPT
f=62027
TT=1.814
T1=1.52
OPT
f=62027
TT=1.301
T1=1.17
No dataNo dataNo dataOPT
f=62027
TT=0.002
T1=0
No dataNo dataOPT
f=62027
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=62027
TT=0.843
T1=1.63
OPT
f=62027
TT=7.076
T1=0.15
OPT
f=62027
TT=9.113
T1=4.86
OPT
f=62027
TT=0.06
T1=0.05
OPT
f=62027
TT=0.089
T1=0.08
OPT
f=62027
TT=0.02
T1=0.01
OPT
f=62027
TT=19.36
T1=0
OPT
f=62027
TT=19.984
T1=0
OPT
f=62027
TT=0.002
T1=0
No dataNo dataOPT
f=62027
TT=0.002
T1=0
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-p0201.opb
OPT
f=1523
TT=0.201
T1=0.13
OPT
f=1523
TT=18.19
T1=16.36
No dataSAT (TO)
f=1523
TT=1800.03
T1=71.15
? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.11

OPT
f=1523
TT=4.096
T1=1.41
OPT
f=1523
TT=1564.12
T1=1250.46
OPT
f=1523
TT=1470.08
T1=259.36
SAT
f=1561
TT=1783.01
T1=1648.32
SAT (TO)
f=1523
TT=1800.06
T1=122.65
OPT
f=1523
TT=20.457
T1=18.05
SAT (TO)
f=1523
TT=1800.78
T1=270.42
OPT
f=1523
TT=1.683
T1=0.84
No dataOPT
f=1523
TT=0.201
T1=0.13
SAT (TO)
f=1523
TT=1801.15
T1=6.2
OPT
f=1523
TT=1.578
T1=1.24
No dataSAT (TO)
f=1523
TT=1800.03
T1=2.22
OPT
f=1523
TT=1.428
T1=0.84
OPT
f=1523
TT=764.23
T1=764.37
? (TO)

TT=1800.1

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=1523
TT=1800.53
T1=900.31
No dataNo dataSAT (TO)
f=1533
TT=1800.07
T1=900.21
No dataNo dataNo dataOPT
f=1523
TT=1424.17
T1=56.93
OPT
f=1523
TT=593.28
T1=109.22
SAT (TO)
f=1523
TT=1800.55
T1=266.72
OPT
f=1523
TT=0.987
T1=0.82
OPT
f=1523
TT=1.128
T1=0.94
OPT
f=1523
TT=1.712
T1=1.33
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.6

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-sentoy.opb
OPT
f=-7772
TT=0.048
T1=0.02
OPT
f=-7772
TT=36.978
T1=36.96
No dataOPT
f=-7772
TT=0.672
T1=0.48
? (problem)

TT=33.002

? (TO)

TT=1800.12

? (problem)

TT=28.48

? (TO)

TT=1800.08

? (problem)

TT=28.59

? (TO)

TT=1800.09

? (problem)

TT=29.22

? (TO)

TT=1800.1

OPT
f=-7772
TT=1.023
T1=0.68
SAT (TO)
f=-6609
TT=1800.1
T1=1741.63
? (TO)

TT=1800.12

SAT
f=-3883
TT=1783.01
T1=1783.28
OPT
f=-7772
TT=6.331
T1=3.38
OPT
f=-7772
TT=28.246
T1=28.22
OPT
f=-7772
TT=6.274
T1=3.47
OPT
f=-7772
TT=0.35
T1=0.34
No dataOPT
f=-7772
TT=0.048
T1=0.05
OPT
f=-7772
TT=2.914
T1=4.18
OPT
f=-7772
TT=0.48
T1=0.17
No dataOPT
f=-7772
TT=3.167
T1=2.22
OPT
f=-7772
TT=0.324
T1=0.04
SAT (TO)
f=-6193
TT=1800.09
T1=1800.4
? (TO)

TT=1800.03

? (TO)

TT=1800.07

No dataNo dataNo dataOPT
f=-7772
TT=7.642
T1=3.81
No dataNo dataOPT
f=-7772
TT=6.762
T1=3.38
No dataNo dataNo dataOPT
f=-7772
TT=3.066
T1=2.7
OPT
f=-7772
TT=2.195
T1=0.55
OPT
f=-7772
TT=4.704
T1=2.88
OPT
f=-7772
TT=0.427
T1=0.42
OPT
f=-7772
TT=0.44
T1=0.43
OPT
f=-7772
TT=0.316
T1=0.02
OPT
f=-7772
TT=38.902
T1=12.59
OPT
f=-7772
TT=38.16
T1=12.36
?

TT=1799.56

No dataNo data?

TT=1799.97

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-stein15.opb
OPT
f=9
TT=0.001
T1=0
OPT
f=9
TT=0.021
T1=0
No dataOPT
f=9
TT=0.003
T1=0
OPT
f=9
TT=0.057
T1=0.02
OPT
f=9
TT=0.068
T1=0.03
OPT
f=9
TT=0.022
T1=0.01
OPT
f=9
TT=0.03
T1=0.02
OPT
f=9
TT=0.015
T1=0.01
OPT
f=9
TT=0.026
T1=0.02
OPT
f=9
TT=0.019
T1=0.01
OPT
f=9
TT=0.024
T1=0.02
OPT
f=9
TT=0.023
T1=0
OPT
f=9
TT=0.005
T1=0
OPT
f=9
TT=0.029
T1=0.01
OPT
f=9
TT=0.005
T1=0
OPT
f=9
TT=0.223
T1=0.12
OPT
f=9
TT=0.021
T1=0
OPT
f=9
TT=0.263
T1=0.11
OPT
f=9
TT=0.056
T1=0.01
No dataOPT
f=9
TT=0.018
T1=0.02
OPT
f=9
TT=0.483
T1=1.11
OPT
f=9
TT=0.085
T1=0.03
No dataOPT
f=9
TT=0.445
T1=0.64
OPT
f=9
TT=0.067
T1=0.02
OPT
f=9
TT=0.003
T1=0
OPT
f=9
TT=0.022
T1=0
OPT
f=9
TT=0.016
T1=0
No dataNo dataNo dataOPT
f=9
TT=0.002
T1=0
No dataNo dataOPT
f=9
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=9
TT=0.415
T1=0.63
OPT
f=9
TT=0.234
T1=0.12
OPT
f=9
TT=0.234
T1=0.12
OPT
f=9
TT=0.1
T1=0.03
OPT
f=9
TT=0.132
T1=0.05
OPT
f=9
TT=0.079
T1=0.01
OPT
f=9
TT=0.012
T1=0
OPT
f=9
TT=0.012
T1=0
OPT
f=9
TT=0.442
T1=0.43
No dataNo dataOPT
f=9
TT=0.442
T1=0.43
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-stein27.opb
OPT
f=18
TT=0.151
T1=0
OPT
f=18
TT=2.015
T1=0
No dataOPT
f=18
TT=0.186
T1=0
OPT
f=18
TT=0.216
T1=0.21
OPT
f=18
TT=0.228
T1=0.22
OPT
f=18
TT=0.175
T1=0.17
OPT
f=18
TT=0.182
T1=0.18
OPT
f=18
TT=0.152
T1=0.01
OPT
f=18
TT=0.171
T1=0.02
OPT
f=18
TT=0.158
T1=0.01
OPT
f=18
TT=0.162
T1=0.02
OPT
f=18
TT=1.724
T1=0
OPT
f=18
TT=0.22
T1=0
OPT
f=18
TT=0.199
T1=0.03
OPT
f=18
TT=0.48
T1=0
OPT
f=18
TT=2.044
T1=0.14
OPT
f=18
TT=2.004
T1=0
OPT
f=18
TT=2.154
T1=0.12
OPT
f=18
TT=0.918
T1=0.09
No dataOPT
f=18
TT=0.358
T1=0.2
OPT
f=18
TT=5.112
T1=1.12
OPT
f=18
TT=1.556
T1=0.04
No dataOPT
f=18
TT=5.134
T1=0.65
OPT
f=18
TT=0.966
T1=0.07
OPT
f=18
TT=0.151
T1=0.15
OPT
f=18
TT=0.17
T1=0.17
OPT
f=18
TT=0.157
T1=0.01
No dataNo dataNo dataOPT
f=18
TT=0.942
T1=0.46
No dataNo dataOPT
f=18
TT=0.941
T1=0.46
No dataNo dataNo dataOPT
f=18
TT=4.453
T1=0.63
OPT
f=18
TT=2.124
T1=0.13
OPT
f=18
TT=2.393
T1=0.13
OPT
f=18
TT=1.593
T1=0.21
OPT
f=18
TT=1.359
T1=0.18
OPT
f=18
TT=1.174
T1=0.18
OPT
f=18
TT=0.954
T1=0
OPT
f=18
TT=0.964
T1=0
?

TT=1799.52

No dataNo data?

TT=1799.83

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-stein45.opb
OPT
f=30
TT=8.3
T1=0.01
OPT
f=30
TT=159.573
T1=2.05
No dataOPT
f=30
TT=52.783
T1=0.05
OPT
f=30
TT=11.808
T1=3.21
OPT
f=30
TT=9.452
T1=9.45
OPT
f=30
TT=11.679
T1=3.16
OPT
f=30
TT=9.416
T1=9.42
OPT
f=30
TT=8.561
T1=0.05
OPT
f=30
TT=9.138
T1=0.2
OPT
f=30
TT=9.042
T1=0.06
OPT
f=30
TT=8.788
T1=0.06
OPT
f=30
TT=78.921
T1=0.5
OPT
f=30
TT=11.386
T1=0.21
OPT
f=30
TT=36.657
T1=0.06
OPT
f=30
TT=54.656
T1=0.01
SAT (TO)
f=30
TT=1800.03
T1=0.22
OPT
f=30
TT=159.515
T1=2.05
SAT (TO)
f=30
TT=1800.62
T1=0.28
OPT
f=30
TT=19.744
T1=1.69
No dataOPT
f=30
TT=12.532
T1=4.45
OPT
f=30
TT=171.628
T1=4.16
OPT
f=30
TT=20.375
T1=3.67
No dataOPT
f=30
TT=189.068
T1=2.18
OPT
f=30
TT=16.424
T1=1.01
OPT
f=30
TT=8.3
T1=8.29
OPT
f=30
TT=11.327
T1=2.61
OPT
f=30
TT=8.659
T1=0.08
No dataNo dataNo dataOPT
f=30
TT=203.024
T1=101.54
No dataNo dataOPT
f=30
TT=195.202
T1=97.61
No dataNo dataNo dataOPT
f=30
TT=868.463
T1=7.67
OPT
f=30
TT=499.72
T1=2.11
OPT
f=30
TT=313.176
T1=0.27
OPT
f=30
TT=16.816
T1=1.27
OPT
f=30
TT=15.585
T1=1.2
OPT
f=30
TT=18.746
T1=2.49
OPT
f=30
TT=252.75
T1=5.35
OPT
f=30
TT=254.156
T1=5.38
?

TT=1799.42

No dataNo data?

TT=1799.76

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/MIPLIB/miplib/
normalized-mps-v2-20-10-stein9.opb
OPT
f=5
TT=0.001
T1=0
OPT
f=5
TT=0.004
T1=0
No dataOPT
f=5
TT=0.002
T1=0
OPT
f=5
TT=0.041
T1=0.02
OPT
f=5
TT=0.052
T1=0.03
OPT
f=5
TT=0.018
T1=0.01
OPT
f=5
TT=0.027
T1=0.02
OPT
f=5
TT=0.013
T1=0.01
OPT
f=5
TT=0.021
T1=0.02
OPT
f=5
TT=0.013
T1=0.01
OPT
f=5
TT=0.02
T1=0.01
OPT
f=5
TT=0.003
T1=0
OPT
f=5
TT=0.002
T1=0
OPT
f=5
TT=0.027
T1=0.01
OPT
f=5
TT=0.002
T1=0
OPT
f=5
TT=0.144
T1=0.12
OPT
f=5
TT=0.004
T1=0
OPT
f=5
TT=0.142
T1=0.1
OPT
f=5
TT=0.019
T1=0
No dataOPT
f=5
TT=0.009
T1=0.01
OPT
f=5
TT=0.153
T1=1.11
OPT
f=5
TT=0.036
T1=0.01
No dataOPT
f=5
TT=0.165
T1=0.63
OPT
f=5
TT=0.046
T1=0.01
OPT
f=5
TT=0.005
T1=0
OPT
f=5
TT=0.015
T1=0
OPT
f=5
TT=0.011
T1=0
No dataNo dataNo dataOPT
f=5
TT=0.002
T1=0
No dataNo dataOPT
f=5
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=5
TT=0.163
T1=0.62
OPT
f=5
TT=0.155
T1=0.11
OPT
f=5
TT=0.175
T1=0.12
OPT
f=5
TT=0.028
T1=0.02
OPT
f=5
TT=0.036
T1=0.02
OPT
f=5
TT=0.018
T1=0
OPT
f=5
TT=0.002
T1=0
OPT
f=5
TT=0.003
T1=0
OPT
f=5
TT=0.001
T1=0
No dataNo dataOPT
f=5
TT=0.001
T1=0
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos10.opb
OPT
f=-1135
TT=2.06
T1=1.13
OPT
f=-1135
TT=8.119
T1=8.06
No dataOPT
f=-1135
TT=2.774
T1=2.13
OPT
f=-1135
TT=202.222
T1=131.41
OPT
f=-1135
TT=767.297
T1=767.84
? (problem)

TT=12.3

? (problem)

TT=29.34

? (problem)

TT=10.75

? (problem)

TT=29.08

? (problem)

TT=10.69

? (problem)

TT=29.18

OPT
f=-1135
TT=9.1
T1=9.08
OPT
f=-1135
TT=113.078
T1=107.63
? (TO)

TT=1800.06

OPT
f=-1135
TT=11.288
T1=11.28
OPT
f=-1135
TT=5.543
T1=3.73
OPT
f=-1135
TT=9.014
T1=8.95
OPT
f=-1135
TT=6.703
T1=4.56
OPT
f=-1135
TT=49.68
T1=49.57
No dataOPT
f=-1135
TT=18.829
T1=18.15
OPT
f=-1135
TT=15.782
T1=29.12
OPT
f=-1135
TT=25.392
T1=25.16
No dataOPT
f=-1135
TT=11.166
T1=13.09
OPT
f=-1135
TT=29.866
T1=29.7
OPT
f=-1135
TT=50.389
T1=50.4
OPT
f=-1135
TT=185.555
T1=160.21
OPT
f=-1135
TT=558.285
T1=549.11
No dataNo dataNo dataOPT
f=-1135
TT=2.486
T1=1.35
No dataNo dataOPT
f=-1135
TT=2.06
T1=1.13
No dataNo dataNo dataOPT
f=-1135
TT=35.758
T1=39.25
OPT
f=-1135
TT=3.382
T1=1.9
OPT
f=-1135
TT=4.776
T1=3.35
OPT
f=-1135
TT=27.27
T1=27.1
OPT
f=-1135
TT=27.038
T1=26.86
OPT
f=-1135
TT=32.307
T1=32.17
OPT
f=-1135
TT=22.486
T1=17.13
OPT
f=-1135
TT=21.698
T1=16.45
?

TT=1799.55

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos16.opb
OPT
f=114
TT=1076.07
T1=5.32
SAT
f=118
TT=1798
T1=8.12
No dataSAT (TO)
f=114
TT=1800.03
T1=5.32
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.12

SAT (TO)
f=119
TT=1800.11
T1=466.31
SAT (TO)
f=115
TT=1800.02
T1=422.86
SAT (TO)
f=114
TT=1802.05
T1=151.22
OPT
f=114
TT=1076.07
T1=112.2
SAT (TO)
f=114
TT=1800.59
T1=217.79
Wrong Opt.
f=121
TT=81.402
T1=10.29
SAT (TO)
f=114
TT=1800.07
T1=41.72
SAT (TO)
f=115
TT=1800.23
T1=840.42
No data? (TO)

TT=1800.32

SAT (TO)
f=115
TT=1800.81
T1=861.84
?

TT=1789.8

No dataSAT (TO)
f=116
TT=1800.15
T1=315.63
?

TT=1797.23

SAT (TO)
f=114
TT=1800.11
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=116
TT=1800.5
T1=900.31
No dataNo dataSAT (TO)
f=116
TT=1800.15
T1=900.41
No dataNo dataNo dataSAT (TO)
f=114
TT=1800.71
T1=627.15
SAT (TO)
f=114
TT=1800.58
T1=70.03
SAT (TO)
f=114
TT=1800.01
T1=7.98
SAT
f=114
TT=1797.17
T1=1676.29
SAT
f=115
TT=1796.97
T1=1493.61
SAT
f=114
TT=1797.01
T1=1442.01
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.6

No dataNo data?

TT=1800

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/
milp/normalized-mps-v2-20-10-neos19.opb
SAT
f=-3
TT=1783.2
T1=189.69
SAT
f=-3
TT=1798.17
T1=189.69
No data? (TO)

TT=1800.07

? (MO)

TT=535.72

? (problem)

TT=164.986

? (MO)

TT=533.72

? (problem)

TT=158.752

? (MO)

TT=536.81

? (problem)

TT=159.968

? (MO)

TT=547.01

? (problem)

TT=160.82

Signal

TT=141.798

Signal

TT=182.188

? (TO)

TT=1711.37

SAT
f=-3
TT=1783.2
T1=1783.39
? (TO)

TT=1800.09

SAT (TO)
f=-3
TT=1800.27
T1=189.23
? (TO)

TT=1800.03

? (TO)

TT=1802.15

No dataNo Cert.

TT=1800.1

? (TO)

TT=1801.08

SAT
f=0
TT=1794.03
T1=9.86
No data? (TO)

TT=1800.13

? (TO)

TT=1802.15

? (TO)

TT=1800.09

? (problem)

TT=504.252

? (problem)

TT=506.771

No dataNo dataNo dataSAT (TO)
f=-1
TT=1801.33
T1=903.61
No dataNo dataSAT (TO)
f=-1
TT=1800.48
T1=903.81
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=0
TT=1800.97
T1=9.22
SAT (TO)
f=0
TT=1801.86
T1=7.75
SAT (TO)
f=0
TT=1801.95
T1=9
SAT (TO)
f=0
TT=1802.01
T1=9.56
? (exit code)

TT=15.279

? (TO)

TT=1800.11

?

TT=1799.57

No dataNo data?

TT=1799.86

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos1.opb
OPT
f=19
TT=1.197
T1=0.67
SAT
f=23
TT=1798
T1=473.26
No dataSAT (TO)
f=28
TT=1800.03
T1=913.5
OPT
f=19
TT=143.066
T1=54.15
OPT
f=19
TT=26.744
T1=20.27
OPT
f=19
TT=140.497
T1=51.96
? (problem)

TT=0.771

OPT
f=19
TT=139.768
T1=105.6
? (problem)

TT=0.78

OPT
f=19
TT=135.032
T1=100.77
? (problem)

TT=0.83

SAT (TO)
f=26
TT=1800.08
T1=9.99
OPT
f=19
TT=10.591
T1=7.41
SAT (TO)
f=27
TT=1802.11
T1=5.96
SAT
f=24
TT=1783
T1=1771.46
SAT (TO)
f=24
TT=1800.08
T1=0.72
SAT
f=25
TT=1798
T1=730.86
SAT (TO)
f=24
TT=1800.25
T1=0.45
OPT
f=19
TT=4.794
T1=4.76
No dataOPT
f=19
TT=2.517
T1=1.04
SAT (TO)
f=21
TT=1801.39
T1=119.62
OPT
f=19
TT=1.197
T1=1.17
No dataSAT (TO)
f=21
TT=1800.1
T1=603.73
OPT
f=19
TT=2.789
T1=0.67
OPT
f=19
TT=6.096
T1=6.09
OPT
f=19
TT=147.451
T1=28.36
OPT
f=19
TT=191.491
T1=138.32
No dataNo dataNo dataOPT
f=19
TT=65.019
T1=32.52
No dataNo dataOPT
f=19
TT=534.33
T1=267.2
No dataNo dataNo dataSAT (TO)
f=21
TT=1800.41
T1=2.39
SAT (TO)
f=21
TT=1800.05
T1=1290.24
SAT (TO)
f=28
TT=1800.02
T1=1461.6
OPT
f=19
TT=6.229
T1=6.2
OPT
f=19
TT=5.854
T1=5.83
OPT
f=19
TT=5.344
T1=5.31
? (TO)

TT=1800.08

? (TO)

TT=1800.11

?

TT=1799.91

No dataNo data?

TT=1799.6

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos5.opb
SAT
f=15360
TT=1352.86
T1=10.65
SAT
f=17408
TT=1798.01
T1=0.17
No dataSAT (TO)
f=16634
TT=1800.03
T1=1771.91
? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.92

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.12

SAT (TO)
f=15681
TT=1800.01
T1=1098.66
SAT (TO)
f=15872
TT=1800.1
T1=63.66
SAT (TO)
f=16384
TT=1802.05
T1=102.49
SAT
f=17408
TT=1783.01
T1=246.19
SAT (TO)
f=17599
TT=1800.09
T1=782.65
SAT
f=17280
TT=1798
T1=1020.85
SAT (TO)
f=17393
TT=1800.09
T1=273.63
SAT (TO)
f=15360
TT=1800.79
T1=30.22
No dataSAT
f=15360
TT=1352.86
T1=481.15
SAT (TO)
f=16384
TT=1800.16
T1=840.95
SAT
f=15360
TT=1790.22
T1=79.73
No dataSAT (TO)
f=16384
TT=1800.72
T1=133.01
SAT
f=15360
TT=1797.89
T1=24.32
SAT (TO)
f=15396
TT=1800.07
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=16384
TT=1800.4
T1=900.21
No dataNo dataSAT (TO)
f=16384
TT=1800.39
T1=900.21
No dataNo dataNo dataSAT (TO)
f=16384
TT=1800.13
T1=436.53
SAT (TO)
f=18543
TT=1800.02
T1=1647.81
SAT (TO)
f=17396
TT=1800.51
T1=862.9
SAT
f=15360
TT=1797.56
T1=11.63
SAT
f=15360
TT=1797.62
T1=10.65
SAT
f=15360
TT=1797.79
T1=14.64
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.94

No dataNo data?

TT=1799.98

normalized-PB06/OPT-SMALLINT/
mps-v2-20-10/plato.asu.edu/pub/milp/
normalized-mps-v2-20-10-neos8.opb
OPT
f=-3719
TT=1.004
T1=0.9
OPT
f=-3719
TT=8.308
T1=8.29
No dataOPT
f=-3719
TT=1.004
T1=0.9
OPT
f=-3719
TT=127.848
T1=117.78
OPT
f=-3719
TT=1131.13
T1=1031.17
? (problem)

TT=14.29

? (problem)

TT=21.59

? (problem)

TT=12.46

? (problem)

TT=19.2

? (problem)

TT=13.01

? (problem)

TT=20.07

OPT
f=-3719
TT=8.386
T1=8.38
OPT
f=-3719
TT=139.854
T1=139.2
? (TO)

TT=1800.07

OPT
f=-3719
TT=3.373
T1=3.37
OPT
f=-3719
TT=4.724
T1=3.04
OPT
f=-3719
TT=8.689
T1=8.68
OPT
f=-3719
TT=4.613
T1=2.88
OPT
f=-3719
TT=43.014
T1=42.91
No dataOPT
f=-3719
TT=35.785
T1=35.18
OPT
f=-3719
TT=9.671
T1=10.25
OPT
f=-3719
TT=13.709
T1=13.6
No dataOPT
f=-3719
TT=6.314
T1=6.65
OPT
f=-3719
TT=13.47
T1=13.34
OPT
f=-3719
TT=29.494
T1=29.45
OPT
f=-3719
TT=160.53
T1=149.04
OPT
f=-3719
TT=610.527
T1=606.63
No dataNo dataNo dataOPT
f=-3719
TT=1.546
T1=0.91
No dataNo dataOPT
f=-3719
TT=1.569
T1=0.92
No dataNo dataNo dataOPT
f=-3719
TT=7.113
T1=10.15
OPT
f=-3719
TT=2.955
T1=1.7
OPT
f=-3719
TT=5.752
T1=4.36
OPT
f=-3719
TT=19.173
T1=19.04
OPT
f=-3719
TT=18.008
T1=17.88
OPT
f=-3719
TT=19.113
T1=18.99
OPT
f=-3719
TT=14.56
T1=12.5
OPT
f=-3719
TT=14.616
T1=12.6
?

TT=1799.73

No dataNo data?

TT=1799.44

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-5xp1.b.opb
OPT
f=12
TT=0.397
T1=0.4
OPT
f=12
TT=14.257
T1=12.68
No dataSAT (TO)
f=17
TT=1800.02
T1=377.31
OPT
f=12
TT=217.442
T1=172.07
OPT
f=12
TT=187.655
T1=160.85
OPT
f=12
TT=246.079
T1=225.92
OPT
f=12
TT=261.878
T1=252.3
OPT
f=12
TT=309.829
T1=290.41
OPT
f=12
TT=434.177
T1=413.33
OPT
f=12
TT=304.689
T1=286.05
OPT
f=12
TT=397.32
T1=378.17
OPT
f=12
TT=1.993
T1=1
OPT
f=12
TT=564.193
T1=493.57
SAT (TO)
f=13
TT=1802.08
T1=628.6
OPT
f=12
TT=80.404
T1=68.78
SAT (TO)
f=17
TT=1800.47
T1=0.43
OPT
f=12
TT=13.762
T1=12.18
SAT (TO)
f=17
TT=1800.86
T1=0.44
OPT
f=12
TT=14.186
T1=12.14
No dataOPT
f=12
TT=0.397
T1=0.4
SAT (TO)
f=12
TT=1801.39
T1=55.61
OPT
f=12
TT=11.905
T1=11.37
No dataSAT (TO)
f=12
TT=1801.06
T1=126.25
OPT
f=12
TT=10.874
T1=10.17
OPT
f=12
TT=338.185
T1=338.25
OPT
f=12
TT=155.218
T1=102.03
OPT
f=12
TT=189.751
T1=136.64
No dataNo dataNo dataOPT
f=12
TT=307.593
T1=153.84
No dataNo dataOPT
f=12
TT=297.85
T1=149.01
No dataNo dataNo dataOPT
f=12
TT=1064.07
T1=203.59
SAT (TO)
f=16
TT=1800.01
T1=1.52
SAT (TO)
f=19
TT=1800
T1=0.36
OPT
f=12
TT=4.913
T1=4.83
OPT
f=12
TT=4.826
T1=4.75
OPT
f=12
TT=4.187
T1=4.17
? (TO)

TT=1800.01

? (TO)

TT=1800.11

?

TT=1799.46

No dataNo data?

TT=1799.38

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-9sym.b.opb
OPT
f=5
TT=0.093
T1=0.09
OPT
f=5
TT=0.248
T1=0.23
No dataOPT
f=5
TT=6.772
T1=3.28
OPT
f=5
TT=1.868
T1=1.86
OPT
f=5
TT=0.306
T1=0.3
OPT
f=5
TT=0.925
T1=0.92
OPT
f=5
TT=0.179
T1=0.18
OPT
f=5
TT=1.466
T1=1.29
OPT
f=5
TT=0.184
T1=0.16
OPT
f=5
TT=1.478
T1=1.29
OPT
f=5
TT=0.181
T1=0.15
OPT
f=5
TT=0.456
T1=0.44
OPT
f=5
TT=0.39
T1=0.33
OPT
f=5
TT=49.233
T1=38.31
OPT
f=5
TT=9.012
T1=8.94
OPT
f=5
TT=4.262
T1=1.66
OPT
f=5
TT=0.247
T1=0.23
OPT
f=5
TT=4.713
T1=1.98
OPT
f=5
TT=6.35
T1=6.34
No dataOPT
f=5
TT=0.261
T1=0.26
OPT
f=5
TT=6.415
T1=4.32
OPT
f=5
TT=10.859
T1=10.85
No dataOPT
f=5
TT=5.332
T1=2.37
OPT
f=5
TT=0.89
T1=0.93
OPT
f=5
TT=0.093
T1=0.09
OPT
f=5
TT=1.389
T1=1.59
OPT
f=5
TT=1.655
T1=1.3
No dataNo dataNo dataOPT
f=5
TT=0.576
T1=0.28
No dataNo dataOPT
f=5
TT=0.597
T1=0.3
No dataNo dataNo dataOPT
f=5
TT=4.414
T1=2.36
OPT
f=5
TT=6.99
T1=3.86
OPT
f=5
TT=7.194
T1=4.08
OPT
f=5
TT=0.937
T1=0.92
OPT
f=5
TT=0.944
T1=0.92
OPT
f=5
TT=0.941
T1=0.92
OPT
f=5
TT=37.199
T1=28.41
OPT
f=5
TT=39.408
T1=30.21
OPT
f=5
TT=46.08
T1=46.17
No dataNo dataOPT
f=5
TT=46.78
T1=46.85
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-alu4.b.opb
OPT
f=50
TT=1.469
T1=1.14
SAT
f=51
TT=1798.03
T1=936.39
No dataSAT (TO)
f=56
TT=1800.06
T1=314.58
? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.02

SAT (TO)
f=50
TT=1800.03
T1=91.95
SAT (TO)
f=51
TT=1800.1
T1=1433.52
SAT (TO)
f=57
TT=1802.09
T1=999.66
SAT
f=54
TT=1783.02
T1=321.41
SAT (TO)
f=68
TT=1800.49
T1=0.42
SAT
f=51
TT=1798.04
T1=937.29
SAT (TO)
f=68
TT=1800.3
T1=0.38
OPT
f=50
TT=17.879
T1=6.76
No dataOPT
f=50
TT=1.469
T1=1.14
SAT (TO)
f=55
TT=1800.18
T1=280.19
OPT
f=50
TT=8.988
T1=8.8
No dataSAT (TO)
f=54
TT=1800.66
T1=800.15
OPT
f=50
TT=24.558
T1=5.9
SAT (TO)
f=50
TT=1800.07
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=52
TT=1800.05
T1=900.31
No dataNo dataSAT (TO)
f=52
TT=1800.45
T1=900.31
No dataNo dataNo dataSAT (TO)
f=56
TT=1800.13
T1=243.59
SAT (TO)
f=60
TT=1800.92
T1=1007.71
SAT (TO)
f=68
TT=1800.05
T1=0.36
OPT
f=50
TT=12.368
T1=3.27
OPT
f=50
TT=12.849
T1=3.3
OPT
f=50
TT=5.599
T1=2.25
? (TO)

TT=1800.02

? (TO)

TT=1800.12

?

TT=1799.39

No dataNo data?

TT=1799.51

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-apex4.a.opb
OPT
f=776
TT=2.161
T1=2.13
SAT
f=793
TT=1798.01
T1=150.81
No dataSAT (TO)
f=799
TT=1800.01
T1=1.26
? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.04

SAT (TO)
f=777
TT=1800.1
T1=476.2
SAT (TO)
f=848
TT=1800.06
T1=0.29
SAT (TO)
f=801
TT=1802.12
T1=0.95
SAT
f=797
TT=1783.01
T1=0.24
No Cert.

TT=482.42

SAT
f=793
TT=1798.01
T1=153.4
SAT (TO)
f=844
TT=1800.04
T1=0.69
OPT
f=776
TT=2.404
T1=2.37
No dataOPT
f=776
TT=2.161
T1=2.13
SAT (TO)
f=818
TT=1800.81
T1=912.02
OPT
f=776
TT=3.816
T1=3.76
No dataSAT (TO)
f=823
TT=1800.04
T1=648.51
OPT
f=776
TT=3.355
T1=3.3
SAT (TO)
f=848
TT=1800.12
T1=1800.61
? (TO)

TT=1800.13

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=803
TT=1800.11
T1=900.31
No dataNo dataSAT (TO)
f=809
TT=1800.13
T1=900.41
No dataNo dataNo dataSAT (TO)
f=822
TT=1800.42
T1=751.04
SAT (TO)
f=843
TT=1800.07
T1=168.32
SAT (TO)
f=848
TT=1800.04
T1=0.49
OPT
f=776
TT=4.735
T1=4.7
OPT
f=776
TT=4.356
T1=4.32
OPT
f=776
TT=2.249
T1=2.2
? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.55

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/logic-synthesis/
normalized-bench1.pi.opb
OPT
f=121
TT=1.093
T1=1.01
OPT
f=121
TT=426.045
T1=424.36
No dataSAT (TO)
f=173
TT=1800.08
T1=0
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.14

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.08

OPT
f=121
TT=7.917
T1=6.36
SAT (TO)
f=173
TT=1800.09
T1=0.05
SAT (TO)
f=229
TT=1802.11
T1=2.24
SAT
f=207
TT=1783.01
T1=9.43
SAT (TO)
f=173
TT=1800.02
T1=0.42
OPT
f=121
TT=412.497
T1=410.74
SAT (TO)
f=173
TT=1800.07
T1=0.42
OPT
f=121
TT=6.481
T1=6.44
No dataOPT
f=121
TT=4.02
T1=3.18
SAT (TO)
f=164
TT=1800.58
T1=892.32
OPT
f=121
TT=1.093
T1=1.01
No dataSAT (TO)
f=165
TT=1800.17
T1=854.37
OPT
f=121
TT=5.214
T1=5.19
SAT (TO)
f=173
TT=1800.04
T1=1800.61
? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=162
TT=1800.11
T1=900.31
No dataNo dataSAT (TO)
f=161
TT=1800.49
T1=900.41
No dataNo dataNo dataSAT (TO)
f=171
TT=1800.74
T1=9.85
SAT (TO)
f=172
TT=1800.01
T1=0.76
SAT (TO)
f=173
TT=1800.04
T1=0.35
OPT
f=121
TT=7.247
T1=7.22
OPT
f=121
TT=7.168
T1=7.15
OPT
f=121
TT=7.213
T1=7.19
? (TO)

TT=1800.09

? (TO)

TT=1800.11

?

TT=1799.41

No dataNo data?

TT=1799.43

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-clip.b.opb
OPT
f=15
TT=0.156
T1=0.15
OPT
f=15
TT=0.943
T1=0.57
No dataSAT (TO)
f=18
TT=1800.02
T1=105.93
OPT
f=15
TT=7.928
T1=7.93
OPT
f=15
TT=3.188
T1=2.21
OPT
f=15
TT=7.069
T1=7.07
OPT
f=15
TT=2.996
T1=1.96
OPT
f=15
TT=5.821
T1=4.68
OPT
f=15
TT=1.163
T1=0.62
OPT
f=15
TT=5.783
T1=4.66
OPT
f=15
TT=1.142
T1=0.61
OPT
f=15
TT=0.383
T1=0.06
OPT
f=15
TT=4.513
T1=0.88
SAT (TO)
f=16
TT=1800.15
T1=3.91
OPT
f=15
TT=17.065
T1=4.35
SAT (TO)
f=21
TT=1800.08
T1=0.34
OPT
f=15
TT=0.949
T1=0.57
SAT (TO)
f=20
TT=1800.45
T1=0.32
OPT
f=15
TT=2.025
T1=2.01
No dataOPT
f=15
TT=0.156
T1=0.15
OPT
f=15
TT=69.694
T1=17.38
OPT
f=15
TT=1.599
T1=1.59
No dataSAT (TO)
f=15
TT=1801.17
T1=14.86
OPT
f=15
TT=0.816
T1=0.8
OPT
f=15
TT=3.162
T1=3.16
OPT
f=15
TT=11.103
T1=11.1
OPT
f=15
TT=11.442
T1=9.46
No dataNo dataNo dataOPT
f=15
TT=2.781
T1=1.39
No dataNo dataOPT
f=15
TT=2.731
T1=1.37
No dataNo dataNo dataOPT
f=15
TT=34.668
T1=7.34
SAT (TO)
f=17
TT=1800.87
T1=47.1
SAT (TO)
f=21
TT=1800.09
T1=0.31
OPT
f=15
TT=1.185
T1=1.17
OPT
f=15
TT=1.149
T1=1.14
OPT
f=15
TT=1.034
T1=1.02
? (TO)

TT=1800.09

? (TO)

TT=1800.02

OPT
f=15
TT=7.501
T1=7.51
No dataNo dataOPT
f=15
TT=7.841
T1=7.85
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-count.b.opb
OPT
f=24
TT=0.16
T1=0.16
OPT
f=24
TT=0.528
T1=0.52
No dataSAT (TO)
f=28
TT=1800.02
T1=47.35
OPT
f=24
TT=60.633
T1=4.27
OPT
f=24
TT=46.539
T1=46.54
OPT
f=24
TT=60.27
T1=4.21
OPT
f=24
TT=45.848
T1=45.87
OPT
f=24
TT=53.167
T1=13.36
OPT
f=24
TT=46.838
T1=3.16
OPT
f=24
TT=51.96
T1=13.47
OPT
f=24
TT=46.45
T1=3.16
OPT
f=24
TT=0.087
T1=0.08
OPT
f=24
TT=436.246
T1=52.74
SAT (TO)
f=26
TT=1802.07
T1=0.46
OPT
f=24
TT=43.324
T1=3.17
SAT (TO)
f=29
TT=1800.06
T1=0.38
OPT
f=24
TT=0.506
T1=0.5
SAT (TO)
f=29
TT=1801.36
T1=0.34
OPT
f=24
TT=0.535
T1=0.52
No dataOPT
f=24
TT=0.16
T1=0.16
SAT (TO)
f=25
TT=1800.84
T1=771.64
OPT
f=24
TT=0.566
T1=0.55
No dataSAT (TO)
f=24
TT=1800.46
T1=758.79
OPT
f=24
TT=0.606
T1=0.59
OPT
f=24
TT=275.05
T1=275.1
OPT
f=24
TT=71.097
T1=4.25
OPT
f=24
TT=63.588
T1=15.91
No dataNo dataNo dataOPT
f=24
TT=8.832
T1=4.41
No dataNo dataOPT
f=24
TT=9.193
T1=4.6
No dataNo dataNo dataSAT (TO)
f=24
TT=1800.52
T1=64.61
SAT (TO)
f=27
TT=1800.1
T1=895.46
SAT (TO)
f=29
TT=1800.66
T1=0.33
OPT
f=24
TT=0.528
T1=0.51
OPT
f=24
TT=0.544
T1=0.52
OPT
f=24
TT=0.425
T1=0.41
? (TO)

TT=1800.08

? (TO)

TT=1800.07

OPT
f=24
TT=6.182
T1=6.19
No dataNo dataOPT
f=24
TT=5.664
T1=5.68
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-e64.b.opb
OPT
f=47
TT=0.825
T1=0.6
SAT
f=60
TT=1798
T1=9.75
No dataSAT (TO)
f=58
TT=1800.03
T1=980.88
? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.08

SAT (TO)
f=53
TT=1800.02
T1=908.93
SAT (TO)
f=51
TT=1800.09
T1=171.61
SAT (TO)
f=61
TT=1800.13
T1=0.42
SAT
f=60
TT=1783.01
T1=237.73
SAT (TO)
f=82
TT=1800.08
T1=0.31
SAT
f=60
TT=1798.01
T1=9.31
SAT (TO)
f=72
TT=1800.77
T1=379.55
OPT
f=47
TT=107.437
T1=106.95
No dataOPT
f=47
TT=0.825
T1=0.6
SAT (TO)
f=58
TT=1801.37
T1=627.02
SAT
f=53
TT=1789.73
T1=3.1
No dataSAT (TO)
f=59
TT=1800.08
T1=189.93
OPT
f=47
TT=15.934
T1=15.92
SAT (TO)
f=53
TT=1800.09
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=55
TT=1800.15
T1=900.31
No dataNo dataSAT (TO)
f=55
TT=1800.32
T1=900.31
No dataNo dataNo dataSAT (TO)
f=62
TT=1800.48
T1=315.36
SAT (TO)
f=80
TT=1800.05
T1=296.48
SAT (TO)
f=74
TT=1800.02
T1=2.88
OPT
f=47
TT=90.452
T1=71.84
OPT
f=47
TT=89.654
T1=71.26
OPT
f=47
TT=244.368
T1=231.27
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.53

No dataNo data?

TT=1799.77

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-ex5.pi.opb
OPT
f=65
TT=5.82
T1=3.12
OPT
f=65
TT=1276.39
T1=1269.68
No dataSAT (TO)
f=99
TT=1800.11
T1=0.01
? (TO)

TT=1800.06

? (TO)

TT=1800.14

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.07

OPT
f=65
TT=42.605
T1=35.28
SAT (TO)
f=83
TT=1800.05
T1=637.55
SAT (TO)
f=100
TT=1800.15
T1=0.91
SAT
f=99
TT=1783.01
T1=0.08
SAT (TO)
f=83
TT=1800.52
T1=0.47
OPT
f=65
TT=1194.86
T1=1186.11
SAT (TO)
f=83
TT=1800.27
T1=0.5
OPT
f=65
TT=11.714
T1=10.74
No dataOPT
f=65
TT=5.82
T1=3.12
SAT (TO)
f=79
TT=1800.09
T1=589.52
SAT
f=66
TT=1789.75
T1=1.3
No dataSAT (TO)
f=78
TT=1800.03
T1=265.29
OPT
f=65
TT=8.66
T1=8.64
SAT (TO)
f=85
TT=1800.09
T1=1800.5
? (TO)

TT=1800.11

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=84
TT=1800.09
T1=900.31
No dataNo dataSAT (TO)
f=84
TT=1800.12
T1=900.31
No dataNo dataNo dataSAT (TO)
f=80
TT=1800.04
T1=138.91
SAT (TO)
f=83
TT=1800.72
T1=0.42
SAT (TO)
f=83
TT=1800.78
T1=0.39
OPT
f=65
TT=19.819
T1=19.79
OPT
f=65
TT=19.629
T1=19.6
OPT
f=65
TT=19.73
T1=19.7
? (TO)

TT=1800.02

? (TO)

TT=1800.01

?

TT=1799.47

No dataNo data?

TT=1799.81

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-exam.pi.opb
OPT
f=63
TT=2.703
T1=1.49
SAT
f=69
TT=1798
T1=167.91
No dataSAT (TO)
f=117
TT=1800.11
T1=1588.65
? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.06

OPT
f=63
TT=87.215
T1=1.52
SAT (TO)
f=90
TT=1800.08
T1=0.15
SAT (TO)
f=141
TT=1802.1
T1=1.89
SAT
f=141
TT=1783.01
T1=7.52
SAT (TO)
f=89
TT=1800.07
T1=0.46
SAT
f=69
TT=1798
T1=172.13
SAT (TO)
f=89
TT=1800.74
T1=0.46
OPT
f=63
TT=6.398
T1=2.67
No dataOPT
f=63
TT=2.703
T1=2.68
SAT (TO)
f=87
TT=1800.93
T1=13.38
OPT
f=63
TT=5.289
T1=1.97
No dataSAT (TO)
f=82
TT=1800.03
T1=738.51
OPT
f=63
TT=23.241
T1=13.83
SAT (TO)
f=90
TT=1800.03
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=89
TT=1800.46
T1=900.31
No dataNo dataSAT (TO)
f=89
TT=1800.51
T1=900.31
No dataNo dataNo dataSAT (TO)
f=87
TT=1800.86
T1=7.37
SAT (TO)
f=89
TT=1800.09
T1=0.39
SAT (TO)
f=89
TT=1800.02
T1=0.38
OPT
f=63
TT=3.157
T1=1.54
OPT
f=63
TT=3.082
T1=1.49
OPT
f=63
TT=3.133
T1=1.52
? (TO)

TT=1800.01

? (TO)

TT=1800.1

?

TT=1799.45

No dataNo data?

TT=1799.74

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-f51m.b.opb
OPT
f=18
TT=0.294
T1=0.26
OPT
f=18
TT=12.188
T1=10.8
No dataSAT (TO)
f=20
TT=1800.03
T1=935.7
OPT
f=18
TT=95.944
T1=95.96
OPT
f=18
TT=80.45
T1=80.46
OPT
f=18
TT=97.752
T1=97.77
OPT
f=18
TT=79.838
T1=79.85
OPT
f=18
TT=96.938
T1=26.4
OPT
f=18
TT=80.643
T1=25.41
OPT
f=18
TT=97.234
T1=25.96
OPT
f=18
TT=78.887
T1=24.41
OPT
f=18
TT=6.444
T1=0.12
OPT
f=18
TT=447.589
T1=196.95
SAT (TO)
f=19
TT=1802.09
T1=593.2
OPT
f=18
TT=57.103
T1=22.57
SAT (TO)
f=26
TT=1800.02
T1=0.34
OPT
f=18
TT=11.694
T1=10.35
SAT (TO)
f=26
TT=1800.95
T1=0.31
OPT
f=18
TT=1.695
T1=0.89
No dataOPT
f=18
TT=0.294
T1=0.26
OPT
f=18
TT=133.755
T1=7.31
OPT
f=18
TT=1.075
T1=0.56
No dataSAT (TO)
f=18
TT=1800.23
T1=4.84
OPT
f=18
TT=1.3
T1=0.67
OPT
f=18
TT=229.807
T1=229.84
OPT
f=18
TT=101.972
T1=102.03
OPT
f=18
TT=103.468
T1=28.07
No dataNo dataNo dataOPT
f=18
TT=1430.41
T1=715.27
No dataNo dataOPT
f=18
TT=1068.68
T1=534.37
No dataNo dataNo dataOPT
f=18
TT=713.496
T1=10.34
SAT (TO)
f=20
TT=1800.53
T1=56.17
SAT (TO)
f=26
TT=1800.03
T1=0.33
OPT
f=18
TT=3.225
T1=0.65
OPT
f=18
TT=3.127
T1=0.61
OPT
f=18
TT=1.089
T1=0.55
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.39

No dataNo data?

TT=1799.52

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-jac3.opb
OPT
f=15
TT=0.295
T1=0.27
OPT
f=15
TT=1.046
T1=0.96
No dataSAT (TO)
f=20
TT=1800.1
T1=0.01
? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.11

OPT
f=15
TT=0.705
T1=0.66
SAT (TO)
f=15
TT=1800.12
T1=893.55
SAT (TO)
f=19
TT=1802.11
T1=294.42
SAT
f=19
TT=1783.01
T1=65.62
SAT (TO)
f=26
TT=1800.04
T1=0.38
OPT
f=15
TT=1.11
T1=1.01
SAT (TO)
f=26
TT=1800.31
T1=0.38
OPT
f=15
TT=0.231
T1=0.21
No dataOPT
f=15
TT=0.773
T1=0.77
SAT (TO)
f=15
TT=1801.27
T1=69.39
OPT
f=15
TT=0.303
T1=0.28
No dataOPT
f=15
TT=365.089
T1=100.98
OPT
f=15
TT=0.295
T1=0.27
SAT (TO)
f=16
TT=1800.04
T1=1800.5
? (TO)

TT=1800.11

? (TO)

TT=1800.04

No dataNo dataNo dataOPT
f=15
TT=28.062
T1=14.03
No dataNo dataOPT
f=15
TT=28.812
T1=14.45
No dataNo dataNo dataOPT
f=15
TT=120.537
T1=29.26
SAT (TO)
f=21
TT=1800.02
T1=1357.08
SAT (TO)
f=26
TT=1800.7
T1=0.36
OPT
f=15
TT=4.303
T1=4.28
OPT
f=15
TT=4.438
T1=4.43
OPT
f=15
TT=5.792
T1=5.77
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=15
TT=14.418
T1=14.45
No dataNo dataOPT
f=15
TT=14.279
T1=14.32
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/logic-synthesis/
normalized-max1024.pi.opb
OPT
f=259
TT=1.657
T1=1.17
SAT
f=264
TT=1798
T1=307.64
No dataSAT (TO)
f=305
TT=1800.02
T1=516.6
? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.06

OPT
f=259
TT=42.101
T1=29.96
SAT (TO)
f=279
TT=1800.04
T1=421.36
SAT (TO)
f=310
TT=1802.11
T1=0.18
SAT
f=308
TT=1783.01
T1=461.79
? (exit code)

TT=820

SAT
f=264
TT=1798.04
T1=326.04
SAT (TO)
f=301
TT=1800.03
T1=0.29
OPT
f=259
TT=15.147
T1=15.14
No dataOPT
f=259
TT=1.657
T1=1.17
SAT (TO)
f=295
TT=1800.14
T1=752.37
OPT
f=259
TT=14.977
T1=14.47
No dataSAT (TO)
f=294
TT=1800.16
T1=858.18
OPT
f=259
TT=18.679
T1=18.66
SAT (TO)
f=282
TT=1800.17
T1=1800.57
? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=284
TT=1800.55
T1=900.31
No dataNo dataSAT (TO)
f=284
TT=1800.12
T1=900.34
No dataNo dataNo dataSAT (TO)
f=294
TT=1800.41
T1=763.71
SAT (TO)
f=301
TT=1800.84
T1=0.27
SAT (TO)
f=301
TT=1800.1
T1=0.28
OPT
f=259
TT=18.443
T1=18.43
OPT
f=259
TT=18.478
T1=18.46
OPT
f=259
TT=13.877
T1=13.86
? (TO)

TT=1800.01

? (TO)

TT=1800.01

?

TT=1799.5

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/logic-synthesis/
normalized-prom2.pi.opb
OPT
f=287
TT=0.491
T1=0.48
SAT (TO)
f=303
TT=1800.02
T1=807.23
No dataSAT (TO)
f=440
TT=1800.01
T1=115.41
? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.12

OPT
f=287
TT=6.292
T1=2.56
SAT (TO)
f=436
TT=1800.06
T1=0.08
SAT (TO)
f=468
TT=1800.11
T1=0.73
SAT
f=442
TT=1783.01
T1=0.16
? (exit code)

TT=579.706

SAT (TO)
f=303
TT=1800.02
T1=809.68
SAT (TO)
f=436
TT=1800.05
T1=0.4
OPT
f=287
TT=2.064
T1=2.05
No dataOPT
f=287
TT=0.896
T1=0.88
SAT (TO)
f=422
TT=1801.07
T1=645.31
OPT
f=287
TT=0.491
T1=0.48
No dataSAT (TO)
f=431
TT=1800.56
T1=464.14
OPT
f=287
TT=1.117
T1=1.1
SAT (TO)
f=436
TT=1800.03
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=356
TT=1800.48
T1=900.41
No dataNo dataSAT (TO)
f=356
TT=1800.03
T1=900.31
No dataNo dataNo dataSAT (TO)
f=429
TT=1800.1
T1=603.88
SAT (TO)
f=436
TT=1800.07
T1=0.32
SAT (TO)
f=436
TT=1800.75
T1=0.34
OPT
f=287
TT=1.457
T1=1.44
OPT
f=287
TT=1.446
T1=1.43
OPT
f=287
TT=1.37
T1=1.35
? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.6

No dataNo data?

TT=1799.77

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-rot.b.opb
OPT
f=115
TT=1.125
T1=1.07
SAT
f=127
TT=1798
T1=421.37
No dataSAT (TO)
f=140
TT=1800.1
T1=1510.45
? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.07

SAT (TO)
f=117
TT=1800.03
T1=4.54
SAT (TO)
f=125
TT=1800.11
T1=90.17
SAT (TO)
f=148
TT=1802.11
T1=3.95
SAT
f=141
TT=1783.01
T1=591.45
SAT (TO)
f=161
TT=1800
T1=0.64
SAT
f=127
TT=1798.07
T1=414.13
SAT (TO)
f=162
TT=1800.72
T1=0.51
OPT
f=115
TT=26.418
T1=26.4
No dataOPT
f=115
TT=1.125
T1=1.07
SAT (TO)
f=143
TT=1800.66
T1=441.85
OPT
f=115
TT=66.753
T1=66.76
No dataSAT (TO)
f=142
TT=1800.48
T1=8.92
OPT
f=115
TT=23.068
T1=23.04
SAT (TO)
f=122
TT=1800.03
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=128
TT=1800.51
T1=900.41
No dataNo dataSAT (TO)
f=128
TT=1800.48
T1=900.41
No dataNo dataNo data? (TO)

TT=1802.01

SAT (TO)
f=161
TT=1800.71
T1=0.45
SAT (TO)
f=158
TT=1800.04
T1=147.46
OPT
f=115
TT=21.33
T1=21.31
OPT
f=115
TT=22.23
T1=22.21
OPT
f=115
TT=22.594
T1=22.57
? (TO)

TT=1800.01

? (TO)

TT=1800.1

?

TT=1799.42

No dataNo data?

TT=1799.37

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
logic-synthesis/normalized-sao2.b.opb
OPT
f=25
TT=0.041
T1=0.04
OPT
f=25
TT=176.335
T1=176.35
No dataSAT (TO)
f=28
TT=1800.02
T1=1244.96
OPT
f=25
TT=478.114
T1=320.63
OPT
f=25
TT=687.665
T1=687.78
OPT
f=25
TT=481.525
T1=322
OPT
f=25
TT=681.434
T1=681.55
OPT
f=25
TT=431.497
T1=272.3
OPT
f=25
TT=685.261
T1=530.22
OPT
f=25
TT=423.235
T1=265.47
OPT
f=25
TT=685.272
T1=530.84
OPT
f=25
TT=0.586
T1=0.58
SAT (TO)
f=26
TT=1800.02
T1=13.98
SAT (TO)
f=29
TT=1802.08
T1=391.38
SAT
f=25
TT=1783.01
T1=1717.73
SAT (TO)
f=36
TT=1800.03
T1=0.33
OPT
f=25
TT=176.242
T1=176.27
SAT (TO)
f=36
TT=1800.78
T1=0.3
OPT
f=25
TT=1.403
T1=1.39
No dataOPT
f=25
TT=0.332
T1=0.26
SAT (TO)
f=26
TT=1800.03
T1=615.55
OPT
f=25
TT=1.739
T1=1.73
No dataSAT (TO)
f=26
TT=1800.13
T1=272.54
OPT
f=25
TT=2.685
T1=2.67
SAT (TO)
f=26
TT=1800.11
T1=1800.4
OPT
f=25
TT=646.289
T1=516.41
OPT
f=25
TT=605.749
T1=475.26
No dataNo dataNo dataOPT
f=25
TT=0.09
T1=0.04
No dataNo dataOPT
f=25
TT=0.091
T1=0.04
No dataNo dataNo dataSAT (TO)
f=26
TT=1800.18
T1=129.41
SAT (TO)
f=30
TT=1800.01
T1=166.05
SAT (TO)
f=37
TT=1800.71
T1=0.28
OPT
f=25
TT=1.132
T1=1.13
OPT
f=25
TT=1.154
T1=1.14
OPT
f=25
TT=1.182
T1=1.17
? (TO)

TT=1800.06

? (TO)

TT=1800.02

OPT
f=25
TT=0.04
T1=0.03
No dataNo dataOPT
f=25
TT=0.041
T1=0.04
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/logic-synthesis/
normalized-test4.pi.opb
SAT
f=96
TT=1796.76
T1=1166.35
SAT
f=155
TT=1798.05
T1=645.41
No dataSAT (TO)
f=179
TT=1800.11
T1=0.02
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800

? (TO)

TT=1800.12

SAT (TO)
f=105
TT=1800.05
T1=1578.28
SAT (TO)
f=180
TT=1800.1
T1=0.61
SAT (TO)
f=182
TT=1802.12
T1=97.78
SAT
f=179
TT=1783
T1=1.04
SAT (TO)
f=179
TT=1800.07
T1=0.82
SAT
f=155
TT=1798.02
T1=648.21
SAT (TO)
f=179
TT=1800.05
T1=0.83
SAT
f=97
TT=1793.78
T1=259.63
No data? (TO)

TT=1800.24

SAT (TO)
f=170
TT=1800.08
T1=244.96
SAT
f=114
TT=1789.76
T1=131.3
No dataSAT (TO)
f=165
TT=1800.31
T1=518.13
SAT
f=96
TT=1796.76
T1=1166.35
SAT (TO)
f=180
TT=1800.03
T1=1800.61
? (TO)

TT=1800.05

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=171
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=171
TT=1800.1
T1=900.41
No dataNo dataNo dataSAT (TO)
f=166
TT=1800.38
T1=820.53
SAT (TO)
f=177
TT=1800.37
T1=42.15
SAT (TO)
f=179
TT=1800.8
T1=0.69
SAT
f=96
TT=1796.77
T1=1196.17
SAT
f=96
TT=1796.78
T1=1199.65
SAT
f=96
TT=1796.77
T1=1192.81
? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.35

No dataNo data?

TT=1799.53

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-100-2_0-yes1-2.opb
OPT
f=100
TT=0.003
T1=0
OPT
f=100
TT=0.005
T1=0
No dataOPT
f=100
TT=0.003
T1=0
OPT
f=100
TT=0.153
T1=0.02
OPT
f=100
TT=0.141
T1=0.03
OPT
f=100
TT=0.089
T1=0.01
OPT
f=100
TT=0.089
T1=0.02
OPT
f=100
TT=0.028
T1=0.01
OPT
f=100
TT=0.032
T1=0.02
OPT
f=100
TT=0.03
T1=0.01
OPT
f=100
TT=0.033
T1=0.02
OPT
f=100
TT=0.006
T1=0
OPT
f=100
TT=0.021
T1=0
OPT
f=100
TT=0.042
T1=0.03
OPT
f=100
TT=0.005
T1=0
OPT
f=100
TT=0.245
T1=0.17
OPT
f=100
TT=0.005
T1=0
OPT
f=100
TT=0.273
T1=0.18
OPT
f=100
TT=7.379
T1=7.37
No dataOPT
f=100
TT=3.288
T1=1.86
OPT
f=100
TT=0.384
T1=1.15
OPT
f=100
TT=0.156
T1=0.14
No dataOPT
f=100
TT=0.403
T1=0.69
OPT
f=100
TT=0.225
T1=0.2
OPT
f=100
TT=0.01
T1=0.01
OPT
f=100
TT=0.096
T1=0.01
OPT
f=100
TT=0.022
T1=0
No dataNo dataNo dataOPT
f=100
TT=0.003
T1=0
No dataNo dataOPT
f=100
TT=0.003
T1=0
No dataNo dataNo dataOPT
f=100
TT=0.342
T1=0.66
OPT
f=100
TT=0.253
T1=0.17
OPT
f=100
TT=0.284
T1=0.19
OPT
f=100
TT=0.197
T1=0.17
OPT
f=100
TT=0.19
T1=0.16
OPT
f=100
TT=1.798
T1=1.79
OPT
f=100
TT=0.018
T1=0.02
OPT
f=100
TT=0.014
T1=0.01
?

TT=1799.57

No dataNo data?

TT=1799.8

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-100-2_0-yes1-3.opb
OPT
f=100
TT=0.002
T1=0
OPT
f=100
TT=0.005
T1=0
No dataOPT
f=100
TT=0.004
T1=0
OPT
f=100
TT=0.127
T1=0.02
OPT
f=100
TT=0.139
T1=0.03
OPT
f=100
TT=0.075
T1=0.01
OPT
f=100
TT=0.082
T1=0.02
OPT
f=100
TT=0.03
T1=0.01
OPT
f=100
TT=0.035
T1=0.02
OPT
f=100
TT=0.027
T1=0.01
OPT
f=100
TT=0.034
T1=0.03
OPT
f=100
TT=0.007
T1=0.01
OPT
f=100
TT=0.005
T1=0
OPT
f=100
TT=0.043
T1=0.03
OPT
f=100
TT=0.004
T1=0
OPT
f=100
TT=0.274
T1=0.18
OPT
f=100
TT=0.006
T1=0
OPT
f=100
TT=0.325
T1=0.19
OPT
f=100
TT=3.392
T1=3.39
No dataOPT
f=100
TT=1.961
T1=1.09
OPT
f=100
TT=0.374
T1=1.16
OPT
f=100
TT=0.176
T1=0.16
No dataOPT
f=100
TT=0.453
T1=0.68
OPT
f=100
TT=0.208
T1=0.18
OPT
f=100
TT=0.004
T1=0
OPT
f=100
TT=0.095
T1=0
OPT
f=100
TT=0.023
T1=0
No dataNo dataNo dataOPT
f=100
TT=0.003
T1=0
No dataNo dataOPT
f=100
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=100
TT=0.404
T1=0.67
OPT
f=100
TT=0.263
T1=0.18
OPT
f=100
TT=0.263
T1=0.19
OPT
f=100
TT=0.205
T1=0.18
OPT
f=100
TT=0.223
T1=0.19
OPT
f=100
TT=5.833
T1=5.71
OPT
f=100
TT=0.021
T1=0.01
OPT
f=100
TT=0.024
T1=0.02
?

TT=1799.98

No dataNo data?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-100-2_0-yes1-4.opb
OPT
f=100
TT=0.002
T1=0
OPT
f=100
TT=0.004
T1=0
No dataOPT
f=100
TT=0.002
T1=0
OPT
f=100
TT=0.136
T1=0.02
OPT
f=100
TT=0.148
T1=0.03
OPT
f=100
TT=0.073
T1=0.01
OPT
f=100
TT=0.085
T1=0.02
OPT
f=100
TT=0.029
T1=0.01
OPT
f=100
TT=0.034
T1=0.02
OPT
f=100
TT=0.028
T1=0.01
OPT
f=100
TT=0.037
T1=0.02
OPT
f=100
TT=0.004
T1=0
OPT
f=100
TT=0.024
T1=0
OPT
f=100
TT=0.044
T1=0.03
OPT
f=100
TT=0.005
T1=0
OPT
f=100
TT=0.244
T1=0.18
OPT
f=100
TT=0.004
T1=0
OPT
f=100
TT=0.264
T1=0.18
OPT
f=100
TT=11.361
T1=11.35
No dataOPT
f=100
TT=1.633
T1=0.67
OPT
f=100
TT=0.383
T1=1.16
OPT
f=100
TT=0.155
T1=0.14
No dataOPT
f=100
TT=0.374
T1=0.68
OPT
f=100
TT=0.204
T1=0.18
OPT
f=100
TT=0.011
T1=0
OPT
f=100
TT=0.088
T1=0.01
OPT
f=100
TT=0.025
T1=0
No dataNo dataNo dataOPT
f=100
TT=0.004
T1=0
No dataNo dataOPT
f=100
TT=0.003
T1=0.01
No dataNo dataNo dataOPT
f=100
TT=0.363
T1=0.68
OPT
f=100
TT=0.264
T1=0.18
OPT
f=100
TT=0.294
T1=0.22
OPT
f=100
TT=0.195
T1=0.17
OPT
f=100
TT=0.191
T1=0.16
OPT
f=100
TT=6.331
T1=6.3
OPT
f=100
TT=0.014
T1=0.01
OPT
f=100
TT=0.017
T1=0.01
?

TT=1799.97

No dataNo data?

TT=1799.99

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-100-6_0-yes1-1.opb
OPT
f=100
TT=0.003
T1=0
OPT
f=100
TT=0.007
T1=0
No dataOPT
f=100
TT=0.004
T1=0
OPT
f=100
TT=0.124
T1=0.02
OPT
f=100
TT=0.139
T1=0.03
OPT
f=100
TT=0.076
T1=0.01
OPT
f=100
TT=0.083
T1=0.02
OPT
f=100
TT=0.027
T1=0.01
OPT
f=100
TT=0.036
T1=0.02
OPT
f=100
TT=0.032
T1=0.02
OPT
f=100
TT=0.036
T1=0.02
OPT
f=100
TT=0.008
T1=0
OPT
f=100
TT=0.026
T1=0.01
OPT
f=100
TT=0.059
T1=0.04
OPT
f=100
TT=0.009
T1=0.01
OPT
f=100
TT=0.304
T1=0.19
OPT
f=100
TT=0.005
T1=0
OPT
f=100
TT=0.323
T1=0.23
OPT
f=100
TT=30.931
T1=23.84
No dataOPT
f=100
TT=1.269
T1=1.27
OPT
f=100
TT=0.373
T1=1.19
OPT
f=100
TT=0.511
T1=0.42
No dataOPT
f=100
TT=0.363
T1=0.72
OPT
f=100
TT=0.354
T1=0.25
OPT
f=100
TT=0.011
T1=0.01
OPT
f=100
TT=0.099
T1=0.01
OPT
f=100
TT=0.029
T1=0.01
No dataNo dataNo dataOPT
f=100
TT=0.004
T1=0.01
No dataNo dataOPT
f=100
TT=0.003
T1=0.01
No dataNo dataNo dataOPT
f=100
TT=0.373
T1=0.7
OPT
f=100
TT=0.334
T1=0.19
OPT
f=100
TT=0.303
T1=0.2
OPT
f=100
TT=0.425
T1=0.31
OPT
f=100
TT=0.399
T1=0.28
OPT
f=100
TT=17.374
T1=0.29
OPT
f=100
TT=0.026
T1=0.02
OPT
f=100
TT=0.021
T1=0.02
?

TT=1799.55

No dataNo data?

TT=1799.96

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-200-2_0-yes1-3.opb
OPT
f=200
TT=0.004
T1=0
OPT
f=200
TT=0.012
T1=0.01
No dataOPT
f=200
TT=0.004
T1=0
OPT
f=200
TT=0.25
T1=0.02
OPT
f=200
TT=0.275
T1=0.03
OPT
f=200
TT=0.169
T1=0.01
OPT
f=200
TT=0.202
T1=0.02
OPT
f=200
TT=0.045
T1=0.02
OPT
f=200
TT=0.051
T1=0.02
OPT
f=200
TT=0.044
T1=0.02
OPT
f=200
TT=0.055
T1=0.03
OPT
f=200
TT=0.007
T1=0
OPT
f=200
TT=0.011
T1=0.01
OPT
f=200
TT=0.061
T1=0.04
OPT
f=200
TT=0.01
T1=0
OPT
f=200
TT=0.333
T1=0.22
OPT
f=200
TT=0.01
T1=0
OPT
f=200
TT=0.415
T1=0.25
OPT
f=200
TT=23.863
T1=23.86
No dataOPT
f=200
TT=1.223
T1=1.22
OPT
f=200
TT=0.634
T1=1.19
OPT
f=200
TT=0.621
T1=0.58
No dataOPT
f=200
TT=0.634
T1=0.72
OPT
f=200
TT=0.842
T1=0.77
OPT
f=200
TT=0.005
T1=0
OPT
f=200
TT=0.244
T1=0.01
OPT
f=200
TT=0.048
T1=0.01
No dataNo dataNo dataOPT
f=200
TT=0.043
T1=0.01
No dataNo dataOPT
f=200
TT=0.023
T1=0.01
No dataNo dataNo dataOPT
f=200
TT=0.514
T1=0.7
OPT
f=200
TT=0.405
T1=0.24
OPT
f=200
TT=0.413
T1=0.26
OPT
f=200
TT=0.783
T1=0.7
OPT
f=200
TT=0.803
T1=0.72
OPT
f=200
TT=21.897
T1=21.72
OPT
f=200
TT=0.036
T1=0.03
OPT
f=200
TT=0.036
T1=0.03
?

TT=1799.61

No dataNo data?

TT=1799.61

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-200-3_4-yes1-2.opb
OPT
f=200
TT=0.004
T1=0
OPT
f=200
TT=0.029
T1=0.02
No dataOPT
f=200
TT=0.004
T1=0
OPT
f=200
TT=0.254
T1=0.03
OPT
f=200
TT=0.268
T1=0.03
OPT
f=200
TT=0.187
T1=0.02
OPT
f=200
TT=0.195
T1=0.04
OPT
f=200
TT=0.053
T1=0.03
OPT
f=200
TT=0.055
T1=0.03
OPT
f=200
TT=0.051
T1=0.02
OPT
f=200
TT=0.058
T1=0.03
OPT
f=200
TT=0.009
T1=0.01
OPT
f=200
TT=0.058
T1=0.01
OPT
f=200
TT=0.07
T1=0.05
OPT
f=200
TT=0.014
T1=0.01
OPT
f=200
TT=0.585
T1=0.29
OPT
f=200
TT=0.023
T1=0.02
OPT
f=200
TT=0.496
T1=0.26
OPT
f=200
TT=133.26
T1=130.71
No dataOPT
f=200
TT=1613.89
T1=446.1
OPT
f=200
TT=0.683
T1=1.21
OPT
f=200
TT=1.581
T1=1.54
No dataOPT
f=200
TT=0.663
T1=0.75
OPT
f=200
TT=1.484
T1=1.28
OPT
f=200
TT=0.018
T1=0.01
OPT
f=200
TT=0.25
T1=0.01
OPT
f=200
TT=0.046
T1=0.01
No dataNo dataNo dataOPT
f=200
TT=0.064
T1=0.02
No dataNo dataOPT
f=200
TT=0.064
T1=0.02
No dataNo dataNo dataOPT
f=200
TT=0.683
T1=0.72
OPT
f=200
TT=0.496
T1=0.27
OPT
f=200
TT=0.424
T1=0.25
OPT
f=200
TT=1.378
T1=1.25
OPT
f=200
TT=1.338
T1=1.22
OPT
f=200
TT=54.582
T1=53.91
OPT
f=200
TT=0.052
T1=0.04
OPT
f=200
TT=0.052
T1=0.04
?

TT=1799.64

No dataNo data?

TT=1799.9

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-200-6_0-yes1-1.opb
OPT
f=200
TT=0.007
T1=0
OPT
f=200
TT=0.036
T1=0.03
No dataOPT
f=200
TT=0.007
T1=0
OPT
f=200
TT=0.251
T1=0.03
OPT
f=200
TT=0.281
T1=0.04
OPT
f=200
TT=0.159
T1=0.02
OPT
f=200
TT=0.205
T1=0.03
OPT
f=200
TT=0.047
T1=0.02
OPT
f=200
TT=0.063
T1=0.03
OPT
f=200
TT=0.049
T1=0.02
OPT
f=200
TT=0.06
T1=0.03
OPT
f=200
TT=0.038
T1=0.04
OPT
f=200
TT=0.029
T1=0.02
OPT
f=200
TT=0.101
T1=0.07
OPT
f=200
TT=0.02
T1=0.02
OPT
f=200
TT=0.685
T1=0.33
OPT
f=200
TT=0.04
T1=0.03
OPT
f=200
TT=0.674
T1=0.31
OPT
f=200
TT=73.374
T1=73.38
No dataOPT
f=200
TT=833.8
T1=234.7
OPT
f=200
TT=0.913
T1=1.24
OPT
f=200
TT=2.28
T1=2.23
No dataOPT
f=200
TT=0.803
T1=0.77
OPT
f=200
TT=1.081
T1=0.94
OPT
f=200
TT=0.011
T1=0.01
OPT
f=200
TT=0.219
T1=0.02
OPT
f=200
TT=0.043
T1=0.01
No dataNo dataNo dataOPT
f=200
TT=0.066
T1=0.04
No dataNo dataOPT
f=200
TT=0.066
T1=0.03
No dataNo dataNo dataOPT
f=200
TT=0.933
T1=0.76
OPT
f=200
TT=0.512
T1=0.28
OPT
f=200
TT=0.553
T1=0.32
OPT
f=200
TT=1.5
T1=1.3
OPT
f=200
TT=1.59
T1=1.39
OPT
f=200
TT=44.573
T1=35.54
OPT
f=200
TT=0.05
T1=0.04
OPT
f=200
TT=0.051
T1=0.04
?

TT=1799.86

No dataNo data?

TT=1799.59

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-200-6_0-yes1-4.opb
OPT
f=200
TT=0.004
T1=0
OPT
f=200
TT=0.067
T1=0.06
No dataOPT
f=200
TT=0.004
T1=0
OPT
f=200
TT=0.258
T1=0.03
OPT
f=200
TT=0.257
T1=0.04
OPT
f=200
TT=0.19
T1=0.02
OPT
f=200
TT=0.177
T1=0.03
OPT
f=200
TT=0.052
T1=0.02
OPT
f=200
TT=0.054
T1=0.03
OPT
f=200
TT=0.054
T1=0.03
OPT
f=200
TT=0.057
T1=0.03
OPT
f=200
TT=0.014
T1=0.01
OPT
f=200
TT=0.072
T1=0.02
OPT
f=200
TT=0.098
T1=0.08
OPT
f=200
TT=0.012
T1=0.01
OPT
f=200
TT=0.605
T1=0.3
OPT
f=200
TT=0.031
T1=0.03
OPT
f=200
TT=0.605
T1=0.32
OPT
f=200
TT=106.178
T1=96.42
No dataOPT
f=200
TT=46.314
T1=15.22
OPT
f=200
TT=0.993
T1=1.25
OPT
f=200
TT=2.509
T1=2.32
No dataOPT
f=200
TT=0.983
T1=0.8
OPT
f=200
TT=1.597
T1=1.4
OPT
f=200
TT=0.023
T1=0.02
OPT
f=200
TT=0.217
T1=0.01
OPT
f=200
TT=0.051
T1=0.02
No dataNo dataNo dataOPT
f=200
TT=0.047
T1=0.02
No dataNo dataOPT
f=200
TT=0.046
T1=0.02
No dataNo dataNo dataOPT
f=200
TT=0.933
T1=0.76
OPT
f=200
TT=0.614
T1=0.31
OPT
f=200
TT=0.546
T1=0.32
OPT
f=200
TT=1.444
T1=1.25
OPT
f=200
TT=1.438
T1=1.24
OPT
f=200
TT=113.864
T1=113.88
OPT
f=200
TT=0.077
T1=0.06
OPT
f=200
TT=0.076
T1=0.06
?

TT=1799.59

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-aim-50-1_6-yes1-1.opb
OPT
f=50
TT=0.002
T1=0
OPT
f=50
TT=0.002
T1=0
No dataOPT
f=50
TT=0.003
T1=0
OPT
f=50
TT=0.083
T1=0.02
OPT
f=50
TT=0.09
T1=0.03
OPT
f=50
TT=0.036
T1=0.01
OPT
f=50
TT=0.047
T1=0.02
OPT
f=50
TT=0.018
T1=0.01
OPT
f=50
TT=0.023
T1=0.02
OPT
f=50
TT=0.018
T1=0.01
OPT
f=50
TT=0.029
T1=0.02
OPT
f=50
TT=0.005
T1=0
OPT
f=50
TT=0.005
T1=0
OPT
f=50
TT=0.028
T1=0.02
OPT
f=50
TT=0.003
T1=0
OPT
f=50
TT=0.183
T1=0.13
OPT
f=50
TT=0.001
T1=0
OPT
f=50
TT=0.184
T1=0.14
OPT
f=50
TT=0.563
T1=0.55
No dataOPT
f=50
TT=0.052
T1=0.05
OPT
f=50
TT=0.224
T1=1.16
OPT
f=50
TT=0.049
T1=0.04
No dataOPT
f=50
TT=0.223
T1=0.68
OPT
f=50
TT=0.053
T1=0.04
OPT
f=50
TT=0.006
T1=0
OPT
f=50
TT=0.044
T1=0
OPT
f=50
TT=0.016
T1=0
No dataNo dataNo dataOPT
f=50
TT=0.002
T1=0
No dataNo dataOPT
f=50
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=50
TT=0.184
T1=0.63
OPT
f=50
TT=0.174
T1=0.15
OPT
f=50
TT=0.214
T1=0.16
OPT
f=50
TT=0.064
T1=0.05
OPT
f=50
TT=0.061
T1=0.05
OPT
f=50
TT=0.465
T1=0.45
OPT
f=50
TT=0.007
T1=0.01
OPT
f=50
TT=0.007
T1=0
?

TT=1799.56

No dataNo data?

TT=1799.84

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-hanoi5.opb
OPT
f=1931
TT=1.109
T1=0.86
OPT
f=1931
TT=739.449
T1=552.53
No dataOPT
f=1931
TT=1.109
T1=1.09
? (TO)

TT=1800.43

? (TO)

TT=1800.11

? (problem)

TT=1.31

? (TO)

TT=1800.09

? (problem)

TT=1.32

OPT
f=1931
TT=3.628
T1=1.01
? (problem)

TT=1.33

OPT
f=1931
TT=3.716
T1=1.07
OPT
f=1931
TT=343.863
T1=300.86
OPT
f=1931
TT=5.841
T1=4.61
OPT
f=1931
TT=88.299
T1=39.41
OPT
f=1931
TT=1485.61
T1=19.31
OPT
f=1931
TT=409.423
T1=313.11
OPT
f=1931
TT=469.43
T1=450.3
OPT
f=1931
TT=19.944
T1=14.2
?

TT=1795.15

No data? (TO)

TT=1800.17

OPT
f=1931
TT=12.972
T1=5.46
?

TT=1789.76

No dataOPT
f=1931
TT=12.103
T1=4.5
?

TT=1796.76

OPT
f=1931
TT=3.087
T1=3.08
? (TO)

TT=1800.13

OPT
f=1931
TT=3.788
T1=0.86
No dataNo dataNo dataOPT
f=1931
TT=11.582
T1=5.8
No dataNo dataOPT
f=1931
TT=11.076
T1=5.55
No dataNo dataNo dataOPT
f=1931
TT=8.904
T1=3.52
OPT
f=1931
TT=9.293
T1=7.03
OPT
f=1931
TT=6.403
T1=4.97
?

TT=1796.76

?

TT=1796.77

?

TT=1796.77

OPT
f=1931
TT=133.327
T1=121
OPT
f=1931
TT=132.624
T1=120.24
?

TT=1799.97

No dataNo data?

TT=1799.95

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii16c1.opb
SAT
f=1284
TT=1800.17
T1=900.41
SAT
f=1369
TT=1797.89
T1=72.7
No dataSAT (TO)
f=1356
TT=1800.12
T1=677.85
? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.08

SAT (TO)
f=1386
TT=1800.03
T1=40.31
SAT (TO)
f=1422
TT=1800.02
T1=0.3
SAT (TO)
f=1457
TT=1801.94
T1=1729.84
SAT
f=1377
TT=1783.01
T1=848.11
No Cert.

TT=97.26

SAT
f=1369
TT=1798
T1=69.71
SAT (TO)
f=1323
TT=1800.08
T1=30.05
SAT
f=1235
TT=1796.59
T1=667.2
No data? (TO)

TT=1800.24

SAT (TO)
f=1377
TT=1800.19
T1=88.65
SAT
f=1339
TT=1789.86
T1=1082.74
No dataSAT (TO)
f=1381
TT=1800.21
T1=52.76
SAT
f=1331
TT=1796.79
T1=637.11
SAT (TO)
f=1422
TT=1800.1
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=1298
TT=1800.19
T1=900.41
No dataNo dataSAT (TO)
f=1284
TT=1800.17
T1=900.41
No dataNo dataNo dataSAT (TO)
f=1425
TT=1800.19
T1=1
SAT (TO)
f=1424
TT=1800.05
T1=557.26
SAT (TO)
f=1423
TT=1800.02
T1=1092.53
SAT
f=1300
TT=1796.8
T1=751.02
SAT
f=1300
TT=1796.82
T1=719.95
SAT
f=1300
TT=1796.8
T1=761.03
? (TO)

TT=1800.04

? (TO)

TT=1800.04

?

TT=1799.57

No dataNo data?

TT=1799.88

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii32b1.opb
OPT
f=191
TT=9.328
T1=0.32
OPT
f=191
TT=1506.39
T1=12.02
No dataSAT (TO)
f=191
TT=1800.03
T1=1.75
OPT
f=191
TT=18.899
T1=12.48
OPT
f=191
TT=14.379
T1=14.48
OPT
f=191
TT=18.811
T1=12.47
OPT
f=191
TT=14.255
T1=14.25
OPT
f=191
TT=10.774
T1=4.33
OPT
f=191
TT=9.328
T1=2.54
OPT
f=191
TT=10.737
T1=4.07
OPT
f=191
TT=9.383
T1=2.58
SAT (TO)
f=191
TT=1800.02
T1=286.21
OPT
f=191
TT=14.803
T1=8.78
SAT (TO)
f=191
TT=1802.08
T1=2.89
OPT
f=191
TT=923.99
T1=0.32
SAT (TO)
f=191
TT=1800.03
T1=76.02
SAT
f=191
TT=1798.04
T1=82.22
SAT (TO)
f=191
TT=1800.29
T1=6.57
OPT
f=191
TT=36.909
T1=26.18
No dataOPT
f=191
TT=9.804
T1=5.69
SAT (TO)
f=191
TT=1800.26
T1=15.31
OPT
f=191
TT=37.845
T1=21.61
No dataSAT (TO)
f=191
TT=1800.02
T1=5.82
OPT
f=191
TT=30.733
T1=22.21
OPT
f=191
TT=11.067
T1=11.06
OPT
f=191
TT=18.932
T1=12.49
OPT
f=191
TT=10.57
T1=4.14
No dataNo dataNo dataOPT
f=191
TT=113.92
T1=57.02
No dataNo dataOPT
f=191
TT=100.293
T1=50.17
No dataNo dataNo dataSAT (TO)
f=192
TT=1800.07
T1=126.15
SAT (TO)
f=194
TT=1800.05
T1=1599.94
SAT (TO)
f=191
TT=1800.1
T1=9.12
OPT
f=191
TT=24.244
T1=14.53
OPT
f=191
TT=24.101
T1=14.44
OPT
f=191
TT=29.034
T1=21.23
? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.34

No dataNo data?

TT=1799.83

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii32d2.opb
OPT
f=372
TT=439.002
T1=0.2
SAT
f=372
TT=1798
T1=218.04
No dataSAT (TO)
f=372
TT=1800.02
T1=0.2
OPT
f=372
TT=1229.14
T1=488.46
OPT
f=372
TT=1771.63
T1=732.43
OPT
f=372
TT=1238.34
T1=498.19
? (TO)

TT=1800.03

OPT
f=372
TT=439.002
T1=18.66
OPT
f=372
TT=587.854
T1=18.6
OPT
f=372
TT=445.049
T1=19.78
OPT
f=372
TT=572.393
T1=18.94
SAT (TO)
f=372
TT=1800.11
T1=490.35
SAT (TO)
f=372
TT=1800.08
T1=54
SAT (TO)
f=372
TT=1802.06
T1=8.54
SAT
f=372
TT=1783.02
T1=46.22
? (exit code)

TT=860.69

SAT
f=372
TT=1798
T1=42.55
SAT (TO)
f=372
TT=1800.07
T1=10.25
SAT
f=372
TT=1799.68
T1=372.83
No data? (TO)

TT=1800

SAT (TO)
f=372
TT=1800.04
T1=19.39
SAT
f=372
TT=1789.78
T1=492.08
No dataSAT (TO)
f=372
TT=1800.6
T1=5.93
SAT
f=372
TT=1796.79
T1=272.59
SAT (TO)
f=372
TT=1800.08
T1=1800.4
OPT
f=372
TT=1341.64
T1=542.92
OPT
f=372
TT=461.608
T1=19.39
No dataNo dataNo dataSAT (TO)
f=372
TT=1800.45
T1=900.31
No dataNo dataSAT (TO)
f=372
TT=1800.51
T1=900.31
No dataNo dataNo dataSAT (TO)
f=372
TT=1800.62
T1=28
SAT (TO)
f=372
TT=1800.02
T1=8.19
SAT (TO)
f=372
TT=1800.04
T1=5.01
SAT
f=372
TT=1796.8
T1=610.25
SAT
f=372
TT=1796.79
T1=488.46
SAT
f=372
TT=1796.78
T1=127.92
? (TO)

TT=1800.08

? (TO)

TT=1800.11

?

TT=1799.45

No dataNo data?

TT=1799.52

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii32e1.opb
OPT
f=162
TT=7.736
T1=1.45
SAT
f=162
TT=1798.02
T1=33.61
No dataSAT (TO)
f=162
TT=1800.03
T1=11.41
OPT
f=162
TT=10.805
T1=5.64
OPT
f=162
TT=11.926
T1=6.87
OPT
f=162
TT=10.839
T1=5.68
OPT
f=162
TT=11.513
T1=6.56
OPT
f=162
TT=8.089
T1=2.67
OPT
f=162
TT=7.955
T1=2.91
OPT
f=162
TT=8.152
T1=2.71
OPT
f=162
TT=8.349
T1=3.08
OPT
f=162
TT=187.048
T1=14.63
OPT
f=162
TT=10.458
T1=3.7
SAT (TO)
f=175
TT=1802.13
T1=86.39
SAT
f=162
TT=1783
T1=6.11
No Cert.

TT=1207.61

SAT
f=162
TT=1798
T1=24.09
SAT (TO)
f=163
TT=1800.06
T1=84.71
OPT
f=162
TT=40.709
T1=8.31
No dataOPT
f=162
TT=17.659
T1=9.13
SAT (TO)
f=162
TT=1800.08
T1=14.27
OPT
f=162
TT=33.626
T1=1.45
No dataSAT (TO)
f=162
TT=1800.06
T1=7.32
OPT
f=162
TT=30.569
T1=11.05
OPT
f=162
TT=7.736
T1=7.73
OPT
f=162
TT=11.058
T1=5.98
OPT
f=162
TT=7.856
T1=2.66
No dataNo dataNo dataOPT
f=162
TT=85.553
T1=42.78
No dataNo dataOPT
f=162
TT=101.052
T1=50.52
No dataNo dataNo dataSAT (TO)
f=167
TT=1800.04
T1=649.39
SAT (TO)
f=169
TT=1800.08
T1=985.1
SAT (TO)
f=162
TT=1800.03
T1=224.1
OPT
f=162
TT=26.047
T1=5.56
OPT
f=162
TT=27.414
T1=5.85
OPT
f=162
TT=31.996
T1=4.06
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.44

No dataNo data?

TT=1799.33

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii8a2.opb
OPT
f=139
TT=5.854
T1=0.78
SAT
f=141
TT=1798
T1=673.79
No dataSAT (TO)
f=142
TT=1800.03
T1=473.09
? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.06

SAT (TO)
f=146
TT=1800.02
T1=0.58
SAT (TO)
f=139
TT=1800.02
T1=57.46
SAT (TO)
f=149
TT=1802.07
T1=150.98
SAT
f=139
TT=1783.01
T1=0.78
SAT (TO)
f=141
TT=1800.02
T1=0.43
SAT
f=139
TT=1798
T1=1678.25
SAT (TO)
f=146
TT=1800.83
T1=1.99
OPT
f=139
TT=39.177
T1=13.4
No dataOPT
f=139
TT=5.854
T1=2.98
SAT (TO)
f=141
TT=1800.4
T1=4.23
OPT
f=139
TT=46.189
T1=11.26
No dataSAT (TO)
f=144
TT=1800.06
T1=43.01
OPT
f=139
TT=32.61
T1=10.72
SAT (TO)
f=139
TT=1800.11
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=139
TT=1800.45
T1=900.31
No dataNo dataSAT (TO)
f=139
TT=1800.32
T1=900.31
No dataNo dataNo dataSAT (TO)
f=142
TT=1800.09
T1=566.37
SAT (TO)
f=143
TT=1800.06
T1=44.82
SAT (TO)
f=147
TT=1800.06
T1=142.12
OPT
f=139
TT=72.147
T1=10.79
OPT
f=139
TT=71.591
T1=10.78
OPT
f=139
TT=31.346
T1=10.37
? (TO)

TT=1800.09

? (TO)

TT=1800.11

?

TT=1799.48

No dataNo data?

TT=1799.8

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii8a4.opb
OPT
f=283
TT=1.595
T1=1.36
SAT
f=289
TT=1798
T1=1652.82
No dataSAT (TO)
f=294
TT=1800.12
T1=1696.72
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.14

? (TO)

TT=1800.09

? (TO)

TT=1800.12

SAT (TO)
f=328
TT=1800.11
T1=0.09
SAT (TO)
f=283
TT=1800.11
T1=1.36
SAT (TO)
f=364
TT=1800.15
T1=1458.45
SAT
f=288
TT=1783.01
T1=1.14
? (exit code)

TT=698.738

SAT
f=307
TT=1798
T1=470.37
SAT (TO)
f=318
TT=1800.73
T1=0.8
OPT
f=283
TT=428.553
T1=58.81
No dataOPT
f=283
TT=1.595
T1=1.59
SAT (TO)
f=310
TT=1800.52
T1=8.31
OPT
f=283
TT=470.056
T1=47.14
No dataSAT (TO)
f=321
TT=1800.18
T1=95.31
OPT
f=283
TT=316.376
T1=111.89
SAT (TO)
f=283
TT=1800.1
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=283
TT=1800.18
T1=900.41
No dataNo dataSAT (TO)
f=283
TT=1800.46
T1=900.31
No dataNo dataNo dataSAT (TO)
f=312
TT=1800.65
T1=139.48
SAT (TO)
f=312
TT=1800.06
T1=674.73
SAT (TO)
f=333
TT=1800.63
T1=40.35
OPT
f=283
TT=13.534
T1=13.52
OPT
f=283
TT=13.029
T1=13.01
OPT
f=283
TT=10.431
T1=10.28
? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.5

No dataNo data?

TT=1799.39

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-ii8e1.opb
OPT
f=343
TT=18.676
T1=8.48
SAT
f=383
TT=1798
T1=0.12
No dataSAT (TO)
f=379
TT=1800.02
T1=716.13
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.08

SAT (TO)
f=409
TT=1800.1
T1=0.1
SAT (TO)
f=357
TT=1800.09
T1=36.38
SAT (TO)
f=464
TT=1802.08
T1=1431.43
SAT
f=343
TT=1783.01
T1=33.13
? (exit code)

TT=693.298

SAT
f=381
TT=1798
T1=19.45
SAT (TO)
f=424
TT=1801.16
T1=99.2
SAT
f=343
TT=1798.24
T1=1158.26
No dataOPT
f=343
TT=18.676
T1=12.22
SAT (TO)
f=394
TT=1800.16
T1=13.37
SAT
f=343
TT=1789.79
T1=134.7
No dataSAT (TO)
f=405
TT=1800.08
T1=113.25
SAT
f=343
TT=1796.78
T1=108.48
SAT (TO)
f=343
TT=1800.03
T1=1800.4
? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=343
TT=1800.03
T1=900.41
No dataNo dataSAT (TO)
f=343
TT=1800.08
T1=900.41
No dataNo dataNo dataSAT (TO)
f=418
TT=1800.54
T1=282.82
SAT (TO)
f=419
TT=1800.49
T1=221.36
SAT (TO)
f=414
TT=1800.03
T1=0.63
SAT
f=343
TT=1796.77
T1=74.64
SAT
f=343
TT=1796.81
T1=74.24
SAT
f=343
TT=1796.75
T1=8.48
? (TO)

TT=1800.09

? (TO)

TT=1800.08

?

TT=1799.8

No dataNo data?

TT=1799.41

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-jnh12.opb
OPT
f=94
TT=0.003
T1=0
OPT
f=94
TT=0.005
T1=0
No dataOPT
f=94
TT=0.003
T1=0
OPT
f=94
TT=0.218
T1=0.22
OPT
f=94
TT=0.191
T1=0.19
OPT
f=94
TT=0.125
T1=0.12
OPT
f=94
TT=0.103
T1=0.1
OPT
f=94
TT=0.089
T1=0.07
OPT
f=94
TT=0.069
T1=0.06
OPT
f=94
TT=0.085
T1=0.07
OPT
f=94
TT=0.074
T1=0.06
OPT
f=94
TT=0.009
T1=0.01
OPT
f=94
TT=0.049
T1=0.03
OPT
f=94
TT=0.161
T1=0.14
OPT
f=94
TT=0.014
T1=0.01
OPT
f=94
TT=0.414
T1=0.26
OPT
f=94
TT=0.006
T1=0
OPT
f=94
TT=0.435
T1=0.26
OPT
f=94
TT=0.056
T1=0.05
No dataOPT
f=94
TT=0.105
T1=0.1
OPT
f=94
TT=0.514
T1=1.24
OPT
f=94
TT=0.052
T1=0.04
No dataOPT
f=94
TT=0.524
T1=0.76
OPT
f=94
TT=0.049
T1=0.04
OPT
f=94
TT=0.012
T1=0.01
OPT
f=94
TT=0.12
T1=0.12
OPT
f=94
TT=0.078
T1=0.06
No dataNo dataNo dataOPT
f=94
TT=0.004
T1=0.01
No dataNo dataOPT
f=94
TT=0.005
T1=0.01
No dataNo dataNo dataOPT
f=94
TT=0.524
T1=1.75
OPT
f=94
TT=0.413
T1=0.27
OPT
f=94
TT=0.435
T1=0.26
OPT
f=94
TT=0.059
T1=0.05
OPT
f=94
TT=0.072
T1=0.06
OPT
f=94
TT=0.071
T1=0.06
OPT
f=94
TT=0.038
T1=0.03
OPT
f=94
TT=0.042
T1=0.03
?

TT=1799.63

No dataNo data?

TT=1800

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-jnh17.opb
OPT
f=95
TT=0.005
T1=0
OPT
f=95
TT=0.406
T1=0.13
No dataOPT
f=95
TT=0.005
T1=0
OPT
f=95
TT=0.258
T1=0.25
OPT
f=95
TT=0.205
T1=0.18
OPT
f=95
TT=0.147
T1=0.15
OPT
f=95
TT=0.129
T1=0.11
OPT
f=95
TT=0.139
T1=0.12
OPT
f=95
TT=0.094
T1=0.08
OPT
f=95
TT=0.135
T1=0.11
OPT
f=95
TT=0.095
T1=0.08
OPT
f=95
TT=2.049
T1=0.55
OPT
f=95
TT=0.076
T1=0.05
OPT
f=95
TT=0.113
T1=0.1
OPT
f=95
TT=0.017
T1=0.01
OPT
f=95
TT=0.595
T1=0.3
OPT
f=95
TT=0.409
T1=0.13
OPT
f=95
TT=0.626
T1=0.32
OPT
f=95
TT=5.207
T1=0.96
No dataOPT
f=95
TT=0.727
T1=0.64
OPT
f=95
TT=0.944
T1=4.24
OPT
f=95
TT=0.247
T1=0.23
No dataOPT
f=95
TT=0.744
T1=2.26
OPT
f=95
TT=2.387
T1=0.21
OPT
f=95
TT=0.023
T1=0.02
OPT
f=95
TT=0.158
T1=0.16
OPT
f=95
TT=0.151
T1=0.13
No dataNo dataNo dataOPT
f=95
TT=0.045
T1=0.02
No dataNo dataOPT
f=95
TT=0.045
T1=0.02
No dataNo dataNo dataOPT
f=95
TT=0.674
T1=2.75
OPT
f=95
TT=0.565
T1=0.29
OPT
f=95
TT=0.603
T1=0.27
OPT
f=95
TT=0.258
T1=0.24
OPT
f=95
TT=0.226
T1=0.2
OPT
f=95
TT=4.362
T1=2.62
OPT
f=95
TT=0.054
T1=0.03
OPT
f=95
TT=0.055
T1=0.03
?

TT=1799.58

No dataNo data?

TT=1799.57

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-jnh1.opb
OPT
f=92
TT=0.018
T1=0
OPT
f=92
TT=5.867
T1=1.35
No dataOPT
f=92
TT=0.018
T1=0
OPT
f=92
TT=0.383
T1=0.38
OPT
f=92
TT=0.323
T1=0.27
OPT
f=92
TT=0.287
T1=0.29
OPT
f=92
TT=0.243
T1=0.19
OPT
f=92
TT=0.295
T1=0.24
OPT
f=92
TT=0.224
T1=0.17
OPT
f=92
TT=0.307
T1=0.24
OPT
f=92
TT=0.234
T1=0.18
OPT
f=92
TT=43.499
T1=3.72
OPT
f=92
TT=0.153
T1=0.09
OPT
f=92
TT=0.252
T1=0.22
OPT
f=92
TT=0.183
T1=0.01
OPT
f=92
TT=0.685
T1=0.34
OPT
f=92
TT=5.564
T1=1.28
OPT
f=92
TT=0.735
T1=0.36
OPT
f=92
TT=18.711
T1=18.16
No dataOPT
f=92
TT=3.111
T1=1.71
OPT
f=92
TT=1.154
T1=5.24
OPT
f=92
TT=0.656
T1=0.63
No dataOPT
f=92
TT=1.023
T1=2.78
OPT
f=92
TT=12.282
T1=0.62
OPT
f=92
TT=0.07
T1=0.07
OPT
f=92
TT=0.296
T1=0.29
OPT
f=92
TT=0.262
T1=0.19
No dataNo dataNo dataOPT
f=92
TT=0.186
T1=0.09
No dataNo dataOPT
f=92
TT=0.205
T1=0.09
No dataNo dataNo dataOPT
f=92
TT=1.275
T1=3.75
OPT
f=92
TT=0.883
T1=0.38
OPT
f=92
TT=0.856
T1=0.4
OPT
f=92
TT=0.816
T1=0.79
OPT
f=92
TT=0.703
T1=0.67
OPT
f=92
TT=11.924
T1=7.6
OPT
f=92
TT=0.217
T1=0.1
OPT
f=92
TT=0.216
T1=0.1
?

TT=1799.88

No dataNo data?

TT=1799.72

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-jnh217.opb
OPT
f=89
TT=0.08
T1=0.07
OPT
f=89
TT=48.34
T1=25.06
No dataOPT
f=89
TT=0.08
T1=0.07
OPT
f=89
TT=1.009
T1=1.01
OPT
f=89
TT=0.845
T1=0.83
OPT
f=89
TT=0.888
T1=0.89
OPT
f=89
TT=0.739
T1=0.74
OPT
f=89
TT=0.842
T1=0.57
OPT
f=89
TT=0.584
T1=0.33
OPT
f=89
TT=0.839
T1=0.56
OPT
f=89
TT=0.584
T1=0.34
OPT
f=89
TT=414.576
T1=341.85
OPT
f=89
TT=0.73
T1=0.37
OPT
f=89
TT=0.617
T1=0.41
OPT
f=89
TT=1.369
T1=0.51
OPT
f=89
TT=1.014
T1=0.49
OPT
f=89
TT=60.613
T1=54.26
OPT
f=89
TT=1.136
T1=0.55
OPT
f=89
TT=34.913
T1=30.55
No dataOPT
f=89
TT=88.999
T1=31.56
OPT
f=89
TT=2.017
T1=5.24
OPT
f=89
TT=40.295
T1=19.71
No dataOPT
f=89
TT=2.004
T1=3.77
OPT
f=89
TT=24.014
T1=15.53
OPT
f=89
TT=0.428
T1=0.42
OPT
f=89
TT=0.903
T1=0.9
OPT
f=89
TT=0.935
T1=0.77
No dataNo dataNo dataOPT
f=89
TT=0.926
T1=0.46
No dataNo dataOPT
f=89
TT=0.985
T1=0.49
No dataNo dataNo dataOPT
f=89
TT=2.474
T1=4.74
OPT
f=89
TT=1.064
T1=0.5
OPT
f=89
TT=1.055
T1=0.5
OPT
f=89
TT=21.691
T1=18.21
OPT
f=89
TT=21.807
T1=18.34
OPT
f=89
TT=21.995
T1=20.03
OPT
f=89
TT=1.933
T1=0.78
OPT
f=89
TT=2.04
T1=0.83
?

TT=1799.58

No dataNo data?

TT=1799.53

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-jnh301.opb
OPT
f=95
TT=0.007
T1=0
OPT
f=95
TT=0.914
T1=0.07
No dataOPT
f=95
TT=0.007
T1=0
OPT
f=95
TT=0.294
T1=0.28
OPT
f=95
TT=0.242
T1=0.23
OPT
f=95
TT=0.182
T1=0.18
OPT
f=95
TT=0.141
T1=0.14
OPT
f=95
TT=0.184
T1=0.16
OPT
f=95
TT=0.126
T1=0.1
OPT
f=95
TT=0.182
T1=0.16
OPT
f=95
TT=0.123
T1=0.1
OPT
f=95
TT=10.768
T1=0.08
OPT
f=95
TT=0.054
T1=0.04
OPT
f=95
TT=0.164
T1=0.15
OPT
f=95
TT=0.02
T1=0.02
OPT
f=95
TT=0.577
T1=0.31
OPT
f=95
TT=0.919
T1=0.07
OPT
f=95
TT=0.603
T1=0.3
OPT
f=95
TT=18.035
T1=6.68
No dataOPT
f=95
TT=2.05
T1=1.45
OPT
f=95
TT=0.945
T1=1.23
OPT
f=95
TT=0.464
T1=0.42
No dataOPT
f=95
TT=0.905
T1=0.77
OPT
f=95
TT=0.609
T1=0.58
OPT
f=95
TT=0.019
T1=0.01
OPT
f=95
TT=0.185
T1=0.18
OPT
f=95
TT=0.17
T1=0.14
No dataNo dataNo dataOPT
f=95
TT=0.045
T1=0.01
No dataNo dataOPT
f=95
TT=0.045
T1=0.01
No dataNo dataNo dataOPT
f=95
TT=0.865
T1=2.26
OPT
f=95
TT=0.625
T1=0.28
OPT
f=95
TT=0.644
T1=0.33
OPT
f=95
TT=0.583
T1=0.56
OPT
f=95
TT=0.586
T1=0.56
OPT
f=95
TT=12.024
T1=11.76
OPT
f=95
TT=0.07
T1=0.04
OPT
f=95
TT=0.069
T1=0.05
?

TT=1799.63

No dataNo data?

TT=1799.6

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-par16-1-c.opb
OPT
f=317
TT=0.197
T1=0.12
OPT
f=317
TT=3.58
T1=0.27
No dataOPT
f=317
TT=0.197
T1=0.12
OPT
f=317
TT=7.298
T1=0.18
OPT
f=317
TT=7.324
T1=0.19
OPT
f=317
TT=7.293
T1=0.18
OPT
f=317
TT=7.351
T1=0.18
OPT
f=317
TT=1.253
T1=0.18
OPT
f=317
TT=1.245
T1=0.18
OPT
f=317
TT=1.325
T1=0.18
OPT
f=317
TT=1.248
T1=0.18
OPT
f=317
TT=2.59
T1=0.23
OPT
f=317
TT=0.612
T1=0.16
OPT
f=317
TT=0.911
T1=0.41
OPT
f=317
TT=1.126
T1=0.52
OPT
f=317
TT=1.142
T1=0.56
OPT
f=317
TT=3.246
T1=0.23
OPT
f=317
TT=1.512
T1=0.49
OPT
f=317
TT=505.537
T1=485.52
No dataOPT
f=317
TT=98.906
T1=31.98
OPT
f=317
TT=3.235
T1=1.26
OPT
f=317
TT=222.349
T1=124.16
No dataOPT
f=317
TT=2.752
T1=1.29
OPT
f=317
TT=211.308
T1=203.82
OPT
f=317
TT=0.407
T1=0.4
OPT
f=317
TT=6.66
T1=0.14
OPT
f=317
TT=0.95
T1=0.15
No dataNo dataNo dataOPT
f=317
TT=1.706
T1=0.85
No dataNo dataOPT
f=317
TT=1.687
T1=0.84
No dataNo dataNo dataOPT
f=317
TT=2.704
T1=0.75
OPT
f=317
TT=1.404
T1=0.81
OPT
f=317
TT=1.304
T1=0.63
OPT
f=317
TT=78.021
T1=54.24
OPT
f=317
TT=77.658
T1=53.84
OPT
f=317
TT=95.234
T1=70.14
OPT
f=317
TT=1.925
T1=1.8
OPT
f=317
TT=1.924
T1=1.79
?

TT=1799.49

No dataNo data?

TT=1799.81

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-par16-3.opb
OPT
f=1015
TT=0.41
T1=0.19
OPT
f=1015
TT=4.656
T1=2.42
No dataOPT
f=1015
TT=0.443
T1=0.3
OPT
f=1015
TT=24.2
T1=0.2
OPT
f=1015
TT=24.053
T1=0.21
OPT
f=1015
TT=23.672
T1=0.19
OPT
f=1015
TT=25.829
T1=0.21
OPT
f=1015
TT=3.575
T1=0.19
OPT
f=1015
TT=3.397
T1=0.22
OPT
f=1015
TT=3.6
T1=0.19
OPT
f=1015
TT=3.548
T1=0.21
OPT
f=1015
TT=4.449
T1=1.49
OPT
f=1015
TT=0.805
T1=0.41
OPT
f=1015
TT=1.385
T1=0.59
OPT
f=1015
TT=10.385
T1=1.98
OPT
f=1015
TT=1.574
T1=0.92
OPT
f=1015
TT=4.067
T1=0.77
OPT
f=1015
TT=2.094
T1=0.89
OPT
f=1015
TT=1475.57
T1=1475.79
No dataOPT
f=1015
TT=117.922
T1=35.99
OPT
f=1015
TT=3.573
T1=1.35
OPT
f=1015
TT=591.857
T1=586.1
No dataOPT
f=1015
TT=3.806
T1=0.86
OPT
f=1015
TT=167.197
T1=147.24
OPT
f=1015
TT=0.41
T1=0.4
OPT
f=1015
TT=25.737
T1=0.19
OPT
f=1015
TT=3.586
T1=0.19
No dataNo dataNo dataSignal

TT=1.737

No dataNo dataOPT
f=1015
TT=1.698
T1=0.85
No dataNo dataNo dataOPT
f=1015
TT=3.804
T1=0.84
OPT
f=1015
TT=2.043
T1=0.64
OPT
f=1015
TT=1.945
T1=0.96
OPT
f=1015
TT=202.714
T1=167.42
OPT
f=1015
TT=217.48
T1=214.87
OPT
f=1015
TT=266.653
T1=173.71
OPT
f=1015
TT=7.289
T1=2.3
OPT
f=1015
TT=7.078
T1=2.15
OPT
f=1015
TT=3.451
T1=3.44
No dataNo dataOPT
f=1015
TT=3.441
T1=3.44
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-par16-5.opb
OPT
f=1015
TT=0.337
T1=0.09
OPT
f=1015
TT=1.718
T1=0.94
No dataOPT
f=1015
TT=0.337
T1=0.09
OPT
f=1015
TT=27.914
T1=0.15
OPT
f=1015
TT=27.378
T1=0.15
OPT
f=1015
TT=27.32
T1=0.13
OPT
f=1015
TT=26.86
T1=0.15
OPT
f=1015
TT=3.953
T1=0.14
OPT
f=1015
TT=4.03
T1=0.15
OPT
f=1015
TT=4.041
T1=0.14
OPT
f=1015
TT=3.94
T1=0.15
OPT
f=1015
TT=3.82
T1=0.94
OPT
f=1015
TT=0.742
T1=0.36
OPT
f=1015
TT=1.091
T1=0.31
OPT
f=1015
TT=2.676
T1=1.5
OPT
f=1015
TT=1.743
T1=0.58
OPT
f=1015
TT=2.025
T1=1.25
OPT
f=1015
TT=2.284
T1=0.86
OPT
f=1015
TT=432.501
T1=399.53
No dataOPT
f=1015
TT=122.617
T1=37.28
OPT
f=1015
TT=4.023
T1=1.32
OPT
f=1015
TT=880.11
T1=858.29
No dataOPT
f=1015
TT=4.472
T1=1.36
OPT
f=1015
TT=240.173
T1=156.35
OPT
f=1015
TT=0.373
T1=0.37
OPT
f=1015
TT=26.46
T1=0.18
OPT
f=1015
TT=3.886
T1=0.18
No dataNo dataNo dataOPT
f=1015
TT=1.876
T1=0.95
No dataNo dataOPT
f=1015
TT=2.293
T1=1.15
No dataNo dataNo dataOPT
f=1015
TT=3.953
T1=1.83
OPT
f=1015
TT=2.105
T1=0.78
OPT
f=1015
TT=2.075
T1=1.05
OPT
f=1015
TT=82.67
T1=10.31
OPT
f=1015
TT=83.22
T1=9.96
OPT
f=1015
TT=114.83
T1=62.57
OPT
f=1015
TT=3.866
T1=3.56
OPT
f=1015
TT=3.793
T1=3.49
OPT
f=1015
TT=0.962
T1=0.95
No dataNo dataOPT
f=1015
TT=0.952
T1=0.95
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-par32-1.opb




?

TT=1798

No data? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1802.08

? (TO)

TT=1800.02

? (TO)

TT=1800.01

?

TT=1798

? (TO)

TT=1800.64

?

TT=1798.49

No data? (TO)

TT=1800.17

? (TO)

TT=1800.15

?

TT=1789.77

No data? (TO)

TT=1800.84

?

TT=1796.79

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.2

No dataNo data? (TO)

TT=1800.16

No dataNo dataNo data? (TO)

TT=1800.17

? (TO)

TT=1800

? (TO)

TT=1800.59

?

TT=1796.79

?

TT=1796.78

?

TT=1796.72

? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.37

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-par32-3.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1802.1

? (TO)

TT=1800.02

? (TO)

TT=1800.51

?

TT=1798

? (TO)

TT=1800.6

?

TT=1799.57

No data? (TO)

TT=1800.35

? (TO)

TT=1800.16

?

TT=1789.96

No data? (TO)

TT=1800.15

?

TT=1796.77

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.12

No dataNo dataNo data? (TO)

TT=1800.18

No dataNo data? (TO)

TT=1800.17

No dataNo dataNo data? (TO)

TT=1801.02

? (TO)

TT=1800.09

? (TO)

TT=1800.08

?

TT=1796.76

?

TT=1796.74

?

TT=1796.74

? (TO)

TT=1800.01

? (TO)

TT=1800.1

?

TT=1799.57

No dataNo data?

TT=1799.58

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-par32-5.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1802.11

? (TO)

TT=1800.02

? (TO)

TT=1800.04

?

TT=1798

? (TO)

TT=1800.08

?

TT=1797.48

No data? (TO)

TT=1800.02

? (TO)

TT=1800.16

?

TT=1789.84

No data? (TO)

TT=1800.03

?

TT=1796.77

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.12

No dataNo dataNo data? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.18

No dataNo dataNo data? (TO)

TT=1800.48

? (TO)

TT=1800.82

? (TO)

TT=1800.06

?

TT=1796.73

?

TT=1796.76

?

TT=1796.76

? (TO)

TT=1800.09

? (TO)

TT=1800.11

?

TT=1799.6

No dataNo data?

TT=1799.95

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/primes-dimacs-cnf/
normalized-par8-1-c.opb
OPT
f=64
TT=0.002
T1=0
OPT
f=64
TT=0.004
T1=0
No dataOPT
f=64
TT=0.003
T1=0
OPT
f=64
TT=0.096
T1=0.02
OPT
f=64
TT=0.11
T1=0.03
OPT
f=64
TT=0.048
T1=0.01
OPT
f=64
TT=0.054
T1=0.02
OPT
f=64
TT=0.021
T1=0.01
OPT
f=64
TT=0.029
T1=0.02
OPT
f=64
TT=0.021
T1=0.01
OPT
f=64
TT=0.027
T1=0.02
OPT
f=64
TT=0.006
T1=0
OPT
f=64
TT=0.012
T1=0
OPT
f=64
TT=0.044
T1=0.03
OPT
f=64
TT=0.003
T1=0
OPT
f=64
TT=0.223
T1=0.16
OPT
f=64
TT=0.004
T1=0
OPT
f=64
TT=0.257
T1=0.16
OPT
f=64
TT=0.556
T1=0.54
No dataOPT
f=64
TT=0.125
T1=0.13
OPT
f=64
TT=0.323
T1=1.17
OPT
f=64
TT=0.059
T1=0.05
No dataOPT
f=64
TT=0.343
T1=0.69
OPT
f=64
TT=0.057
T1=0.04
OPT
f=64
TT=0.007
T1=0
OPT
f=64
TT=0.052
T1=0
OPT
f=64
TT=0.02
T1=0
No dataNo dataNo dataOPT
f=64
TT=0.004
T1=0
No dataNo dataOPT
f=64
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=64
TT=0.325
T1=0.66
OPT
f=64
TT=0.264
T1=0.21
OPT
f=64
TT=0.251
T1=0.46
OPT
f=64
TT=0.069
T1=0.06
OPT
f=64
TT=0.087
T1=0.07
OPT
f=64
TT=0.309
T1=0.3
OPT
f=64
TT=0.014
T1=0.01
OPT
f=64
TT=0.014
T1=0.01
OPT
f=64
TT=0.042
T1=0.03
No dataNo dataOPT
f=64
TT=0.042
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
primes-dimacs-cnf/normalized-par8-2.opb
OPT
f=350
TT=0.004
T1=0
OPT
f=350
TT=0.01
T1=0
No dataOPT
f=350
TT=0.004
T1=0
OPT
f=350
TT=0.493
T1=0.03
OPT
f=350
TT=0.467
T1=0.04
OPT
f=350
TT=0.384
T1=0.02
OPT
f=350
TT=0.418
T1=0.03
OPT
f=350
TT=0.079
T1=0.02
OPT
f=350
TT=0.081
T1=0.03
OPT
f=350
TT=0.075
T1=0.02
OPT
f=350
TT=0.086
T1=0.03
OPT
f=350
TT=0.012
T1=0.01
OPT
f=350
TT=0.051
T1=0.02
OPT
f=350
TT=0.106
T1=0.09
OPT
f=350
TT=0.017
T1=0.01
OPT
f=350
TT=0.485
T1=0.26
OPT
f=350
TT=0.008
T1=0
OPT
f=350
TT=0.505
T1=0.26
OPT
f=350
TT=0.385
T1=0.37
No dataOPT
f=350
TT=0.326
T1=0.32
OPT
f=350
TT=0.965
T1=1.25
OPT
f=350
TT=0.082
T1=0.07
No dataOPT
f=350
TT=0.714
T1=0.76
OPT
f=350
TT=0.092
T1=0.07
OPT
f=350
TT=0.014
T1=0.02
OPT
f=350
TT=0.485
T1=0.01
OPT
f=350
TT=0.079
T1=0.01
No dataNo dataNo dataOPT
f=350
TT=0.066
T1=0.03
No dataNo dataOPT
f=350
TT=0.067
T1=0.03
No dataNo dataNo dataOPT
f=350
TT=0.685
T1=0.78
OPT
f=350
TT=0.474
T1=0.24
OPT
f=350
TT=0.462
T1=0.25
OPT
f=350
TT=0.094
T1=0.08
OPT
f=350
TT=0.09
T1=0.07
OPT
f=350
TT=0.333
T1=0.32
OPT
f=350
TT=0.091
T1=0.07
OPT
f=350
TT=0.09
T1=0.07
OPT
f=350
TT=0.035
T1=0.03
No dataNo dataOPT
f=350
TT=0.034
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-1pb.opb
OPT
f=36
TT=0.003
T1=0
OPT
f=36
TT=0.01
T1=0.01
No dataOPT
f=36
TT=0.006
T1=0
OPT
f=36
TT=0.146
T1=0.04
OPT
f=36
TT=0.156
T1=0.05
OPT
f=36
TT=0.109
T1=0.04
OPT
f=36
TT=0.105
T1=0.04
OPT
f=36
TT=0.056
T1=0.04
OPT
f=36
TT=0.055
T1=0.04
OPT
f=36
TT=0.059
T1=0.04
OPT
f=36
TT=0.059
T1=0.04
OPT
f=36
TT=0.019
T1=0.01
OPT
f=36
TT=0.09
T1=0.04
OPT
f=36
TT=0.074
T1=0.05
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.483
T1=0.25
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.573
T1=0.22
OPT
f=36
TT=0.037
T1=0.03
No dataOPT
f=36
TT=0.019
T1=0.01
OPT
f=36
TT=0.875
T1=1.2
OPT
f=36
TT=0.033
T1=0.03
No dataOPT
f=36
TT=0.833
T1=0.71
OPT
f=36
TT=0.04
T1=0.03
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.109
T1=0.02
OPT
f=36
TT=0.043
T1=0.02
No dataNo dataNo dataOPT
f=36
TT=0.003
T1=0.01
No dataNo dataOPT
f=36
TT=0.004
T1=0.01
No dataNo dataNo dataOPT
f=36
TT=0.802
T1=0.73
OPT
f=36
TT=0.495
T1=0.25
OPT
f=36
TT=0.575
T1=0.29
OPT
f=36
TT=0.044
T1=0.03
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.042
T1=0.03
OPT
f=36
TT=0.047
T1=0.02
OPT
f=36
TT=0.042
T1=0.02
OPT
f=36
TT=0.003
T1=0.01
No dataNo dataOPT
f=36
TT=0.003
T1=0.01
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-2pb.opb
OPT
f=36
TT=0.005
T1=0
OPT
f=36
TT=0.01
T1=0.01
No dataOPT
f=36
TT=0.005
T1=0
OPT
f=36
TT=0.154
T1=0.06
OPT
f=36
TT=0.168
T1=0.06
OPT
f=36
TT=0.12
T1=0.05
OPT
f=36
TT=0.107
T1=0.05
OPT
f=36
TT=0.072
T1=0.06
OPT
f=36
TT=0.063
T1=0.05
OPT
f=36
TT=0.071
T1=0.05
OPT
f=36
TT=0.066
T1=0.05
OPT
f=36
TT=0.017
T1=0.01
OPT
f=36
TT=0.102
T1=0.03
OPT
f=36
TT=0.074
T1=0.05
OPT
f=36
TT=0.013
T1=0
OPT
f=36
TT=0.574
T1=0.25
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.606
T1=0.27
OPT
f=36
TT=0.042
T1=0.03
No dataOPT
f=36
TT=0.022
T1=0.02
OPT
f=36
TT=0.994
T1=1.2
OPT
f=36
TT=0.035
T1=0.03
No dataOPT
f=36
TT=0.864
T1=0.72
OPT
f=36
TT=0.046
T1=0.04
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.121
T1=0.02
OPT
f=36
TT=0.048
T1=0.02
No dataNo dataNo dataOPT
f=36
TT=0.044
T1=0.01
No dataNo dataOPT
f=36
TT=0.044
T1=0.01
No dataNo dataNo dataOPT
f=36
TT=0.834
T1=0.73
OPT
f=36
TT=0.624
T1=0.31
OPT
f=36
TT=0.633
T1=0.31
OPT
f=36
TT=0.054
T1=0.04
OPT
f=36
TT=0.052
T1=0.04
OPT
f=36
TT=0.049
T1=0.04
OPT
f=36
TT=0.061
T1=0.05
OPT
f=36
TT=0.061
T1=0.04
OPT
f=36
TT=0.023
T1=0.01
No dataNo dataOPT
f=36
TT=0.024
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-3pb.opb
OPT
f=36
TT=0.004
T1=0
OPT
f=36
TT=0.009
T1=0
No dataOPT
f=36
TT=0.015
T1=0
OPT
f=36
TT=0.156
T1=0.04
OPT
f=36
TT=0.173
T1=0.05
OPT
f=36
TT=0.125
T1=0.04
OPT
f=36
TT=0.122
T1=0.04
OPT
f=36
TT=0.058
T1=0.04
OPT
f=36
TT=0.067
T1=0.04
OPT
f=36
TT=0.062
T1=0.04
OPT
f=36
TT=0.064
T1=0.04
OPT
f=36
TT=0.018
T1=0.02
OPT
f=36
TT=0.13
T1=0.02
OPT
f=36
TT=0.07
T1=0.04
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.635
T1=0.29
OPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.645
T1=0.3
OPT
f=36
TT=0.039
T1=0.03
No dataOPT
f=36
TT=0.021
T1=0.02
OPT
f=36
TT=1.274
T1=1.21
OPT
f=36
TT=0.036
T1=0.03
No dataOPT
f=36
TT=0.963
T1=0.74
OPT
f=36
TT=0.046
T1=0.04
OPT
f=36
TT=0.072
T1=0.07
OPT
f=36
TT=0.135
T1=0.02
OPT
f=36
TT=0.053
T1=0.02
No dataNo dataNo dataOPT
f=36
TT=0.043
T1=0.01
No dataNo dataOPT
f=36
TT=0.043
T1=0.01
No dataNo dataNo dataOPT
f=36
TT=1.254
T1=0.72
OPT
f=36
TT=0.625
T1=0.31
OPT
f=36
TT=0.646
T1=0.24
OPT
f=36
TT=0.041
T1=0.03
OPT
f=36
TT=0.046
T1=0.04
OPT
f=36
TT=0.051
T1=0.04
OPT
f=36
TT=0.117
T1=0.04
OPT
f=36
TT=0.116
T1=0.04
OPT
f=36
TT=0.023
T1=0.01
No dataNo dataOPT
f=36
TT=0.004
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-4pb.opb
OPT
f=36
TT=0.003
T1=0
OPT
f=36
TT=0.009
T1=0
No dataOPT
f=36
TT=0.017
T1=0
OPT
f=36
TT=0.18
T1=0.04
OPT
f=36
TT=0.17
T1=0.05
OPT
f=36
TT=0.137
T1=0.04
OPT
f=36
TT=0.113
T1=0.04
OPT
f=36
TT=0.061
T1=0.04
OPT
f=36
TT=0.065
T1=0.04
OPT
f=36
TT=0.064
T1=0.04
OPT
f=36
TT=0.061
T1=0.04
OPT
f=36
TT=0.019
T1=0.01
OPT
f=36
TT=0.105
T1=0.02
OPT
f=36
TT=0.073
T1=0.05
OPT
f=36
TT=0.011
T1=0
OPT
f=36
TT=0.634
T1=0.2
OPT
f=36
TT=0.008
T1=0
OPT
f=36
TT=0.664
T1=0.23
OPT
f=36
TT=0.038
T1=0.03
No dataOPT
f=36
TT=0.02
T1=0.01
OPT
f=36
TT=1.385
T1=1.21
OPT
f=36
TT=0.031
T1=0.02
No dataOPT
f=36
TT=1.234
T1=0.72
OPT
f=36
TT=0.042
T1=0.03
OPT
f=36
TT=0.057
T1=0.05
OPT
f=36
TT=0.148
T1=0.02
OPT
f=36
TT=0.053
T1=0.02
No dataNo dataNo dataOPT
f=36
TT=0.004
T1=0.01
No dataNo dataOPT
f=36
TT=0.003
T1=0.01
No dataNo dataNo dataOPT
f=36
TT=1.225
T1=0.72
OPT
f=36
TT=0.604
T1=0.21
OPT
f=36
TT=0.613
T1=0.21
OPT
f=36
TT=0.04
T1=0.03
OPT
f=36
TT=0.05
T1=0.04
OPT
f=36
TT=0.045
T1=0.03
OPT
f=36
TT=0.121
T1=0.02
OPT
f=36
TT=0.121
T1=0.02
OPT
f=36
TT=0.004
T1=0.01
No dataNo dataOPT
f=36
TT=0.004
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s3-3-3-5pb.opb
OPT
f=34
TT=0.003
T1=0
OPT
f=34
TT=0.014
T1=0.01
No dataOPT
f=34
TT=0.02
T1=0
OPT
f=34
TT=0.2
T1=0.04
OPT
f=34
TT=0.178
T1=0.05
OPT
f=34
TT=0.158
T1=0.04
OPT
f=34
TT=0.138
T1=0.04
OPT
f=34
TT=0.074
T1=0.04
OPT
f=34
TT=0.071
T1=0.04
OPT
f=34
TT=0.072
T1=0.04
OPT
f=34
TT=0.07
T1=0.04
OPT
f=34
TT=0.02
T1=0.02
OPT
f=34
TT=0.177
T1=0.01
OPT
f=34
TT=0.125
T1=0.07
OPT
f=34
TT=0.036
T1=0
OPT
f=34
TT=0.614
T1=0.21
OPT
f=34
TT=0.014
T1=0.01
OPT
f=34
TT=0.664
T1=0.21
OPT
f=34
TT=0.038
T1=0.03
No dataOPT
f=34
TT=0.019
T1=0.02
OPT
f=34
TT=1.334
T1=1.19
OPT
f=34
TT=0.035
T1=0.03
No dataOPT
f=34
TT=1.243
T1=0.72
OPT
f=34
TT=0.043
T1=0.03
OPT
f=34
TT=0.106
T1=0.1
OPT
f=34
TT=0.147
T1=0.01
OPT
f=34
TT=0.058
T1=0.02
No dataNo dataNo dataOPT
f=34
TT=0.003
T1=0.01
No dataNo dataOPT
f=34
TT=0.023
T1=0.01
No dataNo dataNo dataOPT
f=34
TT=1.314
T1=0.71
OPT
f=34
TT=0.644
T1=0.2
OPT
f=34
TT=0.664
T1=0.29
OPT
f=34
TT=0.04
T1=0.03
OPT
f=34
TT=0.04
T1=0.03
OPT
f=34
TT=0.048
T1=0.04
OPT
f=34
TT=0.203
T1=0.02
OPT
f=34
TT=0.19
T1=0.02
OPT
f=34
TT=0.004
T1=0.01
No dataNo dataOPT
f=34
TT=0.003
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-10pb.opb
OPT
f=70
TT=0.078
T1=0.04
OPT
f=70
TT=0.078
T1=0.07
No dataOPT
f=70
TT=0.203
T1=0.1
OPT
f=70
TT=1.523
T1=1.21
OPT
f=70
TT=1.406
T1=1.29
OPT
f=70
TT=1.44
T1=1.15
OPT
f=70
TT=1.271
T1=1
OPT
f=70
TT=0.58
T1=0.27
OPT
f=70
TT=0.629
T1=0.37
OPT
f=70
TT=0.58
T1=0.27
OPT
f=70
TT=0.645
T1=0.38
OPT
f=70
TT=0.416
T1=0.41
OPT
f=70
TT=3.884
T1=2.9
OPT
f=70
TT=0.982
T1=0.4
OPT
f=70
TT=0.206
T1=0.04
OPT
f=70
TT=1.517
T1=0.63
OPT
f=70
TT=0.077
T1=0.07
OPT
f=70
TT=1.625
T1=0.71
OPT
f=70
TT=0.102
T1=0.09
No dataOPT
f=70
TT=0.148
T1=0.14
OPT
f=70
TT=3.823
T1=2.31
OPT
f=70
TT=0.088
T1=0.08
No dataOPT
f=70
TT=3.094
T1=1.32
OPT
f=70
TT=0.11
T1=0.1
OPT
f=70
TT=2.59
T1=2.6
OPT
f=70
TT=1.986
T1=1.77
OPT
f=70
TT=0.531
T1=0.2
No dataNo dataNo dataOPT
f=70
TT=0.169
T1=0.08
No dataNo dataOPT
f=70
TT=0.169
T1=0.08
No dataNo dataNo dataOPT
f=70
TT=3.043
T1=1.32
OPT
f=70
TT=1.524
T1=0.64
OPT
f=70
TT=1.604
T1=0.72
OPT
f=70
TT=0.374
T1=0.36
OPT
f=70
TT=0.386
T1=0.37
OPT
f=70
TT=0.243
T1=0.23
OPT
f=70
TT=2.474
T1=0.7
OPT
f=70
TT=2.475
T1=0.7
OPT
f=70
TT=0.09
T1=0.08
No dataNo dataOPT
f=70
TT=0.09
T1=0.08
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-1pb.opb
OPT
f=62
TT=0.068
T1=0.06
OPT
f=62
TT=0.153
T1=0.14
No dataOPT
f=62
TT=324.629
T1=2.14
OPT
f=62
TT=8.919
T1=3.73
OPT
f=62
TT=7.052
T1=4.28
OPT
f=62
TT=9.429
T1=3.94
OPT
f=62
TT=6.99
T1=4.2
OPT
f=62
TT=3.062
T1=2.7
OPT
f=62
TT=4.325
T1=1.56
OPT
f=62
TT=3.034
T1=2.66
OPT
f=62
TT=4.578
T1=1.76
OPT
f=62
TT=0.237
T1=0.23
OPT
f=62
TT=24.167
T1=22.24
SAT (TO)
f=62
TT=1802.1
T1=20.43
OPT
f=62
TT=10.403
T1=2.24
OPT
f=62
TT=225.733
T1=5.26
OPT
f=62
TT=0.145
T1=0.14
OPT
f=62
TT=1024.88
T1=5.7
OPT
f=62
TT=0.382
T1=0.37
No dataOPT
f=62
TT=0.108
T1=0.1
OPT
f=62
TT=1096.49
T1=15.31
OPT
f=62
TT=0.103
T1=0.09
No dataOPT
f=62
TT=892.736
T1=5.34
OPT
f=62
TT=0.108
T1=0.09
OPT
f=62
TT=10.954
T1=10.95
OPT
f=62
TT=10.14
T1=2.25
OPT
f=62
TT=4.215
T1=1.76
No dataNo dataNo dataOPT
f=62
TT=0.128
T1=0.06
No dataNo dataOPT
f=62
TT=0.127
T1=0.06
No dataNo dataNo dataOPT
f=62
TT=632.552
T1=33.65
OPT
f=62
TT=197.725
T1=1.35
OPT
f=62
TT=233.528
T1=3.07
OPT
f=62
TT=0.989
T1=0.97
OPT
f=62
TT=1.059
T1=1.04
OPT
f=62
TT=0.897
T1=0.88
? (TO)

TT=1800.1

? (TO)

TT=1800.09

OPT
f=62
TT=0.067
T1=0.06
No dataNo dataOPT
f=62
TT=0.068
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-2pb.opb
OPT
f=64
TT=0.066
T1=0.06
OPT
f=64
TT=136.795
T1=60.88
No dataOPT
f=64
TT=27.091
T1=7.17
OPT
f=64
TT=6.776
T1=6.77
OPT
f=64
TT=7.075
T1=5.41
OPT
f=64
TT=6.627
T1=6.62
OPT
f=64
TT=6.94
T1=5.27
OPT
f=64
TT=6.827
T1=5.84
OPT
f=64
TT=5.067
T1=3.4
OPT
f=64
TT=6.51
T1=5.53
OPT
f=64
TT=5.203
T1=3.49
OPT
f=64
TT=271.14
T1=39.54
OPT
f=64
TT=63.878
T1=62.52
OPT
f=64
TT=387.758
T1=58.3
OPT
f=64
TT=26.86
T1=3.52
OPT
f=64
TT=338.45
T1=103.35
OPT
f=64
TT=156.172
T1=141.15
OPT
f=64
TT=158.21
T1=32.94
OPT
f=64
TT=0.336
T1=0.32
No dataOPT
f=64
TT=0.126
T1=0.12
OPT
f=64
TT=155.382
T1=28.42
OPT
f=64
TT=1.077
T1=1.06
No dataOPT
f=64
TT=171.539
T1=34.12
OPT
f=64
TT=0.692
T1=0.67
OPT
f=64
TT=16.218
T1=16.22
OPT
f=64
TT=9.159
T1=9.15
OPT
f=64
TT=11.867
T1=9.44
No dataNo dataNo dataOPT
f=64
TT=0.128
T1=0.06
No dataNo dataOPT
f=64
TT=0.127
T1=0.06
No dataNo dataNo dataOPT
f=64
TT=133.895
T1=13.95
OPT
f=64
TT=43.456
T1=6.09
OPT
f=64
TT=63.443
T1=17.82
OPT
f=64
TT=0.535
T1=0.52
OPT
f=64
TT=0.636
T1=0.62
OPT
f=64
TT=0.467
T1=0.45
OPT
f=64
TT=677.882
T1=41.78
OPT
f=64
TT=682.207
T1=42.9
OPT
f=64
TT=0.067
T1=0.06
No dataNo dataOPT
f=64
TT=0.066
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-3pb.opb
OPT
f=62
TT=0.066
T1=0.06
OPT
f=62
TT=86.475
T1=74.7
No dataOPT
f=62
TT=23.894
T1=18.54
OPT
f=62
TT=24.965
T1=4.9
OPT
f=62
TT=7.777
T1=1.97
OPT
f=62
TT=24.851
T1=5.09
OPT
f=62
TT=7.671
T1=1.91
OPT
f=62
TT=15.124
T1=8.99
OPT
f=62
TT=9.22
T1=4.85
OPT
f=62
TT=14.492
T1=8.61
OPT
f=62
TT=9.359
T1=4.53
OPT
f=62
TT=594.328
T1=37.51
OPT
f=62
TT=66.859
T1=66.7
OPT
f=62
TT=692.284
T1=55.38
OPT
f=62
TT=12.991
T1=3.24
OPT
f=62
TT=272.99
T1=177.21
OPT
f=62
TT=957.988
T1=781.41
OPT
f=62
TT=126.13
T1=26.96
OPT
f=62
TT=0.217
T1=0.21
No dataOPT
f=62
TT=0.107
T1=0.11
OPT
f=62
TT=257.884
T1=76.17
OPT
f=62
TT=0.213
T1=0.2
No dataOPT
f=62
TT=172.818
T1=80.19
OPT
f=62
TT=0.271
T1=0.26
OPT
f=62
TT=42.575
T1=42.58
OPT
f=62
TT=22.379
T1=6.44
OPT
f=62
TT=25.25
T1=14.99
No dataNo dataNo dataOPT
f=62
TT=0.127
T1=0.08
No dataNo dataOPT
f=62
TT=0.128
T1=0.06
No dataNo dataNo dataOPT
f=62
TT=158.08
T1=46.92
OPT
f=62
TT=60.084
T1=30.88
OPT
f=62
TT=51.816
T1=26.98
OPT
f=62
TT=0.263
T1=0.25
OPT
f=62
TT=0.262
T1=0.25
OPT
f=62
TT=0.162
T1=0.15
OPT
f=62
TT=1215.32
T1=100.72
OPT
f=62
TT=1226.94
T1=107.2
OPT
f=62
TT=0.066
T1=0.06
No dataNo dataOPT
f=62
TT=0.066
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-4pb.opb
OPT
f=60
TT=0.067
T1=0.06
OPT
f=60
TT=0.3
T1=0.29
No dataOPT
f=60
TT=226.774
T1=11.31
OPT
f=60
TT=2.733
T1=2.43
OPT
f=60
TT=2.712
T1=2.01
OPT
f=60
TT=2.639
T1=2.42
OPT
f=60
TT=2.568
T1=2.03
OPT
f=60
TT=3.803
T1=3.44
OPT
f=60
TT=2.957
T1=2.23
OPT
f=60
TT=3.731
T1=3.48
OPT
f=60
TT=2.81
T1=2.13
OPT
f=60
TT=0.06
T1=0.06
OPT
f=60
TT=31.444
T1=30.87
OPT
f=60
TT=1602.99
T1=203.01
OPT
f=60
TT=7.682
T1=3.59
OPT
f=60
TT=310.09
T1=31.42
OPT
f=60
TT=0.275
T1=0.27
OPT
f=60
TT=1014.07
T1=48.45
OPT
f=60
TT=0.609
T1=0.59
No dataOPT
f=60
TT=0.11
T1=0.1
OPT
f=60
TT=324.945
T1=28.33
OPT
f=60
TT=0.488
T1=0.47
No dataOPT
f=60
TT=780.52
T1=46.99
OPT
f=60
TT=1.977
T1=1.97
OPT
f=60
TT=15.456
T1=15.45
OPT
f=60
TT=2.684
T1=1.31
OPT
f=60
TT=4.362
T1=3.47
No dataNo dataNo dataOPT
f=60
TT=0.127
T1=0.06
No dataNo dataOPT
f=60
TT=0.128
T1=0.06
No dataNo dataNo dataOPT
f=60
TT=518.384
T1=33.93
OPT
f=60
TT=164.4
T1=18.53
OPT
f=60
TT=207.332
T1=26.93
OPT
f=60
TT=0.104
T1=0.09
OPT
f=60
TT=0.094
T1=0.08
OPT
f=60
TT=0.102
T1=0.09
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=60
TT=0.067
T1=0.06
No dataNo dataOPT
f=60
TT=0.067
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-5pb.opb
OPT
f=60
TT=0.067
T1=0.06
OPT
f=60
TT=12.054
T1=12.05
No dataOPT
f=60
TT=43.12
T1=29.16
OPT
f=60
TT=2.677
T1=1.84
OPT
f=60
TT=4.968
T1=2.57
OPT
f=60
TT=2.606
T1=1.79
OPT
f=60
TT=4.83
T1=2.46
OPT
f=60
TT=5.413
T1=4.79
OPT
f=60
TT=6.688
T1=4.22
OPT
f=60
TT=5.442
T1=4.81
OPT
f=60
TT=6.487
T1=4.13
OPT
f=60
TT=1.258
T1=1.25
OPT
f=60
TT=16.247
T1=15.87
OPT
f=60
TT=1067.78
T1=466.11
OPT
f=60
TT=30.996
T1=29.58
OPT
f=60
TT=293.128
T1=149.75
OPT
f=60
TT=39.531
T1=39.53
OPT
f=60
TT=157.41
T1=71.52
OPT
f=60
TT=0.161
T1=0.15
No dataOPT
f=60
TT=0.108
T1=0.1
OPT
f=60
TT=256.335
T1=70.73
OPT
f=60
TT=0.262
T1=0.25
No dataOPT
f=60
TT=208.763
T1=66.91
OPT
f=60
TT=0.204
T1=0.19
OPT
f=60
TT=13.821
T1=13.82
OPT
f=60
TT=2.115
T1=0.64
OPT
f=60
TT=5.43
T1=4.98
No dataNo dataNo dataOPT
f=60
TT=0.128
T1=0.06
No dataNo dataOPT
f=60
TT=0.128
T1=0.06
No dataNo dataNo dataOPT
f=60
TT=251.928
T1=73.6
OPT
f=60
TT=50.195
T1=29.09
OPT
f=60
TT=85.061
T1=61.9
OPT
f=60
TT=0.224
T1=0.21
OPT
f=60
TT=0.221
T1=0.2
OPT
f=60
TT=0.127
T1=0.11
? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=60
TT=0.068
T1=0.06
No dataNo dataOPT
f=60
TT=0.067
T1=0.06
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-6pb.opb
OPT
f=66
TT=0.067
T1=0.06
OPT
f=66
TT=26.241
T1=5.44
No dataOPT
f=66
TT=5.982
T1=1.01
OPT
f=66
TT=8.532
T1=6.67
OPT
f=66
TT=3.822
T1=1.89
OPT
f=66
TT=8.481
T1=6.61
OPT
f=66
TT=3.725
T1=2.13
OPT
f=66
TT=6.148
T1=4.82
OPT
f=66
TT=1.496
T1=0.81
OPT
f=66
TT=5.845
T1=4.55
OPT
f=66
TT=1.504
T1=0.81
OPT
f=66
TT=104.131
T1=9.97
OPT
f=66
TT=7.582
T1=6
OPT
f=66
TT=82.071
T1=11.49
OPT
f=66
TT=2.552
T1=0.86
OPT
f=66
TT=10.37
T1=3.48
OPT
f=66
TT=38.779
T1=17.13
OPT
f=66
TT=13.312
T1=2.87
OPT
f=66
TT=0.172
T1=0.12
No dataOPT
f=66
TT=0.118
T1=0.12
OPT
f=66
TT=25.729
T1=7.31
OPT
f=66
TT=0.331
T1=0.13
No dataOPT
f=66
TT=24.291
T1=5.83
OPT
f=66
TT=0.331
T1=0.32
OPT
f=66
TT=5.098
T1=5.09
OPT
f=66
TT=11.353
T1=10.42
OPT
f=66
TT=3.44
T1=2.51
No dataNo dataNo dataOPT
f=66
TT=0.127
T1=0.06
No dataNo dataOPT
f=66
TT=0.127
T1=0.06
No dataNo dataNo dataOPT
f=66
TT=33.598
T1=2.8
OPT
f=66
TT=11.221
T1=1.45
OPT
f=66
TT=10.872
T1=2.02
OPT
f=66
TT=0.34
T1=0.33
OPT
f=66
TT=0.354
T1=0.34
OPT
f=66
TT=0.208
T1=0.19
OPT
f=66
TT=178.334
T1=21.32
OPT
f=66
TT=178.533
T1=21.97
OPT
f=66
TT=0.067
T1=0.06
No dataNo dataOPT
f=66
TT=0.067
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-7pb.opb
OPT
f=64
TT=0.068
T1=0.06
OPT
f=64
TT=11.807
T1=7.94
No dataOPT
f=64
TT=3.539
T1=2.32
OPT
f=64
TT=5.454
T1=4.36
OPT
f=64
TT=4.303
T1=3.44
OPT
f=64
TT=5.372
T1=4.28
OPT
f=64
TT=4.165
T1=3.33
OPT
f=64
TT=4.977
T1=4.01
OPT
f=64
TT=2.165
T1=1.32
OPT
f=64
TT=4.799
T1=3.71
OPT
f=64
TT=2.158
T1=1.43
SAT (TO)
f=64
TT=1800.11
T1=25.63
OPT
f=64
TT=18.391
T1=17.9
OPT
f=64
TT=51.921
T1=16.01
OPT
f=64
TT=1.936
T1=0.83
OPT
f=64
TT=6.413
T1=2.91
OPT
f=64
TT=8.7
T1=5.1
OPT
f=64
TT=6.762
T1=3.37
OPT
f=64
TT=0.208
T1=0.2
No dataOPT
f=64
TT=0.103
T1=0.1
OPT
f=64
TT=14.292
T1=6.32
OPT
f=64
TT=0.258
T1=0.25
No dataOPT
f=64
TT=17.441
T1=8.35
OPT
f=64
TT=0.245
T1=0.23
OPT
f=64
TT=9.705
T1=9.7
OPT
f=64
TT=3.089
T1=3.09
OPT
f=64
TT=2.875
T1=2.14
No dataNo dataNo dataOPT
f=64
TT=0.128
T1=0.06
No dataNo dataOPT
f=64
TT=0.128
T1=0.06
No dataNo dataNo dataOPT
f=64
TT=18.307
T1=5.32
OPT
f=64
TT=7.254
T1=2.2
OPT
f=64
TT=7.343
T1=2.62
OPT
f=64
TT=0.297
T1=0.28
OPT
f=64
TT=0.294
T1=0.28
OPT
f=64
TT=0.185
T1=0.17
OPT
f=64
TT=198.387
T1=38.26
OPT
f=64
TT=197.236
T1=37.79
OPT
f=64
TT=0.068
T1=0.06
No dataNo dataOPT
f=64
TT=0.068
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-8pb.opb
OPT
f=36
TT=0.034
T1=0.02
OPT
f=36
TT=9.013
T1=9.01
No dataOPT
f=36
TT=206.285
T1=200.96
OPT
f=36
TT=0.393
T1=0.28
OPT
f=36
TT=0.445
T1=0.27
OPT
f=36
TT=0.341
T1=0.23
OPT
f=36
TT=0.355
T1=0.22
OPT
f=36
TT=0.271
T1=0.21
OPT
f=36
TT=0.939
T1=0.88
OPT
f=36
TT=0.272
T1=0.21
OPT
f=36
TT=0.932
T1=0.88
OPT
f=36
TT=0.091
T1=0.09
OPT
f=36
TT=2.548
T1=2.47
SAT (TO)
f=36
TT=1802.11
T1=559.5
OPT
f=36
TT=4.527
T1=3.83
OPT
f=36
TT=221.73
T1=90.01
OPT
f=36
TT=15.845
T1=15.84
OPT
f=36
TT=713.826
T1=362.82
OPT
f=36
TT=0.067
T1=0.06
No dataOPT
f=36
TT=0.054
T1=0.05
OPT
f=36
TT=152.732
T1=56.8
OPT
f=36
TT=0.057
T1=0.05
No dataOPT
f=36
TT=144.123
T1=26.54
OPT
f=36
TT=0.074
T1=0.06
OPT
f=36
TT=1.585
T1=1.58
OPT
f=36
TT=0.255
T1=0.03
OPT
f=36
TT=0.113
T1=0.03
No dataNo dataNo dataOPT
f=36
TT=0.066
T1=0.02
No dataNo dataOPT
f=36
TT=0.066
T1=0.02
No dataNo dataNo dataOPT
f=36
TT=159.122
T1=7.8
OPT
f=36
TT=57.29
T1=18.15
OPT
f=36
TT=107.298
T1=66.46
OPT
f=36
TT=0.235
T1=0.22
OPT
f=36
TT=0.192
T1=0.18
OPT
f=36
TT=0.091
T1=0.08
? (TO)

TT=1800.11

? (TO)

TT=1800.02

OPT
f=36
TT=0.035
T1=0.02
No dataNo dataOPT
f=36
TT=0.034
T1=0.02
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/routing/
normalized-s4-4-3-9pb.opb
OPT
f=68
TT=0.15
T1=0.14
OPT
f=68
TT=1.631
T1=1.61
No dataOPT
f=68
TT=1.828
T1=0.68
OPT
f=68
TT=7.372
T1=5.96
OPT
f=68
TT=5.447
T1=2.65
OPT
f=68
TT=7.321
T1=5.97
OPT
f=68
TT=5.131
T1=2.36
OPT
f=68
TT=2.422
T1=1.63
OPT
f=68
TT=3.985
T1=3.13
OPT
f=68
TT=2.393
T1=1.6
OPT
f=68
TT=3.909
T1=2.9
SAT (TO)
f=68
TT=1800.1
T1=6.14
OPT
f=68
TT=19.257
T1=13.4
OPT
f=68
TT=25.644
T1=2.79
OPT
f=68
TT=1.67
T1=0.46
OPT
f=68
TT=7.543
T1=2.21
OPT
f=68
TT=1.612
T1=1.59
OPT
f=68
TT=5.292
T1=3.27
OPT
f=68
TT=0.7
T1=0.69
No dataOPT
f=68
TT=0.15
T1=0.15
OPT
f=68
TT=10.996
T1=4.35
OPT
f=68
TT=0.421
T1=0.41
No dataOPT
f=68
TT=9.913
T1=2.33
OPT
f=68
TT=0.264
T1=0.25
OPT
f=68
TT=10.465
T1=10.46
OPT
f=68
TT=13.321
T1=6.15
OPT
f=68
TT=6.698
T1=3.22
No dataNo dataNo dataOPT
f=68
TT=0.58
T1=0.29
No dataNo dataOPT
f=68
TT=0.29
T1=0.14
No dataNo dataNo dataOPT
f=68
TT=12.352
T1=3.41
OPT
f=68
TT=4.573
T1=2.42
OPT
f=68
TT=4.353
T1=1.52
OPT
f=68
TT=0.426
T1=0.41
OPT
f=68
TT=0.4
T1=0.38
OPT
f=68
TT=0.226
T1=0.21
OPT
f=68
TT=67.86
T1=32.17
OPT
f=68
TT=68.951
T1=33.15
OPT
f=68
TT=0.398
T1=0.39
No dataNo dataOPT
f=68
TT=0.378
T1=0.37
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-9symml.opb
OPT
f=4517
TT=0.175
T1=0.17
SAT
f=4742
TT=1798
T1=1722.71
No dataSAT (TO)
f=5118
TT=1800.02
T1=288.84
? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.11

OPT
f=4517
TT=75.854
T1=75.44
SAT (TO)
f=5105
TT=1800.1
T1=1213.09
SAT (TO)
f=7054
TT=1802.06
T1=1.19
SAT
f=5274
TT=1783
T1=19.86
? (exit code)

TT=261.16

SAT
f=4738
TT=1798
T1=1759.87
? (exit code)

TT=711.8

OPT
f=4517
TT=1.941
T1=1.43
No dataOPT
f=4517
TT=0.175
T1=0.17
SAT (TO)
f=5301
TT=1800.01
T1=590.95
OPT
f=4517
TT=1.322
T1=1.31
No dataSAT (TO)
f=5352
TT=1800.59
T1=888.41
OPT
f=4517
TT=2.685
T1=2.67
SAT (TO)
f=4978
TT=1800.1
T1=1800.61
? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=5147
TT=1800.09
T1=900.31
No dataNo dataSAT (TO)
f=5048
TT=1800.1
T1=900.31
No dataNo dataNo dataSAT (TO)
f=5616
TT=1800.56
T1=103.57
SAT (TO)
f=5987
TT=1800.85
T1=0.36
SAT (TO)
f=6200
TT=1800.04
T1=1442.34
OPT
f=4517
TT=1.505
T1=1.49
OPT
f=4517
TT=1.422
T1=1.52
OPT
f=4517
TT=1.447
T1=1.43
? (TO)

TT=1800.02

? (TO)

TT=1800.09

?

TT=1799.9

No dataNo data?

TT=1799.59

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-b1.opb
OPT
f=128
TT=0.001
T1=0
OPT
f=128
TT=0.001
T1=0
No dataOPT
f=128
TT=0.002
T1=0
OPT
f=128
TT=0.089
T1=0.05
OPT
f=128
TT=0.127
T1=0.02
OPT
f=128
TT=0.037
T1=0.02
OPT
f=128
TT=0.053
T1=0.01
OPT
f=128
TT=0.022
T1=0.02
OPT
f=128
TT=0.026
T1=0.01
OPT
f=128
TT=0.037
T1=0.03
OPT
f=128
TT=0.035
T1=0.01
OPT
f=128
TT=0.002
T1=0
OPT
f=128
TT=0.005
T1=0
OPT
f=128
TT=0.083
T1=0.08
OPT
f=128
TT=0.005
T1=0
OPT
f=128
TT=0.114
T1=0.12
OPT
f=128
TT=0.001
T1=0
OPT
f=128
TT=0.169
T1=0.14
OPT
f=128
TT=0.016
T1=0.01
No dataOPT
f=128
TT=0.005
T1=0
OPT
f=128
TT=0.183
T1=3.14
OPT
f=128
TT=0.015
T1=0.01
No dataOPT
f=128
TT=0.173
T1=1.64
OPT
f=128
TT=0.018
T1=0.01
OPT
f=128
TT=0.003
T1=0
OPT
f=128
TT=0.056
T1=0.03
OPT
f=128
TT=0.064
T1=0.05
No dataNo dataNo dataOPT
f=128
TT=0.002
T1=0
No dataNo dataOPT
f=128
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=128
TT=0.174
T1=1.65
OPT
f=128
TT=0.167
T1=0.14
OPT
f=128
TT=0.176
T1=0.14
OPT
f=128
TT=0.021
T1=0.01
OPT
f=128
TT=0.016
T1=0.01
OPT
f=128
TT=0.02
T1=0.01
OPT
f=128
TT=0.004
T1=0
OPT
f=128
TT=0.004
T1=0
OPT
f=128
TT=0.001
T1=0
No dataNo dataOPT
f=128
TT=0.002
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-C17.opb
OPT
f=260
TT=0.001
T1=0
OPT
f=260
TT=0.001
T1=0
No dataOPT
f=260
TT=0.001
T1=0
OPT
f=260
TT=0.08
T1=0.07
OPT
f=260
TT=0.105
T1=0.1
OPT
f=260
TT=0.037
T1=0.03
OPT
f=260
TT=0.047
T1=0.04
OPT
f=260
TT=0.02
T1=0.02
OPT
f=260
TT=0.032
T1=0.03
OPT
f=260
TT=0.028
T1=0.03
OPT
f=260
TT=0.041
T1=0.04
OPT
f=260
TT=0.001
T1=0
OPT
f=260
TT=0.002
T1=0
OPT
f=260
TT=0.047
T1=0.03
OPT
f=260
TT=0.001
T1=0
OPT
f=260
TT=0.114
T1=0.13
OPT
f=260
TT=0.001
T1=0
OPT
f=260
TT=0.167
T1=0.14
OPT
f=260
TT=0.015
T1=0.01
No dataOPT
f=260
TT=0.004
T1=0
OPT
f=260
TT=0.166
T1=2.13
OPT
f=260
TT=0.014
T1=0.01
No dataOPT
f=260
TT=0.175
T1=1.16
OPT
f=260
TT=0.017
T1=0.01
OPT
f=260
TT=0.003
T1=0
OPT
f=260
TT=0.037
T1=0.03
OPT
f=260
TT=0.02
T1=0.01
No dataNo dataNo dataOPT
f=260
TT=0.001
T1=0
No dataNo dataOPT
f=260
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=260
TT=0.163
T1=1.13
OPT
f=260
TT=0.145
T1=0.13
OPT
f=260
TT=0.172
T1=0.14
OPT
f=260
TT=0.014
T1=0.01
OPT
f=260
TT=0.015
T1=0.01
OPT
f=260
TT=0.016
T1=0.01
OPT
f=260
TT=0.003
T1=0
OPT
f=260
TT=0.002
T1=0
OPT
f=260
TT=0.002
T1=0
No dataNo dataOPT
f=260
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-C432.opb
OPT
f=4822
TT=0.236
T1=0.23
SAT
f=5427
TT=1798.01
T1=1794.45
No dataSAT (TO)
f=5669
TT=1800.02
T1=1584.1
? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.12

OPT
f=4822
TT=57.695
T1=40.99
SAT (TO)
f=6251
TT=1800.06
T1=418.06
SAT (TO)
f=6921
TT=1800.16
T1=0.42
SAT
f=5610
TT=1783
T1=0.04
? (exit code)

TT=539.9

SAT
f=5435
TT=1798
T1=329.9
SAT
f=6956
TT=848.546
T1=0.37
OPT
f=4822
TT=1.828
T1=1.81
No dataOPT
f=4822
TT=0.236
T1=0.23
SAT (TO)
f=6096
TT=1800.17
T1=398.05
OPT
f=4822
TT=2.574
T1=2.56
No dataSAT (TO)
f=5929
TT=1800.99
T1=289.05
OPT
f=4822
TT=1.463
T1=1.44
SAT (TO)
f=6287
TT=1800.05
T1=1800.61
? (TO)

TT=1800.13

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=5819
TT=1800.11
T1=900.31
No dataNo dataSAT (TO)
f=5762
TT=1800.13
T1=900.31
No dataNo dataNo dataSAT (TO)
f=6744
TT=1800.46
T1=659.7
SAT (TO)
f=6956
TT=1800.05
T1=0.37
SAT (TO)
f=6912
TT=1659.74
T1=876.76
OPT
f=4822
TT=3.772
T1=3.75
OPT
f=4822
TT=3.641
T1=3.63
OPT
f=4822
TT=3.234
T1=1.41
? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.93

No dataNo data?

TT=1799.6

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-c8.opb
OPT
f=1194
TT=0.034
T1=0.03
OPT
f=1194
TT=0.401
T1=0.38
No dataSAT (TO)
f=1302
TT=1800.03
T1=1448.1
? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.05

OPT
f=1194
TT=0.056
T1=0.04
SAT (TO)
f=1301
TT=1800.04
T1=1766.27
SAT (TO)
f=1569
TT=1802.05
T1=575.99
SAT
f=1309
TT=1783.01
T1=557.1
SAT (TO)
f=1569
TT=1800.1
T1=1.24
OPT
f=1194
TT=0.399
T1=0.37
SAT
f=1560
TT=963.389
T1=211.3
OPT
f=1194
TT=0.089
T1=0.08
No dataOPT
f=1194
TT=0.034
T1=0.03
SAT (TO)
f=1380
TT=1800.5
T1=303.94
OPT
f=1194
TT=0.088
T1=0.08
No dataSAT (TO)
f=1334
TT=1800.35
T1=449.53
OPT
f=1194
TT=0.122
T1=0.11
SAT (TO)
f=1310
TT=1800.04
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.04

No dataNo dataNo dataOPT
f=1194
TT=79.882
T1=39.94
No dataNo dataOPT
f=1194
TT=565.04
T1=282.62
No dataNo dataNo dataSAT (TO)
f=1396
TT=1800.03
T1=568.71
SAT (TO)
f=1556
TT=1800.08
T1=0.37
SAT (TO)
f=1649
TT=1800.01
T1=1095.74
OPT
f=1194
TT=0.16
T1=0.15
OPT
f=1194
TT=0.151
T1=0.14
OPT
f=1194
TT=0.351
T1=0.32
? (TO)

TT=1800.03

? (TO)

TT=1800.02

OPT
f=1194
TT=47.577
T1=47.59
No dataNo dataOPT
f=1194
TT=44.77
T1=44.84
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-cc.opb
OPT
f=1567
TT=0.016
T1=0.01
OPT
f=1567
TT=0.201
T1=0.19
No dataSAT (TO)
f=1567
TT=1800.03
T1=645.68
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.06

OPT
f=1567
TT=0.024
T1=0.01
SAT (TO)
f=1631
TT=1800.02
T1=1107.04
SAT (TO)
f=1752
TT=1802.11
T1=0.6
SAT
f=1584
TT=1783
T1=1138.27
SAT (TO)
f=1625
TT=1800.65
T1=356.97
OPT
f=1567
TT=0.195
T1=0.18
SAT (TO)
f=1636
TT=1800.1
T1=264.8
OPT
f=1567
TT=0.021
T1=0.01
No dataOPT
f=1567
TT=0.016
T1=0.01
SAT (TO)
f=1569
TT=1800.19
T1=831.41
OPT
f=1567
TT=0.044
T1=0.01
No dataSAT (TO)
f=1585
TT=1800.06
T1=306.11
OPT
f=1567
TT=0.051
T1=0.02
SAT (TO)
f=1599
TT=1800.01
T1=1800.3
? (TO)

TT=1800.11

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=1602
TT=1800.53
T1=900.31
No dataNo dataSAT (TO)
f=1595
TT=1800.55
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1569
TT=1800.45
T1=123.64
SAT (TO)
f=1653
TT=1800.48
T1=250.88
SAT (TO)
f=1602
TT=1800.06
T1=651.08
OPT
f=1567
TT=0.065
T1=0.06
OPT
f=1567
TT=0.064
T1=0.06
OPT
f=1567
TT=0.028
T1=0.02
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.86

No dataNo data?

TT=1799.54

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-cm42a.opb
OPT
f=694
TT=0.009
T1=0
OPT
f=694
TT=0.009
T1=0
No dataSAT (TO)
f=694
TT=1800.03
T1=120.4
? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.07

OPT
f=694
TT=0.017
T1=0.01
OPT
f=694
TT=175.199
T1=81.58
SAT (TO)
f=694
TT=1802.12
T1=343.93
OPT
f=694
TT=1124.06
T1=302.29
SAT (TO)
f=739
TT=1800.06
T1=1462.19
OPT
f=694
TT=0.01
T1=0
SAT (TO)
f=707
TT=1800.78
T1=744.87
OPT
f=694
TT=0.024
T1=0.02
No dataOPT
f=694
TT=0.021
T1=0.02
SAT (TO)
f=694
TT=1800.12
T1=103.29
OPT
f=694
TT=0.051
T1=0.04
No dataSAT (TO)
f=694
TT=1800.11
T1=77.31
OPT
f=694
TT=0.049
T1=0.04
OPT
f=694
TT=77.428
T1=77.43
? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=696
TT=1800.03
T1=900.21
No dataNo dataSAT (TO)
f=696
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=705
TT=1800.02
T1=756.18
SAT (TO)
f=737
TT=1800.09
T1=1024.46
SAT (TO)
f=694
TT=1800
T1=1477.94
OPT
f=694
TT=0.183
T1=0.16
OPT
f=694
TT=0.19
T1=0.16
OPT
f=694
TT=0.164
T1=0.13
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.54

No dataNo data?

TT=1799.9

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-cmb.opb
OPT
f=1053
TT=0.043
T1=0.04
OPT
f=1053
TT=0.39
T1=0.35
No dataSAT (TO)
f=1173
TT=1800.02
T1=919.1
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.08

OPT
f=1053
TT=0.048
T1=0.02
SAT (TO)
f=1156
TT=1800.07
T1=718.74
SAT (TO)
f=1363
TT=1802.11
T1=0.1
SAT
f=1057
TT=1783.01
T1=0.01
SAT
f=1552
TT=1103.22
T1=206.26
OPT
f=1053
TT=0.386
T1=0.35
? (exit code)

TT=1584.35

OPT
f=1053
TT=0.06
T1=0.05
No dataOPT
f=1053
TT=0.043
T1=0.04
SAT (TO)
f=1191
TT=1800.04
T1=972.09
OPT
f=1053
TT=0.071
T1=0.06
No dataSAT (TO)
f=1156
TT=1800.07
T1=495.39
OPT
f=1053
TT=0.098
T1=0.09
SAT (TO)
f=1156
TT=1800.1
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=1053
TT=0.124
T1=0.06
No dataNo dataOPT
f=1053
TT=0.126
T1=0.06
No dataNo dataNo dataSAT (TO)
f=1201
TT=1800.21
T1=129.21
SAT (TO)
f=1411
TT=1800.91
T1=1475.41
SAT (TO)
f=1524
TT=1800.06
T1=0.26
OPT
f=1053
TT=0.121
T1=0.11
OPT
f=1053
TT=0.115
T1=0.1
OPT
f=1053
TT=0.066
T1=0.06
? (TO)

TT=1800.03

? (TO)

TT=1800.02

OPT
f=1053
TT=0.065
T1=0.06
No dataNo dataOPT
f=1053
TT=0.064
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
synthesis-ptl-cmos-circuits/normalized-mux.opb
OPT
f=872
TT=0.011
T1=0.01
OPT
f=872
TT=0.011
T1=0.01
No dataSAT (TO)
f=1003
TT=1800.02
T1=1418.74
? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.11

OPT
f=872
TT=0.012
T1=0.01
SAT (TO)
f=1196
TT=1800.1
T1=9.25
SAT (TO)
f=1370
TT=1800.34
T1=860.23
SAT
f=882
TT=1783
T1=0.01
SAT
f=1604
TT=1343.88
T1=1157.59
OPT
f=872
TT=0.013
T1=0.01
? (exit code)

TT=1217.35

OPT
f=872
TT=0.038
T1=0.03
No dataOPT
f=872
TT=0.022
T1=0.02
SAT (TO)
f=1140
TT=1800.03
T1=24.26
OPT
f=872
TT=0.035
T1=0.03
No dataSAT (TO)
f=1030
TT=1801.13
T1=569.29
OPT
f=872
TT=0.041
T1=0.03
SAT (TO)
f=1197
TT=1800.08
T1=1800.4
? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataOPT
f=872
TT=0.065
T1=0.03
No dataNo dataOPT
f=872
TT=0.063
T1=0.03
No dataNo dataNo dataSAT (TO)
f=1123
TT=1800.75
T1=983.39
SAT (TO)
f=1313
TT=1800.01
T1=1589.93
SAT (TO)
f=1330
TT=1800.04
T1=0.23
OPT
f=872
TT=0.034
T1=0.02
OPT
f=872
TT=0.035
T1=0.02
OPT
f=872
TT=0.04
T1=0.03
? (TO)

TT=1800.03

? (TO)

TT=1800.03

OPT
f=872
TT=0.033
T1=0.03
No dataNo dataOPT
f=872
TT=0.033
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/synthesis-ptl-cmos-circuits/
normalized-my_adder.opb
OPT
f=4561
TT=0.175
T1=0.17
OPT
f=4561
TT=13.83
T1=1.31
No dataSAT (TO)
f=5331
TT=1800.11
T1=1793.55
? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.13

OPT
f=4561
TT=1.078
T1=0.73
SAT (TO)
f=5525
TT=1800.04
T1=804.48
SAT (TO)
f=6953
TT=1800.48
T1=0.09
SAT
f=4981
TT=1783.01
T1=0.01
? (exit code)

TT=596.333

OPT
f=4561
TT=13.813
T1=1.3
? (exit code)

TT=831.89

OPT
f=4561
TT=0.479
T1=0.32
No dataOPT
f=4561
TT=0.175
T1=0.17
SAT (TO)
f=5481
TT=1800.08
T1=458.43
OPT
f=4561
TT=0.825
T1=0.79
No dataSAT (TO)
f=5204
TT=1800.11
T1=964.61
OPT
f=4561
TT=0.524
T1=0.41
SAT (TO)
f=5439
TT=1800.09
T1=1800.71
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=5486
TT=1800.09
T1=900.31
No dataNo dataSAT (TO)
f=5410
TT=1800.04
T1=900.21
No dataNo dataNo dataSAT (TO)
f=5246
TT=1800.5
T1=790.38
SAT (TO)
f=6091
TT=1800.05
T1=477.89
SAT (TO)
f=6042
TT=1722.23
T1=0.4
OPT
f=4561
TT=0.643
T1=0.37
OPT
f=4561
TT=0.606
T1=0.34
OPT
f=4561
TT=0.464
T1=0.28
? (TO)

TT=1800.09

? (TO)

TT=1800.11

?

TT=1799.59

No dataNo data?

TT=1799.59

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/ttp/
normalized-circ10_3.opb
SAT
f=334
TT=1800.1
T1=1612.48
SAT
f=360
TT=1798.01
T1=223.66
No dataSAT (TO)
f=334
TT=1800.1
T1=1612.48
? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.06

SAT (TO)
f=356
TT=1800.13
T1=157.04
SAT (TO)
f=338
TT=1800.08
T1=821.47
SAT (TO)
f=350
TT=1802.11
T1=1551.47
SAT
f=346
TT=1783.01
T1=260.27
SAT (TO)
f=348
TT=1800.03
T1=527.52
SAT
f=354
TT=1798.05
T1=1669.51
SAT (TO)
f=352
TT=1800.96
T1=1595.23
?

TT=1794.12

No dataSAT
f=392
TT=1798.86
T1=1799.14
SAT (TO)
f=336
TT=1800.8
T1=266.05
?

TT=1789.86

No dataSAT (TO)
f=344
TT=1800.15
T1=22.3
?

TT=1797.18

SAT (TO)
f=348
TT=1800.07
T1=1800.5
? (TO)

TT=1800.04

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=334
TT=1800.07
T1=900.51
No dataNo dataSAT (TO)
f=338
TT=1800.12
T1=900.51
No dataNo dataNo dataSAT (TO)
f=336
TT=1800.04
T1=570.38
SAT (TO)
f=340
TT=1800.03
T1=410.81
SAT (TO)
f=344
TT=1800.09
T1=713.62
?

TT=1796.91

?

TT=1796.93

?

TT=1796.9

? (TO)

TT=1800.08

? (TO)

TT=1800.09

?

TT=1799.55

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-circ4_3.opb
OPT
f=20
TT=0.049
T1=0
OPT
f=20
TT=0.657
T1=0.06
No dataOPT
f=20
TT=0.049
T1=0
OPT
f=20
TT=0.213
T1=0.09
OPT
f=20
TT=0.22
T1=0.08
OPT
f=20
TT=0.218
T1=0.06
OPT
f=20
TT=0.181
T1=0.06
OPT
f=20
TT=0.136
T1=0.05
OPT
f=20
TT=0.123
T1=0.05
OPT
f=20
TT=0.137
T1=0.05
OPT
f=20
TT=0.126
T1=0.06
OPT
f=20
TT=0.426
T1=0.01
OPT
f=20
TT=0.145
T1=0.03
OPT
f=20
TT=0.299
T1=0.1
OPT
f=20
TT=0.087
T1=0
OPT
f=20
TT=0.983
T1=0.27
OPT
f=20
TT=0.495
T1=0.05
OPT
f=20
TT=1.213
T1=0.23
OPT
f=20
TT=6.006
T1=1.75
No dataOPT
f=20
TT=1.951
T1=0.68
OPT
f=20
TT=2.143
T1=1.22
OPT
f=20
TT=6.119
T1=0.25
No dataOPT
f=20
TT=1.876
T1=0.76
OPT
f=20
TT=4.801
T1=1.28
OPT
f=20
TT=0.099
T1=0.1
OPT
f=20
TT=0.182
T1=0.11
OPT
f=20
TT=0.106
T1=0.03
No dataNo dataNo dataOPT
f=20
TT=0.183
T1=0.08
No dataNo dataOPT
f=20
TT=0.183
T1=0.09
No dataNo dataNo dataOPT
f=20
TT=1.804
T1=0.74
OPT
f=20
TT=0.787
T1=0.26
OPT
f=20
TT=0.875
T1=0.34
OPT
f=20
TT=4.771
T1=0.35
OPT
f=20
TT=4.97
T1=0.3
OPT
f=20
TT=3.442
T1=1.01
OPT
f=20
TT=0.515
T1=0.02
OPT
f=20
TT=0.518
T1=0.02
OPT
f=20
TT=0.225
T1=0.22
No dataNo dataOPT
f=20
TT=0.213
T1=0.21
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-circ6_3.opb
SAT
f=64
TT=1800.03
T1=51.22
SAT
f=68
TT=1798.02
T1=1372.1
No dataSAT (TO)
f=64
TT=1800.03
T1=1263.93
? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.13

? (TO)

TT=1800.01

SAT (TO)
f=68
TT=1800.04
T1=258.59
SAT (TO)
f=66
TT=1800.01
T1=612.38
SAT (TO)
f=64
TT=1802.08
T1=185.72
SAT
f=66
TT=1783
T1=726.02
SAT (TO)
f=68
TT=1800.02
T1=1692.02
SAT
f=68
TT=1797.91
T1=227.17
SAT (TO)
f=66
TT=1800
T1=1128.24
SAT
f=72
TT=1798.07
T1=479.2
No data? (TO)

TT=1800.35

SAT (TO)
f=68
TT=1800.27
T1=5.39
SAT
f=74
TT=1789.75
T1=5.09
No dataSAT (TO)
f=64
TT=1800.11
T1=51.22
SAT
f=72
TT=1796.78
T1=946.25
SAT (TO)
f=66
TT=1800.11
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=66
TT=1800.16
T1=900.31
No dataNo dataSAT (TO)
f=68
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=68
TT=1800.92
T1=127.56
SAT (TO)
f=64
TT=1800.73
T1=52.53
SAT (TO)
f=64
TT=1800.05
T1=431.99
SAT
f=70
TT=1796.77
T1=4.99
SAT
f=70
TT=1796.77
T1=5.42
SAT
f=72
TT=1796.77
T1=1118.85
? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.54

No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-circ8_3.opb
SAT
f=148
TT=1800.05
T1=362.78
SAT
f=168
TT=1798.04
T1=823.48
No dataSAT (TO)
f=158
TT=1800.03
T1=2.07
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.12

SAT (TO)
f=176
TT=1800.1
T1=18.81
SAT (TO)
f=172
TT=1800.04
T1=322.99
SAT (TO)
f=168
TT=1802.12
T1=324.97
SAT
f=158
TT=1783.01
T1=1389.47
SAT (TO)
f=170
TT=1800.15
T1=1213.16
SAT
f=174
TT=1798.02
T1=1662.48
SAT (TO)
f=172
TT=1800.3
T1=458.6
SAT
f=192
TT=1792.79
T1=424.93
No data? (TO)

TT=1800.39

SAT (TO)
f=158
TT=1800.04
T1=11.61
SAT
f=200
TT=1790.33
T1=1347.32
No dataSAT (TO)
f=148
TT=1800.05
T1=362.78
SAT
f=202
TT=1796.78
T1=672.71
SAT (TO)
f=154
TT=1800.01
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=160
TT=1800.02
T1=900.31
No dataNo dataSAT (TO)
f=160
TT=1800.16
T1=900.41
No dataNo dataNo dataSAT (TO)
f=150
TT=1800.57
T1=749.93
SAT (TO)
f=154
TT=1800.05
T1=9.86
SAT (TO)
f=166
TT=1800.02
T1=863.42
?

TT=1796.79

?

TT=1796.77

?

TT=1796.76

? (TO)

TT=1800.07

? (TO)

TT=1800.06

?

TT=1799.47

No dataNo data?

TT=1799.92

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/ttp/
normalized-data10_3.opb
SAT
f=76666
TT=1800.16
T1=917.88
SAT
f=77525
TT=1798.01
T1=684.2
No dataSAT (TO)
f=77636
TT=1800.11
T1=443.27
? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.14

? (TO)

TT=1800.04

? (TO)

TT=1800.06

SAT (TO)
f=82252
TT=1800.16
T1=20.4
SAT (TO)
f=79979
TT=1800.08
T1=929.18
SAT (TO)
f=80802
TT=1802.09
T1=1540.64
SAT
f=79920
TT=1783
T1=1561.11
SAT (TO)
f=80523
TT=1800.02
T1=1667.71
SAT
f=80036
TT=1798.05
T1=60.64
SAT (TO)
f=79879
TT=1800.99
T1=1594.77
?

TT=1794.15

No data? (TO)

TT=1800.2

SAT (TO)
f=79541
TT=1800.22
T1=370.86
?

TT=1789.86

No dataSAT (TO)
f=76666
TT=1800.16
T1=917.88
?

TT=1796.91

SAT (TO)
f=79179
TT=1800.01
T1=1800.5
? (TO)

TT=1800.1

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=79455
TT=1800.15
T1=900.41
No dataNo dataSAT (TO)
f=79721
TT=1800.05
T1=900.41
No dataNo dataNo dataSAT (TO)
f=76795
TT=1800.09
T1=728.69
SAT (TO)
f=82763
TT=1800.09
T1=2.14
SAT (TO)
f=77134
TT=1800.09
T1=1595.82
?

TT=1796.9

?

TT=1796.93

?

TT=1796.86

? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.61

No dataNo data?

TT=1799.58

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-data4_3.opb
OPT
f=8276
TT=0.058
T1=0.01
OPT
f=8276
TT=0.669
T1=0.04
No dataOPT
f=8276
TT=0.058
T1=0.03
OPT
f=8276
TT=6.278
T1=3.64
OPT
f=8276
TT=6.369
T1=2.27
OPT
f=8276
TT=5.894
T1=3.3
OPT
f=8276
TT=12.194
T1=2.24
OPT
f=8276
TT=1.674
T1=1.13
OPT
f=8276
TT=0.861
T1=0.35
OPT
f=8276
TT=1.684
T1=1.14
OPT
f=8276
TT=0.881
T1=0.34
OPT
f=8276
TT=0.465
T1=0.01
OPT
f=8276
TT=1.201
T1=0.64
OPT
f=8276
TT=0.401
T1=0.23
OPT
f=8276
TT=0.151
T1=0.01
OPT
f=8276
TT=1.087
T1=0.45
OPT
f=8276
TT=0.499
T1=0.03
OPT
f=8276
TT=1.296
T1=0.34
OPT
f=8276
TT=7.581
T1=2.82
No dataOPT
f=8276
TT=3.894
T1=2.11
OPT
f=8276
TT=2.066
T1=3.22
OPT
f=8276
TT=7.565
T1=3.03
No dataOPT
f=8276
TT=1.926
T1=1.75
OPT
f=8276
TT=4.204
T1=1.4
OPT
f=8276
TT=0.642
T1=0.64
OPT
f=8276
TT=5.92
T1=2.59
OPT
f=8276
TT=2.425
T1=1.88
No dataNo dataNo dataOPT
f=8276
TT=0.223
T1=0.11
No dataNo dataOPT
f=8276
TT=0.245
T1=0.12
No dataNo dataNo dataOPT
f=8276
TT=1.953
T1=2.26
OPT
f=8276
TT=0.816
T1=0.33
OPT
f=8276
TT=0.924
T1=0.33
OPT
f=8276
TT=4.045
T1=1.71
OPT
f=8276
TT=4.023
T1=1.71
OPT
f=8276
TT=6.476
T1=2.63
OPT
f=8276
TT=0.873
T1=0.02
OPT
f=8276
TT=0.868
T1=0.02
?

TT=1799.72

No dataNo data?

TT=1799.93

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-data6_3.opb
SAT
f=23954
TT=1800.02
T1=1063.69
SAT
f=24973
TT=1798
T1=281.68
No dataSAT (TO)
f=23954
TT=1800.02
T1=1063.69
? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.06

SAT (TO)
f=25177
TT=1800.04
T1=924.89
SAT (TO)
f=25361
TT=1800.08
T1=1600.69
SAT (TO)
f=25011
TT=1800.1
T1=566.18
SAT
f=24674
TT=1783.01
T1=322.31
SAT (TO)
f=25341
TT=1800.38
T1=1515.78
SAT
f=25836
TT=1798.02
T1=388.9
SAT (TO)
f=25174
TT=1800.03
T1=734.66
SAT
f=26962
TT=1798.19
T1=1408.72
No data? (TO)

TT=1800.08

SAT (TO)
f=24491
TT=1800.01
T1=571.2
SAT
f=27108
TT=1789.77
T1=1089.59
No dataSAT (TO)
f=25049
TT=1800.18
T1=171.64
SAT
f=25981
TT=1796.77
T1=93.23
SAT (TO)
f=25338
TT=1800.08
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=24310
TT=1800.54
T1=900.31
No dataNo dataSAT (TO)
f=25084
TT=1800.04
T1=900.21
No dataNo dataNo dataSAT (TO)
f=24720
TT=1800.05
T1=592.85
SAT (TO)
f=24892
TT=1800.08
T1=1555.01
SAT (TO)
f=24415
TT=1800.03
T1=140.95
SAT
f=26854
TT=1796.75
T1=4.88
SAT
f=26263
TT=1796.76
T1=557.16
SAT
f=26108
TT=1796.75
T1=1319.87
? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.57

No dataNo data?

TT=1799.84

normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-data8_3.opb
SAT
f=43606
TT=1800.05
T1=528.2
SAT
f=49214
TT=1798.05
T1=745.15
No dataSAT (TO)
f=45835
TT=1800.11
T1=890.61
? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.09

SAT (TO)
f=48865
TT=1800.09
T1=209.85
SAT (TO)
f=48117
TT=1800.04
T1=1330.94
SAT (TO)
f=47945
TT=1802.1
T1=690.13
SAT
f=46692
TT=1783.01
T1=896.02
SAT (TO)
f=48273
TT=1800.07
T1=671.1
SAT
f=50284
TT=1798.02
T1=593.25
SAT (TO)
f=48582
TT=1800.02
T1=1519.36
?

TT=1794.48

No data? (TO)

TT=1800.39

SAT (TO)
f=44677
TT=1801.17
T1=477.67
?

TT=1789.74

No dataSAT (TO)
f=46507
TT=1800.03
T1=2.14
SAT
f=51736
TT=1796.79
T1=858.78
SAT (TO)
f=48235
TT=1800.1
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=47545
TT=1800.43
T1=900.31
No dataNo dataSAT (TO)
f=47861
TT=1800.08
T1=900.31
No dataNo dataNo dataSAT (TO)
f=45233
TT=1800.16
T1=40.42
SAT (TO)
f=43606
TT=1800.05
T1=528.2
SAT (TO)
f=47882
TT=1800.55
T1=364.9
SAT
f=52253
TT=1796.8
T1=204.87
SAT
f=52253
TT=1796.77
T1=203.45
SAT
f=52253
TT=1796.77
T1=201.51
? (TO)

TT=1800.08

? (TO)

TT=1800.05

?

TT=1799.77

No dataNo data?

TT=1799.97

normalized-PB06/OPT-SMALLINT/submitted-PB05/
sorensson/garden/normalized-g100x100.opb
SAT
f=2514
TT=1802.11
T1=13.08
SAT
f=2883
TT=1798.03
T1=474.99
No dataSAT (TO)
f=2854
TT=1800.08
T1=1324.55
? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.06

SAT (TO)
f=2870
TT=1800.08
T1=827.47
SAT (TO)
f=3106
TT=1800.03
T1=0.25
SAT (TO)
f=2514
TT=1802.11
T1=13.08
SAT
f=2932
TT=1783.01
T1=175.29
No Cert.

TT=96.15

SAT
f=2877
TT=1798.01
T1=1767.65
SAT (TO)
f=2953
TT=1800.58
T1=401.3
?

TT=1792.41

No data? (TO)

TT=1800.3

SAT (TO)
f=2895
TT=1800.82
T1=672.29
SAT
f=2652
TT=1789.78
T1=1081.22
No dataSAT (TO)
f=2941
TT=1800.5
T1=682.45
? (TO)

TT=1802.03

SAT (TO)
f=3106
TT=1800.07
T1=1800.61
? (TO)

TT=1800.04

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=3056
TT=1800.12
T1=900.31
No dataNo dataSAT (TO)
f=3056
TT=1800.21
T1=900.41
No dataNo dataNo dataSAT (TO)
f=2932
TT=1800.02
T1=76.68
SAT (TO)
f=3334
TT=1800.07
T1=0.6
SAT (TO)
f=2869
TT=1800.07
T1=68.11
SAT
f=10000
TT=1799.97
T1=0.11
SAT (TO)
f=10000
TT=1800.58
T1=0.09
SAT (TO)
f=10000
TT=1800.41
T1=0.1
? (TO)

TT=1800.12

? (TO)

TT=1800.03

?

TT=1799.53

No dataNo data?

TT=1799.59

normalized-PB06/OPT-SMALLINT/
submitted-PB05/sorensson/
garden/normalized-g15x15.opb
OPT
f=53
TT=77.687
T1=13.8
SAT
f=54
TT=1798.02
T1=77.37
No dataSAT (TO)
f=58
TT=1800.11
T1=253.68
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.06

SAT (TO)
f=53
TT=1800.02
T1=28.14
SAT (TO)
f=54
TT=1800.01
T1=1362.65
SAT (TO)
f=60
TT=1800.13
T1=1664.9
SAT
f=59
TT=1783.01
T1=59.11
SAT (TO)
f=74
TT=1800.01
T1=0.19
SAT
f=54
TT=1798.02
T1=77.89
SAT (TO)
f=73
TT=1800.73
T1=0.77
OPT
f=53
TT=379.305
T1=33.45
No dataOPT
f=53
TT=77.687
T1=22.37
SAT (TO)
f=59
TT=1800.46
T1=693
SAT
f=70
TT=1789.74
T1=231.71
No dataSAT (TO)
f=60
TT=1800.08
T1=30.27
OPT
f=53
TT=375.437
T1=13.8
SAT (TO)
f=55
TT=1800.02
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=58
TT=1800.41
T1=900.21
No dataNo dataSAT (TO)
f=58
TT=1800.49
T1=900.31
No dataNo dataNo dataSAT (TO)
f=61
TT=1800.59
T1=93.56
SAT (TO)
f=74
TT=1800.58
T1=0.18
SAT (TO)
f=72
TT=1800.76
T1=76.07
OPT
f=53
TT=297.424
T1=18.85
OPT
f=53
TT=304.784
T1=19.2
OPT
f=53
TT=303.765
T1=19.14
? (TO)

TT=1800.1

? (TO)

TT=1800.03

?

TT=1799.5

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/
submitted-PB05/sorensson/
garden/normalized-g2x2.opb
OPT
f=2
TT=0
T1=0
OPT
f=2
TT=0.001
T1=0
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.031
T1=0.02
OPT
f=2
TT=0.036
T1=0.02
OPT
f=2
TT=0.011
T1=0.01
OPT
f=2
TT=0.02
T1=0.01
OPT
f=2
TT=0.015
T1=0.01
OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.017
T1=0.01
OPT
f=2
TT=0.021
T1=0.01
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0
T1=0
OPT
f=2
TT=0.02
T1=0.01
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.103
T1=0.11
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.143
T1=0.13
OPT
f=2
TT=0.01
T1=0
No dataOPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.153
T1=1.12
OPT
f=2
TT=0.011
T1=0
No dataOPT
f=2
TT=0.154
T1=0.63
OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.009
T1=0
OPT
f=2
TT=0.012
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
No dataNo dataOPT
f=2
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.173
T1=0.64
OPT
f=2
TT=0.155
T1=0.12
OPT
f=2
TT=0.175
T1=0.14
OPT
f=2
TT=0.01
T1=0
OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.012
T1=0
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.001
T1=0
No dataNo dataOPT
f=2
TT=0.002
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB05/sorensson/
garden/normalized-g4x4.opb
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.001
T1=0
No dataOPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.048
T1=0.05
OPT
f=4
TT=0.055
T1=0.05
OPT
f=4
TT=0.017
T1=0.01
OPT
f=4
TT=0.024
T1=0.02
OPT
f=4
TT=0.014
T1=0.01
OPT
f=4
TT=0.026
T1=0.02
OPT
f=4
TT=0.014
T1=0.01
OPT
f=4
TT=0.019
T1=0.02
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.043
T1=0.03
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.144
T1=0.13
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.163
T1=0.14
OPT
f=4
TT=0.015
T1=0.01
No dataOPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.172
T1=3.14
OPT
f=4
TT=0.013
T1=0.01
No dataOPT
f=4
TT=0.176
T1=1.64
OPT
f=4
TT=0.017
T1=0.01
OPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.019
T1=0.01
OPT
f=4
TT=0.02
T1=0.01
No dataNo dataNo dataOPT
f=4
TT=0.001
T1=0
No dataNo dataOPT
f=4
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=4
TT=0.163
T1=1.64
OPT
f=4
TT=0.153
T1=0.12
OPT
f=4
TT=0.177
T1=0.14
OPT
f=4
TT=0.01
T1=0
OPT
f=4
TT=0.013
T1=0
OPT
f=4
TT=0.011
T1=0
OPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.005
T1=0
OPT
f=4
TT=0.001
T1=0
No dataNo dataOPT
f=4
TT=0.002
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB05/sorensson/
garden/normalized-g7x7.opb
OPT
f=12
TT=0.001
T1=0
OPT
f=12
TT=0.019
T1=0.01
No dataOPT
f=12
TT=31.545
T1=1.05
OPT
f=12
TT=0.099
T1=0.1
OPT
f=12
TT=0.105
T1=0.1
OPT
f=12
TT=0.045
T1=0.08
OPT
f=12
TT=0.05
T1=0.05
OPT
f=12
TT=0.043
T1=0.03
OPT
f=12
TT=0.044
T1=0.04
OPT
f=12
TT=0.042
T1=0.03
OPT
f=12
TT=0.043
T1=0.03
OPT
f=12
TT=0.015
T1=0.01
OPT
f=12
TT=0.047
T1=0.03
OPT
f=12
TT=10.508
T1=0.6
OPT
f=12
TT=0.09
T1=0.02
OPT
f=12
TT=90.83
T1=1.02
OPT
f=12
TT=0.018
T1=0.01
OPT
f=12
TT=309.87
T1=17.69
OPT
f=12
TT=0.184
T1=0.18
No dataOPT
f=12
TT=0.017
T1=0.01
OPT
f=12
TT=3.932
T1=6.16
OPT
f=12
TT=16.478
T1=16.47
No dataOPT
f=12
TT=2.725
T1=3.14
OPT
f=12
TT=0.205
T1=0.19
OPT
f=12
TT=0.03
T1=0.03
OPT
f=12
TT=0.059
T1=0.05
OPT
f=12
TT=0.068
T1=0.04
No dataNo dataNo dataOPT
f=12
TT=0.002
T1=0
No dataNo dataOPT
f=12
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=12
TT=2.603
T1=3.13
OPT
f=12
TT=40.767
T1=32.62
OPT
f=12
TT=48.7
T1=9.93
OPT
f=12
TT=0.215
T1=0.21
OPT
f=12
TT=0.205
T1=0.2
OPT
f=12
TT=0.201
T1=0.19
OPT
f=12
TT=45.618
T1=25.93
OPT
f=12
TT=45.327
T1=25.76
OPT
f=12
TT=0.001
T1=0
No dataNo dataOPT
f=12
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB05/sorensson/
garden/normalized-g9x3.opb
OPT
f=7
TT=0.001
T1=0
OPT
f=7
TT=0.002
T1=0
No dataOPT
f=7
TT=0.012
T1=0
OPT
f=7
TT=0.055
T1=0.04
OPT
f=7
TT=0.058
T1=0.04
OPT
f=7
TT=0.018
T1=0.01
OPT
f=7
TT=0.023
T1=0.03
OPT
f=7
TT=0.02
T1=0.01
OPT
f=7
TT=0.025
T1=0.02
OPT
f=7
TT=0.018
T1=0.01
OPT
f=7
TT=0.023
T1=0.02
OPT
f=7
TT=0.004
T1=0
OPT
f=7
TT=0.007
T1=0
OPT
f=7
TT=0.072
T1=0.04
OPT
f=7
TT=0.002
T1=0
OPT
f=7
TT=0.564
T1=0.29
OPT
f=7
TT=0.002
T1=0
OPT
f=7
TT=0.594
T1=0.23
OPT
f=7
TT=0.013
T1=0.01
No dataOPT
f=7
TT=0.007
T1=0
OPT
f=7
TT=0.394
T1=3.13
OPT
f=7
TT=0.016
T1=0.01
No dataOPT
f=7
TT=0.164
T1=1.63
OPT
f=7
TT=0.019
T1=0.01
OPT
f=7
TT=0.006
T1=0
OPT
f=7
TT=0.022
T1=0.01
OPT
f=7
TT=0.021
T1=0.01
No dataNo dataNo dataOPT
f=7
TT=0.002
T1=0
No dataNo dataOPT
f=7
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=7
TT=0.203
T1=1.64
OPT
f=7
TT=0.483
T1=0.22
OPT
f=7
TT=0.664
T1=0.32
OPT
f=7
TT=0.016
T1=0.01
OPT
f=7
TT=0.017
T1=0.01
OPT
f=7
TT=0.013
T1=0.01
OPT
f=7
TT=0.126
T1=0.1
OPT
f=7
TT=0.127
T1=0.1
OPT
f=7
TT=0.003
T1=0
No dataNo dataOPT
f=7
TT=0.002
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB05/sorensson/
garden/normalized-g9x9.opb
OPT
f=20
TT=0.077
T1=0.06
OPT
f=20
TT=0.179
T1=0.14
No dataSAT (TO)
f=20
TT=1800.03
T1=39.59
OPT
f=20
TT=0.995
T1=0.39
OPT
f=20
TT=1.003
T1=0.39
OPT
f=20
TT=0.949
T1=0.36
OPT
f=20
TT=1.035
T1=0.4
OPT
f=20
TT=0.733
T1=0.35
OPT
f=20
TT=0.735
T1=0.41
OPT
f=20
TT=0.736
T1=0.35
OPT
f=20
TT=0.737
T1=0.35
OPT
f=20
TT=0.05
T1=0.01
OPT
f=20
TT=0.948
T1=0.06
SAT (TO)
f=20
TT=1800.14
T1=157.82
OPT
f=20
TT=47.56
T1=6.15
SAT (TO)
f=22
TT=1800.53
T1=45.47
OPT
f=20
TT=0.191
T1=0.15
SAT (TO)
f=22
TT=1800.92
T1=15.44
OPT
f=20
TT=0.672
T1=0.5
No dataOPT
f=20
TT=0.077
T1=0.07
SAT (TO)
f=21
TT=1800.01
T1=8.13
SAT
f=22
TT=1789.73
T1=15.24
No dataSAT (TO)
f=20
TT=1801.06
T1=400.96
OPT
f=20
TT=0.566
T1=0.5
OPT
f=20
TT=0.657
T1=0.65
OPT
f=20
TT=0.968
T1=0.37
OPT
f=20
TT=0.739
T1=0.35
No dataNo dataNo dataOPT
f=20
TT=1.702
T1=0.84
No dataNo dataOPT
f=20
TT=1.722
T1=0.86
No dataNo dataNo dataSAT (TO)
f=20
TT=1800.08
T1=535.11
SAT (TO)
f=23
TT=1800.72
T1=626.61
SAT (TO)
f=21
TT=1800.51
T1=475.06
OPT
f=20
TT=0.667
T1=0.57
OPT
f=20
TT=0.673
T1=0.57
OPT
f=20
TT=0.669
T1=0.57
? (TO)

TT=1800.03

? (TO)

TT=1800.03

OPT
f=20
TT=3.562
T1=3.56
No dataNo dataOPT
f=20
TT=3.551
T1=3.56
normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_10.opb.PB06.opb
SAT
f=188
TT=1796.77
T1=862.48
SAT
f=213
TT=1798.01
T1=33.21
No dataSAT (TO)
f=204
TT=1800.02
T1=1349.75
? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.08

SAT (TO)
f=219
TT=1800.07
T1=19.06
SAT (TO)
f=216
TT=1800.06
T1=869.15
SAT (TO)
f=210
TT=1800.15
T1=1132.92
SAT
f=211
TT=1783
T1=286.34
? (exit code)

TT=669.88

SAT
f=213
TT=1798.01
T1=31.78
SAT (TO)
f=214
TT=1800.09
T1=131.78
SAT (TO)
f=188
TT=1800.05
T1=349.4
No data? (TO)

TT=1800.28

SAT (TO)
f=207
TT=1800.59
T1=874.48
SAT
f=191
TT=1789.77
T1=148.47
No dataSAT (TO)
f=208
TT=1800.15
T1=59.51
SAT
f=188
TT=1796.77
T1=862.48
SAT (TO)
f=217
TT=1800.05
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=214
TT=1800.12
T1=900.31
No dataNo dataSAT (TO)
f=214
TT=1800.19
T1=900.31
No dataNo dataNo dataSAT (TO)
f=219
TT=1800.01
T1=496.97
SAT (TO)
f=223
TT=1800.66
T1=0.23
SAT (TO)
f=213
TT=1800.09
T1=117.61
SAT
f=191
TT=1796.76
T1=143.89
SAT
f=191
TT=1796.76
T1=145.2
SAT
f=189
TT=1796.75
T1=118.74
? (TO)

TT=1800.08

? (TO)

TT=1800.09

?

TT=1799.57

No dataNo data?

TT=1799.85

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_11.opb.PB06.opb
SAT
f=189
TT=1796.73
T1=93.71
SAT
f=218
TT=1798
T1=200.37
No dataSAT (TO)
f=207
TT=1800.06
T1=1715.07
? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.11

SAT (TO)
f=225
TT=1800.07
T1=11.85
SAT (TO)
f=213
TT=1800.06
T1=9.33
SAT (TO)
f=208
TT=1802.12
T1=0.17
SAT
f=214
TT=1783.01
T1=136.94
SAT (TO)
f=215
TT=1800.01
T1=313.03
SAT
f=214
TT=1798.01
T1=97.35
SAT (TO)
f=214
TT=1800.06
T1=518.2
SAT (TO)
f=188
TT=1800.05
T1=458.45
No data? (TO)

TT=1800.06

SAT (TO)
f=212
TT=1801.28
T1=194.56
SAT
f=191
TT=1789.78
T1=259.32
No dataSAT (TO)
f=211
TT=1800.67
T1=38.64
SAT
f=191
TT=1796.75
T1=152.17
SAT (TO)
f=220
TT=1800.03
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=216
TT=1800.41
T1=900.31
No dataNo dataSAT (TO)
f=216
TT=1800.45
T1=900.31
No dataNo dataNo dataSAT (TO)
f=219
TT=1800.12
T1=133.23
SAT (TO)
f=227
TT=1800.66
T1=0.26
SAT (TO)
f=214
TT=1800.39
T1=669.89
SAT
f=189
TT=1796.73
T1=207.92
SAT
f=189
TT=1796.77
T1=208.29
SAT
f=189
TT=1796.75
T1=93.71
? (TO)

TT=1800.1

? (TO)

TT=1800.06

?

TT=1799.75

No dataNo data?

TT=1799.85

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_12.opb.PB06.opb
SAT
f=183
TT=1789.75
T1=746.25
SAT
f=212
TT=1798.01
T1=1787.16
No dataSAT (TO)
f=200
TT=1800.02
T1=1565.3
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=215
TT=1800.08
T1=28.67
SAT (TO)
f=210
TT=1800.04
T1=167.65
SAT (TO)
f=209
TT=1800.19
T1=0.31
SAT
f=208
TT=1783.01
T1=1039.16
SAT (TO)
f=208
TT=1800.01
T1=86.24
SAT
f=212
TT=1798.69
T1=222.28
SAT (TO)
f=213
TT=1800.09
T1=42.88
SAT (TO)
f=183
TT=1800.04
T1=350.63
No data? (TO)

TT=1800.31

SAT (TO)
f=206
TT=1800.68
T1=646.44
SAT
f=183
TT=1789.75
T1=746.25
No dataSAT (TO)
f=205
TT=1800.95
T1=64.01
SAT
f=185
TT=1796.76
T1=52.42
SAT (TO)
f=210
TT=1800.05
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=207
TT=1800.1
T1=900.31
No dataNo dataSAT (TO)
f=207
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=214
TT=1800.13
T1=516.31
SAT (TO)
f=217
TT=1800.65
T1=0.73
SAT (TO)
f=209
TT=1800.08
T1=215.05
SAT
f=184
TT=1796.75
T1=1700.3
SAT
f=184
TT=1796.76
T1=1746.3
SAT
f=185
TT=1796.78
T1=186.76
? (TO)

TT=1800.02

? (TO)

TT=1800.11

?

TT=1799.5

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_13.opb.PB06.opb
SAT
f=188
TT=1796.75
T1=221.82
SAT
f=220
TT=1798
T1=123.2
No dataSAT (TO)
f=206
TT=1800.02
T1=1034.95
? (TO)

TT=1800.13

? (TO)

TT=1800.14

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.14

? (TO)

TT=1800.09

? (TO)

TT=1800.1

SAT (TO)
f=227
TT=1800.07
T1=0.27
SAT (TO)
f=222
TT=1800.07
T1=26.47
SAT (TO)
f=218
TT=1802.11
T1=3.06
SAT
f=213
TT=1783.01
T1=266.96
SAT (TO)
f=218
TT=1800.09
T1=1836.13
SAT
f=218
TT=1798
T1=256.27
SAT (TO)
f=215
TT=1800.03
T1=1286.1
SAT (TO)
f=192
TT=1800.08
T1=1735.88
No data? (TO)

TT=1800.28

SAT (TO)
f=214
TT=1800.68
T1=199.66
SAT
f=193
TT=1789.76
T1=279.37
No dataSAT (TO)
f=212
TT=1800.15
T1=579.96
SAT
f=190
TT=1796.76
T1=259.77
SAT (TO)
f=219
TT=1800.09
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=216
TT=1800.16
T1=900.41
No dataNo dataSAT (TO)
f=216
TT=1800.13
T1=900.31
No dataNo dataNo dataSAT (TO)
f=219
TT=1800.13
T1=551.46
SAT (TO)
f=222
TT=1800.02
T1=0.31
SAT (TO)
f=212
TT=1800.05
T1=102.12
SAT
f=188
TT=1796.75
T1=225.44
SAT
f=188
TT=1796.75
T1=221.82
SAT
f=193
TT=1796.74
T1=339.75
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.85

No dataNo data?

TT=1799.84

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_14.opb.PB06.opb
SAT
f=189
TT=1789.75
T1=414.17
SAT
f=217
TT=1798
T1=46.38
No dataSAT (TO)
f=206
TT=1800.03
T1=307.58
? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.08

SAT (TO)
f=224
TT=1800.08
T1=3.74
SAT (TO)
f=219
TT=1800.06
T1=10.5
SAT (TO)
f=213
TT=1802.05
T1=0.21
SAT
f=213
TT=1783
T1=1041.14
SAT (TO)
f=213
TT=1800.01
T1=874.97
SAT
f=216
TT=1798
T1=633.55
SAT (TO)
f=217
TT=1800.06
T1=56.3
SAT (TO)
f=188
TT=1800.08
T1=823.15
No data? (TO)

TT=1800.02

SAT (TO)
f=211
TT=1800.17
T1=133.22
SAT
f=189
TT=1789.75
T1=414.17
No dataSAT (TO)
f=211
TT=1800.16
T1=59.7
SAT
f=189
TT=1796.75
T1=447.24
SAT (TO)
f=214
TT=1800.04
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=213
TT=1800.14
T1=900.31
No dataNo dataSAT (TO)
f=213
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=217
TT=1800.48
T1=530.28
SAT (TO)
f=223
TT=1800.52
T1=0.27
SAT (TO)
f=212
TT=1800.05
T1=587.79
SAT
f=192
TT=1796.77
T1=681.74
SAT
f=192
TT=1796.77
T1=682.09
SAT
f=191
TT=1796.74
T1=288.59
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.48

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_15.opb.PB06.opb
SAT
f=192
TT=1789.74
T1=395.21
SAT
f=216
TT=1798.01
T1=342.44
No dataSAT (TO)
f=207
TT=1800.03
T1=327.6
? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.11

SAT (TO)
f=225
TT=1800.06
T1=196.68
SAT (TO)
f=221
TT=1800.04
T1=123.47
SAT (TO)
f=216
TT=1802.09
T1=194.11
SAT
f=213
TT=1783.01
T1=1492.62
SAT (TO)
f=216
TT=1800.02
T1=1585.54
SAT
f=217
TT=1798
T1=751.33
SAT (TO)
f=216
TT=1800.01
T1=541.1
SAT
f=193
TT=1797.94
T1=336.22
No data? (TO)

TT=1800.03

SAT (TO)
f=212
TT=1800.11
T1=143.76
SAT
f=192
TT=1789.74
T1=395.21
No dataSAT (TO)
f=212
TT=1800.13
T1=534.71
SAT
f=195
TT=1796.74
T1=431.17
SAT (TO)
f=218
TT=1800.02
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=217
TT=1800.5
T1=900.31
No dataNo dataSAT (TO)
f=217
TT=1800.09
T1=900.31
No dataNo dataNo dataSAT (TO)
f=218
TT=1801.67
T1=162.86
SAT (TO)
f=231
TT=1800.02
T1=0.33
SAT (TO)
f=214
TT=1800.06
T1=1210.06
SAT
f=194
TT=1796.77
T1=656.37
SAT
f=194
TT=1796.77
T1=650.94
SAT
f=196
TT=1796.77
T1=79.37
? (TO)

TT=1800.11

? (TO)

TT=1800.01

?

TT=1799.45

No dataNo data?

TT=1799.89

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_16.opb.PB06.opb
SAT
f=188
TT=1796.76
T1=228.22
SAT
f=217
TT=1798
T1=766.5
No dataSAT (TO)
f=206
TT=1800.03
T1=1666.4
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.08

SAT (TO)
f=226
TT=1800.06
T1=8.65
SAT (TO)
f=219
TT=1800.06
T1=1040.92
SAT (TO)
f=214
TT=1802.11
T1=0.1
SAT
f=215
TT=1783
T1=113.31
SAT (TO)
f=215
TT=1800.99
T1=424.49
SAT
f=218
TT=1798.01
T1=192.8
SAT (TO)
f=218
TT=1800.09
T1=239.09
SAT (TO)
f=193
TT=1800.07
T1=111.89
No data? (TO)

TT=1800.25

SAT (TO)
f=212
TT=1801.34
T1=725.94
SAT
f=191
TT=1789.76
T1=653.31
No dataSAT (TO)
f=212
TT=1801.51
T1=721.17
SAT
f=188
TT=1796.76
T1=1156.78
SAT (TO)
f=219
TT=1800.04
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=216
TT=1800.42
T1=900.31
No dataNo dataSAT (TO)
f=216
TT=1800.44
T1=900.31
No dataNo dataNo dataSAT (TO)
f=222
TT=1800.44
T1=136.01
SAT (TO)
f=230
TT=1800.06
T1=0.25
SAT (TO)
f=213
TT=1800.02
T1=151.22
SAT
f=192
TT=1796.75
T1=382.03
SAT
f=192
TT=1796.76
T1=380.8
SAT
f=188
TT=1796.77
T1=228.22
? (TO)

TT=1800.02

? (TO)

TT=1800.1

?

TT=1799.37

No dataNo data?

TT=1799.76

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_17.opb.PB06.opb
SAT
f=193
TT=1796.77
T1=1045.64
SAT
f=219
TT=1798.01
T1=1203.84
No dataSAT (TO)
f=211
TT=1800.03
T1=679.79
? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.11

SAT (TO)
f=230
TT=1800.07
T1=1364.95
SAT (TO)
f=222
TT=1800.06
T1=5.31
SAT (TO)
f=215
TT=1802.12
T1=242.64
SAT
f=219
TT=1783.01
T1=0.64
SAT (TO)
f=221
TT=1800.52
T1=198.94
SAT
f=222
TT=1798.05
T1=209.26
SAT (TO)
f=220
TT=1800.01
T1=1298.97
SAT (TO)
f=195
TT=1800.06
T1=1181.76
No data? (TO)

TT=1800.03

SAT (TO)
f=217
TT=1801.14
T1=49.6
SAT
f=199
TT=1789.75
T1=196.13
No dataSAT (TO)
f=217
TT=1800.28
T1=915.52
SAT
f=197
TT=1796.78
T1=254.15
SAT (TO)
f=220
TT=1800.08
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=220
TT=1800.56
T1=900.31
No dataNo dataSAT (TO)
f=220
TT=1800.63
T1=900.31
No dataNo dataNo dataSAT (TO)
f=227
TT=1800.52
T1=341.1
SAT (TO)
f=236
TT=1800.07
T1=0.29
SAT (TO)
f=218
TT=1800.63
T1=781.94
SAT
f=198
TT=1796.76
T1=1324.09
SAT
f=198
TT=1796.76
T1=1320.19
SAT
f=193
TT=1796.77
T1=1045.64
? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.71

No dataNo data?

TT=1799.37

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_18.opb.PB06.opb
SAT
f=190
TT=1796.74
T1=364.69
SAT
f=217
TT=1798
T1=1764.45
No dataSAT (TO)
f=206
TT=1800.02
T1=307.66
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=224
TT=1800.08
T1=186.33
SAT (TO)
f=216
TT=1800.03
T1=1226.47
SAT (TO)
f=214
TT=1802.06
T1=140.56
SAT
f=215
TT=1783.01
T1=1.72
SAT (TO)
f=218
TT=1800.53
T1=26.77
SAT
f=219
TT=1798
T1=1718
SAT (TO)
f=214
TT=1800.91
T1=309.62
SAT (TO)
f=191
TT=1800.07
T1=362.13
No data? (TO)

TT=1800.1

SAT (TO)
f=210
TT=1800.02
T1=342.43
SAT
f=191
TT=1789.74
T1=246.09
No dataSAT (TO)
f=209
TT=1800.18
T1=766.81
SAT
f=190
TT=1796.77
T1=364.69
SAT (TO)
f=216
TT=1800.03
T1=1800.4
? (TO)

TT=1800.01

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=216
TT=1800.5
T1=900.31
No dataNo dataSAT (TO)
f=216
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=219
TT=1800.12
T1=117.85
SAT (TO)
f=224
TT=1801.07
T1=0.59
SAT (TO)
f=212
TT=1800.01
T1=1773.14
SAT
f=190
TT=1796.74
T1=1636.15
SAT
f=190
TT=1796.76
T1=1630.13
SAT
f=194
TT=1796.75
T1=270.3
? (TO)

TT=1800.1

? (TO)

TT=1800.08

?

TT=1799.54

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_19.opb.PB06.opb
SAT
f=184
TT=1796.77
T1=136.57
SAT
f=211
TT=1798.01
T1=109.8
No dataSAT (TO)
f=200
TT=1800.02
T1=177.97
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.07

SAT (TO)
f=217
TT=1800.07
T1=461.16
SAT (TO)
f=208
TT=1800.07
T1=866.86
SAT (TO)
f=205
TT=1802.08
T1=613.19
SAT
f=208
TT=1783.01
T1=0.34
SAT (TO)
f=211
TT=1800.07
T1=284.98
SAT
f=210
TT=1798
T1=332.37
SAT (TO)
f=211
TT=1800.68
T1=82.3
SAT
f=189
TT=1797.46
T1=252.51
No data? (TO)

TT=1800.1

SAT (TO)
f=205
TT=1800.09
T1=212.87
SAT
f=187
TT=1789.75
T1=581.28
No dataSAT (TO)
f=203
TT=1800.49
T1=212.9
SAT
f=188
TT=1796.76
T1=480
SAT (TO)
f=213
TT=1800.03
T1=1800.4
? (TO)

TT=1800.01

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=209
TT=1800.49
T1=900.31
No dataNo dataSAT (TO)
f=209
TT=1800.51
T1=900.31
No dataNo dataNo data? (TO)

TT=1802.15

SAT (TO)
f=223
TT=1800.09
T1=0.24
SAT (TO)
f=209
TT=1800.09
T1=6.04
SAT
f=186
TT=1796.74
T1=209.12
SAT
f=186
TT=1796.75
T1=209.74
SAT
f=184
TT=1796.77
T1=136.57
? (TO)

TT=1800.02

? (TO)

TT=1800.11

?

TT=1799.52

No dataNo data?

TT=1799.45

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_20.opb.PB06.opb
SAT
f=189
TT=1796.76
T1=534.5
SAT
f=213
TT=1798
T1=270.87
No dataSAT (TO)
f=204
TT=1800.02
T1=741.58
? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.05

SAT (TO)
f=221
TT=1800.07
T1=173.78
SAT (TO)
f=223
TT=1800.07
T1=0.28
SAT (TO)
f=213
TT=1802.11
T1=0.6
SAT
f=210
TT=1783.01
T1=586.82
SAT (TO)
f=213
TT=1800.05
T1=641.02
SAT
f=214
TT=1798.01
T1=950.25
SAT (TO)
f=212
TT=1800.58
T1=1028.85
SAT (TO)
f=189
TT=1800.06
T1=858.46
No data? (TO)

TT=1800.05

SAT (TO)
f=208
TT=1800.16
T1=738.37
SAT
f=190
TT=1789.77
T1=128.5
No dataSAT (TO)
f=208
TT=1800.29
T1=661.02
SAT
f=189
TT=1796.76
T1=534.5
SAT (TO)
f=219
TT=1800.06
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=212
TT=1800.02
T1=900.31
No dataNo dataSAT (TO)
f=212
TT=1800.39
T1=900.31
No dataNo dataNo dataSAT (TO)
f=216
TT=1800.63
T1=808.01
SAT (TO)
f=226
TT=1800.07
T1=0.25
SAT (TO)
f=213
TT=1800.08
T1=27.64
SAT
f=190
TT=1796.75
T1=417.31
SAT
f=190
TT=1796.73
T1=416.7
SAT
f=191
TT=1796.75
T1=986.53
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.61

No dataNo data? (TO)

TT=1800.1

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_21.opb.PB06.opb
SAT
f=189
TT=1789.75
T1=543.85
SAT
f=218
TT=1798
T1=280.79
No dataSAT (TO)
f=207
TT=1800.11
T1=164.95
? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.03

SAT (TO)
f=224
TT=1800.07
T1=105.42
SAT (TO)
f=222
TT=1800.07
T1=140.31
SAT (TO)
f=215
TT=1802.03
T1=1.97
SAT
f=216
TT=1783.01
T1=1317.87
SAT (TO)
f=216
TT=1801.23
T1=436.63
SAT
f=215
TT=1798
T1=1000.05
SAT (TO)
f=216
TT=1800.07
T1=109.58
SAT (TO)
f=195
TT=1800.09
T1=524.22
No data? (TO)

TT=1800.15

SAT (TO)
f=214
TT=1800.77
T1=33.27
SAT
f=189
TT=1789.75
T1=543.85
No dataSAT (TO)
f=211
TT=1800.09
T1=28.06
SAT
f=194
TT=1796.76
T1=1589.66
SAT (TO)
f=220
TT=1800.03
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=217
TT=1800.11
T1=900.41
No dataNo dataSAT (TO)
f=217
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=221
TT=1800.74
T1=34.13
SAT (TO)
f=232
TT=1800.1
T1=0.28
SAT (TO)
f=213
TT=1800.51
T1=1685.9
SAT
f=194
TT=1796.74
T1=403.96
SAT
f=194
TT=1796.76
T1=401.63
SAT
f=194
TT=1796.76
T1=899.44
? (TO)

TT=1800.02

? (TO)

TT=1800.09

?

TT=1799.54

No dataNo data?

TT=1799.78

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_22.opb.PB06.opb
SAT
f=186
TT=1789.77
T1=1527.66
SAT
f=214
TT=1798.01
T1=92.62
No dataSAT (TO)
f=204
TT=1800.01
T1=817.48
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.02

SAT (TO)
f=223
TT=1800.05
T1=0.28
SAT (TO)
f=217
TT=1800.03
T1=115.7
SAT (TO)
f=211
TT=1802.09
T1=108.37
SAT
f=211
TT=1783.01
T1=260.91
? (exit code)

TT=627.927

SAT
f=212
TT=1798
T1=97.86
SAT (TO)
f=214
TT=1800.57
T1=720.86
SAT (TO)
f=187
TT=1800.04
T1=613.65
No data? (TO)

TT=1800.39

SAT (TO)
f=211
TT=1801.51
T1=79.89
SAT
f=186
TT=1789.77
T1=1527.66
No dataSAT (TO)
f=208
TT=1800.12
T1=213.16
SAT
f=187
TT=1796.75
T1=193.04
SAT (TO)
f=215
TT=1800.08
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=211
TT=1800.06
T1=900.31
No dataNo dataSAT (TO)
f=211
TT=1800.19
T1=900.31
No dataNo dataNo dataSAT (TO)
f=220
TT=1800.06
T1=7.26
SAT (TO)
f=223
TT=1800.08
T1=0.23
SAT (TO)
f=209
TT=1800.73
T1=654.09
SAT
f=191
TT=1796.77
T1=409.93
SAT
f=191
TT=1796.77
T1=409.32
SAT
f=189
TT=1796.77
T1=215.61
? (TO)

TT=1800.11

? (TO)

TT=1800.03

?

TT=1799.55

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_23.opb.PB06.opb
SAT
f=193
TT=1789.76
T1=548.98
SAT
f=223
TT=1798.01
T1=677.48
No dataSAT (TO)
f=210
TT=1800.02
T1=1794.73
? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.07

SAT (TO)
f=226
TT=1800.08
T1=83.66
SAT (TO)
f=224
TT=1800.04
T1=62.28
SAT (TO)
f=216
TT=1802.05
T1=2.51
SAT
f=218
TT=1783.01
T1=689.7
? (exit code)

TT=1111.43

SAT
f=223
TT=1798
T1=599.25
SAT (TO)
f=222
TT=1800.07
T1=856.38
SAT (TO)
f=192
TT=1800.04
T1=126.25
No data? (TO)

TT=1800.09

SAT (TO)
f=219
TT=1801.4
T1=76.81
SAT
f=193
TT=1789.76
T1=548.98
No dataSAT (TO)
f=216
TT=1800.18
T1=953.76
SAT
f=194
TT=1796.75
T1=256.68
SAT (TO)
f=227
TT=1800.02
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=220
TT=1800.06
T1=900.31
No dataNo dataSAT (TO)
f=220
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=223
TT=1800.8
T1=401.15
SAT (TO)
f=232
TT=1800.72
T1=0.31
SAT (TO)
f=218
TT=1800.06
T1=812.78
SAT
f=195
TT=1796.76
T1=126.23
SAT
f=195
TT=1796.77
T1=124.74
SAT
f=196
TT=1796.75
T1=277.41
? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1799.6

No dataNo data?

TT=1799.58

normalized-PB06/OPT-SMALLINT/submitted-PB06/
liu/domset/
normalized-domset_v500_e2000_w30_mw19_24.opb.PB06.opb
SAT
f=190
TT=1796.75
T1=184.35
SAT
f=219
TT=1798
T1=218.85
No dataSAT (TO)
f=208
TT=1800.06
T1=955.02
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.1

SAT (TO)
f=222
TT=1800.08
T1=0.26
SAT (TO)
f=221
TT=1800.04
T1=230.08
SAT (TO)
f=218
TT=1802.09
T1=66.55
SAT
f=218
TT=1783
T1=52.82
SAT (TO)
f=219
TT=1800.04
T1=1618.93
SAT
f=221
TT=1798.01
T1=3.23
SAT (TO)
f=218
TT=1800.91
T1=353.74
SAT (TO)
f=191
TT=1800.05
T1=733.1
No data? (TO)

TT=1800.16

SAT (TO)
f=216
TT=1800.58
T1=17.29
SAT
f=191
TT=1789.75
T1=702.58
No dataSAT (TO)
f=216
TT=1800.7
T1=37.35
SAT
f=191
TT=1796.75
T1=251.64
SAT (TO)
f=221
TT=1800.03
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=218
TT=1800.49
T1=900.31
No dataNo dataSAT (TO)
f=218
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=219
TT=1800.06
T1=253.4
SAT (TO)
f=220
TT=1800.02
T1=1.37
SAT (TO)
f=214
TT=1800.09
T1=1572.49
SAT
f=190
TT=1796.75
T1=185.08
SAT
f=190
TT=1796.75
T1=184.35
SAT
f=191
TT=1796.77
T1=652.99
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.82

No dataNo data?

TT=1799.86

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_0.opb.PB06.opb
SAT
f=1040
TT=1796.75
T1=1186.62
SAT
f=1071
TT=1798
T1=705.28
No dataSAT (TO)
f=1175
TT=1800.02
T1=261.23
? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.08

SAT (TO)
f=1068
TT=1800.11
T1=31.32
SAT (TO)
f=1181
TT=1800.06
T1=954.47
SAT (TO)
f=1158
TT=1801.08
T1=0.31
SAT
f=1188
TT=1783.01
T1=183.94
No Cert.

TT=83.504

SAT
f=1072
TT=1798.01
T1=1026.78
SAT (TO)
f=1187
TT=1800.5
T1=6.42
SAT
f=1046
TT=1797.42
T1=337.37
No data? (TO)

TT=1800.35

SAT (TO)
f=1171
TT=1800.49
T1=767.55
SAT
f=1047
TT=1789.75
T1=790.9
No dataSAT (TO)
f=1173
TT=1800.5
T1=815.81
SAT
f=1045
TT=1796.75
T1=411.32
SAT (TO)
f=1193
TT=1800.04
T1=1800.71
? (TO)

TT=1800.14

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=1179
TT=1800.08
T1=900.31
No dataNo dataSAT (TO)
f=1179
TT=1800.62
T1=900.41
No dataNo dataNo dataSAT (TO)
f=1176
TT=1800.22
T1=663.16
SAT (TO)
f=1198
TT=1800.04
T1=0.52
SAT (TO)
f=1191
TT=1800.08
T1=1235.45
SAT
f=1041
TT=1796.76
T1=1373.09
SAT
f=1041
TT=1796.76
T1=1355.11
SAT
f=1040
TT=1796.75
T1=1186.62
? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1799.51

No dataNo data?

TT=1799.46

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_11.opb.PB06.opb
SAT
f=1030
TT=1796.82
T1=877.69
SAT
f=1062
TT=1798
T1=451.22
No dataSAT (TO)
f=1164
TT=1800.11
T1=0.4
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.08

SAT (TO)
f=1049
TT=1800.11
T1=1578.63
SAT (TO)
f=1176
TT=1800.02
T1=0.05
SAT (TO)
f=1158
TT=1800.44
T1=0.31
SAT
f=1169
TT=1783.01
T1=975.73
? (exit code)

TT=278.65

SAT
f=1062
TT=1798.01
T1=449.64
SAT (TO)
f=1175
TT=1800.9
T1=0.35
SAT
f=1037
TT=1797.34
T1=553.84
No data? (TO)

TT=1800.07

SAT (TO)
f=1152
TT=1800.03
T1=948.56
SAT
f=1040
TT=1789.75
T1=425.76
No dataSAT (TO)
f=1154
TT=1800.1
T1=457.25
SAT
f=1031
TT=1796.8
T1=1771.13
SAT (TO)
f=1176
TT=1800.1
T1=1800.61
? (TO)

TT=1800.07

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=1162
TT=1800.04
T1=900.21
No dataNo dataSAT (TO)
f=1162
TT=1800.05
T1=900.21
No dataNo dataNo dataSAT (TO)
f=1152
TT=1800.6
T1=540.75
SAT (TO)
f=1174
TT=1800.09
T1=0.46
SAT (TO)
f=1174
TT=1800.07
T1=2.24
SAT
f=1031
TT=1796.74
T1=1554.57
SAT
f=1031
TT=1796.75
T1=1468.81
SAT
f=1030
TT=1796.82
T1=877.69
? (TO)

TT=1800.08

? (TO)

TT=1800.11

?

TT=1799.86

No dataNo data?

TT=1799.79

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_12.opb.PB06.opb
SAT
f=1044
TT=1796.75
T1=1019.53
SAT
f=1064
TT=1798.01
T1=1489.52
No dataSAT (TO)
f=1166
TT=1800.11
T1=1795.55
? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.09

SAT (TO)
f=1066
TT=1800.01
T1=66.72
SAT (TO)
f=1165
TT=1800.13
T1=55.06
SAT (TO)
f=1175
TT=1800.32
T1=0.3
SAT
f=1185
TT=1783.01
T1=1099.65
? (exit code)

TT=281.65

SAT
f=1071
TT=1798
T1=289.25
SAT (TO)
f=1181
TT=1800.62
T1=0.36
SAT
f=1047
TT=1798.27
T1=507.42
No data? (TO)

TT=1800.31

SAT (TO)
f=1160
TT=1800.13
T1=914.22
SAT
f=1046
TT=1789.76
T1=1408.2
No dataSAT (TO)
f=1161
TT=1800.42
T1=420.78
SAT
f=1044
TT=1796.76
T1=1019.53
SAT (TO)
f=1166
TT=1800.06
T1=1800.71
? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=1158
TT=1800.37
T1=900.41
No dataNo dataSAT (TO)
f=1158
TT=1800.4
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1164
TT=1800.5
T1=335.92
SAT (TO)
f=1181
TT=1800.01
T1=0.35
SAT (TO)
f=1178
TT=1800.36
T1=959.65
SAT
f=1045
TT=1796.75
T1=407.71
SAT
f=1045
TT=1796.77
T1=402.76
SAT
f=1044
TT=1796.75
T1=1338.46
? (TO)

TT=1800.02

? (TO)

TT=1800.01

?

TT=1799.54

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_18.opb.PB06.opb
SAT
f=1041
TT=1796.74
T1=934.74
SAT
f=1071
TT=1798
T1=755.33
No dataSAT (TO)
f=1176
TT=1800.09
T1=1454.06
? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.09

SAT (TO)
f=1058
TT=1800.1
T1=36.2
SAT (TO)
f=1198
TT=1800.06
T1=0.05
SAT (TO)
f=1167
TT=1800.45
T1=0.38
SAT
f=1170
TT=1783.01
T1=1712.3
? (exit code)

TT=294.07

SAT
f=1063
TT=1798.01
T1=1097.79
SAT (TO)
f=1190
TT=1800.06
T1=772.64
SAT
f=1046
TT=1795.65
T1=893.68
No data? (TO)

TT=1800.09

SAT (TO)
f=1171
TT=1800.76
T1=828.84
SAT
f=1044
TT=1789.76
T1=926.62
No dataSAT (TO)
f=1172
TT=1800.11
T1=784.66
SAT
f=1041
TT=1796.76
T1=1161.73
SAT (TO)
f=1198
TT=1800.02
T1=1800.71
? (TO)

TT=1800.03

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=1160
TT=1800.62
T1=900.41
No dataNo dataSAT (TO)
f=1160
TT=1800.48
T1=900.31
No dataNo dataNo data? (TO)

TT=1802.09

SAT (TO)
f=1198
TT=1800.01
T1=0.33
SAT (TO)
f=1182
TT=1800.18
T1=210.27
SAT
f=1043
TT=1796.76
T1=1435.19
SAT
f=1043
TT=1796.76
T1=1418.68
SAT
f=1041
TT=1796.74
T1=934.74
? (TO)

TT=1800.08

? (TO)

TT=1800.02

?

TT=1799.26

No dataNo data?

TT=1799.41

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_1.opb.PB06.opb
SAT
f=1043
TT=1796.75
T1=1391.14
SAT
f=1070
TT=1798
T1=1580.7
No dataSAT (TO)
f=1161
TT=1800.11
T1=1601.06
? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.07

SAT (TO)
f=1062
TT=1800.11
T1=23.5
SAT (TO)
f=1189
TT=1800.03
T1=0.04
SAT (TO)
f=1171
TT=1802.09
T1=0.31
SAT
f=1189
TT=1783.01
T1=1550.96
No Cert.

TT=280.22

SAT
f=1071
TT=1798
T1=853.31
SAT (TO)
f=1187
TT=1800.08
T1=427.58
SAT
f=1045
TT=1798.45
T1=669.35
No data? (TO)

TT=1800.13

SAT (TO)
f=1166
TT=1800.71
T1=239.45
SAT
f=1047
TT=1789.74
T1=266.15
No dataSAT (TO)
f=1165
TT=1800.55
T1=548.09
SAT
f=1043
TT=1796.75
T1=1414.69
SAT (TO)
f=1174
TT=1800.02
T1=1800.71
? (TO)

TT=1800.09

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=1169
TT=1800.09
T1=900.31
No dataNo dataSAT (TO)
f=1169
TT=1800.38
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1160
TT=1800.13
T1=129.77
SAT (TO)
f=1188
TT=1800.39
T1=0.37
SAT (TO)
f=1186
TT=1800.87
T1=100.91
SAT
f=1043
TT=1796.76
T1=1397.44
SAT
f=1043
TT=1796.77
T1=1391.14
SAT
f=1046
TT=1796.76
T1=835.68
? (TO)

TT=1800.09

? (TO)

TT=1800.02

?

TT=1799.39

No dataNo data?

TT=1799.85

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_21.opb.PB06.opb
SAT
f=1034
TT=1796.74
T1=1241.65
SAT
f=1062
TT=1798.03
T1=1745.16
No dataSAT (TO)
f=1160
TT=1800.02
T1=1366.63
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.08

SAT (TO)
f=1049
TT=1800.11
T1=1015.68
SAT (TO)
f=1179
TT=1800.07
T1=2.06
SAT (TO)
f=1148
TT=1802.07
T1=0.45
SAT
f=1175
TT=1783.01
T1=689.25
No Cert.

TT=278.731

SAT
f=1064
TT=1798.02
T1=1704.55
SAT (TO)
f=1179
TT=1800.1
T1=211.36
SAT
f=1038
TT=1798.16
T1=578.7
No data? (TO)

TT=1800.13

SAT (TO)
f=1165
TT=1800.08
T1=852.07
SAT
f=1042
TT=1789.78
T1=1225.15
No dataSAT (TO)
f=1158
TT=1800.42
T1=474.03
SAT
f=1034
TT=1796.77
T1=1272.49
SAT (TO)
f=1179
TT=1800.02
T1=1800.71
? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=1160
TT=1800.02
T1=900.31
No dataNo dataSAT (TO)
f=1160
TT=1800.04
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1151
TT=1800.11
T1=957.33
SAT (TO)
f=1208
TT=1800.07
T1=0.41
SAT (TO)
f=1174
TT=1800.09
T1=320.93
SAT
f=1035
TT=1796.78
T1=940.61
SAT
f=1035
TT=1796.76
T1=927.04
SAT
f=1034
TT=1796.74
T1=1241.65
? (TO)

TT=1800.03

? (TO)

TT=1800.11

?

TT=1799.47

No dataNo data?

TT=1799.68

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_2.opb.PB06.opb
SAT
f=1044
TT=1796.75
T1=1542.77
SAT
f=1072
TT=1798.01
T1=943.27
No dataSAT (TO)
f=1166
TT=1800.07
T1=336.41
? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.09

SAT (TO)
f=1063
TT=1800.02
T1=1133.55
SAT (TO)
f=1185
TT=1800.11
T1=63.02
SAT (TO)
f=1180
TT=1800.34
T1=0.48
SAT
f=1190
TT=1783.01
T1=83.25
No Cert.

TT=276.49

SAT
f=1072
TT=1798.01
T1=935.41
SAT (TO)
f=1192
TT=1800.08
T1=1090.45
SAT
f=1051
TT=1797.82
T1=289.73
No data? (TO)

TT=1800.02

SAT (TO)
f=1166
TT=1800.82
T1=47.42
SAT
f=1054
TT=1789.76
T1=1399.36
No dataSAT (TO)
f=1160
TT=1800.06
T1=929.74
SAT
f=1048
TT=1796.81
T1=1125.51
SAT (TO)
f=1199
TT=1800.04
T1=1800.71
? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=1173
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=1173
TT=1800.12
T1=900.41
No dataNo dataNo dataSAT (TO)
f=1170
TT=1800.47
T1=931.98
SAT (TO)
f=1200
TT=1800.05
T1=0.33
SAT (TO)
f=1184
TT=1800.07
T1=1420.59
SAT
f=1045
TT=1796.75
T1=1641.49
SAT
f=1045
TT=1796.76
T1=1636.85
SAT
f=1044
TT=1796.75
T1=1542.77
? (TO)

TT=1800.12

? (TO)

TT=1800.11

?

TT=1799.44

No dataNo data?

TT=1799.4

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_33.opb.PB06.opb
SAT
f=1035
TT=1796.75
T1=1527.21
SAT
f=1064
TT=1798.01
T1=317.58
No dataSAT (TO)
f=1166
TT=1800.08
T1=1514.6
? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.07

SAT (TO)
f=1061
TT=1800.11
T1=520.82
SAT (TO)
f=1174
TT=1800.1
T1=1110.67
SAT (TO)
f=1169
TT=1800.59
T1=0.41
SAT
f=1182
TT=1783
T1=830.44
No Cert.

TT=273.06

SAT
f=1065
TT=1798
T1=1196.14
SAT (TO)
f=1189
TT=1800.1
T1=163.32
SAT
f=1048
TT=1797.05
T1=823.67
No data? (TO)

TT=1800.22

SAT (TO)
f=1152
TT=1800.16
T1=906.25
SAT
f=1036
TT=1789.75
T1=1612.99
No dataSAT (TO)
f=1161
TT=1800.07
T1=978.43
SAT
f=1041
TT=1796.78
T1=957.88
SAT (TO)
f=1192
TT=1800.06
T1=1800.8
? (TO)

TT=1800.06

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=1173
TT=1800.48
T1=900.31
No dataNo dataSAT (TO)
f=1173
TT=1800.05
T1=900.41
No dataNo dataNo data? (TO)

TT=1802.01

SAT (TO)
f=1189
TT=1800.08
T1=0.48
SAT (TO)
f=1181
TT=1800.09
T1=932.31
SAT
f=1035
TT=1796.75
T1=1533.12
SAT
f=1035
TT=1796.76
T1=1527.21
SAT
f=1037
TT=1796.72
T1=466.53
? (TO)

TT=1800.12

? (TO)

TT=1800.02

?

TT=1799.3

No dataNo data?

TT=1799.44

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_34.opb.PB06.opb
SAT
f=1039
TT=1796.74
T1=1286
SAT
f=1067
TT=1798
T1=200.88
No dataSAT (TO)
f=1166
TT=1800.02
T1=942.71
? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.07

SAT (TO)
f=1056
TT=1800.01
T1=14.62
SAT (TO)
f=1163
TT=1800.08
T1=680.29
SAT (TO)
f=1166
TT=1800.33
T1=0.32
SAT
f=1185
TT=1783.01
T1=1437
? (exit code)

TT=75.483

SAT
f=1066
TT=1798.01
T1=1350.21
SAT (TO)
f=1180
TT=1800.08
T1=0.54
SAT
f=1047
TT=1797.53
T1=212.55
No data? (TO)

TT=1800.29

SAT (TO)
f=1155
TT=1800.04
T1=336.52
SAT
f=1049
TT=1789.76
T1=1108.55
No dataSAT (TO)
f=1157
TT=1800.09
T1=957.22
SAT
f=1041
TT=1796.74
T1=1720.94
SAT (TO)
f=1183
TT=1800.09
T1=1800.71
? (TO)

TT=1800.12

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=1166
TT=1800.11
T1=900.31
No dataNo dataSAT (TO)
f=1166
TT=1800.65
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1158
TT=1800.56
T1=531.49
SAT (TO)
f=1180
TT=1800.1
T1=0.43
SAT (TO)
f=1177
TT=1800.09
T1=328.47
SAT
f=1039
TT=1796.74
T1=1301.89
SAT
f=1039
TT=1796.75
T1=1286
SAT
f=1041
TT=1796.74
T1=1439.47
? (TO)

TT=1800.03

? (TO)

TT=1800.06

?

TT=1799.73

No dataNo data?

TT=1799.78

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_36.opb.PB06.opb
SAT
f=1038
TT=1796.75
T1=1126.25
SAT
f=1064
TT=1798.03
T1=248.33
No dataSAT (TO)
f=1170
TT=1800.01
T1=1521.78
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

SAT (TO)
f=1054
TT=1800.01
T1=1704.37
SAT (TO)
f=1175
TT=1800.04
T1=612.11
SAT (TO)
f=1170
TT=1800.13
T1=0.32
SAT
f=1175
TT=1783.01
T1=76.78
No Cert.

TT=256.465

SAT
f=1069
TT=1798.01
T1=819.75
SAT (TO)
f=1188
TT=1800.05
T1=214.4
SAT
f=1046
TT=1797.74
T1=775.87
No data? (TO)

TT=1800.02

SAT (TO)
f=1177
TT=1800.16
T1=744.6
SAT
f=1045
TT=1789.73
T1=1154.78
No dataSAT (TO)
f=1157
TT=1800.04
T1=551.32
SAT
f=1043
TT=1796.75
T1=875.57
SAT (TO)
f=1203
TT=1800.08
T1=1800.71
? (TO)

TT=1800.13

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=1171
TT=1800.44
T1=900.31
No dataNo dataSAT (TO)
f=1171
TT=1800.14
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1178
TT=1800.14
T1=484.76
SAT (TO)
f=1204
TT=1800.06
T1=0.32
SAT (TO)
f=1184
TT=1800.51
T1=147.37
SAT
f=1038
TT=1796.75
T1=1197.22
SAT
f=1038
TT=1796.77
T1=1126.25
SAT
f=1039
TT=1796.73
T1=1793.2
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.47

No dataNo data?

TT=1799.79

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_43.opb.PB06.opb
SAT
f=1040
TT=1796.76
T1=1210.77
SAT
f=1064
TT=1798
T1=1739.74
No dataSAT (TO)
f=1171
TT=1800.11
T1=1521.75
? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.07

SAT (TO)
f=1062
TT=1800.11
T1=643.54
SAT (TO)
f=1185
TT=1800.07
T1=32.28
SAT (TO)
f=1164
TT=1802.08
T1=0.71
SAT
f=1187
TT=1783.01
T1=32.34
? (exit code)

TT=258.87

SAT
f=1074
TT=1798.02
T1=1563.22
SAT (TO)
f=1191
TT=1800.51
T1=6.89
SAT
f=1048
TT=1798.21
T1=670.45
No data? (TO)

TT=1800.05

SAT (TO)
f=1176
TT=1800.13
T1=812.56
SAT
f=1049
TT=1789.75
T1=574.11
No dataSAT (TO)
f=1169
TT=1800.09
T1=652.13
SAT
f=1043
TT=1796.75
T1=1331.71
SAT (TO)
f=1201
TT=1800.04
T1=1800.61
? (TO)

TT=1800.13

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=1179
TT=1800.45
T1=900.31
No dataNo dataSAT (TO)
f=1179
TT=1800.58
T1=900.41
No dataNo dataNo dataSAT (TO)
f=1163
TT=1800.15
T1=897.9
SAT (TO)
f=1199
TT=1800
T1=0.33
SAT (TO)
f=1179
TT=1800.09
T1=140.59
SAT
f=1042
TT=1796.75
T1=1747.79
SAT
f=1042
TT=1796.75
T1=1737.34
SAT
f=1040
TT=1796.76
T1=1210.77
? (TO)

TT=1800.08

? (TO)

TT=1800.02

?

TT=1799.52

No dataNo data?

TT=1799.39

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_5.opb.PB06.opb
SAT
f=1043
TT=1796.75
T1=1215.03
SAT
f=1067
TT=1798
T1=562.56
No dataSAT (TO)
f=1170
TT=1800.11
T1=1229.92
? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.04

SAT (TO)
f=1058
TT=1800.02
T1=47.55
SAT (TO)
f=1167
TT=1800.05
T1=0.04
SAT (TO)
f=1150
TT=1802.08
T1=0.32
SAT
f=1180
TT=1783.02
T1=1579.2
SAT
f=1166
TT=262.03
T1=0.45
SAT
f=1067
TT=1798
T1=524.65
SAT (TO)
f=1166
TT=1800.09
T1=0.48
SAT
f=1047
TT=1795.37
T1=888.6
No data? (TO)

TT=1800.27

SAT (TO)
f=1155
TT=1801.39
T1=359.84
SAT
f=1051
TT=1789.77
T1=218.11
No dataSAT (TO)
f=1153
TT=1800.18
T1=172.27
SAT
f=1046
TT=1796.75
T1=902.17
SAT (TO)
f=1167
TT=1800.07
T1=1800.71
? (TO)

TT=1800.04

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=1166
TT=1800.18
T1=900.41
No dataNo dataSAT (TO)
f=1166
TT=1800.12
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1152
TT=1800.48
T1=687.19
SAT (TO)
f=1166
TT=1800.52
T1=0.39
SAT (TO)
f=1166
TT=1800.03
T1=0.37
SAT
f=1048
TT=1796.76
T1=1588.94
SAT
f=1048
TT=1796.76
T1=1565.54
SAT
f=1043
TT=1796.75
T1=1215.03
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.41

No dataNo data?

TT=1799.34

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_6.opb.PB06.opb
SAT
f=1042
TT=1796.76
T1=566.58
SAT
f=1065
TT=1798.01
T1=1464.38
No dataSAT (TO)
f=1172
TT=1800.07
T1=1474.8
? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.03

SAT (TO)
f=1061
TT=1800.1
T1=1195.19
SAT (TO)
f=1184
TT=1800.11
T1=1.69
SAT (TO)
f=1178
TT=1802.09
T1=0.37
SAT
f=1183
TT=1783
T1=9.58
? (exit code)

TT=288.41

SAT
f=1069
TT=1798.01
T1=1485.75
SAT (TO)
f=1191
TT=1800.54
T1=6.09
SAT
f=1047
TT=1797.68
T1=755.59
No data? (TO)

TT=1800.13

SAT (TO)
f=1177
TT=1800.71
T1=683.86
SAT
f=1047
TT=1789.76
T1=874.69
No dataSAT (TO)
f=1170
TT=1800.13
T1=742.29
SAT
f=1042
TT=1796.76
T1=566.58
SAT (TO)
f=1184
TT=1800.09
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=1170
TT=1800.2
T1=900.41
No dataNo dataSAT (TO)
f=1170
TT=1800.49
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1176
TT=1801.95
T1=869.99
SAT (TO)
f=1211
TT=1800.61
T1=0.35
SAT (TO)
f=1186
TT=1800.01
T1=898.88
SAT
f=1045
TT=1796.83
T1=996.97
SAT
f=1045
TT=1796.77
T1=987.09
SAT
f=1045
TT=1796.78
T1=1364.39
? (TO)

TT=1800.1

? (TO)

TT=1800.03

?

TT=1799.33

No dataNo data?

TT=1799.39

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_7.opb.PB06.opb
SAT
f=1040
TT=1796.74
T1=1321.5
SAT
f=1066
TT=1798
T1=757.75
No dataSAT (TO)
f=1164
TT=1800.11
T1=0.19
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.11

SAT (TO)
f=1059
TT=1800.01
T1=404.23
SAT (TO)
f=1194
TT=1800.03
T1=0.04
SAT (TO)
f=1160
TT=1802.07
T1=0.3
SAT
f=1188
TT=1783
T1=988.32
No Cert.

TT=272.19

SAT
f=1065
TT=1798.01
T1=968.18
SAT (TO)
f=1184
TT=1800.57
T1=17.19
SAT
f=1053
TT=1797.7
T1=517.83
No data? (TO)

TT=1800.06

SAT (TO)
f=1168
TT=1800.48
T1=909.1
SAT
f=1047
TT=1789.76
T1=233.5
No dataSAT (TO)
f=1161
TT=1800.53
T1=544.8
SAT
f=1040
TT=1796.74
T1=1321.5
SAT (TO)
f=1194
TT=1800.04
T1=1800.71
? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=1167
TT=1800.11
T1=900.31
No dataNo dataSAT (TO)
f=1167
TT=1800.4
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1168
TT=1800.61
T1=741.49
SAT (TO)
f=1194
TT=1800.02
T1=0.33
SAT (TO)
f=1185
TT=1800.07
T1=202.08
SAT
f=1042
TT=1796.78
T1=1313.11
SAT
f=1042
TT=1796.77
T1=1305.86
SAT
f=1040
TT=1796.75
T1=1596.13
? (TO)

TT=1800.07

? (TO)

TT=1800.02

?

TT=1799.38

No dataNo data?

TT=1799.71

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/vtxcov/
normalized-vtxcov_v2000_e4000_8.opb.PB06.opb
SAT
f=1040
TT=1796.76
T1=1685.13
SAT
f=1072
TT=1798.01
T1=114.33
No dataSAT (TO)
f=1171
TT=1800.11
T1=672.86
? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.05

SAT (TO)
f=1061
TT=1800.02
T1=200.21
SAT (TO)
f=1203
TT=1800.08
T1=0.05
SAT (TO)
f=1165
TT=1800.34
T1=0.4
SAT
f=1186
TT=1783.01
T1=1437.34
No Cert.

TT=251.448

SAT
f=1070
TT=1798.01
T1=1311.14
SAT (TO)
f=1192
TT=1800.47
T1=4.23
SAT
f=1049
TT=1797.21
T1=971.91
No data? (TO)

TT=1800.42

SAT (TO)
f=1173
TT=1800.45
T1=655.9
SAT
f=1049
TT=1789.77
T1=720.14
No dataSAT (TO)
f=1161
TT=1800.18
T1=498.61
SAT
f=1046
TT=1796.64
T1=882.08
SAT (TO)
f=1203
TT=1800.06
T1=1800.8
? (TO)

TT=1800.03

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=1170
TT=1800.5
T1=900.31
No dataNo dataSAT (TO)
f=1170
TT=1800.39
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1176
TT=1801
T1=578.12
SAT (TO)
f=1203
TT=1800.08
T1=0.35
SAT (TO)
f=1185
TT=1800.9
T1=37.02
SAT
f=1040
TT=1796.77
T1=1685.13
SAT
f=1040
TT=1796.76
T1=1764.46
SAT
f=1043
TT=1796.74
T1=1320.2
? (TO)

TT=1800.12

? (TO)

TT=1800.02

?

TT=1799.43

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_0.opb.PB06.opb
SAT
f=765
TT=1800.19
T1=3.94
SAT
f=5634
TT=1798.02
T1=1598.77
No dataSAT (TO)
f=9934
TT=1800.09
T1=2.77
? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.03

SAT (TO)
f=5435
TT=1800.19
T1=1667.23
? (TO)

TT=1798.13

? (TO)

TT=1802

SAT
f=5407
TT=1783.08
T1=881.06
? (exit code)

TT=1495.27

SAT
f=5600
TT=1798.08
T1=843.16
? (TO)

TT=1800.04

?

TT=1797.58

No data? (TO)

TT=1800.09

SAT (TO)
f=1303
TT=1800.99
T1=4.36
?

TT=1792.92

No dataSAT (TO)
f=886
TT=1800.71
T1=3.87
?

TT=1799.64

SAT (TO)
f=4635
TT=1800.01
T1=1800.9
? (TO)

TT=1800.12

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=5335
TT=1800.66
T1=901.01
No dataNo dataSAT (TO)
f=5335
TT=1800.3
T1=901.11
No dataNo dataNo dataSAT (TO)
f=765
TT=1800.19
T1=3.94
SAT (TO)
f=788
TT=1800.05
T1=3.31
? (TO)

TT=1800.56

? (TO)

TT=1800.03

?

TT=1799.35

?

TT=1799.89

? (TO)

TT=1800.07

? (TO)

TT=1800.08

?

TT=1800.04

No dataNo data?

TT=1799.66

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_10.opb.PB06.opb
SAT
f=668
TT=1800.2
T1=4.33
SAT
f=5518
TT=1798.07
T1=1326.97
No dataSAT (TO)
f=9218
TT=1800.06
T1=3.74
? (TO)

TT=1800.14

? (TO)

TT=1800.14

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.1

SAT (TO)
f=5524
TT=1800.03
T1=1546.5
SAT (TO)
f=5456
TT=1800.19
T1=1284
? (TO)

TT=1802.04

Signal

TT=1638.53

?

TT=1080.18

SAT
f=5684
TT=1798.03
T1=1793.03
? (TO)

TT=1800.08

?

TT=1798.58

No data? (TO)

TT=1800.36

SAT (TO)
f=668
TT=1800.2
T1=4.33
?

TT=1791.72

No dataSAT (TO)
f=840
TT=1800.48
T1=3.99
?

TT=1799.61

SAT (TO)
f=5160
TT=1800.1
T1=1801.1
? (TO)

TT=1800.04

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=5238
TT=1800.25
T1=901.01
No dataNo dataSAT (TO)
f=5238
TT=1800.61
T1=901.01
No dataNo dataNo data? (TO)

TT=1802.63

SAT (TO)
f=1234
TT=1800.01
T1=3.03
? (TO)

TT=1800.05

?

TT=1800

? (TO)

TT=1802.04

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

?

TT=1799.73

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_11.opb.PB06.opb
SAT
f=761
TT=1800.23
T1=3.89
SAT
f=5402
TT=1798.01
T1=358.63
No dataSAT (TO)
f=9745
TT=1800.08
T1=3.7
? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800

? (TO)

TT=1800.07

SAT (TO)
f=5657
TT=1800.2
T1=1773.03
Signal

TT=1544.17

? (TO)

TT=1801.93

Signal

TT=1735.34

?

TT=1291.45

SAT
f=5626
TT=1798.07
T1=1323.45
? (TO)

TT=1800.59

?

TT=1797.8

No data? (TO)

TT=1800.34

SAT (TO)
f=833
TT=1800.02
T1=4.28
?

TT=1791.79

No dataSAT (TO)
f=761
TT=1800.23
T1=3.89
?

TT=1799.03

SAT (TO)
f=6106
TT=1800.1
T1=1801.11
? (TO)

TT=1800.12

? (TO)

TT=1800

No dataNo dataNo dataSAT (TO)
f=5371
TT=1800.69
T1=901.11
No dataNo dataSAT (TO)
f=5371
TT=1800.18
T1=901.21
No dataNo dataNo dataSAT (TO)
f=887
TT=1800.05
T1=4.13
SAT (TO)
f=818
TT=1800.61
T1=3.22
? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.07

?

TT=1799.53

No dataNo data?

TT=1799.34

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_12.opb.PB06.opb
SAT
f=448
TT=1793.17
T1=209.36
SAT
f=5667
TT=1798.01
T1=1795.95
No dataSAT (TO)
f=9520
TT=1800.04
T1=2.98
? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.1

SAT (TO)
f=5602
TT=1800.12
T1=658.98
SAT (TO)
f=5702
TT=1800.12
T1=1024.64
? (TO)

TT=1802.01

? (TO)

TT=1782.59

? (exit code)

TT=1128.75

SAT
f=5746
TT=1798.11
T1=175.27
? (TO)

TT=1801.43

?

TT=1798.45

No data? (TO)

TT=1800.05

SAT (TO)
f=488
TT=1800.8
T1=4.35
SAT
f=448
TT=1793.17
T1=209.36
No dataSAT (TO)
f=488
TT=1800.02
T1=3.94
?

TT=1799.09

SAT (TO)
f=6032
TT=1800.02
T1=1800.3
? (TO)

TT=1800.07

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=5299
TT=1800.12
T1=901.21
No dataNo dataSAT (TO)
f=5299
TT=1800.16
T1=901.01
No dataNo dataNo data? (TO)

TT=1802.2

SAT (TO)
f=852
TT=1800.07
T1=3.27
? (TO)

TT=1800.05

?

TT=1799.19

?

TT=1799.93

?

TT=1799.39

? (TO)

TT=1800.05

? (TO)

TT=1800.08

?

TT=1799.69

No dataNo data?

TT=1800.06

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_13.opb.PB06.opb
SAT
f=486
TT=1792.84
T1=385.79
SAT
f=5734
TT=1798.01
T1=1660.64
No dataSAT (TO)
f=9431
TT=1800.09
T1=2.77
? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.07

SAT (TO)
f=5375
TT=1800.32
T1=365.45
SAT (TO)
f=5270
TT=1800.14
T1=522.8
? (TO)

TT=1800.11

SAT
f=5175
TT=1783.07
T1=697.24
? (exit code)

TT=1103.09

SAT
f=5473
TT=1798.27
T1=121.46
? (TO)

TT=1800.01

SAT
f=543
TT=1799.01
T1=1798.1
No data? (TO)

TT=1800.2

SAT (TO)
f=840
TT=1801.3
T1=5.41
SAT
f=486
TT=1792.84
T1=385.79
No dataSAT (TO)
f=1188
TT=1800.69
T1=5.12
?

TT=1799.01

SAT (TO)
f=5688
TT=1800.01
T1=1800.3
? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=5498
TT=1800.83
T1=901.01
No dataNo dataSAT (TO)
f=5498
TT=1800.23
T1=901.11
No dataNo dataNo dataSAT (TO)
f=1183
TT=1800.8
T1=3.92
SAT (TO)
f=1104
TT=1800.84
T1=2.91
? (TO)

TT=1800.07

?

TT=1799.29

?

TT=1799.18

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo data?

TT=1799.8

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_14.opb.PB06.opb
SAT
f=488
TT=1791.96
T1=435.5
SAT
f=5800
TT=1798.05
T1=1005.36
No dataSAT (TO)
f=9614
TT=1800.08
T1=2.8
? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800

? (TO)

TT=1800.05

? (TO)

TT=1800.06

SAT (TO)
f=5567
TT=1800.18
T1=1777.06
Signal

TT=1513.91

? (TO)

TT=1802.09

Signal

TT=1493.9

?

TT=1494.91

SAT
f=5700
TT=1798.08
T1=1735.95
? (TO)

TT=1800.02

SAT
f=453
TT=1799.41
T1=1798.22
No data? (TO)

TT=1800.04

SAT (TO)
f=585
TT=1801.29
T1=5.7
SAT
f=488
TT=1791.96
T1=435.5
No dataSAT (TO)
f=768
TT=1800.1
T1=4.62
?

TT=1799.56

SAT (TO)
f=5504
TT=1800.01
T1=1801.01
? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=5404
TT=1800.29
T1=901.21
No dataNo dataSAT (TO)
f=5404
TT=1800.22
T1=901.21
No dataNo dataNo dataSAT (TO)
f=615
TT=1800.72
T1=4.22
SAT (TO)
f=745
TT=1800.08
T1=3.08
? (TO)

TT=1800.01

?

TT=1799.82

?

TT=1799.31

?

TT=1799.3

? (TO)

TT=1800.08

? (TO)

TT=1800.09

?

TT=1799.63

No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_1.opb.PB06.opb
SAT
f=712
TT=1800.19
T1=3.91
SAT
f=5583
TT=1798.02
T1=364.34
No dataSAT (TO)
f=9507
TT=1800.09
T1=3.7
? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.01

SAT (TO)
f=5041
TT=1800.31
T1=1784.01
Signal

TT=1254.56

? (TO)

TT=1801.98

Signal

TT=1609.36

?

TT=966.317

SAT
f=5771
TT=1798.11
T1=805.72
? (TO)

TT=1801

SAT
f=515
TT=1798.6
T1=1797.68
No data? (TO)

TT=1800.35

SAT (TO)
f=790
TT=1800.01
T1=4.59
?

TT=1792.5

No dataSAT (TO)
f=712
TT=1800.19
T1=3.91
?

TT=1799

SAT (TO)
f=5470
TT=1800.06
T1=1800.9
? (TO)

TT=1800.08

? (TO)

TT=1800

No dataNo dataNo dataSAT (TO)
f=5282
TT=1800.22
T1=901.11
No dataNo dataSAT (TO)
f=5282
TT=1800.27
T1=901.11
No dataNo dataNo dataSAT (TO)
f=789
TT=1800.12
T1=4.62
SAT (TO)
f=779
TT=1800
T1=3.06
? (TO)

TT=1800.04

?

TT=1799.93

?

TT=1799.65

?

TT=1799.19

? (TO)

TT=1800.03

? (TO)

TT=1800.07

?

TT=1799.34

No dataNo data? (TO)

TT=1800.06

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_2.opb.PB06.opb
SAT
f=687
TT=1800.04
T1=4.77
SAT
f=5740
TT=1798.35
T1=290.84
No dataSAT (TO)
f=10035
TT=1800.09
T1=2.78
? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.1

SAT (TO)
f=5328
TT=1800.16
T1=92.05
SAT (TO)
f=5803
TT=1800.2
T1=925.87
? (TO)

TT=1801.99

SAT
f=5448
TT=1783.06
T1=1454.49
?

TT=1069.18

SAT
f=5587
TT=1798.13
T1=1779.09
? (TO)

TT=1800.07

SAT
f=767
TT=1799.3
T1=1797.99
No data? (TO)

TT=1800.4

SAT (TO)
f=699
TT=1801.18
T1=5.66
?

TT=1793

No dataSAT (TO)
f=840
TT=1800.15
T1=4.53
?

TT=1799.58

SAT (TO)
f=4849
TT=1800.01
T1=1800.3
? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=5168
TT=1800.21
T1=900.91
No dataNo dataSAT (TO)
f=5168
TT=1800.25
T1=901.21
No dataNo dataNo dataSAT (TO)
f=687
TT=1800.04
T1=4.77
SAT (TO)
f=878
TT=1800.71
T1=3.34
? (TO)

TT=1763.55

?

TT=1799.18

? (TO)

TT=1802.05

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.05

?

TT=1799.66

No dataNo data?

TT=1799.58

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_3.opb.PB06.opb
SAT
f=390
TT=1792.91
T1=274.64
SAT
f=5830
TT=1798.18
T1=1094.11
No dataSAT (TO)
f=9725
TT=1800.09
T1=3.7
? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.03

SAT (TO)
f=5643
TT=1800.26
T1=1749.68
Signal

TT=1376.63

? (TO)

TT=1801.94

SAT
f=5303
TT=1783.1
T1=1353.91
?

TT=1057.44

SAT
f=5851
TT=1798.05
T1=1497.95
? (TO)

TT=1800.05

? (TO)

TT=1802.04

No data? (TO)

TT=1800.12

SAT (TO)
f=1237
TT=1800.08
T1=4.7
SAT
f=390
TT=1792.91
T1=274.64
No dataSAT (TO)
f=1077
TT=1800.1
T1=6.2
?

TT=1798.96

SAT (TO)
f=5903
TT=1800.01
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=5436
TT=1800.68
T1=900.91
No dataNo dataSAT (TO)
f=5436
TT=1800.24
T1=901.01
No dataNo dataNo dataSAT (TO)
f=1012
TT=1800.1
T1=4.17
SAT (TO)
f=774
TT=1800.01
T1=3.17
? (TO)

TT=1800.74

?

TT=1799.23

?

TT=1799.35

?

TT=1799.27

? (TO)

TT=1800.08

? (TO)

TT=1800.08

?

TT=1799.64

No dataNo data?

TT=1800.01

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_4.opb.PB06.opb
SAT
f=483
TT=1792.1
T1=438.02
SAT
f=5623
TT=1798.08
T1=881.15
No dataSAT (TO)
f=9461
TT=1800.06
T1=2.79
? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.02

SAT (TO)
f=5609
TT=1800.19
T1=61.49
Signal

TT=1580.56

? (TO)

TT=1801.94

? (TO)

TT=1756.68

?

TT=1302.79

SAT
f=5680
TT=1798.03
T1=1351.11
? (TO)

TT=1800.24

?

TT=1798.75

No data? (TO)

TT=1800.01

SAT (TO)
f=780
TT=1800.14
T1=4.51
SAT
f=483
TT=1792.1
T1=438.02
No dataSAT (TO)
f=836
TT=1800.78
T1=3.75
?

TT=1799.91

SAT (TO)
f=5616
TT=1800
T1=1800.9
? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=5359
TT=1800.67
T1=901.01
No dataNo dataSAT (TO)
f=5359
TT=1800.15
T1=901.11
No dataNo dataNo dataSAT (TO)
f=975
TT=1800.04
T1=4.68
SAT (TO)
f=796
TT=1800.76
T1=2.99
? (TO)

TT=1800.2

?

TT=1799.17

?

TT=1799.94

?

TT=1799.83

? (TO)

TT=1800.07

? (TO)

TT=1800.08

?

TT=1799.66

No dataNo data?

TT=1799.68

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_5.opb.PB06.opb
SAT
f=659
TT=1800.79
T1=4.09
SAT
f=5464
TT=1798.02
T1=1307.08
No dataSAT (TO)
f=9976
TT=1800.06
T1=2.93
? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.03

SAT (TO)
f=5259
TT=1800.2
T1=1704.87
Signal

TT=1320.27

? (TO)

TT=1801.97

Signal

TT=1585

? (exit code)

TT=821.14

SAT
f=5588
TT=1798.13
T1=897.97
? (TO)

TT=1800.07

SAT
f=557
TT=1798.4
T1=1797.16
No data? (TO)

TT=1800.18

SAT (TO)
f=891
TT=1800.12
T1=4.38
?

TT=1792.51

No dataSAT (TO)
f=891
TT=1800.09
T1=3.94
? (TO)

TT=1802.04

SAT (TO)
f=5758
TT=1800.09
T1=1801.01
? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=5376
TT=1800.83
T1=901.11
No dataNo dataSAT (TO)
f=5382
TT=1800.13
T1=901.01
No dataNo dataNo dataSAT (TO)
f=659
TT=1800.79
T1=4.09
SAT (TO)
f=825
TT=1800.06
T1=3.23
? (TO)

TT=1800.5

?

TT=1799.19

?

TT=1799.89

?

TT=1799.28

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.12

No dataNo data?

TT=1799.95

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_6.opb.PB06.opb
SAT
f=371
TT=1793.18
T1=624.67
SAT
f=5484
TT=1798.03
T1=1427.17
No dataSAT (TO)
f=9743
TT=1800.01
T1=2.96
? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.01

SAT (TO)
f=5164
TT=1800.09
T1=1380.29
Signal

TT=1170.45

? (TO)

TT=1801.9

Signal

TT=1684.98

?

TT=1052.94

SAT
f=5465
TT=1798.06
T1=1644.12
? (TO)

TT=1800.04

SAT
f=423
TT=1798.74
T1=1797.72
No data? (TO)

TT=1800.13

SAT (TO)
f=802
TT=1800.95
T1=4.53
SAT
f=371
TT=1793.18
T1=624.67
No dataSAT (TO)
f=977
TT=1800.86
T1=5.09
?

TT=1799.27

SAT (TO)
f=5303
TT=1800.02
T1=1800.3
? (TO)

TT=1800

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=5332
TT=1800.65
T1=900.91
No dataNo dataSAT (TO)
f=5332
TT=1800.25
T1=901.11
No dataNo dataNo dataSAT (TO)
f=956
TT=1800.1
T1=4.23
SAT (TO)
f=784
TT=1800.03
T1=3.26
? (TO)

TT=1800.03

?

TT=1799.26

?

TT=1799.94

?

TT=1799.31

? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1800.03

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_7.opb.PB06.opb
SAT
f=396
TT=1793.24
T1=356.15
SAT
f=5521
TT=1798.04
T1=311.36
No dataSAT (TO)
f=9424
TT=1800.09
T1=3.75
? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

SAT (TO)
f=5621
TT=1800.16
T1=1164.64
Signal

TT=1576.67

? (TO)

TT=1801.95

Signal

TT=1545.65

?

TT=991.323

SAT
f=5552
TT=1798.13
T1=1322.73
? (TO)

TT=1800.87

SAT
f=486
TT=1798.47
T1=232.77
No data? (TO)

TT=1800.26

SAT (TO)
f=944
TT=1801.27
T1=4.35
SAT
f=396
TT=1793.24
T1=356.15
No dataSAT (TO)
f=944
TT=1800.17
T1=3.73
? (TO)

TT=1802.04

SAT (TO)
f=5490
TT=1800.05
T1=1801.1
? (TO)

TT=1800.06

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=5182
TT=1800.99
T1=901.11
No dataNo dataSAT (TO)
f=5182
TT=1800.19
T1=901.11
No dataNo dataNo dataSAT (TO)
f=907
TT=1800.02
T1=4.16
SAT (TO)
f=907
TT=1800
T1=3.08
? (TO)

TT=1801.4

? (TO)

TT=1800.04

?

TT=1799.13

?

TT=1799.34

? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.49

No dataNo data?

TT=1800.03

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_8.opb.PB06.opb
SAT
f=736
TT=1800.83
T1=3.21
SAT
f=5679
TT=1798.05
T1=1445.97
No dataSAT (TO)
f=9426
TT=1800.1
T1=3.78
? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.07

SAT (TO)
f=5599
TT=1800.13
T1=46.59
Signal

TT=1294.07

? (TO)

TT=1801.94

SAT
f=5156
TT=1783.07
T1=1667.61
? (exit code)

TT=1457.05

SAT
f=5586
TT=1798.08
T1=138.13
? (TO)

TT=1800.12

SAT
f=545
TT=1799.34
T1=1798
No data? (TO)

TT=1800.08

SAT (TO)
f=855
TT=1800.13
T1=4.41
?

TT=1791.8

No dataSAT (TO)
f=744
TT=1800.02
T1=4.91
?

TT=1799.1

SAT (TO)
f=6307
TT=1800.06
T1=1801
? (TO)

TT=1800.04

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=5254
TT=1800.08
T1=900.91
No dataNo dataSAT (TO)
f=5254
TT=1800.12
T1=901.11
No dataNo dataNo dataSAT (TO)
f=844
TT=1800.76
T1=5.53
SAT (TO)
f=736
TT=1800.83
T1=3.21
? (TO)

TT=1800

? (TO)

TT=1800.05

? (TO)

TT=1802.04

?

TT=1799.34

? (TO)

TT=1800.08

? (TO)

TT=1800.08

?

TT=1799.6

No dataNo data?

TT=1799.61

normalized-PB06/OPT-SMALLINT/
submitted-PB06/liu/wnq/
normalized-wnq_n100_mw99_9.opb.PB06.opb
SAT
f=419
TT=1792.04
T1=443.73
SAT
f=5730
TT=1798.04
T1=1458.95
No dataSAT (TO)
f=9697
TT=1800.08
T1=4
? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.02

SAT (TO)
f=5633
TT=1800.29
T1=730.05
Signal

TT=1511.22

? (TO)

TT=1800.74

Signal

TT=1620.81

?

TT=977.628

SAT
f=5773
TT=1798.11
T1=1666.92
? (TO)

TT=1800.88

SAT
f=426
TT=1798.66
T1=435.13
No data? (TO)

TT=1800.01

SAT (TO)
f=717
TT=1800.04
T1=4.38
SAT
f=419
TT=1792.04
T1=443.73
No dataSAT (TO)
f=736
TT=1800.09
T1=3.76
?

TT=1799.11

SAT (TO)
f=5545
TT=1800
T1=1800.3
? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=5342
TT=1800.12
T1=901.01
No dataNo dataSAT (TO)
f=5342
TT=1800.33
T1=901.11
No dataNo dataNo dataSAT (TO)
f=775
TT=1800.7
T1=4.65
SAT (TO)
f=981
TT=1800.84
T1=3.21
? (TO)

TT=1800.02

?

TT=1799.2

? (TO)

TT=1800.04

?

TT=1799.84

? (TO)

TT=1800.07

? (TO)

TT=1800.08

?

TT=1799.73

No dataNo data?

TT=1799.72

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_10.opb
OPT
f=55
TT=334.51
T1=86.91
SAT
f=55
TT=1798
T1=136.54
No dataOPT
f=55
TT=1413.88
T1=258.19
? (problem)

TT=30.231

? (TO)

TT=1800.1

? (problem)

TT=29.95

? (TO)

TT=1800.11

? (problem)

TT=29.24

? (TO)

TT=1800.13

? (problem)

TT=28.41

? (TO)

TT=1800.09

SAT (TO)
f=55
TT=1800.05
T1=703.71
SAT (TO)
f=60
TT=1800.1
T1=1088
OPT
f=55
TT=842.843
T1=246.78
OPT
f=55
TT=888.355
T1=314.99
OPT
f=55
TT=924.69
T1=571.6
SAT
f=59
TT=1798
T1=310.53
OPT
f=55
TT=1464.92
T1=308.02
? (TO)

TT=1800.26

No data? (TO)

TT=1800.38

SAT (TO)
f=55
TT=1800.16
T1=830.82
SAT
f=85
TT=1789.86
T1=656.78
No dataOPT
f=55
TT=1567.43
T1=521.76
SAT
f=77
TT=1796.84
T1=553.8
SAT (TO)
f=61
TT=1800.08
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.04

No dataNo dataNo dataOPT
f=55
TT=1716.62
T1=858.3
No dataNo dataSAT (TO)
f=55
TT=1800.05
T1=900.21
No dataNo dataNo dataOPT
f=55
TT=1037.03
T1=282.39
OPT
f=55
TT=334.51
T1=86.91
SAT
f=60
TT=108.19
T1=106.89
?

TT=1797.02

?

TT=1796.88

SAT
f=97
TT=1796.91
T1=359.38
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.67

No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_11.opb
SAT
f=72
TT=1800.01
T1=511.06
SAT
f=76
TT=1798
T1=1204.68
No dataSAT (TO)
f=74
TT=1800.03
T1=835.41
? (problem)

TT=49.23

? (TO)

TT=1800.06

? (problem)

TT=49.63

? (TO)

TT=1800.08

? (problem)

TT=49.58

? (TO)

TT=1800.09

? (problem)

TT=46.35

? (TO)

TT=1800.05

SAT (TO)
f=74
TT=1800.05
T1=1237.34
SAT (TO)
f=82
TT=1800.09
T1=1697.69
SAT (TO)
f=74
TT=1802.07
T1=899.13
SAT
f=74
TT=1783
T1=755.27
SAT (TO)
f=74
TT=1800.08
T1=1026.93
SAT
f=77
TT=1798
T1=1125.34
SAT (TO)
f=75
TT=1800.56
T1=540.34
? (TO)

TT=1800.2

No data? (TO)

TT=1800.09

SAT (TO)
f=77
TT=1800.14
T1=43.56
?

TT=1789.82

No dataSAT (TO)
f=76
TT=1800.48
T1=900.5
?

TT=1797.2

SAT (TO)
f=81
TT=1800.1
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=76
TT=1800.12
T1=900.31
No dataNo dataSAT (TO)
f=77
TT=1800.2
T1=900.31
No dataNo dataNo dataSAT (TO)
f=74
TT=1800.02
T1=435.06
SAT (TO)
f=72
TT=1800.01
T1=511.06
SAT (TO)
f=72
TT=1800.04
T1=1701.17
?

TT=1797

?

TT=1797.04

?

TT=1797.15

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.67

No dataNo data?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_12.opb
SAT
f=91
TT=1783
T1=416.14
SAT
f=95
TT=1798.02
T1=893.28
No dataSAT (TO)
f=95
TT=1800.03
T1=522.99
? (problem)

TT=95.784

? (TO)

TT=1800.13

? (problem)

TT=91.912

? (TO)

TT=1800.08

? (problem)

TT=92.44

? (TO)

TT=1800.08

? (problem)

TT=90.93

? (TO)

TT=1800.03

SAT (TO)
f=99
TT=1800.03
T1=1185.7
SAT (TO)
f=104
TT=1800.08
T1=1210.97
SAT (TO)
f=97
TT=1802.12
T1=844.45
SAT
f=91
TT=1783
T1=416.14
SAT (TO)
f=98
TT=1800.01
T1=1623.56
SAT
f=97
TT=1798.01
T1=1549.02
SAT (TO)
f=99
TT=1800.25
T1=948.67
?

TT=1799.93

No data? (TO)

TT=1800.36

SAT (TO)
f=100
TT=1800.77
T1=709
?

TT=1789.83

No dataSAT (TO)
f=98
TT=1800.67
T1=393.69
?

TT=1796.89

SAT (TO)
f=98
TT=1800.11
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=100
TT=1800.51
T1=900.31
No dataNo dataSAT (TO)
f=95
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=95
TT=1800.01
T1=213.88
SAT (TO)
f=92
TT=1800.02
T1=306.91
SAT (TO)
f=96
TT=1800.43
T1=1601.7
?

TT=1796.87

?

TT=1796.92

?

TT=1796.85

? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.63

No dataNo data?

TT=1799.62

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_13.opb
SAT
f=119
TT=1798
T1=1223.6
SAT
f=119
TT=1798
T1=1597.89
No dataSAT (TO)
f=120
TT=1800.03
T1=858.03
? (problem)

TT=136.417

? (TO)

TT=1800.06

? (problem)

TT=128.45

? (TO)

TT=1800.05

? (problem)

TT=124.96

? (TO)

TT=1800.08

? (problem)

TT=126.34

? (TO)

TT=1800.08

SAT (TO)
f=122
TT=1800.02
T1=1762.72
SAT (TO)
f=166
TT=1800.09
T1=1416.42
SAT (TO)
f=128
TT=1802.12
T1=1495.2
SAT
f=120
TT=1783.01
T1=787.53
SAT (TO)
f=125
TT=1800.1
T1=1413.75
SAT
f=119
TT=1798.01
T1=110.8
SAT (TO)
f=123
TT=1800.28
T1=1582.25
?

TT=1796.74

No data? (TO)

TT=1800.27

SAT (TO)
f=129
TT=1800.89
T1=551.15
?

TT=1789.8

No dataSAT (TO)
f=125
TT=1800.01
T1=224.01
?

TT=1796.88

SAT (TO)
f=166
TT=1800.06
T1=1800.4
? (TO)

TT=1800.02

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=124
TT=1800.48
T1=900.31
No dataNo dataSAT (TO)
f=126
TT=1800.13
T1=900.31
No dataNo dataNo dataSAT (TO)
f=124
TT=1800.66
T1=415.59
SAT (TO)
f=119
TT=1800.1
T1=1223.6
SAT (TO)
f=120
TT=1800.06
T1=1748.99
?

TT=1796.8

?

TT=1796.86

?

TT=1796.91

? (TO)

TT=1800.01

? (TO)

TT=1800.01

?

TT=1799.98

No dataNo data?

TT=1800.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_14.opb
SAT
f=142
TT=1783.01
T1=1368.05
SAT
f=159
TT=1798.01
T1=446.92
No dataSAT (TO)
f=153
TT=1800.03
T1=518.02
? (problem)

TT=191.643

? (TO)

TT=1800.05

? (problem)

TT=184.86

? (TO)

TT=1800.07

? (problem)

TT=178.97

? (TO)

TT=1800.06

? (problem)

TT=180.1

? (TO)

TT=1800.09

SAT (TO)
f=160
TT=1800.1
T1=1569.26
? (TO)

TT=1800.09

SAT (TO)
f=154
TT=1802.15
T1=1259.18
SAT
f=142
TT=1783.01
T1=1368.05
SAT (TO)
f=155
TT=1800.03
T1=1671.66
SAT
f=153
TT=1798.01
T1=1173.28
SAT (TO)
f=157
TT=1800.39
T1=753.01
? (TO)

TT=1800.18

No data? (TO)

TT=1800.1

SAT (TO)
f=153
TT=1800.12
T1=848.72
?

TT=1789.79

No dataSAT (TO)
f=148
TT=1800.16
T1=394.32
?

TT=1796.81

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=156
TT=1800.05
T1=900.31
No dataNo dataSAT (TO)
f=156
TT=1800.08
T1=900.31
No dataNo dataNo dataSAT (TO)
f=148
TT=1800.11
T1=329.87
SAT (TO)
f=149
TT=1800.02
T1=1730.78
SAT
f=154
TT=1097.78
T1=1095.38
?

TT=1796.87

?

TT=1796.82

?

TT=1796.84

? (TO)

TT=1800.01

? (TO)

TT=1800.09

?

TT=1799.62

No dataNo data?

TT=1796.64

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_15.opb
SAT
f=178
TT=1798.05
T1=152.28
SAT
f=178
TT=1798.05
T1=152.28
No dataSAT (TO)
f=182
TT=1800.11
T1=1670.34
? (MO)

TT=221.53

? (TO)

TT=1800.01

? (MO)

TT=225.45

? (TO)

TT=1800.07

? (MO)

TT=218.08

? (TO)

TT=1800.01

? (MO)

TT=219.03

? (TO)

TT=1800.03

SAT (TO)
f=191
TT=1800.09
T1=230.59
? (TO)

TT=1800.09

SAT (TO)
f=194
TT=1802.13
T1=929.01
SAT
f=179
TT=1783.01
T1=540.78
SAT (TO)
f=191
TT=1800.63
T1=1529.96
SAT
f=187
TT=1798.03
T1=624.28
SAT (TO)
f=191
TT=1800.39
T1=1525.28
?

TT=1798.84

No data? (TO)

TT=1800.31

SAT (TO)
f=198
TT=1800.18
T1=434.06
?

TT=1789.8

No dataSAT (TO)
f=185
TT=1800.62
T1=851.94
?

TT=1796.86

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=199
TT=1800.06
T1=900.31
No dataNo dataSAT (TO)
f=196
TT=1800.08
T1=900.31
No dataNo dataNo dataSAT (TO)
f=191
TT=1800.02
T1=815.48
SAT (TO)
f=184
TT=1800.4
T1=978.85
SAT (TO)
f=188
TT=1800.08
T1=1544.35
?

TT=1796.85

?

TT=1796.83

?

TT=1796.77

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.61

No dataNo data?

TT=1799.98

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_16.opb
SAT
f=214
TT=1800.03
T1=1726.92
SAT (TO)
f=220
TT=1800.14
T1=1621.96
No dataSAT (TO)
f=223
TT=1800.02
T1=1615.92
? (MO)

TT=130.18

? (TO)

TT=1800.06

? (MO)

TT=125.7

? (TO)

TT=1800.07

? (MO)

TT=126.27

? (TO)

TT=1800.08

? (MO)

TT=128.01

? (TO)

TT=1800.02

SAT (TO)
f=235
TT=1800.06
T1=999.42
? (TO)

TT=1800.07

SAT (TO)
f=222
TT=1802.14
T1=1589.03
SAT
f=217
TT=1783.01
T1=1555.18
SAT (TO)
f=234
TT=1800.07
T1=1584.86
SAT
f=239
TT=1798.01
T1=967.77
? (TO)

TT=1800.02

?

TT=1797.28

No data? (TO)

TT=1800.1

SAT (TO)
f=226
TT=1800.22
T1=82.02
?

TT=1789.84

No dataSAT (TO)
f=229
TT=1800.17
T1=287.9
?

TT=1796.8

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=242
TT=1800.17
T1=900.41
No dataNo dataSAT (TO)
f=240
TT=1800.51
T1=900.41
No dataNo dataNo dataSAT (TO)
f=224
TT=1800.82
T1=154.81
SAT (TO)
f=214
TT=1800.03
T1=1726.92
SAT (TO)
f=221
TT=1800.08
T1=1670.11
?

TT=1796.83

?

TT=1796.85

?

TT=1796.82

? (TO)

TT=1800.11

? (TO)

TT=1800.12

?

TT=1800.02

No dataNo data?

TT=1799.63

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_17.opb
SAT
f=256
TT=1783.01
T1=1667.91
SAT
f=269
TT=1798.02
T1=528.7
No dataSAT (TO)
f=271
TT=1800.03
T1=207
? (MO)

TT=178.01

? (TO)

TT=1800.03

? (MO)

TT=181.7

? (TO)

TT=1800.01

? (MO)

TT=181.86

? (TO)

TT=1800.05

? (MO)

TT=179.4

? (TO)

TT=1800.01

SAT (TO)
f=263
TT=1800.1
T1=420.63
? (TO)

TT=1800.07

SAT (TO)
f=285
TT=1802.05
T1=1401.96
SAT
f=256
TT=1783.01
T1=1667.91
? (TO)

TT=1800.37

SAT
f=278
TT=1798.01
T1=626.38
SAT (TO)
f=288
TT=1800.08
T1=1303.87
?

TT=1795.63

No data? (TO)

TT=1800.24

SAT (TO)
f=261
TT=1800.24
T1=642.01
?

TT=1789.84

No dataSAT (TO)
f=280
TT=1800.53
T1=699.55
?

TT=1796.89

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=282
TT=1800.12
T1=900.41
No dataNo dataSAT (TO)
f=281
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=264
TT=1800.58
T1=374.2
SAT (TO)
f=267
TT=1800.05
T1=987.39
SAT (TO)
f=280
TT=1800.03
T1=922.36
?

TT=1796.9

?

TT=1796.9

?

TT=1796.87

? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.69

No dataNo data?

TT=1799.67

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_18.opb
SAT
f=299
TT=1783.01
T1=1365.34
SAT
f=316
TT=1798.01
T1=1011.73
No data? (TO)

TT=1800.03

? (problem)

TT=195.851

? (TO)

TT=1800.05

? (problem)

TT=192.91

? (TO)

TT=1800.09

? (problem)

TT=202.295

? (TO)

TT=1800.09

? (problem)

TT=192.283

? (TO)

TT=1800.08

SAT (TO)
f=312
TT=1800.05
T1=1564.74
? (TO)

TT=1800.03

? (TO)

TT=1802.12

SAT
f=299
TT=1783.01
T1=1365.34
SAT (TO)
f=317
TT=1800.1
T1=1123.16
SAT
f=322
TT=1798.01
T1=60.37
? (TO)

TT=1800.89

?

TT=1794.85

No data? (TO)

TT=1800.16

? (TO)

TT=1800.17

?

TT=1789.89

No dataSAT (TO)
f=305
TT=1800.07
T1=779.32
?

TT=1796.85

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.19

No dataNo dataSAT (TO)
f=315
TT=1800.55
T1=900.51
No dataNo dataNo dataSAT (TO)
f=305
TT=1800.03
T1=694.75
SAT (TO)
f=320
TT=1800.09
T1=950.16
? (TO)

TT=1800.03

?

TT=1796.91

?

TT=1796.86

?

TT=1796.89

? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.65

No dataNo data?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_19.opb
SAT
f=345
TT=1800.11
T1=685.82
?

TT=1798.01

No data? (TO)

TT=1800.11

? (problem)

TT=266.587

? (TO)

TT=1800.05

? (problem)

TT=266.064

? (TO)

TT=1800

? (problem)

TT=272.808

? (TO)

TT=1800.01

? (problem)

TT=263.043

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1802.14

? (TO)

TT=1800.1

? (TO)

TT=1800.07

SAT
f=360
TT=1798.02
T1=113.05
? (TO)

TT=1800.05

?

TT=1793.89

No data? (TO)

TT=1800.3

? (TO)

TT=1800.06

?

TT=1789.99

No dataSAT (TO)
f=345
TT=1800.11
T1=685.82
?

TT=1796.94

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.04

No dataNo data? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.53

? (TO)

TT=1800.01

?

TT=1796.94

?

TT=1796.93

?

TT=1797.04

? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.67

No dataNo data?

TT=1800.03

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/bounded_golomb_rulers/
normalized-bogr_20.opb
SAT
f=392
TT=1783.03
T1=1472.65
SAT
f=398
TT=1798.03
T1=823.7
No data? (TO)

TT=1800.02

? (MO)

TT=275.08

? (TO)

TT=1800.03

? (MO)

TT=277.71

? (TO)

TT=1800.09

? (MO)

TT=276.89

? (TO)

TT=1800.02

? (MO)

TT=278.31

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.11

? (TO)

TT=1802.12

SAT
f=392
TT=1783.03
T1=1472.65
? (TO)

TT=1800.1

?

TT=1798.01

? (TO)

TT=1800

?

TT=1795.79

No data? (TO)

TT=1800.19

? (TO)

TT=1800.45

?

TT=1790

No data? (TO)

TT=1800.16

?

TT=1796.92

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.53

No dataNo data? (TO)

TT=1800.55

No dataNo dataNo data? (TO)

TT=1800.55

? (TO)

TT=1800.45

? (TO)

TT=1800.05

?

TT=1796.96

?

TT=1796.99

?

TT=1796.9

? (TO)

TT=1800.1

? (TO)

TT=1800.01

?

TT=1799.69

No dataNo data?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_4.opb
OPT
f=6
TT=0.001
T1=0
OPT
f=6
TT=0.002
T1=0
No dataOPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.303
T1=0.27
OPT
f=6
TT=0.11
T1=0.09
? (problem)

TT=0.2

OPT
f=6
TT=0.076
T1=0.07
? (problem)

TT=0.2

OPT
f=6
TT=0.072
T1=0.07
? (problem)

TT=0.198

? (TO)

TT=1800.05

OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.014
T1=0.01
OPT
f=6
TT=0.045
T1=0.03
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.149
T1=0.15
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.174
T1=0.16
OPT
f=6
TT=0.014
T1=0.01
No dataOPT
f=6
TT=0.008
T1=0.01
OPT
f=6
TT=0.184
T1=1.16
OPT
f=6
TT=0.03
T1=0.02
No dataOPT
f=6
TT=0.197
T1=0.68
OPT
f=6
TT=0.046
T1=0.03
OPT
f=6
TT=0.007
T1=0
OPT
f=6
TT=0.06
T1=0.04
OPT
f=6
TT=0.073
T1=0.06
No dataNo dataNo dataOPT
f=6
TT=0.002
T1=0
No dataNo dataOPT
f=6
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=6
TT=0.195
T1=0.66
OPT
f=6
TT=0.163
T1=0.14
SAT
f=13
TT=0.236
T1=0.18
OPT
f=6
TT=0.035
T1=0.02
OPT
f=6
TT=0.039
T1=0.03
OPT
f=6
TT=0.039
T1=0.03
OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.005
T1=0
OPT
f=6
TT=0.001
T1=0
No dataNo dataOPT
f=6
TT=0.001
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_5.opb
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=0.017
T1=0.01
No dataOPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=1.052
T1=0.99
OPT
f=11
TT=0.323
T1=0.3
? (problem)

TT=0.607

OPT
f=11
TT=0.252
T1=0.25
? (problem)

TT=0.602

OPT
f=11
TT=0.237
T1=0.24
? (problem)

TT=0.61

? (TO)

TT=1800.09

OPT
f=11
TT=0.02
T1=0.02
OPT
f=11
TT=0.064
T1=0.05
OPT
f=11
TT=0.066
T1=0.06
OPT
f=11
TT=0.005
T1=0
OPT
f=11
TT=0.334
T1=0.22
OPT
f=11
TT=0.014
T1=0.01
OPT
f=11
TT=0.312
T1=0.2
OPT
f=11
TT=0.552
T1=0.52
No dataOPT
f=11
TT=0.067
T1=0.08
OPT
f=11
TT=0.435
T1=1.17
OPT
f=11
TT=0.06
T1=0.05
No dataOPT
f=11
TT=0.574
T1=0.71
OPT
f=11
TT=0.393
T1=0.36
OPT
f=11
TT=0.026
T1=0.02
OPT
f=11
TT=0.265
T1=0.23
OPT
f=11
TT=0.3
T1=0.26
No dataNo dataNo dataOPT
f=11
TT=0.003
T1=0
No dataNo dataOPT
f=11
TT=0.004
T1=0.01
No dataNo dataNo dataOPT
f=11
TT=0.614
T1=0.7
OPT
f=11
TT=0.274
T1=0.18
SAT
f=11
TT=0.324
T1=0.22
OPT
f=11
TT=0.06
T1=0.05
OPT
f=11
TT=0.085
T1=0.07
OPT
f=11
TT=0.505
T1=0.44
OPT
f=11
TT=0.019
T1=0.01
OPT
f=11
TT=0.022
T1=0.02
OPT
f=11
TT=0.002
T1=0
No dataNo dataOPT
f=11
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_6.opb
OPT
f=17
TT=0.011
T1=0.01
OPT
f=17
TT=0.043
T1=0.02
No dataOPT
f=17
TT=0.011
T1=0.01
OPT
f=17
TT=4.742
T1=3.52
OPT
f=17
TT=0.535
T1=0.4
OPT
f=17
TT=4.687
T1=3.5
OPT
f=17
TT=0.487
T1=0.39
OPT
f=17
TT=3.761
T1=3.55
OPT
f=17
TT=0.426
T1=0.39
? (TO)

TT=1800.38

? (TO)

TT=1800.07

OPT
f=17
TT=0.042
T1=0.03
OPT
f=17
TT=0.526
T1=0.44
OPT
f=17
TT=0.181
T1=0.15
OPT
f=17
TT=0.047
T1=0.03
OPT
f=17
TT=0.634
T1=0.35
OPT
f=17
TT=0.038
T1=0.02
OPT
f=17
TT=0.834
T1=0.39
OPT
f=17
TT=3.337
T1=2.8
No dataOPT
f=17
TT=2.2
T1=0.95
OPT
f=17
TT=1.499
T1=2.26
OPT
f=17
TT=2.443
T1=1.35
No dataOPT
f=17
TT=0.953
T1=1.24
OPT
f=17
TT=2.265
T1=1.57
OPT
f=17
TT=0.297
T1=0.29
OPT
f=17
TT=1.066
T1=0.64
OPT
f=17
TT=0.877
T1=0.71
No dataNo dataNo dataOPT
f=17
TT=0.064
T1=0.02
No dataNo dataOPT
f=17
TT=0.064
T1=0.02
No dataNo dataNo dataOPT
f=17
TT=1.684
T1=1.76
OPT
f=17
TT=0.596
T1=0.32
SAT
f=30
TT=0.534
T1=0.29
OPT
f=17
TT=1.73
T1=1.35
OPT
f=17
TT=1.736
T1=1.34
OPT
f=17
TT=2.427
T1=2.12
OPT
f=17
TT=0.218
T1=0.13
OPT
f=17
TT=0.231
T1=0.13
OPT
f=17
TT=0.043
T1=0.03
No dataNo dataOPT
f=17
TT=0.035
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_7.opb
OPT
f=25
TT=0.174
T1=0.1
OPT
f=25
TT=0.632
T1=0.17
No dataOPT
f=25
TT=0.174
T1=0.1
OPT
f=25
TT=23.991
T1=17.99
OPT
f=25
TT=2.622
T1=1.26
OPT
f=25
TT=26.361
T1=21.45
OPT
f=25
TT=2.473
T1=1.2
OPT
f=25
TT=21.708
T1=17.97
OPT
f=25
TT=2.197
T1=1.71
OPT
f=25
TT=19.7
T1=16.81
OPT
f=25
TT=2.733
T1=2.27
OPT
f=25
TT=0.57
T1=0.18
OPT
f=25
TT=4.106
T1=1.69
OPT
f=25
TT=0.666
T1=0.35
OPT
f=25
TT=0.661
T1=0.15
OPT
f=25
TT=1.614
T1=0.99
OPT
f=25
TT=0.417
T1=0.08
OPT
f=25
TT=1.835
T1=0.83
OPT
f=25
TT=24.869
T1=6.29
No dataOPT
f=25
TT=101.4
T1=37.01
OPT
f=25
TT=3.894
T1=3.33
OPT
f=25
TT=34.762
T1=14.99
No dataOPT
f=25
TT=2.566
T1=1.32
OPT
f=25
TT=17.177
T1=16.78
OPT
f=25
TT=3.193
T1=3.19
OPT
f=25
TT=6.465
T1=2.85
OPT
f=25
TT=12.252
T1=10.24
No dataNo dataNo dataOPT
f=25
TT=0.489
T1=0.24
No dataNo dataOPT
f=25
TT=0.507
T1=0.25
No dataNo dataNo dataOPT
f=25
TT=2.936
T1=1.32
OPT
f=25
TT=1.094
T1=0.46
SAT
f=25
TT=1.303
T1=0.51
OPT
f=25
TT=34.531
T1=12.39
OPT
f=25
TT=34.285
T1=12.3
OPT
f=25
TT=14.155
T1=14.14
OPT
f=25
TT=3.475
T1=0.87
OPT
f=25
TT=3.428
T1=0.85
OPT
f=25
TT=0.606
T1=0.6
No dataNo dataOPT
f=25
TT=0.607
T1=0.6
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_8.opb
OPT
f=34
TT=4.034
T1=0.58
OPT
f=34
TT=11.233
T1=1.58
No dataOPT
f=34
TT=4.034
T1=0.58
OPT
f=34
TT=174.217
T1=126.76
OPT
f=34
TT=22.955
T1=4.39
OPT
f=34
TT=150.755
T1=133.83
OPT
f=34
TT=22.962
T1=4.45
OPT
f=34
TT=68.679
T1=43.86
OPT
f=34
TT=13.392
T1=6.6
OPT
f=34
TT=80.611
T1=55.44
? (TO)

TT=1800.43

OPT
f=34
TT=11.175
T1=4.09
OPT
f=34
TT=20.558
T1=3.17
OPT
f=34
TT=5.807
T1=1.48
OPT
f=34
TT=8.604
T1=1.38
OPT
f=34
TT=19.424
T1=5.83
OPT
f=34
TT=11.255
T1=1.41
OPT
f=34
TT=11.664
T1=4.14
OPT
f=34
TT=301.255
T1=143.19
No data? (TO)

TT=1800.39

OPT
f=34
TT=26.972
T1=22.41
OPT
f=34
TT=686.858
T1=621.02
No dataOPT
f=34
TT=10.629
T1=1.4
OPT
f=34
TT=263.271
T1=107.43
OPT
f=34
TT=21.708
T1=21.7
OPT
f=34
TT=47.44
T1=23
OPT
f=34
TT=35.122
T1=19.39
No dataNo dataNo dataOPT
f=34
TT=8.063
T1=4.04
No dataNo dataOPT
f=34
TT=7.973
T1=3.99
No dataNo dataNo dataOPT
f=34
TT=12.831
T1=8.89
OPT
f=34
TT=5.632
T1=2.07
SAT
f=35
TT=2.075
T1=1.16
OPT
f=34
TT=189.9
T1=183.5
OPT
f=34
TT=183.395
T1=177.25
OPT
f=34
TT=167.309
T1=160.1
OPT
f=34
TT=41.554
T1=4.14
OPT
f=34
TT=41.663
T1=4.1
OPT
f=34
TT=11.242
T1=11.26
No dataNo dataOPT
f=34
TT=11.25
T1=11.28
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_9.opb
OPT
f=44
TT=36.61
T1=3.43
OPT
f=44
TT=242.678
T1=151.27
No dataOPT
f=44
TT=92.423
T1=3.43
OPT
f=44
TT=1633.59
T1=1636.06
OPT
f=44
TT=966.098
T1=966.28
OPT
f=44
TT=1726.11
T1=1726.65
OPT
f=44
TT=788.733
T1=788.91
OPT
f=44
TT=1257.78
T1=999.58
OPT
f=44
TT=377.018
T1=254.88
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=44
TT=213.913
T1=13.08
OPT
f=44
TT=800.526
T1=311.71
OPT
f=44
TT=82.585
T1=41.43
OPT
f=44
TT=136.733
T1=28.37
OPT
f=44
TT=62
T1=14.66
OPT
f=44
TT=165.987
T1=90.65
OPT
f=44
TT=115.36
T1=33.11
SAT (TO)
f=56
TT=1800.28
T1=1607.49
No data? (TO)

TT=1800.23

OPT
f=44
TT=262.075
T1=98.48
SAT
f=68
TT=1789.86
T1=1712.82
No dataOPT
f=44
TT=112.839
T1=26.58
SAT
f=52
TT=1796.95
T1=1175.4
OPT
f=44
TT=884.463
T1=884.62
OPT
f=44
TT=1577.51
T1=1263.2
OPT
f=44
TT=1042.47
T1=754.62
No dataNo dataNo dataOPT
f=44
TT=142.669
T1=71.33
No dataNo dataOPT
f=44
TT=113.14
T1=56.67
No dataNo dataNo dataOPT
f=44
TT=100.149
T1=43.09
OPT
f=44
TT=36.61
T1=18.31
SAT
f=44
TT=39.898
T1=15.62
SAT
f=50
TT=1797.19
T1=1209.95
SAT
f=50
TT=1797.26
T1=1209.31
SAT
f=51
TT=1797.05
T1=400.12
OPT
f=44
TT=645.339
T1=71.43
OPT
f=44
TT=662.431
T1=70.13
OPT
f=44
TT=174.36
T1=174.4
No dataNo dataOPT
f=44
TT=179.29
T1=179.31
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_10.opb
OPT
f=55
TT=350.209
T1=101.61
SAT
f=55
TT=1798.01
T1=1573.94
No dataOPT
f=55
TT=1761.62
T1=258.66
? (problem)

TT=32.445

? (TO)

TT=1800.06

? (problem)

TT=30.53

? (TO)

TT=1800.04

? (problem)

TT=32.31

? (TO)

TT=1800.06

? (problem)

TT=31.22

? (TO)

TT=1800.03

SAT (TO)
f=55
TT=1800.06
T1=700.08
SAT (TO)
f=59
TT=1800.11
T1=1270.67
OPT
f=55
TT=584.573
T1=170.42
OPT
f=55
TT=858.664
T1=225.02
OPT
f=55
TT=1077.03
T1=645.67
SAT
f=58
TT=1798
T1=427.81
OPT
f=55
TT=1745.88
T1=546.86
SAT (TO)
f=87
TT=1800.19
T1=542.64
No data? (TO)

TT=1800.09

SAT (TO)
f=55
TT=1800.17
T1=748.02
SAT
f=85
TT=1789.93
T1=382.24
No dataOPT
f=55
TT=1364.64
T1=252.08
?

TT=1796.95

SAT (TO)
f=60
TT=1800.06
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=55
TT=1800.19
T1=900.31
No dataNo dataSAT (TO)
f=55
TT=1800.42
T1=900.21
No dataNo dataNo dataOPT
f=55
TT=841.026
T1=103.25
OPT
f=55
TT=350.209
T1=101.61
SAT
f=63
TT=37.8
T1=36.46
?

TT=1796.78

?

TT=1796.83

SAT
f=94
TT=1796.86
T1=551.77
? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1799.57

No dataNo data?

TT=1799.6

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_11.opb
SAT
f=72
TT=1800.02
T1=658.92
SAT
f=76
TT=1798
T1=984.07
No dataSAT (TO)
f=72
TT=1800.03
T1=996.2
? (problem)

TT=46.728

? (TO)

TT=1800.09

? (problem)

TT=44.69

? (TO)

TT=1800.08

? (problem)

TT=45.62

? (TO)

TT=1800.08

? (problem)

TT=45.6

? (TO)

TT=1800.09

SAT (TO)
f=76
TT=1800.02
T1=358.81
SAT (TO)
f=94
TT=1800.09
T1=1740.41
SAT (TO)
f=74
TT=1802.07
T1=1384.84
SAT
f=74
TT=1783
T1=948.45
SAT (TO)
f=76
TT=1800.1
T1=1461.22
SAT
f=77
TT=1798
T1=576.35
SAT (TO)
f=74
TT=1800.1
T1=736.51
? (TO)

TT=1800.22

No data? (TO)

TT=1800.13

SAT (TO)
f=77
TT=1800.83
T1=898.02
?

TT=1789.78

No dataSAT (TO)
f=76
TT=1800.21
T1=415.19
?

TT=1796.81

SAT (TO)
f=81
TT=1800.08
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=74
TT=1800.6
T1=900.31
No dataNo dataSAT (TO)
f=74
TT=1800.15
T1=900.31
No dataNo dataNo dataSAT (TO)
f=74
TT=1800.59
T1=136.88
SAT (TO)
f=72
TT=1800.02
T1=658.92
SAT (TO)
f=75
TT=1800.06
T1=717.4
?

TT=1796.84

?

TT=1796.82

?

TT=1796.93

? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.62

No dataNo data?

TT=1800.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_12.opb
SAT
f=94
TT=1800.17
T1=418.01
SAT
f=96
TT=1798.01
T1=573.56
No dataSAT (TO)
f=98
TT=1800.03
T1=1587.12
? (problem)

TT=99.95

? (TO)

TT=1800.1

? (problem)

TT=94.91

? (TO)

TT=1800.04

? (problem)

TT=96.42

? (TO)

TT=1800.08

? (problem)

TT=93.61

? (TO)

TT=1800.05

SAT (TO)
f=99
TT=1800.05
T1=968.39
SAT (TO)
f=99
TT=1800.07
T1=1579.15
SAT (TO)
f=96
TT=1800.07
T1=1023.11
SAT
f=95
TT=1783.01
T1=249.05
SAT (TO)
f=101
TT=1800.01
T1=1544.01
SAT (TO)
f=99
TT=1800.2
T1=1742.1
SAT (TO)
f=99
TT=1800.13
T1=1708.9
? (TO)

TT=1800.18

No data? (TO)

TT=1800.2

SAT (TO)
f=99
TT=1800.15
T1=760.28
?

TT=1789.79

No dataSAT (TO)
f=97
TT=1800.15
T1=250.13
?

TT=1796.83

SAT (TO)
f=104
TT=1800.03
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=95
TT=1800.18
T1=900.31
No dataNo dataSAT (TO)
f=98
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=94
TT=1800.17
T1=418.01
SAT (TO)
f=95
TT=1800.03
T1=1779.3
SAT (TO)
f=97
TT=1800.09
T1=845.78
?

TT=1796.81

?

TT=1796.89

?

TT=1796.9

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.63

No dataNo data?

TT=1800.07

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_13.opb
SAT
f=117
TT=1800.48
T1=1108.52
SAT
f=122
TT=1798.01
T1=1645.51
No dataSAT (TO)
f=118
TT=1800.03
T1=1631.62
? (problem)

TT=144.809

? (TO)

TT=1800.01

? (problem)

TT=133.95

? (TO)

TT=1800

? (problem)

TT=138.39

? (TO)

TT=1800.09

? (problem)

TT=134.43

? (TO)

TT=1800.05

SAT (TO)
f=126
TT=1800.08
T1=1309.66
? (TO)

TT=1800.08

SAT (TO)
f=123
TT=1802.1
T1=1211.53
SAT
f=118
TT=1783.01
T1=662.29
SAT (TO)
f=128
TT=1800.06
T1=1145.41
SAT
f=129
TT=1798.01
T1=423.62
SAT (TO)
f=125
TT=1801.2
T1=739.9
? (TO)

TT=1800.21

No data? (TO)

TT=1800.42

SAT (TO)
f=129
TT=1800.79
T1=450.87
?

TT=1789.82

No dataSAT (TO)
f=123
TT=1800.32
T1=801.59
?

TT=1796.86

SAT (TO)
f=165
TT=1800.07
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=128
TT=1800.48
T1=900.31
No dataNo dataSAT (TO)
f=121
TT=1800.08
T1=900.31
No dataNo dataNo dataSAT (TO)
f=123
TT=1800.43
T1=524.03
SAT (TO)
f=117
TT=1800.48
T1=1108.52
SAT
f=121
TT=1433.13
T1=1430.98
?

TT=1796.63

?

TT=1796.82

?

TT=1796.87

? (TO)

TT=1800.11

? (TO)

TT=1800.01

?

TT=1799.63

No dataNo data?

TT=1800.01

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_14.opb
SAT
f=144
TT=1800.02
T1=1661.54
SAT
f=155
TT=1798.01
T1=1198.01
No dataSAT (TO)
f=144
TT=1800.02
T1=1661.54
? (problem)

TT=201.018

? (TO)

TT=1800.06

? (problem)

TT=187.5

? (TO)

TT=1800.05

? (problem)

TT=192.71

? (TO)

TT=1800.08

? (problem)

TT=187.39

? (TO)

TT=1800.09

SAT (TO)
f=157
TT=1800.1
T1=478.06
? (TO)

TT=1800.09

SAT (TO)
f=159
TT=1802.08
T1=382
SAT
f=149
TT=1783.01
T1=1141.38
SAT (TO)
f=156
TT=1800.39
T1=1633.43
SAT
f=150
TT=1798
T1=1550.02
SAT (TO)
f=155
TT=1800.01
T1=1740.41
? (TO)

TT=1800.2

No data? (TO)

TT=1800.11

SAT (TO)
f=163
TT=1800.31
T1=818.36
?

TT=1789.81

No dataSAT (TO)
f=151
TT=1800.08
T1=91.22
?

TT=1796.84

? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=156
TT=1800.46
T1=900.31
No dataNo dataSAT (TO)
f=161
TT=1800.51
T1=900.31
No dataNo dataNo dataSAT (TO)
f=151
TT=1800.52
T1=862.34
SAT (TO)
f=146
TT=1800.08
T1=692.56
SAT (TO)
f=156
TT=1800.02
T1=1613.57
?

TT=1796.87

?

TT=1796.82

?

TT=1796.84

? (TO)

TT=1800.09

? (TO)

TT=1800.02

?

TT=1799.65

No dataNo data?

TT=1799.66

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_15.opb
SAT
f=176
TT=1783.01
T1=571.05
SAT
f=199
TT=1798
T1=1469.28
No dataSAT (TO)
f=187
TT=1800.03
T1=869.5
? (MO)

TT=223.07

? (TO)

TT=1800.08

? (MO)

TT=221.32

? (TO)

TT=1800.05

? (MO)

TT=225.25

? (TO)

TT=1800.01

? (MO)

TT=231.64

? (TO)

TT=1800.08

SAT (TO)
f=190
TT=1800.08
T1=1524.84
? (TO)

TT=1800.07

SAT (TO)
f=189
TT=1802.07
T1=1441.81
SAT
f=176
TT=1783.01
T1=571.05
SAT (TO)
f=213
TT=1800.01
T1=1564.59
SAT
f=192
TT=1798.01
T1=181.02
SAT (TO)
f=199
TT=1800.07
T1=1599.16
?

TT=1799.29

No data? (TO)

TT=1800.21

SAT (TO)
f=202
TT=1800.18
T1=285.14
?

TT=1789.78

No dataSAT (TO)
f=187
TT=1800.13
T1=444.2
?

TT=1796.79

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=193
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=196
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=185
TT=1800.78
T1=644.56
SAT (TO)
f=179
TT=1800.03
T1=1249.49
SAT (TO)
f=196
TT=1800.63
T1=1540.14
?

TT=1796.83

?

TT=1796.81

?

TT=1796.8

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.63

No dataNo data?

TT=1799.66

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_16.opb
SAT
f=210
TT=1800.02
T1=431.08
SAT
f=228
TT=1798
T1=1645.9
No dataSAT (TO)
f=210
TT=1800.02
T1=431.08
? (MO)

TT=184.73

? (TO)

TT=1800.02

? (MO)

TT=187.39

? (TO)

TT=1800.08

? (MO)

TT=188.41

? (TO)

TT=1800.06

? (MO)

TT=185.88

? (TO)

TT=1800.01

SAT (TO)
f=223
TT=1800.08
T1=214.62
SAT (TO)
f=234
TT=1800.08
T1=1664.6
SAT (TO)
f=247
TT=1802.13
T1=336.9
SAT
f=223
TT=1783.01
T1=679.57
SAT (TO)
f=239
TT=1800.09
T1=1132.05
SAT
f=226
TT=1798
T1=1001.19
? (TO)

TT=1800.06

?

TT=1797.71

No data? (TO)

TT=1800.08

SAT (TO)
f=241
TT=1801.2
T1=85.08
?

TT=1789.8

No dataSAT (TO)
f=233
TT=1800.13
T1=825.75
?

TT=1796.84

SAT (TO)
f=236
TT=1800.05
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=238
TT=1800.19
T1=900.41
No dataNo dataSAT (TO)
f=244
TT=1800.18
T1=900.41
No dataNo dataNo dataSAT (TO)
f=234
TT=1800.05
T1=317.09
SAT (TO)
f=220
TT=1800.54
T1=1450.48
SAT (TO)
f=252
TT=1800.04
T1=1479.31
?

TT=1796.83

?

TT=1796.83

?

TT=1796.85

? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.67

No dataNo data?

TT=1799.66

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_17.opb
SAT
f=260
TT=1800.2
T1=703.53
SAT
f=278
TT=1798.02
T1=68.56
No dataSAT (TO)
f=270
TT=1800.03
T1=1520.54
? (problem)

TT=183.167

? (TO)

TT=1800.07

? (problem)

TT=180.46

? (TO)

TT=1800.09

? (problem)

TT=188.118

? (TO)

TT=1800.08

? (problem)

TT=182.634

? (TO)

TT=1800.07

SAT (TO)
f=270
TT=1800.05
T1=1656.93
? (TO)

TT=1800.07

? (TO)

TT=1802.11

SAT
f=266
TT=1783.01
T1=740.67
? (TO)

TT=1800.08

SAT
f=266
TT=1798.01
T1=609.86
SAT (TO)
f=277
TT=1800.09
T1=750.49
?

TT=1797.2

No data? (TO)

TT=1800.08

SAT (TO)
f=275
TT=1800.11
T1=802.02
?

TT=1789.81

No dataSAT (TO)
f=281
TT=1800.17
T1=702.44
?

TT=1796.84

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800

No dataNo dataNo data? (TO)

TT=1800.06

No dataNo dataSAT (TO)
f=276
TT=1800.4
T1=900.41
No dataNo dataNo dataSAT (TO)
f=260
TT=1800.2
T1=703.53
SAT (TO)
f=264
TT=1800.04
T1=1395.13
SAT (TO)
f=332
TT=1800.08
T1=1750.11
?

TT=1796.86

?

TT=1796.86

?

TT=1796.85

? (TO)

TT=1800.1

? (TO)

TT=1800.01

?

TT=1799.66

No dataNo data?

TT=1799.65

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_18.opb
SAT
f=307
TT=1800.21
T1=823.27
SAT
f=321
TT=1798.01
T1=85.59
No dataSAT (TO)
f=322
TT=1800.11
T1=1281.49
? (problem)

TT=237.21

? (TO)

TT=1800.02

? (problem)

TT=235.62

? (TO)

TT=1800.04

? (problem)

TT=240.886

? (TO)

TT=1800.03

? (problem)

TT=237.393

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1802.12

SAT
f=312
TT=1783.01
T1=1120.7
? (TO)

TT=1800.75

?

TT=1798.01

? (TO)

TT=1801.24

?

TT=1796.85

No data? (TO)

TT=1800.4

? (TO)

TT=1800.17

?

TT=1789.83

No dataSAT (TO)
f=314
TT=1800.08
T1=276.1
?

TT=1796.9

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.54

No dataNo dataSAT (TO)
f=313
TT=1800.2
T1=900.71
No dataNo dataNo dataSAT (TO)
f=307
TT=1800.21
T1=823.27
SAT (TO)
f=315
TT=1800.89
T1=1447.45
? (TO)

TT=1800.09

?

TT=1796.87

?

TT=1796.99

?

TT=1796.84

? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.97

No dataNo data?

TT=1799.63

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_19.opb
SAT
f=355
TT=1783.01
T1=351.63
?

TT=1798.01

No data? (TO)

TT=1800.02

? (MO)

TT=276.75

? (TO)

TT=1800.03

? (MO)

TT=282.98

? (TO)

TT=1800.02

? (MO)

TT=279.36

? (TO)

TT=1800.02

? (MO)

TT=277.55

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1802.13

SAT
f=355
TT=1783.01
T1=351.63
? (TO)

TT=1800.07

SAT
f=352
TT=1798.01
T1=193.11
? (TO)

TT=1800.56

?

TT=1796.14

No data? (TO)

TT=1800.21

? (TO)

TT=1800.83

?

TT=1790.04

No data? (TO)

TT=1800.18

?

TT=1796.96

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.02

No dataNo data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.46

SAT (TO)
f=357
TT=1800.1
T1=1779.35
? (TO)

TT=1800.78

?

TT=1796.85

?

TT=1797

?

TT=1796.9

? (TO)

TT=1800.11

? (TO)

TT=1800.09

?

TT=1799.64

No dataNo data?

TT=1800.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_20.opb




?

TT=1798.01

No data? (TO)

TT=1800.02

? (MO)

TT=278.9

? (TO)

TT=1800.01

? (MO)

TT=278.97

? (TO)

TT=1800.1

? (MO)

TT=278.51

? (TO)

TT=1800.07

? (MO)

TT=276.45

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1802.14

? (TO)

TT=1800.02

? (TO)

TT=1800.07

?

TT=1798.01

? (TO)

TT=1800.34

?

TT=1795.29

No data? (TO)

TT=1800.27

? (TO)

TT=1800.08

?

TT=1789.91

No data? (TO)

TT=1800.61

?

TT=1796.94

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.42

No dataNo data? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.05

?

TT=1796.91

?

TT=1796.91

?

TT=1796.99

? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.63

No dataNo data?

TT=1799.63

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_4.opb
OPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.004
T1=0
No dataOPT
f=6
TT=0.002
T1=0
OPT
f=6
TT=0.516
T1=0.45
OPT
f=6
TT=0.12
T1=0.09
OPT
f=6
TT=0.467
T1=0.43
OPT
f=6
TT=0.09
T1=0.08
OPT
f=6
TT=0.448
T1=0.64
OPT
f=6
TT=0.087
T1=0.08
? (TO)

TT=1800.01

? (TO)

TT=1800.27

OPT
f=6
TT=0.005
T1=0
OPT
f=6
TT=0.017
T1=0.01
OPT
f=6
TT=0.062
T1=0.11
OPT
f=6
TT=0.004
T1=0
OPT
f=6
TT=0.204
T1=0.16
OPT
f=6
TT=0.003
T1=0
OPT
f=6
TT=0.224
T1=0.14
OPT
f=6
TT=0.151
T1=0.14
No dataOPT
f=6
TT=0.026
T1=0.02
OPT
f=6
TT=0.286
T1=2.17
OPT
f=6
TT=0.034
T1=0.02
No dataOPT
f=6
TT=0.264
T1=1.17
OPT
f=6
TT=0.149
T1=0.14
OPT
f=6
TT=0.008
T1=0
OPT
f=6
TT=0.141
T1=0.11
OPT
f=6
TT=0.186
T1=0.16
No dataNo dataNo dataOPT
f=6
TT=0.002
T1=0
No dataNo dataOPT
f=6
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=6
TT=0.285
T1=1.16
OPT
f=6
TT=0.192
T1=0.16
SAT
f=9
TT=0.233
T1=0.16
OPT
f=6
TT=0.044
T1=0.03
OPT
f=6
TT=0.048
T1=0.04
OPT
f=6
TT=0.126
T1=0.12
OPT
f=6
TT=0.008
T1=0
OPT
f=6
TT=0.007
T1=0
OPT
f=6
TT=0.003
T1=0
No dataNo dataOPT
f=6
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_5.opb
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=0.012
T1=0.01
No dataOPT
f=11
TT=0.004
T1=0
OPT
f=11
TT=1.413
T1=1.41
OPT
f=11
TT=0.37
T1=0.33
OPT
f=11
TT=1.14
T1=1.13
OPT
f=11
TT=0.298
T1=0.28
OPT
f=11
TT=1.098
T1=1.05
OPT
f=11
TT=0.281
T1=0.27
OPT
f=11
TT=1.272
T1=1.16
? (TO)

TT=1800.04

OPT
f=11
TT=0.011
T1=0.01
OPT
f=11
TT=0.119
T1=0.09
OPT
f=11
TT=0.082
T1=0.1
OPT
f=11
TT=0.008
T1=0
OPT
f=11
TT=0.354
T1=0.21
OPT
f=11
TT=0.01
T1=0
OPT
f=11
TT=0.365
T1=0.21
OPT
f=11
TT=0.518
T1=0.47
No dataOPT
f=11
TT=0.248
T1=0.14
OPT
f=11
TT=0.525
T1=2.18
OPT
f=11
TT=0.555
T1=0.46
No dataOPT
f=11
TT=0.533
T1=1.21
OPT
f=11
TT=0.545
T1=0.49
OPT
f=11
TT=0.062
T1=0.06
OPT
f=11
TT=0.436
T1=0.37
OPT
f=11
TT=0.452
T1=0.39
No dataNo dataNo dataOPT
f=11
TT=0.003
T1=0
No dataNo dataOPT
f=11
TT=0.003
T1=0
No dataNo dataNo dataOPT
f=11
TT=0.505
T1=1.18
OPT
f=11
TT=0.345
T1=0.21
SAT
f=11
TT=0.374
T1=0.23
OPT
f=11
TT=0.321
T1=0.3
OPT
f=11
TT=0.368
T1=0.35
OPT
f=11
TT=0.484
T1=0.43
OPT
f=11
TT=0.043
T1=0.03
OPT
f=11
TT=0.035
T1=0.02
OPT
f=11
TT=0.002
T1=0.01
No dataNo dataOPT
f=11
TT=0.002
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_6.opb
OPT
f=17
TT=0.02
T1=0.01
OPT
f=17
TT=0.076
T1=0.03
No dataOPT
f=17
TT=0.02
T1=0.02
OPT
f=17
TT=15.655
T1=8.29
OPT
f=17
TT=0.814
T1=0.72
OPT
f=17
TT=12.607
T1=6.95
OPT
f=17
TT=0.527
T1=0.48
OPT
f=17
TT=8.151
T1=6.56
OPT
f=17
TT=0.489
T1=0.42
OPT
f=17
TT=12.753
T1=10.89
? (TO)

TT=1800.03

OPT
f=17
TT=0.063
T1=0.03
OPT
f=17
TT=0.821
T1=0.57
OPT
f=17
TT=0.337
T1=0.3
OPT
f=17
TT=0.056
T1=0.01
OPT
f=17
TT=0.774
T1=0.4
OPT
f=17
TT=0.077
T1=0.02
OPT
f=17
TT=0.916
T1=0.42
OPT
f=17
TT=2.806
T1=1.61
No dataOPT
f=17
TT=3.179
T1=1.2
OPT
f=17
TT=2.013
T1=5.22
OPT
f=17
TT=3.639
T1=2.48
No dataOPT
f=17
TT=1.254
T1=2.27
OPT
f=17
TT=1.906
T1=1.28
OPT
f=17
TT=0.538
T1=0.53
OPT
f=17
TT=2.838
T1=3.4
OPT
f=17
TT=2.62
T1=1.99
No dataNo dataNo dataOPT
f=17
TT=0.086
T1=0.03
No dataNo dataOPT
f=17
TT=0.086
T1=0.04
No dataNo dataNo dataOPT
f=17
TT=2.524
T1=2.75
OPT
f=17
TT=0.754
T1=0.37
SAT
f=17
TT=0.795
T1=0.34
OPT
f=17
TT=2.357
T1=2.13
OPT
f=17
TT=2.549
T1=2.29
OPT
f=17
TT=2.972
T1=2.74
OPT
f=17
TT=0.374
T1=0.21
OPT
f=17
TT=0.349
T1=0.19
OPT
f=17
TT=0.075
T1=0.07
No dataNo dataOPT
f=17
TT=0.074
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_7.opb
OPT
f=25
TT=0.36
T1=0.04
OPT
f=25
TT=0.838
T1=0.2
No dataOPT
f=25
TT=0.36
T1=0.22
OPT
f=25
TT=38.464
T1=38.47
OPT
f=25
TT=4.703
T1=3.33
OPT
f=25
TT=31.11
T1=31.38
OPT
f=25
TT=3.371
T1=2.25
OPT
f=25
TT=18.624
T1=12.91
OPT
f=25
TT=2.461
T1=1.09
OPT
f=25
TT=39.464
T1=31.87
? (TO)

TT=1800.07

OPT
f=25
TT=0.807
T1=0.14
OPT
f=25
TT=6.069
T1=2.57
OPT
f=25
TT=0.786
T1=0.25
OPT
f=25
TT=0.812
T1=0.04
OPT
f=25
TT=2.245
T1=1.19
OPT
f=25
TT=0.71
T1=0.17
OPT
f=25
TT=2.263
T1=0.59
OPT
f=25
TT=27.846
T1=10.27
No dataOPT
f=25
TT=25.079
T1=8.87
OPT
f=25
TT=5.214
T1=5.33
OPT
f=25
TT=46.813
T1=16.67
No dataOPT
f=25
TT=3.583
T1=2.3
OPT
f=25
TT=33.034
T1=16.32
OPT
f=25
TT=4.568
T1=4.56
OPT
f=25
TT=17.434
T1=17.56
OPT
f=25
TT=16.371
T1=11.2
No dataNo dataNo dataOPT
f=25
TT=0.808
T1=0.4
No dataNo dataOPT
f=25
TT=0.767
T1=0.38
No dataNo dataNo dataOPT
f=25
TT=4.154
T1=7.32
OPT
f=25
TT=1.523
T1=0.58
OPT
f=25
TT=1.675
T1=0.56
OPT
f=25
TT=33.477
T1=14.68
OPT
f=25
TT=37.21
T1=16.37
OPT
f=25
TT=19.296
T1=10.55
OPT
f=25
TT=4.005
T1=0.35
OPT
f=25
TT=3.524
T1=0.46
OPT
f=25
TT=138.53
T1=138.61
No dataNo dataOPT
f=25
TT=146.101
T1=146.09
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_8.opb
OPT
f=34
TT=5.91
T1=0.7
OPT
f=34
TT=13.825
T1=4.37
No dataOPT
f=34
TT=5.91
T1=0.7
OPT
f=34
TT=894.519
T1=901.52
OPT
f=34
TT=34.03
T1=22.26
OPT
f=34
TT=582.624
T1=582.89
OPT
f=34
TT=29.518
T1=29.52
OPT
f=34
TT=342.197
T1=272.8
OPT
f=34
TT=21.351
T1=15.51
? (TO)

TT=1800.29

? (TO)

TT=1800.19

OPT
f=34
TT=11.268
T1=0.97
OPT
f=34
TT=22.926
T1=5.06
OPT
f=34
TT=7.486
T1=2.08
OPT
f=34
TT=10.186
T1=2.79
OPT
f=34
TT=10.912
T1=5.77
OPT
f=34
TT=9.984
T1=1.2
OPT
f=34
TT=14.583
T1=8.02
OPT
f=34
TT=994.92
T1=856.58
No dataOPT
f=34
TT=1444.14
T1=451.63
OPT
f=34
TT=29.442
T1=14.41
OPT
f=34
TT=864.73
T1=625.91
No dataOPT
f=34
TT=15.664
T1=8.02
OPT
f=34
TT=856.626
T1=766.16
OPT
f=34
TT=16.766
T1=16.77
OPT
f=34
TT=94.292
T1=55.8
OPT
f=34
TT=102.836
T1=66.42
No dataNo dataNo dataOPT
f=34
TT=8.264
T1=4.13
No dataNo dataOPT
f=34
TT=8.863
T1=4.44
No dataNo dataNo dataOPT
f=34
TT=12.071
T1=5.44
OPT
f=34
TT=7.183
T1=3.97
SAT
f=34
TT=5.763
T1=1.62
OPT
f=34
TT=155.615
T1=152.92
OPT
f=34
TT=172.903
T1=169.87
OPT
f=34
TT=613.539
T1=311.35
OPT
f=34
TT=80.239
T1=14.8
OPT
f=34
TT=80.866
T1=14.89
OPT
f=34
TT=10.032
T1=10.05
No dataNo dataOPT
f=34
TT=10.042
T1=10.04
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
golomb-rulers/normalized-OGR_9.opb
OPT
f=44
TT=43.227
T1=3.96
OPT
f=44
TT=278.323
T1=88.69
No dataOPT
f=44
TT=108.305
T1=3.96
? (TO)

TT=1800.08

OPT
f=44
TT=566.614
T1=148.19
? (TO)

TT=1800.1

OPT
f=44
TT=507.559
T1=133.98
OPT
f=44
TT=1131.02
T1=502.9
OPT
f=44
TT=407.666
T1=298.35
? (TO)

TT=1800.06

? (TO)

TT=1800.02

OPT
f=44
TT=229.032
T1=72.88
OPT
f=44
TT=1087.42
T1=292.7
OPT
f=44
TT=83.722
T1=36.21
OPT
f=44
TT=109.169
T1=74.02
OPT
f=44
TT=86.53
T1=57.88
OPT
f=44
TT=195.456
T1=47.75
OPT
f=44
TT=119.61
T1=16.39
SAT (TO)
f=64
TT=1800.23
T1=941.69
No data? (TO)

TT=1800.25

OPT
f=44
TT=257.517
T1=83.5
SAT
f=56
TT=1789.84
T1=740.25
No dataOPT
f=44
TT=128.974
T1=43.57
SAT
f=96
TT=1796.86
T1=701.83
OPT
f=44
TT=900.35
T1=900.51
OPT
f=44
TT=1089.25
T1=492.86
OPT
f=44
TT=1021.76
T1=724.91
No dataNo dataNo dataOPT
f=44
TT=165.257
T1=82.64
No dataNo dataOPT
f=44
TT=130.086
T1=65.06
No dataNo dataNo dataOPT
f=44
TT=107.528
T1=26.12
OPT
f=44
TT=43.227
T1=19.95
SAT
f=47
TT=14.51
T1=13.53
SAT
f=68
TT=1796.94
T1=528.81
SAT
f=68
TT=1796.89
T1=550.25
SAT
f=47
TT=1796.89
T1=1129.52
OPT
f=44
TT=744.674
T1=66.1
OPT
f=44
TT=733.76
T1=67.51
?

TT=1799.6

No dataNo data?

TT=1799.96

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-nonunif-100_100.02.opb
OPT
f=44
TT=6.548
T1=6.52
SAT
f=53
TT=1798.01
T1=16.91
No data? (TO)

TT=1800.01

OPT
f=44
TT=16.145
T1=12.93
? (TO)

TT=1800.08

? (problem)

TT=8.82

? (TO)

TT=1800.06

? (problem)

TT=8.73

? (TO)

TT=1800.01

? (problem)

TT=8.721

? (TO)

TT=1800.08

SAT (TO)
f=53
TT=1800.03
T1=13.61
OPT
f=44
TT=41.927
T1=41.76
SAT (TO)
f=60
TT=1802.03
T1=669.28
SAT
f=66
TT=1783.01
T1=1339.08
No Cert.

TT=492.77

SAT
f=53
TT=1798.01
T1=13.97
? (exit code)

TT=1147.5

? (TO)

TT=1802.12

No dataSAT
f=88
TT=1799.76
T1=1799.45
OPT
f=44
TT=482.812
T1=120.81
SAT
f=160
TT=1790.97
T1=44.13
No dataOPT
f=44
TT=436.638
T1=113.6
SAT
f=160
TT=1799.95
T1=62.63
OPT
f=44
TT=24.396
T1=24.39
OPT
f=44
TT=48.842
T1=49.06
OPT
f=44
TT=179.798
T1=177.39
No dataNo dataNo dataOPT
f=44
TT=11.22
T1=7.32
No dataNo dataOPT
f=44
TT=10.602
T1=7.03
No dataNo dataNo dataSAT (TO)
f=44
TT=1800.1
T1=615.98
SAT (TO)
f=44
TT=1800.68
T1=1410.63
SAT (TO)
f=44
TT=1800.65
T1=85.69
SAT
f=160
TT=1798.4
T1=20.5
SAT
f=160
TT=1798.56
T1=14.4
SAT
f=160
TT=1797.99
T1=16.75
SAT
f=54
TT=1329.21
T1=68.37
? (TO)

TT=1800.08

OPT
f=44
TT=6.47
T1=6.45
No dataNo dataOPT
f=44
TT=6.548
T1=6.52
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-nonunif-100_100.07.opb
OPT
f=37
TT=5.632
T1=5.62
SAT
f=57
TT=1798.01
T1=1657.93
No data? (TO)

TT=1800.01

OPT
f=37
TT=37.686
T1=19.69
? (TO)

TT=1800.01

? (problem)

TT=8.83

? (TO)

TT=1800.11

? (problem)

TT=8.5

? (TO)

TT=1800

? (problem)

TT=8.4

? (TO)

TT=1800.05

SAT (TO)
f=57
TT=1800.1
T1=850.19
OPT
f=37
TT=38.893
T1=38.84
SAT (TO)
f=51
TT=1802.02
T1=897.3
SAT
f=50
TT=1783.01
T1=1047.18
? (exit code)

TT=956.5

SAT (TO)
f=53
TT=1800.05
T1=1618.76
SAT
f=37
TT=1385.09
T1=18.84
? (TO)

TT=1801.5

No dataSAT
f=89
TT=1799.72
T1=1799.4
OPT
f=37
TT=1480.03
T1=27.18
SAT
f=165
TT=1790.8
T1=45.77
No dataOPT
f=37
TT=479.301
T1=36.78
SAT
f=165
TT=1798.21
T1=61.44
OPT
f=37
TT=29.532
T1=29.54
OPT
f=37
TT=44.373
T1=36.65
OPT
f=37
TT=193.091
T1=189.69
No dataNo dataNo dataOPT
f=37
TT=8.551
T1=5.91
No dataNo dataOPT
f=37
TT=10.138
T1=6.74
No dataNo dataNo dataOPT
f=37
TT=885.269
T1=17.35
SAT (TO)
f=37
TT=1800.02
T1=8.25
SAT (TO)
f=37
TT=1800.06
T1=40.95
SAT
f=165
TT=1798.15
T1=20.51
SAT
f=165
TT=1798.12
T1=16.37
SAT
f=165
TT=1797.97
T1=20.64
SAT
f=41
TT=344.981
T1=118.73
? (TO)

TT=1800.04

OPT
f=37
TT=5.562
T1=5.54
No dataNo dataOPT
f=37
TT=5.632
T1=5.62
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-nonunif-100_100.10.opb
OPT
f=49
TT=11.644
T1=10.35
SAT
f=74
TT=1798.01
T1=748.61
No data? (TO)

TT=1800.01

OPT
f=49
TT=25.309
T1=24.33
? (TO)

TT=1800.04

? (problem)

TT=12.89

? (TO)

TT=1800.02

? (problem)

TT=12.66

? (TO)

TT=1800.08

? (problem)

TT=12.5

? (TO)

TT=1800.03

SAT (TO)
f=75
TT=1800.06
T1=1644.71
OPT
f=49
TT=67.343
T1=64.71
SAT (TO)
f=63
TT=1801.98
T1=1213.96
SAT
f=71
TT=1783.02
T1=281.68
No Cert.

TT=1608.38

SAT (TO)
f=70
TT=1800.09
T1=1543.59
? (exit code)

TT=1351.4

? (TO)

TT=1802.03

No dataNo Cert.

TT=1800.01

SAT (TO)
f=49
TT=1800.99
T1=135.33
SAT
f=176
TT=1791.63
T1=56.26
No dataSAT (TO)
f=49
TT=1800.06
T1=166.89
SAT
f=176
TT=1798.9
T1=74.53
OPT
f=49
TT=41.603
T1=41.59
OPT
f=49
TT=45.56
T1=45.92
OPT
f=49
TT=220.629
T1=213.64
No dataNo dataNo dataOPT
f=49
TT=15.659
T1=10.36
No dataNo dataOPT
f=49
TT=15.529
T1=10.35
No dataNo dataNo dataSAT (TO)
f=52
TT=1800.14
T1=921.59
SAT (TO)
f=49
TT=1800.07
T1=161.01
SAT (TO)
f=50
TT=1800.07
T1=582.88
SAT
f=176
TT=1798.43
T1=24.76
SAT
f=176
TT=1799.14
T1=23.52
SAT
f=176
TT=1798.76
T1=27.74
? (TO)

TT=1800.07

? (TO)

TT=1800.05

OPT
f=49
TT=11.564
T1=11.56
No dataNo dataOPT
f=49
TT=11.644
T1=11.62
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-nonunif-100_100.11.opb
OPT
f=38
TT=20.808
T1=20.84
SAT
f=52
TT=1798.01
T1=1497.67
No data? (TO)

TT=1800.02

OPT
f=38
TT=43.836
T1=39.68
? (TO)

TT=1800.01

? (problem)

TT=8.14

? (TO)

TT=1800.1

? (problem)

TT=8.11

? (TO)

TT=1800.02

? (problem)

TT=8.06

? (TO)

TT=1800.04

SAT (TO)
f=54
TT=1800.13
T1=1036.57
OPT
f=38
TT=39.477
T1=39.4
SAT (TO)
f=51
TT=1801.99
T1=619.58
SAT
f=44
TT=1783.02
T1=737.54
No Cert.

TT=691.5

SAT
f=54
TT=1798.01
T1=1416.11
? (exit code)

TT=1492.45

? (TO)

TT=1801.5

No dataSAT
f=91
TT=1799.78
T1=1799.46
SAT (TO)
f=38
TT=1800.07
T1=138.97
SAT
f=166
TT=1790.79
T1=14.97
No dataSAT (TO)
f=38
TT=1800.02
T1=212.11
SAT
f=166
TT=1798.46
T1=14.85
OPT
f=38
TT=31.694
T1=31.69
OPT
f=38
TT=44.373
T1=46.46
OPT
f=38
TT=141.392
T1=139.22
No dataNo dataNo dataOPT
f=38
TT=60.027
T1=31.66
No dataNo dataOPT
f=38
TT=125.11
T1=64.26
No dataNo dataNo dataSAT (TO)
f=41
TT=1800.3
T1=675.98
SAT (TO)
f=39
TT=1800.03
T1=771.4
SAT (TO)
f=38
TT=1800.05
T1=167.46
SAT
f=166
TT=1798.36
T1=18.28
SAT
f=166
TT=1798.02
T1=13.42
SAT
f=166
TT=1798.01
T1=15.61
? (TO)

TT=1800.06

? (TO)

TT=1800.05

OPT
f=38
TT=20.58
T1=20.61
No dataNo dataOPT
f=38
TT=20.808
T1=20.84
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-nonunif-100_100.12.opb
OPT
f=41
TT=7.438
T1=7.42
SAT
f=65
TT=1798.03
T1=724.28
No data? (TO)

TT=1800

OPT
f=41
TT=21.144
T1=21.26
? (TO)

TT=1800.02

? (problem)

TT=10.73

? (TO)

TT=1800.07

? (problem)

TT=10.32

? (TO)

TT=1800.09

? (problem)

TT=10.33

? (TO)

TT=1800.04

SAT (TO)
f=72
TT=1800.03
T1=821.97
OPT
f=41
TT=35.748
T1=35.74
SAT (TO)
f=56
TT=1802.08
T1=1318.23
SAT
f=54
TT=1783.02
T1=1718.8
No Cert.

TT=468.293

SAT
f=64
TT=1798.01
T1=657.35
? (exit code)

TT=1018.21

? (TO)

TT=1802.03

No dataNo Cert.

TT=1800.01

SAT (TO)
f=41
TT=1800.08
T1=68.59
SAT
f=178
TT=1791.25
T1=51.31
No dataOPT
f=41
TT=370.453
T1=141
SAT
f=178
TT=1798.53
T1=67.9
OPT
f=41
TT=24.461
T1=24.53
OPT
f=41
TT=51.273
T1=51.84
OPT
f=41
TT=220.941
T1=215.87
No dataNo dataNo dataOPT
f=41
TT=12.762
T1=8.52
No dataNo dataOPT
f=41
TT=12.188
T1=8.25
No dataNo dataNo dataOPT
f=41
TT=310.987
T1=101.62
SAT (TO)
f=41
TT=1800.03
T1=206.26
SAT (TO)
f=41
TT=1800.01
T1=93.8
SAT
f=178
TT=1798.28
T1=26.55
SAT
f=178
TT=1798.73
T1=26.54
SAT
f=178
TT=1798.45
T1=30.49
SAT
f=43
TT=1670.62
T1=1433.56
? (TO)

TT=1800.1

OPT
f=41
TT=7.794
T1=7.78
No dataNo dataOPT
f=41
TT=7.438
T1=7.42
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-nonunif-100_100.14.opb
OPT
f=42
TT=8.602
T1=7.45
SAT
f=64
TT=1798.02
T1=1301.61
No data? (TO)

TT=1800

OPT
f=42
TT=23.817
T1=23.83
? (TO)

TT=1800.01

? (problem)

TT=10.15

? (TO)

TT=1800.06

? (problem)

TT=9.73

? (TO)

TT=1800.05

? (problem)

TT=9.62

? (TO)

TT=1800.04

SAT (TO)
f=65
TT=1800.04
T1=651.13
OPT
f=42
TT=48.162
T1=48
SAT (TO)
f=56
TT=1802.07
T1=1130.3
SAT
f=62
TT=1783.04
T1=1038.66
No Cert.

TT=525.85

SAT
f=65
TT=1798.01
T1=1260.1
? (exit code)

TT=1405.24

? (TO)

TT=1802.12

No dataSAT
f=88
TT=1799.92
T1=1799.48
SAT (TO)
f=42
TT=1800.15
T1=358.33
SAT
f=170
TT=1791.19
T1=62.62
No dataSAT (TO)
f=42
TT=1800.11
T1=687.94
SAT
f=170
TT=1799.21
T1=49.88
OPT
f=42
TT=28.034
T1=28.02
OPT
f=42
TT=51.601
T1=52.08
OPT
f=42
TT=187.859
T1=182.63
No dataNo dataNo dataOPT
f=42
TT=11.483
T1=7.67
No dataNo dataOPT
f=42
TT=10.887
T1=7.45
No dataNo dataNo dataSAT (TO)
f=44
TT=1800.67
T1=912.92
SAT (TO)
f=44
TT=1800.02
T1=1618.34
SAT (TO)
f=46
TT=1800.07
T1=1108.68
SAT
f=170
TT=1798.41
T1=18.2
SAT
f=170
TT=1798.43
T1=18.32
SAT
f=170
TT=1798.32
T1=17.74
SAT
f=61
TT=296.053
T1=105.69
? (TO)

TT=1800.06

OPT
f=42
TT=8.645
T1=8.67
No dataNo dataOPT
f=42
TT=8.602
T1=8.59
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-unif-100_100.00.opb
OPT
f=34
TT=12.012
T1=9.71
SAT
f=39
TT=1798
T1=348.44
No dataSAT (TO)
f=34
TT=1800.03
T1=26.77
OPT
f=34
TT=14.929
T1=12.73
OPT
f=34
TT=12.012
T1=9.71
? (problem)

TT=2.557

? (problem)

TT=2.262

? (problem)

TT=2.51

? (problem)

TT=2.237

? (problem)

TT=2.506

? (problem)

TT=2.3

SAT (TO)
f=38
TT=1800.06
T1=763.63
OPT
f=34
TT=93.641
T1=91.08
? (TO)

TT=1802.1

SAT
f=37
TT=1783.01
T1=1005.35
SAT (TO)
f=37
TT=1800.55
T1=1447.2
SAT
f=39
TT=1798.01
T1=208.78
? (TO)

TT=1802.06

SAT
f=55
TT=1795.73
T1=926.53
No data? (TO)

TT=1800.32

SAT (TO)
f=34
TT=1800.12
T1=158.76
SAT
f=53
TT=1790.01
T1=1245.24
No dataSAT (TO)
f=35
TT=1800.15
T1=249.67
SAT
f=47
TT=1797.04
T1=1552.42
OPT
f=34
TT=68.716
T1=68.72
OPT
f=34
TT=17.189
T1=17.19
OPT
f=34
TT=38.739
T1=36.82
No dataNo dataNo dataOPT
f=34
TT=101
T1=51
No dataNo dataOPT
f=34
TT=31.195
T1=16.12
No dataNo dataNo dataSAT (TO)
f=36
TT=1800.06
T1=177.19
SAT (TO)
f=36
TT=1800.09
T1=296.76
SAT (TO)
f=34
TT=1800.81
T1=175.52
SAT
f=50
TT=1797.09
T1=1777.05
SAT
f=50
TT=1797.09
T1=1614.87
SAT
f=51
TT=1797.12
T1=719.41
? (TO)

TT=1800.1

? (TO)

TT=1800.07

?

TT=1799.41

No dataNo data?

TT=1799.39

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/haplotype/
normalized-simp-unif-100_100.08.opb
OPT
f=34
TT=8.82
T1=8.23
SAT
f=42
TT=1798
T1=1666.91
No dataSAT (TO)
f=34
TT=1800.03
T1=53.99
OPT
f=34
TT=13.002
T1=11.93
OPT
f=34
TT=10.187
T1=8.23
? (problem)

TT=2.935

? (problem)

TT=2.469

? (problem)

TT=2.907

? (problem)

TT=2.65

? (problem)

TT=2.908

? (problem)

TT=2.556

SAT (TO)
f=40
TT=1800.06
T1=1753.82
OPT
f=34
TT=43.021
T1=42.33
SAT (TO)
f=41
TT=1801.95
T1=1406.76
SAT
f=41
TT=1783
T1=1698.44
SAT
f=38
TT=1536.51
T1=703.2
SAT
f=39
TT=1798
T1=1461.35
SAT (TO)
f=34
TT=1800.49
T1=873.02
SAT
f=57
TT=1796.4
T1=1364.11
No data? (TO)

TT=1800.23

SAT (TO)
f=34
TT=1800.09
T1=526.55
SAT
f=58
TT=1790.06
T1=1469.43
No dataSAT (TO)
f=35
TT=1800.14
T1=293.47
SAT
f=48
TT=1797.16
T1=729.56
OPT
f=34
TT=49.797
T1=49.8
OPT
f=34
TT=23.936
T1=23.95
OPT
f=34
TT=41.723
T1=35.06
No dataNo dataNo dataOPT
f=34
TT=4.735
T1=2.91
No dataNo dataOPT
f=34
TT=18.347
T1=9.71
No dataNo dataNo dataSAT (TO)
f=34
TT=1800.43
T1=945.13
SAT (TO)
f=34
TT=1800.07
T1=129.41
SAT (TO)
f=34
TT=1800.07
T1=1384.55
SAT
f=52
TT=1797.18
T1=1406.59
SAT
f=52
TT=1797.2
T1=1316.29
SAT
f=52
TT=1797.16
T1=1371.64
? (TO)

TT=1800.09

? (TO)

TT=1800.09

OPT
f=34
TT=8.781
T1=8.79
No dataNo dataOPT
f=34
TT=8.82
T1=8.8
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-apex6.b.opb
OPT
f=136
TT=10.933
T1=7.45
SAT
f=154
TT=1798.04
T1=1621.83
No dataSAT (TO)
f=159
TT=1800.1
T1=1184.17
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.1

SAT (TO)
f=138
TT=1800.02
T1=24.45
SAT (TO)
f=184
TT=1800.09
T1=1.47
SAT (TO)
f=158
TT=1802.16
T1=18.3
SAT
f=164
TT=1783.01
T1=0.53
SAT (TO)
f=183
TT=1800.05
T1=0.82
SAT
f=156
TT=1798.01
T1=412.86
SAT (TO)
f=174
TT=1800.69
T1=1.16
OPT
f=136
TT=68.316
T1=68.25
No dataOPT
f=136
TT=10.933
T1=7.45
SAT (TO)
f=160
TT=1801.04
T1=377.49
OPT
f=136
TT=105.894
T1=105.51
No dataSAT (TO)
f=159
TT=1800.64
T1=881.24
OPT
f=136
TT=95.871
T1=95.8
SAT (TO)
f=180
TT=1800.09
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=155
TT=1800.21
T1=900.51
No dataNo dataSAT (TO)
f=158
TT=1800.51
T1=900.41
No dataNo dataNo dataSAT (TO)
f=175
TT=1800.04
T1=371.89
SAT (TO)
f=181
TT=1800.07
T1=1
SAT (TO)
f=183
TT=1800.56
T1=0.69
OPT
f=136
TT=103.68
T1=81.6
OPT
f=136
TT=96.532
T1=75.88
OPT
f=136
TT=58.415
T1=53.15
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.47

No dataNo data?

TT=1799.48

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-C499.a.opb
OPT
f=64
TT=4.249
T1=4.24
SAT
f=76
TT=1798
T1=1674.98
No dataSAT (TO)
f=72
TT=1800.11
T1=0.01
? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.08

SAT (TO)
f=71
TT=1800.11
T1=368.7
SAT (TO)
f=78
TT=1800.05
T1=30.04
SAT (TO)
f=112
TT=1802.09
T1=1.57
SAT
f=72
TT=1783
T1=0.08
SAT (TO)
f=88
TT=1800.03
T1=0.49
SAT
f=73
TT=1798
T1=1572
SAT (TO)
f=88
TT=1800.43
T1=0.37
OPT
f=64
TT=117.327
T1=54.96
No dataOPT
f=64
TT=4.249
T1=4.24
SAT (TO)
f=76
TT=1800.18
T1=654.41
OPT
f=64
TT=126.916
T1=91.26
No dataSAT (TO)
f=77
TT=1801.17
T1=273.64
OPT
f=64
TT=160.189
T1=154.9
SAT (TO)
f=76
TT=1800.07
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=73
TT=1800.44
T1=900.31
No dataNo dataSAT (TO)
f=73
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=75
TT=1800.38
T1=553.92
SAT (TO)
f=83
TT=1800.63
T1=0.47
SAT (TO)
f=89
TT=1800.58
T1=0.38
OPT
f=64
TT=193.448
T1=176.73
OPT
f=64
TT=195.224
T1=178.33
OPT
f=64
TT=123.889
T1=89.31
? (TO)

TT=1800.11

? (TO)

TT=1800.11

?

TT=1799.44

No dataNo data?

TT=1799.69

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-C499.b.opb
SAT
f=45
TT=1796.93
T1=844.73
SAT
f=70
TT=1798.05
T1=1280.67
No dataSAT (TO)
f=78
TT=1800.09
T1=1365.34
? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.05

SAT (TO)
f=51
TT=1800.07
T1=1583.24
SAT (TO)
f=88
TT=1800.12
T1=6.08
SAT (TO)
f=75
TT=1802.12
T1=16.1
SAT
f=77
TT=1783.01
T1=5.89
SAT (TO)
f=84
TT=1800.07
T1=2.2
SAT
f=70
TT=1798.02
T1=1207.98
SAT (TO)
f=84
TT=1800.24
T1=1.97
SAT
f=45
TT=1794.45
T1=1724.9
No data? (TO)

TT=1800.09

SAT (TO)
f=71
TT=1800.14
T1=83.02
SAT
f=55
TT=1791.47
T1=32.56
No dataSAT (TO)
f=72
TT=1800.12
T1=177.72
SAT
f=45
TT=1796.93
T1=1307.69
SAT (TO)
f=88
TT=1800.09
T1=1800.81
? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=68
TT=1800.12
T1=900.71
No dataNo dataSAT (TO)
f=68
TT=1800.14
T1=900.71
No dataNo dataNo dataSAT (TO)
f=75
TT=1800.43
T1=412.87
SAT (TO)
f=83
TT=1800.07
T1=2.26
SAT (TO)
f=88
TT=1800.07
T1=1.78
SAT
f=45
TT=1797.02
T1=909
SAT
f=45
TT=1797.04
T1=863.49
SAT
f=45
TT=1796.99
T1=844.73
? (TO)

TT=1800.09

? (TO)

TT=1800.11

?

TT=1799.6

No dataNo data?

TT=1799.57

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-C880.b.opb
OPT
f=63
TT=0.273
T1=0.27
SAT
f=66
TT=1798
T1=1022.15
No dataSAT (TO)
f=74
TT=1800.03
T1=110.23
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.09

OPT
f=63
TT=543.414
T1=541.14
SAT (TO)
f=64
TT=1800.08
T1=21.41
SAT (TO)
f=78
TT=1802.09
T1=852.11
SAT
f=74
TT=1783.01
T1=97.37
SAT (TO)
f=86
TT=1800.1
T1=0.45
SAT
f=66
TT=1798.02
T1=1020.69
SAT (TO)
f=86
TT=1800.07
T1=0.42
OPT
f=63
TT=2.695
T1=2.68
No dataOPT
f=63
TT=0.273
T1=0.27
SAT (TO)
f=74
TT=1800.08
T1=983.48
OPT
f=63
TT=1.829
T1=1.81
No dataSAT (TO)
f=74
TT=1800.2
T1=800.71
OPT
f=63
TT=6.117
T1=6.1
SAT (TO)
f=65
TT=1800.03
T1=1800.3
? (TO)

TT=1800.09

? (TO)

TT=1800.15

No dataNo dataNo dataOPT
f=63
TT=943.65
T1=472.08
No dataNo dataSAT (TO)
f=67
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=78
TT=1800.04
T1=96.91
SAT (TO)
f=85
TT=1800.08
T1=0.46
SAT (TO)
f=89
TT=1800.07
T1=0.34
OPT
f=63
TT=1.853
T1=1.84
OPT
f=63
TT=1.903
T1=1.87
OPT
f=63
TT=3.542
T1=3.53
? (TO)

TT=1800.01

? (TO)

TT=1800.02

OPT
f=63
TT=167.73
T1=167.81
No dataNo dataOPT
f=63
TT=162.326
T1=162.49
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-des.a.opb
OPT
f=942
TT=6.514
T1=6.47
SAT
f=1005
TT=1798.01
T1=2.17
No dataSAT (TO)
f=1034
TT=1800.11
T1=39.42
? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.09

SAT (TO)
f=961
TT=1800.08
T1=693.92
SAT (TO)
f=1030
TT=1800.06
T1=0.53
SAT (TO)
f=1020
TT=1802.09
T1=1.61
SAT
f=988
TT=1783.01
T1=0.43
? (exit code)

TT=431.71

SAT
f=1005
TT=1798.02
T1=2.19
SAT (TO)
f=1017
TT=1800.92
T1=0.72
OPT
f=942
TT=134.293
T1=134.23
No dataOPT
f=942
TT=6.514
T1=6.47
SAT (TO)
f=1009
TT=1800.53
T1=76.76
OPT
f=942
TT=803.342
T1=168.68
No dataSAT (TO)
f=1008
TT=1800.14
T1=105.81
OPT
f=942
TT=1356.25
T1=201.38
SAT (TO)
f=1030
TT=1800.04
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=1013
TT=1800.55
T1=900.41
No dataNo dataSAT (TO)
f=1018
TT=1800.56
T1=900.41
No dataNo dataNo dataSAT (TO)
f=1012
TT=1801.13
T1=23.81
SAT (TO)
f=1013
TT=1800.04
T1=0.79
SAT (TO)
f=1065
TT=1800.78
T1=0.78
SAT
f=946
TT=1796.82
T1=781.88
SAT
f=946
TT=1796.84
T1=788.44
SAT
f=946
TT=1796.87
T1=862.12
? (TO)

TT=1800.13

? (TO)

TT=1800.11

?

TT=1799.88

No dataNo data?

TT=1799.53

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-ex4inp.r.opb
OPT
f=5
TT=0.134
T1=0.02
OPT
f=5
TT=1.077
T1=0.17
No dataOPT
f=5
TT=12.786
T1=0.03
OPT
f=5
TT=1.568
T1=1.57
OPT
f=5
TT=2.498
T1=2.61
OPT
f=5
TT=1.512
T1=1.65
OPT
f=5
TT=1.34
T1=1.34
OPT
f=5
TT=1.407
T1=0.23
OPT
f=5
TT=1.668
T1=0.05
OPT
f=5
TT=1.405
T1=0.24
OPT
f=5
TT=1.662
T1=0.05
OPT
f=5
TT=0.095
T1=0.04
OPT
f=5
TT=0.72
T1=0.25
OPT
f=5
TT=624.703
T1=0.28
OPT
f=5
TT=0.578
T1=0.02
OPT
f=5
TT=191.177
T1=0.45
OPT
f=5
TT=1.064
T1=0.17
OPT
f=5
TT=323.43
T1=0.57
OPT
f=5
TT=0.154
T1=0.14
No dataOPT
f=5
TT=0.203
T1=0.21
OPT
f=5
TT=2.974
T1=4.27
OPT
f=5
TT=0.14
T1=0.08
No dataOPT
f=5
TT=2.045
T1=2.29
OPT
f=5
TT=0.134
T1=0.07
OPT
f=5
TT=0.412
T1=0.41
OPT
f=5
TT=1.329
T1=1.33
OPT
f=5
TT=1.339
T1=0.17
No dataNo dataNo dataOPT
f=5
TT=4.287
T1=2.14
No dataNo dataOPT
f=5
TT=4.388
T1=2.19
No dataNo dataNo dataOPT
f=5
TT=2.988
T1=2.29
OPT
f=5
TT=108.208
T1=0.4
OPT
f=5
TT=208.162
T1=1.62
OPT
f=5
TT=0.139
T1=0.08
OPT
f=5
TT=0.14
T1=0.08
OPT
f=5
TT=0.136
T1=0.07
OPT
f=5
TT=407.672
T1=0.71
OPT
f=5
TT=408.793
T1=0.71
OPT
f=5
TT=1652.71
T1=1652.92
No dataNo dataOPT
f=5
TT=1541.09
T1=1541.61
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-ex6inp.r.opb
OPT
f=4
TT=0.01
T1=0
OPT
f=4
TT=0.082
T1=0.01
No dataOPT
f=4
TT=0.042
T1=0
OPT
f=4
TT=0.093
T1=0.04
OPT
f=4
TT=0.093
T1=0.05
OPT
f=4
TT=0.066
T1=0.03
OPT
f=4
TT=0.077
T1=0.03
OPT
f=4
TT=0.073
T1=0.03
OPT
f=4
TT=0.074
T1=0.02
OPT
f=4
TT=0.074
T1=0.03
OPT
f=4
TT=0.064
T1=0.02
OPT
f=4
TT=0.262
T1=0.21
OPT
f=4
TT=0.084
T1=0.02
OPT
f=4
TT=0.374
T1=0.05
OPT
f=4
TT=0.01
T1=0
OPT
f=4
TT=0.785
T1=0.15
OPT
f=4
TT=0.084
T1=0.01
OPT
f=4
TT=0.964
T1=0.16
OPT
f=4
TT=0.028
T1=0.01
No dataOPT
f=4
TT=0.017
T1=0.01
OPT
f=4
TT=0.824
T1=2.16
OPT
f=4
TT=0.053
T1=0.03
No dataOPT
f=4
TT=0.745
T1=1.18
OPT
f=4
TT=0.052
T1=0.03
OPT
f=4
TT=0.044
T1=0.04
OPT
f=4
TT=0.07
T1=0.07
OPT
f=4
TT=0.097
T1=0.05
No dataNo dataNo dataOPT
f=4
TT=0.123
T1=0.06
No dataNo dataOPT
f=4
TT=0.142
T1=0.06
No dataNo dataNo dataOPT
f=4
TT=0.985
T1=1.19
OPT
f=4
TT=0.825
T1=0.17
OPT
f=4
TT=0.995
T1=0.16
OPT
f=4
TT=0.078
T1=0.05
OPT
f=4
TT=0.071
T1=0.04
OPT
f=4
TT=0.035
T1=0.01
OPT
f=4
TT=1.382
T1=0
OPT
f=4
TT=1.366
T1=0
OPT
f=4
TT=0.352
T1=0.34
No dataNo dataOPT
f=4
TT=0.352
T1=0.34
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-lin.rom.r.opb
OPT
f=120
TT=0.185
T1=0.17
OPT
f=120
TT=2.013
T1=2.01
No dataSAT (TO)
f=172
TT=1800.11
T1=1066.48
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.15

? (TO)

TT=1800.1

OPT
f=120
TT=0.181
T1=0.17
SAT (TO)
f=134
TT=1800.06
T1=10.9
SAT (TO)
f=186
TT=1800.14
T1=0.51
SAT
f=181
TT=1783.01
T1=0.61
No Cert.

TT=1664.37

OPT
f=120
TT=2.035
T1=2.03
SAT (TO)
f=177
TT=1800.06
T1=0.3
OPT
f=120
TT=0.273
T1=0.26
No dataOPT
f=120
TT=0.2
T1=0.19
SAT (TO)
f=161
TT=1800.18
T1=962.11
OPT
f=120
TT=0.279
T1=0.27
No dataSAT (TO)
f=159
TT=1800.13
T1=641.14
OPT
f=120
TT=0.291
T1=0.27
SAT (TO)
f=137
TT=1800.06
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=133
TT=1800.05
T1=900.31
No dataNo dataSAT (TO)
f=133
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=165
TT=1800.06
T1=246.02
SAT (TO)
f=177
TT=1800.03
T1=0.28
SAT (TO)
f=177
TT=1800.1
T1=0.29
OPT
f=120
TT=0.245
T1=0.23
OPT
f=120
TT=0.27
T1=0.25
OPT
f=120
TT=0.185
T1=0.17
? (TO)

TT=1800.11

? (TO)

TT=1800.11

?

TT=1799.88

No dataNo data?

TT=1799.81

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_100_10_10.r.opb
OPT
f=12
TT=1.706
T1=0.81
OPT
f=12
TT=12.588
T1=9.09
No dataSAT (TO)
f=13
TT=1800.02
T1=1063.22
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.14

? (TO)

TT=1800.12

? (TO)

TT=1800.09

OPT
f=12
TT=39.867
T1=39.18
SAT (TO)
f=13
TT=1800.01
T1=1164.56
SAT (TO)
f=14
TT=1802.09
T1=777.01
SAT
f=13
TT=1783
T1=721.57
SAT (TO)
f=16
TT=1800.47
T1=4.03
OPT
f=12
TT=12.59
T1=9.11
? (TO)

TT=1803.95

OPT
f=12
TT=4.767
T1=4.75
No dataOPT
f=12
TT=1.706
T1=0.81
SAT (TO)
f=14
TT=1801.2
T1=28.36
SAT
f=13
TT=1789.72
T1=61.51
No dataSAT (TO)
f=13
TT=1800.1
T1=910.01
OPT
f=12
TT=3.549
T1=3.5
SAT (TO)
f=13
TT=1800.02
T1=1800.3
? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=14
TT=1800.48
T1=900.31
No dataNo dataSAT (TO)
f=14
TT=1800.14
T1=900.31
No dataNo dataNo dataSAT (TO)
f=13
TT=1800.1
T1=645.74
SAT (TO)
f=13
TT=1800.05
T1=322.96
SAT (TO)
f=14
TT=1800.07
T1=161.09
OPT
f=12
TT=4.589
T1=4.58
OPT
f=12
TT=4.692
T1=4.68
OPT
f=12
TT=4.843
T1=4.83
? (TO)

TT=1800.01

? (TO)

TT=1800.03

?

TT=1799.89

No dataNo data?

TT=1799.45

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_100_10_15.r.opb
OPT
f=10
TT=0.13
T1=0.11
OPT
f=10
TT=26.78
T1=26.66
No dataSAT (TO)
f=11
TT=1800.03
T1=464.36
? (TO)

TT=1800.11

OPT
f=10
TT=701.63
T1=434.3
? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.07

OPT
f=10
TT=30.291
T1=29.64
SAT (TO)
f=11
TT=1800.03
T1=354.99
SAT (TO)
f=11
TT=1802.07
T1=1350.4
OPT
f=10
TT=1187.53
T1=1173.13
SAT (TO)
f=13
TT=1802.32
T1=29.73
OPT
f=10
TT=27.101
T1=26.98
SAT (TO)
f=12
TT=1800.78
T1=783.99
OPT
f=10
TT=3.723
T1=3.71
No dataOPT
f=10
TT=0.13
T1=0.11
SAT (TO)
f=11
TT=1800.24
T1=185.15
SAT
f=11
TT=1789.74
T1=94.13
No dataSAT (TO)
f=12
TT=1800.93
T1=7.2
OPT
f=10
TT=1.499
T1=0.83
OPT
f=10
TT=1726.5
T1=1726.76
? (TO)

TT=1800.03

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=12
TT=1800.39
T1=900.31
No dataNo dataSAT (TO)
f=12
TT=1800.03
T1=900.21
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.08
T1=4.17
SAT (TO)
f=11
TT=1800.01
T1=1409.74
SAT (TO)
f=12
TT=1800.02
T1=79.14
OPT
f=10
TT=1.595
T1=0.88
OPT
f=10
TT=1.503
T1=0.83
OPT
f=10
TT=1.492
T1=0.83
? (TO)

TT=1800.02

? (TO)

TT=1800.03

?

TT=1799.81

No dataNo data?

TT=1799.53

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_100_10_30.r.opb
OPT
f=8
TT=0.075
T1=0.08
OPT
f=8
TT=1.394
T1=1
No dataOPT
f=8
TT=1691.74
T1=74.87
OPT
f=8
TT=53.368
T1=45.7
OPT
f=8
TT=73.667
T1=73.68
OPT
f=8
TT=47.958
T1=31.01
OPT
f=8
TT=103.512
T1=103.53
OPT
f=8
TT=34.395
T1=16.19
OPT
f=8
TT=55.549
T1=38.75
OPT
f=8
TT=35.12
T1=16.53
OPT
f=8
TT=52.992
T1=37.31
OPT
f=8
TT=0.591
T1=0.39
OPT
f=8
TT=142.448
T1=118.67
SAT (TO)
f=9
TT=1802.12
T1=1.24
OPT
f=8
TT=34.399
T1=29.52
SAT (TO)
f=10
TT=1800.07
T1=31.12
OPT
f=8
TT=1.482
T1=1.07
SAT (TO)
f=9
TT=1800.25
T1=985.9
OPT
f=8
TT=0.646
T1=0.26
No dataOPT
f=8
TT=0.075
T1=0.08
SAT (TO)
f=9
TT=1800.09
T1=42.57
SAT
f=8
TT=1789.73
T1=886.07
No dataSAT (TO)
f=9
TT=1801.29
T1=9.21
OPT
f=8
TT=0.577
T1=0.22
OPT
f=8
TT=103.565
T1=103.57
OPT
f=8
TT=22.142
T1=13.63
OPT
f=8
TT=27.815
T1=19.31
No dataNo dataNo dataOPT
f=8
TT=292.71
T1=146.47
No dataNo dataOPT
f=8
TT=261.91
T1=131.09
No dataNo dataNo dataSAT (TO)
f=9
TT=1800.03
T1=12.68
SAT (TO)
f=9
TT=1800.08
T1=6.25
SAT (TO)
f=9
TT=1800.43
T1=9.24
OPT
f=8
TT=0.577
T1=0.22
OPT
f=8
TT=0.57
T1=0.22
OPT
f=8
TT=0.559
T1=0.21
? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1799.54

No dataNo data?

TT=1799.8

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_100_30_30.r.opb
OPT
f=5
TT=0.4
T1=0.26
OPT
f=5
TT=42.969
T1=41.82
No dataOPT
f=5
TT=77.937
T1=72.12
OPT
f=5
TT=78.798
T1=78.81
OPT
f=5
TT=4.541
T1=4.98
OPT
f=5
TT=9.352
T1=9.35
OPT
f=5
TT=11.056
T1=11.05
OPT
f=5
TT=38.75
T1=29.97
OPT
f=5
TT=108.124
T1=103.38
OPT
f=5
TT=37.296
T1=28.79
OPT
f=5
TT=107.64
T1=103.21
OPT
f=5
TT=29.135
T1=28.89
OPT
f=5
TT=99.037
T1=92.5
OPT
f=5
TT=126.985
T1=98.06
OPT
f=5
TT=22.326
T1=21.27
SAT (TO)
f=6
TT=1801.53
T1=0.26
OPT
f=5
TT=42.418
T1=41.28
SAT (TO)
f=6
TT=1802.26
T1=1.61
OPT
f=5
TT=1.702
T1=0.99
No dataOPT
f=5
TT=0.4
T1=0.26
OPT
f=5
TT=455.576
T1=166.38
OPT
f=5
TT=125.832
T1=15.68
No dataOPT
f=5
TT=1009.59
T1=534.21
OPT
f=5
TT=1.666
T1=0.96
OPT
f=5
TT=56.214
T1=56.22
OPT
f=5
TT=8.202
T1=3.93
OPT
f=5
TT=8.078
T1=3.81
No dataNo dataNo dataSAT (TO)
f=6
TT=1800.02
T1=900.21
No dataNo dataSAT (TO)
f=6
TT=1800.02
T1=900.21
No dataNo dataNo dataOPT
f=5
TT=356.969
T1=123.71
OPT
f=5
TT=38.55
T1=2.47
OPT
f=5
TT=586.408
T1=539.91
OPT
f=5
TT=1.854
T1=1.03
OPT
f=5
TT=1.748
T1=0.96
OPT
f=5
TT=1.741
T1=0.96
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.5

No dataNo data?

TT=1799.86

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_100_50_50.r.opb
OPT
f=4
TT=0.735
T1=0
OPT
f=4
TT=11.144
T1=0.5
No dataOPT
f=4
TT=1.025
T1=0
OPT
f=4
TT=2.366
T1=0.23
OPT
f=4
TT=1.618
T1=1.61
OPT
f=4
TT=3.248
T1=0.18
OPT
f=4
TT=1.547
T1=1.64
OPT
f=4
TT=3.566
T1=0.53
OPT
f=4
TT=2.551
T1=0.03
OPT
f=4
TT=3.544
T1=0.53
OPT
f=4
TT=2.689
T1=0.03
OPT
f=4
TT=6.619
T1=0.65
OPT
f=4
TT=2.087
T1=0.03
OPT
f=4
TT=5.581
T1=0.08
OPT
f=4
TT=0.832
T1=0.02
OPT
f=4
TT=15.066
T1=0.37
OPT
f=4
TT=10.985
T1=0.5
OPT
f=4
TT=28.05
T1=0.34
OPT
f=4
TT=8.83
T1=0.51
No dataOPT
f=4
TT=0.735
T1=0.35
OPT
f=4
TT=78.243
T1=3.24
OPT
f=4
TT=9.289
T1=0.42
No dataOPT
f=4
TT=47.946
T1=1.73
OPT
f=4
TT=7.177
T1=0.53
OPT
f=4
TT=1.248
T1=1.24
OPT
f=4
TT=2.361
T1=0.21
OPT
f=4
TT=2.688
T1=0.53
No dataNo dataNo dataOPT
f=4
TT=22.311
T1=11.18
No dataNo dataOPT
f=4
TT=22.581
T1=11.31
No dataNo dataNo dataOPT
f=4
TT=15.412
T1=1.73
OPT
f=4
TT=4.384
T1=0.28
OPT
f=4
TT=8.236
T1=0.28
OPT
f=4
TT=7.753
T1=0.55
OPT
f=4
TT=7.704
T1=0.54
OPT
f=4
TT=7.77
T1=0.55
OPT
f=4
TT=19.641
T1=0.02
OPT
f=4
TT=20.295
T1=0.03
OPT
f=4
TT=95.674
T1=95.68
No dataNo dataOPT
f=4
TT=95.33
T1=95.43
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_100_70_70.r.opb
OPT
f=3
TT=0.038
T1=0
OPT
f=3
TT=0.671
T1=0.02
No dataOPT
f=3
TT=0.038
T1=0
OPT
f=3
TT=0.582
T1=0.13
OPT
f=3
TT=0.335
T1=0.03
OPT
f=3
TT=0.555
T1=0.11
OPT
f=3
TT=0.322
T1=0.03
OPT
f=3
TT=0.607
T1=0.11
OPT
f=3
TT=0.315
T1=0.03
OPT
f=3
TT=0.582
T1=0.11
OPT
f=3
TT=0.313
T1=0.03
OPT
f=3
TT=0.784
T1=0.03
OPT
f=3
TT=0.271
T1=0.03
OPT
f=3
TT=0.182
T1=0.07
Signal

TT=0.049

OPT
f=3
TT=1.194
T1=0.25
OPT
f=3
TT=0.678
T1=0.02
OPT
f=3
TT=1.267
T1=0.24
OPT
f=3
TT=1.142
T1=0.41
No dataOPT
f=3
TT=0.211
T1=0.19
OPT
f=3
TT=2.996
T1=1.24
OPT
f=3
TT=0.689
T1=0.35
No dataOPT
f=3
TT=3.275
T1=0.78
OPT
f=3
TT=1.127
T1=0.4
OPT
f=3
TT=0.139
T1=0.13
OPT
f=3
TT=0.841
T1=0.84
OPT
f=3
TT=0.835
T1=0.4
No dataNo dataNo dataOPT
f=3
TT=0.826
T1=0.4
No dataNo dataOPT
f=3
TT=0.836
T1=0.41
No dataNo dataNo dataOPT
f=3
TT=2.473
T1=0.76
OPT
f=3
TT=1.024
T1=0.25
OPT
f=3
TT=0.984
T1=0.25
OPT
f=3
TT=1.245
T1=0.45
OPT
f=3
TT=1.252
T1=0.45
OPT
f=3
TT=1.263
T1=0.45
OPT
f=3
TT=2.139
T1=0.03
OPT
f=3
TT=2.107
T1=0.03
OPT
f=3
TT=2.377
T1=2.37
No dataNo dataOPT
f=3
TT=2.366
T1=2.37
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_300_10_15.r.opb
OPT
f=19
TT=5.299
T1=0.66
OPT
f=19
TT=127.244
T1=26.43
No dataSAT (TO)
f=25
TT=1800.02
T1=158.18
? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.06

OPT
f=19
TT=31.465
T1=2.55
SAT (TO)
f=22
TT=1800.02
T1=1608.27
SAT (TO)
f=30
TT=1802.1
T1=1079.19
SAT
f=30
TT=1783.01
T1=906.44
SAT (TO)
f=34
TT=1800.11
T1=0.19
OPT
f=19
TT=127.117
T1=26.23
SAT (TO)
f=34
TT=1800.3
T1=0.17
OPT
f=19
TT=7.515
T1=0.77
No dataOPT
f=19
TT=5.299
T1=1.85
SAT (TO)
f=24
TT=1800.17
T1=44.49
SAT
f=20
TT=1789.73
T1=0.71
No dataSAT (TO)
f=26
TT=1800.05
T1=7.7
OPT
f=19
TT=6.683
T1=0.66
SAT (TO)
f=23
TT=1800.09
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=25
TT=1800.09
T1=900.31
No dataNo dataSAT (TO)
f=25
TT=1800.44
T1=900.31
No dataNo dataNo dataSAT (TO)
f=23
TT=1800.42
T1=907.74
SAT (TO)
f=27
TT=1800.06
T1=169.09
SAT (TO)
f=33
TT=1800.05
T1=0.2
OPT
f=19
TT=6.902
T1=0.73
OPT
f=19
TT=6.709
T1=0.68
OPT
f=19
TT=7.056
T1=0.74
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.55

No dataNo data?

TT=1799.37

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_50_20_20.r.opb
OPT
f=5
TT=0.331
T1=0
OPT
f=5
TT=1.332
T1=0.09
No dataOPT
f=5
TT=0.622
T1=0
OPT
f=5
TT=1.094
T1=0.12
OPT
f=5
TT=0.698
T1=0.08
OPT
f=5
TT=0.723
T1=0.11
OPT
f=5
TT=0.65
T1=0.05
OPT
f=5
TT=0.662
T1=0.05
OPT
f=5
TT=0.438
T1=0.03
OPT
f=5
TT=0.662
T1=0.05
OPT
f=5
TT=0.459
T1=0.03
OPT
f=5
TT=1.326
T1=0.13
OPT
f=5
TT=0.931
T1=0.01
OPT
f=5
TT=1.375
T1=0.05
OPT
f=5
TT=0.46
T1=0
OPT
f=5
TT=5.184
T1=0.21
OPT
f=5
TT=1.345
T1=0.09
OPT
f=5
TT=7.115
T1=0.36
OPT
f=5
TT=2.702
T1=0.46
No dataOPT
f=5
TT=0.331
T1=0.16
OPT
f=5
TT=15.391
T1=3.17
OPT
f=5
TT=4.33
T1=0.03
No dataOPT
f=5
TT=14.691
T1=1.69
OPT
f=5
TT=2.624
T1=0.03
OPT
f=5
TT=0.605
T1=0.61
OPT
f=5
TT=0.806
T1=0.8
OPT
f=5
TT=0.797
T1=0.04
No dataNo dataNo dataOPT
f=5
TT=4.302
T1=2.15
No dataNo dataOPT
f=5
TT=4.502
T1=2.24
No dataNo dataNo dataOPT
f=5
TT=7.884
T1=1.7
OPT
f=5
TT=2.793
T1=0.24
OPT
f=5
TT=4.432
T1=0.27
OPT
f=5
TT=2.596
T1=0.05
OPT
f=5
TT=2.456
T1=0.04
OPT
f=5
TT=2.5
T1=0.04
OPT
f=5
TT=8.785
T1=0.09
OPT
f=5
TT=8.726
T1=0.09
OPT
f=5
TT=155.04
T1=155.13
No dataNo dataOPT
f=5
TT=157.42
T1=157.57
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_50_30_30.r.opb
OPT
f=3
TT=0.014
T1=0
OPT
f=3
TT=0.263
T1=0.11
No dataOPT
f=3
TT=0.014
T1=0
OPT
f=3
TT=0.155
T1=0.15
OPT
f=3
TT=0.091
T1=0.09
OPT
f=3
TT=0.127
T1=0.12
OPT
f=3
TT=0.065
T1=0.06
OPT
f=3
TT=0.108
T1=0.06
OPT
f=3
TT=0.066
T1=0.05
OPT
f=3
TT=0.106
T1=0.06
OPT
f=3
TT=0.064
T1=0.04
OPT
f=3
TT=0.215
T1=0.08
OPT
f=3
TT=0.037
T1=0.02
OPT
f=3
TT=0.071
T1=0.05
OPT
f=3
TT=0.02
T1=0.01
OPT
f=3
TT=0.623
T1=0.23
OPT
f=3
TT=0.265
T1=0.11
OPT
f=3
TT=0.635
T1=0.21
OPT
f=3
TT=0.564
T1=0.47
No dataOPT
f=3
TT=0.103
T1=0.09
OPT
f=3
TT=1.214
T1=2.19
OPT
f=3
TT=0.506
T1=0.42
No dataOPT
f=3
TT=1.113
T1=1.21
OPT
f=3
TT=0.361
T1=0.28
OPT
f=3
TT=0.016
T1=0.01
OPT
f=3
TT=0.132
T1=0.08
OPT
f=3
TT=0.196
T1=0.15
No dataNo dataNo dataOPT
f=3
TT=0.063
T1=0.02
No dataNo dataOPT
f=3
TT=0.063
T1=0.03
No dataNo dataNo dataOPT
f=3
TT=1.063
T1=1.21
OPT
f=3
TT=0.585
T1=0.25
OPT
f=3
TT=0.622
T1=0.22
OPT
f=3
TT=0.776
T1=0.68
OPT
f=3
TT=0.77
T1=0.68
OPT
f=3
TT=0.775
T1=0.68
OPT
f=3
TT=0.251
T1=0.16
OPT
f=3
TT=0.241
T1=0.16
OPT
f=3
TT=0.152
T1=0.15
No dataNo dataOPT
f=3
TT=0.154
T1=0.15
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m100_50_40_40.r.opb
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.07
T1=0.06
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.124
T1=0.1
OPT
f=2
TT=0.056
T1=0.05
OPT
f=2
TT=0.075
T1=0.06
OPT
f=2
TT=0.031
T1=0.03
OPT
f=2
TT=0.082
T1=0.07
OPT
f=2
TT=0.034
T1=0.03
OPT
f=2
TT=0.075
T1=0.07
OPT
f=2
TT=0.032
T1=0.03
OPT
f=2
TT=0.104
T1=0.1
OPT
f=2
TT=0.026
T1=0.02
OPT
f=2
TT=0.068
T1=0.05
OPT
f=2
TT=0.01
T1=0.01
OPT
f=2
TT=0.384
T1=0.23
OPT
f=2
TT=0.072
T1=0.06
OPT
f=2
TT=0.404
T1=0.24
OPT
f=2
TT=0.565
T1=0.56
No dataOPT
f=2
TT=0.037
T1=0.03
OPT
f=2
TT=0.485
T1=2.25
OPT
f=2
TT=0.223
T1=0.22
No dataOPT
f=2
TT=0.554
T1=1.24
OPT
f=2
TT=0.507
T1=0.5
OPT
f=2
TT=0.008
T1=0
OPT
f=2
TT=0.082
T1=0.07
OPT
f=2
TT=0.109
T1=0.1
No dataNo dataNo dataOPT
f=2
TT=0.004
T1=0
No dataNo dataOPT
f=2
TT=0.004
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.516
T1=1.22
OPT
f=2
TT=0.354
T1=0.21
OPT
f=2
TT=0.364
T1=0.21
OPT
f=2
TT=0.595
T1=0.59
OPT
f=2
TT=0.584
T1=0.58
OPT
f=2
TT=0.602
T1=0.59
OPT
f=2
TT=0.025
T1=0.02
OPT
f=2
TT=0.026
T1=0.02
OPT
f=2
TT=0.003
T1=0
No dataNo dataOPT
f=2
TT=0.004
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-m4.r.opb
OPT
f=90
TT=0.143
T1=0.14
OPT
f=90
TT=0.329
T1=0.29
No dataSAT (TO)
f=111
TT=1800.11
T1=515.5
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.04

OPT
f=90
TT=0.106
T1=0.04
SAT (TO)
f=101
TT=1800.07
T1=412.17
SAT (TO)
f=117
TT=1802.11
T1=0.15
SAT
f=113
TT=1783
T1=28.14
SAT (TO)
f=115
TT=1800.56
T1=0.3
OPT
f=90
TT=0.325
T1=0.28
SAT (TO)
f=115
TT=1800.3
T1=0.33
OPT
f=90
TT=0.46
T1=0.45
No dataOPT
f=90
TT=0.143
T1=0.14
SAT (TO)
f=104
TT=1800.07
T1=448.76
OPT
f=90
TT=7.147
T1=7.14
No dataSAT (TO)
f=104
TT=1800.68
T1=852.22
OPT
f=90
TT=1.044
T1=1.02
SAT (TO)
f=102
TT=1800.09
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=98
TT=1800.05
T1=900.31
No dataNo dataSAT (TO)
f=98
TT=1800.49
T1=900.31
No dataNo dataNo dataSAT (TO)
f=103
TT=1800.05
T1=949.4
SAT (TO)
f=115
TT=1800.73
T1=0.29
SAT (TO)
f=116
TT=1800.02
T1=0.29
OPT
f=90
TT=0.586
T1=0.57
OPT
f=90
TT=0.554
T1=0.53
OPT
f=90
TT=0.594
T1=0.58
? (TO)

TT=1800.04

? (TO)

TT=1800.07

?

TT=1799.44

No dataNo data?

TT=1799.45

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m50_100_10_10.r.opb
OPT
f=8
TT=0.019
T1=0.01
OPT
f=8
TT=0.037
T1=0.03
No dataOPT
f=8
TT=604.501
T1=83.53
OPT
f=8
TT=2.748
T1=2.05
OPT
f=8
TT=3.305
T1=2.61
OPT
f=8
TT=2.357
T1=2.01
OPT
f=8
TT=2.209
T1=1.77
OPT
f=8
TT=12.287
T1=12.26
OPT
f=8
TT=5.321
T1=5.58
OPT
f=8
TT=12.257
T1=12.23
OPT
f=8
TT=5.571
T1=5.55
OPT
f=8
TT=0.02
T1=0.02
OPT
f=8
TT=12.776
T1=11.8
OPT
f=8
TT=325.639
T1=79.12
OPT
f=8
TT=19.053
T1=18.95
SAT (TO)
f=10
TT=1800.03
T1=51.98
OPT
f=8
TT=0.037
T1=0.03
SAT (TO)
f=9
TT=1800.33
T1=34.32
OPT
f=8
TT=0.102
T1=0.09
No dataOPT
f=8
TT=0.019
T1=0.01
SAT (TO)
f=8
TT=1800.2
T1=94.26
OPT
f=8
TT=0.162
T1=0.15
No dataOPT
f=8
TT=267.402
T1=4.14
OPT
f=8
TT=0.11
T1=0.1
OPT
f=8
TT=11.101
T1=11.1
OPT
f=8
TT=3.621
T1=3.14
OPT
f=8
TT=4.149
T1=3.62
No dataNo dataNo dataOPT
f=8
TT=68.49
T1=34.29
No dataNo dataOPT
f=8
TT=72.39
T1=36.23
No dataNo dataNo dataOPT
f=8
TT=242.197
T1=4.15
OPT
f=8
TT=680.6
T1=243.57
OPT
f=8
TT=1648.93
T1=962.34
OPT
f=8
TT=0.102
T1=0.09
OPT
f=8
TT=0.107
T1=0.09
OPT
f=8
TT=0.106
T1=0.09
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.91

No dataNo data?

TT=1799.48

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m50_100_70_70.r.opb
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.16
T1=0.15
No dataOPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.124
T1=0.1
OPT
f=2
TT=0.065
T1=0.05
OPT
f=2
TT=0.079
T1=0.06
OPT
f=2
TT=0.039
T1=0.03
OPT
f=2
TT=0.073
T1=0.06
OPT
f=2
TT=0.041
T1=0.03
OPT
f=2
TT=0.074
T1=0.06
OPT
f=2
TT=0.04
T1=0.03
OPT
f=2
TT=0.319
T1=0.32
OPT
f=2
TT=0.041
T1=0.03
OPT
f=2
TT=0.066
T1=0.05
OPT
f=2
TT=0.011
T1=0.01
OPT
f=2
TT=0.584
T1=0.23
OPT
f=2
TT=0.162
T1=0.15
OPT
f=2
TT=0.593
T1=0.24
OPT
f=2
TT=0.028
T1=0.02
No dataOPT
f=2
TT=0.039
T1=0.03
OPT
f=2
TT=0.754
T1=3.2
OPT
f=2
TT=0.044
T1=0.04
No dataOPT
f=2
TT=0.754
T1=1.74
OPT
f=2
TT=0.058
T1=0.04
OPT
f=2
TT=0.01
T1=0.01
OPT
f=2
TT=0.086
T1=0.07
OPT
f=2
TT=0.273
T1=0.14
No dataNo dataNo dataOPT
f=2
TT=0.003
T1=0.01
No dataNo dataOPT
f=2
TT=0.003
T1=0.01
No dataNo dataNo dataOPT
f=2
TT=0.696
T1=1.71
OPT
f=2
TT=0.473
T1=0.22
OPT
f=2
TT=0.543
T1=0.25
OPT
f=2
TT=0.055
T1=0.04
OPT
f=2
TT=0.058
T1=0.05
OPT
f=2
TT=0.055
T1=0.04
OPT
f=2
TT=0.055
T1=0.02
OPT
f=2
TT=0.055
T1=0.02
OPT
f=2
TT=0.033
T1=0.03
No dataNo dataOPT
f=2
TT=0.045
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-m50_100_90_90.r.opb
OPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.039
T1=0.04
No dataOPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.137
T1=0.11
OPT
f=2
TT=0.051
T1=0.03
OPT
f=2
TT=0.088
T1=0.07
OPT
f=2
TT=0.037
T1=0.03
OPT
f=2
TT=0.08
T1=0.07
OPT
f=2
TT=0.036
T1=0.02
OPT
f=2
TT=0.083
T1=0.07
OPT
f=2
TT=0.055
T1=0.02
OPT
f=2
TT=0.04
T1=0.04
OPT
f=2
TT=0.033
T1=0.02
OPT
f=2
TT=0.063
T1=0.05
OPT
f=2
TT=0.012
T1=0.01
OPT
f=2
TT=0.552
T1=0.23
OPT
f=2
TT=0.04
T1=0.03
OPT
f=2
TT=0.527
T1=0.23
OPT
f=2
TT=0.032
T1=0.02
No dataOPT
f=2
TT=0.057
T1=0.05
OPT
f=2
TT=0.633
T1=1.23
OPT
f=2
TT=0.035
T1=0.03
No dataOPT
f=2
TT=0.646
T1=0.76
OPT
f=2
TT=0.039
T1=0.03
OPT
f=2
TT=0.007
T1=0
OPT
f=2
TT=0.094
T1=0.07
OPT
f=2
TT=0.093
T1=0.07
No dataNo dataNo dataOPT
f=2
TT=0.004
T1=0
No dataNo dataOPT
f=2
TT=0.004
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.614
T1=0.72
OPT
f=2
TT=0.484
T1=0.23
OPT
f=2
TT=0.514
T1=0.23
OPT
f=2
TT=0.034
T1=0.03
OPT
f=2
TT=0.042
T1=0.03
OPT
f=2
TT=0.036
T1=0.03
OPT
f=2
TT=0.043
T1=0.02
OPT
f=2
TT=0.043
T1=0.02
OPT
f=2
TT=0.024
T1=0.01
No dataNo dataOPT
f=2
TT=0.024
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-maincont.r.opb
OPT
f=7
TT=0.003
T1=0.01
OPT
f=7
TT=0.055
T1=0.02
No dataOPT
f=7
TT=4.748
T1=0.14
OPT
f=7
TT=0.122
T1=0.09
OPT
f=7
TT=0.075
T1=0.06
OPT
f=7
TT=0.069
T1=0.06
OPT
f=7
TT=0.042
T1=0.03
OPT
f=7
TT=0.078
T1=0.06
OPT
f=7
TT=0.051
T1=0.03
OPT
f=7
TT=0.07
T1=0.06
OPT
f=7
TT=0.046
T1=0.03
OPT
f=7
TT=0.026
T1=0.02
OPT
f=7
TT=0.064
T1=0.04
OPT
f=7
TT=4.206
T1=0.18
OPT
f=7
TT=0.012
T1=0.01
OPT
f=7
TT=21.45
T1=0.59
OPT
f=7
TT=0.058
T1=0.02
OPT
f=7
TT=21.843
T1=0.39
OPT
f=7
TT=0.048
T1=0.04
No dataOPT
f=7
TT=0.015
T1=0.01
OPT
f=7
TT=1.056
T1=3.19
OPT
f=7
TT=0.068
T1=0.06
No dataOPT
f=7
TT=0.879
T1=1.72
OPT
f=7
TT=0.065
T1=0.05
OPT
f=7
TT=0.034
T1=0.03
OPT
f=7
TT=0.075
T1=0.05
OPT
f=7
TT=0.081
T1=0.06
No dataNo dataNo dataOPT
f=7
TT=0.043
T1=0.01
No dataNo dataOPT
f=7
TT=0.044
T1=0.01
No dataNo dataNo dataOPT
f=7
TT=0.904
T1=1.68
OPT
f=7
TT=9.254
T1=0.82
OPT
f=7
TT=17.891
T1=0.58
OPT
f=7
TT=0.067
T1=0.05
OPT
f=7
TT=0.07
T1=0.06
OPT
f=7
TT=0.063
T1=0.05
OPT
f=7
TT=14.331
T1=2.33
OPT
f=7
TT=14.121
T1=2.29
OPT
f=7
TT=0.003
T1=0.01
No dataNo dataOPT
f=7
TT=0.003
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-max1024.r.opb
OPT
f=245
TT=1.644
T1=1.01
SAT
f=250
TT=1798.01
T1=1257.16
No dataSAT (TO)
f=291
TT=1800.11
T1=1395.46
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.07

OPT
f=245
TT=96.802
T1=83.73
SAT (TO)
f=282
TT=1800.01
T1=706.88
SAT (TO)
f=294
TT=1800.13
T1=0.37
SAT
f=292
TT=1783
T1=1428.8
? (exit code)

TT=822.11

SAT
f=250
TT=1798.02
T1=1256.44
SAT (TO)
f=303
TT=1800.6
T1=0.29
OPT
f=245
TT=21.902
T1=21.89
No dataOPT
f=245
TT=1.644
T1=1.01
SAT (TO)
f=290
TT=1800.51
T1=682.11
OPT
f=245
TT=25.936
T1=25.93
No dataSAT (TO)
f=288
TT=1800.17
T1=937.68
OPT
f=245
TT=17.509
T1=17.47
SAT (TO)
f=281
TT=1800.1
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=276
TT=1800.47
T1=900.31
No dataNo dataSAT (TO)
f=276
TT=1800.12
T1=900.31
No dataNo dataNo dataSAT (TO)
f=283
TT=1800.04
T1=527.95
SAT (TO)
f=303
TT=1800.05
T1=0.29
SAT (TO)
f=303
TT=1800.67
T1=0.28
OPT
f=245
TT=13.061
T1=13.05
OPT
f=245
TT=12.071
T1=12.05
OPT
f=245
TT=13.201
T1=13.18
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.45

No dataNo data?

TT=1799.51

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-opus.r.opb
OPT
f=5
TT=0.002
T1=0
OPT
f=5
TT=0.01
T1=0.01
No dataOPT
f=5
TT=0.054
T1=0.01
OPT
f=5
TT=0.091
T1=0.08
OPT
f=5
TT=0.066
T1=0.05
OPT
f=5
TT=0.042
T1=0.04
OPT
f=5
TT=0.03
T1=0.03
OPT
f=5
TT=0.041
T1=0.04
OPT
f=5
TT=0.03
T1=0.02
OPT
f=5
TT=0.04
T1=0.03
OPT
f=5
TT=0.027
T1=0.02
OPT
f=5
TT=0.013
T1=0.01
OPT
f=5
TT=0.039
T1=0.01
OPT
f=5
TT=0.088
T1=0.07
OPT
f=5
TT=0.011
T1=0
OPT
f=5
TT=0.483
T1=0.16
OPT
f=5
TT=0.01
T1=0.01
OPT
f=5
TT=0.616
T1=0.19
OPT
f=5
TT=0.036
T1=0.03
No dataOPT
f=5
TT=0.015
T1=0.01
OPT
f=5
TT=0.324
T1=2.15
OPT
f=5
TT=0.015
T1=0.01
No dataOPT
f=5
TT=0.363
T1=1.17
OPT
f=5
TT=0.02
T1=0.01
OPT
f=5
TT=0.025
T1=0.02
OPT
f=5
TT=0.056
T1=0.03
OPT
f=5
TT=0.108
T1=0.04
No dataNo dataNo dataOPT
f=5
TT=0.003
T1=0
No dataNo dataOPT
f=5
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=5
TT=0.334
T1=1.16
OPT
f=5
TT=0.515
T1=0.16
OPT
f=5
TT=0.604
T1=0.16
OPT
f=5
TT=0.015
T1=0.01
OPT
f=5
TT=0.017
T1=0.01
OPT
f=5
TT=0.018
T1=0.01
OPT
f=5
TT=0.166
T1=0
OPT
f=5
TT=0.163
T1=0
OPT
f=5
TT=0.023
T1=0.02
No dataNo dataOPT
f=5
TT=0.023
T1=0.02
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-prom2.r.opb
OPT
f=278
TT=0.665
T1=0.65
OPT
f=278
TT=732.022
T1=728.75
No dataSAT (TO)
f=428
TT=1800.11
T1=0
? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.15

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.08

OPT
f=278
TT=1.804
T1=1.64
SAT (TO)
f=438
TT=1800.11
T1=0.08
SAT (TO)
f=454
TT=1802.1
T1=0.78
SAT
f=452
TT=1783
T1=0.16
? (exit code)

TT=565.23

OPT
f=278
TT=734.559
T1=731.27
SAT (TO)
f=439
TT=1800
T1=0.42
OPT
f=278
TT=1.769
T1=1.75
No dataOPT
f=278
TT=0.923
T1=0.91
SAT (TO)
f=415
TT=1800.54
T1=627.55
OPT
f=278
TT=0.665
T1=0.65
No dataSAT (TO)
f=414
TT=1800.03
T1=915.28
OPT
f=278
TT=1.799
T1=1.8
SAT (TO)
f=438
TT=1800.07
T1=1800.5
? (TO)

TT=1800.14

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=324
TT=1800.02
T1=900.31
No dataNo dataSAT (TO)
f=324
TT=1800.18
T1=900.41
No dataNo dataNo dataSAT (TO)
f=430
TT=1801.98
T1=666.93
SAT (TO)
f=439
TT=1800.81
T1=0.33
SAT (TO)
f=439
TT=1800
T1=0.33
OPT
f=278
TT=1.508
T1=1.49
OPT
f=278
TT=1.511
T1=1.49
OPT
f=278
TT=1.549
T1=1.53
? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo data?

TT=1799.27

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/
logic_synthesis/normalized-rd84.b.opb
OPT
f=5
TT=5.707
T1=5.7
SAT
f=7
TT=1798.01
T1=5.94
No dataOPT
f=5
TT=163.644
T1=161.57
OPT
f=5
TT=52.807
T1=44.06
OPT
f=5
TT=11.638
T1=11.63
OPT
f=5
TT=57.931
T1=53.15
OPT
f=5
TT=7.794
T1=7.79
OPT
f=5
TT=79.085
T1=77.64
OPT
f=5
TT=10.219
T1=10.39
OPT
f=5
TT=76.721
T1=75.31
OPT
f=5
TT=10.714
T1=10.68
OPT
f=5
TT=21.566
T1=21.32
OPT
f=5
TT=11.206
T1=10.65
SAT (TO)
f=6
TT=1802.12
T1=16.81
OPT
f=5
TT=36.034
T1=35.47
SAT (TO)
f=6
TT=1800.07
T1=472.53
OPT
f=5
TT=1396.21
T1=1396.23
SAT (TO)
f=6
TT=1800.48
T1=669.24
OPT
f=5
TT=32.577
T1=32.53
No dataOPT
f=5
TT=26.207
T1=13.45
OPT
f=5
TT=1634.54
T1=252.14
OPT
f=5
TT=1408.83
T1=1409.02
No dataSAT (TO)
f=5
TT=1800.02
T1=300.11
OPT
f=5
TT=39.659
T1=39.6
OPT
f=5
TT=5.707
T1=5.7
OPT
f=5
TT=82.618
T1=75.37
OPT
f=5
TT=96.7
T1=90.19
No dataNo dataNo dataOPT
f=5
TT=38.362
T1=19.25
No dataNo dataOPT
f=5
TT=38.564
T1=19.35
No dataNo dataNo dataOPT
f=5
TT=200.413
T1=54.6
OPT
f=5
TT=812.341
T1=725.31
SAT (TO)
f=6
TT=1800.49
T1=292.79
OPT
f=5
TT=44.183
T1=44.13
OPT
f=5
TT=43.228
T1=43.16
OPT
f=5
TT=43.967
T1=43.91
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=5
TT=60.219
T1=60.25
No dataNo dataOPT
f=5
TT=61.76
T1=61.82
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-ricks.r.opb
OPT
f=5
TT=0.302
T1=0.3
OPT
f=5
TT=0.374
T1=0.37
No dataOPT
f=5
TT=28.391
T1=1.68
OPT
f=5
TT=1.051
T1=0.96
OPT
f=5
TT=1.236
T1=1.14
OPT
f=5
TT=1.027
T1=0.94
OPT
f=5
TT=1.341
T1=1.13
OPT
f=5
TT=0.94
T1=0.85
OPT
f=5
TT=1.843
T1=1.75
OPT
f=5
TT=0.951
T1=0.86
OPT
f=5
TT=1.876
T1=1.77
OPT
f=5
TT=0.271
T1=0.27
OPT
f=5
TT=12.471
T1=0.56
OPT
f=5
TT=403.263
T1=143.24
OPT
f=5
TT=0.382
T1=0.38
OPT
f=5
TT=18.96
T1=4.67
OPT
f=5
TT=0.375
T1=0.37
OPT
f=5
TT=57.87
T1=24.01
OPT
f=5
TT=2.639
T1=2.63
No dataOPT
f=5
TT=0.302
T1=0.3
OPT
f=5
TT=5.204
T1=3.28
OPT
f=5
TT=0.765
T1=0.76
No dataOPT
f=5
TT=2.296
T1=1.8
OPT
f=5
TT=0.449
T1=0.44
OPT
f=5
TT=8.398
T1=8.39
OPT
f=5
TT=1.102
T1=0.97
OPT
f=5
TT=1.045
T1=0.92
No dataNo dataNo dataOPT
f=5
TT=6.529
T1=3.27
No dataNo dataOPT
f=5
TT=6.589
T1=3.29
No dataNo dataNo dataOPT
f=5
TT=1.885
T1=1.79
OPT
f=5
TT=40.898
T1=27.68
OPT
f=5
TT=15.273
T1=2.42
OPT
f=5
TT=1.01
T1=1
OPT
f=5
TT=0.935
T1=0.92
OPT
f=5
TT=0.966
T1=0.96
OPT
f=5
TT=329.433
T1=250.63
OPT
f=5
TT=327.497
T1=249.19
OPT
f=5
TT=98.24
T1=98.32
No dataNo dataOPT
f=5
TT=98.409
T1=98.43
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-saucier.r.opb
OPT
f=6
TT=1593.1
T1=272.08
SAT
f=7
TT=1798.07
T1=1251.46
No dataSAT (TO)
f=7
TT=1800.02
T1=20.13
? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.04

SAT (TO)
f=8
TT=1800.09
T1=245.88
SAT (TO)
f=7
TT=1800.15
T1=74.04
SAT (TO)
f=8
TT=1802.08
T1=70.43
SAT
f=8
TT=1783.22
T1=1125.29
SAT (TO)
f=8
TT=1800.56
T1=426.13
SAT
f=7
TT=1798
T1=540.12
SAT (TO)
f=8
TT=1800.04
T1=1080.91
SAT
f=7
TT=1795.73
T1=1.69
No dataOPT
f=6
TT=1593.1
T1=548.97
SAT (TO)
f=7
TT=1800.15
T1=98.16
SAT
f=6
TT=1789.82
T1=272.08
No dataSAT (TO)
f=7
TT=1800.11
T1=302.77
SAT
f=7
TT=1796.83
T1=1.9
SAT (TO)
f=6
TT=1800.06
T1=1800.71
? (TO)

TT=1800.12

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=7
TT=1800.15
T1=900.51
No dataNo dataSAT (TO)
f=7
TT=1800.61
T1=900.51
No dataNo dataNo dataSAT (TO)
f=6
TT=1800.5
T1=360.03
SAT (TO)
f=10
TT=1800.38
T1=385.82
SAT (TO)
f=9
TT=1800.95
T1=382.95
SAT
f=7
TT=1796.85
T1=2.47
SAT
f=7
TT=1796.84
T1=2.23
SAT
f=7
TT=1796.84
T1=1.83
? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.69

No dataNo data?

TT=1800.2

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/logic_synthesis/
normalized-test1.r.opb
OPT
f=110
TT=0.131
T1=0.12
OPT
f=110
TT=0.756
T1=0.74
No dataSAT (TO)
f=161
TT=1800.11
T1=1078.4
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.48

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.11

OPT
f=110
TT=0.135
T1=0.12
SAT (TO)
f=146
TT=1800.05
T1=0.03
SAT (TO)
f=184
TT=1802.12
T1=226.29
SAT
f=176
TT=1783.01
T1=0.73
SAT (TO)
f=149
TT=1800.04
T1=0.3
OPT
f=110
TT=0.759
T1=0.74
SAT (TO)
f=149
TT=1800.01
T1=0.33
OPT
f=110
TT=0.121
T1=0.11
No dataOPT
f=110
TT=0.471
T1=0.46
SAT (TO)
f=135
TT=1800.19
T1=739
OPT
f=110
TT=0.17
T1=0.16
No dataSAT (TO)
f=135
TT=1800.74
T1=703.18
OPT
f=110
TT=0.131
T1=0.12
SAT (TO)
f=146
TT=1800.03
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=138
TT=1800.03
T1=900.31
No dataNo dataSAT (TO)
f=138
TT=1800.18
T1=900.41
No dataNo dataNo dataSAT (TO)
f=136
TT=1800.06
T1=281.55
SAT (TO)
f=148
TT=1800.02
T1=7.76
SAT (TO)
f=149
TT=1800.08
T1=0.33
OPT
f=110
TT=0.252
T1=0.23
OPT
f=110
TT=0.233
T1=0.21
OPT
f=110
TT=0.235
T1=0.22
? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.34

No dataNo data?

TT=1799.41

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_4_30_1.opb
UNSAT

TT=12.858

UNSAT

TT=189.331

No dataUNSAT

TT=133.517

? (TO)

TT=1800.12

UNSAT

TT=240.129

? (TO)

TT=1800.09

UNSAT

TT=236.03

? (TO)

TT=1800.08

UNSAT

TT=240.74

? (TO)

TT=1800.09

UNSAT

TT=235.33

UNSAT

TT=144.964

UNSAT

TT=669.077

UNSAT

TT=12.858

UNSAT

TT=44.919

UNSAT

TT=115.496

UNSAT

TT=213.954

UNSAT

TT=722.55

UNSAT

TT=258.667

No dataUNSAT

TT=41.53

UNSAT

TT=163.529

UNSAT

TT=278.928

No dataUNSAT

TT=160.103

UNSAT

TT=229.499

UNSAT

TT=425.968

UNSAT

TT=344.647

UNSAT

TT=372.616

No dataNo dataNo data? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.5

No dataNo dataNo dataUNSAT

TT=236.26

UNSAT

TT=55.184

UNSAT

TT=96.09

UNSAT

TT=290.68

UNSAT

TT=340.263

UNSAT

TT=134.091

UNSAT

TT=198.275

UNSAT

TT=196.669

UNSAT

TT=1463.16

No dataNo dataUNSAT

TT=1292.02

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_4_30_2.opb
UNSAT

TT=5.995

UNSAT

TT=79.928

No dataUNSAT

TT=47.182

? (TO)

TT=1800.13

UNSAT

TT=147.262

? (TO)

TT=1800.09

UNSAT

TT=144.84

? (TO)

TT=1800.07

UNSAT

TT=150.14

? (TO)

TT=1800.09

UNSAT

TT=143.33

UNSAT

TT=54.274

UNSAT

TT=1175.5

UNSAT

TT=5.995

UNSAT

TT=33.957

UNSAT

TT=50.895

UNSAT

TT=101.347

UNSAT

TT=314.746

UNSAT

TT=140.145

No dataUNSAT

TT=31.935

UNSAT

TT=89.726

UNSAT

TT=119.871

No dataUNSAT

TT=89.141

UNSAT

TT=95.87

UNSAT

TT=808.904

UNSAT

TT=189.245

UNSAT

TT=179.95

No dataNo dataNo dataUNSAT

TT=604.61

No dataNo dataUNSAT

TT=656.59

No dataNo dataNo dataUNSAT

TT=87.932

UNSAT

TT=26.519

UNSAT

TT=39.387

UNSAT

TT=169.592

UNSAT

TT=178.283

UNSAT

TT=135.633

UNSAT

TT=129.572

UNSAT

TT=128.662

UNSAT

TT=313.11

No dataNo dataUNSAT

TT=324.24

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_4_30_3.opb
UNSAT

TT=25.122

UNSAT

TT=458.295

No dataUNSAT

TT=245.575

? (TO)

TT=1800.13

UNSAT

TT=557.971

? (TO)

TT=1800.09

UNSAT

TT=550.67

? (TO)

TT=1800.09

UNSAT

TT=525.39

? (TO)

TT=1800.09

UNSAT

TT=570.77

UNSAT

TT=333.138

UNSAT

TT=661.827

UNSAT

TT=25.122

UNSAT

TT=70.991

UNSAT

TT=368.25

UNSAT

TT=478.475

? (TO)

TT=1800.81

UNSAT

TT=173.823

No dataUNSAT

TT=30.596

UNSAT

TT=293.288

UNSAT

TT=249.81

No dataUNSAT

TT=271.854

UNSAT

TT=213.656

UNSAT

TT=475.228

UNSAT

TT=643.153

UNSAT

TT=635.666

No dataNo dataNo data? (TO)

TT=1800.37

No dataNo data? (TO)

TT=1800.11

No dataNo dataNo dataUNSAT

TT=534.89

UNSAT

TT=126.8

UNSAT

TT=196.78

UNSAT

TT=142.392

UNSAT

TT=164.13

UNSAT

TT=199.594

UNSAT

TT=313.081

UNSAT

TT=309.749

?

TT=1799.57

No dataNo data?

TT=1799.95

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_4_30_4.opb
UNSAT

TT=7.738

UNSAT

TT=113.465

No dataUNSAT

TT=65.387

? (TO)

TT=1800.12

UNSAT

TT=186.785

? (TO)

TT=1800.08

UNSAT

TT=201.63

? (TO)

TT=1800.1

UNSAT

TT=178.336

? (TO)

TT=1800.1

UNSAT

TT=197.54

UNSAT

TT=62.581

UNSAT

TT=635.637

UNSAT

TT=7.738

UNSAT

TT=22.107

UNSAT

TT=59.395

UNSAT

TT=100.385

UNSAT

TT=504.9

UNSAT

TT=79.358

No dataUNSAT

TT=38.47

UNSAT

TT=102.118

UNSAT

TT=80.173

No dataUNSAT

TT=103.498

UNSAT

TT=65.373

UNSAT

TT=468.801

UNSAT

TT=174.54

UNSAT

TT=174.839

No dataNo dataNo dataUNSAT

TT=970.225

No dataNo dataUNSAT

TT=734.347

No dataNo dataNo dataUNSAT

TT=95.642

UNSAT

TT=30.859

UNSAT

TT=43.207

UNSAT

TT=287.465

UNSAT

TT=327.906

UNSAT

TT=210.686

UNSAT

TT=139.697

UNSAT

TT=139.103

UNSAT

TT=368.04

No dataNo dataUNSAT

TT=349.48

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_5_40_1.opb
OPT
f=0
TT=1307.56
T1=572.66
?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1802.11

? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1798

? (TO)

TT=1800.06

? (TO)

TT=1801.05

No dataOPT
f=0
TT=1307.56
T1=572.66
? (TO)

TT=1800.02

?

TT=1791

No data? (TO)

TT=1800.07

?

TT=1798.36

? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.51

No dataNo data? (TO)

TT=1800.42

No dataNo dataNo data? (TO)

TT=1801.16

? (TO)

TT=1800.58

? (TO)

TT=1800.38

?

TT=1798.27

?

TT=1798.29

?

TT=1798.66

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.44

No dataNo data? (TO)

TT=1800.43

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_5_40_3.opb
OPT
f=0
TT=607.011
T1=607.09
?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.03

OPT
f=0
TT=607.011
T1=607.09
? (TO)

TT=1800.03

? (TO)

TT=1800.55

?

TT=1798

? (TO)

TT=1800.04

OPT
f=0
TT=1284.86
T1=1285.11
No dataOPT
f=0
TT=1729.04
T1=716.52
? (TO)

TT=1800.09

OPT
f=0
TT=721.171
T1=721.4
No data? (TO)

TT=1800.01

?

TT=1798.5

? (TO)

TT=1800.02

? (TO)

TT=1800.13

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.01

No dataNo data? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.06

? (TO)

TT=1800.54

?

TT=1798.15

?

TT=1798.59

?

TT=1797.78

? (TO)

TT=1800.03

? (TO)

TT=1800.04

?

TT=1799.56

No dataNo data? (TO)

TT=1800.08

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_5_40_4.opb




?

TT=1798

No data? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1802.13

? (TO)

TT=1800.01

? (TO)

TT=1800.08

?

TT=1798

? (TO)

TT=1800.09

? (TO)

TT=1801.98

No data? (TO)

TT=1815.98

? (TO)

TT=1800.12

?

TT=1790.9

No data? (TO)

TT=1800.12

?

TT=1798.47

? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.51

No dataNo data? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.7

? (TO)

TT=1800.05

? (TO)

TT=1800.07

?

TT=1798.51

?

TT=1798.86

?

TT=1799.12

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.58

No dataNo data?

TT=1799.58

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_6_50_1.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.55

?

TT=1798

? (TO)

TT=1800.63

? (TO)

TT=1802.1

No data? (TO)

TT=1813.46

? (TO)

TT=1800.96

?

TT=1792.35

No data? (TO)

TT=1800.2

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.17

No dataNo data? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.81

? (TO)

TT=1800.68

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.76

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_6_50_3.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1802.03

? (TO)

TT=1800.03

? (TO)

TT=1800.04

?

TT=1798

? (TO)

TT=1800.23

? (TO)

TT=1802.12

No data? (TO)

TT=1802.7

? (TO)

TT=1800.11

?

TT=1793.77

No data? (TO)

TT=1800.17

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.15

No dataNo data? (TO)

TT=1800.43

No dataNo dataNo data? (TO)

TT=1800.94

? (TO)

TT=1800.04

? (TO)

TT=1800.72

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.57

No dataNo data?

TT=1799.84

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_6_50_4.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.83

?

TT=1798

? (TO)

TT=1800.27

? (TO)

TT=1802.12

No data? (TO)

TT=1841.7

? (TO)

TT=1800.15

?

TT=1794.66

No data? (TO)

TT=1800.2

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.51

No dataNo data? (TO)

TT=1800.51

No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.03

?

TT=1799.6

No dataNo data? (TO)

TT=1800.04

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_7_60_1.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1802.12

? (TO)

TT=1800.03

? (TO)

TT=1800.1

?

TT=1798.01

? (TO)

TT=1800.07

? (TO)

TT=1802.13

No data? (TO)

TT=1815.12

? (TO)

TT=1800.75

?

TT=1795.2

No data? (TO)

TT=1800.02

? (TO)

TT=1800.18

? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.18

No dataNo data? (TO)

TT=1800.56

No dataNo dataNo data? (TO)

TT=1800.65

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.65

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_7_60_2.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1802.03

? (TO)

TT=1800.02

? (TO)

TT=1800.09

?

TT=1798

? (TO)

TT=1800.08

? (TO)

TT=1802.12

No data? (TO)

TT=1806.86

? (TO)

TT=1800.09

?

TT=1795.01

No data? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.01

No dataNo data? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.51

No dataNo data?

TT=1799.86

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_7_60_3.opb




?

TT=1798

No data? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1802.13

? (TO)

TT=1800.03

? (TO)

TT=1800.52

?

TT=1798

? (TO)

TT=1800.93

? (TO)

TT=1802.09

No data? (TO)

TT=1800.2

? (TO)

TT=1800.05

?

TT=1795.46

No data? (TO)

TT=1800.74

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.13

No dataNo data? (TO)

TT=1800.19

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.17

? (TO)

TT=1800.15

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.58

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_7_60_4.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1802.03

? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1798

? (TO)

TT=1800.07

? (TO)

TT=1802.12

No data? (TO)

TT=1800.75

? (TO)

TT=1800.15

?

TT=1796.98

No data? (TO)

TT=1800.61

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.01

No dataNo data? (TO)

TT=1800.2

No dataNo dataNo data? (TO)

TT=1800.16

? (TO)

TT=1800.62

? (TO)

TT=1800

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.1

?

TT=1799.76

No dataNo data? (TO)

TT=1800.32

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_8_70_2.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.05

?

TT=1798

? (TO)

TT=1800.06

? (TO)

TT=1802.17

No data? (TO)

TT=1835.62

? (TO)

TT=1800.06

?

TT=1797.62

No data? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.59

No dataNo data? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.62

? (TO)

TT=1800.88

? (TO)

TT=1800.96

? (TO)

TT=1800.07

? (TO)

TT=1800.14

? (TO)

TT=1800.15

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.01

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-market-split_8_70_3.opb




?

TT=1798

No data? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1802.12

? (TO)

TT=1800.03

? (TO)

TT=1800.09

?

TT=1798.14

? (TO)

TT=1800.09

? (TO)

TT=1802.12

No data? (TO)

TT=1805.13

? (TO)

TT=1800.09

?

TT=1796.14

No data? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.17

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.15

? (TO)

TT=1800.12

? (TO)

TT=1800.16

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.43

No dataNo data?

TT=1799.77

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_4_30_2.opb
OPT
f=1
TT=11.194
T1=3.33
OPT
f=1
TT=112.638
T1=6.36
No dataOPT
f=1
TT=52.065
T1=19.51
? (TO)

TT=1800.14

OPT
f=1
TT=840.248
T1=536.53
? (TO)

TT=1800.11

OPT
f=1
TT=654.484
T1=654.59
? (TO)

TT=1800.11

OPT
f=1
TT=596.54
T1=596.64
? (TO)

TT=1800.03

? (TO)

TT=1800.01

OPT
f=1
TT=89.325
T1=32.13
SAT (TO)
f=1
TT=1800.03
T1=843.52
OPT
f=1
TT=11.194
T1=3.33
OPT
f=1
TT=133.065
T1=62.17
OPT
f=1
TT=105.33
T1=22.61
OPT
f=1
TT=146.285
T1=63.46
OPT
f=1
TT=777.05
T1=288.02
OPT
f=1
TT=111.921
T1=3.35
No dataOPT
f=1
TT=257.8
T1=157.93
OPT
f=1
TT=105.459
T1=34.18
OPT
f=1
TT=232.267
T1=16.88
No dataOPT
f=1
TT=108.169
T1=18.25
OPT
f=1
TT=369.56
T1=20.83
SAT (TO)
f=1
TT=1800.03
T1=1800.3
OPT
f=1
TT=1479.63
T1=1186.63
? (TO)

TT=1800.14

No dataNo dataNo dataOPT
f=1
TT=702.59
T1=351.44
No dataNo dataOPT
f=1
TT=792.012
T1=396.04
No dataNo dataNo dataOPT
f=1
TT=93.431
T1=16.23
OPT
f=1
TT=26.42
T1=7.22
SAT
f=1
TT=34.648
T1=14.88
OPT
f=1
TT=333.064
T1=10.92
OPT
f=1
TT=337.551
T1=10.86
OPT
f=1
TT=207.492
T1=110.29
OPT
f=1
TT=182.457
T1=40.3
OPT
f=1
TT=179.874
T1=38.03
OPT
f=1
TT=280.1
T1=280.2
No dataNo dataOPT
f=1
TT=276.312
T1=276.33
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_4_30_3.opb
OPT
f=2
TT=52.396
T1=5.82
OPT
f=2
TT=649.98
T1=48.34
No dataOPT
f=2
TT=325.851
T1=13.19
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.04

? (TO)

TT=1800.04

OPT
f=2
TT=403.374
T1=20.78
SAT (TO)
f=2
TT=1800.02
T1=1062.71
OPT
f=2
TT=52.396
T1=13.93
OPT
f=2
TT=133.912
T1=14.91
OPT
f=2
TT=728.84
T1=96.96
OPT
f=2
TT=680.275
T1=44.35
SAT (TO)
f=2
TT=1800.57
T1=55.95
OPT
f=2
TT=136.927
T1=13.08
No dataOPT
f=2
TT=338.473
T1=227.96
OPT
f=2
TT=359.389
T1=37.19
OPT
f=2
TT=116.52
T1=11.15
No dataOPT
f=2
TT=419.741
T1=119.22
OPT
f=2
TT=154.993
T1=8.81
SAT (TO)
f=3
TT=1800.03
T1=1800.3
? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=3
TT=1800.55
T1=900.31
No dataNo dataSAT (TO)
f=2
TT=1800.13
T1=900.31
No dataNo dataNo dataOPT
f=2
TT=523.314
T1=109.52
OPT
f=2
TT=151.393
T1=36.34
OPT
f=2
TT=204.11
T1=8.5
OPT
f=2
TT=136.02
T1=5.83
OPT
f=2
TT=138.102
T1=5.82
OPT
f=2
TT=153.301
T1=24.21
OPT
f=2
TT=648.563
T1=76.33
OPT
f=2
TT=647.573
T1=75.78
?

TT=1799.51

No dataNo data?

TT=1799.87

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_4_30_4.opb
OPT
f=1
TT=22.173
T1=3.33
OPT
f=1
TT=227.252
T1=30.43
No dataOPT
f=1
TT=94.929
T1=61.71
? (TO)

TT=1800.11

OPT
f=1
TT=1139.85
T1=774.61
? (TO)

TT=1800.05

OPT
f=1
TT=855.27
T1=855.4
? (TO)

TT=1800.09

OPT
f=1
TT=755.829
T1=755.95
? (TO)

TT=1800.07

? (TO)

TT=1800.02

OPT
f=1
TT=111.455
T1=20.85
SAT (TO)
f=1
TT=1800.03
T1=1425.95
OPT
f=1
TT=22.173
T1=12.88
OPT
f=1
TT=51.025
T1=19.69
OPT
f=1
TT=210.66
T1=63.88
OPT
f=1
TT=175.09
T1=13.34
OPT
f=1
TT=830.28
T1=184.51
OPT
f=1
TT=200.188
T1=54.21
No dataOPT
f=1
TT=189.617
T1=116.02
OPT
f=1
TT=129.353
T1=27.17
OPT
f=1
TT=602.544
T1=12.76
No dataOPT
f=1
TT=153.496
T1=70.56
OPT
f=1
TT=489.461
T1=52.58
OPT
f=1
TT=1162.02
T1=1162.2
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataOPT
f=1
TT=1124.43
T1=562.25
No dataNo dataOPT
f=1
TT=1654.22
T1=827.34
No dataNo dataNo dataOPT
f=1
TT=107.807
T1=46.33
OPT
f=1
TT=38.403
T1=26.18
SAT
f=1
TT=48.92
T1=5.38
OPT
f=1
TT=300.393
T1=3.34
OPT
f=1
TT=307.499
T1=3.33
OPT
f=1
TT=305.981
T1=162.84
OPT
f=1
TT=352.885
T1=210.17
OPT
f=1
TT=347.203
T1=206.94
OPT
f=1
TT=596.72
T1=596.97
No dataNo dataOPT
f=1
TT=607.915
T1=607.93
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_5_40_1.opb
SAT
f=1
TT=1789.91
T1=110.16
SAT
f=2
TT=1798
T1=1442.25
No dataSAT (TO)
f=1
TT=1800.03
T1=613.39
? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.07

SAT (TO)
f=2
TT=1800.02
T1=731.51
SAT (TO)
f=20
TT=1800.02
T1=1608.21
SAT (TO)
f=1
TT=1800.07
T1=124.99
SAT
f=2
TT=1783.01
T1=511.33
SAT (TO)
f=4
TT=1800.01
T1=428.99
SAT
f=2
TT=1798
T1=1569.34
SAT (TO)
f=3
TT=1800.05
T1=1492.68
SAT (TO)
f=1
TT=1800.53
T1=1083.96
No data? (TO)

TT=1808.37

SAT (TO)
f=3
TT=1800.12
T1=635.71
SAT
f=1
TT=1789.91
T1=889.65
No dataSAT (TO)
f=2
TT=1800.34
T1=892.04
SAT
f=1
TT=1796.85
T1=110.16
SAT (TO)
f=20
TT=1800.02
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=6
TT=1800.51
T1=900.31
No dataNo dataSAT (TO)
f=7
TT=1800.48
T1=900.31
No dataNo dataNo dataSAT (TO)
f=3
TT=1800.02
T1=191.87
SAT (TO)
f=3
TT=1800.05
T1=83.21
SAT (TO)
f=1
TT=1800.01
T1=841.17
SAT
f=3
TT=1797
T1=170.13
SAT
f=3
TT=1797
T1=170.24
SAT
f=1
TT=1796.85
T1=280.61
? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=1799.57

No dataNo data?

TT=1799.52

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_5_40_2.opb
SAT
f=2
TT=1789.77
T1=429
SAT
f=4
TT=1798
T1=476.28
No dataSAT (TO)
f=2
TT=1800.03
T1=1038.63
? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.02

SAT (TO)
f=2
TT=1800.02
T1=522.62
SAT (TO)
f=17
TT=1800.02
T1=1644.81
SAT (TO)
f=2
TT=1800.05
T1=781.42
SAT
f=3
TT=1783
T1=620.92
SAT (TO)
f=5
TT=1800.09
T1=379.07
SAT
f=3
TT=1798
T1=543.63
SAT (TO)
f=7
TT=1800.04
T1=804.16
SAT (TO)
f=2
TT=1801.27
T1=986.86
No data? (TO)

TT=1803.29

SAT (TO)
f=3
TT=1800.01
T1=208.08
SAT
f=2
TT=1789.77
T1=440.8
No dataSAT (TO)
f=5
TT=1800.16
T1=104.02
SAT
f=3
TT=1797.49
T1=294.01
SAT (TO)
f=16
TT=1800.11
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=8
TT=1800.56
T1=900.31
No dataNo dataSAT (TO)
f=5
TT=1800.17
T1=900.31
No dataNo dataNo dataSAT (TO)
f=3
TT=1800.88
T1=184.3
SAT (TO)
f=3
TT=1800.57
T1=497.2
SAT (TO)
f=2
TT=1800.05
T1=483.78
SAT
f=2
TT=1796.92
T1=580.18
SAT
f=2
TT=1796.95
T1=429
SAT
f=2
TT=1797.33
T1=1526.22
? (TO)

TT=1800.09

? (TO)

TT=1800.03

?

TT=1799.54

No dataNo data?

TT=1799.94

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_5_40_3.opb
OPT
f=0
TT=305.689
T1=199.78
SAT
f=3
TT=1798
T1=724.06
No dataSAT (TO)
f=1
TT=1800.03
T1=1392.7
? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.06

OPT
f=0
TT=1198.48
T1=1198.67
SAT (TO)
f=17
TT=1800.02
T1=1662.29
OPT
f=0
TT=441.171
T1=441.36
SAT
f=2
TT=1783.01
T1=629.12
SAT (TO)
f=4
TT=1800.42
T1=281.07
SAT
f=3
TT=1798
T1=222.49
SAT (TO)
f=6
TT=1800.01
T1=963.25
SAT (TO)
f=1
TT=1800.24
T1=120.4
No dataOPT
f=0
TT=305.689
T1=199.78
SAT (TO)
f=2
TT=1800.88
T1=407.03
SAT
f=3
TT=1789.8
T1=22.37
No dataSAT (TO)
f=3
TT=1800.08
T1=98.91
SAT
f=2
TT=1796.79
T1=1169.86
SAT (TO)
f=18
TT=1800.03
T1=1800.3
? (TO)

TT=1800.11

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=6
TT=1800.5
T1=900.31
No dataNo dataSAT (TO)
f=8
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=3
TT=1800.09
T1=580.59
SAT (TO)
f=2
TT=1800.47
T1=710.19
SAT (TO)
f=2
TT=1800.77
T1=317.37
OPT
f=0
TT=1776.53
T1=1776.8
OPT
f=0
TT=1778.68
T1=1778.96
SAT
f=3
TT=1797.63
T1=42.04
? (TO)

TT=1800.06

? (TO)

TT=1800.03

?

TT=1799.57

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_5_40_4.opb
SAT
f=2
TT=1783.01
T1=47.26
SAT
f=3
TT=1798
T1=571.49
No dataSAT (TO)
f=3
TT=1800.03
T1=1491.22
? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.11

SAT (TO)
f=4
TT=1800.02
T1=322.58
SAT (TO)
f=23
TT=1800.02
T1=1684.61
SAT (TO)
f=2
TT=1800.08
T1=1544.62
SAT
f=2
TT=1783.01
T1=312.3
SAT (TO)
f=4
TT=1800.01
T1=55.34
SAT
f=3
TT=1798
T1=920.03
SAT (TO)
f=3
TT=1800.55
T1=680.98
SAT (TO)
f=2
TT=1800.33
T1=270.42
No data? (TO)

TT=1831.38

SAT (TO)
f=4
TT=1800.03
T1=15.16
SAT
f=2
TT=1789.74
T1=47.26
No dataSAT (TO)
f=3
TT=1800.86
T1=140
SAT
f=2
TT=1796.84
T1=1054.15
SAT (TO)
f=20
TT=1800.03
T1=1800.3
? (TO)

TT=1800.11

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=8
TT=1800.18
T1=900.31
No dataNo dataSAT (TO)
f=8
TT=1800.2
T1=900.31
No dataNo dataNo dataSAT (TO)
f=4
TT=1800.45
T1=779.15
SAT (TO)
f=4
TT=1800
T1=716
SAT (TO)
f=2
TT=1800.57
T1=1577.98
SAT
f=2
TT=1798.11
T1=1585.55
SAT
f=3
TT=1797.65
T1=394.03
SAT
f=2
TT=1797.2
T1=1170.62
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.58

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_6_50_1.opb
SAT
f=5
TT=1790.16
T1=77.14
SAT
f=9
TT=1798.11
T1=936.88
No dataSAT (TO)
f=5
TT=1800.12
T1=1066.22
? (TO)

TT=1800.14

? (problem)

TT=13.629

? (TO)

TT=1800.09

? (problem)

TT=13.56

? (TO)

TT=1800.09

? (problem)

TT=10.73

? (TO)

TT=1800.1

? (problem)

TT=13.4

SAT (TO)
f=7
TT=1800.11
T1=797.49
SAT (TO)
f=171
TT=1800.02
T1=1484.58
SAT (TO)
f=7
TT=1800.11
T1=508.61
SAT
f=6
TT=1783
T1=1556.31
SAT (TO)
f=17
TT=1800.02
T1=1551.44
SAT
f=7
TT=1798
T1=979.77
SAT (TO)
f=19
TT=1800.68
T1=761.67
SAT (TO)
f=3
TT=1801.05
T1=932.12
No data? (TO)

TT=1800.05

SAT (TO)
f=8
TT=1800.05
T1=879.28
SAT
f=5
TT=1790.16
T1=123.51
No dataSAT (TO)
f=8
TT=1800.09
T1=478.47
SAT
f=5
TT=1797.84
T1=77.14
SAT (TO)
f=169
TT=1800.03
T1=1800.3
? (TO)

TT=1800.12

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=15
TT=1800.16
T1=900.31
No dataNo dataSAT (TO)
f=14
TT=1800.48
T1=900.31
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.02
T1=357.02
SAT (TO)
f=10
TT=1800.07
T1=512.75
SAT (TO)
f=11
TT=1800.02
T1=1490.5
SAT
f=5
TT=1798.55
T1=119.03
SAT
f=5
TT=1798.24
T1=119.99
SAT
f=5
TT=1798.49
T1=117.97
? (TO)

TT=1800.02

? (TO)

TT=1800.03

?

TT=1799.5

No dataNo data?

TT=1799.55

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_6_50_2.opb
SAT
f=5
TT=1797.53
T1=20.77
SAT
f=10
TT=1798
T1=149.52
No dataSAT (TO)
f=5
TT=1800.03
T1=1473.83
? (TO)

TT=1800.05

? (problem)

TT=6.86

? (TO)

TT=1800.08

? (problem)

TT=5.5

? (TO)

TT=1800.02

? (problem)

TT=5.42

? (TO)

TT=1800.11

? (problem)

TT=6.73

SAT (TO)
f=8
TT=1800.02
T1=321.13
SAT (TO)
f=136
TT=1800.02
T1=1778.38
SAT (TO)
f=6
TT=1802.05
T1=1588.26
SAT
f=7
TT=1783.01
T1=129.13
SAT (TO)
f=12
TT=1800.01
T1=1759.64
SAT
f=9
TT=1798.04
T1=1010.01
SAT (TO)
f=9
TT=1800.02
T1=1688.1
SAT (TO)
f=7
TT=1802.08
T1=40.22
No data? (TO)

TT=1800.1

SAT (TO)
f=9
TT=1800.23
T1=46.29
SAT
f=6
TT=1790.29
T1=1166.89
No dataSAT (TO)
f=5
TT=1800.16
T1=648.79
SAT
f=5
TT=1798.13
T1=20.77
SAT (TO)
f=86
TT=1800.1
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=17
TT=1800.15
T1=900.31
No dataNo dataSAT (TO)
f=13
TT=1800.18
T1=900.31
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.53
T1=638.7
SAT (TO)
f=9
TT=1800.76
T1=1722.47
SAT (TO)
f=7
TT=1800.05
T1=1041.18
SAT
f=5
TT=1797.53
T1=653.75
SAT
f=5
TT=1797.58
T1=808.34
SAT
f=5
TT=1797.59
T1=644.43
? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo data?

TT=1799.93

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_6_50_3.opb
SAT
f=4
TT=1791.03
T1=834.04
SAT
f=10
TT=1798
T1=1388.41
No dataSAT (TO)
f=7
TT=1800.12
T1=898.87
? (TO)

TT=1800.07

? (problem)

TT=6.214

? (TO)

TT=1800.03

? (problem)

TT=6.07

? (TO)

TT=1800.03

? (problem)

TT=6.23

? (TO)

TT=1800.01

? (problem)

TT=7.59

SAT (TO)
f=11
TT=1800.03
T1=653.34
SAT (TO)
f=149
TT=1800.02
T1=1721.96
SAT (TO)
f=7
TT=1800.06
T1=507.52
SAT
f=7
TT=1783.01
T1=618.77
SAT (TO)
f=8
TT=1800
T1=1650.88
SAT
f=10
TT=1798
T1=732.02
SAT (TO)
f=15
TT=1800.58
T1=1011.94
SAT (TO)
f=4
TT=1802.07
T1=1516.08
No data? (TO)

TT=1814.29

SAT (TO)
f=5
TT=1800.08
T1=768.07
SAT
f=4
TT=1791.03
T1=834.04
No dataSAT (TO)
f=6
TT=1800.92
T1=839.77
SAT
f=5
TT=1797.87
T1=53.84
SAT (TO)
f=108
TT=1800.01
T1=1800.3
? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=14
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=16
TT=1800.13
T1=900.31
No dataNo dataNo dataSAT (TO)
f=10
TT=1800.22
T1=914.86
SAT (TO)
f=7
TT=1800.09
T1=1502.45
SAT (TO)
f=6
TT=1800.05
T1=875.7
SAT
f=5
TT=1798.3
T1=444.79
SAT
f=5
TT=1797.77
T1=556.02
SAT
f=5
TT=1797.96
T1=463.62
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.88

No dataNo data?

TT=1799.53

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_7_60_2.opb
SAT
f=8
TT=1798.7
T1=596.56
SAT
f=80
TT=1798
T1=705.6
No dataSAT (TO)
f=22
TT=1800.02
T1=847.13
? (TO)

TT=1800.02

? (problem)

TT=574.826

? (TO)

TT=1800.08

? (problem)

TT=691.12

? (TO)

TT=1800.04

? (problem)

TT=690.41

? (TO)

TT=1800.03

? (problem)

TT=581.28

SAT (TO)
f=23
TT=1800.02
T1=1200.34
SAT (TO)
f=296
TT=1800.02
T1=1492.56
SAT (TO)
f=15
TT=1800.13
T1=1398.85
SAT
f=19
TT=1783.01
T1=1476.84
SAT (TO)
f=97
TT=1800.49
T1=1769.36
SAT
f=28
TT=1798
T1=483.01
SAT (TO)
f=69
TT=1800.58
T1=1756.27
SAT (TO)
f=10
TT=1802.09
T1=499.05
No data? (TO)

TT=1800.02

SAT (TO)
f=20
TT=1800.79
T1=211.44
SAT
f=9
TT=1793.03
T1=864.24
No dataSAT (TO)
f=17
TT=1800.15
T1=381.61
SAT (TO)
f=12
TT=1800.09
T1=378.66
SAT (TO)
f=246
TT=1800.09
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=20
TT=1800.53
T1=900.31
No dataNo dataSAT (TO)
f=24
TT=1800.14
T1=900.31
No dataNo dataNo dataSAT (TO)
f=84
TT=1800.02
T1=126.25
SAT (TO)
f=38
TT=1800.73
T1=1543.17
SAT (TO)
f=38
TT=1800.01
T1=10.4
SAT
f=8
TT=1798.95
T1=605.3
SAT
f=8
TT=1799.49
T1=602.15
SAT
f=8
TT=1798.7
T1=596.56
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.59

No dataNo data?

TT=1799.54

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_7_60_3.opb
SAT
f=8
TT=1790.84
T1=606.45
SAT
f=72
TT=1798
T1=21.31
No dataSAT (TO)
f=16
TT=1800.03
T1=1524.53
? (TO)

TT=1800.06

? (problem)

TT=1488.13

? (TO)

TT=1800.05

? (problem)

TT=1751.54

? (TO)

TT=1800.03

? (problem)

TT=1559.11

? (TO)

TT=1800.05

? (TO)

TT=1800.07

SAT (TO)
f=23
TT=1800.02
T1=250.19
SAT (TO)
f=305
TT=1800.1
T1=1231.75
SAT (TO)
f=20
TT=1802.13
T1=713.12
SAT
f=16
TT=1783.01
T1=262.7
SAT (TO)
f=65
TT=1800.03
T1=1743.76
SAT
f=140
TT=1798
T1=192.08
SAT (TO)
f=55
TT=1800.83
T1=1755.5
SAT (TO)
f=10
TT=1802.08
T1=544.95
No data? (TO)

TT=1800.05

SAT (TO)
f=18
TT=1800.01
T1=128.35
SAT
f=8
TT=1790.84
T1=1061.57
No dataSAT (TO)
f=20
TT=1800.86
T1=397.24
SAT
f=11
TT=1799.55
T1=1409.79
SAT (TO)
f=262
TT=1800.02
T1=1800.3
? (TO)

TT=1800.12

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=17
TT=1800.17
T1=900.31
No dataNo dataSAT (TO)
f=23
TT=1800.12
T1=900.31
No dataNo dataNo dataSAT (TO)
f=54
TT=1800.47
T1=755.89
SAT (TO)
f=39
TT=1800.73
T1=1568.53
SAT (TO)
f=21
TT=1800.5
T1=373.18
SAT
f=8
TT=1798.48
T1=739.98
SAT
f=8
TT=1798.78
T1=606.45
SAT
f=8
TT=1797.76
T1=606.75
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.47

No dataNo data?

TT=1799.58

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_8_70_1.opb
SAT
f=15
TT=1792.11
T1=868.1
SAT
f=99
TT=1798
T1=316.34
No dataSAT (TO)
f=39
TT=1800.02
T1=1794.12
? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1802.62

? (TO)

TT=1800.05

? (TO)

TT=1800.16

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.03

SAT (TO)
f=81
TT=1800.02
T1=1004.18
SAT (TO)
f=378
TT=1800.02
T1=692.14
SAT (TO)
f=42
TT=1802.07
T1=1006.51
SAT
f=41
TT=1783
T1=1352.17
SAT (TO)
f=353
TT=1800.07
T1=1682.97
SAT
f=75
TT=1798
T1=167.09
SAT (TO)
f=357
TT=1800.69
T1=1599.78
SAT (TO)
f=16
TT=1802.04
T1=1679.62
No data? (TO)

TT=1800.02

SAT (TO)
f=48
TT=1800.61
T1=809.13
SAT
f=15
TT=1792.11
T1=868.1
No dataSAT (TO)
f=53
TT=1800.16
T1=573.93
SAT (TO)
f=16
TT=1800.13
T1=1086.18
SAT (TO)
f=393
TT=1800.02
T1=1800.3
? (TO)

TT=1800.02

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=48
TT=1800.16
T1=900.31
No dataNo dataSAT (TO)
f=44
TT=1800.57
T1=900.31
No dataNo dataNo dataSAT (TO)
f=177
TT=1800.12
T1=812.68
SAT (TO)
f=201
TT=1800.01
T1=1729.98
SAT (TO)
f=53
TT=1800.07
T1=240.8
SAT
f=16
TT=1799.89
T1=1164.52
SAT (TO)
f=16
TT=1800.09
T1=978.92
SAT (TO)
f=16
TT=1800.08
T1=985.37
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.87

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/
submitted-PB06/manquiho/market-split/
normalized-opt-market-split_8_70_3.opb
SAT
f=14
TT=1792.21
T1=1286.38
SAT
f=160
TT=1798
T1=520.57
No dataSAT (TO)
f=42
TT=1800.02
T1=1734.37
? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.08

SAT (TO)
f=28
TT=1800.1
T1=299.08
SAT (TO)
f=388
TT=1800.02
T1=1766.47
SAT (TO)
f=35
TT=1802.14
T1=1532.06
SAT
f=35
TT=1783.01
T1=540.17
SAT (TO)
f=405
TT=1800.02
T1=1753.51
SAT
f=92
TT=1798
T1=1136.87
SAT (TO)
f=420
TT=1800.36
T1=1792.63
SAT (TO)
f=15
TT=1802.09
T1=1707.1
No data? (TO)

TT=1800.1

SAT (TO)
f=68
TT=1800.01
T1=512.18
SAT
f=14
TT=1792.21
T1=1286.38
No dataSAT (TO)
f=51
TT=1800.4
T1=961.21
SAT (TO)
f=15
TT=1800.05
T1=1592.54
SAT (TO)
f=392
TT=1800.03
T1=1800.3
? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=45
TT=1800.55
T1=900.31
No dataNo dataSAT (TO)
f=39
TT=1800.47
T1=900.31
No dataNo dataNo dataSAT (TO)
f=312
TT=1800.15
T1=878.28
SAT (TO)
f=350
TT=1800.09
T1=1781.86
SAT (TO)
f=66
TT=1800.61
T1=6.02
SAT (TO)
f=15
TT=1800.11
T1=1374.09
SAT (TO)
f=15
TT=1800.08
T1=1386.78
SAT
f=15
TT=1799.94
T1=1646.29
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.61

No dataNo data?

TT=1799.77

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=101-Q=379.opb
OPT
f=101
TT=0.006
T1=0
OPT
f=101
TT=0.027
T1=0.02
No dataOPT
f=101
TT=0.006
T1=0
OPT
f=101
TT=8.576
T1=1.81
OPT
f=101
TT=0.189
T1=0.11
OPT
f=101
TT=8.759
T1=1.83
OPT
f=101
TT=0.125
T1=0.09
OPT
f=101
TT=3.591
T1=1.89
OPT
f=101
TT=0.112
T1=0.1
OPT
f=101
TT=3.468
T1=1.88
? (TO)

TT=1800.09

OPT
f=101
TT=0.02
T1=0.02
OPT
f=101
TT=0.026
T1=0.02
OPT
f=101
TT=0.045
T1=0.03
OPT
f=101
TT=0.017
T1=0.01
OPT
f=101
TT=0.423
T1=0.23
OPT
f=101
TT=0.025
T1=0.01
OPT
f=101
TT=0.486
T1=0.25
OPT
f=101
TT=0.225
T1=0.13
No dataOPT
f=101
TT=0.726
T1=0.32
OPT
f=101
TT=0.784
T1=1.14
OPT
f=101
TT=0.383
T1=0.37
No dataOPT
f=101
TT=0.714
T1=0.67
OPT
f=101
TT=0.472
T1=0.46
OPT
f=101
TT=0.013
T1=0.01
OPT
f=101
TT=0.083
T1=0.04
OPT
f=101
TT=0.052
T1=0.04
No dataNo dataNo dataOPT
f=101
TT=0.062
T1=0.02
No dataNo dataOPT
f=101
TT=0.062
T1=0.02
No dataNo dataNo dataOPT
f=101
TT=0.605
T1=0.65
OPT
f=101
TT=0.274
T1=0.17
OPT
f=101
TT=0.405
T1=0.22
OPT
f=101
TT=0.127
T1=0.11
OPT
f=101
TT=0.128
T1=0.11
OPT
f=101
TT=0.614
T1=0.6
OPT
f=101
TT=0.037
T1=0.03
OPT
f=101
TT=0.037
T1=0.03
OPT
f=101
TT=0.051
T1=0.05
No dataNo dataOPT
f=101
TT=0.753
T1=0.74
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=113-Q=233.opb
OPT
f=113
TT=0.004
T1=0
OPT
f=113
TT=0.035
T1=0.02
No dataOPT
f=113
TT=0.004
T1=0
OPT
f=113
TT=34.289
T1=6.69
OPT
f=113
TT=0.184
T1=0.09
OPT
f=113
TT=33.504
T1=6.5
OPT
f=113
TT=0.129
T1=0.08
OPT
f=113
TT=6.847
T1=6.61
OPT
f=113
TT=0.094
T1=0.08
? (TO)

TT=1751.85

OPT
f=113
TT=0.102
T1=0.08
OPT
f=113
TT=0.018
T1=0.01
OPT
f=113
TT=0.018
T1=0.01
OPT
f=113
TT=0.062
T1=0.04
OPT
f=113
TT=0.032
T1=0.03
OPT
f=113
TT=0.444
T1=0.24
OPT
f=113
TT=0.032
T1=0.02
OPT
f=113
TT=0.515
T1=0.25
OPT
f=113
TT=0.566
T1=0.56
No dataOPT
f=113
TT=0.143
T1=0.09
OPT
f=113
TT=0.795
T1=1.14
OPT
f=113
TT=0.056
T1=0.05
No dataOPT
f=113
TT=0.723
T1=0.67
OPT
f=113
TT=0.469
T1=0.46
OPT
f=113
TT=0.008
T1=0
OPT
f=113
TT=0.21
T1=0.1
OPT
f=113
TT=0.131
T1=0.1
No dataNo dataNo dataOPT
f=113
TT=0.102
T1=0.04
No dataNo dataOPT
f=113
TT=0.062
T1=0.03
No dataNo dataNo dataOPT
f=113
TT=0.675
T1=0.65
OPT
f=113
TT=0.334
T1=0.17
OPT
f=113
TT=0.464
T1=0.24
OPT
f=113
TT=0.134
T1=0.12
OPT
f=113
TT=0.132
T1=0.12
OPT
f=113
TT=0.423
T1=0.3
OPT
f=113
TT=0.119
T1=0.11
OPT
f=113
TT=0.118
T1=0.11
OPT
f=113
TT=0.182
T1=0.18
No dataNo dataOPT
f=113
TT=0.181
T1=0.18
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=11-Q=53.opb
OPT
f=11
TT=0.002
T1=0
OPT
f=11
TT=0.017
T1=0.01
No dataOPT
f=11
TT=0.003
T1=0
OPT
f=11
TT=1.317
T1=1.16
OPT
f=11
TT=0.103
T1=0.06
OPT
f=11
TT=1.209
T1=1.32
OPT
f=11
TT=0.051
T1=0.04
OPT
f=11
TT=1.121
T1=1.12
OPT
f=11
TT=0.051
T1=0.05
? (TO)

TT=1800.04

? (TO)

TT=1800.1

OPT
f=11
TT=0.009
T1=0.01
OPT
f=11
TT=0.011
T1=0.01
OPT
f=11
TT=0.04
T1=0.02
OPT
f=11
TT=0.007
T1=0
OPT
f=11
TT=0.252
T1=0.17
OPT
f=11
TT=0.018
T1=0.01
OPT
f=11
TT=0.264
T1=0.16
OPT
f=11
TT=0.07
T1=0.06
No dataOPT
f=11
TT=0.043
T1=0.06
OPT
f=11
TT=0.414
T1=1.17
OPT
f=11
TT=0.033
T1=0.02
No dataOPT
f=11
TT=0.544
T1=0.67
OPT
f=11
TT=0.049
T1=0.04
OPT
f=11
TT=0.006
T1=0
OPT
f=11
TT=1.147
T1=0.82
OPT
f=11
TT=1.087
T1=0.92
No dataNo dataNo dataWrong Cert.

TT=0.002

No dataNo dataOPT
f=11
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=11
TT=0.385
T1=0.65
OPT
f=11
TT=0.224
T1=0.15
OPT
f=11
TT=0.325
T1=0.19
OPT
f=11
TT=0.084
T1=0.07
OPT
f=11
TT=0.07
T1=0.05
OPT
f=11
TT=0.12
T1=0.05
OPT
f=11
TT=0.016
T1=0.01
OPT
f=11
TT=0.017
T1=0.01
Wrong Cert.

TT=0.002

No dataNo dataOPT
f=11
TT=0.002
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=131-Q=137.opb
OPT
f=131
TT=0.005
T1=0
OPT
f=131
TT=0.058
T1=0.05
No dataOPT
f=131
TT=0.005
T1=0
OPT
f=131
TT=22.81
T1=0.55
OPT
f=131
TT=0.227
T1=0.09
OPT
f=131
TT=22.497
T1=0.54
OPT
f=131
TT=0.157
T1=0.19
OPT
f=131
TT=2.053
T1=0.52
OPT
f=131
TT=0.102
T1=0.09
OPT
f=131
TT=4.491
T1=0.53
OPT
f=131
TT=0.112
T1=0.08
OPT
f=131
TT=0.033
T1=0.03
OPT
f=131
TT=0.024
T1=0.02
OPT
f=131
TT=0.066
T1=0.04
OPT
f=131
TT=0.03
T1=0.02
OPT
f=131
TT=0.444
T1=0.23
OPT
f=131
TT=0.048
T1=0.04
OPT
f=131
TT=0.473
T1=0.23
OPT
f=131
TT=0.484
T1=0.48
No dataOPT
f=131
TT=0.26
T1=0.14
OPT
f=131
TT=1.034
T1=1.14
OPT
f=131
TT=0.542
T1=0.53
No dataOPT
f=131
TT=1.004
T1=0.67
OPT
f=131
TT=0.451
T1=0.44
OPT
f=131
TT=0.013
T1=0.01
OPT
f=131
TT=0.268
T1=0.06
OPT
f=131
TT=0.107
T1=0.06
No dataNo dataNo dataWrong Cert.

TT=0.062

No dataNo dataOPT
f=131
TT=0.062
T1=0.02
No dataNo dataNo dataOPT
f=131
TT=0.794
T1=0.65
OPT
f=131
TT=0.394
T1=0.21
OPT
f=131
TT=0.463
T1=0.24
OPT
f=131
TT=0.457
T1=0.43
OPT
f=131
TT=0.387
T1=0.36
OPT
f=131
TT=0.603
T1=0.27
OPT
f=131
TT=0.098
T1=0.09
OPT
f=131
TT=0.097
T1=0.08
Wrong Cert.

TT=0.062

No dataNo dataOPT
f=131
TT=0.073
T1=0.06
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=167-Q=179.opb
OPT
f=167
TT=0.005
T1=0
OPT
f=167
TT=0.052
T1=0.05
No dataOPT
f=167
TT=0.005
T1=0
OPT
f=167
TT=17.592
T1=10.46
OPT
f=167
TT=0.234
T1=0.17
OPT
f=167
TT=15.804
T1=10.41
OPT
f=167
TT=0.149
T1=0.12
OPT
f=167
TT=15.757
T1=8.76
OPT
f=167
TT=0.096
T1=0.09
OPT
f=167
TT=16.822
T1=9.82
OPT
f=167
TT=0.108
T1=0.1
OPT
f=167
TT=0.031
T1=0.02
OPT
f=167
TT=0.027
T1=0.02
OPT
f=167
TT=0.05
T1=0.03
OPT
f=167
TT=0.063
T1=0.01
OPT
f=167
TT=0.422
T1=0.22
OPT
f=167
TT=0.042
T1=0.03
OPT
f=167
TT=0.495
T1=0.23
OPT
f=167
TT=0.527
T1=0.52
No dataOPT
f=167
TT=0.222
T1=0.11
OPT
f=167
TT=0.903
T1=2.14
OPT
f=167
TT=0.064
T1=0.05
No dataOPT
f=167
TT=0.864
T1=1.17
OPT
f=167
TT=0.563
T1=0.55
OPT
f=167
TT=0.016
T1=0.01
OPT
f=167
TT=0.285
T1=0.32
OPT
f=167
TT=0.181
T1=0.1
No dataNo dataNo dataWrong Cert.

TT=0.042

No dataNo dataOPT
f=167
TT=0.083
T1=0.03
No dataNo dataNo dataOPT
f=167
TT=5.443
T1=1.15
OPT
f=167
TT=0.394
T1=0.2
SAT
f=167
TT=0.495
T1=0.25
OPT
f=167
TT=0.111
T1=0.1
OPT
f=167
TT=0.121
T1=0.1
OPT
f=167
TT=0.79
T1=0.77
OPT
f=167
TT=0.09
T1=0.07
OPT
f=167
TT=0.09
T1=0.07
Wrong Cert.

TT=0.031

No dataNo data?

TT=1799.52

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=167-Q=347.opb
OPT
f=167
TT=0.006
T1=0
OPT
f=167
TT=0.078
T1=0.07
No dataOPT
f=167
TT=0.006
T1=0
OPT
f=167
TT=18.019
T1=4.58
OPT
f=167
TT=0.226
T1=0.12
OPT
f=167
TT=18.365
T1=4.58
OPT
f=167
TT=0.147
T1=0.09
OPT
f=167
TT=6.232
T1=4.57
OPT
f=167
TT=0.107
T1=0.1
OPT
f=167
TT=6.211
T1=4.58
? (TO)

TT=1800.08

OPT
f=167
TT=0.039
T1=0.04
OPT
f=167
TT=0.03
T1=0.02
OPT
f=167
TT=0.048
T1=0.03
OPT
f=167
TT=0.022
T1=0.01
OPT
f=167
TT=0.393
T1=0.21
OPT
f=167
TT=0.061
T1=0.05
OPT
f=167
TT=0.525
T1=0.26
OPT
f=167
TT=0.653
T1=0.64
No dataOPT
f=167
TT=0.146
T1=0.08
OPT
f=167
TT=0.854
T1=1.15
OPT
f=167
TT=0.058
T1=0.05
No dataOPT
f=167
TT=0.844
T1=0.67
OPT
f=167
TT=0.535
T1=0.52
OPT
f=167
TT=0.017
T1=0.01
OPT
f=167
TT=0.114
T1=0.04
OPT
f=167
TT=0.079
T1=0.04
No dataNo dataNo dataOPT
f=167
TT=0.062
T1=0.03
No dataNo dataOPT
f=167
TT=0.063
T1=0.02
No dataNo dataNo dataOPT
f=167
TT=0.723
T1=0.65
OPT
f=167
TT=0.453
T1=0.22
SAT
f=167
TT=0.455
T1=0.24
OPT
f=167
TT=0.109
T1=0.09
OPT
f=167
TT=0.082
T1=0.07
OPT
f=167
TT=0.532
T1=0.52
OPT
f=167
TT=0.108
T1=0.08
OPT
f=167
TT=0.106
T1=0.08
OPT
f=167
TT=193.45
T1=193.57
No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=197-Q=479.opb
OPT
f=197
TT=0.006
T1=0
OPT
f=197
TT=0.109
T1=0.1
No dataOPT
f=197
TT=0.006
T1=0
OPT
f=197
TT=3.003
T1=1.15
OPT
f=197
TT=0.203
T1=0.11
OPT
f=197
TT=2.956
T1=1.14
OPT
f=197
TT=0.122
T1=0.09
OPT
f=197
TT=1.59
T1=1.3
OPT
f=197
TT=0.106
T1=0.1
OPT
f=197
TT=1.546
T1=1.16
? (TO)

TT=1800.07

OPT
f=197
TT=0.024
T1=0.02
OPT
f=197
TT=0.027
T1=0.02
OPT
f=197
TT=0.069
T1=0.05
OPT
f=197
TT=0.047
T1=0.04
OPT
f=197
TT=0.455
T1=0.23
OPT
f=197
TT=0.08
T1=0.07
OPT
f=197
TT=0.483
T1=0.24
OPT
f=197
TT=0.587
T1=0.58
No dataOPT
f=197
TT=0.046
T1=0.04
OPT
f=197
TT=0.875
T1=1.14
OPT
f=197
TT=0.049
T1=0.04
No dataOPT
f=197
TT=0.844
T1=0.73
OPT
f=197
TT=0.516
T1=0.51
OPT
f=197
TT=0.015
T1=0.01
OPT
f=197
TT=0.083
T1=0.04
OPT
f=197
TT=0.094
T1=0.05
No dataNo dataNo dataOPT
f=197
TT=0.041
T1=0.01
No dataNo dataOPT
f=197
TT=0.042
T1=0.01
No dataNo dataNo dataOPT
f=197
TT=0.585
T1=0.65
OPT
f=197
TT=0.335
T1=0.19
OPT
f=197
TT=0.465
T1=0.24
OPT
f=197
TT=0.108
T1=0.1
OPT
f=197
TT=0.12
T1=0.1
OPT
f=197
TT=0.385
T1=0.33
OPT
f=197
TT=0.111
T1=0.1
OPT
f=197
TT=0.109
T1=0.11
OPT
f=197
TT=0.044
T1=0.04
No dataNo dataOPT
f=197
TT=0.042
T1=0.04
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=223-Q=307.opb
OPT
f=223
TT=0.008
T1=0
OPT
f=223
TT=0.094
T1=0.06
No dataOPT
f=223
TT=0.008
T1=0
OPT
f=223
TT=22.057
T1=2.61
OPT
f=223
TT=0.211
T1=0.09
OPT
f=223
TT=22.317
T1=2.62
OPT
f=223
TT=0.147
T1=0.08
OPT
f=223
TT=7.123
T1=2.73
OPT
f=223
TT=0.094
T1=0.08
OPT
f=223
TT=7.007
T1=2.71
OPT
f=223
TT=0.108
T1=0.08
OPT
f=223
TT=0.051
T1=0.04
OPT
f=223
TT=0.031
T1=0.02
OPT
f=223
TT=0.045
T1=0.03
OPT
f=223
TT=0.021
T1=0.02
OPT
f=223
TT=0.385
T1=0.2
OPT
f=223
TT=0.082
T1=0.06
OPT
f=223
TT=0.514
T1=0.25
OPT
f=223
TT=0.571
T1=0.56
No dataOPT
f=223
TT=0.133
T1=0.08
OPT
f=223
TT=1.083
T1=2.14
OPT
f=223
TT=0.276
T1=0.06
No dataOPT
f=223
TT=1.004
T1=1.17
OPT
f=223
TT=0.37
T1=0.36
OPT
f=223
TT=0.017
T1=0.01
OPT
f=223
TT=0.103
T1=0.03
OPT
f=223
TT=0.049
T1=0.03
No dataNo dataNo dataOPT
f=223
TT=0.062
T1=0.02
No dataNo dataOPT
f=223
TT=0.082
T1=0.03
No dataNo dataNo dataOPT
f=223
TT=0.653
T1=0.65
OPT
f=223
TT=0.364
T1=0.18
OPT
f=223
TT=0.454
T1=0.23
OPT
f=223
TT=0.109
T1=0.09
OPT
f=223
TT=0.11
T1=0.09
OPT
f=223
TT=0.615
T1=0.59
OPT
f=223
TT=0.188
T1=0.17
OPT
f=223
TT=0.187
T1=0.16
OPT
f=223
TT=0.232
T1=0.22
No dataNo dataOPT
f=223
TT=0.223
T1=0.22
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=223-Q=347.opb
OPT
f=223
TT=0.007
T1=0
OPT
f=223
TT=0.042
T1=0.03
No dataOPT
f=223
TT=0.007
T1=0
OPT
f=223
TT=27.233
T1=6.03
OPT
f=223
TT=0.208
T1=0.09
OPT
f=223
TT=26.038
T1=6.02
OPT
f=223
TT=0.138
T1=0.08
OPT
f=223
TT=4.242
T1=2.79
OPT
f=223
TT=0.09
T1=0.08
OPT
f=223
TT=4.971
T1=3.52
OPT
f=223
TT=0.098
T1=0.07
OPT
f=223
TT=0.052
T1=0.05
OPT
f=223
TT=0.031
T1=0.02
OPT
f=223
TT=0.052
T1=0.02
OPT
f=223
TT=0.019
T1=0.01
OPT
f=223
TT=0.426
T1=0.23
OPT
f=223
TT=0.041
T1=0.03
OPT
f=223
TT=0.534
T1=0.26
OPT
f=223
TT=0.338
T1=0.14
No dataOPT
f=223
TT=0.158
T1=0.09
OPT
f=223
TT=0.835
T1=1.16
OPT
f=223
TT=0.325
T1=0.15
No dataOPT
f=223
TT=0.895
T1=0.67
OPT
f=223
TT=0.561
T1=0.55
OPT
f=223
TT=0.019
T1=0.01
OPT
f=223
TT=0.116
T1=0.06
OPT
f=223
TT=0.069
T1=0.05
No dataNo dataNo dataOPT
f=223
TT=0.083
T1=0.04
No dataNo dataOPT
f=223
TT=0.062
T1=0.03
No dataNo dataNo dataOPT
f=223
TT=0.654
T1=0.65
OPT
f=223
TT=0.383
T1=0.19
OPT
f=223
TT=0.506
T1=0.28
OPT
f=223
TT=0.117
T1=0.1
OPT
f=223
TT=0.121
T1=0.1
OPT
f=223
TT=0.773
T1=0.76
OPT
f=223
TT=0.161
T1=0.15
OPT
f=223
TT=0.16
T1=0.15
OPT
f=223
TT=0.572
T1=0.57
No dataNo dataOPT
f=223
TT=0.623
T1=0.62
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=23-Q=293.opb
OPT
f=23
TT=0.005
T1=0
OPT
f=23
TT=0.033
T1=0.03
No dataOPT
f=23
TT=0.005
T1=0
OPT
f=23
TT=7.044
T1=5.16
OPT
f=23
TT=0.148
T1=0.1
OPT
f=23
TT=6.993
T1=5.11
OPT
f=23
TT=0.097
T1=0.08
OPT
f=23
TT=7.951
T1=7.1
OPT
f=23
TT=0.093
T1=0.09
? (TO)

TT=1800.07

? (TO)

TT=1800.08

OPT
f=23
TT=0.012
T1=0.01
OPT
f=23
TT=0.018
T1=0.01
OPT
f=23
TT=0.055
T1=0.04
OPT
f=23
TT=0.024
T1=0.17
OPT
f=23
TT=0.265
T1=0.17
OPT
f=23
TT=0.027
T1=0.02
OPT
f=23
TT=0.325
T1=0.19
OPT
f=23
TT=0.343
T1=0.33
No dataOPT
f=23
TT=0.069
T1=0.07
OPT
f=23
TT=0.555
T1=1.14
OPT
f=23
TT=0.057
T1=0.05
No dataOPT
f=23
TT=1.194
T1=0.67
OPT
f=23
TT=0.366
T1=0.35
OPT
f=23
TT=0.008
T1=0.01
OPT
f=23
TT=0.475
T1=0.31
OPT
f=23
TT=0.377
T1=0.32
No dataNo dataNo dataOPT
f=23
TT=0.043
T1=0.01
No dataNo dataOPT
f=23
TT=0.044
T1=0.01
No dataNo dataNo dataOPT
f=23
TT=1.104
T1=0.65
OPT
f=23
TT=0.244
T1=0.16
OPT
f=23
TT=0.454
T1=0.24
OPT
f=23
TT=0.089
T1=0.07
OPT
f=23
TT=0.097
T1=0.08
OPT
f=23
TT=0.325
T1=0.31
OPT
f=23
TT=0.017
T1=0.01
OPT
f=23
TT=0.016
T1=0.01
OPT
f=23
TT=0.022
T1=0.01
No dataNo dataOPT
f=23
TT=0.022
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=23-Q=521.opb
UNSAT

TT=0.007

UNSAT

TT=0.07

No dataUNSAT

TT=0.007

UNSAT

TT=1.658

UNSAT

TT=0.081

UNSAT

TT=1.56

UNSAT

TT=0.054

UNSAT

TT=1.67

UNSAT

TT=0.052

UNSAT

TT=1.56

UNSAT

TT=0.052

UNSAT

TT=0.034

UNSAT

TT=0.026

UNSAT

TT=0.034

UNSAT

TT=0.041

UNSAT

TT=0.434

UNSAT

TT=0.056

UNSAT

TT=0.544

UNSAT

TT=0.585

No dataUNSAT

TT=0.705

UNSAT

TT=0.934

UNSAT

TT=0.145

No dataUNSAT

TT=0.864

UNSAT

TT=0.542

UNSAT

TT=0.014

UNSAT

TT=0.14

UNSAT

TT=0.138

No dataNo dataNo dataWrong Cert.

TT=0.042

No dataNo dataUNSAT

TT=0.042

No dataNo dataNo dataUNSAT

TT=0.773

UNSAT

TT=0.424

UNSAT

TT=0.483

UNSAT

TT=0.119

UNSAT

TT=0.088

UNSAT

TT=0.732

UNSAT

TT=0.122

UNSAT

TT=0.121

Wrong Cert.

TT=0.022

No dataNo dataUNSAT

TT=41.57

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=251-Q=307.opb
OPT
f=251
TT=0.009
T1=0
OPT
f=251
TT=0.048
T1=0.04
No dataOPT
f=251
TT=0.009
T1=0
OPT
f=251
TT=26.341
T1=8.13
OPT
f=251
TT=0.241
T1=0.15
OPT
f=251
TT=23.06
T1=8.01
OPT
f=251
TT=0.156
T1=0.11
OPT
f=251
TT=8.529
T1=7.43
OPT
f=251
TT=0.103
T1=0.1
OPT
f=251
TT=9.09
T1=8.08
OPT
f=251
TT=0.12
T1=0.12
OPT
f=251
TT=0.048
T1=0.04
OPT
f=251
TT=0.025
T1=0.02
OPT
f=251
TT=0.051
T1=0.03
OPT
f=251
TT=0.017
T1=0.01
OPT
f=251
TT=0.454
T1=0.22
OPT
f=251
TT=0.038
T1=0.03
OPT
f=251
TT=0.583
T1=0.28
OPT
f=251
TT=0.525
T1=0.52
No dataOPT
f=251
TT=0.257
T1=0.13
OPT
f=251
TT=1.172
T1=2.14
OPT
f=251
TT=0.445
T1=0.44
No dataOPT
f=251
TT=1.033
T1=1.18
OPT
f=251
TT=0.345
T1=0.33
OPT
f=251
TT=0.015
T1=0.01
OPT
f=251
TT=0.108
T1=0.04
OPT
f=251
TT=0.054
T1=0.04
No dataNo dataNo dataOPT
f=251
TT=0.062
T1=0.02
No dataNo dataOPT
f=251
TT=0.082
T1=0.03
No dataNo dataNo dataOPT
f=251
TT=0.685
T1=0.65
OPT
f=251
TT=0.393
T1=0.2
OPT
f=251
TT=0.464
T1=0.24
OPT
f=251
TT=0.12
T1=0.11
OPT
f=251
TT=0.125
T1=0.11
OPT
f=251
TT=0.582
T1=0.52
OPT
f=251
TT=0.073
T1=0.03
OPT
f=251
TT=0.071
T1=0.04
?

TT=1799.56

No dataNo data?

TT=1799.82

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=257-Q=331.opb
OPT
f=257
TT=0.01
T1=0
OPT
f=257
TT=0.14
T1=0.14
No dataOPT
f=257
TT=0.01
T1=0
OPT
f=257
TT=23.895
T1=2.4
OPT
f=257
TT=0.2
T1=0.15
OPT
f=257
TT=23.699
T1=2.34
OPT
f=257
TT=0.144
T1=0.11
OPT
f=257
TT=5.928
T1=2.47
OPT
f=257
TT=0.104
T1=0.1
OPT
f=257
TT=5.628
T1=2.34
OPT
f=257
TT=0.115
T1=0.11
OPT
f=257
TT=0.037
T1=0.03
OPT
f=257
TT=0.023
T1=0.01
OPT
f=257
TT=0.07
T1=0.04
OPT
f=257
TT=0.012
T1=0
OPT
f=257
TT=0.407
T1=0.2
OPT
f=257
TT=0.133
T1=0.13
OPT
f=257
TT=0.504
T1=0.21
OPT
f=257
TT=0.42
T1=0.38
No dataOPT
f=257
TT=0.295
T1=0.13
OPT
f=257
TT=1.093
T1=2.16
OPT
f=257
TT=0.153
T1=0.07
No dataOPT
f=257
TT=2.743
T1=1.17
OPT
f=257
TT=0.257
T1=0.04
OPT
f=257
TT=0.011
T1=0.01
OPT
f=257
TT=0.109
T1=0.07
OPT
f=257
TT=0.073
T1=0.05
No dataNo dataNo dataOPT
f=257
TT=0.042
T1=0.01
No dataNo dataOPT
f=257
TT=0.062
T1=0.02
No dataNo dataNo dataOPT
f=257
TT=0.694
T1=0.66
OPT
f=257
TT=0.394
T1=0.19
OPT
f=257
TT=0.484
T1=0.25
OPT
f=257
TT=0.103
T1=0.09
OPT
f=257
TT=0.105
T1=0.09
OPT
f=257
TT=0.63
T1=0.48
OPT
f=257
TT=0.092
T1=0.08
OPT
f=257
TT=0.091
T1=0.08
OPT
f=257
TT=0.053
T1=0.04
No dataNo dataOPT
f=257
TT=0.063
T1=0.05
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=269-Q=431.opb
OPT
f=269
TT=0.006
T1=0
OPT
f=269
TT=0.102
T1=0.08
No dataOPT
f=269
TT=0.006
T1=0
OPT
f=269
TT=12.777
T1=6.52
OPT
f=269
TT=0.21
T1=0.12
OPT
f=269
TT=12.847
T1=6.6
OPT
f=269
TT=0.135
T1=0.09
OPT
f=269
TT=8.638
T1=6.87
OPT
f=269
TT=0.099
T1=0.1
OPT
f=269
TT=8.355
T1=6.58
OPT
f=269
TT=0.11
T1=0.11
OPT
f=269
TT=0.039
T1=0.04
OPT
f=269
TT=0.022
T1=0.01
OPT
f=269
TT=0.05
T1=0.03
OPT
f=269
TT=0.009
T1=0
OPT
f=269
TT=0.414
T1=0.22
OPT
f=269
TT=0.1
T1=0.07
OPT
f=269
TT=0.414
T1=0.21
OPT
f=269
TT=0.307
T1=0.3
No dataOPT
f=269
TT=0.203
T1=0.09
OPT
f=269
TT=1.035
T1=2.14
OPT
f=269
TT=0.064
T1=0.05
No dataOPT
f=269
TT=1.624
T1=1.17
OPT
f=269
TT=0.405
T1=0.39
OPT
f=269
TT=0.013
T1=0.01
OPT
f=269
TT=0.108
T1=0.03
OPT
f=269
TT=0.071
T1=0.03
No dataNo dataNo dataOPT
f=269
TT=0.062
T1=0.02
No dataNo dataOPT
f=269
TT=0.073
T1=0.03
No dataNo dataNo dataOPT
f=269
TT=0.713
T1=0.65
OPT
f=269
TT=0.313
T1=0.18
OPT
f=269
TT=0.413
T1=0.2
OPT
f=269
TT=0.112
T1=0.1
OPT
f=269
TT=0.083
T1=0.07
OPT
f=269
TT=0.299
T1=0.24
OPT
f=269
TT=0.052
T1=0.04
OPT
f=269
TT=0.051
T1=0.04
?

TT=1799.6

No dataNo data?

TT=1799.56

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=29-Q=521.opb
UNSAT

TT=0.008

UNSAT

TT=0.062

No dataUNSAT

TT=0.008

UNSAT

TT=10.062

UNSAT

TT=0.084

UNSAT

TT=9.98

UNSAT

TT=0.062

UNSAT

TT=10.57

UNSAT

TT=0.06

UNSAT

TT=9.96

UNSAT

TT=0.058

UNSAT

TT=0.033

UNSAT

TT=0.025

UNSAT

TT=0.037

UNSAT

TT=0.021

UNSAT

TT=0.454

UNSAT

TT=0.055

UNSAT

TT=0.555

UNSAT

TT=0.783

No dataUNSAT

TT=1.165

UNSAT

TT=1.034

UNSAT

TT=0.068

No dataUNSAT

TT=0.964

UNSAT

TT=0.555

UNSAT

TT=0.013

UNSAT

TT=0.139

UNSAT

TT=0.138

No dataNo dataNo dataWrong Cert.

TT=0.042

No dataNo dataUNSAT

TT=0.042

No dataNo dataNo dataUNSAT

TT=0.804

UNSAT

TT=0.434

UNSAT

TT=0.474

UNSAT

TT=0.132

UNSAT

TT=0.135

UNSAT

TT=0.665

UNSAT

TT=0.149

UNSAT

TT=0.148

Wrong Cert.

TT=0.024

No dataNo dataUNSAT

TT=0.212

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=307-Q=347.opb
OPT
f=307
TT=0.009
T1=0
OPT
f=307
TT=0.084
T1=0.08
No dataOPT
f=307
TT=0.009
T1=0
OPT
f=307
TT=22.066
T1=2.84
OPT
f=307
TT=0.209
T1=0.18
OPT
f=307
TT=22.353
T1=2.85
OPT
f=307
TT=0.14
T1=0.13
OPT
f=307
TT=8.167
T1=2.94
OPT
f=307
TT=0.111
T1=0.1
OPT
f=307
TT=8.144
T1=2.86
OPT
f=307
TT=0.125
T1=0.12
OPT
f=307
TT=0.033
T1=0.03
OPT
f=307
TT=0.022
T1=0.02
OPT
f=307
TT=0.047
T1=0.03
OPT
f=307
TT=0.026
T1=0.02
OPT
f=307
TT=0.415
T1=0.23
OPT
f=307
TT=0.08
T1=0.07
OPT
f=307
TT=0.525
T1=0.26
OPT
f=307
TT=0.415
T1=0.39
No dataOPT
f=307
TT=0.837
T1=0.35
OPT
f=307
TT=1.124
T1=1.14
OPT
f=307
TT=0.372
T1=0.35
No dataOPT
f=307
TT=1.003
T1=1.17
OPT
f=307
TT=0.317
T1=0.24
OPT
f=307
TT=0.009
T1=0.01
OPT
f=307
TT=0.097
T1=0.08
OPT
f=307
TT=0.07
T1=0.05
No dataNo dataNo dataOPT
f=307
TT=0.062
T1=0.03
No dataNo dataOPT
f=307
TT=0.062
T1=0.02
No dataNo dataNo dataOPT
f=307
TT=0.814
T1=0.65
OPT
f=307
TT=0.433
T1=0.22
OPT
f=307
TT=0.475
T1=0.25
OPT
f=307
TT=0.096
T1=0.08
OPT
f=307
TT=0.098
T1=0.08
OPT
f=307
TT=0.579
T1=0.57
OPT
f=307
TT=0.111
T1=0.1
OPT
f=307
TT=0.109
T1=0.1
OPT
f=307
TT=0.063
T1=0.05
No dataNo dataOPT
f=307
TT=0.073
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=331-Q=347.opb
OPT
f=331
TT=0.008
T1=0
OPT
f=331
TT=0.101
T1=0.09
No dataOPT
f=331
TT=0.008
T1=0
OPT
f=331
TT=21.012
T1=12.48
OPT
f=331
TT=0.238
T1=0.19
OPT
f=331
TT=20.316
T1=12.51
? (problem)

TT=0.06

OPT
f=331
TT=8.034
T1=6.65
? (problem)

TT=0.059

OPT
f=331
TT=7.812
T1=6.45
? (problem)

TT=0.063

OPT
f=331
TT=0.031
T1=0.03
OPT
f=331
TT=0.03
T1=0.02
OPT
f=331
TT=0.048
T1=0.03
OPT
f=331
TT=0.029
T1=0.02
OPT
f=331
TT=0.475
T1=0.23
OPT
f=331
TT=0.083
T1=0.07
OPT
f=331
TT=0.545
T1=0.27
OPT
f=331
TT=0.483
T1=0.47
No dataOPT
f=331
TT=0.225
T1=0.11
OPT
f=331
TT=1.156
T1=2.17
OPT
f=331
TT=0.206
T1=0.06
No dataOPT
f=331
TT=2.013
T1=1.17
OPT
f=331
TT=0.57
T1=0.56
OPT
f=331
TT=0.017
T1=0.01
OPT
f=331
TT=0.132
T1=0.03
OPT
f=331
TT=0.075
T1=0.03
No dataNo dataNo dataOPT
f=331
TT=0.082
T1=0.04
No dataNo dataOPT
f=331
TT=0.063
T1=0.02
No dataNo dataNo dataOPT
f=331
TT=0.693
T1=1.15
OPT
f=331
TT=0.394
T1=0.2
SAT
f=331
TT=0.493
T1=0.25
OPT
f=331
TT=0.091
T1=0.08
OPT
f=331
TT=0.103
T1=0.09
OPT
f=331
TT=0.33
T1=0.14
OPT
f=331
TT=0.12
T1=0.11
OPT
f=331
TT=0.12
T1=0.11
?

TT=1799.55

No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=347-Q=379.opb
OPT
f=347
TT=0.007
T1=0
OPT
f=347
TT=0.064
T1=0.06
No dataOPT
f=347
TT=0.007
T1=0
OPT
f=347
TT=19.343
T1=4.75
OPT
f=347
TT=0.234
T1=0.16
OPT
f=347
TT=19.268
T1=5.89
? (problem)

TT=0.067

OPT
f=347
TT=7.808
T1=4.94
? (problem)

TT=0.066

OPT
f=347
TT=7.732
T1=4.99
? (problem)

TT=0.067

OPT
f=347
TT=0.019
T1=0.02
OPT
f=347
TT=0.022
T1=0.02
OPT
f=347
TT=0.06
T1=0.04
OPT
f=347
TT=0.023
T1=0.16
OPT
f=347
TT=0.384
T1=0.23
OPT
f=347
TT=0.063
T1=0.06
OPT
f=347
TT=0.462
T1=0.25
OPT
f=347
TT=0.419
T1=0.41
No dataOPT
f=347
TT=0.235
T1=0.11
OPT
f=347
TT=1.064
T1=2.16
OPT
f=347
TT=0.05
T1=0.04
No dataOPT
f=347
TT=2.438
T1=1.19
OPT
f=347
TT=0.302
T1=0.29
OPT
f=347
TT=0.012
T1=0.01
OPT
f=347
TT=0.102
T1=0.06
OPT
f=347
TT=0.054
T1=0.04
No dataNo dataNo dataOPT
f=347
TT=0.102
T1=0.04
No dataNo dataOPT
f=347
TT=0.102
T1=0.05
No dataNo dataNo dataOPT
f=347
TT=1.925
T1=1.15
OPT
f=347
TT=0.424
T1=0.21
OPT
f=347
TT=0.465
T1=0.26
OPT
f=347
TT=0.097
T1=0.08
OPT
f=347
TT=0.097
T1=0.08
OPT
f=347
TT=0.464
T1=0.29
OPT
f=347
TT=0.117
T1=0.1
OPT
f=347
TT=0.116
T1=0.1
OPT
f=347
TT=0.072
T1=0.06
No dataNo dataOPT
f=347
TT=0.062
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=409-Q=499.opb
OPT
f=409
TT=0.002
T1=0
OPT
f=409
TT=0.014
T1=0.01
No dataOPT
f=409
TT=0.005
T1=0
OPT
f=409
TT=1.185
T1=0.52
OPT
f=409
TT=0.231
T1=0.16
? (problem)

TT=0.341

? (problem)

TT=0.079

? (problem)

TT=0.34

? (problem)

TT=0.079

? (problem)

TT=0.346

? (problem)

TT=0.078

OPT
f=409
TT=0.011
T1=0.01
OPT
f=409
TT=0.018
T1=0.01
OPT
f=409
TT=0.051
T1=0.04
OPT
f=409
TT=0.011
T1=0
OPT
f=409
TT=0.236
T1=0.16
OPT
f=409
TT=0.016
T1=0.01
OPT
f=409
TT=0.265
T1=0.16
OPT
f=409
TT=0.254
T1=0.25
No dataOPT
f=409
TT=0.034
T1=0.04
OPT
f=409
TT=0.395
T1=1.14
OPT
f=409
TT=0.046
T1=0.04
No dataOPT
f=409
TT=0.424
T1=0.67
OPT
f=409
TT=0.153
T1=0.14
OPT
f=409
TT=0.008
T1=0
OPT
f=409
TT=0.085
T1=0.05
OPT
f=409
TT=0.053
T1=0.04
No dataNo dataNo dataOPT
f=409
TT=0.002
T1=0.01
No dataNo dataOPT
f=409
TT=0.004
T1=0.01
No dataNo dataNo dataOPT
f=409
TT=0.324
T1=0.65
OPT
f=409
TT=0.212
T1=0.15
OPT
f=409
TT=0.243
T1=0.16
OPT
f=409
TT=0.083
T1=0.07
OPT
f=409
TT=0.082
T1=0.07
OPT
f=409
TT=0.079
T1=0.06
OPT
f=409
TT=0.015
T1=0.01
OPT
f=409
TT=0.016
T1=0.01
OPT
f=409
TT=0.002
T1=0.01
No dataNo dataOPT
f=409
TT=0.002
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=47-Q=197.opb
OPT
f=47
TT=0.004
T1=0
OPT
f=47
TT=0.04
T1=0.03
No dataOPT
f=47
TT=0.004
T1=0
OPT
f=47
TT=12.612
T1=5.14
OPT
f=47
TT=0.149
T1=0.08
OPT
f=47
TT=12.041
T1=5.05
OPT
f=47
TT=0.103
T1=0.07
OPT
f=47
TT=2.482
T1=2.17
OPT
f=47
TT=0.084
T1=0.07
? (TO)

TT=1800.06

OPT
f=47
TT=0.096
T1=0.08
OPT
f=47
TT=0.033
T1=0.03
OPT
f=47
TT=0.018
T1=0.01
OPT
f=47
TT=0.046
T1=0.03
OPT
f=47
TT=0.028
T1=0.02
OPT
f=47
TT=0.335
T1=0.17
OPT
f=47
TT=0.035
T1=0.03
OPT
f=47
TT=0.373
T1=0.19
OPT
f=47
TT=0.563
T1=0.55
No dataOPT
f=47
TT=0.284
T1=0.14
OPT
f=47
TT=0.922
T1=2.14
OPT
f=47
TT=0.068
T1=0.06
No dataOPT
f=47
TT=0.824
T1=1.17
OPT
f=47
TT=0.515
T1=0.5
OPT
f=47
TT=0.009
T1=0.01
OPT
f=47
TT=0.364
T1=0.21
OPT
f=47
TT=0.276
T1=0.24
No dataNo dataNo dataOPT
f=47
TT=0.082
T1=0.03
No dataNo dataOPT
f=47
TT=0.053
T1=0.02
No dataNo dataNo dataOPT
f=47
TT=0.513
T1=0.65
OPT
f=47
TT=0.303
T1=0.18
SAT
f=47
TT=0.394
T1=0.21
OPT
f=47
TT=0.14
T1=0.13
OPT
f=47
TT=0.135
T1=0.12
OPT
f=47
TT=0.493
T1=0.48
OPT
f=47
TT=0.03
T1=0.02
OPT
f=47
TT=0.031
T1=0.02
OPT
f=47
TT=0.071
T1=0.06
No dataNo dataOPT
f=47
TT=0.073
T1=0.06
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=47-Q=487.opb
OPT
f=47
TT=0.002
T1=0
OPT
f=47
TT=0.035
T1=0.03
No dataOPT
f=47
TT=0.004
T1=0
OPT
f=47
TT=1.496
T1=1.09
OPT
f=47
TT=0.189
T1=0.12
OPT
f=47
TT=1.463
T1=1.08
OPT
f=47
TT=0.107
T1=0.1
OPT
f=47
TT=1.242
T1=1.13
OPT
f=47
TT=0.106
T1=0.1
OPT
f=47
TT=1.21
T1=1.08
? (TO)

TT=1800.08

OPT
f=47
TT=0.015
T1=0.01
OPT
f=47
TT=0.026
T1=0.02
OPT
f=47
TT=0.053
T1=0.03
OPT
f=47
TT=0.032
T1=0.03
OPT
f=47
TT=0.194
T1=0.14
OPT
f=47
TT=0.029
T1=0.02
OPT
f=47
TT=0.225
T1=0.15
OPT
f=47
TT=0.137
T1=0.13
No dataOPT
f=47
TT=0.232
T1=0.12
OPT
f=47
TT=0.414
T1=1.15
OPT
f=47
TT=0.446
T1=0.44
No dataOPT
f=47
TT=0.323
T1=0.67
OPT
f=47
TT=0.23
T1=0.22
OPT
f=47
TT=0.014
T1=0.01
OPT
f=47
TT=0.121
T1=0.07
OPT
f=47
TT=0.092
T1=0.07
No dataNo dataNo dataOPT
f=47
TT=0.042
T1=0.01
No dataNo dataOPT
f=47
TT=0.002
T1=0.01
No dataNo dataNo dataOPT
f=47
TT=0.224
T1=0.65
OPT
f=47
TT=0.204
T1=0.14
OPT
f=47
TT=0.404
T1=0.22
OPT
f=47
TT=0.117
T1=0.1
OPT
f=47
TT=0.092
T1=0.08
OPT
f=47
TT=0.372
T1=0.36
OPT
f=47
TT=0.009
T1=0
OPT
f=47
TT=0.009
T1=0
OPT
f=47
TT=0.002
T1=0.01
No dataNo dataOPT
f=47
TT=0.002
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=53-Q=127.opb
OPT
f=53
TT=0.003
T1=0
OPT
f=53
TT=0.031
T1=0.02
No dataOPT
f=53
TT=0.003
T1=0
OPT
f=53
TT=11.045
T1=1.64
OPT
f=53
TT=0.161
T1=0.08
OPT
f=53
TT=11.102
T1=1.55
OPT
f=53
TT=0.106
T1=0.07
OPT
f=53
TT=3.523
T1=1.6
OPT
f=53
TT=0.084
T1=0.07
OPT
f=53
TT=3.831
T1=1.52
OPT
f=53
TT=0.097
T1=0.07
OPT
f=53
TT=0.016
T1=0.01
OPT
f=53
TT=0.019
T1=0.01
OPT
f=53
TT=0.055
T1=0.04
OPT
f=53
TT=0.019
T1=0.01
OPT
f=53
TT=0.323
T1=0.18
OPT
f=53
TT=0.031
T1=0.02
OPT
f=53
TT=0.515
T1=0.25
OPT
f=53
TT=0.445
T1=0.41
No dataOPT
f=53
TT=0.041
T1=0.04
OPT
f=53
TT=0.724
T1=1.18
OPT
f=53
TT=0.041
T1=0.03
No dataOPT
f=53
TT=0.693
T1=0.67
OPT
f=53
TT=0.421
T1=0.29
OPT
f=53
TT=0.008
T1=0.01
OPT
f=53
TT=1.004
T1=0.5
OPT
f=53
TT=0.719
T1=0.56
No dataNo dataNo dataWrong Cert.

TT=0.002

No dataNo dataOPT
f=53
TT=0.082
T1=0.03
No dataNo dataNo dataOPT
f=53
TT=5.596
T1=0.67
OPT
f=53
TT=0.313
T1=0.17
SAT
f=53
TT=0.435
T1=0.23
OPT
f=53
TT=0.107
T1=0.09
OPT
f=53
TT=0.082
T1=0.07
OPT
f=53
TT=0.261
T1=0.23
OPT
f=53
TT=0.039
T1=0.03
OPT
f=53
TT=0.038
T1=0.03
Wrong Cert.

TT=0.001

No dataNo dataOPT
f=53
TT=126.57
T1=126.64
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=59-Q=419.opb
OPT
f=59
TT=0.005
T1=0
OPT
f=59
TT=0.034
T1=0.03
No dataOPT
f=59
TT=0.005
T1=0
OPT
f=59
TT=10.418
T1=8.03
OPT
f=59
TT=0.153
T1=0.09
OPT
f=59
TT=10.418
T1=8.06
OPT
f=59
TT=0.104
T1=0.08
OPT
f=59
TT=3.596
T1=3.58
OPT
f=59
TT=0.089
T1=0.08
? (TO)

TT=1722.65

OPT
f=59
TT=0.108
T1=0.09
OPT
f=59
TT=0.018
T1=0.01
OPT
f=59
TT=0.024
T1=0.02
OPT
f=59
TT=0.063
T1=0.05
OPT
f=59
TT=0.028
T1=0.02
OPT
f=59
TT=0.266
T1=0.17
OPT
f=59
TT=0.032
T1=0.03
OPT
f=59
TT=0.322
T1=0.18
OPT
f=59
TT=0.301
T1=0.27
No dataOPT
f=59
TT=0.087
T1=0.07
OPT
f=59
TT=0.584
T1=1.14
OPT
f=59
TT=0.064
T1=0.05
No dataOPT
f=59
TT=0.595
T1=0.67
OPT
f=59
TT=0.38
T1=0.35
OPT
f=59
TT=0.013
T1=0.01
OPT
f=59
TT=0.151
T1=0.1
OPT
f=59
TT=0.178
T1=0.14
No dataNo dataNo dataOPT
f=59
TT=0.042
T1=0.01
No dataNo dataOPT
f=59
TT=0.042
T1=0.01
No dataNo dataNo dataOPT
f=59
TT=0.443
T1=0.65
OPT
f=59
TT=0.243
T1=0.16
SAT
f=59
TT=0.434
T1=0.23
OPT
f=59
TT=0.109
T1=0.1
OPT
f=59
TT=0.087
T1=0.07
OPT
f=59
TT=0.391
T1=0.36
OPT
f=59
TT=0.019
T1=0.01
OPT
f=59
TT=0.019
T1=0.01
OPT
f=59
TT=0.022
T1=0.01
No dataNo dataOPT
f=59
TT=0.022
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=61-Q=163.opb
OPT
f=61
TT=0.004
T1=0
OPT
f=61
TT=0.03
T1=0.02
No dataOPT
f=61
TT=0.004
T1=0
OPT
f=61
TT=14.231
T1=4.74
OPT
f=61
TT=0.154
T1=0.08
OPT
f=61
TT=13.673
T1=4.72
OPT
f=61
TT=0.108
T1=0.07
OPT
f=61
TT=7.261
T1=7.05
OPT
f=61
TT=0.084
T1=0.08
? (TO)

TT=1800.03

OPT
f=61
TT=0.093
T1=0.07
OPT
f=61
TT=0.02
T1=0.02
OPT
f=61
TT=0.021
T1=0.02
OPT
f=61
TT=0.046
T1=0.03
OPT
f=61
TT=0.026
T1=0.02
OPT
f=61
TT=0.355
T1=0.17
OPT
f=61
TT=0.03
T1=0.02
OPT
f=61
TT=0.413
T1=0.18
OPT
f=61
TT=0.428
T1=0.41
No dataOPT
f=61
TT=0.219
T1=0.1
OPT
f=61
TT=0.665
T1=1.14
OPT
f=61
TT=0.073
T1=0.06
No dataOPT
f=61
TT=0.635
T1=0.67
OPT
f=61
TT=0.355
T1=0.34
OPT
f=61
TT=0.013
T1=0.01
OPT
f=61
TT=0.308
T1=0.12
OPT
f=61
TT=0.181
T1=0.13
No dataNo dataNo dataOPT
f=61
TT=0.062
T1=0.02
No dataNo dataOPT
f=61
TT=0.052
T1=0.02
No dataNo dataNo dataOPT
f=61
TT=0.553
T1=0.7
OPT
f=61
TT=0.304
T1=0.16
SAT
f=61
TT=0.402
T1=0.21
OPT
f=61
TT=0.103
T1=0.09
OPT
f=61
TT=0.104
T1=0.09
OPT
f=61
TT=0.609
T1=0.54
OPT
f=61
TT=0.04
T1=0.02
OPT
f=61
TT=0.038
T1=0.02
OPT
f=61
TT=19.43
T1=19.48
No dataNo dataOPT
f=61
TT=17.52
T1=17.51
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=67-Q=191.opb
OPT
f=67
TT=0.004
T1=0
OPT
f=67
TT=0.047
T1=0.04
No dataOPT
f=67
TT=0.004
T1=0
OPT
f=67
TT=13.705
T1=1.58
OPT
f=67
TT=0.179
T1=0.09
OPT
f=67
TT=13.96
T1=1.49
OPT
f=67
TT=0.117
T1=0.08
OPT
f=67
TT=4.406
T1=1.55
OPT
f=67
TT=0.086
T1=0.08
OPT
f=67
TT=5.211
T1=1.51
OPT
f=67
TT=0.102
T1=0.08
OPT
f=67
TT=0.02
T1=0.02
OPT
f=67
TT=0.022
T1=0.01
OPT
f=67
TT=0.047
T1=0.03
OPT
f=67
TT=0.022
T1=0.01
OPT
f=67
TT=0.354
T1=0.2
OPT
f=67
TT=0.041
T1=0.04
OPT
f=67
TT=0.454
T1=0.21
OPT
f=67
TT=0.519
T1=0.48
No dataOPT
f=67
TT=0.744
T1=0.32
OPT
f=67
TT=1.164
T1=2.15
OPT
f=67
TT=0.056
T1=0.05
No dataOPT
f=67
TT=0.944
T1=1.17
OPT
f=67
TT=0.409
T1=0.4
OPT
f=67
TT=0.015
T1=0.01
OPT
f=67
TT=0.36
T1=0.13
OPT
f=67
TT=0.183
T1=0.13
No dataNo dataNo dataWrong Cert.

TT=0.052

No dataNo dataOPT
f=67
TT=0.042
T1=0.01
No dataNo dataNo dataOPT
f=67
TT=0.625
T1=1.16
OPT
f=67
TT=0.364
T1=0.2
OPT
f=67
TT=0.424
T1=0.2
OPT
f=67
TT=0.113
T1=0.1
OPT
f=67
TT=0.113
T1=0.1
OPT
f=67
TT=0.422
T1=0.41
OPT
f=67
TT=0.081
T1=0.08
OPT
f=67
TT=0.08
T1=0.08
Wrong Cert.

TT=0.033

No dataNo dataOPT
f=67
TT=0.042
T1=0.03
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=79-Q=257.opb
OPT
f=79
TT=0.007
T1=0
OPT
f=79
TT=0.09
T1=0.09
No dataOPT
f=79
TT=0.009
T1=0
OPT
f=79
TT=16.44
T1=3.4
OPT
f=79
TT=0.202
T1=0.11
OPT
f=79
TT=16.662
T1=3.38
OPT
f=79
TT=0.126
T1=0.09
OPT
f=79
TT=10.459
T1=9.48
OPT
f=79
TT=0.099
T1=0.1
? (TO)

TT=1800.04

? (TO)

TT=1800.09

OPT
f=79
TT=0.033
T1=0.03
OPT
f=79
TT=0.016
T1=0.01
OPT
f=79
TT=0.06
T1=0.04
OPT
f=79
TT=0.018
T1=0.01
OPT
f=79
TT=0.392
T1=0.22
OPT
f=79
TT=0.075
T1=0.07
OPT
f=79
TT=0.413
T1=0.21
OPT
f=79
TT=0.326
T1=0.3
No dataOPT
f=79
TT=0.176
T1=0.08
OPT
f=79
TT=0.973
T1=2.14
OPT
f=79
TT=0.072
T1=0.06
No dataOPT
f=79
TT=0.893
T1=1.17
OPT
f=79
TT=0.457
T1=0.44
OPT
f=79
TT=0.007
T1=0.01
OPT
f=79
TT=0.163
T1=0.07
OPT
f=79
TT=0.09
T1=0.07
No dataNo dataNo dataOPT
f=79
TT=0.073
T1=0.03
No dataNo dataOPT
f=79
TT=0.102
T1=0.04
No dataNo dataNo dataOPT
f=79
TT=0.865
T1=0.67
OPT
f=79
TT=0.364
T1=0.19
SAT
f=79
TT=0.373
T1=0.19
OPT
f=79
TT=0.114
T1=0.1
OPT
f=79
TT=0.113
T1=0.1
OPT
f=79
TT=0.482
T1=0.28
? (exit code)

TT=0.031

OPT
f=79
TT=0.034
T1=0.03
OPT
f=79
TT=7.351
T1=7.36
No dataNo dataOPT
f=79
TT=19.51
T1=19.56
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=7-Q=31.opb
OPT
f=1
TT=0.002
T1=0
OPT
f=1
TT=0.006
T1=0
No dataOPT
f=1
TT=0.002
T1=0
OPT
f=1
TT=0.368
T1=0.34
OPT
f=1
TT=0.093
T1=0.08
OPT
f=1
TT=0.316
T1=0.31
? (problem)

TT=0.03

OPT
f=1
TT=0.312
T1=0.31
? (problem)

TT=0.027

? (TO)

TT=1800.06

? (problem)

TT=0.029

OPT
f=1
TT=0.008
T1=0
OPT
f=1
TT=0.007
T1=0
OPT
f=1
TT=0.061
T1=0.04
OPT
f=1
TT=0.005
T1=0
OPT
f=1
TT=0.163
T1=0.14
OPT
f=1
TT=0.006
T1=0
OPT
f=1
TT=0.193
T1=0.14
OPT
f=1
TT=0.025
T1=0.02
No dataOPT
f=1
TT=0.01
T1=0
OPT
f=1
TT=0.215
T1=1.14
OPT
f=1
TT=0.03
T1=0.02
No dataOPT
f=1
TT=0.215
T1=0.67
OPT
f=1
TT=0.044
T1=0.03
OPT
f=1
TT=0.004
T1=0
OPT
f=1
TT=0.091
T1=0.08
OPT
f=1
TT=0.133
T1=0.08
No dataNo dataNo dataOPT
f=1
TT=0.003
T1=0
No dataNo dataOPT
f=1
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=1
TT=0.205
T1=0.65
OPT
f=1
TT=0.184
T1=0.14
Wrong Cert.

TT=0.254

OPT
f=1
TT=0.045
T1=0.03
OPT
f=1
TT=0.045
T1=0.03
OPT
f=1
TT=0.053
T1=0.04
OPT
f=1
TT=0.007
T1=0
OPT
f=1
TT=0.006
T1=0
OPT
f=1
TT=0.002
T1=0
No dataNo dataOPT
f=1
TT=0.003
T1=0
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=83-Q=449.opb
OPT
f=83
TT=0.008
T1=0.01
OPT
f=83
TT=0.079
T1=0.07
No dataOPT
f=83
TT=0.008
T1=0.01
OPT
f=83
TT=20.843
T1=17.57
OPT
f=83
TT=0.196
T1=0.12
OPT
f=83
TT=20.892
T1=17.63
OPT
f=83
TT=0.126
T1=0.1
OPT
f=83
TT=11.274
T1=11.13
OPT
f=83
TT=0.116
T1=0.11
? (TO)

TT=1800.16

? (TO)

TT=1800.05

OPT
f=83
TT=0.017
T1=0.01
OPT
f=83
TT=0.026
T1=0.02
OPT
f=83
TT=0.038
T1=0.03
OPT
f=83
TT=0.026
T1=0.02
OPT
f=83
TT=0.254
T1=0.16
OPT
f=83
TT=0.066
T1=0.06
OPT
f=83
TT=0.285
T1=0.17
OPT
f=83
TT=0.206
T1=0.2
No dataOPT
f=83
TT=0.043
T1=0.04
OPT
f=83
TT=0.633
T1=1.14
OPT
f=83
TT=0.074
T1=0.06
No dataOPT
f=83
TT=0.664
T1=0.67
OPT
f=83
TT=0.25
T1=0.24
OPT
f=83
TT=0.013
T1=0.01
OPT
f=83
TT=0.101
T1=0.05
OPT
f=83
TT=0.08
T1=0.07
No dataNo dataNo dataOPT
f=83
TT=0.002
T1=0.01
No dataNo dataOPT
f=83
TT=0.043
T1=0.01
No dataNo dataNo dataOPT
f=83
TT=0.303
T1=0.65
OPT
f=83
TT=0.223
T1=0.15
OPT
f=83
TT=0.343
T1=0.21
OPT
f=83
TT=0.115
T1=0.1
OPT
f=83
TT=0.114
T1=0.1
OPT
f=83
TT=0.362
T1=0.33
OPT
f=83
TT=0.024
T1=0.02
OPT
f=83
TT=0.024
T1=0.02
OPT
f=83
TT=0.022
T1=0.01
No dataNo dataOPT
f=83
TT=0.022
T1=0.01
normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=83-Q=89.opb
OPT
f=83
TT=0.003
T1=0
OPT
f=83
TT=0.051
T1=0.04
No dataOPT
f=83
TT=0.003
T1=0
OPT
f=83
TT=15.764
T1=0.98
OPT
f=83
TT=0.171
T1=0.14
OPT
f=83
TT=15.728
T1=0.98
OPT
f=83
TT=0.116
T1=0.1
OPT
f=83
TT=4.199
T1=1.02
OPT
f=83
TT=0.088
T1=0.08
OPT
f=83
TT=6.294
T1=1
OPT
f=83
TT=0.096
T1=0.09
OPT
f=83
TT=0.027
T1=0.03
OPT
f=83
TT=0.019
T1=0.01
OPT
f=83
TT=0.043
T1=0.02
OPT
f=83
TT=0.018
T1=0.01
OPT
f=83
TT=0.374
T1=0.24
OPT
f=83
TT=0.042
T1=0.04
OPT
f=83
TT=0.505
T1=0.25
OPT
f=83
TT=0.651
T1=0.44
No dataOPT
f=83
TT=0.218
T1=0.11
OPT
f=83
TT=0.914
T1=2.14
OPT
f=83
TT=0.056
T1=0.05
No dataOPT
f=83
TT=3.505
T1=1.17
OPT
f=83
TT=0.48
T1=0.43
OPT
f=83
TT=0.008
T1=0
OPT
f=83
TT=1.2
T1=0.88
OPT
f=83
TT=0.69
T1=0.53
No dataNo dataNo dataWrong Cert.

TT=0.002

No dataNo dataOPT
f=83
TT=0.062
T1=0.02
No dataNo dataNo dataOPT
f=83
TT=4.011
T1=1.4
OPT
f=83
TT=0.374
T1=0.19
OPT
f=83
TT=0.443
T1=0.24
OPT
f=83
TT=0.103
T1=0.09
OPT
f=83
TT=0.082
T1=0.07
OPT
f=83
TT=0.369
T1=0.33
OPT
f=83
TT=0.076
T1=0.06
OPT
f=83
TT=0.076
T1=0.06
Wrong Cert.

TT=0.003

No dataNo data?

TT=1799.86

normalized-PB06/OPT-SMALLINT/
submitted-PB06/roussel/factor/
normalized-factor-size=9-P=89-Q=317.opb
OPT
f=89
TT=0.006
T1=0
OPT
f=89
TT=0.034
T1=0.03
No dataOPT
f=89
TT=0.006
T1=0
OPT
f=89
TT=19.655
T1=7.93
OPT
f=89
TT=0.202
T1=0.11
OPT
f=89
TT=19.628
T1=7.93
OPT
f=89
TT=0.121
T1=0.09
OPT
f=89
TT=3.254
T1=3.14
OPT
f=89
TT=0.099
T1=0.1
? (TO)

TT=1800.08

? (TO)

TT=1800.08

OPT
f=89
TT=0.033
T1=0.03
OPT
f=89
TT=0.026
T1=0.02
OPT
f=89
TT=0.056
T1=0.04
OPT
f=89
TT=0.029
T1=0.02
OPT
f=89
TT=0.334
T1=0.17
OPT
f=89
TT=0.028
T1=0.02
OPT
f=89
TT=0.494
T1=0.25
OPT
f=89
TT=0.392
T1=0.38
No dataOPT
f=89
TT=0.166
T1=0.09
OPT
f=89
TT=0.903
T1=1.15
OPT
f=89
TT=0.066
T1=0.06
No dataOPT
f=89
TT=1.063
T1=0.67
OPT
f=89
TT=0.411
T1=0.4
OPT
f=89
TT=0.016
T1=0.01
OPT
f=89
TT=0.178
T1=0.09
OPT
f=89
TT=0.153
T1=0.1
No dataNo dataNo dataOPT
f=89
TT=0.062
T1=0.02
No dataNo dataOPT
f=89
TT=0.042
T1=0.02
No dataNo dataNo dataOPT
f=89
TT=0.714
T1=1.15
OPT
f=89
TT=0.334
T1=0.18
OPT
f=89
TT=0.494
T1=0.25
OPT
f=89
TT=0.102
T1=0.09
OPT
f=89
TT=0.113
T1=0.09
OPT
f=89
TT=0.672
T1=0.65
OPT
f=89
TT=0.051
T1=0.04
OPT
f=89
TT=0.051
T1=0.05
?

TT=1799.58

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb30-15-opb/normalized-frb30-15-1.opb
OPT
f=-30
TT=19.787
T1=18.87
SAT
f=-25
TT=1798.01
T1=89.8
No dataSAT (TO)
f=-27
TT=1800.07
T1=391.49
OPT
f=-30
TT=20.063
T1=20.06
OPT
f=-30
TT=20.077
T1=20.19
OPT
f=-30
TT=19.944
T1=20.18
OPT
f=-30
TT=19.787
T1=19.95
OPT
f=-30
TT=20.293
T1=18.91
OPT
f=-30
TT=20.51
T1=19.14
OPT
f=-30
TT=20.289
T1=19.1
OPT
f=-30
TT=20.206
T1=18.96
SAT (TO)
f=-25
TT=1800.03
T1=6.56
OPT
f=-30
TT=91.3
T1=62.29
? (TO)

TT=1800.28

SAT
f=-16
TT=1783.01
T1=1783.3
? (exit code)

TT=1184.69

SAT
f=-25
TT=1798
T1=30.4
SAT (TO)
f=-25
TT=1800.91
T1=1.38
SAT
f=-28
TT=1794.17
T1=502.23
No data? (TO)

TT=1800.08

SAT (TO)
f=-26
TT=1800.01
T1=13.55
SAT
f=-28
TT=1789.85
T1=486.1
No dataSAT (TO)
f=-26
TT=1800.58
T1=45.92
OPT
f=-30
TT=1459.94
T1=1460.14
OPT
f=-30
TT=109.659
T1=54.9
OPT
f=-30
TT=19.795
T1=19.8
OPT
f=-30
TT=20.239
T1=18.87
No dataNo dataNo dataOPT
f=-30
TT=372.17
T1=186.26
No dataNo dataOPT
f=-30
TT=381.379
T1=190.7
No dataNo dataNo dataSAT (TO)
f=-24
TT=1800.5
T1=24.24
SAT (TO)
f=-21
TT=1800.67
T1=0.47
SAT (TO)
f=-26
TT=1800.04
T1=6.35
SAT
f=-28
TT=1796.9
T1=198.07
SAT
f=-28
TT=1796.86
T1=193.7
SAT
f=-28
TT=1796.86
T1=192.13
? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.61

No dataNo data?

TT=1799.81

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb30-15-opb/normalized-frb30-15-3.opb
OPT
f=-30
TT=26.055
T1=25.82
SAT
f=-26
TT=1798.02
T1=3.28
No dataSAT (TO)
f=-28
TT=1800.06
T1=262.31
OPT
f=-30
TT=26.171
T1=26.17
OPT
f=-30
TT=26.299
T1=26.3
OPT
f=-30
TT=26.055
T1=26.26
OPT
f=-30
TT=26.514
T1=26.82
OPT
f=-30
TT=28.528
T1=27.1
OPT
f=-30
TT=27.895
T1=26.47
OPT
f=-30
TT=27.065
T1=25.85
OPT
f=-30
TT=27.126
T1=25.9
SAT (TO)
f=-25
TT=1800.06
T1=0.32
OPT
f=-30
TT=48.235
T1=36.65
? (TO)

TT=1800.1

SAT
f=-13
TT=1783.01
T1=1783.31
? (exit code)

TT=1657.23

SAT
f=-26
TT=1798
T1=3.03
SAT (TO)
f=-25
TT=1800.06
T1=2
SAT
f=-29
TT=1794.62
T1=516.34
No data? (TO)

TT=1800.39

SAT (TO)
f=-26
TT=1800.07
T1=87.81
SAT
f=-29
TT=1789.77
T1=349.03
No dataSAT (TO)
f=-26
TT=1800.06
T1=81.66
OPT
f=-30
TT=1620.98
T1=1621.19
OPT
f=-30
TT=62.867
T1=62.88
OPT
f=-30
TT=26.147
T1=26.25
OPT
f=-30
TT=27.192
T1=25.82
No dataNo dataNo dataOPT
f=-30
TT=636.74
T1=318.58
No dataNo dataOPT
f=-30
TT=631.133
T1=315.64
No dataNo dataNo dataSAT (TO)
f=-25
TT=1800.11
T1=53.96
SAT (TO)
f=-24
TT=1800.08
T1=0.51
SAT (TO)
f=-26
TT=1800.62
T1=1240.37
SAT
f=-29
TT=1796.77
T1=339.9
SAT
f=-29
TT=1796.75
T1=345.48
SAT
f=-29
TT=1796.78
T1=354.14
? (TO)

TT=1800.01

? (TO)

TT=1800.13

?

TT=1799.53

No dataNo data?

TT=1799.68

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb30-15-opb/normalized-frb30-15-4.opb
OPT
f=-30
TT=15.964
T1=14.9
SAT
f=-26
TT=1798.01
T1=86.89
No dataSAT (TO)
f=-27
TT=1800.08
T1=251.7
OPT
f=-30
TT=16.131
T1=16.13
OPT
f=-30
TT=16.162
T1=16.25
OPT
f=-30
TT=15.964
T1=16.14
OPT
f=-30
TT=16.051
T1=16.21
OPT
f=-30
TT=16.355
T1=14.97
OPT
f=-30
TT=16.308
T1=15.05
OPT
f=-30
TT=16.352
T1=14.96
OPT
f=-30
TT=16.317
T1=15.05
SAT (TO)
f=-25
TT=1800.06
T1=33.84
OPT
f=-30
TT=51.103
T1=29.42
? (TO)

TT=1800.23

SAT
f=-16
TT=1783.01
T1=1783.3
SAT (TO)
f=-25
TT=1800.52
T1=1.33
SAT
f=-26
TT=1798.01
T1=49.5
SAT (TO)
f=-25
TT=1800.08
T1=43.38
SAT
f=-29
TT=1796.06
T1=304.57
No data? (TO)

TT=1800.14

SAT (TO)
f=-27
TT=1800.09
T1=177.12
SAT
f=-29
TT=1789.78
T1=401.25
No dataSAT (TO)
f=-26
TT=1800.14
T1=31.39
SAT
f=-29
TT=1796.8
T1=1747.96
OPT
f=-30
TT=28.677
T1=28.69
OPT
f=-30
TT=16.038
T1=16.05
OPT
f=-30
TT=16.302
T1=14.9
No dataNo dataNo dataOPT
f=-30
TT=316.21
T1=158.28
No dataNo dataOPT
f=-30
TT=302.291
T1=151.18
No dataNo dataNo dataSAT (TO)
f=-24
TT=1800.95
T1=2.56
SAT (TO)
f=-23
TT=1800.08
T1=0.54
SAT (TO)
f=-25
TT=1800.04
T1=1.47
SAT
f=-29
TT=1796.77
T1=787.49
SAT
f=-29
TT=1796.76
T1=785.57
OPT
f=-30
TT=1731.2
T1=1731.44
? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.54

No dataNo data?

TT=1799.9

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb30-15-opb/normalized-frb30-15-5.opb
OPT
f=-30
TT=12.297
T1=11.52
SAT
f=-25
TT=1798
T1=787.45
No dataSAT (TO)
f=-27
TT=1800.08
T1=1499.65
OPT
f=-30
TT=12.497
T1=12.73
OPT
f=-30
TT=12.561
T1=12.69
OPT
f=-30
TT=12.391
T1=12.39
OPT
f=-30
TT=12.382
T1=12.38
OPT
f=-30
TT=12.907
T1=11.69
OPT
f=-30
TT=12.833
T1=12.54
OPT
f=-30
TT=12.903
T1=11.56
OPT
f=-30
TT=12.896
T1=11.56
SAT (TO)
f=-24
TT=1800.04
T1=127.87
OPT
f=-30
TT=20.516
T1=17.23
? (TO)

TT=1800.31

SAT
f=-16
TT=1783
T1=1783.3
SAT (TO)
f=-26
TT=1800.04
T1=155.7
SAT
f=-26
TT=1798
T1=1220.7
SAT (TO)
f=-25
TT=1800.86
T1=2.13
OPT
f=-30
TT=947.236
T1=947.36
No data? (TO)

TT=1800.26

SAT (TO)
f=-26
TT=1800.11
T1=9.52
OPT
f=-30
TT=1096.61
T1=1096.77
No dataSAT (TO)
f=-26
TT=1801.31
T1=46.43
OPT
f=-30
TT=1040.42
T1=1040.58
OPT
f=-30
TT=18.861
T1=18.86
OPT
f=-30
TT=12.297
T1=12.39
OPT
f=-30
TT=12.861
T1=11.52
No dataNo dataNo dataOPT
f=-30
TT=136.33
T1=68.23
No dataNo dataOPT
f=-30
TT=147.156
T1=73.69
No dataNo dataNo dataSAT (TO)
f=-25
TT=1800.14
T1=54.18
SAT (TO)
f=-22
TT=1801.1
T1=0.74
SAT (TO)
f=-26
TT=1800.08
T1=87.24
OPT
f=-30
TT=811.056
T1=811.14
OPT
f=-30
TT=829.03
T1=829.25
OPT
f=-30
TT=780.732
T1=780.82
? (TO)

TT=1800.1

? (TO)

TT=1800.05

?

TT=1799.49

No dataNo data?

TT=1799.55

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb35-17-opb/normalized-frb35-17-2.opb
OPT
f=-35
TT=45.895
T1=41.45
SAT
f=-28
TT=1798.01
T1=149.23
No dataSAT (TO)
f=-31
TT=1800.05
T1=865.97
OPT
f=-35
TT=47.077
T1=42.73
OPT
f=-35
TT=45.959
T1=41.6
OPT
f=-35
TT=46.847
T1=42.46
OPT
f=-35
TT=45.895
T1=41.45
OPT
f=-35
TT=99.54
T1=95.1
OPT
f=-35
TT=99.393
T1=95.32
OPT
f=-35
TT=99.131
T1=94.85
OPT
f=-35
TT=103.747
T1=99.23
SAT (TO)
f=-28
TT=1800.11
T1=8.97
OPT
f=-35
TT=698.007
T1=698.01
? (TO)

TT=1800.14

SAT
f=-17
TT=1783.02
T1=1783.36
SAT (TO)
f=-29
TT=1800.1
T1=611.66
SAT
f=-29
TT=1798
T1=48.85
SAT (TO)
f=-29
TT=1800.1
T1=444.46
SAT
f=-32
TT=1795.06
T1=278.38
No data? (TO)

TT=1800.15

SAT (TO)
f=-29
TT=1800.55
T1=204.18
SAT
f=-33
TT=1789.87
T1=642.04
No dataSAT (TO)
f=-30
TT=1800.17
T1=225.58
SAT
f=-33
TT=1796.85
T1=729.72
OPT
f=-35
TT=606.083
T1=606.19
OPT
f=-35
TT=46.811
T1=42.2
OPT
f=-35
TT=103.499
T1=98.98
No dataNo dataNo dataSAT (TO)
f=-34
TT=1800.35
T1=900.41
No dataNo dataSAT (TO)
f=-33
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-28
TT=1800.17
T1=269.01
SAT (TO)
f=-26
TT=1801.06
T1=0.53
SAT (TO)
f=-29
TT=1800.02
T1=17.33
SAT
f=-33
TT=1796.88
T1=1133.12
SAT
f=-33
TT=1796.89
T1=1149.7
SAT
f=-33
TT=1796.86
T1=1085.17
? (TO)

TT=1800.05

? (TO)

TT=1800.09

?

TT=1799.57

No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb35-17-opb/normalized-frb35-17-3.opb
OPT
f=-35
TT=54.038
T1=49.89
SAT
f=-29
TT=1798
T1=4.75
No dataSAT (TO)
f=-30
TT=1800.05
T1=2.73
OPT
f=-35
TT=56.33
T1=52.32
OPT
f=-35
TT=55.685
T1=51.47
OPT
f=-35
TT=54.038
T1=49.89
OPT
f=-35
TT=57.065
T1=52.7
OPT
f=-35
TT=71.967
T1=67.64
OPT
f=-35
TT=71.242
T1=67.08
OPT
f=-35
TT=69.576
T1=65.6
OPT
f=-35
TT=70.643
T1=66.44
SAT (TO)
f=-28
TT=1800.1
T1=143.3
OPT
f=-35
TT=185.041
T1=177.55
? (TO)

TT=1800.25

SAT
f=-16
TT=1783.01
T1=1783.35
SAT (TO)
f=-30
TT=1800.41
T1=105.63
SAT
f=-29
TT=1798
T1=4.22
SAT (TO)
f=-30
TT=1801.08
T1=1790.18
SAT
f=-32
TT=1795.45
T1=184.06
No data? (TO)

TT=1800.22

SAT (TO)
f=-30
TT=1800.13
T1=46.76
SAT
f=-33
TT=1789.85
T1=1422.53
No dataSAT (TO)
f=-30
TT=1800.05
T1=131.05
SAT
f=-33
TT=1796.87
T1=564.42
OPT
f=-35
TT=224.945
T1=224.96
OPT
f=-35
TT=56.267
T1=52.08
OPT
f=-35
TT=71.933
T1=67.72
No dataNo dataNo dataOPT
f=-35
TT=616.286
T1=308.16
No dataNo dataOPT
f=-35
TT=580.695
T1=290.42
No dataNo dataNo dataSAT (TO)
f=-28
TT=1800.57
T1=3.66
SAT (TO)
f=-26
TT=1800.03
T1=0.58
SAT (TO)
f=-29
TT=1800.11
T1=7.99
SAT
f=-33
TT=1796.85
T1=808.1
SAT
f=-33
TT=1796.86
T1=910.97
SAT
f=-33
TT=1796.85
T1=824.71
? (TO)

TT=1800.06

? (TO)

TT=1800.03

?

TT=1799.55

No dataNo data?

TT=1799.57

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb35-17-opb/normalized-frb35-17-5.opb
OPT
f=-35
TT=42.769
T1=38.1
SAT
f=-30
TT=1798
T1=941.47
No dataSAT (TO)
f=-30
TT=1800.06
T1=131.33
OPT
f=-35
TT=42.769
T1=38.1
OPT
f=-35
TT=43.012
T1=38.34
OPT
f=-35
TT=43.125
T1=38.22
OPT
f=-35
TT=43.564
T1=38.75
OPT
f=-35
TT=64.096
T1=59.27
OPT
f=-35
TT=65.206
T1=60.42
OPT
f=-35
TT=63.273
T1=58.47
OPT
f=-35
TT=64.518
T1=59.74
SAT (TO)
f=-28
TT=1800.1
T1=2.89
OPT
f=-35
TT=193.09
T1=192.33
? (TO)

TT=1800.09

SAT
f=-15
TT=1783.01
T1=1783.33
SAT (TO)
f=-29
TT=1801.11
T1=19.54
SAT
f=-29
TT=1798.01
T1=4.76
SAT (TO)
f=-29
TT=1800.74
T1=844.8
SAT
f=-32
TT=1793.68
T1=1070.52
No data? (TO)

TT=1800.39

SAT (TO)
f=-30
TT=1800.06
T1=216.99
SAT
f=-33
TT=1789.87
T1=338.79
No dataSAT (TO)
f=-30
TT=1800.15
T1=28.23
SAT
f=-33
TT=1796.91
T1=885.89
OPT
f=-35
TT=91.019
T1=91.04
OPT
f=-35
TT=43.494
T1=38.86
OPT
f=-35
TT=65.336
T1=60.49
No dataNo dataNo dataSAT (TO)
f=-33
TT=1800.14
T1=900.41
No dataNo dataSAT (TO)
f=-33
TT=1800.17
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-28
TT=1800.18
T1=135.87
SAT (TO)
f=-27
TT=1800.66
T1=0.62
SAT (TO)
f=-30
TT=1800
T1=876.66
SAT
f=-33
TT=1796.9
T1=1165.35
SAT
f=-33
TT=1796.91
T1=1143.55
SAT
f=-33
TT=1796.9
T1=1165.92
? (TO)

TT=1800.02

? (TO)

TT=1800.1

?

TT=1799.53

No dataNo data?

TT=1799.9

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb40-19-opb/normalized-frb40-19-1.opb
OPT
f=-40
TT=61.036
T1=54.25
SAT
f=-33
TT=1798
T1=1759.01
No dataSAT (TO)
f=-34
TT=1800.03
T1=12.14
OPT
f=-40
TT=61.308
T1=54.61
OPT
f=-40
TT=64.289
T1=57.33
OPT
f=-40
TT=61.036
T1=54.25
OPT
f=-40
TT=63.244
T1=56.33
OPT
f=-40
TT=77.807
T1=70.63
OPT
f=-40
TT=78.969
T1=71.94
OPT
f=-40
TT=79.073
T1=72.35
OPT
f=-40
TT=79.672
T1=72.59
SAT (TO)
f=-32
TT=1800.05
T1=73.86
OPT
f=-40
TT=246.218
T1=245.4
? (TO)

TT=1800.26

SAT
f=-13
TT=1783.01
T1=1783.38
SAT (TO)
f=-33
TT=1800.02
T1=4.04
SAT
f=-33
TT=1798.01
T1=1767.46
SAT (TO)
f=-33
TT=1800.76
T1=14.18
SAT
f=-36
TT=1794.92
T1=1260.66
No data? (TO)

TT=1800.08

SAT (TO)
f=-34
TT=1800.08
T1=217.08
SAT
f=-37
TT=1789.9
T1=797.99
No dataSAT (TO)
f=-34
TT=1800.15
T1=672.73
SAT
f=-38
TT=1796.91
T1=1741.49
OPT
f=-40
TT=270.088
T1=270.13
OPT
f=-40
TT=63.098
T1=56.28
OPT
f=-40
TT=81.057
T1=73.99
No dataNo dataNo dataSAT (TO)
f=-38
TT=1800.2
T1=900.41
No dataNo dataSAT (TO)
f=-38
TT=1800.07
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-33
TT=1800.22
T1=9.82
SAT (TO)
f=-32
TT=1800
T1=0.55
SAT (TO)
f=-33
TT=1800.44
T1=2.77
SAT
f=-38
TT=1796.92
T1=1683.77
SAT
f=-38
TT=1796.87
T1=1522.77
SAT
f=-38
TT=1796.92
T1=1692.49
? (TO)

TT=1800.02

? (TO)

TT=1800.1

?

TT=1799.57

No dataNo data?

TT=1799.48

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb40-19-opb/normalized-frb40-19-3.opb
OPT
f=-40
TT=1325.76
T1=1326.01
SAT
f=-32
TT=1798
T1=6.2
No dataSAT (TO)
f=-34
TT=1800.1
T1=30.65
OPT
f=-40
TT=1360.45
T1=1360.69
OPT
f=-40
TT=1359.22
T1=1359.64
OPT
f=-40
TT=1355.61
T1=1356.12
OPT
f=-40
TT=1325.76
T1=1326.01
OPT
f=-40
TT=1385.63
T1=1380.79
OPT
f=-40
TT=1353.73
T1=1348.96
OPT
f=-40
TT=1396.34
T1=1391.29
OPT
f=-40
TT=1344.25
T1=1339.52
SAT (TO)
f=-32
TT=1800.04
T1=568.09
SAT (TO)
f=-39
TT=1800.11
T1=1738.81
? (TO)

TT=1800.09

SAT
f=-11
TT=1783.01
T1=1783.4
SAT (TO)
f=-32
TT=1800.45
T1=56.5
SAT
f=-33
TT=1798
T1=92.14
SAT (TO)
f=-33
TT=1800.09
T1=435.99
SAT
f=-36
TT=1794.37
T1=1181.23
No data? (TO)

TT=1800.33

SAT (TO)
f=-33
TT=1800.35
T1=19.75
SAT
f=-36
TT=1789.9
T1=1268.5
No dataSAT (TO)
f=-34
TT=1800.11
T1=39.28
SAT
f=-37
TT=1796.9
T1=1129.8
SAT (TO)
f=-40
TT=1800.08
T1=1800.4
OPT
f=-40
TT=1435.99
T1=1436.32
OPT
f=-40
TT=1432.67
T1=1427.92
No dataNo dataNo dataSAT (TO)
f=-37
TT=1800.17
T1=900.41
No dataNo dataSAT (TO)
f=-37
TT=1800.41
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-32
TT=1800.64
T1=190.51
SAT (TO)
f=-27
TT=1800.03
T1=0.64
SAT (TO)
f=-34
TT=1800.55
T1=1307.03
SAT
f=-37
TT=1796.94
T1=1130.29
SAT
f=-37
TT=1797
T1=1255.91
SAT
f=-37
TT=1796.91
T1=1146.13
? (TO)

TT=1800.07

? (TO)

TT=1800.08

?

TT=1799.55

No dataNo data?

TT=1799.59

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb40-19-opb/normalized-frb40-19-4.opb
OPT
f=-40
TT=269.661
T1=269.73
SAT
f=-32
TT=1798.02
T1=428.2
No dataSAT (TO)
f=-34
TT=1800.08
T1=44.06
OPT
f=-40
TT=315.324
T1=315.77
OPT
f=-40
TT=314.252
T1=314.49
OPT
f=-40
TT=321.643
T1=321.74
OPT
f=-40
TT=318.775
T1=318.86
OPT
f=-40
TT=321.642
T1=315.49
OPT
f=-40
TT=323.913
T1=317.83
OPT
f=-40
TT=330.65
T1=324.41
OPT
f=-40
TT=329.041
T1=322.97
SAT (TO)
f=-32
TT=1800.03
T1=395.74
SAT (TO)
f=-39
TT=1800.1
T1=630.79
? (TO)

TT=1471.98

SAT
f=-12
TT=1783.01
T1=1783.33
SAT (TO)
f=-32
TT=1800.26
T1=1.31
SAT
f=-33
TT=1798.01
T1=665.41
SAT (TO)
f=-33
TT=1800.75
T1=709.64
SAT
f=-37
TT=1794.93
T1=1705.37
No data? (TO)

TT=1800.33

SAT (TO)
f=-33
TT=1800.6
T1=45.08
SAT
f=-37
TT=1789.89
T1=1658.13
No dataSAT (TO)
f=-33
TT=1800.61
T1=9.59
SAT
f=-37
TT=1796.93
T1=1596.13
OPT
f=-40
TT=269.661
T1=269.73
OPT
f=-40
TT=325.274
T1=325.35
OPT
f=-40
TT=348.642
T1=342.17
No dataNo dataNo dataSAT (TO)
f=-37
TT=1800.13
T1=900.41
No dataNo dataSAT (TO)
f=-37
TT=1800.61
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-32
TT=1800.72
T1=119.52
SAT (TO)
f=-28
TT=1800.25
T1=0.51
SAT (TO)
f=-33
TT=1800.48
T1=159.08
SAT
f=-37
TT=1796.95
T1=1787.24
SAT
f=-36
TT=1796.99
T1=790.72
SAT
f=-37
TT=1796.94
T1=1782.68
? (TO)

TT=1800.01

? (TO)

TT=1800.08

?

TT=1799.59

No dataNo data?

TT=1799.53

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb40-19-opb/normalized-frb40-19-5.opb
OPT
f=-40
TT=824.628
T1=819.32
SAT
f=-32
TT=1798.01
T1=60.59
No dataSAT (TO)
f=-34
TT=1800.11
T1=91.21
OPT
f=-40
TT=824.628
T1=819.32
OPT
f=-40
TT=827.954
T1=822.59
OPT
f=-40
TT=850.313
T1=844.7
OPT
f=-40
TT=848.297
T1=842.69
OPT
f=-40
TT=862.933
T1=857.24
OPT
f=-40
TT=877.745
T1=872.08
OPT
f=-40
TT=863.783
T1=858.19
OPT
f=-40
TT=835.68
T1=830.25
SAT (TO)
f=-34
TT=1800.12
T1=536.05
SAT (TO)
f=-40
TT=1800.01
T1=1143.97
? (TO)

TT=1800.27

SAT
f=-15
TT=1783.01
T1=1783.35
SAT (TO)
f=-32
TT=1800
T1=8.08
SAT
f=-33
TT=1798.01
T1=809.46
SAT (TO)
f=-32
TT=1800.1
T1=4.75
SAT
f=-35
TT=1794.58
T1=1584.49
No data? (TO)

TT=1800.02

SAT (TO)
f=-34
TT=1800.05
T1=231.68
SAT
f=-36
TT=1789.92
T1=688.27
No dataSAT (TO)
f=-33
TT=1800.02
T1=69.7
SAT
f=-37
TT=1796.93
T1=1730.51
SAT (TO)
f=-39
TT=1800.1
T1=1800.4
OPT
f=-40
TT=903.979
T1=898.62
OPT
f=-40
TT=911.728
T1=906.08
No dataNo dataNo dataSAT (TO)
f=-38
TT=1800.47
T1=900.41
No dataNo dataSAT (TO)
f=-38
TT=1800.62
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-34
TT=1800.15
T1=118.88
SAT (TO)
f=-29
TT=1800.03
T1=0.61
SAT (TO)
f=-33
TT=1800.58
T1=276.71
SAT
f=-37
TT=1796.9
T1=1601.13
SAT
f=-37
TT=1796.96
T1=1761.32
SAT
f=-37
TT=1796.96
T1=1774.76
? (TO)

TT=1800.08

? (TO)

TT=1800.02

?

TT=1799.47

No dataNo data?

TT=1799.92

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb45-21-opb/normalized-frb45-21-1.opb
SAT
f=-42
TT=1800.08
T1=220.61
SAT
f=-37
TT=1798.01
T1=1648.79
No dataSAT (TO)
f=-38
TT=1800.03
T1=1460.95
? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.1

SAT (TO)
f=-36
TT=1800.08
T1=1377.01
SAT (TO)
f=-42
TT=1800.09
T1=220.61
? (TO)

TT=1800.04

SAT
f=-12
TT=1783.01
T1=1783.37
SAT (TO)
f=-36
TT=1800.08
T1=560.02
SAT
f=-35
TT=1798.01
T1=53.76
SAT (TO)
f=-34
TT=1800.01
T1=0.77
SAT
f=-39
TT=1794.05
T1=464.23
No data? (TO)

TT=1800.11

SAT (TO)
f=-37
TT=1801.11
T1=228.4
SAT
f=-40
TT=1789.95
T1=1273.56
No dataSAT (TO)
f=-36
TT=1800.75
T1=49.72
SAT
f=-39
TT=1796.98
T1=586.77
SAT (TO)
f=-42
TT=1800.08
T1=1800.4
? (TO)

TT=1800.12

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=-42
TT=1800.03
T1=900.41
No dataNo dataSAT (TO)
f=-42
TT=1800.4
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-36
TT=1800.78
T1=403.49
SAT (TO)
f=-33
TT=1800.45
T1=0.54
SAT (TO)
f=-37
TT=1800.05
T1=1514.65
SAT
f=-39
TT=1797.02
T1=749.84
SAT
f=-39
TT=1797.02
T1=719.83
SAT
f=-39
TT=1797.02
T1=754.58
? (TO)

TT=1800.12

? (TO)

TT=1800.08

?

TT=1799.67

No dataNo data?

TT=1799.49

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb45-21-opb/normalized-frb45-21-2.opb
SAT
f=-44
TT=1800.09
T1=1290.06
SAT
f=-35
TT=1798.01
T1=3.13
No dataSAT (TO)
f=-38
TT=1800.12
T1=267.79
? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.08

SAT (TO)
f=-36
TT=1800.11
T1=11.87
SAT (TO)
f=-44
TT=1800.1
T1=1290.06
? (TO)

TT=1800.08

SAT
f=-10
TT=1783.05
T1=1783.41
SAT (TO)
f=-35
TT=1800.49
T1=4.84
SAT
f=-37
TT=1798.02
T1=174.07
SAT (TO)
f=-35
TT=1800.52
T1=60.45
SAT
f=-40
TT=1793.07
T1=701.71
No data? (TO)

TT=1800.21

? (TO)

TT=1802.5

SAT
f=-40
TT=1789.91
T1=1151.19
No dataSAT (TO)
f=-36
TT=1800.2
T1=10.25
SAT
f=-41
TT=1796.98
T1=1404.94
SAT (TO)
f=-44
TT=1800.09
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-41
TT=1800.14
T1=900.51
No dataNo dataSAT (TO)
f=-41
TT=1800.41
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-36
TT=1801.08
T1=103.57
SAT (TO)
f=-32
TT=1800.02
T1=0.74
SAT (TO)
f=-37
TT=1800.08
T1=10.6
SAT
f=-41
TT=1796.99
T1=803.88
SAT
f=-41
TT=1796.88
T1=873.5
SAT
f=-41
TT=1796.99
T1=800.42
? (TO)

TT=1800.06

? (TO)

TT=1800.07

?

TT=1799.9

No dataNo data?

TT=1799.97

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb45-21-opb/normalized-frb45-21-3.opb
OPT
f=-45
TT=106.029
T1=87.61
SAT
f=-36
TT=1798.01
T1=169.02
No dataSAT (TO)
f=-38
TT=1800.11
T1=449.47
OPT
f=-45
TT=106.907
T1=87.61
OPT
f=-45
TT=107.196
T1=87.82
OPT
f=-45
TT=106.029
T1=87.69
OPT
f=-45
TT=110.154
T1=90.81
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.12

SAT (TO)
f=-36
TT=1800.04
T1=649.26
SAT (TO)
f=-43
TT=1800.1
T1=578.49
? (TO)

TT=1800.12

SAT
f=-13
TT=1783.01
T1=1783.35
? (exit code)

TT=1244.38

SAT
f=-37
TT=1798.01
T1=1130.27
SAT (TO)
f=-36
TT=1800.02
T1=38.01
SAT
f=-39
TT=1794.29
T1=554.14
No data? (TO)

TT=1800.09

SAT (TO)
f=-36
TT=1801.06
T1=8.67
SAT
f=-39
TT=1789.9
T1=837.49
No dataSAT (TO)
f=-36
TT=1800.04
T1=26.71
SAT
f=-40
TT=1797.06
T1=452.78
SAT (TO)
f=-43
TT=1800.09
T1=1800.4
OPT
f=-45
TT=112.45
T1=93.1
? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=-42
TT=1800.41
T1=900.31
No dataNo dataSAT (TO)
f=-42
TT=1800.13
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-36
TT=1800.04
T1=722.88
SAT (TO)
f=-31
TT=1800.02
T1=0.67
SAT (TO)
f=-37
TT=1800.03
T1=558.19
SAT
f=-40
TT=1796.98
T1=466.51
SAT
f=-40
TT=1796.99
T1=472.15
SAT
f=-40
TT=1796.96
T1=482.5
? (TO)

TT=1800.11

? (TO)

TT=1800.07

?

TT=1799.54

No dataNo data?

TT=1799.52

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb45-21-opb/normalized-frb45-21-5.opb
SAT
f=-43
TT=1800.09
T1=662.19
SAT
f=-36
TT=1798.01
T1=974.77
No dataSAT (TO)
f=-38
TT=1800.05
T1=427.15
? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.14

? (TO)

TT=1800.06

SAT (TO)
f=-36
TT=1800.13
T1=1772.7
SAT (TO)
f=-43
TT=1800.11
T1=662.19
? (TO)

TT=1800.14

SAT
f=-8
TT=1783.02
T1=1783.33
SAT (TO)
f=-35
TT=1800.09
T1=10.56
SAT
f=-36
TT=1798.02
T1=211.3
SAT (TO)
f=-35
TT=1800.73
T1=5.31
SAT
f=-39
TT=1793.4
T1=580.81
No data? (TO)

TT=1800.03

SAT (TO)
f=-36
TT=1800.03
T1=20.7
SAT
f=-39
TT=1790.02
T1=652.41
No dataSAT (TO)
f=-38
TT=1800.56
T1=420.28
SAT
f=-40
TT=1797.04
T1=763.42
SAT (TO)
f=-43
TT=1800.09
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=-41
TT=1800.02
T1=900.31
No dataNo dataSAT (TO)
f=-41
TT=1800.54
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-36
TT=1800.13
T1=683.41
SAT (TO)
f=-31
TT=1800.09
T1=0.67
SAT (TO)
f=-37
TT=1800.55
T1=1215.84
SAT
f=-40
TT=1796.99
T1=826.21
SAT
f=-40
TT=1796.95
T1=782.6
SAT
f=-40
TT=1796.99
T1=832.96
? (TO)

TT=1800.08

? (TO)

TT=1800.05

?

TT=1799.62

No dataNo data?

TT=1799.51

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb50-23-opb/normalized-frb50-23-1.opb
SAT
f=-47
TT=1800.05
T1=1643.24
SAT
f=-40
TT=1798.01
T1=41.26
No dataSAT (TO)
f=-42
TT=1800.08
T1=1657.62
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.07

SAT (TO)
f=-39
TT=1800.09
T1=216.41
SAT (TO)
f=-47
TT=1800.05
T1=1643.24
? (TO)

TT=1800.24

SAT
f=-12
TT=1783.02
T1=1783.47
SAT (TO)
f=-39
TT=1800.01
T1=36.19
SAT
f=-39
TT=1798.04
T1=1.78
SAT (TO)
f=-40
TT=1800.54
T1=260.44
SAT
f=-44
TT=1794.39
T1=1062.42
No data? (TO)

TT=1800.2

? (TO)

TT=1802.54

SAT
f=-42
TT=1789.96
T1=973.55
No dataSAT (TO)
f=-41
TT=1800.63
T1=683.52
SAT
f=-45
TT=1797.04
T1=1603.83
SAT (TO)
f=-47
TT=1800.07
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=-46
TT=1800.26
T1=900.41
No dataNo dataSAT (TO)
f=-46
TT=1800.11
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-40
TT=1800.34
T1=832.05
SAT (TO)
f=-34
TT=1800.09
T1=0.71
SAT (TO)
f=-41
TT=1800.06
T1=96.03
SAT
f=-44
TT=1797.01
T1=971.13
SAT
f=-44
TT=1797.05
T1=972.84
SAT
f=-44
TT=1797.13
T1=1034.85
? (TO)

TT=1800.05

? (TO)

TT=1800.09

?

TT=1799.97

No dataNo data?

TT=1799.99

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb50-23-opb/normalized-frb50-23-2.opb
SAT
f=-47
TT=1800.04
T1=1056.14
SAT
f=-38
TT=1798.02
T1=6.3
No dataSAT (TO)
f=-42
TT=1800.03
T1=1682.11
? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.13

SAT (TO)
f=-40
TT=1800.03
T1=57.37
SAT (TO)
f=-47
TT=1800.04
T1=1056.14
? (TO)

TT=1800.29

SAT
f=-12
TT=1783.02
T1=1783.42
? (exit code)

TT=1423.33

SAT
f=-39
TT=1798.02
T1=322.19
SAT (TO)
f=-39
TT=1800.53
T1=11.87
SAT
f=-43
TT=1794.13
T1=1416.85
No data? (TO)

TT=1800.22

? (TO)

TT=1623.32

SAT
f=-43
TT=1789.98
T1=698.96
No dataSAT (TO)
f=-41
TT=1800.64
T1=509.02
SAT
f=-45
TT=1797.03
T1=946.54
SAT (TO)
f=-47
TT=1800.05
T1=1800.4
? (TO)

TT=1800.12

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=-45
TT=1800.2
T1=900.51
No dataNo dataSAT (TO)
f=-45
TT=1800.05
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-39
TT=1801.03
T1=45.31
SAT (TO)
f=-34
TT=1800.64
T1=0.67
SAT (TO)
f=-41
TT=1800.04
T1=1142.34
SAT
f=-44
TT=1797.04
T1=741.95
SAT
f=-44
TT=1797.01
T1=700.54
SAT
f=-44
TT=1797.02
T1=660.84
? (TO)

TT=1800.07

? (TO)

TT=1800.1

?

TT=1799.61

No dataNo data?

TT=1799.57

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb50-23-opb/normalized-frb50-23-3.opb
SAT
f=-48
TT=1800.05
T1=1780.2
SAT
f=-40
TT=1798.01
T1=136.72
No dataSAT (TO)
f=-42
TT=1800.09
T1=128.2
? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.14

? (TO)

TT=1800.11

? (TO)

TT=1800.15

? (TO)

TT=1800.04

? (TO)

TT=1800.11

SAT (TO)
f=-39
TT=1800.11
T1=565.87
SAT (TO)
f=-48
TT=1800.05
T1=1780.2
? (TO)

TT=1696.76

SAT
f=-11
TT=1783.05
T1=1783.45
SAT (TO)
f=-39
TT=1800.06
T1=32.22
SAT
f=-39
TT=1798.06
T1=251.05
SAT (TO)
f=-38
TT=1800.52
T1=12.11
SAT
f=-43
TT=1794.46
T1=1519.1
No data? (TO)

TT=1800.36

? (TO)

TT=1688.84

SAT
f=-44
TT=1789.97
T1=1460.93
No dataSAT (TO)
f=-41
TT=1800.1
T1=9.48
SAT
f=-44
TT=1797.13
T1=1231.84
SAT (TO)
f=-47
TT=1800.12
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=-45
TT=1800.59
T1=900.41
No dataNo dataSAT (TO)
f=-45
TT=1800.1
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-39
TT=1800.13
T1=9.11
SAT (TO)
f=-36
TT=1800.05
T1=0.98
SAT (TO)
f=-41
TT=1800.1
T1=713.43
SAT
f=-44
TT=1797.14
T1=1036.93
SAT
f=-44
TT=1797.08
T1=1042.89
SAT
f=-44
TT=1797.09
T1=1001.63
? (TO)

TT=1800.14

? (TO)

TT=1800.07

?

TT=1799.75

No dataNo data?

TT=1799.99

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb50-23-opb/normalized-frb50-23-4.opb
SAT
f=-48
TT=1800.08
T1=900.32
SAT
f=-40
TT=1798.01
T1=208.26
No dataSAT (TO)
f=-41
TT=1800.08
T1=111.64
? (TO)

TT=1800.14

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=-39
TT=1800.06
T1=0.85
SAT (TO)
f=-48
TT=1800.08
T1=900.32
? (TO)

TT=1800.09

SAT
f=-9
TT=1783.02
T1=1783.42
SAT (TO)
f=-39
TT=1800.1
T1=13.56
SAT
f=-40
TT=1798.03
T1=67.5
SAT (TO)
f=-40
TT=1800.05
T1=13.93
SAT
f=-43
TT=1794.19
T1=1129.37
No data? (TO)

TT=1800.19

SAT (TO)
f=-40
TT=1800.7
T1=60.85
SAT
f=-44
TT=1789.98
T1=1548.41
No dataSAT (TO)
f=-40
TT=1800.11
T1=20.67
SAT
f=-45
TT=1796.99
T1=1597.67
SAT (TO)
f=-47
TT=1800.09
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=-46
TT=1800.04
T1=900.41
No dataNo dataSAT (TO)
f=-46
TT=1800.05
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-39
TT=1800.16
T1=103.53
SAT (TO)
f=-36
TT=1801.04
T1=0.67
SAT (TO)
f=-41
TT=1800.09
T1=93.67
SAT
f=-43
TT=1796.99
T1=318.9
SAT
f=-43
TT=1797.02
T1=327.91
SAT
f=-43
TT=1797.08
T1=369.21
? (TO)

TT=1800.09

? (TO)

TT=1800.12

?

TT=1799.89

No dataNo data?

TT=1799.48

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb50-23-opb/normalized-frb50-23-5.opb
SAT
f=-48
TT=1800.08
T1=1800.4
SAT
f=-40
TT=1798.01
T1=1480.23
No dataSAT (TO)
f=-42
TT=1800.11
T1=547.57
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.09

SAT (TO)
f=-39
TT=1800.09
T1=714.62
SAT (TO)
f=-47
TT=1800.08
T1=494.18
? (TO)

TT=1673.67

SAT
f=-9
TT=1783.01
T1=1783.42
? (exit code)

TT=1751.22

SAT
f=-39
TT=1798.04
T1=759
SAT (TO)
f=-40
TT=1800.67
T1=1602.87
SAT
f=-43
TT=1794.53
T1=1686.74
No data? (TO)

TT=1800.32

? (TO)

TT=1455.23

SAT
f=-43
TT=1789.98
T1=975.16
No dataSAT (TO)
f=-40
TT=1800.16
T1=41.34
SAT
f=-44
TT=1797.07
T1=1164.81
SAT (TO)
f=-48
TT=1800.08
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=-46
TT=1800.14
T1=900.51
No dataNo dataSAT (TO)
f=-46
TT=1800.14
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-39
TT=1800.05
T1=72.11
SAT (TO)
f=-35
TT=1800.04
T1=0.68
SAT (TO)
f=-39
TT=1800.09
T1=4.74
SAT
f=-45
TT=1797.08
T1=871.68
SAT
f=-45
TT=1797.05
T1=884.96
SAT
f=-45
TT=1797.05
T1=808.96
? (TO)

TT=1800.11

? (TO)

TT=1800.04

?

TT=1799.56

No dataNo data?

TT=1799.82

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb53-24-opb/normalized-frb53-24-1.opb
SAT
f=-51
TT=1800.08
T1=1402.24
SAT
f=-41
TT=1798.01
T1=1.23
No dataSAT (TO)
f=-44
TT=1800.07
T1=79.61
? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.1

SAT (TO)
f=-40
TT=1800.1
T1=1.17
SAT (TO)
f=-51
TT=1800.08
T1=1402.24
? (TO)

TT=1800.09

SAT
f=-9
TT=1783.07
T1=1783.45
? (exit code)

TT=304.95

SAT
f=-42
TT=1798.01
T1=949.21
SAT (TO)
f=-40
TT=1800.06
T1=2.95
SAT
f=-47
TT=1794.29
T1=1482.83
No data? (TO)

TT=1800.18

? (TO)

TT=1802.47

SAT
f=-46
TT=1790
T1=916.41
No dataSAT (TO)
f=-43
TT=1800.01
T1=28.18
SAT
f=-45
TT=1797.03
T1=1131.22
SAT (TO)
f=-50
TT=1800.06
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-49
TT=1800.51
T1=900.41
No dataNo dataSAT (TO)
f=-49
TT=1800.11
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-45
TT=1801.12
T1=7.4
SAT (TO)
f=-38
TT=1800.09
T1=0.81
SAT (TO)
f=-42
TT=1800
T1=51.78
SAT
f=-47
TT=1797.07
T1=919.92
SAT
f=-47
TT=1797.08
T1=871.98
SAT
f=-47
TT=1797.11
T1=868.06
? (TO)

TT=1800.13

? (TO)

TT=1800.09

?

TT=1799.6

No dataNo data?

TT=1799.94

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb53-24-opb/normalized-frb53-24-4.opb
SAT
f=-50
TT=1800.06
T1=247.97
SAT (TO)
f=-40
TT=1800.07
T1=10.09
No dataSAT (TO)
f=-44
TT=1800.03
T1=1341.65
? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

SAT (TO)
f=-41
TT=1800.11
T1=11.49
SAT (TO)
f=-50
TT=1800.09
T1=247.97
? (TO)

TT=1800.05

SAT
f=-11
TT=1783.03
T1=1783.42
SAT (TO)
f=-41
TT=1800.04
T1=5.81
SAT
f=-40
TT=1798.05
T1=8.87
SAT (TO)
f=-42
TT=1800.01
T1=27.45
SAT
f=-45
TT=1794.15
T1=1403.73
No data? (TO)

TT=1800.06

? (TO)

TT=1347.01

SAT
f=-45
TT=1790.18
T1=1098.07
No dataSAT (TO)
f=-42
TT=1800.64
T1=215.97
SAT
f=-46
TT=1797.08
T1=1722.14
SAT (TO)
f=-50
TT=1800.06
T1=1800.4
? (TO)

TT=1800.05

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=-48
TT=1800.1
T1=900.51
No dataNo dataSAT (TO)
f=-48
TT=1800.05
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-41
TT=1800.13
T1=396.76
SAT (TO)
f=-38
TT=1800.89
T1=0.86
SAT (TO)
f=-42
TT=1800.04
T1=785.99
SAT
f=-46
TT=1797.12
T1=1481.95
SAT
f=-46
TT=1797.09
T1=1476.17
SAT
f=-46
TT=1797.14
T1=1520.73
? (TO)

TT=1800.11

? (TO)

TT=1800.11

?

TT=1799.56

No dataNo data?

TT=1799.78

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb53-24-opb/normalized-frb53-24-5.opb
SAT
f=-51
TT=1800.03
T1=1800.5
SAT
f=-41
TT=1798.01
T1=348.72
No dataSAT (TO)
f=-44
TT=1800.08
T1=183.44
? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.09

SAT (TO)
f=-41
TT=1800.1
T1=16.99
SAT (TO)
f=-50
TT=1800.09
T1=595.42
? (TO)

TT=1800.05

SAT
f=-11
TT=1783.05
T1=1783.47
SAT (TO)
f=-42
TT=1800.48
T1=34.61
SAT
f=-41
TT=1798.02
T1=184.03
SAT (TO)
f=-41
TT=1800.07
T1=5.33
SAT
f=-43
TT=1794.15
T1=990.01
No data? (TO)

TT=1800.24

? (TO)

TT=1389.45

SAT
f=-45
TT=1790
T1=1133.69
No dataSAT (TO)
f=-41
TT=1800.09
T1=10.78
SAT
f=-45
TT=1797.02
T1=862.02
SAT (TO)
f=-51
TT=1800.03
T1=1800.5
? (TO)

TT=1800.13

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=-48
TT=1800.17
T1=900.41
No dataNo dataSAT (TO)
f=-48
TT=1800.51
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-40
TT=1800.3
T1=676
SAT (TO)
f=-36
TT=1800.06
T1=0.92
SAT (TO)
f=-42
TT=1800.03
T1=424.09
SAT
f=-46
TT=1797.09
T1=1207.75
SAT
f=-46
TT=1797.08
T1=1157.85
SAT
f=-46
TT=1797.12
T1=1276.64
? (TO)

TT=1800.05

? (TO)

TT=1800.07

?

TT=1799.63

No dataNo data?

TT=1799.97

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb56-25-opb/normalized-frb56-25-1.opb
SAT
f=-51
TT=1800.01
T1=1015.64
SAT
f=-43
TT=1798.01
T1=75.98
No dataSAT (TO)
f=-46
TT=1800.01
T1=914.05
? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=-43
TT=1800.06
T1=129.92
SAT (TO)
f=-51
TT=1800.09
T1=1015.64
? (TO)

TT=1388.68

SAT
f=-8
TT=1783.04
T1=1783.41
No Cert.

TT=889.72

SAT
f=-44
TT=1798.04
T1=671.71
SAT (TO)
f=-43
TT=1800.02
T1=883.75
SAT
f=-47
TT=1794.02
T1=1354.35
No data? (TO)

TT=1800.1

? (TO)

TT=1327.15

SAT
f=-49
TT=1790.03
T1=956.35
No dataSAT (TO)
f=-45
TT=1800.12
T1=131.54
SAT
f=-49
TT=1797.12
T1=1496.03
SAT (TO)
f=-51
TT=1800.01
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=-50
TT=1800.55
T1=900.51
No dataNo dataSAT (TO)
f=-50
TT=1800.05
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-43
TT=1801.75
T1=70.73
SAT (TO)
f=-42
TT=1801.05
T1=0.73
SAT (TO)
f=-45
TT=1800
T1=546.22
SAT
f=-48
TT=1797.16
T1=988.91
SAT
f=-50
TT=1797.08
T1=1690.3
SAT
f=-48
TT=1797.14
T1=1016.96
? (TO)

TT=1800.13

? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo data?

TT=1799.6

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb56-25-opb/normalized-frb56-25-2.opb
SAT
f=-52
TT=1800.05
T1=492.93
SAT
f=-44
TT=1798.01
T1=4.7
No dataSAT (TO)
f=-47
TT=1800.09
T1=291.52
? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.15

? (TO)

TT=1800.09

? (TO)

TT=1800.07

SAT (TO)
f=-44
TT=1800.12
T1=388.47
SAT (TO)
f=-52
TT=1800.05
T1=492.93
? (TO)

TT=1800.07

SAT
f=-10
TT=1783.02
T1=1783.47
No Cert.

TT=778.28

SAT
f=-44
TT=1798.07
T1=4
SAT (TO)
f=-43
TT=1800.25
T1=314.6
SAT
f=-47
TT=1794.66
T1=1551.38
No data? (TO)

TT=1800.14

? (TO)

TT=1173.51

SAT
f=-48
TT=1790.07
T1=1443.72
No dataSAT (TO)
f=-46
TT=1800.2
T1=683.23
SAT
f=-48
TT=1797.22
T1=664.06
SAT (TO)
f=-52
TT=1800.07
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=-50
TT=1800.01
T1=900.41
No dataNo dataSAT (TO)
f=-50
TT=1800.44
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-43
TT=1800.8
T1=23.92
SAT (TO)
f=-39
TT=1800.01
T1=0.78
SAT (TO)
f=-45
TT=1800.91
T1=8.31
SAT
f=-49
TT=1797.15
T1=1083.05
SAT
f=-49
TT=1797.07
T1=992.12
SAT
f=-49
TT=1797.1
T1=948.56
? (TO)

TT=1800.04

? (TO)

TT=1800.04

?

TT=1799.51

No dataNo data?

TT=1799.91

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb56-25-opb/normalized-frb56-25-3.opb
SAT
f=-52
TT=1800.02
T1=660.13
SAT
f=-44
TT=1798.02
T1=528.25
No dataSAT (TO)
f=-46
TT=1800.02
T1=70.91
? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1806.2

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.14

SAT (TO)
f=-43
TT=1800.09
T1=28.77
SAT (TO)
f=-52
TT=1800.03
T1=660.13
? (TO)

TT=1792.38

SAT
f=-10
TT=1783.02
T1=1783.42
SAT (TO)
f=-42
TT=1800.01
T1=1.98
SAT
f=-43
TT=1798.06
T1=648.7
SAT (TO)
f=-43
TT=1800.01
T1=2.46
SAT
f=-49
TT=1794.4
T1=1282.5
No data? (TO)

TT=1800.36

? (TO)

TT=1241.57

SAT
f=-48
TT=1790.09
T1=1566.97
No dataSAT (TO)
f=-46
TT=1800.04
T1=724.6
SAT
f=-48
TT=1797.28
T1=983.22
SAT (TO)
f=-52
TT=1800.02
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=-51
TT=1800.49
T1=900.51
No dataNo dataSAT (TO)
f=-51
TT=1800.11
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-43
TT=1800.16
T1=13.48
SAT (TO)
f=-39
TT=1800.07
T1=0.85
SAT (TO)
f=-45
TT=1800.78
T1=646.82
SAT
f=-48
TT=1797.08
T1=680.56
SAT
f=-48
TT=1797.07
T1=688.28
SAT
f=-48
TT=1797.08
T1=679.95
? (TO)

TT=1800.05

? (TO)

TT=1800.13

?

TT=1799.51

No dataNo data?

TT=1799.55

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb56-25-opb/normalized-frb56-25-5.opb
SAT
f=-52
TT=1800.09
T1=1800.5
SAT
f=-44
TT=1798.01
T1=534.1
No dataSAT (TO)
f=-46
TT=1800
T1=1723.63
? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.14

? (TO)

TT=1800.05

SAT (TO)
f=-42
TT=1800.12
T1=3.4
SAT (TO)
f=-51
TT=1800.02
T1=1490.68
? (TO)

TT=1800.11

SAT
f=-12
TT=1783.03
T1=1783.54
? (exit code)

TT=326.75

SAT
f=-43
TT=1798.04
T1=6.51
SAT (TO)
f=-43
TT=1800.02
T1=12.52
SAT
f=-46
TT=1794.43
T1=1726.65
No data? (TO)

TT=1800.36

? (TO)

TT=1063.16

SAT
f=-48
TT=1790.06
T1=1522.71
No dataSAT (TO)
f=-45
TT=1800.01
T1=506.6
SAT
f=-49
TT=1797.14
T1=1504.23
SAT (TO)
f=-52
TT=1800.09
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=-50
TT=1800.45
T1=900.51
No dataNo dataSAT (TO)
f=-50
TT=1800.02
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-44
TT=1800.48
T1=397.05
SAT (TO)
f=-39
TT=1800.74
T1=0.8
SAT (TO)
f=-45
TT=1800.08
T1=70.18
SAT
f=-49
TT=1797.17
T1=1435.45
SAT
f=-49
TT=1797.19
T1=1625.92
SAT
f=-49
TT=1797.11
T1=1318.04
? (TO)

TT=1800.09

? (TO)

TT=1800.04

?

TT=1799.59

No dataNo data?

TT=1799.61

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb59-26-opb/normalized-frb59-26-1.opb
SAT
f=-54
TT=1800.02
T1=289.01
SAT
f=-46
TT=1798.01
T1=637.91
No dataSAT (TO)
f=-49
TT=1800.06
T1=834.99
? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=-45
TT=1800.13
T1=1611.45
SAT (TO)
f=-54
TT=1800.05
T1=289.01
? (TO)

TT=1215.35

SAT
f=-9
TT=1783.06
T1=1783.56
SAT (TO)
f=-45
TT=1800.09
T1=5.28
SAT
f=-45
TT=1798.11
T1=54.35
SAT (TO)
f=-46
TT=1800.55
T1=67.32
SAT
f=-49
TT=1794.01
T1=926.57
No data? (TO)

TT=1800.19

? (TO)

TT=1430.57

SAT
f=-49
TT=1790.14
T1=1276.31
No dataSAT (TO)
f=-46
TT=1800.16
T1=43.24
SAT
f=-51
TT=1797.24
T1=1590.88
SAT (TO)
f=-54
TT=1800.02
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=-54
TT=1800.55
T1=900.51
No dataNo dataSAT (TO)
f=-54
TT=1800.03
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-45
TT=1802.05
T1=17.53
SAT (TO)
f=-41
TT=1800.02
T1=0.91
SAT (TO)
f=-47
TT=1800.01
T1=174.25
SAT
f=-50
TT=1797.14
T1=866.87
SAT
f=-50
TT=1797.26
T1=963.44
SAT
f=-50
TT=1797.17
T1=866.17
? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.8

No dataNo data?

TT=1799.46

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb59-26-opb/normalized-frb59-26-3.opb
SAT
f=-55
TT=1800.06
T1=1800.5
SAT
f=-46
TT=1798.01
T1=810.63
No dataSAT (TO)
f=-48
TT=1800.07
T1=64.84
? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.05

SAT (TO)
f=-45
TT=1800.14
T1=2.04
SAT (TO)
f=-54
TT=1800.06
T1=1017.05
? (TO)

TT=1800.05

SAT
f=-8
TT=1783.04
T1=1783.62
SAT (TO)
f=-44
TT=1800.01
T1=2.09
SAT
f=-45
TT=1798.03
T1=26.47
SAT (TO)
f=-45
TT=1800.62
T1=1523.43
SAT
f=-50
TT=1794.19
T1=1109.49
No data? (TO)

TT=1800.12

? (TO)

TT=1802.01

SAT
f=-48
TT=1790.12
T1=1254.76
No dataSAT (TO)
f=-46
TT=1800.01
T1=118.95
SAT
f=-51
TT=1797.16
T1=1171.02
SAT (TO)
f=-55
TT=1800.06
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=-51
TT=1800.17
T1=900.61
No dataNo dataSAT (TO)
f=-51
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-46
TT=1800.09
T1=942.66
SAT (TO)
f=-43
TT=1800
T1=0.86
SAT (TO)
f=-46
TT=1800.08
T1=144.6
SAT
f=-51
TT=1797.23
T1=557.59
SAT
f=-51
TT=1797.16
T1=582.37
SAT
f=-51
TT=1797.24
T1=657.73
? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.53

No dataNo data?

TT=1799.59

normalized-PB06/OPT-SMALLINT/web/
www.nlsde.buaa.edu.cn/~kexu/
benchmarks/frb59-26-opb/normalized-frb59-26-4.opb
SAT
f=-54
TT=1800.01
T1=1692.61
SAT
f=-45
TT=1798.01
T1=22.89
No dataSAT (TO)
f=-48
TT=1800.07
T1=312.98
? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.09

SAT (TO)
f=-45
TT=1800.18
T1=28.19
SAT (TO)
f=-54
TT=1800.01
T1=1692.61
? (TO)

TT=1217.37

SAT
f=-9
TT=1783.02
T1=1783.41
SAT (TO)
f=-44
TT=1800.09
T1=1.69
SAT
f=-46
TT=1798.03
T1=1325.24
SAT (TO)
f=-45
TT=1800.07
T1=10.9
SAT
f=-48
TT=1793.41
T1=1093.06
No data? (TO)

TT=1800.31

? (TO)

TT=1362.11

SAT
f=-49
TT=1790.56
T1=1131.43
No dataSAT (TO)
f=-48
TT=1800.11
T1=750.89
SAT
f=-50
TT=1797.24
T1=554.96
SAT (TO)
f=-54
TT=1800.06
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=-52
TT=1800.14
T1=900.61
No dataNo dataSAT (TO)
f=-52
TT=1800.16
T1=900.61
No dataNo dataNo dataSAT (TO)
f=-45
TT=1800.89
T1=917.32
SAT (TO)
f=-41
TT=1800.07
T1=0.84
SAT (TO)
f=-47
TT=1800.09
T1=16.95
SAT
f=-50
TT=1797.13
T1=437.62
SAT
f=-50
TT=1797.23
T1=520.95
SAT
f=-50
TT=1797.32
T1=502.83
? (TO)

TT=1800.08

? (TO)

TT=1800.12

?

TT=1799.56

No dataNo data?

TT=1799.56

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
course-ass/normalized-ss97-2.opb
OPT
f=939
TT=5.379
T1=5.3
SAT
f=7400
TT=1798.02
T1=290.95
No data? (TO)

TT=1800.02

? (TO)

TT=1800.14

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.02

Signal

TT=1662.99

SAT (TO)
f=25437
TT=1800.08
T1=1190.28
? (TO)

TT=1800.06

SAT
f=38437
TT=1783.02
T1=1783.33
No Cert.

TT=837.36

SAT
f=7088
TT=1798.11
T1=470.17
? (TO)

TT=1800.06

OPT
f=939
TT=332.605
T1=332.6
No dataOPT
f=939
TT=5.379
T1=5.3
SAT (TO)
f=2913
TT=1800.07
T1=1.58
OPT
f=939
TT=9.539
T1=9.45
No dataSAT (TO)
f=2913
TT=1800.69
T1=1.57
OPT
f=939
TT=8.926
T1=8.85
SAT (TO)
f=24824
TT=1800.07
T1=1800.9
? (TO)

TT=1800.11

? (TO)

TT=1800.13

No dataNo dataNo data? (TO)

TT=1800.16

No dataNo dataSAT (TO)
f=8616
TT=1800.54
T1=900.31
No dataNo dataNo dataSAT (TO)
f=1217
TT=1800.16
T1=2.38
SAT (TO)
f=1318
TT=1800.02
T1=1.76
? (TO)

TT=1800.02

OPT
f=939
TT=324.097
T1=324.06
OPT
f=939
TT=299.855
T1=299.83
OPT
f=939
TT=322.286
T1=322.26
? (TO)

TT=1800.11

? (TO)

TT=1800.11

?

TT=1799.77

No dataNo data?

TT=1799.49

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
course-ass/normalized-ss97-4.opb
OPT
f=813
TT=0.191
T1=0.18
SAT
f=3040
TT=1798.01
T1=5.22
No dataSAT (TO)
f=828
TT=1800.11
T1=0.09
? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.02

SAT (TO)
f=2528
TT=1800.11
T1=35.87
? (TO)

TT=1800.12

? (TO)

TT=1800.04

SAT
f=15386
TT=1783
T1=1783.28
? (exit code)

TT=293.01

SAT
f=3040
TT=1798.02
T1=4.67
SAT (TO)
f=837
TT=1800.81
T1=0.66
OPT
f=813
TT=0.223
T1=0.21
No dataOPT
f=813
TT=0.443
T1=0.43
OPT
f=813
TT=742.24
T1=79.34
OPT
f=813
TT=0.29
T1=0.28
No dataSAT (TO)
f=814
TT=1800.59
T1=908.48
OPT
f=813
TT=0.315
T1=0.3
SAT (TO)
f=2139
TT=1800.04
T1=1800.5
? (TO)

TT=1800.13

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=2037
TT=1800.13
T1=900.31
No dataNo dataSAT (TO)
f=2045
TT=1800.07
T1=900.31
No dataNo dataNo data? (TO)

TT=1802.33

SAT (TO)
f=834
TT=1800.04
T1=0.47
SAT (TO)
f=2745
TT=1800.06
T1=1589.18
OPT
f=813
TT=0.252
T1=0.24
OPT
f=813
TT=0.299
T1=0.28
OPT
f=813
TT=0.191
T1=0.18
? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.52

No dataNo data?

TT=1799.93

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
course-ass/normalized-ss97-6.opb
OPT
f=304
TT=0.011
T1=0.01
OPT
f=304
TT=0.192
T1=0.07
No dataSAT (TO)
f=304
TT=1800.03
T1=0.34
OPT
f=304
TT=2.053
T1=1.86
OPT
f=304
TT=2.033
T1=2.02
? (problem)

TT=0.108

? (problem)

TT=0.127

? (problem)

TT=0.109

? (problem)

TT=0.128

? (problem)

TT=0.108

? (problem)

TT=0.124

SAT (TO)
f=304
TT=1800.03
T1=0.05
OPT
f=304
TT=0.537
T1=0.53
? (TO)

TT=1594.41

SAT
f=1432
TT=1783
T1=1783.27
SAT
f=304
TT=643.856
T1=0.31
OPT
f=304
TT=0.176
T1=0.06
SAT (TO)
f=304
TT=1800.4
T1=35.07
OPT
f=304
TT=0.022
T1=0.02
No dataOPT
f=304
TT=0.011
T1=0.01
OPT
f=304
TT=1.174
T1=2.19
OPT
f=304
TT=0.022
T1=0.01
No dataOPT
f=304
TT=1.093
T1=1.16
OPT
f=304
TT=0.029
T1=0.02
OPT
f=304
TT=0.135
T1=0.13
OPT
f=304
TT=0.753
T1=0.66
OPT
f=304
TT=1.035
T1=0.94
No dataNo dataNo dataOPT
f=304
TT=50.229
T1=25.19
No dataNo dataOPT
f=304
TT=29.319
T1=14.69
No dataNo dataNo dataOPT
f=304
TT=1.062
T1=1.17
SAT (TO)
f=305
TT=1800.65
T1=0.17
SAT (TO)
f=304
TT=1800.09
T1=1.36
OPT
f=304
TT=0.022
T1=0.01
OPT
f=304
TT=0.022
T1=0.01
OPT
f=304
TT=0.017
T1=0.01
? (TO)

TT=1800.11

? (TO)

TT=1800.08

OPT
f=304
TT=16.921
T1=16.91
No dataNo dataOPT
f=304
TT=17.152
T1=17.19
normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
course-ass/normalized-ws97-5.opb
OPT
f=2642
TT=0.051
T1=0.04
SAT
f=4248
TT=1798.01
T1=2.09
No dataSAT (TO)
f=2655
TT=1800.11
T1=0.02
? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.14

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.1

SAT (TO)
f=4759
TT=1800.09
T1=0.49
SAT (TO)
f=2748
TT=1800.1
T1=639.09
? (TO)

TT=1800.26

SAT
f=10658
TT=1783
T1=1783.4
? (exit code)

TT=409.28

SAT
f=4248
TT=1798.01
T1=1.93
SAT (TO)
f=2653
TT=1801.1
T1=0.23
OPT
f=2642
TT=0.056
T1=0.05
No dataOPT
f=2642
TT=0.098
T1=0.09
OPT
f=2642
TT=13.554
T1=12.26
OPT
f=2642
TT=0.051
T1=0.04
No dataOPT
f=2642
TT=14.713
T1=6.85
OPT
f=2642
TT=0.067
T1=0.06
SAT (TO)
f=2945
TT=1800.08
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=4053
TT=1800.19
T1=900.31
No dataNo dataSAT (TO)
f=3451
TT=1800.15
T1=900.31
No dataNo dataNo dataOPT
f=2642
TT=25.461
T1=12.38
SAT (TO)
f=2653
TT=1800.01
T1=0.24
SAT (TO)
f=3954
TT=1800.02
T1=109.14
OPT
f=2642
TT=0.066
T1=0.06
OPT
f=2642
TT=0.064
T1=0.06
OPT
f=2642
TT=0.055
T1=0.05
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.61

No dataNo data?

TT=1799.85

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-10:10:4.5:0.5:100.opb
OPT
f=3
TT=0.028
T1=0.02
OPT
f=3
TT=0.274
T1=0.26
No dataSAT (TO)
f=6
TT=1800.02
T1=8.55
? (TO)

TT=1800.04

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.14

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.14

OPT
f=3
TT=0.02
T1=0.02
SAT (TO)
f=7
TT=1800.08
T1=1234.43
? (TO)

TT=1800.1

SAT
f=7
TT=1783
T1=1783.27
SAT (TO)
f=12
TT=1800.07
T1=0.21
OPT
f=3
TT=0.292
T1=0.28
? (exit code)

TT=875.453

OPT
f=3
TT=0.36
T1=0.35
No dataOPT
f=3
TT=0.028
T1=0.02
SAT (TO)
f=7
TT=1801.08
T1=284.92
OPT
f=3
TT=0.691
T1=0.68
No dataSAT (TO)
f=7
TT=1800.15
T1=147.05
OPT
f=3
TT=0.347
T1=0.34
SAT (TO)
f=7
TT=1800.07
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=5
TT=1800.51
T1=900.31
No dataNo dataSAT (TO)
f=5
TT=1800.17
T1=900.31
No dataNo dataNo dataSAT (TO)
f=9
TT=1800.1
T1=2.23
SAT (TO)
f=12
TT=1800.89
T1=0.21
SAT (TO)
f=21
TT=1800.03
T1=276.87
OPT
f=3
TT=0.387
T1=0.37
OPT
f=3
TT=0.394
T1=0.37
OPT
f=3
TT=0.324
T1=0.31
? (TO)

TT=1800.02

? (TO)

TT=1800.1

?

TT=1799.89

No dataNo data?

TT=1799.79

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-10:10:4.5:0.95:100.opb
OPT
f=0
TT=0.04
T1=0.03
OPT
f=0
TT=0.668
T1=0.64
No dataSAT (TO)
f=3
TT=1800.02
T1=1086.1
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.08

OPT
f=0
TT=0.107
T1=0.1
SAT (TO)
f=6
TT=1800.05
T1=274.47
? (TO)

TT=1800.29

SAT
f=5
TT=1783
T1=1783.3
? (exit code)

TT=984.157

OPT
f=0
TT=0.706
T1=0.68
? (exit code)

TT=970.48

OPT
f=0
TT=0.547
T1=0.53
No dataOPT
f=0
TT=0.04
T1=0.03
SAT (TO)
f=3
TT=1800.52
T1=2.21
OPT
f=0
TT=0.062
T1=0.05
No dataSAT (TO)
f=3
TT=1800.08
T1=1.23
OPT
f=0
TT=0.069
T1=0.06
SAT (TO)
f=6
TT=1800.04
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=1
TT=1800.17
T1=900.31
No dataNo dataSAT (TO)
f=1
TT=1800.07
T1=900.31
No dataNo dataNo dataSAT (TO)
f=3
TT=1800.2
T1=1.22
SAT (TO)
f=5
TT=1800.69
T1=0.2
SAT (TO)
f=21
TT=1800.03
T1=0.25
OPT
f=0
TT=0.176
T1=0.16
OPT
f=0
TT=0.166
T1=0.15
OPT
f=0
TT=0.115
T1=0.11
? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.46

No dataNo data?

TT=1799.81

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-10:10:4.5:0.95:98.opb
OPT
f=1
TT=0.033
T1=0.03
OPT
f=1
TT=0.146
T1=0.14
No dataSAT (TO)
f=7
TT=1800.02
T1=1122.84
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.12

OPT
f=1
TT=0.045
T1=0.04
SAT (TO)
f=9
TT=1800.07
T1=120.4
? (TO)

TT=1800.12

SAT
f=11
TT=1783.01
T1=1783.29
? (exit code)

TT=1015.99

OPT
f=1
TT=0.156
T1=0.15
? (exit code)

TT=949.3

OPT
f=1
TT=0.488
T1=0.48
No dataOPT
f=1
TT=0.033
T1=0.03
SAT (TO)
f=6
TT=1800.82
T1=3.24
OPT
f=1
TT=0.533
T1=0.52
No dataSAT (TO)
f=6
TT=1800.06
T1=1.74
OPT
f=1
TT=0.492
T1=0.47
SAT (TO)
f=6
TT=1800.07
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=7
TT=1800.16
T1=900.31
No dataNo dataSAT (TO)
f=7
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=6
TT=1800.07
T1=1.72
SAT (TO)
f=8
TT=1800.09
T1=0.2
SAT (TO)
f=31
TT=1800.04
T1=1069.8
OPT
f=1
TT=0.406
T1=0.39
OPT
f=1
TT=0.391
T1=0.37
OPT
f=1
TT=0.315
T1=0.3
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.56

No dataNo data?

TT=1799.48

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-10:20:4.5:0.5:100.opb
OPT
f=0
TT=0.161
T1=0.16
OPT
f=0
TT=7.411
T1=7.38
No dataSAT (TO)
f=14
TT=1800.02
T1=1396.27
? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.11

OPT
f=0
TT=0.3
T1=0.26
SAT (TO)
f=22
TT=1800.09
T1=1165.85
? (TO)

TT=1613.78

SAT
f=19
TT=1783
T1=1783.38
? (exit code)

TT=407.91

OPT
f=0
TT=7.424
T1=7.39
? (exit code)

TT=1007.2

OPT
f=0
TT=2.881
T1=2.86
No dataOPT
f=0
TT=0.161
T1=0.16
SAT (TO)
f=9
TT=1800.78
T1=8.27
OPT
f=0
TT=5.674
T1=5.66
No dataSAT (TO)
f=9
TT=1800.08
T1=4.29
OPT
f=0
TT=6.476
T1=6.46
SAT (TO)
f=21
TT=1800.06
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=11
TT=1800.55
T1=900.31
No dataNo dataSAT (TO)
f=13
TT=1800.06
T1=900.21
No dataNo dataNo dataSAT (TO)
f=9
TT=1800.02
T1=4.29
SAT (TO)
f=19
TT=1800.07
T1=0.25
SAT (TO)
f=55
TT=1800.65
T1=0.27
OPT
f=0
TT=1.172
T1=1.15
OPT
f=0
TT=1.117
T1=1.09
OPT
f=0
TT=0.941
T1=0.92
? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.5

No dataNo data?

TT=1799.83

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-10:20:4.5:0.95:100.opb
OPT
f=1
TT=0.183
T1=0.18
OPT
f=1
TT=13.864
T1=13.8
No dataSAT (TO)
f=12
TT=1800.02
T1=0
? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.14

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=1
TT=0.4
T1=0.32
SAT (TO)
f=78
TT=1800.07
T1=1246.56
? (TO)

TT=1800.1

SAT
f=16
TT=1783
T1=1783.28
? (exit code)

TT=370.24

OPT
f=1
TT=14.695
T1=14.63
? (exit code)

TT=921.55

OPT
f=1
TT=1.175
T1=1.16
No dataOPT
f=1
TT=0.183
T1=0.18
SAT (TO)
f=10
TT=1800.15
T1=5.27
OPT
f=1
TT=0.85
T1=0.83
No dataSAT (TO)
f=10
TT=1800.04
T1=2.81
OPT
f=1
TT=1.371
T1=1.35
SAT (TO)
f=85
TT=1800.1
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=16
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=13
TT=1800.04
T1=900.31
No dataNo dataNo dataSAT (TO)
f=10
TT=1800.65
T1=2.79
SAT (TO)
f=17
TT=1800.03
T1=0.26
SAT (TO)
f=50
TT=1800.1
T1=0.33
OPT
f=1
TT=1.67
T1=1.65
OPT
f=1
TT=1.722
T1=1.7
OPT
f=1
TT=1.34
T1=1.32
? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.87

No dataNo data?

TT=1799.5

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-10:20:4.5:0.95:98.opb
OPT
f=2
TT=0.182
T1=0.18
OPT
f=2
TT=5.73
T1=5.73
No dataSAT (TO)
f=19
TT=1800.1
T1=0
? (TO)

TT=1800.11

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.12

OPT
f=2
TT=0.384
T1=0.34
SAT (TO)
f=88
TT=1800.07
T1=1642.29
? (TO)

TT=1800.3

SAT
f=25
TT=1783.01
T1=1783.28
? (exit code)

TT=338.932

OPT
f=2
TT=5.825
T1=5.82
? (exit code)

TT=748.17

OPT
f=2
TT=2.066
T1=2.06
No dataOPT
f=2
TT=0.182
T1=0.18
SAT (TO)
f=16
TT=1800.2
T1=6.25
OPT
f=2
TT=17.192
T1=17.18
No dataSAT (TO)
f=16
TT=1800.13
T1=4.81
OPT
f=2
TT=1.495
T1=1.47
SAT (TO)
f=94
TT=1800.06
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=19
TT=1800.38
T1=900.31
No dataNo dataSAT (TO)
f=20
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=16
TT=1800.07
T1=3.27
SAT (TO)
f=25
TT=1800.05
T1=0.25
SAT (TO)
f=73
TT=1800.07
T1=0.27
OPT
f=2
TT=1.544
T1=1.52
OPT
f=2
TT=1.548
T1=1.53
OPT
f=2
TT=1.405
T1=1.38
? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.5

No dataNo data?

TT=1799.53

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-30:30:4.5:0.5:100.opb
OPT
f=5
TT=3.303
T1=3.28
SAT
f=83
TT=1798.09
T1=1787.9
No dataSAT (TO)
f=61
TT=1800.08
T1=0.01
? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.07

OPT
f=5
TT=20.487
T1=19.32
SAT (TO)
f=607
TT=1800.06
T1=1114.57
? (TO)

TT=1800.05

SAT
f=109
TT=1783
T1=1783.3
No Cert.

TT=465.57

SAT
f=101
TT=1798.12
T1=1782.96
SAT (TO)
f=51
TT=1800.84
T1=0.5
OPT
f=5
TT=379.803
T1=379.83
No dataOPT
f=5
TT=3.303
T1=3.28
SAT (TO)
f=45
TT=1800.59
T1=41.57
OPT
f=5
TT=217.202
T1=217.21
No dataSAT (TO)
f=45
TT=1800.17
T1=33.54
OPT
f=5
TT=222.845
T1=222.83
SAT (TO)
f=679
TT=1800.06
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=194
TT=1800.53
T1=900.31
No dataNo dataSAT (TO)
f=189
TT=1800.09
T1=900.31
No dataNo dataNo dataSAT (TO)
f=45
TT=1800.09
T1=14.71
SAT (TO)
f=51
TT=1800.09
T1=0.44
SAT (TO)
f=246
TT=1800.09
T1=0.48
OPT
f=5
TT=89.067
T1=89.03
OPT
f=5
TT=85.898
T1=85.87
OPT
f=5
TT=204.469
T1=204.45
? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.83

No dataNo data?

TT=1799.46

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-30:30:4.5:0.95:100.opb
OPT
f=2
TT=4.242
T1=4.22
SAT
f=251
TT=1798.01
T1=302.58
No dataSAT (TO)
f=60
TT=1800.08
T1=0.02
? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=251
TT=1800.06
T1=1779.01
SAT (TO)
f=714
TT=1800.04
T1=1419.78
? (TO)

TT=1800.07

SAT
f=107
TT=1783.01
T1=1783.32
No Cert.

TT=318.24

SAT
f=253
TT=1798.03
T1=0.49
? (exit code)

TT=940.38

OPT
f=2
TT=690.109
T1=690.17
No dataOPT
f=2
TT=4.242
T1=4.22
SAT (TO)
f=54
TT=1800.72
T1=121.66
OPT
f=2
TT=238.791
T1=238.79
No dataSAT (TO)
f=54
TT=1800.03
T1=120.59
OPT
f=2
TT=454.428
T1=454.45
SAT (TO)
f=720
TT=1800.1
T1=1800.6
? (TO)

TT=1800.04

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=226
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=232
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=54
TT=1800.18
T1=29.56
SAT (TO)
f=69
TT=1800.03
T1=0.45
SAT (TO)
f=295
TT=1800.04
T1=0.49
OPT
f=2
TT=372.418
T1=372.42
OPT
f=2
TT=365.326
T1=365.31
OPT
f=2
TT=655.529
T1=655.58
? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.9

No dataNo data?

TT=1799.89

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-30:30:4.5:0.95:98.opb
OPT
f=4
TT=3.544
T1=3.52
SAT
f=283
TT=1798.02
T1=1570.94
No dataSAT (TO)
f=92
TT=1800.11
T1=0.01
? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.04

SAT (TO)
f=272
TT=1800.13
T1=11.31
SAT (TO)
f=731
TT=1800.07
T1=821.55
? (TO)

TT=1800.25

SAT
f=168
TT=1783.01
T1=1783.32
No Cert.

TT=345.31

SAT
f=275
TT=1798.01
T1=637.58
? (exit code)

TT=890.14

OPT
f=4
TT=271.565
T1=271.57
No dataOPT
f=4
TT=3.544
T1=3.52
SAT (TO)
f=80
TT=1800.85
T1=65.49
OPT
f=4
TT=137.072
T1=137.06
No dataSAT (TO)
f=80
TT=1800.07
T1=64.15
OPT
f=4
TT=14.865
T1=14.8
SAT (TO)
f=761
TT=1800.05
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=268
TT=1800.48
T1=900.31
No dataNo dataSAT (TO)
f=276
TT=1800.48
T1=900.31
No dataNo dataNo dataSAT (TO)
f=80
TT=1800.05
T1=22.01
SAT (TO)
f=88
TT=1800.02
T1=0.44
SAT (TO)
f=337
TT=1800.02
T1=0.61
OPT
f=4
TT=167.416
T1=167.37
OPT
f=4
TT=161.755
T1=161.74
OPT
f=4
TT=140.924
T1=140.9
? (TO)

TT=1800.04

? (TO)

TT=1800.02

?

TT=1799.84

No dataNo data?

TT=1799.39

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-30:70:4.5:0.5:100.opb
OPT
f=9
TT=20.584
T1=19.32
SAT
f=614
TT=1798.01
T1=931.54
No dataSAT (TO)
f=130
TT=1800.08
T1=0.03
? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.05

Signal

TT=602.933

SAT (TO)
f=1978
TT=1800.02
T1=1308.29
? (TO)

TT=1765.72

SAT
f=283
TT=1783.01
T1=1783.35
No Cert.

TT=327.266

SAT
f=612
TT=1798.27
T1=232.87
SAT (TO)
f=146
TT=1800.8
T1=0.78
SAT
f=16
TT=1793.19
T1=711.53
No dataOPT
f=9
TT=20.584
T1=19.32
SAT (TO)
f=130
TT=1800.12
T1=788.57
SAT
f=15
TT=1789.82
T1=1732.77
No dataSAT (TO)
f=130
TT=1800.61
T1=677.11
SAT
f=13
TT=1796.8
T1=1377.46
SAT (TO)
f=1952
TT=1800.05
T1=1800.5
? (TO)

TT=1800.1

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=566
TT=1800.14
T1=900.31
No dataNo dataSAT (TO)
f=565
TT=1800.11
T1=900.31
No dataNo dataNo dataSAT (TO)
f=123
TT=1800.03
T1=601.15
SAT (TO)
f=146
TT=1800.03
T1=0.6
SAT (TO)
f=639
TT=1800.67
T1=0.69
SAT
f=10
TT=1796.84
T1=1728.13
SAT
f=10
TT=1796.81
T1=1663.33
SAT
f=10
TT=1796.85
T1=1669.86
? (TO)

TT=1800.08

? (TO)

TT=1800.12

?

TT=1799.61

No dataNo data?

TT=1799.63

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-30:70:4.5:0.95:100.opb
OPT
f=3
TT=18.669
T1=18.53
SAT
f=641
TT=1798.02
T1=1421.59
No dataSAT (TO)
f=140
TT=1800.07
T1=0.02
? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800

Signal

TT=999.199

SAT (TO)
f=2016
TT=1800.03
T1=1113.47
? (TO)

TT=1800.11

SAT
f=276
TT=1783.01
T1=1783.34
No Cert.

TT=302.55

SAT
f=641
TT=1798.21
T1=1670.98
SAT (TO)
f=135
TT=1800.06
T1=0.76
OPT
f=3
TT=1465.25
T1=1465.41
No dataOPT
f=3
TT=18.669
T1=18.53
SAT (TO)
f=127
TT=1800.2
T1=85.81
SAT
f=9
TT=1789.83
T1=1424
No dataSAT (TO)
f=127
TT=1800.15
T1=79.58
SAT
f=7
TT=1796.82
T1=288.17
SAT (TO)
f=1694
TT=1800.03
T1=1800.5
? (TO)

TT=1800.04

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=575
TT=1800.58
T1=900.31
No dataNo dataSAT (TO)
f=593
TT=1800.14
T1=900.31
No dataNo dataNo dataSAT (TO)
f=127
TT=1800.19
T1=55.59
SAT (TO)
f=135
TT=1800.02
T1=0.61
SAT (TO)
f=688
TT=1800.01
T1=0.61
OPT
f=3
TT=1611.71
T1=1611.8
OPT
f=3
TT=1627.71
T1=1627.79
OPT
f=3
TT=1560.37
T1=1560.48
? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo data?

TT=1799.44

normalized-PB06/OPT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
radar/normalized-30:70:4.5:0.95:98.opb
OPT
f=12
TT=20.71
T1=20.57
SAT
f=729
TT=1798.02
T1=5.37
No dataSAT (TO)
f=249
TT=1800.09
T1=0.03
? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.02

Signal

TT=660.294

SAT (TO)
f=2084
TT=1800.03
T1=589.84
? (TO)

TT=1796.24

SAT
f=390
TT=1783.01
T1=1783.33
? (exit code)

TT=266.7

Signal

TT=1575.95

SAT (TO)
f=203
TT=1800.05
T1=0.78
OPT
f=12
TT=1242.19
T1=1242.29
No dataOPT
f=12
TT=20.71
T1=20.57
SAT (TO)
f=203
TT=1800.57
T1=1.65
SAT
f=15
TT=1789.84
T1=1051.91
No dataSAT (TO)
f=203
TT=1800.02
T1=1.14
SAT
f=15
TT=1796.91
T1=1000.33
SAT (TO)
f=2084
TT=1800.06
T1=1800.61
? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=737
TT=1800.52
T1=900.31
No dataNo dataSAT (TO)
f=718
TT=1800.09
T1=900.31
No dataNo dataNo dataSAT (TO)
f=203
TT=1800.66
T1=1.18
SAT (TO)
f=203
TT=1800.09
T1=0.63
SAT (TO)
f=765
TT=1800.08
T1=0.69
SAT
f=17
TT=1796.82
T1=537.71
SAT
f=17
TT=1796.86
T1=536.83
SAT
f=17
TT=1796.85
T1=520.33
? (TO)

TT=1800.04

? (TO)

TT=1800.06

?

TT=1799.51

No dataNo data?

TT=1799.53

normalized-PB06/SATUNSAT-BIGINT/
submitted-PB06/manquiho/
Aardal_1/normalized-cuww4.opb
SAT
TT=0.371
T1=0.37
No dataNo dataNo data? (problem)
TT=0.402

? (TO)
TT=1800.13

? (problem)
TT=0.403

? (TO)
TT=1800.07

? (problem)
TT=0.403

? (TO)
TT=1800.08

? (problem)
TT=0.437

? (TO)
TT=1800.1

? (TO)
TT=1800.03

SAT
TT=7.59
T1=7.58
No dataNo data? (exit code)
TT=358.311

No data? (TO)
TT=1800.36

No dataNo dataNo data? (TO)
TT=1800.16

?
TT=1795.75

No data? (TO)
TT=1800.83

No dataSAT
TT=0.371
T1=0.37
? (problem)
TT=0.422

? (problem)
TT=0.474

? (TO)
TT=1800.02

? (TO)
TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.22

? (TO)
TT=1800.56

? (TO)
TT=1800.68

No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-BIGINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob10.opb
SAT
TT=0.534
T1=0.33
No dataNo dataNo data? (problem)
TT=0.405

? (TO)
TT=1800.07

? (problem)
TT=0.422

? (TO)
TT=1800.09

? (problem)
TT=0.402

? (TO)
TT=1800.06

? (problem)
TT=0.423

? (TO)
TT=1800.06

SAT
TT=29.204
T1=29.21
SAT
TT=1183.73
T1=1183.91
No dataNo dataSAT
TT=0.534
T1=0.33
No dataSAT
TT=3.284
T1=2.96
No dataNo dataNo dataSAT
TT=20.641
T1=10.15
SAT
TT=5.128
T1=5.12
No dataSAT
TT=18.943
T1=9.17
No dataSAT
TT=102.846
T1=102.86
? (problem)
TT=0.564

? (problem)
TT=0.483

? (TO)
TT=1800.07

? (TO)
TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=16.97
T1=8.23
SAT
TT=209.75
T1=207.83
SAT
TT=11.184
T1=10.5
No dataNo dataNo dataSAT
TT=13.016
T1=13.01
SAT
TT=12.866
T1=12.86
No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-cuww1.opb
SAT
TT=0.004
T1=0
No dataNo dataNo data? (problem)
TT=0.42

? (TO)
TT=1800.1

? (problem)
TT=0.386

? (TO)
TT=1800.09

? (problem)
TT=0.533

? (TO)
TT=1800.08

? (problem)
TT=0.475

? (TO)
TT=1800.07

SAT
TT=0.004
T1=0
SAT
TT=4.729
T1=4.72
No dataNo dataSAT
TT=0.115
T1=0.13
No dataSAT
TT=0.145
T1=0.17
No dataNo dataNo dataSAT
TT=0.153
T1=1.13
SAT
TT=0.019
T1=0.01
No dataSAT
TT=0.164
T1=0.65
No dataSAT
TT=0.263
T1=0.26
? (problem)
TT=0.46

? (problem)
TT=0.402

? (TO)
TT=1800.06

? (TO)
TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=0.163
T1=0.63
SAT
TT=0.143
T1=0.13
SAT
TT=0.186
T1=0.15
No dataNo dataNo data? (TO)
TT=1800.1

? (TO)
TT=1800.11

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-cuww2.opb
SAT
TT=0.816
T1=0.81
No dataNo dataNo data? (problem)
TT=0.426

? (TO)
TT=1800.1

? (problem)
TT=0.417

? (TO)
TT=1800.07

? (problem)
TT=0.412

? (TO)
TT=1800.07

? (problem)
TT=0.469

? (TO)
TT=1800.07

? (TO)
TT=1800.02

SAT
TT=12.33
T1=12.32
No dataNo data? (exit code)
TT=289.189

No data? (TO)
TT=1800.09

No dataNo dataNo data? (TO)
TT=1800.89

SAT
TT=604.056
T1=604.18
No data? (TO)
TT=1800.18

No dataSAT
TT=0.816
T1=0.81
? (problem)
TT=0.448

? (problem)
TT=0.397

? (TO)
TT=1800.08

? (TO)
TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.72

? (TO)
TT=1800.1

? (TO)
TT=1800.76

No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-cuww3.opb
SAT
TT=0.417
T1=0.41
No dataNo dataNo data? (problem)
TT=0.441

? (TO)
TT=1800.12

? (problem)
TT=0.383

? (TO)
TT=1800.03

? (problem)
TT=0.484

? (TO)
TT=1800.08

? (problem)
TT=0.463

? (TO)
TT=1800.08

? (TO)
TT=1800.03

SAT
TT=8.033
T1=8.02
No dataNo data?
TT=434.65

No data? (TO)
TT=1800.63

No dataNo dataNo dataSAT
TT=2.325
T1=1.12
?
TT=1794.4

No dataSAT
TT=1.884
T1=0.64
No dataSAT
TT=0.417
T1=0.41
? (problem)
TT=0.457

? (problem)
TT=0.401

? (TO)
TT=1800.06

? (TO)
TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.82

SAT
TT=433.418
T1=430.57
? (TO)
TT=1800.02

No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-cuww5.opb
SAT
TT=1.087
T1=1.08
No dataNo dataNo data? (problem)
TT=0.421

? (TO)
TT=1800.12

? (problem)
TT=0.394

? (TO)
TT=1800.1

? (problem)
TT=0.408

? (TO)
TT=1800.06

? (problem)
TT=0.465

? (TO)
TT=1800.08

? (TO)
TT=1800.02

SAT
TT=17.828
T1=17.81
No dataNo data? (exit code)
TT=312.537

No data? (TO)
TT=1800.4

No dataNo dataNo data? (TO)
TT=1800.04

?
TT=1793.46

No data? (TO)
TT=1800.05

No dataSAT
TT=1.087
T1=1.08
? (problem)
TT=0.436

? (problem)
TT=0.398

? (TO)
TT=1800.02

? (TO)
TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.07

? (TO)
TT=1800.29

SAT
TT=58.245
T1=57.35
No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob1.opb
SAT
TT=0.041
T1=0.04
No dataNo dataNo data? (problem)
TT=0.428

SAT
TT=21.689
T1=21.69
? (problem)
TT=0.429

SAT
TT=21.529
T1=21.53
? (problem)
TT=0.46

SAT
TT=22.012
T1=22.01
? (problem)
TT=0.474

SAT
TT=22.116
T1=22.11
SAT
TT=0.041
T1=0.04
SAT
TT=638.103
T1=638.21
No dataNo dataSAT
TT=16.212
T1=15.66
No data? (TO)
TT=1800.76

No dataNo dataNo dataSAT
TT=16.582
T1=8.12
SAT
TT=25.186
T1=25.18
No dataSAT
TT=1.683
T1=0.66
No dataSAT
TT=1414.17
T1=1414.5
? (problem)
TT=0.526

? (problem)
TT=0.447

? (TO)
TT=1800.06

? (TO)
TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=3.245
T1=1.15
SAT
TT=223.02
T1=221.33
? (TO)
TT=1800.08

No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob2.opb
SAT
TT=0.335
T1=0.2
No dataNo dataNo data? (problem)
TT=0.412

SAT
TT=198.529
T1=198.56
? (problem)
TT=0.387

SAT
TT=186.907
T1=186.94
? (problem)
TT=0.415

SAT
TT=188.618
T1=188.65
? (problem)
TT=0.468

SAT
TT=191.926
T1=191.95
SAT
TT=0.491
T1=0.49
SAT
TT=143.811
T1=143.87
No dataNo dataSAT
TT=0.335
T1=0.2
No data? (TO)
TT=1800.02

No dataNo dataNo dataSAT
TT=1.064
T1=1.12
SAT
TT=1652.65
T1=1652.93
No dataSAT
TT=1.004
T1=0.65
No dataSAT
TT=15.88
T1=15.86
? (problem)
TT=0.528

? (problem)
TT=0.448

? (TO)
TT=1800.02

? (TO)
TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=359.379
T1=180.46
? (TO)
TT=1800

? (TO)
TT=1800.6

No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.01

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob3.opb
UNSAT
TT=0.193

No dataNo dataNo data? (problem)
TT=0.417

? (TO)
TT=1800.14

? (problem)
TT=0.394

? (TO)
TT=1800.09

? (problem)
TT=0.435

? (TO)
TT=1800.09

? (problem)
TT=0.467

? (TO)
TT=1800.09

? (TO)
TT=1800.03

Signal
TT=2.423

No dataNo data? (exit code)
TT=1166.17

No data? (TO)
TT=1800.3

No dataNo dataNo data? (TO)
TT=1800.2

?
TT=1791.91

No data? (TO)
TT=1800.35

No dataUNSAT
TT=0.193

? (problem)
TT=0.5

? (problem)
TT=0.446

? (TO)
TT=1800.1

? (TO)
TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.7

? (TO)
TT=1800

? (TO)
TT=1800.1

No dataNo dataNo data? (TO)
TT=1800.01

? (TO)
TT=1800.01

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob4.opb
SAT
TT=1.824
T1=1.15
No dataNo dataNo data? (problem)
TT=0.424

SAT
TT=1651.04
T1=1651.3
? (problem)
TT=0.419

SAT
TT=1699.05
T1=1699.34
? (problem)
TT=0.507

SAT
TT=1695.24
T1=1695.52
? (problem)
TT=0.478

SAT
TT=1651.27
T1=1651.52
SAT
TT=144.803
T1=144.82
SAT
TT=387.372
T1=387.44
No dataNo data?
TT=293.86

No data? (TO)
TT=1800.42

No dataNo dataNo dataSAT
TT=123.105
T1=62.25
SAT
TT=12.864
T1=12.86
No dataSAT
TT=26.961
T1=13.14
No dataSAT
TT=492.78
T1=492.86
? (problem)
TT=0.518

? (problem)
TT=0.425

? (TO)
TT=1800

? (TO)
TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT
TT=2.84
T1=1.15
SAT
TT=256.12
T1=253.94
SAT
TT=1.824
T1=1.45
No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob5.opb
SAT
TT=0.4
T1=0.39
No dataNo dataNo data? (problem)
TT=0.415

SAT
TT=40.345
T1=40.36
? (problem)
TT=0.391

SAT
TT=38.357
T1=38.36
? (problem)
TT=0.515

SAT
TT=38.297
T1=38.3
? (problem)
TT=0.473

SAT
TT=38.974
T1=40
SAT
TT=13.645
T1=13.64
SAT
TT=791.242
T1=791.36
No dataNo data?
TT=471.521

No dataSAT
TT=1183.72
T1=1180.76
No dataNo dataNo dataSAT
TT=11.972
T1=6.13
SAT
TT=0.4
T1=0.39
No dataSAT
TT=447.306
T1=232.4
No dataSAT
TT=101.231
T1=101.22
? (problem)
TT=0.511

? (problem)
TT=0.458

? (TO)
TT=1800.03

? (TO)
TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.05

SAT
TT=181.426
T1=179.78
SAT
TT=84.72
T1=83.64
No dataNo dataNo data? (TO)
TT=1800.01

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob6.opb
SAT
TT=0.045
T1=0.04
No dataNo dataNo data? (problem)
TT=0.435

SAT
TT=156.458
T1=156.49
? (problem)
TT=0.415

SAT
TT=155.331
T1=155.36
? (problem)
TT=0.433

SAT
TT=154.361
T1=154.38
? (problem)
TT=0.475

SAT
TT=161.509
T1=161.53
SAT
TT=0.045
T1=0.04
SAT
TT=291.814
T1=291.89
No dataNo data? (exit code)
TT=629.76

No data? (TO)
TT=1800.66

No dataNo dataNo dataSAT
TT=109.237
T1=55.16
?
TT=1795.39

No dataSAT
TT=332.474
T1=170.93
No dataSAT
TT=12.749
T1=12.75
? (problem)
TT=0.509

? (problem)
TT=0.455

? (TO)
TT=1800.03

? (TO)
TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.87

? (TO)
TT=1800.08

SAT
TT=0.957
T1=0.53
No dataNo dataNo data? (TO)
TT=1800.11

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob7.opb
SAT
TT=2.834
T1=1.12
No dataNo dataNo data? (problem)
TT=0.431

SAT
TT=310
T1=310.05
? (problem)
TT=0.414

SAT
TT=306.47
T1=306.52
? (problem)
TT=0.545

SAT
TT=316.874
T1=316.92
? (problem)
TT=0.519

SAT
TT=307.821
T1=307.87
? (TO)
TT=1800.03

SAT
TT=240.555
T1=240.61
No dataNo data? (exit code)
TT=549.83

No data? (TO)
TT=1800.3

No dataNo dataNo dataSAT
TT=2.834
T1=1.12
SAT
TT=184.52
T1=184.57
No data? (TO)
TT=1800.04

No dataSAT
TT=258.678
T1=258.72
? (problem)
TT=0.515

? (problem)
TT=0.457

? (TO)
TT=1800.08

? (TO)
TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.09

? (TO)
TT=1800.28

? (TO)
TT=1800.09

No dataNo dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.03

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-MEDINT/
submitted-PB06/manquiho/
Aardal_1/normalized-prob8.opb
SAT
TT=229.381
T1=229.43
No dataNo dataNo data? (problem)
TT=0.437

? (TO)
TT=1800.1

? (problem)
TT=0.378

? (TO)
TT=1800.07

? (problem)
TT=0.471

? (TO)
TT=1800.07

? (problem)
TT=0.478

? (TO)
TT=1800.07

? (TO)
TT=1800.03

? (TO)
TT=1800.02

No dataNo data? (exit code)
TT=339.55

No data? (TO)
TT=1800.12

No dataNo dataNo dataSAT
TT=1484.92
T1=788.22
SAT
TT=229.381
T1=229.43
No data? (TO)
TT=1800.7

No data? (TO)
TT=1800.03

? (problem)
TT=0.501

? (problem)
TT=0.442

? (TO)
TT=1800.05

? (TO)
TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)
TT=1800.77

? (TO)
TT=1800.67

? (TO)
TT=1800.02

No dataNo dataNo data? (TO)
TT=1800.06

? (TO)
TT=1800.02

No dataNo dataNo dataNo data
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl10_11_pb.cnf.cr.opb
UNSAT
TT=0.002

UNSAT
TT=0.004

UNSAT
TT=138.958

No data? (problem)
TT=0.003

UNSAT
TT=0.678

? (problem)
TT=0.002

UNSAT
TT=0.021

? (problem)
TT=0.002

UNSAT
TT=0.019

? (problem)
TT=0.004

UNSAT
TT=0.019

UNSAT
TT=136.123

UNSAT
TT=15.857

UNSAT
TT=67.31

UNSAT
TT=0.002

UNSAT
TT=307.66

UNSAT
TT=0.004

UNSAT
TT=63.326

UNSAT
TT=0.015

UNSAT
TT=183.94

UNSAT
TT=0.008

UNSAT
TT=0.304

UNSAT
TT=0.02

UNSAT
TT=0.486

UNSAT
TT=0.304

UNSAT
TT=0.02

UNSAT
TT=9.722

? (problem)
TT=0.003

? (problem)
TT=0.003

UNSAT
TT=80.247

UNSAT
TT=2.212

UNSAT
TT=295.02

No dataNo dataNo dataNo dataUNSAT
TT=298.93

No dataNo dataUNSAT
TT=0.284

UNSAT
TT=176.84

UNSAT
TT=33.289

UNSAT
TT=0.018

UNSAT
TT=0.025

UNSAT
TT=0.027

UNSAT
TT=449.037

UNSAT
TT=449.79

UNSAT
TT=299.73

No dataNo dataUNSAT
TT=286.23

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl10_20_pb.cnf.cr.opb
UNSAT
TT=0.004

UNSAT
TT=0.007

UNSAT
TT=39.891

No data? (problem)
TT=0.004

UNSAT
TT=1.327

? (problem)
TT=0.001

UNSAT
TT=1.27

? (problem)
TT=0.003

UNSAT
TT=1.27

? (problem)
TT=0.005

UNSAT
TT=1.27

? (TO)
TT=1800.02

UNSAT
TT=61.708

UNSAT
TT=56.85

UNSAT
TT=0.004

? (TO)
TT=1800.1

UNSAT
TT=0.005

? (TO)
TT=1801.81

UNSAT
TT=0.017

UNSAT
TT=193.37

UNSAT
TT=0.01

UNSAT
TT=0.254

UNSAT
TT=0.019

UNSAT
TT=0.488

UNSAT
TT=0.273

UNSAT
TT=0.024

UNSAT
TT=34.592

? (problem)
TT=0.002

? (problem)
TT=0.005

UNSAT
TT=23.857

UNSAT
TT=20.976

UNSAT
TT=890.61

No dataNo dataNo dataNo dataUNSAT
TT=499.68

No dataNo dataUNSAT
TT=0.245

UNSAT
TT=1521.98

? (TO)
TT=1800.02

UNSAT
TT=0.022

UNSAT
TT=0.026

UNSAT
TT=0.034

? (TO)
TT=1800.03

? (TO)
TT=1800.03

UNSAT
TT=477.89

No dataNo dataUNSAT
TT=461.196

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl15_20_pb.cnf.cr.opb
UNSAT
TT=0.007

UNSAT
TT=0.016

? (TO)
TT=1800.03

No data? (problem)
TT=0.005

? (TO)
TT=1800.12

? (problem)
TT=0.003

? (TO)
TT=1800.08

? (problem)
TT=0.005

? (TO)
TT=1800.04

? (problem)
TT=0.003

? (TO)
TT=1800.06

? (TO)
TT=1800.02

? (TO)
TT=1800.02

? (TO)
TT=1800.03

UNSAT
TT=0.007

? (TO)
TT=1800

UNSAT
TT=0.012

? (TO)
TT=1800.04

UNSAT
TT=0.02

UNSAT
TT=590.45

UNSAT
TT=0.013

UNSAT
TT=0.275

UNSAT
TT=0.026

UNSAT
TT=0.523

UNSAT
TT=0.292

UNSAT
TT=0.024

? (TO)
TT=1800.1

? (problem)
TT=0.005

? (problem)
TT=0.005

? (TO)
TT=1800.08

? (TO)
TT=1800.06

?
TT=1799.91

No dataNo dataNo dataNo data?
TT=1799.66

No dataNo dataUNSAT
TT=0.323

? (TO)
TT=1800.91

? (TO)
TT=1800.06

UNSAT
TT=0.033

UNSAT
TT=0.028

UNSAT
TT=0.038

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1799.65

No dataNo data?
TT=1800.03

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr.opb
UNSAT
TT=0.009

UNSAT
TT=0.017

? (TO)
TT=1800.02

No data? (problem)
TT=0.005

? (TO)
TT=1800.13

? (problem)
TT=0.006

? (TO)
TT=1800.08

? (problem)
TT=0.005

? (TO)
TT=1800.08

? (problem)
TT=0.005

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.04

UNSAT
TT=0.009

? (TO)
TT=1800.02

UNSAT
TT=0.013

? (TO)
TT=1800.03

UNSAT
TT=0.025

UNSAT
TT=589.896

UNSAT
TT=0.015

UNSAT
TT=0.324

UNSAT
TT=0.028

UNSAT
TT=0.509

UNSAT
TT=0.353

UNSAT
TT=0.026

? (TO)
TT=1800.1

? (problem)
TT=0.005

? (problem)
TT=0.006

? (TO)
TT=1800.09

? (TO)
TT=1800.11

?
TT=1799.63

No dataNo dataNo dataNo data?
TT=1799.6

No dataNo dataUNSAT
TT=0.365

? (TO)
TT=1800.08

? (TO)
TT=1800.09

UNSAT
TT=0.032

UNSAT
TT=0.037

UNSAT
TT=0.041

? (TO)
TT=1800.02

? (TO)
TT=1800.11

?
TT=1799.64

No dataNo data?
TT=1799.63

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl30_31_pb.cnf.cr.opb
UNSAT
TT=0.032

UNSAT
TT=0.077

? (TO)
TT=1800.09

No data? (problem)
TT=0.01

? (TO)
TT=1800.09

? (problem)
TT=0.007

? (TO)
TT=1800.08

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (problem)
TT=0.009

? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.11

? (TO)
TT=1800.03

UNSAT
TT=0.032

? (TO)
TT=1800.07

UNSAT
TT=0.058

? (TO)
TT=1800.63

UNSAT
TT=0.044

UNSAT
TT=591.503

UNSAT
TT=0.038

UNSAT
TT=1.193

UNSAT
TT=0.043

UNSAT
TT=0.53

UNSAT
TT=1.094

UNSAT
TT=0.043

? (TO)
TT=1800.09

? (problem)
TT=0.008

? (problem)
TT=0.01

? (TO)
TT=1800.03

? (TO)
TT=1800.09

?
TT=1799.64

No dataNo dataNo dataNo data?
TT=1799.57

No dataNo dataUNSAT
TT=1.052

? (TO)
TT=1800.85

? (TO)
TT=1800.01

UNSAT
TT=0.055

UNSAT
TT=0.057

UNSAT
TT=0.071

? (TO)
TT=1800.09

? (TO)
TT=1800.11

?
TT=1799.96

No dataNo data?
TT=1799.62

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl30_35_pb.cnf.cr.opb
UNSAT
TT=0.042

UNSAT
TT=0.082

? (TO)
TT=1800.11

No data? (problem)
TT=0.009

? (TO)
TT=1800.09

? (problem)
TT=0.009

? (TO)
TT=1800.05

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (problem)
TT=0.01

? (TO)
TT=1800.09

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.12

UNSAT
TT=0.051

? (TO)
TT=1800.1

UNSAT
TT=0.063

? (TO)
TT=1800.01

UNSAT
TT=0.052

UNSAT
TT=590.209

UNSAT
TT=0.042

UNSAT
TT=0.623

UNSAT
TT=0.052

UNSAT
TT=0.555

UNSAT
TT=0.615

UNSAT
TT=0.052

? (TO)
TT=1800.08

? (problem)
TT=0.01

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (TO)
TT=1800.13

?
TT=1799.57

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo dataUNSAT
TT=0.594

? (TO)
TT=1800.1

? (TO)
TT=1800.6

UNSAT
TT=0.065

UNSAT
TT=0.069

UNSAT
TT=0.089

? (TO)
TT=1800.09

? (TO)
TT=1800.1

?
TT=1799.87

No dataNo data? (TO)
TT=1800.07

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl35_36_pb.cnf.cr.opb
UNSAT
TT=0.047

UNSAT
TT=0.124

? (TO)
TT=1800.1

No data? (problem)
TT=0.011

? (TO)
TT=1800.08

? (problem)
TT=0.012

? (TO)
TT=1800.05

? (problem)
TT=0.01

? (TO)
TT=1800

? (problem)
TT=0.009

? (TO)
TT=1800.06

? (TO)
TT=1800.06

? (TO)
TT=1800.08

? (TO)
TT=1800.13

UNSAT
TT=0.055

? (TO)
TT=1800.06

UNSAT
TT=0.095

? (TO)
TT=1800.08

UNSAT
TT=0.054

UNSAT
TT=592.249

UNSAT
TT=0.052

UNSAT
TT=1.475

UNSAT
TT=0.047

UNSAT
TT=0.572

UNSAT
TT=1.515

UNSAT
TT=0.054

? (TO)
TT=1800.03

? (problem)
TT=0.012

? (problem)
TT=0.011

? (TO)
TT=1800.04

? (TO)
TT=1800.15

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.49

No dataNo dataUNSAT
TT=1.545

? (TO)
TT=1800.04

? (TO)
TT=1800.04

UNSAT
TT=0.075

UNSAT
TT=0.076

UNSAT
TT=0.101

? (TO)
TT=1800.09

? (TO)
TT=1800.08

?
TT=1799.88

No dataNo data?
TT=1799.89

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl35_40_pb.cnf.cr.opb
UNSAT
TT=0.054

UNSAT
TT=0.231

? (TO)
TT=1800.07

No data? (problem)
TT=0.011

? (TO)
TT=1800.08

? (problem)
TT=0.01

? (TO)
TT=1800.05

? (problem)
TT=0.012

? (TO)
TT=1800.04

? (problem)
TT=0.011

? (TO)
TT=1800.06

? (TO)
TT=1800.12

? (TO)
TT=1800.08

? (TO)
TT=1800.13

UNSAT
TT=0.072

? (TO)
TT=1800.06

UNSAT
TT=0.157

? (TO)
TT=1800.01

UNSAT
TT=0.059

UNSAT
TT=591.159

UNSAT
TT=0.057

UNSAT
TT=0.803

UNSAT
TT=0.061

UNSAT
TT=0.58

UNSAT
TT=0.813

UNSAT
TT=0.054

? (TO)
TT=1800.07

? (problem)
TT=0.013

? (problem)
TT=0.01

? (TO)
TT=1800.14

? (TO)
TT=1800.06

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.79

No dataNo dataUNSAT
TT=0.814

? (TO)
TT=1800.79

? (TO)
TT=1800.02

UNSAT
TT=0.083

UNSAT
TT=0.079

UNSAT
TT=0.106

? (TO)
TT=1800.08

? (TO)
TT=1800.08

?
TT=1799.88

No dataNo data?
TT=1799.89

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl40_45_pb.cnf.cr.opb
UNSAT
TT=0.074

UNSAT
TT=0.197

? (TO)
TT=1800.1

No data? (problem)
TT=0.017

? (TO)
TT=1800.06

? (problem)
TT=0.013

? (TO)
TT=1800.03

? (problem)
TT=0.015

? (TO)
TT=1800.05

? (problem)
TT=0.018

? (TO)
TT=1800

? (TO)
TT=1800.1

? (TO)
TT=1800.07

? (TO)
TT=1800.11

UNSAT
TT=0.114

? (TO)
TT=1800.53

UNSAT
TT=0.153

? (TO)
TT=1800.06

UNSAT
TT=0.077

UNSAT
TT=592.656

UNSAT
TT=0.078

UNSAT
TT=0.845

UNSAT
TT=0.077

UNSAT
TT=0.608

UNSAT
TT=0.842

UNSAT
TT=0.074

? (TO)
TT=1800.09

? (problem)
TT=0.014

? (problem)
TT=0.015

? (TO)
TT=1800.04

? (TO)
TT=1800.04

?
TT=1799.93

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo dataUNSAT
TT=0.864

? (TO)
TT=1800.06

? (TO)
TT=1800.45

UNSAT
TT=0.108

UNSAT
TT=0.119

UNSAT
TT=0.146

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1799.79

No dataNo data?
TT=1799.42

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl50_51_pb.cnf.cr.opb
UNSAT
TT=0.097

UNSAT
TT=0.399

? (TO)
TT=1800.05

No data? (problem)
TT=0.021

? (TO)
TT=1800.07

? (problem)
TT=0.018

? (TO)
TT=1800.01

? (problem)
TT=0.021

? (TO)
TT=1800.09

? (problem)
TT=0.02

? (TO)
TT=1800.1

? (TO)
TT=1800.11

? (TO)
TT=1800.03

? (TO)
TT=1800.1

UNSAT
TT=0.227

? (TO)
TT=1800.56

UNSAT
TT=0.326

? (TO)
TT=1800.03

UNSAT
TT=0.117

UNSAT
TT=597.799

UNSAT
TT=0.119

UNSAT
TT=2.234

UNSAT
TT=0.097

UNSAT
TT=0.728

UNSAT
TT=2.054

UNSAT
TT=0.097

? (TO)
TT=1800.08

? (problem)
TT=0.022

? (problem)
TT=0.021

? (TO)
TT=1800.04

? (TO)
TT=1800.1

?
TT=1799.71

No dataNo dataNo dataNo data?
TT=1799.49

No dataNo dataUNSAT
TT=2.104

? (TO)
TT=1800.1

? (TO)
TT=1800.04

UNSAT
TT=0.153

UNSAT
TT=0.157

UNSAT
TT=0.191

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.53

No dataNo data?
TT=1799.49

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl50_55_pb.cnf.cr.opb
UNSAT
TT=0.105

UNSAT
TT=0.573

? (TO)
TT=1800.08

No data? (problem)
TT=0.021

? (TO)
TT=1800.05

? (problem)
TT=0.021

? (TO)
TT=1800.01

? (problem)
TT=0.021

? (TO)
TT=1800.07

? (problem)
TT=0.022

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.11

? (TO)
TT=1800.1

UNSAT
TT=0.294

?
TT=1598.73

UNSAT
TT=0.455

? (TO)
TT=1800.06

UNSAT
TT=0.123

? (TO)
TT=1800.09

UNSAT
TT=0.129

UNSAT
TT=1.253

UNSAT
TT=0.106

UNSAT
TT=0.722

UNSAT
TT=1.154

UNSAT
TT=0.105

? (TO)
TT=1800.08

? (problem)
TT=0.02

? (problem)
TT=0.021

? (TO)
TT=1800.14

? (TO)
TT=1800.12

?
TT=1799.84

No dataNo dataNo dataNo data?
TT=1799.83

No dataNo dataUNSAT
TT=1.114

? (TO)
TT=1801.02

? (TO)
TT=1800.05

UNSAT
TT=0.137

UNSAT
TT=0.128

UNSAT
TT=0.188

? (TO)
TT=1800.03

? (TO)
TT=1800.02

?
TT=1799.88

No dataNo data?
TT=1799.77

normalized-PB06/SATUNSAT-SMALLINT/submitted-PB05/
aloul/FPGA_SAT05/normalized-chnl50_60_pb.cnf.cr.opb
UNSAT
TT=0.106

UNSAT
TT=3.845

? (TO)
TT=1800.12

No data? (problem)
TT=0.025

? (TO)
TT=1800.05

? (problem)
TT=0.02

? (TO)
TT=1800.05

? (problem)
TT=0.022

? (TO)
TT=1800.08

? (problem)
TT=0.029

? (TO)
TT=1800.01

? (TO)
TT=1800.05

? (TO)
TT=1800.02

? (TO)
TT=1800.11

UNSAT
TT=0.375

? (TO)
TT=1800

UNSAT
TT=2.6

? (TO)
TT=1800.04

UNSAT
TT=0.117

UNSAT
TT=592.051

UNSAT
TT=0.144

UNSAT
TT=1.284

UNSAT
TT=0.109

UNSAT
TT=0.755

UNSAT
TT=1.143

UNSAT
TT=0.106

? (TO)
TT=1800.05

? (problem)
TT=0.023

? (problem)
TT=0.023

? (TO)
TT=1800.06

? (TO)
TT=1800.1

?
TT=1799.53

No dataNo dataNo dataNo data?
TT=1799.92

No dataNo dataUNSAT
TT=1.215

? (TO)
TT=1800.02

? (TO)
TT=1800.03

UNSAT
TT=0.141

UNSAT
TT=0.145

UNSAT
TT=0.186

? (TO)
TT=1800.11

? (TO)
TT=1800.03

?
TT=1799.55

No dataNo data?
TT=1799.93

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga10_10_sat_pb.cnf.cr.opb
SAT
TT=0.002
T1=0
SAT
TT=0.005
T1=0
SAT
TT=0.041
T1=0.04
No data? (problem)
TT=0.023

SAT
TT=0.063
T1=0.06
? (problem)
TT=0.025

SAT
TT=0.058
T1=0.06
? (problem)
TT=0.023

SAT
TT=0.054
T1=0.05
? (problem)
TT=0.025

SAT
TT=0.056
T1=0.05
SAT
TT=0.006
T1=0.01
SAT
TT=0.008
T1=0
SAT
TT=0.032
T1=0.03
SAT
TT=0.004
T1=0
SAT
TT=5.965
T1=5.72
SAT
TT=0.003
T1=0
SAT
TT=0.553
T1=0.3
SAT
TT=0.027
T1=0.02
SAT
TT=0.607
T1=1.9
SAT
TT=0.017
T1=0.01
SAT
TT=0.504
T1=1.15
SAT
TT=0.13
T1=0.13
SAT
TT=0.832
T1=0.72
SAT
TT=0.534
T1=0.65
SAT
TT=0.136
T1=0.13
SAT
TT=0.005
T1=0
? (problem)
TT=0.023

? (problem)
TT=0.024

SAT
TT=1.37
T1=1.41
SAT
TT=0.415
T1=0.46
SAT
TT=0.003
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.002
T1=0
No dataNo dataSAT
TT=0.566
T1=0.66
SAT
TT=0.364
T1=0.21
SAT
TT=1.964
T1=1.6
SAT
TT=0.18
T1=0.17
SAT
TT=0.163
T1=0.15
SAT
TT=0.03
T1=0.02
SAT
TT=0.014
T1=0.01
SAT
TT=0.015
T1=0.01
SAT
TT=0.002
T1=0
No dataNo dataSAT
TT=0.002
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga11_10_sat_pb.cnf.cr.opb
SAT
TT=0.002
T1=0
SAT
TT=0.003
T1=0
SAT
TT=0.744
T1=0.74
No data? (problem)
TT=0.029

SAT
TT=0.073
T1=0.07
? (problem)
TT=0.027

SAT
TT=0.064
T1=0.06
? (problem)
TT=0.025

SAT
TT=0.064
T1=0.06
? (problem)
TT=0.027

SAT
TT=0.064
T1=0.06
SAT
TT=0.004
T1=0
SAT
TT=0.008
T1=0.01
SAT
TT=0.026
T1=0.03
SAT
TT=0.004
T1=0
SAT
TT=25.559
T1=25.28
SAT
TT=0.002
T1=0
SAT
TT=7.243
T1=6.9
SAT
TT=0.03
T1=0.02
SAT
TT=0.708
T1=1.97
SAT
TT=0.019
T1=0.01
SAT
TT=0.605
T1=1.15
SAT
TT=0.042
T1=0.04
SAT
TT=0.821
T1=0.76
SAT
TT=0.615
T1=0.67
SAT
TT=0.178
T1=0.17
SAT
TT=0.003
T1=0
? (problem)
TT=0.028

? (problem)
TT=0.025

SAT
TT=1.574
T1=1.6
SAT
TT=0.455
T1=0.49
SAT
TT=0.002
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.002
T1=0
No dataNo dataSAT
TT=0.575
T1=0.68
SAT
TT=0.354
T1=0.21
SAT
TT=2.81
T1=2.4
SAT
TT=0.185
T1=0.18
SAT
TT=0.188
T1=0.18
SAT
TT=0.034
T1=0.02
SAT
TT=0.018
T1=0.01
SAT
TT=0.016
T1=0.01
SAT
TT=0.003
T1=0
No dataNo dataSAT
TT=0.002
T1=0
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga11_9_sat_pb.cnf.cr.opb
SAT
TT=0.001
T1=0
SAT
TT=0.002
T1=0
SAT
TT=1.385
T1=1.38
No data? (problem)
TT=0.016

SAT
TT=0.147
T1=0.15
? (problem)
TT=0.016

SAT
TT=0.14
T1=0.14
? (problem)
TT=0.014

SAT
TT=0.141
T1=0.13
? (problem)
TT=0.015

SAT
TT=0.15
T1=0.15
SAT
TT=0.004
T1=0
SAT
TT=0.009
T1=0.01
SAT
TT=0.022
T1=0.01
SAT
TT=0.007
T1=0
SAT
TT=87.34
T1=87.12
SAT
TT=0.003
T1=0
SAT
TT=54.61
T1=54.33
SAT
TT=0.031
T1=0.03
SAT
TT=0.681
T1=1.92
SAT
TT=0.017
T1=0.01
SAT
TT=0.624
T1=1.15
SAT
TT=0.041
T1=0.03
SAT
TT=0.488
T1=0.58
SAT
TT=0.625
T1=0.67
SAT
TT=0.23
T1=0.22
SAT
TT=0.005
T1=0
? (problem)
TT=0.014

? (problem)
TT=0.014

SAT
TT=0.778
T1=0.8
SAT
TT=0.471
T1=0.52
SAT
TT=0.002
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.001
T1=0
No dataNo dataSAT
TT=0.584
T1=0.65
SAT
TT=0.325
T1=0.18
SAT
TT=183.455
T1=182.19
SAT
TT=0.27
T1=0.26
SAT
TT=0.27
T1=0.26
SAT
TT=0.031
T1=0.02
SAT
TT=0.021
T1=0.02
SAT
TT=0.019
T1=0.01
SAT
TT=0.002
T1=0
No dataNo dataSAT
TT=0.002
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga13_12_sat_pb.cnf.cr.opb
SAT
TT=0.003
T1=0
SAT
TT=0.005
T1=0
SAT
TT=30.745
T1=30.75
No data? (problem)
TT=0.005

SAT
TT=0.107
T1=0.1
? (problem)
TT=0.006

SAT
TT=0.103
T1=0.1
? (problem)
TT=0.006

SAT
TT=0.104
T1=0.1
? (problem)
TT=0.006

SAT
TT=0.097
T1=0.09
SAT
TT=0.009
T1=0.01
SAT
TT=0.013
T1=0.01
SAT
TT=0.034
T1=0.03
SAT
TT=0.019
T1=0.11
SAT
TT=1671.16
T1=1669.9
SAT
TT=0.003
T1=0
SAT
TT=422.948
T1=422.54
SAT
TT=0.086
T1=0.08
SAT
TT=0.769
T1=2.16
SAT
TT=0.025
T1=0.02
SAT
TT=0.724
T1=1.17
SAT
TT=0.55
T1=0.54
SAT
TT=0.844
T1=0.75
SAT
TT=0.664
T1=0.69
SAT
TT=0.247
T1=0.24
SAT
TT=0.006
T1=0
? (problem)
TT=0.007

? (problem)
TT=0.005

SAT
TT=4.593
T1=4.67
SAT
TT=0.912
T1=0.89
SAT
TT=0.003
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.003
T1=0.01
No dataNo dataSAT
TT=0.784
T1=0.68
SAT
TT=0.415
T1=0.23
SAT
TT=438.75
T1=436.98
SAT
TT=0.377
T1=0.37
SAT
TT=0.38
T1=0.37
SAT
TT=0.055
T1=0.04
SAT
TT=0.072
T1=0.07
SAT
TT=0.073
T1=0.07
SAT
TT=0.003
T1=0
No dataNo dataSAT
TT=0.003
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga14_12_sat_pb.cnf.cr.opb
SAT
TT=0.002
T1=0
SAT
TT=0.182
T1=0.18
SAT
TT=0.302
T1=0.3
No data? (problem)
TT=0.007

SAT
TT=0.035
T1=0.03
? (problem)
TT=0.007

SAT
TT=0.031
T1=0.03
? (problem)
TT=0.006

SAT
TT=0.031
T1=0.03
? (problem)
TT=0.008

SAT
TT=0.027
T1=0.02
SAT
TT=0.048
T1=0.05
SAT
TT=0.014
T1=0.01
SAT
TT=0.313
T1=0.3
SAT
TT=0.006
T1=0
? (TO)
TT=1800.06

SAT
TT=0.145
T1=0.14
? (TO)
TT=1800.46

SAT
TT=0.053
T1=0.05
SAT
TT=3.681
T1=4.8
SAT
TT=0.028
T1=0.02
SAT
TT=2.974
T1=1.17
SAT
TT=0.758
T1=0.75
SAT
TT=1.414
T1=1.16
SAT
TT=2.974
T1=1.18
SAT
TT=6.253
T1=6.24
SAT
TT=0.01
T1=0
? (problem)
TT=0.006

? (problem)
TT=0.006

SAT
TT=1.321
T1=1.32
SAT
TT=1.047
T1=1.06
SAT
TT=0.002
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.002
T1=0
No dataNo dataSAT
TT=0.874
T1=0.68
SAT
TT=0.407
T1=0.23
? (TO)
TT=1800.55

SAT
TT=0.722
T1=0.71
SAT
TT=0.725
T1=0.71
SAT
TT=0.052
T1=0.04
SAT
TT=0.046
T1=0.05
SAT
TT=0.052
T1=0.05
SAT
TT=0.002
T1=0
No dataNo dataSAT
TT=0.003
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga14_13_sat_pb.cnf.cr.opb
SAT
TT=0.003
T1=0
SAT
TT=0.005
T1=0
SAT
TT=0.293
T1=0.29
No data? (problem)
TT=0.006

SAT
TT=0.622
T1=0.62
? (problem)
TT=0.01

SAT
TT=0.631
T1=0.63
? (problem)
TT=0.007

SAT
TT=0.618
T1=0.61
? (problem)
TT=0.008

SAT
TT=0.617
T1=0.61
SAT
TT=0.005
T1=0
SAT
TT=0.018
T1=0.01
SAT
TT=0.07
T1=0.06
SAT
TT=0.012
T1=0.01
? (TO)
TT=1800.85

SAT
TT=0.004
T1=0
? (TO)
TT=1800.08

SAT
TT=0.055
T1=0.05
SAT
TT=5.137
T1=5.08
SAT
TT=0.044
T1=0.04
SAT
TT=1.204
T1=1.2
SAT
TT=0.416
T1=0.41
SAT
TT=1.006
T1=9.76
SAT
TT=1.135
T1=0.69
SAT
TT=0.505
T1=0.49
SAT
TT=0.006
T1=0.01
? (problem)
TT=0.01

? (problem)
TT=0.01

SAT
TT=7.423
T1=7.56
SAT
TT=0.953
T1=0.97
SAT
TT=0.003
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.003
T1=0
No dataNo dataSAT
TT=0.864
T1=0.68
SAT
TT=0.404
T1=0.22
? (TO)
TT=1800.02

SAT
TT=1.264
T1=1.25
SAT
TT=1.22
T1=1.21
SAT
TT=0.036
T1=0.03
SAT
TT=0.05
T1=0.05
SAT
TT=0.049
T1=0.05
SAT
TT=0.003
T1=0
No dataNo dataSAT
TT=0.003
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga20_18_sat_pb.cnf.cr.opb
SAT
TT=0.004
T1=0.01
SAT
TT=0.016
T1=0.01
SAT
TT=0.435
T1=0.43
No data? (problem)
TT=0.045

SAT
TT=0.155
T1=0.15
? (problem)
TT=0.051

SAT
TT=0.146
T1=0.14
? (problem)
TT=0.046

SAT
TT=0.146
T1=0.14
? (problem)
TT=0.05

SAT
TT=0.142
T1=0.14
SAT
TT=1.485
T1=1.48
SAT
TT=0.096
T1=0.09
SAT
TT=0.752
T1=0.74
SAT
TT=0.022
T1=0.02
? (TO)
TT=1800.03

SAT
TT=0.014
T1=0.01
? (TO)
TT=1800.09

SAT
TT=0.179
T1=0.17
SAT
TT=64.635
T1=61.88
SAT
TT=0.152
T1=0.15
SAT
TT=1.603
T1=1.23
SAT
TT=232.601
T1=232.62
SAT
TT=0.484
T1=0.56
SAT
TT=1.433
T1=0.72
?
TT=1796.74

SAT
TT=0.045
T1=0.04
? (problem)
TT=0.046

? (problem)
TT=0.052

? (TO)
TT=1800.06

? (TO)
TT=1800.1

SAT
TT=19.905
T1=19.95
No dataNo dataNo dataNo dataSAT
TT=0.005
T1=0.01
No dataNo dataSAT
TT=1.314
T1=0.72
SAT
TT=0.574
T1=0.31
? (TO)
TT=1800.04

SAT
TT=84.299
T1=84.3
SAT
TT=84.646
T1=84.65
SAT
TT=0.186
T1=0.17
SAT
TT=0.095
T1=0.09
SAT
TT=0.102
T1=0.1
SAT
TT=0.004
T1=0.01
No dataNo dataSAT
TT=0.004
T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga20_19_sat_pb.cnf.cr.opb
SAT
TT=0.004
T1=0
SAT
TT=0.014
T1=0.01
SAT
TT=0.685
T1=0.68
No data? (problem)
TT=0.045

SAT
TT=0.05
T1=0.04
? (problem)
TT=0.048

SAT
TT=0.036
T1=0.03
? (problem)
TT=0.047

SAT
TT=0.038
T1=0.04
? (problem)
TT=0.051

SAT
TT=0.04
T1=0.04
SAT
TT=0.013
T1=0.01
SAT
TT=0.139
T1=0.13
SAT
TT=0.251
T1=0.24
SAT
TT=0.023
T1=0.02
? (TO)
TT=1800.04

SAT
TT=0.01
T1=0.01
? (TO)
TT=1801

SAT
TT=0.215
T1=0.21
SAT
TT=64.549
T1=62.98
SAT
TT=0.104
T1=0.1
SAT
TT=1.805
T1=1.23
SAT
TT=1.745
T1=1.73
SAT
TT=0.478
T1=0.58
SAT
TT=1.674
T1=0.74
SAT
TT=1.012
T1=1
SAT
TT=0.068
T1=0.07
? (problem)
TT=0.045

? (problem)
TT=0.045

? (TO)
TT=1800.13

? (TO)
TT=1800.11

SAT
TT=0.005
T1=0
No dataNo dataNo dataNo dataSAT
TT=0.004
T1=0
No dataNo dataSAT
TT=1.593
T1=0.74
SAT
TT=0.605
T1=0.32
? (TO)
TT=1800.08

SAT
TT=4.747
T1=4.74
SAT
TT=4.648
T1=4.63
SAT
TT=0.153
T1=0.14
SAT
TT=0.087
T1=0.08
SAT
TT=0.087
T1=0.08
SAT
TT=0.004
T1=0
No dataNo dataSAT
TT=0.006
T1=0
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga25_23_sat_pb.cnf.cr.opb
SAT
TT=0.032
T1=0.03
SAT
TT=0.627
T1=0.62
SAT
TT=0.261
T1=0.26
No data? (problem)
TT=0.018

SAT
TT=15.518
T1=15.52
? (problem)
TT=0.02

SAT
TT=15.697
T1=15.69
? (problem)
TT=0.02

SAT
TT=15.447
T1=15.49
? (problem)
TT=0.017

SAT
TT=15.626
T1=15.63
SAT
TT=83.869
T1=83.87
SAT
TT=7.765
T1=7.76
SAT
TT=0.146
T1=0.13
SAT
TT=0.032
T1=0.03
? (TO)
TT=1800.35

SAT
TT=5.598
T1=5.59
? (TO)
TT=1800.08

SAT
TT=15.529
T1=15.52
SAT
TT=67.782
T1=64.83
SAT
TT=0.203
T1=0.2
SAT
TT=1.672
T1=1.26
SAT
TT=7.565
T1=7.55
SAT
TT=1.145
T1=1.22
SAT
TT=5.705
T1=2.3
SAT
TT=4.165
T1=4.15
SAT
TT=268.347
T1=268.4
? (problem)
TT=0.018

? (problem)
TT=0.019

? (TO)
TT=1800.1

SAT
TT=3.177
T1=3.07
SAT
TT=0.307
T1=0.31
No dataNo dataNo dataNo dataSAT
TT=0.346
T1=0.35
No dataNo dataSAT
TT=1.885
T1=0.79
SAT
TT=0.694
T1=0.35
? (TO)
TT=1800.6

?
TT=1796.78

?
TT=1796.78

SAT
TT=2.232
T1=2.22
SAT
TT=0.309
T1=0.3
SAT
TT=0.312
T1=0.31
SAT
TT=0.349
T1=0.34
No dataNo dataSAT
TT=0.369
T1=0.36
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga25_24_sat_pb.cnf.cr.opb
SAT
TT=0.027
T1=0.02
SAT
TT=0.437
T1=0.43
SAT
TT=0.776
T1=0.77
No data? (problem)
TT=0.021

SAT
TT=1.454
T1=1.45
? (problem)
TT=0.023

SAT
TT=1.436
T1=1.43
? (problem)
TT=0.018

SAT
TT=1.423
T1=1.42
? (problem)
TT=0.018

SAT
TT=1.431
T1=1.43
SAT
TT=0.043
T1=0.04
SAT
TT=0.194
T1=0.19
SAT
TT=1279.74
T1=1279.92
SAT
TT=0.235
T1=0.23
? (TO)
TT=1800.01

SAT
TT=0.369
T1=0.36
? (TO)
TT=1800.02

SAT
TT=15.329
T1=15.32
SAT
TT=64.092
T1=61.51
SAT
TT=0.267
T1=0.26
SAT
TT=2.485
T1=1.26
SAT
TT=10.275
T1=10.27
SAT
TT=1.281
T1=0.96
SAT
TT=1.824
T1=0.8
SAT
TT=596.03
T1=596.11
SAT
TT=0.087
T1=0.08
? (problem)
TT=0.026

? (problem)
TT=0.021

? (TO)
TT=1800.03

? (TO)
TT=1800.06

SAT
TT=0.049
T1=0.04
No dataNo dataNo dataNo dataSAT
TT=0.028
T1=0.02
No dataNo dataSAT
TT=1.904
T1=0.79
SAT
TT=0.744
T1=0.38
? (TO)
TT=1800.71

SAT
TT=59.272
T1=59.28
SAT
TT=55.517
T1=55.52
SAT
TT=2.346
T1=2.33
SAT
TT=0.275
T1=0.27
SAT
TT=0.273
T1=0.27
SAT
TT=0.028
T1=0.02
No dataNo dataSAT
TT=0.027
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga25_25_sat_pb.cnf.cr.opb
SAT
TT=0.027
T1=0.02
SAT
TT=0.032
T1=0.03
SAT
TT=1.227
T1=1.22
No data? (problem)
TT=0.025

SAT
TT=0.286
T1=0.28
? (problem)
TT=0.02

SAT
TT=0.301
T1=0.29
? (problem)
TT=0.021

SAT
TT=0.278
T1=0.28
? (problem)
TT=0.022

SAT
TT=0.278
T1=0.27
SAT
TT=0.973
T1=0.97
SAT
TT=0.145
T1=0.14
SAT
TT=0.173
T1=0.15
SAT
TT=0.05
T1=0.05
? (TO)
TT=1800.05

SAT
TT=0.028
T1=0.02
? (TO)
TT=1800.03

SAT
TT=14.79
T1=14.79
SAT
TT=64.292
T1=62.79
SAT
TT=0.268
T1=0.26
SAT
TT=2.045
T1=1.27
SAT
TT=3.997
T1=3.99
SAT
TT=1.357
T1=1.02
SAT
TT=2.113
T1=0.78
SAT
TT=2.269
T1=2.26
SAT
TT=0.054
T1=0.05
? (problem)
TT=0.022

? (problem)
TT=0.022

? (TO)
TT=1800.04

? (TO)
TT=1800.1

SAT
TT=0.048
T1=0.04
No dataNo dataNo dataNo dataSAT
TT=0.027
T1=0.02
No dataNo dataSAT
TT=1.817
T1=0.79
SAT
TT=0.824
T1=0.39
? (TO)
TT=1800.04

SAT
TT=7.452
T1=7.44
SAT
TT=7.365
T1=7.35
SAT
TT=0.412
T1=0.4
SAT
TT=0.234
T1=0.23
SAT
TT=0.236
T1=0.23
SAT
TT=0.028
T1=0.02
No dataNo dataSAT
TT=0.028
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga30_29_sat_pb.cnf.cr.opb
SAT
TT=0.03
T1=0.02
SAT
TT=0.161
T1=0.16
SAT
TT=0.69
T1=0.69
No data? (problem)
TT=0.031

SAT
TT=0.087
T1=0.09
? (problem)
TT=0.032

SAT
TT=0.075
T1=0.07
? (problem)
TT=0.031

SAT
TT=0.077
T1=0.07
? (problem)
TT=0.035

SAT
TT=0.079
T1=0.07
SAT
TT=0.076
T1=0.08
SAT
TT=0.129
T1=0.13
SAT
TT=0.844
T1=0.82
SAT
TT=0.106
T1=0.1
? (TO)
TT=1800.03

SAT
TT=0.131
T1=0.13
? (TO)
TT=1800.64

SAT
TT=26.846
T1=26.84
SAT
TT=64.039
T1=62.46
SAT
TT=0.863
T1=0.86
SAT
TT=2.844
T1=1.52
SAT
TT=15.929
T1=15.92
SAT
TT=1.585
T1=1.16
SAT
TT=2.673
T1=0.85
SAT
TT=11.931
T1=11.92
SAT
TT=0.03
T1=0.03
? (problem)
TT=0.034

? (problem)
TT=0.03

? (TO)
TT=1800.09

? (TO)
TT=1800.09

SAT
TT=0.032
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.031
T1=0.02
No dataNo dataSAT
TT=2.234
T1=0.81
SAT
TT=0.886
T1=0.43
? (TO)
TT=1800.05

SAT
TT=14.375
T1=14.37
SAT
TT=14.414
T1=14.39
SAT
TT=4.566
T1=4.55
SAT
TT=0.459
T1=0.45
SAT
TT=0.455
T1=0.45
SAT
TT=0.032
T1=0.02
No dataNo dataSAT
TT=0.032
T1=0.03
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga35_33_sat_pb.cnf.cr.opb
SAT
TT=0.036
T1=0.03
SAT
TT=0.58
T1=0.58
SAT
TT=1.085
T1=1.08
No data? (problem)
TT=0.045

SAT
TT=755.413
T1=755.57
? (problem)
TT=0.048

SAT
TT=696.343
T1=696.45
? (problem)
TT=0.047

SAT
TT=695.519
T1=695.65
? (problem)
TT=0.045

SAT
TT=696.009
T1=696.11
SAT
TT=2.041
T1=2.04
SAT
TT=968.6
T1=968.81
SAT
TT=13.184
T1=13.16
SAT
TT=0.164
T1=0.16
? (TO)
TT=1800.32

SAT
TT=0.527
T1=0.52
? (TO)
TT=1800.06

SAT
TT=36.065
T1=36.06
SAT
TT=281.631
T1=270.21
SAT
TT=0.919
T1=0.91
SAT
TT=19.752
T1=9.34
SAT
TT=19.532
T1=19.53
SAT
TT=1.912
T1=1.31
SAT
TT=3.212
T1=1.38
SAT
TT=1775.45
T1=1775.72
SAT
TT=362.954
T1=363.04
? (problem)
TT=0.045

? (problem)
TT=0.05

? (TO)
TT=1800.08

? (TO)
TT=1800.12

SAT
TT=0.036
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=9.257
T1=9.25
No dataNo dataSAT
TT=2.284
T1=0.85
SAT
TT=1.015
T1=0.48
? (TO)
TT=1800.03

?
TT=1796.74

?
TT=1796.75

SAT
TT=5.445
T1=5.57
SAT
TT=0.537
T1=0.53
SAT
TT=0.534
T1=0.53
SAT
TT=9.169
T1=9.16
No dataNo dataSAT
TT=9.157
T1=9.17
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga35_34_sat_pb.cnf.cr.opb
SAT
TT=0.016
T1=0.02
SAT
TT=0.073
T1=0.07
SAT
TT=1.034
T1=1.03
No data? (problem)
TT=0.062

SAT
TT=0.108
T1=0.11
? (problem)
TT=0.048

SAT
TT=0.103
T1=0.1
? (problem)
TT=0.05

SAT
TT=0.099
T1=0.09
? (problem)
TT=0.046

SAT
TT=0.102
T1=0.1
SAT
TT=0.071
T1=0.07
SAT
TT=58.123
T1=58.14
SAT
TT=1.071
T1=1.04
SAT
TT=0.217
T1=0.21
? (TO)
TT=1800.3

SAT
TT=0.065
T1=0.06
? (TO)
TT=1800.68

SAT
TT=41.795
T1=41.79
SAT
TT=64.271
T1=61.71
SAT
TT=1.217
T1=1.21
SAT
TT=3.553
T1=1.33
SAT
TT=94.597
T1=94.6
SAT
TT=1.802
T1=6.61
SAT
TT=2.523
T1=0.84
SAT
TT=16.258
T1=16.24
SAT
TT=55.639
T1=55.65
? (problem)
TT=0.049

? (problem)
TT=0.054

? (TO)
TT=1800.08

? (TO)
TT=1800.06

SAT
TT=0.017
T1=0.02
No dataNo dataNo dataNo dataSAT
TT=0.016
T1=0.02
No dataNo dataSAT
TT=3.372
T1=1.36
SAT
TT=1.134
T1=0.49
? (TO)
TT=1800.08

?
TT=1796.77

?
TT=1796.76

SAT
TT=6.119
T1=6.09
SAT
TT=2.141
T1=2.13
SAT
TT=2.112
T1=2.11
SAT
TT=0.017
T1=0.02
No dataNo dataSAT
TT=0.019
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga35_35_sat_pb.cnf.cr.opb
SAT
TT=0.038
T1=0.02
SAT
TT=0.087
T1=0.08
SAT
TT=1.577
T1=1.57
No data? (problem)
TT=0.051

SAT
TT=1.359
T1=1.35
? (problem)
TT=0.051

SAT
TT=1.363
T1=1.36
? (problem)
TT=0.054

SAT
TT=1.355
T1=1.35
? (problem)
TT=0.055

SAT
TT=1.353
T1=1.35
SAT
TT=0.097
T1=0.09
SAT
TT=33.013
T1=33.03
SAT
TT=3.541
T1=3.51
SAT
TT=0.209
T1=0.21
? (TO)
TT=1800.01

SAT
TT=0.083
T1=0.08
? (TO)
TT=1800.06

SAT
TT=49.863
T1=49.85
SAT
TT=64.064
T1=62.49
SAT
TT=2.107
T1=2.1
SAT
TT=2.994
T1=1.34
SAT
TT=22.301
T1=22.29
SAT
TT=1.833
T1=1.31
SAT
TT=2.574
T1=0.84
?
TT=1796.76

SAT
TT=25.883
T1=25.88
? (problem)
TT=0.052

? (problem)
TT=0.055

? (TO)
TT=1800.07

? (TO)
TT=1800.11

SAT
TT=0.038
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.038
T1=0.02
No dataNo dataSAT
TT=2.553
T1=0.85
SAT
TT=1.114
T1=0.51
? (TO)
TT=1800.05

SAT
TT=22.456
T1=22.45
SAT
TT=22.292
T1=22.27
SAT
TT=6.588
T1=6.57
SAT
TT=2.002
T1=2
SAT
TT=2.04
T1=2.03
SAT
TT=0.038
T1=0.02
No dataNo dataSAT
TT=0.041
T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga40_38_sat_pb.cnf.cr.opb
SAT
TT=0.023
T1=0.02
SAT
TT=0.113
T1=0.11
SAT
TT=1.091
T1=1.09
No data? (problem)
TT=0.071

SAT
TT=35.618
T1=35.62
? (problem)
TT=0.067

SAT
TT=36.007
T1=36.01
? (problem)
TT=0.065

SAT
TT=34.788
T1=34.79
? (problem)
TT=0.066

SAT
TT=35.926
T1=35.93
SAT
TT=0.114
T1=0.11
SAT
TT=1291.57
T1=1291.82
? (TO)
TT=1800.04

SAT
TT=1.549
T1=1.55
? (TO)
TT=1800.05

SAT
TT=0.103
T1=0.1
? (TO)
TT=1800.09

SAT
TT=67.117
T1=67.12
SAT
TT=11.941
T1=12.61
SAT
TT=1.789
T1=1.78
SAT
TT=2.763
T1=1.58
SAT
TT=26.519
T1=26.5
SAT
TT=1.739
T1=1.81
SAT
TT=3.563
T1=1.39
SAT
TT=20.589
T1=20.57
SAT
TT=374.256
T1=374.34
? (problem)
TT=0.068

? (problem)
TT=0.075

? (TO)
TT=1800.05

? (TO)
TT=1800.11

SAT
TT=0.023
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.023
T1=0.02
No dataNo dataSAT
TT=2.344
T1=0.88
SAT
TT=1.126
T1=0.51
? (TO)
TT=1800.05

?
TT=1796.75

?
TT=1796.76

SAT
TT=6.822
T1=6.79
SAT
TT=1.142
T1=1.14
SAT
TT=1.082
T1=1.08
SAT
TT=0.026
T1=0.03
No dataNo dataSAT
TT=0.027
T1=0.03
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga40_39_sat_pb.cnf.cr.opb
SAT
TT=0.116
T1=0.11
SAT
TT=0.268
T1=0.26
SAT
TT=1.27
T1=1.26
No data? (problem)
TT=0.089

SAT
TT=264.787
T1=264.83
? (problem)
TT=0.09

SAT
TT=255.43
T1=255.6
? (problem)
TT=0.073

SAT
TT=266.666
T1=266.7
? (problem)
TT=0.069

SAT
TT=265.771
T1=265.81
SAT
TT=0.127
T1=0.12
SAT
TT=110.825
T1=110.85
SAT
TT=6.148
T1=7.51
SAT
TT=0.427
T1=0.43
? (TO)
TT=1800.55

SAT
TT=0.246
T1=0.24
? (TO)
TT=1800.06

SAT
TT=69.231
T1=69.22
SAT
TT=66.013
T1=63
SAT
TT=2.239
T1=2.23
SAT
TT=2.954
T1=1.35
?
TT=1789.75

SAT
TT=1.146
T1=1.2
SAT
TT=4.013
T1=1.4
?
TT=1796.74

? (TO)
TT=1800.11

? (problem)
TT=0.076

? (problem)
TT=0.089

? (TO)
TT=1800.04

? (TO)
TT=1800

SAT
TT=0.116
T1=0.11
No dataNo dataNo dataNo dataSAT
TT=0.194
T1=0.18
No dataNo dataSAT
TT=2.634
T1=0.87
SAT
TT=1.135
T1=0.52
? (TO)
TT=1800.58

?
TT=1796.79

?
TT=1796.79

SAT
TT=10.626
T1=10.6
SAT
TT=3.644
T1=3.64
SAT
TT=3.591
T1=3.59
SAT
TT=0.173
T1=0.17
No dataNo dataSAT
TT=0.174
T1=0.17
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB05/aloul/FPGA_SAT05/
normalized-fpga45_45_sat_pb.cnf.cr.opb
SAT
TT=0.074
T1=0.07
SAT
TT=0.384
T1=0.38
SAT
TT=1.335
T1=1.33
No data? (problem)
TT=0.109

SAT
TT=563.69
T1=563.8
? (problem)
TT=0.098

SAT
TT=566.604
T1=566.71
? (problem)
TT=0.1

SAT
TT=560.03
T1=560.14
? (problem)
TT=0.099

SAT
TT=560.173
T1=560.26
SAT
TT=0.332
T1=0.33
SAT
TT=0.571
T1=0.57
SAT
TT=4.824
T1=4.77
SAT
TT=0.608
T1=0.6
? (TO)
TT=1800.01

SAT
TT=0.327
T1=0.32
? (TO)
TT=1800.08

SAT
TT=122.461
T1=122.46
SAT
TT=64.294
T1=61.48
SAT
TT=4.642
T1=4.63
SAT
TT=3.054
T1=1.4
SAT
TT=34.72
T1=34.7
SAT
TT=1.521
T1=2.3
SAT
TT=3.802
T1=1.4
SAT
TT=26.085
T1=26.09
SAT
TT=0.166
T1=0.16
? (problem)
TT=0.103

? (problem)
TT=0.101

? (TO)
TT=1800.09

? (TO)
TT=1800.04

SAT
TT=0.145
T1=0.13
No dataNo dataNo dataNo dataSAT
TT=0.074
T1=0.07
No dataNo dataSAT
TT=2.993
T1=0.99
SAT
TT=1.395
T1=0.73
? (TO)
TT=1800.05

SAT
TT=26.834
T1=26.82
SAT
TT=25.696
T1=25.67
SAT
TT=13.017
T1=12.98
SAT
TT=5.003
T1=5
SAT
TT=4.827
T1=4.82
SAT
TT=0.074
T1=0.07
No dataNo dataSAT
TT=0.084
T1=0.07
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_1.opb.PB06.opb
SAT
TT=0.874
T1=0.86
SAT
TT=23.916
T1=23.91
SAT
TT=5.508
T1=5.5
No data? (problem)
TT=6.242

SAT
TT=20.775
T1=20.79
? (problem)
TT=6.324

SAT
TT=20.793
T1=20.86
? (problem)
TT=6.349

SAT
TT=20.447
T1=20.41
? (problem)
TT=6.321

SAT
TT=21.119
T1=21.27
SAT
TT=21.359
T1=21.37
SAT
TT=16.713
T1=16.69
SAT
TT=15.361
T1=13.94
SAT
TT=3.591
T1=3.67
SAT
TT=3.562
T1=2.36
SAT
TT=25.856
T1=25.85
SAT
TT=3.574
T1=2.16
?
TT=1795.85

SAT
TT=1.066
T1=2.12
SAT
TT=48.33
T1=48.31
SAT
TT=4.703
T1=3.31
?
TT=1791.13

SAT
TT=10.025
T1=11.22
SAT
TT=4.672
T1=2.9
?
TT=1797.18

SAT
TT=8.28
T1=8.26
? (problem)
TT=1.719

? (problem)
TT=1.674

? (MO)
TT=276.77

? (MO)
TT=271.77

SAT
TT=0.906
T1=0.89
No dataNo dataNo dataNo dataSAT
TT=0.919
T1=0.91
No dataNo dataSAT
TT=5.005
T1=3
SAT
TT=3.234
T1=2.41
SAT
TT=3.333
T1=2.15
SAT
TT=1502.77
T1=1502.3
SAT
TT=1235.79
T1=1235.38
SAT
TT=1292.62
T1=1292.24
SAT
TT=8.034
T1=7.99
SAT
TT=15.294
T1=7.67
SAT
TT=0.874
T1=0.86
No dataNo dataSAT
TT=0.906
T1=0.9
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_2.opb.PB06.opb
SAT
TT=0.875
T1=0.87
SAT
TT=23.77
T1=23.78
SAT
TT=5.539
T1=5.53
No data? (problem)
TT=6.603

SAT
TT=25.788
T1=25.74
? (problem)
TT=6.525

SAT
TT=26.399
T1=26.34
? (problem)
TT=6.468

SAT
TT=26.32
T1=26.27
? (problem)
TT=6.403

SAT
TT=30.02
T1=29.94
SAT
TT=24.668
T1=24.7
SAT
TT=13.726
T1=13.82
SAT
TT=15.124
T1=13.7
SAT
TT=3.733
T1=3.73
SAT
TT=3.573
T1=2.34
SAT
TT=25.809
T1=25.8
SAT
TT=3.544
T1=2.14
?
TT=1796.33

SAT
TT=0.908
T1=1.19
SAT
TT=48.908
T1=48.89
SAT
TT=5.023
T1=3.27
?
TT=1790.32

SAT
TT=9.682
T1=10.42
SAT
TT=4.664
T1=2.78
?
TT=1798.5

SAT
TT=5.733
T1=5.71
? (problem)
TT=1.708

? (problem)
TT=1.708

? (MO)
TT=274.82

? (MO)
TT=281.23

SAT
TT=0.904
T1=0.9
No dataNo dataNo dataNo dataSAT
TT=0.92
T1=0.91
No dataNo dataSAT
TT=5.124
T1=3.11
SAT
TT=3.214
T1=2.1
SAT
TT=3.263
T1=2.11
SAT
TT=1029
T1=1028.61
SAT
TT=1166.59
T1=1166.15
SAT
TT=1180.89
T1=1180.48
SAT
TT=7.998
T1=7.97
SAT
TT=7.676
T1=7.64
SAT
TT=0.875
T1=0.87
No dataNo dataSAT
TT=0.938
T1=0.93
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_3.opb.PB06.opb
SAT
TT=0.875
T1=0.87
SAT
TT=25.223
T1=25.23
SAT
TT=5.579
T1=5.57
No data? (problem)
TT=7.034

SAT
TT=40.353
T1=40.96
? (problem)
TT=6.578

SAT
TT=39.471
T1=39.54
? (problem)
TT=6.551

SAT
TT=39.567
T1=39.61
? (problem)
TT=6.57

SAT
TT=32.13
T1=32.07
SAT
TT=22.396
T1=22.4
SAT
TT=13.233
T1=13.22
SAT
TT=16.627
T1=15.22
SAT
TT=4.704
T1=4.79
SAT
TT=3.593
T1=2.42
SAT
TT=25.833
T1=25.83
SAT
TT=3.582
T1=2.16
?
TT=1798.76

SAT
TT=0.921
T1=1.06
SAT
TT=16.545
T1=16.53
SAT
TT=5.323
T1=3.3
? (TO)
TT=1800.94

SAT
TT=9.55
T1=9.61
SAT
TT=4.565
T1=2.95
?
TT=1799

SAT
TT=8.223
T1=8.19
? (problem)
TT=1.655

? (problem)
TT=1.653

? (MO)
TT=273.28

? (MO)
TT=426.27

SAT
TT=0.905
T1=0.89
No dataNo dataNo dataNo dataSAT
TT=0.908
T1=0.9
No dataNo dataSAT
TT=5.754
T1=3.09
SAT
TT=3.397
T1=2.13
SAT
TT=3.321
T1=2.15
SAT
TT=1072.5
T1=1071.92
SAT
TT=1299.79
T1=1299.25
SAT
TT=531.979
T1=531.3
SAT
TT=7.949
T1=7.92
SAT
TT=8.164
T1=8.13
SAT
TT=0.875
T1=0.87
No dataNo dataSAT
TT=0.943
T1=0.93
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_8.opb.PB06.opb
SAT
TT=0.876
T1=0.86
SAT
TT=25.254
T1=25.25
SAT
TT=5.573
T1=5.57
No data? (problem)
TT=6.231

SAT
TT=40.582
T1=40.54
? (problem)
TT=6.23

SAT
TT=40.419
T1=40.36
? (problem)
TT=6.66

SAT
TT=40.406
T1=40.57
? (problem)
TT=6.09

SAT
TT=40.323
T1=40.27
SAT
TT=21.927
T1=21.93
SAT
TT=16.189
T1=16.16
SAT
TT=16.936
T1=15.5
SAT
TT=16.589
T1=16.71
SAT
TT=3.526
T1=2.34
SAT
TT=25.575
T1=25.57
SAT
TT=3.522
T1=2.14
?
TT=1795.8

SAT
TT=1.076
T1=2.21
SAT
TT=146.15
T1=99.16
SAT
TT=4.482
T1=3.28
?
TT=1793.23

SAT
TT=9.568
T1=10.76
SAT
TT=4.352
T1=2.88
?
TT=1798.26

SAT
TT=3.707
T1=3.74
? (problem)
TT=1.74

? (problem)
TT=1.715

? (MO)
TT=271.58

? (MO)
TT=432.15

SAT
TT=0.907
T1=0.9
No dataNo dataNo dataNo dataSAT
TT=0.907
T1=0.9
No dataNo dataSAT
TT=5.753
T1=2.96
SAT
TT=3.293
T1=2.38
SAT
TT=3.233
T1=2.13
SAT
TT=1517.06
T1=1516.68
?
TT=1797.7

SAT
TT=1346.21
T1=1345.57
SAT
TT=8.043
T1=8.01
SAT
TT=7.759
T1=7.73
SAT
TT=0.876
T1=0.86
No dataNo dataSAT
TT=0.906
T1=0.9
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_9.opb.PB06.opb
SAT
TT=0.876
T1=0.86
SAT
TT=21.78
T1=21.78
SAT
TT=4.471
T1=4.47
No data? (problem)
TT=7.087

SAT
TT=31.115
T1=31.19
? (problem)
TT=6.628

SAT
TT=30.884
T1=30.94
? (problem)
TT=6.742

SAT
TT=30.395
T1=30.36
? (problem)
TT=6.669

SAT
TT=25.199
T1=25.53
SAT
TT=21.758
T1=21.76
SAT
TT=12.86
T1=12.91
SAT
TT=15.09
T1=13.69
SAT
TT=33.603
T1=33.61
SAT
TT=3.682
T1=2.4
SAT
TT=22.775
T1=22.77
SAT
TT=3.316
T1=2.06
? (TO)
TT=1800.98

SAT
TT=0.919
T1=1.03
SAT
TT=49.601
T1=49.58
SAT
TT=4.673
T1=3.29
?
TT=1791.4

SAT
TT=9.631
T1=9.69
SAT
TT=4.624
T1=2.9
SAT
TT=1438.54
T1=1438.08
SAT
TT=5.793
T1=5.77
? (problem)
TT=1.731

? (problem)
TT=1.682

? (MO)
TT=275.16

? (MO)
TT=437.35

SAT
TT=0.919
T1=0.91
No dataNo dataNo dataNo dataSAT
TT=0.907
T1=0.9
No dataNo dataSAT
TT=5.323
T1=3.03
SAT
TT=3.234
T1=2.08
SAT
TT=3.294
T1=2.12
SAT
TT=1497.65
T1=1497.12
SAT
TT=1623.85
T1=1623.29
SAT
TT=1245.64
T1=1245.1
SAT
TT=7.905
T1=7.87
SAT
TT=7.659
T1=7.62
SAT
TT=0.876
T1=0.86
No dataNo dataSAT
TT=0.904
T1=0.89
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_0.opb.PB06.opb
SAT
TT=1.443
T1=1.53
SAT
TT=150.932
T1=150.98
SAT
TT=32.234
T1=32.25
No data? (problem)
TT=19.431

? (TO)
TT=1800.04

? (problem)
TT=20.071

? (TO)
TT=1800.01

? (problem)
TT=19.02

? (TO)
TT=1800.09

? (problem)
TT=18.848

? (TO)
TT=1800.04

SAT
TT=140.954
T1=141.02
SAT
TT=35.288
T1=35.25
SAT
TT=66.434
T1=61.97
SAT
TT=13.215
T1=13.2
SAT
TT=7.773
T1=5.67
SAT
TT=154.355
T1=154.36
SAT
TT=7.355
T1=5.07
? (TO)
TT=1802.09

SAT
TT=1.443
T1=1.53
SAT
TT=197.465
T1=197.46
SAT
TT=10.573
T1=7
?
TT=1792.23

SAT
TT=25.431
T1=23.18
SAT
TT=8.743
T1=6.36
? (TO)
TT=1800.05

SAT
TT=13.951
T1=13.91
? (problem)
TT=5.281

? (problem)
TT=5.332

? (MO)
TT=276.38

? (MO)
TT=275.98

SAT
TT=2.799
T1=2.78
No dataNo dataNo dataNo dataSAT
TT=2.799
T1=2.78
No dataNo dataSAT
TT=9.784
T1=6.47
SAT
TT=6.714
T1=5.08
SAT
TT=6.835
T1=5.19
?
TT=1799.75

?
TT=1799.83

?
TT=1799.15

SAT
TT=22.716
T1=22.64
SAT
TT=23.697
T1=23.61
SAT
TT=2.709
T1=2.69
No dataNo dataSAT
TT=2.877
T1=2.86
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_2.opb.PB06.opb
SAT
TT=1.506
T1=2.46
SAT
TT=152.205
T1=152.21
SAT
TT=26.353
T1=26.35
No data? (problem)
TT=21.754

? (TO)
TT=1800.06

? (problem)
TT=20.018

? (TO)
TT=1800.07

? (problem)
TT=19.928

? (TO)
TT=1800.08

? (problem)
TT=19.892

? (TO)
TT=1800.05

SAT
TT=173.345
T1=173.42
SAT
TT=42.192
T1=42.16
SAT
TT=54.472
T1=49.74
SAT
TT=12.972
T1=12.96
SAT
TT=8.122
T1=5.83
SAT
TT=181.906
T1=181.91
SAT
TT=7.384
T1=5.09
? (TO)
TT=1802.04

SAT
TT=1.506
T1=2.46
? (exit code)
TT=325.031

SAT
TT=10.341
T1=7.06
?
TT=1791.88

SAT
TT=24.408
T1=21.96
SAT
TT=8.565
T1=6.53
? (TO)
TT=1802.09

SAT
TT=10.138
T1=10.09
? (problem)
TT=5.198

? (problem)
TT=5.318

? (MO)
TT=275.19

? (MO)
TT=439.26

SAT
TT=2.932
T1=2.91
No dataNo dataNo dataNo dataSAT
TT=2.798
T1=2.78
No dataNo dataSAT
TT=9.842
T1=6.77
SAT
TT=6.503
T1=4.99
SAT
TT=6.692
T1=5.12
? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1802.11

SAT
TT=23.557
T1=23.48
SAT
TT=23.473
T1=23.38
SAT
TT=2.704
T1=2.68
No dataNo dataSAT
TT=2.763
T1=2.74
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_5.opb.PB06.opb
SAT
TT=1.407
T1=1.49
SAT
TT=150.401
T1=150.41
SAT
TT=26.4
T1=26.39
No data? (problem)
TT=19.093

? (TO)
TT=1800.07

? (problem)
TT=19.316

? (TO)
TT=1800.07

? (problem)
TT=19.301

? (TO)
TT=1800.02

? (problem)
TT=18.863

? (TO)
TT=1800

SAT
TT=137.823
T1=137.9
SAT
TT=84.567
T1=84.59
SAT
TT=48.982
T1=44.53
SAT
TT=12.996
T1=13.11
SAT
TT=8.012
T1=5.96
SAT
TT=150.221
T1=150.23
SAT
TT=7.552
T1=5.22
? (TO)
TT=1802.05

SAT
TT=1.407
T1=1.49
? (exit code)
TT=176.095

SAT
TT=10.482
T1=7.03
? (TO)
TT=1802.02

SAT
TT=24.792
T1=23.28
SAT
TT=8.493
T1=6.5
? (TO)
TT=1802.04

SAT
TT=13.814
T1=13.77
? (problem)
TT=5.203

? (problem)
TT=5.135

? (MO)
TT=275.45

? (MO)
TT=277.74

SAT
TT=2.808
T1=2.79
No dataNo dataNo dataNo dataSAT
TT=2.8
T1=2.79
No dataNo dataSAT
TT=9.762
T1=6.57
SAT
TT=6.661
T1=5.12
SAT
TT=6.983
T1=5.49
? (TO)
TT=1800.13

? (TO)
TT=1800.11

? (TO)
TT=1800.06

SAT
TT=23.623
T1=23.52
SAT
TT=22.947
T1=22.87
SAT
TT=2.706
T1=2.69
No dataNo dataSAT
TT=2.776
T1=2.76
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_6.opb.PB06.opb
SAT
TT=1.479
T1=1.69
SAT
TT=168.827
T1=168.9
SAT
TT=26.391
T1=26.38
No data? (problem)
TT=20.053

? (TO)
TT=1800.01

? (problem)
TT=20.321

? (TO)
TT=1800.04

? (problem)
TT=20.546

? (TO)
TT=1800.05

? (problem)
TT=20.309

? (TO)
TT=1800.06

SAT
TT=182.128
T1=182.18
SAT
TT=77.392
T1=77.38
SAT
TT=57.06
T1=52.53
SAT
TT=13.901
T1=13.99
SAT
TT=8.144
T1=5.81
SAT
TT=181.914
T1=181.92
SAT
TT=7.182
T1=5.03
? (TO)
TT=1802.11

SAT
TT=1.479
T1=1.69
? (exit code)
TT=227.689

SAT
TT=10.772
T1=7.11
?
TT=1791.24

SAT
TT=24.38
T1=23.18
SAT
TT=8.623
T1=6.42
? (TO)
TT=1800.11

SAT
TT=12.421
T1=12.55
? (problem)
TT=5.153

? (problem)
TT=5.146

? (MO)
TT=275.63

? (MO)
TT=287.45

SAT
TT=2.796
T1=2.78
No dataNo dataNo dataNo dataSAT
TT=2.955
T1=2.93
No dataNo dataSAT
TT=10.701
T1=6.69
SAT
TT=6.882
T1=5.25
SAT
TT=6.994
T1=5.3
?
TT=1799.25

?
TT=1799.6

? (TO)
TT=1802.14

SAT
TT=23.081
T1=23
SAT
TT=23.983
T1=23.89
SAT
TT=2.709
T1=2.69
No dataNo dataSAT
TT=2.822
T1=2.81
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_9.opb.PB06.opb
SAT
TT=1.429
T1=1.54
SAT
TT=137.022
T1=137.1
SAT
TT=33.881
T1=33.89
No data? (problem)
TT=19.053

? (TO)
TT=1800.01

? (problem)
TT=18.962

? (TO)
TT=1800.05

? (problem)
TT=18.275

? (TO)
TT=1800.09

? (problem)
TT=18.722

? (TO)
TT=1800.08

SAT
TT=153.326
T1=153.33
SAT
TT=39.693
T1=39.67
SAT
TT=57.652
T1=53.2
SAT
TT=12.986
T1=13.08
SAT
TT=7.672
T1=5.58
SAT
TT=181.923
T1=181.93
SAT
TT=7.113
T1=4.99
? (TO)
TT=1802.13

SAT
TT=1.429
T1=1.54
SAT
TT=249.801
T1=249.79
SAT
TT=10.472
T1=7.09
?
TT=1791.54

SAT
TT=23.894
T1=21.71
SAT
TT=8.763
T1=6.49
?
TT=1798.9

SAT
TT=8.682
T1=8.63
? (problem)
TT=5.071

? (problem)
TT=5.185

? (MO)
TT=273.64

? (MO)
TT=434.52

SAT
TT=2.799
T1=2.79
No dataNo dataNo dataNo dataSAT
TT=2.813
T1=2.79
No dataNo dataSAT
TT=9.683
T1=7.02
SAT
TT=6.503
T1=4.95
SAT
TT=6.913
T1=5.27
? (TO)
TT=1800.04

? (TO)
TT=1800.04

? (TO)
TT=1800.04

SAT
TT=23.724
T1=23.62
SAT
TT=22.794
T1=22.72
SAT
TT=2.707
T1=2.69
No dataNo dataSAT
TT=2.823
T1=2.81
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_1.opb.PB06.opb
SAT
TT=2.634
T1=2.78
SAT
TT=186.519
T1=186.61
SAT
TT=133.291
T1=133.42
No data? (problem)
TT=55.44

? (MO)
TT=154.82

? (problem)
TT=56.636

? (MO)
TT=163.91

? (problem)
TT=52.126

? (MO)
TT=148.62

? (problem)
TT=52.844

? (MO)
TT=149.29

SAT
TT=187.548
T1=187.55
SAT
TT=82.343
T1=82.28
SAT
TT=190.142
T1=178.05
SAT
TT=271.113
T1=271.25
SAT
TT=17.941
T1=13.14
SAT
TT=186.858
T1=186.95
SAT
TT=16.131
T1=11.24
? (TO)
TT=1802.16

SAT
TT=2.634
T1=2.78
? (exit code)
TT=294.327

SAT
TT=21.751
T1=14.96
? (TO)
TT=1802.25

SAT
TT=271.087
T1=412.03
SAT
TT=19.53
T1=14.21
? (TO)
TT=1802.15

SAT
TT=119.661
T1=119.67
? (problem)
TT=13.537

? (problem)
TT=14.022

? (MO)
TT=290.85

? (MO)
TT=290.25

SAT
TT=7.292
T1=7.27
No dataNo dataNo dataNo dataSAT
TT=7.295
T1=7.27
No dataNo dataSAT
TT=23.011
T1=16.11
SAT
TT=14.102
T1=11.14
SAT
TT=15.031
T1=11.85
? (TO)
TT=1802.24

? (TO)
TT=1802.19

? (TO)
TT=1802.22

SAT
TT=58.646
T1=58.45
SAT
TT=59.118
T1=58.94
SAT
TT=7.035
T1=7.01
No dataNo dataSAT
TT=7.378
T1=7.35
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_3.opb.PB06.opb
SAT
TT=2.738
T1=3.85
SAT
TT=186.586
T1=186.58
SAT
TT=134.828
T1=134.9
No data? (problem)
TT=59.971

? (MO)
TT=153.47

? (problem)
TT=56.172

? (MO)
TT=165.31

? (problem)
TT=56.061

? (MO)
TT=151.87

? (problem)
TT=55.087

? (MO)
TT=155.63

SAT
TT=187.658
T1=187.74
SAT
TT=315.417
T1=315.53
SAT
TT=156.715
T1=143.79
SAT
TT=47.67
T1=47.67
SAT
TT=17.069
T1=12.93
SAT
TT=186.748
T1=186.83
SAT
TT=17
T1=11.56
? (TO)
TT=1802.16

SAT
TT=2.738
T1=3.85
? (exit code)
TT=86.182

SAT
TT=21.5
T1=14.89
?
TT=1795.01

SAT
TT=268.989
T1=460.73
SAT
TT=19.78
T1=14.23
? (TO)
TT=1802.15

SAT
TT=24.735
T1=24.81
? (problem)
TT=13.632

? (problem)
TT=13.604

? (MO)
TT=461.53

? (MO)
TT=459.5

SAT
TT=7.661
T1=7.62
No dataNo dataNo dataNo dataSAT
TT=7.482
T1=7.45
No dataNo dataSAT
TT=24.461
T1=17.23
SAT
TT=14.864
T1=11.43
SAT
TT=14.842
T1=11.84
? (TO)
TT=1800.14

? (TO)
TT=1802.14

? (TO)
TT=1802.16

SAT
TT=58.152
T1=57.98
SAT
TT=58.572
T1=58.4
SAT
TT=7.057
T1=7.03
No dataNo dataSAT
TT=7.622
T1=7.58
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_5.opb.PB06.opb
SAT
TT=2.601
T1=2.65
SAT
TT=186.547
T1=186.68
SAT
TT=129.336
T1=129.41
No data? (problem)
TT=60.337

? (MO)
TT=152.89

? (problem)
TT=60.918

? (MO)
TT=150.65

? (problem)
TT=58.194

? (MO)
TT=149.77

? (problem)
TT=59.32

? (MO)
TT=152.15

SAT
TT=187.451
T1=187.44
SAT
TT=77.727
T1=77.7
SAT
TT=207.36
T1=195.03
SAT
TT=45.024
T1=45
SAT
TT=17.102
T1=13.11
SAT
TT=186.598
T1=186.69
SAT
TT=16.92
T1=11.59
? (TO)
TT=1802.24

SAT
TT=2.601
T1=2.65
? (exit code)
TT=179.494

SAT
TT=21.481
T1=14.91
? (TO)
TT=1802.15

SAT
TT=268.864
T1=399.32
SAT
TT=19.811
T1=14.24
? (TO)
TT=1800.26

SAT
TT=118.039
T1=117.96
? (problem)
TT=13.318

? (problem)
TT=13.67

? (MO)
TT=306.98

? (MO)
TT=472.61

SAT
TT=7.357
T1=7.33
No dataNo dataNo dataNo dataSAT
TT=7.463
T1=7.43
No dataNo dataSAT
TT=25.191
T1=17.39
SAT
TT=14.312
T1=11.37
SAT
TT=14.632
T1=11.52
? (TO)
TT=1802.27

? (TO)
TT=1800.26

? (TO)
TT=1802.22

SAT
TT=61.163
T1=60.93
SAT
TT=60.715
T1=60.5
SAT
TT=7.082
T1=7.05
No dataNo dataSAT
TT=7.368
T1=7.33
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_6.opb.PB06.opb
SAT
TT=2.724
T1=2.8
SAT
TT=186.652
T1=186.71
SAT
TT=131.784
T1=131.86
No data? (problem)
TT=53.542

? (MO)
TT=150.25

? (problem)
TT=53.215

? (MO)
TT=150.17

? (problem)
TT=53.022

? (MO)
TT=151.54

? (problem)
TT=52.635

? (MO)
TT=149.84

SAT
TT=187.458
T1=187.52
SAT
TT=218.273
T1=218.23
SAT
TT=221.268
T1=209.12
SAT
TT=202.634
T1=202.7
SAT
TT=16.78
T1=12.68
SAT
TT=186.914
T1=186.9
SAT
TT=17.033
T1=11.72
? (TO)
TT=1802.23

SAT
TT=2.724
T1=2.8
? (exit code)
TT=115.55

SAT
TT=21.511
T1=14.83
? (TO)
TT=1802.12

SAT
TT=267.788
T1=382.55
SAT
TT=19.941
T1=14.41
? (TO)
TT=1802.15

SAT
TT=139.526
T1=139.46
? (problem)
TT=13.739

? (problem)
TT=13.483

? (MO)
TT=461.29

? (MO)
TT=291.28

SAT
TT=7.336
T1=7.3
No dataNo dataNo dataNo dataSAT
TT=7.463
T1=7.43
No dataNo dataSAT
TT=23.314
T1=16.45
SAT
TT=14.742
T1=11.36
SAT
TT=15.192
T1=11.97
? (TO)
TT=1800.22

? (TO)
TT=1802.2

? (TO)
TT=1802.14

SAT
TT=58.841
T1=58.66
SAT
TT=58.664
T1=58.47
SAT
TT=7.049
T1=7.01
No dataNo dataSAT
TT=7.215
T1=7.18
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_9.opb.PB06.opb
SAT
TT=2.653
T1=2.69
SAT
TT=186.49
T1=186.56
SAT
TT=133.525
T1=133.6
No data? (problem)
TT=56.683

? (MO)
TT=150.58

? (problem)
TT=57.92

? (MO)
TT=148.68

? (problem)
TT=56.927

? (MO)
TT=150.49

? (problem)
TT=57.404

? (MO)
TT=97

SAT
TT=187.275
T1=187.41
SAT
TT=188.441
T1=188.43
SAT
TT=192.083
T1=179.84
SAT
TT=41.162
T1=41.14
SAT
TT=16.682
T1=12.7
SAT
TT=186.76
T1=186.86
SAT
TT=15.833
T1=11.17
? (TO)
TT=1802.22

SAT
TT=2.653
T1=2.69
? (exit code)
TT=183.062

SAT
TT=21.741
T1=14.88
? (TO)
TT=1802.21

SAT
TT=268.242
T1=392.74
SAT
TT=20.282
T1=14.52
? (TO)
TT=1802.23

SAT
TT=12.024
T1=12.18
? (problem)
TT=13.509

? (problem)
TT=13.715

? (MO)
TT=307.69

? (MO)
TT=309.68

SAT
TT=7.295
T1=7.27
No dataNo dataNo dataNo dataSAT
TT=7.382
T1=7.35
No dataNo dataSAT
TT=25.111
T1=17.54
SAT
TT=14.45
T1=11.26
SAT
TT=14.712
T1=11.55
? (TO)
TT=1800.25

? (TO)
TT=1802.19

? (TO)
TT=1802.28

SAT
TT=60.682
T1=60.46
SAT
TT=58.835
T1=58.64
SAT
TT=7.047
T1=7.02
No dataNo dataSAT
TT=7.384
T1=7.35
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/vdw/
normalized-vdw_k3_l5_n550.opb
SAT
TT=904.992
T1=906.59
?
TT=1798.02

SAT
TT=1156.11
T1=1156.3
No data? (problem)
TT=1.686

? (TO)
TT=1800.13

? (problem)
TT=1.675

? (TO)
TT=1800.01

? (problem)
TT=1.67

? (TO)
TT=1800.1

? (problem)
TT=1.769

? (TO)
TT=1800.02

? (TO)
TT=1800.08

? (TO)
TT=1800.11

? (TO)
TT=1800.13

? (TO)
TT=1800.06

? (TO)
TT=1800.07

?
TT=1798.01

? (TO)
TT=1800.09

?
TT=1794.56

SAT
TT=1536.79
T1=1471.74
?
TT=1799.05

? (TO)
TT=1800.93

?
TT=1792.07

? (MO)
TT=1625.7

? (TO)
TT=1800.07

? (TO)
TT=1801.34

? (TO)
TT=1800.09

? (problem)
TT=1.585

? (problem)
TT=1.567

? (TO)
TT=1800.08

SAT
TT=904.992
T1=906.59
?
TT=1799.5

No dataNo dataNo dataNo data?
TT=1799.81

No dataNo data? (TO)
TT=1800.15

? (TO)
TT=1800.09

? (TO)
TT=1800.02

?
TT=1797.13

?
TT=1797.06

?
TT=1797

? (TO)
TT=1800.12

? (TO)
TT=1800.11

?
TT=1799.45

No dataNo data?
TT=1799.44

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/vdw/
normalized-vdw_k3_l6_n1500.opb
SAT
TT=1.835
T1=2.61
SAT
TT=118.769
T1=118.85
SAT
TT=16.097
T1=16.09
No data? (problem)
TT=21.982

? (TO)
TT=1800.04

? (problem)
TT=21.997

? (TO)
TT=1800.01

? (problem)
TT=22.019

? (TO)
TT=1800.04

? (problem)
TT=22.012

? (TO)
TT=1800.08

SAT
TT=122.684
T1=122.75
SAT
TT=19.877
T1=19.85
SAT
TT=46.125
T1=41.92
SAT
TT=14.118
T1=14.11
SAT
TT=8.354
T1=6.68
SAT
TT=160.542
T1=160.6
SAT
TT=7.614
T1=5.91
?
TT=1799.61

SAT
TT=1.835
T1=3.95
? (TO)
TT=1800.02

SAT
TT=9.835
T1=7.65
?
TT=1791.45

SAT
TT=34.592
T1=34.61
SAT
TT=7.932
T1=6.93
? (TO)
TT=1802.04

SAT
TT=2.648
T1=2.61
? (problem)
TT=20.465

? (problem)
TT=20.377

? (MO)
TT=437.19

? (MO)
TT=276.48

SAT
TT=3.317
T1=3.3
No dataNo dataNo dataNo dataSAT
TT=3.266
T1=3.26
No dataNo dataSAT
TT=8.444
T1=7.04
SAT
TT=6.793
T1=5.98
SAT
TT=7.002
T1=5.78
? (TO)
TT=1802.05

? (TO)
TT=1802.06

? (TO)
TT=1802.04

SAT
TT=26.702
T1=26.59
SAT
TT=27.258
T1=27.16
SAT
TT=3.161
T1=3.14
No dataNo dataSAT
TT=3.213
T1=3.64
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/vdw/
normalized-vdw_k4_l4_n360.opb
SAT
TT=817.196
T1=817.41
?
TT=1798.02

? (TO)
TT=1800.1

No data? (problem)
TT=0.604

? (TO)
TT=1800.07

? (problem)
TT=0.59

? (TO)
TT=1800.07

? (problem)
TT=0.603

? (TO)
TT=1800.07

? (problem)
TT=0.594

? (TO)
TT=1800.08

? (TO)
TT=1800.05

? (TO)
TT=1800.07

SAT
TT=883.464
T1=883.35
? (TO)
TT=1800.02

? (TO)
TT=1800

?
TT=1798.01

? (TO)
TT=1800.01

?
TT=1793.74

? (TO)
TT=1800.07

?
TT=1799.01

? (TO)
TT=1800.66

?
TT=1789.9

? (MO)
TT=1623.75

? (TO)
TT=1800.02

?
TT=1796.96

SAT
TT=817.196
T1=817.41
? (problem)
TT=0.551

? (problem)
TT=0.544

? (TO)
TT=1800

? (TO)
TT=1800.08

?
TT=1799.49

No dataNo dataNo dataNo data?
TT=1799.78

No dataNo data? (TO)
TT=1800.16

SAT
TT=1390.75
T1=1386.19
? (TO)
TT=1800.58

?
TT=1796.92

?
TT=1797.14

?
TT=1796.93

? (TO)
TT=1800.04

? (TO)
TT=1800.06

?
TT=1799.78

No dataNo data?
TT=1799.92

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/vdw/
normalized-vdw_k5_l4_n750.opb



?
TT=1798.03

? (TO)
TT=1800.09

No data? (problem)
TT=3.281

? (TO)
TT=1800.09

? (problem)
TT=3.295

? (TO)
TT=1800.06

? (problem)
TT=3.284

? (TO)
TT=1800.01

? (problem)
TT=3.238

? (TO)
TT=1800.09

? (TO)
TT=1800.14

? (TO)
TT=1800.04

? (TO)
TT=1800.01

? (TO)
TT=1800.08

? (exit code)
TT=652.415

?
TT=1798.07

?
TT=1220.96

?
TT=1797.5

? (TO)
TT=1800.03

?
TT=1799.83

? (TO)
TT=1800.9

?
TT=1798.58

? (TO)
TT=1800.1

? (TO)
TT=1800.66

? (TO)
TT=1802.09

? (TO)
TT=1800.12

? (problem)
TT=3.023

? (problem)
TT=2.983

? (MO)
TT=290.24

? (MO)
TT=431.53

?
TT=1799.42

No dataNo dataNo dataNo data?
TT=1799.62

No dataNo data? (TO)
TT=1800.7

? (TO)
TT=1800.02

? (TO)
TT=1800.02

? (TO)
TT=1800.11

? (TO)
TT=1800.03

? (TO)
TT=1801.26

? (TO)
TT=1800.09

? (TO)
TT=1800.13

?
TT=1799.32

No dataNo data?
TT=1799.71

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/vdw/
normalized-vdw_k6_l3_n170.opb



?
TT=1798.01

? (TO)
TT=1800.09

No data? (problem)
TT=0.156

? (TO)
TT=1800.11

? (problem)
TT=0.16

? (TO)
TT=1800

? (problem)
TT=0.156

? (TO)
TT=1800.06

? (problem)
TT=0.157

? (TO)
TT=1800.04

? (TO)
TT=1800.07

? (TO)
TT=1800.1

? (TO)
TT=1800.1

? (TO)
TT=1800.1

? (TO)
TT=1800.59

?
TT=1798.01

? (TO)
TT=1800.31

?
TT=1793.62

? (TO)
TT=1800.07

? (TO)
TT=1800.03

? (TO)
TT=1800.47

?
TT=1789.82

? (TO)
TT=1800.08

? (TO)
TT=1800.12

?
TT=1796.82

? (TO)
TT=1800.11

? (problem)
TT=0.151

? (problem)
TT=0.152

? (TO)
TT=1800.05

? (TO)
TT=1800.03

?
TT=1799.52

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo data? (TO)
TT=1800.02

? (TO)
TT=1800.09

? (TO)
TT=1800.65

?
TT=1796.86

?
TT=1796.87

?
TT=1796.85

? (TO)
TT=1800.09

? (TO)
TT=1800.02

?
TT=1799.84

No dataNo data?
TT=1799.51

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900544484.opb
UNSAT
TT=1.65

UNSAT
TT=535.463

UNSAT
TT=2.292

No data? (problem)
TT=0.013

UNSAT
TT=1.781

? (problem)
TT=0.015

UNSAT
TT=1.66

? (problem)
TT=0.014

UNSAT
TT=1.65

? (problem)
TT=0.017

UNSAT
TT=1.67

UNSAT
TT=608.5

UNSAT
TT=26.862

UNSAT
TT=18.109

UNSAT
TT=100.168

UNSAT
TT=21.241

UNSAT
TT=385.323

UNSAT
TT=5.782

UNSAT
TT=494.692

UNSAT
TT=10.648

UNSAT
TT=518.517

UNSAT
TT=157.758

UNSAT
TT=387.537

UNSAT
TT=11.401

UNSAT
TT=85.611

UNSAT
TT=252.059

UNSAT
TT=23.193

? (problem)
TT=0.014

? (problem)
TT=0.016

? (TO)
TT=1800.06

? (TO)
TT=1800.03

UNSAT
TT=86.76

No dataNo dataNo dataNo dataUNSAT
TT=57.783

No dataNo dataUNSAT
TT=31.068

UNSAT
TT=17.98

UNSAT
TT=16.253

UNSAT
TT=247.054

UNSAT
TT=220.299

UNSAT
TT=223.446

UNSAT
TT=17.443

UNSAT
TT=16.982

UNSAT
TT=57.09

No dataNo dataUNSAT
TT=54.77

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900546076.opb
UNSAT
TT=0.614

UNSAT
TT=384.849

UNSAT
TT=0.614

No data? (problem)
TT=0.013

UNSAT
TT=6.796

? (problem)
TT=0.014

UNSAT
TT=6.67

? (problem)
TT=0.014

UNSAT
TT=6.67

? (problem)
TT=0.014

UNSAT
TT=6.57

UNSAT
TT=652.963

UNSAT
TT=3.641

UNSAT
TT=4.169

UNSAT
TT=45.346

UNSAT
TT=1.715

UNSAT
TT=378.958

UNSAT
TT=2.465

UNSAT
TT=239.396

UNSAT
TT=5.232

UNSAT
TT=403.06

UNSAT
TT=12.493

UNSAT
TT=171.449

UNSAT
TT=3.623

UNSAT
TT=39.457

UNSAT
TT=54.999

UNSAT
TT=2.657

? (problem)
TT=0.012

? (problem)
TT=0.014

? (TO)
TT=1800.08

? (TO)
TT=1800.05

UNSAT
TT=6.038

No dataNo dataNo dataNo dataUNSAT
TT=1.71

No dataNo dataUNSAT
TT=8.674

UNSAT
TT=4.02

UNSAT
TT=4.772

UNSAT
TT=161.766

UNSAT
TT=155.23

UNSAT
TT=72.711

UNSAT
TT=21.834

UNSAT
TT=21.342

UNSAT
TT=1.699

No dataNo dataUNSAT
TT=1.759

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900547416.opb
SAT
TT=0.07
T1=0.07
SAT
TT=13.969
T1=13.97
SAT
TT=0.07
T1=0.07
No data? (problem)
TT=0.014

SAT
TT=2.117
T1=2.11
? (problem)
TT=0.013

SAT
TT=2.112
T1=2.11
? (problem)
TT=0.016

SAT
TT=2.163
T1=2.16
? (problem)
TT=0.013

SAT
TT=2.206
T1=2.2
SAT
TT=12.637
T1=12.64
SAT
TT=16.576
T1=16.57
SAT
TT=1.816
T1=1.8
SAT
TT=3.32
T1=3.43
SAT
TT=2.854
T1=2.14
SAT
TT=5.773
T1=5.77
SAT
TT=3.195
T1=2.54
SAT
TT=21.921
T1=21.92
SAT
TT=1.118
T1=2.3
SAT
TT=1.651
T1=0.82
SAT
TT=4.702
T1=2.31
SAT
TT=16.26
T1=16.26
SAT
TT=0.711
T1=0.82
SAT
TT=9.642
T1=4.33
SAT
TT=17.264
T1=17.26
SAT
TT=11.694
T1=11.69
? (problem)
TT=0.014

? (problem)
TT=0.014

? (TO)
TT=1800.12

SAT
TT=1628.06
T1=1628.46
SAT
TT=0.298
T1=0.29
No dataNo dataNo dataNo dataSAT
TT=0.237
T1=0.23
No dataNo dataSAT
TT=5.565
T1=1.83
SAT
TT=7.302
T1=5.92
SAT
TT=1.504
T1=0.92
SAT
TT=14.721
T1=14.71
SAT
TT=14.694
T1=14.69
SAT
TT=15.396
T1=15.39
SAT
TT=19.531
T1=19.53
SAT
TT=19.422
T1=19.43
SAT
TT=0.237
T1=0.23
No dataNo dataSAT
TT=0.238
T1=0.23
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900550006.opb
UNSAT
TT=3.654

UNSAT
TT=1265.24

UNSAT
TT=3.654

No data? (problem)
TT=0.015

UNSAT
TT=4.036

? (problem)
TT=0.014

UNSAT
TT=3.97

? (problem)
TT=0.017

UNSAT
TT=4.16

? (problem)
TT=0.015

UNSAT
TT=3.96

UNSAT
TT=1191.33

? (TO)
TT=1800.03

UNSAT
TT=77.942

UNSAT
TT=445.504

UNSAT
TT=276.542

UNSAT
TT=1118.67

UNSAT
TT=78.76

UNSAT
TT=640.163

UNSAT
TT=49.128

? (TO)
TT=1800.28

? (TO)
TT=1801.2

UNSAT
TT=1047.13

UNSAT
TT=28.705

UNSAT
TT=1760.78

UNSAT
TT=777.195

? (TO)
TT=1800.03

? (problem)
TT=0.012

? (problem)
TT=0.012

? (TO)
TT=1800.09

? (TO)
TT=1800.08

UNSAT
TT=699.48

No dataNo dataNo dataNo dataUNSAT
TT=327.992

No dataNo dataUNSAT
TT=178.425

UNSAT
TT=61.06

UNSAT
TT=116.72

UNSAT
TT=559.268

UNSAT
TT=683.418

UNSAT
TT=578.598

UNSAT
TT=53.541

UNSAT
TT=52.852

UNSAT
TT=311.32

No dataNo dataUNSAT
TT=306.133

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900551864.opb
UNSAT
TT=0.896

UNSAT
TT=395.006

UNSAT
TT=0.896

No data? (problem)
TT=0.015

UNSAT
TT=2.263

? (problem)
TT=0.014

UNSAT
TT=2.18

? (problem)
TT=0.014

UNSAT
TT=2.18

? (problem)
TT=0.014

UNSAT
TT=2.17

UNSAT
TT=546.765

UNSAT
TT=90.636

UNSAT
TT=12.49

UNSAT
TT=72.696

UNSAT
TT=3.084

UNSAT
TT=702.373

UNSAT
TT=3.273

UNSAT
TT=334.659

UNSAT
TT=5.347

UNSAT
TT=1034.4

UNSAT
TT=33.359

UNSAT
TT=374.732

UNSAT
TT=4.223

UNSAT
TT=20.973

UNSAT
TT=152.478

UNSAT
TT=47.507

? (problem)
TT=0.013

? (problem)
TT=0.014

? (TO)
TT=1800.05

? (TO)
TT=1800.11

UNSAT
TT=29.37

No dataNo dataNo dataNo dataUNSAT
TT=24.813

No dataNo dataUNSAT
TT=13.634

UNSAT
TT=7.444

UNSAT
TT=11.753

UNSAT
TT=210.54

UNSAT
TT=168.751

UNSAT
TT=182.691

UNSAT
TT=14.44

UNSAT
TT=14.178

UNSAT
TT=23.266

No dataNo dataUNSAT
TT=23.886

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900552423.opb
UNSAT
TT=0.081

UNSAT
TT=234.759

UNSAT
TT=0.337

No data? (problem)
TT=0.013

UNSAT
TT=0.518

? (problem)
TT=0.016

UNSAT
TT=0.081

? (problem)
TT=0.013

UNSAT
TT=0.084

? (problem)
TT=0.015

UNSAT
TT=0.083

UNSAT
TT=293.613

UNSAT
TT=5.226

UNSAT
TT=0.724

UNSAT
TT=10.102

UNSAT
TT=1.484

UNSAT
TT=171.149

UNSAT
TT=1.503

UNSAT
TT=34.754

UNSAT
TT=1.075

UNSAT
TT=548.82

UNSAT
TT=5.322

UNSAT
TT=138.114

UNSAT
TT=1.238

UNSAT
TT=4.874

UNSAT
TT=53.714

UNSAT
TT=4.839

? (problem)
TT=0.013

? (problem)
TT=0.012

? (TO)
TT=1800.05

? (TO)
TT=1800.04

UNSAT
TT=2.56

No dataNo dataNo dataNo dataUNSAT
TT=2.968

No dataNo dataUNSAT
TT=7.722

UNSAT
TT=3.284

UNSAT
TT=1.605

UNSAT
TT=92.847

UNSAT
TT=89.424

UNSAT
TT=38.189

UNSAT
TT=1.397

UNSAT
TT=1.378

UNSAT
TT=2.839

No dataNo dataUNSAT
TT=2.848

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900552735.opb
UNSAT
TT=3.964

UNSAT
TT=693.065

UNSAT
TT=3.964

No data? (problem)
TT=0.013

UNSAT
TT=4.645

? (problem)
TT=0.013

UNSAT
TT=4.57

? (problem)
TT=0.014

UNSAT
TT=4.89

? (problem)
TT=0.013

UNSAT
TT=4.56

UNSAT
TT=855.302

UNSAT
TT=31.059

UNSAT
TT=41.932

UNSAT
TT=103.069

UNSAT
TT=264.94

UNSAT
TT=822.241

UNSAT
TT=11.422

UNSAT
TT=293.901

UNSAT
TT=10.064

UNSAT
TT=1168.83

UNSAT
TT=839.727

UNSAT
TT=373.432

UNSAT
TT=20.033

UNSAT
TT=805.763

UNSAT
TT=177.363

UNSAT
TT=25.473

? (problem)
TT=0.013

? (problem)
TT=0.014

? (TO)
TT=1800.12

? (TO)
TT=1800.13

UNSAT
TT=66.46

No dataNo dataNo dataNo dataUNSAT
TT=66.953

No dataNo dataUNSAT
TT=51.526

UNSAT
TT=21.82

UNSAT
TT=36.786

UNSAT
TT=226.244

UNSAT
TT=208.576

UNSAT
TT=236.612

UNSAT
TT=14.202

UNSAT
TT=14.43

UNSAT
TT=62.88

No dataNo dataUNSAT
TT=63.66

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900553812.opb
UNSAT
TT=0.093

UNSAT
TT=697.243

UNSAT
TT=0.966

No data? (problem)
TT=0.013

UNSAT
TT=0.457

? (problem)
TT=0.015

UNSAT
TT=0.096

? (problem)
TT=0.014

UNSAT
TT=0.096

? (problem)
TT=0.013

UNSAT
TT=0.093

UNSAT
TT=611.818

UNSAT
TT=22.038

UNSAT
TT=9.22

UNSAT
TT=43.223

UNSAT
TT=18.731

UNSAT
TT=444.08

UNSAT
TT=3.484

UNSAT
TT=319.172

UNSAT
TT=8.817

UNSAT
TT=314.85

UNSAT
TT=735.731

UNSAT
TT=237.783

UNSAT
TT=10.735

UNSAT
TT=29.532

UNSAT
TT=229.821

UNSAT
TT=17.591

? (problem)
TT=0.013

? (problem)
TT=0.016

? (TO)
TT=1800.07

? (TO)
TT=1800.14

UNSAT
TT=56.08

No dataNo dataNo dataNo dataUNSAT
TT=63.413

No dataNo dataUNSAT
TT=20.562

UNSAT
TT=10.432

UNSAT
TT=8.454

UNSAT
TT=130.485

UNSAT
TT=127.225

UNSAT
TT=157.68

UNSAT
TT=7.115

UNSAT
TT=7.007

UNSAT
TT=63.332

No dataNo dataUNSAT
TT=61.77

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900554072.opb
UNSAT
TT=1.07

UNSAT
TT=385.194

UNSAT
TT=1.143

No data? (problem)
TT=0.013

UNSAT
TT=1.177

? (problem)
TT=0.016

UNSAT
TT=1.08

? (problem)
TT=0.014

UNSAT
TT=1.07

? (problem)
TT=0.014

UNSAT
TT=1.17

UNSAT
TT=727.567

UNSAT
TT=42.666

UNSAT
TT=18.385

UNSAT
TT=119.713

UNSAT
TT=4.284

UNSAT
TT=491.078

UNSAT
TT=3.523

UNSAT
TT=528.174

UNSAT
TT=7.532

UNSAT
TT=781.4

UNSAT
TT=712.276

UNSAT
TT=369.576

UNSAT
TT=10.934

UNSAT
TT=669.502

UNSAT
TT=126.715

UNSAT
TT=9.984

? (problem)
TT=0.014

? (problem)
TT=0.011

? (TO)
TT=1800.09

? (TO)
TT=1800.12

UNSAT
TT=142.73

No dataNo dataNo dataNo dataUNSAT
TT=123.952

No dataNo dataUNSAT
TT=81.443

UNSAT
TT=20.662

UNSAT
TT=33.089

UNSAT
TT=185.689

UNSAT
TT=197.25

UNSAT
TT=196.748

UNSAT
TT=10.859

UNSAT
TT=10.846

UNSAT
TT=124.215

No dataNo dataUNSAT
TT=129.51

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900554154.opb
SAT
TT=0.188
T1=0.19
SAT
TT=1.801
T1=1.8
SAT
TT=0.188
T1=0.19
No data? (problem)
TT=0.014

SAT
TT=2.075
T1=2.07
? (problem)
TT=0.015

SAT
TT=2.071
T1=2.07
? (problem)
TT=0.015

SAT
TT=2.07
T1=2.06
? (problem)
TT=0.013

SAT
TT=2.197
T1=2.19
SAT
TT=0.263
T1=0.26
SAT
TT=0.446
T1=0.44
SAT
TT=1.5
T1=1.51
SAT
TT=3.704
T1=3.78
SAT
TT=3.334
T1=2.59
SAT
TT=3.274
T1=3.27
SAT
TT=1.036
T1=0.5
SAT
TT=7.462
T1=7.45
SAT
TT=1.038
T1=1.13
SAT
TT=2.144
T1=1.16
SAT
TT=3.083
T1=1.31
SAT
TT=12.049
T1=12.04
SAT
TT=0.79
T1=0.88
SAT
TT=7.734
T1=3.37
SAT
TT=11.908
T1=11.9
SAT
TT=0.285
T1=0.28
? (problem)
TT=0.013

? (problem)
TT=0.014

SAT
TT=74.885
T1=75.07
SAT
TT=977.946
T1=978.23
SAT
TT=0.488
T1=0.49
No dataNo dataNo dataNo dataSAT
TT=1.997
T1=1.99
No dataNo dataSAT
TT=11.172
T1=4.83
SAT
TT=12.442
T1=11.05
SAT
TT=1.172
T1=0.63
SAT
TT=11.091
T1=11.08
SAT
TT=11.665
T1=11.66
SAT
TT=11.118
T1=11.1
SAT
TT=12.985
T1=12.98
SAT
TT=12.634
T1=12.64
SAT
TT=1.888
T1=1.88
No dataNo dataSAT
TT=1.888
T1=2.04
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900554389.opb
SAT
TT=0.041
T1=0.04
SAT
TT=1.777
T1=1.77
SAT
TT=0.041
T1=0.04
No data? (problem)
TT=0.015

SAT
TT=3.552
T1=3.55
? (problem)
TT=0.015

SAT
TT=3.536
T1=3.53
? (problem)
TT=0.015

SAT
TT=3.541
T1=3.55
? (problem)
TT=0.013

SAT
TT=3.508
T1=3.5
SAT
TT=2.198
T1=2.19
SAT
TT=7.264
T1=7.26
SAT
TT=0.172
T1=0.15
SAT
TT=0.085
T1=0.2
SAT
TT=1.314
T1=0.63
SAT
TT=0.152
T1=0.15
SAT
TT=0.814
T1=0.39
SAT
TT=7.861
T1=7.85
SAT
TT=0.785
T1=0.93
SAT
TT=0.899
T1=0.68
SAT
TT=2.463
T1=1.31
SAT
TT=12.386
T1=12.38
SAT
TT=0.786
T1=0.87
SAT
TT=4.323
T1=1.81
SAT
TT=17.723
T1=17.72
SAT
TT=10.692
T1=5.4
? (problem)
TT=0.014

? (problem)
TT=0.015

SAT
TT=55.771
T1=55.85
SAT
TT=9.432
T1=9.41
SAT
TT=0.057
T1=0.05
No dataNo dataNo dataNo dataSAT
TT=0.168
T1=0.28
No dataNo dataSAT
TT=1.664
T1=0.82
SAT
TT=1.426
T1=0.92
SAT
TT=0.714
T1=0.36
SAT
TT=3.953
T1=3.94
SAT
TT=3.674
T1=3.66
SAT
TT=5.434
T1=5.42
SAT
TT=6.126
T1=6.12
SAT
TT=6.158
T1=6.15
SAT
TT=0.168
T1=0.15
No dataNo dataSAT
TT=0.177
T1=0.17
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900556231.opb
UNSAT
TT=1.863

UNSAT
TT=1012.53

UNSAT
TT=1.863

No data? (problem)
TT=0.013

UNSAT
TT=25.714

? (problem)
TT=0.012

UNSAT
TT=25.66

? (problem)
TT=0.013

UNSAT
TT=25.04

? (problem)
TT=0.013

UNSAT
TT=25.27

UNSAT
TT=1199.69

UNSAT
TT=213.946

UNSAT
TT=19.016

UNSAT
TT=234.666

UNSAT
TT=50.01

UNSAT
TT=973.835

UNSAT
TT=12.241

UNSAT
TT=342.129

UNSAT
TT=35.761

UNSAT
TT=1075.94

UNSAT
TT=889.618

UNSAT
TT=669.024

UNSAT
TT=19.573

UNSAT
TT=901.95

UNSAT
TT=316.723

UNSAT
TT=152.033

? (problem)
TT=0.012

? (problem)
TT=0.017

? (TO)
TT=1800.05

? (TO)
TT=1800.12

UNSAT
TT=224.29

No dataNo dataNo dataNo dataUNSAT
TT=204.003

No dataNo dataUNSAT
TT=90.319

UNSAT
TT=37.549

UNSAT
TT=46.598

UNSAT
TT=344.306

UNSAT
TT=429.534

UNSAT
TT=256.47

UNSAT
TT=32.808

UNSAT
TT=31.967

UNSAT
TT=197.76

No dataNo dataUNSAT
TT=185.689

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900559365.opb
SAT
TT=0.348
T1=0.34
SAT
TT=2.61
T1=2.61
SAT
TT=0.689
T1=0.68
No data? (problem)
TT=0.014

SAT
TT=1.221
T1=1.21
? (problem)
TT=0.015

SAT
TT=1.209
T1=1.21
? (problem)
TT=0.013

SAT
TT=1.211
T1=1.21
? (problem)
TT=0.013

SAT
TT=1.209
T1=1.2
SAT
TT=18.204
T1=18.21
SAT
TT=4.259
T1=4.25
SAT
TT=0.734
T1=0.72
SAT
TT=8.162
T1=8.16
SAT
TT=1.464
T1=0.76
SAT
TT=5.874
T1=5.87
SAT
TT=1.424
T1=0.83
SAT
TT=52.008
T1=52.01
SAT
TT=1.197
T1=2.24
SAT
TT=21.098
T1=7.56
SAT
TT=4.854
T1=2.31
SAT
TT=52.021
T1=52.03
SAT
TT=0.695
T1=0.78
SAT
TT=4.183
T1=1.83
SAT
TT=7.25
T1=7.24
SAT
TT=3.139
T1=3.14
? (problem)
TT=0.018

? (problem)
TT=0.013

SAT
TT=179.137
T1=179.41
SAT
TT=169.656
T1=169.9
SAT
TT=2.008
T1=2.01
No dataNo dataNo dataNo dataSAT
TT=0.35
T1=0.34
No dataNo dataSAT
TT=31.539
T1=15.41
SAT
TT=5.514
T1=4.39
SAT
TT=1.225
T1=0.69
SAT
TT=15.544
T1=15.54
SAT
TT=16.164
T1=16.16
SAT
TT=16.043
T1=16.03
SAT
TT=1.544
T1=1.54
SAT
TT=1.518
T1=1.51
SAT
TT=0.348
T1=0.34
No dataNo dataSAT
TT=0.348
T1=0.34
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900561288.opb
UNSAT
TT=57.031

?
TT=1798

UNSAT
TT=60.643

No data? (problem)
TT=0.014

UNSAT
TT=87.186

? (problem)
TT=0.011

UNSAT
TT=85.95

? (problem)
TT=0.014

UNSAT
TT=84.65

? (problem)
TT=0.014

UNSAT
TT=84.94

UNSAT
TT=1793.15

? (TO)
TT=1800.03

UNSAT
TT=131.663

UNSAT
TT=394.962

UNSAT
TT=1451.86

UNSAT
TT=932.074

UNSAT
TT=175.35

UNSAT
TT=668.539

UNSAT
TT=207.743

UNSAT
TT=1156.44

? (TO)
TT=1801.06

UNSAT
TT=913.964

UNSAT
TT=57.031

? (TO)
TT=1800.01

UNSAT
TT=774.925

? (TO)
TT=1800.11

? (problem)
TT=0.014

? (problem)
TT=0.014

? (TO)
TT=1800.08

? (TO)
TT=1800.13

UNSAT
TT=714.51

No dataNo dataNo dataNo dataUNSAT
TT=821.878

No dataNo dataUNSAT
TT=297.23

UNSAT
TT=115.43

UNSAT
TT=251.276

UNSAT
TT=657.12

UNSAT
TT=634.688

UNSAT
TT=557.576

UNSAT
TT=106.299

UNSAT
TT=106.23

UNSAT
TT=815.093

No dataNo dataUNSAT
TT=929.81

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900561389.opb
SAT
TT=0.188
T1=0.18
SAT
TT=0.188
T1=0.18
SAT
TT=0.224
T1=0.22
No data? (problem)
TT=0.014

SAT
TT=10.705
T1=10.71
? (problem)
TT=0.013

SAT
TT=10.697
T1=10.69
? (problem)
TT=0.015

SAT
TT=10.599
T1=10.6
? (problem)
TT=0.014

SAT
TT=10.563
T1=10.57
SAT
TT=7.998
T1=8
SAT
TT=11.477
T1=11.48
SAT
TT=2.287
T1=2.27
SAT
TT=1.853
T1=1.94
SAT
TT=2.384
T1=1.63
SAT
TT=12.954
T1=12.95
SAT
TT=5.683
T1=5
SAT
TT=3.087
T1=3.08
SAT
TT=0.678
T1=0.82
SAT
TT=87.909
T1=32.13
SAT
TT=4.013
T1=2.31
SAT
TT=27.631
T1=27.64
SAT
TT=0.912
T1=1
SAT
TT=4.538
T1=1.82
SAT
TT=20.175
T1=20.17
SAT
TT=8.504
T1=8.5
? (problem)
TT=0.014

? (problem)
TT=0.013

SAT
TT=475.384
T1=475.38
SAT
TT=1161.1
T1=1161.24
SAT
TT=0.587
T1=0.58
No dataNo dataNo dataNo dataSAT
TT=0.308
T1=0.31
No dataNo dataSAT
TT=6.643
T1=2.38
SAT
TT=10.133
T1=8.63
SAT
TT=1.595
T1=1.01
SAT
TT=3.518
T1=3.5
SAT
TT=3.422
T1=3.41
SAT
TT=12.013
T1=12.01
SAT
TT=6.103
T1=6.1
SAT
TT=6.064
T1=6.06
SAT
TT=0.307
T1=0.3
No dataNo dataSAT
TT=0.309
T1=0.3
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900565527.opb
SAT
TT=0.008
T1=0.01
SAT
TT=1.33
T1=1.33
SAT
TT=0.596
T1=0.59
No data? (problem)
TT=0.013

SAT
TT=0.976
T1=0.97
? (problem)
TT=0.017

SAT
TT=0.975
T1=0.97
? (problem)
TT=0.012

SAT
TT=0.964
T1=0.96
? (problem)
TT=0.015

SAT
TT=0.965
T1=0.96
SAT
TT=5.915
T1=5.91
SAT
TT=0.89
T1=0.89
SAT
TT=0.906
T1=0.88
SAT
TT=2.061
T1=2.06
SAT
TT=1.455
T1=0.72
SAT
TT=10.679
T1=10.68
SAT
TT=1.454
T1=0.84
SAT
TT=17.06
T1=17.05
SAT
TT=0.944
T1=1.05
SAT
TT=122.69
T1=43.94
SAT
TT=10.431
T1=5.3
SAT
TT=33.535
T1=33.54
SAT
TT=0.715
T1=0.79
SAT
TT=6.333
T1=2.83
SAT
TT=19.68
T1=9.89
SAT
TT=0.615
T1=0.61
? (problem)
TT=0.011

? (problem)
TT=0.014

SAT
TT=91.337
T1=91.42
SAT
TT=512.858
T1=512.94
SAT
TT=0.939
T1=0.93
No dataNo dataNo dataNo dataSAT
TT=0.008
T1=0.01
No dataNo dataSAT
TT=11.072
T1=4.81
SAT
TT=5.072
T1=3.65
SAT
TT=1.434
T1=0.85
SAT
TT=10.119
T1=10.11
SAT
TT=10.091
T1=10.08
SAT
TT=12.442
T1=12.43
SAT
TT=49.943
T1=49.95
SAT
TT=48.573
T1=48.59
SAT
TT=0.008
T1=0.01
No dataNo dataSAT
TT=0.008
T1=0.01
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900565534.opb
UNSAT
TT=1.621

UNSAT
TT=1077.3

UNSAT
TT=1.621

No data? (problem)
TT=0.014

UNSAT
TT=1.967

? (problem)
TT=0.016

UNSAT
TT=1.87

? (problem)
TT=0.013

UNSAT
TT=1.94

? (problem)
TT=0.014

UNSAT
TT=2.08

UNSAT
TT=1055.6

UNSAT
TT=144.139

UNSAT
TT=36.522

UNSAT
TT=189.435

UNSAT
TT=13.242

UNSAT
TT=1054.65

UNSAT
TT=6.324

UNSAT
TT=624.774

UNSAT
TT=32.012

? (TO)
TT=1800.11

UNSAT
TT=1359.57

UNSAT
TT=522.137

UNSAT
TT=21.636

UNSAT
TT=1342.39

UNSAT
TT=336.141

UNSAT
TT=69.427

? (problem)
TT=0.013

? (problem)
TT=0.012

? (TO)
TT=1800.02

? (TO)
TT=1800.08

UNSAT
TT=309.18

No dataNo dataNo dataNo dataUNSAT
TT=290.377

No dataNo dataUNSAT
TT=21.96

UNSAT
TT=67.246

UNSAT
TT=131.064

UNSAT
TT=224.51

UNSAT
TT=285.201

UNSAT
TT=410.632

UNSAT
TT=18.219

UNSAT
TT=18.274

UNSAT
TT=289.799

No dataNo dataUNSAT
TT=286.18

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900566263.opb
SAT
TT=0.02
T1=0.02
SAT
TT=1.057
T1=1.05
SAT
TT=0.02
T1=0.02
No data? (problem)
TT=0.017

SAT
TT=0.312
T1=0.31
? (problem)
TT=0.013

SAT
TT=0.308
T1=0.3
? (problem)
TT=0.012

SAT
TT=0.303
T1=0.57
? (problem)
TT=0.013

SAT
TT=0.304
T1=0.43
SAT
TT=0.274
T1=0.27
SAT
TT=0.402
T1=0.4
SAT
TT=0.217
T1=0.2
SAT
TT=4.157
T1=4.25
SAT
TT=1.214
T1=0.55
SAT
TT=3.937
T1=3.93
SAT
TT=1.134
T1=0.61
SAT
TT=3.253
T1=3.24
SAT
TT=0.956
T1=2.02
SAT
TT=1.447
T1=0.81
SAT
TT=2.304
T1=1.32
SAT
TT=3.054
T1=3.04
SAT
TT=0.522
T1=0.61
SAT
TT=1.396
T1=0.85
SAT
TT=5.275
T1=5.26
SAT
TT=0.263
T1=0.26
? (problem)
TT=0.014

? (problem)
TT=0.013

SAT
TT=49.345
T1=49.54
SAT
TT=8.333
T1=8.31
SAT
TT=0.117
T1=0.11
No dataNo dataNo dataNo dataSAT
TT=0.108
T1=0.09
No dataNo dataSAT
TT=13.024
T1=5.86
SAT
TT=4.743
T1=3.22
SAT
TT=0.884
T1=0.44
SAT
TT=3.413
T1=3.4
SAT
TT=3.611
T1=3.6
SAT
TT=12.616
T1=12.61
SAT
TT=13.598
T1=13.6
SAT
TT=13.673
T1=13.68
SAT
TT=0.108
T1=0.09
No dataNo dataSAT
TT=0.119
T1=0.11
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900568186.opb
UNSAT
TT=0.09

UNSAT
TT=361.413

UNSAT
TT=1.122

No data? (problem)
TT=0.014

UNSAT
TT=0.469

? (problem)
TT=0.017

UNSAT
TT=0.096

? (problem)
TT=0.014

UNSAT
TT=0.091

? (problem)
TT=0.013

UNSAT
TT=0.09

UNSAT
TT=629.52

UNSAT
TT=205.525

UNSAT
TT=10.455

UNSAT
TT=72.979

UNSAT
TT=2.533

UNSAT
TT=478.462

UNSAT
TT=2.174

UNSAT
TT=189.984

UNSAT
TT=8.163

UNSAT
TT=554.6

UNSAT
TT=52.044

UNSAT
TT=216.946

UNSAT
TT=7.695

UNSAT
TT=32.829

UNSAT
TT=140.477

UNSAT
TT=127.915

? (problem)
TT=0.014

? (problem)
TT=0.015

? (TO)
TT=1800.05

? (TO)
TT=1800.02

UNSAT
TT=26.174

No dataNo dataNo dataNo dataUNSAT
TT=52.68

No dataNo dataUNSAT
TT=18.931

UNSAT
TT=10.162

UNSAT
TT=16.981

UNSAT
TT=123.893

UNSAT
TT=122.507

UNSAT
TT=127.083

UNSAT
TT=20.201

UNSAT
TT=20.07

UNSAT
TT=49.854

No dataNo dataUNSAT
TT=50.29

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900574974.opb
SAT
TT=0.019
T1=0.01
SAT
TT=5.479
T1=5.48
SAT
TT=0.019
T1=0.01
No data? (problem)
TT=0.014

SAT
TT=1.328
T1=1.36
? (problem)
TT=0.015

SAT
TT=1.32
T1=1.31
? (problem)
TT=0.015

SAT
TT=1.334
T1=1.33
? (problem)
TT=0.012

SAT
TT=1.378
T1=1.37
SAT
TT=0.163
T1=0.16
SAT
TT=1.978
T1=1.97
SAT
TT=0.383
T1=0.37
SAT
TT=1.173
T1=1.17
SAT
TT=1.844
T1=1.1
SAT
TT=3.54
T1=3.53
SAT
TT=0.753
T1=0.39
SAT
TT=3.742
T1=3.73
SAT
TT=0.695
T1=0.81
SAT
TT=1.681
T1=0.94
SAT
TT=3.863
T1=1.3
SAT
TT=14.125
T1=14.12
SAT
TT=0.537
T1=0.64
SAT
TT=4.104
T1=1.83
SAT
TT=3.747
T1=3.74
SAT
TT=1.431
T1=1.43
? (problem)
TT=0.012

? (problem)
TT=0.016

SAT
TT=10.452
T1=10.51
SAT
TT=65.004
T1=65.17
SAT
TT=0.228
T1=0.22
No dataNo dataNo dataNo dataSAT
TT=0.229
T1=0.22
No dataNo dataSAT
TT=5.723
T1=2.31
SAT
TT=4.343
T1=3.06
SAT
TT=0.923
T1=0.45
SAT
TT=3.266
T1=3.25
SAT
TT=3.263
T1=3.25
SAT
TT=7.104
T1=7.09
SAT
TT=5.338
T1=5.33
SAT
TT=5.206
T1=5.21
SAT
TT=0.208
T1=0.2
No dataNo dataSAT
TT=0.211
T1=0.21
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900576918.opb
SAT
TT=0.048
T1=0.04
SAT
TT=0.738
T1=0.73
SAT
TT=0.116
T1=0.11
No data? (problem)
TT=0.013

SAT
TT=2.369
T1=2.37
? (problem)
TT=0.014

SAT
TT=2.36
T1=2.36
? (problem)
TT=0.013

SAT
TT=2.377
T1=2.39
? (problem)
TT=0.014

SAT
TT=2.529
T1=2.52
SAT
TT=9.906
T1=9.91
SAT
TT=3.07
T1=3.07
SAT
TT=0.134
T1=0.11
SAT
TT=0.398
T1=0.4
SAT
TT=1.264
T1=0.59
SAT
TT=0.689
T1=0.68
SAT
TT=1.074
T1=0.53
SAT
TT=7.339
T1=7.33
SAT
TT=0.724
T1=0.84
SAT
TT=0.74
T1=0.53
SAT
TT=5.253
T1=2.34
SAT
TT=12.149
T1=12.15
SAT
TT=0.63
T1=0.73
SAT
TT=1.775
T1=0.83
SAT
TT=5.386
T1=5.37
SAT
TT=2.113
T1=2.11
? (problem)
TT=0.014

? (problem)
TT=0.014

SAT
TT=40.178
T1=40.2
SAT
TT=60.121
T1=60.18
SAT
TT=0.058
T1=0.05
No dataNo dataNo dataNo dataSAT
TT=0.057
T1=0.05
No dataNo dataSAT
TT=5.925
T1=2.32
SAT
TT=4.624
T1=3.41
SAT
TT=1.203
T1=0.67
SAT
TT=1.958
T1=1.95
SAT
TT=1.971
T1=1.95
SAT
TT=17.54
T1=17.53
SAT
TT=7.303
T1=7.31
SAT
TT=7.27
T1=7.27
SAT
TT=0.048
T1=0.04
No dataNo dataSAT
TT=0.048
T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900576927.opb
UNSAT
TT=2.88

UNSAT
TT=1342.3

UNSAT
TT=2.88

No data? (problem)
TT=0.013

UNSAT
TT=43.743

? (problem)
TT=0.013

UNSAT
TT=43.06

? (problem)
TT=0.012

UNSAT
TT=43.36

? (problem)
TT=0.012

UNSAT
TT=43.75

UNSAT
TT=1244.24

UNSAT
TT=396.689

UNSAT
TT=71.195

UNSAT
TT=214.481

UNSAT
TT=140.362

UNSAT
TT=1626.63

UNSAT
TT=79.36

UNSAT
TT=359.572

UNSAT
TT=49.301

UNSAT
TT=1332.9

? (TO)
TT=1800.11

UNSAT
TT=1232.05

UNSAT
TT=41.597

UNSAT
TT=1752.88

UNSAT
TT=629.968

UNSAT
TT=367.553

? (problem)
TT=0.013

? (problem)
TT=0.013

? (TO)
TT=1800.05

? (TO)
TT=1800.1

UNSAT
TT=261.22

No dataNo dataNo dataNo dataUNSAT
TT=318.105

No dataNo dataUNSAT
TT=174.99

UNSAT
TT=65.223

UNSAT
TT=121.816

UNSAT
TT=862.969

UNSAT
TT=728.662

UNSAT
TT=554.527

UNSAT
TT=79.649

UNSAT
TT=78.292

UNSAT
TT=312.661

No dataNo dataUNSAT
TT=321.17

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900577000.opb
SAT
TT=0.007
T1=0.01
SAT
TT=0.533
T1=0.53
SAT
TT=0.063
T1=0.06
No data? (problem)
TT=0.013

SAT
TT=0.217
T1=0.21
? (problem)
TT=0.014

SAT
TT=0.211
T1=0.21
? (problem)
TT=0.013

SAT
TT=0.21
T1=0.58
? (problem)
TT=0.014

SAT
TT=0.208
T1=0.21
SAT
TT=0.602
T1=0.61
SAT
TT=6.307
T1=6.3
SAT
TT=0.287
T1=0.27
SAT
TT=0.355
T1=0.35
SAT
TT=1.143
T1=0.51
SAT
TT=4.523
T1=4.52
SAT
TT=1.255
T1=0.69
SAT
TT=12.354
T1=12.35
SAT
TT=0.776
T1=0.89
SAT
TT=2.031
T1=1
SAT
TT=6.943
T1=3.32
SAT
TT=8.71
T1=8.7
SAT
TT=0.529
T1=0.59
SAT
TT=1.633
T1=0.83
SAT
TT=7.844
T1=7.83
SAT
TT=4.661
T1=4.66
? (problem)
TT=0.014

? (problem)
TT=0.015

SAT
TT=32.511
T1=32.46
SAT
TT=242.207
T1=242.2
SAT
TT=0.007
T1=0.01
No dataNo dataNo dataNo dataSAT
TT=0.348
T1=0.34
No dataNo dataSAT
TT=9.365
T1=3.82
SAT
TT=4.154
T1=2.85
SAT
TT=1.283
T1=0.71
SAT
TT=9.97
T1=9.96
SAT
TT=9.965
T1=9.95
SAT
TT=12.031
T1=12.02
SAT
TT=44.019
T1=44.03
SAT
TT=44.018
T1=44.03
SAT
TT=0.348
T1=0.34
No dataNo dataSAT
TT=0.348
T1=0.34
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900582300.opb
UNSAT
TT=2.232

UNSAT
TT=1017.05

UNSAT
TT=2.232

No data? (problem)
TT=0.014

UNSAT
TT=10.383

? (problem)
TT=0.013

UNSAT
TT=10.16

? (problem)
TT=0.015

UNSAT
TT=10.26

? (problem)
TT=0.014

UNSAT
TT=10.26

UNSAT
TT=1708.15

UNSAT
TT=453.634

UNSAT
TT=55.35

UNSAT
TT=279.352

UNSAT
TT=33.11

UNSAT
TT=762.292

UNSAT
TT=14.643

UNSAT
TT=542.268

UNSAT
TT=41.684

UNSAT
TT=1547.95

UNSAT
TT=1295.33

UNSAT
TT=668.325

UNSAT
TT=22.233

UNSAT
TT=1261.18

UNSAT
TT=435.355

UNSAT
TT=547.158

? (problem)
TT=0.012

? (problem)
TT=0.016

? (TO)
TT=1800.08

? (TO)
TT=1800.12

UNSAT
TT=426.55

No dataNo dataNo dataNo dataUNSAT
TT=241.74

No dataNo dataUNSAT
TT=96.499

UNSAT
TT=50.936

UNSAT
TT=94.63

UNSAT
TT=498.86

UNSAT
TT=437.577

UNSAT
TT=356.222

UNSAT
TT=56.577

UNSAT
TT=56.987

UNSAT
TT=226.556

No dataNo dataUNSAT
TT=231.9

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900582376.opb
SAT
TT=0.048
T1=0.03
SAT
TT=19.187
T1=19.19
SAT
TT=0.378
T1=0.37
No data? (problem)
TT=0.014

SAT
TT=0.209
T1=0.21
? (problem)
TT=0.012

SAT
TT=0.209
T1=0.2
? (problem)
TT=0.013

SAT
TT=0.205
T1=0.2
? (problem)
TT=0.015

SAT
TT=0.203
T1=0.2
SAT
TT=26.27
T1=26.27
SAT
TT=6.973
T1=6.97
SAT
TT=0.191
T1=0.18
SAT
TT=2.798
T1=2.8
SAT
TT=2.104
T1=1.33
SAT
TT=11.662
T1=11.66
SAT
TT=2.074
T1=1.41
SAT
TT=34.801
T1=34.8
SAT
TT=1.119
T1=2.08
SAT
TT=142
T1=50.64
SAT
TT=16.392
T1=8.3
SAT
TT=21.358
T1=21.36
SAT
TT=1
T1=1.08
SAT
TT=8.742
T1=3.82
SAT
TT=3.233
T1=3.22
SAT
TT=5.142
T1=5.14
? (problem)
TT=0.012

? (problem)
TT=0.016

SAT
TT=1635.62
T1=1636.09
SAT
TT=11.231
T1=11.22
SAT
TT=1.357
T1=1.36
No dataNo dataNo dataNo dataSAT
TT=0.05
T1=0.04
No dataNo dataSAT
TT=4.872
T1=1.85
SAT
TT=1.483
T1=0.82
SAT
TT=3.783
T1=3.17
SAT
TT=10.351
T1=10.34
SAT
TT=10.21
T1=10.2
SAT
TT=10.16
T1=10.15
SAT
TT=7.348
T1=7.35
SAT
TT=7.334
T1=7.33
SAT
TT=0.048
T1=0.03
No dataNo dataSAT
TT=0.048
T1=0.04
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900584106.opb
UNSAT
TT=0.626

UNSAT
TT=619.731

UNSAT
TT=0.626

No data? (problem)
TT=0.016

UNSAT
TT=1.624

? (problem)
TT=0.013

UNSAT
TT=1.56

? (problem)
TT=0.013

UNSAT
TT=1.53

? (problem)
TT=0.014

UNSAT
TT=1.55

UNSAT
TT=503.671

UNSAT
TT=54.358

UNSAT
TT=3.42

UNSAT
TT=55.282

UNSAT
TT=7.603

UNSAT
TT=382.327

UNSAT
TT=2.665

UNSAT
TT=112.38

UNSAT
TT=6.757

UNSAT
TT=498.819

UNSAT
TT=71.934

UNSAT
TT=212.637

UNSAT
TT=2.714

UNSAT
TT=293.248

UNSAT
TT=74.101

UNSAT
TT=33.292

? (problem)
TT=0.012

? (problem)
TT=0.013

? (TO)
TT=1800.09

? (TO)
TT=1800.01

UNSAT
TT=25.89

No dataNo dataNo dataNo dataUNSAT
TT=106.676

No dataNo dataUNSAT
TT=24.11

UNSAT
TT=18.569

UNSAT
TT=12.662

UNSAT
TT=72.601

UNSAT
TT=72.735

UNSAT
TT=93.388

UNSAT
TT=5.769

UNSAT
TT=5.81

UNSAT
TT=104.054

No dataNo dataUNSAT
TT=102.107

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900669299.opb
SAT
TT=0.054
T1=0.05
SAT
TT=9.367
T1=9.36
SAT
TT=0.059
T1=0.05
No data? (problem)
TT=0.014

SAT
TT=0.973
T1=0.97
? (problem)
TT=0.015

SAT
TT=0.963
T1=0.96
? (problem)
TT=0.013

SAT
TT=0.97
T1=0.97
? (problem)
TT=0.014

SAT
TT=0.972
T1=0.97
SAT
TT=3.124
T1=3.12
SAT
TT=0.112
T1=0.11
SAT
TT=0.225
T1=0.21
SAT
TT=5.563
T1=5.56
SAT
TT=1.203
T1=0.57
SAT
TT=2.568
T1=2.56
SAT
TT=1.235
T1=0.65
SAT
TT=10.132
T1=10.12
SAT
TT=0.766
T1=0.84
SAT
TT=1.931
T1=0.86
SAT
TT=6.553
T1=3.31
SAT
TT=27.515
T1=27.52
SAT
TT=0.524
T1=0.62
SAT
TT=1.204
T1=0.83
SAT
TT=3.958
T1=3.94
SAT
TT=0.054
T1=0.05
? (problem)
TT=0.013

? (problem)
TT=0.012

SAT
TT=1060.51
T1=531.6
SAT
TT=34.012
T1=34.37
SAT
TT=0.409
T1=0.4
No dataNo dataNo dataNo dataSAT
TT=0.58
T1=0.57
No dataNo dataSAT
TT=1.183
T1=0.83
SAT
TT=3.761
T1=2.58
SAT
TT=0.683
T1=0.35
SAT
TT=10.691
T1=5.39
SAT
TT=5.388
T1=5.37
SAT
TT=12.487
T1=12.48
SAT
TT=0.088
T1=0.08
SAT
TT=0.086
T1=0.08
SAT
TT=0.578
T1=0.57
No dataNo dataSAT
TT=0.579
T1=0.57
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900669309.opb
SAT
TT=0.27
T1=0.26
SAT
TT=105.81
T1=105.82
SAT
TT=0.556
T1=0.55
No data? (problem)
TT=0.012

SAT
TT=5.234
T1=5.24
? (problem)
TT=0.015

SAT
TT=5.24
T1=5.24
? (problem)
TT=0.014

SAT
TT=5.531
T1=5.55
? (problem)
TT=0.014

SAT
TT=5.529
T1=5.52
SAT
TT=61.535
T1=61.54
SAT
TT=19.652
T1=19.65
SAT
TT=6.674
T1=6.66
SAT
TT=26.061
T1=26.06
SAT
TT=1.653
T1=0.92
SAT
TT=36.847
T1=36.85
SAT
TT=2.075
T1=1.41
SAT
TT=68.662
T1=68.67
SAT
TT=0.809
T1=0.9
SAT
TT=364.645
T1=109.04
SAT
TT=15.433
T1=7.33
SAT
TT=14.192
T1=14.18
SAT
TT=3.885
T1=3.94
SAT
TT=4.27
T1=1.85
SAT
TT=38.492
T1=38.49
SAT
TT=14.212
T1=14.21
? (problem)
TT=0.014

? (problem)
TT=0.013

? (TO)
TT=1800.06

SAT
TT=136
T1=136
SAT
TT=0.27
T1=0.26
No dataNo dataNo dataNo dataSAT
TT=0.448
T1=0.44
No dataNo dataSAT
TT=25.068
T1=11.82
SAT
TT=2.283
T1=1.46
SAT
TT=3.263
T1=2.65
SAT
TT=14.497
T1=14.49
SAT
TT=14.421
T1=14.41
SAT
TT=24.603
T1=24.59
SAT
TT=42.719
T1=42.73
SAT
TT=42.566
T1=42.57
SAT
TT=0.448
T1=0.44
No dataNo dataSAT
TT=0.478
T1=0.48
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900670167.opb
UNSAT
TT=1.428

UNSAT
TT=979.046

UNSAT
TT=1.428

No data? (problem)
TT=0.013

UNSAT
TT=7.896

? (problem)
TT=0.013

UNSAT
TT=7.87

? (problem)
TT=0.013

UNSAT
TT=7.75

? (problem)
TT=0.013

UNSAT
TT=7.77

UNSAT
TT=684.6

UNSAT
TT=16.717

UNSAT
TT=16.027

UNSAT
TT=146.246

UNSAT
TT=5.663

UNSAT
TT=1493.9

UNSAT
TT=5.781

UNSAT
TT=342.928

UNSAT
TT=21.387

UNSAT
TT=1146.14

UNSAT
TT=636.508

UNSAT
TT=393.52

UNSAT
TT=13.126

UNSAT
TT=500.66

UNSAT
TT=225.449

UNSAT
TT=12.606

? (problem)
TT=0.014

? (problem)
TT=0.014

? (TO)
TT=1800.12

? (TO)
TT=1800.09

UNSAT
TT=75.76

No dataNo dataNo dataNo dataUNSAT
TT=89.599

No dataNo dataUNSAT
TT=26.7

UNSAT
TT=16.791

UNSAT
TT=19.361

UNSAT
TT=189.071

UNSAT
TT=205.328

UNSAT
TT=128.022

UNSAT
TT=18.012

UNSAT
TT=18.439

UNSAT
TT=94.256

No dataNo dataUNSAT
TT=88.167

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900670675.opb
UNSAT
TT=0.709

UNSAT
TT=381.464

UNSAT
TT=0.709

No data? (problem)
TT=0.014

UNSAT
TT=1.242

? (problem)
TT=0.014

UNSAT
TT=1.17

? (problem)
TT=0.015

UNSAT
TT=1.15

? (problem)
TT=0.014

UNSAT
TT=1.27

UNSAT
TT=850.953

UNSAT
TT=26.881

UNSAT
TT=4.68

UNSAT
TT=117.077

UNSAT
TT=2.973

UNSAT
TT=361.356

UNSAT
TT=2.364

UNSAT
TT=173.163

UNSAT
TT=6.132

UNSAT
TT=707.53

UNSAT
TT=68.894

UNSAT
TT=251.092

UNSAT
TT=3.669

UNSAT
TT=28.631

UNSAT
TT=164.545

UNSAT
TT=25.052

? (problem)
TT=0.013

? (problem)
TT=0.012

? (TO)
TT=1800.07

? (TO)
TT=1800.05

UNSAT
TT=30.086

No dataNo dataNo dataNo dataUNSAT
TT=44.561

No dataNo dataUNSAT
TT=9.463

UNSAT
TT=3.273

UNSAT
TT=11.313

UNSAT
TT=134.294

UNSAT
TT=128.576

UNSAT
TT=212.538

UNSAT
TT=5.494

UNSAT
TT=5.438

UNSAT
TT=42.194

No dataNo dataUNSAT
TT=40.482

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110967729.opb
UNSAT
TT=0.06

UNSAT
TT=16.899

UNSAT
TT=0.43

No data? (problem)
TT=0.019

UNSAT
TT=3.524

? (problem)
TT=0.022

UNSAT
TT=3.47

? (problem)
TT=0.021

UNSAT
TT=3.43

? (problem)
TT=0.02

UNSAT
TT=3.46

UNSAT
TT=17.51

UNSAT
TT=155.205

UNSAT
TT=0.977

UNSAT
TT=36.498

UNSAT
TT=2.505

UNSAT
TT=11.857

UNSAT
TT=1.935

UNSAT
TT=0.066

UNSAT
TT=1.371

UNSAT
TT=0.06

UNSAT
TT=9.483

UNSAT
TT=0.155

UNSAT
TT=5.238

UNSAT
TT=8.283

UNSAT
TT=0.101

UNSAT
TT=125.796

? (problem)
TT=0.024

? (problem)
TT=0.022

UNSAT
TT=246.258

UNSAT
TT=261.58

UNSAT
TT=2.053

No dataNo dataNo dataNo dataUNSAT
TT=2.073

No dataNo dataUNSAT
TT=6.083

UNSAT
TT=2.138

UNSAT
TT=3.274

UNSAT
TT=0.127

UNSAT
TT=0.126

UNSAT
TT=0.159

UNSAT
TT=7.513

UNSAT
TT=7.854

UNSAT
TT=2.063

No dataNo dataUNSAT
TT=2.163

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110968431.opb
SAT
TT=0.022
T1=0.03
SAT
TT=11.194
T1=11.19
SAT
TT=0.324
T1=0.32
No data? (problem)
TT=0.021

SAT
TT=2.964
T1=2.96
? (problem)
TT=0.023

SAT
TT=2.948
T1=2.94
? (problem)
TT=0.018

SAT
TT=2.957
T1=2.95
? (problem)
TT=0.021

SAT
TT=2.921
T1=2.92
SAT
TT=13.772
T1=13.77
SAT
TT=38.49
T1=38.5
SAT
TT=0.103
T1=0.09
SAT
TT=30.746
T1=30.83
SAT
TT=0.965
T1=0.56
SAT
TT=5.797
T1=5.79
SAT
TT=1.564
T1=1.04
SAT
TT=0.37
T1=0.36
SAT
TT=1.62
T1=1.73
SAT
TT=0.022
T1=0.07
SAT
TT=2.714
T1=1.16
SAT
TT=0.481
T1=0.47
SAT
TT=2.509
T1=2.6
SAT
TT=2.664
T1=1.2
SAT
TT=0.227
T1=0.22
SAT
TT=45.703
T1=45.71
? (problem)
TT=0.02

? (problem)
TT=0.021

SAT
TT=216.752
T1=216.81
SAT
TT=167.26
T1=167.57
SAT
TT=0.954
T1=0.94
No dataNo dataNo dataNo dataSAT
TT=1.034
T1=1.03
No dataNo dataSAT
TT=2.713
T1=1.35
SAT
TT=0.795
T1=0.65
SAT
TT=0.925
T1=0.5
SAT
TT=0.248
T1=0.24
SAT
TT=0.251
T1=0.24
SAT
TT=0.041
T1=0.03
SAT
TT=5.698
T1=5.69
SAT
TT=5.594
T1=5.59
SAT
TT=1.033
T1=1.02
No dataNo dataSAT
TT=1.093
T1=1.09
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110969170.opb
UNSAT
TT=0.015

UNSAT
TT=30.702

UNSAT
TT=0.671

No data? (problem)
TT=0.024

UNSAT
TT=9.288

? (problem)
TT=0.022

UNSAT
TT=9.16

? (problem)
TT=0.02

UNSAT
TT=9.16

? (problem)
TT=0.023

UNSAT
TT=9.16

UNSAT
TT=21.836

UNSAT
TT=169.161

UNSAT
TT=2.189

UNSAT
TT=9.057

UNSAT
TT=3.034

UNSAT
TT=26.363

UNSAT
TT=3.113

UNSAT
TT=0.017

UNSAT
TT=1.499

UNSAT
TT=0.015

UNSAT
TT=23.361

UNSAT
TT=0.019

UNSAT
TT=6.84

UNSAT
TT=16.04

UNSAT
TT=0.021

UNSAT
TT=252.885

? (problem)
TT=0.026

? (problem)
TT=0.02

UNSAT
TT=251.264

UNSAT
TT=270.09

UNSAT
TT=3.063

No dataNo dataNo dataNo dataUNSAT
TT=2.993

No dataNo dataUNSAT
TT=13.422

UNSAT
TT=2.346

UNSAT
TT=3.983

UNSAT
TT=0.024

UNSAT
TT=0.021

UNSAT
TT=0.026

UNSAT
TT=10.109

UNSAT
TT=10.166

UNSAT
TT=3.093

No dataNo dataUNSAT
TT=3.083

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110970277.opb
SAT
TT=0.03
T1=0.07
SAT
TT=29.921
T1=29.92
SAT
TT=0.075
T1=0.07
No data? (problem)
TT=0.018

SAT
TT=2.2
T1=2.2
? (problem)
TT=0.02

SAT
TT=2.184
T1=2.18
? (problem)
TT=0.021

SAT
TT=2.18
T1=2.18
? (problem)
TT=0.021

SAT
TT=2.197
T1=2.19
SAT
TT=21.293
T1=21.3
SAT
TT=26.99
T1=26.99
SAT
TT=1.526
T1=1.6
SAT
TT=3.247
T1=3.34
SAT
TT=1.343
T1=0.95
SAT
TT=26.446
T1=26.45
SAT
TT=2.653
T1=2.12
SAT
TT=1.428
T1=1.42
SAT
TT=1.036
T1=2.14
SAT
TT=0.03
T1=0.11
SAT
TT=4.793
T1=2.16
SAT
TT=1.131
T1=1.12
SAT
TT=1.513
T1=2.27
SAT
TT=9.024
T1=4.21
SAT
TT=1.014
T1=1.01
SAT
TT=20.916
T1=20.91
? (problem)
TT=0.022

? (problem)
TT=0.021

SAT
TT=139.653
T1=140.18
SAT
TT=134.476
T1=134.62
SAT
TT=4.882
T1=4.89
No dataNo dataNo dataNo dataSAT
TT=0.582
T1=0.57
No dataNo dataSAT
TT=1.806
T1=1.49
SAT
TT=1.04
T1=1.16
SAT
TT=1.806
T1=1.38
SAT
TT=1.287
T1=1.28
SAT
TT=1.227
T1=1.22
SAT
TT=0.558
T1=0.56
SAT
TT=12.693
T1=12.69
SAT
TT=12.48
T1=12.48
SAT
TT=0.583
T1=0.57
No dataNo dataSAT
TT=0.582
T1=0.57
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110970631.opb
UNSAT
TT=0.056

UNSAT
TT=24.403

UNSAT
TT=0.768

No data? (problem)
TT=0.02

UNSAT
TT=6.353

? (problem)
TT=0.021

UNSAT
TT=6.36

? (problem)
TT=0.021

UNSAT
TT=6.64

? (problem)
TT=0.025

UNSAT
TT=6.37

UNSAT
TT=23.561

UNSAT
TT=150.692

UNSAT
TT=1.121

UNSAT
TT=27.829

UNSAT
TT=3.473

UNSAT
TT=22.529

UNSAT
TT=3.074

UNSAT
TT=0.07

UNSAT
TT=1.611

UNSAT
TT=0.056

UNSAT
TT=14.64

UNSAT
TT=0.157

UNSAT
TT=8.344

UNSAT
TT=17.001

UNSAT
TT=0.085

UNSAT
TT=143.923

? (problem)
TT=0.021

? (problem)
TT=0.018

UNSAT
TT=268.821

UNSAT
TT=274.605

UNSAT
TT=2.873

No dataNo dataNo dataNo dataUNSAT
TT=2.403

No dataNo dataUNSAT
TT=6.356

UNSAT
TT=2.521

UNSAT
TT=2.915

UNSAT
TT=0.151

UNSAT
TT=0.133

UNSAT
TT=0.146

UNSAT
TT=9.579

UNSAT
TT=9.486

UNSAT
TT=2.383

No dataNo dataUNSAT
TT=2.453

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110971697.opb
UNSAT
TT=0.061

UNSAT
TT=38.176

UNSAT
TT=0.613

No data? (problem)
TT=0.022

UNSAT
TT=6.451

? (problem)
TT=0.021

UNSAT
TT=6.56

? (problem)
TT=0.021

UNSAT
TT=6.35

? (problem)
TT=0.022

UNSAT
TT=6.25

UNSAT
TT=17.751

UNSAT
TT=148.5

UNSAT
TT=2.273

UNSAT
TT=14.679

UNSAT
TT=3.506

UNSAT
TT=31.09

UNSAT
TT=3.412

UNSAT
TT=0.226

UNSAT
TT=1.802

UNSAT
TT=0.061

UNSAT
TT=20.132

UNSAT
TT=0.277

UNSAT
TT=6.804

UNSAT
TT=19.181

UNSAT
TT=0.169

UNSAT
TT=115.145

? (problem)
TT=0.022

? (problem)
TT=0.019

UNSAT
TT=269.106

UNSAT
TT=255.793

UNSAT
TT=2.573

No dataNo dataNo dataNo dataUNSAT
TT=3.282

No dataNo dataUNSAT
TT=7.134

UNSAT
TT=2.468

UNSAT
TT=3.613

UNSAT
TT=0.27

UNSAT
TT=0.234

UNSAT
TT=0.365

UNSAT
TT=12.705

UNSAT
TT=12.419

UNSAT
TT=3.352

No dataNo dataUNSAT
TT=3.352

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110972154.opb
UNSAT
TT=0.061

UNSAT
TT=48.257

UNSAT
TT=1.026

No data? (problem)
TT=0.022

UNSAT
TT=7.898

? (problem)
TT=0.023

UNSAT
TT=7.66

? (problem)
TT=0.026

UNSAT
TT=7.65

? (problem)
TT=0.02

UNSAT
TT=7.75

UNSAT
TT=32.348

UNSAT
TT=200.224

UNSAT
TT=2.268

UNSAT
TT=12.177

UNSAT
TT=5.062

UNSAT
TT=37.588

UNSAT
TT=4.183

UNSAT
TT=0.244

UNSAT
TT=1.898

UNSAT
TT=0.061

UNSAT
TT=31.479

UNSAT
TT=0.338

UNSAT
TT=9.609

UNSAT
TT=18.031

UNSAT
TT=0.195

UNSAT
TT=131.955

? (problem)
TT=0.021

? (problem)
TT=0.023

UNSAT
TT=258.941

UNSAT
TT=270.691

UNSAT
TT=4.482

No dataNo dataNo dataNo dataUNSAT
TT=4.693

No dataNo dataUNSAT
TT=8.812

UNSAT
TT=2.931

UNSAT
TT=5.695

UNSAT
TT=0.152

UNSAT
TT=0.15

UNSAT
TT=0.323

UNSAT
TT=12.551

UNSAT
TT=12.436

UNSAT
TT=4.682

No dataNo dataUNSAT
TT=4.873

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110972958.opb
SAT
TT=0.029
T1=0.03
SAT
TT=40.546
T1=40.55
SAT
TT=0.029
T1=0.03
No data? (problem)
TT=0.021

SAT
TT=3.219
T1=3.22
? (problem)
TT=0.024

SAT
TT=3.425
T1=3.42
? (problem)
TT=0.021

SAT
TT=3.24
T1=3.24
? (problem)
TT=0.02

SAT
TT=3.243
T1=3.24
SAT
TT=29.148
T1=29.15
SAT
TT=34.731
T1=34.73
SAT
TT=0.531
T1=0.52
SAT
TT=2.006
T1=2.12
SAT
TT=5.973
T1=5.66
SAT
TT=7.898
T1=7.89
SAT
TT=2.154
T1=1.68
SAT
TT=2.604
T1=2.6
SAT
TT=0.909
T1=1.23
SAT
TT=0.165
T1=0.11
SAT
TT=5.062
T1=2.16
SAT
TT=2.023
T1=2.01
SAT
TT=2.72
T1=2.82
SAT
TT=12.933
T1=6.19
SAT
TT=0.261
T1=0.25
SAT
TT=44.595
T1=44.61
? (problem)
TT=0.02

? (problem)
TT=0.022

SAT
TT=113.103
T1=113.98
SAT
TT=165.362
T1=165.27
SAT
TT=6.773
T1=6.79
No dataNo dataNo dataNo dataSAT
TT=1.843
T1=1.83
No dataNo dataSAT
TT=8.801
T1=3.69
SAT
TT=1.163
T1=0.83
SAT
TT=1.924
T1=1.44
SAT
TT=1.071
T1=1.06
SAT
TT=1.048
T1=1.04
SAT
TT=0.582
T1=0.57
SAT
TT=10.712
T1=10.71
SAT
TT=10.753
T1=10.76
SAT
TT=1.833
T1=1.83
No dataNo dataSAT
TT=1.882
T1=2
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110973478.opb
SAT
TT=0.034
T1=0.09
SAT
TT=8.536
T1=8.53
SAT
TT=0.511
T1=0.51
No data? (problem)
TT=0.019

SAT
TT=3.62
T1=3.62
? (problem)
TT=0.022

SAT
TT=3.565
T1=3.56
? (problem)
TT=0.022

SAT
TT=3.615
T1=3.61
? (problem)
TT=0.021

SAT
TT=3.613
T1=3.61
SAT
TT=19.01
T1=19.02
SAT
TT=18.358
T1=18.36
SAT
TT=0.782
T1=0.77
SAT
TT=10.18
T1=10.18
SAT
TT=2.906
T1=2.45
SAT
TT=43.644
T1=43.65
SAT
TT=2.453
T1=1.93
SAT
TT=1.889
T1=1.88
SAT
TT=0.833
T1=0.95
SAT
TT=0.034
T1=0.09
SAT
TT=16.401
T1=8.18
SAT
TT=0.615
T1=0.61
SAT
TT=4.641
T1=4.72
SAT
TT=12.672
T1=6.18
SAT
TT=1.013
T1=1
SAT
TT=13.836
T1=13.84
? (problem)
TT=0.023

? (problem)
TT=0.019

SAT
TT=186.519
T1=186.68
SAT
TT=58.864
T1=59.37
SAT
TT=6.853
T1=6.86
No dataNo dataNo dataNo dataSAT
TT=5.282
T1=5.28
No dataNo dataSAT
TT=3.333
T1=1.22
SAT
TT=1.215
T1=0.83
SAT
TT=1.335
T1=0.89
SAT
TT=0.957
T1=0.95
SAT
TT=0.933
T1=0.92
SAT
TT=1.286
T1=1.28
SAT
TT=12.256
T1=12.25
SAT
TT=12.024
T1=12.02
SAT
TT=5.273
T1=5.26
No dataNo dataSAT
TT=5.422
T1=5.42
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110973863.opb
SAT
TT=0.059
T1=0.07
SAT
TT=36.705
T1=36.71
SAT
TT=0.811
T1=0.81
No data? (problem)
TT=0.022

SAT
TT=3.702
T1=3.7
? (problem)
TT=0.02

SAT
TT=3.69
T1=3.69
? (problem)
TT=0.024

SAT
TT=3.987
T1=4.12
? (problem)
TT=0.022

SAT
TT=3.693
T1=3.69
SAT
TT=0.981
T1=0.98
SAT
TT=69.871
T1=69.88
SAT
TT=0.369
T1=0.36
SAT
TT=1.28
T1=1.28
SAT
TT=2.434
T1=2.02
SAT
TT=59.011
T1=59.03
SAT
TT=3.095
T1=2.56
SAT
TT=1.988
T1=1.98
SAT
TT=2.069
T1=2.14
SAT
TT=0.059
T1=0.11
SAT
TT=18.301
T1=9.16
SAT
TT=1.278
T1=1.27
SAT
TT=10.88
T1=11.56
SAT
TT=18.26
T1=8.67
SAT
TT=1.421
T1=1.41
SAT
TT=64.227
T1=64.24
? (problem)
TT=0.021

? (problem)
TT=0.022

SAT
TT=186.799
T1=186.86
SAT
TT=149.45
T1=149.9
SAT
TT=0.083
T1=0.07
No dataNo dataNo dataNo dataSAT
TT=3.853
T1=3.84
No dataNo dataSAT
TT=5.785
T1=2.31
SAT
TT=1.544
T1=1.15
SAT
TT=1.024
T1=0.61
SAT
TT=0.794
T1=0.78
SAT
TT=0.766
T1=0.76
SAT
TT=0.896
T1=0.89
SAT
TT=10.787
T1=10.78
SAT
TT=10.588
T1=10.59
SAT
TT=3.832
T1=3.82
No dataNo dataSAT
TT=3.993
T1=4
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110974180.opb
UNSAT
TT=0.074

UNSAT
TT=38.032

UNSAT
TT=0.82

No data? (problem)
TT=0.019

UNSAT
TT=8.345

? (problem)
TT=0.02

UNSAT
TT=8.35

? (problem)
TT=0.022

UNSAT
TT=8.46

? (problem)
TT=0.023

UNSAT
TT=8.45

UNSAT
TT=26.993

UNSAT
TT=202.35

UNSAT
TT=2.07

UNSAT
TT=4.315

UNSAT
TT=4.623

UNSAT
TT=36.905

UNSAT
TT=3.814

UNSAT
TT=0.215

UNSAT
TT=2.049

UNSAT
TT=0.074

UNSAT
TT=25.64

UNSAT
TT=0.246

UNSAT
TT=10.348

UNSAT
TT=23.371

UNSAT
TT=0.135

UNSAT
TT=173.184

? (problem)
TT=0.024

? (problem)
TT=0.02

UNSAT
TT=269.151

UNSAT
TT=265.477

UNSAT
TT=5.222

No dataNo dataNo dataNo dataUNSAT
TT=6.403

No dataNo dataUNSAT
TT=7.526

UNSAT
TT=3.18

UNSAT
TT=5.224

UNSAT
TT=0.214

UNSAT
TT=0.192

UNSAT
TT=0.264

UNSAT
TT=14.16

UNSAT
TT=13.902

UNSAT
TT=6.372

No dataNo dataUNSAT
TT=6.384

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110974553.opb
SAT
TT=0.055
T1=0.05
SAT
TT=4.429
T1=4.43
SAT
TT=0.508
T1=0.5
No data? (problem)
TT=0.021

SAT
TT=6.213
T1=6.21
? (problem)
TT=0.021

SAT
TT=6.154
T1=6.15
? (problem)
TT=0.023

SAT
TT=6.161
T1=6.16
? (problem)
TT=0.024

SAT
TT=6.294
T1=6.29
SAT
TT=32.066
T1=32.07
SAT
TT=25.826
T1=25.83
SAT
TT=0.088
T1=0.08
SAT
TT=1.934
T1=1.93
SAT
TT=0.546
T1=0.28
SAT
TT=4.027
T1=4.03
SAT
TT=0.915
T1=0.5
SAT
TT=2.347
T1=2.34
SAT
TT=1
T1=1.12
SAT
TT=0.167
T1=0.14
SAT
TT=11.811
T1=6.16
SAT
TT=1.686
T1=1.68
SAT
TT=1.735
T1=1.81
SAT
TT=5.344
T1=2.21
SAT
TT=0.35
T1=0.34
SAT
TT=19.731
T1=19.73
? (problem)
TT=0.022

? (problem)
TT=0.021

SAT
TT=45.379
T1=45.17
SAT
TT=59.62
T1=59.71
SAT
TT=4.831
T1=4.84
No dataNo dataNo dataNo dataSAT
TT=3.314
T1=3.3
No dataNo dataSAT
TT=4.343
T1=1.69
SAT
TT=1.01
T1=0.98
SAT
TT=1.014
T1=0.61
SAT
TT=0.534
T1=0.53
SAT
TT=0.499
T1=0.49
SAT
TT=0.055
T1=0.05
SAT
TT=9.414
T1=9.41
SAT
TT=9.255
T1=9.25
SAT
TT=3.264
T1=3.25
No dataNo dataSAT
TT=3.263
T1=3.26
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110975965.opb
UNSAT
TT=0.117

UNSAT
TT=51.56

UNSAT
TT=1.162

No data? (problem)
TT=0.021

UNSAT
TT=12.054

? (problem)
TT=0.022

UNSAT
TT=11.75

? (problem)
TT=0.02

UNSAT
TT=11.98

? (problem)
TT=0.022

UNSAT
TT=11.76

UNSAT
TT=49.27

UNSAT
TT=212.464

UNSAT
TT=3.213

UNSAT
TT=2.798

UNSAT
TT=6.684

UNSAT
TT=53.656

UNSAT
TT=5.433

UNSAT
TT=1.165

UNSAT
TT=2.655

UNSAT
TT=0.117

UNSAT
TT=38.167

UNSAT
TT=1.702

UNSAT
TT=11.929

UNSAT
TT=35.981

UNSAT
TT=0.87

UNSAT
TT=149.546

? (problem)
TT=0.023

? (problem)
TT=0.021

UNSAT
TT=260.746

UNSAT
TT=263.44

UNSAT
TT=7.263

No dataNo dataNo dataNo dataUNSAT
TT=6.842

No dataNo dataUNSAT
TT=9.195

UNSAT
TT=3.966

UNSAT
TT=5.983

UNSAT
TT=1.302

UNSAT
TT=1.223

UNSAT
TT=1.559

UNSAT
TT=17.272

UNSAT
TT=17.113

UNSAT
TT=6.833

No dataNo dataUNSAT
TT=7.004

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110976935.opb
UNSAT
TT=0.016

UNSAT
TT=24.256

UNSAT
TT=0.463

No data? (problem)
TT=0.021

UNSAT
TT=7.654

? (problem)
TT=0.025

UNSAT
TT=7.46

? (problem)
TT=0.02

UNSAT
TT=7.66

? (problem)
TT=0.02

UNSAT
TT=7.36

UNSAT
TT=30.364

UNSAT
TT=84.133

UNSAT
TT=1.835

UNSAT
TT=2.819

UNSAT
TT=3.553

UNSAT
TT=23.923

UNSAT
TT=3.522

UNSAT
TT=0.018

UNSAT
TT=1.873

UNSAT
TT=0.016

UNSAT
TT=22.951

UNSAT
TT=0.023

UNSAT
TT=7.693

UNSAT
TT=15.652

UNSAT
TT=0.022

UNSAT
TT=63.897

? (problem)
TT=0.024

? (problem)
TT=0.021

UNSAT
TT=268.252

UNSAT
TT=272.685

UNSAT
TT=2.993

No dataNo dataNo dataNo dataUNSAT
TT=2.595

No dataNo dataUNSAT
TT=6.233

UNSAT
TT=1.96

UNSAT
TT=3.374

UNSAT
TT=0.024

UNSAT
TT=0.022

UNSAT
TT=0.028

UNSAT
TT=9.072

UNSAT
TT=8.966

UNSAT
TT=2.443

No dataNo dataUNSAT
TT=2.473

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110977464.opb
SAT
TT=0.044
T1=0.09
SAT
TT=48.631
T1=48.64
SAT
TT=0.643
T1=0.64
No data? (problem)
TT=0.021

SAT
TT=5.778
T1=5.78
? (problem)
TT=0.024

SAT
TT=5.694
T1=5.69
? (problem)
TT=0.021

SAT
TT=5.768
T1=5.77
? (problem)
TT=0.022

SAT
TT=5.785
T1=5.78
SAT
TT=23.552
T1=23.55
SAT
TT=15.032
T1=15.03
SAT
TT=0.114
T1=0.11
SAT
TT=7.605
T1=7.7
SAT
TT=1.524
T1=1.09
SAT
TT=46.772
T1=46.78
SAT
TT=0.914
T1=0.49
SAT
TT=0.873
T1=0.87
SAT
TT=1.923
T1=2.03
SAT
TT=0.044
T1=0.09
SAT
TT=24.21
T1=12.18
SAT
TT=0.584
T1=0.58
SAT
TT=11.081
T1=11.17
SAT
TT=11.273
T1=5.27
SAT
TT=0.379
T1=0.37
SAT
TT=44.026
T1=44.04
? (problem)
TT=0.022

? (problem)
TT=0.021

SAT
TT=244.529
T1=244.72
SAT
TT=193.893
T1=194.01
SAT
TT=3.782
T1=3.79
No dataNo dataNo dataNo dataSAT
TT=3.355
T1=3.35
No dataNo dataSAT
TT=6.442
T1=3.08
SAT
TT=2.504
T1=1.81
SAT
TT=0.496
T1=0.28
SAT
TT=0.55
T1=0.54
SAT
TT=0.591
T1=0.58
SAT
TT=0.474
T1=0.46
SAT
TT=18.289
T1=18.29
SAT
TT=18.019
T1=18.02
SAT
TT=3.352
T1=3.34
No dataNo dataSAT
TT=3.352
T1=3.34
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1110977780.opb
UNSAT
TT=0.014

UNSAT
TT=22.966

UNSAT
TT=0.642

No data? (problem)
TT=0.022

UNSAT
TT=5.624

? (problem)
TT=0.023

UNSAT
TT=5.47

? (problem)
TT=0.021

UNSAT
TT=5.44

? (problem)
TT=0.023

UNSAT
TT=5.46

UNSAT
TT=14.493

UNSAT
TT=267.693

UNSAT
TT=1.435

UNSAT
TT=24.561

UNSAT
TT=2.415

UNSAT
TT=17.712

UNSAT
TT=2.464

UNSAT
TT=0.017

UNSAT
TT=1.474

UNSAT
TT=0.014

UNSAT
TT=6.29

UNSAT
TT=0.022

UNSAT
TT=5.319

UNSAT
TT=6.313

UNSAT
TT=0.022

UNSAT
TT=86.404

? (problem)
TT=0.021

? (problem)
TT=0.022

UNSAT
TT=252.478

UNSAT
TT=268.195

UNSAT
TT=2.073

No dataNo dataNo dataNo dataUNSAT
TT=2.334

No dataNo dataUNSAT
TT=5.614

UNSAT
TT=1.583

UNSAT
TT=2.845

UNSAT
TT=0.024

UNSAT
TT=0.022

UNSAT
TT=0.028

UNSAT
TT=7.828

UNSAT
TT=7.652

UNSAT
TT=2.323

No dataNo dataUNSAT
TT=2.403

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111213868.opb
UNSAT
TT=0.087

UNSAT
TT=35.862

UNSAT
TT=0.593

No data? (problem)
TT=0.023

UNSAT
TT=6.719

? (problem)
TT=0.023

UNSAT
TT=6.57

? (problem)
TT=0.021

UNSAT
TT=6.66

? (problem)
TT=0.02

UNSAT
TT=6.45

UNSAT
TT=33.696

UNSAT
TT=314.145

UNSAT
TT=2.988

UNSAT
TT=13.727

UNSAT
TT=3.736

UNSAT
TT=32.234

UNSAT
TT=3.452

UNSAT
TT=0.339

UNSAT
TT=1.875

UNSAT
TT=0.087

UNSAT
TT=25.659

UNSAT
TT=0.419

UNSAT
TT=8.025

UNSAT
TT=19.042

UNSAT
TT=0.223

UNSAT
TT=87.458

? (problem)
TT=0.021

? (problem)
TT=0.02

UNSAT
TT=269.949

UNSAT
TT=256.434

UNSAT
TT=2.814

No dataNo dataNo dataNo dataUNSAT
TT=3.773

No dataNo dataUNSAT
TT=15.673

UNSAT
TT=2.13

UNSAT
TT=4.633

UNSAT
TT=0.391

UNSAT
TT=0.397

UNSAT
TT=0.47

UNSAT
TT=10.535

UNSAT
TT=10.447

UNSAT
TT=3.762

No dataNo dataUNSAT
TT=3.893

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111216411.opb
UNSAT
TT=0.059

UNSAT
TT=36.208

UNSAT
TT=0.826

No data? (problem)
TT=0.02

UNSAT
TT=6.63

? (problem)
TT=0.021

UNSAT
TT=6.55

? (problem)
TT=0.024

UNSAT
TT=6.36

? (problem)
TT=0.02

UNSAT
TT=6.56

UNSAT
TT=22.445

UNSAT
TT=178.766

UNSAT
TT=1.972

UNSAT
TT=9.09

UNSAT
TT=5.223

UNSAT
TT=36.761

UNSAT
TT=4.222

UNSAT
TT=0.158

UNSAT
TT=2.495

UNSAT
TT=0.059

UNSAT
TT=26.659

UNSAT
TT=0.205

UNSAT
TT=9.798

UNSAT
TT=30.2

UNSAT
TT=0.111

UNSAT
TT=189.256

? (problem)
TT=0.021

? (problem)
TT=0.021

UNSAT
TT=252.262

UNSAT
TT=252.89

UNSAT
TT=3.673

No dataNo dataNo dataNo dataUNSAT
TT=5.142

No dataNo dataUNSAT
TT=6.982

UNSAT
TT=2.964

UNSAT
TT=5.4

UNSAT
TT=0.141

UNSAT
TT=0.145

UNSAT
TT=0.223

UNSAT
TT=14.569

UNSAT
TT=14.423

UNSAT
TT=5.134

No dataNo dataUNSAT
TT=5.221

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111218308.opb
UNSAT
TT=0.112

UNSAT
TT=73.646

UNSAT
TT=1.552

No data? (problem)
TT=0.02

UNSAT
TT=13.828

? (problem)
TT=0.023

UNSAT
TT=13.56

? (problem)
TT=0.024

UNSAT
TT=13.81

? (problem)
TT=0.023

UNSAT
TT=13.87

UNSAT
TT=60.567

UNSAT
TT=229.778

UNSAT
TT=3.677

UNSAT
TT=3.066

UNSAT
TT=9.552

UNSAT
TT=57.276

UNSAT
TT=7.852

UNSAT
TT=1.643

UNSAT
TT=3.092

UNSAT
TT=0.112

UNSAT
TT=53.646

UNSAT
TT=0.848

UNSAT
TT=16.651

UNSAT
TT=46.408

UNSAT
TT=0.436

UNSAT
TT=203.727

? (problem)
TT=0.023

? (problem)
TT=0.02

UNSAT
TT=273.802

UNSAT
TT=284.981

UNSAT
TT=9.8

No dataNo dataNo dataNo dataUNSAT
TT=10.281

No dataNo dataUNSAT
TT=10.397

UNSAT
TT=4.013

UNSAT
TT=5.623

UNSAT
TT=0.441

UNSAT
TT=0.447

UNSAT
TT=0.759

UNSAT
TT=19.236

UNSAT
TT=18.914

UNSAT
TT=10.692

No dataNo dataUNSAT
TT=10.682

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111218955.opb
UNSAT
TT=0.058

UNSAT
TT=19.58

UNSAT
TT=0.47

No data? (problem)
TT=0.022

UNSAT
TT=7.776

? (problem)
TT=0.024

UNSAT
TT=7.86

? (problem)
TT=0.024

UNSAT
TT=7.86

? (problem)
TT=0.021

UNSAT
TT=7.86

UNSAT
TT=19.992

UNSAT
TT=290.285

UNSAT
TT=1.484

UNSAT
TT=13.974

UNSAT
TT=3.065

UNSAT
TT=20.181

UNSAT
TT=2.124

UNSAT
TT=0.17

UNSAT
TT=1.698

UNSAT
TT=0.058

UNSAT
TT=13.873

UNSAT
TT=0.219

UNSAT
TT=5.252

UNSAT
TT=12.413

UNSAT
TT=0.104

UNSAT
TT=121.937

? (problem)
TT=0.024

? (problem)
TT=0.02

UNSAT
TT=259.917

UNSAT
TT=277.682

UNSAT
TT=2.553

No dataNo dataNo dataNo dataUNSAT
TT=2.443

No dataNo dataUNSAT
TT=6.06

UNSAT
TT=1.98

UNSAT
TT=3.625

UNSAT
TT=0.164

UNSAT
TT=0.135

UNSAT
TT=0.159

UNSAT
TT=10.522

UNSAT
TT=10.35

UNSAT
TT=2.423

No dataNo dataUNSAT
TT=2.613

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111219348.opb
UNSAT
TT=0.076

UNSAT
TT=28.838

UNSAT
TT=0.512

No data? (problem)
TT=0.021

UNSAT
TT=6.2

? (problem)
TT=0.023

UNSAT
TT=5.96

? (problem)
TT=0.023

UNSAT
TT=6.16

? (problem)
TT=0.02

UNSAT
TT=6.06

UNSAT
TT=24.376

UNSAT
TT=163.492

UNSAT
TT=2.14

UNSAT
TT=7.342

UNSAT
TT=5.133

UNSAT
TT=32.705

UNSAT
TT=3.265

UNSAT
TT=0.557

UNSAT
TT=1.559

UNSAT
TT=0.076

UNSAT
TT=23.061

UNSAT
TT=0.716

UNSAT
TT=7.497

UNSAT
TT=14.812

UNSAT
TT=0.362

UNSAT
TT=87.039

? (problem)
TT=0.023

? (problem)
TT=0.02

UNSAT
TT=280.045

UNSAT
TT=247.92

UNSAT
TT=2.483

No dataNo dataNo dataNo dataUNSAT
TT=2.513

No dataNo dataUNSAT
TT=7.062

UNSAT
TT=2.213

UNSAT
TT=3.873

UNSAT
TT=0.454

UNSAT
TT=0.409

UNSAT
TT=0.701

UNSAT
TT=9.355

UNSAT
TT=9.261

UNSAT
TT=2.503

No dataNo dataUNSAT
TT=2.633

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111219399.opb
SAT
TT=0.021
T1=0.03
SAT
TT=4.709
T1=4.71
SAT
TT=0.035
T1=0.03
No data? (problem)
TT=0.024

SAT
TT=1.461
T1=1.46
? (problem)
TT=0.021

SAT
TT=1.461
T1=1.46
? (problem)
TT=0.023

SAT
TT=1.455
T1=1.61
? (problem)
TT=0.02

SAT
TT=1.448
T1=1.44
SAT
TT=2.083
T1=2.08
SAT
TT=33.783
T1=33.78
SAT
TT=0.674
T1=0.66
SAT
TT=1.796
T1=1.79
SAT
TT=0.694
T1=0.36
SAT
TT=3.904
T1=3.9
SAT
TT=0.886
T1=0.49
SAT
TT=1.256
T1=1.25
SAT
TT=0.706
T1=0.85
SAT
TT=0.021
T1=0.1
SAT
TT=6.152
T1=3.17
SAT
TT=1.251
T1=1.24
SAT
TT=1.459
T1=1.54
SAT
TT=6.2
T1=2.7
SAT
TT=0.296
T1=0.29
SAT
TT=42.341
T1=42.35
? (problem)
TT=0.023

? (problem)
TT=0.021

SAT
TT=82.384
T1=82.39
SAT
TT=91.06
T1=91.26
SAT
TT=0.823
T1=0.82
No dataNo dataNo dataNo dataSAT
TT=2.313
T1=2.31
No dataNo dataSAT
TT=1.655
T1=0.67
SAT
TT=0.845
T1=0.51
SAT
TT=1.366
T1=0.92
SAT
TT=0.42
T1=0.41
SAT
TT=0.425
T1=0.41
SAT
TT=0.153
T1=0.14
SAT
TT=0.256
T1=0.38
SAT
TT=0.269
T1=0.26
SAT
TT=2.313
T1=2.42
No dataNo dataSAT
TT=2.373
T1=2.37
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111222080.opb
SAT
TT=0.034
T1=0.09
SAT
TT=11.545
T1=11.54
SAT
TT=0.472
T1=0.47
No data? (problem)
TT=0.02

SAT
TT=5.194
T1=5.19
? (problem)
TT=0.02

SAT
TT=5.475
T1=5.47
? (problem)
TT=0.02

SAT
TT=5.175
T1=5.17
? (problem)
TT=0.021

SAT
TT=5.115
T1=5.11
SAT
TT=5.149
T1=5.15
SAT
TT=63.724
T1=63.73
SAT
TT=1.228
T1=1.21
SAT
TT=4.85
T1=4.94
SAT
TT=1.745
T1=1.35
SAT
TT=32.193
T1=32.2
SAT
TT=1.744
T1=1.27
SAT
TT=0.254
T1=0.25
SAT
TT=0.876
T1=0.97
SAT
TT=0.034
T1=0.09
SAT
TT=21.541
T1=13.17
SAT
TT=0.374
T1=0.37
SAT
TT=3.012
T1=3.12
SAT
TT=16.573
T1=7.85
SAT
TT=0.143
T1=0.14
SAT
TT=34.271
T1=34.27
? (problem)
TT=0.022

? (problem)
TT=0.02

SAT
TT=59.803
T1=59.83
SAT
TT=10.558
T1=10.69
SAT
TT=4.452
T1=4.45
No dataNo dataNo dataNo dataSAT
TT=4.832
T1=4.82
No dataNo dataSAT
TT=6.203
T1=2.73
SAT
TT=1.965
T1=1.85
SAT
TT=1.864
T1=1.35
SAT
TT=0.229
T1=0.22
SAT
TT=0.186
T1=0.18
SAT
TT=0.343
T1=0.34
SAT
TT=8.025
T1=8.02
SAT
TT=7.959
T1=7.96
SAT
TT=4.823
T1=4.81
No dataNo dataSAT
TT=4.812
T1=4.8
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111222248.opb
SAT
TT=0.106
T1=0.11
SAT
TT=13.335
T1=13.33
SAT
TT=0.111
T1=0.11
No data? (problem)
TT=0.02

SAT
TT=2.926
T1=2.92
? (problem)
TT=0.025

SAT
TT=3.029
T1=3.02
? (problem)
TT=0.024

SAT
TT=2.874
T1=2.87
? (problem)
TT=0.023

SAT
TT=2.873
T1=2.87
SAT
TT=3.133
T1=3.13
SAT
TT=2.832
T1=2.83
SAT
TT=0.169
T1=0.16
SAT
TT=0.974
T1=1.07
SAT
TT=0.714
T1=0.42
SAT
TT=1.933
T1=1.93
SAT
TT=1.455
T1=0.97
SAT
TT=0.776
T1=0.83
SAT
TT=0.96
T1=1.07
SAT
TT=0.106
T1=0.12
SAT
TT=5.854
T1=3.18
SAT
TT=2.033
T1=2.15
SAT
TT=2.04
T1=2.12
SAT
TT=4.81
T1=2.21
SAT
TT=1.052
T1=1.04
SAT
TT=2.114
T1=2.12
? (problem)
TT=0.022

? (problem)
TT=0.019

SAT
TT=46.319
T1=46.84
SAT
TT=40.73
T1=41.29
SAT
TT=5.473
T1=5.49
No dataNo dataNo dataNo dataSAT
TT=5.192
T1=5.19
No dataNo dataSAT
TT=1.753
T1=0.94
SAT
TT=1.334
T1=0.97
SAT
TT=1.055
T1=0.63
SAT
TT=0.499
T1=0.49
SAT
TT=0.501
T1=0.49
SAT
TT=0.528
T1=0.52
SAT
TT=2.328
T1=2.33
SAT
TT=2.309
T1=2.31
SAT
TT=5.192
T1=5.19
No dataNo dataSAT
TT=5.171
T1=5.19
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111222257.opb
UNSAT
TT=0.086

UNSAT
TT=29.448

UNSAT
TT=0.838

No data? (problem)
TT=0.021

UNSAT
TT=7.035

? (problem)
TT=0.022

UNSAT
TT=6.97

? (problem)
TT=0.025

UNSAT
TT=6.87

? (problem)
TT=0.021

UNSAT
TT=7.06

UNSAT
TT=22.484

UNSAT
TT=166.96

UNSAT
TT=1.688

UNSAT
TT=20.301

UNSAT
TT=3.343

UNSAT
TT=25.357

UNSAT
TT=3.304

UNSAT
TT=0.292

UNSAT
TT=1.706

UNSAT
TT=0.086

UNSAT
TT=21.961

UNSAT
TT=0.271

UNSAT
TT=7.624

UNSAT
TT=22.129

UNSAT
TT=0.164

UNSAT
TT=123.891

? (problem)
TT=0.021

? (problem)
TT=0.024

UNSAT
TT=256.757

UNSAT
TT=261.907

UNSAT
TT=3.352

No dataNo dataNo dataNo dataUNSAT
TT=8.492

No dataNo dataUNSAT
TT=6.53

UNSAT
TT=3.265

UNSAT
TT=4.182

UNSAT
TT=0.234

UNSAT
TT=0.227

UNSAT
TT=0.337

UNSAT
TT=12.479

UNSAT
TT=12.349

UNSAT
TT=4.341

No dataNo dataUNSAT
TT=4.563

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111223220.opb
UNSAT
TT=0.059

UNSAT
TT=32.391

UNSAT
TT=0.807

No data? (problem)
TT=0.021

UNSAT
TT=8.483

? (problem)
TT=0.019

UNSAT
TT=8.56

? (problem)
TT=0.02

UNSAT
TT=8.34

? (problem)
TT=0.021

UNSAT
TT=8.16

UNSAT
TT=28.589

UNSAT
TT=255.007

UNSAT
TT=2.32

UNSAT
TT=14.862

UNSAT
TT=3.833

UNSAT
TT=37.749

UNSAT
TT=3.954

UNSAT
TT=0.152

UNSAT
TT=1.981

UNSAT
TT=0.059

UNSAT
TT=17.821

UNSAT
TT=0.206

UNSAT
TT=7.929

UNSAT
TT=17.022

UNSAT
TT=0.109

UNSAT
TT=85.598

? (problem)
TT=0.022

? (problem)
TT=0.024

UNSAT
TT=251.67

UNSAT
TT=232.332

UNSAT
TT=4.302

No dataNo dataNo dataNo dataUNSAT
TT=3.633

No dataNo dataUNSAT
TT=6.553

UNSAT
TT=2.724

UNSAT
TT=4.214

UNSAT
TT=0.148

UNSAT
TT=0.143

UNSAT
TT=0.211

UNSAT
TT=13.19

UNSAT
TT=13.174

UNSAT
TT=3.622

No dataNo dataUNSAT
TT=3.793

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111223696.opb
SAT
TT=0.037
T1=0.03
SAT
TT=28.054
T1=28.06
SAT
TT=0.656
T1=0.65
No data? (problem)
TT=0.023

SAT
TT=6.667
T1=6.67
? (problem)
TT=0.022

SAT
TT=6.635
T1=6.63
? (problem)
TT=0.024

SAT
TT=6.664
T1=6.67
? (problem)
TT=0.022

SAT
TT=6.674
T1=6.67
SAT
TT=31.972
T1=31.98
SAT
TT=86.502
T1=86.51
SAT
TT=1.181
T1=1.17
SAT
TT=6.992
T1=6.99
SAT
TT=2.254
T1=1.82
SAT
TT=17.868
T1=17.87
SAT
TT=1.263
T1=0.79
SAT
TT=1.241
T1=1.23
SAT
TT=1.679
T1=1.8
SAT
TT=0.039
T1=0.1
SAT
TT=8.623
T1=4.16
SAT
TT=1.082
T1=1.08
SAT
TT=6.298
T1=7
SAT
TT=15.861
T1=7.76
SAT
TT=0.928
T1=0.92
SAT
TT=68.02
T1=68.03
? (problem)
TT=0.02

? (problem)
TT=0.021

SAT
TT=64.377
T1=64.81
SAT
TT=158.204
T1=158.73
SAT
TT=1.554
T1=1.55
No dataNo dataNo dataNo dataSAT
TT=0.493
T1=0.48
No dataNo dataSAT
TT=5.943
T1=2.24
SAT
TT=1.305
T1=0.92
SAT
TT=3.294
T1=2.27
SAT
TT=1.033
T1=1.02
SAT
TT=1.103
T1=1.09
SAT
TT=0.037
T1=0.03
SAT
TT=15.61
T1=15.61
SAT
TT=15.429
T1=15.43
SAT
TT=0.493
T1=0.48
No dataNo dataSAT
TT=0.522
T1=0.51
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111224255.opb
UNSAT
TT=0.085

UNSAT
TT=36.369

UNSAT
TT=0.811

No data? (problem)
TT=0.02

UNSAT
TT=8.197

? (problem)
TT=0.021

UNSAT
TT=8.06

? (problem)
TT=0.023

UNSAT
TT=8.35

? (problem)
TT=0.021

UNSAT
TT=8.26

UNSAT
TT=22.807

UNSAT
TT=199.016

UNSAT
TT=2.029

UNSAT
TT=22.464

UNSAT
TT=3.084

UNSAT
TT=34.526

UNSAT
TT=3.683

UNSAT
TT=0.658

UNSAT
TT=2.163

UNSAT
TT=0.085

UNSAT
TT=20.922

UNSAT
TT=0.63

UNSAT
TT=7.969

UNSAT
TT=19.091

UNSAT
TT=0.336

UNSAT
TT=95.942

? (problem)
TT=0.018

? (problem)
TT=0.023

UNSAT
TT=262.335

UNSAT
TT=259.287

UNSAT
TT=3.592

No dataNo dataNo dataNo dataUNSAT
TT=3.522

No dataNo dataUNSAT
TT=6.343

UNSAT
TT=2.09

UNSAT
TT=4.684

UNSAT
TT=0.437

UNSAT
TT=0.394

UNSAT
TT=0.59

UNSAT
TT=11.308

UNSAT
TT=11.119

UNSAT
TT=3.512

No dataNo dataUNSAT
TT=3.663

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111226680.opb
UNSAT
TT=0.068

UNSAT
TT=38.57

UNSAT
TT=0.5

No data? (problem)
TT=0.022

UNSAT
TT=6.41

? (problem)
TT=0.024

UNSAT
TT=6.594

? (problem)
TT=0.022

UNSAT
TT=6.45

? (problem)
TT=0.019

UNSAT
TT=6.45

UNSAT
TT=22.924

UNSAT
TT=161.662

UNSAT
TT=1.367

UNSAT
TT=6.915

UNSAT
TT=2.994

UNSAT
TT=30.135

UNSAT
TT=2.445

UNSAT
TT=0.172

UNSAT
TT=1.611

UNSAT
TT=0.068

UNSAT
TT=19.131

UNSAT
TT=0.198

UNSAT
TT=7.173

UNSAT
TT=17.061

UNSAT
TT=0.178

UNSAT
TT=122.283

? (problem)
TT=0.022

? (problem)
TT=0.022

UNSAT
TT=243.506

UNSAT
TT=296.078

UNSAT
TT=2.953

No dataNo dataNo dataNo dataUNSAT
TT=3.462

No dataNo dataUNSAT
TT=5.796

UNSAT
TT=1.723

UNSAT
TT=3.913

UNSAT
TT=0.174

UNSAT
TT=0.173

UNSAT
TT=0.344

UNSAT
TT=9.517

UNSAT
TT=9.362

UNSAT
TT=3.323

No dataNo dataUNSAT
TT=3.454

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/namasivayam/wnqueen/
normalized-t2001.13queen13.1111227418.opb
SAT
TT=0.185
T1=0.16
SAT
TT=31.548
T1=31.55
SAT
TT=0.284
T1=0.28
No data? (problem)
TT=0.026

SAT
TT=8.513
T1=8.52
? (problem)
TT=0.02

SAT
TT=8.899
T1=8.9
? (problem)
TT=0.02

SAT
TT=8.724
T1=8.72
? (problem)
TT=0.021

SAT
TT=8.93
T1=8.92
SAT
TT=23.042
T1=23.04
SAT
TT=142.705
T1=142.73
SAT
TT=0.605
T1=0.6
SAT
TT=0.967
T1=1.08
SAT
TT=5.523
T1=5.15
SAT
TT=2.917
T1=2.91
SAT
TT=1.483
T1=0.98
SAT
TT=2.435
T1=2.43
SAT
TT=0.678
T1=0.82
SAT
TT=0.185
T1=0.16
SAT
TT=3.902
T1=2.16
SAT
TT=1.845
T1=1.84
SAT
TT=7.744
T1=7.82
SAT
TT=4.144
T1=1.71
SAT
TT=0.901
T1=0.89
SAT
TT=88.758
T1=88.77
? (problem)
TT=0.024

? (problem)
TT=0.022

SAT
TT=77.273
T1=77.53
SAT
TT=261.571
T1=262.1
SAT
TT=4.692
T1=4.7
No dataNo dataNo dataNo dataSAT
TT=3.541
T1=3.54
No dataNo dataSAT
TT=3.993
T1=1.21
SAT
TT=1.765
T1=1.77
SAT
TT=1.855
T1=1.38
SAT
TT=1.284
T1=1.28
SAT
TT=1.356
T1=1.35
SAT
TT=1.353
T1=1.34
SAT
TT=5.558
T1=5.55
SAT
TT=5.482
T1=5.48
SAT
TT=3.391
T1=3.38
No dataNo dataSAT
TT=3.672
T1=3.67
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army10.14bt.opb
SAT
TT=0.159
T1=0.2
SAT
TT=256.909
T1=256.95
SAT
TT=5.17
T1=5.17
No data? (problem)
TT=0.036

SAT
TT=11.4
T1=11.4
? (problem)
TT=0.035

? (problem)
TT=11.009

? (problem)
TT=0.038

? (problem)
TT=10.58

? (problem)
TT=0.037

? (problem)
TT=10.62

SAT
TT=44.325
T1=44.33
SAT
TT=896.751
T1=896.89
SAT
TT=0.332
T1=0.32
SAT
TT=240.131
T1=240.17
SAT
TT=3.019
T1=2.77
SAT
TT=1318.97
T1=1319.18
SAT
TT=35.901
T1=35.16
SAT
TT=65.055
T1=65.06
SAT
TT=0.94
T1=2.88
SAT
TT=0.159
T1=0.2
SAT
TT=25.679
T1=12.28
SAT
TT=18.882
T1=18.88
SAT
TT=36.772
T1=39.15
SAT
TT=28.091
T1=13.25
SAT
TT=148.964
T1=148.99
SAT
TT=58.936
T1=58.94
? (problem)
TT=0.034

? (problem)
TT=0.041

SAT
TT=255.278
T1=255.53
SAT
TT=59.455
T1=59.5
SAT
TT=255.767
T1=255.8
No dataNo dataNo dataNo dataSAT
TT=263.227
T1=263.25
No dataNo dataSAT
TT=33.123
T1=16.73
SAT
TT=26.486
T1=26.26
SAT
TT=8.786
T1=7.37
SAT
TT=26.743
T1=26.74
SAT
TT=25.993
T1=25.98
SAT
TT=43.75
T1=43.75
SAT
TT=403.936
T1=404
SAT
TT=395.835
T1=395.94
SAT
TT=262.83
T1=262.96
No dataNo dataSAT
TT=259.22
T1=259.36
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army10.14ls.opb
SAT
TT=1.341
T1=1.05
SAT
TT=365.921
T1=365.99
SAT
TT=5.336
T1=5.33
No data? (problem)
TT=0.013

SAT
TT=54.323
T1=54.33
? (problem)
TT=0.013

? (problem)
TT=54.59

? (problem)
TT=0.01

? (problem)
TT=54.13

? (problem)
TT=0.013

? (problem)
TT=55.03

SAT
TT=953.589
T1=953.81
SAT
TT=81.775
T1=81.78
SAT
TT=43.328
T1=43.33
? (TO)
TT=1800.03

SAT
TT=590.23
T1=587.65
?
TT=1798

SAT
TT=259.45
T1=257.52
SAT
TT=80.531
T1=80.53
SAT
TT=1.422
T1=3.56
SAT
TT=14.041
T1=4.94
SAT
TT=784.404
T1=400.97
SAT
TT=280.937
T1=280.98
SAT
TT=50.114
T1=50.73
SAT
TT=97.65
T1=49.75
SAT
TT=733.683
T1=733.79
SAT
TT=12.917
T1=12.91
? (problem)
TT=0.011

? (problem)
TT=0.014

SAT
TT=721.859
T1=722.1
SAT
TT=37.672
T1=38.02
?
TT=1799.84

No dataNo dataNo dataNo data?
TT=1799.58

No dataNo dataSAT
TT=1773.88
T1=889.03
SAT
TT=291.65
T1=290.42
SAT
TT=1.341
T1=1.05
SAT
TT=294.89
T1=294.93
SAT
TT=267.768
T1=267.83
SAT
TT=8.789
T1=8.78
? (TO)
TT=1800.1

? (TO)
TT=1800.1

?
TT=1799.6

No dataNo data?
TT=1799.59

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army11.17bt.opb
SAT
TT=4.114
T1=4.11
?
TT=1798

SAT
TT=4.114
T1=4.11
No data? (problem)
TT=0.04

SAT
TT=37.344
T1=37.35
? (problem)
TT=0.044

? (problem)
TT=38.02

? (problem)
TT=0.043

? (problem)
TT=35.44

? (problem)
TT=0.039

? (problem)
TT=36.33

? (TO)
TT=1800.1

? (TO)
TT=1800.03

SAT
TT=12.145
T1=12.13
SAT
TT=1467.5
T1=1467.85
SAT
TT=12.853
T1=12.29
?
TT=1798

SAT
TT=1014.37
T1=1015.38
SAT
TT=411.581
T1=411.64
SAT
TT=10.931
T1=11.07
? (TO)
TT=1800.3

? (TO)
TT=1800.32

SAT
TT=1355.72
T1=1355.93
SAT
TT=55.591
T1=56.38
SAT
TT=949.02
T1=489.58
SAT
TT=873.918
T1=874.04
? (TO)
TT=1800.02

? (problem)
TT=0.036

? (problem)
TT=0.037

? (TO)
TT=1800.07

SAT
TT=78.206
T1=78.32
SAT
TT=1027.16
T1=1027.4
No dataNo dataNo dataNo data?
TT=1799.97

No dataNo data? (TO)
TT=1800.96

? (TO)
TT=1800.72

SAT
TT=12.241
T1=11.55
?
TT=1796.75

?
TT=1796.74

SAT
TT=102.755
T1=102.76
? (TO)
TT=1800.1

? (TO)
TT=1800.02

?
TT=1799.62

No dataNo data?
TT=1799.87

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army11.17ls.opb
SAT
TT=1.788
T1=1.81
SAT
TT=7.851
T1=7.85
SAT
TT=10.087
T1=10.09
No data? (problem)
TT=0.014

? (TO)
TT=1800.11

? (problem)
TT=0.016

? (TO)
TT=1800.09

? (problem)
TT=0.016

? (TO)
TT=1800.07

? (problem)
TT=0.016

? (TO)
TT=1800.07

? (TO)
TT=1800.1

? (TO)
TT=1800.03

SAT
TT=23.095
T1=23.08
? (TO)
TT=1800.05

? (TO)
TT=1800.02

SAT
TT=74.567
T1=74.58
SAT
TT=1774.57
T1=1769.09
SAT
TT=167.018
T1=167
SAT
TT=1.788
T1=1.81
SAT
TT=37.699
T1=11.88
SAT
TT=522.625
T1=266.68
SAT
TT=1730.3
T1=1730.56
SAT
TT=51.837
T1=51.79
SAT
TT=517.297
T1=267.58
?
TT=1796.74

? (TO)
TT=1800.03

? (problem)
TT=0.015

? (problem)
TT=0.017

? (TO)
TT=1800.1

SAT
TT=123.021
T1=123.78
?
TT=1799.84

No dataNo dataNo dataNo data?
TT=1799.57

No dataNo dataSAT
TT=662.718
T1=334.57
? (TO)
TT=1800.74

SAT
TT=54.996
T1=54.07
?
TT=1796.73

?
TT=1796.71

SAT
TT=116.781
T1=116.79
? (TO)
TT=1800.1

? (TO)
TT=1800.02

?
TT=1799.8

No dataNo data?
TT=1799.57

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army12.21bt.opb
SAT
TT=1373.4
T1=1374.01
?
TT=1798.02

? (TO)
TT=1800.03

No data? (problem)
TT=0.032

? (TO)
TT=1800.13

? (problem)
TT=0.032

? (TO)
TT=1800.08

? (problem)
TT=0.034

? (TO)
TT=1800.09

? (problem)
TT=0.033

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.05

? (TO)
TT=1800.57

?
TT=1798.01

? (TO)
TT=1800.27

? (TO)
TT=1800.16

? (TO)
TT=1800.07

? (TO)
TT=1800.13

? (TO)
TT=1800.62

?
TT=1789.75

? (MO)
TT=1735.23

? (TO)
TT=1800.04

?
TT=1796.73

? (TO)
TT=1800.02

? (problem)
TT=0.026

? (problem)
TT=0.026

? (TO)
TT=1800.05

SAT
TT=1373.4
T1=1374.01
?
TT=1799.94

No dataNo dataNo dataNo data?
TT=1799.6

No dataNo data? (TO)
TT=1800.15

? (TO)
TT=1800.04

? (TO)
TT=1800.04

?
TT=1796.74

?
TT=1796.74

?
TT=1796.74

? (TO)
TT=1800.09

? (TO)
TT=1800.02

?
TT=1799.62

No dataNo data?
TT=1799.6

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army12.21ls.opb
SAT
TT=10.781
T1=10.97
?
TT=1798

? (TO)
TT=1800.03

No data? (problem)
TT=0.02

? (TO)
TT=1800.12

? (problem)
TT=0.021

? (TO)
TT=1800.09

? (problem)
TT=0.018

? (TO)
TT=1800.08

? (problem)
TT=0.019

? (TO)
TT=1800.08

? (TO)
TT=1800.07

? (TO)
TT=1800.02

? (TO)
TT=1800.08

? (TO)
TT=1800.03

? (TO)
TT=1800.05

?
TT=1798.01

? (TO)
TT=1800.07

? (TO)
TT=1800.54

SAT
TT=10.781
T1=10.97
? (TO)
TT=1800.23

? (TO)
TT=1800.68

?
TT=1789.74

? (MO)
TT=1695.94

? (TO)
TT=1800.75

?
TT=1796.74

? (TO)
TT=1800.02

? (problem)
TT=0.018

? (problem)
TT=0.018

? (TO)
TT=1800.06

SAT
TT=533.043
T1=533.06
?
TT=1799.52

No dataNo dataNo dataNo data?
TT=1799.56

No dataNo data? (TO)
TT=1800.16

? (TO)
TT=1800.58

? (TO)
TT=1800.03

?
TT=1796.74

?
TT=1796.73

?
TT=1796.74

? (TO)
TT=1800.12

? (TO)
TT=1800.03

?
TT=1799.58

No dataNo data?
TT=1799.99

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army13.24bt.opb
SAT
TT=23.16
T1=23.16
?
TT=1798.01

SAT
TT=23.16
T1=23.16
No data? (problem)
TT=0.036

? (TO)
TT=1800.09

? (problem)
TT=0.042

? (TO)
TT=1800.09

? (problem)
TT=0.034

? (TO)
TT=1800.08

? (problem)
TT=0.037

? (TO)
TT=1800.09

? (TO)
TT=1800.04

? (TO)
TT=1800.02

SAT
TT=42.062
T1=42.05
? (TO)
TT=1800.05

? (TO)
TT=1800.09

?
TT=1798

? (TO)
TT=1800.23

? (TO)
TT=1800.17

SAT
TT=1652.75
T1=1579.31
? (TO)
TT=1800.19

? (TO)
TT=1800.98

?
TT=1789.75

? (TO)
TT=1800.09

? (TO)
TT=1800.09

?
TT=1796.74

? (TO)
TT=1800.1

? (problem)
TT=0.029

? (problem)
TT=0.033

? (TO)
TT=1800.03

SAT
TT=1527.84
T1=1528.45
?
TT=1799.62

No dataNo dataNo dataNo data?
TT=1799.84

No dataNo data? (TO)
TT=1800.04

? (TO)
TT=1800.07

? (TO)
TT=1800.07

?
TT=1796.75

?
TT=1796.75

?
TT=1796.74

? (TO)
TT=1800.06

? (TO)
TT=1800.06

?
TT=1799.62

No dataNo data? (TO)
TT=1800.36

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army13.24ls.opb
SAT
TT=48.134
T1=48.14
?
TT=1798

SAT
TT=48.134
T1=48.14
No data? (problem)
TT=0.022

? (TO)
TT=1800.12

? (problem)
TT=0.024

? (TO)
TT=1800.09

? (problem)
TT=0.023

? (TO)
TT=1800.07

? (problem)
TT=0.026

? (TO)
TT=1800.09

? (TO)
TT=1800.04

? (TO)
TT=1800.02

? (TO)
TT=1800.03

? (TO)
TT=1800.03

? (TO)
TT=1800.07

?
TT=1798.01

? (TO)
TT=1800.03

? (TO)
TT=1800.4

? (TO)
TT=1800.07

SAT
TT=241.73
T1=75.31
? (TO)
TT=1801.42

?
TT=1789.74

SAT
TT=124.066
T1=123.96
? (TO)
TT=1800.13

?
TT=1796.73

? (TO)
TT=1800.03

? (problem)
TT=0.023

? (problem)
TT=0.026

? (TO)
TT=1800.1

SAT
TT=359.186
T1=359.48
?
TT=1799.98

No dataNo dataNo dataNo data?
TT=1799.58

No dataNo data? (TO)
TT=1800.18

? (TO)
TT=1800.6

? (TO)
TT=1800.08

?
TT=1796.73

?
TT=1796.74

?
TT=1796.74

? (TO)
TT=1800.08

? (TO)
TT=1800.08

?
TT=1799.58

No dataNo data?
TT=1799.58

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army8.9bt.opb
SAT
TT=0.006
T1=0
SAT
TT=2.367
T1=2.36
SAT
TT=0.006
T1=0
No data? (problem)
TT=0.059

SAT
TT=0.208
T1=0.2
? (problem)
TT=0.064

? (problem)
TT=0.166

? (problem)
TT=0.06

? (problem)
TT=0.168

? (problem)
TT=0.063

? (problem)
TT=0.168

SAT
TT=2.937
T1=2.97
SAT
TT=0.106
T1=0.1
SAT
TT=0.047
T1=0.04
SAT
TT=0.567
T1=0.56
SAT
TT=0.72
T1=0.65
SAT
TT=4.287
T1=4.28
SAT
TT=0.744
T1=0.37
SAT
TT=21.54
T1=21.54
SAT
TT=0.707
T1=1.81
SAT
TT=0.098
T1=0.1
SAT
TT=7.045
T1=3.22
SAT
TT=9.481
T1=9.47
SAT
TT=28.421
T1=29.06
SAT
TT=7
T1=2.75
SAT
TT=13.76
T1=13.75
SAT
TT=0.069
T1=0.06
? (problem)
TT=0.061

? (problem)
TT=0.057

SAT
TT=26.383
T1=26.68
SAT
TT=6.217
T1=6.41
SAT
TT=0.623
T1=0.61
No dataNo dataNo dataNo dataSAT
TT=0.564
T1=0.57
No dataNo dataSAT
TT=4.034
T1=1.51
SAT
TT=1.935
T1=1.59
SAT
TT=0.763
T1=0.38
SAT
TT=6.584
T1=6.57
SAT
TT=6.582
T1=6.57
SAT
TT=8.143
T1=8.14
SAT
TT=4.093
T1=4.09
SAT
TT=4.059
T1=4.06
SAT
TT=0.564
T1=0.56
No dataNo dataSAT
TT=0.563
T1=0.56
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army8.9ls.opb
SAT
TT=0.046
T1=0.07
SAT
TT=0.146
T1=0.15
SAT
TT=0.724
T1=0.72
No data? (problem)
TT=0.01

SAT
TT=1.761
T1=1.76
? (problem)
TT=0.007

? (problem)
TT=1.71

? (problem)
TT=0.008

? (problem)
TT=1.74

? (problem)
TT=0.008

? (problem)
TT=1.71

SAT
TT=21.189
T1=21.24
SAT
TT=0.161
T1=0.16
SAT
TT=0.09
T1=0.08
SAT
TT=0.613
T1=0.61
SAT
TT=0.572
T1=0.64
SAT
TT=0.12
T1=0.12
SAT
TT=0.683
T1=0.33
SAT
TT=7.874
T1=7.87
SAT
TT=0.83
T1=2.89
SAT
TT=0.046
T1=0.08
SAT
TT=2.463
T1=1.19
SAT
TT=3.766
T1=3.76
SAT
TT=4.016
T1=9.79
SAT
TT=2.062
T1=0.7
SAT
TT=0.086
T1=0.07
SAT
TT=0.091
T1=0.09
? (problem)
TT=0.011

? (problem)
TT=0.005

SAT
TT=60.859
T1=61.01
SAT
TT=6.064
T1=6.67
SAT
TT=0.363
T1=0.36
No dataNo dataNo dataNo dataSAT
TT=3.322
T1=3.32
No dataNo dataSAT
TT=2.1
T1=1.67
SAT
TT=0.673
T1=0.53
SAT
TT=0.538
T1=0.52
SAT
TT=1.715
T1=1.7
SAT
TT=1.526
T1=1.51
SAT
TT=2.922
T1=2.91
SAT
TT=27.313
T1=27.32
SAT
TT=27.296
T1=27.3
SAT
TT=3.233
T1=3.23
No dataNo dataSAT
TT=3.164
T1=3.16
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army9.12bt.opb
SAT
TT=0.159
T1=0.19
SAT
TT=106.36
T1=106.38
SAT
TT=0.768
T1=0.76
No data? (problem)
TT=0.065

SAT
TT=4.53
T1=4.53
? (problem)
TT=0.069

? (problem)
TT=4.49

? (problem)
TT=0.065

? (problem)
TT=4.5

? (problem)
TT=0.065

? (problem)
TT=4.51

SAT
TT=84.347
T1=84.41
SAT
TT=30.22
T1=30.22
SAT
TT=0.232
T1=0.23
SAT
TT=8.352
T1=8.35
SAT
TT=74.943
T1=74.28
SAT
TT=6.251
T1=6.25
SAT
TT=2.455
T1=1.88
SAT
TT=15.449
T1=15.44
SAT
TT=0.784
T1=1.26
SAT
TT=0.159
T1=0.19
SAT
TT=28.339
T1=13.22
SAT
TT=1178.72
T1=1178.9
SAT
TT=12.187
T1=12.96
SAT
TT=20.236
T1=9.7
SAT
TT=198.596
T1=198.62
SAT
TT=19.73
T1=19.73
? (problem)
TT=0.067

? (problem)
TT=0.063

SAT
TT=121.288
T1=121.43
SAT
TT=43.38
T1=43.76
SAT
TT=7.884
T1=7.88
No dataNo dataNo dataNo dataSAT
TT=42.98
T1=43.04
No dataNo dataSAT
TT=27.711
T1=13.35
SAT
TT=14.12
T1=13.7
SAT
TT=2.414
T1=1.83
SAT
TT=145.594
T1=145.61
SAT
TT=144.364
T1=144.38
SAT
TT=121.294
T1=121.3
SAT
TT=23.998
T1=24
SAT
TT=22.553
T1=22.56
SAT
TT=43.39
T1=43.39
No dataNo dataSAT
TT=43.67
T1=43.71
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/armies/
normalized-army9.12ls.opb
SAT
TT=1.133
T1=1.27
?
TT=1798.02

SAT
TT=1.33
T1=1.32
No data? (problem)
TT=0.009

SAT
TT=136.416
T1=136.44
? (problem)
TT=0.009

? (problem)
TT=134.75

? (problem)
TT=0.009

? (problem)
TT=135.79

? (problem)
TT=0.009

? (problem)
TT=133.44

? (TO)
TT=1800.11

SAT
TT=5.321
T1=5.32
SAT
TT=4.992
T1=4.98
SAT
TT=74.723
T1=74.74
SAT
TT=4.163
T1=3.85
SAT
TT=50.337
T1=50.35
SAT
TT=1335.68
T1=1332.4
SAT
TT=32.917
T1=32.91
SAT
TT=1.133
T1=1.27
SAT
TT=8.076
T1=2.71
SAT
TT=65.083
T1=32.24
SAT
TT=86.694
T1=86.7
SAT
TT=11.368
T1=12.14
SAT
TT=63.193
T1=31.72
SAT
TT=29.465
T1=29.46
SAT
TT=6.377
T1=6.37
? (problem)
TT=0.01

? (problem)
TT=0.01

SAT
TT=918.1
T1=918.24
SAT
TT=35.041
T1=35.25
SAT
TT=196.175
T1=196.19
No dataNo dataNo dataNo data?
TT=1799.62

No dataNo dataSAT
TT=72.327
T1=36.79
SAT
TT=203.22
T1=202.45
SAT
TT=2.144
T1=1.63
SAT
TT=19.447
T1=19.44
SAT
TT=18.045
T1=18.04
SAT
TT=10.811
T1=10.8
SAT
TT=1155.8
T1=1155.99
SAT
TT=1144.24
T1=1144.42
?
TT=1799.97

No dataNo data?
TT=1799.63

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/
robin/normalized-robin10.opb
SAT
TT=0.067
T1=0.06
SAT
TT=24.006
T1=24
SAT
TT=1.043
T1=1.04
No data? (problem)
TT=0.05

? (TO)
TT=1800.05

? (problem)
TT=0.052

? (TO)
TT=1800.03

? (problem)
TT=0.046

? (TO)
TT=1800.03

? (problem)
TT=0.048

? (TO)
TT=1800.03

SAT
TT=9.82
T1=9.82
SAT
TT=0.945
T1=0.94
SAT
TT=0.37
T1=1.44
SAT
TT=1.123
T1=1.2
SAT
TT=1.414
T1=0.77
SAT
TT=0.945
T1=0.94
SAT
TT=1.763
T1=1.13
SAT
TT=24.601
T1=24.59
SAT
TT=0.784
T1=1.13
SAT
TT=5.555
T1=2.87
SAT
TT=5.703
T1=2.33
SAT
TT=15.009
T1=15
SAT
TT=0.699
T1=0.82
SAT
TT=5.507
T1=2.41
SAT
TT=15.027
T1=15.01
SAT
TT=0.448
T1=0.44
? (problem)
TT=0.055

? (problem)
TT=0.051

? (TO)
TT=1800.06

SAT
TT=579.77
T1=578.02
SAT
TT=0.067
T1=0.06
No dataNo dataNo dataNo dataSAT
TT=0.375
T1=0.37
No dataNo dataSAT
TT=3.052
T1=1.4
SAT
TT=1.191
T1=1.26
SAT
TT=1.294
T1=0.68
SAT
TT=16.779
T1=16.76
SAT
TT=32.691
T1=16.38
SAT
TT=19.907
T1=19.89
SAT
TT=1.26
T1=1.25
SAT
TT=1.261
T1=1.26
SAT
TT=0.356
T1=0.35
No dataNo dataSAT
TT=0.355
T1=0.35
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/
robin/normalized-robin12.opb
SAT
TT=1.182
T1=1.67
SAT
TT=92.157
T1=92.15
SAT
TT=1.672
T1=1.67
No data? (problem)
TT=0.104

? (TO)
TT=1800.1

? (problem)
TT=0.103

? (TO)
TT=1800.06

? (problem)
TT=0.099

? (TO)
TT=1800.04

? (problem)
TT=0.098

? (TO)
TT=1800.07

SAT
TT=2.982
T1=3.06
SAT
TT=112.67
T1=112.74
SAT
TT=1.182
T1=2.84
SAT
TT=38.948
T1=39.06
SAT
TT=3.308
T1=5.57
SAT
TT=155.282
T1=155.37
SAT
TT=4.135
T1=3.44
SAT
TT=230.191
T1=230.21
SAT
TT=3.894
T1=9.31
SAT
TT=351.09
T1=105.85
SAT
TT=37.187
T1=18.37
SAT
TT=77.115
T1=77.11
SAT
TT=3.546
T1=13.59
SAT
TT=18.212
T1=8.46
SAT
TT=78.998
T1=78.99
SAT
TT=135.375
T1=135.44
? (problem)
TT=0.112

? (problem)
TT=0.102

? (TO)
TT=1800.03

? (TO)
TT=1800.03

SAT
TT=18.087
T1=18.14
No dataNo dataNo dataNo dataSAT
TT=22.118
T1=22.12
No dataNo dataSAT
TT=14.409
T1=8.22
SAT
TT=11.924
T1=11.24
SAT
TT=2.587
T1=2.16
SAT
TT=210.21
T1=210.21
SAT
TT=212.413
T1=212.42
SAT
TT=107.955
T1=107.95
SAT
TT=45.158
T1=45.19
SAT
TT=45.088
T1=45.11
SAT
TT=21.87
T1=21.91
No dataNo dataSAT
TT=21.865
T1=21.87
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/
robin/normalized-robin14.opb
SAT
TT=9.643
T1=8.57
SAT
TT=1232.91
T1=1233.4
SAT
TT=65.158
T1=65.18
No data? (problem)
TT=0.197

SAT
TT=115.994
T1=116.02
? (problem)
TT=0.19

SAT
TT=108.206
T1=108.21
? (problem)
TT=0.195

SAT
TT=115.907
T1=115.92
? (problem)
TT=0.222

SAT
TT=110.183
T1=110.19
SAT
TT=1388.36
T1=1388.74
SAT
TT=456.218
T1=456.46
SAT
TT=49.832
T1=49.78
? (TO)
TT=1800.03

SAT
TT=469.762
T1=466.86
SAT
TT=1215.88
T1=1216.54
SAT
TT=79.06
T1=78.3
?
TT=1797.24

SAT
TT=161.271
T1=155.86
? (TO)
TT=1800.2

SAT
TT=1208.22
T1=608.44
?
TT=1789.84

SAT
TT=318.726
T1=320.74
SAT
TT=939.341
T1=473.06
SAT
TT=1545.95
T1=1546.14
? (TO)
TT=1800.05

? (problem)
TT=0.199

? (problem)
TT=0.205

? (TO)
TT=1800.02

? (TO)
TT=1800.08

SAT
TT=157.237
T1=157.3
No dataNo dataNo dataNo dataSAT
TT=1008.86
T1=1009.21
No dataNo dataSAT
TT=398.836
T1=207.81
SAT
TT=65.114
T1=64.04
SAT
TT=9.643
T1=8.57
SAT
TT=1674.24
T1=1674.45
SAT
TT=1675.95
T1=1676.19
SAT
TT=680.943
T1=681.03
? (TO)
TT=1800.1

? (TO)
TT=1800.04

SAT
TT=990.67
T1=991.07
No dataNo dataSAT
TT=990.219
T1=990.69
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/
robin/normalized-robin16.opb
SAT
TT=799.922
T1=790.77
?
TT=1798.12

? (TO)
TT=1800.08

No data? (problem)
TT=0.36

? (TO)
TT=1800.09

? (problem)
TT=0.341

? (TO)
TT=1800.1

? (problem)
TT=0.332

? (TO)
TT=1800.07

? (problem)
TT=0.352

? (TO)
TT=1800.06

Signal
TT=823.493

? (TO)
TT=1800.15

SAT
TT=1045
T1=1045.39
? (TO)
TT=1800.1

?
TT=678.65

?
TT=1798.2

? (TO)
TT=1800.01

?
TT=1794.6

? (TO)
TT=1800.07

? (TO)
TT=1800.11

? (TO)
TT=1801.03

?
TT=1789.83

? (TO)
TT=1800.07

? (TO)
TT=1800.03

?
TT=1796.77

? (TO)
TT=1800.09

? (problem)
TT=0.345

? (problem)
TT=0.356

? (TO)
TT=1800.01

? (TO)
TT=1800.05

?
TT=1799.47

No dataNo dataNo dataNo data?
TT=1799.9

No dataNo data? (TO)
TT=1800.18

? (TO)
TT=1800.15

SAT
TT=799.922
T1=790.77
?
TT=1796.79

?
TT=1796.82

?
TT=1796.78

? (TO)
TT=1800.05

? (TO)
TT=1800.11

?
TT=1799.5

No dataNo data?
TT=1799.92

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/
robin/normalized-robin18.opb



?
TT=1798.03

? (TO)
TT=1800.07

No data? (problem)
TT=0.576

? (TO)
TT=1800.03

? (problem)
TT=0.607

? (TO)
TT=1800.01

? (problem)
TT=0.58

? (TO)
TT=1800.05

? (problem)
TT=0.561

? (TO)
TT=1800.02

Signal
TT=664.746

? (TO)
TT=1800.14

? (TO)
TT=1800.04

? (TO)
TT=1800.1

?
TT=657.7

?
TT=1798.44

? (TO)
TT=1800.01

?
TT=1795.61

? (TO)
TT=1800.06

? (TO)
TT=1800.36

? (TO)
TT=1800.4

?
TT=1789.84

? (MO)
TT=1712.2

? (TO)
TT=1800.55

?
TT=1796.87

? (TO)
TT=1800.06

? (problem)
TT=0.608

? (problem)
TT=0.571

? (TO)
TT=1800.09

? (TO)
TT=1800.1

?
TT=1799.61

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo data? (TO)
TT=1802.07

? (TO)
TT=1800.06

? (TO)
TT=1800.07

?
TT=1796.83

?
TT=1796.88

?
TT=1796.96

? (TO)
TT=1800.11

? (TO)
TT=1800.06

?
TT=1799.58

No dataNo data?
TT=1800.02

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/prestwich/
robin/normalized-robin8.opb
SAT
TT=0.026
T1=0.02
SAT
TT=0.159
T1=0.16
SAT
TT=0.026
T1=0.02
No data? (problem)
TT=0.02

SAT
TT=13.01
T1=13.01
? (problem)
TT=0.019

SAT
TT=13.015
T1=13.01
? (problem)
TT=0.018

SAT
TT=12.887
T1=12.88
? (problem)
TT=0.023

SAT
TT=12.983
T1=12.98
SAT
TT=0.067
T1=0.06
SAT
TT=0.278
T1=0.27
SAT
TT=0.074
T1=0.06
SAT
TT=0.059
T1=0.08
SAT
TT=0.788
T1=3.66
SAT
TT=0.13
T1=0.12
SAT
TT=0.782
T1=0.39
SAT
TT=17.996
T1=17.99
SAT
TT=0.932
T1=6.49
SAT
TT=0.324
T1=0.35
SAT
TT=1.916
T1=1.28
SAT
TT=5.544
T1=5.54
SAT
TT=1.665
T1=11.42
SAT
TT=1.818
T1=0.85
SAT
TT=0.145
T1=0.13
SAT
TT=0.137
T1=0.24
? (problem)
TT=0.022

? (problem)
TT=0.022

SAT
TT=202.193
T1=201.55
SAT
TT=94.226
T1=94.02
SAT
TT=0.036
T1=0.03
No dataNo dataNo dataNo dataSAT
TT=0.037
T1=0.03
No dataNo dataSAT
TT=1.03
T1=2.68
SAT
TT=0.698
T1=0.75
SAT
TT=0.698
T1=0.69
SAT
TT=2.019
T1=2.01
SAT
TT=2.116
T1=2.11
SAT
TT=7.772
T1=7.76
SAT
TT=0.048
T1=0.05
SAT
TT=0.046
T1=0.04
SAT
TT=0.036
T1=0.03
No dataNo dataSAT
TT=0.037
T1=0.02
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-101-100.opb
UNSAT
TT=0.19

UNSAT
TT=253.101

? (TO)
TT=1800.08

No data? (problem)
TT=0.046

? (TO)
TT=1800.01

? (problem)
TT=0.046

? (TO)
TT=1800.04

? (problem)
TT=0.044

? (TO)
TT=1800

? (problem)
TT=0.039

? (TO)
TT=1800.1

Signal
TT=1009.69

? (TO)
TT=1800.06

?
TT=437.804

? (TO)
TT=1800.02

?
TT=537.18

UNSAT
TT=16.457

? (TO)
TT=1800.78

UNSAT
TT=0.228

UNSAT
TT=594.366

UNSAT
TT=0.342

UNSAT
TT=16.691

UNSAT
TT=0.19

UNSAT
TT=1.358

UNSAT
TT=17.483

UNSAT
TT=0.227

? (TO)
TT=1800.04

? (problem)
TT=0.038

? (problem)
TT=0.039

? (TO)
TT=1800.02

? (TO)
TT=1800.1

? (TO)
TT=1800.44

No dataNo dataNo dataNo data?
TT=1799.56

No dataNo dataUNSAT
TT=18.491

? (TO)
TT=1800.47

? (TO)
TT=1800.4

UNSAT
TT=0.313

UNSAT
TT=0.283

UNSAT
TT=0.399

? (TO)
TT=1800.08

? (TO)
TT=1800.04

?
TT=1799.44

No dataNo data?
TT=1799.47

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-105-100.opb
UNSAT
TT=0.194

UNSAT
TT=3.768

? (TO)
TT=1800.07

No data? (problem)
TT=0.048

? (TO)
TT=1800.08

? (problem)
TT=0.038

? (TO)
TT=1800.08

? (problem)
TT=0.04

? (TO)
TT=1800.1

? (problem)
TT=0.045

? (TO)
TT=1800.06

Signal
TT=1290.15

? (TO)
TT=1800.11

?
TT=321.188

? (TO)
TT=1800.02

?
TT=428.87

UNSAT
TT=3.104

? (TO)
TT=1800.05

UNSAT
TT=0.244

? (TO)
TT=1800.1

UNSAT
TT=0.357

UNSAT
TT=1.792

UNSAT
TT=0.194

UNSAT
TT=1.386

UNSAT
TT=1.653

UNSAT
TT=0.244

? (TO)
TT=1800.12

? (problem)
TT=0.039

? (problem)
TT=0.047

? (TO)
TT=1800.01

? (TO)
TT=1800.11

?
TT=1799.84

No dataNo dataNo dataNo data?
TT=1799.51

No dataNo dataUNSAT
TT=1.663

? (TO)
TT=1800.37

? (TO)
TT=1800.06

UNSAT
TT=0.53

UNSAT
TT=0.48

UNSAT
TT=0.628

? (TO)
TT=1800.07

? (TO)
TT=1800.07

?
TT=1799.82

No dataNo data?
TT=1799.57

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-11-10.opb
UNSAT
TT=0.003

UNSAT
TT=0.003

UNSAT
TT=157.37

No data? (problem)
TT=0.003

UNSAT
TT=1.433

? (problem)
TT=0.001

UNSAT
TT=1.37

? (problem)
TT=0.003

UNSAT
TT=1.37

? (problem)
TT=0.002

UNSAT
TT=1.37

UNSAT
TT=179.867

UNSAT
TT=29.823

UNSAT
TT=70.38

UNSAT
TT=0.003

UNSAT
TT=226.519

UNSAT
TT=0.003

UNSAT
TT=56.03

UNSAT
TT=0.012

UNSAT
TT=182.899

UNSAT
TT=0.006

UNSAT
TT=0.243

UNSAT
TT=0.017

UNSAT
TT=0.473

UNSAT
TT=0.254

UNSAT
TT=0.019

UNSAT
TT=20.202

? (problem)
TT=0.003

? (problem)
TT=0.003

UNSAT
TT=11.388

UNSAT
TT=2.252

UNSAT
TT=304.807

No dataNo dataNo dataNo dataUNSAT
TT=327.278

No dataNo dataUNSAT
TT=0.264

UNSAT
TT=992.5

UNSAT
TT=23.39

UNSAT
TT=0.019

UNSAT
TT=0.019

UNSAT
TT=0.022

UNSAT
TT=578.336

UNSAT
TT=587.653

UNSAT
TT=295.34

No dataNo dataUNSAT
TT=312.72

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-15-10.opb
UNSAT
TT=0.002

UNSAT
TT=0.004

UNSAT
TT=144.79

No data? (problem)
TT=0.002

UNSAT
TT=2.262

? (problem)
TT=0.002

UNSAT
TT=2.18

? (problem)
TT=0.002

UNSAT
TT=2.18

? (problem)
TT=0.003

UNSAT
TT=2.17

UNSAT
TT=379.212

UNSAT
TT=57.463

UNSAT
TT=67.216

UNSAT
TT=0.002

? (TO)
TT=1800.02

UNSAT
TT=0.003

UNSAT
TT=1641.86

UNSAT
TT=0.014

UNSAT
TT=186.876

UNSAT
TT=0.008

UNSAT
TT=0.214

UNSAT
TT=0.017

UNSAT
TT=0.482

UNSAT
TT=0.225

UNSAT
TT=0.017

UNSAT
TT=50.724

? (problem)
TT=0.002

? (problem)
TT=0.004

UNSAT
TT=26.403

UNSAT
TT=14.396

UNSAT
TT=856.4

No dataNo dataNo dataNo dataUNSAT
TT=948.58

No dataNo dataUNSAT
TT=0.186

UNSAT
TT=1379.24

? (TO)
TT=1800.04

UNSAT
TT=0.02

UNSAT
TT=0.019

UNSAT
TT=0.024

? (TO)
TT=1800.03

? (TO)
TT=1800.03

UNSAT
TT=846.12

No dataNo dataUNSAT
TT=826.22

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-21-20.opb
UNSAT
TT=0.005

UNSAT
TT=0.015

? (TO)
TT=1800.03

No data? (problem)
TT=0.004

? (TO)
TT=1800.09

? (problem)
TT=0.005

? (TO)
TT=1800.09

? (problem)
TT=0.004

? (TO)
TT=1800.09

? (problem)
TT=0.002

? (TO)
TT=1800.1

? (TO)
TT=1800.1

? (TO)
TT=1800.02

? (TO)
TT=1800.13

UNSAT
TT=0.005

? (TO)
TT=1800.02

UNSAT
TT=0.013

? (TO)
TT=1800.71

UNSAT
TT=0.016

UNSAT
TT=592.227

UNSAT
TT=0.011

UNSAT
TT=0.447

UNSAT
TT=0.02

UNSAT
TT=0.469

UNSAT
TT=0.446

UNSAT
TT=0.021

? (TO)
TT=1800.02

? (problem)
TT=0.004

? (problem)
TT=0.004

? (TO)
TT=1800.09

? (TO)
TT=1800.03

?
TT=1799.62

No dataNo dataNo dataNo data?
TT=1800.02

No dataNo dataUNSAT
TT=0.443

? (TO)
TT=1800.03

? (TO)
TT=1800.07

UNSAT
TT=0.025

UNSAT
TT=0.024

UNSAT
TT=0.03

? (TO)
TT=1800.03

? (TO)
TT=1800.02

?
TT=1799.7

No dataNo data?
TT=1800.03

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-25-20.opb
UNSAT
TT=0.008

UNSAT
TT=0.017

? (TO)
TT=1800.02

No data? (problem)
TT=0.004

? (TO)
TT=1800.13

? (problem)
TT=0.004

? (TO)
TT=1800.08

? (problem)
TT=0.004

? (TO)
TT=1800.09

? (problem)
TT=0.003

? (TO)
TT=1800.09

? (TO)
TT=1800.05

? (TO)
TT=1800.02

?
TT=27.351

UNSAT
TT=0.008

? (TO)
TT=1800.08

UNSAT
TT=0.015

? (TO)
TT=1800.1

UNSAT
TT=0.019

UNSAT
TT=690.231

UNSAT
TT=0.013

UNSAT
TT=0.282

UNSAT
TT=0.019

UNSAT
TT=0.458

UNSAT
TT=0.314

UNSAT
TT=0.022

? (TO)
TT=1800.02

? (problem)
TT=0.003

? (problem)
TT=0.003

? (TO)
TT=1800.07

? (TO)
TT=1800.07

?
TT=1799.92

No dataNo dataNo dataNo data?
TT=1799.89

No dataNo dataUNSAT
TT=0.334

? (TO)
TT=1800.02

? (TO)
TT=1800.37

UNSAT
TT=0.025

UNSAT
TT=0.024

UNSAT
TT=0.031

? (TO)
TT=1800.1

? (TO)
TT=1800.03

?
TT=1799.63

No dataNo data?
TT=1799.63

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-31-30.opb
UNSAT
TT=0.019

UNSAT
TT=0.052

? (TO)
TT=1800.02

No data? (problem)
TT=0.007

? (TO)
TT=1800.13

? (problem)
TT=0.007

? (TO)
TT=1800

? (problem)
TT=0.004

? (TO)
TT=1800.1

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (TO)
TT=1800.07

? (TO)
TT=1800.09

? (TO)
TT=1800.03

UNSAT
TT=0.019

? (TO)
TT=1800.08

UNSAT
TT=0.042

? (TO)
TT=1800.06

UNSAT
TT=0.024

UNSAT
TT=591.991

UNSAT
TT=0.022

UNSAT
TT=1.093

UNSAT
TT=0.025

UNSAT
TT=0.503

UNSAT
TT=0.973

UNSAT
TT=0.029

? (TO)
TT=1800.09

? (problem)
TT=0.005

? (problem)
TT=0.004

? (TO)
TT=1800.1

? (TO)
TT=1800.1

?
TT=1799.61

No dataNo dataNo dataNo data?
TT=1799.66

No dataNo dataUNSAT
TT=1.013

? (TO)
TT=1800.03

? (TO)
TT=1800.08

UNSAT
TT=0.034

UNSAT
TT=0.034

UNSAT
TT=0.044

? (TO)
TT=1800.09

? (TO)
TT=1800.05

?
TT=1799.63

No dataNo data?
TT=1799.66

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-35-30.opb
UNSAT
TT=0.023

UNSAT
TT=0.059

? (TO)
TT=1800.12

No data? (problem)
TT=0.007

? (TO)
TT=1800.1

? (problem)
TT=0.005

? (TO)
TT=1800.1

? (problem)
TT=0.006

? (TO)
TT=1800.1

? (problem)
TT=0.004

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.1

? (TO)
TT=1800.11

UNSAT
TT=0.027

? (TO)
TT=1800.47

UNSAT
TT=0.051

? (TO)
TT=1800.54

UNSAT
TT=0.028

UNSAT
TT=590.901

UNSAT
TT=0.023

UNSAT
TT=0.515

UNSAT
TT=0.03

UNSAT
TT=0.52

UNSAT
TT=0.513

UNSAT
TT=0.034

? (TO)
TT=1800.08

? (problem)
TT=0.006

? (problem)
TT=0.006

? (TO)
TT=1800.1

? (TO)
TT=1800.12

?
TT=1799.96

No dataNo dataNo dataNo data?
TT=1799.63

No dataNo dataUNSAT
TT=0.525

? (TO)
TT=1800.01

? (TO)
TT=1800.53

UNSAT
TT=0.037

UNSAT
TT=0.036

UNSAT
TT=0.047

? (TO)
TT=1800.09

? (TO)
TT=1800.11

?
TT=1799.63

No dataNo data?
TT=1799.96

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-41-40.opb
UNSAT
TT=0.037

UNSAT
TT=0.147

? (TO)
TT=1800.02

No data? (problem)
TT=0.01

? (TO)
TT=1800.06

? (problem)
TT=0.008

? (TO)
TT=1800.08

? (problem)
TT=0.008

? (TO)
TT=1800.08

? (problem)
TT=0.008

? (TO)
TT=1800.08

? (TO)
TT=1800.1

? (TO)
TT=1800.1

? (TO)
TT=1800.07

UNSAT
TT=0.057

? (TO)
TT=1800.53

UNSAT
TT=0.115

? (TO)
TT=1800.03

UNSAT
TT=0.037

UNSAT
TT=591.757

UNSAT
TT=0.037

UNSAT
TT=1.454

UNSAT
TT=0.039

UNSAT
TT=0.553

UNSAT
TT=1.403

UNSAT
TT=0.041

? (TO)
TT=1800.07

? (problem)
TT=0.008

? (problem)
TT=0.01

? (TO)
TT=1800.08

? (TO)
TT=1800.1

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo dataUNSAT
TT=1.385

? (TO)
TT=1800.08

? (TO)
TT=1800.07

UNSAT
TT=0.047

UNSAT
TT=0.05

UNSAT
TT=0.061

? (TO)
TT=1800.09

? (TO)
TT=1800.1

?
TT=1799.88

No dataNo data?
TT=1799.52

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-45-40.opb
UNSAT
TT=0.039

UNSAT
TT=0.207

? (TO)
TT=1800.1

No data? (problem)
TT=0.011

? (TO)
TT=1800.05

? (problem)
TT=0.01

? (TO)
TT=1800.06

? (problem)
TT=0.011

? (TO)
TT=1800.07

? (problem)
TT=0.007

? (TO)
TT=1800.07

? (TO)
TT=1800.1

? (TO)
TT=1800.05

? (TO)
TT=1800.04

UNSAT
TT=0.067

? (TO)
TT=1800.08

UNSAT
TT=0.151

? (TO)
TT=1800.04

UNSAT
TT=0.04

UNSAT
TT=609.345

UNSAT
TT=0.042

UNSAT
TT=0.674

UNSAT
TT=0.039

UNSAT
TT=0.519

UNSAT
TT=0.894

UNSAT
TT=0.043

? (TO)
TT=1800.07

? (problem)
TT=0.008

? (problem)
TT=0.011

? (TO)
TT=1800.1

? (TO)
TT=1800.02

?
TT=1799.56

No dataNo dataNo dataNo data?
TT=1799.54

No dataNo dataUNSAT
TT=0.635

? (TO)
TT=1800.08

? (TO)
TT=1800.65

UNSAT
TT=0.052

UNSAT
TT=0.05

UNSAT
TT=0.067

? (TO)
TT=1800.09

? (TO)
TT=1800.05

?
TT=1799.56

No dataNo data?
TT=1799.56

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-51-50.opb
UNSAT
TT=0.05

UNSAT
TT=0.375

? (TO)
TT=1800.01

No data? (problem)
TT=0.012

? (TO)
TT=1800.07

? (problem)
TT=0.014

? (TO)
TT=1800.08

? (problem)
TT=0.013

? (TO)
TT=1800.04

? (problem)
TT=0.014

? (TO)
TT=1800.07

? (TO)
TT=1800.11

? (TO)
TT=1800.06

? (TO)
TT=1800.05

UNSAT
TT=0.129

? (TO)
TT=1800

UNSAT
TT=0.292

? (TO)
TT=1800.07

UNSAT
TT=0.051

UNSAT
TT=589.715

UNSAT
TT=0.062

UNSAT
TT=2.103

UNSAT
TT=0.05

UNSAT
TT=0.576

UNSAT
TT=2.004

UNSAT
TT=0.052

? (TO)
TT=1800.11

? (problem)
TT=0.011

? (problem)
TT=0.012

? (TO)
TT=1800.06

? (TO)
TT=1800.05

?
TT=1799.8

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo dataUNSAT
TT=2.134

? (TO)
TT=1800.07

? (TO)
TT=1800.04

UNSAT
TT=0.07

UNSAT
TT=0.065

UNSAT
TT=0.089

? (TO)
TT=1800.09

? (TO)
TT=1800.07

?
TT=1799.6

No dataNo data?
TT=1799.91

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-55-50.opb
UNSAT
TT=0.05

UNSAT
TT=3.358

? (TO)
TT=1800.11

No data? (problem)
TT=0.014

? (TO)
TT=1800.07

? (problem)
TT=0.013

? (TO)
TT=1800.01

? (problem)
TT=0.013

? (TO)
TT=1800.09

? (problem)
TT=0.013

? (TO)
TT=1800.01

? (TO)
TT=1800.07

? (TO)
TT=1800.06

? (TO)
TT=1800.12

UNSAT
TT=0.226

? (TO)
TT=1800.04

UNSAT
TT=2.92

? (TO)
TT=1800.01

UNSAT
TT=0.058

UNSAT
TT=631.128

UNSAT
TT=0.067

UNSAT
TT=1.033

UNSAT
TT=0.05

UNSAT
TT=0.595

UNSAT
TT=1.055

UNSAT
TT=0.054

? (TO)
TT=1800.09

? (problem)
TT=0.012

? (problem)
TT=0.014

? (TO)
TT=1800.07

? (TO)
TT=1800.08

?
TT=1799.51

No dataNo dataNo dataNo data?
TT=1799.43

No dataNo dataUNSAT
TT=1.043

? (TO)
TT=1800.78

? (TO)
TT=1800.09

UNSAT
TT=0.071

UNSAT
TT=0.068

UNSAT
TT=0.093

? (TO)
TT=1800.07

? (TO)
TT=1800.09

?
TT=1799.54

No dataNo data?
TT=1799.78

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-61-60.opb
UNSAT
TT=0.068

UNSAT
TT=0.499

? (TO)
TT=1800.08

No data? (problem)
TT=0.016

? (TO)
TT=1800.07

? (problem)
TT=0.015

? (TO)
TT=1800.07

? (problem)
TT=0.016

? (TO)
TT=1800.05

? (problem)
TT=0.016

? (TO)
TT=1800.04

? (TO)
TT=1800.25

? (TO)
TT=1800.04

? (TO)
TT=1800.1

UNSAT
TT=0.283

?
TT=1078.49

UNSAT
TT=0.375

? (TO)
TT=1800.01

UNSAT
TT=0.077

UNSAT
TT=641.949

UNSAT
TT=0.098

UNSAT
TT=2.774

UNSAT
TT=0.068

UNSAT
TT=0.671

UNSAT
TT=2.715

UNSAT
TT=0.074

? (TO)
TT=1800.07

? (problem)
TT=0.017

? (problem)
TT=0.016

? (TO)
TT=1800.07

? (TO)
TT=1800.1

?
TT=1799.92

No dataNo dataNo dataNo data?
TT=1799.73

No dataNo dataUNSAT
TT=2.87

? (TO)
TT=1800.81

? (TO)
TT=1800.04

UNSAT
TT=0.097

UNSAT
TT=0.101

UNSAT
TT=0.125

? (TO)
TT=1800.06

? (TO)
TT=1800.05

?
TT=1799.94

No dataNo data?
TT=1799.72

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-65-60.opb
UNSAT
TT=0.07

UNSAT
TT=0.963

? (TO)
TT=1800.07

No data? (problem)
TT=0.018

? (TO)
TT=1800.12

? (problem)
TT=0.016

? (TO)
TT=1800.04

? (problem)
TT=0.018

? (TO)
TT=1800.03

? (problem)
TT=0.014

? (TO)
TT=1807.55

? (TO)
TT=1800.17

? (TO)
TT=1800.06

? (TO)
TT=1800.04

UNSAT
TT=1.131

?
TT=1221.17

UNSAT
TT=0.671

? (TO)
TT=1800

UNSAT
TT=0.08

UNSAT
TT=593.743

UNSAT
TT=0.103

UNSAT
TT=1.113

UNSAT
TT=0.07

UNSAT
TT=0.681

UNSAT
TT=1.183

UNSAT
TT=0.07

? (TO)
TT=1800.09

? (problem)
TT=0.014

? (problem)
TT=0.017

? (TO)
TT=1800

? (TO)
TT=1800.01

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.44

No dataNo dataUNSAT
TT=1.124

? (TO)
TT=1800.1

? (TO)
TT=1800.82

UNSAT
TT=0.099

UNSAT
TT=0.093

UNSAT
TT=0.13

? (TO)
TT=1800.05

? (TO)
TT=1800.05

?
TT=1799.44

No dataNo data?
TT=1799.52

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-71-70.opb
UNSAT
TT=0.093

UNSAT
TT=1.889

? (TO)
TT=1800.06

No data? (problem)
TT=0.023

? (TO)
TT=1800.07

? (problem)
TT=0.02

? (TO)
TT=1800.02

? (problem)
TT=0.02

? (TO)
TT=1800.02

? (problem)
TT=0.022

? (TO)
TT=1800.05

? (TO)
TT=1800.15

? (TO)
TT=1800.05

? (TO)
TT=1800.12

UNSAT
TT=54.024

?
TT=861.48

UNSAT
TT=0.754

? (TO)
TT=1800.03

UNSAT
TT=0.105

UNSAT
TT=628.94

UNSAT
TT=0.145

UNSAT
TT=4.332

UNSAT
TT=0.093

UNSAT
TT=0.761

UNSAT
TT=4.543

UNSAT
TT=0.102

? (TO)
TT=1800.05

? (problem)
TT=0.02

? (problem)
TT=0.023

? (TO)
TT=1800.08

? (TO)
TT=1800.1

?
TT=1799.55

No dataNo dataNo dataNo data?
TT=1799.56

No dataNo dataUNSAT
TT=4.583

? (TO)
TT=1800.73

? (TO)
TT=1800.04

UNSAT
TT=0.144

UNSAT
TT=0.137

UNSAT
TT=0.185

? (TO)
TT=1800.02

? (TO)
TT=1800.05

?
TT=1799.51

No dataNo data?
TT=1799.87

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-75-70.opb
UNSAT
TT=0.093

UNSAT
TT=4.752

? (TO)
TT=1800.05

No data? (problem)
TT=0.022

? (TO)
TT=1800.14

? (problem)
TT=0.021

? (TO)
TT=1800.03

? (problem)
TT=0.023

? (TO)
TT=1800.1

? (problem)
TT=0.019

? (TO)
TT=1800.08

Signal
TT=1707.45

? (TO)
TT=1800.06

?
TT=1320.25

? (TO)
TT=1800.11

?
TT=606.15

UNSAT
TT=3.818

? (TO)
TT=1800.74

UNSAT
TT=0.101

UNSAT
TT=599.518

UNSAT
TT=0.151

UNSAT
TT=1.595

UNSAT
TT=0.093

UNSAT
TT=0.758

UNSAT
TT=1.416

UNSAT
TT=0.104

? (TO)
TT=1800.11

? (problem)
TT=0.023

? (problem)
TT=0.02

? (TO)
TT=1800.07

? (TO)
TT=1800.06

?
TT=1799.95

No dataNo dataNo dataNo data?
TT=1799.9

No dataNo dataUNSAT
TT=1.425

? (TO)
TT=1800.08

? (TO)
TT=1800.06

UNSAT
TT=0.182

UNSAT
TT=0.175

UNSAT
TT=0.229

? (TO)
TT=1800.03

? (TO)
TT=1800.04

?
TT=1799.45

No dataNo data?
TT=1799.92

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-81-80.opb
UNSAT
TT=0.117

?
TT=1798.26

? (TO)
TT=1800.05

No data? (problem)
TT=0.03

? (TO)
TT=1800.09

? (problem)
TT=0.027

? (TO)
TT=1800.02

? (problem)
TT=0.026

? (TO)
TT=1800.08

? (problem)
TT=0.026

? (TO)
TT=1800.05

Signal
TT=1112.81

? (TO)
TT=1800.08

? (TO)
TT=1800.07

? (TO)
TT=1800.1

?
TT=514.597

? (TO)
TT=1800.07

? (TO)
TT=1800.01

UNSAT
TT=0.127

UNSAT
TT=593.416

UNSAT
TT=0.202

UNSAT
TT=6.782

UNSAT
TT=0.117

UNSAT
TT=0.911

UNSAT
TT=7.155

UNSAT
TT=0.126

? (TO)
TT=1800.02

? (problem)
TT=0.026

? (problem)
TT=0.023

? (TO)
TT=1800.04

? (TO)
TT=1800.02

?
TT=1799.8

No dataNo dataNo dataNo data?
TT=1799.85

No dataNo dataUNSAT
TT=7.065

? (TO)
TT=1800.95

? (TO)
TT=1800.03

UNSAT
TT=0.2

UNSAT
TT=0.188

UNSAT
TT=0.253

? (TO)
TT=1800.11

? (TO)
TT=1800.02

?
TT=1799.75

No dataNo data?
TT=1799.53

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-85-80.opb
UNSAT
TT=0.12

UNSAT
TT=1.274

? (TO)
TT=1800.05

No data? (problem)
TT=0.033

? (TO)
TT=1800.02

? (problem)
TT=0.028

? (TO)
TT=1800.07

? (problem)
TT=0.026

? (TO)
TT=1800.1

? (problem)
TT=0.027

? (TO)
TT=1800.04

Signal
TT=851.54

? (TO)
TT=1800.04

?
TT=8.319

? (TO)
TT=1800.1

?
TT=460.283

UNSAT
TT=1.046

? (TO)
TT=1800.08

UNSAT
TT=0.134

? (TO)
TT=1800.04

UNSAT
TT=0.21

UNSAT
TT=1.674

UNSAT
TT=0.12

UNSAT
TT=0.925

UNSAT
TT=1.545

UNSAT
TT=0.123

? (TO)
TT=1800.09

? (problem)
TT=0.025

? (problem)
TT=0.027

? (TO)
TT=1800.04

? (TO)
TT=1800.06

?
TT=1799.53

No dataNo dataNo dataNo data?
TT=1799.55

No dataNo dataUNSAT
TT=1.567

? (TO)
TT=1800.07

? (TO)
TT=1800.79

UNSAT
TT=0.169

UNSAT
TT=0.158

UNSAT
TT=0.228

? (TO)
TT=1800.05

? (TO)
TT=1800.1

?
TT=1799.54

No dataNo data?
TT=1799.44

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-91-90.opb
UNSAT
TT=0.16

UNSAT
TT=2.994

? (TO)
TT=1800.07

No data? (problem)
TT=0.036

? (TO)
TT=1800.08

? (problem)
TT=0.033

? (TO)
TT=1800.03

? (problem)
TT=0.033

? (TO)
TT=1800.07

? (problem)
TT=0.035

? (TO)
TT=1800.02

Signal
TT=917.405

? (TO)
TT=1800.02

? (TO)
TT=1800.1

? (TO)
TT=1800.11

?
TT=479.48

UNSAT
TT=2.393

? (TO)
TT=1800.07

UNSAT
TT=0.178

? (TO)
TT=1800.1

UNSAT
TT=0.265

UNSAT
TT=11.071

UNSAT
TT=0.16

UNSAT
TT=1.072

UNSAT
TT=11.411

UNSAT
TT=0.188

? (TO)
TT=1800.07

? (problem)
TT=0.029

? (problem)
TT=0.032

? (TO)
TT=1800.01

? (TO)
TT=1800.09

?
TT=1799.54

No dataNo dataNo dataNo data?
TT=1799.83

No dataNo dataUNSAT
TT=11.694

? (TO)
TT=1800.05

? (TO)
TT=1800.01

UNSAT
TT=0.258

UNSAT
TT=0.239

UNSAT
TT=0.331

? (TO)
TT=1800.09

? (TO)
TT=1800.04

?
TT=1799.59

No dataNo data?
TT=1799.55

normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/roussel/
normalized-pigeon-cardinality-95-90.opb
UNSAT
TT=0.157

UNSAT
TT=2.274

? (TO)
TT=1800.07

No data? (problem)
TT=0.037

? (TO)
TT=1800.08

? (problem)
TT=0.033

? (TO)
TT=1800.02

? (problem)
TT=0.03

? (TO)
TT=1800

? (problem)
TT=0.037

? (TO)
TT=1800.02

Signal
TT=1651.41

? (TO)
TT=1800.08

? (TO)
TT=1800.12

? (TO)
TT=1800.02

?
TT=545.97

UNSAT
TT=1.698

? (TO)
TT=1800.26

UNSAT
TT=0.206

? (TO)
TT=1800.04

UNSAT
TT=0.276

UNSAT
TT=1.704

UNSAT
TT=0.157

UNSAT
TT=1.122

UNSAT
TT=1.683

UNSAT
TT=0.176

? (TO)
TT=1800.06

? (problem)
TT=0.032

? (problem)
TT=0.033

? (TO)
TT=1800.06

? (TO)
TT=1800.06

?
TT=1799.5

No dataNo dataNo dataNo data?
TT=1799.88

No dataNo dataUNSAT
TT=1.656

? (TO)
TT=1800.1

? (TO)
TT=1800.38

UNSAT
TT=0.242

UNSAT
TT=0.223

UNSAT
TT=0.317

? (TO)
TT=1800.05

? (TO)
TT=1800.03

?
TT=1799.9

No dataNo data?
TT=1799.83

normalized-PB06/SATUNSAT-SMALLINT/
web/
uclid_pb_benchmarks/normalized-22s.smv.opb
UNSAT
TT=0.07

UNSAT
TT=0.456

UNSAT
TT=0.07

No data? (problem)
TT=1.403

UNSAT
TT=0.411

? (problem)
TT=1.416

UNSAT
TT=0.377

? (problem)
TT=1.498

UNSAT
TT=0.378

? (problem)
TT=1.394

UNSAT
TT=0.378

UNSAT
TT=0.403

UNSAT
TT=0.637

UNSAT
TT=0.823

UNSAT
TT=0.341

UNSAT
TT=1.484

UNSAT
TT=0.489

UNSAT
TT=1.225

UNSAT
TT=190.281

UNSAT
TT=0.702

UNSAT
TT=1.243

UNSAT
TT=2.004

UNSAT
TT=436.429

UNSAT
TT=0.919

UNSAT
TT=1.905

UNSAT
TT=100.083

UNSAT
TT=0.175

? (problem)
TT=0.086

? (problem)
TT=0.092

UNSAT
TT=253.254

UNSAT
TT=235.227

UNSAT
TT=0.085

No dataNo dataNo dataNo dataUNSAT
TT=0.084

No dataNo dataUNSAT
TT=2.093

UNSAT
TT=1.344

UNSAT
TT=1.192

UNSAT
TT=281.438

UNSAT
TT=625.201

UNSAT
TT=9.97

UNSAT
TT=0.554

UNSAT
TT=0.562

UNSAT
TT=0.087

No dataNo dataUNSAT
TT=0.084

normalized-PB06/SATUNSAT-SMALLINT/
web/
uclid_pb_benchmarks/normalized-25s.smv.opb
UNSAT
TT=0.032

UNSAT
TT=0.214

UNSAT
TT=0.032

No data? (problem)
TT=1.132

UNSAT
TT=0.398

? (problem)
TT=1.138

UNSAT
TT=0.36

? (problem)
TT=1.185

UNSAT
TT=0.346

? (problem)
TT=1.147

UNSAT
TT=0.344

UNSAT
TT=0.201

UNSAT
TT=0.475

UNSAT
TT=0.694

UNSAT
TT=0.23

UNSAT
TT=1.603

UNSAT
TT=0.217

UNSAT
TT=1.145

UNSAT
TT=423.879

UNSAT
TT=0.649

UNSAT
TT=0.858

UNSAT
TT=1.893

UNSAT
TT=1.421

UNSAT
TT=0.72

UNSAT
TT=1.794

UNSAT
TT=46.128

UNSAT
TT=0.116

? (problem)
TT=0.078

? (problem)
TT=0.076

UNSAT
TT=250.181

UNSAT
TT=227.789

UNSAT
TT=0.067

No dataNo dataNo dataNo dataUNSAT
TT=0.067

No dataNo dataUNSAT
TT=2.103

UNSAT
TT=1.204

UNSAT
TT=1.153

UNSAT
TT=47.379

UNSAT
TT=44.897

UNSAT
TT=5.054

UNSAT
TT=0.339

UNSAT
TT=0.339

UNSAT
TT=0.066

No dataNo dataUNSAT
TT=0.065

normalized-PB06/SATUNSAT-SMALLINT/
web/
uclid_pb_benchmarks/normalized-37s.smv.opb
UNSAT
TT=0.008

UNSAT
TT=0.035

UNSAT
TT=0.009

No data? (problem)
TT=0.324

UNSAT
TT=0.111

? (problem)
TT=0.343

UNSAT
TT=0.101

? (problem)
TT=0.328

UNSAT
TT=0.095

? (problem)
TT=0.325

UNSAT
TT=0.098

UNSAT
TT=0.036

UNSAT
TT=0.066

UNSAT
TT=0.152

UNSAT
TT=0.035

UNSAT
TT=1.393

UNSAT
TT=0.034

UNSAT
TT=0.704

UNSAT
TT=23.231

UNSAT
TT=0.575

UNSAT
TT=1.887

UNSAT
TT=0.953

UNSAT
TT=0.315

UNSAT
TT=0.512

UNSAT
TT=0.903

UNSAT
TT=11.862

UNSAT
TT=0.015

? (problem)
TT=0.311

? (problem)
TT=0.313

UNSAT
TT=20.162

UNSAT
TT=17.111

UNSAT
TT=0.01

No dataNo dataNo dataNo dataUNSAT
TT=0.009

No dataNo dataUNSAT
TT=1.045

UNSAT
TT=0.744

UNSAT
TT=0.733

UNSAT
TT=0.317

UNSAT
TT=0.269

UNSAT
TT=6.035

UNSAT
TT=0.253

UNSAT
TT=0.253

UNSAT
TT=0.008

No dataNo dataUNSAT
TT=0.009

normalized-PB06/SATUNSAT-SMALLINT/
web/
uclid_pb_benchmarks/normalized-44s.smv.opb
UNSAT
TT=0.004

UNSAT
TT=0.013

UNSAT
TT=0.009

No data? (problem)
TT=1.67

UNSAT
TT=0.083

? (problem)
TT=1.773

UNSAT
TT=0.073

? (problem)
TT=1.679

UNSAT
TT=0.072

? (problem)
TT=1.704

UNSAT
TT=0.071

UNSAT
TT=0.013

UNSAT
TT=0.046

UNSAT
TT=0.067

UNSAT
TT=0.015

UNSAT
TT=0.674

UNSAT
TT=0.008

UNSAT
TT=0.695

UNSAT
TT=2.193

UNSAT
TT=0.676

UNSAT
TT=0.468

UNSAT
TT=0.874

UNSAT
TT=2.399

UNSAT
TT=0.482

UNSAT
TT=0.864

UNSAT
TT=1.273

UNSAT
TT=0.013

? (problem)
TT=1.604

? (problem)
TT=1.599

UNSAT
TT=39.042

UNSAT
TT=51.455

UNSAT
TT=0.005

No dataNo dataNo dataNo dataUNSAT
TT=0.004

No dataNo dataUNSAT
TT=0.983

UNSAT
TT=0.545

UNSAT
TT=0.594

UNSAT
TT=1.023

UNSAT
TT=0.918

UNSAT
TT=1.019

UNSAT
TT=0.08

UNSAT
TT=0.08

UNSAT
TT=0.004

No dataNo dataUNSAT
TT=0.005

normalized-PB06/SATUNSAT-SMALLINT/
web/
uclid_pb_benchmarks/normalized-46s.smv.opb
UNSAT
TT=0.02

UNSAT
TT=0.098

UNSAT
TT=0.02

No data? (problem)
TT=4.5

UNSAT
TT=0.195

? (problem)
TT=4.563

UNSAT
TT=0.174

? (problem)
TT=4.44

UNSAT
TT=0.174

? (problem)
TT=4.489

UNSAT
TT=0.171

UNSAT
TT=0.091

UNSAT
TT=0.149

UNSAT
TT=0.209

UNSAT
TT=0.067

UNSAT
TT=1.285

UNSAT
TT=0.081

UNSAT
TT=0.938

UNSAT
TT=24.963

UNSAT
TT=0.647

UNSAT
TT=20.783

UNSAT
TT=1.924

UNSAT
TT=25.417

UNSAT
TT=0.545

UNSAT
TT=1.513

UNSAT
TT=17.278

UNSAT
TT=0.05

? (problem)
TT=4.284

? (problem)
TT=4.328

UNSAT
TT=154.486

UNSAT
TT=87.42

UNSAT
TT=0.031

No dataNo dataNo dataNo dataUNSAT
TT=0.034

No dataNo dataUNSAT
TT=2.043

UNSAT
TT=0.864

UNSAT
TT=1.024

UNSAT
TT=13.573

UNSAT
TT=12.477

UNSAT
TT=14.982

UNSAT
TT=0.278

UNSAT
TT=0.278

UNSAT
TT=0.031

No dataNo dataUNSAT
TT=0.033

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-blast-floppy1-2.ucl.opb
UNSAT
TT=0.002

UNSAT
TT=0.012

UNSAT
TT=0.011

No data? (problem)
TT=0.153

UNSAT
TT=0.047

? (problem)
TT=0.165

UNSAT
TT=0.04

? (problem)
TT=0.175

UNSAT
TT=0.039

? (problem)
TT=0.182

UNSAT
TT=0.042

UNSAT
TT=0.008

UNSAT
TT=0.011

UNSAT
TT=0.03

UNSAT
TT=0.01

UNSAT
TT=0.473

UNSAT
TT=0.009

UNSAT
TT=0.483

UNSAT
TT=0.019

UNSAT
TT=0.603

UNSAT
TT=0.009

UNSAT
TT=0.794

UNSAT
TT=0.024

UNSAT
TT=0.974

UNSAT
TT=1.093

UNSAT
TT=0.023

UNSAT
TT=0.009

? (problem)
TT=0.008

? (problem)
TT=0.009

UNSAT
TT=26.99

UNSAT
TT=35.541

UNSAT
TT=0.003

No dataNo dataNo dataNo dataUNSAT
TT=0.003

No dataNo dataUNSAT
TT=1.093

UNSAT
TT=0.414

UNSAT
TT=0.394

UNSAT
TT=0.019

UNSAT
TT=0.028

UNSAT
TT=0.021

UNSAT
TT=0.075

UNSAT
TT=0.069

UNSAT
TT=0.002

No dataNo dataUNSAT
TT=0.002

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-blast-floppy1-6.ucl.opb
UNSAT
TT=0.004

UNSAT
TT=0.067

UNSAT
TT=0.019

No data? (problem)
TT=0.874

UNSAT
TT=0.198

? (problem)
TT=0.9

UNSAT
TT=0.184

? (problem)
TT=0.902

UNSAT
TT=0.18

? (problem)
TT=0.885

UNSAT
TT=0.177

UNSAT
TT=0.045

UNSAT
TT=0.044

UNSAT
TT=0.071

UNSAT
TT=0.031

UNSAT
TT=0.684

UNSAT
TT=0.057

UNSAT
TT=0.824

UNSAT
TT=0.058

UNSAT
TT=0.589

UNSAT
TT=0.031

UNSAT
TT=0.973

UNSAT
TT=0.188

UNSAT
TT=0.557

UNSAT
TT=0.863

UNSAT
TT=0.093

UNSAT
TT=0.008

? (problem)
TT=0.016

? (problem)
TT=0.017

UNSAT
TT=174.165

UNSAT
TT=172.444

UNSAT
TT=0.005

No dataNo dataNo dataNo dataUNSAT
TT=0.005

No dataNo dataUNSAT
TT=0.844

UNSAT
TT=0.723

UNSAT
TT=0.733

UNSAT
TT=0.179

UNSAT
TT=0.168

UNSAT
TT=0.174

UNSAT
TT=0.148

UNSAT
TT=0.157

UNSAT
TT=0.005

No dataNo dataUNSAT
TT=0.004

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-blast-floppy1-8.ucl.opb
UNSAT
TT=0.011

UNSAT
TT=0.025

UNSAT
TT=0.011

No data? (problem)
TT=41.341

UNSAT
TT=0.177

? (problem)
TT=41.227

UNSAT
TT=0.17

? (problem)
TT=44.939

UNSAT
TT=0.171

? (problem)
TT=40.678

UNSAT
TT=0.163

UNSAT
TT=0.029

UNSAT
TT=0.206

UNSAT
TT=0.327

UNSAT
TT=0.096

UNSAT
TT=1.103

UNSAT
TT=0.025

UNSAT
TT=0.936

UNSAT
TT=0.28

UNSAT
TT=0.595

UNSAT
TT=0.116

UNSAT
TT=1.245

UNSAT
TT=0.209

UNSAT
TT=1.595

UNSAT
TT=1.305

UNSAT
TT=0.2

UNSAT
TT=0.026

? (problem)
TT=0.088

? (problem)
TT=0.081

? (MO)
TT=1513.93

? (MO)
TT=1496.66

UNSAT
TT=0.025

No dataNo dataNo dataNo dataUNSAT
TT=0.025

No dataNo dataUNSAT
TT=1.365

UNSAT
TT=0.883

UNSAT
TT=0.906

UNSAT
TT=0.553

UNSAT
TT=0.279

UNSAT
TT=0.53

Wrong Cert.
TT=0.817

UNSAT
TT=0.218

UNSAT
TT=0.03

No dataNo dataUNSAT
TT=0.029

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-blast-tlan2.ucl.opb
UNSAT
TT=0.024

UNSAT
TT=0.09

UNSAT
TT=0.207

No data? (problem)
TT=2.943

UNSAT
TT=0.379

? (problem)
TT=3.08

UNSAT
TT=0.352

? (problem)
TT=3.075

UNSAT
TT=0.352

? (problem)
TT=3.26

UNSAT
TT=0.345

UNSAT
TT=0.065

UNSAT
TT=0.191

UNSAT
TT=0.222

UNSAT
TT=0.079

UNSAT
TT=1.703

UNSAT
TT=0.081

UNSAT
TT=1.455

UNSAT
TT=0.161

UNSAT
TT=0.638

UNSAT
TT=0.061

UNSAT
TT=1.135

UNSAT
TT=0.142

UNSAT
TT=2.979

UNSAT
TT=1.354

UNSAT
TT=0.13

UNSAT
TT=0.024

? (problem)
TT=0.043

? (problem)
TT=0.044

UNSAT
TT=253.207

UNSAT
TT=260.63

UNSAT
TT=0.037

No dataNo dataNo dataNo dataUNSAT
TT=0.036

No dataNo dataUNSAT
TT=1.295

UNSAT
TT=1.204

UNSAT
TT=1.204

UNSAT
TT=0.324

UNSAT
TT=0.155

UNSAT
TT=0.328

UNSAT
TT=0.228

UNSAT
TT=0.21

UNSAT
TT=0.036

No dataNo dataUNSAT
TT=0.037

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-blast-tlan3.ucl.opb
UNSAT
TT=0.067

UNSAT
TT=0.187

UNSAT
TT=0.067

No data? (problem)
TT=32.36

UNSAT
TT=0.879

? (problem)
TT=33.171

UNSAT
TT=0.873

? (problem)
TT=30.486

UNSAT
TT=0.886

? (problem)
TT=32.794

UNSAT
TT=0.818

UNSAT
TT=0.212

UNSAT
TT=1.395

UNSAT
TT=2.845

UNSAT
TT=2.425

UNSAT
TT=1.735

UNSAT
TT=0.198

UNSAT
TT=1.604

UNSAT
TT=1.161

UNSAT
TT=0.656

UNSAT
TT=0.602

UNSAT
TT=2.033

UNSAT
TT=1.097

UNSAT
TT=1.662

UNSAT
TT=2.165

UNSAT
TT=0.968

UNSAT
TT=0.154

? (problem)
TT=0.457

? (problem)
TT=0.465

? (TO)
TT=1800.05

? (TO)
TT=1800.1

UNSAT
TT=0.174

No dataNo dataNo dataNo dataUNSAT
TT=0.182

No dataNo dataUNSAT
TT=2.654

UNSAT
TT=1.584

UNSAT
TT=1.433

UNSAT
TT=1.234

UNSAT
TT=0.832

UNSAT
TT=1.08

UNSAT
TT=1.506

UNSAT
TT=1.735

UNSAT
TT=0.165

No dataNo dataUNSAT
TT=0.181

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-cache-ibm-q-full.all.ucl.opb
UNSAT
TT=112.93

UNSAT
TT=1000.28

UNSAT
TT=116.974

No data? (problem)
TT=56.981

UNSAT
TT=146.174

? (problem)
TT=56.591

UNSAT
TT=134.32

? (problem)
TT=57.536

UNSAT
TT=112.93

? (problem)
TT=56.834

UNSAT
TT=117.66

? (TO)
TT=1800.08

UNSAT
TT=358.072

UNSAT
TT=874.903

UNSAT
TT=1482.89

UNSAT
TT=1364.84

UNSAT
TT=206.156

? (TO)
TT=1800.04

?
TT=1798

? (TO)
TT=1800.03

? (TO)
TT=1800.39

? (TO)
TT=1800.8

?
TT=1790.54

? (MO)
TT=1630.72

? (TO)
TT=1800.09

?
TT=1797.54

UNSAT
TT=310.875

? (problem)
TT=54.08

? (problem)
TT=54.479

? (MO)
TT=543.63

? (MO)
TT=467.52

UNSAT
TT=862.861

No dataNo dataNo dataNo dataUNSAT
TT=830.598

No dataNo data? (TO)
TT=1800.97

UNSAT
TT=1477.19

? (TO)
TT=1800.05

?
TT=1797.89

?
TT=1797.66

?
TT=1798.12

? (TO)
TT=1800.06

? (TO)
TT=1800.07

UNSAT
TT=1098.6

No dataNo dataUNSAT
TT=802.762

normalized-PB06/SATUNSAT-SMALLINT/web/
uclid_pb_benchmarks/
normalized-cache-ibm-q-unbounded.Ic22arity.ucl.opb
UNSAT
TT=3.352

UNSAT
TT=210.755

UNSAT
TT=3.352

No data? (problem)
TT=23.298

UNSAT
TT=6.967

? (problem)
TT=23.116

UNSAT
TT=6.35

? (problem)
TT=23.229

UNSAT
TT=6.14

? (problem)
TT=23.049

UNSAT
TT=6.04

UNSAT
TT=371.438

UNSAT
TT=7.965

UNSAT
TT=24.551

UNSAT
TT=56.506

UNSAT
TT=19.931

UNSAT
TT=188.226

UNSAT
TT=47.226

?
TT=1796.25

UNSAT
TT=45.298

? (TO)
TT=1800.1

UNSAT
TT=133.194

?
TT=1790.57

UNSAT
TT=10.902

UNSAT
TT=179.747

? (TO)
TT=1802.12

UNSAT
TT=3.496

? (problem)
TT=16.673

? (problem)
TT=16.707

? (MO)
TT=283.86

? (MO)
TT=278.54

UNSAT
TT=13.783

No dataNo dataNo dataNo dataUNSAT
TT=13.626

No dataNo dataUNSAT
TT=53.846

UNSAT
TT=30.228

UNSAT
TT=29.681

?
TT=1797.59

?
TT=1797.7

?
TT=1798.06

UNSAT
TT=250.778

UNSAT
TT=301.765

UNSAT
TT=13.658

No dataNo dataUNSAT
TT=14.472

normalized-PB06/SATUNSAT-SMALLINT/web/
uclid_pb_benchmarks/
normalized-cache-ibm-q-unbounded.Ih2arity.ucl.opb
SAT
TT=0.554
T1=0.52
SAT
TT=191.724
T1=191.75
SAT
TT=0.554
T1=0.52
No data? (problem)
TT=32.01

SAT
TT=4.254
T1=4.2
? (problem)
TT=32.614

? (problem)
TT=4.06

? (problem)
TT=33.278

? (problem)
TT=3.67

? (problem)
TT=32.548

? (problem)
TT=3.61

SAT
TT=183.922
T1=183.93
SAT
TT=4.894
T1=4.86
SAT
TT=11.39
T1=10.28
SAT
TT=35.242
T1=35.23
SAT
TT=4.243
T1=2.81
SAT
TT=182.589
T1=182.61
SAT
TT=3.963
T1=2.57
?
TT=1795.7

SAT
TT=4.126
T1=4.33
?
TT=1799.08

SAT
TT=6.293
T1=3.69
?
TT=1790.54

SAT
TT=4.488
T1=4.53
SAT
TT=5.634
T1=2.76
?
TT=1797.73

SAT
TT=0.839
T1=0.81
? (problem)
TT=23.37

? (problem)
TT=23.272

? (MO)
TT=1544.32

? (MO)
TT=1467.17

SAT
TT=1.226
T1=1.2
No dataNo dataNo dataNo dataSAT
TT=1.23
T1=1.19
No dataNo dataSAT
TT=6.723
T1=2.95
SAT
TT=3.592
T1=2.26
SAT
TT=4.053
T1=2.67
?
TT=1797.68

?
TT=1797.5

?
TT=1797.66

SAT
TT=10.727
T1=10.64
SAT
TT=9.247
T1=9.18
SAT
TT=1.297
T1=1.25
No dataNo dataSAT
TT=1.268
T1=1.23
normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-cache.inv14.ucl.opb
UNSAT
TT=133.03

UNSAT
TT=1016.95

UNSAT
TT=199.328

No data? (problem)
TT=1.752

UNSAT
TT=141.425

? (problem)
TT=1.741

UNSAT
TT=160.33

? (problem)
TT=1.744

UNSAT
TT=133.03

? (problem)
TT=1.767

UNSAT
TT=162.82

? (TO)
TT=1800.11

UNSAT
TT=1655.39

? (TO)
TT=1800.02

? (TO)
TT=1800.06

? (TO)
TT=1800.53

UNSAT
TT=134.571

? (TO)
TT=1800.62

?
TT=1795.07

? (TO)
TT=1800.12

? (TO)
TT=1800.04

? (TO)
TT=1800.62

?
TT=1792.19

? (MO)
TT=1032.81

? (TO)
TT=1800.15

?
TT=1798.02

UNSAT
TT=1101.14

? (problem)
TT=1.672

? (problem)
TT=1.655

UNSAT
TT=559.254

UNSAT
TT=659.634

UNSAT
TT=992.09

No dataNo dataNo dataNo dataUNSAT
TT=1344.86

No dataNo data? (TO)
TT=1800.89

? (TO)
TT=1800.03

? (TO)
TT=1800.03

?
TT=1797.37

?
TT=1797.58

?
TT=1797.7

? (TO)
TT=1800.07

? (TO)
TT=1800.07

UNSAT
TT=1000.2

No dataNo dataUNSAT
TT=1245.15

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-cache.inv8.ucl.opb
UNSAT
TT=0.007

UNSAT
TT=0.017

UNSAT
TT=0.007

No data? (problem)
TT=0.106

UNSAT
TT=0.064

? (problem)
TT=0.107

UNSAT
TT=0.051

? (problem)
TT=0.108

UNSAT
TT=0.049

? (problem)
TT=0.107

UNSAT
TT=0.049

UNSAT
TT=0.018

UNSAT
TT=0.096

UNSAT
TT=0.289

UNSAT
TT=0.069

UNSAT
TT=0.774

UNSAT
TT=0.015

UNSAT
TT=0.595

UNSAT
TT=0.181

UNSAT
TT=0.675

UNSAT
TT=0.035

UNSAT
TT=1.073

UNSAT
TT=0.159

UNSAT
TT=0.549

UNSAT
TT=1.025

UNSAT
TT=0.222

UNSAT
TT=0.017

? (problem)
TT=0.103

? (problem)
TT=0.103

UNSAT
TT=4.752

UNSAT
TT=3.947

UNSAT
TT=0.017

No dataNo dataNo dataNo dataUNSAT
TT=0.017

No dataNo dataUNSAT
TT=1.305

UNSAT
TT=0.604

UNSAT
TT=0.604

UNSAT
TT=0.225

UNSAT
TT=0.164

UNSAT
TT=0.228

UNSAT
TT=0.127

UNSAT
TT=0.132

UNSAT
TT=0.015

No dataNo dataUNSAT
TT=0.017

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-dlx1c.rwmem1.ucl.opb
UNSAT
TT=0.098

UNSAT
TT=1.594

UNSAT
TT=0.098

No data? (problem)
TT=1.779

UNSAT
TT=0.412

? (problem)
TT=1.819

UNSAT
TT=0.315

? (problem)
TT=1.795

UNSAT
TT=0.317

? (problem)
TT=1.764

UNSAT
TT=0.314

UNSAT
TT=1.191

UNSAT
TT=0.56

UNSAT
TT=1.177

UNSAT
TT=0.647

UNSAT
TT=1.934

UNSAT
TT=1.687

UNSAT
TT=1.922

?
TT=1796.37

UNSAT
TT=0.853

? (TO)
TT=1800.38

UNSAT
TT=3.044

UNSAT
TT=1756.76

UNSAT
TT=0.987

UNSAT
TT=2.334

UNSAT
TT=391.783

UNSAT
TT=0.188

? (problem)
TT=1.701

? (problem)
TT=1.705

UNSAT
TT=75.349

UNSAT
TT=64.672

UNSAT
TT=0.189

No dataNo dataNo dataNo dataUNSAT
TT=0.201

No dataNo dataUNSAT
TT=3.29

UNSAT
TT=1.753

UNSAT
TT=1.803

UNSAT
TT=272.331

UNSAT
TT=251.566

UNSAT
TT=779.249

UNSAT
TT=1.98

UNSAT
TT=2.037

UNSAT
TT=0.203

No dataNo dataUNSAT
TT=0.189

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-elf.rf6.ucl.opb
UNSAT
TT=0.001

UNSAT
TT=0.001

UNSAT
TT=0.002

No data? (problem)
TT=0.002

UNSAT
TT=0.029

? (problem)
TT=0.003

UNSAT
TT=0.019

? (problem)
TT=0.003

UNSAT
TT=0.019

? (problem)
TT=0.003

UNSAT
TT=0.016

UNSAT
TT=0.004

UNSAT
TT=0.003

UNSAT
TT=0.019

UNSAT
TT=0.004

UNSAT
TT=0.136

UNSAT
TT=0.001

UNSAT
TT=0.153

UNSAT
TT=0.014

UNSAT
TT=0.646

UNSAT
TT=0.008

UNSAT
TT=0.173

UNSAT
TT=0.018

UNSAT
TT=0.47

UNSAT
TT=0.173

UNSAT
TT=0.019

UNSAT
TT=0.004

? (problem)
TT=0.004

? (problem)
TT=0.003

UNSAT
TT=0.377

UNSAT
TT=0.314

UNSAT
TT=0.002

No dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo dataUNSAT
TT=0.183

UNSAT
TT=0.174

UNSAT
TT=0.185

UNSAT
TT=0.016

UNSAT
TT=0.018

UNSAT
TT=0.013

UNSAT
TT=0.004

UNSAT
TT=0.004

UNSAT
TT=0.002

No dataNo dataUNSAT
TT=0.002

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-elf.rf7.ucl.opb
UNSAT
TT=0.008

UNSAT
TT=0.046

UNSAT
TT=0.011

No data? (problem)
TT=0.268

UNSAT
TT=0.125

? (problem)
TT=0.27

UNSAT
TT=0.111

? (problem)
TT=0.268

UNSAT
TT=0.115

? (problem)
TT=0.271

UNSAT
TT=0.11

UNSAT
TT=0.044

UNSAT
TT=0.07

UNSAT
TT=0.157

UNSAT
TT=0.033

UNSAT
TT=0.632

UNSAT
TT=0.046

UNSAT
TT=0.556

UNSAT
TT=13.032

UNSAT
TT=0.701

UNSAT
TT=0.287

UNSAT
TT=0.954

UNSAT
TT=0.244

UNSAT
TT=0.538

UNSAT
TT=0.874

UNSAT
TT=0.241

UNSAT
TT=0.014

? (problem)
TT=0.26

? (problem)
TT=0.263

UNSAT
TT=16.985

UNSAT
TT=15.903

UNSAT
TT=0.009

No dataNo dataNo dataNo dataUNSAT
TT=0.011

No dataNo dataUNSAT
TT=1.024

UNSAT
TT=0.574

UNSAT
TT=0.594

UNSAT
TT=0.595

UNSAT
TT=0.617

UNSAT
TT=1.506

UNSAT
TT=0.073

UNSAT
TT=0.072

UNSAT
TT=0.008

No dataNo dataUNSAT
TT=0.008

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-elf.rf8.ucl.opb
UNSAT
TT=0.042

UNSAT
TT=0.531

UNSAT
TT=0.042

No data? (problem)
TT=1.838

UNSAT
TT=0.289

? (problem)
TT=1.915

UNSAT
TT=0.265

? (problem)
TT=1.83

UNSAT
TT=0.263

? (problem)
TT=1.869

UNSAT
TT=0.258

UNSAT
TT=0.511

UNSAT
TT=0.363

UNSAT
TT=0.812

UNSAT
TT=0.347

UNSAT
TT=1.363

UNSAT
TT=0.535

UNSAT
TT=1.204

UNSAT
TT=98.67

UNSAT
TT=0.583

UNSAT
TT=27.027

UNSAT
TT=2.004

UNSAT
TT=137.825

UNSAT
TT=0.745

UNSAT
TT=1.806

UNSAT
TT=70.091

UNSAT
TT=0.064

? (problem)
TT=1.763

? (problem)
TT=1.809

UNSAT
TT=59.312

UNSAT
TT=51.018

UNSAT
TT=0.08

No dataNo dataNo dataNo dataUNSAT
TT=0.083

No dataNo dataUNSAT
TT=2.075

UNSAT
TT=1.224

UNSAT
TT=1.134

UNSAT
TT=3.187

UNSAT
TT=1.585

UNSAT
TT=69.327

UNSAT
TT=0.433

UNSAT
TT=0.457

UNSAT
TT=0.078

No dataNo dataUNSAT
TT=0.084

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-elf.rf9.ucl.opb
UNSAT
TT=0.204

UNSAT
TT=5.745

UNSAT
TT=0.204

No data? (problem)
TT=14.79

UNSAT
TT=0.802

? (problem)
TT=14.661

UNSAT
TT=0.69

? (problem)
TT=14.592

UNSAT
TT=0.674

? (problem)
TT=14.738

UNSAT
TT=0.658

UNSAT
TT=5.078

UNSAT
TT=1.183

UNSAT
TT=2.801

UNSAT
TT=2.933

UNSAT
TT=1.944

UNSAT
TT=5.718

UNSAT
TT=1.955

UNSAT
TT=845.583

UNSAT
TT=0.772

? (TO)
TT=1800.08

UNSAT
TT=2.773

UNSAT
TT=1272.16

UNSAT
TT=1.56

UNSAT
TT=2.814

UNSAT
TT=439.358

UNSAT
TT=0.279

? (problem)
TT=14.054

? (problem)
TT=13.964

UNSAT
TT=296.683

UNSAT
TT=300.368

UNSAT
TT=0.314

No dataNo dataNo dataNo dataUNSAT
TT=0.313

No dataNo dataUNSAT
TT=3.104

UNSAT
TT=1.894

UNSAT
TT=1.945

UNSAT
TT=669.242

UNSAT
TT=741.035

UNSAT
TT=699.735

UNSAT
TT=3.219

UNSAT
TT=3.314

UNSAT
TT=0.321

No dataNo dataUNSAT
TT=0.326

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.burch_dill.2.accl.ucl.opb
UNSAT
TT=0.166

UNSAT
TT=2.342

UNSAT
TT=0.228

No data? (problem)
TT=0.969

UNSAT
TT=0.474

? (problem)
TT=0.974

UNSAT
TT=0.167

? (problem)
TT=0.976

UNSAT
TT=0.166

? (problem)
TT=0.97

UNSAT
TT=0.168

UNSAT
TT=2.466

UNSAT
TT=0.66

UNSAT
TT=1.007

UNSAT
TT=0.817

UNSAT
TT=2.493

UNSAT
TT=0.715

UNSAT
TT=2.714

UNSAT
TT=636.4

UNSAT
TT=1.142

? (TO)
TT=1800.03

UNSAT
TT=7.983

UNSAT
TT=886.459

UNSAT
TT=0.949

UNSAT
TT=6.435

UNSAT
TT=311.077

UNSAT
TT=0.375

? (problem)
TT=0.939

? (problem)
TT=0.934

UNSAT
TT=105.798

UNSAT
TT=97.559

UNSAT
TT=0.505

No dataNo dataNo dataNo dataUNSAT
TT=0.507

No dataNo dataUNSAT
TT=6.153

UNSAT
TT=2.065

UNSAT
TT=2.224

UNSAT
TT=363.135

UNSAT
TT=346.241

UNSAT
TT=476.65

UNSAT
TT=6.693

UNSAT
TT=6.533

UNSAT
TT=0.475

No dataNo dataUNSAT
TT=0.465

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.burch_dill.3.accl.ucl.opb
UNSAT
TT=0.671

UNSAT
TT=7.673

UNSAT
TT=0.671

No data? (problem)
TT=1.747

UNSAT
TT=1.203

? (problem)
TT=1.758

UNSAT
TT=1.07

? (problem)
TT=1.766

UNSAT
TT=1.17

? (problem)
TT=1.74

UNSAT
TT=1.08

UNSAT
TT=6.61

UNSAT
TT=1.706

UNSAT
TT=3.273

UNSAT
TT=4.612

UNSAT
TT=4.884

UNSAT
TT=1.178

UNSAT
TT=5.672

?
TT=1799.08

UNSAT
TT=2.59

? (TO)
TT=1800.37

UNSAT
TT=12.641

?
TT=1789.78

UNSAT
TT=2.273

UNSAT
TT=12.152

?
TT=1796.77

UNSAT
TT=1.12

? (problem)
TT=1.669

? (problem)
TT=1.66

UNSAT
TT=284.049

UNSAT
TT=353.901

UNSAT
TT=1.492

No dataNo dataNo dataNo dataUNSAT
TT=1.491

No dataNo dataUNSAT
TT=11.631

UNSAT
TT=3.702

UNSAT
TT=4.59

?
TT=1796.79

?
TT=1796.79

?
TT=1796.8

UNSAT
TT=25.622

UNSAT
TT=52.476

UNSAT
TT=1.561

No dataNo dataUNSAT
TT=1.496

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.burch_dill.4.accl.ucl.opb
UNSAT
TT=0.035

UNSAT
TT=0.22

UNSAT
TT=0.035

No data? (problem)
TT=7.09

UNSAT
TT=0.314

? (problem)
TT=7.175

UNSAT
TT=0.272

? (problem)
TT=7.176

UNSAT
TT=0.259

? (problem)
TT=7.073

UNSAT
TT=0.263

UNSAT
TT=0.17

UNSAT
TT=0.284

UNSAT
TT=0.562

UNSAT
TT=0.188

UNSAT
TT=1.364

UNSAT
TT=0.228

UNSAT
TT=1.326

UNSAT
TT=94.012

UNSAT
TT=0.663

? (TO)
TT=1800.09

UNSAT
TT=1.944

UNSAT
TT=119.536

UNSAT
TT=0.694

UNSAT
TT=3.064

UNSAT
TT=41.903

UNSAT
TT=0.065

? (problem)
TT=6.815

? (problem)
TT=6.816

UNSAT
TT=145.947

UNSAT
TT=136.792

UNSAT
TT=0.126

No dataNo dataNo dataNo dataUNSAT
TT=0.127

No dataNo dataUNSAT
TT=2.525

UNSAT
TT=1.484

UNSAT
TT=1.334

UNSAT
TT=83.701

UNSAT
TT=105.405

UNSAT
TT=93.908

UNSAT
TT=0.433

UNSAT
TT=0.434

UNSAT
TT=0.141

No dataNo dataUNSAT
TT=0.13

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.burch_dill.8.accl.ucl.opb
UNSAT
TT=60.24

?
TT=1798.01

UNSAT
TT=102.341

No data? (problem)
TT=24.023

UNSAT
TT=65.71

? (problem)
TT=23.894

UNSAT
TT=64.35

? (problem)
TT=24.024

UNSAT
TT=60.24

? (problem)
TT=23.752

UNSAT
TT=62.95

? (TO)
TT=1800.07

UNSAT
TT=1115.22

UNSAT
TT=175.771

UNSAT
TT=784.376

UNSAT
TT=242.54

UNSAT
TT=25.376

UNSAT
TT=263.625

?
TT=1794.42

UNSAT
TT=211.853

? (TO)
TT=1800.11

UNSAT
TT=1021.58

?
TT=1789.91

? (MO)
TT=566.34

UNSAT
TT=914.506

?
TT=1797.12

UNSAT
TT=829.021

? (problem)
TT=23.436

? (problem)
TT=22.758

? (TO)
TT=1800.09

? (TO)
TT=1800.02

UNSAT
TT=1202.76

No dataNo dataNo dataNo dataUNSAT
TT=1144.15

No dataNo dataUNSAT
TT=754.648

UNSAT
TT=294.847

UNSAT
TT=196.103

?
TT=1797.01

?
TT=1797.05

?
TT=1796.88

? (TO)
TT=1800.02

? (TO)
TT=1800.04

UNSAT
TT=1191.17

No dataNo dataUNSAT
TT=1188.46

normalized-PB06/SATUNSAT-SMALLINT/web/uclid_pb_benchmarks/
normalized-ooo.ex.mem.LsqHdStrong.ucl.opb
UNSAT
TT=369.578

?
TT=1798.05

UNSAT
TT=369.578

No data? (problem)
TT=63.617

UNSAT
TT=463.506

? (problem)
TT=62.396

UNSAT
TT=594.72

? (problem)
TT=62.238

UNSAT
TT=602.93

? (problem)
TT=62.855

UNSAT
TT=460.16

? (TO)
TT=1800.04

UNSAT
TT=496.259

? (TO)
TT=1800

? (TO)
TT=1800.04

UNSAT
TT=1789.73

UNSAT
TT=288.691

? (TO)
TT=1800.1

? (TO)
TT=1802.11

? (TO)
TT=1800.08

?
TT=1799.04

? (TO)
TT=1800.3

?
TT=1791.59

? (MO)
TT=1065.12

? (TO)
TT=1800.17

?
TT=1798.84

UNSAT
TT=706.692

? (problem)
TT=47.762

? (problem)
TT=47.052

? (MO)
TT=279.19

? (MO)
TT=275.1

UNSAT
TT=1077.05

No dataNo dataNo dataNo dataUNSAT
TT=1331.34

No dataNo data? (TO)
TT=1800.76

? (TO)
TT=1800.08

? (TO)
TT=1800.1

?
TT=1799

?
TT=1798.72

?
TT=1798.87

? (TO)
TT=1800.09

? (TO)
TT=1800.08

UNSAT
TT=1071.54

No dataNo dataUNSAT
TT=1396.62

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.rf10.ucl.opb
UNSAT
TT=2.688

UNSAT
TT=78.339

UNSAT
TT=2.688

No data? (problem)
TT=2.435

UNSAT
TT=2.885

? (problem)
TT=2.443

UNSAT
TT=2.86

? (problem)
TT=2.431

UNSAT
TT=2.76

? (problem)
TT=2.43

UNSAT
TT=2.76

UNSAT
TT=113.193

UNSAT
TT=5.139

UNSAT
TT=7.898

UNSAT
TT=31.046

UNSAT
TT=17.24

UNSAT
TT=119.63

UNSAT
TT=15.713

?
TT=1795.05

UNSAT
TT=4.978

? (TO)
TT=1800.1

UNSAT
TT=33.379

?
TT=1789.89

UNSAT
TT=5.419

UNSAT
TT=31.87

?
TT=1797.17

UNSAT
TT=3.966

? (problem)
TT=2.371

? (problem)
TT=2.351

UNSAT
TT=131.726

UNSAT
TT=123.003

UNSAT
TT=6.844

No dataNo dataNo dataNo dataUNSAT
TT=7.094

No dataNo dataUNSAT
TT=46.708

UNSAT
TT=11.012

UNSAT
TT=12.901

?
TT=1796.94

?
TT=1796.98

?
TT=1796.96

UNSAT
TT=306.603

UNSAT
TT=294.659

UNSAT
TT=6.872

No dataNo dataUNSAT
TT=6.713

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.rf8.ucl.opb
UNSAT
TT=0.126

UNSAT
TT=1.813

UNSAT
TT=0.126

No data? (problem)
TT=1.104

UNSAT
TT=0.338

? (problem)
TT=1.118

UNSAT
TT=0.248

? (problem)
TT=1.111

UNSAT
TT=0.25

? (problem)
TT=1.105

UNSAT
TT=0.245

UNSAT
TT=1.818

UNSAT
TT=0.464

UNSAT
TT=1.028

UNSAT
TT=0.809

UNSAT
TT=1.785

UNSAT
TT=1.776

UNSAT
TT=1.934

UNSAT
TT=594.747

UNSAT
TT=0.822

? (TO)
TT=1800.16

UNSAT
TT=3.673

UNSAT
TT=1051.54

UNSAT
TT=0.855

UNSAT
TT=3.462

UNSAT
TT=392.34

UNSAT
TT=0.159

? (problem)
TT=1.071

? (problem)
TT=1.056

UNSAT
TT=46.13

UNSAT
TT=95.788

UNSAT
TT=0.304

No dataNo dataNo dataNo dataUNSAT
TT=0.305

No dataNo dataUNSAT
TT=5.343

UNSAT
TT=1.833

UNSAT
TT=1.763

UNSAT
TT=742.892

UNSAT
TT=1416.61

UNSAT
TT=433.684

UNSAT
TT=3.334

UNSAT
TT=3.351

UNSAT
TT=0.293

No dataNo dataUNSAT
TT=0.294

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.rf9.ucl.opb
UNSAT
TT=0.419

UNSAT
TT=8.234

UNSAT
TT=0.419

No data? (problem)
TT=1.494

UNSAT
TT=1.043

? (problem)
TT=1.504

UNSAT
TT=0.98

? (problem)
TT=1.498

UNSAT
TT=0.98

? (problem)
TT=1.488

UNSAT
TT=0.97

UNSAT
TT=9.247

UNSAT
TT=1.395

UNSAT
TT=2.372

UNSAT
TT=4.863

UNSAT
TT=3.153

UNSAT
TT=8.37

UNSAT
TT=6.004

?
TT=1795.1

UNSAT
TT=1.673

? (TO)
TT=1800.13

UNSAT
TT=8.462

?
TT=1790.85

UNSAT
TT=1.539

UNSAT
TT=11.232

?
TT=1796.84

UNSAT
TT=0.703

? (problem)
TT=1.415

? (problem)
TT=1.424

UNSAT
TT=57.356

UNSAT
TT=67.131

UNSAT
TT=1.023

No dataNo dataNo dataNo dataUNSAT
TT=1.016

No dataNo dataUNSAT
TT=9.982

UNSAT
TT=3.871

UNSAT
TT=3.483

?
TT=1796.85

?
TT=1796.81

?
TT=1796.87

UNSAT
TT=26.899

UNSAT
TT=26.772

UNSAT
TT=1.011

No dataNo dataUNSAT
TT=1.018

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.tag10.ucl.opb
UNSAT
TT=0.321

UNSAT
TT=4.335

UNSAT
TT=0.559

No data? (problem)
TT=1.885

UNSAT
TT=0.933

? (problem)
TT=1.919

UNSAT
TT=0.333

? (problem)
TT=1.874

UNSAT
TT=0.326

? (problem)
TT=1.909

UNSAT
TT=0.321

UNSAT
TT=18.049

UNSAT
TT=1.775

UNSAT
TT=2.33

UNSAT
TT=8.915

UNSAT
TT=9.143

UNSAT
TT=3.876

UNSAT
TT=12.142

UNSAT
TT=1172.87

UNSAT
TT=2.376

? (TO)
TT=1800.28

UNSAT
TT=31.268

UNSAT
TT=826.551

UNSAT
TT=1.878

UNSAT
TT=21.652

UNSAT
TT=321.615

UNSAT
TT=1.104

? (problem)
TT=1.804

? (problem)
TT=1.827

UNSAT
TT=66.848

UNSAT
TT=59.55

UNSAT
TT=2.959

No dataNo dataNo dataNo dataUNSAT
TT=2.963

No dataNo dataUNSAT
TT=23.579

UNSAT
TT=7.953

UNSAT
TT=11.581

UNSAT
TT=879.504

UNSAT
TT=953.19

UNSAT
TT=930.378

UNSAT
TT=41.853

UNSAT
TT=46.457

UNSAT
TT=2.946

No dataNo dataUNSAT
TT=2.965

normalized-PB06/SATUNSAT-SMALLINT/
web/uclid_pb_benchmarks/
normalized-ooo.unbounded.all.ucl.opb
UNSAT
TT=33.684

UNSAT
TT=1064.34

UNSAT
TT=33.684

No data? (problem)
TT=37.562

UNSAT
TT=61.007

? (problem)
TT=37.139

UNSAT
TT=59.76

? (problem)
TT=36.72

UNSAT
TT=53.46

? (problem)
TT=36.32

UNSAT
TT=50.66

UNSAT
TT=1656.83

UNSAT
TT=132.813

UNSAT
TT=240.789

UNSAT
TT=286.452

UNSAT
TT=277.101

UNSAT
TT=291.87

UNSAT
TT=618.28

? (TO)
TT=1802.03

? (TO)
TT=1800.03

?
TT=1799.04

? (TO)
TT=1800.99

?
TT=1790.64

UNSAT
TT=406.462

UNSAT
TT=1469.17

?
TT=1797.54

UNSAT
TT=112.89

? (problem)
TT=26.436

? (problem)
TT=26.488

? (MO)
TT=494

? (MO)
TT=502.55

UNSAT
TT=542.301

No dataNo dataNo dataNo dataUNSAT
TT=433.508

No dataNo dataUNSAT
TT=1050.74

UNSAT
TT=275.23

UNSAT
TT=363.25

?
TT=1797.58

?
TT=1797.61

?
TT=1797.85

? (TO)
TT=1800.08

? (TO)
TT=1800.08

UNSAT
TT=484.567

No dataNo dataUNSAT
TT=542.16

normalized-PB06/SATUNSAT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
ppp-problems/normalized-ppp:1-11,19,21.opb
SAT
TT=17.878
T1=17.88
?
TT=1798.01

SAT
TT=332.728
T1=332.8
No data? (problem)
TT=0.171

? (TO)
TT=1800.06

? (problem)
TT=0.166

? (TO)
TT=1800.02

? (problem)
TT=0.167

? (TO)
TT=1800.05

? (problem)
TT=0.164

? (TO)
TT=1800.05

? (TO)
TT=1800.06

? (TO)
TT=1800.03

? (TO)
TT=1800.66

SAT
TT=17.878
T1=17.88
? (TO)
TT=1800

?
TT=1798.02

? (TO)
TT=1800.03

?
TT=1793.58

? (TO)
TT=1800.04

? (TO)
TT=1800.19

? (TO)
TT=1800.47

?
TT=1789.78

? (MO)
TT=526.69

? (TO)
TT=1800.18

?
TT=1796.78

SAT
TT=224.816
T1=224.91
? (problem)
TT=0.159

? (problem)
TT=0.162

? (TO)
TT=1800.02

? (TO)
TT=1800.07

?
TT=1799.49

No dataNo dataNo dataNo data?
TT=1799.45

No dataNo data? (TO)
TT=1800.01

? (TO)
TT=1800.04

? (TO)
TT=1800.1

?
TT=1796.83

?
TT=1796.84

?
TT=1796.81

? (TO)
TT=1800.07

? (TO)
TT=1800.05

?
TT=1799.45

No dataNo data?
TT=1799.42

normalized-PB06/SATUNSAT-SMALLINT/web/www.ps.uni-sb.de/
~walser/benchmarks/ppp-problems/normalized-ppp:1-12,16.opb
SAT
TT=0.148
T1=0.14
SAT
TT=0.844
T1=0.84
SAT
TT=1.409
T1=1.4
No data? (problem)
TT=0.172

SAT
TT=10.834
T1=10.83
? (problem)
TT=0.172

SAT
TT=10.886
T1=10.87
? (problem)
TT=0.173

SAT
TT=10.683
T1=10.68
? (problem)
TT=0.176

SAT
TT=10.607
T1=10.6
SAT
TT=0.404
T1=0.4
SAT
TT=5.498
T1=5.49
SAT
TT=4.927
T1=4.79
SAT
TT=1.119
T1=1.11
? (TO)
TT=1800.07

SAT
TT=0.912
T1=0.91
? (TO)
TT=1800.08

?
TT=1794.03

SAT
TT=1.107
T1=1.17
SAT
TT=4.462
T1=4.43
SAT
TT=3.053
T1=1.59
?
TT=1790.83

SAT
TT=1.351
T1=2.45
SAT
TT=2.916
T1=1.11
SAT
TT=207.424
T1=207.39
SAT
TT=2.989
T1=2.98
? (problem)
TT=0.173

? (problem)
TT=0.17

SAT
TT=614.809
T1=613.63
SAT
TT=143.075
T1=142.28
SAT
TT=0.151
T1=0.14
No dataNo dataNo dataNo dataSAT
TT=0.171
T1=0.16
No dataNo dataSAT
TT=3.143
T1=1.13
SAT
TT=1.566
T1=0.74
SAT
TT=2.234
T1=1.3
SAT
TT=380.736
T1=380.73
SAT
TT=380.257
T1=380.26
?
TT=1796.8

SAT
TT=2.057
T1=2.05
SAT
TT=1.956
T1=1.95
SAT
TT=0.148
T1=0.14
No dataNo dataSAT
TT=0.16
T1=0.16
normalized-PB06/SATUNSAT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
ppp-problems/normalized-ppp:1-13.opb
SAT
TT=0.388
T1=0.38
SAT
TT=3.756
T1=3.75
SAT
TT=1.572
T1=1.57
No data? (problem)
TT=0.18

SAT
TT=2.985
T1=2.98
? (problem)
TT=0.181

SAT
TT=2.984
T1=2.97
? (problem)
TT=0.172

SAT
TT=2.979
T1=2.97
? (problem)
TT=0.17

SAT
TT=2.987
T1=2.97
SAT
TT=4.765
T1=4.77
SAT
TT=209.16
T1=209.24
? (TO)
TT=1800.13

SAT
TT=2.633
T1=2.63
? (TO)
TT=1800.01

SAT
TT=2.057
T1=2.05
? (TO)
TT=1800.01

?
TT=1793.85

SAT
TT=1.796
T1=2.38
? (TO)
TT=1800.22

SAT
TT=3.723
T1=1.6
SAT
TT=727.545
T1=727.61
SAT
TT=8.212
T1=8.72
SAT
TT=4.382
T1=1.62
SAT
TT=937.757
T1=937.85
SAT
TT=1754.07
T1=1754.45
? (problem)
TT=0.164

? (problem)
TT=0.167

SAT
TT=691.754
T1=690.39
? (TO)
TT=1800.09

SAT
TT=0.41
T1=0.4
No dataNo dataNo dataNo dataSAT
TT=0.39
T1=0.38
No dataNo dataSAT
TT=3.244
T1=1.11
SAT
TT=2.253
T1=1.32
SAT
TT=79.612
T1=77.78
SAT
TT=232.816
T1=232.77
SAT
TT=244.601
T1=244.6
SAT
TT=1143.91
T1=1144.03
SAT
TT=171.047
T1=171.09
SAT
TT=165.424
T1=165.49
SAT
TT=0.388
T1=0.38
No dataNo dataSAT
TT=0.388
T1=0.38
normalized-PB06/SATUNSAT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
ppp-problems/normalized-ppp:1,3-13,19.opb
SAT
TT=0.188
T1=0.17
SAT
TT=1.971
T1=1.97
SAT
TT=0.954
T1=0.95
No data? (problem)
TT=0.166

? (TO)
TT=1800.16

? (problem)
TT=0.171

? (TO)
TT=1800.06

? (problem)
TT=0.169

? (TO)
TT=1800.06

? (problem)
TT=0.166

? (TO)
TT=1800.09

SAT
TT=0.594
T1=0.59
SAT
TT=65.517
T1=65.55
? (TO)
TT=1800.1

SAT
TT=0.993
T1=0.99
? (TO)
TT=1800.06

SAT
TT=4.18
T1=4.17
? (TO)
TT=1800.05

?
TT=1793.55

SAT
TT=3.762
T1=4.8
? (TO)
TT=1800.32

SAT
TT=3.475
T1=1.57
?
TT=1789.82

SAT
TT=1.651
T1=2.44
SAT
TT=2.975
T1=1.1
?
TT=1796.81

SAT
TT=329.421
T1=329.52
? (problem)
TT=0.159

? (problem)
TT=0.162

SAT
TT=909.411
T1=908.32
? (TO)
TT=1800.03

SAT
TT=0.188
T1=0.17
No dataNo dataNo dataNo dataSAT
TT=0.238
T1=0.23
No dataNo dataSAT
TT=3.084
T1=1.13
SAT
TT=1.685
T1=0.85
SAT
TT=657.89
T1=653.27
SAT
TT=307.914
T1=307.91
SAT
TT=315.423
T1=315.39
SAT
TT=1328.77
T1=1328.9
SAT
TT=3.893
T1=3.88
SAT
TT=4.074
T1=4.06
SAT
TT=0.235
T1=0.22
No dataNo dataSAT
TT=0.245
T1=0.23
normalized-PB06/SATUNSAT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
ppp-problems/normalized-ppp:1-9,16-19.opb
SAT
TT=204.064
T1=204.6
?
TT=1798

? (TO)
TT=1800.08

No data? (problem)
TT=0.175

? (TO)
TT=1800.07

? (problem)
TT=0.173

? (TO)
TT=1800.05

? (problem)
TT=0.168

? (TO)
TT=1800.05

? (problem)
TT=0.176

? (TO)
TT=1800

? (TO)
TT=1800.1

? (TO)
TT=1800.02

? (TO)
TT=1800.13

SAT
TT=226.037
T1=226.09
? (TO)
TT=1800.07

?
TT=1798

? (exit code)
TT=1760.46

?
TT=1793.23

? (TO)
TT=1800.01

? (TO)
TT=1800.15

? (TO)
TT=1801.07

?
TT=1790.69

SAT
TT=204.064
T1=204.6
? (TO)
TT=1800.19

?
TT=1796.78

? (TO)
TT=1800.07

? (problem)
TT=0.164

? (problem)
TT=0.166

? (TO)
TT=1800.05

? (TO)
TT=1800.04

?
TT=1799.74

No dataNo dataNo dataNo data?
TT=1799.85

No dataNo data? (TO)
TT=1800.72

? (TO)
TT=1800.1

? (TO)
TT=1800.41

?
TT=1796.83

?
TT=1796.82

?
TT=1796.83

? (TO)
TT=1800.05

? (TO)
TT=1800.07

?
TT=1799.38

No dataNo data?
TT=1799.5

normalized-PB06/SATUNSAT-SMALLINT/web/
www.ps.uni-sb.de/~walser/benchmarks/
ppp-problems/normalized-ppp:3-13,25,26.opb
SAT
TT=1.339
T1=1.33
SAT
TT=10.799
T1=10.79
SAT
TT=1.956
T1=1.95
No data? (problem)
TT=0.174

? (TO)
TT=1800.05

? (problem)
TT=0.171

? (TO)
TT=1800.08

? (problem)
TT=0.171

? (TO)
TT=1800.07

? (problem)
TT=0.17

? (TO)
TT=1800.1

? (TO)
TT=1800.08

SAT
TT=5.5
T1=5.49
? (TO)
TT=1800.09

SAT
TT=2.592
T1=2.59
? (TO)
TT=1800.5

SAT
TT=1.903
T1=1.9
? (TO)
TT=1801.33

?
TT=1793.23

SAT
TT=10.786
T1=10.48
? (TO)
TT=1800.15

SAT
TT=13.062
T1=6.61
SAT
TT=1740.56
T1=1740.75
SAT
TT=6.561
T1=6.66
SAT
TT=8.993
T1=3.6
SAT
TT=1340.04
T1=1340.18
SAT
TT=3.673
T1=3.67
? (problem)
TT=0.166

? (problem)
TT=0.17

? (TO)
TT=1800.06

? (TO)
TT=1800.05

SAT
TT=2.371
T1=2.36
No dataNo dataNo dataNo dataSAT
TT=1.461
T1=1.45
No dataNo dataSAT
TT=4.844
T1=1.65
SAT
TT=2.786
T1=1.64
? (TO)
TT=1800.65

?
TT=1796.86

?
TT=1796.82

SAT
TT=1601.8
T1=1601.97
SAT
TT=7.1
T1=7.09
SAT
TT=7.221
T1=7.21
SAT
TT=1.339
T1=1.33
No dataNo dataSAT
TT=1.341
T1=1.34
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir03_trarea_ac.opb
OPT
f=23978
TT=158.458
T1=102.47
No dataNo dataNo dataOPT
f=23978
TT=189.85
T1=131.69
OPT
f=23978
TT=158.458
T1=102.47
? (problem)

TT=53

? (problem)

TT=23.72

? (problem)

TT=28.05

? (problem)

TT=54.4

? (TO)

TT=1800.07

? (problem)

TT=54.33

SAT (TO)
f=26724
TT=1800.02
T1=409.05
SAT (TO)
f=28204
TT=1800.03
T1=0.04
No dataNo dataSAT (TO)
f=28135
TT=1801.24
T1=1634.66
No dataSAT (TO)
f=28657
TT=1800.41
T1=519.34
No dataNo dataNo dataSAT (TO)
f=26485
TT=1800.19
T1=842.21
OPT
f=23978
TT=0.075
T1=0.06
No dataSAT (TO)
f=25860
TT=1800.2
T1=918.34
No dataSAT (TO)
f=28204
TT=1800.05
T1=1800.4
OPT
f=23978
TT=195.184
T1=135.65
? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=26101
TT=1800.67
T1=965.65
SAT (TO)
f=28158
TT=1800.06
T1=1322.18
SAT (TO)
f=29044
TT=1800.09
T1=1710.39
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir04_trarea_ac.opb
OPT
f=41202
TT=244.379
T1=216.13
No dataNo dataNo dataOPT
f=41202
TT=467.042
T1=248.36
OPT
f=41202
TT=244.379
T1=216.34
OPT
f=41202
TT=473.798
T1=249.69
OPT
f=41202
TT=244.51
T1=216.13
? (problem)

TT=307.27

? (problem)

TT=156.16

? (TO)

TT=1800.44

? (problem)

TT=154.87

OPT
f=41202
TT=0.256
T1=0.23
SAT (TO)
f=46032
TT=1800.1
T1=0.05
No dataNo dataSAT (TO)
f=54052
TT=1800.44
T1=0.67
No dataSAT (TO)
f=54052
TT=1800.65
T1=0.64
No dataNo dataNo dataSAT (TO)
f=46240
TT=1800.19
T1=132.62
OPT
f=41202
TT=0.163
T1=0.15
No dataSAT (TO)
f=48835
TT=1800.04
T1=215.55
No dataSAT (TO)
f=46032
TT=1800.1
T1=1800.5
OPT
f=41202
TT=482.378
T1=353.43
? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=49380
TT=1800.11
T1=139.29
SAT (TO)
f=52440
TT=1800.09
T1=11.11
SAT (TO)
f=55081
TT=1800.04
T1=0.35
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir05_trarea_ac.opb
OPT
f=47342
TT=86.243
T1=65.5
No dataNo dataNo dataOPT
f=47342
TT=89.532
T1=73.69
OPT
f=47342
TT=86.243
T1=65.5
OPT
f=47342
TT=93.306
T1=76.65
OPT
f=47342
TT=87.81
T1=66.59
? (problem)

TT=56.58

? (problem)

TT=35.28

? (problem)

TT=61.94

? (problem)

TT=35.56

OPT
f=47342
TT=0.083
T1=0.08
SAT (TO)
f=52169
TT=1800.07
T1=0.03
No dataNo dataSAT (TO)
f=54696
TT=1800.07
T1=0.28
No dataSAT (TO)
f=54696
TT=1800.23
T1=0.28
No dataNo dataNo dataSAT (TO)
f=50679
TT=1801.1
T1=155.04
OPT
f=47342
TT=0.063
T1=0.05
No dataSAT (TO)
f=50679
TT=1800.12
T1=146.81
No dataSAT (TO)
f=52169
TT=1800.06
T1=1800.4
OPT
f=47342
TT=91.751
T1=75.71
? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=51128
TT=1800.06
T1=30.29
SAT (TO)
f=54696
TT=1800.01
T1=0.28
SAT (TO)
f=58785
TT=1800.54
T1=0.29
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir06_trarea_ac.opb
SAT
f=37056
TT=1800.01
T1=0.13
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (problem)

TT=1169.73

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (problem)

TT=1169.17

? (TO)

TT=1800.03

? (problem)

TT=1104.41

SAT (TO)
f=37042
TT=1800.11
T1=0.05
SAT (TO)
f=37056
TT=1800.08
T1=0.13
No dataNo dataSAT (TO)
f=47205
TT=1800.46
T1=0.71
No dataSAT (TO)
f=47263
TT=1801.98
T1=0.61
No dataNo dataNo dataSAT (TO)
f=41647
TT=1800.14
T1=791.88
OPT
f=33456
TT=0.39
T1=0.37
No dataSAT (TO)
f=40984
TT=1800.2
T1=652.61
No dataSAT (TO)
f=37056
TT=1800.01
T1=1800.5
? (TO)

TT=1800

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=40056
TT=1800.38
T1=509.09
SAT (TO)
f=46083
TT=1800.58
T1=0.6
SAT (TO)
f=45010
TT=1800.08
T1=0.41
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir07_trarea_ac.opb
SAT
f=57179
TT=1800.17
T1=956.32
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (problem)

TT=0.067

? (problem)

TT=0.074

? (problem)

TT=0.069

? (problem)

TT=0.073

? (problem)

TT=0.068

? (problem)

TT=0.069

SAT (TO)
f=59123
TT=1800.02
T1=678.19
SAT (TO)
f=63286
TT=1800.04
T1=0.07
No dataNo data? (TO)

TT=1801.99

No dataSAT (TO)
f=70079
TT=1800.32
T1=0.56
No dataNo dataNo dataSAT (TO)
f=57798
TT=1800.69
T1=572.83
OPT
f=50162
TT=0.547
T1=0.53
No dataSAT (TO)
f=57179
TT=1800.17
T1=956.32
No dataSAT (TO)
f=63286
TT=1800.08
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=60921
TT=1800.01
T1=332.44
SAT (TO)
f=68835
TT=1800.65
T1=2.08
SAT (TO)
f=68187
TT=1800.52
T1=0.36
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir08_trarea_ac.opb
SAT
f=89369
TT=1800.05
T1=0.79
No dataNo dataNo data? (TO)

TT=1800.97

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.1

SAT (TO)
f=86647
TT=1800.07
T1=0.49
SAT (TO)
f=89369
TT=1800.09
T1=0.79
No dataNo dataSAT (TO)
f=95684
TT=1800.79
T1=2.85
No dataSAT (TO)
f=95684
TT=1800.93
T1=2.17
No dataNo dataNo dataSAT (TO)
f=90114
TT=1800.13
T1=891.62
OPT
f=70311
TT=6.286
T1=6.16
No dataSAT (TO)
f=93024
TT=1800.8
T1=260.35
No dataSAT (TO)
f=89369
TT=1800.05
T1=1800.71
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=92622
TT=1800.07
T1=831.92
SAT (TO)
f=96444
TT=1800.82
T1=1.09
SAT (TO)
f=101312
TT=1800.06
T1=0.87
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir09_trarea_ac.opb
SAT
f=57391
TT=1800.5
T1=390.44
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (problem)

TT=0.119

? (problem)

TT=0.124

? (problem)

TT=0.122

? (problem)

TT=0.118

? (problem)

TT=0.124

? (problem)

TT=0.124

SAT (TO)
f=63195
TT=1800.1
T1=1280.85
SAT (TO)
f=73146
TT=1800.1
T1=0.13
No dataNo dataSAT (TO)
f=64983
TT=1800.01
T1=0.9
No dataSAT (TO)
f=64983
TT=1800.96
T1=0.72
No dataNo dataNo dataSAT (TO)
f=61123
TT=1801.6
T1=141.62
OPT
f=50769
TT=5.946
T1=5.92
No dataSAT (TO)
f=58635
TT=1800.59
T1=179.21
No dataSAT (TO)
f=73146
TT=1800.08
T1=1800.71
? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=57391
TT=1800.5
T1=390.44
SAT (TO)
f=66285
TT=1800.05
T1=0.56
SAT (TO)
f=73258
TT=1800.64
T1=0.48
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
normalized-PB07/OPT-BIGINT-LIN/submittedPB07/
aksoy/trarea_ac/normalized-fir10_trarea_ac.opb
SAT
f=93811
TT=1800.08
T1=0.85
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.11

SAT (TO)
f=93922
TT=1800.05
T1=0.44
SAT (TO)
f=93811
TT=1800.08
T1=0.85
No dataNo dataSAT (TO)
f=105488
TT=1800.95
T1=2.32
No dataSAT (TO)
f=105488
TT=1800.03
T1=1.86
No dataNo dataNo dataSAT (TO)
f=99072
TT=1800.56
T1=961.2
OPT
f=73649
TT=28.808
T1=28.69
No dataSAT (TO)
f=96552
TT=1800.68
T1=516.84
No dataSAT (TO)
f=93811
TT=1800.1
T1=1800.61
? (TO)

TT=1800.04

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=100432
TT=1800.32
T1=895.62
SAT (TO)
f=105498
TT=1800.01
T1=1.01
SAT (TO)
f=117120
TT=1800.82
T1=0.92
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir01_area_delay.opb
OPT
f=5
TT=0.002
T1=0
OPT
f=5
TT=0.004
T1=0
No dataOPT
f=5
TT=0.004
T1=0
OPT
f=5
TT=0.07
T1=0.05
OPT
f=5
TT=0.067
T1=0.05
? (problem)

TT=0.014

? (problem)

TT=0.019

? (problem)

TT=0.008

? (problem)

TT=0.021

? (problem)

TT=0.013

? (problem)

TT=0.022

OPT
f=5
TT=0.007
T1=0.01
OPT
f=5
TT=0.006
T1=0
OPT
f=5
TT=0.111
T1=0.12
OPT
f=5
TT=0.003
T1=0
OPT
f=5
TT=0.415
T1=0.16
OPT
f=5
TT=0.004
T1=0
OPT
f=5
TT=0.455
T1=0.14
OPT
f=5
TT=0.016
T1=0.01
No dataOPT
f=5
TT=0.009
T1=0
OPT
f=5
TT=0.535
T1=1.15
OPT
f=5
TT=0.018
T1=0.01
No dataOPT
f=5
TT=0.555
T1=0.76
OPT
f=5
TT=0.025
T1=0.02
OPT
f=5
TT=0.004
T1=0
OPT
f=5
TT=0.029
T1=0.02
OPT
f=5
TT=0.025
T1=0.02
No dataNo dataNo dataOPT
f=5
TT=0.002
T1=0
No dataNo dataOPT
f=5
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=5
TT=0.525
T1=0.67
OPT
f=5
TT=0.375
T1=0.15
OPT
f=5
TT=0.424
T1=0.16
OPT
f=5
TT=0.028
T1=0.02
OPT
f=5
TT=0.029
T1=0.02
OPT
f=5
TT=0.028
T1=0.02
OPT
f=5
TT=0.014
T1=0
OPT
f=5
TT=0.016
T1=0
OPT
f=5
TT=0.003
T1=0
No dataNo dataOPT
f=5
TT=0.002
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir02_area_delay.opb
OPT
f=8
TT=0.005
T1=0.01
OPT
f=8
TT=0.164
T1=0.16
No dataOPT
f=8
TT=2.307
T1=1.08
OPT
f=8
TT=0.197
T1=0.16
OPT
f=8
TT=0.137
T1=0.13
OPT
f=8
TT=0.117
T1=0.11
? (problem)

TT=0.038

? (problem)

TT=0.046

? (problem)

TT=0.04

? (problem)

TT=0.05

? (problem)

TT=0.04

OPT
f=8
TT=0.065
T1=0.06
OPT
f=8
TT=0.179
T1=0.12
OPT
f=8
TT=11.397
T1=2.85
OPT
f=8
TT=0.327
T1=0.27
OPT
f=8
TT=6.163
T1=3.46
OPT
f=8
TT=0.164
T1=0.16
OPT
f=8
TT=8.093
T1=4.61
OPT
f=8
TT=0.12
T1=0.11
No dataOPT
f=8
TT=0.041
T1=0.04
OPT
f=8
TT=8.435
T1=6.28
OPT
f=8
TT=0.114
T1=0.11
No dataOPT
f=8
TT=4.757
T1=3.29
OPT
f=8
TT=0.137
T1=0.12
OPT
f=8
TT=0.06
T1=0.06
OPT
f=8
TT=0.156
T1=0.13
OPT
f=8
TT=0.233
T1=0.21
No dataNo dataNo dataOPT
f=8
TT=0.007
T1=0.01
No dataNo dataOPT
f=8
TT=0.007
T1=0.01
No dataNo dataNo dataOPT
f=8
TT=9.093
T1=3.31
OPT
f=8
TT=8.375
T1=4.48
OPT
f=8
TT=3.882
T1=0.27
OPT
f=8
TT=0.115
T1=0.1
OPT
f=8
TT=0.117
T1=0.1
OPT
f=8
TT=0.074
T1=0.06
OPT
f=8
TT=11.634
T1=0.05
OPT
f=8
TT=11.912
T1=0.05
OPT
f=8
TT=0.006
T1=0.01
No dataNo dataOPT
f=8
TT=0.005
T1=0.01
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir03_area_delay.opb
OPT
f=10
TT=0.095
T1=0.08
SAT
f=11
TT=1798
T1=0.05
No dataSAT (TO)
f=10
TT=1800.03
T1=454.59
OPT
f=10
TT=25.094
T1=25.09
OPT
f=10
TT=25.935
T1=26.01
OPT
f=10
TT=25.206
T1=25.21
? (problem)

TT=0.144

OPT
f=10
TT=8.292
T1=4.48
? (problem)

TT=0.136

OPT
f=10
TT=8.001
T1=4.41
? (problem)

TT=0.151

SAT (TO)
f=11
TT=1800.11
T1=0.06
OPT
f=10
TT=69.923
T1=62.84
SAT (TO)
f=13
TT=1802.1
T1=7.12
SAT
f=10
TT=1783
T1=1718.53
SAT (TO)
f=14
TT=1800.09
T1=1062.92
OPT
f=10
TT=993.885
T1=686.14
SAT (TO)
f=14
TT=1800.88
T1=50.8
OPT
f=10
TT=11.404
T1=11.38
No dataOPT
f=10
TT=0.483
T1=0.46
OPT
f=10
TT=1790.9
T1=28.47
OPT
f=10
TT=1.689
T1=1.67
No dataOPT
f=10
TT=53.086
T1=14.48
OPT
f=10
TT=1.041
T1=1.01
OPT
f=10
TT=58.798
T1=58.8
OPT
f=10
TT=14.748
T1=14.75
OPT
f=10
TT=15.284
T1=8.44
No dataNo dataNo dataOPT
f=10
TT=0.169
T1=0.09
No dataNo dataOPT
f=10
TT=0.17
T1=0.09
No dataNo dataNo dataSAT (TO)
f=10
TT=1800.04
T1=68.91
SAT (TO)
f=12
TT=1800.1
T1=812.17
SAT (TO)
f=13
TT=1800.57
T1=690.35
OPT
f=10
TT=0.735
T1=0.7
OPT
f=10
TT=0.72
T1=0.69
OPT
f=10
TT=0.634
T1=0.6
? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=10
TT=0.098
T1=0.09
No dataNo dataOPT
f=10
TT=0.095
T1=0.08
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir04_area_delay.opb
OPT
f=12
TT=0.077
T1=0.05
OPT
f=12
TT=0.383
T1=0.33
No dataSAT (TO)
f=12
TT=1800.1
T1=341.82
OPT
f=12
TT=1.981
T1=1.86
OPT
f=12
TT=0.377
T1=0.17
? (problem)

TT=0.033

? (problem)

TT=0.039

? (problem)

TT=0.031

? (problem)

TT=0.034

? (problem)

TT=0.033

? (problem)

TT=0.04

OPT
f=12
TT=0.116
T1=0.07
OPT
f=12
TT=0.699
T1=0.43
SAT (TO)
f=18
TT=1802.1
T1=10.68
OPT
f=12
TT=11.481
T1=8.88
SAT (TO)
f=15
TT=1800.04
T1=38.62
OPT
f=12
TT=0.382
T1=0.33
SAT (TO)
f=15
TT=1800.45
T1=515.84
OPT
f=12
TT=1.492
T1=1.48
No dataOPT
f=12
TT=0.077
T1=0.07
SAT (TO)
f=12
TT=1800.06
T1=7.28
OPT
f=12
TT=0.341
T1=0.33
No dataOPT
f=12
TT=88.873
T1=3.81
OPT
f=12
TT=0.694
T1=0.68
OPT
f=12
TT=0.308
T1=0.3
OPT
f=12
TT=0.905
T1=0.8
OPT
f=12
TT=1.096
T1=0.98
No dataNo dataNo dataOPT
f=12
TT=0.128
T1=0.05
No dataNo dataOPT
f=12
TT=0.107
T1=0.05
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.49
T1=4.83
SAT (TO)
f=14
TT=1800.71
T1=9.3
SAT (TO)
f=13
TT=1800.5
T1=1486.81
OPT
f=12
TT=0.573
T1=0.55
OPT
f=12
TT=0.574
T1=0.55
OPT
f=12
TT=0.519
T1=0.5
? (TO)

TT=1800.02

? (TO)

TT=1800.01

OPT
f=12
TT=0.157
T1=0.15
No dataNo dataOPT
f=12
TT=0.157
T1=0.15
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir05_area_delay.opb
OPT
f=14
TT=0.592
T1=0.48
OPT
f=14
TT=17.862
T1=3.69
No dataSAT (TO)
f=14
TT=1800.03
T1=223.6
OPT
f=14
TT=231.124
T1=231.17
OPT
f=14
TT=142.424
T1=142.45
? (problem)

TT=130.9

? (problem)

TT=0.136

? (problem)

TT=0.425

? (problem)

TT=0.135

? (problem)

TT=0.452

? (problem)

TT=0.131

OPT
f=14
TT=16.885
T1=0.97
OPT
f=14
TT=555.965
T1=24
SAT (TO)
f=19
TT=1802.1
T1=420.56
SAT
f=14
TT=1783.01
T1=573.67
SAT (TO)
f=17
TT=1800.43
T1=525.33
OPT
f=14
TT=17.799
T1=3.67
SAT (TO)
f=16
TT=1800.86
T1=465.17
OPT
f=14
TT=5.94
T1=5.91
No dataOPT
f=14
TT=0.791
T1=0.77
SAT (TO)
f=14
TT=1800.01
T1=262.31
OPT
f=14
TT=15.255
T1=11.01
No dataSAT (TO)
f=14
TT=1800.71
T1=189.34
OPT
f=14
TT=8.213
T1=8.17
OPT
f=14
TT=564.489
T1=564.58
OPT
f=14
TT=294.797
T1=294.96
OPT
f=14
TT=302.643
T1=77.47
No dataNo dataNo dataOPT
f=14
TT=0.989
T1=0.5
No dataNo dataOPT
f=14
TT=0.951
T1=0.48
No dataNo dataNo dataSAT (TO)
f=14
TT=1800.18
T1=90.69
SAT (TO)
f=17
TT=1800.07
T1=10.55
SAT (TO)
f=16
TT=1800.6
T1=748.42
OPT
f=14
TT=6.578
T1=5.29
OPT
f=14
TT=6.569
T1=5.28
OPT
f=14
TT=6.449
T1=5.2
? (TO)

TT=1800.02

? (TO)

TT=1800.1

OPT
f=14
TT=0.596
T1=0.59
No dataNo dataOPT
f=14
TT=0.592
T1=0.59
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir06_area_delay.opb
OPT
f=15
TT=0.327
T1=0.32
SAT
f=15
TT=1798.02
T1=29.34
No dataSAT (TO)
f=18
TT=1800.03
T1=0.04
OPT
f=15
TT=1366.81
T1=1367.02
OPT
f=15
TT=860.27
T1=207.12
OPT
f=15
TT=799.677
T1=799.8
? (problem)

TT=0.209

OPT
f=15
TT=717.87
T1=102.72
? (problem)

TT=0.213

OPT
f=15
TT=695.559
T1=101.18
? (problem)

TT=0.225

SAT (TO)
f=16
TT=1800.11
T1=0.09
SAT (TO)
f=15
TT=1800.1
T1=316.45
SAT (TO)
f=25
TT=1802.11
T1=1.69
SAT
f=16
TT=1783
T1=490.17
SAT (TO)
f=19
TT=1800.02
T1=0.65
SAT
f=16
TT=1798
T1=0.08
SAT (TO)
f=19
TT=1800.51
T1=0.66
OPT
f=15
TT=48.107
T1=48.08
No dataOPT
f=15
TT=1.106
T1=1.08
SAT (TO)
f=15
TT=1800.11
T1=798.24
OPT
f=15
TT=48.415
T1=48.4
No dataSAT (TO)
f=15
TT=1800.59
T1=69.11
OPT
f=15
TT=11.456
T1=11.42
SAT (TO)
f=15
TT=1800.09
T1=1800.4
OPT
f=15
TT=1123.78
T1=1123.98
OPT
f=15
TT=1027.55
T1=411.34
No dataNo dataNo dataOPT
f=15
TT=1.025
T1=0.53
No dataNo dataOPT
f=15
TT=0.924
T1=0.48
No dataNo dataNo dataSAT (TO)
f=15
TT=1800.58
T1=721.79
SAT (TO)
f=19
TT=1800.7
T1=0.58
SAT (TO)
f=20
TT=1800.06
T1=0.48
OPT
f=15
TT=17.151
T1=17.1
OPT
f=15
TT=16.613
T1=16.57
OPT
f=15
TT=26.045
T1=26
? (TO)

TT=1800.1

? (TO)

TT=1800.02

OPT
f=15
TT=0.34
T1=0.34
No dataNo dataOPT
f=15
TT=0.327
T1=0.32
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir07_area_delay.opb
OPT
f=16
TT=4.756
T1=4.64
SAT (TO)
f=16
TT=1800.04
T1=834.97
No dataSAT (TO)
f=23
TT=1800.02
T1=0.16
? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (problem)

TT=0.513

? (problem)

TT=77.61

? (problem)

TT=0.509

? (problem)

TT=89.47

? (problem)

TT=0.527

OPT
f=16
TT=223.772
T1=49.63
SAT (TO)
f=20
TT=1800.07
T1=0.79
SAT (TO)
f=164
TT=1802.06
T1=42.33
SAT
f=23
TT=1783.01
T1=23.41
SAT (TO)
f=27
TT=1800.65
T1=1.16
SAT (TO)
f=16
TT=1800.08
T1=865.27
SAT (TO)
f=27
TT=1800.83
T1=1.07
OPT
f=16
TT=26.299
T1=26.17
No dataOPT
f=16
TT=5.195
T1=5.01
SAT (TO)
f=18
TT=1800.93
T1=645.29
OPT
f=16
TT=4.756
T1=4.64
No dataSAT (TO)
f=16
TT=1800.38
T1=668.44
OPT
f=16
TT=32.712
T1=32.56
SAT (TO)
f=19
TT=1800.04
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.12

No dataNo dataNo dataOPT
f=16
TT=103.002
T1=51.58
No dataNo dataOPT
f=16
TT=82.797
T1=41.47
No dataNo dataNo dataSAT (TO)
f=20
TT=1802.04
T1=648.3
SAT (TO)
f=27
TT=1800.07
T1=0.89
SAT (TO)
f=29
TT=1800.02
T1=0.72
OPT
f=16
TT=7.995
T1=7.85
OPT
f=16
TT=8.959
T1=8.76
OPT
f=16
TT=8.968
T1=8.77
? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=16
TT=37.39
T1=37.43
No dataNo dataOPT
f=16
TT=37.294
T1=37.38
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir08_area_delay.opb
OPT
f=23
TT=425.483
T1=407.96
SAT
f=31
TT=1798.35
T1=81.28
No data? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.04

SAT (TO)
f=31
TT=1800.14
T1=58.53
Signal

TT=8.724

SAT (TO)
f=879
TT=1801.9
T1=1743.01
SAT
f=40
TT=1783.07
T1=127.04
SAT (TO)
f=42
TT=1804.07
T1=14.06
SAT
f=31
TT=1798.14
T1=59.2
SAT (TO)
f=42
TT=1800.83
T1=10.34
OPT
f=23
TT=1730.71
T1=1729.46
No dataOPT
f=23
TT=425.483
T1=407.96
SAT (TO)
f=39
TT=1800.65
T1=58.35
SAT
f=27
TT=1791.41
T1=94.08
No dataSAT (TO)
f=38
TT=1800.85
T1=235.52
OPT
f=23
TT=1558.46
T1=1557.03
No Cert.

TT=1800.03

? (TO)

TT=1800.13

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=32
TT=1800.21
T1=901.31
No dataNo dataSAT (TO)
f=31
TT=1800.6
T1=901.21
No dataNo dataNo dataSAT (TO)
f=43
TT=1800.01
T1=4.87
SAT (TO)
f=43
TT=1801.04
T1=3.44
SAT (TO)
f=47
TT=1800.09
T1=3.26
SAT
f=28
TT=1799.02
T1=747.66
OPT
f=23
TT=1509.31
T1=1507.51
OPT
f=23
TT=1509.17
T1=1507.46
? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.08

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir09_area_delay.opb
OPT
f=17
TT=7.268
T1=7.05
SAT (TO)
f=17
TT=1800.09
T1=844.08
No dataSAT (TO)
f=21
TT=1800.1
T1=0.15
? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (problem)

TT=77.97

? (problem)

TT=0.571

? (problem)

TT=102.83

? (problem)

TT=0.559

? (problem)

TT=89.58

? (problem)

TT=0.545

OPT
f=17
TT=1080.41
T1=110.33
SAT (TO)
f=23
TT=1800.04
T1=0.89
SAT (TO)
f=135
TT=1802.1
T1=1695.27
SAT
f=25
TT=1783.01
T1=121.23
SAT (TO)
f=25
TT=1800.1
T1=1.1
SAT (TO)
f=17
TT=1800.09
T1=847.4
SAT (TO)
f=24
TT=1800.77
T1=1.09
OPT
f=17
TT=54.727
T1=54.59
No dataOPT
f=17
TT=7.268
T1=7.05
SAT (TO)
f=21
TT=1800.21
T1=554.55
OPT
f=17
TT=98.956
T1=98.88
No dataSAT (TO)
f=21
TT=1800.11
T1=569.56
OPT
f=17
TT=55.68
T1=44.88
SAT (TO)
f=23
TT=1800
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=20
TT=1800.47
T1=900.31
No dataNo dataSAT (TO)
f=21
TT=1800.06
T1=900.41
No dataNo dataNo dataSAT (TO)
f=22
TT=1800.15
T1=186.1
SAT (TO)
f=24
TT=1800.06
T1=0.93
SAT (TO)
f=30
TT=1800.72
T1=0.76
OPT
f=17
TT=134.545
T1=134.05
OPT
f=17
TT=133.23
T1=132.8
OPT
f=17
TT=132.987
T1=132.58
? (TO)

TT=1800.08

? (TO)

TT=1800.02

OPT
f=17
TT=1216.93
T1=1217.22
No dataNo dataOPT
f=17
TT=1217.72
T1=1218.05
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_delay/
normalized-fir10_area_delay.opb
OPT
f=27
TT=71.87
T1=40.93
SAT
f=37
TT=1798.05
T1=5.12
No data? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (problem)

TT=1.84

? (TO)

TT=1800.08

? (problem)

TT=1.75

? (TO)

TT=1800.09

? (problem)

TT=1.82

SAT (TO)
f=37
TT=1800.1
T1=4.81
SAT (TO)
f=38
TT=1800.16
T1=3.11
SAT (TO)
f=486
TT=1802.02
T1=754.74
SAT
f=44
TT=1783.02
T1=20.42
SAT (TO)
f=48
TT=1801.11
T1=4.68
SAT
f=37
TT=1798.04
T1=5.19
SAT (TO)
f=48
TT=1800.98
T1=3.45
OPT
f=27
TT=610.55
T1=610.33
No dataOPT
f=27
TT=71.87
T1=69.09
SAT (TO)
f=39
TT=1800.23
T1=664.2
OPT
f=27
TT=748.529
T1=748.41
No dataSAT (TO)
f=42
TT=1800.46
T1=826.99
OPT
f=27
TT=1158.64
T1=1158.17
No Cert.

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=33
TT=1800.06
T1=900.61
No dataNo dataOPT
f=27
TT=81.259
T1=40.93
No dataNo dataNo dataSAT (TO)
f=47
TT=1800.03
T1=655.64
SAT (TO)
f=49
TT=1800.08
T1=1.87
SAT (TO)
f=43
TT=1800.05
T1=1.56
OPT
f=27
TT=470.535
T1=470.33
OPT
f=27
TT=588.216
T1=587.91
OPT
f=27
TT=530.666
T1=530.44
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=27
TT=1222.55
T1=1222.83
No dataNo dataOPT
f=27
TT=1214.58
T1=1214.83
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir01_area_opers.opb
OPT
f=10
TT=0.002
T1=0
OPT
f=10
TT=0.005
T1=0
No dataOPT
f=10
TT=0.07
T1=0
OPT
f=10
TT=0.078
T1=0.07
OPT
f=10
TT=0.065
T1=0.03
OPT
f=10
TT=0.027
T1=0.02
OPT
f=10
TT=0.035
T1=0.02
OPT
f=10
TT=0.029
T1=0.02
OPT
f=10
TT=0.022
T1=0.02
OPT
f=10
TT=0.032
T1=0.02
OPT
f=10
TT=0.025
T1=0.02
OPT
f=10
TT=0.008
T1=0
OPT
f=10
TT=0.015
T1=0
OPT
f=10
TT=0.38
T1=0.03
OPT
f=10
TT=0.006
T1=0.01
OPT
f=10
TT=0.825
T1=0.3
OPT
f=10
TT=0.005
T1=0
OPT
f=10
TT=1.123
T1=0.41
OPT
f=10
TT=0.022
T1=0.01
No dataOPT
f=10
TT=0.008
T1=0
OPT
f=10
TT=1.154
T1=3.17
OPT
f=10
TT=0.022
T1=0.01
No dataOPT
f=10
TT=1.292
T1=1.69
OPT
f=10
TT=0.021
T1=0.01
OPT
f=10
TT=0.006
T1=0
OPT
f=10
TT=0.036
T1=0.03
OPT
f=10
TT=0.044
T1=0.03
No dataNo dataNo dataOPT
f=10
TT=0.002
T1=0
No dataNo dataOPT
f=10
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=10
TT=1.484
T1=1.67
OPT
f=10
TT=1.065
T1=0.39
OPT
f=10
TT=1.233
T1=0.17
OPT
f=10
TT=0.024
T1=0.02
OPT
f=10
TT=0.029
T1=0.02
OPT
f=10
TT=0.024
T1=0.02
OPT
f=10
TT=0.687
T1=0
OPT
f=10
TT=0.682
T1=0
OPT
f=10
TT=0.003
T1=0
No dataNo dataOPT
f=10
TT=0.002
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir02_area_opers.opb
OPT
f=18
TT=0.038
T1=0.01
OPT
f=18
TT=0.654
T1=0.64
No dataSAT (TO)
f=18
TT=1800.03
T1=0.01
OPT
f=18
TT=0.396
T1=0.36
OPT
f=18
TT=0.188
T1=0.06
OPT
f=18
TT=0.27
T1=0.23
OPT
f=18
TT=0.148
T1=0.05
OPT
f=18
TT=0.464
T1=0.42
OPT
f=18
TT=0.086
T1=0.05
OPT
f=18
TT=0.474
T1=0.43
OPT
f=18
TT=0.084
T1=0.05
OPT
f=18
TT=0.13
T1=0.13
OPT
f=18
TT=0.303
T1=0.04
SAT (TO)
f=18
TT=1802.13
T1=0.15
OPT
f=18
TT=7.353
T1=1.31
SAT (TO)
f=25
TT=1800.09
T1=0.35
OPT
f=18
TT=0.646
T1=0.63
SAT (TO)
f=25
TT=1800.41
T1=0.35
OPT
f=18
TT=0.128
T1=0.12
No dataOPT
f=18
TT=0.092
T1=0.08
SAT (TO)
f=18
TT=1800.57
T1=306.03
OPT
f=18
TT=0.083
T1=0.07
No dataSAT (TO)
f=18
TT=1800.18
T1=45.03
OPT
f=18
TT=0.088
T1=0.07
OPT
f=18
TT=0.049
T1=0.04
OPT
f=18
TT=0.256
T1=0.22
OPT
f=18
TT=0.519
T1=0.48
No dataNo dataNo dataOPT
f=18
TT=0.071
T1=0.03
No dataNo dataOPT
f=18
TT=0.07
T1=0.03
No dataNo dataNo dataSAT (TO)
f=18
TT=1800.06
T1=60.47
SAT (TO)
f=21
TT=1800.07
T1=310.25
SAT (TO)
f=18
TT=1800.5
T1=0.31
OPT
f=18
TT=0.081
T1=0.07
OPT
f=18
TT=0.097
T1=0.08
OPT
f=18
TT=0.088
T1=0.07
? (TO)

TT=1800.11

? (TO)

TT=1800.11

OPT
f=18
TT=0.038
T1=0.03
No dataNo dataOPT
f=18
TT=0.038
T1=0.03
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir03_area_opers.opb
OPT
f=17
TT=0.663
T1=0.35
OPT
f=17
TT=13.886
T1=13.81
No dataSAT (TO)
f=20
TT=1800.03
T1=0.03
OPT
f=17
TT=2.688
T1=2.68
OPT
f=17
TT=2.295
T1=2.29
OPT
f=17
TT=2.143
T1=2.13
OPT
f=17
TT=2.125
T1=2.12
OPT
f=17
TT=2.322
T1=1.69
OPT
f=17
TT=1.756
T1=1.34
OPT
f=17
TT=2.57
T1=1.86
OPT
f=17
TT=1.736
T1=1.46
OPT
f=17
TT=5.213
T1=4.97
OPT
f=17
TT=83.137
T1=39.31
SAT (TO)
f=18
TT=1802.12
T1=0.98
SAT
f=20
TT=1783.01
T1=39.75
SAT (TO)
f=27
TT=1800.51
T1=0.68
OPT
f=17
TT=13.66
T1=13.58
SAT (TO)
f=27
TT=1800.8
T1=0.66
OPT
f=17
TT=17.282
T1=8.67
No dataOPT
f=17
TT=1.319
T1=1.26
SAT (TO)
f=19
TT=1801.13
T1=155.63
OPT
f=17
TT=3.209
T1=3.16
No dataSAT (TO)
f=18
TT=1800.72
T1=145.74
OPT
f=17
TT=5.84
T1=5.8
OPT
f=17
TT=77.695
T1=77.72
OPT
f=17
TT=1.859
T1=1.86
OPT
f=17
TT=2.139
T1=1.67
No dataNo dataNo dataOPT
f=17
TT=0.642
T1=0.34
No dataNo dataOPT
f=17
TT=0.663
T1=0.35
No dataNo dataNo dataSAT (TO)
f=19
TT=1800.68
T1=351.55
SAT (TO)
f=24
TT=1800.06
T1=487.85
SAT (TO)
f=19
TT=1800.05
T1=0.5
OPT
f=17
TT=6.694
T1=6.65
OPT
f=17
TT=6.843
T1=6.8
OPT
f=17
TT=5.976
T1=5.94
? (TO)

TT=1800.08

? (TO)

TT=1800.09

OPT
f=17
TT=2.236
T1=2.23
No dataNo dataOPT
f=17
TT=2.235
T1=2.23
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir04_area_opers.opb
OPT
f=29
TT=0.058
T1=0.04
OPT
f=29
TT=0.167
T1=0.16
No dataSAT (TO)
f=30
TT=1800.02
T1=0
OPT
f=29
TT=0.551
T1=0.41
OPT
f=29
TT=0.251
T1=0.06
? (problem)

TT=0.074

OPT
f=29
TT=0.216
T1=0.05
OPT
f=29
TT=1.083
T1=1.01
OPT
f=29
TT=0.107
T1=0.05
OPT
f=29
TT=1.112
T1=1.04
OPT
f=29
TT=0.108
T1=0.05
OPT
f=29
TT=0.161
T1=0.16
OPT
f=29
TT=0.459
T1=0.04
SAT (TO)
f=29
TT=1802.13
T1=0.16
OPT
f=29
TT=24.696
T1=3.09
SAT (TO)
f=37
TT=1800.43
T1=0.33
OPT
f=29
TT=0.157
T1=0.15
SAT (TO)
f=37
TT=1800.1
T1=0.31
OPT
f=29
TT=0.223
T1=0.21
No dataOPT
f=29
TT=0.115
T1=0.11
SAT (TO)
f=29
TT=1800.02
T1=75.5
OPT
f=29
TT=0.137
T1=0.12
No dataSAT (TO)
f=29
TT=1800.06
T1=48.23
OPT
f=29
TT=0.131
T1=0.12
OPT
f=29
TT=0.098
T1=0.09
OPT
f=29
TT=0.479
T1=0.48
OPT
f=29
TT=0.99
T1=0.92
No dataNo dataNo dataOPT
f=29
TT=0.11
T1=0.05
No dataNo dataOPT
f=29
TT=0.11
T1=0.05
No dataNo dataNo dataSAT (TO)
f=30
TT=1800.13
T1=642.99
SAT (TO)
f=36
TT=1800.05
T1=1076.25
SAT (TO)
f=29
TT=1800.71
T1=0.29
OPT
f=29
TT=0.242
T1=0.23
OPT
f=29
TT=0.244
T1=0.23
OPT
f=29
TT=0.11
T1=0.1
? (TO)

TT=1800.02

? (TO)

TT=1800.01

OPT
f=29
TT=0.059
T1=0.05
No dataNo dataOPT
f=29
TT=0.058
T1=0.05
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir05_area_opers.opb
OPT
f=35
TT=0.291
T1=0.03
OPT
f=35
TT=2.521
T1=2.52
No dataSAT (TO)
f=35
TT=1800.03
T1=0.03
OPT
f=35
TT=2.665
T1=1.58
OPT
f=35
TT=1.516
T1=0.2
OPT
f=35
TT=2.329
T1=1.27
OPT
f=35
TT=1.688
T1=0.19
OPT
f=35
TT=3.571
T1=3.35
OPT
f=35
TT=0.518
T1=0.18
OPT
f=35
TT=4.138
T1=3.69
OPT
f=35
TT=0.517
T1=0.18
OPT
f=35
TT=2.527
T1=2.52
SAT (TO)
f=35
TT=1800.11
T1=0.18
SAT (TO)
f=35
TT=1802.12
T1=0.83
SAT
f=39
TT=1783.01
T1=568.06
SAT (TO)
f=44
TT=1800.03
T1=0.63
OPT
f=35
TT=2.533
T1=2.53
SAT (TO)
f=44
TT=1800.41
T1=0.62
OPT
f=35
TT=0.406
T1=0.37
No dataOPT
f=35
TT=1.146
T1=1.1
SAT (TO)
f=38
TT=1800.01
T1=272.77
OPT
f=35
TT=0.3
T1=0.27
No dataSAT (TO)
f=37
TT=1800.1
T1=551.94
OPT
f=35
TT=0.303
T1=0.27
SAT (TO)
f=35
TT=1800.08
T1=1800.4
OPT
f=35
TT=2.388
T1=1.16
OPT
f=35
TT=3.311
T1=2.92
No dataNo dataNo dataOPT
f=35
TT=0.558
T1=0.29
No dataNo dataOPT
f=35
TT=0.558
T1=0.28
No dataNo dataNo dataSAT (TO)
f=36
TT=1800.04
T1=799.1
SAT (TO)
f=42
TT=1800.68
T1=1219.03
SAT (TO)
f=35
TT=1800.1
T1=0.47
OPT
f=35
TT=0.364
T1=0.32
OPT
f=35
TT=0.353
T1=0.31
OPT
f=35
TT=0.304
T1=0.27
? (TO)

TT=1800.08

? (TO)

TT=1800.1

OPT
f=35
TT=0.291
T1=0.28
No dataNo dataOPT
f=35
TT=0.291
T1=0.28
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir06_area_opers.opb
OPT
f=23
TT=2.631
T1=2.29
OPT
f=23
TT=422.737
T1=422.77
No data? (TO)

TT=1800.02

OPT
f=23
TT=7.081
T1=6.73
OPT
f=23
TT=2.631
T1=2.32
OPT
f=23
TT=6.395
T1=5.71
OPT
f=23
TT=2.805
T1=2.29
? (problem)

TT=73.6

OPT
f=23
TT=3.744
T1=3.32
? (problem)

TT=79.44

OPT
f=23
TT=3.779
T1=3.38
OPT
f=23
TT=8.506
T1=8.48
SAT (TO)
f=24
TT=1800.06
T1=1577.36
SAT (TO)
f=26
TT=1802.1
T1=2.07
SAT
f=31
TT=1783.01
T1=45.52
SAT (TO)
f=38
TT=1800.04
T1=0.91
OPT
f=23
TT=421.149
T1=421.17
SAT (TO)
f=38
TT=1800.29
T1=0.85
OPT
f=23
TT=7.984
T1=7.92
No dataOPT
f=23
TT=3.486
T1=3.34
SAT (TO)
f=28
TT=1801.31
T1=343.92
OPT
f=23
TT=11.678
T1=11.64
No dataSAT (TO)
f=27
TT=1800.65
T1=337.67
OPT
f=23
TT=6.596
T1=6.52
SAT (TO)
f=25
TT=1800.02
T1=1800.4
OPT
f=23
TT=6.077
T1=5.06
? (TO)

TT=1800.05

No dataNo dataNo dataOPT
f=23
TT=8.993
T1=4.53
No dataNo dataOPT
f=23
TT=9.19
T1=4.62
No dataNo dataNo dataSAT (TO)
f=25
TT=1800.59
T1=906.7
SAT (TO)
f=38
TT=1800.08
T1=0.71
SAT (TO)
f=26
TT=1800.04
T1=0.6
OPT
f=23
TT=5.399
T1=5.44
OPT
f=23
TT=5.25
T1=5.17
OPT
f=23
TT=5.214
T1=5.13
? (TO)

TT=1800.1

? (TO)

TT=1800.01

OPT
f=23
TT=21.09
T1=21.09
No dataNo dataOPT
f=23
TT=20.98
T1=21.03
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir07_area_opers.opb
OPT
f=32
TT=4.744
T1=2.45
SAT
f=34
TT=1798.01
T1=71.85
No data? (TO)

TT=1800.01

OPT
f=32
TT=1094.76
T1=1095.07
OPT
f=32
TT=20.421
T1=20.41
? (problem)

TT=0.582

? (problem)

TT=16.72

? (problem)

TT=0.582

? (problem)

TT=4.3

? (problem)

TT=0.602

? (problem)

TT=4.23

OPT
f=32
TT=37.778
T1=37.69
SAT (TO)
f=33
TT=1800.11
T1=0.78
SAT (TO)
f=35
TT=1802.11
T1=5.1
SAT
f=42
TT=1783.01
T1=44.69
SAT (TO)
f=52
TT=1800.82
T1=1.93
SAT
f=34
TT=1797.92
T1=73.64
SAT (TO)
f=52
TT=1800.01
T1=1.53
OPT
f=32
TT=20.771
T1=20.59
No dataOPT
f=32
TT=13.304
T1=12.75
SAT (TO)
f=42
TT=1800.04
T1=188.92
OPT
f=32
TT=30.961
T1=30.82
No dataSAT (TO)
f=42
TT=1800.81
T1=10.06
OPT
f=32
TT=15.679
T1=15.54
SAT (TO)
f=33
TT=1800.1
T1=1800.5
OPT
f=32
TT=540
T1=530.95
? (TO)

TT=1800.03

No dataNo dataNo dataOPT
f=32
TT=4.551
T1=2.35
No dataNo dataOPT
f=32
TT=4.744
T1=2.45
No dataNo dataNo dataSAT (TO)
f=37
TT=1800.04
T1=229.76
SAT (TO)
f=52
TT=1800.68
T1=1
SAT (TO)
f=33
TT=1800.72
T1=0.72
OPT
f=32
TT=30.093
T1=29.91
OPT
f=32
TT=32.366
T1=32.16
OPT
f=32
TT=30.092
T1=29.9
? (TO)

TT=1800.02

? (TO)

TT=1800.02

OPT
f=32
TT=41.78
T1=41.88
No dataNo dataOPT
f=32
TT=41.97
T1=42.01
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir08_area_opers.opb
OPT
f=48
TT=718.519
T1=717.04
? (TO)

TT=1800.12

No data? (TO)

TT=1800.02

? (TO)

TT=1800.14

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.43

? (TO)

TT=1800.09

Signal

TT=8.798

SAT (TO)
f=53
TT=1801.96
T1=434.13
SAT
f=70
TT=1783.05
T1=531.91
SAT (TO)
f=84
TT=1804.51
T1=30.71
? (TO)

TT=1800.03

SAT (TO)
f=83
TT=1800.02
T1=30.44
OPT
f=48
TT=610.629
T1=609.39
No dataOPT
f=48
TT=1209.72
T1=1163.3
SAT (TO)
f=62
TT=1800.48
T1=790.51
OPT
f=48
TT=718.519
T1=717.04
No dataSAT (TO)
f=62
TT=1800.91
T1=582.51
OPT
f=48
TT=1271.57
T1=1270.95
? (exit code)

TT=1.427

? (TO)

TT=1800.05

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=58
TT=1800.16
T1=901.11
No dataNo dataSAT (TO)
f=58
TT=1800.11
T1=901.11
No dataNo dataNo dataSAT (TO)
f=83
TT=1800.94
T1=113.7
SAT (TO)
f=83
TT=1801.06
T1=3.58
SAT (TO)
f=56
TT=1800.08
T1=3.06
OPT
f=48
TT=1048.64
T1=1047.98
OPT
f=48
TT=1252.42
T1=1251.51
OPT
f=48
TT=1034.13
T1=1033.45
? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo data?

TT=1799.71

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir09_area_opers.opb
OPT
f=34
TT=7.55
T1=7.37
OPT
f=34
TT=705.573
T1=704.72
No data? (TO)

TT=1800.01

OPT
f=34
TT=1518.51
T1=1518.77
OPT
f=34
TT=319.518
T1=278.58
? (problem)

TT=0.658

? (problem)

TT=0.59

? (problem)

TT=0.655

? (problem)

TT=0.584

? (problem)

TT=0.676

? (problem)

TT=0.576

OPT
f=34
TT=75.952
T1=74.79
SAT (TO)
f=43
TT=1800.04
T1=0.9
SAT (TO)
f=43
TT=1802.12
T1=6.33
SAT
f=46
TT=1783.01
T1=16.24
SAT (TO)
f=59
TT=1800.35
T1=2.23
OPT
f=34
TT=696.854
T1=695.96
SAT (TO)
f=60
TT=1800.75
T1=1.43
OPT
f=34
TT=11.309
T1=11.11
No dataOPT
f=34
TT=19.663
T1=18.95
SAT (TO)
f=45
TT=1800.86
T1=62.45
OPT
f=34
TT=13.647
T1=13.44
No dataSAT (TO)
f=46
TT=1800.04
T1=16.21
OPT
f=34
TT=7.55
T1=7.37
SAT (TO)
f=43
TT=1800.1
T1=1800.61
OPT
f=34
TT=1218.47
T1=1175.4
? (TO)

TT=1800.09

No dataNo dataNo dataOPT
f=34
TT=326.14
T1=163.19
No dataNo dataOPT
f=34
TT=200.903
T1=100.53
No dataNo dataNo dataSAT (TO)
f=41
TT=1800.51
T1=468.44
SAT (TO)
f=56
TT=1800.05
T1=106.58
SAT (TO)
f=43
TT=1800.54
T1=0.81
OPT
f=34
TT=7.878
T1=7.66
OPT
f=34
TT=8.596
T1=8.36
OPT
f=34
TT=8.356
T1=8.14
? (TO)

TT=1800.1

? (TO)

TT=1800.02

?

TT=1799.54

No dataNo data?

TT=1799.57

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_opers/
normalized-fir10_area_opers.opb
OPT
f=51
TT=151.57
T1=147.2
SAT
f=54
TT=1798.07
T1=1561.31
No data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.11

OPT
f=51
TT=728.625
T1=662.59
Signal

TT=3.075

SAT (TO)
f=54
TT=1802.1
T1=69.45
SAT
f=77
TT=1783.04
T1=37.31
SAT (TO)
f=87
TT=1802.85
T1=5.98
SAT
f=54
TT=1798.48
T1=1533.68
SAT (TO)
f=87
TT=1800.1
T1=4.5
OPT
f=51
TT=195.702
T1=195.09
No dataOPT
f=51
TT=165.067
T1=158.06
SAT (TO)
f=70
TT=1801.11
T1=56.95
OPT
f=51
TT=536.452
T1=536.06
No dataSAT (TO)
f=70
TT=1800.09
T1=58.69
OPT
f=51
TT=455.045
T1=454.59
No Cert.

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=51
TT=1800.08
T1=900.71
No dataNo dataSAT (TO)
f=51
TT=1800.49
T1=900.61
No dataNo dataNo dataSAT (TO)
f=86
TT=1800.75
T1=243.17
SAT (TO)
f=87
TT=1800.75
T1=1.63
SAT (TO)
f=56
TT=1800.01
T1=1.48
OPT
f=51
TT=151.57
T1=147.2
OPT
f=51
TT=161.018
T1=156.17
OPT
f=51
TT=161.363
T1=156.66
? (TO)

TT=1800.08

? (TO)

TT=1800.02

?

TT=1799.67

No dataNo data? (TO)

TT=1800.5

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir02_area_partials.opb
OPT
f=19
TT=0.002
T1=0
OPT
f=19
TT=0.004
T1=0
No dataOPT
f=19
TT=0.002
T1=0
OPT
f=19
TT=0.063
T1=0.06
OPT
f=19
TT=0.073
T1=0.03
OPT
f=19
TT=0.026
T1=0.02
OPT
f=19
TT=0.038
T1=0.02
OPT
f=19
TT=0.029
T1=0.02
OPT
f=19
TT=0.024
T1=0.02
OPT
f=19
TT=0.026
T1=0.02
OPT
f=19
TT=0.024
T1=0.02
OPT
f=19
TT=0.004
T1=0
OPT
f=19
TT=0.003
T1=0
OPT
f=19
TT=0.031
T1=0.02
OPT
f=19
TT=0.004
T1=0
OPT
f=19
TT=0.192
T1=0.13
OPT
f=19
TT=0.003
T1=0
OPT
f=19
TT=0.203
T1=0.14
OPT
f=19
TT=0.02
T1=0.02
No dataOPT
f=19
TT=0.007
T1=0
SAT
f=19
TT=0.195
T1=1.14
OPT
f=19
TT=0.017
T1=0.01
No dataOPT
f=19
TT=0.203
T1=0.65
OPT
f=19
TT=0.02
T1=0.01
OPT
f=19
TT=0.003
T1=0
OPT
f=19
TT=0.031
T1=0.03
OPT
f=19
TT=0.029
T1=0.02
No dataNo dataNo dataOPT
f=19
TT=0.002
T1=0
No dataNo dataOPT
f=19
TT=0.003
T1=0
No dataNo dataNo dataOPT
f=19
TT=0.195
T1=0.66
OPT
f=19
TT=0.176
T1=0.14
OPT
f=19
TT=0.205
T1=0.16
OPT
f=19
TT=0.024
T1=0.01
OPT
f=19
TT=0.029
T1=0.02
OPT
f=19
TT=0.027
T1=0.02
OPT
f=19
TT=0.007
T1=0
OPT
f=19
TT=0.006
T1=0
OPT
f=19
TT=0.001
T1=0
No dataNo dataOPT
f=19
TT=0.002
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir03_area_partials.opb
OPT
f=18
TT=0.013
T1=0.02
OPT
f=18
TT=0.421
T1=0.42
No dataOPT
f=18
TT=0.028
T1=0.02
OPT
f=18
TT=0.261
T1=0.24
OPT
f=18
TT=0.179
T1=0.17
? (problem)

TT=0.088

? (problem)

TT=0.086

? (problem)

TT=0.092

? (problem)

TT=0.077

? (problem)

TT=0.091

? (problem)

TT=0.077

OPT
f=18
TT=0.307
T1=0.3
OPT
f=18
TT=0.086
T1=0.07
OPT
f=18
TT=0.848
T1=0.8
OPT
f=18
TT=0.065
T1=0.05
OPT
f=18
TT=1.224
T1=0.54
OPT
f=18
TT=0.413
T1=0.41
OPT
f=18
TT=1.095
T1=0.49
OPT
f=18
TT=1.831
T1=1.81
No dataOPT
f=18
TT=0.096
T1=0.09
OPT
f=18
TT=2.214
T1=2.33
OPT
f=18
TT=2.094
T1=2.07
No dataOPT
f=18
TT=2.024
T1=1.36
OPT
f=18
TT=2.529
T1=2.5
OPT
f=18
TT=0.017
T1=0.03
OPT
f=18
TT=0.155
T1=0.14
OPT
f=18
TT=0.155
T1=0.14
No dataNo dataNo dataOPT
f=18
TT=0.015
T1=0.02
No dataNo dataOPT
f=18
TT=0.013
T1=0.02
No dataNo dataNo dataOPT
f=18
TT=2.413
T1=1.34
OPT
f=18
TT=1.285
T1=0.58
OPT
f=18
TT=0.994
T1=0.33
OPT
f=18
TT=3.146
T1=3.13
OPT
f=18
TT=3.141
T1=3.1
OPT
f=18
TT=2.968
T1=2.93
OPT
f=18
TT=0.494
T1=0.33
OPT
f=18
TT=0.465
T1=0.31
OPT
f=18
TT=0.031
T1=0.02
No dataNo dataOPT
f=18
TT=0.033
T1=0.02
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir04_area_partials.opb
OPT
f=30
TT=0.002
T1=0
OPT
f=30
TT=0.002
T1=0
No dataOPT
f=30
TT=0.002
T1=0
OPT
f=30
TT=0.066
T1=0.02
OPT
f=30
TT=0.077
T1=0.02
OPT
f=30
TT=0.025
T1=0.01
OPT
f=30
TT=0.031
T1=0.02
OPT
f=30
TT=0.018
T1=0.01
OPT
f=30
TT=0.021
T1=0.01
OPT
f=30
TT=0.017
T1=0.01
OPT
f=30
TT=0.024
T1=0.01
OPT
f=30
TT=0.004
T1=0
OPT
f=30
TT=0.002
T1=0
OPT
f=30
TT=0.057
T1=0.04
OPT
f=30
TT=0.003
T1=0
OPT
f=30
TT=0.126
T1=0.12
OPT
f=30
TT=0.002
T1=0
OPT
f=30
TT=0.145
T1=0.11
OPT
f=30
TT=0.016
T1=0.01
No dataOPT
f=30
TT=0.005
T1=0
SAT
f=30
TT=0.175
T1=1.13
OPT
f=30
TT=0.014
T1=0.01
No dataOPT
f=30
TT=0.164
T1=0.62
OPT
f=30
TT=0.017
T1=0.01
OPT
f=30
TT=0.005
T1=0
OPT
f=30
TT=0.025
T1=0
OPT
f=30
TT=0.013
T1=0
No dataNo dataNo dataOPT
f=30
TT=0.002
T1=0
No dataNo dataOPT
f=30
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=30
TT=0.174
T1=0.63
OPT
f=30
TT=0.168
T1=0.14
OPT
f=30
TT=0.185
T1=0.13
OPT
f=30
TT=0.022
T1=0.01
OPT
f=30
TT=0.019
T1=0.01
OPT
f=30
TT=0.02
T1=0.01
OPT
f=30
TT=0.003
T1=0
OPT
f=30
TT=0.004
T1=0
OPT
f=30
TT=0.001
T1=0
No dataNo dataOPT
f=30
TT=0.003
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir05_area_partials.opb
OPT
f=36
TT=0.005
T1=0
OPT
f=36
TT=0.041
T1=0.04
No dataOPT
f=36
TT=0.009
T1=0
OPT
f=36
TT=0.123
T1=0.08
OPT
f=36
TT=0.115
T1=0.04
OPT
f=36
TT=0.076
T1=0.05
? (problem)

TT=0.037

OPT
f=36
TT=0.063
T1=0.05
? (problem)

TT=0.032

OPT
f=36
TT=0.064
T1=0.05
? (problem)

TT=0.032

OPT
f=36
TT=0.038
T1=0.04
OPT
f=36
TT=0.028
T1=0.02
OPT
f=36
TT=0.249
T1=0.24
OPT
f=36
TT=0.022
T1=0.01
OPT
f=36
TT=0.464
T1=0.31
OPT
f=36
TT=0.038
T1=0.03
OPT
f=36
TT=0.425
T1=0.26
OPT
f=36
TT=0.088
T1=0.08
No dataOPT
f=36
TT=0.035
T1=0.03
SAT
f=36
TT=0.576
T1=2.27
OPT
f=36
TT=0.068
T1=0.06
No dataOPT
f=36
TT=0.534
T1=1.27
OPT
f=36
TT=0.068
T1=0.06
OPT
f=36
TT=0.006
T1=0
OPT
f=36
TT=0.073
T1=0.04
OPT
f=36
TT=0.053
T1=0.03
No dataNo dataNo dataOPT
f=36
TT=0.007
T1=0.01
No dataNo dataOPT
f=36
TT=0.007
T1=0
No dataNo dataNo dataOPT
f=36
TT=0.675
T1=1.28
OPT
f=36
TT=0.435
T1=0.28
OPT
f=36
TT=0.404
T1=0.25
OPT
f=36
TT=0.289
T1=0.27
OPT
f=36
TT=0.294
T1=0.27
OPT
f=36
TT=0.191
T1=0.18
OPT
f=36
TT=0.038
T1=0.03
OPT
f=36
TT=0.038
T1=0.03
OPT
f=36
TT=0.005
T1=0.01
No dataNo dataOPT
f=36
TT=0.005
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir06_area_partials.opb
OPT
f=24
TT=0.025
T1=0.01
OPT
f=24
TT=0.296
T1=0.29
No dataOPT
f=24
TT=0.025
T1=0.02
OPT
f=24
TT=0.127
T1=0.07
OPT
f=24
TT=0.116
T1=0.11
? (problem)

TT=0.034

? (problem)

TT=0.042

? (problem)

TT=0.037

? (problem)

TT=0.039

? (problem)

TT=0.036

? (problem)

TT=0.04

OPT
f=24
TT=0.559
T1=0.54
OPT
f=24
TT=0.268
T1=0.25
OPT
f=24
TT=0.711
T1=0.67
OPT
f=24
TT=0.034
T1=0.03
OPT
f=24
TT=1.037
T1=0.62
OPT
f=24
TT=0.292
T1=0.29
OPT
f=24
TT=1.105
T1=0.63
OPT
f=24
TT=0.196
T1=0.18
No dataOPT
f=24
TT=0.071
T1=0.06
OPT
f=24
TT=4.904
T1=3.27
OPT
f=24
TT=0.227
T1=0.22
No dataOPT
f=24
TT=2.134
T1=1.77
OPT
f=24
TT=0.218
T1=0.2
OPT
f=24
TT=0.154
T1=0.15
OPT
f=24
TT=0.079
T1=0.04
OPT
f=24
TT=0.07
T1=0.06
No dataNo dataNo dataOPT
f=24
TT=0.047
T1=0.01
No dataNo dataOPT
f=24
TT=0.047
T1=0.01
No dataNo dataNo dataOPT
f=24
TT=1.484
T1=1.28
OPT
f=24
TT=0.743
T1=0.36
OPT
f=24
TT=0.963
T1=0.5
OPT
f=24
TT=0.929
T1=0.92
OPT
f=24
TT=0.946
T1=0.93
OPT
f=24
TT=0.764
T1=0.75
OPT
f=24
TT=0.769
T1=0.67
OPT
f=24
TT=0.77
T1=0.67
OPT
f=24
TT=0.025
T1=0.01
No dataNo dataOPT
f=24
TT=0.026
T1=0.01
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir07_area_partials.opb
OPT
f=33
TT=0.004
T1=0
OPT
f=33
TT=0.02
T1=0.01
No dataOPT
f=33
TT=0.005
T1=0
OPT
f=33
TT=0.087
T1=0.05
OPT
f=33
TT=0.092
T1=0.08
? (problem)

TT=0.013

? (problem)

TT=0.023

? (problem)

TT=0.014

? (problem)

TT=0.022

? (problem)

TT=0.016

? (problem)

TT=0.02

OPT
f=33
TT=0.038
T1=0.03
OPT
f=33
TT=0.013
T1=0.01
OPT
f=33
TT=0.247
T1=0.23
OPT
f=33
TT=0.007
T1=0
OPT
f=33
TT=0.405
T1=0.21
OPT
f=33
TT=0.018
T1=0.01
OPT
f=33
TT=0.415
T1=0.2
OPT
f=33
TT=0.168
T1=0.16
No dataOPT
f=33
TT=0.02
T1=0.01
OPT
f=33
TT=0.503
T1=4.18
OPT
f=33
TT=0.08
T1=0.07
No dataOPT
f=33
TT=0.532
T1=2.17
OPT
f=33
TT=0.24
T1=0.23
OPT
f=33
TT=0.004
T1=0
OPT
f=33
TT=0.043
T1=0.02
OPT
f=33
TT=0.037
T1=0.03
No dataNo dataNo dataOPT
f=33
TT=0.003
T1=0
No dataNo dataOPT
f=33
TT=0.004
T1=0
No dataNo dataNo dataOPT
f=33
TT=0.583
T1=2.19
OPT
f=33
TT=0.405
T1=0.22
OPT
f=33
TT=0.374
T1=0.21
OPT
f=33
TT=0.136
T1=0.04
OPT
f=33
TT=0.147
T1=0.05
OPT
f=33
TT=0.065
T1=0.04
OPT
f=33
TT=0.024
T1=0.01
OPT
f=33
TT=0.024
T1=0.01
OPT
f=33
TT=0.003
T1=0
No dataNo dataOPT
f=33
TT=0.004
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir08_area_partials.opb
OPT
f=49
TT=7.021
T1=5.21
SAT (TO)
f=53
TT=1800.09
T1=409.72
No data? (TO)

TT=1800

OPT
f=49
TT=29.1
T1=29.21
OPT
f=49
TT=8.566
T1=5.21
? (problem)

TT=1.96

? (problem)

TT=1.55

? (problem)

TT=2

? (problem)

TT=1.52

? (problem)

TT=2.14

? (problem)

TT=1.53

SAT (TO)
f=53
TT=1800.03
T1=382.05
OPT
f=49
TT=15.888
T1=13.78
SAT (TO)
f=52
TT=1802.06
T1=1319.27
SAT
f=53
TT=1783.02
T1=14.56
SAT (TO)
f=53
TT=1800.09
T1=1.62
SAT (TO)
f=53
TT=1800.11
T1=401.36
SAT (TO)
f=50
TT=1800.69
T1=1653.83
?

TT=1795.27

No dataOPT
f=49
TT=442.08
T1=440.28
SAT (TO)
f=50
TT=1800.13
T1=83.58
SAT
f=1821
TT=1796.5
T1=1.47
No dataSAT (TO)
f=50
TT=1800.13
T1=213.68
SAT
f=1733
TT=1797.48
T1=23.99
OPT
f=49
TT=7.021
T1=7
OPT
f=49
TT=14.49
T1=14.88
OPT
f=49
TT=26.276
T1=20.98
No dataNo dataNo dataOPT
f=49
TT=35.931
T1=18.25
No dataNo dataOPT
f=49
TT=49.807
T1=25.15
No dataNo dataNo dataSAT (TO)
f=49
TT=1800.06
T1=384.24
SAT (TO)
f=51
TT=1800.08
T1=125.56
SAT (TO)
f=59
TT=1800.09
T1=1504.17
SAT
f=55
TT=1797.53
T1=13.85
SAT
f=55
TT=1797.58
T1=11.67
SAT
f=55
TT=1797.45
T1=13.27
? (TO)

TT=1800.1

? (TO)

TT=1800.08

?

TT=1799.84

No dataNo data?

TT=1799.47

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir09_area_partials.opb
OPT
f=35
TT=0.692
T1=0.58
OPT
f=35
TT=862.427
T1=848.88
No dataOPT
f=35
TT=2.432
T1=1.59
OPT
f=35
TT=0.992
T1=0.99
OPT
f=35
TT=0.692
T1=0.58
? (problem)

TT=0.308

? (problem)

TT=0.279

? (problem)

TT=0.307

? (problem)

TT=0.269

? (problem)

TT=0.309

? (problem)

TT=0.268

OPT
f=35
TT=18.562
T1=13.49
OPT
f=35
TT=1.995
T1=1.72
OPT
f=35
TT=38.146
T1=35.8
OPT
f=35
TT=4.336
T1=2.15
OPT
f=35
TT=22.4
T1=17.57
OPT
f=35
TT=857.543
T1=844.01
OPT
f=35
TT=12.422
T1=7.99
OPT
f=35
TT=346.099
T1=346.12
No dataOPT
f=35
TT=8.853
T1=8.82
OPT
f=35
TT=28.571
T1=17.55
OPT
f=35
TT=260.244
T1=260.24
No dataOPT
f=35
TT=13.662
T1=6.5
OPT
f=35
TT=157.466
T1=157.43
OPT
f=35
TT=0.865
T1=0.86
OPT
f=35
TT=0.736
T1=0.96
OPT
f=35
TT=0.769
T1=0.58
No dataNo dataNo dataOPT
f=35
TT=1.518
T1=0.78
No dataNo dataOPT
f=35
TT=1.495
T1=0.77
No dataNo dataNo dataOPT
f=35
TT=32.047
T1=14.64
OPT
f=35
TT=72
T1=68.53
OPT
f=35
TT=14.26
T1=9.28
OPT
f=35
TT=79.229
T1=79.17
OPT
f=35
TT=76.456
T1=76.38
OPT
f=35
TT=74.102
T1=74.07
OPT
f=35
TT=59.971
T1=9.05
OPT
f=35
TT=53.863
T1=8.49
OPT
f=35
TT=4.416
T1=4.42
No dataNo dataOPT
f=35
TT=4.442
T1=4.43
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/area_partials/
normalized-fir10_area_partials.opb
OPT
f=52
TT=1.165
T1=0.47
OPT
f=52
TT=146.778
T1=123.64
No dataOPT
f=52
TT=773.572
T1=9.15
OPT
f=52
TT=1.781
T1=1.78
OPT
f=52
TT=1.436
T1=0.47
? (problem)

TT=0.159

? (problem)

TT=0.133

? (problem)

TT=0.161

? (problem)

TT=0.128

? (problem)

TT=0.161

? (problem)

TT=0.124

OPT
f=52
TT=19.627
T1=6.79
OPT
f=52
TT=3.349
T1=1.65
SAT (TO)
f=52
TT=1802.07
T1=34.39
OPT
f=52
TT=6.417
T1=2.88
SAT (TO)
f=52
TT=1800.04
T1=60.12
OPT
f=52
TT=145.395
T1=122.4
SAT (TO)
f=52
TT=1800.79
T1=85.71
OPT
f=52
TT=9.897
T1=9.87
No dataOPT
f=52
TT=1.165
T1=1.16
SAT (TO)
f=52
TT=1800.02
T1=16.4
OPT
f=52
TT=10.787
T1=10.75
No dataSAT (TO)
f=52
TT=1800.29
T1=16.46
OPT
f=52
TT=14.454
T1=14.42
OPT
f=52
TT=2.389
T1=2.38
OPT
f=52
TT=1.427
T1=1.42
OPT
f=52
TT=1.453
T1=0.59
No dataNo dataNo dataOPT
f=52
TT=13.422
T1=6.73
No dataNo dataOPT
f=52
TT=13.602
T1=6.81
No dataNo dataNo dataOPT
f=52
TT=1413.31
T1=10.16
OPT
f=52
TT=915.8
T1=237.25
OPT
f=52
TT=1571.53
T1=416.85
OPT
f=52
TT=13.432
T1=13.39
OPT
f=52
TT=13.51
T1=13.46
OPT
f=52
TT=12.839
T1=12.8
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=52
TT=90.97
T1=91.03
No dataNo dataOPT
f=52
TT=91.07
T1=91.13
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_10.opb
SAT
f=25
TT=1800.78
T1=900.61
SAT
f=30
TT=1798.01
T1=2.48
No data? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (problem)

TT=2.4

? (TO)

TT=1800.11

? (problem)

TT=2.42

? (problem)

TT=2.98

? (problem)

TT=2.81

? (problem)

TT=3.02

Signal

TT=725.084

SAT (TO)
f=29
TT=1800.08
T1=1471.26
? (TO)

TT=1802.05

SAT
f=32
TT=1783.69
T1=14.55
SAT (TO)
f=29
TT=1800.6
T1=1.43
SAT
f=30
TT=1798.11
T1=2.49
SAT (TO)
f=29
TT=1800.09
T1=1.35
?

TT=1793.52

No dataNo Cert.

TT=1800

SAT (TO)
f=28
TT=1800.1
T1=166.95
?

TT=1790.21

No dataSAT (TO)
f=28
TT=1800.74
T1=139.61
? (TO)

TT=1802.03

No Cert.

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=26
TT=1800.34
T1=900.71
No dataNo dataSAT (TO)
f=25
TT=1800.78
T1=900.61
No dataNo dataNo dataSAT (TO)
f=29
TT=1800.19
T1=2.73
SAT (TO)
f=29
TT=1800.79
T1=1.38
? (TO)

TT=1800.4

SAT
f=32
TT=1798
T1=52.07
SAT
f=32
TT=1798
T1=53.23
SAT
f=32
TT=1798.09
T1=51.65
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.31

No dataNo data?

TT=1799.78

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_1.opb
SAT
f=24
TT=1800.04
T1=854.89
SAT
f=30
TT=1798.02
T1=54.08
No data? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (problem)

TT=1.168

? (TO)

TT=1800.13

? (problem)

TT=1.134

? (problem)

TT=1773.33

? (problem)

TT=1.119

SAT (TO)
f=30
TT=1800.11
T1=123.72
SAT (TO)
f=24
TT=1800.11
T1=854.89
? (TO)

TT=1802.1

SAT
f=30
TT=1783.03
T1=3.97
SAT (TO)
f=27
TT=1800.05
T1=1.12
SAT
f=30
TT=1798.14
T1=891.93
SAT (TO)
f=27
TT=1800.66
T1=0.93
?

TT=1798.36

No data? (TO)

TT=1800.37

SAT (TO)
f=26
TT=1800.08
T1=23.9
SAT
f=33
TT=1793.43
T1=709.28
No dataSAT (TO)
f=27
TT=1800.97
T1=1.81
SAT
f=29
TT=1797.88
T1=1047.04
SAT (TO)
f=24
TT=1800.04
T1=1800.5
? (TO)

TT=1800.11

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=25
TT=1800.16
T1=900.41
No dataNo dataSAT (TO)
f=25
TT=1800.18
T1=900.61
No dataNo dataNo dataSAT (TO)
f=27
TT=1800.72
T1=1.91
SAT (TO)
f=27
TT=1800.9
T1=0.85
? (TO)

TT=1800.57

SAT
f=29
TT=1797.09
T1=14.42
SAT
f=29
TT=1797.08
T1=13.43
SAT
f=29
TT=1797.51
T1=14.46
? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.43

No dataNo data?

TT=1799.83

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_2.opb
OPT
f=19
TT=618.033
T1=255.78
SAT
f=25
TT=1798.03
T1=0.35
No dataSAT (TO)
f=25
TT=1800.12
T1=0.13
OPT
f=19
TT=815.948
T1=816.07
OPT
f=19
TT=618.033
T1=618.13
? (problem)

TT=0.653

? (problem)

TT=0.78

? (problem)

TT=0.64

? (problem)

TT=0.77

? (problem)

TT=0.662

? (problem)

TT=0.75

SAT (TO)
f=25
TT=1800.11
T1=323.71
SAT (TO)
f=20
TT=1800.08
T1=1029.55
? (TO)

TT=1802.07

SAT
f=25
TT=1783.02
T1=0.8
SAT (TO)
f=26
TT=1800.09
T1=1.03
SAT
f=24
TT=1798.01
T1=404.27
SAT (TO)
f=26
TT=1800.94
T1=0.6
SAT
f=27
TT=1793.74
T1=933.68
No data? (TO)

TT=1800.15

SAT (TO)
f=22
TT=1801.1
T1=17.7
SAT
f=27
TT=1789.79
T1=875.77
No dataSAT (TO)
f=22
TT=1800.7
T1=378.42
SAT
f=24
TT=1796.84
T1=172.66
SAT (TO)
f=21
TT=1800.08
T1=1800.4
OPT
f=19
TT=1065.46
T1=458.45
OPT
f=19
TT=856.416
T1=255.78
No dataNo dataNo dataSAT (TO)
f=21
TT=1800.04
T1=900.41
No dataNo dataSAT (TO)
f=21
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=22
TT=1800.73
T1=216.74
SAT (TO)
f=26
TT=1800.71
T1=0.6
? (TO)

TT=1800.59

SAT
f=24
TT=1796.87
T1=2.02
SAT
f=24
TT=1796.85
T1=2.48
SAT
f=24
TT=1796.87
T1=2.69
? (TO)

TT=1800.09

? (TO)

TT=1800.08

?

TT=1799.39

No dataNo data?

TT=1799.35

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_3.opb
OPT
f=21
TT=266.663
T1=64.35
SAT
f=28
TT=1798.03
T1=0.18
No dataSAT (TO)
f=29
TT=1800.02
T1=0.07
OPT
f=21
TT=346.494
T1=121.09
OPT
f=21
TT=276.729
T1=276.77
OPT
f=21
TT=346.653
T1=121.33
? (problem)

TT=0.555

OPT
f=21
TT=317.27
T1=67.03
? (problem)

TT=0.548

OPT
f=21
TT=291.611
T1=65.86
? (problem)

TT=0.565

SAT (TO)
f=26
TT=1800.03
T1=646.91
SAT (TO)
f=21
TT=1800.09
T1=1098.95
? (TO)

TT=1802.1

SAT
f=27
TT=1783.01
T1=0.38
SAT (TO)
f=26
TT=1800.57
T1=0.59
SAT
f=27
TT=1798
T1=1.25
SAT (TO)
f=26
TT=1800.22
T1=0.54
SAT
f=25
TT=1794.29
T1=869.95
No data? (TO)

TT=1800.09

SAT (TO)
f=25
TT=1800.64
T1=2.56
SAT
f=26
TT=1789.79
T1=1058.38
No dataSAT (TO)
f=25
TT=1800.02
T1=4.51
SAT
f=25
TT=1796.79
T1=80.94
SAT (TO)
f=21
TT=1800.08
T1=1800.4
OPT
f=21
TT=320.677
T1=113.41
OPT
f=21
TT=266.663
T1=64.35
No dataNo dataNo dataSAT (TO)
f=21
TT=1800.62
T1=900.51
No dataNo dataSAT (TO)
f=21
TT=1800.46
T1=900.41
No dataNo dataNo dataSAT (TO)
f=25
TT=1800.6
T1=174.65
SAT (TO)
f=26
TT=1800.07
T1=0.54
? (TO)

TT=1800.69

SAT
f=25
TT=1796.8
T1=4.13
SAT
f=25
TT=1796.72
T1=4.74
SAT
f=25
TT=1796.92
T1=4.67
? (TO)

TT=1800.06

? (TO)

TT=1800.08

?

TT=1799.27

No dataNo data?

TT=1799.88

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_4.opb
SAT
f=26
TT=1800.83
T1=900.81
SAT (TO)
f=31
TT=1800.12
T1=56.98
No data? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (problem)

TT=14.91

? (TO)

TT=1800.06

? (problem)

TT=17.72

? (TO)

TT=1800.08

? (problem)

TT=17.89

? (TO)

TT=1800.01

Signal

TT=824.993

SAT (TO)
f=38
TT=1800.12
T1=1483.48
? (TO)

TT=1802.07

SAT
f=33
TT=1783.03
T1=76.99
SAT (TO)
f=33
TT=1800.53
T1=2.69
SAT
f=32
TT=1798.24
T1=17.2
SAT (TO)
f=33
TT=1800.04
T1=2.5
?

TT=1795.83

No data?

TT=1799.68

SAT (TO)
f=30
TT=1800.68
T1=6.8
?

TT=1791.74

No dataSAT (TO)
f=27
TT=1800.24
T1=184.15
? (TO)

TT=1802.04

No Cert.

TT=1800.08

? (TO)

TT=1800.14

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=27
TT=1800.84
T1=900.91
No dataNo dataSAT (TO)
f=26
TT=1800.83
T1=900.81
No dataNo dataNo dataSAT (TO)
f=28
TT=1800.19
T1=100.78
SAT (TO)
f=33
TT=1800.01
T1=2.18
? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1802.1

? (TO)

TT=1802.11

? (TO)

TT=1800.09

? (TO)

TT=1800.08

?

TT=1799.57

No dataNo data?

TT=1799.47

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_5.opb
OPT
f=20
TT=47.406
T1=18.98
SAT
f=25
TT=1798.02
T1=716.33
No dataSAT (TO)
f=29
TT=1800.11
T1=0.06
OPT
f=20
TT=101.378
T1=101.39
OPT
f=20
TT=54.913
T1=54.92
? (problem)

TT=0.507

? (problem)

TT=0.465

? (problem)

TT=0.499

? (problem)

TT=0.452

? (problem)

TT=0.517

? (problem)

TT=0.449

SAT (TO)
f=26
TT=1800.1
T1=0.53
OPT
f=20
TT=1115.42
T1=874.44
? (TO)

TT=1802.08

SAT
f=26
TT=1783.02
T1=145.32
SAT (TO)
f=26
TT=1800.57
T1=0.59
SAT
f=26
TT=1798.02
T1=68.72
SAT (TO)
f=27
TT=1800.39
T1=0.49
SAT
f=22
TT=1794.12
T1=1319.55
No data? (TO)

TT=1800.34

SAT (TO)
f=23
TT=1800.14
T1=112.63
SAT
f=24
TT=1789.78
T1=361.49
No dataSAT (TO)
f=23
TT=1800.8
T1=33.11
SAT
f=22
TT=1796.78
T1=1512.25
OPT
f=20
TT=956.122
T1=956.29
OPT
f=20
TT=48.432
T1=18.98
OPT
f=20
TT=47.406
T1=20.47
No dataNo dataNo dataSAT (TO)
f=21
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=21
TT=1800.02
T1=900.41
No dataNo dataNo data? (TO)

TT=1802.32

SAT (TO)
f=26
TT=1800.74
T1=0.53
? (TO)

TT=1800.63

SAT
f=25
TT=1796.82
T1=4.16
SAT
f=25
TT=1796.79
T1=3.87
SAT
f=25
TT=1796.8
T1=3.68
? (TO)

TT=1800.11

? (TO)

TT=1800.09

?

TT=1799.72

No dataNo data?

TT=1799.46

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_6.opb
OPT
f=20
TT=97.9
T1=7.64
SAT
f=25
TT=1798.01
T1=1199.24
No dataSAT (TO)
f=30
TT=1800.03
T1=0.06
OPT
f=20
TT=107.766
T1=7.64
OPT
f=20
TT=97.9
T1=97.92
? (problem)

TT=0.513

? (problem)

TT=0.506

? (problem)

TT=0.507

? (problem)

TT=0.502

? (problem)

TT=0.533

? (problem)

TT=0.496

SAT (TO)
f=25
TT=1800.07
T1=0.8
OPT
f=20
TT=1073.75
T1=200.24
? (TO)

TT=1802.1

SAT
f=23
TT=1783.06
T1=0.38
SAT (TO)
f=27
TT=1800.09
T1=0.93
SAT
f=25
TT=1798.02
T1=1682.82
SAT (TO)
f=27
TT=1800.85
T1=0.56
SAT
f=24
TT=1794.2
T1=39.23
No data? (TO)

TT=1800.17

SAT (TO)
f=22
TT=1800.18
T1=154.05
SAT
f=28
TT=1790.08
T1=1386.18
No dataSAT (TO)
f=21
TT=1800.07
T1=149.22
SAT
f=22
TT=1797.29
T1=966.73
OPT
f=20
TT=876.482
T1=876.65
OPT
f=20
TT=147.98
T1=84.41
OPT
f=20
TT=136.281
T1=69.22
No dataNo dataNo dataSAT (TO)
f=20
TT=1800.21
T1=900.41
No dataNo dataSAT (TO)
f=21
TT=1800.09
T1=900.31
No dataNo dataNo dataSAT (TO)
f=22
TT=1800.03
T1=223.22
SAT (TO)
f=27
TT=1800.04
T1=0.55
SAT (TO)
f=31
TT=1800.09
T1=0.55
SAT
f=22
TT=1796.82
T1=1595.44
SAT
f=23
TT=1796.79
T1=7.71
SAT
f=22
TT=1796.81
T1=1585.41
? (TO)

TT=1800.06

? (TO)

TT=1800.09

?

TT=1799.44

No dataNo data?

TT=1799.48

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_7.opb
OPT
f=21
TT=263.406
T1=8.12
SAT
f=26
TT=1798.01
T1=0.48
No dataSAT (TO)
f=29
TT=1800
T1=0.22
OPT
f=21
TT=263.406
T1=263.47
OPT
f=21
TT=359.22
T1=359.27
? (problem)

TT=0.9

? (problem)

TT=0.83

? (problem)

TT=0.91

? (problem)

TT=0.81

? (problem)

TT=1

? (problem)

TT=0.82

SAT (TO)
f=26
TT=1800.07
T1=0.48
SAT (TO)
f=21
TT=1800.04
T1=8.12
? (TO)

TT=1802.12

SAT
f=27
TT=1783.04
T1=41.92
SAT (TO)
f=24
TT=1800.09
T1=0.8
SAT
f=26
TT=1798.04
T1=0.51
SAT (TO)
f=24
TT=1800.25
T1=0.68
SAT
f=30
TT=1794.04
T1=1621.02
No data? (TO)

TT=1800.35

SAT (TO)
f=23
TT=1800.14
T1=794.53
SAT
f=25
TT=1789.87
T1=125.53
No dataSAT (TO)
f=24
TT=1800.03
T1=1.18
? (TO)

TT=1802.02

SAT (TO)
f=21
TT=1800.05
T1=1800.4
OPT
f=21
TT=319.733
T1=62.31
OPT
f=21
TT=273.814
T1=11.61
No dataNo dataNo dataSAT (TO)
f=21
TT=1800.62
T1=900.51
No dataNo dataSAT (TO)
f=21
TT=1800.59
T1=900.51
No dataNo dataNo dataSAT (TO)
f=24
TT=1800.1
T1=1.3
SAT (TO)
f=24
TT=1800.02
T1=0.65
? (TO)

TT=1800.06

SAT
f=25
TT=1796.88
T1=10.74
SAT
f=25
TT=1797.01
T1=10.47
SAT
f=25
TT=1796.89
T1=11.02
? (TO)

TT=1800.11

? (TO)

TT=1800.09

?

TT=1799.72

No dataNo data?

TT=1799.42

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_8.opb
OPT
f=18
TT=60.868
T1=15.22
SAT
f=25
TT=1798.01
T1=2.16
No dataSAT (TO)
f=28
TT=1800.02
T1=0.05
OPT
f=18
TT=137.608
T1=85.89
OPT
f=18
TT=113.351
T1=45.42
? (problem)

TT=0.395

? (problem)

TT=0.446

? (problem)

TT=0.391

? (problem)

TT=0.446

? (problem)

TT=0.401

? (problem)

TT=0.443

SAT (TO)
f=24
TT=1800.07
T1=0.5
OPT
f=18
TT=412.267
T1=146.62
? (TO)

TT=1802.1

SAT
f=23
TT=1783.01
T1=709.18
SAT (TO)
f=24
TT=1800.55
T1=0.56
SAT
f=24
TT=1798
T1=13.64
SAT (TO)
f=24
TT=1800.79
T1=0.52
SAT
f=20
TT=1794.6
T1=1667.1
No data? (TO)

TT=1800.26

SAT (TO)
f=20
TT=1800.01
T1=479.75
SAT
f=23
TT=1789.77
T1=1725.17
No dataSAT (TO)
f=20
TT=1800.07
T1=449
SAT
f=20
TT=1796.77
T1=808.93
OPT
f=18
TT=224.68
T1=224.73
OPT
f=18
TT=65.907
T1=65.97
OPT
f=18
TT=60.868
T1=15.22
No dataNo dataNo dataOPT
f=18
TT=511.47
T1=255.83
No dataNo dataOPT
f=18
TT=1145.47
T1=572.93
No dataNo dataNo dataSAT (TO)
f=20
TT=1800.15
T1=9.06
SAT (TO)
f=24
TT=1800.1
T1=0.57
SAT (TO)
f=24
TT=1800.85
T1=0.47
SAT
f=21
TT=1796.78
T1=43.02
SAT
f=21
TT=1796.8
T1=44.57
SAT
f=21
TT=1796.79
T1=43.28
? (TO)

TT=1800.09

? (TO)

TT=1800.02

?

TT=1799.37

No dataNo data?

TT=1799.92

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/decomp/
normalized-matrix_5x3_9.opb
OPT
f=21
TT=879.419
T1=424.19
SAT
f=28
TT=1798.02
T1=2.56
No data? (TO)

TT=1800.06

OPT
f=21
TT=879.419
T1=424.19
OPT
f=21
TT=931.674
T1=460.65
? (problem)

TT=1.27

? (problem)

TT=0.928

? (problem)

TT=1.27

? (problem)

TT=1.04

? (problem)

TT=1.098

? (problem)

TT=1.02

SAT (TO)
f=27
TT=1800.11
T1=5.13
SAT (TO)
f=23
TT=1800.02
T1=584.91
? (TO)

TT=1802.1

SAT
f=28
TT=1783.02
T1=1.92
SAT (TO)
f=27
TT=1800.44
T1=0.88
SAT
f=27
TT=1798.02
T1=59.49
SAT (TO)
f=28
TT=1800.26
T1=0.73
SAT
f=27
TT=1794.26
T1=195.41
No data? (TO)

TT=1800.11

SAT (TO)
f=24
TT=1800.03
T1=87.2
SAT
f=27
TT=1789.9
T1=231.18
No dataSAT (TO)
f=26
TT=1800.13
T1=1.7
SAT
f=26
TT=1796.94
T1=396.4
SAT (TO)
f=23
TT=1800.06
T1=1800.5
OPT
f=21
TT=1504.48
T1=1504.83
OPT
f=21
TT=1384.43
T1=786.72
No dataNo dataNo dataSAT (TO)
f=23
TT=1800.2
T1=900.51
No dataNo dataSAT (TO)
f=23
TT=1800.02
T1=900.41
No dataNo dataNo dataSAT (TO)
f=26
TT=1800.03
T1=13.33
SAT (TO)
f=28
TT=1800.68
T1=0.7
SAT (TO)
f=29
TT=1800.64
T1=0.71
SAT
f=27
TT=1797.08
T1=7.06
SAT
f=27
TT=1796.9
T1=7.85
SAT
f=27
TT=1796.88
T1=7.57
? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.42

No dataNo data?

TT=1799.65

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/trarea_ac/
normalized-fir01_trarea_ac.opb
OPT
f=13949
TT=0.002
T1=0
OPT
f=13949
TT=0.008
T1=0
No dataOPT
f=13949
TT=0.644
T1=0
OPT
f=13949
TT=1.568
T1=1.39
OPT
f=13949
TT=1.635
T1=1.16
OPT
f=13949
TT=1.428
T1=1.28
OPT
f=13949
TT=1.476
T1=1.05
? (problem)

TT=0.38

? (problem)

TT=0.698

? (problem)

TT=0.388

? (problem)

TT=0.9

OPT
f=13949
TT=0.01
T1=0.01
OPT
f=13949
TT=15.653
T1=13.92
OPT
f=13949
TT=4.733
T1=3.42
OPT
f=13949
TT=2.43
T1=0.35
OPT
f=13949
TT=1.974
T1=0.26
OPT
f=13949
TT=0.009
T1=0
OPT
f=13949
TT=2.375
T1=0.22
OPT
f=13949
TT=0.023
T1=0.02
No dataOPT
f=13949
TT=0.011
T1=0.01
OPT
f=13949
TT=2.835
T1=3.19
OPT
f=13949
TT=0.021
T1=0.01
No dataOPT
f=13949
TT=2.354
T1=1.67
OPT
f=13949
TT=0.024
T1=0.01
OPT
f=13949
TT=6.784
T1=6.78
OPT
f=13949
TT=1.62
T1=0.98
OPT
f=13949
TT=7.401
T1=7.43
No dataNo dataNo dataOPT
f=13949
TT=0.002
T1=0.01
No dataNo dataOPT
f=13949
TT=0.002
T1=0.01
No dataNo dataNo dataOPT
f=13949
TT=3.244
T1=2.7
OPT
f=13949
TT=1.714
T1=0.26
OPT
f=13949
TT=3.396
T1=1.56
OPT
f=13949
TT=0.028
T1=0.02
OPT
f=13949
TT=0.024
T1=0.02
OPT
f=13949
TT=0.027
T1=0.02
OPT
f=13949
TT=13.777
T1=0.39
OPT
f=13949
TT=13.7
T1=0.39
OPT
f=13949
TT=0.002
T1=0.01
No dataNo dataOPT
f=13949
TT=0.002
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/aksoy/trarea_ac/
normalized-fir02_trarea_ac.opb
OPT
f=24890
TT=0.029
T1=0.02
SAT
f=26324
TT=1798
T1=544.56
No dataSAT (TO)
f=24890
TT=1800.03
T1=646.24
OPT
f=24890
TT=19.472
T1=8.9
OPT
f=24890
TT=17.029
T1=17.04
OPT
f=24890
TT=19.31
T1=8.77
OPT
f=24890
TT=16.584
T1=16.62
? (problem)

TT=8.54

? (problem)

TT=5.08

? (problem)

TT=8.26

? (problem)

TT=5.16

SAT (TO)
f=26600
TT=1800.03
T1=0.01
SAT (TO)
f=26876
TT=1800.1
T1=0.01
SAT (TO)
f=26026
TT=1802.11
T1=0.23
SAT
f=25328
TT=1783
T1=1626.48
SAT (TO)
f=28038
TT=1800.03
T1=1431.89
SAT
f=26600
TT=1798
T1=0
SAT (TO)
f=27342
TT=1800.48
T1=1202.64
OPT
f=24890
TT=0.046
T1=0.04
No dataOPT
f=24890
TT=0.029
T1=0.02
SAT (TO)
f=24890
TT=1800.18
T1=12.28
OPT
f=24890
TT=0.039
T1=0.03
No dataSAT (TO)
f=24890
TT=1800.11
T1=254.45
OPT
f=24890
TT=0.042
T1=0.03
SAT (TO)
f=26547
TT=1800.09
T1=1800.4
OPT
f=24890
TT=20.786
T1=4.26
OPT
f=24890
TT=735.788
T1=736.33
No dataNo dataNo dataOPT
f=24890
TT=0.954
T1=0.47
No dataNo dataOPT
f=24890
TT=0.944
T1=0.47
No dataNo dataNo dataSAT (TO)
f=24890
TT=1800.1
T1=47.3
SAT (TO)
f=26674
TT=1800.07
T1=1659.96
SAT (TO)
f=30538
TT=1800.02
T1=1790.57
OPT
f=24890
TT=0.052
T1=0.04
OPT
f=24890
TT=0.042
T1=0.03
OPT
f=24890
TT=0.049
T1=0.04
? (TO)

TT=1800.03

? (TO)

TT=1800.03

OPT
f=24890
TT=0.385
T1=0.38
No dataNo dataOPT
f=24890
TT=0.396
T1=0.38
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_001_area_delay.opb
OPT
f=28
TT=36.507
T1=15.16
SAT
f=32
TT=1798
T1=293.96
No dataSAT (TO)
f=34
TT=1800.12
T1=212.75
OPT
f=28
TT=38.573
T1=38.58
OPT
f=28
TT=64.152
T1=64.16
? (problem)

TT=0.377

? (problem)

TT=0.375

? (problem)

TT=0.374

? (problem)

TT=0.376

? (problem)

TT=0.38

? (problem)

TT=0.372

SAT (TO)
f=33
TT=1800.08
T1=0.25
SAT (TO)
f=36
TT=1800.06
T1=1056.81
SAT (TO)
f=88
TT=1802.06
T1=19.41
SAT
f=33
TT=1783.01
T1=1.7
SAT (TO)
f=37
TT=1800.65
T1=73.38
SAT
f=33
TT=1798.01
T1=0.22
SAT (TO)
f=38
TT=1800.25
T1=196.31
OPT
f=28
TT=106.326
T1=104.31
No dataOPT
f=28
TT=36.507
T1=15.16
SAT (TO)
f=33
TT=1800.18
T1=361.21
OPT
f=28
TT=90.12
T1=87.51
No dataSAT (TO)
f=32
TT=1800.11
T1=687.17
OPT
f=28
TT=73.719
T1=72.18
SAT (TO)
f=33
TT=1800.08
T1=1800.5
OPT
f=28
TT=67.092
T1=49.03
OPT
f=28
TT=592.106
T1=577.94
No dataNo dataNo dataOPT
f=28
TT=175.38
T1=87.8
No dataNo dataOPT
f=28
TT=209.54
T1=104.82
No dataNo dataNo dataSAT (TO)
f=35
TT=1800.19
T1=748.87
SAT (TO)
f=40
TT=1800.01
T1=0.79
SAT (TO)
f=46
TT=1800.04
T1=107.15
OPT
f=28
TT=75.856
T1=74.11
OPT
f=28
TT=74.158
T1=72.47
OPT
f=28
TT=75.596
T1=73.86
? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.56

No dataNo data?

TT=1799.82

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_002_area_delay.opb
OPT
f=24
TT=2.676
T1=2.21
SAT
f=27
TT=1798
T1=1309.64
No dataSAT (TO)
f=27
TT=1800.02
T1=246.8
OPT
f=24
TT=4.206
T1=2.85
OPT
f=24
TT=5.449
T1=5.44
OPT
f=24
TT=3.409
T1=2.21
OPT
f=24
TT=5.3
T1=5.31
OPT
f=24
TT=6.953
T1=6.02
? (problem)

TT=0.511

OPT
f=24
TT=5.96
T1=5.3
? (problem)

TT=0.507

SAT (TO)
f=28
TT=1800.02
T1=0.12
SAT (TO)
f=26
TT=1800.09
T1=1112.37
SAT (TO)
f=91
TT=1802.12
T1=3.75
SAT
f=28
TT=1783.01
T1=0.38
SAT (TO)
f=32
TT=1800.05
T1=45.48
SAT
f=27
TT=1798
T1=390.39
SAT (TO)
f=33
TT=1800.43
T1=38.4
OPT
f=24
TT=79.182
T1=79.14
No dataOPT
f=24
TT=2.676
T1=2.63
SAT (TO)
f=27
TT=1800.13
T1=262.88
OPT
f=24
TT=9.39
T1=9.34
No dataSAT (TO)
f=27
TT=1800.88
T1=18.44
OPT
f=24
TT=9.072
T1=9.02
SAT (TO)
f=24
TT=1800.09
T1=1800.4
OPT
f=24
TT=5.54
T1=3.74
OPT
f=24
TT=8.083
T1=6.9
No dataNo dataNo dataOPT
f=24
TT=6.297
T1=3.17
No dataNo dataOPT
f=24
TT=12.745
T1=6.38
No dataNo dataNo dataSAT (TO)
f=29
TT=1800.2
T1=413.94
SAT (TO)
f=36
TT=1800.01
T1=0.57
SAT (TO)
f=40
TT=1800.08
T1=2.95
OPT
f=24
TT=20.931
T1=20.89
OPT
f=24
TT=20.761
T1=20.72
OPT
f=24
TT=19.114
T1=19.08
? (TO)

TT=1800.1

? (TO)

TT=1800.1

OPT
f=24
TT=105.011
T1=104.99
No dataNo dataOPT
f=24
TT=103.829
T1=103.87
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_003_area_delay.opb
OPT
f=26
TT=1.104
T1=0.57
SAT
f=29
TT=1798
T1=1159.23
No dataSAT (TO)
f=27
TT=1800.03
T1=1255.45
OPT
f=26
TT=6.471
T1=3.45
OPT
f=26
TT=6.4
T1=2.54
? (problem)

TT=0.259

? (problem)

TT=0.243

? (problem)

TT=0.256

? (problem)

TT=0.252

? (problem)

TT=0.26

? (problem)

TT=0.241

SAT (TO)
f=29
TT=1800.01
T1=262.48
SAT (TO)
f=29
TT=1800.09
T1=1117.26
SAT (TO)
f=94
TT=1802.07
T1=675.02
SAT
f=29
TT=1783.01
T1=13.47
SAT (TO)
f=38
TT=1800.44
T1=4.75
SAT
f=30
TT=1798
T1=69.45
SAT (TO)
f=33
TT=1800.3
T1=14.49
OPT
f=26
TT=18.855
T1=13.11
No dataOPT
f=26
TT=3.598
T1=3.53
SAT (TO)
f=29
TT=1801.05
T1=3.61
OPT
f=26
TT=29.326
T1=29.05
No dataSAT (TO)
f=29
TT=1800.07
T1=160.21
OPT
f=26
TT=19.851
T1=14.92
SAT (TO)
f=27
TT=1800.04
T1=1800.4
OPT
f=26
TT=6.586
T1=2.77
OPT
f=26
TT=8.387
T1=5.58
No dataNo dataNo dataOPT
f=26
TT=3.222
T1=1.64
No dataNo dataOPT
f=26
TT=1.104
T1=0.57
No dataNo dataNo dataSAT (TO)
f=31
TT=1800.08
T1=379.09
SAT (TO)
f=40
TT=1800.1
T1=0.54
SAT (TO)
f=37
TT=1800.07
T1=3.59
OPT
f=26
TT=17.809
T1=12.2
OPT
f=26
TT=16.654
T1=11.48
OPT
f=26
TT=17.426
T1=11.52
? (TO)

TT=1800.1

? (TO)

TT=1800.09

OPT
f=26
TT=2.125
T1=2.12
No dataNo dataOPT
f=26
TT=2.142
T1=2.13
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_004_area_delay.opb
OPT
f=27
TT=2.413
T1=2.2
SAT
f=30
TT=1798
T1=4.13
No dataSAT (TO)
f=29
TT=1800.03
T1=1218.75
OPT
f=27
TT=4.799
T1=4.93
OPT
f=27
TT=5.363
T1=5.47
? (problem)

TT=0.217

? (problem)

TT=0.208

? (problem)

TT=0.214

? (problem)

TT=0.208

? (problem)

TT=0.221

? (problem)

TT=0.21

SAT (TO)
f=29
TT=1800.1
T1=1390.14
SAT (TO)
f=30
TT=1800.07
T1=519
SAT (TO)
f=99
TT=1802.14
T1=4.74
SAT
f=30
TT=1783
T1=1770.1
SAT (TO)
f=34
TT=1800.62
T1=195.75
SAT
f=29
TT=1798
T1=1185.13
SAT (TO)
f=36
TT=1800.25
T1=1187.1
OPT
f=27
TT=21.227
T1=7.19
No dataOPT
f=27
TT=2.413
T1=2.2
SAT (TO)
f=29
TT=1800.37
T1=861.75
OPT
f=27
TT=27.001
T1=10.65
No dataSAT (TO)
f=29
TT=1800.82
T1=3.55
OPT
f=27
TT=22.374
T1=14.59
SAT (TO)
f=32
TT=1800.04
T1=1800.4
OPT
f=27
TT=4.763
T1=4.76
OPT
f=27
TT=7.17
T1=5.25
No dataNo dataNo dataOPT
f=27
TT=5.906
T1=2.97
No dataNo dataOPT
f=27
TT=5.308
T1=2.68
No dataNo dataNo data? (TO)

TT=1802.19

SAT (TO)
f=39
TT=1800.05
T1=0.51
SAT (TO)
f=44
TT=1800.08
T1=43.43
OPT
f=27
TT=14.111
T1=6.55
OPT
f=27
TT=14.171
T1=6.66
OPT
f=27
TT=14.393
T1=6.81
? (TO)

TT=1800.11

? (TO)

TT=1800.09

OPT
f=27
TT=14.481
T1=14.51
No dataNo dataOPT
f=27
TT=14.451
T1=14.49
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_005_area_delay.opb
OPT
f=26
TT=21.581
T1=11.16
SAT
f=33
TT=1798.04
T1=2.35
No data? (TO)

TT=1800

OPT
f=26
TT=284.66
T1=276.75
OPT
f=26
TT=27.349
T1=11.16
? (problem)

TT=0.997

? (problem)

TT=0.98

? (problem)

TT=1.01

? (problem)

TT=1

? (problem)

TT=1.05

? (problem)

TT=1.01

SAT (TO)
f=33
TT=1800.1
T1=2.09
SAT (TO)
f=34
TT=1800.08
T1=1.93
SAT (TO)
f=153
TT=1802.13
T1=24.02
SAT
f=36
TT=1783.02
T1=10.06
SAT (TO)
f=41
TT=1800.03
T1=162.36
SAT
f=33
TT=1798
T1=2.31
SAT (TO)
f=41
TT=1800.45
T1=181.43
OPT
f=26
TT=525.554
T1=523.29
No dataOPT
f=26
TT=21.581
T1=21.25
SAT (TO)
f=33
TT=1801.03
T1=118.37
OPT
f=26
TT=101.678
T1=47.9
No dataSAT (TO)
f=32
TT=1800.57
T1=532.58
OPT
f=26
TT=85.28
T1=35.23
SAT (TO)
f=33
TT=1800.09
T1=1800.61
OPT
f=26
TT=192.702
T1=192.94
? (TO)

TT=1800.05

No dataNo dataNo dataOPT
f=26
TT=30.619
T1=15.47
No dataNo dataOPT
f=26
TT=23.947
T1=12.18
No dataNo dataNo dataSAT (TO)
f=37
TT=1800.78
T1=403.4
SAT (TO)
f=43
TT=1800.1
T1=1.13
SAT (TO)
f=35
TT=1800.81
T1=1.16
OPT
f=26
TT=62.332
T1=34.02
OPT
f=26
TT=55.238
T1=29.78
OPT
f=26
TT=62.452
T1=34.16
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.66

No dataNo data?

TT=1799.95

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_006_area_delay.opb
OPT
f=22
TT=0.358
T1=0.35
OPT
f=22
TT=85.281
T1=81.35
No dataSAT (TO)
f=22
TT=1800.02
T1=43.36
OPT
f=22
TT=1.3
T1=1.03
OPT
f=22
TT=1.095
T1=1.1
OPT
f=22
TT=1.079
T1=0.8
OPT
f=22
TT=0.914
T1=0.91
OPT
f=22
TT=1.257
T1=1.04
? (problem)

TT=0.158

OPT
f=22
TT=1.326
T1=1.06
? (problem)

TT=0.157

OPT
f=22
TT=1.565
T1=1.12
OPT
f=22
TT=3.283
T1=1.07
SAT (TO)
f=50
TT=1800.15
T1=205.2
SAT
f=23
TT=1783.01
T1=7.91
SAT (TO)
f=26
TT=1800.02
T1=47.95
OPT
f=22
TT=84.976
T1=81.02
SAT (TO)
f=26
TT=1801.07
T1=17.14
OPT
f=22
TT=4.284
T1=3.71
No dataOPT
f=22
TT=0.448
T1=0.43
SAT (TO)
f=22
TT=1800.76
T1=951.94
OPT
f=22
TT=4.545
T1=3.78
No dataSAT (TO)
f=22
TT=1800.42
T1=979.84
OPT
f=22
TT=3.589
T1=2.97
OPT
f=22
TT=1.433
T1=1.42
OPT
f=22
TT=1.087
T1=0.84
OPT
f=22
TT=1.263
T1=0.99
No dataNo dataNo dataOPT
f=22
TT=0.621
T1=0.32
No dataNo dataOPT
f=22
TT=0.743
T1=0.37
No dataNo dataNo dataSAT (TO)
f=25
TT=1800.01
T1=113.66
SAT (TO)
f=30
TT=1800.1
T1=0.48
SAT (TO)
f=28
TT=1800.05
T1=384.29
OPT
f=22
TT=4.112
T1=3.49
OPT
f=22
TT=3.79
T1=3.25
OPT
f=22
TT=4.076
T1=3.38
? (TO)

TT=1800.1

? (TO)

TT=1800.1

OPT
f=22
TT=0.357
T1=0.35
No dataNo dataOPT
f=22
TT=0.358
T1=0.35
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_007_area_delay.opb
OPT
f=26
TT=12.542
T1=9.21
SAT
f=30
TT=1798.01
T1=181.48
No data? (TO)

TT=1800

OPT
f=26
TT=33.24
T1=21.91
OPT
f=26
TT=50.204
T1=19.01
? (problem)

TT=0.376

? (problem)

TT=0.365

? (problem)

TT=0.397

? (problem)

TT=0.372

? (problem)

TT=0.383

? (problem)

TT=0.368

SAT (TO)
f=31
TT=1800.1
T1=36.52
SAT (TO)
f=34
TT=1800.03
T1=1582.7
SAT (TO)
f=91
TT=1802.09
T1=9.27
SAT
f=30
TT=1783.01
T1=707.21
SAT (TO)
f=35
TT=1800.1
T1=21.97
SAT
f=31
TT=1798.01
T1=229.93
SAT (TO)
f=36
TT=1800.26
T1=0.79
OPT
f=26
TT=136.839
T1=136.77
No dataOPT
f=26
TT=12.542
T1=9.21
SAT (TO)
f=32
TT=1800.25
T1=6.85
OPT
f=26
TT=87.554
T1=87.52
No dataSAT (TO)
f=31
TT=1800.86
T1=6.4
OPT
f=26
TT=59.911
T1=54.56
SAT (TO)
f=36
TT=1800.03
T1=1800.4
OPT
f=26
TT=25.286
T1=25.28
OPT
f=26
TT=390.448
T1=376.11
No dataNo dataNo dataOPT
f=26
TT=168.701
T1=84.39
No dataNo dataOPT
f=26
TT=298.16
T1=149.24
No dataNo dataNo dataSAT (TO)
f=34
TT=1800.52
T1=249.22
SAT (TO)
f=36
TT=1800.04
T1=0.67
SAT (TO)
f=45
TT=1800.82
T1=38.33
OPT
f=26
TT=64.313
T1=64.23
OPT
f=26
TT=63.632
T1=63.56
OPT
f=26
TT=63.011
T1=62.91
? (TO)

TT=1800.08

? (TO)

TT=1800.09

?

TT=1799.41

No dataNo data?

TT=1799.51

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_008_area_delay.opb
OPT
f=25
TT=1.82
T1=1.63
SAT
f=27
TT=1798.01
T1=768.66
No dataSAT (TO)
f=26
TT=1800.03
T1=1547.18
OPT
f=25
TT=6.693
T1=4.99
OPT
f=25
TT=6.609
T1=4.06
? (problem)

TT=0.14

? (problem)

TT=0.141

? (problem)

TT=0.141

? (problem)

TT=0.144

? (problem)

TT=0.137

? (problem)

TT=0.15

SAT (TO)
f=27
TT=1800.01
T1=1206.27
OPT
f=25
TT=17.851
T1=9.85
SAT (TO)
f=114
TT=1802.1
T1=42.34
SAT
f=27
TT=1783
T1=38.91
SAT (TO)
f=36
TT=1800.56
T1=17.35
SAT
f=27
TT=1798
T1=363.9
SAT (TO)
f=36
TT=1800.47
T1=7.93
OPT
f=25
TT=85.007
T1=85
No dataOPT
f=25
TT=1.82
T1=1.63
SAT (TO)
f=28
TT=1800.12
T1=131.63
OPT
f=25
TT=24.668
T1=10.06
No dataSAT (TO)
f=27
TT=1801.13
T1=198.78
OPT
f=25
TT=38.073
T1=36.69
OPT
f=25
TT=11.481
T1=11.47
OPT
f=25
TT=5.084
T1=3.08
OPT
f=25
TT=6.719
T1=5.08
No dataNo dataNo dataOPT
f=25
TT=5.452
T1=2.74
No dataNo dataOPT
f=25
TT=5.392
T1=2.71
No dataNo dataNo dataSAT (TO)
f=27
TT=1800.55
T1=859.08
SAT (TO)
f=38
TT=1800.04
T1=3.9
SAT (TO)
f=52
TT=1800.06
T1=22.94
OPT
f=25
TT=12.414
T1=10.6
OPT
f=25
TT=12.479
T1=10.66
OPT
f=25
TT=15.758
T1=11.86
? (TO)

TT=1800.11

? (TO)

TT=1800.1

OPT
f=25
TT=73.88
T1=73.97
No dataNo dataOPT
f=25
TT=66.169
T1=66.18
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_009_area_delay.opb
OPT
f=24
TT=0.239
T1=0.23
SAT
f=26
TT=1798
T1=1412.26
No dataSAT (TO)
f=25
TT=1800.03
T1=1641.14
OPT
f=24
TT=2.319
T1=1.7
OPT
f=24
TT=1.778
T1=1.45
? (problem)

TT=0.232

? (problem)

TT=0.225

? (problem)

TT=0.231

? (problem)

TT=0.234

? (problem)

TT=0.231

? (problem)

TT=0.222

SAT (TO)
f=26
TT=1800.01
T1=202.83
SAT (TO)
f=26
TT=1800.09
T1=349.8
SAT (TO)
f=67
TT=1802.11
T1=4.17
SAT
f=26
TT=1783.01
T1=926.86
SAT (TO)
f=31
TT=1800.09
T1=19.95
SAT
f=25
TT=1798
T1=1415.14
SAT (TO)
f=34
TT=1800.49
T1=5.79
OPT
f=24
TT=5.305
T1=5.26
No dataOPT
f=24
TT=1.264
T1=1.22
SAT (TO)
f=25
TT=1800.13
T1=585.11
OPT
f=24
TT=8.592
T1=8.54
No dataSAT (TO)
f=26
TT=1800.06
T1=30.7
OPT
f=24
TT=5.587
T1=5.51
SAT (TO)
f=25
TT=1800.06
T1=1800.4
OPT
f=24
TT=1.733
T1=1.25
OPT
f=24
TT=2.9
T1=2.59
No dataNo dataNo dataOPT
f=24
TT=0.452
T1=0.24
No dataNo dataOPT
f=24
TT=0.471
T1=0.25
No dataNo dataNo dataSAT (TO)
f=27
TT=1801.46
T1=859.58
SAT (TO)
f=35
TT=1800.06
T1=1127.15
SAT (TO)
f=26
TT=1800.07
T1=0.5
OPT
f=24
TT=5.999
T1=5.92
OPT
f=24
TT=6.058
T1=5.99
OPT
f=24
TT=5.932
T1=5.86
? (TO)

TT=1800.01

? (TO)

TT=1800.09

OPT
f=24
TT=0.232
T1=0.22
No dataNo dataOPT
f=24
TT=0.239
T1=0.23
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_010_area_delay.opb
OPT
f=26
TT=77.831
T1=46.27
SAT
f=30
TT=1798.02
T1=469.49
No dataSAT (TO)
f=30
TT=1800.01
T1=402.79
OPT
f=26
TT=96.343
T1=96.6
OPT
f=26
TT=79.028
T1=47.11
OPT
f=26
TT=94.298
T1=96.76
OPT
f=26
TT=77.831
T1=46.27
? (problem)

TT=40.76

? (problem)

TT=0.79

? (problem)

TT=43.08

? (problem)

TT=0.79

SAT (TO)
f=30
TT=1800.09
T1=78.52
SAT (TO)
f=32
TT=1800.05
T1=1679.24
SAT (TO)
f=108
TT=1802.14
T1=926.28
SAT
f=29
TT=1783.01
T1=228.05
SAT (TO)
f=36
TT=1800.71
T1=97.18
SAT
f=31
TT=1798.01
T1=393.78
SAT (TO)
f=36
TT=1800.83
T1=34.62
OPT
f=26
TT=267.545
T1=267.47
No dataOPT
f=26
TT=247.384
T1=86
SAT (TO)
f=29
TT=1801.36
T1=14.91
OPT
f=26
TT=212.483
T1=212.46
No dataSAT (TO)
f=30
TT=1800.06
T1=263.93
OPT
f=26
TT=136.329
T1=136.01
SAT (TO)
f=33
TT=1800.02
T1=1800.4
OPT
f=26
TT=121.695
T1=121.74
OPT
f=26
TT=206.615
T1=182.28
No dataNo dataNo dataOPT
f=26
TT=564.88
T1=282.66
No dataNo dataOPT
f=26
TT=550.03
T1=275.23
No dataNo dataNo dataSAT (TO)
f=35
TT=1800.72
T1=273.09
SAT (TO)
f=40
TT=1800.49
T1=0.76
SAT (TO)
f=38
TT=1800.03
T1=251.16
OPT
f=26
TT=152.709
T1=152.38
OPT
f=26
TT=147.66
T1=147.4
OPT
f=26
TT=147.916
T1=147.66
? (TO)

TT=1800.02

? (TO)

TT=1800.1

?

TT=1799.45

No dataNo data?

TT=1799.7

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_011_area_delay.opb
OPT
f=26
TT=7.913
T1=6.35
SAT
f=31
TT=1798.01
T1=981.24
No dataSAT (TO)
f=31
TT=1800
T1=839.56
OPT
f=26
TT=64.638
T1=61.6
OPT
f=26
TT=12.691
T1=6.35
? (problem)

TT=0.446

? (problem)

TT=0.438

? (problem)

TT=0.451

? (problem)

TT=0.449

? (problem)

TT=0.468

? (problem)

TT=0.448

SAT (TO)
f=31
TT=1800.09
T1=520.11
SAT (TO)
f=37
TT=1800.06
T1=1699.21
SAT (TO)
f=91
TT=1802.12
T1=15.08
SAT
f=31
TT=1783.01
T1=53.53
SAT (TO)
f=36
TT=1800.03
T1=31.91
SAT
f=31
TT=1798.01
T1=1600.82
SAT (TO)
f=35
TT=1800.32
T1=904.97
OPT
f=26
TT=55.887
T1=55.83
No dataOPT
f=26
TT=7.913
T1=7.71
SAT (TO)
f=31
TT=1800.2
T1=260.33
OPT
f=26
TT=45.58
T1=45.48
No dataSAT (TO)
f=30
TT=1800.13
T1=617.41
OPT
f=26
TT=25.537
T1=25.42
SAT (TO)
f=33
TT=1800.02
T1=1800.4
OPT
f=26
TT=63.052
T1=63.09
OPT
f=26
TT=1264.66
T1=1228.17
No dataNo dataNo dataOPT
f=26
TT=11.835
T1=5.99
No dataNo dataOPT
f=26
TT=23.957
T1=12.06
No dataNo dataNo dataSAT (TO)
f=34
TT=1800.57
T1=417.36
SAT (TO)
f=42
TT=1800.64
T1=0.68
SAT (TO)
f=37
TT=1800.7
T1=2.63
OPT
f=26
TT=35.968
T1=35.85
OPT
f=26
TT=37.34
T1=37.2
OPT
f=26
TT=37.638
T1=37.46
? (TO)

TT=1800.08

? (TO)

TT=1800.1

OPT
f=26
TT=111.23
T1=111.3
No dataNo dataOPT
f=26
TT=107.1
T1=107.13
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_012_area_delay.opb
OPT
f=27
TT=13.058
T1=12.63
SAT
f=32
TT=1798.01
T1=13.36
No data? (TO)

TT=1800.02

OPT
f=27
TT=135.621
T1=103.74
OPT
f=27
TT=58.998
T1=27.45
? (problem)

TT=0.51

? (problem)

TT=0.493

? (problem)

TT=0.504

? (problem)

TT=0.504

? (problem)

TT=0.517

? (problem)

TT=0.51

SAT (TO)
f=32
TT=1800.08
T1=349.59
SAT (TO)
f=34
TT=1800.03
T1=0.71
SAT (TO)
f=113
TT=1802.1
T1=15.56
SAT
f=30
TT=1783.01
T1=698.29
SAT (TO)
f=42
TT=1800.09
T1=912.97
SAT
f=30
TT=1798.01
T1=496
SAT (TO)
f=42
TT=1800.76
T1=38.53
OPT
f=27
TT=69.201
T1=55.83
No dataOPT
f=27
TT=13.058
T1=12.63
SAT (TO)
f=32
TT=1801.49
T1=16.03
OPT
f=27
TT=84.186
T1=63.28
No dataSAT (TO)
f=32
TT=1800.16
T1=6.94
OPT
f=27
TT=69.903
T1=53.11
SAT (TO)
f=34
TT=1800.09
T1=1800.5
OPT
f=27
TT=120.691
T1=76.86
? (TO)

TT=1800.02

No dataNo dataNo dataOPT
f=27
TT=205.187
T1=102.69
No dataNo dataOPT
f=27
TT=255.17
T1=127.75
No dataNo dataNo dataSAT (TO)
f=42
TT=1800.07
T1=222.77
SAT (TO)
f=46
TT=1800.02
T1=0.74
SAT (TO)
f=43
TT=1800.01
T1=166.16
OPT
f=27
TT=59.517
T1=47.91
OPT
f=27
TT=58.966
T1=47.59
OPT
f=27
TT=62.68
T1=48.78
? (TO)

TT=1800.09

? (TO)

TT=1800.08

?

TT=1799.76

No dataNo data?

TT=1799.69

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_013_area_delay.opb
OPT
f=22
TT=23.811
T1=13.43
SAT
f=31
TT=1798.04
T1=2.96
No data? (TO)

TT=1800.01

OPT
f=22
TT=616.169
T1=606.01
OPT
f=22
TT=41.567
T1=38.59
? (problem)

TT=374.41

OPT
f=22
TT=41.888
T1=38.68
? (problem)

TT=637.69

? (problem)

TT=4.51

? (problem)

TT=752.68

? (problem)

TT=4.09

SAT (TO)
f=31
TT=1800.03
T1=3.37
SAT (TO)
f=27
TT=1800.04
T1=423.59
SAT (TO)
f=183
TT=1802.11
T1=83.2
SAT
f=28
TT=1783.02
T1=1582.34
SAT (TO)
f=35
TT=1800.34
T1=1.99
SAT
f=29
TT=1798.01
T1=1485.27
SAT (TO)
f=35
TT=1800.29
T1=1.71
OPT
f=22
TT=70.065
T1=69.93
No dataOPT
f=22
TT=23.811
T1=23.33
SAT (TO)
f=29
TT=1800.2
T1=37.19
OPT
f=22
TT=56.293
T1=55.94
No dataSAT (TO)
f=28
TT=1800.04
T1=350.14
OPT
f=22
TT=66.68
T1=66.29
SAT (TO)
f=25
TT=1800.07
T1=1800.61
OPT
f=22
TT=284.143
T1=278.86
? (TO)

TT=1800.06

No dataNo dataNo dataOPT
f=22
TT=17.53
T1=8.98
No dataNo dataOPT
f=22
TT=26.371
T1=13.43
No dataNo dataNo dataSAT (TO)
f=30
TT=1800.57
T1=760.76
SAT (TO)
f=35
TT=1800.01
T1=1.29
SAT (TO)
f=156
TT=1800.73
T1=1793.95
OPT
f=22
TT=65.054
T1=64.5
OPT
f=22
TT=59.904
T1=59.45
OPT
f=22
TT=68.915
T1=68.34
? (TO)

TT=1800.11

? (TO)

TT=1800.01

OPT
f=22
TT=513.497
T1=513.56
No dataNo dataOPT
f=22
TT=562.92
T1=563.06
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_014_area_delay.opb
OPT
f=27
TT=9.002
T1=4.75
SAT
f=30
TT=1798.01
T1=1449.33
No dataSAT (TO)
f=30
TT=1800.03
T1=409.22
OPT
f=27
TT=14.98
T1=7.44
OPT
f=27
TT=15.562
T1=6.66
? (problem)

TT=0.18

? (problem)

TT=0.177

? (problem)

TT=0.184

? (problem)

TT=0.182

? (problem)

TT=0.186

? (problem)

TT=0.188

SAT (TO)
f=29
TT=1800.1
T1=823.09
SAT (TO)
f=35
TT=1800.09
T1=492.9
SAT (TO)
f=104
TT=1802.1
T1=3.4
SAT
f=30
TT=1783.01
T1=543.89
SAT (TO)
f=38
TT=1800.05
T1=481.8
SAT
f=28
TT=1798
T1=1056.58
SAT (TO)
f=37
TT=1800.42
T1=401.44
OPT
f=27
TT=28.759
T1=14.32
No dataOPT
f=27
TT=9.002
T1=4.75
SAT (TO)
f=30
TT=1800.05
T1=116.84
OPT
f=27
TT=57.693
T1=35.63
No dataSAT (TO)
f=29
TT=1800.02
T1=224.64
OPT
f=27
TT=27.365
T1=17.47
SAT (TO)
f=32
TT=1800.04
T1=1800.4
OPT
f=27
TT=14.918
T1=15.06
OPT
f=27
TT=14.555
T1=7.45
No dataNo dataNo dataOPT
f=27
TT=35.653
T1=17.89
No dataNo dataOPT
f=27
TT=47.523
T1=23.78
No dataNo dataNo dataSAT (TO)
f=32
TT=1800.13
T1=801.56
SAT (TO)
f=41
TT=1800.07
T1=8.44
SAT (TO)
f=52
TT=1800.1
T1=1523.73
OPT
f=27
TT=31.704
T1=17.59
OPT
f=27
TT=29.525
T1=16.33
OPT
f=27
TT=51.897
T1=50.26
? (TO)

TT=1800.1

? (TO)

TT=1800.05

?

TT=1799.43

No dataNo data?

TT=1799.75

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_015_area_delay.opb
OPT
f=25
TT=2.502
T1=2.43
SAT
f=28
TT=1798
T1=474.62
No dataSAT (TO)
f=28
TT=1800.03
T1=257.66
OPT
f=25
TT=10.48
T1=7.15
OPT
f=25
TT=10.847
T1=10.84
? (problem)

TT=0.284

? (problem)

TT=0.264

? (problem)

TT=0.277

? (problem)

TT=0.265

? (problem)

TT=0.283

? (problem)

TT=0.27

SAT (TO)
f=29
TT=1800.1
T1=0.15
SAT (TO)
f=28
TT=1800.08
T1=695.17
SAT (TO)
f=102
TT=1802.11
T1=440.67
SAT
f=27
TT=1783
T1=333.34
SAT (TO)
f=34
TT=1800.01
T1=42.32
SAT
f=28
TT=1798.01
T1=1545.71
SAT (TO)
f=34
TT=1800.88
T1=10.42
OPT
f=25
TT=18.668
T1=15.02
No dataOPT
f=25
TT=2.502
T1=2.43
SAT (TO)
f=27
TT=1800.09
T1=635.01
OPT
f=25
TT=16.042
T1=9.65
No dataSAT (TO)
f=29
TT=1800.62
T1=4.7
OPT
f=25
TT=66.523
T1=56.18
SAT (TO)
f=27
TT=1800.07
T1=1800.4
OPT
f=25
TT=10.281
T1=6.59
OPT
f=25
TT=11.687
T1=7.19
No dataNo dataNo dataOPT
f=25
TT=9.161
T1=4.62
No dataNo dataOPT
f=25
TT=11.907
T1=6
No dataNo dataNo dataSAT (TO)
f=29
TT=1800.26
T1=752.65
SAT (TO)
f=38
TT=1800.66
T1=0.65
SAT (TO)
f=45
TT=1800.77
T1=95.15
OPT
f=25
TT=15.435
T1=15.35
OPT
f=25
TT=15.465
T1=15.38
OPT
f=25
TT=15.52
T1=15.42
? (TO)

TT=1800.1

? (TO)

TT=1800.1

OPT
f=25
TT=4.112
T1=4.22
No dataNo dataOPT
f=25
TT=4.085
T1=4.08
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_016_area_delay.opb
OPT
f=25
TT=3.931
T1=3.81
OPT
f=25
TT=22.675
T1=15.77
No dataSAT (TO)
f=27
TT=1800.02
T1=938.63
OPT
f=25
TT=14.199
T1=6.68
OPT
f=25
TT=14.3
T1=6.37
? (problem)

TT=1.04

OPT
f=25
TT=13.761
T1=5.93
OPT
f=25
TT=16.171
T1=9.86
OPT
f=25
TT=16.456
T1=10.16
OPT
f=25
TT=18.565
T1=11.01
OPT
f=25
TT=13.65
T1=8.49
OPT
f=25
TT=22.879
T1=20.13
SAT (TO)
f=27
TT=1800.07
T1=1273.94
SAT (TO)
f=101
TT=1802.1
T1=327.65
SAT
f=27
TT=1783.01
T1=122.51
SAT (TO)
f=33
TT=1800.03
T1=340.1
OPT
f=25
TT=22.548
T1=15.72
SAT (TO)
f=34
TT=1800.3
T1=5.92
OPT
f=25
TT=28.538
T1=25.49
No dataOPT
f=25
TT=3.931
T1=3.81
SAT (TO)
f=27
TT=1801.1
T1=601.55
OPT
f=25
TT=118.461
T1=110.91
No dataSAT (TO)
f=27
TT=1800.13
T1=250.12
OPT
f=25
TT=23.26
T1=19.82
SAT (TO)
f=28
TT=1800.05
T1=1800.4
OPT
f=25
TT=14.765
T1=9.29
OPT
f=25
TT=19.421
T1=13.87
No dataNo dataNo dataOPT
f=25
TT=21.331
T1=10.7
No dataNo dataOPT
f=25
TT=23.624
T1=11.88
No dataNo dataNo dataSAT (TO)
f=28
TT=1800.12
T1=593.15
SAT (TO)
f=36
TT=1800.03
T1=0.69
SAT (TO)
f=31
TT=1800.56
T1=201.77
OPT
f=25
TT=24.09
T1=23.19
OPT
f=25
TT=24.927
T1=23.92
OPT
f=25
TT=24.871
T1=23.37
? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=25
TT=27.689
T1=27.67
No dataNo dataOPT
f=25
TT=27.696
T1=27.68
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_017_area_delay.opb
OPT
f=25
TT=15.811
T1=10.22
SAT
f=30
TT=1798.01
T1=1.8
No dataSAT (TO)
f=29
TT=1800.03
T1=93.61
OPT
f=25
TT=60.675
T1=60.68
OPT
f=25
TT=26.42
T1=14.05
OPT
f=25
TT=50.142
T1=50.23
OPT
f=25
TT=24.467
T1=12.76
? (problem)

TT=1.16

OPT
f=25
TT=39.436
T1=31.27
? (problem)

TT=1.34

OPT
f=25
TT=38.713
T1=30.73
SAT (TO)
f=29
TT=1800.09
T1=162.81
SAT (TO)
f=31
TT=1800.07
T1=0.45
SAT (TO)
f=86
TT=1802.15
T1=9.81
SAT
f=29
TT=1783.01
T1=65.93
SAT (TO)
f=34
TT=1803.14
T1=547.93
SAT
f=30
TT=1798.01
T1=8.87
SAT (TO)
f=34
TT=1801.02
T1=56.99
OPT
f=25
TT=37.259
T1=32.02
No dataOPT
f=25
TT=15.811
T1=10.22
SAT (TO)
f=28
TT=1800.02
T1=275.02
OPT
f=25
TT=48.259
T1=37.27
No dataSAT (TO)
f=29
TT=1800.13
T1=423.65
OPT
f=25
TT=33.974
T1=26.81
SAT (TO)
f=30
TT=1800.04
T1=1800.4
OPT
f=25
TT=34.447
T1=34.45
OPT
f=25
TT=38.757
T1=25.81
No dataNo dataNo dataOPT
f=25
TT=384.31
T1=192.39
No dataNo dataOPT
f=25
TT=323.37
T1=161.85
No dataNo dataNo dataSAT (TO)
f=30
TT=1800.15
T1=436.17
SAT (TO)
f=38
TT=1800.61
T1=0.63
SAT (TO)
f=35
TT=1800.74
T1=204
OPT
f=25
TT=21.325
T1=18.51
OPT
f=25
TT=22.795
T1=19.67
OPT
f=25
TT=21.711
T1=18.32
? (TO)

TT=1800.06

? (TO)

TT=1800.09

?

TT=1799.6

No dataNo data?

TT=1799.91

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_018_area_delay.opb
OPT
f=25
TT=1.079
T1=1.06
SAT
f=27
TT=1798
T1=659.17
No dataSAT (TO)
f=27
TT=1800.03
T1=108.41
OPT
f=25
TT=2.539
T1=1.89
OPT
f=25
TT=1.936
T1=2.05
? (problem)

TT=0.114

? (problem)

TT=0.125

? (problem)

TT=0.11

? (problem)

TT=0.119

? (problem)

TT=0.113

? (problem)

TT=0.116

SAT (TO)
f=28
TT=1800.02
T1=0.05
OPT
f=25
TT=7.766
T1=6.52
SAT (TO)
f=90
TT=1802.12
T1=1.56
SAT
f=28
TT=1783.01
T1=70.37
SAT (TO)
f=33
TT=1800.01
T1=4.6
SAT
f=27
TT=1798
T1=311.81
SAT (TO)
f=32
TT=1800.91
T1=35.51
OPT
f=25
TT=8.945
T1=8.07
No dataOPT
f=25
TT=1.079
T1=1.06
SAT (TO)
f=27
TT=1800.13
T1=526.35
OPT
f=25
TT=18.818
T1=18.8
No dataSAT (TO)
f=27
TT=1800.56
T1=207.45
OPT
f=25
TT=4.463
T1=3.86
OPT
f=25
TT=3.312
T1=3.3
OPT
f=25
TT=2.425
T1=2.42
OPT
f=25
TT=3.646
T1=3.01
No dataNo dataNo dataOPT
f=25
TT=4.526
T1=2.27
No dataNo dataOPT
f=25
TT=3.597
T1=1.8
No dataNo dataNo dataSAT (TO)
f=27
TT=1800.18
T1=115.92
SAT (TO)
f=34
TT=1800
T1=0.44
SAT (TO)
f=41
TT=1800.08
T1=6.39
OPT
f=25
TT=16.909
T1=16.7
OPT
f=25
TT=16.808
T1=16.6
OPT
f=25
TT=10.149
T1=10.12
? (TO)

TT=1800.12

? (TO)

TT=1800.07

OPT
f=25
TT=1.742
T1=1.74
No dataNo dataOPT
f=25
TT=1.722
T1=1.72
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_019_area_delay.opb
OPT
f=24
TT=4.223
T1=2.57
SAT
f=26
TT=1798
T1=778.07
No dataSAT (TO)
f=26
TT=1800.04
T1=1098.06
OPT
f=24
TT=9.582
T1=6.73
OPT
f=24
TT=6.101
T1=4.12
? (problem)

TT=0.267

? (problem)

TT=0.261

? (problem)

TT=0.267

? (problem)

TT=0.263

? (problem)

TT=0.269

? (problem)

TT=0.276

SAT (TO)
f=28
TT=1800.1
T1=66.37
SAT (TO)
f=28
TT=1800.07
T1=639.35
SAT (TO)
f=95
TT=1802.06
T1=5
SAT
f=27
TT=1783.01
T1=1172.5
SAT (TO)
f=32
TT=1800.64
T1=19.48
SAT
f=27
TT=1798
T1=142.76
SAT (TO)
f=33
TT=1800.43
T1=466.24
OPT
f=24
TT=84.328
T1=84.31
No dataOPT
f=24
TT=4.223
T1=3.98
SAT (TO)
f=28
TT=1800.2
T1=52.71
OPT
f=24
TT=126.157
T1=113.12
No dataSAT (TO)
f=26
TT=1800.17
T1=619.14
OPT
f=24
TT=76.188
T1=75.06
SAT (TO)
f=26
TT=1800.03
T1=1800.4
OPT
f=24
TT=6.392
T1=6.39
OPT
f=24
TT=12.098
T1=8.79
No dataNo dataNo dataOPT
f=24
TT=8.622
T1=4.35
No dataNo dataOPT
f=24
TT=5.074
T1=2.57
No dataNo dataNo data? (TO)

TT=1802.01

SAT (TO)
f=37
TT=1800.56
T1=0.67
SAT (TO)
f=38
TT=1800.08
T1=1276.19
OPT
f=24
TT=31.4
T1=31.34
OPT
f=24
TT=33.654
T1=33.59
OPT
f=24
TT=31.078
T1=31.01
? (TO)

TT=1800.1

? (TO)

TT=1800.1

OPT
f=24
TT=7.244
T1=7.24
No dataNo dataOPT
f=24
TT=7.243
T1=7.23
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_020_area_delay.opb
OPT
f=23
TT=1.096
T1=0.56
SAT
f=24
TT=1798
T1=0.07
No dataSAT (TO)
f=26
TT=1800.03
T1=1251.37
OPT
f=23
TT=2.806
T1=2.49
OPT
f=23
TT=2.197
T1=2.19
? (problem)

TT=0.161

? (problem)

TT=0.159

? (problem)

TT=0.159

? (problem)

TT=0.164

? (problem)

TT=0.159

? (problem)

TT=0.156

SAT (TO)
f=24
TT=1800.09
T1=0.08
OPT
f=23
TT=10.418
T1=7.84
SAT (TO)
f=92
TT=1802.09
T1=2.76
SAT
f=26
TT=1783.01
T1=425.1
SAT (TO)
f=30
TT=1800.06
T1=11.09
SAT
f=24
TT=1798
T1=0.07
SAT (TO)
f=31
TT=1800.47
T1=88.06
OPT
f=23
TT=6.68
T1=6.65
No dataOPT
f=23
TT=1.273
T1=1.25
SAT (TO)
f=24
TT=1800.04
T1=723.5
OPT
f=23
TT=8.809
T1=8.78
No dataSAT (TO)
f=25
TT=1800.14
T1=185.1
OPT
f=23
TT=8.065
T1=8.03
OPT
f=23
TT=3.265
T1=3.25
OPT
f=23
TT=2.246
T1=1.77
OPT
f=23
TT=2.887
T1=2.42
No dataNo dataNo dataOPT
f=23
TT=1.378
T1=0.7
No dataNo dataOPT
f=23
TT=1.096
T1=0.56
No dataNo dataNo dataSAT (TO)
f=24
TT=1800.02
T1=259.5
SAT (TO)
f=33
TT=1800.05
T1=0.63
SAT (TO)
f=38
TT=1800.69
T1=140.42
OPT
f=23
TT=9.238
T1=9.19
OPT
f=23
TT=9.198
T1=9.15
OPT
f=23
TT=8.71
T1=8.65
? (TO)

TT=1800.11

? (TO)

TT=1800.08

OPT
f=23
TT=3.001
T1=2.99
No dataNo dataOPT
f=23
TT=3.002
T1=2.99
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_021_area_delay.opb
OPT
f=24
TT=3.797
T1=2.19
SAT
f=26
TT=1798.01
T1=0.4
No dataSAT (TO)
f=27
TT=1800.03
T1=88.92
OPT
f=24
TT=9.495
T1=6.69
OPT
f=24
TT=7.388
T1=4.93
OPT
f=24
TT=8.858
T1=6.14
OPT
f=24
TT=7.325
T1=4.79
OPT
f=24
TT=12.1
T1=9.46
? (problem)

TT=1.129

OPT
f=24
TT=14.753
T1=11.35
? (problem)

TT=1.119

SAT (TO)
f=26
TT=1800.1
T1=0.22
SAT (TO)
f=25
TT=1800.1
T1=1768.39
SAT (TO)
f=31
TT=1802.1
T1=23.69
SAT
f=27
TT=1783.01
T1=54.38
SAT (TO)
f=28
TT=1800.09
T1=1556.88
SAT
f=26
TT=1798
T1=0.34
SAT (TO)
f=27
TT=1800.69
T1=240.52
OPT
f=24
TT=24.344
T1=20.6
No dataOPT
f=24
TT=4.481
T1=4.38
SAT (TO)
f=27
TT=1800.2
T1=18.75
OPT
f=24
TT=26.885
T1=21.84
No dataSAT (TO)
f=26
TT=1800.16
T1=370.75
OPT
f=24
TT=34.545
T1=27
SAT (TO)
f=26
TT=1800.04
T1=1800.4
OPT
f=24
TT=7.29
T1=4.33
OPT
f=24
TT=14.943
T1=11.37
No dataNo dataNo dataOPT
f=24
TT=5.762
T1=2.92
No dataNo dataOPT
f=24
TT=4.293
T1=2.19
No dataNo dataNo dataSAT (TO)
f=27
TT=1800.16
T1=776.34
SAT (TO)
f=34
TT=1800.02
T1=0.63
SAT (TO)
f=32
TT=1800.07
T1=18.61
OPT
f=24
TT=28.814
T1=26.01
OPT
f=24
TT=28.727
T1=25.96
OPT
f=24
TT=29.127
T1=26.29
? (TO)

TT=1800.09

? (TO)

TT=1800.09

OPT
f=24
TT=3.723
T1=3.71
No dataNo dataOPT
f=24
TT=3.797
T1=3.8
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_022_area_delay.opb
OPT
f=26
TT=3.663
T1=3.59
SAT
f=30
TT=1798
T1=1251.11
No dataSAT (TO)
f=29
TT=1800.11
T1=970.39
OPT
f=26
TT=11.678
T1=7.12
OPT
f=26
TT=15.623
T1=9.05
OPT
f=26
TT=10.909
T1=6.53
OPT
f=26
TT=13.348
T1=7.66
OPT
f=26
TT=10.009
T1=5.98
? (problem)

TT=1.119

OPT
f=26
TT=11.141
T1=6.77
? (problem)

TT=1.26

SAT (TO)
f=30
TT=1800.11
T1=144.4
SAT (TO)
f=29
TT=1800.04
T1=1755.97
SAT (TO)
f=32
TT=1802.1
T1=26.88
SAT
f=30
TT=1783.01
T1=34.77
SAT (TO)
f=34
TT=1800.04
T1=3.23
SAT
f=30
TT=1798.01
T1=260.21
SAT (TO)
f=35
TT=1800.42
T1=859.14
OPT
f=26
TT=29.707
T1=19.92
No dataOPT
f=26
TT=3.663
T1=3.59
SAT (TO)
f=29
TT=1800.08
T1=55.77
OPT
f=26
TT=19.314
T1=14.49
No dataSAT (TO)
f=30
TT=1800.1
T1=645.39
OPT
f=26
TT=22.888
T1=18.71
SAT (TO)
f=30
TT=1800.06
T1=1800.4
OPT
f=26
TT=11.667
T1=11.69
OPT
f=26
TT=13.842
T1=8.21
No dataNo dataNo dataOPT
f=26
TT=37.763
T1=18.96
No dataNo dataOPT
f=26
TT=14.021
T1=7.03
No dataNo dataNo dataSAT (TO)
f=31
TT=1800.58
T1=573.67
SAT (TO)
f=41
TT=1800.01
T1=0.63
SAT (TO)
f=51
TT=1800.07
T1=40.35
OPT
f=26
TT=25.173
T1=17.9
OPT
f=26
TT=25.27
T1=18.04
OPT
f=26
TT=23.902
T1=18.77
? (TO)

TT=1800.11

? (TO)

TT=1800.11

OPT
f=26
TT=56.08
T1=56.19
No dataNo dataOPT
f=26
TT=54.47
T1=54.57
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_023_area_delay.opb
OPT
f=22
TT=26.127
T1=25.74
SAT
f=28
TT=1798.08
T1=2.71
No data? (TO)

TT=1800.09

OPT
f=22
TT=285.026
T1=279.79
OPT
f=22
TT=34.715
T1=34.69
? (problem)

TT=115.24

OPT
f=22
TT=31.225
T1=31.19
? (problem)

TT=241.53

OPT
f=22
TT=45.575
T1=37.26
? (problem)

TT=264.57

OPT
f=22
TT=40.039
T1=32.62
SAT (TO)
f=28
TT=1800.05
T1=2.91
SAT (TO)
f=24
TT=1800.11
T1=240.27
SAT (TO)
f=26
TT=1802.02
T1=227.57
SAT
f=30
TT=1783.01
T1=62.22
SAT (TO)
f=35
TT=1800.35
T1=155.7
SAT
f=28
TT=1798.01
T1=2.69
SAT (TO)
f=35
TT=1800.62
T1=1313.09
OPT
f=22
TT=857.608
T1=857.21
No dataOPT
f=22
TT=26.127
T1=25.74
SAT (TO)
f=27
TT=1800.04
T1=418.56
OPT
f=22
TT=689.274
T1=689
No dataSAT (TO)
f=27
TT=1800.07
T1=529.35
OPT
f=22
TT=613.371
T1=613.06
SAT (TO)
f=24
TT=1800.05
T1=1800.5
OPT
f=22
TT=253.631
T1=244.76
? (TO)

TT=1800.09

No dataNo dataNo dataOPT
f=22
TT=18.263
T1=9.31
No dataNo dataOPT
f=22
TT=56.116
T1=28.24
No dataNo dataNo dataSAT (TO)
f=32
TT=1800.11
T1=214.83
SAT (TO)
f=37
TT=1800.09
T1=1.25
SAT (TO)
f=52
TT=1800.67
T1=1515.39
OPT
f=22
TT=295.64
T1=295.25
OPT
f=22
TT=264.449
T1=264.01
OPT
f=22
TT=290.473
T1=289.99
? (TO)

TT=1800.1

? (TO)

TT=1800.02

OPT
f=22
TT=1224.59
T1=1224.67
No dataNo dataOPT
f=22
TT=1275.94
T1=1275.92
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_024_area_delay.opb
OPT
f=24
TT=1.396
T1=1.38
SAT
f=25
TT=1798
T1=724.57
No dataSAT (TO)
f=25
TT=1800.03
T1=724.48
OPT
f=24
TT=5.678
T1=5.67
OPT
f=24
TT=5.836
T1=5.82
OPT
f=24
TT=5.454
T1=5.45
OPT
f=24
TT=5.852
T1=5.99
OPT
f=24
TT=6.155
T1=3.75
OPT
f=24
TT=7.637
T1=4.36
OPT
f=24
TT=6.335
T1=3.86
OPT
f=24
TT=7.585
T1=4.35
SAT (TO)
f=25
TT=1800.11
T1=717.75
OPT
f=24
TT=14.846
T1=8.39
SAT (TO)
f=30
TT=1802.08
T1=7.31
SAT
f=26
TT=1783.01
T1=6.82
SAT (TO)
f=28
TT=1800.06
T1=518.42
SAT
f=27
TT=1798
T1=103.19
SAT (TO)
f=29
TT=1800.27
T1=11.05
OPT
f=24
TT=10.749
T1=6.68
No dataOPT
f=24
TT=1.396
T1=1.38
SAT (TO)
f=27
TT=1801.19
T1=247.31
OPT
f=24
TT=42.439
T1=39.44
No dataSAT (TO)
f=27
TT=1800.19
T1=3.47
OPT
f=24
TT=18.197
T1=10.5
OPT
f=24
TT=9.699
T1=9.69
OPT
f=24
TT=5.177
T1=1.97
OPT
f=24
TT=6.499
T1=4.1
No dataNo dataNo dataOPT
f=24
TT=9.048
T1=4.54
No dataNo dataOPT
f=24
TT=15.296
T1=7.68
No dataNo dataNo dataSAT (TO)
f=27
TT=1800.72
T1=270.55
SAT (TO)
f=32
TT=1800.5
T1=0.55
SAT (TO)
f=42
TT=1800.66
T1=386.04
OPT
f=24
TT=16.141
T1=8.01
OPT
f=24
TT=16.119
T1=8.02
OPT
f=24
TT=10.769
T1=7.78
? (TO)

TT=1800.08

? (TO)

TT=1800.01

?

TT=1799.81

No dataNo data?

TT=1799.62

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_025_area_delay.opb
OPT
f=25
TT=15.14
T1=14.84
SAT
f=28
TT=1798.03
T1=282.89
No data? (TO)

TT=1800.01

OPT
f=25
TT=129.745
T1=122.34
OPT
f=25
TT=46.07
T1=46.04
? (problem)

TT=0.97

? (problem)

TT=0.951

? (problem)

TT=0.98

? (problem)

TT=0.98

? (problem)

TT=0.98

? (problem)

TT=1

OPT
f=25
TT=146.11
T1=138.09
SAT (TO)
f=35
TT=1800.03
T1=1.82
SAT (TO)
f=135
TT=1802.14
T1=96.67
SAT
f=33
TT=1783.01
T1=135.27
SAT (TO)
f=44
TT=1802
T1=1.3
SAT
f=28
TT=1798.07
T1=282.49
SAT (TO)
f=44
TT=1800.24
T1=1.12
OPT
f=25
TT=148.677
T1=148.46
No dataOPT
f=25
TT=15.14
T1=14.84
SAT (TO)
f=32
TT=1800.18
T1=3.27
OPT
f=25
TT=213.138
T1=213.03
No dataSAT (TO)
f=31
TT=1800.15
T1=696.38
OPT
f=25
TT=138.262
T1=138.17
SAT (TO)
f=34
TT=1800.08
T1=1800.61
OPT
f=25
TT=179.7
T1=181.3
? (TO)

TT=1800.11

No dataNo dataNo dataOPT
f=25
TT=72.83
T1=36.66
No dataNo dataOPT
f=25
TT=51.642
T1=25.98
No dataNo dataNo dataSAT (TO)
f=35
TT=1800.56
T1=551.66
SAT (TO)
f=43
TT=1800.08
T1=63.64
SAT (TO)
f=58
TT=1800.65
T1=891.89
OPT
f=25
TT=69.531
T1=69.34
OPT
f=25
TT=69.276
T1=69.08
OPT
f=25
TT=75.272
T1=75.03
? (TO)

TT=1800.12

? (TO)

TT=1800.11

OPT
f=25
TT=1325.17
T1=1325.67
No dataNo dataOPT
f=25
TT=1325.23
T1=1325.61
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_026_area_delay.opb
OPT
f=28
TT=23.679
T1=15.95
SAT
f=30
TT=1798.01
T1=350.2
No dataSAT (TO)
f=31
TT=1800.1
T1=1490.76
OPT
f=28
TT=115.281
T1=115.45
OPT
f=28
TT=55.692
T1=55.76
? (problem)

TT=0.429

? (problem)

TT=0.424

? (problem)

TT=0.434

? (problem)

TT=0.423

? (problem)

TT=0.43

? (problem)

TT=0.42

SAT (TO)
f=29
TT=1800.1
T1=1646.39
SAT (TO)
f=34
TT=1800.06
T1=403.02
SAT (TO)
f=90
TT=1802.11
T1=10.4
SAT
f=30
TT=1783.01
T1=581.59
SAT (TO)
f=36
TT=1800.09
T1=20.31
SAT
f=31
TT=1798.01
T1=17.49
SAT (TO)
f=35
TT=1800.29
T1=31.46
OPT
f=28
TT=111.669
T1=45.32
No dataOPT
f=28
TT=23.679
T1=15.95
SAT (TO)
f=31
TT=1801.2
T1=3.81
OPT
f=28
TT=190.712
T1=62.97
No dataSAT (TO)
f=31
TT=1800.15
T1=11.51
OPT
f=28
TT=115.87
T1=59.81
SAT (TO)
f=35
TT=1800.1
T1=1800.5
OPT
f=28
TT=154.42
T1=154.45
OPT
f=28
TT=1296.93
T1=1262.56
No dataNo dataNo dataOPT
f=28
TT=151.6
T1=75.87
No dataNo dataOPT
f=28
TT=115.288
T1=57.7
No dataNo dataNo dataSAT (TO)
f=35
TT=1800.63
T1=203.65
SAT (TO)
f=38
TT=1800.1
T1=0.69
SAT (TO)
f=45
TT=1800.85
T1=31.66
OPT
f=28
TT=108.841
T1=56.85
OPT
f=28
TT=107.252
T1=55.62
OPT
f=28
TT=107.514
T1=55.9
? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.84

No dataNo data?

TT=1799.41

normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_027_area_delay.opb
OPT
f=25
TT=2.141
T1=2.09
SAT
f=27
TT=1798
T1=1511.12
No dataSAT (TO)
f=28
TT=1800.02
T1=780.36
OPT
f=25
TT=13.901
T1=13.91
OPT
f=25
TT=11.61
T1=8.37
? (problem)

TT=0.314

? (problem)

TT=0.306

? (problem)

TT=0.307

? (problem)

TT=0.306

? (problem)

TT=0.31

? (problem)

TT=0.335

SAT (TO)
f=29
TT=1800.11
T1=0.18
SAT (TO)
f=28
TT=1800.1
T1=0.42
SAT (TO)
f=95
TT=1802.05
T1=8.07
SAT
f=28
TT=1783.01
T1=68.49
SAT (TO)
f=35
TT=1800.09
T1=9.54
SAT
f=27
TT=1798.01
T1=1545.73
SAT (TO)
f=36
TT=1800.25
T1=8.78
OPT
f=25
TT=27.163
T1=24.92
No dataOPT
f=25
TT=4.183
T1=4.09
SAT (TO)
f=28
TT=1800.01
T1=620.93
OPT
f=25
TT=21.377
T1=18.91
No dataSAT (TO)
f=28
TT=1800.01
T1=749.38
OPT
f=25
TT=28.098
T1=28.03
SAT (TO)
f=28
TT=1800.05
T1=1800.4
OPT
f=25
TT=13.921
T1=13.99
OPT
f=25
TT=14.842
T1=11.78
No dataNo dataNo dataOPT
f=25
TT=1.333
T1=0.7
No dataNo dataOPT
f=25
TT=4.12
T1=2.09
No dataNo dataNo dataSAT (TO)
f=29
TT=1800.12
T1=420.8
SAT (TO)
f=37
TT=1800.05
T1=0.69
SAT (TO)
f=53
TT=1800.05
T1=27.04
OPT
f=25
TT=17.326
T1=16.06
OPT
f=25
TT=17.24
T1=16.01
OPT
f=25
TT=17.403
T1=16.7
? (TO)

TT=1800.1

? (TO)

TT=1800.11

OPT
f=25
TT=2.141
T1=2.13
No dataNo dataOPT
f=25
TT=2.141
T1=2.25
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_028_area_delay.opb
OPT
f=23
TT=5.46
T1=2.9
SAT
f=25
TT=1798.04
T1=212.89
No data? (TO)

TT=1800.01

OPT
f=23
TT=91.33
T1=90.06
OPT
f=23
TT=5.482
T1=4.68
? (problem)

TT=0.98

? (problem)

TT=0.953

? (problem)

TT=0.97

? (problem)

TT=0.92

? (problem)

TT=0.99

? (problem)

TT=0.94

OPT
f=23
TT=126.23
T1=125.29
SAT (TO)
f=30
TT=1800.07
T1=753.38
SAT (TO)
f=147
TT=1802.14
T1=21.25
SAT
f=31
TT=1783.02
T1=1060.3
SAT (TO)
f=33
TT=1800.3
T1=1.55
SAT
f=25
TT=1798.01
T1=211.29
SAT (TO)
f=33
TT=1800.65
T1=1.33
OPT
f=23
TT=26.131
T1=25.84
No dataOPT
f=23
TT=14.616
T1=14.3
SAT (TO)
f=28
TT=1801.03
T1=614.8
OPT
f=23
TT=38.628
T1=38.33
No dataSAT (TO)
f=29
TT=1800.19
T1=7.12
OPT
f=23
TT=32.35
T1=32.01
SAT (TO)
f=31
TT=1800.06
T1=1800.5
OPT
f=23
TT=141.453
T1=141.48
? (TO)

TT=1800.03

No dataNo dataNo dataOPT
f=23
TT=4.202
T1=2.26
No dataNo dataOPT
f=23
TT=5.46
T1=2.9
No dataNo dataNo dataSAT (TO)
f=32
TT=1800.17
T1=485.23
SAT (TO)
f=33
TT=1800.09
T1=1.23
SAT (TO)
f=51
TT=1800.64
T1=1.1
OPT
f=23
TT=36.693
T1=36.32
OPT
f=23
TT=38.317
T1=37.93
OPT
f=23
TT=40.161
T1=39.69
? (TO)

TT=1800.11

? (TO)

TT=1800.01

OPT
f=23
TT=220.623
T1=220.61
No dataNo dataOPT
f=23
TT=219.932
T1=219.93
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_029_area_delay.opb
OPT
f=24
TT=12.186
T1=10.23
SAT
f=26
TT=1798.01
T1=1173.83
No data? (TO)

TT=1800.1

OPT
f=24
TT=240.301
T1=235.93
OPT
f=24
TT=13.683
T1=10.23
? (problem)

TT=1.02

? (problem)

TT=5.3

? (problem)

TT=1.01

? (problem)

TT=2.27

? (problem)

TT=1.03

? (problem)

TT=2.12

OPT
f=24
TT=102.464
T1=102.05
SAT (TO)
f=27
TT=1800.07
T1=1.93
SAT (TO)
f=87
TT=1802.12
T1=159.43
SAT
f=33
TT=1783.01
T1=6.52
SAT (TO)
f=39
TT=1800.02
T1=1.95
SAT
f=26
TT=1798.07
T1=1080.87
SAT (TO)
f=39
TT=1800.79
T1=1.62
OPT
f=24
TT=90.901
T1=90.57
No dataOPT
f=24
TT=12.186
T1=11.84
SAT (TO)
f=30
TT=1800.86
T1=717.48
OPT
f=24
TT=121.453
T1=121.16
No dataSAT (TO)
f=30
TT=1800.19
T1=789.78
OPT
f=24
TT=96.379
T1=96.05
SAT (TO)
f=27
TT=1800.07
T1=1800.5
OPT
f=24
TT=185.311
T1=181.58
? (TO)

TT=1800.09

No dataNo dataNo dataOPT
f=24
TT=6.987
T1=3.66
No dataNo dataOPT
f=24
TT=22.631
T1=11.52
No dataNo dataNo dataSAT (TO)
f=36
TT=1800.45
T1=516.28
SAT (TO)
f=39
TT=1800.59
T1=1.31
SAT (TO)
f=29
TT=1800.62
T1=1.15
OPT
f=24
TT=49.739
T1=49.35
OPT
f=24
TT=49.496
T1=49.1
OPT
f=24
TT=55.139
T1=54.68
? (TO)

TT=1800.12

? (TO)

TT=1800.11

OPT
f=24
TT=48.931
T1=48.92
No dataNo dataOPT
f=24
TT=48.542
T1=48.55
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/manquinho/areaDelay/
normalized-f20c10b_030_area_delay.opb
OPT
f=25
TT=1.211
T1=1.18
SAT
f=28
TT=1798
T1=48.86
No dataSAT (TO)
f=28
TT=1800.12
T1=873.05
OPT
f=25
TT=3.37
T1=2.42
OPT
f=25
TT=4.683
T1=3.51
OPT
f=25
TT=2.907
T1=1.86
OPT
f=25
TT=4.5
T1=3.31
OPT
f=25
TT=4.225
T1=3.16
? (problem)

TT=0.453

OPT
f=25
TT=4.547
T1=3.45
? (problem)

TT=0.451

SAT (TO)
f=28
TT=1800.01
T1=355.83
SAT (TO)
f=27
TT=1800.06
T1=366.72
SAT (TO)
f=99
TT=1802.12
T1=3.64
SAT
f=28
TT=1783
T1=486.55
SAT (TO)
f=34
TT=1800.07
T1=102.77
SAT
f=27
TT=1798
T1=1650.83
SAT (TO)
f=34
TT=1800.45
T1=32.49
OPT
f=25
TT=23.052
T1=23.02
No dataOPT
f=25
TT=1.211
T1=1.18
SAT (TO)
f=26
TT=1800.11
T1=919.56
OPT
f=25
TT=8.632
T1=8.6
No dataSAT (TO)
f=28
TT=1800.11
T1=489.21
OPT
f=25
TT=6.102
T1=6.06
SAT (TO)
f=26
TT=1800.08
T1=1800.4
OPT
f=25
TT=2.332
T1=1.21
OPT
f=25
TT=4.743
T1=3.59
No dataNo dataNo dataOPT
f=25
TT=4.458
T1=2.24
No dataNo dataOPT
f=25
TT=2.633
T1=1.33
No dataNo dataNo dataSAT (TO)
f=29
TT=1800.59
T1=669.98
SAT (TO)
f=36
TT=1800.46
T1=0.67
SAT (TO)
f=38
TT=1800.51
T1=0.49
OPT
f=25
TT=9.682
T1=9.64
OPT
f=25
TT=9.643
T1=9.59
OPT
f=25
TT=9.532
T1=9.48
? (TO)

TT=1800.08

? (TO)

TT=1800.02

OPT
f=25
TT=5.422
T1=5.41
No dataNo dataOPT
f=25
TT=5.409
T1=5.41
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/poldner/PB/
testset/normalized-10_20.opb
OPT
f=8034
TT=0.007
T1=0
OPT
f=8034
TT=0.007
T1=0
No dataOPT
f=8034
TT=3.67
T1=0
OPT
f=8034
TT=25.967
T1=20.99
OPT
f=8034
TT=28.337
T1=11
OPT
f=8034
TT=25.865
T1=20.91
OPT
f=8034
TT=28.839
T1=11.1
OPT
f=8034
TT=20.489
T1=18.13
OPT
f=8034
TT=25.168
T1=22.62
OPT
f=8034
TT=20.717
T1=18.33
OPT
f=8034
TT=25.367
T1=22.75
OPT
f=8034
TT=0.007
T1=0
OPT
f=8034
TT=376.615
T1=251.44
OPT
f=8034
TT=187.419
T1=180.67
OPT
f=8034
TT=30.053
T1=23.58
OPT
f=8034
TT=8.68
T1=0.67
OPT
f=8034
TT=0.006
T1=0
OPT
f=8034
TT=11.731
T1=0.71
OPT
f=8034
TT=0.025
T1=0.02
No dataOPT
f=8034
TT=0.013
T1=0.01
OPT
f=8034
TT=2.542
T1=3.17
OPT
f=8034
TT=0.023
T1=0.02
No dataOPT
f=8034
TT=2.155
T1=1.66
OPT
f=8034
TT=0.023
T1=0.01
OPT
f=8034
TT=312.308
T1=312.37
OPT
f=8034
TT=27.12
T1=22.29
OPT
f=8034
TT=21.108
T1=19.16
No dataNo dataNo dataOPT
f=8034
TT=0.142
T1=0.07
No dataNo dataOPT
f=8034
TT=0.142
T1=0.06
No dataNo dataNo dataOPT
f=8034
TT=1.713
T1=2.67
OPT
f=8034
TT=6.623
T1=1.86
OPT
f=8034
TT=58.964
T1=56.15
OPT
f=8034
TT=0.018
T1=0.01
OPT
f=8034
TT=0.023
T1=0.01
OPT
f=8034
TT=0.022
T1=0.01
OPT
f=8034
TT=1372.36
T1=1298.25
OPT
f=8034
TT=1348.91
T1=1276.32
OPT
f=8034
TT=0.072
T1=0.06
No dataNo dataOPT
f=8034
TT=0.072
T1=0.06
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/poldner/PB/
testset/normalized-11_22.opb
OPT
f=8908
TT=0.026
T1=0.01
OPT
f=8908
TT=0.026
T1=0.01
No dataOPT
f=8908
TT=329.352
T1=270.27
OPT
f=8908
TT=80.662
T1=51.41
OPT
f=8908
TT=90.17
T1=49.33
OPT
f=8908
TT=79.362
T1=50.51
OPT
f=8908
TT=88.542
T1=48.28
OPT
f=8908
TT=81.53
T1=73.25
OPT
f=8908
TT=96.884
T1=89.8
OPT
f=8908
TT=83.401
T1=74.85
OPT
f=8908
TT=95.026
T1=87.68
OPT
f=8908
TT=0.021
T1=0.01
SAT (TO)
f=9699
TT=1800.11
T1=1449.83
SAT (TO)
f=10468
TT=1800.1
T1=1797.44
OPT
f=8908
TT=674.119
T1=277.02
SAT (TO)
f=9029
TT=1800.07
T1=1753.59
OPT
f=8908
TT=0.027
T1=0.01
? (exit code)

TT=1166.01

OPT
f=8908
TT=0.058
T1=0.05
No dataOPT
f=8908
TT=0.027
T1=0.02
OPT
f=8908
TT=3.125
T1=6.19
OPT
f=8908
TT=0.084
T1=0.08
No dataOPT
f=8908
TT=2.186
T1=3.68
OPT
f=8908
TT=0.072
T1=0.08
SAT (TO)
f=9184
TT=1800.1
T1=1800.4
OPT
f=8908
TT=81.427
T1=51.86
OPT
f=8908
TT=83.486
T1=75.58
No dataNo dataNo dataOPT
f=8908
TT=0.292
T1=0.14
No dataNo dataOPT
f=8908
TT=0.302
T1=0.14
No dataNo dataNo dataOPT
f=8908
TT=3.114
T1=4.18
OPT
f=8908
TT=580.71
T1=561.22
SAT (TO)
f=10217
TT=1800
T1=1655.71
OPT
f=8908
TT=0.085
T1=0.08
OPT
f=8908
TT=0.116
T1=0.11
OPT
f=8908
TT=0.048
T1=0.04
? (TO)

TT=1800.03

? (TO)

TT=1800.03

OPT
f=8908
TT=0.152
T1=0.14
No dataNo dataOPT
f=8908
TT=0.153
T1=0.14
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/poldner/PB/
testset/normalized-5_10.opb
OPT
f=3951
TT=0.001
T1=0
OPT
f=3951
TT=0.044
T1=0.04
No dataOPT
f=3951
TT=0.004
T1=0
OPT
f=3951
TT=16.042
T1=9.37
OPT
f=3951
TT=36.231
T1=26.12
OPT
f=3951
TT=10.972
T1=5.49
OPT
f=3951
TT=31.995
T1=23.15
OPT
f=3951
TT=5.893
T1=5.33
OPT
f=3951
TT=4.438
T1=4.2
OPT
f=3951
TT=7.251
T1=6.58
OPT
f=3951
TT=4.376
T1=4.13
OPT
f=3951
TT=0.038
T1=0.04
OPT
f=3951
TT=1.874
T1=1.75
OPT
f=3951
TT=0.072
T1=0.06
OPT
f=3951
TT=0.013
T1=0.01
OPT
f=3951
TT=0.304
T1=0.12
OPT
f=3951
TT=0.041
T1=0.04
OPT
f=3951
TT=0.312
T1=0.12
OPT
f=3951
TT=0.016
T1=0.01
No dataOPT
f=3951
TT=0.007
T1=0
OPT
f=3951
TT=0.623
T1=1.14
OPT
f=3951
TT=0.014
T1=0.01
No dataOPT
f=3951
TT=0.564
T1=0.63
OPT
f=3951
TT=0.017
T1=0.01
OPT
f=3951
TT=0.472
T1=0.52
OPT
f=3951
TT=8.161
T1=4.71
OPT
f=3951
TT=8.379
T1=7.64
No dataNo dataNo dataOPT
f=3951
TT=0.002
T1=0
No dataNo dataOPT
f=3951
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=3951
TT=0.494
T1=0.63
OPT
f=3951
TT=0.284
T1=0.14
OPT
f=3951
TT=0.523
T1=0.26
OPT
f=3951
TT=0.013
T1=0.01
OPT
f=3951
TT=0.018
T1=0.01
OPT
f=3951
TT=0.015
T1=0.01
OPT
f=3951
TT=0.035
T1=0
OPT
f=3951
TT=0.035
T1=0
OPT
f=3951
TT=0.002
T1=0
No dataNo dataOPT
f=3951
TT=0.001
T1=0
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/poldner/PB/
testset/normalized-6_12.opb
OPT
f=5867
TT=0.009
T1=0
OPT
f=5867
TT=0.093
T1=0
No dataOPT
f=5867
TT=0.009
T1=0
OPT
f=5867
TT=2.109
T1=0.02
OPT
f=5867
TT=1.789
T1=0.03
OPT
f=5867
TT=1.979
T1=0.01
OPT
f=5867
TT=1.683
T1=0.02
OPT
f=5867
TT=0.185
T1=0.01
OPT
f=5867
TT=0.184
T1=0.02
OPT
f=5867
TT=0.203
T1=0.01
OPT
f=5867
TT=0.185
T1=0.02
OPT
f=5867
TT=0.072
T1=0
OPT
f=5867
TT=0.84
T1=0
OPT
f=5867
TT=0.075
T1=0.06
OPT
f=5867
TT=0.077
T1=0.01
OPT
f=5867
TT=0.492
T1=0.15
OPT
f=5867
TT=0.08
T1=0
OPT
f=5867
TT=0.575
T1=0.15
OPT
f=5867
TT=0.019
T1=0.01
No dataOPT
f=5867
TT=0.013
T1=0.01
OPT
f=5867
TT=0.735
T1=2.14
OPT
f=5867
TT=0.046
T1=0.04
No dataOPT
f=5867
TT=0.604
T1=1.14
OPT
f=5867
TT=0.036
T1=0.03
OPT
f=5867
TT=0.523
T1=0.52
OPT
f=5867
TT=1.974
T1=0
OPT
f=5867
TT=0.186
T1=0.01
No dataNo dataNo dataOPT
f=5867
TT=0.043
T1=0.01
No dataNo dataOPT
f=5867
TT=0.042
T1=0.01
No dataNo dataNo dataOPT
f=5867
TT=0.653
T1=1.63
OPT
f=5867
TT=0.466
T1=0.15
OPT
f=5867
TT=0.514
T1=0.14
OPT
f=5867
TT=0.043
T1=0.04
OPT
f=5867
TT=0.067
T1=0.06
OPT
f=5867
TT=0.019
T1=0.01
OPT
f=5867
TT=0.352
T1=0.27
OPT
f=5867
TT=0.348
T1=0.27
OPT
f=5867
TT=0.021
T1=0.01
No dataNo dataOPT
f=5867
TT=0.021
T1=0.01
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/poldner/PB/
testset/normalized-7_14.opb
OPT
f=5148
TT=0.002
T1=0
OPT
f=5148
TT=0.003
T1=0
No dataOPT
f=5148
TT=0.824
T1=0
OPT
f=5148
TT=5.242
T1=2.13
OPT
f=5148
TT=3.988
T1=3.27
OPT
f=5148
TT=5.153
T1=2.08
OPT
f=5148
TT=3.87
T1=3.18
OPT
f=5148
TT=7.471
T1=7
OPT
f=5148
TT=5.771
T1=5.55
OPT
f=5148
TT=7.545
T1=6.96
OPT
f=5148
TT=5.795
T1=5.51
OPT
f=5148
TT=0.005
T1=0
OPT
f=5148
TT=44.331
T1=40.58
OPT
f=5148
TT=8.362
T1=6.96
OPT
f=5148
TT=3.317
T1=2.49
OPT
f=5148
TT=1.764
T1=0.13
OPT
f=5148
TT=0.003
T1=0
OPT
f=5148
TT=2.346
T1=0.14
OPT
f=5148
TT=0.018
T1=0.01
No dataOPT
f=5148
TT=0.006
T1=0
OPT
f=5148
TT=1.364
T1=1.14
OPT
f=5148
TT=0.02
T1=0.01
No dataOPT
f=5148
TT=1.033
T1=0.64
OPT
f=5148
TT=0.019
T1=0.01
OPT
f=5148
TT=46.91
T1=46.92
OPT
f=5148
TT=5.149
T1=2.24
OPT
f=5148
TT=7.707
T1=7.26
No dataNo dataNo dataOPT
f=5148
TT=0.001
T1=0.01
No dataNo dataOPT
f=5148
TT=0.002
T1=0.01
No dataNo dataNo dataOPT
f=5148
TT=1.043
T1=0.63
OPT
f=5148
TT=2.134
T1=0.14
OPT
f=5148
TT=6.492
T1=4.28
OPT
f=5148
TT=0.014
T1=0.01
OPT
f=5148
TT=0.019
T1=0.01
OPT
f=5148
TT=0.018
T1=0.01
OPT
f=5148
TT=8.4
T1=0
OPT
f=5148
TT=8.276
T1=0
OPT
f=5148
TT=0.002
T1=0.01
No dataNo dataOPT
f=5148
TT=0.002
T1=0.01
normalized-PB07/OPT-SMALLINT-LIN/
submittedPB07/poldner/PB/
testset/normalized-8_16.opb
OPT
f=5852
TT=0.01
T1=0
OPT
f=5852
TT=0.01
T1=0
No dataOPT
f=5852
TT=335.046
T1=10.04
OPT
f=5852
TT=12.586
T1=9.67
OPT
f=5852
TT=17.755
T1=9.59
OPT
f=5852
TT=12.433
T1=9.75
OPT
f=5852
TT=17.9
T1=9.52
OPT
f=5852
TT=9.852
T1=8.48
OPT
f=5852
TT=15.466
T1=13.35
OPT
f=5852
TT=9.998
T1=8.64
OPT
f=5852
TT=15.671
T1=13.61
OPT
f=5852
TT=0.018
T1=0.01
SAT (TO)
f=5887
TT=1800.1
T1=1432.41
OPT
f=5852
TT=808.617
T1=276.14
OPT
f=5852
TT=642.9
T1=19.6
SAT (TO)
f=5886
TT=1800.03
T1=21.94
OPT
f=5852
TT=0.011
T1=0
SAT (TO)
f=5866
TT=1800.47
T1=1438.61
OPT
f=5852
TT=0.037
T1=0.03
No dataOPT
f=5852
TT=0.025
T1=0.02
OPT
f=5852
TT=3.114
T1=4.16
OPT
f=5852
TT=0.058
T1=0.05
No dataOPT
f=5852
TT=3.553
T1=2.16
OPT
f=5852
TT=0.059
T1=0.05
SAT (TO)
f=6211
TT=1800.11
T1=1800.4
OPT
f=5852
TT=12.505
T1=9.71
OPT
f=5852
TT=10.104
T1=8.74
No dataNo dataNo dataOPT
f=5852
TT=0.103
T1=0.05
No dataNo dataOPT
f=5852
TT=0.123
T1=0.05
No dataNo dataNo dataOPT
f=5852
TT=4.344
T1=1.66
OPT
f=5852
TT=368.22
T1=135.44
OPT
f=5852
TT=1453.67
T1=1436.4
OPT
f=5852
TT=0.066
T1=0.06
OPT
f=5852
TT=0.093
T1=0.08
OPT
f=5852
TT=0.037
T1=0.03
? (TO)

TT=1800.03

? (TO)

TT=1800.03

OPT
f=5852
TT=0.053
T1=0.05
No dataNo dataOPT
f=5852
TT=0.052
T1=0.05
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_1000_25_1.opb
SAT
f=-134
TT=1800.1
T1=610.85
SAT
f=-111
TT=1798.01
T1=1741.55
No dataSAT (TO)
f=-134
TT=1800.1
T1=610.85
? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.14

? (TO)

TT=1800.07

? (TO)

TT=1800.14

? (TO)

TT=1800.07

SAT (TO)
f=-35
TT=1800.17
T1=166.28
? (TO)

TT=1800.11

? (TO)

TT=1800.05

SAT
f=-101
TT=1783.03
T1=1783.48
?

TT=38.25

Signal

TT=1156.77

SAT (TO)
f=-100
TT=1800.58
T1=1085.23
?

TT=1793.1

No dataNo Cert.

TT=1800.09

SAT (TO)
f=-79
TT=1800.63
T1=769.65
SAT
f=0
TT=1791.91
T1=0.33
No dataSAT (TO)
f=-82
TT=1800.02
T1=276.31
SAT
f=-2
TT=1797.21
T1=1113.09
?

TT=0.005

? (TO)

TT=1800.01

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-2
TT=1800.02
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-2
TT=1800.03
T1=900.41
SAT (TO)
f=-94
TT=1800.14
T1=274.94
SAT (TO)
f=-84
TT=1800.03
T1=491.58
SAT (TO)
f=-110
TT=1800.4
T1=1016.38
SAT
f=-17
TT=1796.99
T1=1661.12
SAT
f=-3
TT=1798.26
T1=1496
SAT
f=-17
TT=1796.99
T1=1686.93
? (TO)

TT=1800.08

? (TO)

TT=1800.03

No data?

TT=1800.01

?

TT=1800

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_1000_25_2.opb
SAT
f=-130
TT=1800.1
T1=8.81
SAT
f=-113
TT=1798.02
T1=1358.81
No dataSAT (TO)
f=-130
TT=1800.1
T1=8.81
? (TO)

TT=1800.04

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.04

SAT (TO)
f=-33
TT=1800.11
T1=221.29
? (TO)

TT=1800.1

? (TO)

TT=1729.75

SAT
f=-98
TT=1783.02
T1=1783.41
?

TT=36.61

Signal

TT=774.185

? (exit code)

TT=1204.3

?

TT=1794.06

No dataNo Cert.

TT=1800.02

SAT (TO)
f=-78
TT=1800.19
T1=491.92
SAT
f=0
TT=1791.96
T1=0.38
No dataSAT (TO)
f=-79
TT=1800.74
T1=185.55
? (TO)

TT=1802.03

?

TT=0.006

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-2
TT=1800.06
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-2
TT=1800.03
T1=900.41
SAT (TO)
f=-90
TT=1800.64
T1=144.79
SAT (TO)
f=-76
TT=1800.01
T1=207.58
SAT (TO)
f=-111
TT=1800.08
T1=1125.06
SAT
f=-20
TT=1797.06
T1=471.37
SAT
f=-3
TT=1797.05
T1=1359.14
SAT
f=-20
TT=1797.13
T1=572.33
? (TO)

TT=1800.08

? (TO)

TT=1800.08

No data?

TT=1799.84

?

TT=1799.95

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_1000_60_1.opb
SAT
f=-70
TT=1800.11
T1=652.41
SAT
f=-61
TT=1798.04
T1=1546.1
No dataSAT (TO)
f=-70
TT=1800.11
T1=652.41
? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.01

SAT (TO)
f=-23
TT=1800.11
T1=296.27
? (TO)

TT=1800.11

? (TO)

TT=1486.37

SAT
f=-49
TT=1783.06
T1=1783.52
?

TT=257.367

Signal

TT=1597.25

SAT (TO)
f=-54
TT=1800.08
T1=522.66
?

TT=1795.99

No dataNo Cert.

TT=1800.01

SAT (TO)
f=-47
TT=1800.06
T1=760.15
SAT
f=0
TT=1792.39
T1=0.81
No dataSAT (TO)
f=-43
TT=1800.19
T1=227.04
? (TO)

TT=1802.09

?

TT=0.006

? (TO)

TT=1800

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-48
TT=1800.18
T1=900.71
No dataNo dataNo dataSAT (TO)
f=-53
TT=1800.11
T1=900.71
SAT (TO)
f=-47
TT=1800.08
T1=607.39
SAT (TO)
f=-41
TT=1800.75
T1=259.2
SAT (TO)
f=-61
TT=1800.54
T1=298.53
? (TO)

TT=1802.03

SAT
f=-2
TT=1798.44
T1=1323.5
? (TO)

TT=1802.02

? (TO)

TT=1800.03

? (TO)

TT=1800.06

No data?

TT=1799.57

?

TT=1799.52

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_1000_60_2.opb
SAT
f=-69
TT=1800.02
T1=1700.33
SAT
f=-64
TT=1798.01
T1=562.03
No dataSAT (TO)
f=-69
TT=1800.02
T1=1700.33
? (TO)

TT=1800.15

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.09

Signal

TT=938.131

? (TO)

TT=1800.11

? (TO)

TT=876.135

SAT
f=-58
TT=1783.06
T1=1783.59
?

TT=392.71

Signal

TT=1498.56

? (exit code)

TT=1547.26

?

TT=1794.08

No dataNo Cert.

TT=1800

SAT (TO)
f=-37
TT=1800.62
T1=1071.1
SAT
f=0
TT=1792.25
T1=0.76
No dataSAT (TO)
f=-42
TT=1800.39
T1=306.06
? (TO)

TT=1802.02

?

TT=0.005

? (TO)

TT=1800.06

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-50
TT=1800.6
T1=900.71
No dataNo dataNo dataSAT (TO)
f=-50
TT=1800.62
T1=900.71
SAT (TO)
f=-52
TT=1800.16
T1=81.74
SAT (TO)
f=-45
TT=1800.02
T1=1087.33
SAT (TO)
f=-62
TT=1800.58
T1=54.24
? (TO)

TT=1802.02

? (TO)

TT=1802.03

? (TO)

TT=1802.03

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No data?

TT=1799.82

?

TT=1799.95

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_1000_60_3.opb
SAT
f=-69
TT=1800.02
T1=1619.66
SAT
f=-60
TT=1798.03
T1=1342.53
No dataSAT (TO)
f=-69
TT=1800.02
T1=1619.66
? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.06

Signal

TT=740.923

? (TO)

TT=1800.09

? (TO)

TT=1264.05

SAT
f=-52
TT=1783.04
T1=1783.77
?

TT=255.145

? (TO)

TT=1777.8

SAT (TO)
f=-53
TT=1800.01
T1=1567.43
?

TT=1793.9

No dataNo Cert.

TT=1800.01

SAT (TO)
f=-47
TT=1800.18
T1=1079.2
SAT
f=0
TT=1792.34
T1=0.76
No dataSAT (TO)
f=-42
TT=1800.12
T1=278.63
? (TO)

TT=1802.12

?

TT=0.006

? (TO)

TT=1800.06

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-46
TT=1800.09
T1=900.71
No dataNo dataNo dataSAT (TO)
f=-53
TT=1800.02
T1=900.71
SAT (TO)
f=-47
TT=1800.2
T1=449.23
SAT (TO)
f=-39
TT=1800
T1=302.45
SAT (TO)
f=-62
TT=1800.69
T1=1074.67
SAT (TO)
f=-18
TT=1802.04
T1=1753.07
SAT
f=-1
TT=1799.47
T1=155.22
? (TO)

TT=1802.02

? (TO)

TT=1800.07

? (TO)

TT=1800.07

No data?

TT=1799.55

?

TT=1799.5

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_1000_60_4.opb
SAT
f=-69
TT=1800.11
T1=830.34
SAT
f=-62
TT=1798.01
T1=1305.67
No dataSAT (TO)
f=-69
TT=1800.11
T1=830.34
? (TO)

TT=1800.15

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.3

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.08

SAT (TO)
f=-24
TT=1800.28
T1=283.53
? (TO)

TT=1800.09

? (TO)

TT=1524.02

SAT
f=-56
TT=1783.06
T1=1783.5
?

TT=257.94

SAT
f=-57
TT=1798.11
T1=1762.42
SAT (TO)
f=-54
TT=1800.02
T1=1755.3
?

TT=1793.73

No dataNo Cert.

TT=1800.03

SAT (TO)
f=-47
TT=1800.4
T1=943.94
SAT
f=0
TT=1792.7
T1=0.92
No dataSAT (TO)
f=-42
TT=1800.18
T1=727.98
SAT
f=-2
TT=1798.44
T1=715.64
?

TT=0.008

? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-49
TT=1800.54
T1=900.71
No dataNo dataNo dataSAT (TO)
f=-51
TT=1800.59
T1=900.71
SAT (TO)
f=-56
TT=1800.52
T1=446.7
SAT (TO)
f=-38
TT=1800.01
T1=222.64
SAT (TO)
f=-60
TT=1800.52
T1=107.61
SAT (TO)
f=0
TT=1802.11
T1=0.54
SAT
f=-2
TT=1798.29
T1=1266.09
? (TO)

TT=1802.03

? (TO)

TT=1800.07

? (TO)

TT=1800.09

No data?

TT=1799.55

? (TO)

TT=1800.1

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_100_10_1.opb
SAT
f=-28
TT=1789.76
T1=17.12
SAT
f=-21
TT=1798.01
T1=398.69
No dataSAT (TO)
f=-26
TT=1800.02
T1=267.4
? (TO)

TT=1800.14

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.12

SAT (TO)
f=-15
TT=1800.01
T1=1028.65
SAT (TO)
f=-25
TT=1800.02
T1=470.86
? (TO)

TT=1784.83

SAT
f=-25
TT=1783.01
T1=1783.28
?

TT=0.504

SAT
f=-22
TT=1798
T1=1095.89
SAT (TO)
f=-25
TT=1800.03
T1=43.71
SAT (TO)
f=-28
TT=1800.2
T1=1536.27
No data? (TO)

TT=1800.14

SAT (TO)
f=-23
TT=1800.03
T1=243.89
SAT
f=-28
TT=1789.76
T1=878.9
No dataSAT (TO)
f=-23
TT=1800.45
T1=41.84
SAT
f=-28
TT=1797.15
T1=17.12
?

TT=0.005

? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-20
TT=1800.42
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-19
TT=1800.1
T1=900.31
SAT (TO)
f=-24
TT=1800.02
T1=430.14
SAT (TO)
f=-19
TT=1800.1
T1=402.43
SAT (TO)
f=-26
TT=1800.68
T1=904.06
SAT
f=-27
TT=1796.75
T1=220.88
SAT
f=-28
TT=1797.36
T1=20.11
SAT
f=-27
TT=1796.76
T1=324.86
? (TO)

TT=1800.06

? (TO)

TT=1800.04

No data?

TT=1799.86

?

TT=1799.41

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_100_10_3.opb
SAT
f=-28
TT=1797.3
T1=14.46
SAT
f=-22
TT=1798.01
T1=538.63
No dataSAT (TO)
f=-26
TT=1800.02
T1=472.31
? (TO)

TT=1800.05

? (TO)

TT=1800.13

? (problem)

TT=0.192

? (TO)

TT=1800.12

? (problem)

TT=0.196

? (TO)

TT=1800.12

? (problem)

TT=0.194

? (TO)

TT=1800.1

SAT (TO)
f=-15
TT=1800.07
T1=642.08
SAT (TO)
f=-24
TT=1800.02
T1=48.19
? (TO)

TT=1498.86

SAT
f=-26
TT=1783.01
T1=1783.28
?

TT=0.496

SAT
f=-23
TT=1798.01
T1=423.8
SAT (TO)
f=-24
TT=1800.7
T1=112.74
SAT (TO)
f=-27
TT=1800.23
T1=1006.1
No data? (TO)

TT=1800.22

SAT (TO)
f=-25
TT=1800.1
T1=527.49
SAT
f=-27
TT=1789.76
T1=68.83
No dataSAT (TO)
f=-22
TT=1800.7
T1=9.86
SAT
f=-28
TT=1797.42
T1=14.46
?

TT=0.005

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-18
TT=1800.14
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-21
TT=1800.52
T1=900.31
SAT (TO)
f=-23
TT=1800.63
T1=669.89
SAT (TO)
f=-20
TT=1800.03
T1=805.32
SAT (TO)
f=-25
TT=1800.72
T1=158.7
SAT
f=-27
TT=1796.75
T1=133.83
SAT
f=-28
TT=1797.3
T1=19.95
SAT
f=-27
TT=1796.75
T1=600.27
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No data?

TT=1799.9

?

TT=1799.46

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_100_25_1.opb
SAT
f=-15
TT=1797.5
T1=67.36
SAT
f=-13
TT=1798.03
T1=231.7
No dataSAT (TO)
f=-15
TT=1800.02
T1=700
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.05

SAT (TO)
f=-10
TT=1800.08
T1=521.05
SAT (TO)
f=-14
TT=1800.02
T1=554.85
? (TO)

TT=1800.17

SAT
f=-14
TT=1783.01
T1=1783.29
?

TT=0.965

SAT
f=-13
TT=1798.01
T1=12.73
SAT (TO)
f=-14
TT=1800.34
T1=290.32
SAT
f=-14
TT=1796.44
T1=1236.72
No data? (TO)

TT=1800.08

SAT (TO)
f=-13
TT=1801.1
T1=62.83
SAT
f=-14
TT=1789.79
T1=166.34
No dataSAT (TO)
f=-13
TT=1800.11
T1=61.19
SAT
f=-15
TT=1797.5
T1=740.89
?

TT=0.005

? (TO)

TT=1800.05

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-12
TT=1800.15
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-12
TT=1800.47
T1=900.31
SAT (TO)
f=-14
TT=1800.67
T1=312.02
SAT (TO)
f=-13
TT=1800.02
T1=1181.2
SAT (TO)
f=-14
TT=1800.59
T1=14.31
SAT
f=-14
TT=1796.76
T1=359.25
SAT
f=-15
TT=1797.56
T1=67.36
SAT
f=-14
TT=1796.77
T1=461.08
? (TO)

TT=1800.07

? (TO)

TT=1800.09

No data?

TT=1799.72

?

TT=1799.37

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_100_25_3.opb
SAT
f=-15
TT=1797.54
T1=197.54
SAT
f=-13
TT=1798.01
T1=11.7
No dataSAT (TO)
f=-15
TT=1800.02
T1=197.54
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (problem)

TT=0.258

? (TO)

TT=1800.12

? (problem)

TT=0.249

? (TO)

TT=1800.1

? (problem)

TT=0.26

? (TO)

TT=1800.12

SAT (TO)
f=-8
TT=1800.1
T1=7.73
SAT (TO)
f=-14
TT=1800.1
T1=169.81
? (TO)

TT=1739.46

SAT
f=-14
TT=1783.01
T1=1783.29
?

TT=0.984

SAT
f=-12
TT=1798.03
T1=106
SAT (TO)
f=-14
TT=1800.02
T1=48.64
SAT
f=-13
TT=1798.22
T1=98.41
No data? (TO)

TT=1800.14

SAT (TO)
f=-13
TT=1800.27
T1=17.78
SAT
f=-14
TT=1789.77
T1=1225.81
No dataSAT (TO)
f=-13
TT=1800.01
T1=12
SAT
f=-15
TT=1797.54
T1=319.73
?

TT=0.005

? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-11
TT=1800.44
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-12
TT=1800.49
T1=900.31
SAT (TO)
f=-14
TT=1800.09
T1=252.78
SAT (TO)
f=-13
TT=1800.08
T1=1748.67
SAT (TO)
f=-14
TT=1800.07
T1=39.57
SAT
f=-14
TT=1796.77
T1=876.99
SAT
f=-15
TT=1797.82
T1=690.3
SAT
f=-14
TT=1796.78
T1=507.55
? (TO)

TT=1800.04

? (TO)

TT=1800.03

No data?

TT=1799.91

?

TT=1799.5

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_100_25_5.opb
SAT
f=-15
TT=1797.4
T1=7.64
SAT
f=-12
TT=1798.01
T1=10.27
No dataSAT (TO)
f=-14
TT=1800.02
T1=6.29
? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.09

SAT (TO)
f=-9
TT=1800.17
T1=571.01
SAT (TO)
f=-13
TT=1800.11
T1=142.49
? (TO)

TT=1246.33

SAT
f=-13
TT=1783.01
T1=1783.29
?

TT=0.973

SAT
f=-13
TT=1798.01
T1=8.43
SAT (TO)
f=-13
TT=1800.01
T1=5.34
SAT
f=-13
TT=1797.5
T1=438.39
No data? (TO)

TT=1800.34

SAT (TO)
f=-12
TT=1800.05
T1=16.83
SAT
f=-14
TT=1789.76
T1=937.09
No dataSAT (TO)
f=-13
TT=1800.3
T1=729.85
SAT
f=-15
TT=1797.4
T1=1791.38
?

TT=0.005

? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-11
TT=1800.21
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-11
TT=1800.14
T1=900.31
SAT (TO)
f=-13
TT=1800.14
T1=86.7
SAT (TO)
f=-14
TT=1800.08
T1=1187.98
SAT (TO)
f=-14
TT=1800.09
T1=23.09
SAT
f=-14
TT=1796.77
T1=778.52
SAT
f=-15
TT=1797.57
T1=7.64
SAT
f=-14
TT=1796.77
T1=1250.76
? (TO)

TT=1800.05

? (TO)

TT=1800.05

No data?

TT=1799.76

?

TT=1799.53

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_10_4_1.opb
OPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.009
T1=0
No dataOPT
f=-3
TT=0.003
T1=0
OPT
f=-3
TT=0.07
T1=0.07
OPT
f=-3
TT=0.074
T1=0.04
OPT
f=-3
TT=0.038
T1=0.03
OPT
f=-3
TT=0.047
T1=0.03
OPT
f=-3
TT=0.06
T1=0.02
OPT
f=-3
TT=0.038
T1=0.03
OPT
f=-3
TT=0.031
T1=0.02
OPT
f=-3
TT=0.034
T1=0.03
OPT
f=-3
TT=0.01
T1=0
OPT
f=-3
TT=0.013
T1=0
? (TO)

TT=1800.28

OPT
f=-3
TT=0.003
T1=0
?

TT=0.114

OPT
f=-3
TT=0.007
T1=0
OPT
f=-3
TT=0.445
T1=0.16
OPT
f=-3
TT=0.481
T1=0.44
No dataOPT
f=-3
TT=0.117
T1=0.12
OPT
f=-3
TT=0.643
T1=2.14
OPT
f=-3
TT=0.225
T1=0.06
No dataOPT
f=-3
TT=0.673
T1=1.17
OPT
f=-3
TT=0.088
T1=0.03
?

TT=0.005

OPT
f=-3
TT=0.03
T1=0.02
OPT
f=-3
TT=0.025
T1=0.01
No dataNo dataNo dataNo dataNo dataOPT
f=-3
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.602
T1=1.16
OPT
f=-3
TT=0.303
T1=0.15
OPT
f=-3
TT=0.323
T1=0.15
OPT
f=-3
TT=0.095
T1=0.07
OPT
f=-3
TT=0.079
T1=0.06
OPT
f=-3
TT=0.285
T1=0.25
OPT
f=-3
TT=0.014
T1=0
OPT
f=-3
TT=0.017
T1=0
No dataOPT
f=-3
TT=4.822
T1=4.93
OPT
f=-3
TT=4.822
T1=4.83
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/bsg/
normalized-bsg_10_4_3.opb
OPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.011
T1=0
No dataOPT
f=-3
TT=0.003
T1=0
OPT
f=-3
TT=0.07
T1=0.06
OPT
f=-3
TT=0.075
T1=0.08
OPT
f=-3
TT=0.041
T1=0.04
OPT
f=-3
TT=0.047
T1=0.04
OPT
f=-3
TT=0.033
T1=0.03
OPT
f=-3
TT=0.042
T1=0.04
OPT
f=-3
TT=0.033
T1=0.03
OPT
f=-3
TT=0.042
T1=0.03
OPT
f=-3
TT=0.016
T1=0.01
OPT
f=-3
TT=0.01
T1=0
? (TO)

TT=1691.57

OPT
f=-3
TT=0.004
T1=0
?

TT=0.114

OPT
f=-3
TT=0.008
T1=0
OPT
f=-3
TT=0.444
T1=0.15
OPT
f=-3
TT=0.304
T1=0.27
No dataOPT
f=-3
TT=0.023
T1=0.02
OPT
f=-3
TT=0.645
T1=2.15
OPT
f=-3
TT=0.088
T1=0.06
No dataOPT
f=-3
TT=0.625
T1=1.15
OPT
f=-3
TT=0.095
T1=0.02
?

TT=0.006

OPT
f=-3
TT=0.032
T1=0.03
OPT
f=-3
TT=0.023
T1=0.02
No dataNo dataNo dataNo dataNo dataOPT
f=-3
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.635
T1=1.14
OPT
f=-3
TT=0.334
T1=0.15
OPT
f=-3
TT=0.333
T1=0.16
OPT
f=-3
TT=0.096
T1=0.08
OPT
f=-3
TT=0.075
T1=0.06
OPT
f=-3
TT=0.174
T1=0.13
OPT
f=-3
TT=0.016
T1=0
OPT
f=-3
TT=0.015
T1=0.01
No dataOPT
f=-3
TT=2.781
T1=2.78
OPT
f=-3
TT=2.952
T1=2.94
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_200_10_1.opb
SAT
f=-58
TT=1796.83
T1=108.6
SAT
f=-44
TT=1798.01
T1=30.13
No dataSAT (TO)
f=-50
TT=1800.03
T1=1424.21
? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.06

SAT (TO)
f=-19
TT=1800.11
T1=1179.36
SAT (TO)
f=-48
TT=1800.05
T1=1743.98
? (TO)

TT=1646.77

SAT
f=-39
TT=1783.01
T1=1783.3
?

TT=0.886

SAT
f=-43
TT=1798
T1=8.3
? (exit code)

TT=745.721

SAT
f=-51
TT=1797.05
T1=755.84
No data? (TO)

TT=1800.19

SAT (TO)
f=-40
TT=1800.69
T1=29.66
SAT
f=-51
TT=1789.79
T1=782.3
No dataSAT (TO)
f=-40
TT=1800.16
T1=17.43
SAT
f=-58
TT=1796.83
T1=108.6
?

TT=0.005

? (TO)

TT=1800.06

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-39
TT=1800.56
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-35
TT=1800.47
T1=900.31
SAT (TO)
f=-42
TT=1800.65
T1=98.56
SAT (TO)
f=-34
TT=1800.35
T1=1.97
SAT (TO)
f=-46
TT=1800.55
T1=200.94
SAT
f=-50
TT=1796.74
T1=318.76
SAT
f=-57
TT=1796.82
T1=499.21
SAT
f=-52
TT=1796.75
T1=720.71
? (TO)

TT=1800.08

? (TO)

TT=1800.08

No data?

TT=1799.7

?

TT=1799.8

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_200_10_4.opb
SAT
f=-58
TT=1796.84
T1=87.18
SAT
f=-43
TT=1798
T1=7.44
No dataSAT (TO)
f=-49
TT=1800.11
T1=316.32
? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=-17
TT=1800.09
T1=1791.43
SAT (TO)
f=-50
TT=1800.06
T1=1036.24
? (TO)

TT=1341

SAT
f=-46
TT=1783.02
T1=1783.3
?

TT=0.904

SAT
f=-43
TT=1798
T1=3.78
? (exit code)

TT=550.15

SAT
f=-52
TT=1798.13
T1=1620.99
No data? (TO)

TT=1800.12

SAT (TO)
f=-41
TT=1800.55
T1=71.8
SAT
f=-51
TT=1789.75
T1=1532.21
No dataSAT (TO)
f=-43
TT=1800.17
T1=14.45
SAT
f=-58
TT=1796.84
T1=87.18
?

TT=0.005

? (TO)

TT=1800.1

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-36
TT=1800.4
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-39
TT=1800.11
T1=900.41
SAT (TO)
f=-42
TT=1800.03
T1=623.83
SAT (TO)
f=-33
TT=1800.51
T1=2.46
SAT (TO)
f=-46
TT=1800.07
T1=257.33
SAT
f=-51
TT=1796.76
T1=135.25
SAT
f=-57
TT=1796.83
T1=124.27
SAT
f=-52
TT=1796.74
T1=403.74
? (TO)

TT=1800.05

? (TO)

TT=1800.09

No data?

TT=1799.73

?

TT=1799.69

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_200_25_1.opb
SAT
f=-33
TT=1796.84
T1=140.4
SAT
f=-23
TT=1798.01
T1=27.57
No dataSAT (TO)
f=-27
TT=1800.02
T1=227.68
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.08

SAT (TO)
f=-16
TT=1800.09
T1=424.64
SAT (TO)
f=-28
TT=1800.03
T1=57.46
? (TO)

TT=1639.5

SAT
f=-24
TT=1783.01
T1=1783.31
?

TT=1.835

SAT
f=-24
TT=1798.01
T1=929
SAT (TO)
f=-25
TT=1800.55
T1=92.7
SAT
f=-7
TT=1794.98
T1=121.52
No data? (TO)

TT=1800.36

SAT (TO)
f=-23
TT=1800.02
T1=45.19
SAT
f=-10
TT=1789.77
T1=34.61
No dataSAT (TO)
f=-24
TT=1800.18
T1=546.22
SAT
f=-32
TT=1796.85
T1=148.85
?

TT=0.003

? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-21
TT=1800.36
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-22
TT=1800.19
T1=900.41
SAT (TO)
f=-23
TT=1800.41
T1=373.78
SAT (TO)
f=-19
TT=1800.01
T1=868.46
SAT (TO)
f=-27
TT=1800.6
T1=135.96
SAT
f=-27
TT=1796.79
T1=1726.91
SAT
f=-33
TT=1796.84
T1=140.4
SAT
f=-23
TT=1796.76
T1=1338.71
? (TO)

TT=1800.09

? (TO)

TT=1800.07

No data?

TT=1799.44

?

TT=1799.9

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_200_25_2.opb
SAT
f=-33
TT=1796.73
T1=141.32
SAT
f=-24
TT=1798.01
T1=1446.28
No dataSAT (TO)
f=-28
TT=1800.03
T1=282.64
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.07

SAT (TO)
f=-17
TT=1800.05
T1=172.71
SAT (TO)
f=-29
TT=1800.07
T1=241.09
? (TO)

TT=1279.36

SAT
f=-27
TT=1783.01
T1=1783.31
?

TT=1.794

SAT
f=-24
TT=1798.03
T1=5.41
SAT (TO)
f=-25
TT=1800.06
T1=11.29
SAT
f=-7
TT=1794.43
T1=43.43
No data? (TO)

TT=1800.13

SAT (TO)
f=-25
TT=1800.15
T1=768.11
SAT
f=-23
TT=1789.78
T1=1456.54
No dataSAT (TO)
f=-25
TT=1800.12
T1=623.97
SAT
f=-33
TT=1796.8
T1=507.05
?

TT=0.005

? (TO)

TT=1800.07

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-20
TT=1800.08
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-23
TT=1800.01
T1=900.31
SAT (TO)
f=-24
TT=1800.51
T1=190.26
SAT (TO)
f=-17
TT=1800.04
T1=1.49
SAT (TO)
f=-26
TT=1800.58
T1=94.05
SAT
f=-27
TT=1796.77
T1=1286.11
SAT
f=-33
TT=1796.73
T1=141.32
SAT
f=-24
TT=1796.76
T1=955.26
? (TO)

TT=1800.05

? (TO)

TT=1800.07

No data?

TT=1799.56

?

TT=1799.51

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_200_25_5.opb
SAT
f=-33
TT=1796.8
T1=140.15
SAT
f=-23
TT=1798.01
T1=33.46
No dataSAT (TO)
f=-29
TT=1800.02
T1=1271.83
? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.07

SAT (TO)
f=-8
TT=1800.03
T1=897.05
SAT (TO)
f=-29
TT=1800.03
T1=813.78
? (TO)

TT=1800.04

SAT
f=-26
TT=1783.01
T1=1783.3
?

TT=1.765

SAT
f=-24
TT=1798.04
T1=20.49
SAT (TO)
f=-24
TT=1800.05
T1=7.48
SAT
f=-8
TT=1794.55
T1=39.26
No data? (TO)

TT=1800.36

SAT (TO)
f=-23
TT=1800.11
T1=355.72
SAT
f=-26
TT=1789.79
T1=1743.62
No dataSAT (TO)
f=-23
TT=1800.07
T1=503.86
SAT
f=-33
TT=1796.8
T1=140.15
?

TT=0.005

? (TO)

TT=1800.07

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-20
TT=1800.13
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-23
TT=1800.05
T1=900.31
SAT (TO)
f=-22
TT=1800.45
T1=11.66
SAT (TO)
f=-17
TT=1800.75
T1=17.26
SAT (TO)
f=-26
TT=1800.51
T1=409.79
SAT
f=-27
TT=1796.76
T1=1636.21
SAT
f=-33
TT=1796.81
T1=154.3
SAT
f=-23
TT=1796.78
T1=1569.56
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No data?

TT=1799.62

?

TT=1799.83

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_500_10_1.opb
SAT
f=-146
TT=1796.74
T1=876.93
SAT
f=-108
TT=1798.03
T1=531.5
No dataSAT (TO)
f=-115
TT=1800.11
T1=569.25
? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.05

SAT (TO)
f=-14
TT=1800.05
T1=1073.83
SAT (TO)
f=-110
TT=1800.06
T1=466.43
? (TO)

TT=1800.07

SAT
f=-119
TT=1783.01
T1=1783.3
?

TT=2.353

SAT
f=-105
TT=1798.02
T1=1263.35
? (exit code)

TT=574.09

SAT
f=-12
TT=1793.69
T1=99.61
No data? (TO)

TT=1800.39

SAT (TO)
f=-91
TT=1800.22
T1=889.64
SAT
f=-12
TT=1789.91
T1=6.81
No dataSAT (TO)
f=-91
TT=1800.36
T1=666.44
SAT
f=-145
TT=1796.74
T1=731.2
?

TT=0.005

? (TO)

TT=1800.12

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-77
TT=1800.16
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-67
TT=1800.5
T1=900.31
SAT (TO)
f=-99
TT=1800.1
T1=870.03
SAT (TO)
f=-78
TT=1800.07
T1=67.19
SAT (TO)
f=-101
TT=1800.45
T1=1077.74
SAT
f=-16
TT=1796.82
T1=13.01
SAT
f=-146
TT=1796.74
T1=876.93
SAT
f=-16
TT=1796.86
T1=13.96
? (TO)

TT=1800.1

? (TO)

TT=1800.07

No data?

TT=1799.36

?

TT=1799.21

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_500_10_2.opb
SAT
f=-144
TT=1796.75
T1=1714.16
SAT
f=-106
TT=1798.01
T1=377.36
No dataSAT (TO)
f=-115
TT=1800.11
T1=1630.28
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.1

SAT (TO)
f=-19
TT=1800.16
T1=450.52
SAT (TO)
f=-111
TT=1800.02
T1=1742.21
? (TO)

TT=1800.05

SAT
f=-103
TT=1783.01
T1=1783.3
?

TT=2.326

SAT
f=-103
TT=1798.05
T1=503.28
? (exit code)

TT=767.09

SAT
f=-10
TT=1794.57
T1=111.55
No data? (TO)

TT=1800.34

SAT (TO)
f=-94
TT=1800.13
T1=591.41
SAT
f=-11
TT=1789.81
T1=53.46
No dataSAT (TO)
f=-90
TT=1800.03
T1=529.44
SAT
f=-143
TT=1796.77
T1=1248.79
?

TT=0.006

? (TO)

TT=1800.12

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-79
TT=1800.17
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-77
TT=1800.44
T1=900.31
SAT (TO)
f=-98
TT=1800.22
T1=734.05
SAT (TO)
f=-79
TT=1800.01
T1=85.71
SAT (TO)
f=-106
TT=1800.08
T1=744.01
SAT
f=-11
TT=1796.78
T1=41.79
SAT
f=-144
TT=1796.75
T1=1714.16
SAT
f=-11
TT=1796.84
T1=29.47
? (TO)

TT=1800.09

? (TO)

TT=1800.07

No data?

TT=1799.66

?

TT=1799.17

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_500_10_3.opb
SAT
f=-146
TT=1796.83
T1=1271.51
SAT
f=-107
TT=1798.01
T1=1244.37
No dataSAT (TO)
f=-116
TT=1800.11
T1=1747.9
? (TO)

TT=1800.15

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.08

SAT (TO)
f=-16
TT=1800.12
T1=402.13
SAT (TO)
f=-115
TT=1800.03
T1=1669.54
? (TO)

TT=1514.6

SAT
f=-100
TT=1783.01
T1=1783.32
?

TT=2.363

SAT
f=-106
TT=1798.02
T1=1016.96
? (exit code)

TT=1040.3

SAT
f=-14
TT=1794.22
T1=160.79
No data? (TO)

TT=1800.1

SAT (TO)
f=-94
TT=1800.45
T1=742.31
SAT
f=-20
TT=1789.79
T1=35.42
No dataSAT (TO)
f=-94
TT=1800.23
T1=707.2
SAT
f=-146
TT=1796.85
T1=1271.51
?

TT=0.004

? (TO)

TT=1800.13

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-81
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-72
TT=1800.58
T1=900.41
SAT (TO)
f=-98
TT=1800.15
T1=650.87
SAT (TO)
f=-74
TT=1800.03
T1=32.23
SAT (TO)
f=-103
TT=1800.08
T1=330.26
SAT
f=-15
TT=1796.78
T1=65.3
SAT
f=-146
TT=1796.83
T1=1414.71
SAT
f=-15
TT=1796.77
T1=56.35
? (TO)

TT=1800.07

? (TO)

TT=1800.07

No data?

TT=1799.56

?

TT=1799.41

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_500_10_4.opb
SAT
f=-144
TT=1796.77
T1=765.94
SAT
f=-105
TT=1798.01
T1=1142.03
No dataSAT (TO)
f=-115
TT=1800.11
T1=1406.02
? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.14

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.13

SAT (TO)
f=-24
TT=1800.16
T1=6.27
SAT (TO)
f=-109
TT=1800.05
T1=1252.66
? (TO)

TT=1647.23

SAT
f=-105
TT=1783.01
T1=1783.32
?

TT=2.354

SAT
f=-106
TT=1798.03
T1=1750.32
? (exit code)

TT=489.51

SAT
f=-12
TT=1794.46
T1=176.36
No data? (TO)

TT=1800.31

SAT (TO)
f=-90
TT=1800.08
T1=786.6
SAT
f=-19
TT=1789.73
T1=59.99
No dataSAT (TO)
f=-95
TT=1800.12
T1=908.19
SAT
f=-144
TT=1796.89
T1=765.94
?

TT=0.005

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-87
TT=1800.16
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-69
TT=1800.38
T1=900.31
SAT (TO)
f=-98
TT=1800.56
T1=895.64
SAT (TO)
f=-78
TT=1800.06
T1=40.62
SAT (TO)
f=-103
TT=1800.07
T1=843.49
SAT
f=-18
TT=1796.77
T1=64.37
SAT
f=-144
TT=1796.77
T1=1253.93
SAT
f=-18
TT=1796.79
T1=54.87
? (TO)

TT=1800.06

? (TO)

TT=1800.09

No data?

TT=1799.87

?

TT=1799.38

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_500_10_5.opb
SAT
f=-146
TT=1796.75
T1=1005.12
SAT (TO)
f=-107
TT=1800.09
T1=40.4
No dataSAT (TO)
f=-116
TT=1800.11
T1=1478.13
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.05

SAT (TO)
f=-23
TT=1800.08
T1=1505.51
SAT (TO)
f=-110
TT=1800.02
T1=1780.1
? (TO)

TT=1800.04

SAT
f=-100
TT=1783.01
T1=1783.34
?

TT=2.346

SAT
f=-107
TT=1798.03
T1=24.25
? (exit code)

TT=882.59

SAT
f=-17
TT=1793.69
T1=72.15
No data? (TO)

TT=1800.11

SAT (TO)
f=-93
TT=1800.09
T1=839.44
SAT
f=-19
TT=1790.3
T1=34.61
No dataSAT (TO)
f=-96
TT=1800.04
T1=846.5
SAT
f=-146
TT=1796.75
T1=1005.12
?

TT=0.006

? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-80
TT=1800.04
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-80
TT=1800.15
T1=900.41
SAT (TO)
f=-98
TT=1800.08
T1=816.66
SAT (TO)
f=-77
TT=1800.03
T1=36.87
SAT (TO)
f=-102
TT=1800.04
T1=1291.88
SAT
f=-15
TT=1796.79
T1=35.98
SAT
f=-145
TT=1796.79
T1=1390.28
SAT
f=-15
TT=1796.76
T1=24.34
? (TO)

TT=1800.09

? (TO)

TT=1800.08

No data?

TT=1799.55

?

TT=1799.87

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_500_60_4.opb
SAT
f=-44
TT=1796.97
T1=1263.65
SAT
f=-32
TT=1798.02
T1=1455.83
No dataSAT (TO)
f=-34
TT=1800.09
T1=401.19
? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.04

SAT (TO)
f=-19
TT=1800.19
T1=185.95
SAT (TO)
f=-35
TT=1800.04
T1=940.45
? (TO)

TT=1781.22

SAT
f=-31
TT=1783.03
T1=1783.38
?

TT=93.25

SAT
f=-31
TT=1798.04
T1=190.48
SAT (TO)
f=-31
TT=1800.24
T1=305.64
?

TT=1793.28

No dataNo Cert.

TT=1800.02

SAT (TO)
f=-29
TT=1800.13
T1=586.07
SAT
f=-8
TT=1790.08
T1=260.87
No dataSAT (TO)
f=-29
TT=1800.33
T1=393.49
SAT
f=-43
TT=1797.07
T1=1643.17
?

TT=0.005

? (TO)

TT=1800.12

? (TO)

TT=1800.14

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-26
TT=1800.1
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-24
TT=1800.12
T1=900.51
SAT (TO)
f=-29
TT=1800.11
T1=201.81
SAT (TO)
f=-22
TT=1800.02
T1=84.59
SAT (TO)
f=-32
TT=1800.54
T1=139.53
SAT
f=-5
TT=1797.04
T1=531.17
SAT
f=-44
TT=1796.97
T1=1263.65
SAT
f=-5
TT=1797.07
T1=541.76
? (TO)

TT=1800.12

? (TO)

TT=1800.11

No data?

TT=1799.47

?

TT=1799.58

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_50_10_1.opb
OPT
f=-14
TT=214.256
T1=1.84
SAT
f=-14
TT=1798
T1=1503.33
No dataSAT (TO)
f=-14
TT=1800.03
T1=1.84
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.12

SAT (TO)
f=-10
TT=1800.09
T1=166.95
SAT (TO)
f=-13
TT=1800.03
T1=471.45
? (TO)

TT=1510.13

SAT
f=-13
TT=1783.01
T1=1783.28
?

TT=0.323

SAT
f=-13
TT=1798
T1=1586.94
SAT (TO)
f=-13
TT=1800.89
T1=14.9
OPT
f=-14
TT=542.182
T1=106.67
No dataOPT
f=-14
TT=1480.87
T1=416.62
SAT (TO)
f=-13
TT=1800.07
T1=37.42
OPT
f=-14
TT=654.38
T1=62.61
No dataSAT (TO)
f=-13
TT=1800.05
T1=12.82
OPT
f=-14
TT=214.256
T1=7.42
?

TT=0.006

? (TO)

TT=1800.04

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-12
TT=1800.07
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-12
TT=1800.11
T1=900.31
SAT (TO)
f=-13
TT=1800.1
T1=47.57
SAT (TO)
f=-13
TT=1800.02
T1=44.17
SAT (TO)
f=-13
TT=1800.07
T1=3.45
OPT
f=-14
TT=791.665
T1=147.89
OPT
f=-14
TT=310.953
T1=9.69
OPT
f=-14
TT=634.053
T1=206.25
? (TO)

TT=1800.09

? (TO)

TT=1800.04

No data?

TT=1799.73

? (TO)

TT=1800.02

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_50_10_4.opb
OPT
f=-14
TT=160.333
T1=21.7
SAT
f=-12
TT=1798
T1=5.1
No dataSAT (TO)
f=-13
TT=1800.04
T1=14.45
? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.11

SAT (TO)
f=-11
TT=1800.09
T1=448.24
SAT (TO)
f=-13
TT=1800.03
T1=1250.12
? (TO)

TT=1746.23

SAT
f=-13
TT=1783
T1=1783.28
?

TT=0.336

SAT
f=-13
TT=1798
T1=209.09
SAT (TO)
f=-13
TT=1800.04
T1=66.7
OPT
f=-14
TT=988.381
T1=900.81
No dataOPT
f=-14
TT=963.04
T1=274.27
SAT (TO)
f=-12
TT=1800.1
T1=7.31
OPT
f=-14
TT=525.549
T1=331.46
No dataSAT (TO)
f=-13
TT=1801.1
T1=162.01
OPT
f=-14
TT=163.56
T1=39.12
?

TT=0.004

? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-11
TT=1800.47
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-11
TT=1800.47
T1=900.31
SAT (TO)
f=-13
TT=1800.75
T1=308.17
SAT (TO)
f=-13
TT=1800.31
T1=1322.78
SAT (TO)
f=-13
TT=1800.08
T1=9.57
OPT
f=-14
TT=406.866
T1=102.33
OPT
f=-14
TT=160.333
T1=21.7
OPT
f=-14
TT=263.672
T1=100.81
? (TO)

TT=1800.11

? (TO)

TT=1800.08

No data?

TT=1799.79

?

TT=1799.95

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_50_25_1.opb
OPT
f=-6
TT=14.858
T1=0.01
SAT (TO)
f=-6
TT=1800.09
T1=3.03
No dataOPT
f=-6
TT=60.434
T1=0.01
OPT
f=-6
TT=306.116
T1=92.54
OPT
f=-6
TT=303.253
T1=89.28
OPT
f=-6
TT=316.527
T1=97.04
OPT
f=-6
TT=309.655
T1=91.86
OPT
f=-6
TT=225.124
T1=0.48
OPT
f=-6
TT=212.983
T1=0.58
OPT
f=-6
TT=219.262
T1=0.47
OPT
f=-6
TT=214.175
T1=0.58
SAT (TO)
f=-6
TT=1800.13
T1=434.8
OPT
f=-6
TT=1028.97
T1=1.75
? (TO)

TT=1800.04

OPT
f=-6
TT=39.752
T1=39.76
?

TT=0.724

SAT
f=-6
TT=1798.01
T1=0.81
SAT (TO)
f=-6
TT=1800.25
T1=0.8
OPT
f=-6
TT=643.476
T1=67.84
No dataOPT
f=-6
TT=1226.07
T1=386.28
OPT
f=-6
TT=1009.12
T1=5.42
OPT
f=-6
TT=475.187
T1=41.1
No dataOPT
f=-6
TT=848.413
T1=2.36
OPT
f=-6
TT=15.488
T1=0.73
?

TT=0.006

OPT
f=-6
TT=345.085
T1=117.64
OPT
f=-6
TT=220.909
T1=0.41
No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-6
TT=1800.25
T1=900.21
No dataNo dataNo dataSAT (TO)
f=-6
TT=1800.2
T1=900.31
OPT
f=-6
TT=783.344
T1=3.32
OPT
f=-6
TT=217.95
T1=0.95
OPT
f=-6
TT=344.93
T1=0.57
OPT
f=-6
TT=214.697
T1=19.06
OPT
f=-6
TT=14.858
T1=0.17
OPT
f=-6
TT=257.305
T1=23.17
OPT
f=-6
TT=1702.58
T1=0.53
OPT
f=-6
TT=1711.18
T1=0.53
No data?

TT=1799.62

?

TT=1799.54

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_50_25_2.opb
OPT
f=-7
TT=9.399
T1=0.76
SAT
f=-7
TT=1798.01
T1=380.82
No dataOPT
f=-7
TT=58.29
T1=0.76
OPT
f=-7
TT=303.098
T1=118.11
OPT
f=-7
TT=260.291
T1=107.84
OPT
f=-7
TT=304.812
T1=116.78
OPT
f=-7
TT=260.026
T1=106.46
OPT
f=-7
TT=190.181
T1=1.55
OPT
f=-7
TT=153.43
T1=5.46
OPT
f=-7
TT=187.753
T1=1.56
OPT
f=-7
TT=155.385
T1=5.73
SAT (TO)
f=-6
TT=1800.02
T1=2.89
OPT
f=-7
TT=1291.46
T1=22.59
? (TO)

TT=1542.74

OPT
f=-7
TT=25.917
T1=25.92
?

TT=0.684

SAT
f=-7
TT=1798
T1=1.37
SAT (TO)
f=-7
TT=1801
T1=3.03
OPT
f=-7
TT=353.993
T1=247.91
No dataOPT
f=-7
TT=528.71
T1=169.72
OPT
f=-7
TT=1088.87
T1=65.72
OPT
f=-7
TT=234.998
T1=87.72
No dataOPT
f=-7
TT=816.791
T1=12.4
OPT
f=-7
TT=17.287
T1=3.47
?

TT=0.006

OPT
f=-7
TT=352.873
T1=153.49
OPT
f=-7
TT=189.771
T1=3.59
No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-7
TT=1800.02
T1=900.21
No dataNo dataNo dataSAT (TO)
f=-7
TT=1800.35
T1=900.21
OPT
f=-7
TT=728.155
T1=7.36
OPT
f=-7
TT=225.58
T1=32.92
OPT
f=-7
TT=320.43
T1=5.76
OPT
f=-7
TT=150.047
T1=41.91
OPT
f=-7
TT=9.399
T1=2.81
OPT
f=-7
TT=138.015
T1=63.94
OPT
f=-7
TT=1781.24
T1=1.49
OPT
f=-7
TT=1712.66
T1=1.48
No data?

TT=1799.64

?

TT=1799.56

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_50_25_3.opb
OPT
f=-7
TT=9.751
T1=4.02
SAT
f=-7
TT=1798.01
T1=23.43
No dataOPT
f=-7
TT=54.13
T1=4.02
OPT
f=-7
TT=280.663
T1=125.6
OPT
f=-7
TT=289.149
T1=113.56
OPT
f=-7
TT=279.812
T1=127.18
OPT
f=-7
TT=301.561
T1=119.71
OPT
f=-7
TT=167.159
T1=4.45
OPT
f=-7
TT=180.412
T1=5.79
OPT
f=-7
TT=157.446
T1=4.22
OPT
f=-7
TT=183.959
T1=5.74
SAT (TO)
f=-7
TT=1800.03
T1=1688.89
OPT
f=-7
TT=1310.91
T1=164.9
? (TO)

TT=1596.25

OPT
f=-7
TT=67.178
T1=67.19
?

TT=0.706

SAT
f=-7
TT=1798
T1=653.03
SAT (TO)
f=-7
TT=1800.32
T1=29.96
OPT
f=-7
TT=361.748
T1=196.92
No dataOPT
f=-7
TT=647.732
T1=206.4
OPT
f=-7
TT=1042.71
T1=18.46
OPT
f=-7
TT=292.113
T1=192.72
No dataOPT
f=-7
TT=726.695
T1=13.91
OPT
f=-7
TT=9.751
T1=5.38
?

TT=0.004

OPT
f=-7
TT=335.044
T1=163.03
OPT
f=-7
TT=202.475
T1=25.14
No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-7
TT=1800.2
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-7
TT=1800.55
T1=900.31
OPT
f=-7
TT=732.474
T1=36.23
OPT
f=-7
TT=198.41
T1=10.06
OPT
f=-7
TT=341.67
T1=6.64
OPT
f=-7
TT=151.765
T1=120.12
OPT
f=-7
TT=10.647
T1=6.18
OPT
f=-7
TT=147.515
T1=79.81
? (TO)

TT=1800.05

? (TO)

TT=1800.05

No data?

TT=1799.85

?

TT=1799.97

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
bsg/normalized-bsg_50_25_4.opb
OPT
f=-7
TT=9.476
T1=0.04
SAT
f=-7
TT=1798
T1=152.87
No dataOPT
f=-7
TT=61.983
T1=0.04
OPT
f=-7
TT=312.919
T1=131.23
OPT
f=-7
TT=286.368
T1=107.97
OPT
f=-7
TT=314.712
T1=133.96
OPT
f=-7
TT=280.094
T1=104.76
OPT
f=-7
TT=180.857
T1=0.73
OPT
f=-7
TT=181.594
T1=2.13
OPT
f=-7
TT=183.546
T1=0.69
OPT
f=-7
TT=179.43
T1=2.11
SAT (TO)
f=-7
TT=1800.05
T1=429.92
SAT (TO)
f=-7
TT=1800.02
T1=8.98
? (TO)

TT=1800.35

OPT
f=-7
TT=48.584
T1=48.59
?

TT=0.694

SAT
f=-7
TT=1798.01
T1=241.33
SAT (TO)
f=-7
TT=1800.3
T1=5.45
OPT
f=-7
TT=455.878
T1=241.68
No dataOPT
f=-7
TT=649.25
T1=204.24
OPT
f=-7
TT=961.839
T1=18.41
OPT
f=-7
TT=232.235
T1=95.74
No dataOPT
f=-7
TT=697.568
T1=41.5
OPT
f=-7
TT=9.476
T1=2.72
?

TT=0.007

OPT
f=-7
TT=348.492
T1=119.42
OPT
f=-7
TT=231.829
T1=3.34
No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-7
TT=1800.51
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-7
TT=1800.32
T1=900.21
OPT
f=-7
TT=821.937
T1=24.6
OPT
f=-7
TT=207.14
T1=9.13
OPT
f=-7
TT=332.87
T1=18.4
OPT
f=-7
TT=163.576
T1=104.05
OPT
f=-7
TT=10.761
T1=0.89
OPT
f=-7
TT=190.057
T1=113.29
OPT
f=-7
TT=1690.32
T1=12.52
OPT
f=-7
TT=1660.09
T1=12.55
No data?

TT=1799.66

? (TO)

TT=1800.04

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_1000_25_1.opb
SAT
f=57
TT=1798.23
T1=674.4
SAT
f=88
TT=1798.02
T1=47.07
No dataSAT (TO)
f=83
TT=1800.06
T1=403.6
? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.15

? (TO)

TT=1800.02

SAT (TO)
f=84
TT=1800.18
T1=2.37
SAT (TO)
f=77
TT=1800.71
T1=1181.27
SAT (TO)
f=93
TT=1802.1
T1=1211.09
SAT
f=87
TT=1783.02
T1=5.41
SAT (TO)
f=89
TT=1800.51
T1=41.75
SAT
f=84
TT=1798.02
T1=1.9
SAT (TO)
f=89
TT=1800.04
T1=68.24
SAT
f=91
TT=1793.95
T1=10.66
No data? (TO)

TT=1800.09

SAT (TO)
f=83
TT=1800.05
T1=622.27
SAT
f=91
TT=1789.94
T1=12.75
No dataSAT (TO)
f=83
TT=1800.17
T1=766.56
SAT
f=57
TT=1798.23
T1=674.4
?

TT=0.006

? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=76
TT=1800.05
T1=900.41
No dataNo dataNo dataSAT (TO)
f=76
TT=1800.13
T1=900.51
SAT (TO)
f=85
TT=1800.04
T1=781.32
SAT (TO)
f=88
TT=1800.04
T1=173.24
SAT (TO)
f=78
TT=1800.51
T1=3.69
SAT
f=91
TT=1796.97
T1=8.46
SAT
f=58
TT=1796.96
T1=673.5
SAT
f=91
TT=1796.92
T1=8.39
? (TO)

TT=1800.11

? (TO)

TT=1800.02

No data?

TT=1799.9

?

TT=1799.89

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_1000_25_5.opb
SAT
f=58
TT=1796.82
T1=1274.65
SAT
f=81
TT=1798.01
T1=25.27
No dataSAT (TO)
f=84
TT=1800.09
T1=178.65
? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.04

SAT (TO)
f=85
TT=1800.08
T1=2.78
SAT (TO)
f=85
TT=1800.13
T1=25.9
SAT (TO)
f=94
TT=1802.1
T1=51.22
SAT
f=87
TT=1783.02
T1=5.2
SAT (TO)
f=89
TT=1800.04
T1=42.57
SAT
f=85
TT=1798.02
T1=2.75
SAT (TO)
f=89
TT=1800.03
T1=70.08
SAT
f=91
TT=1793.73
T1=9.21
No data? (TO)

TT=1800.08

SAT (TO)
f=83
TT=1801.24
T1=583.44
SAT
f=91
TT=1789.91
T1=10.95
No dataSAT (TO)
f=84
TT=1800.07
T1=111.17
SAT
f=58
TT=1796.82
T1=1357.64
?

TT=0.006

? (TO)

TT=1800.12

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=78
TT=1800.05
T1=900.51
No dataNo dataNo dataSAT (TO)
f=78
TT=1800.15
T1=900.51
SAT (TO)
f=85
TT=1800.03
T1=457.18
SAT (TO)
f=89
TT=1800.07
T1=0.97
SAT (TO)
f=78
TT=1800.01
T1=2.95
SAT
f=91
TT=1796.92
T1=8.87
SAT
f=58
TT=1796.91
T1=1274.65
SAT
f=91
TT=1796.93
T1=8.37
? (TO)

TT=1800.11

? (TO)

TT=1800.1

No data?

TT=1799.76

?

TT=1799.74

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_1000_60_2.opb
SAT
f=29
TT=1796.96
T1=943.28
SAT
f=47
TT=1798.01
T1=199.83
No dataSAT (TO)
f=43
TT=1800.08
T1=821.47
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.09

SAT (TO)
f=38
TT=1800.13
T1=13.89
SAT (TO)
f=47
TT=1800.08
T1=4.48
SAT (TO)
f=48
TT=1801.98
T1=1440.44
SAT
f=46
TT=1783.06
T1=35.44
SAT (TO)
f=46
TT=1800.04
T1=308.82
SAT
f=45
TT=1798.05
T1=8.23
SAT (TO)
f=46
TT=1800.04
T1=477.09
SAT
f=48
TT=1793.77
T1=91.88
No data? (TO)

TT=1800.01

SAT (TO)
f=44
TT=1800.72
T1=640.77
SAT
f=48
TT=1790.16
T1=98.26
No dataSAT (TO)
f=43
TT=1800.01
T1=454.02
SAT
f=30
TT=1797.97
T1=660.62
?

TT=0.007

? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=41
TT=1800.09
T1=900.61
No dataNo dataNo dataSAT (TO)
f=41
TT=1800.18
T1=900.71
SAT (TO)
f=42
TT=1800.04
T1=552.98
SAT (TO)
f=45
TT=1800.9
T1=38.26
SAT (TO)
f=38
TT=1800.01
T1=6.5
SAT
f=38
TT=1797.33
T1=1599.86
SAT
f=29
TT=1796.96
T1=943.28
SAT
f=38
TT=1797.18
T1=1416.34
? (TO)

TT=1800.09

? (TO)

TT=1800.08

No data?

TT=1799.9

?

TT=1799.63

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_1000_60_3.opb
SAT
f=29
TT=1797.19
T1=1108.68
SAT
f=42
TT=1798.01
T1=64.96
No dataSAT (TO)
f=43
TT=1800.08
T1=811.99
? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.14

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.03

? (TO)

TT=1800.03

SAT (TO)
f=42
TT=1800.11
T1=17.6
SAT (TO)
f=42
TT=1800.15
T1=115.13
SAT (TO)
f=47
TT=1802.04
T1=216.98
SAT
f=46
TT=1783.03
T1=1343.1
SAT (TO)
f=49
TT=1800.36
T1=461.03
SAT
f=43
TT=1798.06
T1=10.28
SAT (TO)
f=49
TT=1800.08
T1=311.37
SAT
f=51
TT=1793.83
T1=63.31
No data? (TO)

TT=1800.09

SAT (TO)
f=41
TT=1800.09
T1=824.14
SAT
f=51
TT=1790.3
T1=60.95
No dataSAT (TO)
f=43
TT=1800.42
T1=643.37
SAT
f=30
TT=1796.95
T1=767.2
?

TT=0.01

? (TO)

TT=1800.12

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=39
TT=1800.09
T1=900.61
No dataNo dataNo dataSAT (TO)
f=39
TT=1800.1
T1=900.61
SAT (TO)
f=42
TT=1800.41
T1=550.89
SAT (TO)
f=47
TT=1800.03
T1=640.56
SAT (TO)
f=41
TT=1800.02
T1=13.17
SAT
f=52
TT=1797.33
T1=35.15
SAT
f=29
TT=1797.19
T1=1108.68
SAT
f=52
TT=1797.15
T1=31.34
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No data?

TT=1799.58

?

TT=1799.74

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_1000_60_4.opb
SAT
f=29
TT=1797.18
T1=1043.96
SAT
f=45
TT=1798.02
T1=350.92
No dataSAT (TO)
f=43
TT=1800.06
T1=715.02
? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.03

SAT (TO)
f=43
TT=1800.05
T1=25.92
SAT (TO)
f=43
TT=1800.05
T1=1611.88
SAT (TO)
f=47
TT=1802.03
T1=180.42
SAT
f=45
TT=1783.05
T1=28.92
SAT (TO)
f=48
TT=1800.1
T1=455.72
SAT
f=44
TT=1798.06
T1=8.14
SAT (TO)
f=48
TT=1801.06
T1=325.43
SAT
f=48
TT=1793.78
T1=85.84
No data? (TO)

TT=1800.02

SAT (TO)
f=44
TT=1800.12
T1=974.3
SAT
f=48
TT=1790.21
T1=82.72
No dataSAT (TO)
f=43
TT=1800.2
T1=80.47
SAT
f=30
TT=1796.98
T1=995.78
?

TT=0.005

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=40
TT=1800.14
T1=900.61
No dataNo dataNo dataSAT (TO)
f=40
TT=1800.05
T1=900.61
SAT (TO)
f=43
TT=1800.56
T1=229.41
SAT (TO)
f=47
TT=1800.08
T1=6.55
SAT (TO)
f=41
TT=1800.06
T1=9.12
SAT
f=48
TT=1797.35
T1=34.01
SAT
f=29
TT=1797.18
T1=1043.96
SAT
f=48
TT=1797.35
T1=30.26
? (TO)

TT=1800.08

? (TO)

TT=1800.07

No data?

TT=1799.59

?

TT=1800.02

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_100_10_4.opb
OPT
f=10
TT=4.324
T1=4.31
SAT
f=12
TT=1798
T1=595.61
No dataSAT (TO)
f=12
TT=1800.02
T1=14.95
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.14

? (TO)

TT=1800.11

? (TO)

TT=1800.12

SAT (TO)
f=12
TT=1800.09
T1=60.62
SAT (TO)
f=11
TT=1800.02
T1=12.24
SAT (TO)
f=11
TT=1802.09
T1=1110.05
SAT
f=12
TT=1783.01
T1=78.35
SAT (TO)
f=13
TT=1800.01
T1=232.1
SAT
f=12
TT=1798
T1=906.3
SAT (TO)
f=13
TT=1800.51
T1=624.03
OPT
f=10
TT=44.125
T1=43.01
No dataOPT
f=10
TT=262.73
T1=77.63
SAT (TO)
f=11
TT=1800.1
T1=40.41
OPT
f=10
TT=106.038
T1=106.05
No dataSAT (TO)
f=11
TT=1800.76
T1=473.57
OPT
f=10
TT=4.324
T1=4.31
?

TT=0.006

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=11
TT=1800.47
T1=900.31
No dataNo dataNo dataSAT (TO)
f=11
TT=1800.08
T1=900.31
SAT (TO)
f=12
TT=1800.59
T1=27.13
SAT (TO)
f=12
TT=1800.05
T1=174.56
SAT (TO)
f=12
TT=1800.09
T1=1021.25
OPT
f=10
TT=16.051
T1=15.18
OPT
f=10
TT=5.331
T1=5.32
OPT
f=10
TT=16.355
T1=14.14
? (TO)

TT=1800.1

? (TO)

TT=1800.03

No data?

TT=1799.91

?

TT=1799.58

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_100_25_2.opb
OPT
f=5
TT=2.741
T1=1.49
SAT
f=6
TT=1798.04
T1=240.5
No dataOPT
f=5
TT=11.909
T1=6.35
OPT
f=5
TT=32.915
T1=32.92
OPT
f=5
TT=16.273
T1=12.46
OPT
f=5
TT=7.481
T1=7.49
OPT
f=5
TT=21.276
T1=12.45
OPT
f=5
TT=19.159
T1=12.73
OPT
f=5
TT=26.616
T1=17.38
OPT
f=5
TT=19.331
T1=12.97
OPT
f=5
TT=25.766
T1=16.98
SAT (TO)
f=6
TT=1800.03
T1=0.11
OPT
f=5
TT=28.512
T1=17.13
OPT
f=5
TT=1103.5
T1=191.54
SAT
f=6
TT=1783
T1=1.04
SAT (TO)
f=6
TT=1800.04
T1=0.67
SAT
f=6
TT=1798
T1=2.97
SAT (TO)
f=5
TT=1800.68
T1=788.67
OPT
f=5
TT=46.979
T1=43.06
No dataOPT
f=5
TT=661.13
T1=203.13
SAT (TO)
f=5
TT=1800.16
T1=59.59
OPT
f=5
TT=95.372
T1=95.2
No dataSAT (TO)
f=6
TT=1800.02
T1=1.38
OPT
f=5
TT=2.741
T1=2.1
?

TT=0.005

OPT
f=5
TT=4.758
T1=1.61
OPT
f=5
TT=4.803
T1=1.49
No dataNo dataNo dataNo dataNo dataOPT
f=5
TT=628.287
T1=314.18
No dataNo dataNo dataOPT
f=5
TT=635.57
T1=317.93
OPT
f=5
TT=1601.2
T1=403.56
OPT
f=5
TT=837.43
T1=482.47
SAT (TO)
f=5
TT=1800.56
T1=1509.45
OPT
f=5
TT=42.171
T1=42.16
OPT
f=5
TT=2.806
T1=2.13
OPT
f=5
TT=26.932
T1=25.1
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataOPT
f=5
TT=1553.18
T1=1553.38
OPT
f=5
TT=1551.08
T1=1551.52
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_100_25_3.opb
OPT
f=5
TT=1.592
T1=0.3
SAT
f=5
TT=1798
T1=1567.74
No dataOPT
f=5
TT=11.013
T1=4.65
OPT
f=5
TT=6.423
T1=2.67
OPT
f=5
TT=16.64
T1=16.64
OPT
f=5
TT=7.618
T1=2.6
OPT
f=5
TT=18.16
T1=18.16
OPT
f=5
TT=8.564
T1=2.75
OPT
f=5
TT=6.844
T1=0.81
OPT
f=5
TT=8.714
T1=2.76
OPT
f=5
TT=6.549
T1=0.81
SAT (TO)
f=6
TT=1800.11
T1=0.1
OPT
f=5
TT=52.101
T1=39.72
OPT
f=5
TT=1256.21
T1=78.32
OPT
f=5
TT=1584.02
T1=624.57
SAT (TO)
f=6
TT=1800.05
T1=79.82
SAT
f=6
TT=1798.02
T1=7.55
SAT (TO)
f=6
TT=1800.26
T1=19.29
OPT
f=5
TT=40.519
T1=25.61
No dataOPT
f=5
TT=905
T1=292.55
SAT (TO)
f=5
TT=1800.13
T1=127.04
OPT
f=5
TT=35.165
T1=15.04
No dataSAT (TO)
f=5
TT=1800.1
T1=193.92
OPT
f=5
TT=1.592
T1=0.3
?

TT=0.006

OPT
f=5
TT=8.812
T1=5.51
OPT
f=5
TT=8.928
T1=5.83
No dataNo dataNo dataNo dataNo dataOPT
f=5
TT=146.49
T1=73.24
No dataNo dataNo dataOPT
f=5
TT=147.15
T1=73.61
SAT (TO)
f=6
TT=1800.11
T1=3.89
OPT
f=5
TT=751.1
T1=417.29
OPT
f=5
TT=746.172
T1=131.4
OPT
f=5
TT=29.324
T1=28.1
OPT
f=5
TT=1.735
T1=0.48
OPT
f=5
TT=12.878
T1=7.4
? (TO)

TT=1800.04

? (TO)

TT=1800.1

No data?

TT=1799.76

?

TT=1799.9

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_100_25_4.opb
OPT
f=5
TT=1.881
T1=0.43
SAT
f=6
TT=1798.03
T1=1.51
No dataOPT
f=5
TT=10.383
T1=4.17
OPT
f=5
TT=4.126
T1=0.36
OPT
f=5
TT=5.878
T1=0.97
OPT
f=5
TT=9.236
T1=5.3
OPT
f=5
TT=5.352
T1=0.9
OPT
f=5
TT=9.238
T1=2.84
OPT
f=5
TT=11.069
T1=3.83
OPT
f=5
TT=9.428
T1=2.9
OPT
f=5
TT=10.739
T1=3.79
SAT (TO)
f=5
TT=1800.08
T1=1755.59
OPT
f=5
TT=32.69
T1=0.92
OPT
f=5
TT=1536.27
T1=39.99
OPT
f=5
TT=1622.13
T1=656.8
SAT (TO)
f=5
TT=1800.5
T1=563.63
SAT
f=6
TT=1798.01
T1=7.34
SAT (TO)
f=6
TT=1800.34
T1=2.94
OPT
f=5
TT=46.222
T1=41.43
No dataOPT
f=5
TT=419.16
T1=135.15
SAT (TO)
f=5
TT=1800.71
T1=273.43
OPT
f=5
TT=50.974
T1=46.53
No dataSAT (TO)
f=5
TT=1800.5
T1=61.65
OPT
f=5
TT=1.881
T1=0.43
?

TT=0.004

OPT
f=5
TT=29.997
T1=26.55
OPT
f=5
TT=30.666
T1=27.26
No dataNo dataNo dataNo dataNo dataOPT
f=5
TT=124.293
T1=62.15
No dataNo dataNo dataOPT
f=5
TT=122.53
T1=61.3
OPT
f=5
TT=1455.8
T1=291.57
OPT
f=5
TT=1133.65
T1=846.75
SAT (TO)
f=5
TT=1800.06
T1=1510.9
OPT
f=5
TT=13.153
T1=10.65
OPT
f=5
TT=2.089
T1=0.68
OPT
f=5
TT=20.692
T1=14.74
? (TO)

TT=1800.06

? (TO)

TT=1800.06

No data?

TT=1799.75

?

TT=1799.77

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_100_25_5.opb
OPT
f=5
TT=1.081
T1=0.24
SAT
f=6
TT=1798.08
T1=137.05
No dataOPT
f=5
TT=32.288
T1=25.98
OPT
f=5
TT=40.205
T1=33.12
OPT
f=5
TT=103.382
T1=99.16
OPT
f=5
TT=43.724
T1=36.4
OPT
f=5
TT=107.685
T1=103.38
OPT
f=5
TT=9.029
T1=4.35
OPT
f=5
TT=17.884
T1=7.77
OPT
f=5
TT=9.225
T1=4.44
OPT
f=5
TT=17.445
T1=7.76
SAT (TO)
f=6
TT=1800.12
T1=10.58
OPT
f=5
TT=106.493
T1=95.65
SAT (TO)
f=6
TT=1800.11
T1=35.2
OPT
f=5
TT=1419.18
T1=267.81
SAT (TO)
f=6
TT=1800.06
T1=26.74
SAT
f=6
TT=1798.01
T1=124.84
SAT (TO)
f=6
TT=1800.21
T1=4.23
OPT
f=5
TT=75.999
T1=74.32
No dataOPT
f=5
TT=659.13
T1=204.62
SAT (TO)
f=6
TT=1800.07
T1=4.57
OPT
f=5
TT=179.244
T1=179.26
No dataSAT (TO)
f=5
TT=1800.18
T1=239.96
OPT
f=5
TT=1.37
T1=1.02
?

TT=0.007

OPT
f=5
TT=22.579
T1=16.94
OPT
f=5
TT=22.721
T1=17.14
No dataNo dataNo dataNo dataNo dataOPT
f=5
TT=129.28
T1=64.76
No dataNo dataNo dataOPT
f=5
TT=144.33
T1=72.26
SAT (TO)
f=6
TT=1800.13
T1=3.9
SAT (TO)
f=6
TT=1800.07
T1=4.73
OPT
f=5
TT=1622.28
T1=1227.97
OPT
f=5
TT=17.637
T1=14.35
OPT
f=5
TT=1.081
T1=0.24
OPT
f=5
TT=13.355
T1=8.54
? (TO)

TT=1800.03

? (TO)

TT=1800.04

No data?

TT=1799.87

?

TT=1799.48

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_10_4_1.opb
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.003
T1=0
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.04
T1=0.04
OPT
f=2
TT=0.061
T1=0.06
OPT
f=2
TT=0.017
T1=0.01
OPT
f=2
TT=0.022
T1=0.02
OPT
f=2
TT=0.018
T1=0.01
OPT
f=2
TT=0.023
T1=0.02
OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.027
T1=0.02
OPT
f=2
TT=0.004
T1=0.01
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.047
T1=0.03
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.144
T1=0.13
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.156
T1=0.13
OPT
f=2
TT=0.017
T1=0.01
No dataOPT
f=2
TT=0.008
T1=0
OPT
f=2
TT=0.163
T1=2.12
OPT
f=2
TT=0.033
T1=0.03
No dataOPT
f=2
TT=0.165
T1=1.13
OPT
f=2
TT=0.016
T1=0.01
?

TT=0.004

OPT
f=2
TT=0.017
T1=0.01
OPT
f=2
TT=0.018
T1=0.01
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.184
T1=1.15
OPT
f=2
TT=0.156
T1=0.14
OPT
f=2
TT=0.182
T1=0.14
OPT
f=2
TT=0.034
T1=0.03
OPT
f=2
TT=0.021
T1=0.01
OPT
f=2
TT=0.029
T1=0.02
OPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.002
T1=0
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.003
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_10_4_2.opb
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.001
T1=0
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.044
T1=0.04
OPT
f=2
TT=0.059
T1=0.06
OPT
f=2
TT=0.018
T1=0.01
OPT
f=2
TT=0.027
T1=0.02
OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.023
T1=0.02
OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.028
T1=0.02
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.039
T1=0.03
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.145
T1=0.13
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.164
T1=0.13
OPT
f=2
TT=0.02
T1=0.01
No dataOPT
f=2
TT=0.007
T1=0.01
OPT
f=2
TT=0.164
T1=2.14
OPT
f=2
TT=0.035
T1=0.03
No dataOPT
f=2
TT=0.164
T1=1.13
OPT
f=2
TT=0.016
T1=0.01
?

TT=0.005

OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.017
T1=0.01
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.185
T1=1.14
OPT
f=2
TT=0.165
T1=0.13
OPT
f=2
TT=0.184
T1=0.14
OPT
f=2
TT=0.04
T1=0.03
OPT
f=2
TT=0.017
T1=0.01
OPT
f=2
TT=0.03
T1=0.02
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.003
T1=0
No dataOPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.001
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_10_4_3.opb
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.002
T1=0
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.045
T1=0.04
OPT
f=2
TT=0.057
T1=0.06
OPT
f=2
TT=0.014
T1=0.01
OPT
f=2
TT=0.025
T1=0.02
OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.02
T1=0.02
OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.023
T1=0.02
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.005
T1=0
OPT
f=2
TT=0.046
T1=0.04
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.144
T1=0.11
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.177
T1=0.14
OPT
f=2
TT=0.017
T1=0.02
No dataOPT
f=2
TT=0.009
T1=0.01
OPT
f=2
TT=0.165
T1=2.13
OPT
f=2
TT=0.035
T1=0.03
No dataOPT
f=2
TT=0.175
T1=1.13
OPT
f=2
TT=0.021
T1=0.01
?

TT=0.005

OPT
f=2
TT=0.016
T1=0.01
OPT
f=2
TT=0.014
T1=0.01
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.175
T1=1.14
OPT
f=2
TT=0.177
T1=0.15
OPT
f=2
TT=0.174
T1=0.14
OPT
f=2
TT=0.037
T1=0.03
OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.029
T1=0.02
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.003
T1=0
No dataOPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.001
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mds/
normalized-mds_10_4_5.opb
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.002
T1=0
No dataOPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.045
T1=0.04
OPT
f=2
TT=0.048
T1=0.04
OPT
f=2
TT=0.015
T1=0.01
OPT
f=2
TT=0.025
T1=0.02
OPT
f=2
TT=0.02
T1=0.01
OPT
f=2
TT=0.022
T1=0.02
OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.022
T1=0.02
OPT
f=2
TT=0.004
T1=0
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.039
T1=0.05
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.155
T1=0.14
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.167
T1=0.15
OPT
f=2
TT=0.019
T1=0.01
No dataOPT
f=2
TT=0.008
T1=0
OPT
f=2
TT=0.164
T1=2.14
OPT
f=2
TT=0.04
T1=0.03
No dataOPT
f=2
TT=0.184
T1=1.14
OPT
f=2
TT=0.018
T1=0.01
?

TT=0.005

OPT
f=2
TT=0.02
T1=0.01
OPT
f=2
TT=0.019
T1=0.01
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.175
T1=1.15
OPT
f=2
TT=0.165
T1=0.14
OPT
f=2
TT=0.175
T1=0.14
OPT
f=2
TT=0.035
T1=0.03
OPT
f=2
TT=0.017
T1=0.01
OPT
f=2
TT=0.029
T1=0.02
OPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.004
T1=0
No dataOPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.001
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_200_10_2.opb
SAT
f=21
TT=1789.78
T1=53.9
SAT
f=29
TT=1798
T1=52.45
No dataSAT (TO)
f=26
TT=1800.02
T1=583.92
? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=28
TT=1800.05
T1=0.08
SAT (TO)
f=26
TT=1800.09
T1=30.04
SAT (TO)
f=29
TT=1802.12
T1=1.79
SAT
f=30
TT=1783.01
T1=0.08
SAT (TO)
f=32
TT=1800.25
T1=770.13
SAT
f=30
TT=1798
T1=0.06
SAT (TO)
f=33
TT=1800.34
T1=0.52
SAT
f=21
TT=1798.78
T1=53.9
No data? (TO)

TT=1800.41

SAT (TO)
f=26
TT=1800.89
T1=698.44
SAT
f=21
TT=1789.78
T1=631.99
No dataSAT (TO)
f=28
TT=1800.5
T1=3.87
SAT
f=21
TT=1796.96
T1=77.18
?

TT=0.005

? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=25
TT=1800.11
T1=900.31
No dataNo dataNo dataSAT (TO)
f=26
TT=1800.11
T1=900.31
SAT (TO)
f=27
TT=1800.6
T1=14.46
SAT (TO)
f=28
TT=1800.66
T1=972.27
SAT (TO)
f=29
TT=1800.67
T1=0.52
SAT
f=21
TT=1796.8
T1=606.11
SAT
f=21
TT=1796.99
T1=114.99
SAT
f=21
TT=1796.76
T1=166.65
? (TO)

TT=1800.11

? (TO)

TT=1800.02

No data?

TT=1799.68

?

TT=1799.79

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_200_10_5.opb
SAT
f=20
TT=1789.75
T1=43.23
SAT
f=30
TT=1798
T1=0.28
No dataSAT (TO)
f=25
TT=1800.03
T1=713.64
? (TO)

TT=1800.11

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.09

SAT (TO)
f=27
TT=1800.08
T1=156.62
SAT (TO)
f=26
TT=1800.1
T1=16.47
SAT (TO)
f=29
TT=1802.09
T1=5.51
SAT
f=29
TT=1783
T1=35.8
SAT (TO)
f=28
TT=1800.08
T1=0.73
SAT
f=28
TT=1798.01
T1=52.72
SAT (TO)
f=29
TT=1800.27
T1=0.62
SAT (TO)
f=20
TT=1800.18
T1=43.23
No data? (TO)

TT=1800.05

SAT (TO)
f=27
TT=1800.19
T1=649.22
SAT
f=20
TT=1789.75
T1=1388.13
No dataSAT (TO)
f=26
TT=1800.74
T1=238.85
SAT
f=20
TT=1796.89
T1=867.79
?

TT=0.004

? (TO)

TT=1800.01

? (TO)

TT=1800.14

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=23
TT=1800.49
T1=900.31
No dataNo dataNo dataSAT (TO)
f=24
TT=1800.08
T1=900.31
SAT (TO)
f=27
TT=1800.01
T1=21.01
SAT (TO)
f=27
TT=1800.02
T1=42.58
SAT (TO)
f=30
TT=1800.41
T1=0.54
SAT
f=21
TT=1796.77
T1=1004.9
SAT
f=20
TT=1796.82
T1=1409.41
SAT
f=20
TT=1796.75
T1=589.72
? (TO)

TT=1800.01

? (TO)

TT=1800.11

No data?

TT=1799.81

?

TT=1799.81

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_200_25_1.opb
SAT
f=11
TT=1789.78
T1=5.41
SAT
f=15
TT=1798.01
T1=69.46
No dataSAT (TO)
f=13
TT=1800.02
T1=1019.67
? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.07

SAT (TO)
f=14
TT=1800.12
T1=0.28
SAT (TO)
f=13
TT=1800.06
T1=41.1
SAT (TO)
f=14
TT=1802.07
T1=108.65
SAT
f=15
TT=1783
T1=2.6
SAT (TO)
f=15
TT=1800.35
T1=1.34
SAT
f=15
TT=1798.02
T1=243.09
SAT (TO)
f=15
TT=1800.68
T1=1.31
SAT
f=11
TT=1795.94
T1=383.27
No data? (TO)

TT=1800.36

SAT (TO)
f=13
TT=1800.1
T1=130.95
SAT
f=11
TT=1789.78
T1=1736.93
No dataSAT (TO)
f=14
TT=1800.73
T1=2.03
SAT
f=11
TT=1796.94
T1=5.41
?

TT=0.004

? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=12
TT=1800.09
T1=900.31
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.12
T1=900.31
SAT (TO)
f=14
TT=1800.73
T1=2.01
SAT (TO)
f=13
TT=1800.04
T1=702.86
SAT (TO)
f=15
TT=1800.07
T1=1073.62
SAT
f=11
TT=1796.79
T1=838.5
SAT
f=11
TT=1797.02
T1=5.55
SAT
f=11
TT=1796.78
T1=150.64
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No data?

TT=1799.77

?

TT=1799.48

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_200_25_3.opb
SAT
f=11
TT=1789.78
T1=3.46
SAT
f=15
TT=1798.11
T1=0.39
No dataSAT (TO)
f=13
TT=1800.11
T1=48.01
? (TO)

TT=1800.13

? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.11

SAT (TO)
f=13
TT=1800.07
T1=0.26
SAT (TO)
f=12
TT=1800.08
T1=951.71
SAT (TO)
f=14
TT=1800.15
T1=1284.29
SAT
f=15
TT=1783.01
T1=11.92
SAT (TO)
f=15
TT=1800.05
T1=1164.82
SAT
f=15
TT=1798.02
T1=3.78
SAT (TO)
f=16
TT=1801.44
T1=1.45
SAT
f=11
TT=1796.07
T1=483.32
No data? (TO)

TT=1800.4

SAT (TO)
f=14
TT=1800.12
T1=8.27
SAT
f=11
TT=1789.78
T1=987.08
No dataSAT (TO)
f=14
TT=1800.1
T1=6.04
SAT
f=11
TT=1796.91
T1=3.46
?

TT=0.007

? (TO)

TT=1800.02

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=12
TT=1800.42
T1=900.41
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.1
T1=900.41
SAT (TO)
f=13
TT=1800.03
T1=70.52
SAT (TO)
f=13
TT=1800.09
T1=80.49
SAT (TO)
f=16
TT=1800.06
T1=1.07
SAT
f=11
TT=1796.79
T1=591.94
SAT
f=11
TT=1796.98
T1=3.51
SAT
f=11
TT=1796.76
T1=176.93
? (TO)

TT=1800.11

? (TO)

TT=1800.02

No data?

TT=1799.55

?

TT=1799.44

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_200_25_4.opb
OPT
f=10
TT=351.226
T1=3.45
SAT
f=14
TT=1798.03
T1=493.81
No dataSAT (TO)
f=12
TT=1800.02
T1=31.82
? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.14

SAT (TO)
f=13
TT=1800.1
T1=1602.5
SAT (TO)
f=13
TT=1800.07
T1=87.4
SAT (TO)
f=15
TT=1802.1
T1=91.33
SAT
f=13
TT=1783.01
T1=750.38
SAT (TO)
f=16
TT=1800.01
T1=1.48
SAT
f=15
TT=1798.03
T1=6.89
SAT (TO)
f=16
TT=1800.28
T1=1.41
SAT
f=11
TT=1796.06
T1=303.66
No data? (TO)

TT=1800.18

SAT (TO)
f=14
TT=1801.37
T1=9.38
SAT
f=11
TT=1789.82
T1=970.52
No dataSAT (TO)
f=13
TT=1800.1
T1=297.39
OPT
f=10
TT=351.226
T1=3.45
?

TT=0.008

? (TO)

TT=1800.13

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=12
TT=1800.04
T1=900.31
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.02
T1=900.31
SAT (TO)
f=13
TT=1800.12
T1=94.98
SAT (TO)
f=13
TT=1800
T1=424.09
SAT (TO)
f=14
TT=1800.56
T1=47.49
SAT
f=11
TT=1796.8
T1=504.44
OPT
f=10
TT=374.091
T1=7.36
SAT
f=10
TT=1796.78
T1=162.98
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No data?

TT=1799.52

?

TT=1799.84

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_200_25_5.opb
SAT
f=10
TT=1796.78
T1=672.74
SAT
f=15
TT=1798.06
T1=0.42
No dataSAT (TO)
f=13
TT=1800.01
T1=15.3
? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.04

SAT (TO)
f=14
TT=1800.1
T1=263.33
SAT (TO)
f=13
TT=1800.09
T1=384.44
SAT (TO)
f=14
TT=1800.08
T1=1589.57
SAT
f=14
TT=1783.01
T1=522.79
SAT (TO)
f=15
TT=1800.3
T1=529.97
SAT
f=14
TT=1798.01
T1=85.48
SAT (TO)
f=15
TT=1800.78
T1=416.75
SAT
f=11
TT=1795.88
T1=275.82
No data? (TO)

TT=1800.25

SAT (TO)
f=14
TT=1800.17
T1=82.44
SAT
f=11
TT=1789.79
T1=612.83
No dataSAT (TO)
f=14
TT=1800.06
T1=18.23
SAT
f=11
TT=1796.92
T1=3.1
?

TT=0.008

? (TO)

TT=1800.08

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=12
TT=1800.39
T1=900.41
No dataNo dataNo dataSAT (TO)
f=12
TT=1800.08
T1=900.41
SAT (TO)
f=14
TT=1800.05
T1=23.6
SAT (TO)
f=14
TT=1800
T1=417.8
SAT (TO)
f=15
TT=1800.08
T1=146.12
SAT
f=11
TT=1796.8
T1=751.17
SAT
f=11
TT=1797.04
T1=3.22
SAT
f=10
TT=1796.78
T1=672.74
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No data?

TT=1799.85

?

TT=1799.48

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_10_2.opb
SAT
f=53
TT=1796.76
T1=131.19
SAT
f=75
TT=1798.01
T1=1.05
No dataSAT (TO)
f=73
TT=1800.1
T1=497.46
? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

SAT (TO)
f=77
TT=1800.09
T1=705.31
SAT (TO)
f=74
TT=1800.11
T1=14.45
SAT (TO)
f=78
TT=1800.08
T1=1.2
SAT
f=76
TT=1783.02
T1=0.53
SAT (TO)
f=83
TT=1800.09
T1=1.45
SAT
f=76
TT=1798.01
T1=0.18
SAT (TO)
f=82
TT=1800.13
T1=1.52
SAT
f=58
TT=1794.55
T1=1134.76
No data? (TO)

TT=1800.35

SAT (TO)
f=74
TT=1800.06
T1=7.34
SAT
f=93
TT=1789.79
T1=4.54
No dataSAT (TO)
f=75
TT=1800.09
T1=824.61
SAT
f=53
TT=1796.77
T1=411.23
?

TT=0.005

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=69
TT=1800.03
T1=900.31
No dataNo dataNo dataSAT (TO)
f=69
TT=1800.05
T1=900.31
SAT (TO)
f=77
TT=1800.17
T1=39.58
SAT (TO)
f=82
TT=1800.07
T1=1.39
SAT (TO)
f=79
TT=1800.08
T1=0.84
SAT
f=92
TT=1796.78
T1=2.66
SAT
f=53
TT=1796.76
T1=131.19
SAT
f=55
TT=1796.77
T1=183.93
? (TO)

TT=1800.11

? (TO)

TT=1800.09

No data?

TT=1799.59

?

TT=1799.58

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_25_1.opb
SAT
f=27
TT=1796.79
T1=510.52
SAT
f=42
TT=1798.01
T1=3.53
No dataSAT (TO)
f=40
TT=1800.09
T1=141.45
? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.13

SAT (TO)
f=39
TT=1800.07
T1=0.67
SAT (TO)
f=40
TT=1800.05
T1=15.03
SAT (TO)
f=42
TT=1802.11
T1=692.47
SAT
f=40
TT=1783.01
T1=4.6
SAT (TO)
f=45
TT=1800.61
T1=6.28
SAT
f=41
TT=1798.01
T1=17.76
SAT (TO)
f=45
TT=1800.06
T1=7.95
SAT
f=48
TT=1794.79
T1=13.43
No data? (TO)

TT=1800.21

SAT (TO)
f=40
TT=1800.93
T1=49.72
SAT
f=48
TT=1789.85
T1=12.32
No dataSAT (TO)
f=39
TT=1800.01
T1=745.92
SAT
f=27
TT=1796.79
T1=510.52
?

TT=0.006

? (TO)

TT=1800.07

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=37
TT=1800.08
T1=900.41
No dataNo dataNo dataSAT (TO)
f=37
TT=1800.2
T1=900.51
SAT (TO)
f=40
TT=1800.55
T1=94.69
SAT (TO)
f=45
TT=1800.04
T1=0.79
SAT (TO)
f=39
TT=1800.51
T1=1.34
SAT
f=30
TT=1796.85
T1=452.33
SAT
f=27
TT=1796.8
T1=598.66
SAT
f=30
TT=1796.9
T1=472.05
? (TO)

TT=1800.08

? (TO)

TT=1800.07

No data?

TT=1799.57

?

TT=1799.59

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_25_2.opb
SAT
f=28
TT=1796.77
T1=109.6
SAT
f=43
TT=1798.01
T1=8.47
No dataSAT (TO)
f=40
TT=1800.09
T1=1154.62
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.11

SAT (TO)
f=38
TT=1800.11
T1=0.74
SAT (TO)
f=40
TT=1800.06
T1=11.92
SAT (TO)
f=43
TT=1802.06
T1=226.84
SAT
f=40
TT=1783.01
T1=83.86
SAT (TO)
f=45
TT=1800.05
T1=7.13
SAT
f=40
TT=1798.02
T1=0.89
SAT (TO)
f=45
TT=1800.05
T1=8.1
SAT
f=51
TT=1794.75
T1=14.15
No data? (TO)

TT=1800.17

SAT (TO)
f=40
TT=1800.17
T1=91.8
SAT
f=51
TT=1789.82
T1=12.36
No dataSAT (TO)
f=39
TT=1800.14
T1=426.87
SAT
f=28
TT=1796.77
T1=509.11
?

TT=0.008

? (TO)

TT=1800.12

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=35
TT=1800.54
T1=900.41
No dataNo dataNo dataSAT (TO)
f=35
TT=1800.18
T1=900.41
SAT (TO)
f=41
TT=1800.11
T1=168.06
SAT (TO)
f=43
TT=1800.09
T1=454.74
SAT (TO)
f=37
TT=1800.65
T1=2.44
SAT
f=51
TT=1796.83
T1=12.01
SAT
f=28
TT=1796.79
T1=109.6
SAT
f=51
TT=1796.86
T1=11
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No data?

TT=1799.47

?

TT=1799.46

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_25_3.opb
SAT
f=27
TT=1796.78
T1=233.61
SAT
f=39
TT=1798.02
T1=3.78
No dataSAT (TO)
f=39
TT=1800.09
T1=1585.81
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.13

? (TO)

TT=1800.13

SAT (TO)
f=37
TT=1800.11
T1=1.36
SAT (TO)
f=36
TT=1800.03
T1=373.4
SAT (TO)
f=44
TT=1802.07
T1=34.05
SAT
f=41
TT=1783.01
T1=13.02
SAT (TO)
f=42
TT=1800.05
T1=6.98
SAT
f=42
TT=1798.03
T1=82.67
SAT (TO)
f=42
TT=1800.56
T1=7.05
SAT
f=45
TT=1795.31
T1=16.32
No data? (TO)

TT=1800.18

SAT (TO)
f=39
TT=1800.86
T1=150.12
SAT
f=45
TT=1789.87
T1=15.03
No dataSAT (TO)
f=39
TT=1800.76
T1=73.08
SAT
f=27
TT=1796.78
T1=677.67
?

TT=0.006

? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=36
TT=1800.21
T1=900.41
No dataNo dataNo dataSAT (TO)
f=36
TT=1800.08
T1=900.41
SAT (TO)
f=40
TT=1800.2
T1=85.89
SAT (TO)
f=41
TT=1800.51
T1=47.67
SAT (TO)
f=40
TT=1800.43
T1=2.51
SAT
f=45
TT=1796.85
T1=12.76
SAT
f=27
TT=1796.8
T1=233.61
SAT
f=45
TT=1796.82
T1=13.83
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No data?

TT=1799.72

?

TT=1799.46

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_25_4.opb
SAT
f=28
TT=1796.78
T1=58.17
SAT
f=43
TT=1798.02
T1=5.28
No dataSAT (TO)
f=40
TT=1800.08
T1=177.98
? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.09

SAT (TO)
f=41
TT=1800.13
T1=0.83
SAT (TO)
f=38
TT=1800.06
T1=34.12
SAT (TO)
f=43
TT=1802.12
T1=6.9
SAT
f=44
TT=1783.01
T1=1.96
SAT (TO)
f=45
TT=1800.68
T1=6.41
SAT
f=41
TT=1798.01
T1=1035.37
SAT (TO)
f=45
TT=1800.28
T1=6.99
SAT
f=48
TT=1794.67
T1=8.11
No data? (TO)

TT=1800.29

SAT (TO)
f=40
TT=1800.09
T1=173.47
SAT
f=48
TT=1789.88
T1=7.72
No dataSAT (TO)
f=39
TT=1800.43
T1=304.82
SAT
f=28
TT=1796.78
T1=58.55
?

TT=0.006

? (TO)

TT=1800.13

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=35
TT=1800.2
T1=900.41
No dataNo dataNo dataSAT (TO)
f=35
TT=1800.19
T1=900.41
SAT (TO)
f=39
TT=1800.01
T1=3.37
SAT (TO)
f=43
TT=1800.06
T1=203.59
SAT (TO)
f=39
TT=1800.58
T1=1.44
SAT
f=48
TT=1796.82
T1=10.63
SAT
f=28
TT=1796.78
T1=58.17
SAT
f=48
TT=1796.85
T1=12.05
? (TO)

TT=1800.1

? (TO)

TT=1800.01

No data?

TT=1799.46

?

TT=1799.47

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_60_3.opb
SAT
f=15
TT=1796.85
T1=55.4
SAT
f=22
TT=1798.05
T1=368.49
No dataSAT (TO)
f=18
TT=1800.08
T1=77.65
? (TO)

TT=1800.12

? (TO)

TT=1800.01

? (TO)

TT=1800.13

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.04

SAT (TO)
f=20
TT=1800.07
T1=4.81
SAT (TO)
f=19
TT=1800.06
T1=4.76
SAT (TO)
f=21
TT=1802.14
T1=429.72
SAT
f=22
TT=1783.02
T1=15.46
SAT (TO)
f=22
TT=1800.56
T1=963.74
SAT
f=21
TT=1798.03
T1=104.32
SAT (TO)
f=23
TT=1800.06
T1=68.04
SAT
f=23
TT=1795.01
T1=892.49
No data? (TO)

TT=1800.08

SAT (TO)
f=20
TT=1800.17
T1=186.7
SAT
f=24
TT=1790.03
T1=98.79
No dataSAT (TO)
f=19
TT=1800.11
T1=176
SAT
f=15
TT=1796.86
T1=61.05
?

TT=0.005

? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=18
TT=1800.42
T1=900.51
No dataNo dataNo dataSAT (TO)
f=18
TT=1800.06
T1=900.51
SAT (TO)
f=19
TT=1800.5
T1=587.9
SAT (TO)
f=23
TT=1800
T1=0.98
SAT (TO)
f=18
TT=1800.02
T1=2.86
SAT
f=17
TT=1797.07
T1=1000.24
SAT
f=15
TT=1796.85
T1=55.4
SAT
f=17
TT=1796.91
T1=957.7
? (TO)

TT=1800.03

? (TO)

TT=1800.11

No data?

TT=1799.92

?

TT=1799.81

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_500_60_4.opb
SAT
f=14
TT=1796.86
T1=846.56
SAT
f=21
TT=1798.04
T1=682.98
No dataSAT (TO)
f=18
TT=1800.09
T1=35
? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.01

SAT (TO)
f=20
TT=1800.08
T1=4.48
SAT (TO)
f=20
TT=1800.11
T1=3.79
SAT (TO)
f=21
TT=1802.17
T1=30.67
SAT
f=21
TT=1783.01
T1=462.5
SAT (TO)
f=23
TT=1800.1
T1=69.09
SAT
f=19
TT=1798.03
T1=4.08
SAT (TO)
f=23
TT=1800.07
T1=69.35
SAT
f=23
TT=1794.76
T1=55.39
No data? (TO)

TT=1800.05

SAT (TO)
f=19
TT=1800.17
T1=653.19
SAT
f=22
TT=1790.02
T1=1502.31
No dataSAT (TO)
f=19
TT=1800.18
T1=744.16
SAT
f=14
TT=1796.86
T1=846.56
?

TT=0.007

? (TO)

TT=1800.11

? (TO)

TT=1800.15

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=18
TT=1800.61
T1=900.51
No dataNo dataNo dataSAT (TO)
f=18
TT=1800.14
T1=900.51
SAT (TO)
f=19
TT=1800.07
T1=459.74
SAT (TO)
f=23
TT=1800.03
T1=0.93
SAT (TO)
f=22
TT=1800.08
T1=6.66
SAT
f=16
TT=1796.98
T1=1179.1
SAT
f=15
TT=1796.85
T1=59.61
SAT
f=16
TT=1797.07
T1=1258
? (TO)

TT=1800.1

? (TO)

TT=1800.11

No data?

TT=1799.92

?

TT=1799.44

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_50_10_4.opb
OPT
f=6
TT=0.323
T1=0.01
OPT
f=6
TT=27.624
T1=0.03
No dataOPT
f=6
TT=1.822
T1=0.01
OPT
f=6
TT=0.383
T1=0.38
OPT
f=6
TT=0.367
T1=0.36
OPT
f=6
TT=0.34
T1=0.33
OPT
f=6
TT=0.323
T1=0.32
OPT
f=6
TT=0.351
T1=0.05
OPT
f=6
TT=0.425
T1=0.06
OPT
f=6
TT=0.352
T1=0.05
OPT
f=6
TT=0.434
T1=0.06
OPT
f=6
TT=88.544
T1=0.01
OPT
f=6
TT=1.246
T1=0.05
OPT
f=6
TT=25.834
T1=0.16
OPT
f=6
TT=42.998
T1=0.03
OPT
f=6
TT=52.36
T1=0.65
OPT
f=6
TT=321.632
T1=0.03
OPT
f=6
TT=60.736
T1=0.49
OPT
f=6
TT=5.409
T1=3.2
No dataOPT
f=6
TT=11.444
T1=5.19
OPT
f=6
TT=160.631
T1=2.24
OPT
f=6
TT=5.744
T1=2.62
No dataOPT
f=6
TT=82.75
T1=1.23
OPT
f=6
TT=0.333
T1=0.04
?

TT=0.007

OPT
f=6
TT=0.355
T1=0.35
OPT
f=6
TT=0.368
T1=0.05
No dataNo dataNo dataNo dataNo dataOPT
f=6
TT=7.504
T1=3.75
No dataNo dataNo dataOPT
f=6
TT=7.684
T1=3.84
OPT
f=6
TT=30.808
T1=1.23
OPT
f=6
TT=16.272
T1=0.34
OPT
f=6
TT=32.83
T1=1.55
OPT
f=6
TT=2.941
T1=2.15
OPT
f=6
TT=0.471
T1=0.17
OPT
f=6
TT=2.224
T1=1.52
OPT
f=6
TT=44.655
T1=0.01
OPT
f=6
TT=43.85
T1=0.01
No dataOPT
f=6
TT=1050.12
T1=1050.15
OPT
f=6
TT=1005.04
T1=1005.4
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_50_10_5.opb
OPT
f=6
TT=0.413
T1=0.01
OPT
f=6
TT=21.332
T1=0.06
No dataOPT
f=6
TT=1.914
T1=0.01
OPT
f=6
TT=0.61
T1=0.6
OPT
f=6
TT=0.668
T1=0.16
OPT
f=6
TT=0.554
T1=0.55
OPT
f=6
TT=0.505
T1=0.12
OPT
f=6
TT=0.467
T1=0.04
OPT
f=6
TT=0.517
T1=0.07
OPT
f=6
TT=0.465
T1=0.05
OPT
f=6
TT=0.508
T1=0.07
OPT
f=6
TT=87.084
T1=0.01
OPT
f=6
TT=1.316
T1=0.1
OPT
f=6
TT=31.061
T1=0.18
OPT
f=6
TT=68.118
T1=3.29
OPT
f=6
TT=68.95
T1=0.62
OPT
f=6
TT=135.186
T1=0.83
OPT
f=6
TT=61.54
T1=1.77
OPT
f=6
TT=4.113
T1=2.24
No dataOPT
f=6
TT=3.335
T1=1.13
OPT
f=6
TT=158.099
T1=2.23
OPT
f=6
TT=5.225
T1=2.05
No dataOPT
f=6
TT=95.121
T1=1.23
OPT
f=6
TT=0.413
T1=0.04
?

TT=0.006

OPT
f=6
TT=0.508
T1=0.51
OPT
f=6
TT=0.505
T1=0.02
No dataNo dataNo dataNo dataNo dataOPT
f=6
TT=9.005
T1=4.5
No dataNo dataNo dataOPT
f=6
TT=9.295
T1=4.66
OPT
f=6
TT=35.109
T1=1.22
OPT
f=6
TT=20.1
T1=0.59
OPT
f=6
TT=31.81
T1=0.26
OPT
f=6
TT=2.632
T1=1.61
OPT
f=6
TT=0.421
T1=0.06
OPT
f=6
TT=2.71
T1=1.75
OPT
f=6
TT=43.914
T1=0.01
OPT
f=6
TT=43.622
T1=0.01
No dataOPT
f=6
TT=128.324
T1=128.31
OPT
f=6
TT=120.341
T1=120.37
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mds/normalized-mds_50_25_4.opb
OPT
f=2
TT=0.013
T1=0.01
OPT
f=2
TT=0.351
T1=0.32
No dataOPT
f=2
TT=0.013
T1=0.01
OPT
f=2
TT=0.16
T1=0.14
OPT
f=2
TT=0.147
T1=0.15
OPT
f=2
TT=0.097
T1=0.09
OPT
f=2
TT=0.113
T1=0.11
OPT
f=2
TT=0.112
T1=0.11
OPT
f=2
TT=0.105
T1=0.1
OPT
f=2
TT=0.111
T1=0.11
OPT
f=2
TT=0.109
T1=0.1
OPT
f=2
TT=0.142
T1=0.13
OPT
f=2
TT=0.089
T1=0.08
OPT
f=2
TT=0.402
T1=0.36
OPT
f=2
TT=0.182
T1=0.17
OPT
f=2
TT=1.263
T1=0.59
OPT
f=2
TT=0.742
T1=0.73
OPT
f=2
TT=1.355
T1=0.64
OPT
f=2
TT=3.124
T1=3.1
No dataOPT
f=2
TT=62.769
T1=32.09
OPT
f=2
TT=2.924
T1=3.35
OPT
f=2
TT=2.739
T1=2.72
No dataOPT
f=2
TT=2.522
T1=1.82
OPT
f=2
TT=0.178
T1=0.17
?

TT=0.005

OPT
f=2
TT=0.1
T1=0.1
OPT
f=2
TT=0.141
T1=0.12
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.051
T1=0.02
No dataNo dataNo dataOPT
f=2
TT=0.051
T1=0.02
OPT
f=2
TT=2.784
T1=1.83
OPT
f=2
TT=1.024
T1=0.52
OPT
f=2
TT=0.804
T1=0.39
OPT
f=2
TT=1.159
T1=0.77
OPT
f=2
TT=0.316
T1=0.3
OPT
f=2
TT=0.84
T1=0.83
OPT
f=2
TT=0.147
T1=0.04
OPT
f=2
TT=0.146
T1=0.04
No dataOPT
f=2
TT=0.03
T1=0.02
OPT
f=2
TT=0.029
T1=0.02
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_1000_25_1.opb
SAT
f=-126
TT=1798.01
T1=0.48
SAT
f=-126
TT=1798.01
T1=0.48
No dataSAT (TO)
f=-125
TT=1800.05
T1=556.82
? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.15

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.13

SAT (TO)
f=-126
TT=1800.07
T1=0.48
SAT (TO)
f=-126
TT=1800.05
T1=835.14
? (TO)

TT=1201.24

SAT
f=-85
TT=1783.01
T1=1783.34
?

TT=8.702

SAT
f=-126
TT=1798.01
T1=0.27
SAT
f=-118
TT=158.79
T1=16.41
SAT
f=-98
TT=1799.5
T1=1.06
No data? (TO)

TT=1800.39

SAT (TO)
f=-123
TT=1800.28
T1=770.37
SAT
f=-99
TT=1789.74
T1=1.02
No dataSAT (TO)
f=-124
TT=1800.03
T1=330.19
SAT
f=-99
TT=1796.91
T1=1.05
?

TT=0.006

? (TO)

TT=1800.15

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-126
TT=1800.19
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-126
TT=1800.09
T1=900.41
SAT (TO)
f=-121
TT=1800.17
T1=362.4
SAT (TO)
f=-106
TT=1800.02
T1=0.82
SAT (TO)
f=-120
TT=1801.33
T1=1203.18
SAT
f=-99
TT=1796.86
T1=1.16
SAT
f=-99
TT=1797
T1=0.97
SAT
f=-99
TT=1796.93
T1=0.98
? (TO)

TT=1800.06

? (TO)

TT=1800.11

No data?

TT=1799.94

?

TT=1799.9

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_1000_25_2.opb
SAT
f=-128
TT=1800.09
T1=900.41
SAT
f=-122
TT=1798.01
T1=0.52
No dataSAT (TO)
f=-127
TT=1800.01
T1=1074.34
? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.12

SAT (TO)
f=-122
TT=1800.08
T1=0.45
SAT (TO)
f=-125
TT=1800.03
T1=2.06
? (TO)

TT=1800.11

SAT
f=-76
TT=1783.01
T1=1783.35
?

TT=8.754

SAT
f=-122
TT=1798.01
T1=0.25
? (exit code)

TT=159.27

SAT
f=-91
TT=1799.73
T1=2.29
No data? (TO)

TT=1800.1

? (TO)

TT=1258.94

SAT
f=-102
TT=1789.8
T1=1.03
No dataSAT (TO)
f=-125
TT=1800.03
T1=662.79
SAT
f=-102
TT=1796.95
T1=1.08
?

TT=0.006

? (TO)

TT=1800.1

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-128
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-128
TT=1800.44
T1=900.41
SAT (TO)
f=-122
TT=1802.44
T1=172.6
SAT (TO)
f=-103
TT=1800.72
T1=0.88
SAT (TO)
f=-120
TT=1800.05
T1=498.03
SAT
f=-102
TT=1796.83
T1=0.95
SAT
f=-102
TT=1796.9
T1=0.92
SAT
f=-102
TT=1796.94
T1=1.2
? (TO)

TT=1800.05

? (TO)

TT=1800.1

No data?

TT=1799.86

?

TT=1799.44

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_1000_25_4.opb
SAT
f=-128
TT=1800.02
T1=900.41
SAT
f=-119
TT=1798.01
T1=177.56
No dataSAT (TO)
f=-126
TT=1800.06
T1=1196.61
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.09

SAT (TO)
f=-118
TT=1800.05
T1=0.48
SAT (TO)
f=-124
TT=1800.05
T1=2.4
? (TO)

TT=1695.5

SAT
f=-83
TT=1783.01
T1=1783.36
?

TT=8.853

SAT
f=-120
TT=1798.01
T1=496.04
? (exit code)

TT=163.14

SAT (TO)
f=-94
TT=1800.72
T1=5.17
No data? (TO)

TT=1800.34

SAT (TO)
f=-122
TT=1800.13
T1=486.66
SAT
f=-99
TT=1789.79
T1=492.15
No dataSAT (TO)
f=-124
TT=1800.23
T1=854.84
SAT
f=-98
TT=1796.89
T1=1.23
?

TT=0.006

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-128
TT=1800.02
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-128
TT=1800.13
T1=900.41
SAT (TO)
f=-120
TT=1800.57
T1=105.46
SAT (TO)
f=-108
TT=1800.91
T1=0.93
SAT (TO)
f=-118
TT=1801.47
T1=24.69
SAT
f=-98
TT=1796.83
T1=0.98
SAT
f=-98
TT=1796.89
T1=0.95
SAT
f=-98
TT=1796.85
T1=0.92
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No data?

TT=1799.95

?

TT=1799.59

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_1000_25_5.opb
SAT
f=-128
TT=1800.07
T1=900.41
SAT
f=-120
TT=1798.01
T1=36.36
No dataSAT (TO)
f=-127
TT=1800.05
T1=1338.5
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.15

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.09

SAT (TO)
f=-120
TT=1800.05
T1=196.04
SAT (TO)
f=-124
TT=1800.04
T1=443.64
? (TO)

TT=1800.09

SAT
f=-95
TT=1783.01
T1=1783.35
?

TT=8.811

SAT
f=-119
TT=1798.01
T1=0.27
No Cert.

TT=180.34

SAT (TO)
f=-91
TT=1800.26
T1=0.73
No data? (TO)

TT=1800.27

SAT (TO)
f=-122
TT=1800.37
T1=575.32
SAT
f=-101
TT=1789.75
T1=0.95
No dataSAT (TO)
f=-123
TT=1800.19
T1=771.35
SAT
f=-101
TT=1796.98
T1=1.05
?

TT=0.008

? (TO)

TT=1800.12

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-128
TT=1800.11
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-128
TT=1800.07
T1=900.41
SAT (TO)
f=-121
TT=1800.63
T1=425.57
SAT (TO)
f=-100
TT=1800.6
T1=0.96
SAT (TO)
f=-119
TT=1800.47
T1=54.41
SAT
f=-101
TT=1796.93
T1=1.18
SAT
f=-101
TT=1796.97
T1=1.18
SAT
f=-101
TT=1796.85
T1=1.19
? (TO)

TT=1800.08

? (TO)

TT=1800.05

No data?

TT=1799.91

?

TT=1799.56

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_1000_60_1.opb
SAT
f=-73
TT=1800.04
T1=900.51
SAT
f=-65
TT=1798.01
T1=2.52
No dataSAT (TO)
f=-73
TT=1800.06
T1=1253.4
? (TO)

TT=1800.15

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.01

SAT (TO)
f=-65
TT=1800.09
T1=2.52
SAT (TO)
f=-70
TT=1800.13
T1=72.85
? (TO)

TT=1568.22

SAT
f=-39
TT=1783.04
T1=1783.39
?

TT=85.291

SAT
f=-66
TT=1798.01
T1=223.74
SAT (TO)
f=-65
TT=1800.04
T1=164.72
SAT
f=-51
TT=1797.75
T1=9.48
No data? (TO)

TT=1800.1

SAT (TO)
f=-69
TT=1801.23
T1=212.83
SAT
f=-58
TT=1789.85
T1=1180.54
No dataSAT (TO)
f=-68
TT=1800.87
T1=56.16
SAT
f=-51
TT=1796.97
T1=2.92
?

TT=0.006

? (TO)

TT=1800.1

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-73
TT=1800.58
T1=900.61
No dataNo dataNo dataSAT (TO)
f=-73
TT=1800.04
T1=900.51
SAT (TO)
f=-68
TT=1800.39
T1=661.5
SAT (TO)
f=-55
TT=1800.08
T1=15.77
SAT (TO)
f=-66
TT=1800.54
T1=399.38
SAT
f=-51
TT=1796.85
T1=2.31
SAT
f=-51
TT=1797.04
T1=2.26
SAT
f=-51
TT=1796.88
T1=2.51
? (TO)

TT=1800.07

? (TO)

TT=1800.03

No data?

TT=1799.87

?

TT=1800

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_1000_60_4.opb
SAT
f=-71
TT=1800.09
T1=900.41
SAT
f=-66
TT=1798.01
T1=1690.52
No dataSAT (TO)
f=-71
TT=1800.09
T1=1215.82
? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.03

SAT (TO)
f=-63
TT=1800.11
T1=2.56
SAT (TO)
f=-68
TT=1800.12
T1=3.21
? (TO)

TT=1800.06

SAT
f=-42
TT=1783.02
T1=1783.47
?

TT=85.161

SAT
f=-65
TT=1798.01
T1=1027.44
SAT (TO)
f=-67
TT=1800.1
T1=567.2
SAT
f=-50
TT=1797.17
T1=5.53
No data? (TO)

TT=1800.29

SAT (TO)
f=-69
TT=1800.77
T1=432.03
SAT
f=-57
TT=1789.86
T1=1681.79
No dataSAT (TO)
f=-70
TT=1800.16
T1=14.64
SAT
f=-53
TT=1796.98
T1=3.16
?

TT=0.006

? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-71
TT=1800.2
T1=900.61
No dataNo dataNo dataSAT (TO)
f=-71
TT=1800.44
T1=900.41
SAT (TO)
f=-66
TT=1800.18
T1=134.66
SAT (TO)
f=-55
TT=1800.93
T1=1.34
SAT (TO)
f=-68
TT=1800.05
T1=200.23
SAT
f=-53
TT=1796.85
T1=2.64
SAT
f=-53
TT=1796.94
T1=2.21
SAT
f=-53
TT=1796.86
T1=2.34
? (TO)

TT=1800.06

? (TO)

TT=1800.08

No data?

TT=1799.89

?

TT=1799.62

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_100_10_1.opb
OPT
f=-26
TT=2.581
T1=1.31
SAT
f=-26
TT=1798
T1=166.92
No dataOPT
f=-26
TT=844.311
T1=4.95
OPT
f=-26
TT=131.195
T1=76.94
OPT
f=-26
TT=130.845
T1=76.73
OPT
f=-26
TT=130.707
T1=76.3
OPT
f=-26
TT=132.701
T1=77.49
OPT
f=-26
TT=82.08
T1=28.4
OPT
f=-26
TT=83.559
T1=27.59
OPT
f=-26
TT=84.459
T1=28.39
OPT
f=-26
TT=82.616
T1=28.05
SAT (TO)
f=-26
TT=1800.03
T1=74.32
OPT
f=-26
TT=106.784
T1=35.47
? (TO)

TT=1578.12

OPT
f=-26
TT=639.869
T1=639.96
?

TT=0.315

SAT
f=-26
TT=1798
T1=88.88
SAT (TO)
f=-25
TT=1800.06
T1=57.49
OPT
f=-26
TT=2.752
T1=1.31
No dataOPT
f=-26
TT=1.015
T1=0.57
OPT
f=-26
TT=1624.17
T1=46.33
SAT
f=-26
TT=1789.74
T1=1388.44
No dataOPT
f=-26
TT=1283.72
T1=123.29
OPT
f=-26
TT=2.857
T1=2.17
?

TT=0.005

OPT
f=-26
TT=118.654
T1=60.24
OPT
f=-26
TT=60.989
T1=2.44
No dataNo dataNo dataNo dataNo dataOPT
f=-26
TT=1260.5
T1=630.3
No dataNo dataNo dataOPT
f=-26
TT=1095.31
T1=547.68
SAT (TO)
f=-25
TT=1800.08
T1=19.33
SAT (TO)
f=-24
TT=1800.68
T1=142.64
SAT (TO)
f=-26
TT=1800.02
T1=25.56
OPT
f=-26
TT=3.093
T1=2.7
OPT
f=-26
TT=2.581
T1=2.22
OPT
f=-26
TT=3.405
T1=3.11
? (TO)

TT=1800.07

? (TO)

TT=1800.09

No data?

TT=1799.9

?

TT=1799.5

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_100_10_2.opb
OPT
f=-26
TT=2.641
T1=0.42
SAT
f=-26
TT=1798
T1=205.72
No dataOPT
f=-26
TT=590.279
T1=0.42
OPT
f=-26
TT=234.374
T1=154.24
OPT
f=-26
TT=235.291
T1=153.09
OPT
f=-26
TT=234.677
T1=153.3
OPT
f=-26
TT=238.344
T1=155.67
OPT
f=-26
TT=181.636
T1=100.85
OPT
f=-26
TT=183.002
T1=101.17
OPT
f=-26
TT=186.323
T1=100.99
OPT
f=-26
TT=181.391
T1=100.91
SAT (TO)
f=-26
TT=1800.03
T1=412.37
OPT
f=-26
TT=146.944
T1=12.5
? (TO)

TT=1800.04

OPT
f=-26
TT=467.716
T1=467.82
?

TT=0.325

SAT
f=-26
TT=1798
T1=359.41
SAT (TO)
f=-24
TT=1801.02
T1=0.56
OPT
f=-26
TT=4.281
T1=3.75
No dataOPT
f=-26
TT=1.038
T1=0.55
SAT (TO)
f=-26
TT=1800.12
T1=728.18
OPT
f=-26
TT=1768.52
T1=378.82
No dataOPT
f=-26
TT=1235.76
T1=14.83
OPT
f=-26
TT=3.361
T1=3.08
?

TT=0.005

OPT
f=-26
TT=212.904
T1=111.55
OPT
f=-26
TT=148.044
T1=52.04
No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-26
TT=1800.16
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-26
TT=1800.15
T1=900.31
SAT (TO)
f=-24
TT=1800.78
T1=4.75
SAT (TO)
f=-25
TT=1800.05
T1=848.42
SAT (TO)
f=-26
TT=1800.09
T1=2.56
OPT
f=-26
TT=3.235
T1=2.45
OPT
f=-26
TT=2.641
T1=1.62
OPT
f=-26
TT=3.653
T1=3.1
? (TO)

TT=1800.12

? (TO)

TT=1800.11

No data?

TT=1799.92

?

TT=1799.91

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_100_10_3.opb
OPT
f=-26
TT=3.019
T1=2.17
SAT
f=-26
TT=1798
T1=1106.35
No dataOPT
f=-26
TT=671.417
T1=9.67
OPT
f=-26
TT=216.293
T1=147.05
OPT
f=-26
TT=218.557
T1=148.35
OPT
f=-26
TT=220.576
T1=151.62
OPT
f=-26
TT=216.806
T1=148.81
OPT
f=-26
TT=191.588
T1=118.14
OPT
f=-26
TT=184.453
T1=114.65
OPT
f=-26
TT=184.236
T1=115.11
OPT
f=-26
TT=182.57
T1=113.59
SAT (TO)
f=-25
TT=1800.02
T1=697.47
OPT
f=-26
TT=108.009
T1=10.26
? (TO)

TT=1349.65

OPT
f=-26
TT=647.784
T1=647.88
?

TT=0.325

?

TT=0.005

SAT (TO)
f=-25
TT=1800.04
T1=67.32
OPT
f=-26
TT=3.019
T1=2.17
No dataNo Cert.

TT=1.351

OPT
f=-26
TT=1440.88
T1=81.65
SAT
f=-26
TT=1789.74
T1=1451.71
No dataSAT (TO)
f=-26
TT=1800.62
T1=642.31
OPT
f=-26
TT=4.728
T1=4.62
?

TT=0.005

OPT
f=-26
TT=164.647
T1=109.97
OPT
f=-26
TT=112.448
T1=59.35
No dataNo dataNo dataNo dataNo dataNo Cert.

TT=1116.69

No dataNo dataNo dataNo Cert.

TT=1007.27

SAT (TO)
f=-24
TT=1800.66
T1=167.25
SAT (TO)
f=-24
TT=1800.03
T1=1359.49
SAT (TO)
f=-25
TT=1800.06
T1=19.31
OPT
f=-26
TT=3.435
T1=3.23
OPT
f=-26
TT=3.164
T1=2.93
OPT
f=-26
TT=3.979
T1=3.95
? (TO)

TT=1800.07

? (TO)

TT=1800.07

No data?

TT=1799.92

?

TT=1799.57

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_100_10_5.opb
OPT
f=-25
TT=3.149
T1=0.46
SAT
f=-25
TT=1798
T1=166.38
No dataOPT
f=-25
TT=1090.24
T1=0.46
OPT
f=-25
TT=97.315
T1=16.96
OPT
f=-25
TT=95.832
T1=16.75
OPT
f=-25
TT=98.054
T1=16.88
OPT
f=-25
TT=96.065
T1=16.57
OPT
f=-25
TT=79.282
T1=17.75
OPT
f=-25
TT=78.426
T1=18.26
OPT
f=-25
TT=78.056
T1=18.08
OPT
f=-25
TT=79.417
T1=19.07
SAT (TO)
f=-25
TT=1800.03
T1=54.71
OPT
f=-25
TT=107.313
T1=0.62
? (TO)

TT=1487.87

OPT
f=-25
TT=652.945
T1=653.04
?

TT=0.313

SAT
f=-25
TT=1798
T1=728.64
SAT (TO)
f=-24
TT=1800.01
T1=0.93
OPT
f=-25
TT=3.279
T1=2.72
No dataOPT
f=-25
TT=3.249
T1=1.56
SAT (TO)
f=-25
TT=1800.25
T1=24.33
SAT
f=-25
TT=1789.74
T1=191.03
No dataOPT
f=-25
TT=1712.82
T1=7.82
OPT
f=-25
TT=4.783
T1=3.81
?

TT=0.005

OPT
f=-25
TT=110.406
T1=28.22
OPT
f=-25
TT=89.489
T1=28.91
No dataNo dataNo dataNo dataNo dataOPT
f=-25
TT=909.91
T1=455.1
No dataNo dataNo dataOPT
f=-25
TT=860.245
T1=430.19
SAT (TO)
f=-24
TT=1800.64
T1=493.41
SAT (TO)
f=-23
TT=1801.02
T1=50.8
SAT (TO)
f=-25
TT=1800.77
T1=7.11
OPT
f=-25
TT=3.735
T1=3.38
OPT
f=-25
TT=3.149
T1=2.24
OPT
f=-25
TT=3.529
T1=2.86
? (TO)

TT=1800.1

? (TO)

TT=1800.03

No data?

TT=1799.58

?

TT=1799.55

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_100_25_1.opb
OPT
f=-15
TT=2.462
T1=0.09
OPT
f=-15
TT=31.645
T1=6
No dataOPT
f=-15
TT=3.372
T1=0.32
OPT
f=-15
TT=8.019
T1=3.16
OPT
f=-15
TT=7.957
T1=3.2
OPT
f=-15
TT=8.446
T1=3.31
OPT
f=-15
TT=8.342
T1=3.3
OPT
f=-15
TT=5.874
T1=0.74
OPT
f=-15
TT=5.844
T1=0.8
OPT
f=-15
TT=5.606
T1=0.74
OPT
f=-15
TT=5.495
T1=0.75
OPT
f=-15
TT=39.602
T1=4.1
OPT
f=-15
TT=7.247
T1=0.09
? (TO)

TT=1674.3

OPT
f=-15
TT=18.672
T1=18.67
?

TT=0.673

OPT
f=-15
TT=31.43
T1=0.27
OPT
f=-15
TT=248.125
T1=43.72
OPT
f=-15
TT=3.484
T1=2.34
No dataOPT
f=-15
TT=1.733
T1=0.97
OPT
f=-15
TT=46.347
T1=5.43
OPT
f=-15
TT=24.697
T1=1.49
No dataOPT
f=-15
TT=31.49
T1=2.84
OPT
f=-15
TT=2.718
T1=1.99
?

TT=0.006

OPT
f=-15
TT=10.667
T1=5.24
OPT
f=-15
TT=7.976
T1=2.47
No dataNo dataNo dataNo dataNo dataOPT
f=-15
TT=59.805
T1=29.98
No dataNo dataNo dataOPT
f=-15
TT=61.332
T1=30.76
OPT
f=-15
TT=52.224
T1=23.04
OPT
f=-15
TT=29.861
T1=8.09
OPT
f=-15
TT=26.35
T1=12.62
OPT
f=-15
TT=2.848
T1=2.74
OPT
f=-15
TT=2.55
T1=1.36
OPT
f=-15
TT=2.462
T1=1.1
OPT
f=-15
TT=149.236
T1=99.48
OPT
f=-15
TT=154.067
T1=102.71
No data?

TT=1799.61

?

TT=1799.83

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_10_4_1.opb
OPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.001
T1=0
No dataOPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.05
T1=0.04
OPT
f=-3
TT=0.058
T1=0.04
OPT
f=-3
TT=0.013
T1=0.01
OPT
f=-3
TT=0.022
T1=0.02
OPT
f=-3
TT=0.016
T1=0.02
OPT
f=-3
TT=0.02
T1=0.02
OPT
f=-3
TT=0.014
T1=0.01
OPT
f=-3
TT=0.022
T1=0.02
OPT
f=-3
TT=0.001
T1=0.06
OPT
f=-3
TT=0.002
T1=0
? (TO)

TT=1800.11

OPT
f=-3
TT=0.002
T1=0
?

TT=0.104

OPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.164
T1=0.14
OPT
f=-3
TT=0.011
T1=0.01
No dataOPT
f=-3
TT=0.004
T1=0
OPT
f=-3
TT=0.165
T1=1.13
OPT
f=-3
TT=0.015
T1=0.01
No dataOPT
f=-3
TT=0.184
T1=0.64
OPT
f=-3
TT=0.039
T1=0.03
?

TT=0.004

OPT
f=-3
TT=0.023
T1=0.01
OPT
f=-3
TT=0.025
T1=0.02
No dataNo dataNo dataNo dataNo dataOPT
f=-3
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.182
T1=0.64
OPT
f=-3
TT=0.163
T1=0.14
OPT
f=-3
TT=0.205
T1=0.16
OPT
f=-3
TT=0.021
T1=0.01
OPT
f=-3
TT=0.034
T1=0.02
OPT
f=-3
TT=0.013
T1=0.01
OPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.003
T1=0
No dataOPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.001
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_10_4_2.opb
OPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.002
T1=0
No dataOPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.062
T1=0.05
OPT
f=-3
TT=0.07
T1=0.06
OPT
f=-3
TT=0.018
T1=0.01
OPT
f=-3
TT=0.024
T1=0.02
OPT
f=-3
TT=0.017
T1=0.04
OPT
f=-3
TT=0.025
T1=0.02
OPT
f=-3
TT=0.015
T1=0.01
OPT
f=-3
TT=0.021
T1=0.02
OPT
f=-3
TT=0.003
T1=0
OPT
f=-3
TT=0.002
T1=0
? (TO)

TT=1800.06

OPT
f=-3
TT=0.002
T1=0
?

TT=0.102

OPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.163
T1=0.14
OPT
f=-3
TT=0.014
T1=0.01
No dataOPT
f=-3
TT=0.006
T1=0
OPT
f=-3
TT=0.163
T1=2.14
OPT
f=-3
TT=0.015
T1=0.01
No dataOPT
f=-3
TT=0.186
T1=1.16
OPT
f=-3
TT=0.042
T1=0.03
?

TT=0.009

OPT
f=-3
TT=0.023
T1=0.01
OPT
f=-3
TT=0.025
T1=0.02
No dataNo dataNo dataNo dataNo dataOPT
f=-3
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.193
T1=1.15
OPT
f=-3
TT=0.152
T1=0.13
OPT
f=-3
TT=0.174
T1=0.14
OPT
f=-3
TT=0.027
T1=0.02
OPT
f=-3
TT=0.034
T1=0.02
OPT
f=-3
TT=0.016
T1=0.01
OPT
f=-3
TT=0.003
T1=0
OPT
f=-3
TT=0.003
T1=0
No dataOPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.001
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_10_4_3.opb
OPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.001
T1=0
No dataOPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.039
T1=0.03
OPT
f=-3
TT=0.07
T1=0.05
OPT
f=-3
TT=0.02
T1=0.01
OPT
f=-3
TT=0.029
T1=0.02
OPT
f=-3
TT=0.012
T1=0.01
OPT
f=-3
TT=0.023
T1=0.02
OPT
f=-3
TT=0.016
T1=0.01
OPT
f=-3
TT=0.026
T1=0.02
OPT
f=-3
TT=0.002
T1=0
OPT
f=-3
TT=0.002
T1=0
? (TO)

TT=1800.12

OPT
f=-3
TT=0.002
T1=0
?

TT=0.115

OPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.184
T1=0.13
OPT
f=-3
TT=0.012
T1=0
No dataOPT
f=-3
TT=0.005
T1=0
OPT
f=-3
TT=0.164
T1=2.14
OPT
f=-3
TT=0.015
T1=0.01
No dataOPT
f=-3
TT=0.164
T1=1.13
OPT
f=-3
TT=0.047
T1=0.03
?

TT=0.006

OPT
f=-3
TT=0.023
T1=0.02
OPT
f=-3
TT=0.018
T1=0.02
No dataNo dataNo dataNo dataNo dataOPT
f=-3
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.174
T1=1.13
OPT
f=-3
TT=0.174
T1=0.13
OPT
f=-3
TT=0.185
T1=0.13
OPT
f=-3
TT=0.024
T1=0.01
OPT
f=-3
TT=0.026
T1=0.01
OPT
f=-3
TT=0.015
T1=0.01
OPT
f=-3
TT=0.003
T1=0
OPT
f=-3
TT=0.004
T1=0
No dataOPT
f=-3
TT=0.001
T1=0
OPT
f=-3
TT=0.001
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/mis/
normalized-mis_10_4_5.opb
OPT
f=-4
TT=0.001
T1=0
OPT
f=-4
TT=0.001
T1=0
No dataOPT
f=-4
TT=0.002
T1=0
OPT
f=-4
TT=0.039
T1=0.03
OPT
f=-4
TT=0.052
T1=0.05
OPT
f=-4
TT=0.014
T1=0.01
OPT
f=-4
TT=0.027
T1=0.02
OPT
f=-4
TT=0.015
T1=0.01
OPT
f=-4
TT=0.023
T1=0.02
OPT
f=-4
TT=0.011
T1=0.01
OPT
f=-4
TT=0.022
T1=0.02
OPT
f=-4
TT=0.004
T1=0.03
OPT
f=-4
TT=0.001
T1=0
? (TO)

TT=1744.62

OPT
f=-4
TT=0.001
T1=0
?

TT=0.104

OPT
f=-4
TT=0.001
T1=0
OPT
f=-4
TT=0.166
T1=0.16
OPT
f=-4
TT=0.015
T1=0.01
No dataOPT
f=-4
TT=0.005
T1=0
OPT
f=-4
TT=0.165
T1=3.14
OPT
f=-4
TT=0.013
T1=0.01
No dataOPT
f=-4
TT=0.163
T1=1.64
OPT
f=-4
TT=0.044
T1=0.03
?

TT=0.005

OPT
f=-4
TT=0.028
T1=0.02
OPT
f=-4
TT=0.031
T1=0.02
No dataNo dataNo dataNo dataNo dataOPT
f=-4
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=-4
TT=0.001
T1=0
OPT
f=-4
TT=0.172
T1=1.64
OPT
f=-4
TT=0.174
T1=0.12
OPT
f=-4
TT=0.174
T1=0.14
OPT
f=-4
TT=0.028
T1=0.02
OPT
f=-4
TT=0.034
T1=0.02
OPT
f=-4
TT=0.016
T1=0.01
OPT
f=-4
TT=0.002
T1=0
OPT
f=-4
TT=0.003
T1=0
No dataOPT
f=-4
TT=0.003
T1=0
OPT
f=-4
TT=0.001
T1=0
No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_200_10_1.opb
SAT
f=-52
TT=1797.52
T1=426.41
SAT
f=-48
TT=1798
T1=1009.42
No dataSAT (TO)
f=-50
TT=1800.03
T1=404.46
? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.1

SAT (TO)
f=-46
TT=1800.09
T1=455.12
SAT (TO)
f=-48
TT=1800.02
T1=43.95
? (TO)

TT=1800.29

SAT
f=-44
TT=1783.01
T1=1783.29
?

TT=0.553

SAT
f=-48
TT=1798
T1=1045.86
SAT (TO)
f=-46
TT=1800.71
T1=3.21
SAT (TO)
f=-52
TT=1800.28
T1=426.41
No data? (TO)

TT=1800.02

SAT (TO)
f=-48
TT=1800.59
T1=43.41
SAT
f=-41
TT=1789.74
T1=625.6
No dataSAT (TO)
f=-48
TT=1800.55
T1=937.24
SAT
f=-51
TT=1797.96
T1=400.88
?

TT=0.005

? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-48
TT=1800.38
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-48
TT=1800.53
T1=900.31
SAT (TO)
f=-46
TT=1800.03
T1=345.44
SAT (TO)
f=-43
TT=1800.02
T1=1044.28
SAT (TO)
f=-46
TT=1800.1
T1=27.9
SAT
f=-51
TT=1797.86
T1=258.54
SAT
f=-52
TT=1797.58
T1=1506.54
SAT
f=-52
TT=1797.52
T1=725.61
? (TO)

TT=1800.08

? (TO)

TT=1800.12

No data?

TT=1799.6

?

TT=1799.51

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_200_10_5.opb
SAT
f=-52
TT=1797.47
T1=62.38
SAT
f=-47
TT=1798
T1=32.27
No dataSAT (TO)
f=-51
TT=1800.02
T1=613.14
? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.09

SAT (TO)
f=-47
TT=1800.12
T1=1762.97
SAT (TO)
f=-50
TT=1800.02
T1=1466.5
? (TO)

TT=1800.11

SAT
f=-44
TT=1783.01
T1=1783.3
?

TT=0.574

SAT
f=-47
TT=1798
T1=1730.25
SAT (TO)
f=-46
TT=1800.01
T1=2.87
SAT (TO)
f=-52
TT=1800.31
T1=62.38
No data? (TO)

TT=1800.16

SAT (TO)
f=-48
TT=1800.78
T1=339.15
SAT
f=-45
TT=1789.74
T1=1278.31
No data? (TO)

TT=1801.41

SAT
f=-52
TT=1797.74
T1=294.3
?

TT=0.005

? (TO)

TT=1800.05

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-48
TT=1800.08
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-48
TT=1800.01
T1=900.31
SAT (TO)
f=-47
TT=1800.49
T1=756.28
SAT (TO)
f=-39
TT=1800.05
T1=10.39
SAT (TO)
f=-48
TT=1800.61
T1=1674.91
SAT
f=-52
TT=1797.47
T1=824.26
SAT
f=-52
TT=1797.47
T1=468.31
SAT
f=-52
TT=1797.47
T1=947.24
? (TO)

TT=1800.09

? (TO)

TT=1800.07

No data?

TT=1799.88

?

TT=1799.88

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_200_25_1.opb
SAT
f=-31
TT=1796.94
T1=428.22
SAT
f=-28
TT=1798
T1=1024.83
No dataSAT (TO)
f=-30
TT=1800.02
T1=1332.27
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.08

SAT (TO)
f=-28
TT=1800.08
T1=695.52
SAT (TO)
f=-29
TT=1800.02
T1=250.01
? (TO)

TT=1143.95

SAT
f=-26
TT=1783.01
T1=1783.28
?

TT=1.055

SAT
f=-28
TT=1798
T1=1266.03
SAT (TO)
f=-27
TT=1800.02
T1=245.72
SAT (TO)
f=-31
TT=1800.25
T1=1156.45
No data? (TO)

TT=1800.15

SAT (TO)
f=-29
TT=1800.57
T1=507.18
SAT
f=-28
TT=1789.74
T1=1218.2
No dataSAT (TO)
f=-28
TT=1800.02
T1=8.5
SAT
f=-31
TT=1797.08
T1=752.49
?

TT=0.004

? (TO)

TT=1800.11

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-30
TT=1800.37
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-30
TT=1800.07
T1=900.31
SAT (TO)
f=-26
TT=1800.06
T1=67.91
SAT (TO)
f=-24
TT=1800.79
T1=474.85
SAT (TO)
f=-27
TT=1800.09
T1=24.71
SAT
f=-31
TT=1797.08
T1=428.22
SAT
f=-31
TT=1796.99
T1=1135.77
SAT
f=-31
TT=1796.94
T1=543.08
? (TO)

TT=1800.04

? (TO)

TT=1800.04

No data?

TT=1799.84

?

TT=1799.56

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_200_25_3.opb
SAT
f=-29
TT=1797.7
T1=6.18
SAT
f=-27
TT=1798
T1=2.99
No dataSAT (TO)
f=-29
TT=1800.02
T1=24.24
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.12

SAT (TO)
f=-27
TT=1800.11
T1=86.72
SAT (TO)
f=-29
TT=1800.02
T1=312.78
? (TO)

TT=1800.06

SAT
f=-25
TT=1783.01
T1=1783.31
?

TT=1.054

SAT
f=-26
TT=1798
T1=0.04
SAT (TO)
f=-28
TT=1801.16
T1=55.43
SAT (TO)
f=-29
TT=1800.85
T1=341.25
No data? (TO)

TT=1800.21

SAT (TO)
f=-28
TT=1800.85
T1=252.06
SAT
f=-26
TT=1789.74
T1=220.51
No dataSAT (TO)
f=-28
TT=1800.14
T1=108.01
SAT
f=-29
TT=1797.79
T1=88.08
?

TT=0.005

? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-29
TT=1800.15
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-29
TT=1800.14
T1=900.31
SAT (TO)
f=-26
TT=1800.04
T1=22.17
SAT (TO)
f=-25
TT=1800.05
T1=295.43
SAT (TO)
f=-28
TT=1800.7
T1=6.52
SAT
f=-29
TT=1797.8
T1=6.18
SAT
f=-29
TT=1797.92
T1=348.38
SAT
f=-29
TT=1797.7
T1=89.29
? (TO)

TT=1800.06

? (TO)

TT=1800.06

No data?

TT=1799.54

?

TT=1799.97

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_200_25_5.opb
SAT
f=-31
TT=1797.22
T1=1533.44
SAT
f=-27
TT=1798
T1=163.75
No dataSAT (TO)
f=-30
TT=1800.03
T1=335.14
? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.1

SAT (TO)
f=-28
TT=1800.01
T1=156.02
SAT (TO)
f=-28
TT=1800.02
T1=33.91
? (TO)

TT=1800.26

SAT
f=-27
TT=1783.01
T1=1783.28
?

TT=1.054

SAT
f=-27
TT=1798
T1=147.82
SAT (TO)
f=-27
TT=1800.07
T1=90.39
SAT (TO)
f=-30
TT=1800.52
T1=296.37
No data? (TO)

TT=1800.03

SAT (TO)
f=-28
TT=1800.48
T1=53.99
SAT
f=-28
TT=1789.74
T1=1430.7
No dataSAT (TO)
f=-28
TT=1800.74
T1=14.62
SAT
f=-31
TT=1797.22
T1=1533.44
?

TT=0.004

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-28
TT=1800.07
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-28
TT=1800.04
T1=900.31
SAT (TO)
f=-27
TT=1800.1
T1=107.85
SAT (TO)
f=-24
TT=1800.03
T1=0.74
SAT (TO)
f=-27
TT=1800.56
T1=13.81
SAT
f=-30
TT=1797.6
T1=744.74
SAT
f=-30
TT=1797.55
T1=367.92
SAT
f=-30
TT=1797.35
T1=622.89
? (TO)

TT=1800.05

? (TO)

TT=1800.07

No data?

TT=1799.52

?

TT=1799.86

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_10_1.opb
SAT
f=-120
TT=1800.14
T1=708.44
SAT
f=-108
TT=1798
T1=1597.79
No dataSAT (TO)
f=-113
TT=1800.11
T1=1267.7
? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.09

SAT (TO)
f=-107
TT=1800.08
T1=1538.55
SAT (TO)
f=-111
TT=1800.05
T1=77.82
? (TO)

TT=1773.89

SAT
f=-84
TT=1783
T1=1783.3
?

TT=1.075

SAT
f=-108
TT=1798
T1=365.3
? (exit code)

TT=218.2

SAT (TO)
f=-120
TT=1800.14
T1=708.44
No data? (TO)

TT=1800.24

SAT (TO)
f=-111
TT=1800.52
T1=130.53
SAT
f=-86
TT=1789.74
T1=69.48
No dataSAT (TO)
f=-112
TT=1800.11
T1=521.94
SAT
f=-81
TT=1797.25
T1=0.24
?

TT=0.007

? (TO)

TT=1800.11

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-113
TT=1800.19
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-113
TT=1800.54
T1=900.41
SAT (TO)
f=-111
TT=1800.1
T1=517.41
SAT (TO)
f=-97
TT=1800.57
T1=0.81
SAT (TO)
f=-109
TT=1800.34
T1=171.6
SAT
f=-85
TT=1797.25
T1=332.28
SAT
f=-84
TT=1797.28
T1=0.28
SAT
f=-83
TT=1797.4
T1=10.9
? (TO)

TT=1800.05

? (TO)

TT=1800.1

No data?

TT=1799.52

?

TT=1799.83

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_10_2.opb
SAT
f=-116
TT=1800.22
T1=1506.96
SAT
f=-110
TT=1798
T1=780.88
No dataSAT (TO)
f=-112
TT=1800.1
T1=276.85
? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.02

SAT (TO)
f=-109
TT=1800.09
T1=0.05
SAT (TO)
f=-112
TT=1800.09
T1=5.23
? (TO)

TT=1604.56

SAT
f=-96
TT=1783
T1=1783.29
?

TT=1.073

SAT
f=-109
TT=1798
T1=0.03
? (exit code)

TT=222.082

SAT (TO)
f=-116
TT=1800.22
T1=1506.96
No data? (TO)

TT=1800.08

SAT (TO)
f=-111
TT=1800.44
T1=556.04
SAT
f=-88
TT=1789.75
T1=1382.92
No dataSAT (TO)
f=-110
TT=1800.66
T1=10.74
SAT
f=-86
TT=1797.17
T1=1614.6
?

TT=0.007

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-114
TT=1800.1
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-114
TT=1800.56
T1=900.41
SAT (TO)
f=-109
TT=1800.62
T1=78.95
SAT (TO)
f=-90
TT=1801.1
T1=300.95
SAT (TO)
f=-108
TT=1800.01
T1=501.84
SAT
f=-88
TT=1797.43
T1=600.76
SAT
f=-86
TT=1797.37
T1=0.46
SAT
f=-86
TT=1797.49
T1=0.36
? (TO)

TT=1800.14

? (TO)

TT=1800.13

No data?

TT=1799.92

?

TT=1799.51

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_10_3.opb
SAT
f=-115
TT=1800.13
T1=900.41
SAT
f=-107
TT=1798
T1=0.05
No dataSAT (TO)
f=-113
TT=1800.02
T1=208.82
? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.05

SAT (TO)
f=-108
TT=1800.09
T1=11.32
SAT (TO)
f=-111
TT=1800.09
T1=733.68
? (TO)

TT=1800.12

SAT
f=-91
TT=1783.01
T1=1783.29
?

TT=1.082

SAT
f=-108
TT=1798
T1=52.39
SAT
f=-107
TT=200.18
T1=143.25
SAT (TO)
f=-114
TT=1800.19
T1=843.04
No data? (TO)

TT=1800.03

SAT (TO)
f=-112
TT=1800.34
T1=950.02
SAT
f=-91
TT=1789.73
T1=461.38
No dataSAT (TO)
f=-112
TT=1800.92
T1=147.58
SAT
f=-80
TT=1797.11
T1=0.25
?

TT=0.005

? (TO)

TT=1800.13

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-115
TT=1800.54
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-115
TT=1800.13
T1=900.41
SAT (TO)
f=-110
TT=1800.6
T1=312.04
SAT (TO)
f=-98
TT=1800.04
T1=0.84
SAT (TO)
f=-108
TT=1800.05
T1=181.72
SAT
f=-83
TT=1797.19
T1=0.29
SAT
f=-83
TT=1797.25
T1=0.46
SAT
f=-83
TT=1797.36
T1=0.22
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No data?

TT=1799.86

?

TT=1799.52

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_25_3.opb
SAT
f=-68
TT=1800.42
T1=900.41
SAT
f=-63
TT=1798
T1=1030.16
No dataSAT (TO)
f=-67
TT=1800.1
T1=689.34
? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.05

SAT (TO)
f=-62
TT=1800.08
T1=128.56
SAT (TO)
f=-65
TT=1800.07
T1=240.01
? (TO)

TT=1800.1

SAT
f=-49
TT=1783.01
T1=1783.33
?

TT=2.535

SAT
f=-63
TT=1798.01
T1=854.5
SAT (TO)
f=-62
TT=1800.55
T1=11.62
SAT (TO)
f=-60
TT=1800.32
T1=1760.66
No data? (TO)

TT=1800.3

SAT (TO)
f=-65
TT=1800.02
T1=155.94
SAT
f=-55
TT=1789.76
T1=1688.28
No dataSAT (TO)
f=-65
TT=1800.15
T1=137.53
SAT
f=-47
TT=1797.71
T1=0.46
?

TT=0.005

? (TO)

TT=1800.14

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-68
TT=1800.42
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-68
TT=1800.48
T1=900.41
SAT (TO)
f=-62
TT=1800.08
T1=119.02
SAT (TO)
f=-54
TT=1800.04
T1=1.4
SAT (TO)
f=-63
TT=1800.78
T1=758.96
SAT
f=-48
TT=1797.72
T1=0.52
SAT
f=-52
TT=1797.56
T1=1294.09
SAT
f=-57
TT=1797.95
T1=1409.65
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No data?

TT=1799.61

?

TT=1799.62

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_25_5.opb
SAT
f=-69
TT=1800.08
T1=568.19
SAT
f=-64
TT=1798
T1=1767.2
No dataSAT (TO)
f=-66
TT=1800.09
T1=1002.39
? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.09

SAT (TO)
f=-62
TT=1800.04
T1=0.18
SAT (TO)
f=-69
TT=1800.08
T1=568.19
? (TO)

TT=1705.87

SAT
f=-46
TT=1783.01
T1=1783.32
?

TT=2.544

SAT
f=-63
TT=1798
T1=1421
SAT (TO)
f=-63
TT=1800.02
T1=1618.39
SAT (TO)
f=-47
TT=1800.17
T1=1.83
No data? (TO)

TT=1800.31

SAT (TO)
f=-64
TT=1800.15
T1=102.34
SAT
f=-53
TT=1789.76
T1=273.5
No dataSAT (TO)
f=-63
TT=1801.27
T1=4.71
SAT
f=-52
TT=1797.82
T1=1526.13
?

TT=0.005

? (TO)

TT=1800.04

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-67
TT=1800.05
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-67
TT=1800.07
T1=900.31
SAT (TO)
f=-63
TT=1800.18
T1=294.01
SAT (TO)
f=-51
TT=1800.35
T1=1.28
SAT (TO)
f=-63
TT=1800.04
T1=76.12
SAT
f=-59
TT=1797.45
T1=1586.36
SAT
f=-49
TT=1797.78
T1=0.74
SAT
f=-53
TT=1797.48
T1=480.48
? (TO)

TT=1800.06

? (TO)

TT=1800.11

No data?

TT=1799.91

?

TT=1799.54

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_60_1.opb
SAT
f=-37
TT=1800.06
T1=192.83
SAT
f=-35
TT=1798.01
T1=18.6
No dataSAT (TO)
f=-37
TT=1800.09
T1=722.68
? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.14

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.12

SAT (TO)
f=-34
TT=1800.02
T1=245.89
SAT (TO)
f=-37
TT=1800.06
T1=192.83
? (TO)

TT=1800.1

SAT
f=-29
TT=1783.01
T1=1783.38
?

TT=11.931

SAT
f=-34
TT=1798.01
T1=1291.97
SAT (TO)
f=-36
TT=1800.09
T1=794.21
SAT (TO)
f=-33
TT=1800.66
T1=878.68
No data? (TO)

TT=1800.24

SAT (TO)
f=-36
TT=1800.07
T1=159.77
SAT
f=-32
TT=1789.8
T1=933.26
No dataSAT (TO)
f=-36
TT=1800.1
T1=56.28
SAT
f=-36
TT=1797.4
T1=1405.77
?

TT=0.007

? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-37
TT=1800.11
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-37
TT=1800.59
T1=900.51
SAT (TO)
f=-35
TT=1800.12
T1=828.69
SAT (TO)
f=-28
TT=1800.52
T1=1.03
SAT (TO)
f=-35
TT=1800.35
T1=656.44
SAT
f=-35
TT=1797.5
T1=1214.33
SAT
f=-36
TT=1797.37
T1=832.82
SAT
f=-35
TT=1797.32
T1=1200.7
? (TO)

TT=1800.12

? (TO)

TT=1800.1

No data?

TT=1799.55

?

TT=1799.56

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_500_60_3.opb
SAT
f=-38
TT=1800.05
T1=113.73
SAT
f=-35
TT=1798
T1=1184.21
No dataSAT (TO)
f=-38
TT=1800.05
T1=118.58
? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.05

SAT (TO)
f=-34
TT=1800.04
T1=1.03
SAT (TO)
f=-38
TT=1800.05
T1=1595.66
? (TO)

TT=1557.91

SAT
f=-29
TT=1783.03
T1=1783.38
?

TT=23.041

SAT
f=-34
TT=1798.01
T1=0.45
SAT (TO)
f=-36
TT=1800.07
T1=852.11
SAT (TO)
f=-33
TT=1800.59
T1=1007.85
No data? (TO)

TT=1800.23

SAT (TO)
f=-38
TT=1800.21
T1=113.73
SAT
f=-32
TT=1789.77
T1=718.65
No dataSAT (TO)
f=-37
TT=1800.03
T1=642.51
SAT
f=-35
TT=1797.54
T1=848.04
?

TT=0.006

? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=-38
TT=1800.48
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-38
TT=1800.11
T1=900.41
SAT (TO)
f=-35
TT=1800.12
T1=464.47
SAT (TO)
f=-29
TT=1800.01
T1=5.28
SAT (TO)
f=-35
TT=1800.01
T1=1503.84
SAT
f=-36
TT=1797.36
T1=1371.35
SAT
f=-34
TT=1797.59
T1=661.53
SAT
f=-36
TT=1797.32
T1=1383.48
? (TO)

TT=1800.1

? (TO)

TT=1800.08

No data?

TT=1799.99

?

TT=1799.58

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_50_10_3.opb
OPT
f=-13
TT=0.03
T1=0
OPT
f=-13
TT=0.369
T1=0.19
No dataOPT
f=-13
TT=0.03
T1=0
OPT
f=-13
TT=0.321
T1=0.24
OPT
f=-13
TT=0.359
T1=0.26
OPT
f=-13
TT=0.287
T1=0.2
OPT
f=-13
TT=0.291
T1=0.21
OPT
f=-13
TT=0.198
T1=0.12
OPT
f=-13
TT=0.224
T1=0.13
OPT
f=-13
TT=0.201
T1=0.12
OPT
f=-13
TT=0.201
T1=0.12
OPT
f=-13
TT=0.202
T1=0.07
OPT
f=-13
TT=0.153
T1=0.15
? (TO)

TT=1800.11

OPT
f=-13
TT=0.083
T1=0.08
?

TT=0.215

OPT
f=-13
TT=0.321
T1=0.08
OPT
f=-13
TT=1.084
T1=0.64
OPT
f=-13
TT=0.57
T1=0.56
No dataOPT
f=-13
TT=0.149
T1=0.15
OPT
f=-13
TT=2.035
T1=5.23
OPT
f=-13
TT=0.617
T1=0.54
No dataOPT
f=-13
TT=1.745
T1=2.71
OPT
f=-13
TT=0.485
T1=0.44
?

TT=0.005

OPT
f=-13
TT=0.247
T1=0.15
OPT
f=-13
TT=0.181
T1=0.09
No dataNo dataNo dataNo dataNo dataOPT
f=-13
TT=0.203
T1=0.1
No dataNo dataNo dataOPT
f=-13
TT=0.225
T1=0.11
OPT
f=-13
TT=1.863
T1=2.7
OPT
f=-13
TT=0.784
T1=0.4
OPT
f=-13
TT=0.787
T1=0.3
OPT
f=-13
TT=0.46
T1=0.43
OPT
f=-13
TT=0.376
T1=0.36
OPT
f=-13
TT=0.431
T1=0.42
OPT
f=-13
TT=0.468
T1=0.23
OPT
f=-13
TT=0.464
T1=0.23
No data?

TT=1799.87

?

TT=1799.54

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_50_25_1.opb
OPT
f=-6
TT=0.005
T1=0
OPT
f=-6
TT=0.039
T1=0.02
No dataOPT
f=-6
TT=0.005
T1=0
OPT
f=-6
TT=0.124
T1=0.08
OPT
f=-6
TT=0.141
T1=0.09
OPT
f=-6
TT=0.095
T1=0.05
OPT
f=-6
TT=0.101
T1=0.06
OPT
f=-6
TT=0.065
T1=0.04
OPT
f=-6
TT=0.07
T1=0.05
OPT
f=-6
TT=0.068
T1=0.04
OPT
f=-6
TT=0.081
T1=0.05
OPT
f=-6
TT=0.027
T1=0.02
OPT
f=-6
TT=0.041
T1=0.02
? (TO)

TT=1493.88

OPT
f=-6
TT=0.036
T1=0.03
?

TT=0.344

OPT
f=-6
TT=0.03
T1=0.01
OPT
f=-6
TT=0.855
T1=0.34
OPT
f=-6
TT=0.815
T1=0.81
No dataOPT
f=-6
TT=0.096
T1=0.09
OPT
f=-6
TT=1.495
T1=3.31
OPT
f=-6
TT=0.748
T1=0.74
No dataOPT
f=-6
TT=0.975
T1=1.77
OPT
f=-6
TT=0.385
T1=0.08
?

TT=0.005

OPT
f=-6
TT=0.102
T1=0.05
OPT
f=-6
TT=0.065
T1=0.04
No dataNo dataNo dataNo dataNo dataOPT
f=-6
TT=0.047
T1=0.02
No dataNo dataNo dataOPT
f=-6
TT=0.048
T1=0.02
OPT
f=-6
TT=1.034
T1=2.28
OPT
f=-6
TT=0.604
T1=0.27
OPT
f=-6
TT=0.595
T1=0.27
OPT
f=-6
TT=0.183
T1=0.11
OPT
f=-6
TT=0.186
T1=0.11
OPT
f=-6
TT=0.558
T1=0.55
OPT
f=-6
TT=0.067
T1=0.02
OPT
f=-6
TT=0.068
T1=0.02
No data?

TT=1799.71

?

TT=1799.93

No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/manquinho/
mis/normalized-mis_50_25_3.opb
OPT
f=-6
TT=0.006
T1=0
OPT
f=-6
TT=0.04
T1=0.01
No dataOPT
f=-6
TT=0.006
T1=0
OPT
f=-6
TT=0.151
T1=0.09
OPT
f=-6
TT=0.157
T1=0.11
OPT
f=-6
TT=0.097
T1=0.06
OPT
f=-6
TT=0.102
T1=0.06
OPT
f=-6
TT=0.087
T1=0.06
OPT
f=-6
TT=0.094
T1=0.07
OPT
f=-6
TT=0.084
T1=0.06
OPT
f=-6
TT=0.101
T1=0.07
OPT
f=-6
TT=0.028
T1=0.02
OPT
f=-6
TT=0.043
T1=0.02
? (TO)

TT=1800.08

OPT
f=-6
TT=0.035
T1=0.03
?

TT=0.343

OPT
f=-6
TT=0.034
T1=0
OPT
f=-6
TT=0.856
T1=0.39
OPT
f=-6
TT=0.712
T1=0.7
No dataOPT
f=-6
TT=0.071
T1=0.06
OPT
f=-6
TT=1.564
T1=3.27
OPT
f=-6
TT=0.482
T1=0.47
No dataOPT
f=-6
TT=1.174
T1=1.78
OPT
f=-6
TT=0.579
T1=0.57
?

TT=0.004

OPT
f=-6
TT=0.097
T1=0.05
OPT
f=-6
TT=0.078
T1=0.04
No dataNo dataNo dataNo dataNo dataOPT
f=-6
TT=0.046
T1=0.02
No dataNo dataNo dataOPT
f=-6
TT=0.047
T1=0.02
OPT
f=-6
TT=1.093
T1=1.77
OPT
f=-6
TT=0.584
T1=0.27
OPT
f=-6
TT=0.584
T1=0.24
OPT
f=-6
TT=0.384
T1=0.26
OPT
f=-6
TT=0.39
T1=0.25
OPT
f=-6
TT=0.476
T1=0.47
OPT
f=-6
TT=0.073
T1=0.02
OPT
f=-6
TT=0.074
T1=0.02
No data?

TT=1799.89

?

TT=1799.86

No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/
factor-mod-B/
factor-mod-size=5-P0=11-P1=13-P2=29-P3=23-P4=5-P5=29-P6=29-P7=31-P8=29-P9=31-B.opb
OPT
f=3
TT=0.037
T1=0.02
OPT
f=3
TT=1.925
T1=0.68
No dataOPT
f=3
TT=0.171
T1=0.02
OPT
f=3
TT=69.594
T1=11.69
OPT
f=3
TT=0.501
T1=0.25
OPT
f=3
TT=71.237
T1=11.57
OPT
f=3
TT=0.425
T1=0.19
OPT
f=3
TT=70.609
T1=11.63
OPT
f=3
TT=0.492
T1=0.26
OPT
f=3
TT=67.772
T1=11.2
? (TO)

TT=1800.06

OPT
f=3
TT=0.895
T1=0.35
OPT
f=3
TT=0.037
T1=0.03
OPT
f=3
TT=7.827
T1=5.73
OPT
f=3
TT=1.942
T1=0.5
OPT
f=3
TT=1.175
T1=0.39
OPT
f=3
TT=1.01
T1=0.92
OPT
f=3
TT=1.344
T1=0.65
OPT
f=3
TT=1.378
T1=1.37
No data? (TO)

TT=1800.24

OPT
f=3
TT=4.463
T1=1.18
OPT
f=3
TT=0.819
T1=0.81
No dataOPT
f=3
TT=3.803
T1=1.17
OPT
f=3
TT=0.079
T1=0.06
?

TT=0.004

OPT
f=3
TT=2.446
T1=1.53
OPT
f=3
TT=2.144
T1=1.52
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.504
T1=0.24
No dataNo dataNo dataOPT
f=3
TT=0.664
T1=0.32
OPT
f=3
TT=4.663
T1=0.68
OPT
f=3
TT=1.054
T1=0.33
SAT
f=3
TT=1.224
T1=0.37
OPT
f=3
TT=0.062
T1=0.05
OPT
f=3
TT=0.111
T1=0.1
OPT
f=3
TT=0.091
T1=0.08
OPT
f=3
TT=6.212
T1=0.38
OPT
f=3
TT=16.838
T1=0.39
No dataOPT
f=3
TT=0.454
T1=0.45
OPT
f=3
TT=0.454
T1=0.45
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=5-P0=11-P1=2-P2=23-B.opb
OPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.012
T1=0.01
No dataOPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=1.407
T1=1.35
OPT
f=2
TT=0.06
T1=0.05
OPT
f=2
TT=1.412
T1=1.41
OPT
f=2
TT=0.04
T1=0.03
OPT
f=2
TT=1.462
T1=1.45
OPT
f=2
TT=0.036
T1=0.03
? (TO)

TT=1800.2

? (TO)

TT=1800.1

OPT
f=2
TT=0.005
T1=0
OPT
f=2
TT=0.008
T1=0
OPT
f=2
TT=0.063
T1=0.05
OPT
f=2
TT=0.005
T1=0
OPT
f=2
TT=0.136
T1=0.13
OPT
f=2
TT=0.01
T1=0
OPT
f=2
TT=0.175
T1=0.14
OPT
f=2
TT=0.056
T1=0.05
No dataOPT
f=2
TT=0.036
T1=0.05
OPT
f=2
TT=0.214
T1=1.14
OPT
f=2
TT=0.225
T1=0.22
No dataOPT
f=2
TT=0.194
T1=0.63
OPT
f=2
TT=0.051
T1=0.03
?

TT=0.005

OPT
f=2
TT=0.396
T1=0.36
OPT
f=2
TT=0.364
T1=0.33
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.001
T1=0
OPT
f=2
TT=0.185
T1=0.64
OPT
f=2
TT=0.162
T1=0.13
SAT
f=2
TT=0.314
T1=0.2
OPT
f=2
TT=0.05
T1=0.04
OPT
f=2
TT=0.054
T1=0.04
OPT
f=2
TT=0.042
T1=0.03
OPT
f=2
TT=0.01
T1=0.01
OPT
f=2
TT=0.011
T1=0.01
No dataOPT
f=2
TT=0.003
T1=0
OPT
f=2
TT=0.002
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=5-P0=13-P1=5-P2=17-P3=2-P4=29-P5=5-P6=19-P7=17-P8=5-B.opb
OPT
f=2
TT=0.033
T1=0.03
OPT
f=2
TT=0.639
T1=0.63
No dataOPT
f=2
TT=0.05
T1=0.05
OPT
f=2
TT=26.786
T1=26.65
OPT
f=2
TT=0.212
T1=0.2
OPT
f=2
TT=16.77
T1=16.77
OPT
f=2
TT=0.187
T1=0.19
OPT
f=2
TT=63.436
T1=63.43
OPT
f=2
TT=0.309
T1=0.31
? (TO)

TT=1800.07

? (TO)

TT=1800.07

OPT
f=2
TT=0.646
T1=0.64
OPT
f=2
TT=0.033
T1=0.03
OPT
f=2
TT=1.904
T1=1.89
OPT
f=2
TT=1.248
T1=1.24
OPT
f=2
TT=0.895
T1=0.58
OPT
f=2
TT=0.818
T1=0.81
OPT
f=2
TT=1.024
T1=0.59
OPT
f=2
TT=2.321
T1=2.31
No dataOPT
f=2
TT=865.807
T1=299.04
OPT
f=2
TT=3.254
T1=2.18
OPT
f=2
TT=1.405
T1=1.4
No dataOPT
f=2
TT=3.013
T1=1.16
OPT
f=2
TT=0.072
T1=0.05
?

TT=0.005

OPT
f=2
TT=1.397
T1=1.36
OPT
f=2
TT=1.552
T1=1.51
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.264
T1=0.13
No dataNo dataNo dataOPT
f=2
TT=0.144
T1=0.06
OPT
f=2
TT=1.553
T1=1.17
OPT
f=2
TT=0.785
T1=0.49
SAT
f=2
TT=1.034
T1=0.6
OPT
f=2
TT=2.816
T1=2.8
OPT
f=2
TT=2.306
T1=2.3
OPT
f=2
TT=7.102
T1=7.09
OPT
f=2
TT=2.668
T1=2.66
OPT
f=2
TT=6.287
T1=6.28
No dataOPT
f=2
TT=0.202
T1=0.19
OPT
f=2
TT=0.202
T1=0.19
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=5-P0=17-P1=13-P2=11-P3=19-P4=11-P5=23-B.opb
OPT
f=3
TT=0.021
T1=0.01
OPT
f=3
TT=0.514
T1=0.49
No dataOPT
f=3
TT=0.091
T1=0.01
OPT
f=3
TT=37.625
T1=11.63
OPT
f=3
TT=0.274
T1=0.27
OPT
f=3
TT=36.389
T1=11.73
OPT
f=3
TT=0.242
T1=0.24
OPT
f=3
TT=36.013
T1=13.01
OPT
f=3
TT=0.249
T1=0.15
? (TO)

TT=1800.34

OPT
f=3
TT=0.38
T1=0.28
OPT
f=3
TT=0.206
T1=0.17
OPT
f=3
TT=0.021
T1=0.02
OPT
f=3
TT=0.539
T1=0.28
OPT
f=3
TT=0.794
T1=0.05
OPT
f=3
TT=0.842
T1=0.3
OPT
f=3
TT=0.327
T1=0.3
OPT
f=3
TT=0.816
T1=0.27
OPT
f=3
TT=0.489
T1=0.48
No data? (TO)

TT=1800.2

OPT
f=3
TT=3.092
T1=2.19
OPT
f=3
TT=0.049
T1=0.04
No dataOPT
f=3
TT=2.174
T1=0.66
OPT
f=3
TT=0.062
T1=0.05
?

TT=0.006

OPT
f=3
TT=1.369
T1=0.68
OPT
f=3
TT=1.796
T1=1.14
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.143
T1=0.06
No dataNo dataNo dataOPT
f=3
TT=0.183
T1=0.09
OPT
f=3
TT=3.274
T1=2.25
OPT
f=3
TT=0.806
T1=0.32
SAT
f=3
TT=0.883
T1=0.39
OPT
f=3
TT=0.065
T1=0.05
OPT
f=3
TT=0.069
T1=0.05
OPT
f=3
TT=0.056
T1=0.04
OPT
f=3
TT=5.008
T1=0.41
OPT
f=3
TT=5.629
T1=0.4
No dataOPT
f=3
TT=0.163
T1=0.16
OPT
f=3
TT=0.163
T1=0.16
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=5-P0=29-P1=11-P2=11-P3=17-P4=29-P5=23-B.opb
OPT
f=3
TT=0.021
T1=0.01
OPT
f=3
TT=0.584
T1=0.34
No dataOPT
f=3
TT=0.063
T1=0.01
OPT
f=3
TT=42.257
T1=16.69
OPT
f=3
TT=0.352
T1=0.35
OPT
f=3
TT=35.152
T1=8.62
OPT
f=3
TT=0.192
T1=0.19
OPT
f=3
TT=31.383
T1=16.02
OPT
f=3
TT=0.214
T1=0.2
? (TO)

TT=1800.07

? (TO)

TT=1800.04

OPT
f=3
TT=0.3
T1=0.07
OPT
f=3
TT=0.021
T1=0.02
OPT
f=3
TT=0.765
T1=0.37
OPT
f=3
TT=0.168
T1=0.08
OPT
f=3
TT=0.764
T1=0.24
OPT
f=3
TT=0.193
T1=0.15
OPT
f=3
TT=0.863
T1=0.26
OPT
f=3
TT=0.49
T1=0.48
No data? (TO)

TT=1800.25

OPT
f=3
TT=1.894
T1=1.16
OPT
f=3
TT=0.06
T1=0.05
No dataOPT
f=3
TT=2.013
T1=0.65
OPT
f=3
TT=0.073
T1=0.06
?

TT=0.007

OPT
f=3
TT=1.492
T1=1.05
OPT
f=3
TT=1.706
T1=1.32
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.222
T1=0.1
No dataNo dataNo dataOPT
f=3
TT=0.183
T1=0.09
OPT
f=3
TT=3.672
T1=0.65
OPT
f=3
TT=0.864
T1=0.2
SAT
f=3
TT=0.994
T1=0.29
OPT
f=3
TT=0.065
T1=0.05
OPT
f=3
TT=0.071
T1=0.05
OPT
f=3
TT=0.056
T1=0.04
OPT
f=3
TT=6.279
T1=0.07
OPT
f=3
TT=4.756
T1=0.06
No dataOPT
f=3
TT=0.192
T1=0.18
OPT
f=3
TT=0.183
T1=0.18
No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=5-P0=2-P1=23-P2=29-P3=19-B.opb
OPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.069
T1=0.06
No dataOPT
f=2
TT=0.018
T1=0.01
OPT
f=2
TT=3.953
T1=3.95
OPT
f=2
TT=0.104
T1=0.09
OPT
f=2
TT=3.767
T1=3.76
OPT
f=2
TT=0.083
T1=0.08
OPT
f=2
TT=2.799
T1=2.79
OPT
f=2
TT=0.08
T1=0.08
? (TO)

TT=1800.06

? (TO)

TT=-1

OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.012
T1=0.01
OPT
f=2
TT=0.167
T1=0.15
OPT
f=2
TT=0.194
T1=0.19
OPT
f=2
TT=0.196
T1=0.16
OPT
f=2
TT=0.019
T1=0.01
OPT
f=2
TT=0.174
T1=0.14
OPT
f=2
TT=0.404
T1=0.4
No dataOPT
f=2
TT=0.018
T1=0.01
OPT
f=2
TT=0.265
T1=1.15
OPT
f=2
TT=0.659
T1=0.65
No dataOPT
f=2
TT=0.244
T1=0.64
OPT
f=2
TT=0.047
T1=0.03
?

TT=0.004

OPT
f=2
TT=0.421
T1=0.42
OPT
f=2
TT=0.507
T1=0.7
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.233
T1=0.64
OPT
f=2
TT=0.167
T1=0.15
SAT
f=2
TT=0.484
T1=0.25
OPT
f=2
TT=0.039
T1=0.03
OPT
f=2
TT=0.101
T1=0.09
OPT
f=2
TT=0.039
T1=0.03
OPT
f=2
TT=0.043
T1=0.04
OPT
f=2
TT=0.043
T1=0.04
No dataOPT
f=2
TT=0.002
T1=0
OPT
f=2
TT=0.003
T1=0
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/
factor-mod-B/
factor-mod-size=6-P0=11-P1=37-P2=59-P3=23-P4=53-P5=31-P6=59-P7=29-P8=2-P9=67-B.opb
OPT
f=2
TT=0.056
T1=0.05
OPT
f=2
TT=29.201
T1=29.2
No dataOPT
f=2
TT=0.514
T1=0.51
? (TO)

TT=1800.07

OPT
f=2
TT=1.373
T1=1.5
? (TO)

TT=1800.13

OPT
f=2
TT=0.534
T1=0.66
? (TO)

TT=1800.09

OPT
f=2
TT=0.959
T1=0.95
? (TO)

TT=1800.03

? (TO)

TT=1800.17

OPT
f=2
TT=1.967
T1=1.96
OPT
f=2
TT=0.056
T1=0.05
OPT
f=2
TT=45.747
T1=45.75
OPT
f=2
TT=18.025
T1=18.03
OPT
f=2
TT=2.774
T1=2.32
OPT
f=2
TT=8.385
T1=8.37
OPT
f=2
TT=3.704
T1=3.15
OPT
f=2
TT=5.941
T1=5.94
No data? (TO)

TT=1800.13

OPT
f=2
TT=5.994
T1=3.2
OPT
f=2
TT=6.004
T1=5.99
No dataOPT
f=2
TT=6.302
T1=2.69
OPT
f=2
TT=24.873
T1=24.87
?

TT=0.004

OPT
f=2
TT=30.485
T1=15.12
OPT
f=2
TT=17.205
T1=17.16
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=1.324
T1=0.65
No dataNo dataNo dataOPT
f=2
TT=1.284
T1=0.63
OPT
f=2
TT=5.393
T1=1.72
OPT
f=2
TT=2.624
T1=1.45
SAT
f=2
TT=3.114
T1=2.61
OPT
f=2
TT=9.793
T1=9.78
OPT
f=2
TT=5.026
T1=5.01
OPT
f=2
TT=37.024
T1=37.02
OPT
f=2
TT=43.558
T1=43.57
OPT
f=2
TT=18.653
T1=18.65
No dataOPT
f=2
TT=1.735
T1=1.73
OPT
f=2
TT=1.735
T1=1.72
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=6-P0=29-P1=2-P2=59-P3=2-P4=47-P5=53-P6=37-P7=53-P8=53-B.opb
OPT
f=2
TT=0.049
T1=0.04
OPT
f=2
TT=11.47
T1=11.47
No dataOPT
f=2
TT=0.273
T1=0.27
OPT
f=2
TT=266.148
T1=266.2
OPT
f=2
TT=0.536
T1=0.53
OPT
f=2
TT=308.833
T1=308.97
OPT
f=2
TT=0.467
T1=0.46
OPT
f=2
TT=324.753
T1=324.77
OPT
f=2
TT=0.37
T1=0.37
OPT
f=2
TT=262.19
T1=262.5
? (TO)

TT=1800.08

OPT
f=2
TT=2.822
T1=2.82
OPT
f=2
TT=0.049
T1=0.04
OPT
f=2
TT=31.849
T1=31.86
OPT
f=2
TT=3.202
T1=3.2
OPT
f=2
TT=2.173
T1=1.81
OPT
f=2
TT=0.854
T1=0.85
OPT
f=2
TT=2.164
T1=1.68
OPT
f=2
TT=3.683
T1=3.67
No dataOPT
f=2
TT=0.044
T1=0.04
OPT
f=2
TT=5.851
T1=4.19
OPT
f=2
TT=12.097
T1=12.09
No dataOPT
f=2
TT=3.233
T1=1.17
OPT
f=2
TT=72.408
T1=72.4
?

TT=0.007

OPT
f=2
TT=5.481
T1=5.8
OPT
f=2
TT=8.462
T1=8.92
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.104
T1=0.04
No dataNo dataNo dataOPT
f=2
TT=0.523
T1=0.26
OPT
f=2
TT=2.024
T1=1.19
OPT
f=2
TT=0.576
T1=0.28
SAT
f=2
TT=1.163
T1=0.74
OPT
f=2
TT=26.71
T1=26.7
OPT
f=2
TT=1.439
T1=1.43
OPT
f=2
TT=30.741
T1=30.72
OPT
f=2
TT=3.044
T1=3.04
OPT
f=2
TT=3.04
T1=3.04
No dataOPT
f=2
TT=0.054
T1=0.04
OPT
f=2
TT=0.055
T1=0.04
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=6-P0=41-P1=53-P2=59-B.opb
OPT
f=3
TT=0.013
T1=0.01
OPT
f=3
TT=0.25
T1=0.2
No dataOPT
f=3
TT=0.037
T1=0.03
OPT
f=3
TT=35.458
T1=35.79
OPT
f=3
TT=0.177
T1=0.13
OPT
f=3
TT=42.961
T1=43.07
OPT
f=3
TT=0.137
T1=0.11
OPT
f=3
TT=50.682
T1=48.83
OPT
f=3
TT=0.117
T1=0.1
? (TO)

TT=1800.05

? (TO)

TT=1800.16

OPT
f=3
TT=0.093
T1=0.07
OPT
f=3
TT=0.013
T1=0.01
OPT
f=3
TT=0.15
T1=0.12
OPT
f=3
TT=0.053
T1=0.01
OPT
f=3
TT=0.534
T1=0.28
OPT
f=3
TT=0.126
T1=0.12
OPT
f=3
TT=0.624
T1=0.28
OPT
f=3
TT=0.315
T1=0.31
No dataOPT
f=3
TT=0.285
T1=0.15
OPT
f=3
TT=1.924
T1=4.15
OPT
f=3
TT=0.114
T1=0.11
No dataOPT
f=3
TT=6.572
T1=1.14
OPT
f=3
TT=0.073
T1=0.05
?

TT=0.006

OPT
f=3
TT=10.635
T1=10.63
OPT
f=3
TT=19.75
T1=15.3
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.062
T1=0.03
No dataNo dataNo dataOPT
f=3
TT=0.082
T1=0.03
OPT
f=3
TT=1.135
T1=0.64
OPT
f=3
TT=0.486
T1=0.22
SAT
f=3
TT=0.584
T1=0.26
OPT
f=3
TT=0.034
T1=0.03
OPT
f=3
TT=0.055
T1=0.04
OPT
f=3
TT=0.04
T1=0.03
OPT
f=3
TT=0.392
T1=0.18
OPT
f=3
TT=0.399
T1=0.18
No dataOPT
f=3
TT=0.042
T1=0.03
OPT
f=3
TT=0.043
T1=0.03
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=6-P0=53-P1=17-P2=17-P3=13-P4=17-P5=61-B.opb
OPT
f=3
TT=0.032
T1=0.03
OPT
f=3
TT=2.862
T1=1.93
No dataOPT
f=3
TT=0.851
T1=0.07
? (TO)

TT=1800.11

OPT
f=3
TT=1.202
T1=0.55
OPT
f=3
TT=1786.39
T1=1786.7
OPT
f=3
TT=1.048
T1=0.39
? (TO)

TT=1800.1

OPT
f=3
TT=0.858
T1=0.3
? (TO)

TT=1800.06

? (TO)

TT=1800.09

OPT
f=3
TT=3.85
T1=1
OPT
f=3
TT=0.032
T1=0.03
OPT
f=3
TT=4.055
T1=1.44
OPT
f=3
TT=0.603
T1=0.54
OPT
f=3
TT=1.663
T1=0.24
Wrong UNSAT

TT=0.279

OPT
f=3
TT=2.105
T1=0.27
OPT
f=3
TT=1.098
T1=1.09
No data? (TO)

TT=1800.23

OPT
f=3
TT=6.313
T1=1.17
OPT
f=3
TT=0.227
T1=0.22
No dataOPT
f=3
TT=5.065
T1=0.67
OPT
f=3
TT=0.099
T1=0.08
?

TT=0.005

OPT
f=3
TT=17.883
T1=7.33
OPT
f=3
TT=21.728
T1=11.34
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.723
T1=0.35
No dataNo dataNo dataOPT
f=3
TT=1.063
T1=0.52
OPT
f=3
TT=4.804
T1=0.66
OPT
f=3
TT=1.313
T1=0.26
SAT
f=3
TT=2.045
T1=0.37
OPT
f=3
TT=0.073
T1=0.06
OPT
f=3
TT=0.082
T1=0.07
OPT
f=3
TT=0.048
T1=0.04
OPT
f=3
TT=92.807
T1=0.21
OPT
f=3
TT=39.139
T1=0.21
No dataOPT
f=3
TT=0.934
T1=0.93
OPT
f=3
TT=0.933
T1=1.06
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=6-P0=53-P1=41-P2=53-B.opb
OPT
f=3
TT=0.014
T1=0.01
OPT
f=3
TT=0.298
T1=0.29
No dataOPT
f=3
TT=0.027
T1=0.02
OPT
f=3
TT=45.947
T1=45.96
OPT
f=3
TT=0.15
T1=0.11
OPT
f=3
TT=48.726
T1=48.77
OPT
f=3
TT=0.12
T1=0.1
OPT
f=3
TT=34.086
T1=31.23
OPT
f=3
TT=0.103
T1=0.1
? (TO)

TT=1800.62

? (TO)

TT=1800.07

OPT
f=3
TT=0.399
T1=0.4
OPT
f=3
TT=0.014
T1=0.01
OPT
f=3
TT=0.145
T1=0.1
OPT
f=3
TT=0.046
T1=0.03
OPT
f=3
TT=0.514
T1=0.25
OPT
f=3
TT=0.128
T1=0.12
OPT
f=3
TT=0.658
T1=0.3
OPT
f=3
TT=0.271
T1=0.26
No dataOPT
f=3
TT=0.217
T1=0.11
OPT
f=3
TT=1.396
T1=1.14
OPT
f=3
TT=0.088
T1=0.08
No dataOPT
f=3
TT=0.993
T1=0.64
OPT
f=3
TT=0.075
T1=0.06
?

TT=0.005

OPT
f=3
TT=11.636
T1=6.66
OPT
f=3
TT=8.156
T1=4.05
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.082
T1=0.03
No dataNo dataNo dataOPT
f=3
TT=0.082
T1=0.03
OPT
f=3
TT=1.283
T1=1.65
OPT
f=3
TT=0.485
T1=0.19
SAT
f=3
TT=0.555
T1=0.22
OPT
f=3
TT=0.064
T1=0.05
OPT
f=3
TT=0.063
T1=0.06
OPT
f=3
TT=0.141
T1=0.13
OPT
f=3
TT=0.374
T1=0.09
OPT
f=3
TT=0.375
T1=0.09
No dataOPT
f=3
TT=0.043
T1=0.03
OPT
f=3
TT=0.043
T1=0.03
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=6-P0=7-P1=29-P2=53-P3=31-P4=23-P5=47-P6=67-B.opb
OPT
f=3
TT=0.041
T1=0.04
OPT
f=3
TT=5.602
T1=2.34
No dataOPT
f=3
TT=0.885
T1=0.13
? (TO)

TT=1800.08

OPT
f=3
TT=1.074
T1=0.21
? (TO)

TT=1800

OPT
f=3
TT=1.026
T1=0.19
? (TO)

TT=1800.11

OPT
f=3
TT=0.921
T1=0.21
? (TO)

TT=1800.02

? (TO)

TT=1777.94

OPT
f=3
TT=2.334
T1=1.8
OPT
f=3
TT=0.041
T1=0.04
OPT
f=3
TT=7.163
T1=3.04
OPT
f=3
TT=3.18
T1=0.37
OPT
f=3
TT=2.042
T1=0.57
OPT
f=3
TT=2.385
T1=0.9
OPT
f=3
TT=3.351
T1=0.33
OPT
f=3
TT=1.695
T1=1.69
No data? (TO)

TT=1800.12

OPT
f=3
TT=5.715
T1=2.18
OPT
f=3
TT=0.195
T1=0.18
No dataOPT
f=3
TT=4.763
T1=2.17
OPT
f=3
TT=0.119
T1=0.1
?

TT=0.005

OPT
f=3
TT=20.882
T1=20.87
OPT
f=3
TT=51.026
T1=35.18
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.784
T1=0.38
No dataNo dataNo dataOPT
f=3
TT=1.343
T1=0.67
OPT
f=3
TT=6.573
T1=1.67
OPT
f=3
TT=3.154
T1=0.46
SAT
f=3
TT=2.424
T1=0.47
OPT
f=3
TT=0.054
T1=0.05
OPT
f=3
TT=0.101
T1=0.08
OPT
f=3
TT=0.08
T1=0.07
OPT
f=3
TT=105.736
T1=2.46
OPT
f=3
TT=70.885
T1=2.46
No dataOPT
f=3
TT=0.954
T1=0.94
OPT
f=3
TT=0.953
T1=0.94
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=7-P0=107-P1=13-P2=17-P3=127-P4=13-P5=53-P6=73-P7=59-B.opb
OPT
f=3
TT=0.063
T1=0.06
OPT
f=3
TT=55.639
T1=11.04
No dataOPT
f=3
TT=7.804
T1=0.28
? (TO)

TT=1800.07

OPT
f=3
TT=9.601
T1=9.6
? (TO)

TT=1800.05

OPT
f=3
TT=6.77
T1=6.77
? (TO)

TT=1800.03

OPT
f=3
TT=8.082
T1=1.75
? (TO)

TT=1800.1

? (TO)

TT=1800.29

OPT
f=3
TT=21.003
T1=9.91
OPT
f=3
TT=0.063
T1=0.06
OPT
f=3
TT=498.435
T1=286.47
OPT
f=3
TT=10.827
T1=4.69
OPT
f=3
TT=14.552
T1=6.59
OPT
f=3
TT=20.362
T1=19.91
OPT
f=3
TT=15.552
T1=5.16
OPT
f=3
TT=3.218
T1=3.21
No data? (TO)

TT=1800.1

OPT
f=3
TT=22.832
T1=14.2
OPT
f=3
TT=0.296
T1=0.28
No dataOPT
f=3
TT=16.261
T1=6.69
OPT
f=3
TT=0.169
T1=0.15
?

TT=0.006

OPT
f=3
TT=1279.91
T1=661.5
OPT
f=3
TT=1330.4
T1=678.2
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=8.934
T1=4.46
No dataNo dataNo dataOPT
f=3
TT=9.803
T1=4.91
OPT
f=3
TT=19.609
T1=2.7
OPT
f=3
TT=10.902
T1=1.32
SAT
f=3
TT=10.312
T1=0.78
OPT
f=3
TT=0.075
T1=0.06
OPT
f=3
TT=0.134
T1=0.12
OPT
f=3
TT=0.086
T1=0.07
OPT
f=3
TT=666.123
T1=9.16
OPT
f=3
TT=616.706
T1=9.07
No dataOPT
f=3
TT=6.395
T1=6.39
OPT
f=3
TT=6.065
T1=6.06
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=7-P0=17-P1=53-P2=109-B.opb
OPT
f=3
TT=0.018
T1=0.01
OPT
f=3
TT=1.3
T1=1.08
No dataOPT
f=3
TT=0.133
T1=0.05
OPT
f=3
TT=612.692
T1=320.17
OPT
f=3
TT=0.253
T1=0.14
OPT
f=3
TT=963.687
T1=687.39
OPT
f=3
TT=0.218
T1=0.22
OPT
f=3
TT=353.993
T1=265.39
OPT
f=3
TT=0.945
T1=0.94
? (TO)

TT=1800.07

? (TO)

TT=1800.07

OPT
f=3
TT=0.472
T1=0.46
OPT
f=3
TT=0.018
T1=0.01
OPT
f=3
TT=0.437
T1=0.25
OPT
f=3
TT=0.318
T1=0.06
OPT
f=3
TT=0.832
T1=0.4
Wrong UNSAT

TT=0.392

OPT
f=3
TT=0.955
T1=0.29
OPT
f=3
TT=0.452
T1=0.44
No dataOPT
f=3
TT=8.537
T1=2.96
OPT
f=3
TT=3.259
T1=2.17
OPT
f=3
TT=0.154
T1=0.14
No dataOPT
f=3
TT=3.006
T1=1.65
OPT
f=3
TT=0.08
T1=0.06
?

TT=0.005

OPT
f=3
TT=178.458
T1=29.05
OPT
f=3
TT=181.278
T1=29.87
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.342
T1=0.16
No dataNo dataNo dataOPT
f=3
TT=0.382
T1=0.18
OPT
f=3
TT=2.115
T1=2.15
OPT
f=3
TT=0.654
T1=0.21
SAT
f=3
TT=0.924
T1=0.36
OPT
f=3
TT=0.038
T1=0.03
OPT
f=3
TT=0.058
T1=0.04
OPT
f=3
TT=0.046
T1=0.04
OPT
f=3
TT=2.107
T1=0.33
OPT
f=3
TT=2.123
T1=0.33
No dataOPT
f=3
TT=0.232
T1=0.22
OPT
f=3
TT=0.233
T1=0.22
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=7-P0=37-P1=43-B.opb
OPT
f=3
TT=0.001
T1=0
OPT
f=3
TT=0.078
T1=0.07
No dataOPT
f=3
TT=0.007
T1=0
OPT
f=3
TT=249.031
T1=244.05
OPT
f=3
TT=0.145
T1=0.12
OPT
f=3
TT=251.075
T1=248.64
OPT
f=3
TT=0.099
T1=0.09
OPT
f=3
TT=331.97
T1=332.35
OPT
f=3
TT=0.107
T1=0.11
? (TO)

TT=1800.01

? (TO)

TT=1800.01

OPT
f=3
TT=0.012
T1=0.01
OPT
f=3
TT=0.009
T1=0
OPT
f=3
TT=0.141
T1=0.12
OPT
f=3
TT=0.009
T1=0.01
OPT
f=3
TT=0.124
T1=0.13
OPT
f=3
TT=0.058
T1=0.05
OPT
f=3
TT=0.175
T1=0.14
OPT
f=3
TT=0.167
T1=0.16
No dataOPT
f=3
TT=0.02
T1=0.03
OPT
f=3
TT=0.213
T1=1.14
OPT
f=3
TT=0.038
T1=0.03
No dataOPT
f=3
TT=0.325
T1=0.63
OPT
f=3
TT=0.053
T1=0.04
?

TT=0.004

OPT
f=3
TT=224.059
T1=226.62
OPT
f=3
TT=316.494
T1=314.03
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=3
TT=0.001
T1=0
OPT
f=3
TT=0.242
T1=0.64
OPT
f=3
TT=0.154
T1=0.12
SAT
f=3
TT=0.344
T1=0.2
OPT
f=3
TT=0.052
T1=0.04
OPT
f=3
TT=0.068
T1=0.05
OPT
f=3
TT=0.043
T1=0.03
OPT
f=3
TT=0.005
T1=0
OPT
f=3
TT=0.005
T1=0
No dataOPT
f=3
TT=0.001
T1=0
OPT
f=3
TT=0.002
T1=0
No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=7-P0=43-P1=107-P2=31-P3=113-P4=127-P5=2-P6=79-B.opb
OPT
f=2
TT=0.055
T1=0.05
OPT
f=2
TT=73.537
T1=73.51
No dataOPT
f=2
TT=0.171
T1=0.17
? (TO)

TT=1800.03

OPT
f=2
TT=1.687
T1=1.69
? (TO)

TT=1800.06

OPT
f=2
TT=1.616
T1=1.61
? (TO)

TT=1800.06

OPT
f=2
TT=0.569
T1=0.57
? (TO)

TT=1800.09

? (TO)

TT=1800.33

OPT
f=2
TT=16.008
T1=16.01
OPT
f=2
TT=0.055
T1=0.05
OPT
f=2
TT=273.348
T1=273.44
OPT
f=2
TT=50.101
T1=50.11
OPT
f=2
TT=1.782
T1=1.38
Wrong Opt.
f=3
TT=29.373
T1=3.92
OPT
f=2
TT=14.133
T1=12.81
OPT
f=2
TT=3.7
T1=3.69
No dataOPT
f=2
TT=1217.21
T1=386.4
OPT
f=2
TT=2.195
T1=1.2
OPT
f=2
TT=3.055
T1=3.04
No dataOPT
f=2
TT=9.353
T1=4.18
OPT
f=2
TT=2.323
T1=2.31
?

TT=0.006

OPT
f=2
TT=230.565
T1=230.64
OPT
f=2
TT=350.766
T1=348.41
No dataNo dataNo dataNo dataNo dataOPT
f=2
TT=0.684
T1=0.33
No dataNo dataNo dataOPT
f=2
TT=1.604
T1=0.8
OPT
f=2
TT=4.401
T1=2.21
OPT
f=2
TT=1.673
T1=1.15
SAT
f=2
TT=2.985
T1=2.44
OPT
f=2
TT=1.287
T1=1.27
OPT
f=2
TT=0.158
T1=0.14
OPT
f=2
TT=20.185
T1=20.17
OPT
f=2
TT=13.037
T1=13.03
OPT
f=2
TT=21.143
T1=21.15
No dataOPT
f=2
TT=0.073
T1=0.07
OPT
f=2
TT=0.073
T1=0.07
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/
factor-mod-B/
factor-mod-size=7-P0=53-P1=109-P2=43-P3=13-P4=17-P5=101-P6=59-P7=7-P8=29-P9=107-B.opb
OPT
f=3
TT=0.081
T1=0.08
OPT
f=3
TT=72.896
T1=50
No dataOPT
f=3
TT=10.607
T1=3.23
? (problem)

TT=44.064

OPT
f=3
TT=15.399
T1=1.34
? (problem)

TT=43.23

OPT
f=3
TT=15.39
T1=1.37
? (problem)

TT=44.08

OPT
f=3
TT=11.06
T1=3.38
? (problem)

TT=43.11

? (TO)

TT=1800.1

OPT
f=3
TT=46.529
T1=18.82
OPT
f=3
TT=0.081
T1=0.08
OPT
f=3
TT=561.075
T1=398.98
OPT
f=3
TT=86.488
T1=3.83
OPT
f=3
TT=19.554
T1=7.46
Wrong Opt.
f=65
TT=12.014
T1=3.45
OPT
f=3
TT=43.977
T1=17.81
OPT
f=3
TT=4.496
T1=4.49
No data? (TO)

TT=1800.07

OPT
f=3
TT=32.329
T1=12.22
OPT
f=3
TT=0.267
T1=0.25
No dataOPT
f=3
TT=32.24
T1=14.83
OPT
f=3
TT=0.181
T1=0.16
?

TT=0.005

OPT
f=3
TT=1667.81
T1=1060.32
OPT
f=3
TT=1596.5
T1=986.3
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=11.943
T1=5.96
No dataNo dataNo dataOPT
f=3
TT=10.683
T1=5.35
OPT
f=3
TT=43.148
T1=1.71
OPT
f=3
TT=18.151
T1=2.36
SAT
f=3
TT=12.272
T1=1.26
OPT
f=3
TT=0.099
T1=0.09
OPT
f=3
TT=0.218
T1=0.2
OPT
f=3
TT=0.196
T1=0.18
OPT
f=3
TT=1388.01
T1=7.86
? (TO)

TT=1800.02

No dataOPT
f=3
TT=10.965
T1=10.95
OPT
f=3
TT=10.904
T1=10.91
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=7-P0=53-P1=37-P2=29-P3=83-P4=23-P5=67-B.opb
OPT
f=3
TT=0.045
T1=0.04
OPT
f=3
TT=30.288
T1=2.41
No dataOPT
f=3
TT=5.539
T1=0.38
? (TO)

TT=1800.1

OPT
f=3
TT=7.403
T1=0.93
? (TO)

TT=1800.04

OPT
f=3
TT=7.32
T1=0.91
? (TO)

TT=1800.08

OPT
f=3
TT=4.99
T1=0.92
? (TO)

TT=1800.05

? (TO)

TT=1800.21

OPT
f=3
TT=8.861
T1=6.96
OPT
f=3
TT=0.045
T1=0.04
OPT
f=3
TT=65.576
T1=28.35
OPT
f=3
TT=7.076
T1=1.16
OPT
f=3
TT=9.023
T1=0.64
OPT
f=3
TT=4.094
T1=1.67
OPT
f=3
TT=8.113
T1=1.13
OPT
f=3
TT=3.848
T1=3.84
No data? (TO)

TT=1800.2

OPT
f=3
TT=19.72
T1=5.2
OPT
f=3
TT=0.195
T1=0.18
No dataOPT
f=3
TT=18.09
T1=5.67
OPT
f=3
TT=0.112
T1=0.09
?

TT=0.004

OPT
f=3
TT=954.479
T1=641.3
OPT
f=3
TT=693.014
T1=366.79
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=4.723
T1=2.36
No dataNo dataNo dataOPT
f=3
TT=4.823
T1=2.41
OPT
f=3
TT=14.765
T1=0.69
OPT
f=3
TT=6.575
T1=0.3
SAT
f=3
TT=6.59
T1=0.72
OPT
f=3
TT=0.058
T1=0.05
OPT
f=3
TT=0.104
T1=0.09
OPT
f=3
TT=0.06
T1=0.06
OPT
f=3
TT=792.574
T1=6.88
OPT
f=3
TT=322.413
T1=6.86
No dataOPT
f=3
TT=3.474
T1=3.46
OPT
f=3
TT=3.453
T1=3.45
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=7-P0=61-P1=127-P2=131-P3=107-P4=47-B.opb
OPT
f=3
TT=0.034
T1=0.02
OPT
f=3
TT=12.072
T1=2.52
No dataOPT
f=3
TT=3.55
T1=0.07
? (TO)

TT=1800.01

OPT
f=3
TT=4.896
T1=4.98
? (TO)

TT=1800.05

OPT
f=3
TT=4.103
T1=1.6
? (TO)

TT=1800.06

OPT
f=3
TT=3.339
T1=1.55
? (TO)

TT=1800.09

? (TO)

TT=1800.07

OPT
f=3
TT=18.949
T1=0.46
OPT
f=3
TT=0.036
T1=0.03
OPT
f=3
TT=20.351
T1=6.64
OPT
f=3
TT=9.496
T1=0.49
OPT
f=3
TT=6.495
T1=0.79
OPT
f=3
TT=4.83
T1=3.16
OPT
f=3
TT=14.563
T1=0.42
OPT
f=3
TT=3.493
T1=3.48
No data? (TO)

TT=1800.17

OPT
f=3
TT=10.284
T1=1.17
OPT
f=3
TT=0.15
T1=0.14
No dataOPT
f=3
TT=10.921
T1=0.66
OPT
f=3
TT=0.034
T1=0.02
?

TT=0.006

OPT
f=3
TT=693.221
T1=693.52
OPT
f=3
TT=510.959
T1=260.79
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=2.622
T1=1.3
No dataNo dataNo dataOPT
f=3
TT=3.452
T1=1.72
OPT
f=3
TT=11.613
T1=0.67
OPT
f=3
TT=3.7
T1=0.26
SAT
f=3
TT=4.204
T1=0.71
OPT
f=3
TT=0.05
T1=0.04
OPT
f=3
TT=0.086
T1=0.07
OPT
f=3
TT=0.056
T1=0.04
OPT
f=3
TT=631.832
T1=1.48
OPT
f=3
TT=200.172
T1=1.47
No dataOPT
f=3
TT=2.933
T1=2.93
OPT
f=3
TT=2.934
T1=2.92
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=7-P0=89-P1=17-P2=37-B.opb
OPT
f=3
TT=0.018
T1=0.01
OPT
f=3
TT=1.184
T1=0.22
No dataOPT
f=3
TT=0.125
T1=0.06
OPT
f=3
TT=696.286
T1=309.27
OPT
f=3
TT=1.485
T1=1.35
? (TO)

TT=1800.04

OPT
f=3
TT=1.532
T1=1.39
OPT
f=3
TT=361.595
T1=311.62
OPT
f=3
TT=1.441
T1=1.35
? (TO)

TT=1800.08

? (TO)

TT=1800.05

OPT
f=3
TT=0.665
T1=0.66
OPT
f=3
TT=0.018
T1=0.01
OPT
f=3
TT=0.443
T1=0.24
OPT
f=3
TT=0.423
T1=0.02
OPT
f=3
TT=0.826
T1=0.36
OPT
f=3
TT=0.199
T1=0.07
OPT
f=3
TT=0.905
T1=0.31
OPT
f=3
TT=0.483
T1=0.48
No dataOPT
f=3
TT=18.299
T1=6.6
OPT
f=3
TT=3.853
T1=2.15
OPT
f=3
TT=0.174
T1=0.16
No dataOPT
f=3
TT=3.315
T1=1.14
OPT
f=3
TT=0.084
T1=0.07
?

TT=0.003

OPT
f=3
TT=245.023
T1=245.06
OPT
f=3
TT=248.771
T1=92.34
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=0.403
T1=0.19
No dataNo dataNo dataOPT
f=3
TT=0.462
T1=0.22
OPT
f=3
TT=2.514
T1=0.64
OPT
f=3
TT=0.653
T1=0.2
SAT
f=3
TT=0.946
T1=0.32
OPT
f=3
TT=0.053
T1=0.04
OPT
f=3
TT=0.054
T1=0.04
OPT
f=3
TT=0.048
T1=0.04
OPT
f=3
TT=2.059
T1=0.15
OPT
f=3
TT=1.575
T1=0.15
No dataOPT
f=3
TT=0.213
T1=0.21
OPT
f=3
TT=0.212
T1=0.21
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=7-P0=89-P1=37-P2=43-P3=47-P4=41-P5=107-P6=127-B.opb
OPT
f=3
TT=0.054
T1=0.05
OPT
f=3
TT=24.499
T1=22.73
No dataOPT
f=3
TT=5.2
T1=0.76
? (TO)

TT=1800.1

OPT
f=3
TT=10.038
T1=2.92
? (TO)

TT=1800.04

OPT
f=3
TT=6.035
T1=6.03
? (TO)

TT=1800.02

OPT
f=3
TT=5.794
T1=1.87
? (TO)

TT=1800.08

? (TO)

TT=1800.11

OPT
f=3
TT=16.81
T1=12.38
OPT
f=3
TT=0.054
T1=0.05
OPT
f=3
TT=76.346
T1=10.07
OPT
f=3
TT=18.623
T1=4.72
OPT
f=3
TT=10.013
T1=0.88
Wrong UNSAT

TT=11.191

OPT
f=3
TT=11.064
T1=1.93
OPT
f=3
TT=2.814
T1=2.8
No data? (TO)

TT=1800.31

OPT
f=3
TT=18.462
T1=10.19
OPT
f=3
TT=0.262
T1=0.25
No dataOPT
f=3
TT=23.02
T1=2.18
OPT
f=3
TT=0.15
T1=0.13
?

TT=0.006

OPT
f=3
TT=1164.19
T1=1164.46
OPT
f=3
TT=1017.08
T1=337.35
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=5.933
T1=2.96
No dataNo dataNo dataOPT
f=3
TT=6.042
T1=3.02
OPT
f=3
TT=17.291
T1=1.68
OPT
f=3
TT=7.512
T1=1.41
SAT
f=3
TT=8.624
T1=0.87
OPT
f=3
TT=0.067
T1=0.05
OPT
f=3
TT=0.126
T1=0.11
OPT
f=3
TT=0.076
T1=0.06
OPT
f=3
TT=921.312
T1=5.31
OPT
f=3
TT=824.791
T1=5.26
No dataOPT
f=3
TT=6.604
T1=6.59
OPT
f=3
TT=6.614
T1=6.6
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=7-P0=97-P1=37-P2=107-P3=53-P4=53-B.opb
OPT
f=3
TT=0.036
T1=0.03
OPT
f=3
TT=12.416
T1=4.91
No dataOPT
f=3
TT=4.139
T1=0.19
? (TO)

TT=1800.01

OPT
f=3
TT=4.831
T1=1.65
? (TO)

TT=1800.05

OPT
f=3
TT=4.457
T1=1.16
? (TO)

TT=1800.03

OPT
f=3
TT=3.009
T1=1.24
? (TO)

TT=1800.09

? (TO)

TT=1800.11

OPT
f=3
TT=4.535
T1=3.39
OPT
f=3
TT=0.036
T1=0.03
OPT
f=3
TT=15.901
T1=13.74
OPT
f=3
TT=5.958
T1=0.35
OPT
f=3
TT=9.224
T1=0.32
OPT
f=3
TT=5.144
T1=3.81
OPT
f=3
TT=10.441
T1=0.44
OPT
f=3
TT=3.022
T1=3.01
No data? (TO)

TT=1800.05

OPT
f=3
TT=10.864
T1=1.19
OPT
f=3
TT=0.188
T1=0.18
No dataOPT
f=3
TT=8.752
T1=1.16
OPT
f=3
TT=0.118
T1=0.1
?

TT=0.004

OPT
f=3
TT=689.972
T1=214.77
OPT
f=3
TT=800.774
T1=326.72
No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=3.702
T1=1.84
No dataNo dataNo dataOPT
f=3
TT=3.223
T1=1.6
OPT
f=3
TT=9.333
T1=2.17
OPT
f=3
TT=3.973
T1=0.25
SAT
f=3
TT=5.584
T1=0.52
OPT
f=3
TT=0.084
T1=0.07
OPT
f=3
TT=0.082
T1=0.06
OPT
f=3
TT=0.074
T1=0.06
OPT
f=3
TT=1376.37
T1=1.37
OPT
f=3
TT=784.644
T1=1.41
No dataOPT
f=3
TT=3.872
T1=4
OPT
f=3
TT=3.872
T1=3.86
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=8-P0=139-P1=101-P2=227-P3=251-P4=227-P5=251-B.opb
OPT
f=3
TT=0.066
T1=0.06
OPT
f=3
TT=291.212
T1=101.23
No dataOPT
f=3
TT=40.64
T1=1.6
Wrong UNSAT

TT=321.859

OPT
f=3
TT=33.778
T1=0.37
Wrong UNSAT

TT=324.24

OPT
f=3
TT=33.997
T1=0.35
Wrong UNSAT

TT=323.75

OPT
f=3
TT=25.294
T1=0.67
Wrong UNSAT

TT=323.48

OPT
f=3
TT=66.541
T1=42.4
OPT
f=3
TT=145.051
T1=139.68
OPT
f=3
TT=0.066
T1=0.06
OPT
f=3
TT=438.751
T1=198.28
OPT
f=3
TT=516.003
T1=2.44
OPT
f=3
TT=128.63
T1=3.38
Wrong Opt.
f=33
TT=10.072
T1=2.45
OPT
f=3
TT=416.521
T1=1.53
OPT
f=3
TT=4.663
T1=4.65
No data? (TO)

TT=1800.14

OPT
f=3
TT=76.771
T1=34.32
OPT
f=3
TT=1.591
T1=1.58
No dataOPT
f=3
TT=87.822
T1=28.75
OPT
f=3
TT=0.125
T1=0.11
?

TT=0.005

? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=38.328
T1=19.16
No dataNo dataNo dataOPT
f=3
TT=34.16
T1=17.1
OPT
f=3
TT=50.846
T1=2.69
OPT
f=3
TT=16.801
T1=0.37
SAT
f=3
TT=33.929
T1=0.73
OPT
f=3
TT=0.072
T1=0.06
OPT
f=3
TT=0.127
T1=0.11
OPT
f=3
TT=0.129
T1=0.12
? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataOPT
f=3
TT=53.177
T1=53.19
OPT
f=3
TT=105.217
T1=52.69
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=8-P0=149-P1=79-P2=59-P3=73-P4=211-B.opb
OPT
f=3
TT=0.049
T1=0.04
OPT
f=3
TT=426.646
T1=0.92
No dataOPT
f=3
TT=25.743
T1=0.91
Wrong UNSAT

TT=321.728

OPT
f=3
TT=26.163
T1=26.17
Wrong UNSAT

TT=317.38

OPT
f=3
TT=25.884
T1=1.71
Wrong UNSAT

TT=315.81

OPT
f=3
TT=14.371
T1=1.85
Wrong UNSAT

TT=320.09

? (TO)

TT=1800.06

OPT
f=3
TT=56.488
T1=31.84
OPT
f=3
TT=0.049
T1=0.04
OPT
f=3
TT=156.554
T1=104.65
OPT
f=3
TT=81.814
T1=6.08
OPT
f=3
TT=16.682
T1=0.5
Wrong Opt.
f=41
TT=4.204
T1=0.23
OPT
f=3
TT=39.569
T1=0.63
OPT
f=3
TT=2.26
T1=2.25
No data? (TO)

TT=1800.11

OPT
f=3
TT=41.509
T1=2.18
OPT
f=3
TT=1.1
T1=1.09
No dataOPT
f=3
TT=43.966
T1=5.17
OPT
f=3
TT=0.087
T1=0.07
?

TT=0.005

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=19.801
T1=9.9
No dataNo dataNo dataOPT
f=3
TT=24.99
T1=12.53
OPT
f=3
TT=35.549
T1=1.68
OPT
f=3
TT=13.122
T1=0.54
SAT
f=3
TT=18.422
T1=0.7
OPT
f=3
TT=0.105
T1=0.09
OPT
f=3
TT=0.108
T1=0.09
OPT
f=3
TT=0.061
T1=0.06
? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataOPT
f=3
TT=51.551
T1=51.54
OPT
f=3
TT=48.57
T1=48.63
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/
factor-mod-B/
factor-mod-size=8-P0=211-P1=113-P2=103-P3=37-P4=167-P5=5-P6=191-P7=13-P8=223-P9=137-B.opb
OPT
f=3
TT=0.113
T1=0.11
SAT
f=3
TT=1798
T1=369.64
No dataOPT
f=3
TT=151.564
T1=13.11
Wrong UNSAT

TT=325.185

OPT
f=3
TT=72.659
T1=28.11
Wrong UNSAT

TT=324.95

OPT
f=3
TT=64.493
T1=20.56
Wrong UNSAT

TT=326.62

OPT
f=3
TT=54.805
T1=11.13
Wrong UNSAT

TT=320.91

? (TO)

TT=1800.57

OPT
f=3
TT=500.909
T1=348.26
OPT
f=3
TT=0.113
T1=0.11
SAT (TO)
f=129
TT=1800.12
T1=1587.78
OPT
f=3
TT=176.264
T1=91.41
OPT
f=3
TT=181.11
T1=70.14
Wrong UNSAT

TT=1.462

OPT
f=3
TT=798.21
T1=146.02
OPT
f=3
TT=3.459
T1=3.45
No data? (TO)

TT=1800.08

OPT
f=3
TT=166.719
T1=89.3
OPT
f=3
TT=3.067
T1=3.05
No dataOPT
f=3
TT=127.615
T1=51.03
OPT
f=3
TT=0.18
T1=0.16
?

TT=0.006

? (TO)

TT=1800.08

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=118.908
T1=59.46
No dataNo dataNo dataOPT
f=3
TT=87.35
T1=43.76
OPT
f=3
TT=230.279
T1=14.8
OPT
f=3
TT=78.79
T1=7.07
SAT
f=3
TT=105.11
T1=1.17
OPT
f=3
TT=0.295
T1=0.28
OPT
f=3
TT=0.248
T1=0.23
OPT
f=3
TT=0.288
T1=0.27
? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataOPT
f=3
TT=124.969
T1=125.01
OPT
f=3
TT=125.528
T1=125.58
No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=8-P0=229-P1=67-P2=149-P3=97-P4=149-P5=211-P6=89-P7=59-B.opb
OPT
f=3
TT=0.087
T1=0.08
OPT
f=3
TT=1117.07
T1=408.21
No dataOPT
f=3
TT=71.209
T1=3.21
Wrong UNSAT

TT=340.893

OPT
f=3
TT=42.925
T1=5.65
Wrong UNSAT

TT=322

OPT
f=3
TT=40.804
T1=40.86
Wrong UNSAT

TT=326.48

OPT
f=3
TT=41.341
T1=9.49
Wrong UNSAT

TT=323.41

? (TO)

TT=1800.06

OPT
f=3
TT=256.805
T1=151.85
OPT
f=3
TT=0.087
T1=0.08
OPT
f=3
TT=1514.02
T1=1234.03
OPT
f=3
TT=388.097
T1=2.71
OPT
f=3
TT=230.12
T1=2.49
OPT
f=3
TT=31.65
T1=4.05
OPT
f=3
TT=881.231
T1=68.5
OPT
f=3
TT=2.039
T1=2.03
No data? (TO)

TT=1800.23

OPT
f=3
TT=129.454
T1=41.45
OPT
f=3
TT=8.624
T1=8.61
No dataOPT
f=3
TT=84.74
T1=31.41
OPT
f=3
TT=1.605
T1=1.59
?

TT=0.006

? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=62.246
T1=31.11
No dataNo dataNo dataOPT
f=3
TT=60.56
T1=30.35
OPT
f=3
TT=104.658
T1=1.22
OPT
f=3
TT=78.73
T1=5.74
SAT
f=3
TT=60.51
T1=5.96
OPT
f=3
TT=0.184
T1=0.17
OPT
f=3
TT=0.179
T1=0.16
OPT
f=3
TT=0.177
T1=0.16
? (TO)

TT=1800.01

? (TO)

TT=1800.03

No dataOPT
f=3
TT=128.129
T1=128.17
OPT
f=3
TT=127.748
T1=127.79
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=8-P0=61-P1=167-P2=157-P3=13-P4=173-P5=47-P6=47-P7=251-P8=79-B.opb
OPT
f=3
TT=0.114
T1=0.1
SAT
f=3
TT=1798.25
T1=721
No dataOPT
f=3
TT=93.867
T1=2.4
Wrong UNSAT

TT=314.52

OPT
f=3
TT=61.489
T1=17.17
Wrong UNSAT

TT=313.81

OPT
f=3
TT=58.362
T1=58.37
Wrong UNSAT

TT=317.07

OPT
f=3
TT=46.341
T1=11.21
Wrong UNSAT

TT=320.08

? (TO)

TT=1800.08

OPT
f=3
TT=193.877
T1=147.83
OPT
f=3
TT=0.137
T1=0.13
SAT (TO)
f=239
TT=1802.07
T1=1538.56
OPT
f=3
TT=589.752
T1=112.38
OPT
f=3
TT=369.95
T1=1.04
Wrong UNSAT

TT=4.986

OPT
f=3
TT=175.09
T1=12.81
OPT
f=3
TT=1.012
T1=1
No data? (TO)

TT=1800.36

OPT
f=3
TT=154.533
T1=68.53
OPT
f=3
TT=4.066
T1=4.06
No dataOPT
f=3
TT=187.505
T1=41.77
OPT
f=3
TT=0.22
T1=0.2
?

TT=0.005

? (TO)

TT=1800.05

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=112.109
T1=56.07
No dataNo dataNo dataOPT
f=3
TT=73.75
T1=36.91
OPT
f=3
TT=169.007
T1=7.23
OPT
f=3
TT=114.86
T1=4.35
SAT
f=3
TT=135.2
T1=2.8
OPT
f=3
TT=0.114
T1=0.1
OPT
f=3
TT=0.213
T1=0.19
OPT
f=3
TT=0.236
T1=0.22
? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataOPT
f=3
TT=97.994
T1=98.02
OPT
f=3
TT=99.225
T1=99.24
No data
normalized-PB07/OPT-SMALLINT-NLC/
submittedPB07/roussel/factor-mod-B/
factor-mod-size=9-P0=41-P1=331-P2=37-B.opb
OPT
f=3
TT=0.033
T1=0.03
OPT
f=3
TT=50.285
T1=5.03
No dataOPT
f=3
TT=3.68
T1=0.86
? (problem)

TT=677.802

OPT
f=3
TT=3.221
T1=0.32
? (problem)

TT=637.292

OPT
f=3
TT=3.285
T1=0.32
? (problem)

TT=638.619

OPT
f=3
TT=3.749
T1=0.57
? (problem)

TT=652.096

? (TO)

TT=1800.26

OPT
f=3
TT=40.203
T1=3.48
OPT
f=3
TT=0.033
T1=0.03
OPT
f=3
TT=5.938
T1=0.27
OPT
f=3
TT=6.838
T1=0.17
OPT
f=3
TT=7.263
T1=0.34
OPT
f=3
TT=3.395
T1=0.77
OPT
f=3
TT=20.071
T1=0.3
OPT
f=3
TT=1.016
T1=1.01
No dataWrong Cert.

TT=149.979

OPT
f=3
TT=33.818
T1=2.17
OPT
f=3
TT=1.333
T1=1.32
No dataOPT
f=3
TT=32.079
T1=3.15
OPT
f=3
TT=0.121
T1=0.1
?

TT=0.005

? (problem)

TT=622.995

? (problem)

TT=633.929

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=18.479
T1=9.23
No dataNo dataNo dataOPT
f=3
TT=18.59
T1=9.32
OPT
f=3
TT=12.583
T1=2.17
OPT
f=3
TT=6.043
T1=0.35
SAT
f=3
TT=8.253
T1=1.53
OPT
f=3
TT=0.068
T1=0.06
OPT
f=3
TT=0.069
T1=0.05
OPT
f=3
TT=0.06
T1=0.05
OPT
f=3
TT=58.673
T1=1.25
OPT
f=3
TT=55.059
T1=1.25
No dataOPT
f=3
TT=8.752
T1=8.74
OPT
f=3
TT=8.971
T1=8.97
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=9-P0=499-P1=293-P2=223-P3=277-B.opb
OPT
f=3
TT=0.05
T1=0.04
OPT
f=3
TT=1536.65
T1=3.83
No dataOPT
f=3
TT=107.306
T1=1.3
? (problem)

TT=637.449

OPT
f=3
TT=73.177
T1=73.19
? (problem)

TT=637.826

OPT
f=3
TT=73.65
T1=0.46
? (problem)

TT=637.929

OPT
f=3
TT=28.78
T1=0.58
? (problem)

TT=654.206

? (TO)

TT=1800.23

OPT
f=3
TT=257.383
T1=162.74
OPT
f=3
TT=0.05
T1=0.04
OPT
f=3
TT=607.233
T1=138.39
SAT
f=3
TT=1783
T1=0.2
OPT
f=3
TT=66.5
T1=0.43
Wrong UNSAT

TT=3.716

OPT
f=3
TT=1685.81
T1=0.43
OPT
f=3
TT=1.067
T1=1.06
No data? (TO)

TT=1800.09

OPT
f=3
TT=121.775
T1=32.2
OPT
f=3
TT=0.183
T1=0.17
No dataOPT
f=3
TT=86.002
T1=24.7
OPT
f=3
TT=0.129
T1=0.11
?

TT=0.005

? (problem)

TT=623.034

? (problem)

TT=627.939

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=111.197
T1=55.6
No dataNo dataNo dataOPT
f=3
TT=104.37
T1=52.26
OPT
f=3
TT=116.536
T1=0.68
OPT
f=3
TT=41.12
T1=0.26
SAT
f=3
TT=55.09
T1=1.79
OPT
f=3
TT=0.099
T1=0.09
OPT
f=3
TT=0.105
T1=0.09
OPT
f=3
TT=0.057
T1=0.05
? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataOPT
f=3
TT=42.58
T1=42.58
OPT
f=3
TT=42.68
T1=42.73
No data
normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
roussel/factor-mod-B/
factor-mod-size=9-P0=67-P1=349-P2=67-P3=499-P4=79-P5=347-P6=307-B.opb
OPT
f=3
TT=0.111
T1=0.1
SAT
f=3
TT=1798
T1=1200.94
No dataOPT
f=3
TT=534.921
T1=10.11
? (problem)

TT=628.95

OPT
f=3
TT=204.42
T1=204.46
? (problem)

TT=633.839

OPT
f=3
TT=202.323
T1=202.36
? (problem)

TT=631.49

OPT
f=3
TT=188.89
T1=26.28
? (problem)

TT=632.832

? (TO)

TT=1800.03

OPT
f=3
TT=1542.36
T1=1120.27
OPT
f=3
TT=0.199
T1=0.19
? (TO)

TT=1802.11

SAT
f=3
TT=1783.01
T1=84.69
OPT
f=3
TT=1258.94
T1=86.3
Wrong UNSAT

TT=5.59

SAT (TO)
f=3
TT=1800.5
T1=112.56
OPT
f=3
TT=1.694
T1=1.68
No data? (TO)

TT=1800.03

OPT
f=3
TT=628.574
T1=81.51
OPT
f=3
TT=2.573
T1=2.56
No dataOPT
f=3
TT=328.545
T1=112.14
OPT
f=3
TT=0.188
T1=0.17
?

TT=0.006

? (problem)

TT=616.997

? (problem)

TT=618.19

No dataNo dataNo dataNo dataNo dataOPT
f=3
TT=294.039
T1=147.06
No dataNo dataNo dataOPT
f=3
TT=379.05
T1=189.6
OPT
f=3
TT=1007.6
T1=10.72
OPT
f=3
TT=291.11
T1=5.29
SAT
f=3
TT=1067.13
T1=14.16
OPT
f=3
TT=0.111
T1=0.1
OPT
f=3
TT=0.24
T1=0.22
OPT
f=3
TT=0.239
T1=0.23
? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataOPT
f=3
TT=1492.26
T1=1492.49
OPT
f=3
TT=1494.15
T1=1494.44
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_100_10_3_40.opb



?
TT=1797.9

? (TO)
TT=1800.02

No data? (problem)
TT=0.025

? (TO)
TT=1800.13

? (problem)
TT=0.024

? (TO)
TT=1800.1

? (problem)
TT=0.019

? (TO)
TT=1800.09

? (problem)
TT=0.019

? (TO)
TT=1800.08

? (TO)
TT=1800.04

? (TO)
TT=1800.11

?
TT=879.894

? (TO)
TT=1800.02

?
TT=0.483

?
TT=1798.01

? (TO)
TT=1800.07

? (TO)
TT=1800.21

No Cert.
TT=1.871

? (TO)
TT=1800.4

? (TO)
TT=1800.02

?
TT=1789.74

? (MO)
TT=1677.67

? (TO)
TT=1800.12

?
TT=1796.75

?
TT=0.004

? (problem)
TT=0.019

? (problem)
TT=0.024

No dataNo dataNo dataNo data?
TT=1799.89

No dataNo dataNo data?
TT=1799.47

No data? (TO)
TT=1800.08

? (TO)
TT=1800.87

? (TO)
TT=1800.01

?
TT=1796.74

?
TT=1796.77

?
TT=1796.71

? (TO)
TT=1800.02

? (TO)
TT=1800.05

No data?
TT=1799.47

?
TT=1799.85

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_100_10_4_15.opb
SAT
TT=0.034
T1=0.03
SAT
TT=0.609
T1=0.6
SAT
TT=1.31
T1=1.31
No data? (problem)
TT=0.021

SAT
TT=0.377
T1=0.37
? (problem)
TT=0.019

SAT
TT=0.368
T1=0.36
? (problem)
TT=0.018

SAT
TT=0.365
T1=0.36
? (problem)
TT=0.018

SAT
TT=0.361
T1=0.36
SAT
TT=13.698
T1=13.7
SAT
TT=0.145
T1=0.14
SAT
TT=0.178
T1=0.16
SAT
TT=0.034
T1=0.03
?
TT=0.503

SAT
TT=0.194
T1=0.19
SAT
TT=1.055
T1=0.53
SAT
TT=2.293
T1=2.28
SAT
TT=214.911
T1=203.98
SAT
TT=0.077
T1=0.07
SAT
TT=3.084
T1=1.36
SAT
TT=3.078
T1=3.07
SAT
TT=0.58
T1=0.63
SAT
TT=2.974
T1=1.3
SAT
TT=0.113
T1=0.1
?
TT=0.006

? (problem)
TT=0.019

? (problem)
TT=0.018

No dataNo dataNo dataNo dataSAT
TT=1.272
T1=1.26
No dataNo dataNo dataSAT
TT=0.039
T1=0.03
No dataSAT
TT=3.198
T1=1.31
SAT
TT=17.151
T1=16.34
SAT
TT=0.794
T1=0.4
SAT
TT=2.398
T1=2.38
SAT
TT=0.136
T1=0.12
SAT
TT=1.274
T1=1.26
SAT
TT=0.038
T1=0.03
SAT
TT=0.039
T1=0.03
No dataSAT
TT=0.04
T1=0.03
SAT
TT=0.04
T1=0.03
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_100_25_2_15.opb
SAT
TT=93.697
T1=93.7
?
TT=1798.01

? (TO)
TT=1800.02

No data? (problem)
TT=0.035

? (TO)
TT=1800.11

? (problem)
TT=0.033

? (TO)
TT=1800

? (problem)
TT=0.03

? (TO)
TT=1800.08

? (problem)
TT=0.028

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.09

? (TO)
TT=1800.06

? (TO)
TT=1800.02

?
TT=0.963

?
TT=1798.01

? (TO)
TT=1800.49

SAT
TT=242.334
T1=242.34
No Cert.
TT=1.393

? (TO)
TT=1800.3

? (TO)
TT=1800.91

SAT
TT=1422.08
T1=1422.32
? (MO)
TT=1670.57

? (TO)
TT=1800.07

SAT
TT=93.697
T1=93.7
?
TT=0.005

? (problem)
TT=0.03

? (problem)
TT=0.031

No dataNo dataNo dataNo data?
TT=1799.83

No dataNo dataNo data?
TT=1799.52

No data? (TO)
TT=1800.09

? (TO)
TT=1800.04

SAT
TT=1703.21
T1=1696.27
SAT
TT=928.589
T1=928.73
SAT
TT=408.956
T1=408.99
SAT
TT=801.607
T1=801.72
? (TO)
TT=1800.03

? (TO)
TT=1800.02

No data?
TT=1799.9

?
TT=1799.47

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_100_25_5_40.opb
UNSAT
TT=17.053

?
TT=1798.02

? (TO)
TT=1800.03

No data? (problem)
TT=0.032

? (TO)
TT=1800.13

? (problem)
TT=0.027

? (TO)
TT=1800

? (problem)
TT=0.029

? (TO)
TT=1800.09

? (problem)
TT=0.03

? (TO)
TT=1800.09

? (TO)
TT=1800.12

? (TO)
TT=1800.1

?
TT=701.138

? (TO)
TT=1800.02

?
TT=0.986

?
TT=1798.05

? (TO)
TT=1800.09

UNSAT
TT=113.261

No Cert.
TT=111.843

UNSAT
TT=122.26

? (TO)
TT=1800.29

UNSAT
TT=624.514

UNSAT
TT=1188.46

? (TO)
TT=1800.16

UNSAT
TT=17.053

?
TT=0.008

? (problem)
TT=0.032

? (problem)
TT=0.031

No dataNo dataNo dataNo data?
TT=1799.94

No dataNo dataNo data?
TT=1799.87

No data? (TO)
TT=1800.79

? (TO)
TT=1800.74

? (TO)
TT=1800.09

UNSAT
TT=314.555

UNSAT
TT=17.546

UNSAT
TT=482.132

? (TO)
TT=1800.04

? (TO)
TT=1800.03

No data?
TT=1799.82

?
TT=1799.47

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/
dbsg/normalized-dbsg_10_4_3_5.opb
UNSAT
TT=0.001

UNSAT
TT=0.003

UNSAT
TT=0.003

No data? (problem)
TT=0.003

UNSAT
TT=0.031

? (problem)
TT=0.004

UNSAT
TT=0.027

? (problem)
TT=0.007

UNSAT
TT=0.023

? (problem)
TT=0.004

UNSAT
TT=0.022

UNSAT
TT=0.006

UNSAT
TT=0.011

UNSAT
TT=0.023

UNSAT
TT=0.003

?
TT=0.114

UNSAT
TT=0.002

UNSAT
TT=0.354

UNSAT
TT=0.027

No Cert.
TT=0.898

UNSAT
TT=0.016

UNSAT
TT=0.635

UNSAT
TT=0.046

UNSAT
TT=0.547

UNSAT
TT=0.575

UNSAT
TT=0.041

?
TT=0.005

? (problem)
TT=0.003

? (problem)
TT=0.003

No dataNo dataNo dataNo dataUNSAT
TT=0.003

No dataNo dataNo dataUNSAT
TT=0.002

No dataUNSAT
TT=0.546

UNSAT
TT=0.283

UNSAT
TT=0.305

UNSAT
TT=0.047

UNSAT
TT=0.041

UNSAT
TT=0.031

UNSAT
TT=0.013

UNSAT
TT=0.013

No dataUNSAT
TT=0.001

UNSAT
TT=0.001

No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/
dbsg/normalized-dbsg_10_4_4_5.opb
UNSAT
TT=0.002

UNSAT
TT=0.003

UNSAT
TT=0.003

No data? (problem)
TT=0.005

UNSAT
TT=0.038

? (problem)
TT=0.003

UNSAT
TT=0.027

? (problem)
TT=0.004

UNSAT
TT=0.024

? (problem)
TT=0.004

UNSAT
TT=0.026

UNSAT
TT=0.008

UNSAT
TT=0.011

UNSAT
TT=0.02

UNSAT
TT=0.003

?
TT=0.104

UNSAT
TT=0.002

UNSAT
TT=0.355

UNSAT
TT=0.024

No Cert.
TT=1.046

UNSAT
TT=0.018

UNSAT
TT=0.584

UNSAT
TT=0.044

UNSAT
TT=0.541

UNSAT
TT=0.594

UNSAT
TT=0.036

?
TT=0.004

? (problem)
TT=0.004

? (problem)
TT=0.002

No dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo dataNo dataUNSAT
TT=0.003

No dataUNSAT
TT=0.413

UNSAT
TT=0.285

UNSAT
TT=0.325

UNSAT
TT=0.045

UNSAT
TT=0.059

UNSAT
TT=0.023

UNSAT
TT=0.013

UNSAT
TT=0.014

No dataUNSAT
TT=0.002

UNSAT
TT=0.002

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/
dbsg/normalized-dbsg_10_4_4_8.opb
UNSAT
TT=0.001

UNSAT
TT=0.003

UNSAT
TT=0.002

No data? (problem)
TT=0.002

UNSAT
TT=0.028

? (problem)
TT=0.003

UNSAT
TT=0.022

? (problem)
TT=0.003

UNSAT
TT=0.018

? (problem)
TT=0.003

UNSAT
TT=0.019

UNSAT
TT=0.003

UNSAT
TT=0.006

UNSAT
TT=0.019

UNSAT
TT=0.003

?
TT=0.11

UNSAT
TT=0.001

UNSAT
TT=0.164

UNSAT
TT=0.015

UNSAT
TT=0.846

UNSAT
TT=0.007

UNSAT
TT=0.214

UNSAT
TT=0.018

UNSAT
TT=0.484

UNSAT
TT=0.201

UNSAT
TT=0.022

?
TT=0.005

? (problem)
TT=0.003

? (problem)
TT=0.003

No dataNo dataNo dataNo dataUNSAT
TT=0.002

No dataNo dataNo dataUNSAT
TT=0.003

No dataUNSAT
TT=0.194

UNSAT
TT=0.165

UNSAT
TT=0.184

UNSAT
TT=0.013

UNSAT
TT=0.016

UNSAT
TT=0.018

UNSAT
TT=0.004

UNSAT
TT=0.004

No dataUNSAT
TT=0.001

UNSAT
TT=0.002

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_10_1_15.opb
SAT
TT=0.031
T1=0.03
SAT
TT=1.209
T1=1.2
SAT
TT=0.031
T1=0.03
No data? (problem)
TT=0.046

SAT
TT=0.581
T1=0.58
? (problem)
TT=0.053

? (problem)
TT=0.498

? (problem)
TT=0.043

? (problem)
TT=0.48

? (problem)
TT=0.044

? (problem)
TT=0.489

? (TO)
TT=1800.1

SAT
TT=0.277
T1=0.27
SAT
TT=0.349
T1=0.32
SAT
TT=0.083
T1=0.08
?
TT=0.864

SAT
TT=0.324
T1=0.32
SAT
TT=1.704
T1=0.96
SAT
TT=3.045
T1=3.02
SAT
TT=215.13
T1=204.15
SAT
TT=0.147
T1=0.13
SAT
TT=1.494
T1=1.67
SAT
TT=1.263
T1=1.24
SAT
TT=0.672
T1=0.73
SAT
TT=1.625
T1=0.92
SAT
TT=28.974
T1=28.96
?
TT=0.008

? (problem)
TT=0.041

? (problem)
TT=0.043

No dataNo dataNo dataNo dataSAT
TT=0.17
T1=0.16
No dataNo dataNo dataSAT
TT=0.68
T1=0.67
No dataSAT
TT=1.653
T1=0.9
SAT
TT=48.096
T1=45.81
SAT
TT=1.594
T1=0.67
SAT
TT=0.698
T1=0.67
SAT
TT=26.993
T1=26.99
SAT
TT=0.584
T1=0.56
SAT
TT=0.084
T1=0.08
SAT
TT=0.082
T1=0.08
No dataSAT
TT=0.669
T1=0.66
SAT
TT=0.67
T1=0.66
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_10_2_40.opb
SAT
TT=0.085
T1=0.08
SAT
TT=61.651
T1=61.64
SAT
TT=132.301
T1=132.32
No data? (problem)
TT=0.044

SAT
TT=0.837
T1=0.83
? (problem)
TT=0.044

SAT
TT=0.794
T1=0.79
? (problem)
TT=0.047

SAT
TT=0.765
T1=0.76
? (problem)
TT=0.047

SAT
TT=0.792
T1=0.79
? (TO)
TT=1800.08

SAT
TT=1.284
T1=1.28
SAT
TT=38.939
T1=38.91
SAT
TT=852.979
T1=853.12
?
TT=0.876

SAT
TT=5.02
T1=5.01
SAT
TT=3.904
T1=3.12
SAT
TT=9.919
T1=9.91
No Cert.
TT=1.876

SAT
TT=0.395
T1=0.38
SAT
TT=22.722
T1=11.69
SAT
TT=17.795
T1=17.78
SAT
TT=0.684
T1=0.75
SAT
TT=17.031
T1=7.97
SAT
TT=71.371
T1=71.37
?
TT=0.005

? (problem)
TT=0.044

? (problem)
TT=0.05

No dataNo dataNo dataNo dataSAT
TT=102.86
T1=102.95
No dataNo dataNo dataSAT
TT=277.095
T1=277.15
No dataSAT
TT=12.862
T1=5.4
? (TO)
TT=1800.54

SAT
TT=1.842
T1=0.8
SAT
TT=14.307
T1=14.29
SAT
TT=19.092
T1=19.08
SAT
TT=3.791
T1=3.77
SAT
TT=0.085
T1=0.08
SAT
TT=0.085
T1=0.08
No dataSAT
TT=274.497
T1=274.55
SAT
TT=263.587
T1=263.62
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_10_4_40.opb
SAT
TT=0.084
T1=0.08
SAT
TT=2.547
T1=2.54
SAT
TT=149.193
T1=149.22
No data? (problem)
TT=0.048

SAT
TT=0.963
T1=0.96
? (problem)
TT=0.045

SAT
TT=0.937
T1=0.93
? (problem)
TT=0.043

SAT
TT=0.936
T1=0.93
? (problem)
TT=0.046

SAT
TT=0.911
T1=0.91
? (TO)
TT=1800.09

SAT
TT=1.863
T1=1.86
SAT
TT=1.156
T1=1.06
SAT
TT=0.508
T1=0.51
?
TT=0.915

SAT
TT=1.556
T1=1.55
SAT
TT=6.983
T1=6.09
SAT
TT=16.31
T1=16.28
SAT
TT=219.506
T1=209.74
SAT
TT=0.489
T1=0.48
SAT
TT=9.355
T1=4.66
SAT
TT=15.733
T1=15.71
SAT
TT=0.67
T1=1.04
SAT
TT=8.772
T1=3.92
SAT
TT=66.869
T1=66.87
?
TT=0.006

? (problem)
TT=0.044

? (problem)
TT=0.049

No dataNo dataNo dataNo dataSAT
TT=650.548
T1=650.59
No dataNo dataNo dataSAT
TT=292.06
T1=292.21
No dataSAT
TT=8.084
T1=3.44
? (TO)
TT=1800.57

SAT
TT=2.246
T1=1.23
SAT
TT=13.205
T1=13.18
SAT
TT=13.45
T1=13.44
SAT
TT=33.356
T1=33.35
SAT
TT=0.084
T1=0.08
SAT
TT=0.088
T1=0.09
No dataSAT
TT=292.5
T1=292.54
SAT
TT=291.456
T1=291.51
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_25_2_40.opb



?
TT=1799.17

? (TO)
TT=1800.01

No data? (problem)
TT=0.07

? (TO)
TT=1800.02

? (problem)
TT=0.074

? (TO)
TT=1800.03

? (problem)
TT=0.07

? (TO)
TT=1800.02

? (problem)
TT=0.069

? (TO)
TT=1800.11

? (TO)
TT=1800.11

? (TO)
TT=1800.11

? (TO)
TT=1800.07

? (TO)
TT=1800.11

?
TT=1.734

?
TT=1798.02

? (TO)
TT=1800.04

? (TO)
TT=1800.28

?
TT=670.387

? (TO)
TT=1800.02

? (TO)
TT=1801.08

?
TT=1789.8

? (MO)
TT=1672.86

? (TO)
TT=1800.28

?
TT=1796.78

?
TT=0.009

? (problem)
TT=0.066

? (problem)
TT=0.072

No dataNo dataNo dataNo data?
TT=1799.81

No dataNo dataNo data?
TT=1799.76

No data? (TO)
TT=1800.01

? (TO)
TT=1800.84

? (TO)
TT=1800.51

?
TT=1796.77

?
TT=1796.73

?
TT=1796.78

? (TO)
TT=1800.06

? (TO)
TT=1800.11

No data?
TT=1799.48

?
TT=1799.4

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_25_3_15.opb
SAT
TT=0.209
T1=0.2
SAT
TT=18.464
T1=18.48
SAT
TT=2.665
T1=2.66
No data? (problem)
TT=0.07

SAT
TT=0.766
T1=0.76
? (problem)
TT=0.065

SAT
TT=0.76
T1=0.75
? (problem)
TT=0.07

SAT
TT=0.724
T1=0.72
? (problem)
TT=0.066

SAT
TT=0.734
T1=0.73
? (TO)
TT=1800.02

SAT
TT=0.612
T1=0.6
SAT
TT=0.857
T1=0.79
SAT
TT=0.277
T1=0.27
?
TT=1.772

SAT
TT=4.533
T1=4.53
SAT
TT=3.733
T1=2.84
SAT
TT=8.663
T1=8.62
No Cert.
TT=25.753

SAT
TT=0.677
T1=0.62
SAT
TT=9.873
T1=5.06
SAT
TT=9.771
T1=9.73
SAT
TT=0.933
T1=0.97
SAT
TT=8.633
T1=3.58
SAT
TT=17.467
T1=17.44
?
TT=0.007

? (problem)
TT=0.063

? (problem)
TT=0.073

No dataNo dataNo dataNo dataSAT
TT=0.376
T1=0.37
No dataNo dataNo dataSAT
TT=0.326
T1=0.32
No dataSAT
TT=9.023
T1=3.22
SAT
TT=768.89
T1=762.67
SAT
TT=2.305
T1=0.92
SAT
TT=8.762
T1=8.71
SAT
TT=0.373
T1=0.35
SAT
TT=1.89
T1=1.85
SAT
TT=0.209
T1=0.2
SAT
TT=0.21
T1=0.2
No dataSAT
TT=0.317
T1=0.31
SAT
TT=0.33
T1=0.32
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_25_5_15.opb
SAT
TT=0.186
T1=0.18
SAT
TT=18.689
T1=18.69
SAT
TT=3.251
T1=3.25
No data? (problem)
TT=0.072

SAT
TT=0.743
T1=0.74
? (problem)
TT=0.063

SAT
TT=0.703
T1=0.69
? (problem)
TT=0.061

SAT
TT=0.675
T1=0.67
? (problem)
TT=0.064

SAT
TT=0.699
T1=0.69
? (TO)
TT=1800.07

SAT
TT=0.775
T1=0.77
SAT
TT=0.763
T1=0.72
SAT
TT=0.297
T1=0.3
?
TT=1.814

SAT
TT=4.276
T1=4.27
SAT
TT=3.713
T1=2.74
SAT
TT=7.619
T1=7.57
SAT
TT=216.767
T1=207.27
SAT
TT=0.472
T1=0.42
SAT
TT=13.262
T1=7.29
SAT
TT=14.683
T1=14.65
SAT
TT=0.984
T1=1.8
SAT
TT=10.613
T1=4.62
SAT
TT=41.425
T1=41.4
?
TT=0.009

? (problem)
TT=0.061

? (problem)
TT=0.067

No dataNo dataNo dataNo dataSAT
TT=0.236
T1=0.23
No dataNo dataNo dataSAT
TT=0.226
T1=0.21
No dataSAT
TT=8.401
T1=3.11
SAT
TT=31.379
T1=30
SAT
TT=2.293
T1=0.92
SAT
TT=10.019
T1=9.98
SAT
TT=0.549
T1=0.52
SAT
TT=5.436
T1=5.38
SAT
TT=0.194
T1=0.19
SAT
TT=0.186
T1=0.18
No dataSAT
TT=0.225
T1=0.21
SAT
TT=0.225
T1=0.21
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_200_25_5_40.opb



?
TT=1798.01

? (TO)
TT=1800.01

No data? (problem)
TT=0.063

? (TO)
TT=1800.07

? (problem)
TT=0.065

? (TO)
TT=1800.09

? (problem)
TT=0.064

? (TO)
TT=1800

? (problem)
TT=0.072

? (TO)
TT=1800.11

? (TO)
TT=1800.1

? (TO)
TT=1800.05

? (TO)
TT=1800.06

? (TO)
TT=1800.11

?
TT=1.804

? (TO)
TT=1800.05

? (TO)
TT=1800.06

? (TO)
TT=1800.26

?
TT=670.877

? (TO)
TT=1800.04

? (TO)
TT=1800.99

?
TT=1789.93

? (MO)
TT=1620.27

? (TO)
TT=1800.55

?
TT=1796.77

?
TT=0.005

? (problem)
TT=0.065

? (problem)
TT=0.069

No dataNo dataNo dataNo data?
TT=1799.52

No dataNo dataNo data?
TT=1799.48

No data? (TO)
TT=1800.69

? (TO)
TT=1800.4

? (TO)
TT=1800.09

?
TT=1796.8

?
TT=1796.78

?
TT=1796.79

? (TO)
TT=1800.03

? (TO)
TT=1800.06

No data?
TT=1799.51

?
TT=1799.9

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_10_1_80.opb
SAT
TT=0.231
T1=0.23
SAT
TT=312.613
T1=312.76
SAT
TT=64.436
T1=64.46
No data? (problem)
TT=0.129

SAT
TT=2.747
T1=2.74
? (problem)
TT=0.127

SAT
TT=3.019
T1=3.01
? (problem)
TT=0.125

SAT
TT=2.796
T1=2.79
? (problem)
TT=0.134

SAT
TT=2.779
T1=2.77
? (TO)
TT=1800.08

SAT
TT=2.541
T1=2.53
SAT
TT=15.855
T1=15.77
SAT
TT=0.357
T1=0.35
?
TT=2.264

SAT
TT=312.464
T1=312.62
SAT
TT=10.043
T1=8.88
SAT
TT=49.404
T1=49.36
No Cert.
TT=6.834

SAT
TT=0.706
T1=0.64
SAT
TT=32.918
T1=17.2
SAT
TT=41.92
T1=41.89
SAT
TT=32.494
T1=32.5
SAT
TT=31.07
T1=15.18
SAT
TT=497.164
T1=497.22
?
TT=0.008

? (problem)
TT=0.128

? (problem)
TT=0.13

No dataNo dataNo dataNo dataSAT
TT=1418.78
T1=1419.25
No dataNo dataNo dataSAT
TT=108.34
T1=108.44
No dataSAT
TT=17.612
T1=7.65
? (TO)
TT=1800.39

SAT
TT=2.864
T1=1.28
SAT
TT=82.925
T1=82.89
SAT
TT=527.623
T1=527.69
SAT
TT=7.355
T1=7.3
SAT
TT=0.231
T1=0.23
SAT
TT=0.255
T1=0.25
No dataSAT
TT=113.657
T1=113.68
SAT
TT=106.1
T1=106.11
No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_10_2_15.opb
SAT
TT=0.026
T1=0.02
SAT
TT=3.69
T1=3.69
SAT
TT=0.026
T1=0.02
No data? (problem)
TT=0.124

SAT
TT=4.092
T1=4.11
? (problem)
TT=0.142

SAT
TT=3.91
T1=3.91
? (problem)
TT=0.12

SAT
TT=3.953
T1=3.95
? (problem)
TT=0.119

SAT
TT=4.278
T1=4.27
? (TO)
TT=1800.06

SAT
TT=1.711
T1=1.7
SAT
TT=9.71
T1=9.63
SAT
TT=0.339
T1=0.34
?
TT=2.245

SAT
TT=0.915
T1=0.91
SAT
TT=5.494
T1=4.43
SAT
TT=0.373
T1=0.33
SAT
TT=218.45
T1=208.49
SAT
TT=0.508
T1=0.44
SAT
TT=3.451
T1=3.08
SAT
TT=0.279
T1=0.24
SAT
TT=2.403
T1=2.36
SAT
TT=2.687
T1=1.12
SAT
TT=0.466
T1=0.44
?
TT=0.006

? (problem)
TT=0.143

? (problem)
TT=0.132

No dataNo dataNo dataNo dataSAT
TT=2.013
T1=2.01
No dataNo dataNo dataSAT
TT=1.912
T1=1.91
No dataSAT
TT=4.041
T1=1.65
SAT
TT=136.153
T1=133.22
SAT
TT=2.774
T1=1.24
SAT
TT=0.389
T1=0.46
SAT
TT=0.396
T1=0.36
SAT
TT=1.302
T1=1.25
SAT
TT=0.247
T1=0.24
SAT
TT=0.254
T1=0.25
No dataSAT
TT=1.908
T1=1.9
SAT
TT=1.908
T1=1.9
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_10_3_80.opb
SAT
TT=0.229
T1=0.22
?
TT=1798.01

SAT
TT=107.642
T1=107.66
No data? (problem)
TT=0.128

SAT
TT=2.94
T1=2.93
? (problem)
TT=0.129

SAT
TT=2.849
T1=2.84
? (problem)
TT=0.125

SAT
TT=2.546
T1=2.53
? (problem)
TT=0.129

SAT
TT=2.858
T1=2.85
? (TO)
TT=1800.05

SAT
TT=13.648
T1=13.64
SAT
TT=17.593
T1=17.53
SAT
TT=0.436
T1=0.43
?
TT=2.265

?
TT=1798.18

SAT
TT=5.424
T1=4.25
SAT
TT=54.744
T1=54.7
No Cert.
TT=4.207

SAT
TT=0.812
T1=0.75
SAT
TT=33.908
T1=17.2
SAT
TT=48.568
T1=48.55
SAT
TT=31.71
T1=31.72
SAT
TT=34.38
T1=16.66
SAT
TT=665.251
T1=665.32
?
TT=0.008

? (problem)
TT=0.125

? (problem)
TT=0.137

No dataNo dataNo dataNo dataSAT
TT=525.603
T1=525.62
No dataNo dataNo dataSAT
TT=244.163
T1=244.21
No dataSAT
TT=18.34
T1=8.13
SAT
TT=1672.65
T1=1593.7
SAT
TT=2.705
T1=1.14
SAT
TT=81.601
T1=81.56
SAT
TT=639.281
T1=639.36
SAT
TT=6.896
T1=6.82
SAT
TT=0.235
T1=0.23
SAT
TT=0.229
T1=0.22
No dataSAT
TT=244.005
T1=243.99
SAT
TT=240.61
T1=240.71
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_10_5_80.opb
SAT
TT=0.249
T1=0.24
?
TT=1798.01

SAT
TT=90.955
T1=90.97
No data? (problem)
TT=0.133

SAT
TT=2.649
T1=2.64
? (problem)
TT=0.125

SAT
TT=2.555
T1=2.75
? (problem)
TT=0.124

SAT
TT=2.552
T1=2.55
? (problem)
TT=0.131

SAT
TT=2.322
T1=2.31
? (TO)
TT=1800.03

SAT
TT=12.39
T1=12.38
SAT
TT=25.481
T1=25.4
SAT
TT=0.42
T1=0.41
?
TT=2.333

?
TT=1798.05

SAT
TT=10.292
T1=9.12
SAT
TT=52.06
T1=52.05
No Cert.
TT=22.407

SAT
TT=0.557
T1=0.49
SAT
TT=39.678
T1=20.1
SAT
TT=66.19
T1=66.17
SAT
TT=10.266
T1=10.27
SAT
TT=29.569
T1=14.66
SAT
TT=575.572
T1=575.64
?
TT=0.012

? (problem)
TT=0.124

? (problem)
TT=0.125

No dataNo dataNo dataNo dataSAT
TT=150.04
T1=150.12
No dataNo dataNo data?
TT=1799.53

No dataSAT
TT=16.25
T1=7.12
? (TO)
TT=1800.04

SAT
TT=3.572
T1=1.95
SAT
TT=85.651
T1=85.62
SAT
TT=589.344
T1=589.41
SAT
TT=8.395
T1=8.34
SAT
TT=0.249
T1=0.24
SAT
TT=0.257
T1=0.25
No data?
TT=1800.01

?
TT=1800.03

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_25_3_80.opb



?
TT=1798.13

? (TO)
TT=1800.1

No data? (problem)
TT=0.196

? (TO)
TT=1800.12

? (problem)
TT=0.178

? (TO)
TT=1800.05

? (problem)
TT=0.178

? (TO)
TT=1800.08

? (problem)
TT=0.186

? (TO)
TT=1800.06

? (TO)
TT=1800.16

? (TO)
TT=1800.1

?
TT=296.432

? (TO)
TT=1800.06

?
TT=9.575

?
TT=1798.06

?
TT=1491.66

?
TT=1796.52

No Cert.
TT=6.985

? (TO)
TT=1800.11

? (TO)
TT=1800.17

?
TT=1789.91

? (MO)
TT=1665.4

? (TO)
TT=1800.11

?
TT=1796.82

?
TT=0.008

? (problem)
TT=0.181

? (problem)
TT=0.176

No dataNo dataNo dataNo data?
TT=1799.4

No dataNo dataNo data?
TT=1799.77

No data? (TO)
TT=1800.09

? (TO)
TT=1800.69

? (TO)
TT=1800.03

?
TT=1796.83

?
TT=1796.79

?
TT=1796.87

? (TO)
TT=1800.1

? (TO)
TT=1800.02

No data?
TT=1799.86

?
TT=1799.42

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_25_5_15.opb
SAT
TT=0.093
T1=0.09
SAT
TT=70.063
T1=70.07
SAT
TT=0.093
T1=0.09
No data? (problem)
TT=0.176

SAT
TT=3.82
T1=4.14
? (problem)
TT=0.164

SAT
TT=3.692
T1=3.67
? (problem)
TT=0.166

SAT
TT=3.307
T1=3.3
? (problem)
TT=0.173

SAT
TT=3.719
T1=3.71
SAT
TT=132.632
T1=132.66
SAT
TT=3.036
T1=3.02
SAT
TT=4.769
T1=4.56
SAT
TT=1.423
T1=1.42
?
TT=9.594

SAT
TT=12.236
T1=12.23
SAT
TT=18.462
T1=17.05
SAT
TT=4.307
T1=4.17
No Cert.
TT=5.704

SAT
TT=1.421
T1=1.1
SAT
TT=14.671
T1=14.22
SAT
TT=19.09
T1=19
SAT
TT=3.648
T1=2.35
SAT
TT=3.554
T1=1.41
SAT
TT=618.504
T1=618.56
?
TT=0.007

? (problem)
TT=0.166

? (problem)
TT=0.169

No dataNo dataNo dataNo dataSAT
TT=2.306
T1=2.3
No dataNo dataNo dataSAT
TT=2.157
T1=2.15
No dataSAT
TT=4.233
T1=1.45
SAT
TT=306.129
T1=301.2
SAT
TT=3.843
T1=2.03
SAT
TT=26.773
T1=26.67
SAT
TT=280.737
T1=280.73
SAT
TT=3.735
T1=3.62
SAT
TT=0.629
T1=0.62
SAT
TT=0.579
T1=0.57
No dataSAT
TT=2.155
T1=2.14
SAT
TT=2.154
T1=2.14
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_25_5_80.opb



?
TT=1798

? (TO)
TT=1800.09

No data? (problem)
TT=0.185

? (TO)
TT=1800.12

? (problem)
TT=0.18

? (TO)
TT=1800.05

? (problem)
TT=0.18

? (TO)
TT=1800.09

? (problem)
TT=0.182

? (TO)
TT=1800.09

? (TO)
TT=1800.03

? (TO)
TT=1800.04

?
TT=588.674

? (TO)
TT=1800.09

?
TT=9.703

?
TT=1798.06

? (exit code)
TT=1024.36

?
TT=1796.92

No Cert.
TT=16.933

? (TO)
TT=1800.06

? (TO)
TT=1800.03

?
TT=1789.87

? (MO)
TT=1661.52

? (TO)
TT=1800.14

?
TT=1796.8

?
TT=0.007

? (problem)
TT=0.18

? (problem)
TT=0.179

No dataNo dataNo dataNo data?
TT=1799.81

No dataNo dataNo data?
TT=1799.46

No data? (TO)
TT=1800.71

? (TO)
TT=1807.68

? (TO)
TT=1800.75

?
TT=1796.83

?
TT=1796.8

?
TT=1796.88

? (TO)
TT=1800.1

? (TO)
TT=1800.1

No data?
TT=1799.81

?
TT=1799.94

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_60_4_15.opb
SAT
TT=1.278
T1=1.27
SAT
TT=179.401
T1=179.42
SAT
TT=8.914
T1=8.9
No data? (problem)
TT=0.303

SAT
TT=3.002
T1=3.12
? (problem)
TT=0.292

SAT
TT=3.177
T1=3.16
? (problem)
TT=0.289

SAT
TT=2.998
T1=3.15
? (problem)
TT=0.292

SAT
TT=2.981
T1=2.96
? (TO)
TT=1800.11

SAT
TT=9.272
T1=9.25
SAT
TT=7.732
T1=7.3
SAT
TT=6.273
T1=6.26
?
TT=90.2

SAT
TT=179.373
T1=179.39
SAT
TT=131.19
T1=129.64
SAT
TT=97.452
T1=97.14
?
TT=670.039

SAT
TT=5.628
T1=3.97
SAT
TT=115.316
T1=114.17
SAT
TT=94.362
T1=94.07
SAT
TT=6.8
T1=7.36
SAT
TT=3.481
T1=1.58
SAT
TT=228.218
T1=228.16
?
TT=0.009

? (problem)
TT=0.28

? (problem)
TT=0.291

No dataNo dataNo dataNo dataSAT
TT=3.539
T1=3.53
No dataNo dataNo dataSAT
TT=13.249
T1=13.26
No dataSAT
TT=4.739
T1=1.89
SAT
TT=984.01
T1=979.82
SAT
TT=4.092
T1=2.05
SAT
TT=74.527
T1=74.28
SAT
TT=248.499
T1=248.43
SAT
TT=34.483
T1=34.22
SAT
TT=1.278
T1=1.27
SAT
TT=1.337
T1=1.33
No dataSAT
TT=12.576
T1=12.58
SAT
TT=12.317
T1=12.33
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_500_60_5_15.opb
SAT
TT=1.222
T1=1.21
SAT
TT=179.392
T1=179.43
SAT
TT=13.812
T1=13.8
No data? (problem)
TT=0.302

SAT
TT=3.971
T1=3.96
? (problem)
TT=0.3

SAT
TT=4.338
T1=4.4
? (problem)
TT=0.286

SAT
TT=4.029
T1=4.12
? (problem)
TT=0.291

SAT
TT=4.036
T1=4.15
? (TO)
TT=1800.1

SAT
TT=7.125
T1=7.1
SAT
TT=7.72
T1=7.28
SAT
TT=6.273
T1=6.26
?
TT=92.36

SAT
TT=179.349
T1=179.37
SAT
TT=133.54
T1=132
SAT
TT=53.156
T1=52.94
?
TT=672.918

SAT
TT=4.827
T1=3.13
SAT
TT=164.45
T1=163.39
SAT
TT=118.291
T1=118.05
SAT
TT=7.349
T1=7.25
SAT
TT=3.513
T1=1.57
SAT
TT=415.978
T1=415.94
?
TT=0.008

? (problem)
TT=0.288

? (problem)
TT=0.294

No dataNo dataNo dataNo dataSAT
TT=6.053
T1=6.05
No dataNo dataNo dataSAT
TT=3.945
T1=4.03
No dataSAT
TT=4.862
T1=1.91
SAT
TT=435.29
T1=431.85
SAT
TT=4.214
T1=2.14
SAT
TT=91.793
T1=91.55
SAT
TT=235.167
T1=235.12
SAT
TT=39.769
T1=39.5
SAT
TT=1.222
T1=1.21
SAT
TT=1.326
T1=1.31
No dataSAT
TT=3.822
T1=3.92
SAT
TT=3.663
T1=3.64
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_10_1_15.opb
UNSAT
TT=1448.34

? (TO)
TT=1800.12

? (TO)
TT=1800.01

No data? (problem)
TT=0.008

? (TO)
TT=1800.13

? (problem)
TT=0.009

? (TO)
TT=1800.09

? (problem)
TT=0.008

? (TO)
TT=1800.09

? (problem)
TT=0.009

? (TO)
TT=1800.1

? (TO)
TT=1800.08

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.03

?
TT=0.334

?
TT=1798

? (TO)
TT=1800.68

? (TO)
TT=1800.23

No Cert.
TT=41.172

UNSAT
TT=1448.34

? (TO)
TT=1800.12

?
TT=1789.74

? (MO)
TT=1687.49

? (TO)
TT=1800.16

?
TT=1796.7

?
TT=0.005

? (problem)
TT=0.011

? (problem)
TT=0.009

No dataNo dataNo dataNo data?
TT=1799.42

No dataNo dataNo data?
TT=1799.51

No data? (TO)
TT=1800.09

? (TO)
TT=1800.05

? (TO)
TT=1800.58

?
TT=1796.74

?
TT=1796.86

?
TT=1796.75

? (TO)
TT=1800.06

? (TO)
TT=1800.09

No data?
TT=1799.61

?
TT=1799.82

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_10_2_5.opb
SAT
TT=0.004
T1=0
SAT
TT=0.25
T1=0.25
SAT
TT=0.004
T1=0
No data? (problem)
TT=0.008

SAT
TT=0.166
T1=0.16
? (problem)
TT=0.011

SAT
TT=0.158
T1=0.15
? (problem)
TT=0.009

SAT
TT=0.155
T1=0.15
? (problem)
TT=0.009

SAT
TT=0.156
T1=0.15
SAT
TT=6.863
T1=6.86
SAT
TT=0.058
T1=0.05
SAT
TT=0.09
T1=0.07
SAT
TT=0.016
T1=0.01
?
TT=0.333

SAT
TT=0.066
T1=0.06
SAT
TT=0.656
T1=0.34
SAT
TT=0.104
T1=0.09
No Cert.
TT=1.109

SAT
TT=0.035
T1=0.03
SAT
TT=0.554
T1=1.25
SAT
TT=0.139
T1=0.13
SAT
TT=0.522
T1=0.58
SAT
TT=0.513
T1=0.74
SAT
TT=0.074
T1=0.06
?
TT=0.005

? (problem)
TT=0.009

? (problem)
TT=0.008

No dataNo dataNo dataNo dataSAT
TT=0.005
T1=0.01
No dataNo dataNo dataSAT
TT=0.005
T1=0.01
No dataSAT
TT=0.563
T1=0.74
SAT
TT=1.194
T1=0.66
SAT
TT=0.564
T1=0.31
SAT
TT=0.358
T1=0.35
SAT
TT=0.111
T1=0.1
SAT
TT=0.083
T1=0.07
SAT
TT=0.02
T1=0.02
SAT
TT=0.019
T1=0.01
No dataSAT
TT=0.005
T1=0.01
SAT
TT=0.007
T1=0.01
No data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_10_3_15.opb
UNSAT
TT=1448.56

?
TT=1798.01

? (TO)
TT=1800.03

No data? (problem)
TT=0.011

? (TO)
TT=1800.13

? (problem)
TT=0.013

? (TO)
TT=1800.06

? (problem)
TT=0.009

? (TO)
TT=1800.08

? (problem)
TT=0.009

? (TO)
TT=1800.09

? (TO)
TT=1800.07

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.02

?
TT=0.323

?
TT=1798.01

? (TO)
TT=1800.57

? (TO)
TT=1800.25

?
TT=671.901

UNSAT
TT=1448.56

? (TO)
TT=1800.12

?
TT=1789.74

? (MO)
TT=1687.16

? (TO)
TT=1800.04

?
TT=1796.8

?
TT=0.005

? (problem)
TT=0.008

? (problem)
TT=0.011

No dataNo dataNo dataNo data? (TO)
TT=1800.04

No dataNo dataNo data?
TT=1799.42

No data? (TO)
TT=1800.03

? (TO)
TT=1800.02

? (TO)
TT=1800.05

?
TT=1796.76

?
TT=1796.76

UNSAT
TT=1536.8

? (TO)
TT=1800.07

? (TO)
TT=1800.04

No data?
TT=1799.83

?
TT=1799.38

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_10_3_5.opb
SAT
TT=0.005
T1=0
SAT
TT=0.241
T1=0.24
SAT
TT=0.005
T1=0
No data? (problem)
TT=0.006

SAT
TT=0.162
T1=0.16
? (problem)
TT=0.008

SAT
TT=0.152
T1=0.15
? (problem)
TT=0.007

SAT
TT=0.154
T1=0.15
? (problem)
TT=0.009

SAT
TT=0.153
T1=0.15
SAT
TT=48.752
T1=48.77
SAT
TT=0.068
T1=0.06
SAT
TT=0.089
T1=0.08
SAT
TT=0.015
T1=0.01
?
TT=0.345

SAT
TT=0.065
T1=0.06
SAT
TT=0.715
T1=0.37
SAT
TT=0.114
T1=0.1
No Cert.
TT=0.925

SAT
TT=0.033
T1=0.03
SAT
TT=0.585
T1=1.25
SAT
TT=0.192
T1=0.18
SAT
TT=0.535
T1=1.37
SAT
TT=0.534
T1=0.76
SAT
TT=0.077
T1=0.07
?
TT=0.005

? (problem)
TT=0.009

? (problem)
TT=0.009

No dataNo dataNo dataNo dataSAT
TT=0.007
T1=0.01
No dataNo dataNo dataSAT
TT=0.005
T1=0.01
No dataSAT
TT=0.533
T1=0.76
SAT
TT=0.794
T1=0.49
SAT
TT=0.585
T1=0.33
SAT
TT=0.551
T1=0.54
SAT
TT=0.094
T1=0.08
SAT
TT=0.082
T1=0.07
SAT
TT=0.02
T1=0.02
SAT
TT=0.022
T1=0.02
No dataSAT
TT=0.006
T1=0.01
SAT
TT=0.006
T1=0.01
No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_10_5_15.opb
UNSAT
TT=1561.61

?
TT=1798.01

? (TO)
TT=1800.03

No data? (problem)
TT=0.008

? (TO)
TT=1800.12

? (problem)
TT=0.011

? (TO)
TT=1800.1

? (problem)
TT=0.008

? (TO)
TT=1800.08

? (problem)
TT=0.009

? (TO)
TT=1800.08

? (TO)
TT=1800.07

? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1800.1

?
TT=0.315

?
TT=1798.01

? (TO)
TT=1800.27

? (TO)
TT=1800.33

No Cert.
TT=1.157

UNSAT
TT=1561.61

? (TO)
TT=1801.19

?
TT=1789.75

? (MO)
TT=1687.56

? (TO)
TT=1801

?
TT=1796.76

?
TT=0.008

? (problem)
TT=0.01

? (problem)
TT=0.011

No dataNo dataNo dataNo data? (TO)
TT=1800.43

No dataNo dataNo data?
TT=1799.95

No data? (TO)
TT=1800.04

? (TO)
TT=1800.06

? (TO)
TT=1800.48

?
TT=1796.76

?
TT=1796.76

?
TT=1796.72

? (TO)
TT=1800.07

? (TO)
TT=1800.09

No data?
TT=1799.95

?
TT=1799.54

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_25_3_15.opb
UNSAT
TT=0.835

UNSAT
TT=245.466

UNSAT
TT=10.779

No data? (problem)
TT=0.014

UNSAT
TT=27.828

? (problem)
TT=0.015

UNSAT
TT=28.05

? (problem)
TT=0.014

UNSAT
TT=29.25

? (problem)
TT=0.013

UNSAT
TT=27.66

? (TO)
TT=1800.03

UNSAT
TT=11.291

UNSAT
TT=30.261

UNSAT
TT=7.145

?
TT=0.676

UNSAT
TT=154.437

UNSAT
TT=302.33

UNSAT
TT=8.532

UNSAT
TT=438.522

UNSAT
TT=12.902

UNSAT
TT=88.172

UNSAT
TT=51.652

UNSAT
TT=14.5

UNSAT
TT=85.001

UNSAT
TT=0.835

?
TT=0.006

? (problem)
TT=0.014

? (problem)
TT=0.015

No dataNo dataNo dataNo dataUNSAT
TT=1040.63

No dataNo dataNo dataUNSAT
TT=787.39

No dataUNSAT
TT=59.116

UNSAT
TT=29.753

UNSAT
TT=43.108

UNSAT
TT=21.498

UNSAT
TT=1.095

UNSAT
TT=27.036

UNSAT
TT=409.303

UNSAT
TT=425.136

No dataUNSAT
TT=845.612

UNSAT
TT=843.49

No data
normalized-PB07/SATUNSAT-SMALLINT-NLC/
submittedPB07/manquinho/dbsg/
normalized-dbsg_50_25_5_15.opb
UNSAT
TT=0.743

UNSAT
TT=339.693

UNSAT
TT=10.669

No data? (problem)
TT=0.014

UNSAT
TT=24.499

? (problem)
TT=0.016

UNSAT
TT=24.26

? (problem)
TT=0.014

UNSAT
TT=24.51

? (problem)
TT=0.015

UNSAT
TT=24.35

? (TO)
TT=1800.04

UNSAT
TT=17.291

UNSAT
TT=32.317

UNSAT
TT=7.033

?
TT=0.676

UNSAT
TT=345.558

UNSAT
TT=776.17

UNSAT
TT=8.144

UNSAT
TT=437.671

UNSAT
TT=13.288

UNSAT
TT=56.267

UNSAT
TT=40.638

UNSAT
TT=15.546

UNSAT
TT=55.886

UNSAT
TT=0.743

?
TT=0.009

? (problem)
TT=0.014

? (problem)
TT=0.012

No dataNo dataNo dataNo dataUNSAT
TT=1130

No dataNo dataNo dataUNSAT
TT=832.39

No dataUNSAT
TT=40.147

UNSAT
TT=27.93

UNSAT
TT=54.594

UNSAT
TT=24.403

UNSAT
TT=0.756

UNSAT
TT=28.352

UNSAT
TT=565.021

UNSAT
TT=541.678

No dataUNSAT
TT=706.539

UNSAT
TT=807.97

No data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_1000_5__369_766__1024.opb
SAT
f=1465935
TT=1803.37
T1=957.36
No dataNo dataNo data? (MO)

TT=205.88

? (problem)

TT=293.351

? (MO)

TT=209.45

? (problem)

TT=296.444

? (MO)

TT=207.62

? (problem)

TT=293.685

? (MO)

TT=211.7

? (problem)

TT=293.939

Signal

TT=8.245

Signal

TT=1541.53

No dataNo data? (exit code)

TT=146.59

No data? (exit code)

TT=117.916

No dataNo dataNo data?

TT=113.82

? (exit code)

TT=1644.57

No data? (TO)

TT=1800.2

No data? (TO)

TT=1800.07

? (MO)

TT=76.92

? (MO)

TT=76.47

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (exit code)

TT=743.62

SAT (TO)
f=1465935
TT=1803.37
T1=957.36
? (TO)

TT=1800.28

No dataNo dataNo data? (exit code)

TT=97.797

? (TO)

TT=1800.59

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_1000_5__369_766__128.opb
SAT
f=128918
TT=1801.22
T1=12.8
No dataNo dataNo data? (problem)

TT=29.746

? (MO)

TT=162.15

? (problem)

TT=27.92

? (MO)

TT=161.76

? (problem)

TT=28.71

? (MO)

TT=164.28

? (problem)

TT=28.52

? (MO)

TT=164.16

SAT (TO)
f=129849
TT=1800.24
T1=1765.76
? (TO)

TT=1800.12

No dataNo data?

TT=667.26

No data? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=154204
TT=1800.68
T1=659.93
OPT
f=87132
TT=1522.86
T1=1512.06
No dataSAT (TO)
f=164220
TT=1801.01
T1=269.35
No data? (TO)

TT=1800.01

? (MO)

TT=142.74

? (MO)

TT=142.71

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=288574
TT=1800.77
T1=110.96
SAT (TO)
f=557252
TT=1800.63
T1=118.84
SAT (TO)
f=128918
TT=1801.22
T1=12.8
No dataNo dataNo data? (exit code)

TT=12.895

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_1000_5__369_766__2048.opb




No dataNo dataNo data? (MO)

TT=147.19

? (problem)

TT=47.638

? (MO)

TT=144.93

No data? (MO)

TT=145.08

? (problem)

TT=47.67

? (MO)

TT=144.93

? (problem)

TT=48.378

Signal

TT=17.284

Signal

TT=326.514

No dataNo data? (TO)

TT=1802.49

No data?

TT=42.02

No dataNo dataNo data?

TT=49.98

? (MO)

TT=507.265

No data?

TT=966.587

No data? (TO)

TT=1800.02

? (MO)

TT=113.61

? (MO)

TT=110.84

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1802.35

? (exit code)

TT=828.95

?

TT=1169.39

No dataNo dataNo data? (exit code)

TT=194.887

? (exit code)

TT=244.515

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_1000_5__369_766__32.opb
SAT
f=123243
TT=1800.17
T1=18.5
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.09

SAT (TO)
f=199612
TT=1800.13
T1=9.34
? (TO)

TT=1800.04

No dataNo dataSAT (TO)
f=28546359
TT=1804.13
T1=1489.03
No dataSAT (TO)
f=29654920
TT=1800.03
T1=157.35
No dataNo dataNo dataSAT (TO)
f=123243
TT=1800.72
T1=20.78
OPT
f=87132
TT=321.601
T1=273.89
No dataSAT (TO)
f=123243
TT=1800.17
T1=18.5
No data? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=132571
TT=1800.03
T1=9.65
SAT (TO)
f=132571
TT=1800.11
T1=7.47
SAT (TO)
f=23551044
TT=1800.02
T1=1561.08
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_1000_5__369_766__8.opb
SAT
f=174384
TT=1800.53
T1=522.46
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.02

SAT (TO)
f=171215
TT=1800.07
T1=1554.87
Signal

TT=1134.07

No dataNo dataSAT (TO)
f=24897717
TT=1802.48
T1=813.49
No dataSAT (TO)
f=25734724
TT=1800.07
T1=1383.64
No dataNo dataNo dataSAT (TO)
f=191341
TT=1800.05
T1=662.37
OPT
f=87132
TT=65.979
T1=65.78
No dataSAT (TO)
f=174384
TT=1800.53
T1=522.46
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=716742
TT=1800.1
T1=4.29
SAT (TO)
f=838244
TT=1800.01
T1=7.04
SAT (TO)
f=2060970
TT=1800.05
T1=1.5
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_100_3__3_91__16.opb
OPT
f=70998
TT=1571.21
T1=8.82
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.07

OPT
f=70998
TT=1571.21
T1=1235.99
? (TO)

TT=1800.1

OPT
f=70998
TT=1781
T1=1403.76
SAT (TO)
f=71837
TT=1800.09
T1=983.73
SAT (TO)
f=2321871
TT=1800.09
T1=1309.32
No dataNo dataSAT (TO)
f=70998
TT=1800.5
T1=8.82
No dataSAT (TO)
f=70998
TT=1800.08
T1=54.27
No dataNo dataNo dataSAT (TO)
f=70998
TT=1800.12
T1=17.41
OPT
f=70998
TT=0.79
T1=0.77
No dataSAT (TO)
f=70998
TT=1800.52
T1=33.34
No dataSAT (TO)
f=1858465
TT=1800.11
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=70998
TT=1800.86
T1=39.81
SAT (TO)
f=70998
TT=1800.95
T1=140.87
SAT (TO)
f=70998
TT=1800.08
T1=1312.38
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_100_3__3_91__64.opb
SAT
f=72709
TT=1800.5
T1=1051.45
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.15

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.11

SAT (TO)
f=98605
TT=1800.11
T1=137.44
SAT (TO)
f=2753599
TT=1800.12
T1=25.02
No dataNo dataSAT (TO)
f=2279334
TT=1800.5
T1=482.11
No dataSAT (TO)
f=2229197
TT=1800.1
T1=263.27
No dataNo dataNo dataSAT (TO)
f=72709
TT=1800.5
T1=1051.45
OPT
f=70998
TT=3.482
T1=3.41
No dataSAT (TO)
f=72735
TT=1800.19
T1=105.26
No dataSAT (TO)
f=2325531
TT=1800.07
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=226397
TT=1800.12
T1=1.22
SAT (TO)
f=226397
TT=1800.04
T1=0.87
SAT (TO)
f=102488
TT=1800.47
T1=1018.58
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_100_3__3_91.opb
OPT
f=70998
TT=0.285
T1=0.03
No dataNo dataNo dataOPT
f=70998
TT=6.423
T1=3.63
OPT
f=70998
TT=6.554
T1=1.84
? (problem)

TT=0.044

OPT
f=70998
TT=6.643
T1=1.68
? (problem)

TT=0.047

OPT
f=70998
TT=6.732
T1=6.45
? (problem)

TT=0.046

OPT
f=70998
TT=6.986
T1=6.7
OPT
f=70998
TT=0.087
T1=0.08
OPT
f=70998
TT=852.106
T1=543.85
No dataNo dataOPT
f=70998
TT=0.564
T1=0.23
No dataOPT
f=70998
TT=0.769
T1=0.26
No dataNo dataNo dataOPT
f=70998
TT=1.693
T1=4.18
OPT
f=70998
TT=0.075
T1=0.07
No dataOPT
f=70998
TT=1.275
T1=2.2
No dataOPT
f=70998
TT=216.003
T1=216.04
OPT
f=70998
TT=13.273
T1=8.22
OPT
f=70998
TT=154.391
T1=154.08
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=70998
TT=1.186
T1=2.2
OPT
f=70998
TT=0.545
T1=0.2
OPT
f=70998
TT=0.465
T1=0.27
No dataNo dataNo dataOPT
f=70998
TT=0.285
T1=0.03
OPT
f=70998
TT=0.281
T1=0.03
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_2000_5__647_1792__256.opb
SAT
f=201611
TT=1801.59
T1=67.27
No dataNo dataNo data? (problem)

TT=124.179

? (problem)

TT=179.65

? (problem)

TT=118.83

? (problem)

TT=179.67

? (problem)

TT=115.74

? (problem)

TT=179.221

? (problem)

TT=115.14

? (problem)

TT=179.755

Signal

TT=3.904

? (TO)

TT=1800.11

No dataNo data? (exit code)

TT=155.429

No data?

TT=129.615

No dataNo dataNo data? (exit code)

TT=130.43

?

TT=1799.56

No data? (TO)

TT=1800.08

No data? (TO)

TT=1800.09

? (MO)

TT=276.97

? (MO)

TT=276.79

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2089990
TT=1802.37
T1=342.2
SAT (TO)
f=1051338
TT=1801.12
T1=509.2
SAT (TO)
f=201611
TT=1801.59
T1=67.27
No dataNo dataNo data? (exit code)

TT=48.554

? (TO)

TT=1800.31

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_2000_5__647_1792__32.opb
SAT
f=121608
TT=1801.06
T1=174.34
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.44

SAT (TO)
f=204162
TT=1800.17
T1=26.26
? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.32

No data? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=121608
TT=1801.06
T1=174.34
OPT
f=74222
TT=705.557
T1=695.1
No dataSAT (TO)
f=251954
TT=1800.46
T1=1420.43
No data? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=1809772
TT=1801.06
T1=69.2
SAT (TO)
f=606194
TT=1800.31
T1=12.51
? (TO)

TT=1800.8

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_2000_5__647_1792__8.opb
SAT
f=129834
TT=1800.04
T1=230.3
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.01

SAT (TO)
f=129950
TT=1800.08
T1=468.16
? (TO)

TT=1800.1

No dataNo dataNo Cert.

TT=1802.45

No data? (exit code)

TT=1690.86

No dataNo dataNo dataSAT (TO)
f=131144
TT=1800.05
T1=69.28
OPT
f=74222
TT=92.935
T1=92.41
No dataSAT (TO)
f=129834
TT=1800.04
T1=230.3
No data? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4931381
TT=1800.18
T1=79.07
SAT (TO)
f=729258
TT=1800.03
T1=9.81
SAT (TO)
f=409838
TT=1800.04
T1=2.85
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__1024.opb
OPT
f=46877
TT=5.363
T1=0.83
No dataNo dataNo data? (TO)

TT=1800.06

? (problem)

TT=10.525

? (TO)

TT=1800.11

? (problem)

TT=10.28

? (TO)

TT=1800.07

? (problem)

TT=10.18

? (TO)

TT=1800.09

? (problem)

TT=10.34

SAT (TO)
f=46877
TT=1800.04
T1=179.28
Signal

TT=194.745

No dataNo dataSAT (TO)
f=46877
TT=1801.49
T1=66.87
No dataSAT (TO)
f=46877
TT=1800.04
T1=86.64
No dataNo dataNo dataOPT
f=46877
TT=7.634
T1=3.37
OPT
f=46877
TT=12.827
T1=12.69
No dataOPT
f=46877
TT=6.827
T1=2.93
No dataNo Cert.

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=5.363
T1=1.84
SAT (TO)
f=46877
TT=1800.07
T1=8.06
SAT (TO)
f=46877
TT=1800.57
T1=0.83
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__128.opb
OPT
f=46877
TT=2.734
T1=0.54
No dataNo dataNo dataOPT
f=46877
TT=575.365
T1=244.41
OPT
f=46877
TT=335.317
T1=50.67
OPT
f=46877
TT=582.034
T1=242.96
OPT
f=46877
TT=336.896
T1=50.46
? (TO)

TT=1800.07

OPT
f=46877
TT=130.564
T1=100.58
? (TO)

TT=1800.04

OPT
f=46877
TT=134.537
T1=104.33
OPT
f=46877
TT=226.736
T1=62.83
SAT (TO)
f=390213
TT=1800.08
T1=898.42
No dataNo dataOPT
f=46877
TT=287.39
T1=0.88
No dataOPT
f=46877
TT=252.05
T1=0.95
No dataNo dataNo dataOPT
f=46877
TT=2.903
T1=1.36
OPT
f=46877
TT=1.152
T1=1.13
No dataOPT
f=46877
TT=3.106
T1=0.98
No dataOPT
f=46877
TT=832.464
T1=832.64
OPT
f=46877
TT=469.289
T1=185.9
? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=2.734
T1=0.95
OPT
f=46877
TT=57.78
T1=0.54
OPT
f=46877
TT=145.981
T1=85.5
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__16.opb
OPT
f=46877
TT=0.764
T1=0.06
No dataNo dataNo dataOPT
f=46877
TT=8.684
T1=2.39
OPT
f=46877
TT=9.433
T1=0.65
OPT
f=46877
TT=8.808
T1=2.29
OPT
f=46877
TT=9.504
T1=0.65
OPT
f=46877
TT=30.13
T1=29.14
OPT
f=46877
TT=3.326
T1=2.59
? (TO)

TT=1800.08

OPT
f=46877
TT=3.465
T1=2.71
OPT
f=46877
TT=21.241
T1=21.12
OPT
f=46877
TT=1075.13
T1=1075.05
No dataNo dataOPT
f=46877
TT=0.764
T1=0.28
No dataOPT
f=46877
TT=1.155
T1=0.26
No dataNo dataNo dataOPT
f=46877
TT=1.142
T1=1.21
OPT
f=46877
TT=0.082
T1=0.05
No dataOPT
f=46877
TT=1.084
T1=0.73
No dataOPT
f=46877
TT=62.035
T1=62.03
OPT
f=46877
TT=9.47
T1=2.81
OPT
f=46877
TT=26.903
T1=25.97
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=1.126
T1=0.73
OPT
f=46877
TT=0.933
T1=0.23
OPT
f=46877
TT=1.755
T1=0.8
No dataNo dataNo dataOPT
f=46877
TT=1.913
T1=0.06
OPT
f=46877
TT=1.876
T1=0.06
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__256.opb
OPT
f=46877
TT=3.305
T1=0.7
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

SAT (TO)
f=46877
TT=1800.11
T1=247.35
SAT (TO)
f=419043
TT=1800.11
T1=1797.06
No dataNo dataSAT (TO)
f=46877
TT=1800.8
T1=1.64
No dataSAT (TO)
f=46877
TT=1800.01
T1=2.42
No dataNo dataNo dataOPT
f=46877
TT=3.854
T1=1.5
OPT
f=46877
TT=2.261
T1=2.23
No dataOPT
f=46877
TT=3.594
T1=1.13
No dataSAT (TO)
f=249718
TT=1800.01
T1=1800.5
? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=3.305
T1=1.06
OPT
f=46877
TT=1484.24
T1=0.7
OPT
f=46877
TT=356.559
T1=0.85
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__32.opb
OPT
f=46877
TT=1.477
T1=0.22
No dataNo dataNo dataOPT
f=46877
TT=37.489
T1=10.48
OPT
f=46877
TT=28.314
T1=2.41
OPT
f=46877
TT=36.922
T1=9.88
OPT
f=46877
TT=28.666
T1=2.29
OPT
f=46877
TT=131.226
T1=123.88
OPT
f=46877
TT=16.923
T1=14.57
? (TO)

TT=1800.12

OPT
f=46877
TT=16.608
T1=14.29
OPT
f=46877
TT=143.645
T1=139.39
OPT
f=46877
TT=1233.11
T1=1232.62
No dataNo dataOPT
f=46877
TT=2.075
T1=0.4
No dataOPT
f=46877
TT=2.804
T1=0.41
No dataNo dataNo dataOPT
f=46877
TT=1.566
T1=1.25
OPT
f=46877
TT=0.251
T1=0.2
No dataOPT
f=46877
TT=1.477
T1=0.76
No dataOPT
f=46877
TT=696.432
T1=696.6
OPT
f=46877
TT=40.05
T1=12.32
OPT
f=46877
TT=108.107
T1=105.45
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=1.496
T1=0.77
OPT
f=46877
TT=1.525
T1=0.3
OPT
f=46877
TT=2.135
T1=0.83
No dataNo dataNo dataOPT
f=46877
TT=43.829
T1=0.22
OPT
f=46877
TT=43.418
T1=0.31
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__512.opb
OPT
f=46877
TT=3.722
T1=1.12
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.14

? (TO)

TT=1800.15

? (TO)

TT=1800.1

? (TO)

TT=1800.05

SAT (TO)
f=46877
TT=1800.02
T1=91.85
SAT (TO)
f=558116
TT=1800.11
T1=36.57
No dataNo dataSAT (TO)
f=46877
TT=1800.89
T1=6.45
No dataSAT (TO)
f=46877
TT=1800.82
T1=6.97
No dataNo dataNo dataOPT
f=46877
TT=4.004
T1=1.67
OPT
f=46877
TT=4.725
T1=4.67
No dataOPT
f=46877
TT=3.722
T1=1.27
No dataSAT (TO)
f=286228
TT=1800.1
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=3.802
T1=1.12
SAT (TO)
f=46877
TT=1800.04
T1=1.61
SAT (TO)
f=238030
TT=1800.66
T1=1565.22
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12__8.opb
OPT
f=46877
TT=0.102
T1=0.02
No dataNo dataNo dataOPT
f=46877
TT=2.966
T1=0.59
OPT
f=46877
TT=1.85
T1=0.33
OPT
f=46877
TT=2.834
T1=0.55
OPT
f=46877
TT=1.682
T1=0.29
OPT
f=46877
TT=15.461
T1=15.28
OPT
f=46877
TT=1.296
T1=1.12
? (TO)

TT=1800.12

OPT
f=46877
TT=1.377
T1=1.2
OPT
f=46877
TT=0.016
T1=0.01
OPT
f=46877
TT=129.824
T1=129.64
No dataNo dataOPT
f=46877
TT=0.487
T1=0.22
No dataOPT
f=46877
TT=0.485
T1=0.19
No dataNo dataNo dataOPT
f=46877
TT=0.683
T1=1.18
OPT
f=46877
TT=0.047
T1=0.02
No dataOPT
f=46877
TT=0.433
T1=0.69
No dataOPT
f=46877
TT=24.594
T1=24.58
OPT
f=46877
TT=2.988
T1=0.6
OPT
f=46877
TT=21.61
T1=21.45
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=0.505
T1=0.69
OPT
f=46877
TT=0.454
T1=0.18
OPT
f=46877
TT=1.254
T1=0.58
No dataNo dataNo dataOPT
f=46877
TT=0.102
T1=0.02
OPT
f=46877
TT=0.102
T1=0.02
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_20_2__17_12.opb
OPT
f=46877
TT=0.003
T1=0
No dataNo dataNo dataOPT
f=46877
TT=0.23
T1=0.08
OPT
f=46877
TT=0.272
T1=0.06
? (problem)

TT=0.012

? (problem)

TT=0.033

? (problem)

TT=0.012

? (problem)

TT=0.072

? (problem)

TT=0.013

? (TO)

TT=1800.1

OPT
f=46877
TT=0.003
T1=0
OPT
f=46877
TT=54.892
T1=54.89
No dataNo dataOPT
f=46877
TT=0.145
T1=0.12
No dataOPT
f=46877
TT=0.143
T1=0.11
No dataNo dataNo dataOPT
f=46877
TT=0.166
T1=1.12
OPT
f=46877
TT=0.04
T1=0.03
No dataOPT
f=46877
TT=0.164
T1=0.63
No dataOPT
f=46877
TT=2.702
T1=2.7
OPT
f=46877
TT=0.141
T1=0.02
OPT
f=46877
TT=0.063
T1=0.05
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=46877
TT=0.182
T1=0.63
OPT
f=46877
TT=0.153
T1=0.12
OPT
f=46877
TT=0.172
T1=0.13
No dataNo dataNo dataOPT
f=46877
TT=0.003
T1=0
OPT
f=46877
TT=0.004
T1=0
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_3000_5__126_2812__128.opb
SAT
f=365451
TT=1802.06
T1=178.52
No dataNo dataNo data? (problem)

TT=90.968

? (problem)

TT=149.731

? (problem)

TT=84.93

? (problem)

TT=159.691

? (problem)

TT=87.11

? (problem)

TT=146.802

? (problem)

TT=87.96

? (problem)

TT=146.917

Signal

TT=2.584

? (TO)

TT=1800.09

No dataNo data? (exit code)

TT=782.673

No data?

TT=62.356

No dataNo dataNo data? (exit code)

TT=118.27

OPT
f=60720
TT=1536.84
T1=1530.08
No data? (TO)

TT=1800.04

No data? (TO)

TT=1800.07

? (problem)

TT=224.765

? (MO)

TT=154.48

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=365451
TT=1802.06
T1=178.52
SAT (TO)
f=947061
TT=1801.61
T1=131.55
? (TO)

TT=1800.88

No dataNo dataNo data? (exit code)

TT=35.83

? (TO)

TT=1800.18

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_500_3__212_366__32.opb
SAT
f=107914
TT=1800.06
T1=3.5
No dataNo dataNo data? (TO)

TT=1800.08

? (problem)

TT=1027.93

? (TO)

TT=1800.04

? (problem)

TT=813.72

? (TO)

TT=1800.03

? (problem)

TT=886.85

? (TO)

TT=1801.23

? (problem)

TT=798.51

SAT (TO)
f=209107
TT=1800.05
T1=1692.31
Signal

TT=447.548

No dataNo data? (TO)

TT=1802.07

No dataSAT (TO)
f=14066486
TT=1800.7
T1=450.27
No dataNo dataNo dataSAT (TO)
f=107914
TT=1800.06
T1=4.14
OPT
f=95378
TT=13.136
T1=12.9
No dataSAT (TO)
f=107914
TT=1800.07
T1=3.5
No data? (TO)

TT=1800

? (TO)

TT=1800.08

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2093853
TT=1800.95
T1=3.86
SAT (TO)
f=2724425
TT=1800.93
T1=3.32
SAT (TO)
f=113351
TT=1800.37
T1=488.15
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_500_3__212_366__512.opb
SAT
f=95378
TT=1800.85
T1=17.13
No dataNo dataNo data? (problem)

TT=35.733

? (problem)

TT=112.912

? (problem)

TT=34.91

? (problem)

TT=112.787

? (problem)

TT=35.2

? (problem)

TT=114.905

? (problem)

TT=34.13

? (problem)

TT=113.362

SAT (TO)
f=264480
TT=1800.18
T1=252.01
? (TO)

TT=1800.03

No dataNo data?

TT=594.82

No data? (TO)

TT=1800.59

No dataNo dataNo data? (TO)

TT=1802.09

OPT
f=95378
TT=583.734
T1=579.83
No dataSAT (TO)
f=185820
TT=1800.79
T1=567.62
No data? (TO)

TT=1800.05

? (MO)

TT=161.08

? (MO)

TT=164.84

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=95378
TT=1801.28
T1=28.9
SAT (TO)
f=95378
TT=1800.85
T1=17.13
? (TO)

TT=1800.1

No dataNo dataNo data? (exit code)

TT=14.848

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_500_3__212_366__64.opb
SAT
f=95378
TT=1800.48
T1=662.29
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.05

SAT (TO)
f=316033
TT=1800.14
T1=47.17
Signal

TT=1439.91

No dataNo dataNo Cert.

TT=1802.04

No dataSAT (TO)
f=14989592
TT=1800.07
T1=585.25
No dataNo dataNo dataSAT (TO)
f=95378
TT=1800.48
T1=662.29
OPT
f=95378
TT=29.711
T1=29.35
No dataSAT (TO)
f=113351
TT=1800.89
T1=235.96
No data? (exit code)

TT=1150.32

? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=107914
TT=1801.02
T1=3.21
SAT (TO)
f=107914
TT=1800.1
T1=1.97
SAT (TO)
f=13569565
TT=1800.08
T1=401.5
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_500_3__212_366.opb
OPT
f=95378
TT=1.873
T1=0.99
No dataNo dataNo dataOPT
f=95378
TT=148.7
T1=36.23
OPT
f=95378
TT=216.545
T1=105.86
? (problem)

TT=0.166

OPT
f=95378
TT=213.539
T1=103.55
? (problem)

TT=0.164

? (TO)

TT=1800.06

? (problem)

TT=0.166

? (TO)

TT=1800.04

OPT
f=95378
TT=0.798
T1=0.79
SAT (TO)
f=6042887
TT=1800.02
T1=1600.02
No dataNo dataOPT
f=95378
TT=4.923
T1=3.75
No dataOPT
f=95378
TT=3.215
T1=2.03
No dataNo dataNo dataOPT
f=95378
TT=4.055
T1=5.29
OPT
f=95378
TT=0.281
T1=0.27
No dataOPT
f=95378
TT=3.304
T1=2.83
No dataSAT (TO)
f=4015993
TT=1800.03
T1=1800.61
? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=95378
TT=3.432
T1=2.81
OPT
f=95378
TT=1.873
T1=0.99
OPT
f=95378
TT=7.785
T1=6.49
No dataNo dataNo dataOPT
f=95378
TT=11.201
T1=10.88
OPT
f=95378
TT=11.004
T1=10.67
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_50_2__8_45__128.opb
OPT
f=45008
TT=3.463
T1=0.52
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.09

OPT
f=45008
TT=19.853
T1=4.43
SAT (TO)
f=1195958
TT=1800.12
T1=11.06
No dataNo dataOPT
f=45008
TT=82
T1=25.55
No dataSAT (TO)
f=72813
TT=1800.07
T1=6.85
No dataNo dataNo dataOPT
f=45008
TT=4.213
T1=2.67
OPT
f=45008
TT=2.83
T1=2.78
No dataOPT
f=45008
TT=3.463
T1=1.13
No dataSAT (TO)
f=597831
TT=1800.06
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=45008
TT=3.783
T1=1.62
SAT (TO)
f=72813
TT=1800.08
T1=0.69
OPT
f=45008
TT=3.554
T1=0.52
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_50_2__8_45__16.opb
OPT
f=45008
TT=1.004
T1=0.28
No dataNo dataNo dataOPT
f=45008
TT=80.541
T1=61.63
OPT
f=45008
TT=18.964
T1=5.53
OPT
f=45008
TT=81.227
T1=62.06
OPT
f=45008
TT=19.678
T1=5.77
? (TO)

TT=1800.07

OPT
f=45008
TT=36.422
T1=35.31
? (TO)

TT=1800.17

OPT
f=45008
TT=38.23
T1=37.05
OPT
f=45008
TT=0.066
T1=0.03
SAT (TO)
f=610789
TT=1800.09
T1=1643.58
No dataNo dataOPT
f=45008
TT=4.923
T1=4.07
No dataOPT
f=45008
TT=10.422
T1=9.54
No dataNo dataNo dataOPT
f=45008
TT=2.143
T1=2.3
OPT
f=45008
TT=0.246
T1=0.23
No dataOPT
f=45008
TT=1.874
T1=1.28
No dataSAT (TO)
f=104087
TT=1800.01
T1=1800.3
OPT
f=45008
TT=113.955
T1=87.99
OPT
f=45008
TT=1169.32
T1=1166.54
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=45008
TT=1.904
T1=1.28
OPT
f=45008
TT=1.764
T1=1.06
OPT
f=45008
TT=1.004
T1=0.28
No dataNo dataNo dataOPT
f=45008
TT=245.517
T1=243.27
OPT
f=45008
TT=242.844
T1=240.6
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_50_2__8_45__256.opb
OPT
f=45008
TT=4.973
T1=0.72
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.1

OPT
f=45008
TT=94.437
T1=30.8
SAT (TO)
f=1077114
TT=1800.11
T1=36.79
No dataNo dataOPT
f=45008
TT=783.555
T1=342.5
No dataSAT (TO)
f=72813
TT=1800.01
T1=6.09
No dataNo dataNo dataOPT
f=45008
TT=6.173
T1=3.35
OPT
f=45008
TT=6.927
T1=6.85
No dataOPT
f=45008
TT=5.832
T1=2.43
No dataSAT (TO)
f=450492
TT=1800.03
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=45008
TT=4.973
T1=1.87
OPT
f=45008
TT=42.658
T1=24.74
OPT
f=45008
TT=19.802
T1=0.72
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_50_2__8_45__32.opb
OPT
f=45008
TT=1.495
T1=0.37
No dataNo dataNo dataOPT
f=45008
TT=333.363
T1=252.67
OPT
f=45008
TT=310.933
T1=249.14
OPT
f=45008
TT=377.713
T1=286.72
OPT
f=45008
TT=350.883
T1=282.32
? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.06

OPT
f=45008
TT=0.254
T1=0.11
SAT (TO)
f=770496
TT=1800.02
T1=1756.48
No dataNo dataOPT
f=45008
TT=26.45
T1=24.6
No dataOPT
f=45008
TT=50.735
T1=49
No dataNo dataNo dataOPT
f=45008
TT=2.764
T1=2.34
OPT
f=45008
TT=0.576
T1=0.56
No dataOPT
f=45008
TT=2.564
T1=1.41
No dataSAT (TO)
f=655550
TT=1800.06
T1=1800.5
OPT
f=45008
TT=354.366
T1=236.14
? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=45008
TT=2.713
T1=1.39
OPT
f=45008
TT=20.771
T1=19.59
OPT
f=45008
TT=1.495
T1=0.37
No dataNo dataNo dataOPT
f=45008
TT=1637.18
T1=1626.53
OPT
f=45008
TT=1632.6
T1=1621.95
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_50_2__8_45__512.opb
OPT
f=45008
TT=6.733
T1=0.85
No dataNo dataNo data? (TO)

TT=1800.07

? (problem)

TT=187.548

? (TO)

TT=1800.08

? (problem)

TT=188.01

? (TO)

TT=1800

? (problem)

TT=170.17

? (TO)

TT=1800.11

? (problem)

TT=170.37

OPT
f=45008
TT=712.493
T1=179.26
Signal

TT=253.363

No dataNo dataSAT (TO)
f=72813
TT=1802.3
T1=32.14
No dataSAT (TO)
f=72813
TT=1800.74
T1=110.11
No dataNo dataNo dataOPT
f=45008
TT=10.651
T1=7.2
OPT
f=45008
TT=20.006
T1=19.79
No dataOPT
f=45008
TT=9.843
T1=5.3
No dataNo Cert.

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=45008
TT=6.733
T1=3.03
SAT (TO)
f=72813
TT=1800.07
T1=2.41
OPT
f=45008
TT=165.009
T1=0.85
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_50_2__8_45__64.opb
OPT
f=45008
TT=1.764
T1=0.44
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.54

? (TO)

TT=1800

OPT
f=45008
TT=87.485
T1=0.64
SAT (TO)
f=881437
TT=1800.02
T1=1187.77
No dataNo dataOPT
f=45008
TT=299.74
T1=291.45
No dataOPT
f=45008
TT=29.21
T1=22.87
No dataNo dataNo dataOPT
f=45008
TT=3.572
T1=2.43
OPT
f=45008
TT=1.247
T1=1.22
No dataOPT
f=45008
TT=2.653
T1=0.98
No dataSAT (TO)
f=620691
TT=1800.04
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=45008
TT=2.876
T1=1.53
OPT
f=45008
TT=64.788
T1=61.79
OPT
f=45008
TT=1.764
T1=0.44
No dataNo dataNo dataOPT
f=45008
TT=279.721
T1=4.97
OPT
f=45008
TT=275.867
T1=4.81
No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.01-2.opb
SAT
f=96575
TT=1800.28
T1=8.83
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (problem)

TT=11.36

? (TO)

TT=1800.07

? (problem)

TT=12.01

? (TO)

TT=1800.11

? (problem)

TT=11.35

? (TO)

TT=1800.1

SAT (TO)
f=292958
TT=1800.26
T1=161.57
SAT (TO)
f=1099366
TT=1800.07
T1=14.33
No dataNo data? (exit code)

TT=596.68

No data? (exit code)

TT=687.348

No dataNo dataNo dataSAT (TO)
f=172687
TT=1800.95
T1=52.98
?

TT=1792.01

No dataSAT (TO)
f=181394
TT=1800.91
T1=59.08
No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=100656
TT=1800.4
T1=9.53
SAT (TO)
f=96575
TT=1800.28
T1=8.83
SAT (TO)
f=144191
TT=1800.65
T1=7.26
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.01-4.opb
SAT
f=111124
TT=1800.41
T1=10.93
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (problem)

TT=11.26

? (TO)

TT=1800.04

? (problem)

TT=11.73

? (TO)

TT=1800.09

? (problem)

TT=11.86

? (TO)

TT=1800.02

SAT (TO)
f=377796
TT=1800.18
T1=119.25
SAT (TO)
f=1234752
TT=1800.12
T1=14.44
No dataNo dataNo Cert.

TT=1802.04

No data? (exit code)

TT=882.78

No dataNo dataNo dataSAT (TO)
f=183731
TT=1800.39
T1=37.79
?

TT=1791.84

No dataSAT (TO)
f=214542
TT=1801.01
T1=13.29
No dataNo Cert.

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=111124
TT=1800.41
T1=10.93
SAT (TO)
f=122161
TT=1800.6
T1=8.81
SAT (TO)
f=265657
TT=1800.09
T1=7.72
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.01-5.opb
SAT
f=124485
TT=1800.36
T1=7.96
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (problem)

TT=11.32

? (TO)

TT=1800.09

? (problem)

TT=11.64

? (TO)

TT=1800.01

? (problem)

TT=11.22

? (TO)

TT=1800.05

SAT (TO)
f=282513
TT=1800.19
T1=107.13
SAT (TO)
f=1164467
TT=1800.08
T1=13.5
No dataNo data? (exit code)

TT=720.32

No data? (exit code)

TT=532.6

No dataNo dataNo dataSAT (TO)
f=169794
TT=1800.43
T1=36.35
?

TT=1792.41

No dataSAT (TO)
f=189551
TT=1801.01
T1=41.42
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=129125
TT=1800.55
T1=14.94
SAT (TO)
f=124485
TT=1800.36
T1=7.96
SAT (TO)
f=215107
TT=1800.88
T1=7
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.10-10.opb
SAT
f=119257
TT=1800.4
T1=908.92
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (problem)

TT=15.48

? (TO)

TT=1800.09

? (problem)

TT=15.36

? (TO)

TT=1800.05

? (problem)

TT=14.86

? (TO)

TT=1800.07

SAT (TO)
f=396403
TT=1800.09
T1=119.9
SAT (TO)
f=1198752
TT=1800.15
T1=21.33
No dataNo data? (exit code)

TT=651.025

No data? (exit code)

TT=664.27

No dataNo dataNo dataSAT (TO)
f=211642
TT=1800.43
T1=18.72
?

TT=1793.51

No dataSAT (TO)
f=279049
TT=1800.57
T1=21.81
No dataNo Cert.

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=119257
TT=1800.4
T1=908.92
SAT (TO)
f=135534
TT=1800.34
T1=10.62
SAT (TO)
f=140134
TT=1800.37
T1=10.5
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.10-7.opb
SAT
f=116344
TT=1800.35
T1=11.62
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (problem)

TT=16.54

? (TO)

TT=1800.01

? (problem)

TT=16.59

? (TO)

TT=1800.06

? (problem)

TT=16.05

? (TO)

TT=1800.09

SAT (TO)
f=398147
TT=1800.13
T1=104.16
SAT (TO)
f=1208629
TT=1800.15
T1=23.78
No dataNo data? (exit code)

TT=473.32

No data? (exit code)

TT=567.499

No dataNo dataNo dataSAT (TO)
f=313936
TT=1800.53
T1=24.87
?

TT=1793.71

No dataSAT (TO)
f=214544
TT=1801.16
T1=23.31
No dataNo Cert.

TT=1800

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=125648
TT=1801.03
T1=16.93
SAT (TO)
f=116344
TT=1800.35
T1=11.62
SAT (TO)
f=184292
TT=1801.06
T1=10.8
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb1-0.01-2.opb
SAT
f=6443
TT=1800.64
T1=358.59
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (problem)

TT=11.27

? (TO)

TT=1800.03

? (problem)

TT=11.65

? (TO)

TT=1800.01

? (problem)

TT=11.52

? (TO)

TT=1800.02

SAT (TO)
f=284191
TT=1800.2
T1=68.15
SAT (TO)
f=1153931
TT=1800.11
T1=14.75
No dataNo data? (exit code)

TT=1183.56

No data? (exit code)

TT=941.58

No dataNo dataNo dataSAT (TO)
f=139513
TT=1801.26
T1=25.49
?

TT=1791.54

No dataSAT (TO)
f=111052
TT=1801.62
T1=57.94
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6443
TT=1800.64
T1=358.59
SAT (TO)
f=7017
TT=1800.07
T1=864.79
SAT (TO)
f=96509
TT=1800.06
T1=7.38
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.20-11.opb
SAT
f=126821
TT=1800.09
T1=100.87
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (problem)

TT=20.35

? (TO)

TT=1800.06

? (problem)

TT=20.84

? (TO)

TT=1800.08

? (problem)

TT=20.04

? (TO)

TT=1800.02

SAT (TO)
f=507393
TT=1800.11
T1=112.25
SAT (TO)
f=1392886
TT=1800.17
T1=37.75
No dataNo data? (exit code)

TT=532.67

No dataNo Cert.

TT=543.52

No dataNo dataNo dataSAT (TO)
f=301736
TT=1800.45
T1=29.17
? (TO)

TT=1802.23

No dataSAT (TO)
f=247101
TT=1800.77
T1=18.51
No dataNo Cert.

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=159952
TT=1800.57
T1=53.81
SAT (TO)
f=126821
TT=1800.09
T1=100.87
SAT (TO)
f=325495
TT=1800.32
T1=15.32
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.20-13.opb
SAT
f=96022
TT=1800.31
T1=14.25
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (problem)

TT=19.89

? (TO)

TT=1800.03

? (problem)

TT=20.43

? (TO)

TT=1800.09

? (problem)

TT=19.89

? (TO)

TT=1800.02

SAT (TO)
f=415579
TT=1800.17
T1=153.62
SAT (TO)
f=1360949
TT=1800.11
T1=34.95
No dataNo data? (exit code)

TT=860.283

No data? (exit code)

TT=581.25

No dataNo dataNo dataSAT (TO)
f=263959
TT=1800.39
T1=25.63
? (TO)

TT=1802.17

No dataSAT (TO)
f=234883
TT=1800.44
T1=36.08
No dataNo Cert.

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=109964
TT=1800.71
T1=32.55
SAT (TO)
f=96022
TT=1800.31
T1=14.25
SAT (TO)
f=308063
TT=1800.08
T1=14.3
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.20-14.opb
SAT
f=132621
TT=1800.64
T1=15.41
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (problem)

TT=20.56

? (TO)

TT=1800.1

? (problem)

TT=20.35

? (TO)

TT=1800.08

? (problem)

TT=20.52

? (TO)

TT=1800.06

SAT (TO)
f=423696
TT=1800.12
T1=121.49
SAT (TO)
f=1225553
TT=1800.14
T1=34.36
No dataNo dataNo Cert.

TT=1802.92

No data? (exit code)

TT=559.651

No dataNo dataNo dataSAT (TO)
f=256973
TT=1800.43
T1=32.62
? (TO)

TT=1802.26

No dataSAT (TO)
f=261611
TT=1801.07
T1=25.93
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=134385
TT=1800.46
T1=21.58
SAT (TO)
f=132621
TT=1800.64
T1=15.41
SAT (TO)
f=359764
TT=1800.34
T1=14.38
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb1-0.10-8.opb
SAT
f=9927
TT=1800.05
T1=879.38
No dataNo dataNo data? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (problem)

TT=16.34

? (TO)

TT=1800.07

? (problem)

TT=16.31

? (TO)

TT=1800.06

? (problem)

TT=16.93

? (TO)

TT=1800.03

SAT (TO)
f=350446
TT=1800.16
T1=140.78
SAT (TO)
f=1264926
TT=1800.16
T1=24.87
No dataNo data? (exit code)

TT=733.6

No data? (exit code)

TT=645.427

No dataNo dataNo dataSAT (TO)
f=208136
TT=1801.08
T1=18.23
?

TT=1793.19

No dataSAT (TO)
f=207542
TT=1800.94
T1=38.51
No dataNo Cert.

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=9927
TT=1800.05
T1=879.38
SAT (TO)
f=12833
TT=1800.05
T1=445.41
SAT (TO)
f=140663
TT=1800.86
T1=10.78
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb1-0.20-13.opb
SAT
f=11676
TT=1800.9
T1=205.94
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (problem)

TT=20.22

? (TO)

TT=1800.04

? (problem)

TT=20.83

? (TO)

TT=1800.06

? (problem)

TT=20.19

? (TO)

TT=1800.1

SAT (TO)
f=347562
TT=1800.15
T1=102.88
SAT (TO)
f=1179607
TT=1800.16
T1=34.49
No dataNo dataNo Cert.

TT=832.27

No data? (exit code)

TT=805.46

No dataNo dataNo dataSAT (TO)
f=150017
TT=1800.94
T1=29.88
? (TO)

TT=1802.23

No dataSAT (TO)
f=205807
TT=1800.4
T1=19.14
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=11676
TT=1800.9
T1=205.94
SAT (TO)
f=37849
TT=1800.03
T1=1090.04
SAT (TO)
f=235398
TT=1800.47
T1=15.09
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb1-0.20-15.opb
SAT
f=7604
TT=1800.07
T1=700.63
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (problem)

TT=22.33

? (TO)

TT=1800.1

? (problem)

TT=22.23

? (TO)

TT=1800.04

? (problem)

TT=22.37

? (TO)

TT=1800.04

SAT (TO)
f=359158
TT=1800.22
T1=102.31
SAT (TO)
f=1579370
TT=1800.17
T1=37.15
No dataNo data? (exit code)

TT=591.27

No data? (exit code)

TT=656.534

No dataNo dataNo dataSAT (TO)
f=302284
TT=1800.45
T1=25.7
? (TO)

TT=1802.19

No dataSAT (TO)
f=251715
TT=1801.03
T1=28
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=9349
TT=1800.54
T1=57.24
SAT (TO)
f=7604
TT=1800.07
T1=700.63
SAT (TO)
f=197613
TT=1800.36
T1=16.34
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.01-1.opb
SAT
f=57026
TT=1800.78
T1=297.7
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (problem)

TT=11.31

? (TO)

TT=1800.05

? (problem)

TT=10.71

? (TO)

TT=1800.11

? (problem)

TT=10.81

? (TO)

TT=1800.01

SAT (TO)
f=274335
TT=1800.1
T1=133.73
SAT (TO)
f=1183020
TT=1800.12
T1=14.61
No dataNo data? (exit code)

TT=802.77

No data? (exit code)

TT=743.042

No dataNo dataNo data? (TO)

TT=1802.33

?

TT=1791.83

No dataSAT (TO)
f=208696
TT=1800.39
T1=17.7
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=68641
TT=1801.02
T1=9.05
SAT (TO)
f=57026
TT=1800.78
T1=297.7
SAT (TO)
f=248192
TT=1800.22
T1=6.92
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.01-2.opb
SAT
f=70991
TT=1800.39
T1=12.49
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (problem)

TT=12.65

? (TO)

TT=1800.02

? (problem)

TT=13.14

? (TO)

TT=1800.06

? (problem)

TT=12.7

? (TO)

TT=1800.04

SAT (TO)
f=346397
TT=1800.15
T1=109.77
SAT (TO)
f=1373004
TT=1800.13
T1=15.96
No dataNo data? (exit code)

TT=651.07

No data? (exit code)

TT=705.67

No dataNo dataNo dataSAT (TO)
f=196500
TT=1800.46
T1=40.03
?

TT=1792.28

No dataSAT (TO)
f=198826
TT=1800.54
T1=63.28
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=75651
TT=1800.53
T1=431.03
SAT (TO)
f=70991
TT=1800.39
T1=12.49
SAT (TO)
f=198235
TT=1800.07
T1=8.5
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.01-5.opb
SAT
f=40763
TT=1800.11
T1=43.83
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (problem)

TT=10.95

? (TO)

TT=1800.1

? (problem)

TT=11.3

? (TO)

TT=1800.02

? (problem)

TT=10.86

? (TO)

TT=1800.01

SAT (TO)
f=226106
TT=1800.17
T1=102.37
SAT (TO)
f=1094126
TT=1800.1
T1=13.36
No dataNo dataNo Cert.

TT=1802.64

No data? (exit code)

TT=681.64

No dataNo dataNo dataSAT (TO)
f=175576
TT=1800.5
T1=19.47
?

TT=1791.85

No dataSAT (TO)
f=145939
TT=1800.54
T1=65.58
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=48314
TT=1800.75
T1=633.72
SAT (TO)
f=40763
TT=1800.11
T1=43.83
SAT (TO)
f=143024
TT=1800.35
T1=6.91
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.10-10.opb
SAT
f=41334
TT=1800.44
T1=337.26
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (problem)

TT=15.4

? (TO)

TT=1800.03

? (problem)

TT=15.25

? (TO)

TT=1800.05

? (problem)

TT=14.8

? (TO)

TT=1800.06

SAT (TO)
f=367308
TT=1800.08
T1=82.94
SAT (TO)
f=1167351
TT=1800.17
T1=21.74
No dataNo dataNo Cert.

TT=1802.07

No data? (exit code)

TT=651.886

No dataNo dataNo dataSAT (TO)
f=188952
TT=1800.51
T1=18.43
?

TT=1794.07

No dataSAT (TO)
f=218581
TT=1800.46
T1=25.22
No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=41334
TT=1800.44
T1=337.26
SAT (TO)
f=80280
TT=1800.33
T1=10.68
SAT (TO)
f=209833
TT=1800.03
T1=10.01
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.10-7.opb
SAT
f=71569
TT=1800.11
T1=256.42
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (problem)

TT=14.91

? (TO)

TT=1800.01

? (problem)

TT=14.59

? (TO)

TT=1800.07

? (problem)

TT=14.72

? (TO)

TT=1800.05

SAT (TO)
f=384738
TT=1800.24
T1=69.26
SAT (TO)
f=1170855
TT=1800.12
T1=20.73
No dataNo data? (exit code)

TT=644.91

No data? (exit code)

TT=755.52

No dataNo dataNo dataSAT (TO)
f=167441
TT=1801.4
T1=27.59
?

TT=1793.21

No dataSAT (TO)
f=177910
TT=1800.51
T1=19.06
No dataNo Cert.

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=91916
TT=1800.98
T1=93.46
SAT (TO)
f=71569
TT=1800.11
T1=256.42
SAT (TO)
f=177309
TT=1800.12
T1=10.15
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.10-8.opb
SAT
f=58780
TT=1800.38
T1=17.65
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (problem)

TT=16.16

? (TO)

TT=1800.09

? (problem)

TT=16.14

? (TO)

TT=1800.08

? (problem)

TT=15.63

? (TO)

TT=1800.08

SAT (TO)
f=216235
TT=1800.12
T1=122.16
SAT (TO)
f=1353268
TT=1800.06
T1=23.03
No dataNo data? (exit code)

TT=874.64

No data? (exit code)

TT=651.964

No dataNo dataNo dataSAT (TO)
f=247058
TT=1800.37
T1=53.79
? (TO)

TT=1802.15

No dataSAT (TO)
f=246492
TT=1800.83
T1=32.16
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=58780
TT=1800.38
T1=17.65
SAT (TO)
f=59952
TT=1800.46
T1=604.55
SAT (TO)
f=197628
TT=1800.05
T1=10.99
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.10-9.opb
SAT
f=89020
TT=1800.4
T1=11.06
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800

? (problem)

TT=15.03

? (TO)

TT=1800.05

? (problem)

TT=15.52

? (TO)

TT=1800.06

? (problem)

TT=15.47

? (TO)

TT=1800.03

SAT (TO)
f=337101
TT=1800.13
T1=97.66
SAT (TO)
f=1162130
TT=1800.14
T1=21.82
No dataNo dataNo Cert.

TT=1802.33

No data? (exit code)

TT=618.23

No dataNo dataNo dataSAT (TO)
f=154673
TT=1800.94
T1=14.49
?

TT=1793.33

No dataNo Cert.

TT=1801.62

No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=101205
TT=1800.44
T1=211.9
SAT (TO)
f=89020
TT=1800.4
T1=11.06
SAT (TO)
f=192420
TT=1800.05
T1=9.8
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.12

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.E.recomb10-0.20-11.opb
SAT
f=15750
TT=1800.03
T1=4.44
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (problem)

TT=5.49

? (problem)

TT=5.28

? (problem)

TT=5.63

? (problem)

TT=5.67

? (problem)

TT=5.48

? (problem)

TT=5.31

SAT (TO)
f=76447
TT=1800.18
T1=24.37
SAT (TO)
f=289549
TT=1800.1
T1=8.3
No dataNo data? (exit code)

TT=413.14

No data? (exit code)

TT=604.633

No dataNo dataNo dataSAT (TO)
f=48506
TT=1801.24
T1=5.37
?

TT=1791.21

No dataSAT (TO)
f=69326
TT=1800.19
T1=8.57
No dataNo Cert.

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=17111
TT=1800.05
T1=574.72
SAT (TO)
f=15750
TT=1800.03
T1=4.44
SAT (TO)
f=41651
TT=1800.09
T1=4.07
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.E.recomb10-0.20-14.opb
SAT
f=19841
TT=1800.15
T1=7.42
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.95

? (problem)

TT=6.14

? (problem)

TT=6.07

? (problem)

TT=6.34

? (problem)

TT=6.11

? (problem)

TT=6.18

? (problem)

TT=6.01

SAT (TO)
f=75433
TT=1800.07
T1=46.76
SAT (TO)
f=301831
TT=1800.05
T1=9.95
No dataNo data? (exit code)

TT=372.04

No data? (exit code)

TT=500.837

No dataNo dataNo dataSAT (TO)
f=60085
TT=1800.13
T1=13.7
?

TT=1791.51

No dataSAT (TO)
f=69324
TT=1800.74
T1=7.49
No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=19841
TT=1800.15
T1=7.42
SAT (TO)
f=22915
TT=1800.04
T1=5.64
SAT (TO)
f=20155
TT=1800.03
T1=4.42
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.F.recomb10-0.01-1.opb
SAT
f=11978
TT=1800.06
T1=524.2
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (problem)

TT=3.44

? (problem)

TT=3.28

? (problem)

TT=3.59

? (problem)

TT=3.17

? (problem)

TT=3.45

? (problem)

TT=3.19

SAT (TO)
f=39940
TT=1800.05
T1=16.88
SAT (TO)
f=261249
TT=1800.11
T1=4.67
No dataNo data? (exit code)

TT=856.1

No dataSAT (TO)
f=40656
TT=1800.07
T1=4.15
No dataNo dataNo dataSAT (TO)
f=21186
TT=1800.12
T1=12.35
?

TT=1790.48

No dataSAT (TO)
f=23576
TT=1800.03
T1=5.06
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=13686
TT=1800.52
T1=894.12
SAT (TO)
f=11978
TT=1800.06
T1=524.2
SAT (TO)
f=26644
TT=1800
T1=2.87
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.F.recomb10-0.10-10.opb
SAT
f=10963
TT=1800.1
T1=4.62
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (problem)

TT=4.54

? (problem)

TT=4.28

? (problem)

TT=4.54

? (problem)

TT=4.18

? (problem)

TT=4.41

? (problem)

TT=4.18

SAT (TO)
f=48470
TT=1800.05
T1=12.05
SAT (TO)
f=271480
TT=1800.07
T1=5.92
No dataNo dataNo Cert.

TT=1802.06

No dataNo Cert.

TT=663.44

No dataNo dataNo dataSAT (TO)
f=23586
TT=1800.57
T1=4.74
?

TT=1790.54

No dataSAT (TO)
f=23586
TT=1800.81
T1=4.08
No dataNo Cert.

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=10963
TT=1800.1
T1=4.62
SAT (TO)
f=12331
TT=1800.08
T1=216.3
SAT (TO)
f=17432
TT=1800.82
T1=3.39
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.F.recomb10-0.10-7.opb
SAT
f=12334
TT=1800.74
T1=164.7
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (problem)

TT=4.62

? (problem)

TT=4.61

? (problem)

TT=4.74

? (problem)

TT=4.36

? (problem)

TT=4.61

? (problem)

TT=4.47

SAT (TO)
f=49841
TT=1800.12
T1=24.6
SAT (TO)
f=294350
TT=1800.08
T1=6.47
No dataNo dataNo Cert.

TT=455.667

No data? (exit code)

TT=585.86

No dataNo dataNo dataSAT (TO)
f=42353
TT=1800.13
T1=10.61
?

TT=1790.59

No dataSAT (TO)
f=34839
TT=1800.15
T1=6.95
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=12334
TT=1800.74
T1=164.7
SAT (TO)
f=14386
TT=1800.08
T1=3.85
SAT (TO)
f=22553
TT=1800.07
T1=3.57
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.F.recomb10-0.10-9.opb
SAT
f=8223
TT=1800.83
T1=17.27
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (problem)

TT=4.16

? (problem)

TT=3.77

? (problem)

TT=3.94

? (problem)

TT=3.74

? (problem)

TT=4

? (problem)

TT=3.97

SAT (TO)
f=48819
TT=1800.11
T1=21.68
SAT (TO)
f=256826
TT=1800.12
T1=5.42
No dataNo dataNo Cert.

TT=850.126

No data? (exit code)

TT=820.91

No dataNo dataNo dataSAT (TO)
f=17093
TT=1800.18
T1=8.78
?

TT=1790.76

No dataSAT (TO)
f=24594
TT=1800.94
T1=14.68
No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.15

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=8223
TT=1800.83
T1=17.27
SAT (TO)
f=8224
TT=1800.01
T1=1548.86
SAT (TO)
f=62796
TT=1800.07
T1=3.26
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
OPT-BIGINT-LIN/graca/
normalized-ped3.F.recomb10-0.20-12.opb
SAT
f=13019
TT=1800.03
T1=319.09
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (problem)

TT=4.89

? (problem)

TT=4.7

? (problem)

TT=5.07

? (problem)

TT=4.82

? (problem)

TT=4.94

? (problem)

TT=4.82

SAT (TO)
f=77133
TT=1800.1
T1=19.54
SAT (TO)
f=272177
TT=1800.05
T1=8.02
No dataNo data? (exit code)

TT=337.89

No data? (exit code)

TT=418.57

No dataNo dataNo dataSAT (TO)
f=39968
TT=1801.04
T1=7.35
?

TT=1790.92

No dataSAT (TO)
f=48496
TT=1800.91
T1=5.56
No dataNo Cert.

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=14397
TT=1800.78
T1=282.95
SAT (TO)
f=13019
TT=1800.03
T1=319.09
SAT (TO)
f=48825
TT=1800.02
T1=3.75
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.G.recomb10-0.01-2.opb
SAT
f=20215
TT=1800.96
T1=47.1
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (problem)

TT=4.36

? (problem)

TT=4.17

? (problem)

TT=4.46

? (problem)

TT=4.07

? (problem)

TT=8.725

? (problem)

TT=4.13

SAT (TO)
f=90131
TT=1800.1
T1=23.7
SAT (TO)
f=445780
TT=1800.08
T1=5.41
No dataNo data? (exit code)

TT=625.11

No data? (exit code)

TT=662.09

No dataNo dataNo dataSAT (TO)
f=51591
TT=1800.19
T1=9.54
?

TT=1790.58

No dataSAT (TO)
f=46133
TT=1800.92
T1=7.79
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=21588
TT=1800.03
T1=5.95
SAT (TO)
f=20215
TT=1800.96
T1=47.1
SAT (TO)
f=50216
TT=1800.08
T1=3.36
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.G.recomb10-0.10-10.opb
SAT
f=22950
TT=1800.73
T1=731.95
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (problem)

TT=5.47

? (problem)

TT=5.26

? (problem)

TT=5.42

? (problem)

TT=5.43

? (problem)

TT=5.29

? (problem)

TT=5.2

SAT (TO)
f=127630
TT=1800.08
T1=17.73
SAT (TO)
f=434554
TT=1800.07
T1=7.79
No dataNo data? (exit code)

TT=702.92

No data? (exit code)

TT=631.01

No dataNo dataNo dataSAT (TO)
f=76177
TT=1800.19
T1=8.52
?

TT=1791.14

No dataSAT (TO)
f=51257
TT=1800.13
T1=8.67
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=24988
TT=1800.1
T1=62.51
SAT (TO)
f=22950
TT=1800.73
T1=731.95
SAT (TO)
f=56694
TT=1800.03
T1=4.14
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.G.recomb10-0.20-12.opb
SAT
f=20554
TT=1800.02
T1=5.64
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (problem)

TT=6.9

? (problem)

TT=66.84

? (problem)

TT=6.77

? (problem)

TT=56.6

? (problem)

TT=6.84

? (problem)

TT=54.68

SAT (TO)
f=130707
TT=1800.21
T1=24.48
SAT (TO)
f=394672
TT=1800.07
T1=11.82
No dataNo data? (exit code)

TT=477.13

No data? (exit code)

TT=434.11

No dataNo dataNo dataSAT (TO)
f=73095
TT=1800.02
T1=8.43
?

TT=1790.91

No dataSAT (TO)
f=70025
TT=1800.14
T1=6.92
No dataNo Cert.

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=21607
TT=1800.09
T1=803.36
SAT (TO)
f=20554
TT=1800.02
T1=5.64
SAT (TO)
f=66921
TT=1800.01
T1=5.6
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
OPT-BIGINT-LIN/graca/
normalized-ped3.G.recomb10-0.20-13.opb
SAT
f=39324
TT=1800.88
T1=6.97
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (problem)

TT=7.1

? (problem)

TT=81.99

? (problem)

TT=7.29

? (problem)

TT=81.09

? (problem)

TT=7.13

? (problem)

TT=81.17

SAT (TO)
f=131420
TT=1800.15
T1=64.39
SAT (TO)
f=493603
TT=1800.14
T1=12.75
No dataNo dataNo Cert.

TT=435.798

No data? (exit code)

TT=397.625

No dataNo dataNo dataSAT (TO)
f=94600
TT=1800.86
T1=7.24
?

TT=1791.21

No dataSAT (TO)
f=94600
TT=1800.02
T1=7.13
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=39324
TT=1800.88
T1=6.97
SAT (TO)
f=44476
TT=1800.82
T1=6.2
SAT (TO)
f=96943
TT=1800.02
T1=5.66
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-air04.opb
SAT
f=71079
TT=1800.09
T1=1800.71
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.11

SAT (TO)
f=74531
TT=1800.06
T1=1462.26
No dataNo data? (exit code)

TT=976.367

No data? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.04

OPT
f=56137
TT=125.005
T1=116.37
No data? (TO)

TT=1800.09

No dataSAT (TO)
f=71079
TT=1800.09
T1=1800.71
? (TO)

TT=1800.03

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.26

? (TO)

TT=1800.01

SAT (TO)
f=76725
TT=1800.5
T1=1392.66
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-bley_xl1.opb
OPT
f=38
TT=19.912
T1=11.21
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800

? (problem)

TT=50.4

? (TO)

TT=1800.02

? (problem)

TT=44.87

? (TO)

TT=1800.08

? (problem)

TT=51.28

? (TO)

TT=1800.08

SAT (TO)
f=53
TT=1800.11
T1=1741.08
OPT
f=38
TT=1695.48
T1=1673.43
No dataNo dataOPT
f=38
TT=650.346
T1=497.03
No dataOPT
f=38
TT=1006.35
T1=719
No dataNo dataNo dataOPT
f=38
TT=27.428
T1=16.2
OPT
f=38
TT=305.049
T1=304.9
No dataOPT
f=38
TT=31.107
T1=13.49
No dataSAT (TO)
f=63
TT=1800.12
T1=1800.5
? (TO)

TT=1800.03

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=38
TT=19.912
T1=11.21
OPT
f=38
TT=177.45
T1=84.21
OPT
f=38
TT=541.672
T1=508.44
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-co-100.opb
SAT
f=275018906
TT=1800.1
T1=299.87
No dataNo dataNo data? (problem)

TT=264.855

? (problem)

TT=107.977

? (problem)

TT=260.867

? (problem)

TT=107.528

? (problem)

TT=256.045

? (problem)

TT=108.311

? (problem)

TT=258.084

? (problem)

TT=105.549

SAT (TO)
f=735572478
TT=1800.08
T1=1442.25
? (TO)

TT=1800.09

No dataNo dataNo Cert.

TT=263.623

No dataSAT (TO)
f=377227026
TT=1801.25
T1=364.59
No dataNo dataNo dataSAT (TO)
f=286440169
TT=1801.02
T1=17.95
? (TO)

TT=1800.86

No dataSAT (TO)
f=286248169
TT=1800.16
T1=17.65
No data? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=275018906
TT=1800.1
T1=299.87
SAT (TO)
f=397646871
TT=1801.46
T1=4.83
SAT (TO)
f=398028948
TT=1800.09
T1=1430.31
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-ds-big.opb
SAT
f=4124714222330000
TT=1800.06
T1=1576.19
No dataNo dataNo data? (MO)

TT=175.68

? (MO)

TT=173.82

? (TO)

TT=1659.99

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo Cert.

TT=406.71

No dataSAT (TO)
f=6235983221650000
TT=1800.09
T1=518.4
No dataNo dataNo dataSAT (TO)
f=8590774940180000
TT=1800.05
T1=376.89
Wrong UNSAT

TT=520.422

No dataSAT (TO)
f=8309708333670000
TT=1800.1
T1=447.22
No data? (TO)

TT=1800.07

? (MO)

TT=135.36

? (MO)

TT=142.88

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1802.01

SAT (TO)
f=9207391165450000
TT=1800.14
T1=15.5
SAT (TO)
f=4124714222330000
TT=1800.06
T1=1576.19
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-eilB101.opb
SAT
f=362784496250000004
TT=1800.46
T1=1210.09
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.6

? (TO)

TT=1800.12

? (TO)

TT=1800.08

?

TT=0.003

SAT (TO)
f=723342118750000002
TT=1800.02
T1=2.57
No dataNo data? (exit code)

TT=842.54

No dataSAT (TO)
f=432378028249999999
TT=1800.05
T1=573.06
No dataNo dataNo dataSAT (TO)
f=389689232750000003
TT=1800.43
T1=817.23
SAT
f=462994466000000003
TT=1789.75
T1=1790.01
No dataSAT (TO)
f=395291292749999999
TT=1800.43
T1=795.15
No dataSAT (TO)
f=723342118750000002
TT=1800.03
T1=1800.3
? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=739813547250000007
TT=1800.07
T1=1062.4
SAT (TO)
f=707556376000000004
TT=1800.92
T1=1589.8
SAT (TO)
f=362784496250000004
TT=1800.46
T1=1210.09
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/
heinz/normalized-harp2.opb
SAT
f=-67205306
TT=1800.06
T1=53.98
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800

SAT (TO)
f=-62126175
TT=1800.15
T1=9.73
? (TO)

TT=1800.03

No dataNo data? (exit code)

TT=656.97

No dataSAT (TO)
f=-65459570
TT=1800.04
T1=0.68
No dataNo dataNo dataSAT (TO)
f=-66951559
TT=1800.58
T1=68.4
OPT
f=-73899798
TT=289.94
T1=202.03
No dataSAT (TO)
f=-67205306
TT=1800.06
T1=53.98
No data? (TO)

TT=1800.03

? (TO)

TT=1800

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-66908274
TT=1800.29
T1=592.07
SAT (TO)
f=-62360729
TT=1800.77
T1=316.66
SAT (TO)
f=-61084807
TT=1800.08
T1=62.37
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-ivu06-big.opb
SAT
f=2865693364730000016
TT=1801.7
T1=1601.21
No dataNo dataNo data? (MO)

TT=1691.83

? (problem)

TT=1436.74

? (TO)

TT=1691.07

? (problem)

TT=1412.63

? (problem)

TT=1414.37

? (problem)

TT=1428.79

? (problem)

TT=1429.6

? (problem)

TT=1425.12

?

TT=0.007

? (TO)

TT=1800.06

No dataNo data?

TT=144.332

No data?

TT=1102.88

No dataNo dataNo data?

TT=385.165

? (TO)

TT=1800.44

No data? (TO)

TT=1800.82

No data? (exit code)

TT=1550.32

? (MO)

TT=860.38

? (problem)

TT=570.258

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4705446866950000016
TT=1801.98
T1=207.53
SAT (TO)
f=4635520194260000021
TT=1801.92
T1=115.9
SAT (TO)
f=2865693364730000016
TT=1801.7
T1=1601.21
No dataNo dataNo data? (exit code)

TT=120.996

? (TO)

TT=1800.27

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-ivu52.opb
SAT
f=20170239442749999993
TT=1800.69
T1=429.66
No dataNo dataNo data? (problem)

TT=3.394

? (problem)

TT=3.551

? (problem)

TT=3.208

? (problem)

TT=3.53

? (problem)

TT=3.221

? (problem)

TT=3.539

? (problem)

TT=3.279

? (problem)

TT=3.997

?

TT=0.006

Signal

TT=377.099

No dataNo data? (TO)

TT=1800.1

No data? (TO)

TT=1800.58

No dataNo dataNo data? (TO)

TT=1800.09

?

TT=1794.36

No data? (TO)

TT=1800.64

No data? (exit code)

TT=297.023

? (problem)

TT=3.244

? (problem)

TT=3.206

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.55

? (TO)

TT=1800.09

SAT (TO)
f=20170239442749999993
TT=1800.69
T1=429.66
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-n3div36.opb
SAT
f=1840
TT=1800.2
T1=362.13
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.81

? (TO)

TT=1800.05

Signal

TT=1302.97

SAT (TO)
f=48871
TT=1800.04
T1=406.54
No dataNo dataSAT (TO)
f=5788
TT=1800.53
T1=4.79
No dataSAT (TO)
f=5788
TT=1800.04
T1=4.24
No dataNo dataNo dataSAT (TO)
f=2069
TT=1800.43
T1=280.19
SAT
f=909
TT=1796.01
T1=951.22
No dataSAT (TO)
f=1840
TT=1800.2
T1=362.13
No dataSAT (TO)
f=51112
TT=1800.04
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5481
TT=1800.2
T1=810.32
SAT (TO)
f=5677
TT=1800.05
T1=1574.33
SAT (TO)
f=2604
TT=1800.03
T1=307.69
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-n3seq24.opb
SAT
f=277
TT=1800.08
T1=53.17
No dataNo dataNo data? (TO)

TT=1800.07

? (problem)

TT=136.975

? (TO)

TT=1800.07

? (problem)

TT=136.17

? (TO)

TT=1800.05

? (problem)

TT=142.592

? (TO)

TT=1800.09

? (problem)

TT=140.823

SAT (TO)
f=1368
TT=1800.18
T1=292.15
? (TO)

TT=1800.11

No dataNo dataSAT (TO)
f=280
TT=1804.57
T1=51.23
No dataSAT (TO)
f=280
TT=1800.08
T1=33.89
No dataNo dataNo dataSAT (TO)
f=280
TT=1800.06
T1=472.8
SAT
f=337
TT=1795.35
T1=1082.96
No dataSAT (TO)
f=277
TT=1800.08
T1=53.17
No data? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=281
TT=1800.73
T1=10.15
SAT (TO)
f=281
TT=1800.72
T1=7.11
SAT (TO)
f=1247
TT=1800.71
T1=1202.5
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/
normalized-neos-941313.opb
SAT
f=17101
TT=1800.69
T1=749.76
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.09

SAT (TO)
f=21157
TT=1800.25
T1=901.23
? (TO)

TT=1800.02

No dataNo dataSAT (TO)
f=18785
TT=1804.97
T1=48.18
No dataSAT (TO)
f=19867
TT=1800.67
T1=17.49
No dataNo dataNo dataSAT (TO)
f=17636
TT=1801.55
T1=43.12
SAT
f=9418
TT=1794.08
T1=481.9
No dataSAT (TO)
f=18338
TT=1800.46
T1=39.52
No data? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=18900
TT=1800.18
T1=378.36
SAT (TO)
f=17101
TT=1800.69
T1=749.76
SAT (TO)
f=20122
TT=1800.1
T1=6.97
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/
normalized-netdiversion.opb




No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1825.73

SAT (TO)
f=8100923
TT=1800.15
T1=3.68
? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.03

No data? (exit code)

TT=1060.73

No dataNo dataNo data? (TO)

TT=1801.22

?

TT=1797.81

No data? (TO)

TT=1800.12

No data? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1800.88

? (TO)

TT=1800.64

No dataNo dataNo data?

TT=1106.24

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-ns1663818.opb
SAT
f=285
TT=1800.22
T1=125.74
No dataNo dataNo data? (MO)

TT=211.25

? (problem)

TT=113.067

? (MO)

TT=216.23

? (problem)

TT=113.11

? (MO)

TT=209.71

? (problem)

TT=113.808

? (MO)

TT=163.9

? (problem)

TT=116.338

? (TO)

TT=1800.09

? (TO)

TT=1800.03

No dataNo data?

TT=731.64

No data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.27

No dataSAT (TO)
f=285
TT=1800.22
T1=125.74
No data? (TO)

TT=1800.06

? (MO)

TT=186.35

? (MO)

TT=178.23

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.48

? (TO)

TT=1800

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.12

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-ns1685374.opb
OPT
f=-13
TT=276.793
T1=119.89
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.06

? (TO)

TT=1800.11

SAT (TO)
f=-8
TT=1800.03
T1=1.88
SAT (TO)
f=-7
TT=1800.05
T1=4.04
No dataNo dataSAT (TO)
f=-9
TT=1800.06
T1=1.28
No dataSAT (TO)
f=-10
TT=1800.72
T1=888.55
No dataNo dataNo dataOPT
f=-13
TT=616.14
T1=359.94
?

TT=1789.95

No dataOPT
f=-13
TT=276.793
T1=119.89
No dataSAT (TO)
f=-8
TT=1800.09
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=-13
TT=528.324
T1=265.09
? (TO)

TT=1800.01

SAT (TO)
f=-9
TT=1800.02
T1=112.14
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/
normalized-opm2-z10-s2.opb
SAT
f=-21379
TT=1800.05
T1=733.14
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.01

Signal

TT=705.726

SAT (TO)
f=-4704
TT=1800.1
T1=806.19
No dataNo data? (exit code)

TT=511.177

No dataSAT (TO)
f=-20215
TT=1800.08
T1=1.91
No dataNo dataNo dataSAT (TO)
f=-20035
TT=1801.46
T1=30.39
SAT
f=-21620
TT=1790.68
T1=1220
No dataSAT (TO)
f=-19595
TT=1800.06
T1=610.74
No data? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-19984
TT=1800.05
T1=136.43
SAT (TO)
f=-19981
TT=1801.05
T1=1.43
SAT (TO)
f=-21379
TT=1800.05
T1=733.14
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/
heinz/
normalized-opm2-z11-s8.opb
SAT
f=-28803
TT=1800.67
T1=357.37
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.09

Signal

TT=865.698

? (TO)

TT=1800.13

No dataNo data? (exit code)

TT=550.97

No dataSAT (TO)
f=-26692
TT=1800.02
T1=1391.01
No dataNo dataNo dataSAT (TO)
f=-28803
TT=1800.67
T1=357.37
SAT (TO)
f=-28973
TT=1800.08
T1=1233.76
No dataSAT (TO)
f=-26981
TT=1800.05
T1=13.46
No dataSAT (TO)
f=-12525
TT=1800.05
T1=1800.61
? (TO)

TT=1800.06

? (TO)

TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-26981
TT=1800.03
T1=6.97
SAT (TO)
f=-22921
TT=1800.08
T1=1.66
SAT (TO)
f=-26710
TT=1800.01
T1=48.09
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/
normalized-opm2-z12-s14.opb
SAT
f=-44342
TT=1800.11
T1=549.1
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.05

Signal

TT=1517.68

? (TO)

TT=1800.09

No dataNo data? (exit code)

TT=527.98

No dataSAT (TO)
f=-42369
TT=1800.02
T1=271.8
No dataNo dataNo dataSAT (TO)
f=-41393
TT=1801.74
T1=764.72
SAT
f=-36710
TT=1790.62
T1=916.98
No dataSAT (TO)
f=-44342
TT=1800.11
T1=549.1
No data? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-38774
TT=1800.41
T1=390.72
SAT (TO)
f=-38687
TT=1800.18
T1=2.12
SAT (TO)
f=-43089
TT=1800.05
T1=80.35
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/
normalized-opm2-z12-s7.opb
SAT
f=-43894
TT=1800.08
T1=525.49
No dataNo dataNo data? (TO)

TT=1800.23

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.09

Signal

TT=797.458

? (TO)

TT=1800.07

No dataNo data? (exit code)

TT=543.652

No dataSAT (TO)
f=-43828
TT=1800.6
T1=1156.94
No dataNo dataNo dataSAT (TO)
f=-37886
TT=1800.22
T1=889.44
? (TO)

TT=1802.11

No dataSAT (TO)
f=-36801
TT=1800.76
T1=346.13
No dataSAT (TO)
f=-15490
TT=1800.03
T1=1800.5
? (TO)

TT=1800

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-38363
TT=1800.19
T1=343.05
SAT (TO)
f=-32138
TT=1800.09
T1=1.89
SAT (TO)
f=-43894
TT=1800.08
T1=525.49
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/heinz/
normalized-opm2-z7-s2.opb
SAT
f=-7368
TT=1800.09
T1=1254.49
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.09

SAT (TO)
f=-8834
TT=1800.02
T1=243.8
? (TO)

TT=1800.11

No dataNo data? (exit code)

TT=1655.47

No dataSAT (TO)
f=-5774
TT=1800.59
T1=10.43
No dataNo dataNo dataSAT (TO)
f=-5857
TT=1800.47
T1=408.33
OPT
f=-10280
TT=1708.98
T1=1652.91
No dataSAT (TO)
f=-5703
TT=1800.57
T1=825.1
No dataSAT (TO)
f=-3212
TT=1800.11
T1=1800.71
? (TO)

TT=1800.1

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-5572
TT=1800.01
T1=70.42
SAT (TO)
f=-4467
TT=1800.08
T1=0.7
SAT (TO)
f=-7368
TT=1800.09
T1=1254.49
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/
normalized-opm2-z9-s14.opb
SAT
f=-16917
TT=1800.06
T1=729.36
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.04

Signal

TT=640.212

SAT (TO)
f=-6113
TT=1800.12
T1=604.45
No dataNo dataSAT
f=-16746
TT=700.147
T1=2.32
No dataSAT (TO)
f=-13639
TT=1800.03
T1=39.84
No dataNo dataNo dataSAT (TO)
f=-14785
TT=1800.02
T1=54.13
SAT
f=-17098
TT=1790
T1=1340.67
No dataSAT (TO)
f=-16917
TT=1800.06
T1=729.36
No dataSAT (TO)
f=-7416
TT=1800.03
T1=1800.61
? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-13677
TT=1801.46
T1=964.08
SAT (TO)
f=-12647
TT=1800.09
T1=8.85
SAT (TO)
f=-16183
TT=1800.66
T1=1208.45
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-sp97ar.opb
SAT
f=2193774424000000011
TT=1800.1
T1=209.38
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (problem)

TT=26.449

? (TO)

TT=1800.08

? (problem)

TT=35.391

? (TO)

TT=1800.09

?

TT=0.003

SAT (TO)
f=24956833502399999996
TT=1800.04
T1=81.73
No dataNo dataSAT (TO)
f=2211832547200000014
TT=1800.93
T1=3.14
No dataSAT (TO)
f=2213966871200000016
TT=1800.71
T1=2.7
No dataNo dataNo dataSAT (TO)
f=2194784492800000011
TT=1800.08
T1=123.07
Wrong UNSAT

TT=4.294

No dataSAT (TO)
f=2193774424000000011
TT=1800.62
T1=534.29
No data? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (problem)

TT=8.059

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2193774424000000011
TT=1800.1
T1=209.38
SAT (TO)
f=2194784492800000011
TT=1800.02
T1=2.1
SAT (TO)
f=4624919597599999974
TT=1800.54
T1=1.05
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-sp98ar.opb
SAT
f=1684166798400000016
TT=1800.03
T1=2.74
No dataNo dataNo data? (problem)

TT=19.629

? (TO)

TT=1800.01

? (problem)

TT=17.74

? (TO)

TT=1800.09

? (problem)

TT=17.95

? (TO)

TT=1800.08

? (problem)

TT=17.97

? (TO)

TT=1800.07

?

TT=0.002

SAT (TO)
f=24983394735599999993
TT=1800.08
T1=874.91
No dataNo dataSAT (TO)
f=2321562574400000014
TT=1800.33
T1=3.87
No dataSAT (TO)
f=1900507642400000027
TT=1800.05
T1=4.34
No dataNo dataNo dataSAT (TO)
f=1684166798400000016
TT=1800.05
T1=8.63
?

TT=1790.2

No dataSAT (TO)
f=1684166798400000016
TT=1800.16
T1=5.13
No data? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=1684166798400000016
TT=1800.09
T1=5.31
SAT (TO)
f=1684166798400000016
TT=1800.03
T1=2.74
SAT (TO)
f=4210701639600000014
TT=1800.07
T1=1.48
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-sp98ic.opb
SAT
f=622354759199999996
TT=1800.08
T1=20.26
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (problem)

TT=26.767

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.02

?

TT=0.003

SAT (TO)
f=18709251770879999998
TT=1800.08
T1=418.6
No dataNo dataSAT (TO)
f=630323063039999996
TT=1800.55
T1=5.41
No dataSAT (TO)
f=630323063039999996
TT=1800.04
T1=4.84
No dataNo dataNo dataSAT (TO)
f=622354759199999996
TT=1800.81
T1=41.61
?

TT=1789.94

No dataSAT (TO)
f=622354759199999996
TT=1800.84
T1=20.26
No data? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (problem)

TT=9.923

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=630323063039999996
TT=1800.16
T1=3.33
SAT (TO)
f=622354759199999996
TT=1800.08
T1=1609.57
SAT (TO)
f=1225765334399999996
TT=1800.62
T1=1.1
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-stp3d.opb




No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.08

No dataNo data? (TO)

TT=1801.16

No data? (TO)

TT=1800.29

No dataNo dataNo data? (TO)

TT=1800.75

?

TT=1791.08

No data? (TO)

TT=1800.09

No data? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.67

? (TO)

TT=1800.01

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-t1717.opb
SAT
f=201342
TT=1800.07
T1=1.57
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.02

SAT (TO)
f=201342
TT=1800.1
T1=56.62
Signal

TT=199.194

No dataNo dataSAT (TO)
f=379944
TT=1804.13
T1=27.97
No dataSAT (TO)
f=366375
TT=1800.04
T1=18.56
No dataNo dataNo dataSAT (TO)
f=410506
TT=1800.58
T1=149.75
SAT
f=200255
TT=1790.15
T1=874.29
No dataSAT (TO)
f=382403
TT=1800.18
T1=6.64
No dataNo Cert.

TT=1800

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=444902
TT=1800.94
T1=2.64
SAT (TO)
f=425546
TT=1800.01
T1=1.95
SAT (TO)
f=201342
TT=1800.07
T1=1.57
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/
heinz/normalized-t1722.opb
SAT
f=194040
TT=1800.15
T1=1.22
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800

? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=217616
TT=1800.17
T1=11.86
SAT (TO)
f=248563
TT=1800.07
T1=1458.06
No dataNo dataSAT (TO)
f=212421
TT=1801.27
T1=5.47
No dataSAT (TO)
f=218827
TT=1800.06
T1=3.09
No dataNo dataNo dataSAT (TO)
f=210598
TT=1800.55
T1=2.23
SAT
f=123185
TT=1789.92
T1=1029.27
No dataSAT (TO)
f=214699
TT=1800.92
T1=2.27
No dataNo Cert.

TT=1800.05

? (TO)

TT=1800

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=194040
TT=1800.15
T1=1.22
SAT (TO)
f=215936
TT=1800.06
T1=1.42
SAT (TO)
f=216268
TT=1800.03
T1=45.26
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/
heinz/normalized-zib01.opb




No dataNo dataNo data? (problem)

TT=210.633

? (MO)

TT=338.94

? (problem)

TT=212.851

? (MO)

TT=330.87

? (problem)

TT=210.925

? (MO)

TT=340.5

? (problem)

TT=212.792

? (MO)

TT=332.7

Signal

TT=20.822

Signal

TT=154.154

No dataNo data?

TT=105.907

No data?

TT=111.867

No dataNo dataNo data? (exit code)

TT=103.31

? (exit code)

TT=1203.07

No data? (TO)

TT=1800.14

No data? (MO)

TT=196.28

? (problem)

TT=216.529

? (problem)

TT=217.218

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.3

? (TO)

TT=1800.01

? (TO)

TT=1801.41

No dataNo dataNo data? (MO)

TT=277.841

? (MO)

TT=279.36

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-codebreaker.cudf.paranoid.opb
OPT
f=193395
TT=710.886
T1=311.87
No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.1

? (problem)

TT=1.37

? (problem)

TT=1

? (problem)

TT=1.281

? (problem)

TT=0.97

? (problem)

TT=1.339

? (problem)

TT=0.948

SAT (TO)
f=206326
TT=1800.07
T1=1707.94
SAT (TO)
f=12018797
TT=1800.1
T1=1.97
No dataNo dataSAT (TO)
f=223606
TT=1800.02
T1=748.74
No data? (exit code)

TT=1738.21

No dataNo dataNo dataOPT
f=193395
TT=1080.04
T1=531.24
OPT
f=193395
TT=91.557
T1=91.24
No dataOPT
f=193395
TT=710.886
T1=311.87
No dataSAT (TO)
f=12018797
TT=1800.06
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=193471
TT=1800.39
T1=976.46
SAT (TO)
f=194112
TT=1800.02
T1=1698.04
SAT (TO)
f=245078
TT=1800.66
T1=1791.36
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-dwww.cudf.paranoid.opb
OPT
f=176457
TT=1376.53
T1=507.13
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (problem)

TT=1.3

? (problem)

TT=1.12

? (problem)

TT=1.281

? (problem)

TT=1.06

? (problem)

TT=1.41

? (problem)

TT=1.08

SAT (TO)
f=185092
TT=1800.04
T1=1728.88
SAT (TO)
f=11667154
TT=1800.13
T1=1.87
No dataNo dataSAT (TO)
f=224046
TT=1800.42
T1=252.48
No data? (exit code)

TT=1003.64

No dataNo dataNo dataOPT
f=176457
TT=1376.53
T1=507.13
OPT
f=176457
TT=72.877
T1=72.62
No dataSAT (TO)
f=176478
TT=1800.26
T1=977.35
No dataSAT (TO)
f=11667154
TT=1800.03
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=176457
TT=1642.44
T1=832.11
SAT (TO)
f=176972
TT=1800.73
T1=1728.06
SAT (TO)
f=292997
TT=1800.57
T1=1580.32
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/misc2010/
datasets/10orplus/normalized-epiphany-browser.cudf.paranoid.opb
SAT
f=262343
TT=1800.28
T1=920.83
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (problem)

TT=1.312

? (problem)

TT=1.07

? (problem)

TT=1.295

? (problem)

TT=1.06

? (problem)

TT=1.35

? (problem)

TT=1.09

SAT (TO)
f=287968
TT=1800.06
T1=1052.44
SAT (TO)
f=756226
TT=1800.02
T1=633.63
No dataNo dataSAT (TO)
f=296738
TT=1800.08
T1=177.92
No data? (exit code)

TT=879.23

No dataNo dataNo dataSAT (TO)
f=262343
TT=1800.28
T1=920.83
OPT
f=244977
TT=77.331
T1=77.08
No dataSAT (TO)
f=275764
TT=1800.02
T1=321.5
No dataSAT (TO)
f=10340739
TT=1800.08
T1=1800.71
? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=266667
TT=1800.41
T1=1034.85
SAT (TO)
f=266627
TT=1800.08
T1=1793.25
SAT (TO)
f=318487
TT=1800.09
T1=1558.31
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-evolution-dev.cudf.paranoid.opb
OPT
f=197900
TT=1130.86
T1=588.81
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (problem)

TT=1.291

? (problem)

TT=1.06

? (problem)

TT=1.335

? (problem)

TT=1.06

? (problem)

TT=1.343

? (problem)

TT=1.05

SAT (TO)
f=219496
TT=1800.06
T1=1712.96
SAT (TO)
f=847396
TT=1800.02
T1=1713.75
No dataNo dataSAT (TO)
f=241059
TT=1800.71
T1=1151.44
No data? (exit code)

TT=1374.91

No dataNo dataNo dataSAT (TO)
f=197900
TT=1800.06
T1=960.72
OPT
f=197900
TT=73.487
T1=64.9
No dataOPT
f=197900
TT=1130.86
T1=588.81
No dataSAT (TO)
f=10013040
TT=1800.06
T1=1800.61
? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=202234
TT=1800.36
T1=876.68
SAT (TO)
f=202211
TT=1800.03
T1=1730.24
SAT (TO)
f=262577
TT=1800.8
T1=1789.93
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-libhtml-parser-perl.cudf.paranoid.opb
OPT
f=141778
TT=346.84
T1=183.43
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (problem)

TT=1.313

? (problem)

TT=1.059

? (problem)

TT=1.29

? (problem)

TT=1.05

? (problem)

TT=1.317

? (problem)

TT=1.039

SAT (TO)
f=141778
TT=1800.09
T1=1770.78
SAT (TO)
f=12149147
TT=1800.04
T1=1.96
No dataNo dataSAT (TO)
f=172045
TT=1800.78
T1=1646.26
No data? (exit code)

TT=1693.73

No dataNo dataNo dataOPT
f=141778
TT=437.887
T1=229.32
OPT
f=141778
TT=79.638
T1=79.42
No dataOPT
f=141778
TT=346.84
T1=183.43
No dataSAT (TO)
f=12149147
TT=1800.04
T1=1800.68
? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=141778
TT=986.83
T1=422.18
SAT (TO)
f=141854
TT=1800.03
T1=1017.95
SAT (TO)
f=146622
TT=1800.73
T1=1789.66
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-libpango-perl.cudf.paranoid.opb
OPT
f=176205
TT=1313.6
T1=572.39
No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.04

? (problem)

TT=1.302

? (problem)

TT=1.03

? (problem)

TT=1.282

? (problem)

TT=1.05

? (problem)

TT=1.341

? (problem)

TT=1.04

SAT (TO)
f=189109
TT=1800.03
T1=1645.96
SAT (TO)
f=10778862
TT=1800.07
T1=1.87
No dataNo dataSAT (TO)
f=223728
TT=1800.71
T1=507.28
No data? (exit code)

TT=1013.15

No dataNo dataNo dataOPT
f=176205
TT=1313.6
T1=572.39
OPT
f=176205
TT=77.664
T1=77.5
No dataSAT (TO)
f=176205
TT=1800.15
T1=1430.94
No dataSAT (TO)
f=528614
TT=1800.03
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=180544
TT=1800.28
T1=776.26
SAT (TO)
f=176360
TT=1800.52
T1=1605.44
SAT (TO)
f=253864
TT=1800.09
T1=1750.59
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-libpoe-perl.cudf.paranoid.opb
OPT
f=176288
TT=1711.19
T1=753.07
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (problem)

TT=1.293

? (problem)

TT=1.1

? (problem)

TT=1.279

? (problem)

TT=1.03

? (problem)

TT=1.346

? (problem)

TT=1.1

SAT (TO)
f=180617
TT=1800.08
T1=1763.38
SAT (TO)
f=12081754
TT=1800.07
T1=1.86
No dataNo dataSAT (TO)
f=223831
TT=1800.69
T1=1518.88
No dataNo Cert.

TT=1053.64

No dataNo dataNo dataOPT
f=176288
TT=1711.19
T1=896.37
OPT
f=176288
TT=83.724
T1=83.5
No dataSAT (TO)
f=176288
TT=1800.22
T1=942.99
No dataSAT (TO)
f=12081754
TT=1800.1
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=176288
TT=1800.44
T1=753.07
SAT (TO)
f=197981
TT=1800.05
T1=1767.85
SAT (TO)
f=258086
TT=1800.02
T1=1643.81
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/10orplus/
normalized-python-cairo.cudf.paranoid.opb
OPT
f=141778
TT=260.852
T1=133.15
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (problem)

TT=1.31

? (problem)

TT=1.07

? (problem)

TT=1.291

? (problem)

TT=1.05

? (problem)

TT=1.341

? (problem)

TT=1.025

OPT
f=141778
TT=959.237
T1=848.34
SAT (TO)
f=12046066
TT=1800.11
T1=1.85
No dataNo dataSAT (TO)
f=159230
TT=1800.07
T1=1075.49
No dataSAT (TO)
f=163308
TT=1800.58
T1=1759.22
No dataNo dataNo dataOPT
f=141778
TT=603.574
T1=364.33
OPT
f=141778
TT=89.95
T1=89.64
No dataOPT
f=141778
TT=260.852
T1=133.15
No dataSAT (TO)
f=12046066
TT=1800.02
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.14

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=141778
TT=533.644
T1=258.1
SAT (TO)
f=141786
TT=1800.02
T1=1475.6
SAT (TO)
f=150512
TT=1800.69
T1=1788.06
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-gtwitter.cudf.paranoid.opb
OPT
f=141888
TT=394.487
T1=181.04
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.15

? (problem)

TT=1.291

? (problem)

TT=1.02

? (problem)

TT=1.282

? (problem)

TT=1.016

? (problem)

TT=1.337

? (problem)

TT=0.966

OPT
f=141888
TT=1557.11
T1=1537.78
SAT (TO)
f=10188483
TT=1800.1
T1=1.86
No dataNo dataSAT (TO)
f=167686
TT=1800.7
T1=1415.89
No dataSAT (TO)
f=167673
TT=1800.68
T1=1786.33
No dataNo dataNo dataOPT
f=141888
TT=394.487
T1=181.04
OPT
f=141888
TT=57.787
T1=57.54
No dataOPT
f=141888
TT=569.957
T1=267.3
No dataSAT (TO)
f=10188483
TT=1800.04
T1=1800.5
? (TO)

TT=1800.04

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=141888
TT=1800.08
T1=928.21
OPT
f=141888
TT=1127.12
T1=608.19
SAT (TO)
f=215152
TT=1800.47
T1=1780.62
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-kjumpingcube.cudf.paranoid.opb
OPT
f=141778
TT=386.836
T1=195.29
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (problem)

TT=1.323

? (problem)

TT=1.05

? (problem)

TT=1.3

? (problem)

TT=1.07

? (problem)

TT=1.335

? (problem)

TT=1.04

OPT
f=141778
TT=1259.97
T1=1181.59
SAT (TO)
f=10972188
TT=1800.09
T1=1.86
No dataNo dataSAT (TO)
f=163286
TT=1800.62
T1=413.79
No dataSAT (TO)
f=167606
TT=1800.73
T1=1673.48
No dataNo dataNo dataOPT
f=141778
TT=465.483
T1=326.77
OPT
f=141778
TT=84.748
T1=84.46
No dataOPT
f=141778
TT=386.836
T1=195.29
No dataSAT (TO)
f=10972188
TT=1800.07
T1=1800.61
? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=141778
TT=1800.2
T1=970.54
SAT (TO)
f=141854
TT=1800.78
T1=1767.81
OPT
f=141778
TT=1794.48
T1=1783.1
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-kmines.cudf.paranoid.opb
OPT
f=141778
TT=333.523
T1=172.17
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (problem)

TT=1.308

? (problem)

TT=1.08

? (problem)

TT=1.288

? (problem)

TT=1.06

? (problem)

TT=1.344

? (problem)

TT=1.06

OPT
f=141778
TT=1796.44
T1=1659.21
SAT (TO)
f=11028040
TT=1800.06
T1=1.86
No dataNo dataSAT (TO)
f=163286
TT=1800.39
T1=421.4
No dataSAT (TO)
f=163390
TT=1801.04
T1=1778.26
No dataNo dataNo dataOPT
f=141778
TT=617.04
T1=352.29
OPT
f=141778
TT=71.883
T1=71.63
No dataOPT
f=141778
TT=333.523
T1=172.17
No dataSAT (TO)
f=11028040
TT=1800.03
T1=1800.5
? (TO)

TT=1800.02

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=141785
TT=1800.39
T1=921.11
SAT (TO)
f=141854
TT=1800.03
T1=1764.71
OPT
f=141778
TT=1791.06
T1=1781.28
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-mono-gac.cudf.paranoid.opb
OPT
f=141778
TT=461.153
T1=211.73
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (problem)

TT=1.39

? (problem)

TT=1.055

? (problem)

TT=1.293

? (problem)

TT=1.05

? (problem)

TT=1.351

? (problem)

TT=1.04

OPT
f=141778
TT=1022.92
T1=929.35
SAT (TO)
f=1173043
TT=1800.05
T1=363.86
No dataNo dataSAT (TO)
f=176205
TT=1800.3
T1=1692.77
No data? (exit code)

TT=1652.76

No dataNo dataNo dataOPT
f=141778
TT=568.888
T1=385.84
OPT
f=141778
TT=75.715
T1=75.48
No dataOPT
f=141778
TT=461.153
T1=211.73
No dataSAT (TO)
f=12243658
TT=1800.06
T1=1800.61
? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=141778
TT=1609.04
T1=841
SAT (TO)
f=142287
TT=1800.06
T1=1549.04
SAT (TO)
f=150607
TT=1800.46
T1=1791.71
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-plasma-widgets-workspace.cudf.paranoid.opb
OPT
f=146133
TT=149.05
T1=83.08
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (problem)

TT=1.39

? (problem)

TT=1.01

? (problem)

TT=1.277

? (problem)

TT=0.97

? (problem)

TT=1.341

? (problem)

TT=0.98

Wrong Opt.
f=150426
TT=761.529
T1=685.97
SAT (TO)
f=11229936
TT=1800.11
T1=1.86
No dataNo dataSAT (TO)
f=180541
TT=1800.07
T1=1754.22
No dataSAT (TO)
f=159137
TT=1800.89
T1=1780.37
No dataNo dataNo dataOPT
f=146133
TT=289.022
T1=190.53
OPT
f=146133
TT=58.414
T1=58.15
No dataOPT
f=146133
TT=149.05
T1=83.08
No dataSAT (TO)
f=11229936
TT=1800.09
T1=1800.61
? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=146133
TT=1065.9
T1=559.83
SAT (TO)
f=146139
TT=1800.65
T1=1786.51
SAT (TO)
f=193668
TT=1800.06
T1=1781.07
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-r-cran-car.cudf.paranoid.opb
OPT
f=146110
TT=193.467
T1=108.54
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (problem)

TT=1.35

? (problem)

TT=1.07

? (problem)

TT=1.281

? (problem)

TT=1.05

? (problem)

TT=1.333

? (problem)

TT=1.04

OPT
f=146110
TT=1268.44
T1=1104.24
SAT (TO)
f=11232520
TT=1800.03
T1=1.87
No dataNo dataSAT (TO)
f=180554
TT=1800.02
T1=1079.34
No dataSAT (TO)
f=167662
TT=1800.3
T1=1763.18
No dataNo dataNo dataOPT
f=146110
TT=393.714
T1=272.55
OPT
f=146110
TT=76.356
T1=76.1
No dataOPT
f=146110
TT=193.467
T1=108.54
No dataSAT (TO)
f=11232520
TT=1800.04
T1=1800.5
? (TO)

TT=1800.13

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=146110
TT=1205.95
T1=647.2
SAT (TO)
f=150415
TT=1800.08
T1=1758.99
OPT
f=146110
TT=1650.67
T1=1640.94
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-r-cran-rodbc.cudf.paranoid.opb
OPT
f=146110
TT=505.727
T1=232.69
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (problem)

TT=1.285

? (problem)

TT=1.06

? (problem)

TT=1.287

? (problem)

TT=1.093

? (problem)

TT=1.345

? (problem)

TT=1.05

OPT
f=146110
TT=837.022
T1=774.33
SAT (TO)
f=270747
TT=1800.06
T1=1764.84
No dataNo dataSAT (TO)
f=180665
TT=1800.76
T1=1734.46
No data? (TO)

TT=1802.03

No dataNo dataNo dataOPT
f=146110
TT=722.484
T1=486.43
OPT
f=146110
TT=77.482
T1=77.23
No dataOPT
f=146110
TT=505.727
T1=232.69
No dataSAT (TO)
f=11352843
TT=1800.04
T1=1800.5
? (TO)

TT=1800.03

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=146110
TT=1722.49
T1=868.3
SAT (TO)
f=146186
TT=1800.61
T1=1688.25
SAT (TO)
f=150705
TT=1800.55
T1=1790.1
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-tasque.cudf.paranoid.opb
OPT
f=141990
TT=629.259
T1=147.81
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (problem)

TT=1.304

? (problem)

TT=1.072

? (problem)

TT=1.28

? (problem)

TT=1.041

? (problem)

TT=1.343

? (problem)

TT=1.034

SAT (TO)
f=146323
TT=1800.07
T1=1133.26
SAT (TO)
f=10814707
TT=1800.04
T1=1.87
No dataNo dataSAT (TO)
f=180708
TT=1800.29
T1=1367.89
No data? (exit code)

TT=1634.08

No dataNo dataNo dataOPT
f=141990
TT=629.259
T1=147.81
OPT
f=141990
TT=59.61
T1=59.38
No dataOPT
f=141990
TT=1772.62
T1=432.64
No dataSAT (TO)
f=10814707
TT=1800.06
T1=1800.61
? (TO)

TT=1800.07

? (TO)

TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=141990
TT=1800.18
T1=769.15
SAT (TO)
f=146291
TT=1800.08
T1=724.2
SAT (TO)
f=228298
TT=1800.78
T1=1791.28
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/9orless/
normalized-upstart-compat-sysv.cudf.paranoid.opb
OPT
f=154743
TT=826.928
T1=399.26
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (problem)

TT=1.37

? (problem)

TT=1.052

? (problem)

TT=1.292

? (problem)

TT=1.04

? (problem)

TT=1.344

? (problem)

TT=1.042

OPT
f=154743
TT=1781.38
T1=1759.65
SAT (TO)
f=12060260
TT=1800.04
T1=1.84
No dataNo dataSAT (TO)
f=193510
TT=1800.66
T1=1286.55
No dataSAT (TO)
f=180642
TT=1800.49
T1=1189.44
No dataNo dataNo dataOPT
f=154743
TT=826.928
T1=399.26
OPT
f=154743
TT=77.193
T1=76.94
No dataOPT
f=154743
TT=992.403
T1=447.24
No dataSAT (TO)
f=12060260
TT=1800.08
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=154743
TT=1482.83
T1=537.65
SAT (TO)
f=154818
TT=1800.01
T1=1570.72
SAT (TO)
f=180650
TT=1800.08
T1=1769.4
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1131.cudf.paranoid.opb
UNSAT

TT=0.053

No dataNo dataNo dataUNSAT

TT=0.154

UNSAT

TT=0.18

UNSAT

TT=0.146

UNSAT

TT=0.172

UNSAT

TT=0.147

UNSAT

TT=0.169

UNSAT

TT=0.156

UNSAT

TT=0.172

UNSAT

TT=0.121

UNSAT

TT=0.457

No dataNo dataUNSAT

TT=0.925

No dataUNSAT

TT=0.894

No dataNo dataNo dataUNSAT

TT=1.274

UNSAT

TT=0.511

No dataUNSAT

TT=1.095

No dataUNSAT

TT=0.053

UNSAT

TT=0.133

UNSAT

TT=0.131

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.664

UNSAT

TT=0.955

UNSAT

TT=0.874

No dataNo dataNo dataUNSAT

TT=2.999

UNSAT

TT=2.944

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1468.cudf.paranoid.opb
OPT
f=6
TT=1.674
T1=0.65
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (problem)

TT=0.395

? (problem)

TT=0.443

? (problem)

TT=0.393

? (problem)

TT=0.439

? (problem)

TT=0.409

? (problem)

TT=0.489

OPT
f=6
TT=34.989
T1=34.99
SAT (TO)
f=2483294
TT=1800.1
T1=674.38
No dataNo dataOPT
f=6
TT=1.934
T1=0.77
No dataOPT
f=6
TT=1.884
T1=0.76
No dataNo dataNo dataOPT
f=6
TT=2.547
T1=1.65
OPT
f=6
TT=2.769
T1=2.7
No dataOPT
f=6
TT=1.976
T1=1.14
No dataSAT (TO)
f=119339
TT=1800.06
T1=1800.5
? (TO)

TT=1800.01

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=6
TT=2.592
T1=1.25
OPT
f=6
TT=1.674
T1=0.65
OPT
f=6
TT=1.724
T1=0.7
No dataNo dataNo dataOPT
f=6
TT=3.269
T1=3.25
OPT
f=6
TT=3.177
T1=3.15
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-520.cudf.paranoid.opb
UNSAT

TT=0.042

No dataNo dataNo dataUNSAT

TT=0.125

UNSAT

TT=0.147

UNSAT

TT=0.116

UNSAT

TT=0.144

UNSAT

TT=0.118

UNSAT

TT=0.142

UNSAT

TT=0.127

UNSAT

TT=0.14

UNSAT

TT=0.099

UNSAT

TT=0.367

No dataNo dataUNSAT

TT=0.924

No dataUNSAT

TT=0.874

No dataNo dataNo dataUNSAT

TT=1.353

UNSAT

TT=0.428

No dataUNSAT

TT=1.076

No dataUNSAT

TT=0.042

UNSAT

TT=0.105

UNSAT

TT=0.113

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.545

UNSAT

TT=0.903

UNSAT

TT=0.852

No dataNo dataNo dataUNSAT

TT=2.158

UNSAT

TT=2.119

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-550.cudf.paranoid.opb
OPT
f=2
TT=1.312
T1=0.57
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (problem)

TT=0.301

? (problem)

TT=0.335

? (problem)

TT=0.298

? (problem)

TT=0.323

? (problem)

TT=0.313

? (problem)

TT=0.344

OPT
f=2
TT=14.459
T1=14.46
SAT (TO)
f=1838
TT=1800.06
T1=1772.02
No dataNo dataOPT
f=2
TT=1.338
T1=0.65
No dataOPT
f=2
TT=1.447
T1=0.64
No dataNo dataNo dataOPT
f=2
TT=2.134
T1=1.59
OPT
f=2
TT=1.421
T1=1.38
No dataOPT
f=2
TT=1.594
T1=1.06
No dataSAT (TO)
f=75747
TT=1800.03
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=2
TT=2.355
T1=1.19
OPT
f=2
TT=1.312
T1=0.57
SAT
f=2
TT=1.984
T1=0.93
No dataNo dataNo dataOPT
f=2
TT=1.758
T1=1.74
OPT
f=2
TT=1.739
T1=1.7
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand5c0b12.cudf.paranoid.opb
UNSAT

TT=0.071

No dataNo dataNo dataUNSAT

TT=0.215

UNSAT

TT=0.181

UNSAT

TT=0.202

UNSAT

TT=0.177

UNSAT

TT=0.203

UNSAT

TT=0.17

UNSAT

TT=0.215

UNSAT

TT=0.179

UNSAT

TT=0.092

UNSAT

TT=0.518

No dataNo dataUNSAT

TT=1.204

No dataUNSAT

TT=0.943

No dataNo dataNo dataUNSAT

TT=1.225

UNSAT

TT=0.42

No dataUNSAT

TT=1.083

No dataUNSAT

TT=0.071

UNSAT

TT=0.149

UNSAT

TT=0.148

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.784

UNSAT

TT=1.064

UNSAT

TT=0.903

No dataNo dataNo dataUNSAT

TT=1.418

UNSAT

TT=1.427

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand659e05.cudf.paranoid.opb
UNSAT

TT=0.073

No dataNo dataNo dataUNSAT

TT=0.202

UNSAT

TT=0.169

UNSAT

TT=0.194

UNSAT

TT=0.162

UNSAT

TT=0.198

UNSAT

TT=0.163

UNSAT

TT=0.206

UNSAT

TT=0.174

UNSAT

TT=0.093

UNSAT

TT=0.49

No dataNo dataUNSAT

TT=1.204

No dataUNSAT

TT=0.945

No dataNo dataNo dataUNSAT

TT=1.234

UNSAT

TT=0.351

No dataUNSAT

TT=1.184

No dataUNSAT

TT=0.073

UNSAT

TT=0.142

UNSAT

TT=0.139

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.415

UNSAT

TT=1.094

UNSAT

TT=0.924

No dataNo dataNo dataUNSAT

TT=1.334

UNSAT

TT=1.343

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-randee102b.cudf.paranoid.opb
SAT
f=14736
TT=1800.16
T1=49.37
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (problem)

TT=0.357

? (problem)

TT=0.298

? (problem)

TT=0.362

? (problem)

TT=0.305

? (problem)

TT=0.375

? (problem)

TT=0.312

SAT (TO)
f=14741
TT=1800.07
T1=1799.28
SAT (TO)
f=131880
TT=1800.03
T1=1661.93
No dataNo dataSAT (TO)
f=14741
TT=1802.06
T1=1786.63
No dataSAT (TO)
f=14739
TT=1800.76
T1=372.48
No dataNo dataNo dataSAT (TO)
f=14737
TT=1800.12
T1=203.04
OPT
f=14734
TT=7.649
T1=7.59
No dataSAT (TO)
f=14736
TT=1800.58
T1=344.64
No dataSAT (TO)
f=37072
TT=1800.11
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=14736
TT=1800.16
T1=49.37
SAT (TO)
f=14737
TT=1800.78
T1=952.06
SAT (TO)
f=14741
TT=1800.07
T1=1783.87
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.smallist/
normalized-rand2fa1f8.cudf.paranoid.opb
UNSAT

TT=0.02

No dataNo dataNo dataUNSAT

TT=0.077

UNSAT

TT=0.094

UNSAT

TT=0.069

UNSAT

TT=0.088

UNSAT

TT=0.072

UNSAT

TT=0.082

UNSAT

TT=0.074

UNSAT

TT=0.089

UNSAT

TT=0.054

UNSAT

TT=0.163

No dataNo dataUNSAT

TT=0.934

No dataUNSAT

TT=0.683

No dataNo dataNo dataUNSAT

TT=0.985

UNSAT

TT=0.234

No dataUNSAT

TT=0.964

No dataUNSAT

TT=0.02

UNSAT

TT=0.059

UNSAT

TT=0.061

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.018

UNSAT

TT=0.745

UNSAT

TT=0.724

No dataNo dataNo dataUNSAT

TT=1.347

UNSAT

TT=1.342

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.smallist/
normalized-rand56b853.cudf.paranoid.opb
OPT
f=337
TT=2.033
T1=0.69
No dataNo dataNo dataOPT
f=337
TT=655.961
T1=649.51
OPT
f=337
TT=56.169
T1=56.39
? (problem)

TT=0.17

? (problem)

TT=0.195

? (problem)

TT=0.171

? (problem)

TT=0.176

? (problem)

TT=0.177

? (problem)

TT=0.178

OPT
f=337
TT=7.149
T1=7.14
OPT
f=337
TT=316.648
T1=316.52
No dataNo dataOPT
f=337
TT=2.725
T1=1.04
No dataOPT
f=337
TT=2.096
T1=0.77
No dataNo dataNo dataOPT
f=337
TT=3.964
T1=4.6
OPT
f=337
TT=0.549
T1=0.52
No dataOPT
f=337
TT=2.994
T1=2.58
No dataOPT
f=337
TT=337.168
T1=337.24
? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=337
TT=3.712
T1=1.57
OPT
f=337
TT=2.054
T1=0.69
OPT
f=337
TT=2.033
T1=0.78
No dataNo dataNo dataOPT
f=337
TT=2.605
T1=1.89
OPT
f=337
TT=4.207
T1=1.93
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.smallist/
normalized-rand88811a.cudf.paranoid.opb
OPT
f=2256
TT=2.644
T1=0.93
No dataNo dataNo dataOPT
f=2256
TT=609.085
T1=595.99
OPT
f=2256
TT=197.636
T1=197.84
? (problem)

TT=0.178

? (problem)

TT=0.187

? (problem)

TT=0.179

? (problem)

TT=0.188

? (problem)

TT=0.187

? (problem)

TT=0.2

OPT
f=2256
TT=7.174
T1=7.15
SAT (TO)
f=302903
TT=1800.07
T1=916.41
No dataNo dataOPT
f=2256
TT=3.033
T1=0.95
No dataOPT
f=2256
TT=2.644
T1=0.93
No dataNo dataNo dataOPT
f=2256
TT=4.023
T1=4.59
OPT
f=2256
TT=0.623
T1=0.59
No dataOPT
f=2256
TT=3.772
T1=3.14
No dataSAT (TO)
f=451305
TT=1800.09
T1=1800.5
OPT
f=2256
TT=1466.05
T1=1466.37
? (TO)

TT=2158.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=2256
TT=6.675
T1=3.17
OPT
f=2256
TT=6.255
T1=4.69
OPT
f=2256
TT=2.795
T1=1.22
No dataNo dataNo dataOPT
f=2256
TT=7.674
T1=4.56
OPT
f=2256
TT=7.399
T1=4.52
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.smallist/
normalized-randa65dfb.cudf.paranoid.opb
OPT
f=2355
TT=14.011
T1=0.76
No dataNo dataNo data? (TO)

TT=1800.07

OPT
f=2355
TT=159.119
T1=105.8
? (problem)

TT=0.181

? (problem)

TT=0.191

? (problem)

TT=0.187

? (problem)

TT=0.186

? (problem)

TT=0.192

? (problem)

TT=0.193

OPT
f=2355
TT=9.545
T1=9.39
SAT (TO)
f=180673
TT=1800.02
T1=1797.02
No dataNo dataOPT
f=2355
TT=37.207
T1=1.32
No dataOPT
f=2355
TT=32.078
T1=1.92
No dataNo dataNo dataOPT
f=2355
TT=14.011
T1=3.58
OPT
f=2355
TT=0.568
T1=0.54
No dataOPT
f=2355
TT=26.37
T1=2.7
No dataSAT (TO)
f=10226
TT=1800.01
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=2355
TT=74.143
T1=1.58
OPT
f=2355
TT=22.253
T1=0.76
OPT
f=2355
TT=22.381
T1=8.09
No dataNo dataNo dataOPT
f=2355
TT=157.553
T1=11.91
OPT
f=2355
TT=158.348
T1=12.29
No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.smallist/
normalized-randdd5509.cudf.paranoid.opb
UNSAT

TT=0.043

No dataNo dataNo dataUNSAT

TT=0.108

UNSAT

TT=0.127

UNSAT

TT=0.098

UNSAT

TT=0.109

UNSAT

TT=0.101

UNSAT

TT=0.109

UNSAT

TT=0.104

UNSAT

TT=0.11

UNSAT

TT=0.057

UNSAT

TT=0.281

No dataNo dataUNSAT

TT=1.234

No dataUNSAT

TT=0.913

No dataNo dataNo dataUNSAT

TT=1.455

UNSAT

TT=0.327

No dataUNSAT

TT=1.245

No dataUNSAT

TT=0.043

UNSAT

TT=0.063

UNSAT

TT=0.063

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.666

UNSAT

TT=0.933

UNSAT

TT=0.867

No dataNo dataNo dataUNSAT

TT=1.422

UNSAT

TT=1.422

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.smallist/
normalized-randea4da3.cudf.paranoid.opb
UNSAT

TT=0.042

No dataNo dataNo dataUNSAT

TT=0.102

UNSAT

TT=0.112

UNSAT

TT=0.096

UNSAT

TT=0.105

UNSAT

TT=0.094

UNSAT

TT=0.102

UNSAT

TT=0.098

UNSAT

TT=0.101

UNSAT

TT=0.055

UNSAT

TT=0.261

No dataNo dataUNSAT

TT=1.144

No dataUNSAT

TT=0.913

No dataNo dataNo dataUNSAT

TT=1.444

UNSAT

TT=0.229

No dataUNSAT

TT=1.093

No dataUNSAT

TT=0.042

UNSAT

TT=0.063

UNSAT

TT=0.056

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.645

UNSAT

TT=0.904

UNSAT

TT=0.853

No dataNo dataNo dataUNSAT

TT=1.293

UNSAT

TT=1.287

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/10orplus/
normalized-konq-plugins.cudf.trendy.opb
SAT
f=2941009195980
TT=1800.35
T1=10.31
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (problem)

TT=1.308

? (problem)

TT=1.1

? (problem)

TT=1.306

? (problem)

TT=1.1

? (problem)

TT=1.342

? (problem)

TT=1.07

SAT (TO)
f=15700668812337
TT=1800.03
T1=141.19
SAT (TO)
f=199188946777308
TT=1800.03
T1=1.94
No dataNo dataSAT (TO)
f=2941009195980
TT=1800.35
T1=10.31
No data? (exit code)

TT=835.19

No dataNo dataNo dataSAT (TO)
f=3733327366826
TT=1800.09
T1=11.49
?

TT=1790.27

No dataSAT (TO)
f=3180617603639
TT=1800.16
T1=7.92
No dataSAT (TO)
f=199188946777308
TT=1800.04
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3345995182785
TT=1800.13
T1=415.91
SAT (TO)
f=3495416085419
TT=1800.07
T1=260.43
SAT (TO)
f=5875322121626
TT=1800.52
T1=1684.17
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/datasets/
10orplus/normalized-libdbd-pg-perl.cudf.trendy.opb
SAT
f=3887655178043
TT=1800.2
T1=678.22
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (problem)

TT=1.313

? (problem)

TT=1.15

? (problem)

TT=1.289

? (problem)

TT=1.13

? (problem)

TT=1.348

? (problem)

TT=1.1

SAT (TO)
f=11184080764161
TT=1800.09
T1=302.24
SAT (TO)
f=224855731527707
TT=1800.03
T1=1.91
No dataNo dataSAT (TO)
f=4363293270668
TT=1800.3
T1=87.94
No data? (exit code)

TT=1315.01

No dataNo dataNo dataSAT (TO)
f=4921518694049
TT=1800.21
T1=8.44
?

TT=1790.34

No dataSAT (TO)
f=4442541690064
TT=1800.88
T1=33.58
No dataSAT (TO)
f=224855731527707
TT=1800.01
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3887655178043
TT=1800.2
T1=678.22
SAT (TO)
f=3891934887712
TT=1800.02
T1=1125.94
SAT (TO)
f=6508700725057
TT=1800.6
T1=1777.56
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.12

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/10orplus/
normalized-mercurial-common.cudf.trendy.opb
SAT
f=3183187736701
TT=1800.92
T1=561.42
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (problem)

TT=1.328

? (problem)

TT=1.14

? (problem)

TT=1.302

? (problem)

TT=1.11

? (problem)

TT=1.369

? (problem)

TT=1.11

SAT (TO)
f=6200201106580
TT=1800.1
T1=145.21
SAT (TO)
f=215658671420169
TT=1800.03
T1=1.91
No dataNo dataSAT (TO)
f=3418127728453
TT=1800.35
T1=10.01
No data? (exit code)

TT=1109.49

No dataNo dataNo dataSAT (TO)
f=5559311385494
TT=1801.68
T1=10.56
?

TT=1790.32

No dataSAT (TO)
f=3577049037818
TT=1800.12
T1=45.69
No dataSAT (TO)
f=215658671420169
TT=1800.1
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3262288506856
TT=1800.12
T1=193.98
SAT (TO)
f=3183187736701
TT=1800.92
T1=561.42
SAT (TO)
f=6116726355486
TT=1800.82
T1=1334.91
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/10orplus/
normalized-sonata.cudf.trendy.opb
SAT
f=3341467903034
TT=1800.78
T1=314.73
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (problem)

TT=1.329

? (problem)

TT=1.01

? (problem)

TT=1.309

? (problem)

TT=1.08

? (problem)

TT=1.361

? (problem)

TT=1.02

SAT (TO)
f=10408274613422
TT=1800.07
T1=149.12
SAT (TO)
f=215650513310438
TT=1800.03
T1=1.91
No dataNo dataSAT (TO)
f=4051324418110
TT=1800.34
T1=9.14
No data? (exit code)

TT=1002.96

No dataNo dataNo dataSAT (TO)
f=4056512860653
TT=1800.06
T1=9.52
?

TT=1790.29

No dataSAT (TO)
f=3579120737094
TT=1800.2
T1=19.75
No dataSAT (TO)
f=215650513310438
TT=1800.03
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3499853887875
TT=1800.11
T1=42.27
SAT (TO)
f=3341467903034
TT=1800.78
T1=314.73
SAT (TO)
f=6118226437788
TT=1800.84
T1=1593.36
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/10orplus/
normalized-xvfb.cudf.trendy.opb
SAT
f=3022771522395
TT=1801.58
T1=10.56
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (problem)

TT=1.309

? (problem)

TT=1.18

? (problem)

TT=1.28

? (problem)

TT=1.13

? (problem)

TT=1.334

? (problem)

TT=1.12

SAT (TO)
f=13652911048477
TT=1800.04
T1=134.78
SAT (TO)
f=226519210856450
TT=1800.03
T1=2.11
No dataNo dataSAT (TO)
f=3972755900459
TT=1800.3
T1=10.08
No data? (exit code)

TT=860.35

No dataNo dataNo dataSAT (TO)
f=3022771522395
TT=1801.58
T1=10.56
?

TT=1790.35

No dataSAT (TO)
f=4451752958008
TT=1800.78
T1=8.46
No dataSAT (TO)
f=226519210856450
TT=1800.05
T1=1800.61
? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3113646975535
TT=1800.09
T1=29.65
SAT (TO)
f=3262251595672
TT=1800.09
T1=2.6
SAT (TO)
f=6275204730042
TT=1800.83
T1=1786.03
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/9orless/
normalized-gnash-common-opengl.cudf.trendy.opb
SAT
f=3512029902480
TT=1800.04
T1=842.74
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (problem)

TT=1.299

? (problem)

TT=1.13

? (problem)

TT=1.299

? (problem)

TT=1.11

? (problem)

TT=1.343

? (problem)

TT=1.11

SAT (TO)
f=10007151752558
TT=1800.07
T1=155.09
SAT (TO)
f=207888986273486
TT=1800.04
T1=2.06
No dataNo dataSAT (TO)
f=3734807643400
TT=1800.71
T1=10.27
No data? (exit code)

TT=1124.97

No dataNo dataNo dataSAT (TO)
f=4369127165283
TT=1800.54
T1=10.52
?

TT=1790.07

No dataSAT (TO)
f=3735176755716
TT=1800.08
T1=566.27
No dataSAT (TO)
f=207888986273486
TT=1800.03
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3580998539605
TT=1800.06
T1=896.32
SAT (TO)
f=3512029902480
TT=1800.04
T1=842.74
SAT (TO)
f=5956291685603
TT=1800.1
T1=1684.92
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/9orless/
normalized-gtwitter.cudf.trendy.opb
SAT
f=3182837080026
TT=1800.11
T1=117.72
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (problem)

TT=1.334

? (problem)

TT=1.06

? (problem)

TT=1.302

? (problem)

TT=1.07

? (problem)

TT=1.353

? (problem)

TT=1

SAT (TO)
f=7230079846252
TT=1800.09
T1=135.57
SAT (TO)
f=175781345094756
TT=1800.03
T1=2.02
No dataNo dataSAT (TO)
f=3655799151310
TT=1800.77
T1=35.18
No data? (exit code)

TT=980.35

No dataNo dataNo dataSAT (TO)
f=4608644149666
TT=1801.78
T1=10.56
SAT
f=3895906715378
TT=1790.4
T1=1790.42
No dataSAT (TO)
f=3735435134314
TT=1800.05
T1=9.25
No dataSAT (TO)
f=175781345094756
TT=1800.02
T1=1800.4
? (TO)

TT=1800

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3182837080026
TT=1800.11
T1=117.72
SAT (TO)
f=3341278543391
TT=1800.04
T1=23.94
SAT (TO)
f=6272787044447
TT=1800.06
T1=1531.56
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/9orless/
normalized-kphotoalbum.cudf.trendy.opb
SAT
f=2862148164095
TT=1800.22
T1=10.61
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (problem)

TT=1.49

? (problem)

TT=1.07

? (problem)

TT=1.309

? (problem)

TT=1.06

? (problem)

TT=1.344

? (problem)

TT=1.06

SAT (TO)
f=9683765773916
TT=1800.1
T1=134.53
SAT (TO)
f=203862998630746
TT=1800.03
T1=1.94
No dataNo dataSAT (TO)
f=3651551705005
TT=1801.85
T1=9.66
No data? (exit code)

TT=894.637

No dataNo dataNo dataSAT (TO)
f=2862148164095
TT=1800.22
T1=10.61
?

TT=1790.29

No dataSAT (TO)
f=3417735662998
TT=1800.85
T1=8.51
No dataSAT (TO)
f=203862998630746
TT=1800
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3257504803977
TT=1800.16
T1=842.68
SAT (TO)
f=3184805078375
TT=1800.59
T1=650.86
SAT (TO)
f=5950899583177
TT=1800.04
T1=1417.67
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/9orless/
normalized-mono-gac.cudf.trendy.opb
SAT
f=3177795208946
TT=1800.68
T1=402.61
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (problem)

TT=1.49

? (problem)

TT=1.13

? (problem)

TT=1.311

? (problem)

TT=1.09

? (problem)

TT=1.356

? (problem)

TT=1.08

SAT (TO)
f=16023362620577
TT=1800.1
T1=134.25
SAT (TO)
f=224063634721230
TT=1800.03
T1=1.91
No dataNo dataSAT (TO)
f=3732478803677
TT=1800.34
T1=78.26
No data? (exit code)

TT=1034.49

No dataNo dataNo dataSAT (TO)
f=6109691574331
TT=1801.21
T1=9.52
?

TT=1790.45

No dataSAT (TO)
f=3574240223243
TT=1800.08
T1=12.65
No dataSAT (TO)
f=224063634721230
TT=1800.1
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3180617603682
TT=1800.39
T1=891.6
SAT (TO)
f=3177795208946
TT=1800.68
T1=402.61
SAT (TO)
f=5637539969445
TT=1800.09
T1=1508.73
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/9orless/
normalized-plasma-widgets-workspace.cudf.trendy.opb
SAT
f=3494051005557
TT=1800.63
T1=437.2
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (problem)

TT=1.32

? (problem)

TT=1.12

? (problem)

TT=1.297

? (problem)

TT=1.08

? (problem)

TT=1.345

? (problem)

TT=1.04

SAT (TO)
f=6194418760087
TT=1800.04
T1=131.32
SAT (TO)
f=200376234200358
TT=1800.11
T1=2.06
No dataNo dataSAT (TO)
f=3969486180903
TT=1800.9
T1=9.48
No data? (exit code)

TT=870.5

No dataNo dataNo dataSAT (TO)
f=4839669244170
TT=1800.09
T1=9.46
SAT
f=30352956299578
TT=1790.34
T1=1790.38
No dataSAT (TO)
f=3574111094076
TT=1800.87
T1=12.58
No dataSAT (TO)
f=200376234200358
TT=1800.03
T1=1800.61
? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3494051005557
TT=1800.63
T1=437.2
SAT (TO)
f=3494383051968
TT=1800.09
T1=1701.5
SAT (TO)
f=5633905905567
TT=1800.6
T1=1667.08
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/caixa/
normalized-1098.cudf.trendy.opb
OPT
f=102017
TT=0.142
T1=0.13
No dataNo dataNo dataOPT
f=102017
TT=37.871
T1=37.88
OPT
f=102017
TT=49.57
T1=49.74
? (problem)

TT=0.039

? (problem)

TT=0.05

? (problem)

TT=0.036

? (problem)

TT=0.054

? (problem)

TT=0.043

? (problem)

TT=0.048

Wrong Opt.
f=610822
TT=0.027
T1=0.02
OPT
f=102017
TT=14.95
T1=14.94
No dataNo dataOPT
f=102017
TT=1.004
T1=0.45
No dataOPT
f=102017
TT=0.995
T1=0.45
No dataNo dataNo dataOPT
f=102017
TT=1.924
T1=1.35
OPT
f=102017
TT=0.118
T1=0.09
No dataOPT
f=102017
TT=1.355
T1=0.86
No dataOPT
f=102017
TT=0.772
T1=0.77
OPT
f=102017
TT=56.86
T1=40.38
OPT
f=102017
TT=61.371
T1=53.07
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=102017
TT=1.935
T1=0.87
OPT
f=102017
TT=0.784
T1=0.36
OPT
f=102017
TT=1.043
T1=0.48
No dataNo dataNo dataOPT
f=102017
TT=0.142
T1=0.13
OPT
f=102017
TT=0.142
T1=0.13
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/caixa/
normalized-121.cudf.trendy.opb
UNSAT

TT=0.019

No dataNo dataNo dataUNSAT

TT=0.059

UNSAT

TT=0.073

UNSAT

TT=0.052

UNSAT

TT=0.067

UNSAT

TT=0.049

UNSAT

TT=0.064

UNSAT

TT=0.055

UNSAT

TT=0.064

UNSAT

TT=0.035

UNSAT

TT=0.138

No dataNo dataUNSAT

TT=0.813

No dataUNSAT

TT=0.645

No dataNo dataNo dataUNSAT

TT=0.963

UNSAT

TT=0.185

No dataUNSAT

TT=0.936

No dataUNSAT

TT=0.019

UNSAT

TT=0.046

UNSAT

TT=0.042

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.075

UNSAT

TT=0.704

UNSAT

TT=0.673

No dataNo dataNo dataUNSAT

TT=0.589

UNSAT

TT=0.587

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/caixa/
normalized-1335.cudf.trendy.opb
UNSAT

TT=0.054

No dataNo dataNo dataUNSAT

TT=0.157

UNSAT

TT=0.183

UNSAT

TT=0.149

UNSAT

TT=0.183

UNSAT

TT=0.149

UNSAT

TT=0.172

UNSAT

TT=0.158

UNSAT

TT=0.174

UNSAT

TT=0.118

UNSAT

TT=0.464

No dataNo dataUNSAT

TT=0.935

No dataUNSAT

TT=0.904

No dataNo dataNo dataUNSAT

TT=1.205

UNSAT

TT=0.568

No dataUNSAT

TT=1.104

No dataUNSAT

TT=0.054

UNSAT

TT=0.133

UNSAT

TT=0.133

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.673

UNSAT

TT=0.998

UNSAT

TT=0.904

No dataNo dataNo dataUNSAT

TT=3.631

UNSAT

TT=3.606

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/datasets/caixa/
normalized-902.cudf.trendy.opb
OPT
f=283030
TT=0.207
T1=0.19
No dataNo dataNo dataOPT
f=283030
TT=35.939
T1=36
OPT
f=283030
TT=76.125
T1=76.89
? (problem)

TT=0.048

? (problem)

TT=0.056

? (problem)

TT=0.044

? (problem)

TT=0.057

? (problem)

TT=0.051

? (problem)

TT=0.059

Wrong Opt.
f=1979542
TT=0.038
T1=0.07
OPT
f=283030
TT=38.79
T1=38.78
No dataNo dataOPT
f=283030
TT=1.335
T1=0.58
No dataOPT
f=283030
TT=1.626
T1=0.67
No dataNo dataNo dataOPT
f=283030
TT=2.309
T1=5.43
OPT
f=283030
TT=0.189
T1=0.17
No dataOPT
f=283030
TT=2.656
T1=2.93
No dataOPT
f=283030
TT=3.949
T1=3.94
OPT
f=283030
TT=137.777
T1=137.94
OPT
f=283030
TT=297.471
T1=269.73
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=283030
TT=2.195
T1=2.94
OPT
f=283030
TT=1.113
T1=0.5
OPT
f=283030
TT=1.514
T1=0.66
No dataNo dataNo dataOPT
f=283030
TT=0.207
T1=0.19
OPT
f=283030
TT=0.208
T1=0.19
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-rand0c02bc.cudf.trendy.opb
OPT
f=23334331450
TT=9.084
T1=6.48
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (problem)

TT=0.348

? (problem)

TT=0.294

? (problem)

TT=0.345

? (problem)

TT=0.294

? (problem)

TT=0.359

? (problem)

TT=0.287

Wrong Opt.
f=28083452746
TT=532.267
T1=531.3
SAT (TO)
f=636062682825
TT=1800.12
T1=1254.33
No dataNo dataOPT
f=23334331450
TT=14.462
T1=12.15
No dataOPT
f=23334331450
TT=62.97
T1=56.32
No dataNo dataNo dataOPT
f=23334331450
TT=57.735
T1=25.72
OPT
f=23334331450
TT=6.023
T1=5.98
No dataOPT
f=23334331450
TT=117.165
T1=60.52
No dataSAT (TO)
f=649946012164
TT=1800.09
T1=1800.61
? (TO)

TT=1800.03

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=23334331450
TT=20.631
T1=9.74
OPT
f=23334331450
TT=9.084
T1=6.48
OPT
f=23334331450
TT=25.329
T1=23.1
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-rand2d8467.cudf.trendy.opb
OPT
f=41472152248
TT=6.933
T1=2.1
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (problem)

TT=0.349

? (problem)

TT=0.292

? (problem)

TT=0.346

? (problem)

TT=0.297

? (problem)

TT=0.357

? (problem)

TT=0.293

Wrong Opt.
f=53455977655
TT=311.956
T1=312.01
SAT (TO)
f=1339318482135
TT=1800.03
T1=1535.78
No dataNo dataOPT
f=41472152248
TT=12.478
T1=10.55
No dataOPT
f=41472152248
TT=6.933
T1=2.1
No dataNo dataNo dataOPT
f=41472152248
TT=25.05
T1=16.71
OPT
f=41472152248
TT=7.108
T1=7.05
No dataOPT
f=41472152248
TT=11.972
T1=10
No dataSAT (TO)
f=464950828899
TT=1800.1
T1=1800.5
? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=41472152248
TT=20.61
T1=16.36
OPT
f=41472152248
TT=8.623
T1=5.96
OPT
f=41472152248
TT=14.971
T1=13.27
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-rand5c0b12.cudf.trendy.opb
UNSAT

TT=0.087

No dataNo dataNo dataUNSAT

TT=0.23

UNSAT

TT=0.209

UNSAT

TT=0.22

UNSAT

TT=0.198

UNSAT

TT=0.22

UNSAT

TT=0.192

UNSAT

TT=0.232

UNSAT

TT=0.194

UNSAT

TT=0.103

UNSAT

TT=0.575

No dataNo dataUNSAT

TT=1.265

No dataUNSAT

TT=1.043

No dataNo dataNo dataUNSAT

TT=1.333

UNSAT

TT=0.478

No dataUNSAT

TT=1.163

No dataUNSAT

TT=0.087

UNSAT

TT=0.16

UNSAT

TT=0.158

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.673

UNSAT

TT=1.055

UNSAT

TT=0.919

No dataNo dataNo dataUNSAT

TT=2.642

UNSAT

TT=2.738

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-rand65d021.cudf.trendy.opb
UNSAT

TT=0.081

No dataNo dataNo dataUNSAT

TT=0.204

UNSAT

TT=0.177

UNSAT

TT=0.198

UNSAT

TT=0.163

UNSAT

TT=0.195

UNSAT

TT=0.164

UNSAT

TT=0.205

UNSAT

TT=0.164

UNSAT

TT=0.112

UNSAT

TT=0.502

No dataNo dataUNSAT

TT=1.635

No dataUNSAT

TT=1.383

No dataNo dataNo dataUNSAT

TT=1.934

UNSAT

TT=0.402

No dataUNSAT

TT=1.495

No dataUNSAT

TT=0.081

UNSAT

TT=0.173

UNSAT

TT=0.173

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=2.12

UNSAT

TT=1.464

UNSAT

TT=1.244

No dataNo dataNo dataUNSAT

TT=2.406

UNSAT

TT=2.448

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-randa491d5.cudf.trendy.opb
UNSAT

TT=0.086

No dataNo dataNo dataUNSAT

TT=0.211

UNSAT

TT=0.182

UNSAT

TT=0.203

UNSAT

TT=0.181

UNSAT

TT=0.2

UNSAT

TT=0.175

UNSAT

TT=0.212

UNSAT

TT=0.173

UNSAT

TT=0.144

UNSAT

TT=0.534

No dataNo dataUNSAT

TT=1.475

No dataUNSAT

TT=1.443

No dataNo dataNo dataUNSAT

TT=2.094

UNSAT

TT=0.435

No dataUNSAT

TT=1.654

No dataUNSAT

TT=0.086

UNSAT

TT=0.143

UNSAT

TT=0.146

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=2.343

UNSAT

TT=1.343

UNSAT

TT=1.153

No dataNo dataNo dataUNSAT

TT=2.318

UNSAT

TT=2.335

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-randb87834.cudf.trendy.opb
OPT
f=36760393453
TT=5.893
T1=3.98
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (problem)

TT=0.357

? (problem)

TT=0.31

? (problem)

TT=0.355

? (problem)

TT=0.303

? (problem)

TT=0.371

? (problem)

TT=0.305

Wrong Opt.
f=36967118565
TT=1573.33
T1=1573.55
SAT (TO)
f=458606324517
TT=1800.1
T1=1142.5
No dataNo dataOPT
f=36760393453
TT=10.334
T1=8.21
No dataOPT
f=36760393453
TT=25.999
T1=22.59
No dataNo dataNo dataOPT
f=36760393453
TT=52.896
T1=34.8
OPT
f=36760393453
TT=6.564
T1=6.53
No dataOPT
f=36760393453
TT=232.06
T1=128.66
No dataSAT (TO)
f=774979102794
TT=1800.08
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=36760393453
TT=61.104
T1=54.98
OPT
f=36760393453
TT=5.893
T1=3.98
OPT
f=36760393453
TT=21.369
T1=18.66
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-randd1cab2.cudf.trendy.opb
OPT
f=52432601474
TT=3.374
T1=1.8
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (problem)

TT=0.366

? (problem)

TT=0.301

? (problem)

TT=0.368

? (problem)

TT=0.322

? (problem)

TT=0.382

? (problem)

TT=0.301

Wrong Opt.
f=59167834757
TT=176.667
T1=176.67
SAT (TO)
f=1089231449354
TT=1800.05
T1=1500.22
No dataNo dataOPT
f=52432601474
TT=4.033
T1=2.48
No dataOPT
f=52432601474
TT=3.843
T1=2.19
No dataNo dataNo dataOPT
f=52432601474
TT=6.574
T1=9.74
OPT
f=52432601474
TT=5.954
T1=5.93
No dataOPT
f=52432601474
TT=25.56
T1=13.21
No dataSAT (TO)
f=676257329864
TT=1800.04
T1=1800.61
? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=52432601474
TT=13.331
T1=10.15
OPT
f=52432601474
TT=3.374
T1=1.8
OPT
f=52432601474
TT=9.863
T1=8.25
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.biglist/
normalized-randf7d077.cudf.trendy.opb
UNSAT

TT=0.088

No dataNo dataNo dataUNSAT

TT=0.22

UNSAT

TT=0.183

UNSAT

TT=0.209

UNSAT

TT=0.178

UNSAT

TT=0.21

UNSAT

TT=0.18

UNSAT

TT=0.221

UNSAT

TT=0.175

UNSAT

TT=0.117

UNSAT

TT=0.533

No dataNo dataUNSAT

TT=1.323

No dataUNSAT

TT=1.225

No dataNo dataNo dataUNSAT

TT=1.665

UNSAT

TT=0.473

No dataUNSAT

TT=1.305

No dataUNSAT

TT=0.088

UNSAT

TT=0.164

UNSAT

TT=0.167

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.933

UNSAT

TT=1.184

UNSAT

TT=1.213

No dataNo dataNo dataUNSAT

TT=2.113

UNSAT

TT=2.124

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.newlist/
normalized-rand362510.cudf.trendy.opb
OPT
f=5239100859
TT=3.593
T1=1.86
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (problem)

TT=0.339

? (problem)

TT=0.296

? (problem)

TT=0.335

? (problem)

TT=0.287

? (problem)

TT=0.349

? (problem)

TT=0.282

SAT (TO)
f=5413931786
TT=1800.11
T1=1793.13
SAT (TO)
f=1452964579481
TT=1800.05
T1=0.63
No dataNo dataOPT
f=5239100859
TT=5.524
T1=4.04
No dataOPT
f=5239100859
TT=15.491
T1=13.54
No dataNo dataNo dataOPT
f=5239100859
TT=15.303
T1=13.69
OPT
f=5239100859
TT=6.239
T1=6.34
No dataOPT
f=5239100859
TT=24.57
T1=9.74
No dataSAT (TO)
f=201542194533
TT=1800.02
T1=1800.5
? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=5239100859
TT=7.143
T1=5.19
OPT
f=5239100859
TT=3.593
T1=1.86
OPT
f=5239100859
TT=20.301
T1=18.3
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.newlist/
normalized-rand767898.cudf.trendy.opb
OPT
f=10741049961
TT=2.864
T1=1.43
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (problem)

TT=0.326

? (problem)

TT=0.272

? (problem)

TT=0.32

? (problem)

TT=0.299

? (problem)

TT=0.332

? (problem)

TT=0.268

Wrong Opt.
f=10847328360
TT=1273.08
T1=1273.24
SAT (TO)
f=913347328530
TT=1800.07
T1=715.42
No dataNo dataOPT
f=10741049961
TT=4.244
T1=2.36
No dataOPT
f=10741049961
TT=4.813
T1=3.11
No dataNo dataNo dataOPT
f=10741049961
TT=8.693
T1=10.65
OPT
f=10741049961
TT=5.729
T1=5.69
No dataOPT
f=10741049961
TT=12.302
T1=7.67
No dataSAT (TO)
f=194785203881
TT=1800.01
T1=1800.5
? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=10741049961
TT=5.783
T1=3.2
OPT
f=10741049961
TT=2.864
T1=1.43
OPT
f=10741049961
TT=6.024
T1=4.56
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.newlist/
normalized-randc18b26.cudf.trendy.opb
OPT
f=30185484701
TT=3.433
T1=1.82
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (problem)

TT=0.338

? (problem)

TT=0.287

? (problem)

TT=0.333

? (problem)

TT=0.284

? (problem)

TT=0.348

? (problem)

TT=0.291

Wrong Opt.
f=30279055900
TT=133.977
T1=133.98
SAT (TO)
f=1440642664236
TT=1800.03
T1=0.6
No dataNo dataOPT
f=30185484701
TT=8.872
T1=6.91
No dataOPT
f=30185484701
TT=9.493
T1=7.66
No dataNo dataNo dataOPT
f=30185484701
TT=16.192
T1=17.77
OPT
f=30185484701
TT=29.657
T1=29.61
No dataOPT
f=30185484701
TT=143.453
T1=90
No dataSAT (TO)
f=337414823893
TT=1800.03
T1=1800.4
? (TO)

TT=1800

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=30185484701
TT=7.236
T1=4.2
OPT
f=30185484701
TT=3.433
T1=1.82
OPT
f=30185484701
TT=9.063
T1=7.55
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.newlist/
normalized-randc5b1f2.cudf.trendy.opb
UNSAT

TT=0.034

No dataNo dataNo dataUNSAT

TT=0.14

UNSAT

TT=0.134

UNSAT

TT=0.129

UNSAT

TT=0.127

UNSAT

TT=0.131

UNSAT

TT=0.123

UNSAT

TT=0.14

UNSAT

TT=0.122

UNSAT

TT=0.082

UNSAT

TT=0.289

No dataNo dataUNSAT

TT=0.985

No dataUNSAT

TT=0.805

No dataNo dataNo dataUNSAT

TT=0.987

UNSAT

TT=0.307

No dataUNSAT

TT=0.934

No dataUNSAT

TT=0.034

UNSAT

TT=0.12

UNSAT

TT=0.122

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.154

UNSAT

TT=0.854

UNSAT

TT=0.805

No dataNo dataNo dataUNSAT

TT=1.612

UNSAT

TT=1.579

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/
misc2010/random/rand.newlist/
normalized-randf794d2.cudf.trendy.opb
OPT
f=20204418175
TT=3.613
T1=1.97
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (problem)

TT=0.338

? (problem)

TT=0.268

? (problem)

TT=0.332

? (problem)

TT=0.271

? (problem)

TT=0.348

? (problem)

TT=0.263

Wrong Opt.
f=20285215646
TT=1138.5
T1=1138.6
SAT (TO)
f=1144253799057
TT=1800.05
T1=1120.07
No dataNo dataOPT
f=20204418175
TT=5.495
T1=3.8
No dataOPT
f=20204418175
TT=12.662
T1=11.01
No dataNo dataNo dataOPT
f=20204418175
TT=15.211
T1=13.67
OPT
f=20204418175
TT=5.038
T1=4.99
No dataOPT
f=20204418175
TT=47.699
T1=10.69
No dataSAT (TO)
f=158582713928
TT=1800.07
T1=1800.5
? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=20204418175
TT=7.485
T1=7.19
OPT
f=20204418175
TT=3.613
T1=1.97
OPT
f=20204418175
TT=12.053
T1=10.38
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/
rand.smallist/normalized-rand1958fb.cudf.trendy.opb
OPT
f=15832587875
TT=2.034
T1=0.67
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (problem)

TT=0.206

? (problem)

TT=0.196

? (problem)

TT=0.208

? (problem)

TT=0.202

? (problem)

TT=0.214

? (problem)

TT=0.201

Wrong Opt.
f=15884224512
TT=7.159
T1=7.16
SAT (TO)
f=3674097661112
TT=1800.11
T1=854.47
No dataNo dataOPT
f=15832587875
TT=2.856
T1=1.12
No dataOPT
f=15832587875
TT=2.494
T1=1.03
No dataNo dataNo dataOPT
f=15832587875
TT=3.454
T1=2.59
OPT
f=15832587875
TT=0.721
T1=0.81
No dataOPT
f=15832587875
TT=3.055
T1=1.6
No dataSAT (TO)
f=4473182562772
TT=1800.05
T1=1800.4
? (TO)

TT=1800.11

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=15832587875
TT=3.503
T1=1.09
OPT
f=15832587875
TT=2.034
T1=0.67
OPT
f=15832587875
TT=2.514
T1=1.21
No dataNo dataNo dataOPT
f=15832587875
TT=4.124
T1=3.67
OPT
f=15832587875
TT=6.066
T1=5.61
No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/
rand.smallist/normalized-randcef367.cudf.trendy.opb
UNSAT

TT=0.053

No dataNo dataNo dataUNSAT

TT=0.133

UNSAT

TT=0.144

UNSAT

TT=0.125

UNSAT

TT=0.138

UNSAT

TT=0.119

UNSAT

TT=0.128

UNSAT

TT=0.128

UNSAT

TT=0.135

UNSAT

TT=0.067

UNSAT

TT=0.341

No dataNo dataUNSAT

TT=1.283

No dataUNSAT

TT=1.004

No dataNo dataNo dataUNSAT

TT=1.522

UNSAT

TT=0.336

No dataUNSAT

TT=1.414

No dataUNSAT

TT=0.053

UNSAT

TT=0.075

UNSAT

TT=0.077

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.743

UNSAT

TT=0.985

UNSAT

TT=0.865

No dataNo dataNo dataUNSAT

TT=2.706

UNSAT

TT=2.693

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/leberre/opb-trendy/misc2010/random/
rand.smallist/normalized-randdd5509.cudf.trendy.opb
UNSAT

TT=0.043

No dataNo dataNo dataUNSAT

TT=0.116

UNSAT

TT=0.126

UNSAT

TT=0.106

UNSAT

TT=0.12

UNSAT

TT=0.105

UNSAT

TT=0.117

UNSAT

TT=0.112

UNSAT

TT=0.118

UNSAT

TT=0.058

UNSAT

TT=0.3

No dataNo dataUNSAT

TT=1.285

No dataUNSAT

TT=0.985

No dataNo dataNo dataUNSAT

TT=1.505

UNSAT

TT=0.359

No dataUNSAT

TT=1.215

No dataUNSAT

TT=0.043

UNSAT

TT=0.065

UNSAT

TT=0.065

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataUNSAT

TT=1.653

UNSAT

TT=0.905

UNSAT

TT=0.834

No dataNo dataNo dataUNSAT

TT=2.118

UNSAT

TT=2.121

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE1.0_TMAX120_K67_cod3.opb
SAT
f=-140701
TT=1800.07
T1=8.37
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (problem)

TT=11.75

? (problem)

TT=95.28

? (problem)

TT=10.81

? (problem)

TT=67.07

? (problem)

TT=11.86

? (problem)

TT=63.23

? (TO)

TT=1800.03

Signal

TT=2.511

No dataNo dataSAT (TO)
f=-121914
TT=1801.07
T1=7.82
No dataSAT (TO)
f=-140701
TT=1800.07
T1=8.37
No dataNo dataNo dataSAT (TO)
f=-101475
TT=1800.53
T1=51.95
?

TT=1789.92

No dataSAT (TO)
f=-125951
TT=1800.12
T1=27.32
No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-66053
TT=1800.2
T1=3.36
SAT (TO)
f=-53134
TT=1800.79
T1=1457.46
SAT (TO)
f=-61440
TT=1800.03
T1=1456.2
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE1.0_TMAX180_K67_cod3.opb
SAT
f=-182278
TT=1800.05
T1=19.75
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (problem)

TT=708.35

? (problem)

TT=17.51

? (problem)

TT=700.13

? (problem)

TT=22.11

? (problem)

TT=531.38

? (problem)

TT=17.67

SAT (TO)
f=-41611
TT=1800.04
T1=65.37
Signal

TT=2.369

No dataNo dataSAT (TO)
f=-159399
TT=1801.27
T1=2.25
No dataSAT (TO)
f=-146479
TT=1800.07
T1=2.21
No dataNo dataNo dataSAT (TO)
f=-182278
TT=1800.05
T1=19.75
?

TT=1790.26

No dataSAT (TO)
f=-169968
TT=1800.08
T1=18.45
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-169358
TT=1800.13
T1=2.19
SAT (TO)
f=-65252
TT=1800.11
T1=1.91
SAT (TO)
f=-92629
TT=1800.49
T1=810.75
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE1.0_TMAX300_K67_cod1.opb
SAT
f=-277886
TT=1800.08
T1=2.87
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (problem)

TT=924.17

? (problem)

TT=220.99

? (problem)

TT=905.24

? (problem)

TT=331.83

? (problem)

TT=901.7

? (problem)

TT=335.9

SAT (TO)
f=-89896
TT=1800.06
T1=714.97
Signal

TT=2.415

No dataNo dataNo Cert.

TT=768.317

No dataNo Cert.

TT=1294.78

No dataNo dataNo dataSAT (TO)
f=-277886
TT=1800.08
T1=2.87
?

TT=1790.19

No dataSAT (TO)
f=-256549
TT=1800.2
T1=2.89
No data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-201209
TT=1800.2
T1=2.79
SAT (TO)
f=-18933
TT=1800.08
T1=350.72
SAT (TO)
f=-119550
TT=1800
T1=979.58
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_0null20mast_rapportOE2.0_TMAX120_K67_cod2.opb
SAT
f=-114631
TT=1800
T1=91.03
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (problem)

TT=4.64

? (TO)

TT=1800.06

? (problem)

TT=4.68

? (problem)

TT=9.94

? (problem)

TT=4.6

? (TO)

TT=1800.07

SAT (TO)
f=-2584
TT=1800.09
T1=18.41
SAT (TO)
f=-780
TT=1800.14
T1=17.49
No dataNo dataSAT (TO)
f=-99501
TT=1800.02
T1=2.21
No dataSAT (TO)
f=-33969
TT=1800.8
T1=2.55
No dataNo dataNo dataSAT (TO)
f=-2
TT=1800.01
T1=539.08
?

TT=1790.04

No dataSAT (TO)
f=-2
TT=1800.06
T1=538.02
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-103538
TT=1800.2
T1=597.81
SAT (TO)
f=-87568
TT=1800.06
T1=53.36
SAT (TO)
f=-114631
TT=1800
T1=91.03
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_0null50mast_rapportOE1.0_TMAX300_K67_cod3.opb
SAT
f=-527853
TT=1800.05
T1=149.4
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (problem)

TT=1724.13

? (TO)

TT=1800.06

? (problem)

TT=1365.99

? (TO)

TT=1800.05

? (problem)

TT=1408.93

? (TO)

TT=1800.06

Signal

TT=635.08

Signal

TT=2.392

No dataNo dataNo Cert.

TT=932.55

No dataSAT (TO)
f=-484208
TT=1800.02
T1=11.87
No dataNo dataNo dataSAT (TO)
f=-484208
TT=1800.19
T1=29.09
?

TT=1789.99

No dataSAT (TO)
f=-484208
TT=1800.1
T1=3.97
No dataNo Cert.

TT=1800

? (TO)

TT=1800.08

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-73001
TT=1800.01
T1=2.81
SAT (TO)
f=-261518
TT=1800.11
T1=1.72
SAT (TO)
f=-527853
TT=1800.05
T1=149.4
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_10null10mast_rapportOE1.0_TMAX300_K67_cod3.opb
SAT
f=-454564
TT=1800.07
T1=2.74
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (problem)

TT=44.21

? (TO)

TT=1800.02

? (problem)

TT=44.64

? (TO)

TT=1800.02

? (problem)

TT=46.36

? (TO)

TT=1800.03

Signal

TT=1145.58

Signal

TT=2.346

No dataNo dataNo Cert.

TT=633.35

No dataNo Cert.

TT=1199.68

No dataNo dataNo dataSAT (TO)
f=-441411
TT=1801.31
T1=36.29
?

TT=1790.07

No dataSAT (TO)
f=-454564
TT=1800.07
T1=2.74
No data? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-417922
TT=1800.98
T1=2.22
SAT (TO)
f=-92036
TT=1800.05
T1=1.52
SAT (TO)
f=-293327
TT=1800.82
T1=205.82
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_10null50mast_rapportOE1.0_TMAX120_K67_cod3.opb
SAT
f=-249174
TT=1801.11
T1=6.38
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.11

? (problem)

TT=10.83

? (TO)

TT=1800.08

? (problem)

TT=10.72

? (TO)

TT=1800.06

? (problem)

TT=10.78

? (TO)

TT=1800.1

? (TO)

TT=1800.12

Signal

TT=2.509

No dataNo dataSAT (TO)
f=-249174
TT=1801.11
T1=6.38
No dataSAT (TO)
f=-65676
TT=1800.04
T1=3.08
No dataNo dataNo dataSAT (TO)
f=-10946
TT=1800.18
T1=4.81
?

TT=1789.95

No dataSAT (TO)
f=-10946
TT=1800.02
T1=4.24
No dataNo Cert.

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-192847
TT=1800.63
T1=706.39
SAT (TO)
f=-90762
TT=1800.75
T1=14.72
SAT (TO)
f=-214756
TT=1800.05
T1=45.96
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_20null0mast_rapportOE2.0_TMAX15_K67_cod1.opb
SAT
f=-14517
TT=1800.07
T1=497.58
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1711.64

? (TO)

TT=1800.1

? (problem)

TT=1701.27

? (TO)

TT=1800.09

? (problem)

TT=1720.88

? (TO)

TT=1800

SAT (TO)
f=-615
TT=1800.11
T1=1479.98
Signal

TT=2.377

No dataNo dataSAT (TO)
f=-2584
TT=1801.56
T1=1260.74
No dataSAT (TO)
f=-7375
TT=1800.69
T1=1519.75
No dataNo dataNo dataSAT (TO)
f=-6799
TT=1800.19
T1=812.53
?

TT=1790.02

No dataSAT (TO)
f=-14517
TT=1800.07
T1=497.58
No dataNo Cert.

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-13532
TT=1800.07
T1=907.41
SAT (TO)
f=-13530
TT=1800.79
T1=71.59
SAT (TO)
f=-13585
TT=1800.03
T1=982.74
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_20null10mast_rapportOE1.0_TMAX120_K67_cod1.opb
SAT
f=-152401
TT=1800.16
T1=12.68
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (problem)

TT=10.83

? (TO)

TT=1800.03

? (problem)

TT=11.72

? (TO)

TT=1800.04

? (problem)

TT=11.68

? (TO)

TT=1801.53

? (TO)

TT=1800.06

Signal

TT=2.495

No dataNo dataNo Cert.

TT=1469.18

No dataSAT (TO)
f=-97658
TT=1800.65
T1=8.06
No dataNo dataNo dataSAT (TO)
f=-152401
TT=1800.76
T1=13.12
?

TT=1790.04

No dataSAT (TO)
f=-152401
TT=1800.16
T1=12.68
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-139892
TT=1800.18
T1=10.35
SAT (TO)
f=-46983
TT=1800.05
T1=1730.47
SAT (TO)
f=-93956
TT=1800.08
T1=1084.95
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_20null50mast_rapportOE2.0_TMAX60_K67_cod2.opb
SAT
f=-50552
TT=1800.05
T1=364.15
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (problem)

TT=4.37

? (problem)

TT=7.06

? (problem)

TT=4.34

? (problem)

TT=7.37

? (problem)

TT=4.32

? (problem)

TT=7.13

? (TO)

TT=1800.12

SAT (TO)
f=-21947
TT=1800.07
T1=1447.54
No dataNo dataSAT (TO)
f=-22125
TT=1800.05
T1=15.14
No dataSAT (TO)
f=-47355
TT=1800.74
T1=174.53
No dataNo dataNo dataSAT (TO)
f=-43784
TT=1800.08
T1=264.11
?

TT=1790.05

No dataSAT (TO)
f=-50552
TT=1800.05
T1=364.15
No dataNo Cert.

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-6765
TT=1800.08
T1=100.65
SAT (TO)
f=0
TT=1800.1
T1=13.1
SAT (TO)
f=-45381
TT=1800.08
T1=1094.91
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null10mast_rapportOE1.0_TMAX15_K67_cod3.opb
SAT
f=-18088
TT=1800.66
T1=1144.69
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (problem)

TT=1225.97

? (TO)

TT=1800.1

? (problem)

TT=1469.51

? (problem)

TT=1515.66

? (problem)

TT=1144.4

? (problem)

TT=1562.62

SAT (TO)
f=-7155
TT=1800.05
T1=1731.11
Signal

TT=2.494

No dataNo dataSAT (TO)
f=-10946
TT=1800.72
T1=488.75
No dataSAT (TO)
f=-6778
TT=1800.82
T1=978.13
No dataNo dataNo data? (TO)

TT=1800.05

?

TT=1790.09

No dataSAT (TO)
f=-10955
TT=1800.15
T1=792.48
No data? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-10946
TT=1800.75
T1=141.31
SAT (TO)
f=-7765
TT=1800.01
T1=1438.04
SAT (TO)
f=-18088
TT=1800.66
T1=1144.69
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null10mast_rapportOE2.0_TMAX300_K67_cod3.opb
SAT
f=-248564
TT=1800.1
T1=3.44
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (problem)

TT=13.72

? (problem)

TT=28.23

? (problem)

TT=13.52

? (problem)

TT=22.36

? (problem)

TT=15

? (problem)

TT=22.25

Signal

TT=916.419

Signal

TT=2.408

No dataNo dataNo Cert.

TT=1434.66

No dataSAT (TO)
f=-218920
TT=1800.88
T1=4.16
No dataNo dataNo dataSAT (TO)
f=-240812
TT=1800.21
T1=67.95
?

TT=1789.91

No dataSAT (TO)
f=-248564
TT=1800.1
T1=3.44
No data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-65687
TT=1800.76
T1=2.23
SAT (TO)
f=-65687
TT=1800.06
T1=1.25
SAT (TO)
f=-184690
TT=1800.06
T1=109.19
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null10mast_rapportOE2.0_TMAX60_K67_cod1.opb
SAT
f=-35450
TT=1800.01
T1=286.63
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.1

Signal

TT=2.452

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-17712
TT=1800.82
T1=287.44
?

TT=1789.96

No data? (TO)

TT=1800.08

No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.76

SAT (TO)
f=0
TT=1800.81
T1=1196.48
SAT (TO)
f=-35450
TT=1800.01
T1=286.63
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null20mast_rapportOE1.0_TMAX15_K67_cod2.opb
OPT
f=-12022
TT=607.882
T1=7.15
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (problem)

TT=3.16

OPT
f=-12022
TT=1063.05
T1=793.1
? (problem)

TT=6.167

OPT
f=-12022
TT=1018.82
T1=763.39
? (problem)

TT=3.15

? (TO)

TT=1800.1

SAT (TO)
f=0
TT=1800.1
T1=1757.85
No dataNo dataSAT (TO)
f=-12022
TT=1800
T1=7.15
No dataSAT (TO)
f=-10946
TT=1800.78
T1=497.5
No dataNo dataNo dataSAT (TO)
f=-3660
TT=1800.4
T1=816.74
?

TT=1789.86

No dataSAT (TO)
f=-1
TT=1800.07
T1=761.81
No data? (TO)

TT=1800.1

? (TO)

TT=1800

OPT
f=-12022
TT=607.882
T1=374.21
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-89
TT=1800.56
T1=520.83
SAT (TO)
f=-10946
TT=1800.09
T1=461.17
SAT (TO)
f=-10946
TT=1800.02
T1=120.42
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null20mast_rapportOE2.0_TMAX60_K67_cod1.opb
SAT
f=-40844
TT=1800.69
T1=627.98
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (problem)

TT=662.8

? (TO)

TT=1800.08

? (problem)

TT=566.53

? (TO)

TT=1800.1

? (problem)

TT=656.49

? (TO)

TT=1800.07

? (TO)

TT=1800.06

Signal

TT=2.416

No dataNo dataSAT (TO)
f=-21892
TT=1800.73
T1=23.78
No data? (TO)

TT=1800.85

No dataNo dataNo dataSAT (TO)
f=-28657
TT=1800.16
T1=542.04
?

TT=1790.17

No dataSAT (TO)
f=0
TT=1800.17
T1=1.89
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-3
TT=1800.08
T1=2.23
? (TO)

TT=1800.85

SAT (TO)
f=-40844
TT=1800.69
T1=627.98
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_0null50mast_rapportOE1.0_TMAX180_K67_cod1.opb
SAT
f=-7488
TT=1774.04
T1=6.2
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (problem)

TT=1296

? (problem)

TT=24.719

? (problem)

TT=1530.27

? (problem)

TT=12.85

? (problem)

TT=1309.6

? (problem)

TT=11.83

SAT (TO)
f=-2131
TT=1800.13
T1=1018.28
Signal

TT=2.507

No dataNo dataSAT
f=-7488
TT=1774.04
T1=6.2
No dataSAT (TO)
f=-4897
TT=1800.46
T1=6.51
No dataNo dataNo dataSAT (TO)
f=-4896
TT=1800.15
T1=92.3
?

TT=1789.91

No dataSAT (TO)
f=-4879
TT=1800.21
T1=59.69
No data? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-4105
TT=1800.06
T1=33.1
SAT (TO)
f=-5221
TT=1800.01
T1=5.2
SAT (TO)
f=-6500
TT=1800.55
T1=1174.67
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null20mast_rapportOE2.0_TMAX300_K67_cod3.opb
SAT
f=-5888
TT=1800.03
T1=555.26
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (problem)

TT=1138.64

? (TO)

TT=1800.09

? (problem)

TT=1152.15

? (TO)

TT=1800.03

? (problem)

TT=1150.78

? (TO)

TT=1800.03

? (TO)

TT=1799.29

Signal

TT=2.4

No dataNo dataSAT
f=-5656
TT=1221.67
T1=50.14
No dataSAT (TO)
f=-5648
TT=1800.04
T1=2.81
No dataNo dataNo dataSAT (TO)
f=-5888
TT=1800.03
T1=555.26
?

TT=1790.24

No dataSAT (TO)
f=-5424
TT=1800.05
T1=47.98
No dataNo Cert.

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-3072
TT=1800.15
T1=146.74
SAT (TO)
f=-1596
TT=1800.99
T1=1675.96
SAT (TO)
f=-5242
TT=1800.07
T1=874.17
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null50mast_rapportOE1.0_TMAX120_K67_cod1.opb
SAT
f=-3926
TT=1800.64
T1=585.58
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (problem)

TT=12.83

? (problem)

TT=1336.12

? (problem)

TT=12.59

? (problem)

TT=1364.86

? (problem)

TT=11.65

? (problem)

TT=1314.63

? (TO)

TT=1800.07

Signal

TT=2.395

No dataNo dataNo Cert.

TT=834.451

No dataSAT (TO)
f=-1863
TT=1800.01
T1=1194.22
No dataNo dataNo dataSAT (TO)
f=-1296
TT=1800.13
T1=5.9
?

TT=1790.05

No dataSAT (TO)
f=-1360
TT=1800.06
T1=168.72
No dataNo Cert.

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1324
TT=1800.65
T1=12.48
SAT (TO)
f=-2304
TT=1800.03
T1=598.46
SAT (TO)
f=-3926
TT=1800.64
T1=585.58
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_20null50mast_rapportOE1.0_TMAX15_K67_cod1.opb
SAT
f=-384
TT=1800.1
T1=1681.72
No dataNo dataNo data? (TO)

TT=1800.09

? (problem)

TT=1.884

? (problem)

TT=578.06

? (problem)

TT=1.59

? (problem)

TT=576.29

? (problem)

TT=1.61

? (problem)

TT=779.35

? (problem)

TT=1.67

SAT (TO)
f=-9
TT=1800.1
T1=1691.23
Signal

TT=2.497

No dataNo dataSAT (TO)
f=-32
TT=1801.39
T1=529.15
No dataSAT (TO)
f=-8
TT=1800.03
T1=215.94
No dataNo dataNo dataSAT (TO)
f=-16
TT=1800.86
T1=21.55
?

TT=1790.06

No dataSAT (TO)
f=-256
TT=1800.11
T1=21.28
No data? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-256
TT=1800.36
T1=605.67
SAT (TO)
f=-128
TT=1800.02
T1=442.76
SAT (TO)
f=-384
TT=1800.1
T1=1681.72
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_50null20mast_rapportOE1.0_TMAX180_K67_cod3.opb
SAT
f=-5138
TT=1800.19
T1=492.99
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (problem)

TT=1157.88

? (TO)

TT=1800.04

? (problem)

TT=959.76

? (TO)

TT=1800.08

? (problem)

TT=1134.78

? (TO)

TT=1800.08

SAT (TO)
f=-2599
TT=1800.15
T1=72.21
Signal

TT=2.37

No dataNo dataNo Cert.

TT=1587.63

No dataSAT (TO)
f=-4624
TT=1800.05
T1=589.72
No dataNo dataNo dataSAT (TO)
f=-4864
TT=1800.63
T1=10.39
?

TT=1790.09

No dataSAT (TO)
f=-4916
TT=1800.13
T1=10.42
No data? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-5138
TT=1800.19
T1=492.99
SAT (TO)
f=-2339
TT=1800.7
T1=4.83
SAT (TO)
f=-4158
TT=1800.03
T1=523.38
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_50null20mast_rapportOE2.0_TMAX120_K67_cod1.opb
SAT
f=-1547
TT=1800.07
T1=949.65
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (problem)

TT=12.38

? (TO)

TT=1800.07

? (problem)

TT=11.76

? (TO)

TT=1800.06

? (problem)

TT=11.29

? (TO)

TT=1800.03

Signal

TT=2.389

No dataNo dataNo Cert.

TT=1159.89

No dataSAT (TO)
f=-800
TT=1800.76
T1=4.91
No dataNo dataNo dataSAT (TO)
f=-820
TT=1800.02
T1=19.38
?

TT=1789.92

No dataSAT (TO)
f=-1072
TT=1800.09
T1=10.3
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.13

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1026
TT=1800.07
T1=792.87
SAT (TO)
f=-789
TT=1801.05
T1=921.23
SAT (TO)
f=-1547
TT=1800.07
T1=949.65
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_0null50mast_rapportOE2.0_TMAX15_K67_cod1.opb
OPT
f=-4355
TT=1477.86
T1=1459.5
No dataNo dataNo data? (TO)

TT=1800.11

? (problem)

TT=1.687

? (problem)

TT=310.33

? (problem)

TT=1.54

? (problem)

TT=312.55

? (problem)

TT=1.6

? (problem)

TT=320.83

? (problem)

TT=1.54

SAT (TO)
f=-2277
TT=1800.08
T1=1447.17
Signal

TT=2.417

No dataNo dataSAT (TO)
f=-987
TT=1801.88
T1=453.93
No dataSAT (TO)
f=-2160
TT=1800.06
T1=1415.68
No dataNo dataNo dataSAT (TO)
f=-1936
TT=1801.09
T1=26.89
?

TT=1791.76

No dataSAT (TO)
f=0
TT=1800.11
T1=5.98
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-2502
TT=1800.16
T1=522.37
OPT
f=-4355
TT=1477.86
T1=1459.5
SAT (TO)
f=-4106
TT=1800.03
T1=1640.48
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_10null50mast_rapportOE2.0_TMAX120_K67_cod3.opb
SAT
f=-12659
TT=1801.56
T1=14.67
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (problem)

TT=13.72

? (problem)

TT=43.31

? (problem)

TT=14

? (problem)

TT=44.23

? (problem)

TT=13.87

? (problem)

TT=43.18

? (TO)

TT=1800.06

Signal

TT=2.521

No dataNo dataSAT (TO)
f=-12659
TT=1801.56
T1=14.67
No dataSAT (TO)
f=-6542
TT=1800
T1=1311.65
No dataNo dataNo dataSAT (TO)
f=-1000
TT=1801.25
T1=4.81
?

TT=1790.16

No dataSAT (TO)
f=-1000
TT=1800.17
T1=3.65
No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-6655
TT=1800.12
T1=915.92
SAT (TO)
f=-7076
TT=1800.24
T1=1634.38
SAT (TO)
f=-9752
TT=1800.05
T1=19.25
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null0mast_rapportOE1.0_TMAX180_K67_cod1.opb
SAT
f=-48598
TT=1800.15
T1=50.36
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (problem)

TT=329.39

? (problem)

TT=1196.13

? (problem)

TT=360.52

? (problem)

TT=1009.84

? (problem)

TT=338.62

? (problem)

TT=1205.09

SAT (TO)
f=-25853
TT=1800.07
T1=350.57
Signal

TT=2.358

No dataNo dataNo Cert.

TT=722.344

No dataSAT (TO)
f=-33437
TT=1800.04
T1=7.6
No dataNo dataNo dataSAT (TO)
f=-48598
TT=1800.74
T1=330.12
?

TT=1790.44

No dataSAT (TO)
f=-48598
TT=1800.15
T1=50.36
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-38598
TT=1800.82
T1=185.81
SAT (TO)
f=-22695
TT=1800.68
T1=24.4
SAT (TO)
f=-38622
TT=1800.08
T1=561.45
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null10mast_rapportOE1.0_TMAX60_K67_cod1.opb
SAT
f=-9842
TT=1800.09
T1=1511.16
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (problem)

TT=77.1

? (TO)

TT=1800.08

? (problem)

TT=78.67

? (TO)

TT=1800.08

? (problem)

TT=81.53

? (TO)

TT=1800.13

Signal

TT=2.366

No dataNo dataSAT (TO)
f=-2000
TT=1801.41
T1=82.32
No data? (TO)

TT=1800.59

No dataNo dataNo dataSAT (TO)
f=-2000
TT=1800.09
T1=556.34
?

TT=1790.21

No dataSAT (TO)
f=-5
TT=1800.06
T1=3.98
No dataNo Cert.

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-5
TT=1800.68
T1=2.27
? (TO)

TT=1800.07

SAT (TO)
f=-9842
TT=1800.09
T1=1511.16
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null10mast_rapportOE2.0_TMAX60_K67_cod1.opb
SAT
f=-5814
TT=1800.01
T1=138.58
No dataNo dataNo data? (TO)

TT=1800.13

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.03

Signal

TT=2.382

No dataNo dataSAT (TO)
f=-960
TT=1801.71
T1=53.42
No dataSAT (TO)
f=0
TT=1801.01
T1=480.87
No dataNo dataNo dataSAT (TO)
f=-1
TT=1800.16
T1=26.43
?

TT=1790.13

No dataSAT (TO)
f=-1
TT=1800.16
T1=26.42
No data? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1
TT=1800.02
T1=25.84
? (TO)

TT=1800.02

SAT (TO)
f=-5814
TT=1800.01
T1=138.58
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null10mast_rapportOE2.0_TMAX60_K67_cod3.opb
SAT
f=-3996
TT=1800.04
T1=1371.28
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.11

Signal

TT=2.403

No dataNo dataSAT (TO)
f=-1972
TT=1801.62
T1=521.98
No dataSAT (TO)
f=-3791
TT=1800.97
T1=880.53
No dataNo dataNo dataSAT (TO)
f=-1000
TT=1800.14
T1=576.69
?

TT=1790.07

No dataSAT (TO)
f=-1000
TT=1800.17
T1=565.37
No data? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1000
TT=1800.18
T1=279.88
? (TO)

TT=1800.55

SAT (TO)
f=-3996
TT=1800.04
T1=1371.28
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null20mast_rapportOE1.0_TMAX120_K67_cod1.opb
SAT
f=-22071
TT=1800.57
T1=1352.78
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (problem)

TT=10.91

? (problem)

TT=14.34

? (problem)

TT=11.05

? (problem)

TT=14.42

? (problem)

TT=12.15

? (problem)

TT=14.22

? (TO)

TT=1800.11

Signal

TT=2.432

No dataNo dataSAT (TO)
f=-16935
TT=1800.84
T1=347.8
No dataSAT (TO)
f=-13978
TT=1800.07
T1=2.43
No dataNo dataNo dataSAT (TO)
f=-5000
TT=1800.12
T1=25.11
?

TT=1790.02

No dataSAT (TO)
f=-10592
TT=1800.19
T1=40.37
No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-9918
TT=1800.16
T1=137.1
SAT (TO)
f=-10726
TT=1801.16
T1=1.8
SAT (TO)
f=-22071
TT=1800.57
T1=1352.78
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null50mast_rapportOE1.0_TMAX15_K67_cod3.opb
SAT
f=-3327
TT=1800.06
T1=1637.16
No dataNo dataNo data? (TO)

TT=1800.03

? (problem)

TT=1.519

? (problem)

TT=1263.08

? (problem)

TT=1.38

? (problem)

TT=1444.01

? (problem)

TT=1.36

? (problem)

TT=1239.48

? (problem)

TT=1.53

? (TO)

TT=1800.04

Signal

TT=2.447

No dataNo dataSAT (TO)
f=-995
TT=1800.87
T1=430.56
No dataSAT (TO)
f=-1783
TT=1800.04
T1=5.06
No dataNo dataNo dataSAT (TO)
f=-1826
TT=1800.06
T1=469.11
?

TT=1790.12

No dataSAT (TO)
f=0
TT=1800.14
T1=36.19
No data? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1240
TT=1800.2
T1=781.41
SAT (TO)
f=-3327
TT=1800.06
T1=1637.16
SAT (TO)
f=-3210
TT=1800.1
T1=1536.47
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_50null0mast_rapportOE1.0_TMAX300_K67_cod1.opb
SAT
f=-67580
TT=1800.16
T1=4.77
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (problem)

TT=251.31

? (problem)

TT=18.39

? (problem)

TT=247.67

? (problem)

TT=17.95

? (problem)

TT=338.13

? (problem)

TT=15.79

Signal

TT=985.673

Signal

TT=2.393

No dataNo dataNo Cert.

TT=233.1

No dataSAT (TO)
f=-58929
TT=1800.06
T1=3.65
No dataNo dataNo dataSAT (TO)
f=-66156
TT=1800.13
T1=3.91
?

TT=1789.96

No dataSAT (TO)
f=-67580
TT=1800.16
T1=4.77
No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-65815
TT=1800.08
T1=125.97
SAT (TO)
f=-6418
TT=1800.09
T1=1.54
SAT (TO)
f=-53319
TT=1800.05
T1=1516.01
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_0null0mast_rapportOE2.0_TMAX15_K192_cod2.opb
SAT
f=-15127
TT=1800.32
T1=419.04
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.1

Signal

TT=34.376

No dataNo dataSAT (TO)
f=-14642
TT=1800.91
T1=990.42
No data? (TO)

TT=1800.56

No dataNo dataNo dataSAT (TO)
f=0
TT=1801.4
T1=10.89
SAT
f=-61495
TT=1796.36
T1=1290.93
No dataSAT (TO)
f=0
TT=1800.44
T1=10.83
No data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1597
TT=1800.49
T1=251.32
SAT (TO)
f=0
TT=1800.36
T1=658.82
SAT (TO)
f=-15127
TT=1800.32
T1=419.04
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_0null10mast_rapportOE1.0_TMAX180_K192_cod1.opb
SAT
f=-239215
TT=1800.8
T1=1758.61
No dataNo dataNo data? (problem)

TT=3.952

? (problem)

TT=4.751

? (problem)

TT=4.021

? (problem)

TT=5.027

? (problem)

TT=4.022

? (problem)

TT=5.24

? (problem)

TT=3.956

? (problem)

TT=5.675

SAT (TO)
f=-24885
TT=1800.18
T1=189.65
Signal

TT=35.636

No dataNo dataSAT (TO)
f=-146505
TT=1804.06
T1=853.88
No dataSAT (TO)
f=-239215
TT=1800.8
T1=1758.61
No dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1800.09

No data? (TO)

TT=1800.11

No data? (exit code)

TT=2.29

? (problem)

TT=3.785

? (problem)

TT=3.815

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.39

SAT (TO)
f=-91966
TT=1800.43
T1=22.44
No dataNo dataNo data? (exit code)

TT=17.286

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_0null50mast_rapportOE2.0_TMAX300_K192_cod2.opb
SAT
f=-320018
TT=1800.96
T1=738.92
No dataNo dataNo data? (problem)

TT=32.516

? (TO)

TT=1800.09

? (problem)

TT=32.35

? (TO)

TT=1800.02

? (problem)

TT=31.68

? (TO)

TT=1800.09

? (problem)

TT=32.77

? (TO)

TT=1800.01

SAT (TO)
f=0
TT=1800.11
T1=185.53
Signal

TT=34.167

No dataNo dataSAT (TO)
f=-165787
TT=1801.32
T1=52.09
No dataSAT (TO)
f=-320018
TT=1800.96
T1=738.92
No dataNo dataNo dataSAT (TO)
f=0
TT=1800.43
T1=13.28
? (TO)

TT=1800.19

No dataSAT (TO)
f=0
TT=1800.39
T1=13.07
No dataNo Cert.

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=0
TT=1801
T1=12.87
SAT (TO)
f=-109460
TT=1800.32
T1=711.05
SAT (TO)
f=-266885
TT=1800.33
T1=1099.92
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_10null0mast_rapportOE1.0_TMAX180_K192_cod1.opb
SAT
f=-115005
TT=1804.76
T1=62.57
No dataNo dataNo data? (problem)

TT=3.938

? (problem)

TT=4.715

? (problem)

TT=4.03

? (problem)

TT=4.622

? (problem)

TT=4.01

? (problem)

TT=4.926

? (problem)

TT=4.105

? (problem)

TT=4.754

SAT (TO)
f=-9748
TT=1800.19
T1=189.89
Signal

TT=37.039

No dataNo dataSAT (TO)
f=-115005
TT=1804.76
T1=62.57
No data? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.13

? (TO)

TT=1802.24

No data? (TO)

TT=1800.01

No data? (exit code)

TT=2.423

? (problem)

TT=3.792

? (problem)

TT=3.782

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-5017
TT=1800.47
T1=203.8
? (TO)

TT=1800.04

SAT (TO)
f=-62280
TT=1800.35
T1=531.21
No dataNo dataNo data? (exit code)

TT=17.013

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_10null10mast_rapportOE1.0_TMAX15_K192_cod1.opb
SAT
f=-10947
TT=1800.52
T1=26.28
No dataNo dataNo data? (problem)

TT=3.923

? (problem)

TT=4.512

? (problem)

TT=3.991

? (problem)

TT=4.584

? (problem)

TT=3.996

? (problem)

TT=4.461

? (problem)

TT=4.028

? (problem)

TT=4.846

? (TO)

TT=1800.1

Signal

TT=35.765

No dataNo dataSAT (TO)
f=-6765
TT=1804.43
T1=644.46
No data? (TO)

TT=1800.37

No dataNo dataNo dataSAT (TO)
f=-10947
TT=1800.52
T1=376.51
? (TO)

TT=1802.24

No dataSAT (TO)
f=-10947
TT=1800.54
T1=382.93
No data? (exit code)

TT=2.535

? (problem)

TT=3.787

? (problem)

TT=3.987

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-10947
TT=1800.91
T1=26.28
? (TO)

TT=1800.46

SAT (TO)
f=-1
TT=1800.37
T1=1677.42
No dataNo dataNo data? (exit code)

TT=18.008

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_10null10mast_rapportOE1.0_TMAX300_K192_cod1.opb
SAT
f=-571776
TT=1804.1
T1=73.21
No dataNo dataNo data? (problem)

TT=3.95

? (problem)

TT=4.735

? (problem)

TT=3.948

? (problem)

TT=4.65

? (problem)

TT=4.023

? (problem)

TT=4.855

? (problem)

TT=4.088

? (problem)

TT=4.933

SAT (TO)
f=-44924
TT=1800.1
T1=185.21
Signal

TT=35.713

No dataNo dataSAT (TO)
f=-571776
TT=1804.1
T1=73.21
No dataSAT (TO)
f=-437840
TT=1800.84
T1=102.02
No dataNo dataNo dataSAT (TO)
f=-54730
TT=1800.52
T1=101.35
? (TO)

TT=1802.14

No dataSAT (TO)
f=-54730
TT=1800.38
T1=100.45
No data? (exit code)

TT=2.452

? (problem)

TT=3.851

? (problem)

TT=3.84

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-54730
TT=1800.48
T1=11.81
No Cert.

TT=1336.64

SAT (TO)
f=-267287
TT=1800.29
T1=400.25
No dataNo dataNo data? (exit code)

TT=17.937

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_10null10mast_rapportOE2.0_TMAX15_K192_cod1.opb
SAT
f=-11724
TT=1800.93
T1=951.49
No dataNo dataNo data? (problem)

TT=3.892

? (problem)

TT=4.915

? (problem)

TT=4.012

? (problem)

TT=4.988

? (problem)

TT=4.085

? (problem)

TT=4.432

? (problem)

TT=4.041

? (problem)

TT=4.882

? (TO)

TT=1800.1

Signal

TT=35.458

No dataNo dataSAT (TO)
f=0
TT=1804.09
T1=341.45
No dataSAT (TO)
f=0
TT=1800.79
T1=753.47
No dataNo dataNo data? (TO)

TT=1800.5

? (TO)

TT=1802.09

No data? (TO)

TT=1800.19

No data? (exit code)

TT=3.032

? (problem)

TT=3.764

? (problem)

TT=3.924

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.65

? (TO)

TT=1800.04

SAT (TO)
f=-11724
TT=1800.93
T1=951.49
No dataNo dataNo data? (exit code)

TT=17.962

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_20null20mast_rapportOE2.0_TMAX120_K192_cod1.opb
SAT
f=-83387
TT=1800.75
T1=1106.46
No dataNo dataNo data? (problem)

TT=3.976

? (problem)

TT=4.984

? (problem)

TT=3.957

? (problem)

TT=4.838

? (problem)

TT=4.011

? (problem)

TT=4.942

? (problem)

TT=4.107

? (problem)

TT=4.685

SAT (TO)
f=-23668
TT=1800.19
T1=192.62
Signal

TT=35.618

No dataNo dataSAT (TO)
f=-48952
TT=1804.08
T1=78.75
No dataSAT (TO)
f=-83387
TT=1800.75
T1=1106.46
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1802.24

No data? (TO)

TT=1800.12

No data? (exit code)

TT=2.572

? (problem)

TT=3.879

? (problem)

TT=3.83

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.6

? (TO)

TT=1800.62

SAT (TO)
f=-14894
TT=1800.29
T1=1548.53
No dataNo dataNo data? (exit code)

TT=17.543

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_20null50mast_rapportOE1.0_TMAX300_K192_cod2.opb
SAT
f=-646801
TT=1800.35
T1=166.93
No dataNo dataNo data? (problem)

TT=68.559

? (TO)

TT=1800.06

? (problem)

TT=67.89

? (TO)

TT=1800.09

? (problem)

TT=85.62

? (TO)

TT=1800.09

? (problem)

TT=86.68

? (TO)

TT=1800.07

SAT (TO)
f=0
TT=1800.16
T1=187.93
Signal

TT=34.446

No dataNo dataSAT (TO)
f=-615560
TT=1800.72
T1=1419.52
No dataSAT (TO)
f=-221504
TT=1801.06
T1=645.57
No dataNo dataNo dataSAT (TO)
f=0
TT=1800.47
T1=13.36
? (TO)

TT=1802.18

No dataSAT (TO)
f=0
TT=1800.95
T1=12.14
No data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-21892
TT=1800.45
T1=15.43
? (TO)

TT=1800.01

SAT (TO)
f=-646801
TT=1800.35
T1=166.93
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_20null50mast_rapportOE1.0_TMAX60_K192_cod1.opb
SAT
f=-79206
TT=1804.07
T1=279.49
No dataNo dataNo data? (problem)

TT=3.909

? (problem)

TT=5.024

? (problem)

TT=3.943

? (problem)

TT=4.606

? (problem)

TT=3.996

? (problem)

TT=4.811

? (problem)

TT=4.057

? (problem)

TT=9.771

? (TO)

TT=1800.1

Signal

TT=35.452

No dataNo dataSAT (TO)
f=-79206
TT=1804.07
T1=279.49
No data? (TO)

TT=1800.62

No dataNo dataNo data? (TO)

TT=1800.4

? (TO)

TT=1802.23

No data? (TO)

TT=1800.61

No data? (exit code)

TT=2.622

? (problem)

TT=3.762

? (problem)

TT=3.767

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.56

? (TO)

TT=1800.04

SAT (TO)
f=0
TT=1800.38
T1=912.41
No dataNo dataNo data? (exit code)

TT=16.858

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_50null10mast_rapportOE2.0_TMAX15_K192_cod2.opb
SAT
f=-11933
TT=1800.33
T1=445.58
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

Signal

TT=34.566

No dataNo dataSAT (TO)
f=-6765
TT=1800.53
T1=1651.26
No dataSAT (TO)
f=-11933
TT=1800.33
T1=445.58
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1802.15

No data? (TO)

TT=1800.06

No data? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-6765
TT=1800.5
T1=193.36
SAT (TO)
f=-89
TT=1800.5
T1=125.73
SAT (TO)
f=-7896
TT=1800.36
T1=1050.5
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_50null10mast_rapportOE2.0_TMAX180_K192_cod1.opb
SAT
f=-68687
TT=1801.2
T1=326.46
No dataNo dataNo data? (problem)

TT=3.903

? (problem)

TT=4.795

? (problem)

TT=3.923

? (problem)

TT=4.736

? (problem)

TT=4.082

? (problem)

TT=4.802

? (problem)

TT=3.911

? (problem)

TT=5.263

SAT (TO)
f=-36258
TT=1800.09
T1=189.98
Signal

TT=35.474

No dataNo dataSAT (TO)
f=-57314
TT=1804.15
T1=202.69
No dataSAT (TO)
f=-31241
TT=1800.32
T1=97.7
No dataNo dataNo dataSAT (TO)
f=-10947
TT=1800.36
T1=176.46
? (TO)

TT=1802.11

No dataSAT (TO)
f=-10947
TT=1800.93
T1=173.47
No data? (exit code)

TT=2.63

? (problem)

TT=3.854

? (problem)

TT=3.709

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-10947
TT=1800.39
T1=19.93
? (TO)

TT=1800.06

SAT (TO)
f=-68687
TT=1801.2
T1=326.46
No dataNo dataNo data? (exit code)

TT=16.445

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_50null20mast_rapportOE2.0_TMAX15_K192_cod2.opb
SAT
f=-17711
TT=1800.34
T1=77.13
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.07

Signal

TT=34.435

No dataNo dataSAT (TO)
f=-2584
TT=1801.22
T1=1469.68
No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-17711
TT=1800.52
T1=339.32
? (TO)

TT=1802.04

No dataSAT (TO)
f=0
TT=1800.55
T1=8.29
No data? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=0
TT=1800.88
T1=9.87
SAT (TO)
f=0
TT=1800.32
T1=1011.93
SAT (TO)
f=-17711
TT=1800.34
T1=77.13
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_0null10mast_rapportOE1.0_TMAX300_K192_cod1.opb
SAT
f=-59392
TT=1800.34
T1=179.6
No dataNo dataNo data? (problem)

TT=3.926

? (problem)

TT=5.157

? (problem)

TT=3.939

? (problem)

TT=4.844

? (problem)

TT=3.946

? (problem)

TT=4.698

? (problem)

TT=4.039

? (problem)

TT=4.908

SAT (TO)
f=-1070
TT=1800.19
T1=185.28
Signal

TT=37.461

No dataNo dataSAT (TO)
f=-26112
TT=1804.59
T1=881.58
No dataSAT (TO)
f=-38912
TT=1800.31
T1=111.37
No dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1802.12

No data? (TO)

TT=1800.16

No data? (exit code)

TT=2.241

? (problem)

TT=3.83

? (problem)

TT=3.828

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1802.03

SAT
f=-2188
TT=1120.78
T1=10.73
SAT (TO)
f=-59392
TT=1800.34
T1=179.6
No dataNo dataNo data? (exit code)

TT=17.968

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX60_K192_cod1.opb
SAT
f=-2
TT=1800.33
T1=863.32
No dataNo dataNo data? (problem)

TT=3.963

? (problem)

TT=4.674

? (problem)

TT=3.96

? (problem)

TT=4.983

? (problem)

TT=4.015

? (problem)

TT=4.866

? (problem)

TT=3.947

? (problem)

TT=4.789

? (TO)

TT=1800.11

Signal

TT=35.326

No dataNo data? (TO)

TT=1800.39

No data? (TO)

TT=1800.55

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1802.14

No data? (TO)

TT=1800.18

No data? (exit code)

TT=2.476

? (problem)

TT=3.774

? (problem)

TT=3.777

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.05

SAT (TO)
f=-2
TT=1800.33
T1=863.32
No dataNo dataNo data? (exit code)

TT=16.92

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE2.0_TMAX15_K192_cod1.opb
SAT
f=-256
TT=1800.84
T1=540.56
No dataNo dataNo data? (problem)

TT=3.924

? (problem)

TT=4.893

? (problem)

TT=3.995

? (problem)

TT=4.661

? (problem)

TT=4.053

? (problem)

TT=4.816

? (problem)

TT=3.944

? (problem)

TT=4.746

? (TO)

TT=1800.11

Signal

TT=36.608

No dataNo dataSAT (TO)
f=0
TT=1804.07
T1=135.33
No dataSAT (TO)
f=0
TT=1800.89
T1=934.49
No dataNo dataNo data? (TO)

TT=1800.3

? (TO)

TT=1802.21

No dataSAT (TO)
f=-256
TT=1800.84
T1=540.56
No data? (exit code)

TT=2.398

? (problem)

TT=3.877

? (problem)

TT=3.997

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.19

? (TO)

TT=1800.59

SAT (TO)
f=-256
TT=1801.1
T1=1712.77
No dataNo dataNo data? (exit code)

TT=16.994

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE2.0_TMAX60_K192_cod1.opb
SAT
f=-3
TT=1800.41
T1=773.24
No dataNo dataNo data? (problem)

TT=3.936

? (problem)

TT=4.761

? (problem)

TT=3.934

? (problem)

TT=4.824

? (problem)

TT=3.938

? (problem)

TT=4.877

? (problem)

TT=4.124

? (problem)

TT=4.644

? (TO)

TT=1800.1

Signal

TT=35.414

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.57

No dataNo dataNo data? (TO)

TT=1800.59

? (TO)

TT=1802.1

No data? (TO)

TT=1800.02

No data? (exit code)

TT=2.919

? (problem)

TT=3.763

? (problem)

TT=3.759

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.68

? (TO)

TT=1800.01

SAT (TO)
f=-3
TT=1800.41
T1=773.24
No dataNo dataNo data? (exit code)

TT=17.704

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null50mast_rapportOE2.0_TMAX60_K192_cod1.opb
SAT
f=-131
TT=1800.37
T1=1375.47
No dataNo dataNo data? (problem)

TT=4.029

? (problem)

TT=4.796

? (problem)

TT=3.954

? (problem)

TT=4.877

? (problem)

TT=4.04

? (problem)

TT=4.866

? (problem)

TT=4.062

? (problem)

TT=4.694

? (TO)

TT=1800.12

Signal

TT=35.788

No dataNo data? (TO)

TT=1800.1

No data? (TO)

TT=1800.82

No dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1802.2

No data? (TO)

TT=1800.14

No data? (exit code)

TT=2.533

? (problem)

TT=3.757

? (problem)

TT=3.863

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.03

SAT (TO)
f=-131
TT=1800.37
T1=1375.47
No dataNo dataNo data? (exit code)

TT=17.961

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null20mast_rapportOE1.0_TMAX300_K192_cod1.opb
SAT
f=-46120
TT=1800.45
T1=411.49
No dataNo dataNo data? (problem)

TT=3.934

? (problem)

TT=5.044

? (problem)

TT=3.955

? (problem)

TT=4.854

? (problem)

TT=4.1

? (problem)

TT=5.085

? (problem)

TT=3.948

? (problem)

TT=4.615

SAT (TO)
f=-4118
TT=1800.12
T1=186.13
Signal

TT=35.41

No dataNo dataSAT (TO)
f=-43008
TT=1804.13
T1=58.8
No dataSAT (TO)
f=-46120
TT=1800.45
T1=411.49
No dataNo dataNo dataSAT (TO)
f=-22814
TT=1800.76
T1=1116.44
? (TO)

TT=1802.09

No dataSAT (TO)
f=-1025
TT=1800.48
T1=351
No data? (exit code)

TT=2.499

? (problem)

TT=3.825

? (problem)

TT=3.757

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo Cert.

TT=1803.72

No Cert.

TT=557.948

SAT (TO)
f=-17690
TT=1800.33
T1=9.53
No dataNo dataNo data? (exit code)

TT=16.882

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null20mast_rapportOE2.0_TMAX120_K192_cod1.opb
SAT
f=-7178
TT=1800.38
T1=1201.22
No dataNo dataNo data? (problem)

TT=4.006

? (problem)

TT=4.963

? (problem)

TT=4.035

? (problem)

TT=4.834

? (problem)

TT=4.078

? (problem)

TT=4.564

? (problem)

TT=4.079

? (problem)

TT=4.874

SAT (TO)
f=-1059
TT=1800.2
T1=191.62
Signal

TT=36.054

No dataNo dataSAT (TO)
f=-3087
TT=1804.34
T1=1797.42
No data? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=-1025
TT=1800.91
T1=329.82
? (TO)

TT=1802.2

No dataSAT (TO)
f=-1025
TT=1800.52
T1=326.16
No data? (exit code)

TT=3.114

? (problem)

TT=3.875

? (problem)

TT=3.765

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1025
TT=1801.06
T1=17.67
SAT (TO)
f=-1025
TT=1800.33
T1=69.97
SAT (TO)
f=-7178
TT=1800.38
T1=1201.22
No dataNo dataNo data? (exit code)

TT=17.66

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null20mast_rapportOE2.0_TMAX300_K192_cod1.opb
SAT
f=-11468
TT=1800.32
T1=459.05
No dataNo dataNo data? (problem)

TT=3.931

? (problem)

TT=5.051

? (problem)

TT=3.945

? (problem)

TT=4.592

? (problem)

TT=4.052

? (problem)

TT=4.841

? (problem)

TT=4.045

? (problem)

TT=5.067

SAT (TO)
f=-41
TT=1800.2
T1=185.13
Signal

TT=36.815

No dataNo dataSAT (TO)
f=-10816
TT=1804.49
T1=68.34
No dataSAT (TO)
f=-10384
TT=1800.89
T1=108.35
No dataNo dataNo dataSAT (TO)
f=-1024
TT=1800.5
T1=95.72
? (TO)

TT=1802.08

No dataSAT (TO)
f=-1024
TT=1800.89
T1=89.63
No data? (exit code)

TT=2.437

? (problem)

TT=3.781

? (problem)

TT=3.896

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-3111
TT=1801.14
T1=23.35
SAT (TO)
f=-3215
TT=1800.83
T1=449.13
SAT (TO)
f=-11468
TT=1800.32
T1=459.05
No dataNo dataNo data? (exit code)

TT=17.432

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null20mast_rapportOE1.0_TMAX180_K192_cod1.opb
SAT
f=-19488
TT=1804.11
T1=43.59
No dataNo dataNo data? (problem)

TT=3.89

? (problem)

TT=4.834

? (problem)

TT=3.976

? (problem)

TT=5.116

? (problem)

TT=3.965

? (problem)

TT=4.756

? (problem)

TT=3.958

? (problem)

TT=4.646

SAT (TO)
f=-4111
TT=1800.2
T1=190.1
Signal

TT=35.269

No dataNo dataSAT (TO)
f=-19488
TT=1804.11
T1=43.59
No data? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=-1026
TT=1800.98
T1=568.38
? (TO)

TT=1802.2

No dataSAT (TO)
f=-1026
TT=1800.46
T1=596.23
No data? (exit code)

TT=2.396

? (problem)

TT=3.767

? (problem)

TT=3.746

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-1026
TT=1800.49
T1=344.65
? (TO)

TT=1800.07

SAT (TO)
f=-12368
TT=1800.38
T1=1314.97
No dataNo dataNo data? (exit code)

TT=16.438

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null50mast_rapportOE2.0_TMAX300_K192_cod1.opb
SAT
f=-13312
TT=1800.34
T1=1526.59
No dataNo dataNo data? (problem)

TT=3.89

? (problem)

TT=4.983

? (problem)

TT=3.947

? (problem)

TT=4.812

? (problem)

TT=3.943

? (problem)

TT=4.69

? (problem)

TT=3.916

? (problem)

TT=4.676

SAT (TO)
f=-8192
TT=1800.19
T1=184.95
Signal

TT=35.832

No dataNo dataSAT (TO)
f=-10240
TT=1804.65
T1=58.43
No dataSAT (TO)
f=-13312
TT=1800.34
T1=1526.59
No dataNo dataNo data? (TO)

TT=1800.18

? (TO)

TT=1802.1

No data? (TO)

TT=1800.13

No data? (exit code)

TT=2.506

? (problem)

TT=3.754

? (problem)

TT=3.758

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-10240
TT=1800.45
T1=763.63
SAT (TO)
f=-11264
TT=1800.38
T1=457.37
SAT (TO)
f=-9217
TT=1800.31
T1=13.32
No dataNo dataNo data? (exit code)

TT=17.149

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_0null20mast_rapportOE2.0_TMAX120_K192_cod2.opb
SAT
f=-14045
TT=1800.31
T1=1731.88
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.05

Signal

TT=34.166

No dataNo dataSAT (TO)
f=-5871
TT=1801.4
T1=586.09
No data? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.49
T1=11.9
?

TT=1793.11

No dataSAT (TO)
f=0
TT=1800.5
T1=11.62
No data? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=0
TT=1801.12
T1=12.49
? (TO)

TT=1800.82

SAT (TO)
f=-14045
TT=1800.31
T1=1731.88
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_0null50mast_rapportOE1.0_TMAX300_K192_cod1.opb
SAT
f=-50955
TT=1800.73
T1=41.86
No dataNo dataNo data? (problem)

TT=3.95

? (problem)

TT=4.794

? (problem)

TT=3.984

? (problem)

TT=4.886

? (problem)

TT=3.996

? (problem)

TT=4.607

? (problem)

TT=4.05

? (problem)

TT=4.877

SAT (TO)
f=-10841
TT=1800.18
T1=185.93
Signal

TT=36.256

No dataNo dataSAT (TO)
f=-17996
TT=1804.06
T1=102.23
No dataSAT (TO)
f=-22966
TT=1800.75
T1=173.94
No dataNo dataNo dataSAT (TO)
f=-4000
TT=1800.99
T1=116.1
? (TO)

TT=1800.17

No dataSAT (TO)
f=-4000
TT=1800.36
T1=114.86
No data? (exit code)

TT=2.472

? (problem)

TT=3.767

? (problem)

TT=3.919

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-20906
TT=1801.08
T1=68.13
SAT (TO)
f=-26261
TT=1800.29
T1=312.88
SAT (TO)
f=-50955
TT=1800.73
T1=41.86
No dataNo dataNo data? (exit code)

TT=18.119

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_10null0mast_rapportOE2.0_TMAX300_K192_cod1.opb
SAT
f=-69306
TT=1800.56
T1=442.08
No dataNo dataNo data? (problem)

TT=3.92

? (problem)

TT=4.584

? (problem)

TT=4.031

? (problem)

TT=4.887

? (problem)

TT=3.969

? (problem)

TT=4.765

? (problem)

TT=3.937

? (problem)

TT=4.762

SAT (TO)
f=-7443
TT=1800.14
T1=185.3
Signal

TT=35.597

No dataNo dataSAT (TO)
f=-40394
TT=1804.08
T1=75.16
No dataSAT (TO)
f=-34315
TT=1800.34
T1=569.77
No dataNo dataNo dataSAT (TO)
f=-69306
TT=1800.85
T1=449.58
? (TO)

TT=1802.19

No dataSAT (TO)
f=-69306
TT=1800.56
T1=442.08
No data? (exit code)

TT=2.702

? (problem)

TT=3.758

? (problem)

TT=3.718

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=-66739
TT=1800.42
T1=13.95
SAT (TO)
f=-24787
TT=1800.6
T1=461.09
SAT (TO)
f=-14355
TT=1800.84
T1=230.04
No dataNo dataNo data? (exit code)

TT=17.098

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_10null0mast_rapportOE2.0_TMAX60_K192_cod1.opb
SAT
f=-4876
TT=1800.35
T1=1403.8
No dataNo dataNo data? (problem)

TT=3.989

? (problem)

TT=4.85

? (problem)

TT=3.926

? (problem)

TT=4.646

? (problem)

TT=4.019

? (problem)

TT=4.767

? (problem)

TT=3.968

? (problem)

TT=4.684

? (TO)

TT=1800.11

Signal

TT=35.71

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.41
T1=341.85
? (TO)

TT=1802.22

No dataSAT (TO)
f=0
TT=1800.94
T1=319.38
No data? (exit code)

TT=2.963

? (problem)

TT=3.765

? (problem)

TT=3.744

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=0
TT=1800.71
T1=264.19
? (TO)

TT=1800.08

SAT (TO)
f=-4876
TT=1800.35
T1=1403.8
No dataNo dataNo data? (exit code)

TT=17.084

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX120_K192_cod1.opb
SAT
f=-8948
TT=1804.11
T1=63.27
No dataNo dataNo data? (problem)

TT=3.953

? (problem)

TT=4.771

? (problem)

TT=4.035

? (problem)

TT=4.632

? (problem)

TT=4.025

? (problem)

TT=4.568

? (problem)

TT=3.93

? (problem)

TT=4.981

SAT (TO)
f=-3870
TT=1800.18
T1=191.39
Signal

TT=35.469

No dataNo dataSAT (TO)
f=-8948
TT=1804.11
T1=63.27
No data? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1802.16

No data? (TO)

TT=1800.18

No data? (exit code)

TT=2.521

? (problem)

TT=3.97

? (problem)

TT=3.892

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.05

SAT (TO)
f=-8335
TT=1800.29
T1=429.74
No dataNo dataNo data? (exit code)

TT=16.647

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX180_K192_cod1.opb
SAT
f=-8044
TT=1800.33
T1=58.05
No dataNo dataNo data? (problem)

TT=3.911

? (problem)

TT=4.583

? (problem)

TT=4.181

? (problem)

TT=5.054

? (problem)

TT=3.982

? (problem)

TT=4.851

? (problem)

TT=4.055

? (problem)

TT=4.619

SAT (TO)
f=-5596
TT=1800.18
T1=189.9
Signal

TT=35.688

No dataNo dataSAT (TO)
f=-7952
TT=1804.12
T1=230
No data? (TO)

TT=1800.71

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1802.1

No data? (TO)

TT=1800.2

No data? (exit code)

TT=2.423

? (problem)

TT=3.753

? (problem)

TT=3.761

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.65

SAT (TO)
f=-3994
TT=1800.37
T1=707.05
SAT (TO)
f=-8044
TT=1800.33
T1=58.05
No dataNo dataNo data? (exit code)

TT=17.055

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null50mast_rapportOE1.0_TMAX15_K192_cod1.opb
SAT
f=-50
TT=1800.37
T1=384.95
No dataNo dataNo data? (problem)

TT=3.886

? (problem)

TT=4.613

? (problem)

TT=3.981

? (problem)

TT=4.545

? (problem)

TT=3.907

? (problem)

TT=4.823

? (problem)

TT=3.949

? (problem)

TT=4.699

SAT (TO)
f=0
TT=1800.2
T1=207.69
Signal

TT=35.491

No dataNo dataSAT (TO)
f=0
TT=1804.56
T1=56.87
No dataSAT (TO)
f=0
TT=1800.37
T1=278.06
No dataNo dataNo data? (TO)

TT=1800.52

? (TO)

TT=1802.21

No data? (TO)

TT=1800.09

No data? (exit code)

TT=2.396

? (problem)

TT=3.701

? (problem)

TT=3.678

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.19

? (TO)

TT=1800.87

SAT (TO)
f=-50
TT=1800.37
T1=384.95
No dataNo dataNo data? (exit code)

TT=16.164

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_2.opb
SAT
f=8443107
TT=1801.27
T1=62.47
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.01

SAT (TO)
f=38661101
TT=1800.13
T1=1457.19
? (TO)

TT=1800.25

No dataNo dataSAT (TO)
f=13977401
TT=1800.51
T1=84.29
No dataSAT (TO)
f=16021097
TT=1800.07
T1=158.83
No dataNo dataNo dataSAT (TO)
f=8443107
TT=1801.27
T1=62.47
SAT
f=8433379
TT=1789.82
T1=1601.27
No dataSAT (TO)
f=10443813
TT=1800.48
T1=395.15
No dataSAT (TO)
f=102611897
TT=1800.01
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=9434865
TT=1800.83
T1=402.12
SAT (TO)
f=10382283
TT=1800.77
T1=96.07
SAT (TO)
f=45609693
TT=1800.02
T1=1440.33
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_3.opb
SAT
f=6182423
TT=1800.5
T1=429.35
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.13

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.07

SAT (TO)
f=27194873
TT=1800.1
T1=1251.58
? (TO)

TT=1800.16

No dataNo data?

TT=271.48

No dataSAT (TO)
f=37399451
TT=1800.82
T1=37.04
No dataNo dataNo dataSAT (TO)
f=13100599
TT=1800.19
T1=534.91
SAT
f=6793923
TT=1789.85
T1=1479.49
No dataSAT (TO)
f=8772657
TT=1800.13
T1=39.01
No dataSAT (TO)
f=356167071
TT=1800.09
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6182423
TT=1800.5
T1=429.35
SAT (TO)
f=11777859
TT=1800.68
T1=1.38
SAT (TO)
f=8080107
TT=1800.01
T1=333.59
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_4.opb
SAT
f=6564197
TT=1647.82
T1=334.65
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.06

SAT (TO)
f=22366033
TT=1800.1
T1=111.98
? (TO)

TT=1800.12

No dataNo dataSAT
f=6564197
TT=1647.82
T1=334.65
No data? (exit code)

TT=1077.33

No dataNo dataNo dataSAT (TO)
f=8472549
TT=1801.4
T1=49.25
SAT
f=7914575
TT=1790.29
T1=1059.49
No dataSAT (TO)
f=6775155
TT=1800.14
T1=108.54
No dataSAT (TO)
f=144808167
TT=1800.01
T1=1800.3
? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=90339033
TT=1800.12
T1=86.31
SAT (TO)
f=17090467
TT=1800.65
T1=12.67
SAT (TO)
f=7898789
TT=1800.06
T1=750.5
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_6.opb
SAT
f=5657601
TT=1800.41
T1=26.89
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.01

SAT (TO)
f=10116489
TT=1800.11
T1=967.14
? (TO)

TT=1800.18

No dataNo dataNo Cert.

TT=647.068

No data? (exit code)

TT=1653.95

No dataNo dataNo dataSAT (TO)
f=5657601
TT=1800.41
T1=26.89
SAT
f=6163473
TT=1789.78
T1=1647.76
No dataSAT (TO)
f=7314973
TT=1800.41
T1=757.93
No dataSAT (TO)
f=158559891
TT=1800.02
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5951375
TT=1800.13
T1=12.63
SAT (TO)
f=5944489
TT=1800.68
T1=937.76
SAT (TO)
f=7055761
TT=1800.78
T1=10.3
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_7.opb
SAT
f=8017325
TT=1800.01
T1=437.99
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.04

SAT (TO)
f=15022829
TT=1800.07
T1=1.49
? (TO)

TT=1800.12

No dataNo data? (exit code)

TT=487.69

No dataSAT (TO)
f=28496867
TT=1800.09
T1=7.48
No dataNo dataNo dataSAT (TO)
f=11322611
TT=1800.12
T1=59.34
SAT
f=9605181
TT=1790.02
T1=1760.09
No dataSAT (TO)
f=8670373
TT=1800.76
T1=501.8
No dataSAT (TO)
f=101265501
TT=1800.01
T1=1800.3
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=16918017
TT=1800.76
T1=77.99
SAT (TO)
f=17301745
TT=1800.05
T1=1.56
SAT (TO)
f=8017325
TT=1800.01
T1=437.99
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_8.opb
SAT
f=4769881
TT=1800.08
T1=105.41
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.04

SAT (TO)
f=10311167
TT=1800.25
T1=375.75
? (TO)

TT=1800.14

No dataNo dataSAT (TO)
f=13792995
TT=1800.5
T1=44.99
No dataSAT
f=4851381
TT=1193.27
T1=632.53
No dataNo dataNo dataSAT (TO)
f=4769881
TT=1800.08
T1=105.41
SAT
f=6976389
TT=1789.85
T1=668.23
No dataSAT (TO)
f=6296685
TT=1800.2
T1=11.73
No dataSAT (TO)
f=199756949
TT=1800.01
T1=1800.3
? (TO)

TT=1800.03

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4900523
TT=1800.04
T1=5.07
SAT (TO)
f=7072703
TT=1800.1
T1=1.14
SAT (TO)
f=6098289
TT=1759.52
T1=51.1
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat100_4_32_9.opb
SAT
f=5562055
TT=1800.13
T1=321.65
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.06

SAT (TO)
f=16076087
TT=1800.13
T1=22.33
? (TO)

TT=1800.14

No dataNo data? (exit code)

TT=1511.09

No dataSAT (TO)
f=7209723
TT=1800.77
T1=404.74
No dataNo dataNo dataSAT (TO)
f=6440297
TT=1801.21
T1=25.79
SAT
f=6150317
TT=1789.81
T1=1338.55
No dataSAT (TO)
f=9348477
TT=1800.28
T1=882.72
No dataSAT (TO)
f=26746933
TT=1800.08
T1=1800.4
? (TO)

TT=1800.03

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5562055
TT=1800.13
T1=321.65
SAT (TO)
f=6428355
TT=1800.09
T1=1.29
SAT (TO)
f=6911337
TT=1800.67
T1=112.38
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_0.opb
SAT
f=2908167
TT=1800.12
T1=3.26
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.09

SAT (TO)
f=8843497
TT=1800.09
T1=15.53
SAT (TO)
f=165387385
TT=1800.03
T1=6.62
No dataNo dataSAT (TO)
f=3372641
TT=1800.01
T1=1.47
No dataSAT (TO)
f=3372641
TT=1801.79
T1=1.04
No dataNo dataNo dataSAT (TO)
f=2999139
TT=1800.12
T1=66.67
OPT
f=2835125
TT=820.52
T1=128.87
No dataSAT (TO)
f=2908167
TT=1800.54
T1=3.26
No dataSAT (TO)
f=165387385
TT=1800.02
T1=1800.3
? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2908167
TT=1800.12
T1=3.66
SAT (TO)
f=3372641
TT=1800.54
T1=0.77
SAT (TO)
f=4692189
TT=1800.03
T1=1147.03
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_1.opb
SAT
f=3948307
TT=1800.1
T1=647.96
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.06

SAT (TO)
f=4243473
TT=1800.12
T1=1417.72
SAT (TO)
f=120868549
TT=1800.03
T1=6.24
No dataNo data? (exit code)

TT=1656.02

No dataSAT (TO)
f=5513849
TT=1800.28
T1=520.93
No dataNo dataNo dataSAT (TO)
f=4008657
TT=1800.21
T1=305.88
OPT
f=2899749
TT=1002.23
T1=467.2
No dataSAT (TO)
f=4307507
TT=1800.13
T1=40.15
No dataSAT (TO)
f=90355055
TT=1800.03
T1=1800.3
? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3948307
TT=1800.1
T1=647.96
SAT (TO)
f=5400081
TT=1800.58
T1=0.68
SAT (TO)
f=4231653
TT=1800.1
T1=507.86
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_2.opb
SAT
f=3385647
TT=1800.12
T1=47.67
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=12779011
TT=1800.06
T1=37.46
SAT (TO)
f=508874743
TT=1800.1
T1=6.54
No dataNo dataSAT (TO)
f=3406633
TT=1800.82
T1=294.75
No dataSAT (TO)
f=3406633
TT=1801.85
T1=0.92
No dataNo dataNo dataSAT (TO)
f=3385647
TT=1800.12
T1=47.67
OPT
f=3367493
TT=155.278
T1=139.08
No dataSAT (TO)
f=3406633
TT=1800.07
T1=1.74
No dataSAT (TO)
f=508874743
TT=1800.03
T1=1800.3
? (TO)

TT=1800

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3406633
TT=1800.2
T1=2.15
SAT (TO)
f=3406633
TT=1800.72
T1=0.74
SAT (TO)
f=4949069
TT=1800.66
T1=229.4
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_5.opb
SAT
f=5696927
TT=1801.28
T1=305.23
No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.12

SAT (TO)
f=10275083
TT=1800.09
T1=487.33
SAT (TO)
f=335088841
TT=1800.04
T1=6.54
No dataNo dataSAT (TO)
f=6016157
TT=1800.02
T1=1.39
No dataSAT (TO)
f=5895237
TT=1800.64
T1=795.45
No dataNo dataNo dataSAT (TO)
f=5696927
TT=1801.28
T1=305.23
OPT
f=5114519
TT=1667.65
T1=276.89
No dataSAT (TO)
f=6012437
TT=1800.56
T1=41.79
No dataSAT (TO)
f=335088841
TT=1800.02
T1=1800.3
? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6012437
TT=1800.55
T1=23.36
SAT (TO)
f=6012863
TT=1800.01
T1=0.96
SAT (TO)
f=6881371
TT=1800.03
T1=853.55
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_6.opb
SAT
f=5473551
TT=1800.14
T1=17.27
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.13

? (TO)

TT=1800.02

? (TO)

TT=1800.13

? (TO)

TT=1800.06

SAT (TO)
f=8219865
TT=1800.06
T1=22.77
SAT (TO)
f=360722445
TT=1800.04
T1=6.63
No dataNo data? (exit code)

TT=1372.68

No dataSAT (TO)
f=5917855
TT=1800.04
T1=1.68
No dataNo dataNo dataSAT (TO)
f=5473551
TT=1800.57
T1=22.65
OPT
f=4396639
TT=963.154
T1=466.62
No dataSAT (TO)
f=5473551
TT=1800.14
T1=17.27
No dataSAT (TO)
f=360722445
TT=1800.03
T1=1800.3
? (TO)

TT=1800.1

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5577959
TT=1800.76
T1=22.81
SAT (TO)
f=5473551
TT=1800.73
T1=307.24
SAT (TO)
f=6583207
TT=1800.01
T1=1683.18
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_8.opb
SAT
f=3841241
TT=1800.08
T1=0.58
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.14

? (TO)

TT=1800.1

? (TO)

TT=1800.05

SAT (TO)
f=5342871
TT=1800.02
T1=760.97
SAT (TO)
f=306716777
TT=1800.02
T1=6.54
No dataNo data? (exit code)

TT=1393.3

No data? (TO)

TT=1802.01

No dataNo dataNo dataSAT (TO)
f=3841241
TT=1800.54
T1=1.58
OPT
f=3806957
TT=1307.37
T1=237.42
No dataSAT (TO)
f=3841241
TT=1800.42
T1=1.16
No dataSAT (TO)
f=306716777
TT=1800.03
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3841241
TT=1800.75
T1=1.08
SAT (TO)
f=3841241
TT=1800.08
T1=0.58
SAT (TO)
f=5280503
TT=1800.03
T1=36.85
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat50_4_16_9.opb
SAT
f=3179263
TT=1801.45
T1=9.58
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.08

SAT (TO)
f=8561437
TT=1800.07
T1=149.2
SAT (TO)
f=134684579
TT=1800.03
T1=6.26
No dataNo data? (exit code)

TT=1786.44

No dataSAT (TO)
f=3212965
TT=1800.98
T1=7.59
No dataNo dataNo dataSAT (TO)
f=3179263
TT=1801.45
T1=9.58
OPT
f=3157179
TT=268.863
T1=221.26
No dataSAT (TO)
f=3181603
TT=1800.04
T1=12.7
No dataSAT (TO)
f=134684579
TT=1800.03
T1=1800.3
? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3194111
TT=1800.19
T1=2.67
SAT (TO)
f=3245071
TT=1800.06
T1=0.75
SAT (TO)
f=3543111
TT=1800.08
T1=1707.29
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_0.opb
SAT
f=4272093
TT=1800.49
T1=54.12
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800

SAT (TO)
f=8171125
TT=1800.1
T1=232.86
SAT (TO)
f=226757721
TT=1800.03
T1=6.73
No dataNo dataSAT
f=125990951
TT=416.85
T1=10.88
No dataSAT (TO)
f=4272093
TT=1800.49
T1=54.12
No dataNo dataNo dataSAT (TO)
f=4278795
TT=1800.13
T1=3.85
SAT
f=6282585
TT=1789.83
T1=1290.12
No dataSAT (TO)
f=4278795
TT=1800.02
T1=2.48
No dataSAT (TO)
f=226757721
TT=1800.03
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4359359
TT=1800.03
T1=76.77
SAT (TO)
f=4325387
TT=1800.02
T1=1.06
SAT (TO)
f=6722177
TT=1800.07
T1=227.98
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.12

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_2.opb
SAT
f=4041903
TT=1800.49
T1=7.36
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.08

SAT (TO)
f=6576593
TT=1800.1
T1=359.44
SAT (TO)
f=57815233
TT=1800.03
T1=6.33
No dataNo dataSAT (TO)
f=4232841
TT=1800.74
T1=2.39
No dataSAT (TO)
f=4255107
TT=1801.2
T1=395.31
No dataNo dataNo dataNo Cert.

TT=1800.4

SAT
f=4409011
TT=1789.78
T1=487.79
No dataSAT (TO)
f=4232841
TT=1800.18
T1=1.89
No dataSAT (TO)
f=57815233
TT=1800.03
T1=1800.3
? (TO)

TT=1800.14

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4041903
TT=1800.49
T1=7.36
SAT (TO)
f=4232841
TT=1800.89
T1=0.96
SAT (TO)
f=5505471
TT=1800.03
T1=76.24
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_3.opb
SAT
f=4527423
TT=1800.05
T1=9
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.12

SAT (TO)
f=16272385
TT=1800.17
T1=25.98
SAT (TO)
f=17740747
TT=1800.02
T1=6.72
No dataNo dataSAT (TO)
f=4527423
TT=1800.08
T1=9
No dataSAT (TO)
f=4586855
TT=1800.72
T1=9.09
No dataNo dataNo dataSAT (TO)
f=4527423
TT=1800.05
T1=10.17
SAT
f=3892789
TT=1789.84
T1=1375.96
No dataSAT (TO)
f=4750163
TT=1800.04
T1=2.47
No dataSAT (TO)
f=17740747
TT=1800.09
T1=1800.8
? (TO)

TT=1800.05

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4874561
TT=1800.17
T1=8.83
SAT (TO)
f=4877383
TT=1800.84
T1=1.56
SAT (TO)
f=5044867
TT=1800.79
T1=202.39
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_4.opb
SAT
f=3452273
TT=1800.15
T1=23.97
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.01

SAT (TO)
f=14976571
TT=1800.08
T1=1469.72
SAT (TO)
f=134948949
TT=1800.03
T1=6.47
No dataNo data? (exit code)

TT=1737.25

No dataSAT (TO)
f=3462929
TT=1800.24
T1=5.52
No dataNo dataNo dataSAT (TO)
f=3462929
TT=1801.74
T1=8.12
SAT
f=3437313
TT=1789.78
T1=1320.22
No dataSAT (TO)
f=3462929
TT=1800.17
T1=3.63
No dataSAT (TO)
f=134948949
TT=1800.02
T1=1800.3
? (TO)

TT=1800.05

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3452273
TT=1800.15
T1=23.97
SAT (TO)
f=3471965
TT=1800.06
T1=0.82
SAT (TO)
f=5018227
TT=1800.05
T1=40.59
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_5.opb
SAT
f=4494319
TT=1800.14
T1=1.73
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.02

SAT (TO)
f=9158229
TT=1800.1
T1=245.43
SAT (TO)
f=371426925
TT=1800.03
T1=6.44
No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=4582103
TT=1800.16
T1=18.15
SAT
f=6760323
TT=1789.8
T1=703.52
No dataSAT (TO)
f=4583443
TT=1800.05
T1=20.26
No dataSAT (TO)
f=371426925
TT=1800.03
T1=1800.3
? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4494319
TT=1800.14
T1=1.73
SAT (TO)
f=4618495
TT=1800.06
T1=0.89
SAT (TO)
f=5672679
TT=1800.03
T1=29.93
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_6.opb
SAT
f=5298527
TT=1800.07
T1=2.16
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.06

SAT (TO)
f=13939403
TT=1800.06
T1=357.36
SAT (TO)
f=166747505
TT=1800.03
T1=6.32
No dataNo dataSAT (TO)
f=5298527
TT=1800.07
T1=14.75
No dataSAT (TO)
f=5298527
TT=1800.55
T1=40.51
No dataNo dataNo dataSAT (TO)
f=5307599
TT=1800.2
T1=120.09
SAT
f=5477817
TT=1789.78
T1=1601.48
No dataSAT (TO)
f=5659509
TT=1800.53
T1=80.37
No dataSAT (TO)
f=166747505
TT=1800.08
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5712431
TT=1800.08
T1=6.3
SAT (TO)
f=5298527
TT=1800.4
T1=2.16
SAT (TO)
f=7792449
TT=1800.81
T1=428.8
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_7.opb
SAT
f=4636291
TT=1800.13
T1=4.72
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.03

SAT (TO)
f=13079229
TT=1800.13
T1=536.67
SAT (TO)
f=171832397
TT=1800.03
T1=6.45
No dataNo dataSAT (TO)
f=4643371
TT=1800.78
T1=65.85
No dataSAT (TO)
f=4643371
TT=1800.77
T1=12.57
No dataNo dataNo dataSAT (TO)
f=4643371
TT=1800.18
T1=3.89
SAT
f=4617363
TT=1789.8
T1=1388.74
No dataSAT (TO)
f=4636291
TT=1800.19
T1=6
No dataSAT (TO)
f=171832397
TT=1800.03
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4636291
TT=1800.13
T1=4.72
SAT (TO)
f=4643371
TT=1800.01
T1=1.15
SAT (TO)
f=9212671
TT=1800.43
T1=242.99
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_8.opb
SAT
f=4692139
TT=1801.26
T1=139.81
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (TO)

TT=1800.1

SAT (TO)
f=11536363
TT=1800.13
T1=672.39
SAT (TO)
f=28266149
TT=1800.03
T1=6.35
No dataNo data? (exit code)

TT=797.73

No data? (exit code)

TT=819.722

No dataNo dataNo dataSAT (TO)
f=4692139
TT=1801.26
T1=139.81
SAT
f=5083717
TT=1789.79
T1=1289.75
No dataSAT (TO)
f=4709987
TT=1800.08
T1=7.56
No dataSAT (TO)
f=28266149
TT=1800.03
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5457041
TT=1800.72
T1=1.74
SAT (TO)
f=4918901
TT=1800.61
T1=0.94
SAT (TO)
f=6849317
TT=1800.06
T1=1238.36
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat70_4_22_9.opb
SAT
f=4065875
TT=1800.37
T1=23.09
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.14

? (TO)

TT=1801.2

? (TO)

TT=1800.07

? (TO)

TT=1800.1

SAT (TO)
f=6326407
TT=1800.23
T1=352.3
SAT (TO)
f=45831131
TT=1800.03
T1=6.48
No dataNo dataNo Cert.

TT=1710.09

No dataSAT (TO)
f=4083003
TT=1800.35
T1=6.98
No dataNo dataNo dataSAT (TO)
f=4065875
TT=1800.37
T1=23.09
SAT
f=5143043
TT=1789.81
T1=1597.49
No dataSAT (TO)
f=4072555
TT=1800.65
T1=3.83
No dataSAT (TO)
f=45831131
TT=1800.03
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4072555
TT=1800.89
T1=3.77
SAT (TO)
f=4081443
TT=1800.08
T1=0.73
SAT (TO)
f=6592207
TT=1800.07
T1=139.06
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_0.opb
SAT
f=6221849
TT=1800.13
T1=435.89
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.01

SAT (TO)
f=36559067
TT=1800.07
T1=149.75
SAT (TO)
f=114273053
TT=1800.03
T1=126.92
No dataNo data? (exit code)

TT=171.198

No dataSAT (TO)
f=9229679
TT=1800.89
T1=217.4
No dataNo dataNo dataSAT (TO)
f=6221849
TT=1800.13
T1=435.89
SAT
f=5905237
TT=1789.83
T1=1179.15
No dataSAT (TO)
f=7796283
TT=1800.12
T1=3.67
No dataSAT (TO)
f=214434881
TT=1800.02
T1=1800.3
? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6335449
TT=1800.9
T1=3.96
SAT (TO)
f=6368897
TT=1800.05
T1=1.35
SAT (TO)
f=7700879
TT=1800.1
T1=1350.77
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_1.opb
SAT
f=4654355
TT=1800.56
T1=97.07
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.12

? (TO)

TT=1800.03

SAT (TO)
f=63983839
TT=1800.06
T1=31.28
SAT (TO)
f=192855611
TT=1800.07
T1=126.38
No dataNo dataNo Cert.

TT=210.91

No dataSAT (TO)
f=17212777
TT=1800.66
T1=68.99
No dataNo dataNo dataSAT (TO)
f=4654355
TT=1800.56
T1=97.07
SAT
f=6398747
TT=1789.8
T1=1097.16
No dataSAT (TO)
f=4658169
TT=1800.69
T1=11.82
No dataSAT (TO)
f=510859013
TT=1800.03
T1=1800.3
? (TO)

TT=1800.05

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5345915
TT=1800.05
T1=1.3
SAT (TO)
f=4691361
TT=1800.66
T1=2.63
SAT (TO)
f=7466121
TT=1800.71
T1=220.88
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_4.opb
SAT
f=6667103
TT=1800.07
T1=0.99
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.1

SAT (TO)
f=10950273
TT=1800.13
T1=4.78
SAT (TO)
f=182438903
TT=1800.03
T1=125.1
No dataNo dataSAT (TO)
f=14974553
TT=1800.37
T1=36.5
No dataSAT (TO)
f=8803197
TT=1800.89
T1=1549.01
No dataNo dataNo dataSAT (TO)
f=7164579
TT=1801.5
T1=5.12
SAT
f=8850441
TT=1789.83
T1=481.15
No dataSAT (TO)
f=6748763
TT=1800.1
T1=143.89
No dataSAT (TO)
f=265884525
TT=1800.03
T1=1800.3
? (TO)

TT=1800.03

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6978897
TT=1800.11
T1=2.34
SAT (TO)
f=6667103
TT=1800.07
T1=0.99
SAT (TO)
f=7835409
TT=1800.77
T1=132.42
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_5.opb
SAT
f=5206831
TT=1800.24
T1=2.33
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.14

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.03

SAT (TO)
f=11592997
TT=1800.13
T1=1294.53
SAT (TO)
f=161309149
TT=1800.09
T1=126.64
No dataNo data? (exit code)

TT=132.974

No dataSAT (TO)
f=301358721
TT=1800.05
T1=22.81
No dataNo dataNo dataSAT (TO)
f=7192469
TT=1801.02
T1=159.37
SAT
f=6795863
TT=1789.84
T1=1539.42
No dataSAT (TO)
f=5385187
TT=1800.63
T1=1.87
No dataSAT (TO)
f=52399453
TT=1800.03
T1=1800.3
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5206831
TT=1800.24
T1=2.33
SAT (TO)
f=5306499
TT=1800
T1=1.52
SAT (TO)
f=7709047
TT=1800.09
T1=164.99
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_7.opb
SAT
f=7290551
TT=1800.09
T1=773.68
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.1

SAT (TO)
f=15775787
TT=1800.19
T1=438.9
SAT (TO)
f=134219779
TT=1800.03
T1=124.93
No dataNo dataSAT (TO)
f=421002947
TT=1800.8
T1=66.79
No data? (TO)

TT=1800.48

No dataNo dataNo dataSAT (TO)
f=11047903
TT=1801.25
T1=12.37
SAT
f=9047993
TT=1789.8
T1=1713.2
No dataSAT (TO)
f=8285177
TT=1800.17
T1=69.14
No dataSAT (TO)
f=199481687
TT=1800.12
T1=1800.4
? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=10267811
TT=1800.2
T1=44.62
SAT (TO)
f=7777407
TT=1800
T1=1.14
SAT (TO)
f=7290551
TT=1800.09
T1=773.68
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_8.opb
SAT
f=4276357
TT=1800.57
T1=140.84
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.03

SAT (TO)
f=20670073
TT=1800.12
T1=2.6
SAT (TO)
f=40068351
TT=1800.09
T1=126.54
No dataNo dataSAT
f=151416277
TT=353.07
T1=103.2
No dataSAT (TO)
f=6988853
TT=1800.31
T1=124.07
No dataNo dataNo dataSAT (TO)
f=4276357
TT=1800.57
T1=140.84
SAT
f=4911795
TT=1789.8
T1=1560.83
No dataSAT (TO)
f=4470353
TT=1800.04
T1=411.1
No dataSAT (TO)
f=191835439
TT=1800.02
T1=1800.3
? (TO)

TT=1800.06

? (TO)

TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4587349
TT=1800.16
T1=7.08
SAT (TO)
f=5202133
TT=1800.72
T1=2.3
SAT (TO)
f=7229583
TT=1800.04
T1=1786.34
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Base/
normalized-minisat85_4_27_9.opb
SAT
f=4508351
TT=1800.04
T1=52.46
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.08

SAT (TO)
f=17988815
TT=1800.06
T1=364.2
SAT (TO)
f=244222645
TT=1800.04
T1=127.82
No dataNo data?

TT=413.26

No data? (exit code)

TT=761.918

No dataNo dataNo dataSAT (TO)
f=4508351
TT=1800.04
T1=52.46
SAT
f=5812655
TT=1789.84
T1=931.61
No dataSAT (TO)
f=5738731
TT=1800.17
T1=3.07
No dataSAT (TO)
f=154843949
TT=1800.03
T1=1800.3
? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=20959683
TT=1800.2
T1=1.83
SAT (TO)
f=5850857
TT=1800.02
T1=1.25
SAT (TO)
f=5580725
TT=1800.05
T1=240.99
No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_0_ic.opb
OPT
f=5767234
TT=2.023
T1=0.61
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.19

OPT
f=5767234
TT=42.113
T1=42.12
SAT (TO)
f=131505462
TT=1800.03
T1=1620.79
No dataNo dataOPT
f=5767234
TT=5.083
T1=2.71
No dataOPT
f=5767234
TT=4.38
T1=1.87
No dataNo dataNo dataOPT
f=5767234
TT=6.344
T1=4.43
OPT
f=5767234
TT=69.549
T1=57.39
No dataOPT
f=5767234
TT=5.106
T1=2.53
No dataSAT (TO)
f=9682788
TT=1800.09
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=5767234
TT=4.054
T1=2.47
OPT
f=5767234
TT=2.023
T1=0.61
OPT
f=5767234
TT=9.163
T1=7.75
No dataNo dataNo dataOPT
f=5767234
TT=98.811
T1=98
OPT
f=5767234
TT=98.366
T1=98.26
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_1_ic.opb
OPT
f=18260924
TT=1.832
T1=0.35
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.13

OPT
f=18260924
TT=1330.76
T1=656.03
? (TO)

TT=1800

? (TO)

TT=1800.15

OPT
f=18260924
TT=4.27
T1=4.18
SAT (TO)
f=445699634
TT=1800.04
T1=0.27
No dataNo dataOPT
f=18260924
TT=4.434
T1=0.66
No dataOPT
f=18260924
TT=3.82
T1=0.59
No dataNo dataNo dataOPT
f=18260924
TT=7.482
T1=4.44
OPT
f=18260924
TT=81.945
T1=80.43
No dataOPT
f=18260924
TT=5.781
T1=2.45
No dataSAT (TO)
f=35606358
TT=1800.11
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=18260924
TT=3.792
T1=2.46
OPT
f=18260924
TT=1.832
T1=0.52
OPT
f=18260924
TT=8.549
T1=7.53
No dataNo dataNo dataOPT
f=18260924
TT=49.618
T1=0.35
OPT
f=18260924
TT=48.572
T1=0.34
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_2_ic.opb
OPT
f=6838116
TT=4.753
T1=0.61
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.13

OPT
f=6838116
TT=1094.42
T1=800.85
? (TO)

TT=1800.1

? (TO)

TT=1800.03

OPT
f=6838116
TT=72.643
T1=67.13
SAT (TO)
f=101639864
TT=1800.03
T1=0.27
No dataNo dataOPT
f=6838116
TT=10.133
T1=0.79
No dataOPT
f=6838116
TT=8.504
T1=0.78
No dataNo dataNo dataOPT
f=6838116
TT=14.613
T1=7.46
OPT
f=6838116
TT=152.288
T1=107.02
No dataOPT
f=6838116
TT=11.333
T1=3.49
No dataSAT (TO)
f=13565016
TT=1800.11
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=6838116
TT=10.37
T1=4.46
OPT
f=6838116
TT=4.753
T1=0.61
OPT
f=6838116
TT=10.822
T1=9.59
No dataNo dataNo dataOPT
f=6838116
TT=419.356
T1=368.74
OPT
f=6838116
TT=434.85
T1=382.22
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_3_ic.opb
OPT
f=5900212
TT=3.153
T1=0.36
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.22

? (TO)

TT=1800.18

OPT
f=5900212
TT=84.982
T1=84.02
SAT (TO)
f=247734378
TT=1800.03
T1=0.27
No dataNo dataOPT
f=5900212
TT=5.905
T1=0.67
No dataOPT
f=5900212
TT=6.175
T1=0.59
No dataNo dataNo dataOPT
f=5900212
TT=9.675
T1=2.44
OPT
f=5900212
TT=150.077
T1=61.79
No dataOPT
f=5900212
TT=7.043
T1=1.48
No dataSAT (TO)
f=31561132
TT=1800.03
T1=1800.3
? (TO)

TT=1800.13

OPT
f=5900212
TT=1724.67
T1=826.34
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=5900212
TT=7.126
T1=1.94
OPT
f=5900212
TT=3.153
T1=0.53
OPT
f=5900212
TT=8.8
T1=7.44
No dataNo dataNo dataOPT
f=5900212
TT=56.748
T1=0.36
OPT
f=5900212
TT=56.642
T1=0.33
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_4_ic.opb
OPT
f=4225708
TT=2.774
T1=1.6
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.24

? (TO)

TT=1800.64

OPT
f=4225708
TT=28.349
T1=24.21
SAT (TO)
f=197918442
TT=1800.02
T1=0.27
No dataNo dataOPT
f=4225708
TT=4.332
T1=1.86
No dataOPT
f=4225708
TT=3.874
T1=1.89
No dataNo dataNo dataOPT
f=4225708
TT=6.725
T1=5.45
OPT
f=4225708
TT=83.702
T1=70.16
No dataOPT
f=4225708
TT=5.532
T1=3.47
No dataSAT (TO)
f=7852562
TT=1800.07
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=4225708
TT=5.982
T1=4.96
OPT
f=4225708
TT=2.774
T1=1.6
OPT
f=4225708
TT=7.424
T1=6.15
No dataNo dataNo dataOPT
f=4225708
TT=53.843
T1=52.34
Wrong Opt.
f=4427600
TT=45.497
T1=44.2
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_5_ic.opb
OPT
f=2624620
TT=2.023
T1=0.54
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.13

OPT
f=2624620
TT=463.741
T1=390.57
OPT
f=2624620
TT=825.361
T1=724.86
? (TO)

TT=1800.18

? (TO)

TT=1800.05

OPT
f=2624620
TT=53.307
T1=52.89
SAT (TO)
f=70733570
TT=1800.03
T1=1630.52
No dataNo dataOPT
f=2624620
TT=3.031
T1=0.66
No dataOPT
f=2624620
TT=3.128
T1=0.9
No dataNo dataNo dataOPT
f=2624620
TT=5.253
T1=2.42
OPT
f=2624620
TT=59.774
T1=54.39
No dataOPT
f=2624620
TT=3.942
T1=1.44
No dataSAT (TO)
f=3286730
TT=1800.07
T1=1800.4
? (TO)

TT=1800.08

OPT
f=2624620
TT=1238.89
T1=1091.47
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=2624620
TT=4.156
T1=2.43
OPT
f=2624620
TT=2.023
T1=0.54
OPT
f=2624620
TT=8.575
T1=7.25
No dataNo dataNo dataOPT
f=2624620
TT=20.291
T1=18.5
OPT
f=2624620
TT=17.958
T1=14.36
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_6_ic.opb
OPT
f=8489816
TT=2.055
T1=0.33
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.22

OPT
f=8489816
TT=1210.91
T1=1036.75
OPT
f=8489816
TT=917.958
T1=591.06
? (TO)

TT=1800.07

? (TO)

TT=1800.22

OPT
f=8489816
TT=60.871
T1=60.76
SAT (TO)
f=160779822
TT=1800.03
T1=0.28
No dataNo dataOPT
f=8489816
TT=4.513
T1=2.69
No dataOPT
f=8489816
TT=4.254
T1=2.69
No dataNo dataNo dataOPT
f=8489816
TT=11.042
T1=9.45
OPT
f=8489816
TT=88.19
T1=69.19
No dataOPT
f=8489816
TT=7.004
T1=4.48
No dataSAT (TO)
f=21248104
TT=1800.08
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=8489816
TT=4.482
T1=2.92
OPT
f=8489816
TT=2.055
T1=0.87
OPT
f=8489816
TT=5.905
T1=4.78
No dataNo dataNo dataOPT
f=8489816
TT=25.881
T1=0.33
OPT
f=8489816
TT=66.602
T1=1.51
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_7_ic.opb
OPT
f=16633202
TT=3.564
T1=1.74
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.08

OPT
f=16633202
TT=1761.08
T1=1141.45
? (TO)

TT=1800.03

? (TO)

TT=1800.29

OPT
f=16633202
TT=22.333
T1=22.31
SAT (TO)
f=57626496
TT=1800.03
T1=0.29
No dataNo dataOPT
f=16633202
TT=6.544
T1=3.17
No dataOPT
f=16633202
TT=6.763
T1=3.94
No dataNo dataNo dataOPT
f=16633202
TT=10.155
T1=8.44
OPT
f=16633202
TT=93.746
T1=86.37
No dataOPT
f=16633202
TT=9.861
T1=5.97
No dataSAT (TO)
f=18007138
TT=1800.04
T1=1800.4
? (TO)

TT=1800.14

OPT
f=16633202
TT=1282.99
T1=489.13
No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=16633202
TT=9.111
T1=7.43
OPT
f=16633202
TT=3.564
T1=1.74
OPT
f=16633202
TT=9.421
T1=7.94
No dataNo dataNo dataOPT
f=16633202
TT=95.799
T1=78.95
OPT
f=16633202
TT=94.392
T1=77.8
No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_8_ic.opb
OPT
f=5065770
TT=1.984
T1=0.33
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.11

OPT
f=5065770
TT=1486.15
T1=1128.29
OPT
f=5065770
TT=1222.21
T1=951.45
? (TO)

TT=1800.3

? (TO)

TT=1800.01

OPT
f=5065770
TT=38.029
T1=36.51
SAT (TO)
f=162850952
TT=1800.03
T1=0.27
No dataNo dataOPT
f=5065770
TT=2.926
T1=0.63
No dataOPT
f=5065770
TT=2.754
T1=0.54
No dataNo dataNo dataOPT
f=5065770
TT=5.352
T1=3.4
OPT
f=5065770
TT=43.524
T1=26.25
No dataOPT
f=5065770
TT=4.093
T1=2.94
No dataSAT (TO)
f=34822730
TT=1800.08
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=5065770
TT=4.112
T1=1.41
OPT
f=5065770
TT=1.984
T1=0.55
OPT
f=5065770
TT=7.263
T1=5.71
No dataNo dataNo dataOPT
f=5065770
TT=21.406
T1=0.33
OPT
f=5065770
TT=20.118
T1=0.32
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat15_5_3_9_ic.opb
OPT
f=7836062
TT=2.915
T1=0.42
No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.06

OPT
f=7836062
TT=1563.63
T1=1150.35
? (TO)

TT=1800.18

? (TO)

TT=1800.09

OPT
f=7836062
TT=94.718
T1=94.71
SAT (TO)
f=129747852
TT=1800.03
T1=0.28
No dataNo dataOPT
f=7836062
TT=4.29
T1=0.57
No dataOPT
f=7836062
TT=4.772
T1=0.48
No dataNo dataNo dataOPT
f=7836062
TT=9.103
T1=2.43
OPT
f=7836062
TT=97.465
T1=60.35
No dataOPT
f=7836062
TT=7.332
T1=1.47
No dataSAT (TO)
f=10025534
TT=1800.11
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=7836062
TT=6.091
T1=0.95
OPT
f=7836062
TT=2.915
T1=0.42
OPT
f=7836062
TT=10.773
T1=9.5
No dataNo dataNo dataOPT
f=7836062
TT=133.481
T1=111.78
OPT
f=7836062
TT=131.771
T1=110.44
No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_0_ic.opb




No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.02

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.23

No dataNo dataNo data? (TO)

TT=1801.31

UNSAT

TT=1.795

No data? (TO)

TT=1800.01

No data? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.71

? (TO)

TT=1800.5

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_1_ic.opb




No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.05

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.01

UNSAT

TT=1.893

No data? (TO)

TT=1800.8

No data? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.04

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.58

? (TO)

TT=1800.48

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_2_ic.opb




No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.96

No data? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.09

UNSAT

TT=1.934

No data? (TO)

TT=1800.06

No data? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.81

? (TO)

TT=1800.05

? (TO)

TT=1800.5

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_3_ic.opb




No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.52

No dataNo dataNo data? (TO)

TT=1800.18

UNSAT

TT=2.386

No data? (TO)

TT=1800.12

No data? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.62

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_4_ic.opb




No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.95

UNSAT

TT=1.81

No data? (TO)

TT=1800.35

No data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_5_ic.opb




No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.78

No data? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.53

UNSAT

TT=1.833

No data? (TO)

TT=1800.08

No data? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.58

? (TO)

TT=1800

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_6_ic.opb




No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.1

No data? (TO)

TT=1801.11

No dataNo dataNo data? (TO)

TT=1800.03

UNSAT

TT=2.084

No data? (TO)

TT=1800.47

No data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.71

? (TO)

TT=1800

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_7_ic.opb




No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.01

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.59

No dataNo dataNo data? (TO)

TT=1800.12

UNSAT

TT=1.973

No data? (TO)

TT=1800.17

No data? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.68

? (TO)

TT=1800.6

No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_8_ic.opb




No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.05

No dataNo data? (TO)

TT=1800.1

No data? (TO)

TT=1801.08

No dataNo dataNo data? (TO)

TT=1801.07

UNSAT

TT=1.691

No data? (TO)

TT=1800.45

No data? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.61

? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat25_6_3_9_ic.opb




No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1800.04

No data? (TO)

TT=1800.6

No dataNo dataNo data? (TO)

TT=1801

UNSAT

TT=1.823

No data? (TO)

TT=1800.04

No data? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.59

? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_0_ic.opb
SAT
f=19663339
TT=1800.95
T1=10.67
No dataNo dataNo data? (problem)

TT=27.474

? (TO)

TT=1800.06

? (problem)

TT=25.67

? (TO)

TT=1800.09

? (problem)

TT=26.76

? (TO)

TT=1800.06

? (problem)

TT=25.49

? (TO)

TT=1800.1

SAT (TO)
f=195261929
TT=1800.06
T1=1590.55
SAT (TO)
f=349855005
TT=1800.13
T1=21.72
No dataNo data? (TO)

TT=1800.07

No dataSAT (TO)
f=69008777
TT=1800.38
T1=9.27
No dataNo dataNo dataSAT (TO)
f=19663339
TT=1800.95
T1=10.67
?

TT=1790.47

No dataSAT (TO)
f=72445855
TT=1800.74
T1=52.37
No dataNo Cert.

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=20715455
TT=1800.22
T1=4.44
SAT (TO)
f=52740603
TT=1800.02
T1=724
SAT (TO)
f=122076649
TT=1800.04
T1=408.8
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_1_ic.opb
SAT
f=17594349
TT=1800.54
T1=356.62
No dataNo dataNo data? (problem)

TT=28.087

? (TO)

TT=1800.09

? (problem)

TT=25.55

? (TO)

TT=1800.01

? (problem)

TT=26.8

? (TO)

TT=1800.1

? (problem)

TT=25.69

? (TO)

TT=1800.06

SAT (TO)
f=263878701
TT=1800.09
T1=12.3
SAT (TO)
f=483585019
TT=1800.13
T1=21.71
No dataNo data? (TO)

TT=1800.13

No data? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=17594349
TT=1801.05
T1=587.43
?

TT=1790.77

No dataSAT (TO)
f=17594349
TT=1800.54
T1=356.62
No dataNo Cert.

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=30347327
TT=1801.07
T1=4.26
SAT (TO)
f=30347327
TT=1800.09
T1=2.89
SAT (TO)
f=465353945
TT=1800.03
T1=2.78
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_2_ic.opb
SAT
f=16405051
TT=1800.11
T1=713.24
No dataNo dataNo data? (problem)

TT=28.01

? (TO)

TT=1800.01

? (problem)

TT=26.17

? (TO)

TT=1800.04

? (problem)

TT=26.43

? (TO)

TT=1800.05

? (problem)

TT=25.42

? (TO)

TT=1800.1

SAT (TO)
f=188376195
TT=1800.09
T1=845.58
SAT (TO)
f=411264517
TT=1800.05
T1=21.63
No dataNo dataSAT (TO)
f=145728873
TT=1800.86
T1=56.19
No dataSAT (TO)
f=158134211
TT=1800.23
T1=6.34
No dataNo dataNo dataSAT (TO)
f=70245787
TT=1800.36
T1=1476.42
?

TT=1790.77

No dataSAT (TO)
f=16405051
TT=1800.11
T1=713.24
No dataNo Cert.

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=17674193
TT=1800.18
T1=6.74
SAT (TO)
f=21823205
TT=1800.81
T1=3.01
SAT (TO)
f=683953235
TT=1800.07
T1=2.33
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_3_ic.opb
SAT
f=18759965
TT=1800.07
T1=172.43
No dataNo dataNo data? (problem)

TT=28.145

? (TO)

TT=1800.05

? (problem)

TT=26.23

? (TO)

TT=1800.1

? (problem)

TT=26.18

? (TO)

TT=1800.07

? (problem)

TT=25.15

? (TO)

TT=1800.09

SAT (TO)
f=208889327
TT=1800.13
T1=48.63
SAT (TO)
f=573747721
TT=1800.04
T1=21.6
No dataNo dataSAT (TO)
f=670269021
TT=1800.88
T1=5.11
No dataSAT (TO)
f=672035799
TT=1800.71
T1=4.56
No dataNo dataNo dataSAT (TO)
f=18759965
TT=1800.07
T1=172.43
?

TT=1790.52

No dataSAT (TO)
f=33752535
TT=1800.15
T1=120.87
No dataNo Cert.

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=20014515
TT=1800.13
T1=4.34
SAT (TO)
f=20489021
TT=1800.08
T1=2.84
SAT (TO)
f=185969423
TT=1800.29
T1=2.42
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_4_ic.opb
SAT
f=24098223
TT=1800.03
T1=6.49
No dataNo dataNo data? (problem)

TT=27.181

? (TO)

TT=1800.04

? (problem)

TT=25.92

? (TO)

TT=1800.1

? (problem)

TT=25.55

? (TO)

TT=1800.06

? (problem)

TT=25.63

? (TO)

TT=1800.05

SAT (TO)
f=124533733
TT=1800.14
T1=11.87
SAT (TO)
f=303670573
TT=1800.13
T1=21.95
No dataNo dataSAT (TO)
f=1464398555
TT=1801.89
T1=6.08
No dataSAT (TO)
f=24098223
TT=1800.03
T1=6.49
No dataNo dataNo dataSAT (TO)
f=38604277
TT=1800.08
T1=6.01
?

TT=1790.48

No dataSAT (TO)
f=54108771
TT=1800.78
T1=51.84
No dataNo Cert.

TT=1800

? (TO)

TT=1800.17

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=24430075
TT=1800.08
T1=4.43
SAT (TO)
f=35645267
TT=1800.07
T1=3.16
SAT (TO)
f=126336457
TT=1800.04
T1=1468.54
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_5_ic.opb
SAT
f=20693353
TT=1800.06
T1=7.44
No dataNo dataNo data? (problem)

TT=27.868

? (TO)

TT=1800.02

? (problem)

TT=26.04

? (TO)

TT=1800.06

? (problem)

TT=26.48

? (TO)

TT=1800.09

? (problem)

TT=25.74

? (TO)

TT=1800.1

SAT (TO)
f=184734685
TT=1800.2
T1=11.61
SAT (TO)
f=339596185
TT=1800.05
T1=21.61
No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.81

No dataNo dataNo dataSAT (TO)
f=20693353
TT=1800.06
T1=7.44
?

TT=1790.46

No dataSAT (TO)
f=20830519
TT=1800.98
T1=4.48
No dataNo Cert.

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=26014359
TT=1800.9
T1=4.21
SAT (TO)
f=23397345
TT=1800.09
T1=3.01
SAT (TO)
f=185878211
TT=1800.06
T1=1536.64
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_6_ic.opb
SAT
f=23421403
TT=1800.02
T1=3.26
No dataNo dataNo data? (problem)

TT=27.39

? (TO)

TT=1800.05

? (problem)

TT=25.54

? (TO)

TT=1800.07

? (problem)

TT=26.26

? (TO)

TT=1800.07

? (problem)

TT=25.71

? (TO)

TT=1800.06

SAT (TO)
f=208271001
TT=1800.14
T1=107.42
SAT (TO)
f=311228109
TT=1800.14
T1=19.14
No dataNo data? (TO)

TT=1800.04

No data? (TO)

TT=1800.83

No dataNo dataNo dataSAT (TO)
f=243640291
TT=1800.39
T1=690.98
?

TT=1790.7

No dataSAT (TO)
f=63993277
TT=1800.75
T1=61.17
No dataNo Cert.

TT=1800.08

? (TO)

TT=1800.42

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=24776505
TT=1800.76
T1=4.34
SAT (TO)
f=23421403
TT=1800.02
T1=3.26
SAT (TO)
f=184979753
TT=1801.14
T1=213.73
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_7_ic.opb
SAT
f=22045487
TT=1800.86
T1=9.3
No dataNo dataNo data? (problem)

TT=27.317

? (TO)

TT=1800.05

? (problem)

TT=26.45

? (TO)

TT=1800.08

? (problem)

TT=26.13

? (TO)

TT=1800.08

? (problem)

TT=26.67

? (TO)

TT=1800.09

SAT (TO)
f=141410843
TT=1800.13
T1=87.43
SAT (TO)
f=232621833
TT=1800.04
T1=20.22
No dataNo data? (TO)

TT=1800.05

No data? (TO)

TT=1800

No dataNo dataNo dataSAT (TO)
f=22316407
TT=1801.19
T1=15.44
?

TT=1790.74

No dataSAT (TO)
f=23085595
TT=1800.2
T1=9.16
No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=22045487
TT=1800.86
T1=9.3
SAT (TO)
f=23968435
TT=1800.09
T1=3.32
SAT (TO)
f=183702611
TT=1800.1
T1=367.66
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_8_ic.opb
SAT
f=20224039
TT=1800.23
T1=5.3
No dataNo dataNo data? (problem)

TT=27.646

? (TO)

TT=1800.08

? (problem)

TT=26.67

? (TO)

TT=1800.07

? (problem)

TT=26.19

? (TO)

TT=1800.07

? (problem)

TT=26.34

? (TO)

TT=1800.11

SAT (TO)
f=213676795
TT=1800.07
T1=411.91
SAT (TO)
f=392470271
TT=1800.05
T1=19.38
No dataNo dataSAT (TO)
f=271641953
TT=1801.14
T1=5.31
No data? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=38410059
TT=1800.12
T1=10.15
?

TT=1790.5

No dataSAT (TO)
f=33370465
TT=1800.06
T1=5.65
No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.21

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=20224039
TT=1800.23
T1=5.3
SAT (TO)
f=32510607
TT=1800.05
T1=3.62
SAT (TO)
f=587168385
TT=1800.56
T1=3.01
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
IC/
normalized-minisat50_6_9_9_ic.opb
SAT
f=18576569
TT=1800.16
T1=147.03
No dataNo dataNo data? (problem)

TT=28.341

? (TO)

TT=1800.07

? (problem)

TT=27.29

? (TO)

TT=1800.04

? (problem)

TT=26.75

? (TO)

TT=1800.04

? (problem)

TT=25.59

? (TO)

TT=1800.1

SAT (TO)
f=205277921
TT=1800.11
T1=11.4
SAT (TO)
f=546153303
TT=1800.05
T1=21.61
No dataNo data? (TO)

TT=1800.09

No data? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=18576569
TT=1800.16
T1=147.03
?

TT=1790.48

No dataSAT (TO)
f=36749763
TT=1800.76
T1=6.13
No dataNo Cert.

TT=1800

? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=31378619
TT=1800.16
T1=4.2
SAT (TO)
f=39038857
TT=1800.62
T1=3.36
SAT (TO)
f=257856583
TT=1800.09
T1=290.06
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_0_ic.opb
SAT
f=15556017
TT=1801.33
T1=38.01
No dataNo dataNo data? (MO)

TT=128.37

? (problem)

TT=128.718

? (MO)

TT=129.35

? (problem)

TT=126.195

? (MO)

TT=128.25

? (problem)

TT=129.145

? (MO)

TT=127.12

? (problem)

TT=127.361

Signal

TT=188.435

? (TO)

TT=1800.04

No dataNo data? (TO)

TT=1800.04

No data? (TO)

TT=1800.9

No dataNo dataNo data?

TT=372.479

?

TT=1799.63

No dataSAT (TO)
f=15632555
TT=1800.73
T1=66.05
No data? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=15556017
TT=1801.33
T1=38.01
SAT (TO)
f=15852677
TT=1801.48
T1=18.05
? (TO)

TT=1800.05

No dataNo dataNo data? (exit code)

TT=46.853

? (TO)

TT=1800.18

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_0_mh.opb
SAT
f=12005073
TT=1802.05
T1=91.06
No dataNo dataNo data? (problem)

TT=108.794

? (problem)

TT=137.26

? (problem)

TT=110.85

? (problem)

TT=136.493

? (problem)

TT=112.209

? (problem)

TT=137.366

? (problem)

TT=108.981

? (problem)

TT=136.625

Signal

TT=27.942

? (TO)

TT=1800.02

No dataNo data? (TO)

TT=1800.81

No data?

TT=213.57

No dataNo dataNo data?

TT=475.893

? (MO)

TT=313.522

No dataSAT (TO)
f=576452692
TT=1801.38
T1=1098.18
No data? (TO)

TT=1800.08

? (TO)

TT=1800

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=12005073
TT=1802.05
T1=91.06
? (TO)

TT=1800.54

? (TO)

TT=1800.01

No dataNo dataNo data? (exit code)

TT=94.842

? (TO)

TT=1800.4

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_1_ic.opb
SAT
f=23994341
TT=1800.77
T1=39.15
No dataNo dataNo data? (MO)

TT=126.85

? (problem)

TT=128.612

? (MO)

TT=132.57

? (problem)

TT=126.845

? (MO)

TT=130.28

? (problem)

TT=127.18

? (MO)

TT=131.41

? (problem)

TT=124.872

Signal

TT=187.218

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1800.98

No data? (TO)

TT=1800.22

No dataNo dataNo data?

TT=380.3

?

TT=1798.23

No dataSAT (TO)
f=23994341
TT=1800.77
T1=39.15
No data? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=35726575
TT=1801.37
T1=32.9
SAT (TO)
f=25311381
TT=1801.02
T1=19.08
? (TO)

TT=1800.05

No dataNo dataNo data? (exit code)

TT=46.519

? (TO)

TT=1800.17

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_1_mh.opb
SAT
f=23298810
TT=1801.45
T1=1436.83
No dataNo dataNo data? (problem)

TT=108.76

? (problem)

TT=134.593

? (problem)

TT=112.894

? (problem)

TT=135.015

? (problem)

TT=111.981

? (problem)

TT=137.454

? (problem)

TT=109.434

? (problem)

TT=136.004

Signal

TT=27.814

? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.46

No data?

TT=210.212

No dataNo dataNo data? (TO)

TT=1802.26

? (MO)

TT=304.419

No dataSAT (TO)
f=23298810
TT=1801.45
T1=1436.83
No data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.21

? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo data? (exit code)

TT=98.99

? (TO)

TT=1800.36

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_2_ic.opb
SAT
f=18641903
TT=1800.72
T1=37.53
No dataNo dataNo data? (MO)

TT=130.8

? (problem)

TT=127.175

? (MO)

TT=127.49

? (problem)

TT=127.842

? (MO)

TT=127.81

? (problem)

TT=127.435

? (MO)

TT=132.56

? (problem)

TT=127.61

Signal

TT=1440.98

? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.1

No data? (TO)

TT=1801.12

No dataNo dataNo data?

TT=388.12

? (TO)

TT=1800.28

No dataSAT (TO)
f=1958196751
TT=1800.73
T1=887.35
No data? (TO)

TT=1800.01

? (TO)

TT=1800

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=18641903
TT=1800.72
T1=37.53
SAT (TO)
f=21498829
TT=1800.8
T1=20.3
? (TO)

TT=1800.03

No dataNo dataNo data? (exit code)

TT=49.228

? (TO)

TT=1800.15

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_2_mh.opb




No dataNo dataNo data? (problem)

TT=109.706

? (problem)

TT=140.239

? (problem)

TT=113.465

? (problem)

TT=135.344

? (problem)

TT=109.881

? (problem)

TT=137.993

? (problem)

TT=116.884

? (problem)

TT=139.621

Signal

TT=26.581

? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.88

No data?

TT=214.59

No dataNo dataNo data? (TO)

TT=1802.63

? (MO)

TT=290.614

No data? (TO)

TT=1800.16

No data? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.19

? (TO)

TT=1800.08

? (TO)

TT=1800.04

No dataNo dataNo data? (exit code)

TT=99.543

? (TO)

TT=1800.31

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_3_ic.opb
SAT
f=19921107
TT=1800.49
T1=17.52
No dataNo dataNo data? (MO)

TT=127.24

? (problem)

TT=127.255

? (MO)

TT=127.57

? (problem)

TT=127.36

? (MO)

TT=127.74

? (problem)

TT=126.097

? (MO)

TT=126.43

? (problem)

TT=127.072

Signal

TT=187.683

? (TO)

TT=1800.08

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.02

No dataNo dataNo data? (exit code)

TT=382.53

?

TT=1799.59

No data? (TO)

TT=1800.07

No data? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=19921107
TT=1801.36
T1=23.81
SAT (TO)
f=19921107
TT=1800.49
T1=17.52
? (TO)

TT=1800.09

No dataNo dataNo data? (exit code)

TT=46.591

? (TO)

TT=1800.19

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_3_mh.opb
SAT
f=649774124
TT=1802.01
T1=1086.5
No dataNo dataNo data? (problem)

TT=111.665

? (problem)

TT=137.106

? (problem)

TT=111.037

? (problem)

TT=136.559

? (problem)

TT=112.857

? (problem)

TT=133.732

? (problem)

TT=112.196

? (problem)

TT=137.123

Signal

TT=26.443

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1802

No data?

TT=213.222

No dataNo dataNo data? (TO)

TT=1802.05

? (MO)

TT=281.231

No dataSAT (TO)
f=649774124
TT=1802.01
T1=1086.5
No data? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.2

? (TO)

TT=1800.8

? (TO)

TT=1800.78

No dataNo dataNo data? (exit code)

TT=99.983

? (TO)

TT=1800.31

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_4_ic.opb
SAT
f=702654757
TT=1800.73
T1=877.45
No dataNo dataNo data? (MO)

TT=133.51

? (problem)

TT=126.765

? (MO)

TT=140.32

? (problem)

TT=128.378

? (MO)

TT=129.83

? (problem)

TT=129.328

? (MO)

TT=132.86

? (problem)

TT=127.518

Signal

TT=191.923

? (TO)

TT=1800.07

No dataNo data? (TO)

TT=1801.11

No data? (TO)

TT=1800.78

No dataNo dataNo data?

TT=482.242

?

TT=1799.01

No dataSAT (TO)
f=702654757
TT=1800.73
T1=877.45
No data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.73

? (TO)

TT=1800.03

No dataNo dataNo data? (exit code)

TT=46.109

? (TO)

TT=1800.19

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_4_mh.opb
SAT
f=13309104
TT=1800.88
T1=42.65
No dataNo dataNo data? (problem)

TT=111.669

? (problem)

TT=140.389

? (problem)

TT=111.593

? (problem)

TT=134.811

? (problem)

TT=114.71

? (problem)

TT=139.324

? (problem)

TT=115.968

? (problem)

TT=139.727

Signal

TT=26.32

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1802.02

No data?

TT=209.654

No dataNo dataNo data? (TO)

TT=1802.07

? (MO)

TT=306.924

No data? (TO)

TT=1800.04

No data? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=15499791
TT=1804.2
T1=69.28
SAT (TO)
f=13309104
TT=1800.88
T1=42.65
? (TO)

TT=1800.06

No dataNo dataNo data? (exit code)

TT=98.147

? (TO)

TT=1800.32

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_5_ic.opb
SAT
f=15413119
TT=1801.3
T1=460.88
No dataNo dataNo data? (MO)

TT=129.28

? (problem)

TT=128.938

? (MO)

TT=130.75

? (problem)

TT=125.986

? (MO)

TT=129.31

? (problem)

TT=128.304

? (MO)

TT=129.23

? (problem)

TT=125.512

Signal

TT=186.007

? (TO)

TT=1800.02

No dataNo data? (TO)

TT=1801.59

No data? (TO)

TT=1800.01

No dataNo dataNo data?

TT=384.23

? (TO)

TT=1800.33

No dataSAT (TO)
f=15413119
TT=1801.3
T1=460.88
No data? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=17114153
TT=1800.8
T1=26.52
SAT (TO)
f=17595677
TT=1801.12
T1=18.64
? (TO)

TT=1800.02

No dataNo dataNo data? (exit code)

TT=46.138

? (TO)

TT=1800.14

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_5_mh.opb
SAT
f=9895127
TT=1800.86
T1=38.81
No dataNo dataNo data? (problem)

TT=111.576

? (problem)

TT=135.865

? (problem)

TT=112.142

? (problem)

TT=136.9

? (problem)

TT=110.188

? (problem)

TT=136.018

? (problem)

TT=114.241

? (problem)

TT=135.696

Signal

TT=26.261

? (TO)

TT=1800.1

No dataNo data? (TO)

TT=1802.73

No data?

TT=210.102

No dataNo dataNo data? (TO)

TT=1802.44

? (MO)

TT=284.748

No dataSAT (TO)
f=10125574
TT=1800.9
T1=1751.63
No data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=12350736
TT=1802.02
T1=120.1
SAT (TO)
f=9895127
TT=1800.86
T1=38.81
? (TO)

TT=1800.49

No dataNo dataNo data? (exit code)

TT=102.03

? (TO)

TT=1800.36

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_6_ic.opb
SAT
f=18197499
TT=1800.55
T1=21.11
No dataNo dataNo data? (MO)

TT=161.99

? (problem)

TT=131.025

? (MO)

TT=129.77

? (problem)

TT=128.788

? (MO)

TT=127.59

? (problem)

TT=125.386

? (MO)

TT=135.17

? (problem)

TT=129.422

Signal

TT=189.329

? (TO)

TT=1800.07

No dataNo data? (TO)

TT=1800.69

No dataSAT (TO)
f=18287799
TT=1801.94
T1=103.85
No dataNo dataNo data? (exit code)

TT=389.97

?

TT=1799.83

No dataSAT (TO)
f=18349921
TT=1800.8
T1=52.65
No data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=18248941
TT=1801.7
T1=40.32
SAT (TO)
f=18197499
TT=1800.55
T1=21.11
? (TO)

TT=1800.1

No dataNo dataNo data? (exit code)

TT=47.975

? (TO)

TT=1800.21

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_6_mh.opb




No dataNo dataNo data? (problem)

TT=109.917

? (problem)

TT=138.133

? (problem)

TT=108.999

? (problem)

TT=135.363

? (problem)

TT=111.071

? (problem)

TT=136.062

? (problem)

TT=107.482

? (problem)

TT=144.931

Signal

TT=26.92

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1800.63

No data?

TT=209.343

No dataNo dataNo data?

TT=468.1

? (MO)

TT=309.724

No data? (TO)

TT=1800.05

No data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.53

? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo data? (exit code)

TT=98.706

? (TO)

TT=1800.45

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_7_ic.opb
SAT
f=22900311
TT=1800.77
T1=556.96
No dataNo dataNo data? (MO)

TT=127.03

? (problem)

TT=127.919

? (MO)

TT=128.68

? (problem)

TT=132.578

? (MO)

TT=127.53

? (problem)

TT=126.293

? (MO)

TT=128.71

? (problem)

TT=131.769

? (TO)

TT=1800.14

? (TO)

TT=1800.07

No dataNo data? (TO)

TT=1800.81

No dataSAT (TO)
f=23003887
TT=1801.27
T1=57.33
No dataNo dataNo data?

TT=377.92

?

TT=1798.91

No dataSAT (TO)
f=23049253
TT=1800.75
T1=50.65
No data? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=22900311
TT=1800.77
T1=556.96
SAT (TO)
f=23128011
TT=1801.27
T1=16.35
? (TO)

TT=1800.05

No dataNo dataNo data? (exit code)

TT=46.259

? (TO)

TT=1800.19

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_7_mh.opb
SAT
f=12324240
TT=1800.93
T1=39.12
No dataNo dataNo data? (problem)

TT=109.49

? (problem)

TT=135.977

? (problem)

TT=116.129

? (problem)

TT=138.302

? (problem)

TT=113.368

? (problem)

TT=137.77

? (problem)

TT=113.745

? (problem)

TT=136.041

Signal

TT=28.508

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1802.5

No data?

TT=211.011

No dataNo dataNo data? (TO)

TT=1802.05

? (MO)

TT=316.631

No dataSAT (TO)
f=16223003
TT=1800.87
T1=1674.42
No data? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=13509640
TT=1801.35
T1=98.43
SAT (TO)
f=12324240
TT=1800.93
T1=39.12
? (TO)

TT=1800.07

No dataNo dataNo data? (exit code)

TT=99.454

? (TO)

TT=1800.4

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_8_ic.opb
SAT
f=19839407
TT=1800.69
T1=216.62
No dataNo dataNo data? (MO)

TT=128.35

? (problem)

TT=131.26

? (MO)

TT=130.34

? (problem)

TT=126.936

? (MO)

TT=132.31

? (problem)

TT=132.489

? (MO)

TT=128.05

? (problem)

TT=126.844

Signal

TT=1328.58

? (TO)

TT=1800.04

No dataNo data? (TO)

TT=1801.23

No data? (TO)

TT=1800.23

No dataNo dataNo data?

TT=374.668

?

TT=1799.68

No dataSAT (TO)
f=19839407
TT=1800.81
T1=615.45
No data? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=19839407
TT=1800.69
T1=216.62
SAT (TO)
f=19996345
TT=1800.97
T1=18.89
? (TO)

TT=1800.03

No dataNo dataNo data? (exit code)

TT=48.516

? (TO)

TT=1800.21

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_8_mh.opb
SAT
f=9289758
TT=1801.37
T1=1698.03
No dataNo dataNo data? (problem)

TT=108.991

? (problem)

TT=137.191

? (problem)

TT=111.203

? (problem)

TT=137.163

? (problem)

TT=111.782

? (problem)

TT=137.449

? (problem)

TT=114.91

? (problem)

TT=139.825

Signal

TT=26.407

? (TO)

TT=1800.1

No dataNo data? (TO)

TT=1802.46

No data? (TO)

TT=1802.47

No dataNo dataNo data? (TO)

TT=1802.05

? (MO)

TT=306.82

No dataSAT (TO)
f=9289758
TT=1801.37
T1=1698.03
No data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.43

No dataNo dataNo data? (exit code)

TT=99.464

? (TO)

TT=1800.33

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_9_ic.opb
SAT
f=18291783
TT=1800.54
T1=18.63
No dataNo dataNo data? (MO)

TT=134.6

? (problem)

TT=126.724

? (MO)

TT=129.33

? (problem)

TT=126.955

? (MO)

TT=130.48

? (problem)

TT=129.469

? (MO)

TT=143.21

? (problem)

TT=126.34

Signal

TT=186.508

? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.59

No dataNo dataNo data?

TT=370.39

?

TT=1799.4

No data? (TO)

TT=1800.21

No data? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=21250477
TT=1800.78
T1=29.44
SAT (TO)
f=18291783
TT=1800.54
T1=18.63
? (TO)

TT=1800.08

No dataNo dataNo data? (exit code)

TT=47.553

? (TO)

TT=1800.16

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Large/
normalized-minisat100_16_6_9_mh.opb
SAT
f=750142818
TT=1801.3
T1=1261.04
No dataNo dataNo data? (problem)

TT=110.71

? (problem)

TT=135.422

? (problem)

TT=114.879

? (problem)

TT=137.751

? (problem)

TT=109.734

? (problem)

TT=134.553

? (problem)

TT=111.131

? (problem)

TT=136.589

Signal

TT=26.757

? (TO)

TT=1800.03

No dataNo data? (TO)

TT=1802.23

No data?

TT=228.83

No dataNo dataNo data? (TO)

TT=1802.01

? (MO)

TT=286.411

No dataSAT (TO)
f=750142818
TT=1801.3
T1=1261.04
No data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.59

? (TO)

TT=1800.03

? (TO)

TT=1800.81

No dataNo dataNo data? (exit code)

TT=100.121

? (TO)

TT=1800.32

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_0_mh_ic.opb
OPT
f=2252617
TT=504.786
T1=472.86
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.05

SAT (TO)
f=2922031
TT=1800.1
T1=859.59
SAT (TO)
f=153809854
TT=1800.03
T1=6.55
No dataNo dataSAT (TO)
f=2378979
TT=1800.05
T1=1560.35
No dataSAT (TO)
f=2337815
TT=1800.71
T1=1554.99
No dataNo dataNo dataSAT (TO)
f=2393080
TT=1801.51
T1=512.43
OPT
f=2252617
TT=375.851
T1=368.54
No dataSAT (TO)
f=2307919
TT=1800.42
T1=675.52
No dataSAT (TO)
f=98483335
TT=1800.08
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=2252617
TT=1016.12
T1=472.86
OPT
f=2252617
TT=504.786
T1=481.32
SAT (TO)
f=3653970
TT=1800.1
T1=1786.16
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_1_mh_ic.opb
OPT
f=1396365
TT=680.72
T1=575.63
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.06

SAT (TO)
f=2227400
TT=1800.05
T1=1447.22
SAT (TO)
f=78224332
TT=1800.03
T1=6.17
No dataNo dataSAT (TO)
f=2612349
TT=1800.5
T1=1407.85
No dataSAT (TO)
f=1642021
TT=1800.64
T1=858.8
No dataNo dataNo dataSAT (TO)
f=1438959
TT=1800.55
T1=870.19
OPT
f=1396365
TT=929.881
T1=861.38
No dataSAT (TO)
f=1396365
TT=1800.16
T1=889.93
No dataSAT (TO)
f=9220574
TT=1800.01
T1=1800.3
? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=1474638
TT=1801.47
T1=864.11
OPT
f=1396365
TT=680.72
T1=575.63
SAT (TO)
f=2265550
TT=1800.06
T1=1659.45
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_3_mh_ic.opb
SAT
f=4397958
TT=1800.07
T1=910.95
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.15

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.09

SAT (TO)
f=4731186
TT=1800.09
T1=1536.42
SAT (TO)
f=271907504
TT=1800.03
T1=6.27
No dataNo dataSAT (TO)
f=4542849
TT=1800.04
T1=1267.58
No dataSAT (TO)
f=4465751
TT=1800.48
T1=1317.49
No dataNo dataNo dataSAT (TO)
f=4477760
TT=1800.19
T1=797.33
OPT
f=4323015
TT=1767.21
T1=1654.21
No dataSAT (TO)
f=4680914
TT=1800.08
T1=107.39
No dataSAT (TO)
f=46789899
TT=1800.02
T1=1800.3
? (TO)

TT=1800.04

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4397958
TT=1800.07
T1=910.95
SAT (TO)
f=4439354
TT=1800
T1=1242.27
SAT (TO)
f=5244145
TT=1800.8
T1=1074.7
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_5_mh_ic.opb
OPT
f=2814188
TT=710.67
T1=588.78
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.87

? (TO)

TT=1800

? (TO)

TT=1800.04

? (TO)

TT=1800.06

SAT (TO)
f=5095172
TT=1800.09
T1=1431.45
SAT (TO)
f=154798544
TT=1800.03
T1=6.23
No dataNo dataSAT (TO)
f=3109934
TT=1800.25
T1=1370.18
No dataSAT (TO)
f=2899404
TT=1800.46
T1=1154.38
No dataNo dataNo dataSAT (TO)
f=2827160
TT=1800.74
T1=917.65
OPT
f=2814188
TT=874.528
T1=572.6
No dataSAT (TO)
f=2910388
TT=1800.59
T1=525.77
No dataSAT (TO)
f=14684690
TT=1800.02
T1=1800.3
? (TO)

TT=1800.09

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3101507
TT=1800.43
T1=228.62
OPT
f=2814188
TT=710.67
T1=588.78
SAT (TO)
f=3108870
TT=1800.02
T1=1702.57
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_6_mh_ic.opb
OPT
f=2886748
TT=222.049
T1=125.13
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.16

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.08

SAT (TO)
f=3068260
TT=1800.06
T1=1697.28
SAT (TO)
f=104368343
TT=1800.03
T1=6.25
No dataNo dataSAT (TO)
f=4876630
TT=1800.03
T1=1762.67
No dataSAT (TO)
f=2889483
TT=1801.06
T1=1698.97
No dataNo dataNo dataOPT
f=2886748
TT=1183.33
T1=523.14
OPT
f=2886748
TT=360.601
T1=332.98
No dataSAT (TO)
f=3108404
TT=1800.1
T1=286.07
No dataSAT (TO)
f=55971742
TT=1800
T1=1800.4
? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3065787
TT=1800.51
T1=60.62
OPT
f=2886748
TT=222.049
T1=125.13
SAT (TO)
f=5641372
TT=1800.08
T1=1743.83
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_8_mh_ic.opb
OPT
f=5227195
TT=75.503
T1=67.95
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.16

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.08

SAT (TO)
f=5303705
TT=1800.1
T1=1418.08
SAT (TO)
f=148259312
TT=1800.11
T1=6.24
No dataNo dataOPT
f=5227195
TT=1383.25
T1=1236.12
No dataOPT
f=5227195
TT=493.614
T1=435.87
No dataNo dataNo dataOPT
f=5227195
TT=711.495
T1=326.21
OPT
f=5227195
TT=283.146
T1=239.93
No dataOPT
f=5227195
TT=686.059
T1=322.5
No dataSAT (TO)
f=30638900
TT=1800.05
T1=1800.4
? (TO)

TT=1800.13

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5240441
TT=1800.1
T1=137.48
OPT
f=5227195
TT=75.503
T1=67.95
SAT (TO)
f=10008470
TT=1800.01
T1=1771.75
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat15_4_4_9_mh_ic.opb
OPT
f=3056260
TT=130.34
T1=57.28
No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.15

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.09

SAT (TO)
f=3850342
TT=1800.08
T1=1394.2
SAT (TO)
f=294326259
TT=1800.03
T1=6.2
No dataNo dataSAT (TO)
f=3102554
TT=1800.89
T1=1701.41
No dataSAT (TO)
f=3068509
TT=1800.49
T1=1396.17
No dataNo dataNo dataOPT
f=3056260
TT=1425.06
T1=194.37
OPT
f=3056260
TT=294.481
T1=242.25
No dataSAT (TO)
f=3068509
TT=1800.05
T1=321.96
No dataSAT (TO)
f=104125786
TT=1800.02
T1=1800.3
? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3435345
TT=1800.09
T1=51.92
OPT
f=3056260
TT=130.34
T1=57.28
SAT (TO)
f=5756438
TT=1800.09
T1=1597.86
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_0_mh_ic.opb
SAT
f=4905751
TT=1800.04
T1=1.84
No dataNo dataNo data? (TO)

TT=1800.14

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.02

SAT (TO)
f=12500686
TT=1800.11
T1=725.18
? (TO)

TT=1800.14

No dataNo data? (TO)

TT=1800.18

No data? (TO)

TT=1800.45

No dataNo dataNo dataSAT (TO)
f=5689442
TT=1800.03
T1=2.65
?

TT=1791.53

No dataSAT (TO)
f=5910068
TT=1800.01
T1=2.21
No data? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4905751
TT=1800.04
T1=1.84
SAT (TO)
f=5260668
TT=1800.02
T1=66.22
? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_1_mh_ic.opb
SAT
f=3302087
TT=1800.89
T1=45.75
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.1

SAT (TO)
f=7890866
TT=1800.09
T1=1188.16
? (TO)

TT=1800.1

No dataNo data? (TO)

TT=1800.09

No data? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=3302087
TT=1800.89
T1=45.75
?

TT=1790.19

No dataSAT (TO)
f=4400817
TT=1800.91
T1=2.03
No data? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3688233
TT=1800.83
T1=7.05
SAT (TO)
f=4531753
TT=1800.01
T1=1.52
? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_2_mh_ic.opb
SAT
f=2217982
TT=1800.17
T1=2.54
No dataNo dataNo data? (TO)

TT=1800

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.09

SAT (TO)
f=13334784
TT=1800.16
T1=35.62
? (TO)

TT=1800.13

No dataNo data? (TO)

TT=1800.09

No data? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=5936045
TT=1800.03
T1=147.8
?

TT=1791.1

No dataSAT (TO)
f=2217982
TT=1800.17
T1=2.54
No data? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=9940362
TT=1800.88
T1=3.79
SAT (TO)
f=3491895
TT=1800.06
T1=339.92
? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_3_mh_ic.opb
SAT
f=2554940
TT=1800.03
T1=4.27
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.06

SAT (TO)
f=5948007
TT=1800.07
T1=422.71
? (TO)

TT=1800.23

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.61

No dataNo dataNo dataSAT (TO)
f=2587254
TT=1800.07
T1=298.27
?

TT=1790.21

No dataSAT (TO)
f=2554940
TT=1800.03
T1=4.27
No data? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6068654
TT=1800.02
T1=48.07
SAT (TO)
f=2927692
TT=1800.02
T1=413.69
? (TO)

TT=1800.48

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_4_mh_ic.opb
SAT
f=5114454
TT=1800.17
T1=5.73
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.02

SAT (TO)
f=9392638
TT=1800.09
T1=1437.95
? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=6171664
TT=1800.14
T1=11.46
?

TT=1790.19

No dataSAT (TO)
f=5114454
TT=1800.17
T1=5.73
No data? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=14210029
TT=1800.84
T1=8.77
SAT (TO)
f=5335459
TT=1800.08
T1=531.87
? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_5_mh_ic.opb
SAT
f=4402831
TT=1800.79
T1=4.28
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.03

SAT (TO)
f=8851293
TT=1800.06
T1=37.81
? (TO)

TT=1800.14

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=5887917
TT=1800.09
T1=3.99
SAT
f=6538189
TT=1790.35
T1=1780.02
No dataSAT (TO)
f=4402831
TT=1800.79
T1=4.28
No data? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=8192053
TT=1800.67
T1=696.96
SAT (TO)
f=5715202
TT=1800.06
T1=26.85
? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_6_mh_ic.opb
SAT
f=1403187
TT=1800.17
T1=3.46
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.05

SAT (TO)
f=4357820
TT=1800.11
T1=40.57
? (TO)

TT=1800.14

No dataNo data? (TO)

TT=1800.72

No data? (TO)

TT=1800.42

No dataNo dataNo dataSAT (TO)
f=1479432
TT=1800.08
T1=2.64
SAT
f=9067421
TT=1790.25
T1=1688.93
No dataSAT (TO)
f=1403187
TT=1800.17
T1=3.46
No data? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2165024
TT=1800.14
T1=1.87
SAT (TO)
f=2142791
TT=1800.58
T1=1149.45
? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
MH+IC/
normalized-minisat25_4_7_8_mh_ic.opb
SAT
f=2961738
TT=1800.17
T1=114.22
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.06

SAT (TO)
f=5766955
TT=1800.03
T1=391.54
? (TO)

TT=1800.1

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1800.88

No dataNo dataNo dataSAT (TO)
f=2961738
TT=1800.17
T1=114.22
SAT
f=2753912
TT=1790.54
T1=1786.4
No dataSAT (TO)
f=7423449
TT=1800.03
T1=2.58
No data? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=9122571
TT=1800.04
T1=2.9
SAT (TO)
f=18281270
TT=1800.85
T1=89.53
? (TO)

TT=1800.66

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat35_4_11_0_mh_ic.opb
SAT
f=2869405
TT=1800.5
T1=18.25
No dataNo dataNo data? (problem)

TT=17.551

? (TO)

TT=1800

? (problem)

TT=16.2

? (TO)

TT=1800.09

? (problem)

TT=15.69

? (TO)

TT=1800.02

? (problem)

TT=15.77

? (TO)

TT=1800.1

SAT (TO)
f=15338192
TT=1800.14
T1=334.85
? (TO)

TT=1800.19

No dataNo data? (TO)

TT=1800.38

No data? (TO)

TT=1800.89

No dataNo dataNo dataSAT (TO)
f=2869405
TT=1800.5
T1=18.25
?

TT=1790.99

No dataSAT (TO)
f=7024836
TT=1800.21
T1=11.11
No data? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=15416719
TT=1800.61
T1=228.45
SAT (TO)
f=5544188
TT=1800.74
T1=880.57
? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat35_4_11_4_mh_ic.opb
SAT
f=5963035
TT=1800.17
T1=17.75
No dataNo dataNo data? (problem)

TT=16.667

? (TO)

TT=1800.08

? (problem)

TT=15.92

? (TO)

TT=1800.06

? (problem)

TT=16.32

? (TO)

TT=1800.02

? (problem)

TT=16.48

? (TO)

TT=1800.09

SAT (TO)
f=18272328
TT=1800.08
T1=650.37
? (TO)

TT=1800.26

No dataNo data? (TO)

TT=1800.01

No dataSAT (TO)
f=208562468
TT=1685.93
T1=990.39
No dataNo dataNo dataSAT (TO)
f=5963035
TT=1800.17
T1=17.75
?

TT=1791.1

No dataSAT (TO)
f=6299023
TT=1800.21
T1=9.59
No data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=281668098
TT=1800.07
T1=21.67
? (TO)

TT=1800.5

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat35_4_11_6_mh_ic.opb
SAT
f=3983873
TT=1800.19
T1=12.87
No dataNo dataNo data? (problem)

TT=16.693

? (TO)

TT=1800.08

? (problem)

TT=15.91

? (TO)

TT=1800.1

? (problem)

TT=16.39

? (TO)

TT=1800.02

? (problem)

TT=16.19

? (TO)

TT=1800.03

SAT (TO)
f=12972652
TT=1800.16
T1=434.69
? (TO)

TT=1800.17

No dataNo data? (TO)

TT=1800.01

No data? (TO)

TT=1674.97

No dataNo dataNo dataSAT (TO)
f=18346204
TT=1800.18
T1=37.87
?

TT=1790.85

No dataSAT (TO)
f=3983873
TT=1800.19
T1=12.87
No data? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6891206
TT=1800.43
T1=38.96
SAT (TO)
f=4592683
TT=1800.01
T1=149.55
? (TO)

TT=1800.39

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat35_4_11_7_mh_ic.opb
SAT
f=2673435
TT=1800.04
T1=799.81
No dataNo dataNo data? (problem)

TT=17.705

? (TO)

TT=1800.04

? (problem)

TT=28.221

? (TO)

TT=1800.05

? (problem)

TT=16.28

? (TO)

TT=1800.06

? (problem)

TT=16.13

? (TO)

TT=1800.1

SAT (TO)
f=17514264
TT=1800.12
T1=171.98
Signal

TT=1715.07

No dataNo data? (TO)

TT=1800.84

No data? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=3588896
TT=1801.25
T1=26.35
?

TT=1791.42

No dataSAT (TO)
f=2809421
TT=1800.83
T1=28.67
No data? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=66230726
TT=1800.71
T1=107.85
SAT (TO)
f=2673435
TT=1800.04
T1=799.81
? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat35_4_11_8_mh_ic.opb
SAT
f=7816078
TT=1800.29
T1=34.43
No dataNo dataNo data? (problem)

TT=16.757

? (TO)

TT=1800.1

? (problem)

TT=15.64

? (TO)

TT=1800.08

? (problem)

TT=15.59

? (TO)

TT=1800.04

? (problem)

TT=15.72

? (TO)

TT=1800.07

SAT (TO)
f=16902499
TT=1800.1
T1=1785.77
? (TO)

TT=1800.17

No dataNo data? (TO)

TT=1800.09

No data? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=7816078
TT=1800.29
T1=34.43
?

TT=1791.28

No dataSAT (TO)
f=11107922
TT=1800.04
T1=28.45
No data? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=11720501
TT=1800.82
T1=108.03
SAT (TO)
f=9440372
TT=1800.05
T1=1568.65
? (TO)

TT=1800

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat35_4_11_9_mh_ic.opb
SAT
f=5734377
TT=1800.07
T1=9.21
No dataNo dataNo data? (problem)

TT=17.211

? (TO)

TT=1800.08

? (problem)

TT=16.1

? (TO)

TT=1800.01

? (problem)

TT=15.58

? (TO)

TT=1800.08

? (problem)

TT=15.98

? (TO)

TT=1800.04

SAT (TO)
f=33672376
TT=1800.17
T1=131.02
? (TO)

TT=1800.21

No dataNo data? (TO)

TT=1801.03

No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=6835070
TT=1800.97
T1=15.8
?

TT=1790.99

No dataSAT (TO)
f=5734377
TT=1800.07
T1=9.21
No data? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=275426391
TT=1800.1
T1=96.03
SAT (TO)
f=7961162
TT=1800.09
T1=970.52
? (TO)

TT=1800.62

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_0_mh_ic.opb
SAT
f=3507933
TT=1801.09
T1=133.22
No dataNo dataNo data? (problem)

TT=67.241

? (TO)

TT=1800.08

? (problem)

TT=65.44

? (TO)

TT=1800.1

? (problem)

TT=64.12

? (TO)

TT=1800

? (problem)

TT=62.16

? (TO)

TT=1800.02

SAT (TO)
f=39365609
TT=1800.18
T1=286.75
Signal

TT=1451.63

No dataNo data? (TO)

TT=1800.08

No data? (TO)

TT=1801.28

No dataNo dataNo dataSAT (TO)
f=4217155
TT=1800.47
T1=551.14
?

TT=1796.15

No dataSAT (TO)
f=3507933
TT=1801.09
T1=133.22
No data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4217134
TT=1800.48
T1=28.94
? (TO)

TT=1800.08

? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_1_mh_ic.opb
SAT
f=9736335
TT=1800.46
T1=102.37
No dataNo dataNo data? (problem)

TT=68.404

? (TO)

TT=1800.01

? (problem)

TT=62.41

? (TO)

TT=1800.01

? (problem)

TT=63.55

? (TO)

TT=1800.07

? (problem)

TT=63.45

? (TO)

TT=1800.08

SAT (TO)
f=32238144
TT=1800.15
T1=216.94
Signal

TT=1526.07

No dataNo data? (TO)

TT=1800.7

No data? (TO)

TT=1801.06

No dataNo dataNo dataSAT (TO)
f=9736335
TT=1800.46
T1=102.37
?

TT=1795.51

No dataSAT (TO)
f=12682471
TT=1800.98
T1=117.66
No data? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.51

? (TO)

TT=1800.71

? (TO)

TT=1801.09

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_3_mh_ic.opb
SAT
f=3638518
TT=1800.55
T1=53.48
No dataNo dataNo data? (problem)

TT=67.032

? (TO)

TT=1800.1

? (problem)

TT=64.91

? (TO)

TT=1800.01

? (problem)

TT=66.02

? (TO)

TT=1800.07

? (problem)

TT=65.08

? (TO)

TT=1800.05

SAT (TO)
f=23466322
TT=1800.15
T1=268.6
Signal

TT=1543.07

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1801.21

No dataNo dataNo dataSAT (TO)
f=3638518
TT=1800.55
T1=60.93
?

TT=1795.49

No dataSAT (TO)
f=3638518
TT=1801.08
T1=53.48
No data? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=364083720
TT=1800.36
T1=99.13
? (TO)

TT=1800.06

? (TO)

TT=1800.92

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_4_mh_ic.opb
SAT
f=3877349
TT=1800.84
T1=18.7
No dataNo dataNo data? (problem)

TT=66.891

? (TO)

TT=1800.08

? (problem)

TT=63.58

? (TO)

TT=1800.08

? (problem)

TT=62.5

? (TO)

TT=1800.01

? (problem)

TT=64.47

? (TO)

TT=1800.07

SAT (TO)
f=32337472
TT=1800.18
T1=1700.39
Signal

TT=1425.52

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1801.04

No dataNo dataNo dataSAT (TO)
f=5261239
TT=1800.43
T1=85.62
?

TT=1798.1

No dataSAT (TO)
f=18206899
TT=1800.36
T1=201.21
No data? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.05

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3877349
TT=1800.84
T1=18.7
SAT (TO)
f=5084298
TT=1801.3
T1=18.25
? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_5_mh_ic.opb
SAT
f=4811337
TT=1800.56
T1=44.39
No dataNo dataNo data? (problem)

TT=69.502

? (TO)

TT=1800.03

? (problem)

TT=62.79

? (TO)

TT=1800.05

? (problem)

TT=64.72

? (TO)

TT=1800.02

? (problem)

TT=63.43

? (TO)

TT=1800

SAT (TO)
f=14990232
TT=1800.13
T1=431.3
Signal

TT=1438.95

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=4811337
TT=1800.56
T1=44.39
? (TO)

TT=1802.22

No dataSAT (TO)
f=19964662
TT=1800.85
T1=1038.87
No data? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=129056949
TT=1800.37
T1=196.78
SAT (TO)
f=5621118
TT=1800.39
T1=10.04
? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_6_mh_ic.opb
SAT
f=5942333
TT=1800.46
T1=45.59
No dataNo dataNo data? (problem)

TT=68.735

? (TO)

TT=1800.05

? (problem)

TT=64.89

? (TO)

TT=1800.06

? (problem)

TT=64.72

? (TO)

TT=1800.09

? (problem)

TT=64.9

? (TO)

TT=1800.03

SAT (TO)
f=22963636
TT=1800.19
T1=1354.18
Signal

TT=1561.14

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=5942333
TT=1800.46
T1=45.59
?

TT=1796.01

No dataSAT (TO)
f=15581725
TT=1800.5
T1=76.2
No data? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=37235047
TT=1800.39
T1=19.65
? (TO)

TT=1800.93

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_7_mh_ic.opb
SAT
f=6201610
TT=1801.08
T1=112.43
No dataNo dataNo data? (problem)

TT=68.145

? (TO)

TT=1800.08

? (problem)

TT=64.78

? (TO)

TT=1800.09

? (problem)

TT=64.75

? (TO)

TT=1800.01

? (problem)

TT=62.37

? (TO)

TT=1800.09

SAT (TO)
f=24035898
TT=1800.16
T1=271.62
Signal

TT=1443.58

No dataNo data? (TO)

TT=1800.08

No data? (TO)

TT=1800.8

No dataNo dataNo dataSAT (TO)
f=16913517
TT=1800.42
T1=58.7
?

TT=1794.71

No dataSAT (TO)
f=7403849
TT=1800.55
T1=88.86
No data? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6400267
TT=1800.46
T1=168.89
SAT (TO)
f=6201610
TT=1801.08
T1=112.43
? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_8_mh_ic.opb
SAT
f=4291485
TT=1800.42
T1=30.38
No dataNo dataNo data? (problem)

TT=69.312

? (TO)

TT=1800.09

? (problem)

TT=62.78

? (TO)

TT=1800.03

? (problem)

TT=65.16

? (TO)

TT=1800.1

? (problem)

TT=63.71

? (TO)

TT=1800.08

SAT (TO)
f=30528797
TT=1800.18
T1=826.58
Signal

TT=1421.43

No dataNo data? (TO)

TT=1802.85

No data? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=5166348
TT=1800.36
T1=98.78
?

TT=1796.12

No dataSAT (TO)
f=4291485
TT=1800.42
T1=30.38
No data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.09

SAT (TO)
f=5818699
TT=1800.37
T1=6.92
? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/MH+IC/
normalized-minisat50_4_16_9_mh_ic.opb
SAT
f=4628317
TT=1800.43
T1=57.49
No dataNo dataNo data? (problem)

TT=70.846

? (TO)

TT=1800.06

? (problem)

TT=62.42

? (TO)

TT=1800.01

? (problem)

TT=64.79

? (TO)

TT=1800.08

? (problem)

TT=63.46

? (TO)

TT=1800.1

SAT (TO)
f=23276352
TT=1800.16
T1=695.6
Signal

TT=1440.2

No dataNo data? (TO)

TT=1800.05

No data? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=9199501
TT=1800.62
T1=43.47
?

TT=1795.2

No dataSAT (TO)
f=4628317
TT=1800.43
T1=57.49
No data? (TO)

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=67947880
TT=1800.46
T1=16.14
? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_0_mh.opb
OPT
f=5088349
TT=3.085
T1=0.66
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.27

OPT
f=5088349
TT=1287.14
T1=1284.63
SAT (TO)
f=249543866
TT=1800.02
T1=1.47
No dataNo dataOPT
f=5088349
TT=8.482
T1=5.53
No dataOPT
f=5088349
TT=16.133
T1=10.65
No dataNo dataNo dataOPT
f=5088349
TT=16.144
T1=4.61
OPT
f=5088349
TT=21.34
T1=21.27
No dataOPT
f=5088349
TT=10.773
T1=2.05
No dataSAT (TO)
f=20154025
TT=1800.1
T1=1800.61
? (TO)

TT=1800.02

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=5088349
TT=6.352
T1=2.65
OPT
f=5088349
TT=3.085
T1=0.66
SAT (TO)
f=8913949
TT=1800.03
T1=1790
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_1_mh.opb
OPT
f=17754249
TT=47.438
T1=11.19
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.07

SAT (TO)
f=17827257
TT=1800.11
T1=1692.91
SAT (TO)
f=481704835
TT=1800.03
T1=1.39
No dataNo dataOPT
f=17754249
TT=399.71
T1=103.11
No dataOPT
f=17754249
TT=311.44
T1=244.59
No dataNo dataNo dataOPT
f=17754249
TT=996.813
T1=196.69
OPT
f=17754249
TT=130.246
T1=98.65
No dataOPT
f=17754249
TT=873.91
T1=173.08
No dataSAT (TO)
f=102574199
TT=1800.09
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=17754249
TT=99.5
T1=11.19
OPT
f=17754249
TT=47.438
T1=12.13
OPT
f=17754249
TT=519.67
T1=494.11
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_2_mh.opb
OPT
f=5950590
TT=113.64
T1=23.34
No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=6126522
TT=1800.06
T1=826.65
SAT (TO)
f=125979575
TT=1800.03
T1=1.39
No dataNo dataOPT
f=5950590
TT=1349.05
T1=1302.51
No dataOPT
f=5950590
TT=732.292
T1=539.05
No dataNo dataNo dataOPT
f=5950590
TT=1666.04
T1=402.31
OPT
f=5950590
TT=198.513
T1=174.93
No dataOPT
f=5950590
TT=1360.2
T1=467.68
No dataSAT (TO)
f=43549473
TT=1800.08
T1=1800.5
? (TO)

TT=1800.09

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=5950590
TT=167.299
T1=23.34
OPT
f=5950590
TT=113.64
T1=82.65
SAT (TO)
f=6351109
TT=1800.1
T1=1725.06
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_3_mh.opb
OPT
f=4911296
TT=29.749
T1=0.69
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.08

SAT (TO)
f=4989520
TT=1800.09
T1=1299.39
SAT (TO)
f=336835888
TT=1800.03
T1=1.41
No dataNo dataOPT
f=4911296
TT=183.38
T1=1.18
No dataOPT
f=4911296
TT=184.768
T1=0.89
No dataNo dataNo dataOPT
f=4911296
TT=581.007
T1=7.66
OPT
f=4911296
TT=16.67
T1=16.49
No dataOPT
f=4911296
TT=391.173
T1=3.9
No dataSAT (TO)
f=47559689
TT=1800.02
T1=1800.3
? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=4911296
TT=55.907
T1=4.16
OPT
f=4911296
TT=29.749
T1=0.69
OPT
f=4911296
TT=859.423
T1=852.51
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_4_mh.opb
OPT
f=3608846
TT=41.409
T1=13.45
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.08

OPT
f=3608846
TT=1286.25
T1=1000.39
SAT (TO)
f=225296428
TT=1800.03
T1=1.47
No dataNo dataOPT
f=3608846
TT=206.41
T1=65.68
No dataOPT
f=3608846
TT=41.409
T1=13.45
No dataNo dataNo dataOPT
f=3608846
TT=137.277
T1=79.13
OPT
f=3608846
TT=87.848
T1=87.49
No dataOPT
f=3608846
TT=163.479
T1=30.89
No dataSAT (TO)
f=15712616
TT=1800.04
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=3608846
TT=81.261
T1=49.81
OPT
f=3608846
TT=57.557
T1=55.7
OPT
f=3608846
TT=214.33
T1=211.95
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_5_mh.opb
OPT
f=2014265
TT=15.923
T1=4.7
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.06

OPT
f=2014265
TT=1663.16
T1=1654.2
SAT (TO)
f=227953687
TT=1800.03
T1=1.39
No dataNo dataOPT
f=2014265
TT=116.45
T1=60.86
No dataOPT
f=2014265
TT=115.24
T1=110
No dataNo dataNo dataOPT
f=2014265
TT=377.727
T1=195.9
OPT
f=2014265
TT=13.211
T1=13.13
No dataOPT
f=2014265
TT=317.796
T1=129.6
No dataSAT (TO)
f=27167940
TT=1800.09
T1=1800.71
? (TO)

TT=1800.03

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=2014265
TT=46.687
T1=16.7
OPT
f=2014265
TT=15.923
T1=4.7
OPT
f=2014265
TT=1121.03
T1=1114.63
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_6_mh.opb
OPT
f=7586846
TT=3.234
T1=0.5
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.07

OPT
f=7586846
TT=389.456
T1=389.56
SAT (TO)
f=234195480
TT=1800.01
T1=1.47
No dataNo dataOPT
f=7586846
TT=27.832
T1=18.66
No dataOPT
f=7586846
TT=30.618
T1=24.61
No dataNo dataNo dataOPT
f=7586846
TT=29.22
T1=23.74
OPT
f=7586846
TT=6.543
T1=6.48
No dataOPT
f=7586846
TT=28.843
T1=16.56
No dataSAT (TO)
f=38067031
TT=1800.02
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=7586846
TT=6.382
T1=1.09
OPT
f=7586846
TT=3.234
T1=0.5
OPT
f=7586846
TT=1191.54
T1=1185.39
No dataNo dataNo dataOPT
f=7586846
TT=1391.52
T1=1.99
? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_7_mh.opb
OPT
f=15820949
TT=105.68
T1=51.5
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.14

? (TO)

TT=1800.05

? (TO)

TT=1800.15

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.07

SAT (TO)
f=16111995
TT=1800.11
T1=1771.76
SAT (TO)
f=100106520
TT=1800.03
T1=1.47
No dataNo dataSAT (TO)
f=15839612
TT=1800.48
T1=1643.52
No dataOPT
f=15820949
TT=1507.38
T1=1179.63
No dataNo dataNo dataSAT (TO)
f=15820949
TT=1801.46
T1=489.41
OPT
f=15820949
TT=218.512
T1=206.03
No dataSAT (TO)
f=15820949
TT=1800.66
T1=261.77
No dataSAT (TO)
f=90184147
TT=1800.08
T1=1800.8
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=15820949
TT=215.369
T1=62.66
OPT
f=15820949
TT=105.68
T1=51.5
OPT
f=15820949
TT=1595.07
T1=1582.21
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_8_mh.opb
OPT
f=4415664
TT=146.43
T1=77.73
No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.14

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.08

SAT (TO)
f=6014918
TT=1800.11
T1=1780.48
SAT (TO)
f=294219267
TT=1800.03
T1=1.39
No dataNo dataOPT
f=4415664
TT=1307.8
T1=607.45
No dataOPT
f=4415664
TT=1103.86
T1=962.45
No dataNo dataNo dataSAT (TO)
f=4420770
TT=1801.26
T1=562.89
OPT
f=4415664
TT=143.335
T1=137.82
No dataSAT (TO)
f=4415664
TT=1800.12
T1=659.28
No dataSAT (TO)
f=35466565
TT=1800
T1=1800.3
? (TO)

TT=1800.1

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=4415664
TT=236.166
T1=77.73
OPT
f=4415664
TT=146.43
T1=132.83
OPT
f=4415664
TT=419.09
T1=373.82
No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat15_5_3_9_mh.opb
OPT
f=6925310
TT=41.29
T1=9.55
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.14

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800

SAT (TO)
f=7145647
TT=1800.1
T1=1330.96
SAT (TO)
f=160362853
TT=1800.03
T1=1.39
No dataNo dataOPT
f=6925310
TT=423.83
T1=230.85
No dataOPT
f=6925310
TT=189.315
T1=144.69
No dataNo dataNo dataOPT
f=6925310
TT=791.734
T1=229.11
OPT
f=6925310
TT=161.113
T1=155.49
No dataOPT
f=6925310
TT=459.874
T1=134.83
No dataSAT (TO)
f=71336677
TT=1800.03
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.25

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataOPT
f=6925310
TT=79.581
T1=24.43
OPT
f=6925310
TT=41.29
T1=9.55
SAT (TO)
f=7952348
TT=1800.1
T1=1787.54
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_0_mh.opb
SAT
f=3689644
TT=1800.11
T1=4.52
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.14

? (TO)

TT=1800.06

? (TO)

TT=1800.13

SAT (TO)
f=26363176
TT=1800.06
T1=1490.8
? (TO)

TT=1818.86

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=3715524
TT=1801.78
T1=5.79
SAT
f=3796712
TT=1790.08
T1=1709.11
No dataSAT (TO)
f=3689644
TT=1800.11
T1=4.52
No data? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3858647
TT=1800.89
T1=9.61
SAT (TO)
f=3856351
TT=1800.05
T1=89.85
? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_1_mh.opb
SAT
f=3481479
TT=1800.89
T1=3.21
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800

SAT (TO)
f=13389171
TT=1800.04
T1=1259.89
? (TO)

TT=1800.12

No dataNo data? (TO)

TT=1800.03

No dataSAT (TO)
f=365441243
TT=1800.26
T1=567.86
No dataNo dataNo dataSAT (TO)
f=3604568
TT=1801.43
T1=321.04
SAT
f=3377084
TT=1790.08
T1=1627.74
No dataSAT (TO)
f=3481479
TT=1800.89
T1=3.21
No data? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3694768
TT=1800.03
T1=112.59
SAT (TO)
f=3697825
TT=1800.1
T1=504.78
? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_2_mh.opb
SAT
f=6197734
TT=1800.2
T1=96.64
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.02

SAT (TO)
f=34024497
TT=1800.05
T1=786.63
? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.04

No data? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=6222244
TT=1800.08
T1=9.77
SAT
f=6627280
TT=1790.24
T1=1722.11
No dataSAT (TO)
f=6239301
TT=1800.77
T1=2.45
No data? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.01

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6197734
TT=1800.2
T1=96.64
SAT (TO)
f=6201603
TT=1800.1
T1=260.18
? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_3_mh.opb
SAT
f=5682452
TT=1800.16
T1=650.87
No dataNo dataNo data? (TO)

TT=1800.03

? (TO)

TT=1800.13

? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.05

SAT (TO)
f=15627897
TT=1800.06
T1=1468.85
? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.89

No data? (TO)

TT=1800.28

No dataNo dataNo dataSAT (TO)
f=5959600
TT=1800.18
T1=281.51
SAT
f=5210373
TT=1790.18
T1=1181.1
No dataSAT (TO)
f=6025461
TT=1800.12
T1=4.03
No data? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5682452
TT=1800.16
T1=650.87
SAT (TO)
f=5968523
TT=1800.58
T1=1559.53
? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_4_mh.opb
SAT
f=4066318
TT=1800.06
T1=135.76
No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.04

SAT (TO)
f=17543103
TT=1800.12
T1=1773.39
? (TO)

TT=1800.05

No dataNo dataSAT (TO)
f=4152082
TT=1800.54
T1=1.51
No dataSAT (TO)
f=4187044
TT=1800.94
T1=1.4
No dataNo dataNo dataSAT (TO)
f=4101527
TT=1800.64
T1=6.04
SAT
f=4217294
TT=1790.69
T1=1596.95
No dataSAT (TO)
f=4091568
TT=1800.02
T1=72.38
No data? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.03

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4070314
TT=1800.18
T1=26.9
SAT (TO)
f=4066318
TT=1800.06
T1=135.76
? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_5_mh.opb
SAT
f=6311552
TT=1800.63
T1=483.42
No dataNo dataNo data? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

SAT (TO)
f=66773063
TT=1800.11
T1=1572.43
? (TO)

TT=1800.12

No dataNo data? (TO)

TT=1800.06

No data? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=6322985
TT=1801.79
T1=5.47
SAT
f=5833066
TT=1790.06
T1=1484.36
No dataSAT (TO)
f=6322985
TT=1800.2
T1=4.51
No data? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6311552
TT=1800.63
T1=483.42
SAT (TO)
f=6313128
TT=1800.05
T1=994.36
? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_6_mh.opb
SAT
f=5637187
TT=1800.02
T1=306.75
No dataNo dataNo data? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.13

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.05

SAT (TO)
f=21161055
TT=1800.07
T1=1644.86
? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.8

No dataNo dataNo dataSAT (TO)
f=5644129
TT=1800.81
T1=124.1
SAT
f=5687138
TT=1790.21
T1=1365.52
No dataSAT (TO)
f=5637187
TT=1800.02
T1=306.75
No data? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5650088
TT=1800.03
T1=42.82
SAT (TO)
f=5675195
TT=1800.75
T1=1.05
? (TO)

TT=1800.75

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_7_mh.opb
SAT
f=7664353
TT=1800.64
T1=140.99
No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.11

SAT (TO)
f=26001099
TT=1800.06
T1=1691.95
? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.77

No data? (TO)

TT=1800

No dataNo dataNo dataSAT (TO)
f=7797347
TT=1801.86
T1=5.99
SAT
f=7705712
TT=1790.1
T1=949.95
No dataSAT (TO)
f=8502529
TT=1800.14
T1=1.82
No data? (TO)

TT=1800

? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=7664353
TT=1800.64
T1=140.99
SAT (TO)
f=7691175
TT=1800.02
T1=12.29
? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_8_mh.opb
SAT
f=7759662
TT=1800.54
T1=1.71
No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.01

SAT (TO)
f=24203418
TT=1800.14
T1=337.51
? (TO)

TT=1800.07

No dataNo data? (TO)

TT=1800.02

No data? (TO)

TT=1800.45

No dataNo dataNo dataSAT (TO)
f=7759662
TT=1800.54
T1=2.22
SAT
f=11306065
TT=1790.29
T1=1556.54
No dataSAT (TO)
f=7759662
TT=1800.8
T1=1.71
No data? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=7781067
TT=1800.2
T1=518.01
SAT (TO)
f=7781657
TT=1800.01
T1=1006.9
? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat25_6_4_9_mh.opb
SAT
f=2596841
TT=1800.37
T1=269.17
No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.06

SAT (TO)
f=12325827
TT=1800.07
T1=1740.27
? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.39

No data? (TO)

TT=1800.98

No dataNo dataNo dataSAT (TO)
f=2596841
TT=1800.37
T1=269.17
SAT
f=2803853
TT=1790.18
T1=1470.95
No dataSAT (TO)
f=2618986
TT=1800.11
T1=91.88
No data? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2629719
TT=1800.2
T1=59.1
SAT (TO)
f=2674740
TT=1800.03
T1=1.22
? (TO)

TT=1800.78

No dataNo dataNo data? (TO)

TT=1800.01

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_0_mh.opb
SAT
f=4664822
TT=1800.89
T1=20.18
No dataNo dataNo data? (problem)

TT=35.739

? (TO)

TT=1800.06

? (problem)

TT=33.97

? (TO)

TT=1800.09

? (problem)

TT=34.7

? (TO)

TT=1800.04

? (problem)

TT=33.24

? (TO)

TT=1800.04

SAT (TO)
f=42968412
TT=1800.18
T1=1494.67
Signal

TT=1392.7

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=4664822
TT=1801.61
T1=22.53
?

TT=1793.68

No dataSAT (TO)
f=4664822
TT=1800.89
T1=20.18
No data? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4769902
TT=1800.99
T1=40.85
? (TO)

TT=1800.1

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_1_mh.opb
SAT
f=2952569
TT=1800.98
T1=38.83
No dataNo dataNo data? (problem)

TT=36.023

? (TO)

TT=1800.09

? (problem)

TT=33.86

? (TO)

TT=1800.02

? (problem)

TT=34.73

? (TO)

TT=1800.08

? (problem)

TT=34.304

? (TO)

TT=1800.07

SAT (TO)
f=41014451
TT=1800.12
T1=452.36
Signal

TT=1357.54

No dataNo data? (TO)

TT=1800.03

No data? (TO)

TT=1800.84

No dataNo dataNo dataSAT (TO)
f=3001125
TT=1801.1
T1=35.72
?

TT=1794.43

No dataSAT (TO)
f=2952569
TT=1800.98
T1=38.83
No data? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=308676909
TT=1800.69
T1=501.36
? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.03

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_2_mh.opb
SAT
f=5500107
TT=1801
T1=28.2
No dataNo dataNo data? (problem)

TT=35.968

? (TO)

TT=1800.09

? (problem)

TT=35.08

? (TO)

TT=1800.03

? (problem)

TT=34.74

? (TO)

TT=1800.01

? (problem)

TT=34.42

? (TO)

TT=1800

SAT (TO)
f=38670696
TT=1800.15
T1=953.03
Signal

TT=1373.71

No dataNo data? (TO)

TT=1800.07

No data? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=6220515
TT=1801.99
T1=54.35
?

TT=1793.72

No dataSAT (TO)
f=5500107
TT=1801
T1=28.2
No data? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=5836767
TT=1800.53
T1=562.34
? (TO)

TT=1800.06

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_3_mh.opb
SAT
f=3903525
TT=1801.36
T1=11.45
No dataNo dataNo data? (problem)

TT=37.151

? (TO)

TT=1800.07

? (problem)

TT=34.45

? (TO)

TT=1800.1

? (problem)

TT=33.48

? (TO)

TT=1800.09

? (problem)

TT=33.55

? (TO)

TT=1800.05

SAT (TO)
f=85906774
TT=1800.09
T1=357.37
Signal

TT=1373.92

No dataNo data? (TO)

TT=1800.08

No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=99201018
TT=1801.35
T1=51.41
? (TO)

TT=1802.11

No dataSAT (TO)
f=4531392
TT=1800.5
T1=23.59
No data? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=3903525
TT=1801.36
T1=11.45
SAT (TO)
f=4166423
TT=1800.39
T1=7.72
? (TO)

TT=1800.87

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_4_mh.opb
SAT
f=3385478
TT=1800.42
T1=20.47
No dataNo dataNo data? (problem)

TT=35.828

? (TO)

TT=1800.08

? (problem)

TT=33.88

? (TO)

TT=1800.08

? (problem)

TT=34.34

? (TO)

TT=1800.04

? (problem)

TT=34.62

? (TO)

TT=1800.06

SAT (TO)
f=21071687
TT=1800.15
T1=1463.18
Signal

TT=1484.73

No dataNo data? (TO)

TT=1801.04

No data? (TO)

TT=1800

No dataNo dataNo dataSAT (TO)
f=3432285
TT=1801.07
T1=21.79
?

TT=1794

No dataSAT (TO)
f=3385478
TT=1800.42
T1=20.47
No data? (TO)

TT=1800.08

? (TO)

TT=1800.11

? (TO)

TT=1800.06

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4412935
TT=1800.74
T1=736.74
? (TO)

TT=1800.68

? (TO)

TT=1800.96

No dataNo dataNo data? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_5_mh.opb
SAT
f=4357880
TT=1800.32
T1=8.86
No dataNo dataNo data? (problem)

TT=35.909

? (TO)

TT=1800

? (problem)

TT=34.15

? (TO)

TT=1800.02

? (problem)

TT=33.43

? (TO)

TT=1800.02

? (problem)

TT=33.38

? (TO)

TT=1800.02

SAT (TO)
f=56482067
TT=1800.16
T1=276.56
Signal

TT=1635.86

No dataNo data? (TO)

TT=1801.06

No data? (TO)

TT=1801.28

No dataNo dataNo dataSAT (TO)
f=4948052
TT=1800.78
T1=25.81
?

TT=1794.8

No dataSAT (TO)
f=6050262
TT=1801
T1=22.61
No data? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=6663759
TT=1800.63
T1=500.71
SAT (TO)
f=4357880
TT=1800.32
T1=8.86
? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.09

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_6_mh.opb
SAT
f=4276416
TT=1800.02
T1=941.47
No dataNo dataNo data? (problem)

TT=36.097

? (TO)

TT=1800.02

? (problem)

TT=34.5

? (TO)

TT=1800.02

? (problem)

TT=34.72

? (TO)

TT=1800.06

? (problem)

TT=34.94

? (TO)

TT=1800.06

SAT (TO)
f=37770961
TT=1800.15
T1=735.81
Signal

TT=1408.94

No dataNo data? (TO)

TT=1800.05

No data? (TO)

TT=1801.17

No dataNo dataNo dataSAT (TO)
f=4276416
TT=1800.02
T1=941.47
?

TT=1794.68

No dataSAT (TO)
f=22555388
TT=1800.52
T1=883.03
No data? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.12

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=4550100
TT=1800.54
T1=11.32
SAT (TO)
f=4616155
TT=1800.3
T1=1767.53
? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_7_mh.opb
SAT
f=5332944
TT=1800.37
T1=38.05
No dataNo dataNo data? (problem)

TT=37.128

? (TO)

TT=1800.04

? (problem)

TT=33.62

? (TO)

TT=1800.03

? (problem)

TT=33.45

? (TO)

TT=1800.03

? (problem)

TT=33.82

? (TO)

TT=1800.09

SAT (TO)
f=142075324
TT=1800.15
T1=779.09
Signal

TT=1637.65

No dataNo data? (TO)

TT=1800.05

No data? (TO)

TT=1800.19

No dataNo dataNo dataSAT (TO)
f=5332944
TT=1800.37
T1=38.05
?

TT=1793.78

No dataSAT (TO)
f=5350268
TT=1800.43
T1=21.96
No data? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.66

? (TO)

TT=1800.1

? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo dataNo data
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_8_mh.opb
SAT
f=2441959
TT=1800.98
T1=19.62
No dataNo dataNo data? (problem)

TT=35.925

? (TO)

TT=1800.01

? (problem)

TT=34.39

? (TO)

TT=1800.06

? (problem)

TT=34.43

? (TO)

TT=1800.1

? (problem)

TT=33.55

? (TO)

TT=1800.11

SAT (TO)
f=29271348
TT=1800.12
T1=590.17
Signal

TT=1344.3

No dataNo data? (TO)

TT=1800.82

No data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=2441959
TT=1801.05
T1=20.67
?

TT=1793.99

No dataSAT (TO)
f=2441959
TT=1800.98
T1=19.62
No data? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataSAT (TO)
f=2458141
TT=1800.45
T1=5.77
SAT (TO)
f=2458141
TT=1801.24
T1=4.36
? (TO)

TT=1801.12

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.02

No dataNo dataNo dataNo data
/OPT-BIGINT-LIN/zahidi/
Multihop/
normalized-minisat50_6_9_9_mh.opb
SAT
f=5617829
TT=1801.07
T1=76.56
No dataNo dataNo data? (problem)

TT=35.779

? (TO)

TT=1800.01

? (problem)

TT=33.56

? (TO)

TT=1800.08

? (problem)

TT=34.77

? (TO)

TT=1800.08

? (problem)

TT=34.62

? (TO)

TT=1800.01

SAT (TO)
f=87423615
TT=1800.12
T1=1115.22
Signal

TT=1738.38

No dataNo data? (TO)

TT=1800

No data? (TO)

TT=1800.82

No dataNo dataNo dataSAT (TO)
f=5617829
TT=1801.07
T1=76.56
?

TT=1794.37

No dataSAT (TO)
f=5638801
TT=1800.38
T1=21.35
No data? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.11

No dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo dataNo data? (TO)

TT=1800.78

? (TO)

TT=1800.85

? (TO)

TT=1800.01

No dataNo dataNo data? (TO)

TT=1800.06

? (TO)

TT=1800.07

No dataNo dataNo dataNo data
/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-10000opt.opb
OPT
f=-164
TT=7.548
T1=2.32
OPT
f=-164
TT=330.111
T1=19.34
No dataOPT
f=-164
TT=7.548
T1=2.32
OPT
f=-164
TT=21.781
T1=21.78
OPT
f=-164
TT=22.177
T1=22.17
OPT
f=-164
TT=22.998
T1=23.02
OPT
f=-164
TT=22.622
T1=22.62
OPT
f=-164
TT=21.351
T1=16.08
OPT
f=-164
TT=20.737
T1=15.8
OPT
f=-164
TT=21.676
T1=16.33
OPT
f=-164
TT=21.595
T1=16.25
OPT
f=-164
TT=497.695
T1=6.66
OPT
f=-164
TT=22.383
T1=11.38
? (TO)

TT=1800.21

OPT
f=-164
TT=132.488
T1=132.51
OPT
f=-164
TT=318.79
T1=20.65
OPT
f=-164
TT=518.085
T1=21.83
OPT
f=-164
TT=40.479
T1=6.61
SAT
f=-40
TT=1793.45
T1=1793.66
No dataSAT
f=-116
TT=1798.95
T1=1799.22
OPT
f=-164
TT=23.43
T1=15.72
SAT
f=-40
TT=1789.89
T1=167.45
No dataOPT
f=-164
TT=19.471
T1=11.74
? (TO)

TT=1802.02

OPT
f=-164
TT=26.917
T1=26.92
OPT
f=-164
TT=16.708
T1=12.36
OPT
f=-164
TT=35.532
T1=31.29
No dataNo dataNo dataOPT
f=-164
TT=148.151
T1=74.18
No dataNo dataOPT
f=-164
TT=170.19
T1=85.21
No dataNo dataNo dataOPT
f=-164
TT=28.641
T1=14.7
OPT
f=-164
TT=46.761
T1=43.99
OPT
f=-164
TT=11.971
T1=9.23
SAT
f=-45
TT=1796.88
T1=78.69
SAT
f=-45
TT=1796.92
T1=80.45
SAT
f=-45
TT=1797.1
T1=96.2
OPT
f=-164
TT=379.371
T1=322.35
OPT
f=-164
TT=329.144
T1=278.26
?

TT=1799.55

No dataNo data?

TT=1799.9

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-1000opt.opb
OPT
f=-178
TT=3.605
T1=2.42
OPT
f=-178
TT=115.244
T1=36.24
No dataOPT
f=-178
TT=3.605
T1=2.94
OPT
f=-178
TT=11.781
T1=11.78
OPT
f=-178
TT=11.623
T1=11.61
OPT
f=-178
TT=8.586
T1=8.59
OPT
f=-178
TT=8.711
T1=8.71
OPT
f=-178
TT=17.481
T1=15.02
OPT
f=-178
TT=17.55
T1=15.09
OPT
f=-178
TT=18.03
T1=15.59
OPT
f=-178
TT=17.241
T1=14.96
OPT
f=-178
TT=118.24
T1=93.67
OPT
f=-178
TT=7.061
T1=2.42
? (TO)

TT=1800.08

OPT
f=-178
TT=70.075
T1=70.09
OPT
f=-178
TT=123.93
T1=122.1
OPT
f=-178
TT=94.865
T1=26.85
OPT
f=-178
TT=19.471
T1=14.9
SAT
f=-42
TT=1793.41
T1=1793.59
No dataSAT
f=-117
TT=1798.81
T1=1799.08
OPT
f=-178
TT=11.503
T1=11.72
SAT
f=-46
TT=1789.89
T1=399.16
No dataOPT
f=-178
TT=10.082
T1=5.21
? (TO)

TT=1802.02

OPT
f=-178
TT=4.899
T1=4.89
OPT
f=-178
TT=9.617
T1=7.77
OPT
f=-178
TT=20.775
T1=18.95
No dataNo dataNo dataOPT
f=-178
TT=49.64
T1=24.89
No dataNo dataOPT
f=-178
TT=75.19
T1=37.77
No dataNo dataNo dataSAT (TO)
f=-172
TT=1800.1
T1=18.03
OPT
f=-178
TT=44.93
T1=40.46
OPT
f=-178
TT=9.452
T1=7.88
SAT
f=-39
TT=1796.9
T1=154.24
SAT
f=-39
TT=1796.92
T1=160.91
SAT
f=-39
TT=1796.91
T1=132.96
OPT
f=-178
TT=757.163
T1=753.83
OPT
f=-178
TT=873.46
T1=869.98
?

TT=1799.53

No dataNo data?

TT=1799.83

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-2000opt.opb
OPT
f=-167
TT=11.875
T1=5.26
OPT
f=-167
TT=679.565
T1=27.19
No dataOPT
f=-167
TT=11.875
T1=5.26
OPT
f=-167
TT=32.785
T1=32.89
OPT
f=-167
TT=32.974
T1=32.96
OPT
f=-167
TT=26.911
T1=26.99
OPT
f=-167
TT=27.306
T1=27.33
OPT
f=-167
TT=40.431
T1=29.04
OPT
f=-167
TT=40.07
T1=28.33
OPT
f=-167
TT=40.794
T1=29.48
OPT
f=-167
TT=40.077
T1=28.47
OPT
f=-167
TT=943.044
T1=3.88
OPT
f=-167
TT=24.567
T1=8.82
? (TO)

TT=1554.52

OPT
f=-167
TT=239.572
T1=239.62
OPT
f=-167
TT=1319.3
T1=636.46
OPT
f=-167
TT=719.515
T1=231.74
OPT
f=-167
TT=128.096
T1=78.01
SAT
f=-42
TT=1793.43
T1=1793.58
No dataSAT
f=-130
TT=1798.94
T1=1799.22
OPT
f=-167
TT=24.799
T1=13.71
SAT
f=-39
TT=1789.89
T1=292.56
No dataOPT
f=-167
TT=23.429
T1=9.71
? (TO)

TT=1802.02

OPT
f=-167
TT=19.056
T1=19.06
OPT
f=-167
TT=24.768
T1=20.18
OPT
f=-167
TT=46.578
T1=41.95
No dataNo dataNo dataOPT
f=-167
TT=129.864
T1=65.03
No dataNo dataOPT
f=-167
TT=190.133
T1=95.14
No dataNo dataNo dataOPT
f=-167
TT=46.926
T1=27.73
OPT
f=-167
TT=108.98
T1=87.57
OPT
f=-167
TT=18.051
T1=13.72
SAT
f=-42
TT=1796.93
T1=427.5
SAT
f=-42
TT=1796.97
T1=375.07
SAT
f=-42
TT=1796.94
T1=373.45
OPT
f=-167
TT=650.307
T1=578.69
OPT
f=-167
TT=627.977
T1=556.95
?

TT=1799.96

No dataNo data?

TT=1799.59

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-3000opt.opb
OPT
f=-187
TT=12.052
T1=3.22
OPT
f=-187
TT=347.23
T1=7.45
No dataOPT
f=-187
TT=12.052
T1=5.08
OPT
f=-187
TT=22.5
T1=22.51
OPT
f=-187
TT=28.412
T1=23.35
OPT
f=-187
TT=25.426
T1=25.43
OPT
f=-187
TT=24.419
T1=24.44
OPT
f=-187
TT=35.644
T1=33.58
OPT
f=-187
TT=33.414
T1=31.62
OPT
f=-187
TT=35.751
T1=33.6
OPT
f=-187
TT=35.39
T1=33.3
OPT
f=-187
TT=419.908
T1=18.47
OPT
f=-187
TT=16.124
T1=4.92
? (TO)

TT=1800.05

OPT
f=-187
TT=193.19
T1=193.23
OPT
f=-187
TT=713.37
T1=292.6
OPT
f=-187
TT=263.169
T1=91.12
OPT
f=-187
TT=138.04
T1=111.72
SAT
f=-46
TT=1793.67
T1=1793.81
No dataSAT
f=-146
TT=1798.97
T1=1799.25
OPT
f=-187
TT=29.359
T1=17.72
SAT
f=-47
TT=1789.75
T1=333.34
No dataOPT
f=-187
TT=24.919
T1=3.22
? (TO)

TT=1802.03

OPT
f=-187
TT=13.385
T1=13.39
OPT
f=-187
TT=18.927
T1=18.93
OPT
f=-187
TT=40.352
T1=36.16
No dataNo dataNo dataOPT
f=-187
TT=243.78
T1=122.06
No dataNo dataOPT
f=-187
TT=152.18
T1=76.21
No dataNo dataNo dataSAT (TO)
f=-173
TT=1800.01
T1=25.21
OPT
f=-187
TT=180.987
T1=165.82
OPT
f=-187
TT=15.142
T1=6.16
SAT
f=-46
TT=1796.89
T1=236.4
SAT
f=-46
TT=1796.92
T1=278.1
SAT
f=-46
TT=1796.9
T1=239.41
OPT
f=-187
TT=850.316
T1=836.65
OPT
f=-187
TT=988.874
T1=973.71
?

TT=1799.54

No dataNo data?

TT=1799.36

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-4000opt.opb
OPT
f=-164
TT=6.559
T1=0.6
OPT
f=-164
TT=825.679
T1=89.19
No dataOPT
f=-164
TT=6.559
T1=0.6
OPT
f=-164
TT=26.816
T1=26.94
OPT
f=-164
TT=26.756
T1=26.76
OPT
f=-164
TT=22.057
T1=22.06
OPT
f=-164
TT=21.285
T1=21.29
OPT
f=-164
TT=30.598
T1=28.16
OPT
f=-164
TT=30.655
T1=28.14
OPT
f=-164
TT=30.637
T1=28.26
OPT
f=-164
TT=32.59
T1=29.94
OPT
f=-164
TT=647.139
T1=305.49
OPT
f=-164
TT=18.352
T1=9.48
? (TO)

TT=1800.11

OPT
f=-164
TT=261.378
T1=261.43
OPT
f=-164
TT=431.418
T1=1.39
OPT
f=-164
TT=646.143
T1=83.81
OPT
f=-164
TT=71.324
T1=34.34
SAT
f=-37
TT=1793.27
T1=1793.45
No data? (TO)

TT=1800.11

OPT
f=-164
TT=24.12
T1=17.76
SAT
f=-51
TT=1790.05
T1=284.07
No dataOPT
f=-164
TT=20.64
T1=5.73
SAT
f=-48
TT=1796.9
T1=510.59
OPT
f=-164
TT=15.07
T1=15.06
OPT
f=-164
TT=19.298
T1=19.3
OPT
f=-164
TT=53.98
T1=49.64
No dataNo dataNo dataOPT
f=-164
TT=175.162
T1=87.68
No dataNo dataOPT
f=-164
TT=305.07
T1=152.74
No dataNo dataNo dataOPT
f=-164
TT=42.718
T1=24.03
OPT
f=-164
TT=96.47
T1=55.43
OPT
f=-164
TT=17.042
T1=15.02
SAT
f=-43
TT=1797.09
T1=26.2
SAT
f=-43
TT=1796.98
T1=27.1
SAT
f=-43
TT=1796.91
T1=23.63
OPT
f=-164
TT=616.202
T1=523.44
OPT
f=-164
TT=728.193
T1=623.45
?

TT=1799.55

No dataNo data?

TT=1799.88

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-5000opt.opb
OPT
f=-169
TT=7.951
T1=7.9
OPT
f=-169
TT=351.07
T1=108.92
No dataOPT
f=-169
TT=7.951
T1=7.9
OPT
f=-169
TT=21.539
T1=21.53
OPT
f=-169
TT=21.588
T1=21.78
OPT
f=-169
TT=14.909
T1=15.06
OPT
f=-169
TT=14.919
T1=14.91
OPT
f=-169
TT=25.491
T1=22.11
OPT
f=-169
TT=26.458
T1=23
OPT
f=-169
TT=27.529
T1=23.95
OPT
f=-169
TT=26.176
T1=22.75
OPT
f=-169
TT=341.092
T1=33.94
OPT
f=-169
TT=19.505
T1=16.01
? (TO)

TT=1800.12

OPT
f=-169
TT=159.803
T1=159.84
OPT
f=-169
TT=389.17
T1=162.65
OPT
f=-169
TT=338.338
T1=22.27
OPT
f=-169
TT=74.693
T1=55.48
SAT
f=-36
TT=1793.2
T1=1793.4
No dataSAT
f=-126
TT=1798.91
T1=1799.19
OPT
f=-169
TT=21.201
T1=20.88
SAT
f=-51
TT=1789.94
T1=367.09
No dataOPT
f=-169
TT=18.044
T1=9.25
SAT
f=-47
TT=1796.9
T1=351.24
OPT
f=-169
TT=14.414
T1=14.42
OPT
f=-169
TT=19.776
T1=19.81
OPT
f=-169
TT=43.174
T1=39.57
No dataNo dataNo dataOPT
f=-169
TT=74.685
T1=37.42
No dataNo dataOPT
f=-169
TT=67
T1=33.63
No dataNo dataNo dataSAT (TO)
f=-165
TT=1800.86
T1=18.89
OPT
f=-169
TT=83.72
T1=60.65
OPT
f=-169
TT=12.842
T1=10.56
SAT
f=-47
TT=1797.05
T1=365.1
SAT
f=-47
TT=1796.9
T1=338.62
SAT
f=-47
TT=1796.93
T1=409.65
OPT
f=-169
TT=508.553
T1=480.14
OPT
f=-169
TT=506.196
T1=478.29
?

TT=1799.47

No dataNo data?

TT=1799.91

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-6000opt.opb
OPT
f=-175
TT=11.317
T1=4.29
OPT
f=-175
TT=526.204
T1=19.99
No dataOPT
f=-175
TT=11.317
T1=4.29
OPT
f=-175
TT=17.908
T1=17.91
OPT
f=-175
TT=17.318
T1=17.31
OPT
f=-175
TT=21.47
T1=21.46
OPT
f=-175
TT=22.14
T1=22.13
OPT
f=-175
TT=25.742
T1=21.36
OPT
f=-175
TT=25.389
T1=20.96
OPT
f=-175
TT=27.347
T1=22.7
OPT
f=-175
TT=27.294
T1=22.54
OPT
f=-175
TT=652.515
T1=67.28
OPT
f=-175
TT=19.607
T1=9.53
? (TO)

TT=1800.17

OPT
f=-175
TT=319.574
T1=319.64
OPT
f=-175
TT=804.951
T1=91.61
OPT
f=-175
TT=607.511
T1=75.84
OPT
f=-175
TT=109.06
T1=81.37
SAT
f=-51
TT=1794.05
T1=1794.21
No dataSAT
f=-126
TT=1798.96
T1=1799.24
OPT
f=-175
TT=19.991
T1=9.74
SAT
f=-49
TT=1791.83
T1=300.98
No dataOPT
f=-175
TT=18.651
T1=9.75
? (TO)

TT=1802.02

OPT
f=-175
TT=15.565
T1=15.56
OPT
f=-175
TT=16.328
T1=16.33
OPT
f=-175
TT=39.435
T1=35.04
No dataNo dataNo dataOPT
f=-175
TT=171.047
T1=85.59
No dataNo dataOPT
f=-175
TT=195.323
T1=97.78
No dataNo dataNo dataSAT (TO)
f=-170
TT=1801.07
T1=453.36
OPT
f=-175
TT=153.541
T1=148.2
OPT
f=-175
TT=15.161
T1=11.58
SAT
f=-54
TT=1796.95
T1=168.67
SAT
f=-54
TT=1796.99
T1=142.9
SAT
f=-54
TT=1796.89
T1=144.49
OPT
f=-175
TT=671.387
T1=638.34
OPT
f=-175
TT=694.989
T1=662.34
?

TT=1799.52

No dataNo data?

TT=1799.95

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-7000opt.opb
OPT
f=-172
TT=20.842
T1=15.31
OPT
f=-172
TT=412.156
T1=148.85
No dataOPT
f=-172
TT=20.842
T1=20
OPT
f=-172
TT=21.625
T1=15.63
OPT
f=-172
TT=22.03
T1=15.95
OPT
f=-172
TT=32.965
T1=31.04
OPT
f=-172
TT=31.85
T1=29.79
OPT
f=-172
TT=45.345
T1=41.59
OPT
f=-172
TT=46.778
T1=42.88
OPT
f=-172
TT=48.768
T1=44.5
OPT
f=-172
TT=48.986
T1=44.67
OPT
f=-172
TT=617.537
T1=411.89
OPT
f=-172
TT=21.506
T1=15.31
? (TO)

TT=1800.11

OPT
f=-172
TT=276.217
T1=276.29
OPT
f=-172
TT=1233.49
T1=1081.29
OPT
f=-172
TT=437.233
T1=115.16
OPT
f=-172
TT=178.927
T1=169.82
SAT
f=-46
TT=1793.57
T1=1793.72
No dataSAT
f=-92
TT=1799.12
T1=1799.4
OPT
f=-172
TT=56.816
T1=39.87
SAT
f=-49
TT=1790.06
T1=450.93
No dataOPT
f=-172
TT=36.597
T1=23.44
SAT
f=-49
TT=1796.86
T1=515.29
OPT
f=-172
TT=37.101
T1=37.1
OPT
f=-172
TT=34.019
T1=28.89
OPT
f=-172
TT=69.137
T1=64.04
No dataNo dataNo dataOPT
f=-172
TT=245.58
T1=122.98
No dataNo dataOPT
f=-172
TT=192.13
T1=96.22
No dataNo dataNo dataSAT (TO)
f=-167
TT=1800.43
T1=42.29
OPT
f=-172
TT=225.65
T1=216.48
OPT
f=-172
TT=30.549
T1=28.59
SAT
f=-45
TT=1796.95
T1=168.02
SAT
f=-45
TT=1797.01
T1=144.99
SAT
f=-45
TT=1796.94
T1=170.92
OPT
f=-172
TT=1490.34
T1=1459.17
OPT
f=-172
TT=1478.76
T1=1447.59
?

TT=1799.44

No dataNo data?

TT=1799.5

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-8000opt.opb
OPT
f=-162
TT=42.056
T1=34.87
SAT
f=-162
TT=1798.01
T1=819.18
No dataOPT
f=-162
TT=42.056
T1=40.97
OPT
f=-162
TT=97.856
T1=97.87
OPT
f=-162
TT=98.298
T1=98.31
OPT
f=-162
TT=68.233
T1=68.25
OPT
f=-162
TT=66.757
T1=66.78
OPT
f=-162
TT=95.556
T1=90.53
OPT
f=-162
TT=101.538
T1=96.03
OPT
f=-162
TT=102.539
T1=97.23
OPT
f=-162
TT=98.947
T1=93.73
SAT (TO)
f=-161
TT=1800.07
T1=113.41
OPT
f=-162
TT=168.71
T1=139.27
? (TO)

TT=1800.09

OPT
f=-162
TT=1102.96
T1=1103.16
SAT (TO)
f=-162
TT=1800.53
T1=1562.17
SAT
f=-162
TT=1798
T1=342.34
OPT
f=-162
TT=537.59
T1=54.58
SAT
f=-47
TT=1793.5
T1=1793.67
No dataSAT
f=-96
TT=1799.02
T1=1799.29
OPT
f=-162
TT=109.263
T1=68.9
SAT
f=-52
TT=1789.9
T1=424.82
No dataOPT
f=-162
TT=72.583
T1=34.87
SAT
f=-47
TT=1796.88
T1=389.14
OPT
f=-162
TT=92.96
T1=92.96
OPT
f=-162
TT=72.073
T1=47.82
OPT
f=-162
TT=90.908
T1=66.88
No dataNo dataNo dataSAT (TO)
f=-162
TT=1800.58
T1=900.41
No dataNo dataSAT (TO)
f=-158
TT=1800.14
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-154
TT=1800.53
T1=906.78
OPT
f=-162
TT=699.14
T1=690.94
OPT
f=-162
TT=40.847
T1=25.28
SAT
f=-41
TT=1797
T1=138.31
SAT
f=-41
TT=1796.98
T1=140.93
SAT
f=-41
TT=1796.98
T1=139.18
? (TO)

TT=1800.06

? (TO)

TT=1800.06

?

TT=1799.51

No dataNo data?

TT=1799.49

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-250-false-45-90-4-9000opt.opb
OPT
f=-193
TT=3.79
T1=2.38
OPT
f=-193
TT=136.404
T1=110.95
No dataOPT
f=-193
TT=3.79
T1=2.38
OPT
f=-193
TT=9.43
T1=7.61
OPT
f=-193
TT=9.499
T1=7.55
OPT
f=-193
TT=8.414
T1=6.93
OPT
f=-193
TT=8.497
T1=6.93
OPT
f=-193
TT=15.07
T1=13.2
OPT
f=-193
TT=14.565
T1=12.74
OPT
f=-193
TT=15.461
T1=13.71
OPT
f=-193
TT=16.131
T1=14.27
OPT
f=-193
TT=166.36
T1=41.86
OPT
f=-193
TT=16.75
T1=13.51
? (TO)

TT=1800.08

OPT
f=-193
TT=67.692
T1=67.69
OPT
f=-193
TT=212.66
T1=140.31
OPT
f=-193
TT=145.424
T1=110.38
OPT
f=-193
TT=33.26
T1=28.77
SAT
f=-42
TT=1793.41
T1=1793.58
No dataSAT
f=-140
TT=1799
T1=1799.28
OPT
f=-193
TT=15.222
T1=11.74
SAT
f=-50
TT=1789.97
T1=366.08
No dataOPT
f=-193
TT=14.492
T1=8.2
? (TO)

TT=1802.12

OPT
f=-193
TT=12.028
T1=12.02
OPT
f=-193
TT=8.675
T1=8.68
OPT
f=-193
TT=19.735
T1=18.23
No dataNo dataNo dataOPT
f=-193
TT=132.538
T1=66.38
No dataNo dataOPT
f=-193
TT=91.15
T1=45.74
No dataNo dataNo dataSAT (TO)
f=-183
TT=1800.45
T1=20.58
OPT
f=-193
TT=71.494
T1=55.25
OPT
f=-193
TT=13.113
T1=10.37
SAT
f=-48
TT=1796.87
T1=147.8
SAT
f=-48
TT=1796.91
T1=143.57
SAT
f=-48
TT=1796.94
T1=151.58
OPT
f=-193
TT=1035.35
T1=1031.13
OPT
f=-193
TT=1045.78
T1=1041.46
?

TT=1799.47

No dataNo data?

TT=1799.56

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-10000opt.opb
OPT
f=-75
TT=1.158
T1=0.39
OPT
f=-75
TT=11.319
T1=1.86
No dataOPT
f=-75
TT=1.158
T1=0.39
OPT
f=-75
TT=23.7
T1=6.57
OPT
f=-75
TT=11.918
T1=6.58
OPT
f=-75
TT=12.07
T1=5.44
OPT
f=-75
TT=12.092
T1=5.57
OPT
f=-75
TT=8.328
T1=7.36
OPT
f=-75
TT=8.342
T1=7.4
OPT
f=-75
TT=8.78
T1=7.77
OPT
f=-75
TT=8.265
T1=7.33
OPT
f=-75
TT=6.964
T1=3.71
OPT
f=-75
TT=8.707
T1=5.38
? (TO)

TT=1800.15

OPT
f=-75
TT=11.701
T1=11.7
OPT
f=-75
TT=11.022
T1=4.32
OPT
f=-75
TT=10.53
T1=1.81
OPT
f=-75
TT=5.402
T1=3.81
SAT
f=-16
TT=1793.77
T1=550.36
No dataSAT
f=-51
TT=1798.8
T1=1799.1
OPT
f=-75
TT=6.432
T1=7.54
SAT
f=-16
TT=1789.77
T1=26.31
No dataOPT
f=-75
TT=5.474
T1=6.54
SAT
f=-64
TT=1796.79
T1=1723.1
OPT
f=-75
TT=5.493
T1=5.49
OPT
f=-75
TT=6.35
T1=4.76
OPT
f=-75
TT=5.091
T1=3.49
No dataNo dataNo dataOPT
f=-75
TT=17.592
T1=8.83
No dataNo dataOPT
f=-75
TT=19.558
T1=9.84
No dataNo dataNo dataSAT (TO)
f=-74
TT=1800.08
T1=148.38
OPT
f=-75
TT=5.325
T1=3.34
OPT
f=-75
TT=3.993
T1=1.77
SAT
f=-67
TT=1796.79
T1=1288.23
SAT
f=-67
TT=1796.86
T1=1296.5
SAT
f=-67
TT=1796.81
T1=1309.99
OPT
f=-75
TT=34.008
T1=23.73
OPT
f=-75
TT=36.714
T1=25.75
?

TT=1799.54

No dataNo data?

TT=1799.57

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-1000opt.opb
OPT
f=-78
TT=1.017
T1=0.71
OPT
f=-78
TT=14.881
T1=7.88
No dataOPT
f=-78
TT=1.017
T1=0.71
OPT
f=-78
TT=10.122
T1=10.11
OPT
f=-78
TT=10.248
T1=10.31
OPT
f=-78
TT=9.278
T1=9.52
OPT
f=-78
TT=8.974
T1=8.97
OPT
f=-78
TT=7.537
T1=3.99
OPT
f=-78
TT=7.468
T1=3.94
OPT
f=-78
TT=7.576
T1=4.01
OPT
f=-78
TT=7.446
T1=4.02
OPT
f=-78
TT=10.738
T1=5.75
OPT
f=-78
TT=10.747
T1=7.08
? (TO)

TT=1800.08

OPT
f=-78
TT=17.303
T1=17.3
OPT
f=-78
TT=14.263
T1=3.73
OPT
f=-78
TT=16.267
T1=1.8
OPT
f=-78
TT=5.883
T1=2.5
SAT
f=-16
TT=1793.59
T1=982.74
No dataSAT
f=-50
TT=1798.83
T1=1799.11
OPT
f=-78
TT=6.744
T1=9.55
SAT
f=-44
TT=1789.78
T1=1524.08
No dataOPT
f=-78
TT=6.302
T1=8.05
SAT
f=-59
TT=1796.8
T1=1404.48
OPT
f=-78
TT=8.243
T1=8.24
OPT
f=-78
TT=7.533
T1=7.54
OPT
f=-78
TT=7.521
T1=5.8
No dataNo dataNo dataOPT
f=-78
TT=23.633
T1=11.85
No dataNo dataOPT
f=-78
TT=25.91
T1=13.03
No dataNo dataNo dataOPT
f=-78
TT=8.763
T1=7.64
OPT
f=-78
TT=9.202
T1=7.51
OPT
f=-78
TT=4.592
T1=2.39
SAT
f=-68
TT=1796.78
T1=1590.89
SAT
f=-68
TT=1796.81
T1=1557.44
SAT
f=-68
TT=1796.8
T1=1556
OPT
f=-78
TT=32.616
T1=16.11
OPT
f=-78
TT=33.652
T1=16.71
?

TT=1799.98

No dataNo data?

TT=1799.59

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-2000opt.opb
OPT
f=-70
TT=1.846
T1=1.77
OPT
f=-70
TT=18.2
T1=8.64
No dataOPT
f=-70
TT=1.846
T1=1.79
OPT
f=-70
TT=16.537
T1=11.43
OPT
f=-70
TT=16.857
T1=11.64
OPT
f=-70
TT=15.371
T1=9.41
OPT
f=-70
TT=14.845
T1=9.23
OPT
f=-70
TT=14.889
T1=11.15
OPT
f=-70
TT=14.926
T1=11.16
OPT
f=-70
TT=15.077
T1=11.39
OPT
f=-70
TT=15.058
T1=11.41
OPT
f=-70
TT=11.108
T1=3.38
OPT
f=-70
TT=13.494
T1=1.77
? (TO)

TT=1800.11

OPT
f=-70
TT=13.892
T1=13.89
OPT
f=-70
TT=16.151
T1=4.16
OPT
f=-70
TT=18.217
T1=9.75
OPT
f=-70
TT=7.725
T1=1.78
SAT
f=-16
TT=1794.21
T1=1223.81
No dataSAT
f=-49
TT=1798.74
T1=1799.03
OPT
f=-70
TT=7.844
T1=13.54
SAT
f=-17
TT=1790.55
T1=58.83
No dataOPT
f=-70
TT=7.432
T1=7.54
SAT
f=-53
TT=1796.76
T1=1488.71
OPT
f=-70
TT=10.135
T1=10.13
OPT
f=-70
TT=13.491
T1=10.51
OPT
f=-70
TT=11.738
T1=8.77
No dataNo dataNo dataOPT
f=-70
TT=23.72
T1=11.89
No dataNo dataOPT
f=-70
TT=27.75
T1=13.94
No dataNo dataNo dataOPT
f=-70
TT=12.962
T1=9.68
OPT
f=-70
TT=10.013
T1=8.84
OPT
f=-70
TT=5.073
T1=3.14
SAT
f=-49
TT=1796.81
T1=1740.37
SAT
f=-49
TT=1796.8
T1=1699.58
SAT
f=-49
TT=1796.78
T1=1694.75
OPT
f=-70
TT=53.582
T1=40.05
OPT
f=-70
TT=57.903
T1=43.5
?

TT=1799.95

No dataNo data?

TT=1799.64

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-3000opt.opb
OPT
f=-81
TT=1.013
T1=0.26
OPT
f=-81
TT=10.903
T1=1.52
No dataOPT
f=-81
TT=1.013
T1=0.26
OPT
f=-81
TT=17.425
T1=8.55
OPT
f=-81
TT=17.466
T1=8.56
OPT
f=-81
TT=10.518
T1=10.51
OPT
f=-81
TT=10.346
T1=10.34
OPT
f=-81
TT=8.04
T1=2.58
OPT
f=-81
TT=8.223
T1=2.64
OPT
f=-81
TT=8.05
T1=2.58
OPT
f=-81
TT=8.024
T1=2.6
OPT
f=-81
TT=8.143
T1=1.46
OPT
f=-81
TT=7.887
T1=3.87
? (TO)

TT=1800.1

OPT
f=-81
TT=20.162
T1=20.16
OPT
f=-81
TT=14.422
T1=4.66
OPT
f=-81
TT=10.671
T1=1.94
OPT
f=-81
TT=5.443
T1=2.82
SAT
f=-18
TT=1793.88
T1=1025.94
No dataSAT
f=-50
TT=1798.79
T1=1799.08
OPT
f=-81
TT=5.752
T1=9.54
SAT
f=-16
TT=1789.8
T1=29.39
No dataOPT
f=-81
TT=5.864
T1=7.04
SAT
f=-72
TT=1797.26
T1=1532.73
OPT
f=-81
TT=5.485
T1=5.49
OPT
f=-81
TT=5.691
T1=5.71
OPT
f=-81
TT=7.204
T1=5.14
No dataNo dataNo dataOPT
f=-81
TT=18.733
T1=9.4
No dataNo dataOPT
f=-81
TT=18.015
T1=9.06
No dataNo dataNo dataOPT
f=-81
TT=10.502
T1=8.08
OPT
f=-81
TT=7.323
T1=5.65
OPT
f=-81
TT=3.793
T1=2.07
SAT
f=-68
TT=1796.78
T1=758.81
SAT
f=-68
TT=1796.82
T1=775.03
SAT
f=-68
TT=1796.81
T1=765.75
OPT
f=-81
TT=29.8
T1=28.95
OPT
f=-81
TT=30.09
T1=29.22
?

TT=1799.59

No dataNo data?

TT=1799.57

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-4000opt.opb
OPT
f=-82
TT=0.643
T1=0.47
OPT
f=-82
TT=6.052
T1=1.5
No dataOPT
f=-82
TT=0.643
T1=0.47
OPT
f=-82
TT=8.014
T1=1.51
OPT
f=-82
TT=8.044
T1=1.5
OPT
f=-82
TT=7.837
T1=1.45
OPT
f=-82
TT=7.706
T1=1.41
OPT
f=-82
TT=6.722
T1=5.59
OPT
f=-82
TT=6.65
T1=5.53
OPT
f=-82
TT=6.767
T1=5.64
OPT
f=-82
TT=6.828
T1=5.67
OPT
f=-82
TT=3.921
T1=2.43
OPT
f=-82
TT=7.012
T1=5.34
? (TO)

TT=1800.08

OPT
f=-82
TT=14.999
T1=14.99
OPT
f=-82
TT=7.401
T1=6.43
OPT
f=-82
TT=5.836
T1=1.87
OPT
f=-82
TT=3.154
T1=1.41
SAT
f=-20
TT=1793.89
T1=451.23
No dataSAT
f=-54
TT=1798.77
T1=1799.06
OPT
f=-82
TT=6.473
T1=9.54
SAT
f=-18
TT=1789.8
T1=65.98
No dataOPT
f=-82
TT=4.782
T1=4.54
SAT
f=-44
TT=1796.76
T1=1656.73
OPT
f=-82
TT=4.371
T1=4.36
OPT
f=-82
TT=6.394
T1=1.79
OPT
f=-82
TT=9.606
T1=8.66
No dataNo dataNo dataOPT
f=-82
TT=8.615
T1=4.34
No dataNo dataOPT
f=-82
TT=8.578
T1=4.33
No dataNo dataNo dataSAT (TO)
f=-81
TT=1800.57
T1=5.09
OPT
f=-82
TT=3.933
T1=2.62
OPT
f=-82
TT=3.433
T1=2.07
SAT
f=-48
TT=1796.8
T1=558.66
SAT
f=-48
TT=1796.82
T1=551.75
SAT
f=-48
TT=1796.78
T1=544.06
OPT
f=-82
TT=30.894
T1=29.66
OPT
f=-82
TT=29.128
T1=27.96
?

TT=1799.58

No dataNo data?

TT=1799.53

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-5000opt.opb
OPT
f=-70
TT=1.426
T1=0.69
OPT
f=-70
TT=13.883
T1=1.38
No dataOPT
f=-70
TT=1.426
T1=0.69
OPT
f=-70
TT=22.694
T1=11.15
OPT
f=-70
TT=22.898
T1=11.44
OPT
f=-70
TT=19.018
T1=8.93
OPT
f=-70
TT=18.184
T1=8.51
OPT
f=-70
TT=9.326
T1=3.81
OPT
f=-70
TT=9.186
T1=3.78
OPT
f=-70
TT=9
T1=3.74
OPT
f=-70
TT=8.938
T1=3.74
OPT
f=-70
TT=10.099
T1=1.59
OPT
f=-70
TT=11.638
T1=6.76
? (TO)

TT=1800.23

OPT
f=-70
TT=15.07
T1=15.07
OPT
f=-70
TT=12.572
T1=1.14
OPT
f=-70
TT=12.951
T1=1.11
OPT
f=-70
TT=5.935
T1=2.08
SAT
f=-12
TT=1794.11
T1=788.65
No dataSAT
f=-45
TT=1798.85
T1=1799.14
OPT
f=-70
TT=7.875
T1=4.56
SAT
f=-19
TT=1789.85
T1=48.4
No dataOPT
f=-70
TT=6.963
T1=5.54
SAT
f=-46
TT=1796.79
T1=716.99
OPT
f=-70
TT=9.79
T1=9.78
OPT
f=-70
TT=10.915
T1=3.07
OPT
f=-70
TT=8.175
T1=5.65
No dataNo dataNo dataOPT
f=-70
TT=22.517
T1=11.29
No dataNo dataOPT
f=-70
TT=23.3
T1=11.71
No dataNo dataNo dataOPT
f=-70
TT=11.023
T1=5.62
OPT
f=-70
TT=6.355
T1=4.65
OPT
f=-70
TT=4.931
T1=3.03
SAT
f=-50
TT=1796.81
T1=484.35
SAT
f=-50
TT=1796.82
T1=485.18
SAT
f=-50
TT=1796.8
T1=474.33
OPT
f=-70
TT=50.828
T1=29.25
OPT
f=-70
TT=50.816
T1=29.49
?

TT=1799.53

No dataNo data?

TT=1799.84

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-6000opt.opb
OPT
f=-74
TT=2.217
T1=1.45
OPT
f=-74
TT=24.656
T1=5.08
No dataOPT
f=-74
TT=2.217
T1=1.45
OPT
f=-74
TT=25.427
T1=19.84
OPT
f=-74
TT=25.58
T1=19.83
OPT
f=-74
TT=23.987
T1=17.61
OPT
f=-74
TT=24.421
T1=17.68
OPT
f=-74
TT=16.119
T1=10.82
OPT
f=-74
TT=17.505
T1=11.73
OPT
f=-74
TT=16.789
T1=11.28
OPT
f=-74
TT=16.023
T1=10.93
OPT
f=-74
TT=13.8
T1=4.27
OPT
f=-74
TT=11.197
T1=1.53
? (TO)

TT=1529.42

OPT
f=-74
TT=24.905
T1=24.91
OPT
f=-74
TT=43.61
T1=17.79
OPT
f=-74
TT=22.696
T1=12.05
OPT
f=-74
TT=12.443
T1=7.03
SAT
f=-15
TT=1794.11
T1=750.05
No dataSAT
f=-52
TT=1798.85
T1=1799.13
OPT
f=-74
TT=9.235
T1=13.54
SAT
f=-35
TT=1789.79
T1=1450.39
No dataOPT
f=-74
TT=8.403
T1=6.54
? (TO)

TT=1802.11

OPT
f=-74
TT=8.643
T1=8.64
OPT
f=-74
TT=13.415
T1=13.44
OPT
f=-74
TT=12.762
T1=9.2
No dataNo dataNo dataOPT
f=-74
TT=38.789
T1=19.43
No dataNo dataOPT
f=-74
TT=44.759
T1=22.47
No dataNo dataNo dataOPT
f=-74
TT=15.212
T1=12.62
OPT
f=-74
TT=11.063
T1=9.02
OPT
f=-74
TT=5.072
T1=2.98
SAT
f=-60
TT=1796.78
T1=1402.69
SAT
f=-60
TT=1796.79
T1=1400.26
SAT
f=-60
TT=1796.78
T1=1399.56
OPT
f=-74
TT=101.242
T1=96.53
OPT
f=-74
TT=108.304
T1=103.34
?

TT=1799.56

No dataNo data?

TT=1799.98

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-7000opt.opb
OPT
f=-68
TT=1.647
T1=0.43
OPT
f=-68
TT=16.237
T1=1.63
No dataOPT
f=-68
TT=1.647
T1=0.43
OPT
f=-68
TT=21.943
T1=21.95
OPT
f=-68
TT=22.151
T1=22.15
OPT
f=-68
TT=18.222
T1=18
OPT
f=-68
TT=17.666
T1=17.44
OPT
f=-68
TT=9.501
T1=3.21
OPT
f=-68
TT=10.221
T1=3.48
OPT
f=-68
TT=10.121
T1=3.39
OPT
f=-68
TT=10.15
T1=3.41
OPT
f=-68
TT=10.667
T1=6.38
OPT
f=-68
TT=12.358
T1=8.59
? (TO)

TT=1800.05

OPT
f=-68
TT=12.686
T1=12.68
OPT
f=-68
TT=14.483
T1=5.68
OPT
f=-68
TT=16.363
T1=3.68
OPT
f=-68
TT=7.323
T1=5.26
SAT
f=-9
TT=1793.92
T1=878.91
No dataSAT
f=-51
TT=1798.74
T1=1799.02
OPT
f=-68
TT=6.992
T1=10.54
SAT
f=-44
TT=1789.79
T1=1455.74
No dataOPT
f=-68
TT=8.048
T1=9.09
SAT
f=-45
TT=1796.77
T1=1352.48
OPT
f=-68
TT=9.581
T1=9.58
OPT
f=-68
TT=11.862
T1=9.17
OPT
f=-68
TT=9.141
T1=6.46
No dataNo dataNo dataOPT
f=-68
TT=37.87
T1=18.96
No dataNo dataOPT
f=-68
TT=33.193
T1=16.67
No dataNo dataNo dataOPT
f=-68
TT=11.431
T1=10.62
OPT
f=-68
TT=7.073
T1=5.11
OPT
f=-68
TT=5.013
T1=2.7
SAT
f=-47
TT=1796.79
T1=521.32
SAT
f=-47
TT=1796.76
T1=515.44
SAT
f=-47
TT=1796.86
T1=533.15
OPT
f=-68
TT=70.465
T1=62.86
OPT
f=-68
TT=70.003
T1=62.47
?

TT=1799.77

No dataNo data?

TT=1799.5

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-8000opt.opb
OPT
f=-76
TT=1.364
T1=1.04
OPT
f=-76
TT=12.063
T1=1.78
No dataOPT
f=-76
TT=1.364
T1=1.04
OPT
f=-76
TT=12.044
T1=9.15
OPT
f=-76
TT=11.938
T1=8.85
OPT
f=-76
TT=11.467
T1=11.48
OPT
f=-76
TT=11.181
T1=11.17
OPT
f=-76
TT=15.128
T1=11.58
OPT
f=-76
TT=15.241
T1=11.68
OPT
f=-76
TT=15.242
T1=11.7
OPT
f=-76
TT=15.244
T1=11.68
OPT
f=-76
TT=7.471
T1=0.62
OPT
f=-76
TT=9.558
T1=1.93
? (TO)

TT=1800.08

OPT
f=-76
TT=21.589
T1=21.59
OPT
f=-76
TT=20.66
T1=18.87
OPT
f=-76
TT=11.583
T1=1.67
OPT
f=-76
TT=7.284
T1=3.81
SAT
f=-19
TT=1793.67
T1=870.52
No data? (TO)

TT=1800.31

OPT
f=-76
TT=7.132
T1=11.54
SAT
f=-23
TT=1789.8
T1=9.66
No dataOPT
f=-76
TT=7.393
T1=9.54
SAT
f=-37
TT=1799.45
T1=953.55
OPT
f=-76
TT=7.269
T1=7.27
OPT
f=-76
TT=8.256
T1=5.99
OPT
f=-76
TT=9.219
T1=6.93
No dataNo dataNo dataOPT
f=-76
TT=23.361
T1=11.71
No dataNo dataOPT
f=-76
TT=24.99
T1=12.56
No dataNo dataNo dataOPT
f=-76
TT=12.772
T1=11.63
OPT
f=-76
TT=8.553
T1=6.16
OPT
f=-76
TT=4.383
T1=2.77
SAT
f=-59
TT=1796.81
T1=415.32
SAT
f=-59
TT=1796.83
T1=410.08
SAT
f=-59
TT=1796.81
T1=413.83
OPT
f=-76
TT=59.217
T1=37.78
OPT
f=-76
TT=65.666
T1=41.08
?

TT=1799.53

No dataNo data?

TT=1799.53

/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-9000opt.opb
OPT
f=-79
TT=1.412
T1=0.16
OPT
f=-79
TT=19.255
T1=4.12
No dataOPT
f=-79
TT=1.412
T1=0.16
OPT
f=-79
TT=19.791
T1=6.16
OPT
f=-79
TT=19.966
T1=6.26
OPT
f=-79
TT=17.55
T1=17.56
OPT
f=-79
TT=17.648
T1=17.74
OPT
f=-79
TT=11.84
T1=5.86
OPT
f=-79
TT=11.795
T1=5.85
OPT
f=-79
TT=11.607
T1=5.74
OPT
f=-79
TT=11.309
T1=5.82
OPT
f=-79
TT=10.978
T1=3.27
OPT
f=-79
TT=6.481
T1=1.87
? (TO)

TT=1800.05

OPT
f=-79
TT=12.929
T1=12.92
OPT
f=-79
TT=23.62
T1=14.78
OPT
f=-79
TT=18.799
T1=3.47
OPT
f=-79
TT=7.235
T1=1.15
SAT
f=-11
TT=1794.37
T1=99.67
No data? (TO)

TT=1800.03

OPT
f=-79
TT=9.102
T1=9.56
SAT
f=-19
TT=1789.57
T1=32.74
No dataOPT
f=-79
TT=7.752
T1=4.55
SAT
f=-55
TT=1796.81
T1=1117.98
OPT
f=-79
TT=5.088
T1=5.08
OPT
f=-79
TT=12.238
T1=4.13
OPT
f=-79
TT=7.732
T1=4.46
No dataNo dataNo dataOPT
f=-79
TT=39.158
T1=19.61
No dataNo dataOPT
f=-79
TT=42.04
T1=21.09
No dataNo dataNo dataOPT
f=-79
TT=6.903
T1=5.59
OPT
f=-79
TT=8.072
T1=3.15
OPT
f=-79
TT=4.763
T1=2.82
SAT
f=-71
TT=1796.79
T1=740.03
SAT
f=-71
TT=1796.8
T1=718.98
SAT
f=-71
TT=1796.82
T1=732.98
OPT
f=-79
TT=66.116
T1=65.72
OPT
f=-79
TT=66.706
T1=66.29
?

TT=1799.57

No dataNo data?

TT=1799.95

/OPT-SMALLINT-LIN/flexray/
normalized-fx30.opb




?

TT=1798.02

No data? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.13

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.07

?

TT=1798

? (TO)

TT=1800.01

? (TO)

TT=1800.04

No data? (TO)

TT=1800.31

? (TO)

TT=1800.02

?

TT=1789.55

No data? (TO)

TT=1800.07

?

TT=1796.75

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1800.79

No dataNo dataNo data? (TO)

TT=1800.54

No dataNo data? (TO)

TT=1800.15

No dataNo dataNo data? (TO)

TT=1800.08

? (TO)

TT=1800.6

? (TO)

TT=1800.4

?

TT=1796.79

?

TT=1796.73

?

TT=1796.77

? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.49

No dataNo data?

TT=1799.84

/OPT-SMALLINT-LIN/flexray/
normalized-fx49.opb




?

TT=1798.03

No data? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1802.12

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1798.07

? (TO)

TT=1800.84

? (TO)

TT=1800.14

No data? (TO)

TT=1800.19

? (TO)

TT=1800.96

?

TT=1789.77

No data? (TO)

TT=1800.17

?

TT=1796.77

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.2

No dataNo data? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.63

? (TO)

TT=1800.08

? (TO)

TT=1800.01

?

TT=1796.76

?

TT=1796.79

?

TT=1796.75

? (TO)

TT=1800.09

? (TO)

TT=1800.11

?

TT=1799.49

No dataNo data?

TT=1799.54

/OPT-SMALLINT-LIN/flexray/
normalized-fx57.opb
OPT
f=6
TT=0.065
T1=0.05
OPT
f=6
TT=1.073
T1=1.07
No dataOPT
f=6
TT=0.151
T1=0.15
OPT
f=6
TT=39.088
T1=37.39
? (problem)

TT=8.81

OPT
f=6
TT=36.993
T1=36.42
? (problem)

TT=7.3

OPT
f=6
TT=36.529
T1=36.22
? (problem)

TT=7.41

OPT
f=6
TT=30.027
T1=29.89
? (problem)

TT=8.47

OPT
f=6
TT=3.756
T1=3.75
OPT
f=6
TT=560.115
T1=560.26
OPT
f=6
TT=0.652
T1=0.63
OPT
f=6
TT=4.594
T1=4.59
OPT
f=6
TT=2.015
T1=0.93
OPT
f=6
TT=1.071
T1=1.07
OPT
f=6
TT=1.907
T1=0.96
? (TO)

TT=1800.14

No dataOPT
f=6
TT=2.836
T1=1.48
OPT
f=6
TT=3.844
T1=1.43
OPT
f=6
TT=485.646
T1=485.7
No dataOPT
f=6
TT=3.485
T1=1.52
?

TT=1796.73

OPT
f=6
TT=574.84
T1=574.98
OPT
f=6
TT=118.005
T1=117.18
OPT
f=6
TT=116.975
T1=116.57
No dataNo dataNo dataOPT
f=6
TT=0.431
T1=0.22
No dataNo dataOPT
f=6
TT=0.09
T1=0.05
No dataNo dataNo dataOPT
f=6
TT=2.765
T1=1.01
OPT
f=6
TT=2.445
T1=1.54
OPT
f=6
TT=1.463
T1=0.63
OPT
f=6
TT=16.615
T1=16.58
OPT
f=6
TT=17.487
T1=17.46
?

TT=1796.6

OPT
f=6
TT=10.823
T1=10.82
OPT
f=6
TT=10.641
T1=10.63
OPT
f=6
TT=0.07
T1=0.06
No dataNo dataOPT
f=6
TT=0.065
T1=0.05
/OPT-SMALLINT-LIN/flexray/
normalized-fx60.opb
OPT
f=6
TT=3.682
T1=2.7
OPT
f=6
TT=13.698
T1=13.69
No dataOPT
f=6
TT=8.419
T1=8.41
OPT
f=6
TT=39.884
T1=37.95
? (problem)

TT=111.357

OPT
f=6
TT=30.798
T1=30.32
? (problem)

TT=105.34

OPT
f=6
TT=36.822
T1=36.51
? (problem)

TT=111.4

OPT
f=6
TT=30.657
T1=30.49
? (problem)

TT=122.56

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1802.05

? (TO)

TT=1800.1

? (exit code)

TT=1564.16

?

TT=1798.01

? (TO)

TT=1800.74

? (TO)

TT=1800.15

No data? (TO)

TT=1800.21

OPT
f=6
TT=195.904
T1=98.72
OPT
f=6
TT=75.742
T1=75.73
No dataOPT
f=6
TT=23.57
T1=10.94
?

TT=1796.77

? (TO)

TT=1800.1

OPT
f=6
TT=638.973
T1=638.18
OPT
f=6
TT=593.04
T1=592.73
No dataNo dataNo dataOPT
f=6
TT=1.914
T1=0.96
No dataNo dataOPT
f=6
TT=12.332
T1=6.19
No dataNo dataNo dataOPT
f=6
TT=12.843
T1=5.57
OPT
f=6
TT=3.682
T1=2.7
OPT
f=6
TT=16.77
T1=15.66
?

TT=1796.79

?

TT=1796.76

?

TT=1796.75

? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.44

No dataNo data?

TT=1799.73

/OPT-SMALLINT-LIN/flexray/
normalized-fx63.opb




?

TT=1798.01

No data? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1802.07

? (TO)

TT=1800.1

? (TO)

TT=1800.05

?

TT=1798.03

? (TO)

TT=1800.03

? (TO)

TT=1800.15

No data? (TO)

TT=1800.06

? (TO)

TT=1800.18

?

TT=1789.76

No data? (TO)

TT=1800.78

?

TT=1796.75

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.55

No dataNo data? (TO)

TT=1800.2

No dataNo dataNo data? (TO)

TT=1800.11

? (TO)

TT=1800.36

? (TO)

TT=1800.61

?

TT=1796.79

?

TT=1796.77

?

TT=1796.72

? (TO)

TT=1800.07

? (TO)

TT=1800.09

?

TT=1799.89

No dataNo data?

TT=1799.51

/OPT-SMALLINT-LIN/flexray/
normalized-fx75.opb




?

TT=1798

No data? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.02

? (TO)

TT=1800

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (exit code)

TT=1293.06

?

TT=1798.07

? (exit code)

TT=1296.53

? (TO)

TT=1800.13

No data? (TO)

TT=1800.17

? (TO)

TT=1800.63

?

TT=1789.8

No data? (TO)

TT=1800.53

?

TT=1796.76

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.13

No dataNo dataNo data? (TO)

TT=1800.17

? (TO)

TT=1800.09

? (TO)

TT=1800.39

?

TT=1796.76

?

TT=1796.79

?

TT=1796.76

? (TO)

TT=1800.09

? (TO)

TT=1800.06

?

TT=1799.89

No dataNo data?

TT=1799.79

/OPT-SMALLINT-LIN/flexray/
normalized-fx84.opb
OPT
f=8
TT=0.271
T1=0.24
OPT
f=8
TT=5.117
T1=5.11
No dataOPT
f=8
TT=0.323
T1=0.31
OPT
f=8
TT=405.264
T1=402.35
? (TO)

TT=1800.08

OPT
f=8
TT=544.043
T1=541.02
? (TO)

TT=1800.04

OPT
f=8
TT=396.425
T1=395.7
? (TO)

TT=1800.06

OPT
f=8
TT=394.488
T1=393.68
? (TO)

TT=1800.01

OPT
f=8
TT=2.834
T1=2.83
? (TO)

TT=1800.07

OPT
f=8
TT=9.554
T1=9.43
OPT
f=8
TT=0.661
T1=0.66
OPT
f=8
TT=10.862
T1=9.35
OPT
f=8
TT=5.339
T1=5.33
OPT
f=8
TT=5.352
T1=4.2
OPT
f=8
TT=153.264
T1=153.25
No dataOPT
f=8
TT=5.414
T1=3.26
OPT
f=8
TT=4.493
T1=1.67
OPT
f=8
TT=80.579
T1=80.55
No dataOPT
f=8
TT=3.403
T1=1.14
OPT
f=8
TT=43.744
T1=43.7
? (TO)

TT=1800.08

OPT
f=8
TT=50.675
T1=47.56
OPT
f=8
TT=45.703
T1=44.67
No dataNo dataNo dataOPT
f=8
TT=0.583
T1=0.31
No dataNo dataOPT
f=8
TT=0.43
T1=0.24
No dataNo dataNo dataOPT
f=8
TT=3.863
T1=1.3
OPT
f=8
TT=1.543
T1=0.66
OPT
f=8
TT=1.664
T1=0.76
?

TT=1796.85

?

TT=1796.81

OPT
f=8
TT=71.641
T1=71.6
OPT
f=8
TT=4.337
T1=4.33
OPT
f=8
TT=4.299
T1=4.29
OPT
f=8
TT=0.282
T1=0.27
No dataNo dataOPT
f=8
TT=0.271
T1=0.26
/OPT-SMALLINT-LIN/flexray/
normalized-fx92.opb
OPT
f=9
TT=0.141
T1=0.14
OPT
f=9
TT=7.468
T1=7.46
No dataOPT
f=9
TT=1.539
T1=1.53
OPT
f=9
TT=613.956
T1=610.32
? (TO)

TT=1800.07

OPT
f=9
TT=538.605
T1=534.91
? (TO)

TT=1800.05

OPT
f=9
TT=543.177
T1=543.59
? (TO)

TT=1800.01

OPT
f=9
TT=540.416
T1=539.67
? (TO)

TT=1800.1

OPT
f=9
TT=111.828
T1=111.87
? (TO)

TT=1800.07

OPT
f=9
TT=3.462
T1=3.14
OPT
f=9
TT=5.482
T1=5.48
OPT
f=9
TT=1.925
T1=0.79
OPT
f=9
TT=10.971
T1=10.96
OPT
f=9
TT=4.785
T1=3.66
OPT
f=9
TT=108.41
T1=108.4
No dataOPT
f=9
TT=54.667
T1=19.53
OPT
f=9
TT=5.093
T1=2.67
OPT
f=9
TT=241.835
T1=241.84
No dataOPT
f=9
TT=4.613
T1=1.67
?

TT=1796.78

? (TO)

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataOPT
f=9
TT=1.719
T1=0.89
No dataNo dataOPT
f=9
TT=0.22
T1=0.14
No dataNo dataNo dataOPT
f=9
TT=6.353
T1=2.31
OPT
f=9
TT=1.724
T1=0.83
OPT
f=9
TT=1.684
T1=0.78
?

TT=1796.85

?

TT=1796.82

?

TT=1796.8

OPT
f=9
TT=30.596
T1=30.59
OPT
f=9
TT=29.953
T1=29.94
OPT
f=9
TT=0.155
T1=0.15
No dataNo dataOPT
f=9
TT=0.141
T1=0.17
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/flexray/
normalized-fx97.opb




?

TT=1798

No data? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1802.12

? (TO)

TT=1800.04

? (TO)

TT=1800.06

?

TT=1798.05

? (TO)

TT=1800.83

?

TT=1799.51

No data? (TO)

TT=1800.2

? (TO)

TT=1801.16

?

TT=1789.8

No data? (TO)

TT=1800.05

?

TT=1796.81

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.44

No dataNo data? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.61

?

TT=1796.78

?

TT=1796.78

?

TT=1796.78

? (TO)

TT=1800.04

? (TO)

TT=1800.06

?

TT=1799.57

No dataNo data?

TT=1799.76

OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.01-1.opb
OPT
f=7
TT=0.564
T1=0.49
OPT
f=7
TT=34.959
T1=34.77
No dataOPT
f=7
TT=0.564
T1=0.49
OPT
f=7
TT=91.903
T1=91.8
OPT
f=7
TT=84.859
T1=84.57
? (problem)

TT=4.73

? (problem)

TT=3.27

? (problem)

TT=5.19

? (problem)

TT=3.44

? (problem)

TT=4.82

? (problem)

TT=3.22

OPT
f=7
TT=43.52
T1=43.41
OPT
f=7
TT=379.568
T1=379.61
SAT (TO)
f=139452
TT=1800.14
T1=1751.13
OPT
f=7
TT=182.93
T1=182.9
OPT
f=7
TT=8.294
T1=6.34
OPT
f=7
TT=41.945
T1=41.78
OPT
f=7
TT=5.304
T1=3.77
SAT
f=7
TT=1797.45
T1=455.14
No dataOPT
f=7
TT=86.226
T1=25.93
OPT
f=7
TT=5.903
T1=3.35
SAT
f=7
TT=1790.31
T1=361.22
No dataOPT
f=7
TT=4.302
T1=2.63
OPT
f=7
TT=435.379
T1=434.52
No Cert.

TT=1800.03

OPT
f=7
TT=63.929
T1=63.9
OPT
f=7
TT=851.414
T1=852.79
No dataNo dataNo dataOPT
f=7
TT=3.636
T1=2.37
No dataNo dataOPT
f=7
TT=3.346
T1=2.22
No dataNo dataNo dataOPT
f=7
TT=6.212
T1=2.81
OPT
f=7
TT=3.933
T1=2.23
OPT
f=7
TT=6.403
T1=4.48
OPT
f=7
TT=202.89
T1=161.34
OPT
f=7
TT=198.033
T1=158.03
OPT
f=7
TT=201.653
T1=160.52
OPT
f=7
TT=9.949
T1=9.75
OPT
f=7
TT=10.115
T1=9.92
OPT
f=7
TT=2.166
T1=2.1
No dataNo dataOPT
f=7
TT=1.932
T1=1.87
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.01-2.opb
OPT
f=7
TT=0.72
T1=0.65
OPT
f=7
TT=25.185
T1=25.08
No dataOPT
f=7
TT=0.72
T1=0.65
OPT
f=7
TT=92.487
T1=92.76
OPT
f=7
TT=37.94
T1=37.69
? (problem)

TT=5.21

? (problem)

TT=3.43

? (problem)

TT=5.16

? (problem)

TT=3.32

? (problem)

TT=5.28

? (problem)

TT=6.55

OPT
f=7
TT=23.337
T1=23.17
SAT (TO)
f=169662
TT=1800.13
T1=3.77
SAT (TO)
f=135385
TT=1802.06
T1=1719.23
OPT
f=7
TT=192.522
T1=192.55
OPT
f=7
TT=10.093
T1=8.11
OPT
f=7
TT=25.932
T1=25.82
OPT
f=7
TT=7.773
T1=6.18
OPT
f=7
TT=703.858
T1=685.96
No dataOPT
f=7
TT=72.42
T1=24.64
OPT
f=7
TT=5.565
T1=3.35
OPT
f=7
TT=747.454
T1=668.6
No dataOPT
f=7
TT=4.443
T1=2.67
OPT
f=7
TT=217.437
T1=215.97
No Cert.

TT=1800.01

OPT
f=7
TT=51.135
T1=50.88
OPT
f=7
TT=1406.96
T1=1408.21
No dataNo dataNo dataOPT
f=7
TT=3.698
T1=2.42
No dataNo dataOPT
f=7
TT=3.212
T1=2.16
No dataNo dataNo dataOPT
f=7
TT=6.503
T1=3.36
OPT
f=7
TT=4.533
T1=2.58
OPT
f=7
TT=8.633
T1=6.79
OPT
f=7
TT=430.491
T1=427.86
OPT
f=7
TT=401.784
T1=399.73
OPT
f=7
TT=367.79
T1=365.78
OPT
f=7
TT=9.136
T1=8.88
OPT
f=7
TT=17.482
T1=8.56
OPT
f=7
TT=2.03
T1=2.08
No dataNo dataOPT
f=7
TT=1.939
T1=1.88
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.01-3.opb
OPT
f=6
TT=0.555
T1=0.49
OPT
f=6
TT=25.761
T1=25.7
No dataOPT
f=6
TT=0.555
T1=0.49
OPT
f=6
TT=42.632
T1=42.81
OPT
f=6
TT=6.071
T1=5.75
? (problem)

TT=5.46

? (problem)

TT=3.36

? (problem)

TT=5.4

? (problem)

TT=3.63

? (problem)

TT=4.95

? (problem)

TT=3.34

OPT
f=6
TT=24.075
T1=23.98
OPT
f=6
TT=1467.89
T1=1468.08
SAT (TO)
f=118531
TT=1802.04
T1=1663.46
OPT
f=6
TT=180.748
T1=180.77
OPT
f=6
TT=5.094
T1=3.15
OPT
f=6
TT=22.048
T1=21.98
OPT
f=6
TT=7.763
T1=6.17
OPT
f=6
TT=349.158
T1=348.5
No dataOPT
f=6
TT=66.625
T1=22.69
OPT
f=6
TT=5.042
T1=3.29
OPT
f=6
TT=295.395
T1=294.86
No dataOPT
f=6
TT=3.872
T1=2.62
OPT
f=6
TT=245.987
T1=245.09
No Cert.

TT=1800.04

OPT
f=6
TT=42.722
T1=42.63
OPT
f=6
TT=255.907
T1=256.65
No dataNo dataNo dataOPT
f=6
TT=2.476
T1=1.76
No dataNo dataOPT
f=6
TT=2.543
T1=1.79
No dataNo dataNo dataOPT
f=6
TT=5.422
T1=2.77
OPT
f=6
TT=3.874
T1=2.24
OPT
f=6
TT=5.534
T1=3.73
OPT
f=6
TT=253.432
T1=252.25
OPT
f=6
TT=228.361
T1=227.43
OPT
f=6
TT=226.69
T1=225.78
OPT
f=6
TT=8.375
T1=8.08
OPT
f=6
TT=9.003
T1=8.69
OPT
f=6
TT=1.673
T1=1.61
No dataNo dataOPT
f=6
TT=1.649
T1=1.59
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.01-4.opb
OPT
f=7
TT=0.559
T1=0.49
OPT
f=7
TT=28.182
T1=28.08
No dataOPT
f=7
TT=0.559
T1=0.49
OPT
f=7
TT=9.924
T1=9.34
OPT
f=7
TT=33.827
T1=34.06
? (problem)

TT=4.34

? (problem)

TT=3.22

? (problem)

TT=4.7

? (problem)

TT=3.44

? (problem)

TT=4.32

? (problem)

TT=3.2

OPT
f=7
TT=26.045
T1=25.95
SAT (TO)
f=195808
TT=1800.1
T1=3.67
SAT (TO)
f=120857
TT=1802.08
T1=1679.19
OPT
f=7
TT=172.125
T1=172.14
OPT
f=7
TT=8.774
T1=6.61
OPT
f=7
TT=27.863
T1=27.77
OPT
f=7
TT=6.935
T1=5.26
OPT
f=7
TT=1020.97
T1=1004.09
No dataOPT
f=7
TT=132.002
T1=51.04
OPT
f=7
TT=5.374
T1=3.29
OPT
f=7
TT=539.885
T1=497.83
No dataOPT
f=7
TT=4.401
T1=2.55
OPT
f=7
TT=827.185
T1=789.38
No Cert.

TT=1800.08

OPT
f=7
TT=69.134
T1=69.11
OPT
f=7
TT=854.485
T1=855.83
No dataNo dataNo dataOPT
f=7
TT=3.103
T1=2.06
No dataNo dataOPT
f=7
TT=3.073
T1=2.03
No dataNo dataNo dataOPT
f=7
TT=5.903
T1=2.72
OPT
f=7
TT=3.953
T1=2.24
OPT
f=7
TT=6.694
T1=4.78
OPT
f=7
TT=334.324
T1=322.51
OPT
f=7
TT=366.052
T1=353.02
OPT
f=7
TT=364.772
T1=352.04
OPT
f=7
TT=9.342
T1=9.1
OPT
f=7
TT=9.856
T1=9.61
OPT
f=7
TT=1.987
T1=1.93
No dataNo dataOPT
f=7
TT=1.94
T1=1.88
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.01-5.opb
OPT
f=7
TT=0.583
T1=0.51
OPT
f=7
TT=32.089
T1=31.99
No dataOPT
f=7
TT=0.583
T1=0.51
OPT
f=7
TT=89.407
T1=89.33
OPT
f=7
TT=37.422
T1=37.04
? (problem)

TT=5.4

? (problem)

TT=3.23

? (problem)

TT=4.92

? (problem)

TT=3.48

? (problem)

TT=5.11

? (problem)

TT=3.15

OPT
f=7
TT=18.646
T1=18.57
SAT (TO)
f=41839
TT=1800.05
T1=1667.58
SAT (TO)
f=114466
TT=1802.02
T1=1789.49
OPT
f=7
TT=184.055
T1=184.07
OPT
f=7
TT=8.644
T1=6.7
OPT
f=7
TT=31.057
T1=30.99
OPT
f=7
TT=5.433
T1=3.95
OPT
f=7
TT=440.026
T1=350.74
No dataOPT
f=7
TT=52.607
T1=16.76
OPT
f=7
TT=6.452
T1=5.64
OPT
f=7
TT=314.619
T1=313.8
No dataOPT
f=7
TT=5.343
T1=4
OPT
f=7
TT=210.812
T1=209.93
No Cert.

TT=1800.08

OPT
f=7
TT=69.126
T1=68.67
OPT
f=7
TT=44.72
T1=45.16
No dataNo dataNo dataOPT
f=7
TT=3.216
T1=2.14
No dataNo dataOPT
f=7
TT=3.122
T1=2.06
No dataNo dataNo dataOPT
f=7
TT=5.483
T1=2.8
OPT
f=7
TT=3.945
T1=2.36
OPT
f=7
TT=9.042
T1=7.18
OPT
f=7
TT=132.5
T1=131.53
OPT
f=7
TT=133.793
T1=132.73
OPT
f=7
TT=144.84
T1=143.59
OPT
f=7
TT=8.492
T1=8.32
OPT
f=7
TT=8.493
T1=8.34
OPT
f=7
TT=2.145
T1=2.08
No dataNo dataOPT
f=7
TT=1.91
T1=1.97
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.10-10.opb
OPT
f=6
TT=0.771
T1=0.7
OPT
f=6
TT=39.303
T1=38.78
No dataOPT
f=6
TT=0.771
T1=0.7
OPT
f=6
TT=75.672
T1=75.15
OPT
f=6
TT=55.577
T1=56.85
? (problem)

TT=5.49

? (problem)

TT=3.89

? (problem)

TT=5.67

? (problem)

TT=4.21

? (problem)

TT=5.54

? (problem)

TT=3.98

OPT
f=6
TT=24.915
T1=24.67
SAT (TO)
f=183604
TT=1800.14
T1=4.7
SAT (TO)
f=242286
TT=1802.33
T1=1765.04
OPT
f=6
TT=257.864
T1=256.44
OPT
f=6
TT=7.493
T1=5.52
OPT
f=6
TT=32.335
T1=31.75
OPT
f=6
TT=6.155
T1=4.55
SAT
f=7
TT=1797.45
T1=1198.39
No dataOPT
f=6
TT=244.308
T1=140.66
OPT
f=6
TT=6.615
T1=5.31
SAT
f=7
TT=1790.59
T1=1290.25
No dataOPT
f=6
TT=5.323
T1=3.8
SAT
f=6
TT=1797.68
T1=591.75
No Cert.

TT=1800.03

OPT
f=6
TT=13.974
T1=14.18
OPT
f=6
TT=468.065
T1=469.66
No dataNo dataNo dataOPT
f=6
TT=3.812
T1=2.57
No dataNo dataOPT
f=6
TT=3.759
T1=2.52
No dataNo dataNo dataOPT
f=6
TT=7.633
T1=3.76
OPT
f=6
TT=4.593
T1=2.68
OPT
f=6
TT=8.233
T1=6.23
SAT
f=6
TT=1797.93
T1=1187.33
SAT
f=6
TT=1798.18
T1=1193.41
SAT
f=6
TT=1797.92
T1=1197.66
OPT
f=6
TT=11.698
T1=11.36
OPT
f=6
TT=12.301
T1=11.96
OPT
f=6
TT=2.459
T1=2.4
No dataNo dataOPT
f=6
TT=2.376
T1=2.31
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.10-6.opb
OPT
f=7
TT=0.904
T1=0.83
OPT
f=7
TT=64.173
T1=63.87
No dataOPT
f=7
TT=0.904
T1=0.83
OPT
f=7
TT=68.16
T1=67.82
OPT
f=7
TT=71.558
T1=71.53
? (problem)

TT=6.2

? (problem)

TT=4.51

? (problem)

TT=6.21

? (problem)

TT=4.46

? (problem)

TT=5.87

? (problem)

TT=4.26

OPT
f=7
TT=35.491
T1=35.1
SAT (TO)
f=196970
TT=1800.11
T1=5.38
SAT (TO)
f=230669
TT=1802.1
T1=1676.01
OPT
f=7
TT=291.04
T1=291.07
OPT
f=7
TT=10.321
T1=8.15
OPT
f=7
TT=51.177
T1=51
OPT
f=7
TT=9.862
T1=7.79
?

TT=1797.46

No dataOPT
f=7
TT=598.777
T1=391.2
OPT
f=7
TT=8.122
T1=5.19
?

TT=1792.33

No dataOPT
f=7
TT=6.364
T1=4.02
SAT
f=7
TT=1798.03
T1=1784.62
No Cert.

TT=1800.02

OPT
f=7
TT=195.092
T1=195.68
? (TO)

TT=1800.04

No dataNo dataNo dataOPT
f=7
TT=4.545
T1=2.98
No dataNo dataOPT
f=7
TT=5.252
T1=3.36
No dataNo dataNo dataOPT
f=7
TT=8.442
T1=3.93
OPT
f=7
TT=5.373
T1=3.14
OPT
f=7
TT=12.102
T1=10.07
SAT
f=8
TT=1798.28
T1=1273.63
SAT
f=8
TT=1798.06
T1=1180.23
SAT
f=8
TT=1798.09
T1=1396.23
OPT
f=7
TT=13.885
T1=13.58
OPT
f=7
TT=14.427
T1=14.12
OPT
f=7
TT=2.801
T1=2.73
No dataNo dataOPT
f=7
TT=3.002
T1=2.93
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.10-7.opb
OPT
f=588
TT=0.969
T1=0.77
OPT
f=588
TT=802.618
T1=801.59
No dataOPT
f=588
TT=0.969
T1=0.77
OPT
f=588
TT=157.336
T1=154.74
OPT
f=588
TT=109.413
T1=109.33
? (problem)

TT=5.65

? (problem)

TT=4.24

? (problem)

TT=5.59

? (problem)

TT=4.38

? (problem)

TT=5.58

? (problem)

TT=4.23

SAT (TO)
f=10467
TT=1800.14
T1=85.28
SAT (TO)
f=208009
TT=1800.07
T1=5.17
SAT (TO)
f=226022
TT=1800.02
T1=1778.74
SAT
f=4076
TT=1783.04
T1=1715.91
OPT
f=588
TT=17.47
T1=14.62
OPT
f=588
TT=1181.01
T1=1180.98
OPT
f=588
TT=11.712
T1=9.37
?

TT=1797.63

No data? (TO)

TT=1800.08

OPT
f=588
TT=15.893
T1=6.21
SAT
f=2334
TT=1791.35
T1=1736.91
No dataOPT
f=588
TT=14.332
T1=5.2
SAT
f=588
TT=1797.93
T1=1119.32
No Cert.

TT=1800.09

OPT
f=588
TT=125.289
T1=122.29
OPT
f=588
TT=1185.37
T1=1182.9
No dataNo dataNo dataOPT
f=588
TT=4.84
T1=3.12
No dataNo dataOPT
f=588
TT=5.548
T1=3.53
No dataNo dataNo dataOPT
f=588
TT=9.951
T1=4.96
OPT
f=588
TT=5.843
T1=3.35
OPT
f=588
TT=24.062
T1=21.56
SAT
f=589
TT=1797.95
T1=1743
SAT
f=589
TT=1798.03
T1=1789.97
SAT
f=589
TT=1797.97
T1=1740.28
OPT
f=588
TT=35.042
T1=12.29
OPT
f=588
TT=35.274
T1=12.53
OPT
f=588
TT=2.993
T1=2.93
No dataNo dataOPT
f=588
TT=2.859
T1=2.8
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.10-8.opb
OPT
f=589
TT=0.902
T1=0.83
OPT
f=589
TT=81.721
T1=81.59
No dataOPT
f=589
TT=0.902
T1=0.83
OPT
f=589
TT=167.462
T1=168.02
OPT
f=589
TT=68.614
T1=68.58
? (problem)

TT=5.61

? (problem)

TT=4.07

? (problem)

TT=5.76

? (problem)

TT=4.41

? (problem)

TT=5.64

? (problem)

TT=4.13

OPT
f=589
TT=103.505
T1=103.36
SAT (TO)
f=181886
TT=1800.07
T1=1191.21
SAT (TO)
f=216144
TT=1801.97
T1=1748.92
OPT
f=589
TT=736.242
T1=736.33
OPT
f=589
TT=11.641
T1=9.47
OPT
f=589
TT=73.641
T1=73.5
OPT
f=589
TT=6.515
T1=4.9
?

TT=1797.62

No dataOPT
f=589
TT=519.917
T1=264.46
OPT
f=589
TT=7.383
T1=3.94
?

TT=1794.38

No dataOPT
f=589
TT=6.402
T1=3.25
SAT
f=590
TT=1797.97
T1=1692.75
OPT
f=589
TT=1062.78
T1=1062.98
OPT
f=589
TT=130.362
T1=130.87
? (TO)

TT=1800.05

No dataNo dataNo dataOPT
f=589
TT=4.703
T1=3.03
No dataNo dataOPT
f=589
TT=4.998
T1=3.19
No dataNo dataNo dataOPT
f=589
TT=7.354
T1=3.95
OPT
f=589
TT=4.724
T1=2.94
OPT
f=589
TT=9.992
T1=8
SAT
f=589
TT=1798.02
T1=882.67
SAT
f=589
TT=1798.23
T1=886.29
SAT
f=589
TT=1798.31
T1=1180.45
OPT
f=589
TT=15.853
T1=15.22
OPT
f=589
TT=15.79
T1=15.29
OPT
f=589
TT=2.863
T1=2.81
No dataNo dataOPT
f=589
TT=2.767
T1=2.72
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.10-9.opb
OPT
f=7
TT=0.826
T1=0.8
OPT
f=7
TT=59.383
T1=58.6
No dataOPT
f=7
TT=0.826
T1=0.8
OPT
f=7
TT=57.458
T1=57.46
OPT
f=7
TT=62.456
T1=62.5
? (problem)

TT=5.85

? (problem)

TT=4.1

? (problem)

TT=5.89

? (problem)

TT=4.33

? (problem)

TT=5.41

? (problem)

TT=4.07

OPT
f=7
TT=56.055
T1=55.63
SAT (TO)
f=190579
TT=1800.06
T1=5.2
SAT (TO)
f=191163
TT=1802.04
T1=1676.17
OPT
f=7
TT=325.48
T1=325.3
OPT
f=7
TT=14.222
T1=12.01
OPT
f=7
TT=58.916
T1=58.23
OPT
f=7
TT=8.865
T1=7.2
SAT
f=10
TT=1798.11
T1=1638.57
No dataOPT
f=7
TT=153.671
T1=70.72
OPT
f=7
TT=17.42
T1=15.39
SAT
f=2335
TT=1790.47
T1=1378.34
No dataOPT
f=7
TT=13.052
T1=9.05
OPT
f=7
TT=1663.91
T1=460.94
No Cert.

TT=1800.02

OPT
f=7
TT=81.209
T1=81.95
OPT
f=7
TT=1315.35
T1=1315.73
No dataNo dataNo dataOPT
f=7
TT=4.775
T1=3.1
No dataNo dataOPT
f=7
TT=4.095
T1=2.72
No dataNo dataNo dataOPT
f=7
TT=7.472
T1=3.28
OPT
f=7
TT=4.952
T1=2.82
OPT
f=7
TT=17.251
T1=15.06
SAT
f=8
TT=1798.22
T1=1053.37
SAT
f=8
TT=1798.02
T1=917.87
SAT
f=8
TT=1797.87
T1=923.37
OPT
f=7
TT=13.544
T1=12.22
OPT
f=7
TT=13.016
T1=11.75
OPT
f=7
TT=2.816
T1=2.74
No dataNo dataOPT
f=7
TT=2.526
T1=2.48
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.20-11.opb
OPT
f=7
TT=1.208
T1=1.13
SAT
f=7
TT=1798.05
T1=380.28
No dataOPT
f=7
TT=1.208
T1=1.13
OPT
f=7
TT=49.937
T1=49.68
OPT
f=7
TT=119.234
T1=119.94
? (problem)

TT=6.51

? (problem)

TT=5.18

? (problem)

TT=5.99

? (problem)

TT=4.93

? (problem)

TT=6

? (problem)

TT=4.87

OPT
f=7
TT=39.08
T1=33.19
SAT (TO)
f=158712
TT=1800.13
T1=320.37
SAT (TO)
f=188838
TT=1802.02
T1=1657.29
? (TO)

TT=1800.11

OPT
f=7
TT=16.91
T1=14.5
OPT
f=7
TT=123.105
T1=99.03
OPT
f=7
TT=15.262
T1=13.28
?

TT=1797.45

No data? (TO)

TT=1800.41

OPT
f=7
TT=22.82
T1=17.42
?

TT=1790.91

No dataOPT
f=7
TT=32.159
T1=22.27
SAT
f=592
TT=1798.17
T1=1654.63
No Cert.

TT=1800.02

OPT
f=7
TT=138.268
T1=137.97
OPT
f=7
TT=977.094
T1=977.01
No dataNo dataNo dataOPT
f=7
TT=7.108
T1=4.41
No dataNo dataOPT
f=7
TT=6.003
T1=3.85
No dataNo dataNo dataOPT
f=7
TT=11.542
T1=4.91
OPT
f=7
TT=7.043
T1=3.66
OPT
f=7
TT=53.666
T1=50.16
SAT
f=281937
TT=1798.31
T1=215.99
SAT
f=281937
TT=1798.16
T1=259.68
SAT
f=281937
TT=1798.44
T1=361.54
OPT
f=7
TT=42.007
T1=33.93
OPT
f=7
TT=40.654
T1=32.96
OPT
f=7
TT=4.046
T1=3.97
No dataNo dataOPT
f=7
TT=3.939
T1=3.87
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.20-12.opb
OPT
f=7
TT=1.366
T1=1.28
OPT
f=7
TT=390.348
T1=385.1
No dataOPT
f=7
TT=1.366
T1=1.28
OPT
f=7
TT=47.975
T1=48.1
OPT
f=7
TT=54.642
T1=54.34
? (problem)

TT=6.62

? (problem)

TT=4.86

? (problem)

TT=6.12

? (problem)

TT=4.99

? (problem)

TT=6.09

? (problem)

TT=4.83

SAT (TO)
f=3494
TT=1800.09
T1=1783.58
SAT (TO)
f=196391
TT=1800.13
T1=6.5
SAT (TO)
f=179541
TT=1801.99
T1=1768.96
SAT
f=6399
TT=1783.06
T1=323.42
OPT
f=7
TT=30.33
T1=27.67
OPT
f=7
TT=758.335
T1=755.64
OPT
f=7
TT=25.58
T1=23.54
? (TO)

TT=1800.87

No data? (TO)

TT=1800.2

OPT
f=7
TT=36.997
T1=26.44
?

TT=1795.56

No dataOPT
f=7
TT=55.146
T1=34.88
SAT
f=2335
TT=1798.15
T1=1382.08
No Cert.

TT=1800.1

OPT
f=7
TT=206.073
T1=204.57
? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=7
TT=6.901
T1=4.28
No dataNo dataOPT
f=7
TT=6
T1=3.79
No dataNo dataNo dataOPT
f=7
TT=12.292
T1=5.44
OPT
f=7
TT=6.493
T1=3.75
OPT
f=7
TT=87.519
T1=83.84
SAT
f=1177
TT=1798.08
T1=1301.16
SAT
f=1177
TT=1798.11
T1=1291.26
SAT
f=1177
TT=1798.34
T1=1535.05
OPT
f=7
TT=772.29
T1=771.06
OPT
f=7
TT=764.711
T1=763.5
OPT
f=7
TT=3.652
T1=3.58
No dataNo dataOPT
f=7
TT=3.433
T1=3.37
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.20-13.opb
OPT
f=7
TT=1.389
T1=1.27
SAT
f=5236
TT=1798.05
T1=1787.73
No dataOPT
f=7
TT=1.389
T1=1.27
OPT
f=7
TT=134.278
T1=133.68
OPT
f=7
TT=42.114
T1=42.93
? (problem)

TT=6.28

? (problem)

TT=5.02

? (problem)

TT=6.86

? (problem)

TT=4.92

? (problem)

TT=6.33

? (problem)

TT=4.86

OPT
f=7
TT=1738.04
T1=1697.11
SAT (TO)
f=142937
TT=1800.13
T1=6.75
SAT (TO)
f=181288
TT=1802.04
T1=1687.12
SAT
f=1169
TT=1783.06
T1=1698.21
OPT
f=7
TT=31.429
T1=26.88
SAT
f=6981
TT=1798.05
T1=74.8
OPT
f=7
TT=20.532
T1=18.32
?

TT=1797.36

No data? (TO)

TT=1800.27

OPT
f=7
TT=46.937
T1=35.97
?

TT=1790.76

No dataOPT
f=7
TT=39.538
T1=27.35
SAT
f=13
TT=1798.25
T1=1428.3
No Cert.

TT=1800.05

OPT
f=7
TT=102.615
T1=101.95
OPT
f=7
TT=221.886
T1=222
No dataNo dataNo dataOPT
f=7
TT=7.974
T1=4.87
No dataNo dataOPT
f=7
TT=6.862
T1=4.31
No dataNo dataNo dataOPT
f=7
TT=10.144
T1=5.52
OPT
f=7
TT=8.933
T1=3.52
OPT
f=7
TT=95.11
T1=91.13
SAT
f=1171
TT=1798.48
T1=1621.41
SAT
f=1171
TT=1798.22
T1=1384.59
SAT
f=1171
TT=1798.27
T1=1450.93
OPT
f=7
TT=24.859
T1=19.95
OPT
f=7
TT=26.428
T1=21.23
OPT
f=7
TT=4.259
T1=4.19
No dataNo dataOPT
f=7
TT=4.13
T1=4.07
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.20-14.opb
OPT
f=7
TT=1.052
T1=0.97
OPT
f=7
TT=101.508
T1=100.38
No dataOPT
f=7
TT=1.052
T1=0.97
OPT
f=7
TT=121.943
T1=121
OPT
f=7
TT=34.232
T1=34.33
? (problem)

TT=5.88

? (problem)

TT=4.69

? (problem)

TT=5.92

? (problem)

TT=4.81

? (problem)

TT=5.91

? (problem)

TT=4.55

OPT
f=7
TT=127.546
T1=126.33
SAT (TO)
f=177213
TT=1800.11
T1=6.66
SAT (TO)
f=204524
TT=1802.07
T1=1693.69
OPT
f=7
TT=586.477
T1=586.27
OPT
f=7
TT=12.864
T1=10.51
OPT
f=7
TT=86.146
T1=85.11
OPT
f=7
TT=11.741
T1=9.61
? (TO)

TT=1802.04

No data? (TO)

TT=1800.31

OPT
f=7
TT=7.722
T1=4.3
?

TT=1793.1

No dataOPT
f=7
TT=6.995
T1=4.31
SAT
f=591
TT=1798.06
T1=1407.56
OPT
f=7
TT=568.71
T1=568.83
OPT
f=7
TT=79.422
T1=77.79
OPT
f=7
TT=759.358
T1=759.64
No dataNo dataNo dataOPT
f=7
TT=5.949
T1=3.74
No dataNo dataOPT
f=7
TT=6.148
T1=3.87
No dataNo dataNo dataOPT
f=7
TT=8.983
T1=4.79
OPT
f=7
TT=5.762
T1=3.41
OPT
f=7
TT=28.91
T1=26.37
SAT
f=319686
TT=1798.09
T1=148.71
SAT
f=319686
TT=1798.28
T1=146.43
SAT
f=319686
TT=1798.36
T1=226.98
OPT
f=7
TT=16.799
T1=15.95
OPT
f=7
TT=17.123
T1=16.28
OPT
f=7
TT=4.042
T1=3.97
No dataNo dataOPT
f=7
TT=3.565
T1=3.51
OPT-SMALLINT-LIN/graca/
normalized-ped2.B.recomb1-0.20-15.opb
OPT
f=7
TT=1.222
T1=1.14
SAT
f=5238
TT=1798.03
T1=1773.64
No dataOPT
f=7
TT=1.222
T1=1.14
OPT
f=7
TT=38.443
T1=38.05
OPT
f=7
TT=49.775
T1=49.47
? (problem)

TT=6.4

? (problem)

TT=5.15

? (problem)

TT=6.37

? (problem)

TT=5.78

? (problem)

TT=6.6

? (problem)

TT=5

OPT
f=7
TT=1234.76
T1=1221.96
SAT (TO)
f=200457
TT=1800.07
T1=6.85
SAT (TO)
f=106338
TT=1801.9
T1=1704.95
SAT
f=1170
TT=1783.04
T1=1754.7
OPT
f=7
TT=21.611
T1=18.84
OPT
f=7
TT=1734.84
T1=1729.52
OPT
f=7
TT=15.882
T1=13.76
?

TT=1797.88

No data? (TO)

TT=1800.27

OPT
f=7
TT=10.173
T1=4.6
?

TT=1790.77

No dataOPT
f=7
TT=8.974
T1=4.53
?

TT=1798.88

No Cert.

TT=1800.03

OPT
f=7
TT=81.491
T1=81.3
OPT
f=7
TT=142.345
T1=142.1
No dataNo dataNo dataOPT
f=7
TT=7.17
T1=4.47
No dataNo dataOPT
f=7
TT=7.307
T1=4.58
No dataNo dataNo dataOPT
f=7
TT=8.923
T1=4.69
OPT
f=7
TT=6.563
T1=3.9
OPT
f=7
TT=119.81
T1=116.57
SAT
f=5242
TT=1798.47
T1=1780.77
SAT
f=5242
TT=1798.66
T1=1780.26
SAT
f=2920
TT=1798.2
T1=1790.88
OPT
f=7
TT=68.844
T1=66.75
OPT
f=7
TT=68.912
T1=66.82
OPT
f=7
TT=5.479
T1=5.4
No dataNo dataOPT
f=7
TT=5.379
T1=5.32
OPT-SMALLINT-LIN/graca/
normalized-ped3.D.recomb10-0.20-11.opb
OPT
f=690
TT=4.363
T1=0.7
SAT
f=1031
TT=1798.01
T1=1024.81
No dataOPT
f=690
TT=4.363
T1=0.7
OPT
f=690
TT=66.116
T1=62.89
OPT
f=690
TT=45.782
T1=46.92
? (problem)

TT=2.676

? (problem)

TT=2.18

? (problem)

TT=2.534

? (problem)

TT=2.27

? (problem)

TT=2.59

? (problem)

TT=2.16

SAT (TO)
f=2056
TT=1800.07
T1=482.37
SAT (TO)
f=59918
TT=1800.07
T1=1506.71
SAT (TO)
f=39914
TT=1801.89
T1=1791.49
SAT
f=2737
TT=1787.07
T1=49.72
OPT
f=690
TT=628.56
T1=5.09
SAT
f=2055
TT=1798.02
T1=1099.86
OPT
f=690
TT=81.88
T1=6.84
?

TT=1795.58

No data? (TO)

TT=1800.35

OPT
f=690
TT=711.189
T1=3.86
?

TT=1790.25

No dataOPT
f=690
TT=628.626
T1=2.76
SAT
f=691
TT=1797.27
T1=1132.9
No Cert.

TT=1800.08

OPT
f=690
TT=83.429
T1=83.63
OPT
f=690
TT=1476.54
T1=1474.22
No dataNo dataNo dataOPT
f=690
TT=10.244
T1=5.48
No dataNo dataOPT
f=690
TT=8.523
T1=4.62
No dataNo dataNo dataOPT
f=690
TT=58.686
T1=4.91
OPT
f=690
TT=370.83
T1=222.83
OPT
f=690
TT=53.556
T1=38.62
SAT
f=1721
TT=1797.58
T1=1324.44
SAT
f=1717
TT=1797.86
T1=1613.01
SAT
f=1717
TT=1797.39
T1=1541.2
? (TO)

TT=1800.1

? (TO)

TT=1800.02

OPT
f=690
TT=5.189
T1=5.25
No dataNo dataOPT
f=690
TT=5.085
T1=5.18
OPT-SMALLINT-LIN/graca/
normalized-ped3.D.recomb10-0.20-12.opb
OPT
f=349
TT=0.705
T1=0.63
OPT
f=349
TT=690.673
T1=687.45
No dataOPT
f=349
TT=0.705
T1=0.63
OPT
f=349
TT=75.688
T1=75.8
OPT
f=349
TT=40.093
T1=39.82
? (problem)

TT=2.599

? (problem)

TT=2.23

? (problem)

TT=2.592

? (problem)

TT=2.3

? (problem)

TT=2.66

? (problem)

TT=2.19

OPT
f=349
TT=116.378
T1=25.48
OPT
f=349
TT=180.197
T1=180.13
SAT (TO)
f=38902
TT=1802.08
T1=1776.23
SAT
f=5130
TT=1783.02
T1=1783.14
OPT
f=349
TT=6.243
T1=4.16
OPT
f=349
TT=80.61
T1=75.66
OPT
f=349
TT=5.242
T1=3.01
?

TT=1795.37

No data? (TO)

TT=1800.05

OPT
f=349
TT=8.152
T1=3.86
?

TT=1790.25

No dataOPT
f=349
TT=6.322
T1=2.84
SAT
f=350
TT=1797.45
T1=930.65
OPT
f=349
TT=294.752
T1=294.79
OPT
f=349
TT=52.109
T1=51.99
OPT
f=349
TT=1065.58
T1=1066.99
No dataNo dataNo dataOPT
f=349
TT=2.589
T1=1.66
No dataNo dataOPT
f=349
TT=2.747
T1=1.76
No dataNo dataNo dataOPT
f=349
TT=8.344
T1=2.88
OPT
f=349
TT=4.443
T1=2.06
OPT
f=349
TT=58.255
T1=55.34
SAT
f=350
TT=1797.65
T1=1421.53
SAT
f=349
TT=1797.64
T1=1713.24
SAT
f=350
TT=1797.64
T1=1536.87
OPT
f=349
TT=78.398
T1=55.68
OPT
f=349
TT=77.257
T1=54.81
OPT
f=349
TT=1.552
T1=1.51
No dataNo dataOPT
f=349
TT=1.505
T1=1.48
OPT-SMALLINT-LIN/graca/
normalized-ped3.D.recomb10-0.20-13.opb
OPT
f=350
TT=2.789
T1=0.98
SAT
f=1717
TT=1798.02
T1=1728.55
No dataOPT
f=350
TT=3.072
T1=0.98
OPT
f=350
TT=85.61
T1=85.77
OPT
f=350
TT=49.615
T1=45.47
? (problem)

TT=2.74

? (problem)

TT=2.31

? (problem)

TT=2.75

? (problem)

TT=2.35

? (problem)

TT=2.77

? (problem)

TT=2.25

SAT (TO)
f=2060
TT=1800.08
T1=1157.61
SAT (TO)
f=22590
TT=1800.04
T1=1796.73
SAT (TO)
f=46055
TT=1801.91
T1=1783.58
SAT
f=3762
TT=1783.02
T1=92.54
OPT
f=350
TT=89.16
T1=32.84
SAT
f=2059
TT=1798.02
T1=578.24
OPT
f=350
TT=75.672
T1=40.02
?

TT=1795.52

No data? (TO)

TT=1800.25

OPT
f=350
TT=141.942
T1=11.11
?

TT=1793.69

No dataOPT
f=350
TT=140.974
T1=7.59
SAT
f=353
TT=1797.57
T1=1750.03
OPT
f=350
TT=422.36
T1=422.44
OPT
f=350
TT=105.004
T1=105.05
OPT
f=350
TT=238.087
T1=231.13
No dataNo dataNo dataOPT
f=350
TT=5.29
T1=3.04
No dataNo dataOPT
f=350
TT=6.559
T1=3.66
No dataNo dataNo dataOPT
f=350
TT=29.4
T1=3.94
OPT
f=350
TT=38.408
T1=2.73
OPT
f=350
TT=120.81
T1=95.77
SAT
f=361
TT=1797.6
T1=1711.02
SAT
f=361
TT=1797.54
T1=1685.69
SAT
f=361
TT=1797.49
T1=1556.91
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=350
TT=2.966
T1=2.93
No dataNo dataOPT
f=350
TT=2.789
T1=2.76
OPT-SMALLINT-LIN/graca/
normalized-ped3.D.recomb10-0.20-14.opb
OPT
f=7
TT=0.77
T1=0.62
OPT
f=7
TT=367.589
T1=324.6
No dataOPT
f=7
TT=0.77
T1=0.62
OPT
f=7
TT=6.679
T1=6.62
OPT
f=7
TT=23.399
T1=23.35
? (problem)

TT=2.75

? (problem)

TT=2.21

? (problem)

TT=2.58

? (problem)

TT=2.3

? (problem)

TT=2.69

? (problem)

TT=2.172

OPT
f=7
TT=128.689
T1=102.02
OPT
f=7
TT=490.975
T1=490.62
SAT (TO)
f=41639
TT=1801.97
T1=1798.91
OPT
f=7
TT=272.239
T1=266.19
OPT
f=7
TT=6.693
T1=3.76
OPT
f=7
TT=67.373
T1=35.33
OPT
f=7
TT=7.964
T1=5.32
?

TT=1795.36

No data? (TO)

TT=1800.17

OPT
f=7
TT=8.703
T1=3.82
?

TT=1790.21

No dataOPT
f=7
TT=7.542
T1=2.88
SAT
f=7
TT=1797.29
T1=1518.97
OPT
f=7
TT=329.547
T1=329.63
OPT
f=7
TT=73.023
T1=72.24
OPT
f=7
TT=1016.39
T1=1016.79
No dataNo dataNo dataOPT
f=7
TT=2.675
T1=1.69
No dataNo dataOPT
f=7
TT=2.747
T1=1.72
No dataNo dataNo dataOPT
f=7
TT=7.983
T1=2.87
OPT
f=7
TT=6.503
T1=2.15
OPT
f=7
TT=38.76
T1=36.29
SAT
f=2741
TT=1797.39
T1=520.45
SAT
f=2741
TT=1797.43
T1=559.49
SAT
f=2741
TT=1797.59
T1=695.5
OPT
f=7
TT=146.542
T1=129.78
OPT
f=7
TT=154.333
T1=135.6
OPT
f=7
TT=1.759
T1=1.72
No dataNo dataOPT
f=7
TT=1.762
T1=1.73
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
OPT-SMALLINT-LIN/graca/
normalized-ped3.D.recomb10-0.20-15.opb
OPT
f=689
TT=34.738
T1=0.67
SAT
f=689
TT=1798.02
T1=790.15
No dataOPT
f=689
TT=34.738
T1=0.67
OPT
f=689
TT=190.016
T1=142.43
OPT
f=689
TT=87.2
T1=52.97
? (problem)

TT=2.68

? (problem)

TT=2.11

? (problem)

TT=2.75

? (problem)

TT=2.26

? (problem)

TT=2.547

? (problem)

TT=2.13

SAT (TO)
f=689
TT=1800.08
T1=36.26
OPT
f=689
TT=356.025
T1=263.04
SAT (TO)
f=36517
TT=1802.03
T1=1773.32
SAT
f=1714
TT=1783.02
T1=1247.18
? (exit code)

TT=574.17

SAT
f=689
TT=1798.01
T1=77.42
OPT
f=689
TT=78.353
T1=4.2
?

TT=1795.61

No data? (TO)

TT=1800.23

OPT
f=689
TT=1040.7
T1=4.84
?

TT=1792.34

No dataOPT
f=689
TT=1123.8
T1=3.36
SAT
f=690
TT=1797.41
T1=981.43
OPT
f=689
TT=647.488
T1=647.61
OPT
f=689
TT=111.243
T1=87.25
OPT
f=689
TT=1172.02
T1=1148.45
No dataNo dataNo dataOPT
f=689
TT=1405.82
T1=703.52
No dataNo dataOPT
f=689
TT=562.284
T1=281.55
No dataNo dataNo dataOPT
f=689
TT=53.446
T1=2.29
OPT
f=689
TT=215.04
T1=2.08
OPT
f=689
TT=87.951
T1=18.83
SAT
f=689
TT=1797.39
T1=1468.93
SAT
f=689
TT=1797.5
T1=1362.82
SAT
f=689
TT=1797.57
T1=1395.43
? (TO)

TT=1800.01

? (TO)

TT=1800.11

OPT
f=689
TT=194.052
T1=194.08
No dataNo dataOPT
f=689
TT=192.79
T1=192.91
/OPT-SMALLINT-LIN/heinz/
normalized-acc-tight6.opb
OPT
f=0
TT=0.144
T1=0.14
OPT
f=0
TT=0.61
T1=0.61
No dataOPT
f=0
TT=0.144
T1=0.14
OPT
f=0
TT=1.023
T1=1.01
OPT
f=0
TT=0.653
T1=0.65
? (problem)

TT=0.82

? (problem)

TT=0.441

? (problem)

TT=0.83

? (problem)

TT=0.421

? (problem)

TT=0.84

? (problem)

TT=0.437

OPT
f=0
TT=3.02
T1=3.02
OPT
f=0
TT=0.699
T1=0.69
OPT
f=0
TT=0.788
T1=0.74
OPT
f=0
TT=0.96
T1=0.96
OPT
f=0
TT=1.444
T1=0.72
OPT
f=0
TT=1.546
T1=1.54
OPT
f=0
TT=1.414
T1=0.83
OPT
f=0
TT=647.272
T1=647.36
No dataOPT
f=0
TT=406.56
T1=139.05
OPT
f=0
TT=3.358
T1=1.36
OPT
f=0
TT=334.56
T1=334.58
No dataOPT
f=0
TT=2.724
T1=1.38
OPT
f=0
TT=183.681
T1=183.69
OPT
f=0
TT=0.396
T1=0.39
OPT
f=0
TT=0.797
T1=0.79
OPT
f=0
TT=0.789
T1=1.02
No dataNo dataNo dataOPT
f=0
TT=0.257
T1=0.13
No dataNo dataOPT
f=0
TT=0.456
T1=0.23
No dataNo dataNo dataOPT
f=0
TT=2.914
T1=1.35
OPT
f=0
TT=1.234
T1=0.61
OPT
f=0
TT=1.734
T1=1
OPT
f=0
TT=193.333
T1=193.33
OPT
f=0
TT=194.135
T1=194.14
OPT
f=0
TT=301.502
T1=301.52
OPT
f=0
TT=0.194
T1=0.19
OPT
f=0
TT=0.192
T1=0.19
OPT
f=0
TT=0.245
T1=0.23
No dataNo dataOPT
f=0
TT=0.243
T1=0.23
/OPT-SMALLINT-LIN/
heinz/normalized-bnatt350.opb
OPT
f=0
TT=0.178
T1=0.17
OPT
f=0
TT=3.662
T1=3.66
No dataOPT
f=0
TT=0.99
T1=0.98
OPT
f=0
TT=1.404
T1=1.39
OPT
f=0
TT=1.025
T1=1.27
OPT
f=0
TT=1.371
T1=1.37
? (problem)

TT=0.97

OPT
f=0
TT=1.377
T1=1.37
? (problem)

TT=1

OPT
f=0
TT=1.416
T1=1.41
? (problem)

TT=0.96

OPT
f=0
TT=9.393
T1=9.39
OPT
f=0
TT=1.064
T1=1.06
OPT
f=0
TT=2.935
T1=2.93
OPT
f=0
TT=1.119
T1=1.12
OPT
f=0
TT=2.684
T1=1.85
Wrong UNSAT

TT=2.586

OPT
f=0
TT=2.264
T1=1.49
?

TT=1798.32

No data? (TO)

TT=1800.2

OPT
f=0
TT=4.452
T1=2.38
OPT
f=0
TT=1642.32
T1=1642.55
No dataOPT
f=0
TT=5.592
T1=2.43
OPT
f=0
TT=1596.46
T1=1596.67
OPT
f=0
TT=0.761
T1=0.76
OPT
f=0
TT=1.017
T1=1.01
OPT
f=0
TT=1.012
T1=1.01
No dataNo dataNo dataOPT
f=0
TT=0.641
T1=0.32
No dataNo dataOPT
f=0
TT=0.481
T1=0.25
No dataNo dataNo dataOPT
f=0
TT=2.795
T1=0.89
OPT
f=0
TT=2.484
T1=1.74
OPT
f=0
TT=2.854
T1=1.78
?

TT=1796.77

?

TT=1796.76

?

TT=1796.72

OPT
f=0
TT=6.14
T1=6.15
OPT
f=0
TT=6.006
T1=6
OPT
f=0
TT=0.179
T1=0.17
No dataNo dataOPT
f=0
TT=0.178
T1=0.17
/OPT-SMALLINT-LIN/
heinz/normalized-bnatt400.opb
OPT
f=1
TT=0.759
T1=0.52
OPT
f=1
TT=9.074
T1=7.91
No dataOPT
f=1
TT=0.759
T1=0.52
OPT
f=1
TT=2.403
T1=1.74
OPT
f=1
TT=1.267
T1=0.78
? (problem)

TT=1.65

? (problem)

TT=0.167

? (problem)

TT=1.67

? (problem)

TT=0.168

? (problem)

TT=1.65

? (problem)

TT=0.17

OPT
f=1
TT=22.487
T1=19.26
OPT
f=1
TT=1.203
T1=1.01
OPT
f=1
TT=4.787
T1=3.29
OPT
f=1
TT=2.944
T1=1.88
OPT
f=1
TT=4.233
T1=3.05
Wrong UNSAT

TT=2.199

OPT
f=1
TT=4.122
T1=2.96
?

TT=1796.96

No data? (TO)

TT=1800.27

SAT
f=1
TT=8.135
T1=3.4
?

TT=1789.89

No dataSAT
f=1
TT=5.746
T1=1.93
?

TT=1796.78

OPT
f=1
TT=0.959
T1=0.95
OPT
f=1
TT=3.713
T1=2.34
OPT
f=1
TT=3.687
T1=2.32
No dataNo dataNo dataOPT
f=1
TT=1.364
T1=0.69
No dataNo dataOPT
f=1
TT=1.613
T1=0.81
No dataNo dataNo dataOPT
f=1
TT=6.042
T1=1.92
OPT
f=1
TT=3.104
T1=2.01
OPT
f=1
TT=2.923
T1=1.93
?

TT=1796.75

?

TT=1796.77

?

TT=1796.76

OPT
f=1
TT=4.581
T1=2.96
OPT
f=1
TT=4.56
T1=2.93
OPT
f=1
TT=1.863
T1=1.86
No dataNo dataOPT
f=1
TT=1.85
T1=1.84
/OPT-SMALLINT-LIN/
heinz/normalized-datt256.opb




? (TO)

TT=1800.05

No data? (TO)

TT=1800.05

? (problem)

TT=1094.52

? (MO)

TT=127.07

? (problem)

TT=1069.58

? (MO)

TT=124.84

? (problem)

TT=1034

? (MO)

TT=120.89

? (problem)

TT=1177.86

? (MO)

TT=122.33

Signal

TT=834.7

? (TO)

TT=1800.1

? (TO)

TT=1802.84

? (TO)

TT=1800.02

? (exit code)

TT=170.758

?

TT=1798.18

? (TO)

TT=1800.01

?

TT=1796.27

No data? (TO)

TT=1800.02

? (TO)

TT=1800.64

?

TT=1791

No data? (TO)

TT=1800.65

?

TT=1797.86

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.13

No dataNo data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.18

? (TO)

TT=1801.07

? (TO)

TT=1800.46

?

TT=1798.54

?

TT=1798.64

?

TT=1798.57

? (TO)

TT=1800.1

? (TO)

TT=1800.09

?

TT=1799.66

No dataNo data?

TT=1799.68

/OPT-SMALLINT-LIN/heinz/
normalized-ex1010-pi.opb
SAT
f=238
TT=1796.84
T1=1054.48
SAT
f=496
TT=1798.39
T1=28.85
No data? (TO)

TT=1800.03

? (TO)

TT=1800.17

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.14

? (TO)

TT=1800.07

SAT (TO)
f=254
TT=1800.1
T1=639.85
SAT (TO)
f=643
TT=1800.13
T1=0.6
SAT (TO)
f=434
TT=1802.04
T1=49.97
SAT
f=445
TT=1783.01
T1=2.62
SAT (TO)
f=641
TT=1801.16
T1=1.01
SAT
f=496
TT=1798.88
T1=28.58
SAT (TO)
f=641
TT=1800.04
T1=1.05
SAT
f=239
TT=1794.73
T1=1592.15
No data? (TO)

TT=1800.38

SAT (TO)
f=457
TT=1800.07
T1=823.38
SAT
f=274
TT=1789.85
T1=586.44
No dataSAT (TO)
f=461
TT=1800.73
T1=522.65
SAT
f=242
TT=1796.86
T1=1484.37
SAT (TO)
f=643
TT=1800.06
T1=1800.61
? (TO)

TT=1800.13

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=479
TT=1800.07
T1=900.31
No dataNo dataSAT (TO)
f=511
TT=1800.04
T1=900.31
No dataNo dataNo dataSAT (TO)
f=547
TT=1800.43
T1=683.96
SAT (TO)
f=641
TT=1800.08
T1=0.66
SAT (TO)
f=641
TT=1800.07
T1=0.6
SAT
f=238
TT=1796.85
T1=1054.48
SAT
f=238
TT=1796.84
T1=1065.77
SAT
f=238
TT=1796.86
T1=1056.09
? (TO)

TT=1800.1

? (TO)

TT=1800.07

?

TT=1799.43

No dataNo data?

TT=1799.43

/OPT-SMALLINT-LIN/heinz/
normalized-ex9.opb
OPT
f=81
TT=0.447
T1=0.21
OPT
f=81
TT=18.678
T1=18.67
No dataOPT
f=81
TT=0.447
T1=0.21
OPT
f=81
TT=34.687
T1=7.55
OPT
f=81
TT=9.219
T1=1.44
OPT
f=81
TT=41.117
T1=7.58
OPT
f=81
TT=8.286
T1=1.43
OPT
f=81
TT=11.935
T1=6.72
OPT
f=81
TT=2.591
T1=1.39
OPT
f=81
TT=14.282
T1=8.57
OPT
f=81
TT=2.842
T1=1.44
OPT
f=81
TT=15.955
T1=15.95
OPT
f=81
TT=31.066
T1=3.63
OPT
f=81
TT=8.121
T1=5.23
OPT
f=81
TT=3.334
T1=1.91
OPT
f=81
TT=3.194
T1=1.41
OPT
f=81
TT=17.719
T1=17.72
OPT
f=81
TT=3.014
T1=1.32
OPT
f=81
TT=109.828
T1=109.72
No data?

TT=1799.09

OPT
f=81
TT=5.604
T1=2.18
OPT
f=81
TT=133.52
T1=133.44
No dataOPT
f=81
TT=3.594
T1=1.69
OPT
f=81
TT=113.499
T1=113.41
OPT
f=81
TT=1.886
T1=1.87
OPT
f=81
TT=36.811
T1=5.78
OPT
f=81
TT=9.084
T1=5.61
No dataNo dataNo dataOPT
f=81
TT=1.783
T1=1.09
No dataNo dataOPT
f=81
TT=1.905
T1=1.16
No dataNo dataNo dataOPT
f=81
TT=4.252
T1=1.69
OPT
f=81
TT=3.164
T1=1.21
OPT
f=81
TT=2.625
T1=1.2
OPT
f=81
TT=23.52
T1=23.41
OPT
f=81
TT=26.062
T1=25.9
OPT
f=81
TT=21.175
T1=21.04
OPT
f=81
TT=25.291
T1=17.72
OPT
f=81
TT=26.016
T1=17.97
?

TT=1799.58

No dataNo data?

TT=1799.56

/OPT-SMALLINT-LIN/heinz/
normalized-f2000.opb




?

TT=1798.01

No data? (TO)

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1802.11

? (TO)

TT=1800.09

? (TO)

TT=1800.53

?

TT=1798

? (TO)

TT=1800.07

?

TT=1792.65

No data? (TO)

TT=1800.34

? (TO)

TT=1800.5

?

TT=1793.04

No data? (TO)

TT=1800.08

?

TT=1796.85

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.1

No dataNo data? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.8

? (TO)

TT=1801.1

? (TO)

TT=1800.08

?

TT=1796.76

?

TT=1796.75

?

TT=1796.79

? (TO)

TT=1800.1

? (TO)

TT=1800.08

?

TT=1799.54

No dataNo data?

TT=1799.53

/OPT-SMALLINT-LIN/heinz/
normalized-go19.opb
SAT
f=84
TT=1796.78
T1=60.2
SAT
f=94
TT=1798
T1=0
No dataSAT (TO)
f=96
TT=1800.02
T1=1037.47
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.06

SAT (TO)
f=95
TT=1800.11
T1=0.01
SAT (TO)
f=92
TT=1800.1
T1=706.26
SAT (TO)
f=96
TT=1802.11
T1=706.46
SAT
f=95
TT=1783.01
T1=668.25
SAT (TO)
f=120
TT=1800.04
T1=0.43
SAT
f=94
TT=1798
T1=0
SAT (TO)
f=121
TT=1800.76
T1=0.41
SAT (TO)
f=84
TT=1800.16
T1=43.47
No data? (TO)

TT=1800.12

SAT (TO)
f=97
TT=1800.6
T1=882.82
SAT
f=107
TT=1789.74
T1=119.64
No dataSAT (TO)
f=99
TT=1800.13
T1=195.48
SAT
f=84
TT=1796.79
T1=100.28
SAT (TO)
f=93
TT=1800.08
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=95
TT=1800.1
T1=900.31
No dataNo dataSAT (TO)
f=95
TT=1800.06
T1=900.21
No dataNo dataNo dataSAT (TO)
f=104
TT=1800.15
T1=56.15
SAT (TO)
f=129
TT=1800.06
T1=1317.97
SAT (TO)
f=95
TT=1800.03
T1=0.21
SAT
f=84
TT=1796.85
T1=60.73
SAT
f=84
TT=1796.78
T1=60.2
SAT
f=84
TT=1796.85
T1=60.35
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.51

No dataNo data?

TT=1799.92

/OPT-SMALLINT-LIN/heinz/
normalized-iis-pima-cov.opb
OPT
f=33
TT=848.205
T1=135.43
SAT
f=39
TT=1799.22
T1=21.03
No dataSAT (TO)
f=71
TT=1800.11
T1=726.15
? (TO)

TT=1800.06

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.12

SAT (TO)
f=36
TT=1800.08
T1=859.89
SAT (TO)
f=44
TT=1800.11
T1=0.38
SAT (TO)
f=86
TT=1802.05
T1=198.66
SAT
f=87
TT=1783.01
T1=0.25
SAT (TO)
f=42
TT=1800.47
T1=0.5
SAT
f=39
TT=1798.11
T1=20.43
SAT (TO)
f=42
TT=1800.28
T1=0.5
OPT
f=33
TT=1396.96
T1=508.88
No data? (TO)

TT=1800.31

SAT (TO)
f=38
TT=1801.35
T1=8.44
SAT
f=37
TT=1789.73
T1=1327.9
No dataSAT (TO)
f=40
TT=1800.84
T1=2.93
OPT
f=33
TT=848.205
T1=135.43
SAT (TO)
f=44
TT=1800.09
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=43
TT=1800.36
T1=900.31
No dataNo dataSAT (TO)
f=43
TT=1800.1
T1=900.41
No dataNo dataNo dataSAT (TO)
f=39
TT=1800.62
T1=3.94
SAT (TO)
f=41
TT=1800.72
T1=0.61
SAT (TO)
f=44
TT=1800.03
T1=0.41
OPT
f=33
TT=1138.13
T1=597.28
OPT
f=33
TT=1126.19
T1=592.05
OPT
f=33
TT=1137.25
T1=598.45
? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.41

No dataNo data?

TT=1799.5

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/heinz/
normalized-methanosarcina.opb
SAT
f=2816
TT=1796.76
T1=1408.61
SAT
f=3243
TT=1798.02
T1=10.62
No dataSAT (TO)
f=3072
TT=1800.09
T1=642.92
? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.09

SAT (TO)
f=3095
TT=1800.04
T1=175.82
SAT (TO)
f=3926
TT=1800.13
T1=142.3
SAT (TO)
f=3416
TT=1802
T1=18.32
SAT
f=3282
TT=1783.01
T1=9.37
No Cert.

TT=218.371

SAT
f=3243
TT=1798.02
T1=9.37
SAT (TO)
f=3137
TT=1800.31
T1=3.13
SAT
f=3515
TT=1794.93
T1=1198.17
No dataSAT
f=3006
TT=1798.9
T1=1799.12
SAT (TO)
f=3170
TT=1801.07
T1=71.68
SAT
f=3394
TT=1789.82
T1=1620.8
No dataSAT (TO)
f=3097
TT=1800.12
T1=249.37
? (TO)

TT=1802.08

SAT (TO)
f=3782
TT=1800.01
T1=1800.61
? (TO)

TT=1800.04

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=3161
TT=1800.17
T1=900.41
No dataNo dataSAT (TO)
f=3239
TT=1800.1
T1=900.31
No dataNo dataNo dataSAT (TO)
f=3321
TT=1800.2
T1=1.54
SAT (TO)
f=3195
TT=1800.01
T1=0.61
SAT (TO)
f=3147
TT=1800.07
T1=784.64
SAT
f=2816
TT=1796.76
T1=1424.29
SAT
f=2816
TT=1796.79
T1=1408.61
SAT
f=2816
TT=1796.78
T1=1440.17
? (TO)

TT=1800.17

? (TO)

TT=1800.07

?

TT=1799.6

No dataNo data?

TT=1799.95

/OPT-SMALLINT-LIN/heinz/
normalized-mspp16.opb
OPT
f=33
TT=190.345
T1=78.7
SAT (TO)
f=39
TT=1800.08
T1=1483.38
No data? (TO)
f=33
TT=1800.03
T1=177.66
? (MO)

TT=157.72

? (problem)

TT=211.658

? (MO)

TT=155.4

? (problem)

TT=212.861

? (MO)

TT=156.47

? (problem)

TT=211.411

? (MO)

TT=157

? (problem)

TT=210.271

SAT (TO)
f=43
TT=1800.07
T1=418.81
Signal

TT=334.61

SAT (TO)
f=45
TT=1802.58
T1=192.68
SAT
f=35
TT=1783.06
T1=89.75
? (TO)

TT=1802.46

SAT
f=39
TT=1798.03
T1=1229.97
SAT (TO)
f=39
TT=1801.03
T1=46.67
? (TO)

TT=1802.21

No data? (exit code)

TT=396.533

SAT (TO)
f=33
TT=1800.21
T1=358.98
?

TT=1793.98

No dataSAT (TO)
f=33
TT=1800.67
T1=507.95
? (TO)

TT=1800.19

? (exit code)

TT=272.738

? (MO)

TT=137.28

? (MO)

TT=137.83

No dataNo dataNo dataOPT
f=33
TT=407.721
T1=217.3
No dataNo dataOPT
f=33
TT=415.174
T1=219.71
No dataNo dataNo dataSAT (TO)
f=33
TT=1800.91
T1=78.7
SAT (TO)
f=35
TT=1800.09
T1=44.18
SAT (TO)
f=42
TT=1800.05
T1=668.65
SAT (TO)
f=33
TT=1800.32
T1=806.81
SAT (TO)
f=33
TT=1800.32
T1=785.7
SAT (TO)
f=33
TT=1800.38
T1=813.94
? (TO)

TT=1800.2

? (TO)

TT=1800.12

OPT
f=33
TT=190.594
T1=190.39
No dataNo dataOPT
f=33
TT=190.345
T1=189.96
/OPT-SMALLINT-LIN/heinz/
normalized-neos-1109824.opb
OPT
f=378
TT=84.446
T1=14.53
SAT
f=584
TT=1798.01
T1=53.7
No dataSAT (TO)
f=474
TT=1800.12
T1=0.1
? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.06

SAT (TO)
f=593
TT=1800.07
T1=1642.73
SAT (TO)
f=522
TT=1800.11
T1=824.92
SAT (TO)
f=574
TT=1854.44
T1=717.12
SAT
f=532
TT=1783.01
T1=500.56
? (exit code)

TT=501.189

SAT
f=590
TT=1798.06
T1=83.53
SAT (TO)
f=572
TT=1800.78
T1=125.75
OPT
f=378
TT=396.996
T1=62.64
No dataOPT
f=378
TT=84.446
T1=28.64
SAT (TO)
f=441
TT=1801.13
T1=1.57
OPT
f=378
TT=221.595
T1=17.72
No dataSAT (TO)
f=431
TT=1800.11
T1=505.65
OPT
f=378
TT=364.791
T1=14.53
SAT (TO)
f=546
TT=1800.03
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=556
TT=1800.56
T1=900.41
No dataNo dataSAT (TO)
f=541
TT=1800.09
T1=900.41
No dataNo dataNo dataSAT (TO)
f=404
TT=1800.02
T1=2.13
SAT (TO)
f=406
TT=1800.51
T1=71.15
SAT (TO)
f=550
TT=1800.09
T1=1629.62
OPT
f=378
TT=267.587
T1=30.32
OPT
f=378
TT=261.241
T1=29.68
OPT
f=378
TT=256.07
T1=25.29
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.61

No dataNo data?

TT=1799.51

/OPT-SMALLINT-LIN/heinz/
normalized-neos-1440225.opb
OPT
f=36
TT=3.204
T1=0.93
OPT
f=36
TT=377.019
T1=377.12
No dataOPT
f=36
TT=508.675
T1=0.93
? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.08

OPT
f=36
TT=545.746
T1=546.05
SAT (TO)
f=36
TT=1800.03
T1=113.95
SAT (TO)
f=36
TT=1802.11
T1=14.14
SAT
f=36
TT=1783.01
T1=22.07
SAT (TO)
f=36
TT=1800.01
T1=5.82
OPT
f=36
TT=986.366
T1=986.61
SAT (TO)
f=36
TT=1800.17
T1=14.4
OPT
f=36
TT=334.314
T1=334.36
No data? (TO)

TT=1800.28

SAT (TO)
f=36
TT=1801.05
T1=39.37
OPT
f=36
TT=1299.17
T1=1299.36
No dataSAT (TO)
f=36
TT=1800.07
T1=38.54
OPT
f=36
TT=400.928
T1=400.98
SAT (TO)
f=36
TT=1800.05
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=36
TT=6.755
T1=3.38
No dataNo dataOPT
f=36
TT=3.204
T1=1.61
No dataNo dataNo dataSAT (TO)
f=36
TT=1800.68
T1=26.37
SAT (TO)
f=36
TT=1800.06
T1=2.12
SAT (TO)
f=36
TT=1800.08
T1=4.45
OPT
f=36
TT=294.676
T1=294.71
OPT
f=36
TT=417.294
T1=417.35
OPT
f=36
TT=383.174
T1=383.22
? (TO)

TT=1800.1

? (TO)

TT=1800.09

OPT
f=36
TT=129.923
T1=129.91
No dataNo dataOPT
f=36
TT=125.23
T1=125.36
/OPT-SMALLINT-LIN/heinz/
normalized-neos-1616732.opb
SAT
f=159
TT=1789.91
T1=306.04
SAT
f=162
TT=1798
T1=79.59
No dataSAT (TO)
f=161
TT=1800.02
T1=96.02
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.12

SAT (TO)
f=162
TT=1800.01
T1=1583.79
SAT (TO)
f=161
TT=1800.1
T1=206.82
SAT (TO)
f=162
TT=1802.11
T1=275.05
SAT
f=162
TT=1783.01
T1=66.21
SAT (TO)
f=163
TT=1800.55
T1=1259.2
SAT
f=164
TT=1798
T1=20.5
SAT (TO)
f=164
TT=1800.03
T1=2.79
SAT (TO)
f=159
TT=1800.11
T1=1135.22
No data? (TO)

TT=1800.37

SAT (TO)
f=162
TT=1800.89
T1=32.33
SAT
f=159
TT=1789.91
T1=306.04
No dataSAT (TO)
f=162
TT=1801.16
T1=18.39
SAT
f=160
TT=1796.95
T1=65.47
SAT (TO)
f=161
TT=1800.11
T1=1800.4
? (TO)

TT=1800.09

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=162
TT=1800.45
T1=900.31
No dataNo dataSAT (TO)
f=162
TT=1800.1
T1=900.31
No dataNo dataNo dataSAT (TO)
f=164
TT=1800.61
T1=33.77
SAT (TO)
f=165
TT=1800.04
T1=198.34
SAT (TO)
f=162
TT=1800.01
T1=62.73
SAT
f=159
TT=1796.87
T1=576.71
SAT
f=159
TT=1796.92
T1=569.15
SAT
f=159
TT=1796.91
T1=753.06
? (TO)

TT=1800.1

? (TO)

TT=1800.05

?

TT=1799.8

No dataNo data?

TT=1799.53

/OPT-SMALLINT-LIN/heinz/
normalized-neos18.opb
OPT
f=16
TT=0.047
T1=0.02
OPT
f=16
TT=0.823
T1=0.09
No dataOPT
f=16
TT=0.052
T1=0.02
OPT
f=16
TT=0.332
T1=0.29
OPT
f=16
TT=0.195
T1=0.17
? (problem)

TT=0.12

? (problem)

TT=0.092

? (problem)

TT=0.121

? (problem)

TT=0.082

? (problem)

TT=0.115

? (problem)

TT=0.09

OPT
f=16
TT=1.552
T1=0.1
OPT
f=16
TT=0.132
T1=0.09
OPT
f=16
TT=2.437
T1=2.1
OPT
f=16
TT=0.391
T1=0.13
OPT
f=16
TT=1.534
T1=0.61
OPT
f=16
TT=0.552
T1=0.08
OPT
f=16
TT=1.354
T1=0.48
OPT
f=16
TT=113.192
T1=40.78
No dataOPT
f=16
TT=165.794
T1=48.89
OPT
f=16
TT=2.837
T1=4.46
OPT
f=16
TT=129.798
T1=50.93
No dataOPT
f=16
TT=2.604
T1=2.47
OPT
f=16
TT=123.194
T1=44.49
OPT
f=16
TT=0.047
T1=0.04
OPT
f=16
TT=0.213
T1=0.15
OPT
f=16
TT=0.211
T1=0.15
No dataNo dataNo dataOPT
f=16
TT=0.133
T1=0.07
No dataNo dataOPT
f=16
TT=0.142
T1=0.08
No dataNo dataNo dataOPT
f=16
TT=2.625
T1=0.93
OPT
f=16
TT=1.344
T1=0.43
OPT
f=16
TT=1.244
T1=0.49
OPT
f=16
TT=90.338
T1=36.64
OPT
f=16
TT=87.683
T1=35.76
OPT
f=16
TT=103.308
T1=53.22
OPT
f=16
TT=0.641
T1=0.15
OPT
f=16
TT=0.642
T1=0.16
OPT
f=16
TT=0.102
T1=0.09
No dataNo dataOPT
f=16
TT=0.11
T1=0.1
/OPT-SMALLINT-LIN/heinz/
normalized-neos-538867.opb
OPT
f=122
TT=58.879
T1=18.13
SAT
f=167
TT=1798
T1=1289.93
No dataOPT
f=122
TT=154.229
T1=52.68
OPT
f=122
TT=586.273
T1=455.09
OPT
f=122
TT=316.878
T1=316.91
? (problem)

TT=123.79

? (problem)

TT=2.23

? (problem)

TT=122.69

? (problem)

TT=2.18

? (problem)

TT=122.25

? (problem)

TT=2.19

SAT (TO)
f=127
TT=1800.03
T1=688.83
OPT
f=122
TT=131.383
T1=129.14
SAT (TO)
f=127
TT=1802.11
T1=287.62
SAT
f=182
TT=1783.01
T1=0.03
SAT (TO)
f=132
TT=1800.01
T1=314.22
SAT
f=137
TT=1798
T1=1503.61
SAT (TO)
f=162
TT=1800.3
T1=581.74
OPT
f=122
TT=178.215
T1=87.91
No dataOPT
f=122
TT=66.489
T1=20.9
SAT (TO)
f=122
TT=1800.18
T1=112.67
OPT
f=122
TT=68.159
T1=58.39
No dataSAT (TO)
f=122
TT=1800.6
T1=277.41
OPT
f=122
TT=58.879
T1=18.13
OPT
f=122
TT=162.188
T1=162.2
OPT
f=122
TT=563.69
T1=467.14
OPT
f=122
TT=1287.44
T1=1189
No dataNo dataNo dataSAT (TO)
f=122
TT=1800.54
T1=900.31
No dataNo dataSAT (TO)
f=127
TT=1800.12
T1=900.31
No dataNo dataNo dataOPT
f=122
TT=737.073
T1=233.52
OPT
f=122
TT=738.232
T1=588.79
OPT
f=122
TT=1096.48
T1=654.41
OPT
f=122
TT=83.311
T1=52.43
OPT
f=122
TT=78.075
T1=49.65
OPT
f=122
TT=82.909
T1=47.11
? (TO)

TT=1800.03

? (TO)

TT=1800.01

?

TT=1799.64

No dataNo data?

TT=1799.55

/OPT-SMALLINT-LIN/heinz/
normalized-neos-544324.opb
OPT
f=15
TT=465.377
T1=12.49
?

TT=1798.07

No dataSAT (TO)
f=18
TT=1800.1
T1=169.41
? (problem)

TT=45.342

? (MO)

TT=139.57

? (problem)

TT=42.72

? (MO)

TT=134.99

? (problem)

TT=41.15

? (MO)

TT=344.6

? (problem)

TT=43.4

? (MO)

TT=135.4

? (TO)

TT=1800.18

? (TO)

TT=1800.11

? (TO)

TT=1802.02

? (TO)

TT=1800.02

?

TT=1065.37

?

TT=1798.03

? (TO)

TT=1800.04

SAT
f=15
TT=1795.22
T1=116.49
No dataOPT
f=15
TT=465.377
T1=464.86
? (TO)

TT=1800.05

SAT
f=15
TT=1790.04
T1=438.19
No data? (TO)

TT=1800.12

SAT
f=15
TT=1797.04
T1=173.79
? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.07

No dataNo data? (TO)

TT=1800.48

No dataNo dataNo data? (TO)

TT=1800.17

? (TO)

TT=1800.02

? (TO)

TT=1800.06

SAT
f=15
TT=1796.95
T1=12.56
SAT
f=15
TT=1797
T1=12.62
SAT
f=15
TT=1796.98
T1=12.49
? (TO)

TT=1800.04

? (TO)

TT=1800.06

?

TT=1799.98

No dataNo data?

TT=1799.68

/OPT-SMALLINT-LIN/heinz/
normalized-neos-631710.opb
SAT
f=205
TT=1798.04
T1=779.7
SAT
f=205
TT=1798.04
T1=779.7
No data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.05

SAT (TO)
f=203
TT=1800.28
T1=500.77
SAT (TO)
f=224
TT=1800.07
T1=1116.53
? (TO)

TT=1802.02

? (TO)

TT=1800.14

No Cert.

TT=174.557

SAT
f=205
TT=1798.04
T1=1263.37
No Cert.

TT=1096.27

?

TT=1799.98

No data? (TO)

TT=1800.09

No Cert.

TT=1149.06

?

TT=1795.87

No dataSAT (TO)
f=320
TT=1800.61
T1=1202.2
? (TO)

TT=1800.03

No Cert.

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=552
TT=1800.18
T1=900.91
No dataNo dataSAT (TO)
f=439
TT=1800.71
T1=900.81
No dataNo dataNo dataSAT (TO)
f=476
TT=1800.53
T1=860.97
SAT (TO)
f=431
TT=1800.07
T1=1776.39
SAT
f=554
TT=6.153
T1=4.35
SAT (TO)
f=556
TT=1800.19
T1=860.35
SAT (TO)
f=556
TT=1800.35
T1=883.63
SAT (TO)
f=556
TT=1800.32
T1=972.08
? (TO)

TT=1800.08

? (TO)

TT=1800.02

?

TT=1799.65

No dataNo data?

TT=1799.95

/OPT-SMALLINT-LIN/heinz/
normalized-neos-777800.opb
OPT
f=-80
TT=5.245
T1=5.2
SAT
f=-80
TT=1798.01
T1=17.5
No dataSAT (TO)
f=-80
TT=1800.06
T1=49.41
? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.04

Signal

TT=983.951

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

No Cert.

TT=738.182

SAT
f=-80
TT=1798.06
T1=16.09
? (TO)

TT=1800.01

OPT
f=-80
TT=4.024
T1=3.99
No dataOPT
f=-80
TT=9.578
T1=9.53
? (TO)

TT=1802

OPT
f=-80
TT=70.328
T1=70.31
No dataSAT (TO)
f=-80
TT=1800.71
T1=144.35
OPT
f=-80
TT=5.245
T1=5.2
? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.48

No dataNo dataSAT (TO)
f=-80
TT=1800.49
T1=900.31
No dataNo dataNo dataSAT (TO)
f=-80
TT=1800.13
T1=66.29
? (TO)

TT=1800.01

SAT (TO)
f=-80
TT=1800.08
T1=1372.93
OPT
f=-80
TT=21.32
T1=21.28
OPT
f=-80
TT=21.571
T1=21.52
OPT
f=-80
TT=76.675
T1=76.65
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.6

No dataNo data?

TT=1799.95

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/heinz/
normalized-neos-785912.opb
UNSAT

TT=0.929

UNSAT

TT=1045.61

No dataUNSAT

TT=12.331

UNSAT

TT=1.317

UNSAT

TT=5.518

UNSAT

TT=1.26

UNSAT

TT=5.57

UNSAT

TT=1.27

UNSAT

TT=5.54

UNSAT

TT=1.26

UNSAT

TT=5.66

? (TO)

TT=1800.11

UNSAT

TT=126.518

UNSAT

TT=24.061

UNSAT

TT=1373.41

UNSAT

TT=10.033

UNSAT

TT=867.411

UNSAT

TT=7.314

UNSAT

TT=133.812

No data? (TO)

TT=1800.22

UNSAT

TT=31.748

UNSAT

TT=172.135

No dataUNSAT

TT=31.24

UNSAT

TT=83.251

UNSAT

TT=85.823

UNSAT

TT=0.929

UNSAT

TT=0.933

No dataNo dataNo dataUNSAT

TT=91.332

No dataNo dataUNSAT

TT=105.209

No dataNo dataNo dataUNSAT

TT=18.771

UNSAT

TT=9.544

UNSAT

TT=8.743

UNSAT

TT=155.033

UNSAT

TT=154.628

UNSAT

TT=76.841

UNSAT

TT=40.793

UNSAT

TT=40.775

UNSAT

TT=317.71

No dataNo dataUNSAT

TT=291.6

/OPT-SMALLINT-LIN/heinz/
normalized-neos-807456.opb




?

TT=1798.01

No data? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.12

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.15

? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1798

? (TO)

TT=1800.28

?

TT=1797.17

No data? (TO)

TT=1800.03

? (TO)

TT=1801.18

?

TT=1789.76

No data? (TO)

TT=1800.2

?

TT=1796.75

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.19

No dataNo data? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.84

? (TO)

TT=1800

? (TO)

TT=1800.54

?

TT=1796.75

?

TT=1796.76

?

TT=1796.75

? (TO)

TT=1800.08

? (TO)

TT=1800.06

?

TT=1799.44

No dataNo data?

TT=1799.82

/OPT-SMALLINT-LIN/heinz/
normalized-neos-859770.opb
UNSAT

TT=134.834

?

TT=1798.07

No data? (TO)

TT=1800.12

UNSAT

TT=548.802

UNSAT

TT=241.056

UNSAT

TT=532.01

UNSAT

TT=244.6

UNSAT

TT=704.7

UNSAT

TT=241.48

UNSAT

TT=711.87

UNSAT

TT=246.13

? (TO)

TT=1800.11

UNSAT

TT=1403.76

? (TO)

TT=1802.12

? (TO)

TT=1800.02

UNSAT

TT=208

?

TT=1798.09

UNSAT

TT=350.74

UNSAT

TT=61.928

No dataUNSAT

TT=134.834

? (TO)

TT=1800.78

?

TT=1789.79

No data? (TO)

TT=1800.13

UNSAT

TT=1241.8

UNSAT

TT=1196.56

UNSAT

TT=793.191

UNSAT

TT=563.727

No dataNo dataNo data? (TO)

TT=1800.34

No dataNo data? (TO)

TT=1800.36

No dataNo dataNo dataUNSAT

TT=1454.09

? (TO)

TT=1800.02

UNSAT

TT=107.54

UNSAT

TT=522.883

UNSAT

TT=526.387

UNSAT

TT=466.429

? (TO)

TT=1800.08

? (TO)

TT=1800.08

?

TT=1799.66

No dataNo data?

TT=1800.06

/OPT-SMALLINT-LIN/heinz/
normalized-ns1696083.opb
OPT
f=45
TT=226.602
T1=104.09
SAT
f=47
TT=1798.03
T1=305.24
No dataOPT
f=45
TT=226.602
T1=104.09
? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

SAT (TO)
f=47
TT=1800.08
T1=619.91
SAT (TO)
f=47
TT=1800.11
T1=1308.91
SAT (TO)
f=45
TT=1802.09
T1=811.43
SAT
f=46
TT=1783.02
T1=1360.03
SAT (TO)
f=46
TT=1800.06
T1=667.5
SAT
f=48
TT=1798.07
T1=1794.53
SAT (TO)
f=47
TT=1800.05
T1=907.24
?

TT=1795.77

No data? (TO)

TT=1800.08

SAT (TO)
f=47
TT=1801.08
T1=297.61
?

TT=1790.22

No dataSAT (TO)
f=46
TT=1800.17
T1=391.45
?

TT=1797.31

SAT (TO)
f=47
TT=1800.03
T1=1800.5
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=47
TT=1800.15
T1=900.61
No dataNo dataSAT (TO)
f=47
TT=1800.65
T1=900.51
No dataNo dataNo dataSAT (TO)
f=46
TT=1800.16
T1=393.41
OPT
f=45
TT=1283.7
T1=777.33
SAT (TO)
f=45
TT=1800.04
T1=442.59
?

TT=1796.82

?

TT=1796.83

?

TT=1796.87

? (TO)

TT=1800.06

? (TO)

TT=1800.08

?

TT=1799.59

No dataNo data?

TT=1799.6

/OPT-SMALLINT-LIN/heinz/
normalized-ns1745726.opb
UNSAT

TT=0.943

UNSAT

TT=3.252

No dataUNSAT

TT=0.943

UNSAT

TT=35.727

UNSAT

TT=23.519

UNSAT

TT=35.26

UNSAT

TT=30.05

UNSAT

TT=34.84

UNSAT

TT=23.84

UNSAT

TT=29.04

UNSAT

TT=24.07

UNSAT

TT=2.306

UNSAT

TT=38.008

UNSAT

TT=3.523

UNSAT

TT=11.363

UNSAT

TT=4.692

UNSAT

TT=2.827

UNSAT

TT=4.972

UNSAT

TT=1142.34

No dataUNSAT

TT=687.914

UNSAT

TT=19.411

UNSAT

TT=356.432

No dataUNSAT

TT=16.093

UNSAT

TT=142.955

UNSAT

TT=23.468

UNSAT

TT=24.794

UNSAT

TT=24.266

No dataNo dataNo dataUNSAT

TT=17.044

No dataNo dataUNSAT

TT=14.203

No dataNo dataNo dataUNSAT

TT=9.723

UNSAT

TT=3.763

UNSAT

TT=4.236

UNSAT

TT=12.388

UNSAT

TT=14.132

UNSAT

TT=34.867

UNSAT

TT=86.21

UNSAT

TT=86.725

UNSAT

TT=24.39

No dataNo dataUNSAT

TT=24.404

/OPT-SMALLINT-LIN/heinz/
normalized-ns1853823.opb
SAT
f=123
TT=1800.87
T1=248.33
SAT
f=142
TT=1798.05
T1=8.81
No data? (TO)

TT=1800.09

? (problem)

TT=149.338

? (TO)

TT=1800.09

? (problem)

TT=144.531

? (TO)

TT=1800.01

? (problem)

TT=132.818

? (TO)

TT=1800.02

? (problem)

TT=135.759

? (TO)

TT=1800.08

SAT (TO)
f=149
TT=1800.07
T1=8.22
? (TO)

TT=1800.08

? (TO)

TT=1802.1

? (TO)

TT=1800.06

? (exit code)

TT=1256.27

SAT
f=142
TT=1798.04
T1=8.2
? (TO)

TT=1802.58

?

TT=1799.9

No data?

TT=1799.29

SAT (TO)
f=1452
TT=1800.73
T1=341.33
?

TT=1794.6

No dataSAT (TO)
f=1452
TT=1800.14
T1=341.44
? (TO)

TT=1802.12

? (TO)

TT=1800.05

? (MO)

TT=98.71

? (MO)

TT=102.84

No dataNo dataNo dataSAT (TO)
f=368
TT=1800.44
T1=901.41
No dataNo dataSAT (TO)
f=368
TT=1800.15
T1=901.71
No dataNo dataNo dataSAT (TO)
f=123
TT=1800.87
T1=248.33
SAT (TO)
f=315
TT=1800.08
T1=670.95
SAT (TO)
f=145
TT=1800.67
T1=9.6
?

TT=1799.94

?

TT=1799.93

?

TT=1800.02

? (TO)

TT=1800.07

? (TO)

TT=1800.07

?

TT=1799.94

No dataNo data?

TT=1799.77

/OPT-SMALLINT-LIN/
heinz/normalized-ns894244.opb
SAT
f=16
TT=1783.02
T1=1014.46
?

TT=1798

No data? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1801.95

SAT
f=16
TT=1783.02
T1=1014.46
? (TO)

TT=1800.08

?

TT=1798.02

? (exit code)

TT=1032.15

?

TT=1793.9

No data? (TO)

TT=1800.18

? (TO)

TT=1800.67

?

TT=1790.62

No data? (TO)

TT=1800.77

?

TT=1796.82

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.16

? (TO)

TT=1800.53

? (TO)

TT=1800.09

?

TT=1796.86

?

TT=1796.79

?

TT=1796.82

? (TO)

TT=1800.11

? (TO)

TT=1800.03

?

TT=1799.47

No dataNo data?

TT=1799.78

/OPT-SMALLINT-LIN/
heinz/normalized-ns894788.opb
OPT
f=7
TT=180.313
T1=170.14
?

TT=1798.04

No data? (TO)

TT=1800.03

? (TO)

TT=1800.12

OPT
f=7
TT=180.313
T1=170.14
? (TO)

TT=1800.1

? (problem)

TT=173.74

? (TO)

TT=1800.06

? (problem)

TT=171.55

? (TO)

TT=1800.05

? (problem)

TT=171.18

? (TO)

TT=1800.16

? (TO)

TT=1800.09

? (TO)

TT=1802.08

? (TO)

TT=1800.05

? (TO)

TT=1800.39

?

TT=1798.1

? (TO)

TT=1800.41

? (TO)

TT=1800.14

No dataOPT
f=7
TT=1147.16
T1=333.16
? (TO)

TT=1800.7

OPT
f=7
TT=1135.55
T1=1135.71
No data? (TO)

TT=1800.76

?

TT=1796.77

? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.19

No dataNo data? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.67

? (TO)

TT=1800.62

? (TO)

TT=1800.05

OPT
f=7
TT=433.787
T1=433.82
OPT
f=7
TT=426.582
T1=426.61
?

TT=1796.76

? (TO)

TT=1800.04

? (TO)

TT=1800.08

?

TT=1799.47

No dataNo data?

TT=1799.88

/OPT-SMALLINT-LIN/heinz/
normalized-p6b.opb
SAT
f=-63
TT=1796.78
T1=913.31
SAT
f=-54
TT=1798.05
T1=0.02
No dataSAT (TO)
f=-55
TT=1800.11
T1=176.62
? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.09

SAT (TO)
f=-54
TT=1800.09
T1=0.02
SAT (TO)
f=-59
TT=1800.02
T1=240.74
? (TO)

TT=1800.09

SAT
f=-32
TT=1783
T1=1783.29
SAT (TO)
f=-54
TT=1800.57
T1=0.4
SAT
f=-54
TT=1798
T1=0.02
SAT (TO)
f=-54
TT=1800.34
T1=0.37
SAT
f=-62
TT=1797.17
T1=179.6
No data? (TO)

TT=1800.39

SAT (TO)
f=-55
TT=1800.12
T1=16.54
SAT
f=-62
TT=1789.77
T1=525.01
No dataSAT (TO)
f=-55
TT=1800.21
T1=6.39
SAT
f=-63
TT=1796.78
T1=913.31
SAT (TO)
f=-59
TT=1800.09
T1=1800.4
? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=-59
TT=1800.49
T1=900.41
No dataNo dataSAT (TO)
f=-59
TT=1800.17
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-54
TT=1800.2
T1=1.37
SAT (TO)
f=-54
TT=1800.1
T1=0.36
SAT (TO)
f=-53
TT=1800.56
T1=0.52
SAT
f=-62
TT=1796.78
T1=161.46
SAT
f=-62
TT=1796.77
T1=160.11
SAT
f=-62
TT=1796.76
T1=89.72
? (TO)

TT=1800.02

? (TO)

TT=1800.08

?

TT=1799.48

No dataNo data?

TT=1799.71

/OPT-SMALLINT-LIN/
heinz/
normalized-pb-simp-nonunif.opb
OPT
f=42
TT=8.185
T1=7.47
SAT
f=62
TT=1798.01
T1=1247.15
No data? (TO)

TT=1800.01

OPT
f=42
TT=24.794
T1=24.17
? (TO)

TT=1800.02

? (problem)

TT=10.13

? (TO)

TT=1800.01

? (problem)

TT=9.83

? (TO)

TT=1800.04

? (problem)

TT=9.77

? (TO)

TT=1800.06

SAT (TO)
f=64
TT=1800.03
T1=745.24
OPT
f=42
TT=52.579
T1=52.4
SAT (TO)
f=59
TT=1802.01
T1=1028.81
SAT
f=58
TT=1783.02
T1=1561.5
? (exit code)

TT=1135.81

SAT
f=62
TT=1798.01
T1=1231.17
? (exit code)

TT=1688.62

? (TO)

TT=1802.12

No dataSAT
f=88
TT=1799.94
T1=1799.49
SAT (TO)
f=42
TT=1801
T1=214.71
SAT
f=170
TT=1791.05
T1=63.45
No dataSAT (TO)
f=42
TT=1800.2
T1=150.13
SAT
f=170
TT=1798.1
T1=47.11
OPT
f=42
TT=22.975
T1=23.2
OPT
f=42
TT=40.779
T1=31.05
OPT
f=42
TT=218.129
T1=213.44
No dataNo dataNo dataOPT
f=42
TT=15.431
T1=9.54
No dataNo dataOPT
f=42
TT=11.381
T1=7.47
No dataNo dataNo dataSAT (TO)
f=45
TT=1800.13
T1=41.27
SAT (TO)
f=42
TT=1800.04
T1=318.57
SAT (TO)
f=42
TT=1800.73
T1=365.44
SAT
f=170
TT=1798.3
T1=24.48
SAT
f=170
TT=1798.57
T1=20.86
SAT
f=170
TT=1798.09
T1=21.47
SAT
f=43
TT=782.27
T1=573.99
? (TO)

TT=1800.1

OPT
f=42
TT=7.464
T1=7.46
No dataNo dataOPT
f=42
TT=8.185
T1=8.17
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/heinz/
normalized-queens-30.opb
SAT
f=-38
TT=1797.42
T1=134.78
SAT
f=-37
TT=1798.05
T1=748.23
No dataSAT (TO)
f=-38
TT=1800.09
T1=134.78
? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.14

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.04

SAT (TO)
f=-29
TT=1800.11
T1=1056.27
SAT (TO)
f=-35
TT=1800.07
T1=1781.24
? (TO)

TT=1800.09

SAT
f=-27
TT=1783.01
T1=1783.29
SAT (TO)
f=-36
TT=1800.18
T1=2.26
SAT
f=-37
TT=1798.06
T1=1314.89
SAT (TO)
f=-36
TT=1800.51
T1=1.79
SAT
f=-38
TT=1796.48
T1=1695.37
No data? (TO)

TT=1800.2

SAT (TO)
f=-37
TT=1800.08
T1=12.58
SAT
f=-36
TT=1790.13
T1=1460.25
No dataSAT (TO)
f=-37
TT=1800.73
T1=18.28
SAT
f=-36
TT=1798.82
T1=1423.11
SAT (TO)
f=-35
TT=1800.05
T1=1800.4
? (TO)

TT=1800.15

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=-38
TT=1800.03
T1=900.31
No dataNo dataSAT (TO)
f=-38
TT=1800.1
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-37
TT=1800.34
T1=784.65
SAT (TO)
f=-31
TT=1800.05
T1=0.65
SAT (TO)
f=-37
TT=1800.51
T1=68.91
? (TO)

TT=1802.03

SAT
f=-38
TT=1797.42
T1=1750.34
SAT
f=-38
TT=1799.53
T1=1620.97
? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.96

No dataNo data?

TT=1799.98

/OPT-SMALLINT-LIN/
kullmann/
normalized-mul_8_11_shg.opb
SAT
f=72
TT=1798.38
T1=1797.03
SAT
f=193
TT=1798.01
T1=15.2
No data? (TO)

TT=1800.07

? (problem)

TT=47.508

? (problem)

TT=125.029

? (problem)

TT=44.11

? (problem)

TT=125.139

? (problem)

TT=43.77

? (problem)

TT=124.124

? (problem)

TT=43.96

? (problem)

TT=126.49

SAT (TO)
f=193
TT=1800.02
T1=14.01
SAT (TO)
f=195
TT=1800.12
T1=29.91
SAT (TO)
f=814
TT=1801.97
T1=175.75
SAT
f=786
TT=1783.01
T1=16.52
SAT (TO)
f=185
TT=1800.72
T1=9.14
SAT
f=193
TT=1798.2
T1=12.82
SAT (TO)
f=185
TT=1800.03
T1=8.16
? (TO)

TT=1802.09

No data? (TO)

TT=1800.32

SAT (TO)
f=173
TT=1800.11
T1=506.89
SAT
f=80
TT=1790.93
T1=285.3
No dataSAT (TO)
f=179
TT=1800.11
T1=503.47
SAT
f=76
TT=1799.22
T1=1797.84
SAT (TO)
f=195
TT=1800.03
T1=1801.3
? (TO)

TT=1800.01

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=171
TT=1800.57
T1=902.31
No dataNo dataSAT (TO)
f=171
TT=1800.7
T1=902.41
No dataNo dataNo dataSAT (TO)
f=176
TT=1800.61
T1=314.27
SAT (TO)
f=188
TT=1800.06
T1=6.54
SAT (TO)
f=193
TT=1800.08
T1=6.2
SAT
f=72
TT=1798.38
T1=1797.03
SAT
f=72
TT=1798.85
T1=1797.12
SAT
f=72
TT=1798.55
T1=1797.32
? (TO)

TT=1800.09

? (TO)

TT=1800.1

?

TT=1799.59

No dataNo data?

TT=1799.59

/OPT-SMALLINT-LIN/
kullmann/
normalized-mul_8_13_shg.opb
SAT
f=76
TT=1798.19
T1=611.32
SAT
f=161
TT=1798.02
T1=20.1
No data? (TO)

TT=1800.08

? (problem)

TT=47.653

? (problem)

TT=124.622

? (problem)

TT=44.55

? (problem)

TT=123.713

? (problem)

TT=42.63

? (problem)

TT=126.781

? (problem)

TT=42.99

? (problem)

TT=121.647

SAT (TO)
f=161
TT=1800.02
T1=26.28
SAT (TO)
f=153
TT=1800.13
T1=29.43
SAT (TO)
f=711
TT=1802.19
T1=52.98
SAT
f=849
TT=1783.02
T1=13.12
SAT (TO)
f=156
TT=1800.3
T1=8.56
SAT
f=161
TT=1798.1
T1=25.6
SAT (TO)
f=156
TT=1800.78
T1=7.42
? (TO)

TT=1802.11

No data? (TO)

TT=1800.04

SAT (TO)
f=152
TT=1800.1
T1=728.92
SAT
f=82
TT=1790.72
T1=735.75
No dataSAT (TO)
f=152
TT=1800.58
T1=904.07
SAT (TO)
f=76
TT=1801.25
T1=611.32
SAT (TO)
f=153
TT=1800.1
T1=1800.9
? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=153
TT=1800.49
T1=902.11
No dataNo dataSAT (TO)
f=153
TT=1800.42
T1=902.11
No dataNo dataNo dataSAT (TO)
f=155
TT=1800.11
T1=258.67
SAT (TO)
f=156
TT=1800.03
T1=6.53
SAT (TO)
f=162
TT=1800.06
T1=6.01
SAT
f=76
TT=1798.54
T1=1080.98
SAT
f=76
TT=1799.42
T1=990.36
SAT
f=76
TT=1798.19
T1=1081.81
? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.54

No dataNo data?

TT=1799.92

/OPT-SMALLINT-LIN/
kullmann/
normalized-mul_8_14_shg.opb
SAT
f=63
TT=1797.86
T1=674.88
SAT
f=109
TT=1798.01
T1=15.16
No data? (TO)

TT=1800.04

? (problem)

TT=45.5

? (problem)

TT=124.194

? (problem)

TT=42.59

? (problem)

TT=122.327

? (problem)

TT=41.63

? (problem)

TT=123.258

? (problem)

TT=42.18

? (problem)

TT=123.897

SAT (TO)
f=109
TT=1800.04
T1=15.73
SAT (TO)
f=115
TT=1800.04
T1=28.44
SAT (TO)
f=781
TT=1802
T1=66.43
SAT
f=812
TT=1783.02
T1=13.35
SAT (TO)
f=104
TT=1800.91
T1=8.49
SAT
f=109
TT=1798.02
T1=14.58
SAT (TO)
f=104
TT=1800.04
T1=7.14
? (TO)

TT=1802.11

No data? (TO)

TT=1800.04

SAT (TO)
f=103
TT=1800.54
T1=721.58
SAT
f=70
TT=1790.94
T1=375.77
No dataSAT (TO)
f=104
TT=1800.09
T1=9.24
? (TO)

TT=1802.12

SAT (TO)
f=115
TT=1800.02
T1=1800.61
? (TO)

TT=1800.02

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=111
TT=1800.17
T1=902.21
No dataNo dataSAT (TO)
f=111
TT=1800.17
T1=902.11
No dataNo dataNo dataSAT (TO)
f=104
TT=1800.83
T1=10.02
SAT (TO)
f=104
TT=1800.71
T1=6.14
SAT (TO)
f=110
TT=1800.05
T1=5.99
SAT
f=63
TT=1798.13
T1=678.97
SAT
f=63
TT=1798.6
T1=674.88
SAT
f=63
TT=1797.86
T1=675.91
? (TO)

TT=1800.02

? (TO)

TT=1800.08

?

TT=1799.42

No dataNo data?

TT=1800

/OPT-SMALLINT-LIN/
kullmann/normalized-mul_8_3_shg.opb
OPT
f=36
TT=253.091
T1=253.1
SAT
f=44
TT=1798.01
T1=9.25
No dataSAT (TO)
f=188
TT=1800.04
T1=338.71
? (problem)

TT=22.402

? (TO)

TT=1800.06

? (problem)

TT=20.44

? (TO)

TT=1800.09

? (problem)

TT=20.11

? (TO)

TT=1800.08

? (problem)

TT=20.59

? (TO)

TT=1656.89

SAT (TO)
f=44
TT=1800.04
T1=8.52
SAT (TO)
f=45
TT=1800.1
T1=12.93
SAT (TO)
f=265
TT=1802.05
T1=41.63
SAT
f=499
TT=1783.01
T1=8.32
SAT (TO)
f=44
TT=1800.03
T1=3.98
SAT
f=44
TT=1798.01
T1=8.16
SAT (TO)
f=44
TT=1800.31
T1=3.37
? (TO)

TT=1802.03

No dataOPT
f=36
TT=253.091
T1=253.1
SAT (TO)
f=44
TT=1800.14
T1=5.6
SAT
f=38
TT=1790.31
T1=1510.72
No dataSAT (TO)
f=44
TT=1800.16
T1=4.37
SAT
f=40
TT=1797.29
T1=181.43
SAT (TO)
f=45
TT=1800.1
T1=1800.4
? (TO)

TT=1800.1

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=49
TT=1800.47
T1=901.21
No dataNo dataSAT (TO)
f=49
TT=1800.51
T1=901.11
No dataNo dataNo dataSAT (TO)
f=44
TT=1800.19
T1=4.48
SAT (TO)
f=44
TT=1800.6
T1=3.34
SAT (TO)
f=44
TT=1800.54
T1=3.24
SAT
f=36
TT=1797.39
T1=1355.53
SAT
f=36
TT=1797.66
T1=1440.26
SAT
f=36
TT=1797.67
T1=1437.86
? (TO)

TT=1800.05

? (TO)

TT=1800.11

?

TT=1799.96

No dataNo data?

TT=1799.56

/OPT-SMALLINT-LIN/
kullmann/normalized-mul_8_9_shg.opb
SAT
f=48
TT=1790.38
T1=49.12
SAT
f=82
TT=1798.05
T1=11.01
No dataSAT (TO)
f=212
TT=1800.04
T1=1375.65
? (problem)

TT=31.246

? (MO)

TT=159.85

? (problem)

TT=29.58

? (MO)

TT=158.92

? (problem)

TT=29.55

? (MO)

TT=156.14

? (problem)

TT=29.95

? (MO)

TT=156.5

SAT (TO)
f=82
TT=1800.05
T1=11.78
SAT (TO)
f=83
TT=1800.1
T1=19.21
SAT (TO)
f=603
TT=1802.08
T1=51.65
SAT
f=588
TT=1783.01
T1=8.59
SAT (TO)
f=82
TT=1800.09
T1=5.27
SAT
f=82
TT=1798.01
T1=11
SAT (TO)
f=82
TT=1800.31
T1=4.75
SAT
f=52
TT=1799.09
T1=82.73
No data? (TO)

TT=1800.12

SAT (TO)
f=82
TT=1801.01
T1=6.58
SAT
f=48
TT=1790.38
T1=478.52
No dataSAT (TO)
f=81
TT=1800.57
T1=887.32
SAT
f=48
TT=1797.67
T1=49.12
SAT (TO)
f=83
TT=1800.08
T1=1800.8
? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=86
TT=1800.57
T1=901.51
No dataNo dataSAT (TO)
f=86
TT=1800.17
T1=901.61
No dataNo dataNo dataSAT (TO)
f=81
TT=1800.14
T1=458
SAT (TO)
f=82
TT=1800.08
T1=4.5
SAT (TO)
f=83
TT=1800.63
T1=4.48
SAT
f=48
TT=1798.72
T1=60.81
SAT
f=48
TT=1797.81
T1=64.82
SAT
f=48
TT=1797.47
T1=60.16
? (TO)

TT=1800.08

? (TO)

TT=1800.09

?

TT=1799.45

No dataNo data?

TT=1799.39

/OPT-SMALLINT-LIN/
kullmann/normalized-sbox_4_shg.opb
OPT
f=22
TT=0.139
T1=0.12
OPT
f=22
TT=1.632
T1=0.61
No dataSAT (TO)
f=23
TT=1800.03
T1=40.65
? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.1

OPT
f=22
TT=1.117
T1=0.03
SAT (TO)
f=22
TT=1800.02
T1=100.19
SAT (TO)
f=23
TT=1802.11
T1=72.92
OPT
f=22
TT=198.524
T1=52.03
SAT (TO)
f=31
TT=1800.85
T1=0.2
OPT
f=22
TT=1.62
T1=0.6
SAT (TO)
f=31
TT=1800.31
T1=0.22
OPT
f=22
TT=5.047
T1=2.23
No dataOPT
f=22
TT=0.139
T1=0.12
SAT (TO)
f=23
TT=1800.15
T1=108.31
OPT
f=22
TT=4.633
T1=3.14
No dataSAT (TO)
f=23
TT=1800.08
T1=6.03
OPT
f=22
TT=3.412
T1=1.66
SAT (TO)
f=22
TT=1800.11
T1=1800.4
? (TO)

TT=1800.06

? (TO)

TT=1800.01

No dataNo dataNo dataSAT (TO)
f=22
TT=1800.11
T1=900.31
No dataNo dataSAT (TO)
f=22
TT=1800.14
T1=900.31
No dataNo dataNo dataSAT (TO)
f=22
TT=1800.72
T1=639.22
SAT (TO)
f=29
TT=1800.07
T1=1.43
SAT (TO)
f=30
TT=1800.03
T1=0.23
OPT
f=22
TT=2.277
T1=1.26
OPT
f=22
TT=2.245
T1=1.24
OPT
f=22
TT=1.955
T1=0.99
? (TO)

TT=1800.03

? (TO)

TT=1800.03

?

TT=1799.52

No dataNo data?

TT=1799.63

/OPT-SMALLINT-LIN/
kullmann/normalized-sbox_8_shg.opb
SAT
f=655
TT=1800.93
T1=99.72
SAT
f=668
TT=1798.11
T1=292.57
No data? (TO)

TT=1800.07

? (MO)

TT=162.6

? (MO)

TT=1076.5

? (MO)

TT=162.8

? (MO)

TT=1033.15

? (MO)

TT=160.06

? (MO)

TT=1035.38

? (MO)

TT=162.22

? (MO)

TT=1036.66

SAT (TO)
f=662
TT=1800.13
T1=259.52
Signal

TT=397.935

? (TO)

TT=1802.04

SAT
f=775
TT=1783.06
T1=159.06
SAT (TO)
f=844
TT=1804.08
T1=99.38
SAT
f=668
TT=1798.35
T1=293.09
SAT (TO)
f=844
TT=1800.02
T1=95.06
? (TO)

TT=1802.6

No data? (TO)

TT=1800.01

? (TO)

TT=1802.3

? (MO)

TT=132.108

No dataSAT (TO)
f=655
TT=1800.93
T1=99.72
Signal

TT=121.747

? (exit code)

TT=30.2

? (MO)

TT=138.95

? (MO)

TT=140.11

No dataNo dataNo dataSAT (TO)
f=692
TT=1800.64
T1=930.01
No dataNo dataSAT (TO)
f=692
TT=1800.18
T1=929.31
No dataNo dataNo dataSAT (TO)
f=842
TT=1800.49
T1=482.26
SAT (TO)
f=844
TT=1800.82
T1=57.06
SAT (TO)
f=845
TT=1800.01
T1=55.79
? (exit code)

TT=249.63

? (MO)

TT=217.543

? (exit code)

TT=251.208

? (MO)

TT=245.512

? (MO)

TT=247.506

? (TO)

TT=1800.05

No dataNo data?

TT=1799.59

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1034.cudf.paranoid.opb
UNSAT

TT=0.006

UNSAT

TT=0.012

No dataUNSAT

TT=0.006

UNSAT

TT=0.043

UNSAT

TT=0.045

UNSAT

TT=0.028

UNSAT

TT=0.04

UNSAT

TT=0.028

UNSAT

TT=0.038

UNSAT

TT=0.033

UNSAT

TT=0.037

UNSAT

TT=0.018

UNSAT

TT=0.083

UNSAT

TT=0.285

UNSAT

TT=0.051

UNSAT

TT=0.754

UNSAT

TT=0.012

UNSAT

TT=0.572

UNSAT

TT=0.088

No dataUNSAT

TT=0.048

UNSAT

TT=1.143

UNSAT

TT=0.087

No dataUNSAT

TT=1.025

UNSAT

TT=0.101

UNSAT

TT=0.016

UNSAT

TT=0.021

UNSAT

TT=0.023

No dataNo dataNo dataUNSAT

TT=0.015

No dataNo dataUNSAT

TT=0.016

No dataNo dataNo dataUNSAT

TT=1.594

UNSAT

TT=0.634

UNSAT

TT=0.614

UNSAT

TT=0.08

UNSAT

TT=0.096

UNSAT

TT=0.097

UNSAT

TT=0.126

UNSAT

TT=0.13

UNSAT

TT=0.012

No dataNo dataUNSAT

TT=0.013

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1078.cudf.paranoid.opb
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.001
T1=0
No dataOPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.044
T1=0.01
OPT
f=4
TT=0.037
T1=0.02
OPT
f=4
TT=0.016
T1=0.01
OPT
f=4
TT=0.027
T1=0.02
OPT
f=4
TT=0.017
T1=0.01
OPT
f=4
TT=0.019
T1=0.01
OPT
f=4
TT=0.014
T1=0.01
OPT
f=4
TT=0.022
T1=0.01
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.027
T1=0.01
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.106
T1=0.1
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.135
T1=0.1
OPT
f=4
TT=0.016
T1=0.01
No dataOPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.163
T1=1.12
OPT
f=4
TT=0.011
T1=0
No dataOPT
f=4
TT=0.176
T1=0.64
OPT
f=4
TT=0.016
T1=0.01
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.014
T1=0
OPT
f=4
TT=0.012
T1=0
No dataNo dataNo dataOPT
f=4
TT=0.001
T1=0
No dataNo dataOPT
f=4
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=4
TT=0.164
T1=0.61
OPT
f=4
TT=0.154
T1=0.12
OPT
f=4
TT=0.195
T1=0.14
OPT
f=4
TT=0.009
T1=0
OPT
f=4
TT=0.014
T1=0
OPT
f=4
TT=0.01
T1=0
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.002
T1=0
No dataNo dataOPT
f=4
TT=0.002
T1=0
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1094.cudf.paranoid.opb
OPT
f=126
TT=0.004
T1=0
OPT
f=126
TT=0.008
T1=0
No dataOPT
f=126
TT=0.004
T1=0
OPT
f=126
TT=0.135
T1=0.03
OPT
f=126
TT=0.127
T1=0.03
? (problem)

TT=0.019

? (problem)

TT=0.028

? (problem)

TT=0.017

? (problem)

TT=0.025

? (problem)

TT=0.017

? (problem)

TT=0.029

OPT
f=126
TT=0.01
T1=0.01
OPT
f=126
TT=0.032
T1=0.03
OPT
f=126
TT=0.112
T1=0.09
OPT
f=126
TT=0.013
T1=0.01
OPT
f=126
TT=0.423
T1=0.27
OPT
f=126
TT=0.008
T1=0
OPT
f=126
TT=0.402
T1=0.29
OPT
f=126
TT=0.046
T1=0.04
No dataOPT
f=126
TT=0.016
T1=0.01
OPT
f=126
TT=0.565
T1=1.27
OPT
f=126
TT=0.039
T1=0.03
No dataOPT
f=126
TT=0.575
T1=0.79
OPT
f=126
TT=0.045
T1=0.04
OPT
f=126
TT=0.009
T1=0
OPT
f=126
TT=0.092
T1=0.02
OPT
f=126
TT=0.035
T1=0.02
No dataNo dataNo dataOPT
f=126
TT=0.006
T1=0.01
No dataNo dataOPT
f=126
TT=0.006
T1=0.01
No dataNo dataNo dataOPT
f=126
TT=0.533
T1=0.76
OPT
f=126
TT=0.434
T1=0.27
OPT
f=126
TT=0.444
T1=0.27
OPT
f=126
TT=0.041
T1=0.03
OPT
f=126
TT=0.045
T1=0.03
OPT
f=126
TT=0.043
T1=0.03
OPT
f=126
TT=0.037
T1=0.03
OPT
f=126
TT=0.038
T1=0.03
OPT
f=126
TT=0.006
T1=0.01
No dataNo dataOPT
f=126
TT=0.005
T1=0.01
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/datasets/caixa/
normalized-1125.cudf.paranoid.opb
UNSAT

TT=0.002

UNSAT

TT=0.002

No dataUNSAT

TT=0.002

UNSAT

TT=0.02

UNSAT

TT=0.026

UNSAT

TT=0.012

UNSAT

TT=0.018

UNSAT

TT=0.01

UNSAT

TT=0.018

UNSAT

TT=0.011

UNSAT

TT=0.017

UNSAT

TT=0.004

UNSAT

TT=0.007

UNSAT

TT=0.051

UNSAT

TT=0.005

UNSAT

TT=0.216

UNSAT

TT=0.002

UNSAT

TT=0.213

UNSAT

TT=0.018

No dataUNSAT

TT=0.006

UNSAT

TT=0.254

UNSAT

TT=0.017

No dataUNSAT

TT=0.264

UNSAT

TT=0.025

UNSAT

TT=0.003

UNSAT

TT=0.007

UNSAT

TT=0.007

No dataNo dataNo dataUNSAT

TT=0.003

No dataNo dataUNSAT

TT=0.003

No dataNo dataNo dataUNSAT

TT=0.264

UNSAT

TT=0.234

UNSAT

TT=0.243

UNSAT

TT=0.017

UNSAT

TT=0.018

UNSAT

TT=0.016

UNSAT

TT=0.014

UNSAT

TT=0.015

UNSAT

TT=0.003

No dataNo dataUNSAT

TT=0.003

/OPT-SMALLINT-LIN/leberre/
opb-paranoid/misc2010/datasets/caixa/
normalized-658.cudf.paranoid.opb
UNSAT

TT=0.003

UNSAT

TT=0.004

No dataUNSAT

TT=0.003

UNSAT

TT=0.021

UNSAT

TT=0.027

UNSAT

TT=0.014

UNSAT

TT=0.022

UNSAT

TT=0.012

UNSAT

TT=0.02

UNSAT

TT=0.015

UNSAT

TT=0.022

UNSAT

TT=0.009

UNSAT

TT=0.022

UNSAT

TT=0.097

UNSAT

TT=0.016

UNSAT

TT=0.365

UNSAT

TT=0.005

UNSAT

TT=0.336

UNSAT

TT=0.032

No dataUNSAT

TT=0.016

UNSAT

TT=0.443

UNSAT

TT=0.03

No dataUNSAT

TT=0.464

UNSAT

TT=0.037

UNSAT

TT=0.005

UNSAT

TT=0.012

UNSAT

TT=0.01

No dataNo dataNo dataUNSAT

TT=0.006

No dataNo dataUNSAT

TT=0.007

No dataNo dataNo dataUNSAT

TT=0.433

UNSAT

TT=0.365

UNSAT

TT=0.384

UNSAT

TT=0.029

UNSAT

TT=0.033

UNSAT

TT=0.029

UNSAT

TT=0.039

UNSAT

TT=0.039

UNSAT

TT=0.006

No dataNo dataUNSAT

TT=0.006

/OPT-SMALLINT-LIN/leberre/
opb-paranoid/misc2010/datasets/caixa/
normalized-990.cudf.paranoid.opb
OPT
f=273
TT=0.011
T1=0.01
OPT
f=273
TT=0.096
T1=0.08
No dataOPT
f=273
TT=0.011
T1=0.01
OPT
f=273
TT=0.329
T1=0.29
OPT
f=273
TT=0.306
T1=0.06
? (problem)

TT=0.042

? (problem)

TT=0.053

? (problem)

TT=0.044

? (problem)

TT=0.057

? (problem)

TT=0.046

? (problem)

TT=0.056

OPT
f=273
TT=0.052
T1=0.05
OPT
f=273
TT=0.128
T1=0.09
OPT
f=273
TT=1.495
T1=1.42
OPT
f=273
TT=0.049
T1=0.04
OPT
f=273
TT=1.344
T1=0.56
OPT
f=273
TT=0.097
T1=0.08
OPT
f=273
TT=1.152
T1=0.5
OPT
f=273
TT=0.179
T1=0.16
No dataOPT
f=273
TT=0.079
T1=0.07
OPT
f=273
TT=2.173
T1=3.37
OPT
f=273
TT=0.149
T1=0.13
No dataOPT
f=273
TT=1.675
T1=1.89
OPT
f=273
TT=0.167
T1=0.14
OPT
f=273
TT=0.039
T1=0.03
OPT
f=273
TT=0.397
T1=0.39
OPT
f=273
TT=0.32
T1=0.27
No dataNo dataNo dataOPT
f=273
TT=0.114
T1=0.05
No dataNo dataOPT
f=273
TT=0.106
T1=0.05
No dataNo dataNo dataOPT
f=273
TT=2.254
T1=3.4
OPT
f=273
TT=1.023
T1=0.47
OPT
f=273
TT=1.104
T1=0.51
OPT
f=273
TT=0.226
T1=0.21
OPT
f=273
TT=0.227
T1=0.2
OPT
f=273
TT=0.267
T1=0.36
OPT
f=273
TT=0.145
T1=0.13
OPT
f=273
TT=0.146
T1=0.13
OPT
f=273
TT=0.573
T1=0.56
No dataNo dataOPT
f=273
TT=0.562
T1=0.56
/OPT-SMALLINT-LIN/leberre/
opb-paranoid/misc2010/datasets/caixa/
normalized-995.cudf.paranoid.opb
UNSAT

TT=0.002

UNSAT

TT=0.003

No dataUNSAT

TT=0.002

UNSAT

TT=0.021

UNSAT

TT=0.024

UNSAT

TT=0.012

UNSAT

TT=0.022

UNSAT

TT=0.011

UNSAT

TT=0.017

UNSAT

TT=0.012

UNSAT

TT=0.018

UNSAT

TT=0.003

UNSAT

TT=0.011

UNSAT

TT=0.057

UNSAT

TT=0.008

UNSAT

TT=0.245

UNSAT

TT=0.003

UNSAT

TT=0.223

UNSAT

TT=0.021

No dataUNSAT

TT=0.008

UNSAT

TT=0.274

UNSAT

TT=0.02

No dataUNSAT

TT=0.294

UNSAT

TT=0.024

UNSAT

TT=0.004

UNSAT

TT=0.008

UNSAT

TT=0.006

No dataNo dataNo dataUNSAT

TT=0.004

No dataNo dataUNSAT

TT=0.004

No dataNo dataNo dataUNSAT

TT=0.295

UNSAT

TT=0.263

UNSAT

TT=0.275

UNSAT

TT=0.018

UNSAT

TT=0.02

UNSAT

TT=0.021

UNSAT

TT=0.017

UNSAT

TT=0.018

UNSAT

TT=0.003

No dataNo dataUNSAT

TT=0.003

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand0c02bc.cudf.paranoid.opb
OPT
f=8730
TT=1.124
T1=1.05
SAT
f=8731
TT=1798
T1=1252.88
No dataOPT
f=8730
TT=1.343
T1=1.05
? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (problem)

TT=0.327

? (problem)

TT=0.26

? (problem)

TT=0.328

? (problem)

TT=0.262

? (problem)

TT=0.327

? (problem)

TT=0.269

Wrong Opt.
f=10397
TT=268.957
T1=91.79
SAT (TO)
f=97626
TT=1800.04
T1=1673.61
SAT (TO)
f=129590
TT=1802.16
T1=1801.13
OPT
f=8730
TT=9.925
T1=7.09
OPT
f=8730
TT=99.99
T1=93.51
SAT
f=8733
TT=1798.51
T1=1070.01
OPT
f=8730
TT=44.66
T1=39.27
Wrong Opt.
f=8731
TT=3.476
T1=2.76
No dataOPT
f=8730
TT=1.124
T1=1.08
OPT
f=8730
TT=19.713
T1=14.62
OPT
f=8730
TT=6.45
T1=6.4
No dataSAT (TO)
f=8731
TT=1800.34
T1=1049.42
OPT
f=8730
TT=6.883
T1=6.82
SAT (TO)
f=74070
TT=1800.07
T1=1800.5
? (TO)

TT=1800.06

? (TO)

TT=1800.13

No dataNo dataNo dataOPT
f=8730
TT=7.058
T1=3.56
No dataNo dataOPT
f=8730
TT=7.405
T1=3.74
No dataNo dataNo dataOPT
f=8730
TT=764.19
T1=660.79
OPT
f=8730
TT=251.05
T1=227.84
OPT
f=8730
TT=38.017
T1=33.87
OPT
f=8730
TT=6.613
T1=6.53
OPT
f=8730
TT=6.215
T1=6.15
OPT
f=8730
TT=6.462
T1=6.38
? (TO)

TT=1800.02

? (TO)

TT=1800.01

OPT
f=8730
TT=3.233
T1=3.24
No dataNo dataOPT
f=8730
TT=3.395
T1=3.39
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand199fd6.cudf.paranoid.opb
UNSAT

TT=0.015

UNSAT

TT=0.073

No dataUNSAT

TT=0.015

UNSAT

TT=0.155

UNSAT

TT=0.136

UNSAT

TT=0.144

UNSAT

TT=0.134

UNSAT

TT=0.143

UNSAT

TT=0.131

UNSAT

TT=0.146

UNSAT

TT=0.131

UNSAT

TT=0.087

UNSAT

TT=0.346

UNSAT

TT=1.326

UNSAT

TT=0.49

UNSAT

TT=1.044

UNSAT

TT=0.074

UNSAT

TT=0.865

UNSAT

TT=0.327

No dataUNSAT

TT=0.755

UNSAT

TT=0.994

UNSAT

TT=0.331

No dataUNSAT

TT=0.994

UNSAT

TT=0.334

UNSAT

TT=0.043

UNSAT

TT=0.136

UNSAT

TT=0.133

No dataNo dataNo dataUNSAT

TT=0.08

No dataNo dataUNSAT

TT=0.086

No dataNo dataNo dataUNSAT

TT=1.306

UNSAT

TT=0.944

UNSAT

TT=0.884

UNSAT

TT=0.326

UNSAT

TT=0.285

UNSAT

TT=0.294

UNSAT

TT=1.222

UNSAT

TT=1.233

UNSAT

TT=0.069

No dataNo dataUNSAT

TT=0.071

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand2d8467.cudf.paranoid.opb
OPT
f=13125
TT=1.175
T1=0.67
SAT
f=13137
TT=1798.01
T1=1738.04
No dataOPT
f=13125
TT=1.175
T1=0.67
? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (problem)

TT=0.316

? (problem)

TT=0.277

? (problem)

TT=0.308

? (problem)

TT=0.271

? (problem)

TT=0.318

? (problem)

TT=0.273

Wrong Opt.
f=16738
TT=45.749
T1=39.69
SAT (TO)
f=38745
TT=1800.03
T1=1712.98
SAT (TO)
f=135210
TT=1800.15
T1=1801.32
OPT
f=13125
TT=43.521
T1=38.51
OPT
f=13125
TT=80.3
T1=77.91
SAT
f=13147
TT=1798
T1=886.91
OPT
f=13125
TT=142.54
T1=138.35
OPT
f=13125
TT=3.244
T1=3.18
No dataOPT
f=13125
TT=1.194
T1=1.14
OPT
f=13125
TT=30.889
T1=22.68
OPT
f=13125
TT=5.923
T1=5.87
No dataOPT
f=13125
TT=32.851
T1=15.78
OPT
f=13125
TT=6.215
T1=6.16
SAT (TO)
f=122004
TT=1800.07
T1=1800.61
? (TO)

TT=1800.07

? (TO)

TT=1800.02

No dataNo dataNo dataOPT
f=13125
TT=8.578
T1=4.33
No dataNo dataOPT
f=13125
TT=7.838
T1=3.95
No dataNo dataNo dataOPT
f=13125
TT=445.406
T1=231.99
OPT
f=13125
TT=121.24
T1=110.64
OPT
f=13125
TT=122.574
T1=120.28
OPT
f=13125
TT=5.368
T1=5.31
OPT
f=13125
TT=6.519
T1=6.46
OPT
f=13125
TT=4.994
T1=4.94
? (TO)

TT=1800.01

? (TO)

TT=1800.1

OPT
f=13125
TT=3.555
T1=3.55
No dataNo dataOPT
f=13125
TT=3.527
T1=3.53
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand35d0c8.cudf.paranoid.opb
OPT
f=5656
TT=1.286
T1=1.24
SAT
f=5667
TT=1798.01
T1=350.8
No dataOPT
f=5656
TT=16.185
T1=2.55
? (TO)

TT=1800.05

OPT
f=5656
TT=836.41
T1=445.38
? (problem)

TT=0.32

? (problem)

TT=0.271

? (problem)

TT=0.322

? (problem)

TT=0.277

? (problem)

TT=0.316

? (problem)

TT=0.281

Wrong Opt.
f=7411
TT=595.006
T1=319.67
SAT (TO)
f=65719
TT=1800.05
T1=1649.01
SAT (TO)
f=141678
TT=1802.06
T1=1806.35
OPT
f=5656
TT=251.375
T1=223.02
OPT
f=5656
TT=1467.16
T1=1383.08
SAT
f=5667
TT=1798.01
T1=358.85
OPT
f=5656
TT=914.58
T1=860.06
OPT
f=5656
TT=5.58
T1=5.14
No dataOPT
f=5656
TT=1.286
T1=1.24
OPT
f=5656
TT=260.693
T1=130.64
OPT
f=5656
TT=7.167
T1=6.03
No dataOPT
f=5656
TT=349.09
T1=171.64
OPT
f=5656
TT=7.421
T1=7.05
SAT (TO)
f=67558
TT=1800.01
T1=1800.4
? (TO)

TT=1800.14

? (TO)

TT=1800.03

No dataNo dataNo dataOPT
f=5656
TT=7.295
T1=3.68
No dataNo dataOPT
f=5656
TT=7.285
T1=3.67
No dataNo dataNo dataSAT (TO)
f=5656
TT=1800.2
T1=18.7
SAT (TO)
f=5657
TT=1800.03
T1=1604.05
OPT
f=5656
TT=1502.85
T1=1458.84
OPT
f=5656
TT=7.908
T1=7.29
OPT
f=5656
TT=6.069
T1=5.51
OPT
f=5656
TT=6.689
T1=6.6
? (TO)

TT=1800.09

? (TO)

TT=1800.08

OPT
f=5656
TT=3.423
T1=3.43
No dataNo dataOPT
f=5656
TT=3.617
T1=3.62
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand4bf850.cudf.paranoid.opb
OPT
f=10949
TT=1.126
T1=1.08
SAT
f=10949
TT=1798
T1=481.99
No dataOPT
f=10949
TT=11.06
T1=1.12
? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (problem)

TT=0.324

? (problem)

TT=0.289

? (problem)

TT=0.329

? (problem)

TT=0.268

? (problem)

TT=0.338

? (problem)

TT=0.281

OPT
f=10949
TT=182.826
T1=61.47
OPT
f=10949
TT=1746.52
T1=1742.7
SAT (TO)
f=144235
TT=1800.13
T1=1808.27
OPT
f=10949
TT=19.472
T1=14.31
OPT
f=10949
TT=137.82
T1=17.5
SAT
f=10949
TT=1798.01
T1=495.93
OPT
f=10949
TT=69.94
T1=16.13
OPT
f=10949
TT=3.73
T1=3.67
No dataOPT
f=10949
TT=1.126
T1=1.08
OPT
f=10949
TT=42.8
T1=6.62
OPT
f=10949
TT=5.419
T1=5.37
No dataOPT
f=10949
TT=132.283
T1=105.26
OPT
f=10949
TT=4.942
T1=4.87
OPT
f=10949
TT=1580.21
T1=1580.58
? (TO)

TT=1800.06

? (TO)

TT=1800.15

No dataNo dataNo dataOPT
f=10949
TT=7.109
T1=3.59
No dataNo dataOPT
f=10949
TT=7.141
T1=3.61
No dataNo dataNo dataOPT
f=10949
TT=514.536
T1=8.13
OPT
f=10949
TT=451.19
T1=68.38
OPT
f=10949
TT=54.756
T1=11.08
OPT
f=10949
TT=4.741
T1=4.71
OPT
f=10949
TT=5.811
T1=5.73
OPT
f=10949
TT=5.128
T1=5.07
? (TO)

TT=1800.1

? (TO)

TT=1800.09

OPT
f=10949
TT=3.173
T1=3.17
No dataNo dataOPT
f=10949
TT=3.366
T1=3.36
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-rand65d021.cudf.paranoid.opb
UNSAT

TT=0.064

UNSAT

TT=0.09

No dataUNSAT

TT=0.08

UNSAT

TT=0.192

UNSAT

TT=0.156

UNSAT

TT=0.184

UNSAT

TT=0.154

UNSAT

TT=0.182

UNSAT

TT=0.15

UNSAT

TT=0.181

UNSAT

TT=0.149

UNSAT

TT=0.099

UNSAT

TT=0.46

UNSAT

TT=1.379

UNSAT

TT=0.515

UNSAT

TT=1.303

UNSAT

TT=0.091

UNSAT

TT=1.145

UNSAT

TT=0.355

No dataUNSAT

TT=0.783

UNSAT

TT=1.624

UNSAT

TT=0.334

No dataUNSAT

TT=1.464

UNSAT

TT=0.34

UNSAT

TT=0.07

UNSAT

TT=0.147

UNSAT

TT=0.144

No dataNo dataNo dataUNSAT

TT=0.113

No dataNo dataUNSAT

TT=0.112

No dataNo dataNo dataUNSAT

TT=2.074

UNSAT

TT=1.325

UNSAT

TT=1.195

UNSAT

TT=0.305

UNSAT

TT=0.376

UNSAT

TT=0.383

UNSAT

TT=1.228

UNSAT

TT=1.246

UNSAT

TT=0.063

No dataNo dataUNSAT

TT=0.064

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-randa491d5.cudf.paranoid.opb
UNSAT

TT=0.068

UNSAT

TT=0.111

No dataUNSAT

TT=0.073

UNSAT

TT=0.191

UNSAT

TT=0.16

UNSAT

TT=0.184

UNSAT

TT=0.159

UNSAT

TT=0.183

UNSAT

TT=0.156

UNSAT

TT=0.186

UNSAT

TT=0.165

UNSAT

TT=0.119

UNSAT

TT=0.517

UNSAT

TT=1.307

UNSAT

TT=0.54

UNSAT

TT=1.402

UNSAT

TT=0.108

UNSAT

TT=1.264

UNSAT

TT=0.375

No dataUNSAT

TT=0.925

UNSAT

TT=1.873

UNSAT

TT=0.353

No dataUNSAT

TT=1.477

UNSAT

TT=0.369

UNSAT

TT=0.079

UNSAT

TT=0.135

UNSAT

TT=0.133

No dataNo dataNo dataUNSAT

TT=0.121

No dataNo dataUNSAT

TT=0.116

No dataNo dataNo dataUNSAT

TT=2.126

UNSAT

TT=1.393

UNSAT

TT=1.133

UNSAT

TT=0.437

UNSAT

TT=0.294

UNSAT

TT=0.365

UNSAT

TT=1.284

UNSAT

TT=1.248

UNSAT

TT=0.066

No dataNo dataUNSAT

TT=0.068

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-randa6997e.cudf.paranoid.opb
OPT
f=5898
TT=1.186
T1=0.3
SAT
f=5898
TT=1798.01
T1=811.05
No dataOPT
f=5898
TT=8.196
T1=0.3
? (TO)

TT=1800.09

OPT
f=5898
TT=856.912
T1=857.09
? (problem)

TT=0.311

? (problem)

TT=0.271

? (problem)

TT=0.308

? (problem)

TT=0.269

? (problem)

TT=0.31

? (problem)

TT=0.278

Wrong Opt.
f=5899
TT=27.389
T1=10.11
OPT
f=5898
TT=1798.18
T1=1794.78
SAT (TO)
f=111372
TT=1802.09
T1=1799.29
OPT
f=5898
TT=31.273
T1=24.1
OPT
f=5898
TT=320.09
T1=287.53
SAT
f=5898
TT=1798.01
T1=1573.54
OPT
f=5898
TT=137.123
T1=58.61
OPT
f=5898
TT=4.382
T1=4.35
No dataOPT
f=5898
TT=1.186
T1=1.14
OPT
f=5898
TT=43.886
T1=21.58
OPT
f=5898
TT=4.743
T1=4.69
No dataOPT
f=5898
TT=50.977
T1=22.62
OPT
f=5898
TT=5.194
T1=5.12
SAT (TO)
f=11267
TT=1800.07
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataOPT
f=5898
TT=14.177
T1=7.14
No dataNo dataOPT
f=5898
TT=11.988
T1=6.05
No dataNo dataNo dataOPT
f=5898
TT=314.066
T1=89.14
OPT
f=5898
TT=604.89
T1=391.87
OPT
f=5898
TT=95.73
T1=76.79
OPT
f=5898
TT=7.459
T1=7.38
OPT
f=5898
TT=7.109
T1=7.04
OPT
f=5898
TT=5.437
T1=5.39
? (TO)

TT=1800.09

? (TO)

TT=1800.1

OPT
f=5898
TT=6.194
T1=6.2
No dataNo dataOPT
f=5898
TT=6.146
T1=6.16
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-randaef248.cudf.paranoid.opb
UNSAT

TT=0.026

UNSAT

TT=0.073

No dataUNSAT

TT=0.026

UNSAT

TT=0.202

UNSAT

TT=0.165

UNSAT

TT=0.192

UNSAT

TT=0.161

UNSAT

TT=0.19

UNSAT

TT=0.158

UNSAT

TT=0.192

UNSAT

TT=0.157

UNSAT

TT=0.085

UNSAT

TT=0.467

UNSAT

TT=1.371

UNSAT

TT=0.578

UNSAT

TT=1.125

UNSAT

TT=0.075

UNSAT

TT=0.936

UNSAT

TT=0.406

No dataUNSAT

TT=0.756

UNSAT

TT=1.184

UNSAT

TT=0.379

No dataUNSAT

TT=1.104

UNSAT

TT=0.391

UNSAT

TT=0.071

UNSAT

TT=0.137

UNSAT

TT=0.136

No dataNo dataNo dataUNSAT

TT=0.08

No dataNo dataUNSAT

TT=0.079

No dataNo dataNo dataUNSAT

TT=1.644

UNSAT

TT=1.053

UNSAT

TT=0.914

UNSAT

TT=0.352

UNSAT

TT=0.458

UNSAT

TT=0.365

UNSAT

TT=1.203

UNSAT

TT=1.214

UNSAT

TT=0.068

No dataNo dataUNSAT

TT=0.07

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.biglist/
normalized-randf7d077.cudf.paranoid.opb
UNSAT

TT=0.079

UNSAT

TT=0.079

No dataUNSAT

TT=0.083

UNSAT

TT=0.202

UNSAT

TT=0.166

UNSAT

TT=0.195

UNSAT

TT=0.164

UNSAT

TT=0.193

UNSAT

TT=0.16

UNSAT

TT=0.193

UNSAT

TT=0.158

UNSAT

TT=0.093

UNSAT

TT=0.485

UNSAT

TT=1.366

UNSAT

TT=0.565

UNSAT

TT=1.303

UNSAT

TT=0.08

UNSAT

TT=1.093

UNSAT

TT=0.401

No dataUNSAT

TT=0.89

UNSAT

TT=1.595

UNSAT

TT=0.388

No dataUNSAT

TT=1.284

UNSAT

TT=0.405

UNSAT

TT=0.08

UNSAT

TT=0.149

UNSAT

TT=0.147

No dataNo dataNo dataUNSAT

TT=0.139

No dataNo dataUNSAT

TT=0.128

No dataNo dataNo dataUNSAT

TT=1.874

UNSAT

TT=1.234

UNSAT

TT=1.204

UNSAT

TT=0.368

UNSAT

TT=0.498

UNSAT

TT=0.497

UNSAT

TT=1.204

UNSAT

TT=1.217

UNSAT

TT=0.087

No dataNo dataUNSAT

TT=0.089

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-rand0a62b6.cudf.paranoid.opb
OPT
f=6943
TT=0.188
T1=0.18
OPT
f=6943
TT=832.822
T1=832.08
No dataOPT
f=6943
TT=0.188
T1=0.18
OPT
f=6943
TT=1402.26
T1=1107.45
OPT
f=6943
TT=871.922
T1=872.23
? (problem)

TT=0.316

? (problem)

TT=0.263

? (problem)

TT=0.313

? (problem)

TT=0.278

? (problem)

TT=0.315

? (problem)

TT=0.272

Wrong Opt.
f=10273
TT=19.793
T1=19.34
SAT (TO)
f=70707
TT=1800.09
T1=1786.99
SAT (TO)
f=102797
TT=1802.12
T1=1799.48
OPT
f=6943
TT=1.233
T1=1.22
OPT
f=6943
TT=2.816
T1=1.29
OPT
f=6943
TT=771.671
T1=770.96
OPT
f=6943
TT=2.556
T1=1.27
OPT
f=6943
TT=2.588
T1=2.53
No dataOPT
f=6943
TT=1.149
T1=1.1
OPT
f=6943
TT=3.096
T1=6.58
OPT
f=6943
TT=6.037
T1=5.98
No dataOPT
f=6943
TT=2.922
T1=2.6
OPT
f=6943
TT=6.801
T1=6.75
SAT (TO)
f=165745
TT=1800.09
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800.01

No dataNo dataNo dataOPT
f=6943
TT=4.951
T1=2.5
No dataNo dataOPT
f=6943
TT=4.986
T1=2.53
No dataNo dataNo dataOPT
f=6943
TT=4.135
T1=3.69
OPT
f=6943
TT=2.644
T1=1.27
OPT
f=6943
TT=3.775
T1=2.47
OPT
f=6943
TT=6.025
T1=5.95
OPT
f=6943
TT=7.244
T1=7.16
OPT
f=6943
TT=6.434
T1=6.37
OPT
f=6943
TT=10.18
T1=2.39
OPT
f=6943
TT=10.041
T1=2.34
OPT
f=6943
TT=2.293
T1=2.29
No dataNo dataOPT
f=6943
TT=2.304
T1=2.31
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-rand18b530.cudf.paranoid.opb
OPT
f=6563
TT=0.112
T1=0.1
OPT
f=6563
TT=383.482
T1=306.83
No dataOPT
f=6563
TT=0.112
T1=0.1
OPT
f=6563
TT=1391.32
T1=1377.23
OPT
f=6563
TT=1421.92
T1=1307.87
? (problem)

TT=0.315

? (problem)

TT=0.286

? (problem)

TT=0.312

? (problem)

TT=0.262

? (problem)

TT=0.311

? (problem)

TT=0.271

OPT
f=6563
TT=14.151
T1=13.24
SAT (TO)
f=35295
TT=1800.06
T1=1737.74
SAT (TO)
f=25899
TT=1802.12
T1=1799.76
OPT
f=6563
TT=0.68
T1=0.66
OPT
f=6563
TT=2.695
T1=1.31
OPT
f=6563
TT=388.34
T1=312.18
OPT
f=6563
TT=2.445
T1=1.15
OPT
f=6563
TT=2.094
T1=2.04
No dataOPT
f=6563
TT=1.018
T1=0.97
OPT
f=6563
TT=2.993
T1=6.59
OPT
f=6563
TT=4.893
T1=4.84
No dataOPT
f=6563
TT=2.814
T1=2.6
OPT
f=6563
TT=5.343
T1=5.29
OPT
f=6563
TT=1347.39
T1=1347.53
? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataOPT
f=6563
TT=3.043
T1=1.55
No dataNo dataOPT
f=6563
TT=3.064
T1=1.57
No dataNo dataNo dataOPT
f=6563
TT=4.963
T1=2.65
OPT
f=6563
TT=2.073
T1=0.92
OPT
f=6563
TT=3.873
T1=2.55
OPT
f=6563
TT=4.967
T1=4.89
OPT
f=6563
TT=4.647
T1=4.58
OPT
f=6563
TT=5.237
T1=5.17
OPT
f=6563
TT=5.957
T1=5.63
OPT
f=6563
TT=5.984
T1=5.65
OPT
f=6563
TT=1.401
T1=1.4
No dataNo dataOPT
f=6563
TT=1.402
T1=1.4
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-rand27da90.cudf.paranoid.opb
OPT
f=11364
TT=0.197
T1=0.17
OPT
f=11364
TT=542.968
T1=507.5
No dataOPT
f=11364
TT=0.197
T1=0.17
? (TO)

TT=1800.07

OPT
f=11364
TT=1479.46
T1=1220.01
? (problem)

TT=0.31

? (problem)

TT=0.268

? (problem)

TT=0.297

? (problem)

TT=0.256

? (problem)

TT=0.296

? (problem)

TT=0.251

OPT
f=11364
TT=67.284
T1=54.47
SAT (TO)
f=43200
TT=1800.04
T1=1583.24
SAT (TO)
f=113217
TT=1800.47
T1=1806.37
OPT
f=11364
TT=1.071
T1=0.98
OPT
f=11364
TT=3.654
T1=1.91
OPT
f=11364
TT=511.942
T1=497.93
OPT
f=11364
TT=3.134
T1=1.77
OPT
f=11364
TT=3.467
T1=3.42
No dataOPT
f=11364
TT=1.069
T1=1.03
OPT
f=11364
TT=3.833
T1=6.58
OPT
f=11364
TT=5.335
T1=4.88
No dataOPT
f=11364
TT=3.413
T1=5.1
OPT
f=11364
TT=5.422
T1=5.37
SAT (TO)
f=150683
TT=1800.06
T1=1800.5
? (TO)

TT=1800.12

? (TO)

TT=1800.07

No dataNo dataNo dataOPT
f=11364
TT=6.662
T1=3.37
No dataNo dataOPT
f=11364
TT=5.837
T1=2.96
No dataNo dataNo dataOPT
f=11364
TT=12.102
T1=12.17
OPT
f=11364
TT=6.613
T1=4.95
OPT
f=11364
TT=3.185
T1=1.99
OPT
f=11364
TT=5.911
T1=5.84
OPT
f=11364
TT=7.15
T1=7.08
OPT
f=11364
TT=5.091
T1=4.93
OPT
f=11364
TT=197.176
T1=196.68
OPT
f=11364
TT=195.21
T1=194.72
OPT
f=11364
TT=2.589
T1=2.67
No dataNo dataOPT
f=11364
TT=2.663
T1=2.67
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-rand3c03fd.cudf.paranoid.opb
OPT
f=4927
TT=0.18
T1=0.14
OPT
f=4927
TT=422.787
T1=420.2
No dataOPT
f=4927
TT=0.18
T1=0.14
OPT
f=4927
TT=1650.84
T1=798.99
OPT
f=4927
TT=467.845
T1=398.33
? (problem)

TT=0.305

? (problem)

TT=0.275

? (problem)

TT=0.299

? (problem)

TT=0.244

? (problem)

TT=0.301

? (problem)

TT=0.237

OPT
f=4927
TT=15.288
T1=14.95
OPT
f=4927
TT=871.568
T1=870.73
SAT (TO)
f=127604
TT=1800.08
T1=1802.37
OPT
f=4927
TT=1.41
T1=1.29
OPT
f=4927
TT=5.772
T1=3.62
OPT
f=4927
TT=429.696
T1=427.15
OPT
f=4927
TT=3.354
T1=1.84
OPT
f=4927
TT=2.299
T1=2.24
No dataOPT
f=4927
TT=1.034
T1=0.99
OPT
f=4927
TT=4.284
T1=11.63
OPT
f=4927
TT=4.953
T1=4.9
No dataOPT
f=4927
TT=94.4
T1=90.16
OPT
f=4927
TT=5.479
T1=5.17
OPT
f=4927
TT=1387.99
T1=1388.31
? (TO)

TT=1800.05

? (TO)

TT=1800.06

No dataNo dataNo dataOPT
f=4927
TT=4.052
T1=2.05
No dataNo dataOPT
f=4927
TT=4.013
T1=2.05
No dataNo dataNo dataOPT
f=4927
TT=77.01
T1=69.11
OPT
f=4927
TT=14.084
T1=12.41
OPT
f=4927
TT=3.653
T1=2.39
OPT
f=4927
TT=5.363
T1=5.29
OPT
f=4927
TT=4.985
T1=5.18
OPT
f=4927
TT=3.872
T1=3.81
? (TO)

TT=1800.1

? (TO)

TT=1800.03

OPT
f=4927
TT=1.778
T1=1.78
No dataNo dataOPT
f=4927
TT=1.831
T1=1.82
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-rand5d20db.cudf.paranoid.opb
OPT
f=5106
TT=0.161
T1=0.14
OPT
f=5106
TT=263.81
T1=263.64
No dataOPT
f=5106
TT=0.161
T1=0.14
OPT
f=5106
TT=1257.8
T1=1055.4
OPT
f=5106
TT=556.249
T1=556.37
? (problem)

TT=0.324

? (problem)

TT=0.263

? (problem)

TT=0.315

? (problem)

TT=0.259

? (problem)

TT=0.318

? (problem)

TT=0.256

OPT
f=5106
TT=53.612
T1=49.38
SAT (TO)
f=29245
TT=1800.09
T1=1776.38
SAT (TO)
f=127333
TT=1801.58
T1=1801.21
OPT
f=5106
TT=1.05
T1=1.02
OPT
f=5106
TT=3.324
T1=1.81
OPT
f=5106
TT=266.952
T1=266.78
OPT
f=5106
TT=3.613
T1=2.17
OPT
f=5106
TT=3.48
T1=3.43
No dataOPT
f=5106
TT=1.127
T1=1.08
OPT
f=5106
TT=4.704
T1=16.66
OPT
f=5106
TT=5.862
T1=5.81
No dataOPT
f=5106
TT=3.373
T1=4.6
OPT
f=5106
TT=5.816
T1=5.76
SAT (TO)
f=10053
TT=1800.07
T1=1800.5
? (TO)

TT=1800.15

? (TO)

TT=1800.14

No dataNo dataNo dataOPT
f=5106
TT=4.766
T1=2.41
No dataNo dataOPT
f=5106
TT=4.913
T1=2.49
No dataNo dataNo dataOPT
f=5106
TT=6.314
T1=7.73
OPT
f=5106
TT=4.472
T1=3.02
OPT
f=5106
TT=5.434
T1=4.05
OPT
f=5106
TT=7.129
T1=7.06
OPT
f=5106
TT=5.538
T1=5.48
OPT
f=5106
TT=6.507
T1=6.45
OPT
f=5106
TT=163.593
T1=162.63
OPT
f=5106
TT=162.73
T1=162.44
OPT
f=5106
TT=2.212
T1=2.21
No dataNo dataOPT
f=5106
TT=2.225
T1=2.34
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-rand71b131.cudf.paranoid.opb
OPT
f=5657
TT=1.025
T1=0.12
SAT
f=5657
TT=1798.33
T1=687.83
No dataOPT
f=5657
TT=1.025
T1=0.12
? (TO)

TT=1800.11

OPT
f=5657
TT=720.042
T1=720.24
? (problem)

TT=0.314

? (problem)

TT=0.272

? (problem)

TT=0.315

? (problem)

TT=0.268

? (problem)

TT=0.319

? (problem)

TT=0.265

OPT
f=5657
TT=25.779
T1=15.03
SAT (TO)
f=198861
TT=1800.05
T1=1409.92
SAT (TO)
f=155558
TT=1802.1
T1=1802.77
OPT
f=5657
TT=3.139
T1=1.44
OPT
f=5657
TT=38.749
T1=28.19
SAT
f=5657
TT=1798.01
T1=677.91
OPT
f=5657
TT=27.159
T1=19.54
OPT
f=5657
TT=4.8
T1=4.75
No dataOPT
f=5657
TT=1.164
T1=1.11
OPT
f=5657
TT=12.882
T1=11.62
OPT
f=5657
TT=5.577
T1=5.54
No dataOPT
f=5657
TT=13.862
T1=8.61
OPT
f=5657
TT=5.997
T1=5.93
SAT (TO)
f=156833
TT=1800.02
T1=1800.5
? (TO)

TT=1800.03

? (TO)

TT=1800.06

No dataNo dataNo dataOPT
f=5657
TT=6.955
T1=3.51
No dataNo dataOPT
f=5657
TT=6.899
T1=3.5
No dataNo dataNo dataOPT
f=5657
TT=62.264
T1=24.38
OPT
f=5657
TT=38.87
T1=18.83
OPT
f=5657
TT=19.429
T1=14.69
OPT
f=5657
TT=4.004
T1=3.94
OPT
f=5657
TT=5.005
T1=4.93
OPT
f=5657
TT=4.562
T1=4.5
? (TO)

TT=1800.09

? (TO)

TT=1800.11

OPT
f=5657
TT=3.154
T1=3.16
No dataNo dataOPT
f=5657
TT=3.335
T1=3.34
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randa2004a.cudf.paranoid.opb
OPT
f=1859
TT=0.184
T1=0.16
OPT
f=1859
TT=69.193
T1=69.15
No dataOPT
f=1859
TT=0.184
T1=0.16
OPT
f=1859
TT=1329.52
T1=1329.78
OPT
f=1859
TT=278.746
T1=247.11
? (problem)

TT=0.307

? (problem)

TT=0.286

? (problem)

TT=0.31

? (problem)

TT=0.259

? (problem)

TT=0.309

? (problem)

TT=0.259

OPT
f=1859
TT=16.718
T1=13.02
OPT
f=1859
TT=1141.58
T1=1141.3
SAT (TO)
f=109838
TT=1801.78
T1=1807
OPT
f=1859
TT=0.742
T1=0.69
OPT
f=1859
TT=2.764
T1=1.33
OPT
f=1859
TT=68.729
T1=68.68
OPT
f=1859
TT=2.534
T1=1.1
OPT
f=1859
TT=4.692
T1=3.26
No dataOPT
f=1859
TT=1.172
T1=1.13
OPT
f=1859
TT=3.602
T1=4.56
OPT
f=1859
TT=6.187
T1=5.18
No dataOPT
f=1859
TT=2.984
T1=2.56
OPT
f=1859
TT=6.259
T1=5.45
SAT (TO)
f=59055
TT=1800.06
T1=1800.61
OPT
f=1859
TT=826.576
T1=826.82
? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=1859
TT=1.814
T1=0.93
No dataNo dataOPT
f=1859
TT=1.812
T1=0.93
No dataNo dataNo dataOPT
f=1859
TT=4.493
T1=1.07
OPT
f=1859
TT=2.805
T1=0.65
OPT
f=1859
TT=3.412
T1=2.1
OPT
f=1859
TT=5.19
T1=5.01
OPT
f=1859
TT=6.772
T1=6.58
OPT
f=1859
TT=4.897
T1=4.52
OPT
f=1859
TT=15.86
T1=15.01
OPT
f=1859
TT=14.98
T1=14.19
OPT
f=1859
TT=1.531
T1=1.52
No dataNo dataOPT
f=1859
TT=1.512
T1=1.51
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randb54299.cudf.paranoid.opb
OPT
f=11142
TT=0.146
T1=0.1
OPT
f=11142
TT=194.296
T1=190.54
No dataOPT
f=11142
TT=0.146
T1=0.1
? (TO)

TT=1800.27

? (TO)

TT=1800.13

? (problem)

TT=0.298

? (problem)

TT=0.247

? (problem)

TT=0.305

? (problem)

TT=0.245

? (problem)

TT=0.293

? (problem)

TT=0.249

OPT
f=11142
TT=4.122
T1=3.11
SAT (TO)
f=16217
TT=1800.05
T1=1717.77
SAT (TO)
f=56404
TT=1802.32
T1=1801.7
OPT
f=11142
TT=0.857
T1=0.83
OPT
f=11142
TT=3.512
T1=1.28
OPT
f=11142
TT=184.831
T1=181.26
OPT
f=11142
TT=3.123
T1=1.67
OPT
f=11142
TT=2.968
T1=2.93
No dataOPT
f=11142
TT=0.926
T1=0.89
OPT
f=11142
TT=3.974
T1=7.59
OPT
f=11142
TT=3.814
T1=3.78
No dataOPT
f=11142
TT=3.644
T1=4.09
OPT
f=11142
TT=4.384
T1=4.33
SAT (TO)
f=18861
TT=1800.1
T1=1800.5
? (TO)

TT=1800.1

? (TO)

TT=1800.14

No dataNo dataNo dataOPT
f=11142
TT=5.679
T1=2.87
No dataNo dataOPT
f=11142
TT=5.07
T1=2.57
No dataNo dataNo dataOPT
f=11142
TT=5.773
T1=4.7
OPT
f=11142
TT=3.412
T1=1.37
OPT
f=11142
TT=5.661
T1=4
OPT
f=11142
TT=4.219
T1=4.15
OPT
f=11142
TT=5.05
T1=4.99
OPT
f=11142
TT=4.71
T1=4.65
OPT
f=11142
TT=95.273
T1=93.17
OPT
f=11142
TT=54.952
T1=53.32
OPT
f=11142
TT=2.267
T1=2.25
No dataNo dataOPT
f=11142
TT=2.309
T1=2.31
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randc5b1f2.cudf.paranoid.opb
UNSAT

TT=0.015

UNSAT

TT=0.06

No dataUNSAT

TT=0.015

UNSAT

TT=0.127

UNSAT

TT=0.126

UNSAT

TT=0.122

UNSAT

TT=0.114

UNSAT

TT=0.122

UNSAT

TT=0.11

UNSAT

TT=0.123

UNSAT

TT=0.115

UNSAT

TT=0.077

UNSAT

TT=0.287

UNSAT

TT=1.088

UNSAT

TT=0.367

UNSAT

TT=1.006

UNSAT

TT=0.06

UNSAT

TT=0.824

UNSAT

TT=0.291

No dataUNSAT

TT=0.589

UNSAT

TT=0.957

UNSAT

TT=0.276

No dataUNSAT

TT=0.941

UNSAT

TT=0.284

UNSAT

TT=0.034

UNSAT

TT=0.113

UNSAT

TT=0.115

No dataNo dataNo dataUNSAT

TT=0.068

No dataNo dataUNSAT

TT=0.064

No dataNo dataNo dataUNSAT

TT=1.224

UNSAT

TT=0.886

UNSAT

TT=0.835

UNSAT

TT=0.303

UNSAT

TT=0.212

UNSAT

TT=0.282

UNSAT

TT=0.974

UNSAT

TT=0.972

UNSAT

TT=0.056

No dataNo dataUNSAT

TT=0.059

/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randc5fe62.cudf.paranoid.opb
OPT
f=1882
TT=0.56
T1=0.11
SAT
f=1882
TT=1798.01
T1=214.48
No dataOPT
f=1882
TT=0.56
T1=0.11
OPT
f=1882
TT=1568.98
T1=1569.3
OPT
f=1882
TT=256.131
T1=207.19
? (problem)

TT=0.297

? (problem)

TT=0.248

? (problem)

TT=0.293

? (problem)

TT=0.262

? (problem)

TT=0.297

? (problem)

TT=0.251

OPT
f=1882
TT=135.052
T1=57.33
OPT
f=1882
TT=1271.48
T1=1269.53
SAT (TO)
f=112306
TT=1801.22
T1=1803.61
OPT
f=1882
TT=4.961
T1=4.24
OPT
f=1882
TT=33.321
T1=27.39
SAT
f=1882
TT=1798.23
T1=215.42
OPT
f=1882
TT=11.911
T1=9.36
OPT
f=1882
TT=3.456
T1=3.42
No dataOPT
f=1882
TT=1.072
T1=1.03
OPT
f=1882
TT=7.563
T1=8.58
OPT
f=1882
TT=6.659
T1=6.61
No dataOPT
f=1882
TT=6.583
T1=4.64
OPT
f=1882
TT=6.066
T1=6.02
SAT (TO)
f=10123
TT=1800.07
T1=1800.5
? (TO)

TT=1800.07

? (TO)

TT=1800.15

No dataNo dataNo dataOPT
f=1882
TT=5.068
T1=2.56
No dataNo dataOPT
f=1882
TT=5.052
T1=2.56
No dataNo dataNo dataOPT
f=1882
TT=85.661
T1=45.16
OPT
f=1882
TT=39.659
T1=22.71
OPT
f=1882
TT=20.02
T1=17.54
OPT
f=1882
TT=5.713
T1=4.87
OPT
f=1882
TT=6.971
T1=5.9
OPT
f=1882
TT=6.393
T1=5.76
OPT
f=1882
TT=1206.6
T1=1139.06
OPT
f=1882
TT=1157.65
T1=1094.99
OPT
f=1882
TT=2.41
T1=2.41
No dataNo dataOPT
f=1882
TT=2.362
T1=2.35
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randc7f8e5.cudf.paranoid.opb
OPT
f=9465
TT=0.289
T1=0.15
OPT
f=9465
TT=1012.14
T1=964.76
No dataOPT
f=9465
TT=0.289
T1=0.15
? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (problem)

TT=0.304

? (problem)

TT=0.254

? (problem)

TT=0.302

? (problem)

TT=0.27

? (problem)

TT=0.303

? (problem)

TT=0.252

Wrong Opt.
f=12529
TT=31.781
T1=17.37
SAT (TO)
f=18843
TT=1800.05
T1=1778.87
SAT (TO)
f=46789
TT=1802.11
T1=1798.83
OPT
f=9465
TT=2.434
T1=2.38
OPT
f=9465
TT=4.101
T1=1.6
OPT
f=9465
TT=1056.26
T1=993.04
OPT
f=9465
TT=3.013
T1=1.43
OPT
f=9465
TT=3.083
T1=3.05
No dataOPT
f=9465
TT=1.004
T1=0.96
OPT
f=9465
TT=4.814
T1=11.63
OPT
f=9465
TT=4.584
T1=4.54
No dataOPT
f=9465
TT=4.683
T1=5.6
OPT
f=9465
TT=5.469
T1=5.41
SAT (TO)
f=28153
TT=1800.1
T1=1800.5
? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataOPT
f=9465
TT=4.668
T1=2.36
No dataNo dataOPT
f=9465
TT=4.705
T1=2.39
No dataNo dataNo dataOPT
f=9465
TT=7.343
T1=6.71
OPT
f=9465
TT=4.892
T1=3.28
OPT
f=9465
TT=4.154
T1=2.87
OPT
f=9465
TT=4.861
T1=4.8
OPT
f=9465
TT=4.902
T1=4.85
OPT
f=9465
TT=5.882
T1=5.82
OPT
f=9465
TT=241.441
T1=202.69
OPT
f=9465
TT=242.133
T1=203.75
OPT
f=9465
TT=2.087
T1=2.09
No dataNo dataOPT
f=9465
TT=2.171
T1=2.17
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randd7b2b4.cudf.paranoid.opb
OPT
f=4750
TT=0.227
T1=0.21
OPT
f=4750
TT=198.936
T1=183.23
No dataOPT
f=4750
TT=0.227
T1=0.21
OPT
f=4750
TT=1417.17
T1=1417.51
OPT
f=4750
TT=458.034
T1=428.2
? (problem)

TT=0.309

? (problem)

TT=0.261

? (problem)

TT=0.301

? (problem)

TT=0.262

? (problem)

TT=0.303

? (problem)

TT=0.241

OPT
f=4750
TT=13.496
T1=13.31
SAT (TO)
f=135342
TT=1800.02
T1=1032.51
SAT (TO)
f=98110
TT=1801.47
T1=1805.29
OPT
f=4750
TT=0.835
T1=0.71
OPT
f=4750
TT=3.136
T1=1.62
OPT
f=4750
TT=194.006
T1=178.72
OPT
f=4750
TT=2.604
T1=1.37
OPT
f=4750
TT=2.273
T1=2.22
No dataOPT
f=4750
TT=1.098
T1=1.06
OPT
f=4750
TT=3.313
T1=6.58
OPT
f=4750
TT=5.165
T1=5.11
No dataOPT
f=4750
TT=2.954
T1=4.62
OPT
f=4750
TT=5.208
T1=5.15
SAT (TO)
f=82275
TT=1800.04
T1=1800.5
? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataOPT
f=4750
TT=2.129
T1=1.08
No dataNo dataOPT
f=4750
TT=2.432
T1=1.25
No dataNo dataNo dataOPT
f=4750
TT=5.612
T1=5.23
OPT
f=4750
TT=6.094
T1=4.68
OPT
f=4750
TT=4.343
T1=3.08
OPT
f=4750
TT=5.916
T1=5.84
OPT
f=4750
TT=5.856
T1=5.78
OPT
f=4750
TT=5.199
T1=5.14
OPT
f=4750
TT=1647.7
T1=1647.02
OPT
f=4750
TT=1653.85
T1=1653.16
OPT
f=4750
TT=1.828
T1=1.82
No dataNo dataOPT
f=4750
TT=1.821
T1=1.81
/OPT-SMALLINT-LIN/leberre/opb-paranoid/
misc2010/random/rand.newlist/
normalized-randfd04d4.cudf.paranoid.opb
OPT
f=3511
TT=0.132
T1=0.12
OPT
f=3511
TT=73.082
T1=72.94
No dataOPT
f=3511
TT=0.132
T1=0.12
OPT
f=3511
TT=919.196
T1=904.08
OPT
f=3511
TT=216.357
T1=216.6
? (problem)

TT=0.306

? (problem)

TT=0.258

? (problem)

TT=0.301

? (problem)

TT=0.265

? (problem)

TT=0.306

? (problem)

TT=0.255

OPT
f=3511
TT=2.715
T1=2.59
OPT
f=3511
TT=829.803
T1=829.26
SAT (TO)
f=127006
TT=1802.07
T1=1803.06
OPT
f=3511
TT=0.603
T1=0.6
OPT
f=3511
TT=2.633
T1=1.29
OPT
f=3511
TT=68.93
T1=68.81
OPT
f=3511
TT=2.393
T1=1.09
OPT
f=3511
TT=4.75
T1=4.7
No dataOPT
f=3511
TT=1.123
T1=1.08
OPT
f=3511
TT=2.814
T1=4.57
OPT
f=3511
TT=5.342
T1=5.29
No dataOPT
f=3511
TT=2.473
T1=3.07
OPT
f=3511
TT=5.673
T1=5.63
OPT
f=3511
TT=1655.89
T1=1656.16
? (TO)

TT=1800.08

? (TO)

TT=1800.13

No dataNo dataNo dataOPT
f=3511
TT=2.104
T1=1.08
No dataNo dataOPT
f=3511
TT=1.892
T1=0.97
No dataNo dataNo dataOPT
f=3511
TT=4.225
T1=4.2
OPT
f=3511
TT=2.584
T1=1.13
OPT
f=3511
TT=2.843
T1=1.69
OPT
f=3511
TT=6.579
T1=6.5
OPT
f=3511
TT=4.904
T1=4.84
OPT
f=3511
TT=4.691
T1=4.63
OPT
f=3511
TT=453.687
T1=453.73
OPT
f=3511
TT=472.667
T1=472.19
OPT
f=3511
TT=1.561
T1=1.56
No dataNo dataOPT
f=3511
TT=1.583
T1=1.58
/OPT-SMALLINT-LIN/leberre/
opb-trendy/misc2010/datasets/caixa/
normalized-1021.cudf.trendy.opb
UNSAT

TT=0.002

UNSAT

TT=0.002

No dataUNSAT

TT=0.003

UNSAT

TT=0.019

UNSAT

TT=0.026

UNSAT

TT=0.009

UNSAT

TT=0.022

UNSAT

TT=0.009

UNSAT

TT=0.017

UNSAT

TT=0.01

UNSAT

TT=0.018

UNSAT

TT=0.006

UNSAT

TT=0.008

UNSAT

TT=0.051

UNSAT

TT=0.006

UNSAT

TT=0.216

UNSAT

TT=0.002

UNSAT

TT=0.214

UNSAT

TT=0.017

No dataUNSAT

TT=0.008

UNSAT

TT=0.243

UNSAT

TT=0.019

No dataUNSAT

TT=0.264

UNSAT

TT=0.023

UNSAT

TT=0.003

UNSAT

TT=0.009

UNSAT

TT=0.008

No dataNo dataNo dataUNSAT

TT=0.003

No dataNo dataUNSAT

TT=0.003

No dataNo dataNo dataUNSAT

TT=0.244

UNSAT

TT=0.234

UNSAT

TT=0.254

UNSAT

TT=0.016

UNSAT

TT=0.02

UNSAT

TT=0.018

UNSAT

TT=0.017

UNSAT

TT=0.019

UNSAT

TT=0.003

No dataNo dataUNSAT

TT=0.003

/OPT-SMALLINT-LIN/leberre/
opb-trendy/misc2010/datasets/caixa/
normalized-1078.cudf.trendy.opb
OPT
f=4
TT=0
T1=0
OPT
f=4
TT=0
T1=0
No dataOPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.04
T1=0.01
OPT
f=4
TT=0.045
T1=0.02
OPT
f=4
TT=0.021
T1=0.01
OPT
f=4
TT=0.022
T1=0.02
OPT
f=4
TT=0.016
T1=0.01
OPT
f=4
TT=0.017
T1=0.01
OPT
f=4
TT=0.027
T1=0.01
OPT
f=4
TT=0.03
T1=0.01
OPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.029
T1=0.01
OPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.105
T1=0.1
OPT
f=4
TT=0.001
T1=0
OPT
f=4
TT=0.143
T1=0.1
OPT
f=4
TT=0.017
T1=0.01
No dataOPT
f=4
TT=0.004
T1=0
OPT
f=4
TT=0.166
T1=1.12
OPT
f=4
TT=0.011
T1=0.01
No dataOPT
f=4
TT=0.176
T1=0.66
OPT
f=4
TT=0.018
T1=0.01
OPT
f=4
TT=0.003
T1=0
OPT
f=4
TT=0.015
T1=0.01
OPT
f=4
TT=0.009
T1=0
No dataNo dataNo dataOPT
f=4
TT=0.001
T1=0
No dataNo dataOPT
f=4
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=4
TT=0.174
T1=0.63
OPT
f=4
TT=0.155
T1=0.12
OPT
f=4
TT=0.197
T1=0.15
OPT
f=4
TT=0.012
T1=0.01
OPT
f=4
TT=0.015
T1=0.01
OPT
f=4
TT=0.013
T1=0.01
OPT
f=4
TT=0.002
T1=0
OPT
f=4
TT=0.003
T1=0
OPT
f=4
TT=0.002
T1=0
No dataNo dataOPT
f=4
TT=0.003
T1=0
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/leberre/
opb-trendy/misc2010/datasets/caixa/
normalized-787.cudf.trendy.opb
OPT
f=14
TT=0.002
T1=0
OPT
f=14
TT=0.002
T1=0
No dataOPT
f=14
TT=0.002
T1=0
OPT
f=14
TT=0.047
T1=0.01
OPT
f=14
TT=0.055
T1=0.02
? (problem)

TT=0.009

? (problem)

TT=0.023

? (problem)

TT=0.01

? (problem)

TT=0.017

? (problem)

TT=0.006

? (problem)

TT=0.018

Wrong Opt.
f=270
TT=0.002
T1=0
OPT
f=14
TT=0.004
T1=0
OPT
f=14
TT=0.037
T1=0.02
OPT
f=14
TT=0.003
T1=0
OPT
f=14
TT=0.165
T1=0.13
OPT
f=14
TT=0.001
T1=0
OPT
f=14
TT=0.193
T1=0.13
OPT
f=14
TT=0.02
T1=0.01
No dataOPT
f=14
TT=0.006
T1=0
OPT
f=14
TT=0.205
T1=1.15
OPT
f=14
TT=0.016
T1=0.01
No dataOPT
f=14
TT=0.214
T1=0.67
OPT
f=14
TT=0.023
T1=0.01
OPT
f=14
TT=0.003
T1=0
OPT
f=14
TT=0.033
T1=0.01
OPT
f=14
TT=0.032
T1=0.03
No dataNo dataNo dataOPT
f=14
TT=0.002
T1=0
No dataNo dataOPT
f=14
TT=0.002
T1=0
No dataNo dataNo dataOPT
f=14
TT=0.204
T1=0.64
OPT
f=14
TT=0.215
T1=0.15
OPT
f=14
TT=0.215
T1=0.16
OPT
f=14
TT=0.022
T1=0.01
OPT
f=14
TT=0.024
T1=0.01
OPT
f=14
TT=0.021
T1=0.01
OPT
f=14
TT=0.006
T1=0
OPT
f=14
TT=0.006
T1=0
OPT
f=14
TT=0.002
T1=0
No dataNo dataOPT
f=14
TT=0.002
T1=0
/OPT-SMALLINT-LIN/leberre/
opb-trendy/misc2010/datasets/caixa/
normalized-995.cudf.trendy.opb
UNSAT

TT=0.003

UNSAT

TT=0.004

No dataUNSAT

TT=0.003

UNSAT

TT=0.022

UNSAT

TT=0.024

UNSAT

TT=0.011

UNSAT

TT=0.022

UNSAT

TT=0.012

UNSAT

TT=0.02

UNSAT

TT=0.014

UNSAT

TT=0.018

UNSAT

TT=0.005

UNSAT

TT=0.01

UNSAT

TT=0.066

UNSAT

TT=0.008

UNSAT

TT=0.245

UNSAT

TT=0.003

UNSAT

TT=0.245

UNSAT

TT=0.023

No dataUNSAT

TT=0.012

UNSAT

TT=0.275

UNSAT

TT=0.021

No dataUNSAT

TT=0.304

UNSAT

TT=0.025

UNSAT

TT=0.004

UNSAT

TT=0.009

UNSAT

TT=0.008

No dataNo dataNo dataUNSAT

TT=0.005

No dataNo dataUNSAT

TT=0.006

No dataNo dataNo dataUNSAT

TT=0.285

UNSAT

TT=0.264

UNSAT

TT=0.273

UNSAT

TT=0.018

UNSAT

TT=0.022

UNSAT

TT=0.02

UNSAT

TT=0.022

UNSAT

TT=0.023

UNSAT

TT=0.004

No dataNo dataUNSAT

TT=0.004

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12015_5.std.opb
OPT
f=87
TT=0.299
T1=0.27
OPT
f=87
TT=197.891
T1=197.92
No dataOPT
f=87
TT=0.299
T1=0.27
? (problem)

TT=35.822

OPT
f=87
TT=65.104
T1=65.96
? (problem)

TT=29.02

? (problem)

TT=33.67

? (problem)

TT=30.333

? (problem)

TT=28.85

? (problem)

TT=33.41

? (problem)

TT=33.73

OPT
f=87
TT=143.823
T1=143.84
OPT
f=87
TT=127.504
T1=127.53
OPT
f=87
TT=16.912
T1=14.8
OPT
f=87
TT=37
T1=36.99
OPT
f=87
TT=3.643
T1=1.92
OPT
f=87
TT=197.576
T1=197.6
OPT
f=87
TT=3.521
T1=1.81
? (TO)

TT=1802.13

No dataOPT
f=87
TT=275.014
T1=268.74
OPT
f=87
TT=4.703
T1=2.92
? (TO)

TT=1802.08

No dataOPT
f=87
TT=4.273
T1=2.32
? (TO)

TT=1802.13

OPT
f=87
TT=121.52
T1=121.48
OPT
f=87
TT=254.328
T1=282.63
? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=87
TT=1.928
T1=1.34
No dataNo dataOPT
f=87
TT=1.884
T1=1.31
No dataNo dataNo dataOPT
f=87
TT=5.963
T1=2.65
OPT
f=87
TT=3.342
T1=1.79
OPT
f=87
TT=3.163
T1=1.78
OPT
f=87
TT=754.853
T1=753.86
OPT
f=87
TT=744.816
T1=743.78
OPT
f=87
TT=763.721
T1=762.72
OPT
f=87
TT=5.095
T1=5.02
OPT
f=87
TT=5.155
T1=5.08
OPT
f=87
TT=1.029
T1=1
No dataNo dataOPT
f=87
TT=1.042
T1=1.02
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12018_6.std.opb
SAT
f=143
TT=1800.18
T1=456.49
SAT
f=147
TT=1798.04
T1=373.38
No data? (TO)

TT=1800.06

? (problem)

TT=49.067

? (TO)

TT=1800.08

? (problem)

TT=36.75

? (problem)

TT=37.46

? (problem)

TT=36.98

? (problem)

TT=32.23

? (problem)

TT=38.5

? (problem)

TT=32.92

SAT (TO)
f=146
TT=1800.1
T1=198.93
? (TO)

TT=1800.1

SAT (TO)
f=144
TT=1802
T1=891.22
SAT
f=231
TT=1783.02
T1=1466.07
SAT (TO)
f=147
TT=1800.7
T1=729.5
SAT
f=145
TT=1798.05
T1=461.09
SAT (TO)
f=146
TT=1800.33
T1=287
?

TT=1796.36

No dataNo Cert.

TT=1800

SAT (TO)
f=147
TT=1801.1
T1=821.01
?

TT=1791.8

No dataSAT (TO)
f=144
TT=1800.04
T1=759.65
? (TO)

TT=1802.21

? (TO)

TT=1800.04

? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=144
TT=1800.06
T1=900.71
No dataNo dataSAT (TO)
f=143
TT=1800.18
T1=900.81
No dataNo dataNo data? (TO)

TT=1802.66

SAT (TO)
f=143
TT=1800.58
T1=456.49
SAT (TO)
f=143
TT=1800.73
T1=469.48
?

TT=1797.43

?

TT=1798.14

?

TT=1798.08

? (TO)

TT=1800.04

? (TO)

TT=1800.09

?

TT=1799.59

No dataNo data?

TT=1799.64

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12020_7.std.opb
OPT
f=81
TT=0.317
T1=0.28
OPT
f=81
TT=195.631
T1=195.67
No dataOPT
f=81
TT=0.317
T1=0.28
? (problem)

TT=165.237

OPT
f=81
TT=109.917
T1=110.21
? (problem)

TT=218.21

OPT
f=81
TT=99.391
T1=100.31
? (problem)

TT=221.88

? (problem)

TT=1096.67

? (problem)

TT=162.65

? (TO)

TT=1800.08

OPT
f=81
TT=158.016
T1=158.02
OPT
f=81
TT=828.342
T1=828.47
OPT
f=81
TT=16.495
T1=14.55
OPT
f=81
TT=38.218
T1=38.21
OPT
f=81
TT=4.181
T1=2.5
OPT
f=81
TT=200.406
T1=200.44
OPT
f=81
TT=4.393
T1=2.6
?

TT=1796.24

No dataOPT
f=81
TT=821.359
T1=454.52
OPT
f=81
TT=7.943
T1=11
?

TT=1791.92

No dataOPT
f=81
TT=7.084
T1=6.5
? (TO)

TT=1802.16

OPT
f=81
TT=884.914
T1=885.13
? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo dataOPT
f=81
TT=1.766
T1=1.26
No dataNo dataOPT
f=81
TT=1.994
T1=1.39
No dataNo dataNo dataOPT
f=81
TT=6.907
T1=3.32
OPT
f=81
TT=4.143
T1=2.21
SAT
f=81
TT=10.682
T1=8.79
OPT
f=81
TT=1153.26
T1=1152.18
OPT
f=81
TT=1199.41
T1=1198.15
OPT
f=81
TT=919.121
T1=918.29
OPT
f=81
TT=5.497
T1=5.41
OPT
f=81
TT=5.334
T1=5.26
OPT
f=81
TT=1.167
T1=1.13
No dataNo dataOPT
f=81
TT=1.113
T1=1.08
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12020_8.std.opb
OPT
f=107
TT=2.512
T1=2.49
OPT
f=107
TT=369.815
T1=369.96
No dataOPT
f=107
TT=2.512
T1=2.49
? (problem)

TT=49.607

? (TO)

TT=1800.05

? (problem)

TT=39.27

? (problem)

TT=102.01

? (problem)

TT=40.61

? (problem)

TT=101.63

? (problem)

TT=46.63

? (problem)

TT=81.37

OPT
f=107
TT=574.366
T1=574.4
SAT (TO)
f=288
TT=1800.12
T1=1433.91
OPT
f=107
TT=159.611
T1=157.86
OPT
f=107
TT=93.087
T1=93.13
OPT
f=107
TT=20.453
T1=18.14
OPT
f=107
TT=217.998
T1=218
OPT
f=107
TT=12.644
T1=10.4
?

TT=1797.02

No data? (TO)

TT=1800.28

OPT
f=107
TT=715.465
T1=397.41
?

TT=1791.98

No dataOPT
f=107
TT=94.879
T1=56.04
? (TO)

TT=1802.13

No Cert.

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.09

No dataNo dataNo dataOPT
f=107
TT=17.488
T1=9.17
No dataNo dataOPT
f=107
TT=6.557
T1=3.69
No dataNo dataNo dataOPT
f=107
TT=16.112
T1=9.23
OPT
f=107
TT=7.082
T1=4.92
SAT
f=107
TT=23.961
T1=21.74
SAT
f=300
TT=1798.29
T1=324.42
SAT
f=300
TT=1798.53
T1=354.21
SAT
f=300
TT=1798.38
T1=305.75
OPT
f=107
TT=67.996
T1=67.95
OPT
f=107
TT=67.175
T1=67.12
OPT
f=107
TT=3.17
T1=3.14
No dataNo dataOPT
f=107
TT=3.127
T1=3.09
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12026_4.std.opb
SAT
f=174
TT=1800.02
T1=773.89
SAT
f=177
TT=1798.01
T1=1400.39
No data? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (problem)

TT=13.2

? (problem)

TT=10.36

? (problem)

TT=13.12

? (problem)

TT=11.41

? (problem)

TT=13.17

? (problem)

TT=10.14

SAT (TO)
f=181
TT=1800.04
T1=330.36
SAT (TO)
f=290
TT=1800.09
T1=1714.46
SAT (TO)
f=176
TT=1801.88
T1=953.77
SAT
f=177
TT=1783.03
T1=1218.78
SAT (TO)
f=174
TT=1800.02
T1=1246.74
SAT
f=177
TT=1798.02
T1=1125.51
SAT (TO)
f=174
TT=1800.47
T1=928.75
?

TT=1796.85

No dataNo Cert.

TT=1800

SAT (TO)
f=176
TT=1800.71
T1=708.15
?

TT=1790.43

No dataSAT (TO)
f=175
TT=1800.72
T1=495.56
?

TT=1797.54

No Cert.

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=176
TT=1800.08
T1=900.71
No dataNo dataSAT (TO)
f=175
TT=1800.15
T1=900.71
No dataNo dataNo dataSAT (TO)
f=175
TT=1800.92
T1=252.4
SAT (TO)
f=174
TT=1800.79
T1=773.89
SAT (TO)
f=176
TT=1800.68
T1=751.13
?

TT=1799.06

?

TT=1799.16

?

TT=1799.38

? (TO)

TT=1800.09

? (TO)

TT=1800.04

?

TT=1799.9

No dataNo data?

TT=1799.95

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12037_6.std.opb
SAT
f=175
TT=1800.8
T1=199.03
SAT
f=179
TT=1798.02
T1=1014.85
No data? (TO)

TT=1800.1

? (problem)

TT=131.546

? (TO)

TT=1800.01

? (problem)

TT=90.33

? (problem)

TT=723.33

? (problem)

TT=92.17

? (problem)

TT=612.14

? (problem)

TT=96.99

? (problem)

TT=782.06

SAT (TO)
f=179
TT=1800.05
T1=844.19
? (TO)

TT=1800.11

SAT (TO)
f=176
TT=1802
T1=985.99
SAT
f=274
TT=1783.02
T1=1510.26
SAT (TO)
f=180
TT=1800.72
T1=1711.03
SAT
f=180
TT=1798.02
T1=1398.53
SAT (TO)
f=180
TT=1801.18
T1=948.8
?

TT=1797.45

No data?

TT=1799.72

SAT (TO)
f=191
TT=1800.53
T1=891.81
?

TT=1791.62

No dataSAT (TO)
f=178
TT=1800.54
T1=804.09
? (TO)

TT=1802.11

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=178
TT=1800.39
T1=900.71
No dataNo dataSAT (TO)
f=177
TT=1800.38
T1=900.71
No dataNo dataNo dataSAT (TO)
f=175
TT=1800.8
T1=199.03
SAT (TO)
f=176
TT=1800.1
T1=575.78
SAT (TO)
f=177
TT=1800.1
T1=845.34
?

TT=1799.07

?

TT=1799.35

?

TT=1799.19

? (TO)

TT=1800.06

? (TO)

TT=1800.12

?

TT=1799.59

No dataNo data?

TT=1799.6

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12038_4.std.opb
SAT
f=147
TT=1800.2
T1=73.23
SAT
f=151
TT=1798.04
T1=267.33
No data? (TO)

TT=1800.08

? (problem)

TT=136.764

? (TO)

TT=1800.06

? (problem)

TT=100.57

? (problem)

TT=164.17

? (problem)

TT=99.11

? (problem)

TT=123.96

? (problem)

TT=102.24

? (problem)

TT=130.19

SAT (TO)
f=150
TT=1800.03
T1=1277.22
SAT (TO)
f=299
TT=1800.05
T1=1356.57
SAT (TO)
f=147
TT=1801.96
T1=1344.86
SAT
f=257
TT=1783.02
T1=919.71
SAT (TO)
f=152
TT=1800.05
T1=226.62
SAT
f=151
TT=1798.03
T1=414.28
SAT (TO)
f=154
TT=1800
T1=12.19
?

TT=1796.73

No data?

TT=1799.1

SAT (TO)
f=148
TT=1800.17
T1=535.57
?

TT=1791.68

No dataSAT (TO)
f=149
TT=1800.19
T1=424.11
? (TO)

TT=1802.24

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=149
TT=1800.17
T1=900.81
No dataNo dataSAT (TO)
f=149
TT=1800.53
T1=900.81
No dataNo dataNo dataSAT (TO)
f=147
TT=1800.2
T1=73.23
SAT (TO)
f=147
TT=1800.66
T1=1248.04
SAT (TO)
f=148
TT=1800.76
T1=1636.06
?

TT=1799.13

?

TT=1797.56

?

TT=1797.58

? (TO)

TT=1800.07

? (TO)

TT=1800.09

?

TT=1799.53

No dataNo data?

TT=1799.6

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j1204_10.std.opb
OPT
f=77
TT=0.289
T1=0.26
OPT
f=77
TT=193.34
T1=193.37
No dataOPT
f=77
TT=0.289
T1=0.26
OPT
f=77
TT=19.883
T1=20.16
OPT
f=77
TT=13.321
T1=13.46
? (problem)

TT=9.5

? (problem)

TT=7.2

? (problem)

TT=9.58

? (problem)

TT=7.17

? (problem)

TT=10.6

? (problem)

TT=6.53

OPT
f=77
TT=160.093
T1=160.12
OPT
f=77
TT=96.384
T1=96.35
OPT
f=77
TT=16.124
T1=14.06
OPT
f=77
TT=36.096
T1=36.08
OPT
f=77
TT=3.374
T1=1.78
OPT
f=77
TT=194.646
T1=194.65
OPT
f=77
TT=3.098
T1=1.6
? (TO)

TT=1802.2

No dataOPT
f=77
TT=156.289
T1=150.34
OPT
f=77
TT=3.963
T1=2.69
?

TT=1791.77

No dataOPT
f=77
TT=3.782
T1=2.13
?

TT=1798.78

OPT
f=77
TT=93.047
T1=92.95
OPT
f=77
TT=14.366
T1=15.58
OPT
f=77
TT=271.92
T1=286.47
No dataNo dataNo dataOPT
f=77
TT=1.734
T1=1.18
No dataNo dataOPT
f=77
TT=1.691
T1=1.16
No dataNo dataNo dataOPT
f=77
TT=5.001
T1=2.35
OPT
f=77
TT=3.145
T1=1.64
SAT
f=77
TT=3.294
T1=1.86
OPT
f=77
TT=899.252
T1=898.48
OPT
f=77
TT=1207.71
T1=1206.65
OPT
f=77
TT=1217.93
T1=1216.87
OPT
f=77
TT=4.569
T1=4.5
OPT
f=77
TT=4.87
T1=4.79
OPT
f=77
TT=0.908
T1=0.88
No dataNo dataOPT
f=77
TT=1.001
T1=1.09
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12041_1.std.opb
OPT
f=127
TT=0.35
T1=0.31
OPT
f=127
TT=198.352
T1=198.3
No dataOPT
f=127
TT=0.35
T1=0.31
OPT
f=127
TT=13.172
T1=11.86
OPT
f=127
TT=7.477
T1=5.88
? (problem)

TT=6.59

? (problem)

TT=4.29

? (problem)

TT=6.02

? (problem)

TT=3.92

? (problem)

TT=6.69

? (problem)

TT=4.3

OPT
f=127
TT=193.241
T1=193.21
OPT
f=127
TT=50.857
T1=50.76
OPT
f=127
TT=895.289
T1=900.95
OPT
f=127
TT=42.084
T1=42.05
OPT
f=127
TT=4.034
T1=2.28
OPT
f=127
TT=194.996
T1=194.86
OPT
f=127
TT=3.743
T1=2.02
?

TT=1797.12

No dataNo Cert.

TT=1800.09

OPT
f=127
TT=7.144
T1=5.75
?

TT=1790.32

No dataOPT
f=127
TT=6.952
T1=3.74
?

TT=1797.63

OPT
f=127
TT=36.382
T1=36.35
OPT
f=127
TT=8.682
T1=8.85
OPT
f=127
TT=169.679
T1=175.99
No dataNo dataNo dataOPT
f=127
TT=7.827
T1=4.26
No dataNo dataOPT
f=127
TT=7.858
T1=4.28
No dataNo dataNo dataOPT
f=127
TT=7.472
T1=3.5
OPT
f=127
TT=3.642
T1=1.98
OPT
f=127
TT=9.625
T1=7.61
?

TT=1798.04

?

TT=1798.01

?

TT=1797.96

OPT
f=127
TT=6.578
T1=6.36
OPT
f=127
TT=7.357
T1=7.11
OPT
f=127
TT=3.425
T1=3.4
No dataNo dataOPT
f=127
TT=3.545
T1=3.52
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j1204_1.std.opb
OPT
f=74
TT=0.293
T1=0.26
OPT
f=74
TT=192.506
T1=192.55
No dataOPT
f=74
TT=0.293
T1=0.26
OPT
f=74
TT=18.589
T1=19.52
OPT
f=74
TT=13.087
T1=12.25
? (problem)

TT=8.79

? (problem)

TT=7.88

? (problem)

TT=8.85

? (problem)

TT=7.06

? (problem)

TT=9.84

? (problem)

TT=6.91

OPT
f=74
TT=166.506
T1=166.51
OPT
f=74
TT=103.723
T1=103.66
OPT
f=74
TT=1313.55
T1=1314.33
OPT
f=74
TT=36.732
T1=36.72
OPT
f=74
TT=3.268
T1=1.82
OPT
f=74
TT=197.461
T1=197.49
OPT
f=74
TT=3.152
T1=1.63
?

TT=1795.2

No dataOPT
f=74
TT=234.512
T1=228.26
OPT
f=74
TT=4.215
T1=2.73
?

TT=1790.33

No dataOPT
f=74
TT=4.033
T1=2.16
?

TT=1797.97

OPT
f=74
TT=100.874
T1=50.42
OPT
f=74
TT=10.971
T1=11.58
OPT
f=74
TT=259.919
T1=272.38
No dataNo dataNo dataOPT
f=74
TT=2.723
T1=1.68
No dataNo dataOPT
f=74
TT=2.72
T1=1.68
No dataNo dataNo dataOPT
f=74
TT=5.643
T1=2.46
OPT
f=74
TT=3.203
T1=1.66
SAT
f=74
TT=3.381
T1=1.81
?

TT=1798.36

?

TT=1798.37

?

TT=1798.41

OPT
f=74
TT=4.746
T1=4.54
OPT
f=74
TT=4.756
T1=4.56
OPT
f=74
TT=1.365
T1=1.33
No dataNo dataOPT
f=74
TT=1.472
T1=1.44
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12044_1.std.opb
OPT
f=100
TT=0.298
T1=0.27
OPT
f=100
TT=190.536
T1=190.59
No dataOPT
f=100
TT=0.298
T1=0.27
OPT
f=100
TT=14.963
T1=11.74
OPT
f=100
TT=10.217
T1=8.7
? (problem)

TT=7.81

? (problem)

TT=6.5

? (problem)

TT=7.81

? (problem)

TT=6.56

? (problem)

TT=7.84

? (problem)

TT=5.9

OPT
f=100
TT=191.846
T1=191.87
OPT
f=100
TT=14.989
T1=14.95
OPT
f=100
TT=16.449
T1=14.59
OPT
f=100
TT=39.515
T1=39.5
OPT
f=100
TT=3.303
T1=1.8
OPT
f=100
TT=190.361
T1=190.37
OPT
f=100
TT=3.105
T1=1.66
? (TO)

TT=1802.13

No dataOPT
f=100
TT=146.04
T1=140.1
OPT
f=100
TT=4.032
T1=2.69
?

TT=1790.43

No dataOPT
f=100
TT=3.955
T1=2.23
? (TO)

TT=1802.23

OPT
f=100
TT=9.698
T1=9.64
OPT
f=100
TT=11.355
T1=11.68
OPT
f=100
TT=204.929
T1=208.25
No dataNo dataNo dataOPT
f=100
TT=1.788
T1=1.24
No dataNo dataOPT
f=100
TT=1.78
T1=1.22
No dataNo dataNo dataOPT
f=100
TT=5.112
T1=2.44
OPT
f=100
TT=3.252
T1=1.71
OPT
f=100
TT=3.155
T1=1.82
OPT
f=100
TT=1042.81
T1=1042.09
OPT
f=100
TT=1329.98
T1=1328.93
OPT
f=100
TT=1301.46
T1=1300.42
OPT
f=100
TT=4.835
T1=4.76
OPT
f=100
TT=5.033
T1=4.95
OPT
f=100
TT=0.953
T1=0.93
No dataNo dataOPT
f=100
TT=1.045
T1=1.01
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12044_8.std.opb
OPT
f=108
TT=0.315
T1=0.26
OPT
f=108
TT=193.182
T1=193.21
No dataOPT
f=108
TT=0.315
T1=0.26
OPT
f=108
TT=15.43
T1=15.91
OPT
f=108
TT=11.058
T1=11.39
? (problem)

TT=7.26

? (problem)

TT=6.32

? (problem)

TT=7.38

? (problem)

TT=5.62

? (problem)

TT=7.98

? (problem)

TT=5.69

OPT
f=108
TT=190.685
T1=190.71
OPT
f=108
TT=169.527
T1=169.42
OPT
f=108
TT=949.399
T1=953.7
OPT
f=108
TT=38.928
T1=38.91
OPT
f=108
TT=3.435
T1=1.85
OPT
f=108
TT=189.795
T1=189.82
OPT
f=108
TT=3.283
T1=1.71
?

TT=1795.97

No dataOPT
f=108
TT=77.896
T1=71.93
OPT
f=108
TT=4.293
T1=2.73
?

TT=1790.38

No dataOPT
f=108
TT=4.112
T1=2.23
?

TT=1797.35

OPT
f=108
TT=115.427
T1=115.43
OPT
f=108
TT=9.041
T1=9.34
OPT
f=108
TT=185.732
T1=195.61
No dataNo dataNo dataOPT
f=108
TT=2.478
T1=1.58
No dataNo dataOPT
f=108
TT=2.451
T1=1.56
No dataNo dataNo dataOPT
f=108
TT=5.425
T1=2.4
OPT
f=108
TT=3.353
T1=1.71
SAT
f=108
TT=3.474
T1=1.88
OPT
f=108
TT=1583.18
T1=1582.89
OPT
f=108
TT=1329
T1=1328.72
OPT
f=108
TT=1359.27
T1=1359.07
OPT
f=108
TT=4.96
T1=4.77
OPT
f=108
TT=4.981
T1=4.79
OPT
f=108
TT=1.254
T1=1.22
No dataNo dataOPT
f=108
TT=1.266
T1=1.23
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12051_6.std.opb
SAT
f=228
TT=1800.09
T1=620.36
SAT
f=241
TT=1798.04
T1=406.96
No data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (problem)

TT=14.39

? (problem)

TT=182.71

? (problem)

TT=14.55

? (problem)

TT=180.77

? (problem)

TT=17

? (problem)

TT=243

SAT (TO)
f=240
TT=1800.1
T1=1014.26
? (TO)

TT=1800.05

SAT (TO)
f=235
TT=1802.07
T1=338.95
SAT
f=240
TT=1783.04
T1=1625.51
SAT (TO)
f=235
TT=1800.08
T1=1669.17
SAT
f=239
TT=1798.03
T1=797.57
SAT (TO)
f=237
TT=1800.93
T1=385.01
?

TT=1797.12

No data? (TO)

TT=1800.02

SAT (TO)
f=236
TT=1800.61
T1=846.85
?

TT=1790.45

No dataSAT (TO)
f=237
TT=1800.32
T1=896.28
?

TT=1797.71

? (TO)

TT=1800.08

? (TO)

TT=1800.15

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=231
TT=1800.11
T1=900.71
No dataNo dataSAT (TO)
f=233
TT=1800.02
T1=900.71
No dataNo dataNo dataSAT (TO)
f=228
TT=1800.09
T1=620.36
SAT (TO)
f=228
TT=1800.83
T1=1570.97
SAT (TO)
f=231
TT=1800.78
T1=1501.75
?

TT=1799.19

?

TT=1799.33

?

TT=1798.93

? (TO)

TT=1800.05

? (TO)

TT=1800.07

?

TT=1799.65

No dataNo data?

TT=1799.65

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12053_6.std.opb
SAT
f=108
TT=1800.63
T1=658.18
SAT
f=112
TT=1798.04
T1=878.78
No data? (TO)

TT=1800.09

? (problem)

TT=27.251

? (TO)

TT=1800.15

? (problem)

TT=25.67

? (problem)

TT=29.04

? (problem)

TT=26.15

? (problem)

TT=24.64

? (problem)

TT=26.48

? (problem)

TT=29.28

SAT (TO)
f=112
TT=1800.06
T1=468.27
SAT (TO)
f=274
TT=1800.06
T1=1742.25
SAT (TO)
f=108
TT=1802.01
T1=1436.21
SAT
f=114
TT=1783.03
T1=1398.15
SAT (TO)
f=116
TT=1800.6
T1=236.45
SAT
f=111
TT=1798.05
T1=547.12
SAT (TO)
f=109
TT=1800.44
T1=286.5
?

TT=1796.06

No dataNo Cert.

TT=1800.01

SAT (TO)
f=110
TT=1800.42
T1=247.49
?

TT=1790.32

No dataSAT (TO)
f=109
TT=1800.61
T1=472.17
?

TT=1797.42

No Cert.

TT=1800.01

? (TO)

TT=1800.12

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=110
TT=1800.42
T1=900.71
No dataNo dataSAT (TO)
f=111
TT=1800.19
T1=900.81
No dataNo dataNo dataSAT (TO)
f=109
TT=1800.78
T1=313.42
SAT (TO)
f=108
TT=1800.63
T1=658.18
SAT (TO)
f=108
TT=1800.1
T1=255.42
? (TO)

TT=1802.08

? (TO)

TT=1802.03

? (TO)

TT=1802.04

? (TO)

TT=1800.07

? (TO)

TT=1800.11

?

TT=1799.97

No dataNo data?

TT=1799.94

/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12055_4.std.opb
OPT
f=90
TT=0.324
T1=0.3
OPT
f=90
TT=195.435
T1=195.47
No dataOPT
f=90
TT=0.324
T1=0.3
? (problem)

TT=76.012

OPT
f=90
TT=99.079
T1=96.74
? (problem)

TT=72.49

? (problem)

TT=26.05

? (problem)

TT=70.84

? (problem)

TT=25.51

? (problem)

TT=92.75

? (problem)

TT=25.54

OPT
f=90
TT=194.502
T1=194.53
OPT
f=90
TT=594.01
T1=594.15
OPT
f=90
TT=1027.76
T1=1030.16
OPT
f=90
TT=40.427
T1=40.42
OPT
f=90
TT=4.484
T1=2.74
OPT
f=90
TT=192.133
T1=192.14
OPT
f=90
TT=5.244
T1=3.35
?

TT=1796.56

No data? (TO)

TT=1800.38

OPT
f=90
TT=8.423
T1=14.03
?

TT=1791.84

No dataOPT
f=90
TT=7.443
T1=8.03
?

TT=1797.61

OPT
f=90
TT=875.606
T1=875.76
OPT
f=90
TT=242.45
T1=237.52
? (TO)

TT=1800.14

No dataNo dataNo dataOPT
f=90
TT=2.086
T1=1.44
No dataNo dataOPT
f=90
TT=1.805
T1=1.28
No dataNo dataNo dataOPT
f=90
TT=12.262
T1=8.74
OPT
f=90
TT=5.232
T1=3.29
SAT
f=90
TT=9.863
T1=7.91
?

TT=1797.73

?

TT=1797.9

?

TT=1797.63

OPT
f=90
TT=6.096
T1=6.02
OPT
f=90
TT=6.161
T1=6.09
OPT
f=90
TT=1.102
T1=1.1
No dataNo dataOPT
f=90
TT=1.101
T1=1.07
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j1205_7.std.opb
OPT
f=84
TT=0.305
T1=0.27
OPT
f=84
TT=192.536
T1=192.56
No dataOPT
f=84
TT=0.305
T1=0.27
OPT
f=84
TT=15.47
T1=13.82
OPT
f=84
TT=14.005
T1=14.13
? (problem)

TT=8.25

? (problem)

TT=8.15

? (problem)

TT=8.72

? (problem)

TT=7.43

? (problem)

TT=8.58

? (problem)

TT=7.6

OPT
f=84
TT=134.843
T1=134.86
OPT
f=84
TT=123.879
T1=123.86
OPT
f=84
TT=15.399
T1=13.66
OPT
f=84
TT=36.087
T1=36.09
OPT
f=84
TT=3.322
T1=1.74
OPT
f=84
TT=189.175
T1=189.21
OPT
f=84
TT=3.193
T1=1.65
? (TO)

TT=1802.13

No dataOPT
f=84
TT=53.013
T1=47.04
OPT
f=84
TT=4.313
T1=2.71
?

TT=1790.61

No dataOPT
f=84
TT=4.053
T1=2.25
?

TT=1797.58

OPT
f=84
TT=72.518
T1=72.44
OPT
f=84
TT=9.434
T1=9.09
OPT
f=84
TT=11.638
T1=11.14
No dataNo dataNo dataOPT
f=84
TT=1.461
T1=1.03
No dataNo dataOPT
f=84
TT=1.667
T1=1.15
No dataNo dataNo dataOPT
f=84
TT=5.291
T1=2.48
OPT
f=84
TT=3.245
T1=1.7
OPT
f=84
TT=3.234
T1=1.7
OPT
f=84
TT=1125.56
T1=1124.57
OPT
f=84
TT=873.728
T1=872.93
OPT
f=84
TT=1137.86
T1=1136.78
OPT
f=84
TT=4.577
T1=4.5
OPT
f=84
TT=4.554
T1=4.48
OPT
f=84
TT=0.978
T1=0.94
No dataNo dataOPT
f=84
TT=0.921
T1=0.88
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j12060_6.std.opb
OPT
f=110
TT=1.295
T1=1.27
OPT
f=110
TT=204.201
T1=204.2
No dataOPT
f=110
TT=1.855
T1=1.82
? (problem)

TT=374.312

OPT
f=110
TT=542.342
T1=544.13
? (problem)

TT=358.26

OPT
f=110
TT=511.354
T1=512.97
? (problem)

TT=257.56

OPT
f=110
TT=1317.17
T1=1316.5
? (problem)

TT=260.24

? (TO)

TT=1705.54

OPT
f=110
TT=193.275
T1=193.3
SAT (TO)
f=236
TT=1800.07
T1=1754.09
OPT
f=110
TT=1069.37
T1=1072.09
OPT
f=110
TT=57.529
T1=57.53
SAT (TO)
f=114
TT=1800.08
T1=3.29
OPT
f=110
TT=201.096
T1=201.13
OPT
f=110
TT=10.202
T1=7.99
?

TT=1797.35

No data? (TO)

TT=1800.07

OPT
f=110
TT=1469.82
T1=777
?

TT=1791.71

No dataOPT
f=110
TT=40.847
T1=26.62
? (TO)

TT=1802.17

No Cert.

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.02

No dataNo dataNo dataOPT
f=110
TT=2.21
T1=1.53
No dataNo dataOPT
f=110
TT=2.014
T1=1.44
No dataNo dataNo dataOPT
f=110
TT=9.409
T1=7.27
OPT
f=110
TT=4.515
T1=2.72
SAT
f=110
TT=11.762
T1=9.56
?

TT=1798.01

?

TT=1798.15

?

TT=1797.82

OPT
f=110
TT=7.661
T1=7.59
OPT
f=110
TT=8.078
T1=8
OPT
f=110
TT=1.214
T1=1.18
No dataNo dataOPT
f=110
TT=1.295
T1=1.27
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j1207_10.std.opb
SAT
f=119
TT=1800.66
T1=475.59
SAT
f=124
TT=1798.05
T1=331.06
No data? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (problem)

TT=15.87

? (problem)

TT=15.74

? (problem)

TT=13.5

? (problem)

TT=13.65

? (problem)

TT=13.72

? (problem)

TT=16.08

SAT (TO)
f=123
TT=1800.08
T1=379.49
SAT (TO)
f=292
TT=1800.05
T1=1696.41
SAT (TO)
f=122
TT=1801.98
T1=1117.34
SAT
f=128
TT=1783.03
T1=1141.65
No Cert.

TT=1493.43

SAT
f=124
TT=1798.03
T1=897
SAT (TO)
f=122
TT=1800.34
T1=102.78
?

TT=1796.76

No dataNo Cert.

TT=1800.01

SAT (TO)
f=120
TT=1800.11
T1=703.3
?

TT=1790.33

No dataSAT (TO)
f=121
TT=1800.1
T1=761.3
?

TT=1798.32

No Cert.

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=122
TT=1800.56
T1=900.71
No dataNo dataSAT (TO)
f=121
TT=1800.63
T1=900.71
No dataNo dataNo dataSAT (TO)
f=120
TT=1800.76
T1=504.74
SAT (TO)
f=119
TT=1800.66
T1=475.59
SAT (TO)
f=121
TT=1800.08
T1=1473.49
?

TT=1797.71

?

TT=1797.74

?

TT=1799.08

? (TO)

TT=1800.07

? (TO)

TT=1800.11

?

TT=1799.63

No dataNo data?

TT=1799.87

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/
oliveras/j120opt/
normalized-j1207_6.std.opb
SAT
f=125
TT=1800.02
T1=333.71
SAT
f=127
TT=1798.02
T1=314.11
No data? (TO)

TT=1800.09

? (TO)

TT=1800.13

? (TO)

TT=1800.1

? (problem)

TT=13.6

? (problem)

TT=15.92

? (problem)

TT=13.69

? (problem)

TT=13.66

? (problem)

TT=16.5

? (problem)

TT=14.18

SAT (TO)
f=129
TT=1800.09
T1=482.96
SAT (TO)
f=286
TT=1800.08
T1=1796
SAT (TO)
f=126
TT=1802
T1=953.64
SAT
f=127
TT=1783.02
T1=1398.86
SAT (TO)
f=125
TT=1800.02
T1=966.85
SAT
f=127
TT=1798.02
T1=373.3
SAT (TO)
f=125
TT=1800.46
T1=1546.79
?

TT=1795.91

No dataNo Cert.

TT=1800.08

SAT (TO)
f=126
TT=1800.97
T1=210.65
?

TT=1790.47

No dataSAT (TO)
f=126
TT=1800.19
T1=849.8
?

TT=1797.44

No Cert.

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=126
TT=1800.08
T1=900.71
No dataNo dataSAT (TO)
f=126
TT=1800.51
T1=900.71
No dataNo dataNo dataSAT (TO)
f=126
TT=1800.81
T1=92.43
SAT (TO)
f=125
TT=1800.07
T1=333.71
SAT (TO)
f=126
TT=1800.54
T1=67.07
?

TT=1797.67

?

TT=1797.92

?

TT=1797.75

? (TO)

TT=1800.05

? (TO)

TT=1800.06

?

TT=1799.59

No dataNo data?

TT=1799.9

/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3010_3.std.opb
OPT
f=62
TT=0.077
T1=0.07
OPT
f=62
TT=30.475
T1=30.47
No dataOPT
f=62
TT=0.077
T1=0.07
OPT
f=62
TT=11.081
T1=11.22
OPT
f=62
TT=6.054
T1=6.05
? (problem)

TT=6.43

? (problem)

TT=2.62

? (problem)

TT=5.8

? (problem)

TT=2.87

? (problem)

TT=6.33

? (problem)

TT=2.71

OPT
f=62
TT=21.465
T1=21.45
OPT
f=62
TT=88.823
T1=88.66
OPT
f=62
TT=3.253
T1=2.77
OPT
f=62
TT=3.063
T1=3.06
OPT
f=62
TT=2.357
T1=1.04
OPT
f=62
TT=29.898
T1=29.89
OPT
f=62
TT=2.363
T1=0.94
? (TO)

TT=1802.12

No dataOPT
f=62
TT=49.572
T1=21.06
OPT
f=62
TT=3.155
T1=1.81
?

TT=1791.03

No dataOPT
f=62
TT=3.823
T1=1.46
OPT
f=62
TT=1253.91
T1=1244.45
OPT
f=62
TT=52.071
T1=51.98
OPT
f=62
TT=6.82
T1=7.3
OPT
f=62
TT=148.533
T1=158.25
No dataNo dataNo dataOPT
f=62
TT=0.495
T1=0.32
No dataNo dataOPT
f=62
TT=0.469
T1=0.3
No dataNo dataNo dataOPT
f=62
TT=4.572
T1=2.03
OPT
f=62
TT=2.332
T1=1
SAT
f=62
TT=3.933
T1=2.38
OPT
f=62
TT=254.215
T1=243.76
OPT
f=62
TT=256.45
T1=245.47
OPT
f=62
TT=282.318
T1=270.96
OPT
f=62
TT=1.397
T1=1.33
OPT
f=62
TT=1.32
T1=1.27
OPT
f=62
TT=0.287
T1=0.27
No dataNo dataOPT
f=62
TT=0.267
T1=0.25
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j301_8.std.opb
OPT
f=53
TT=0.072
T1=0.06
OPT
f=53
TT=24.783
T1=24.79
No dataOPT
f=53
TT=0.072
T1=0.06
OPT
f=53
TT=8.422
T1=6.57
OPT
f=53
TT=1.391
T1=1.13
? (problem)

TT=5.38

? (problem)

TT=0.807

? (problem)

TT=5.43

? (problem)

TT=0.71

? (problem)

TT=5.36

? (problem)

TT=0.7

OPT
f=53
TT=18.428
T1=18.43
OPT
f=53
TT=4.672
T1=4.65
OPT
f=53
TT=3.064
T1=2.71
OPT
f=53
TT=2.927
T1=2.92
OPT
f=53
TT=1.734
T1=0.8
OPT
f=53
TT=26.515
T1=26.51
OPT
f=53
TT=1.573
T1=0.72
OPT
f=53
TT=393.487
T1=393.3
No dataOPT
f=53
TT=3.577
T1=3.18
OPT
f=53
TT=2.114
T1=1.75
OPT
f=53
TT=526.42
T1=526.25
No dataOPT
f=53
TT=2.554
T1=1.36
OPT
f=53
TT=516.547
T1=516.4
OPT
f=53
TT=2.086
T1=2.07
OPT
f=53
TT=6.541
T1=7.09
OPT
f=53
TT=4.63
T1=5.6
No dataNo dataNo dataOPT
f=53
TT=0.396
T1=0.26
No dataNo dataOPT
f=53
TT=0.374
T1=0.25
No dataNo dataNo dataOPT
f=53
TT=2.67
T1=1.42
OPT
f=53
TT=1.654
T1=0.8
OPT
f=53
TT=1.594
T1=0.77
OPT
f=53
TT=72.648
T1=72.45
OPT
f=53
TT=73.919
T1=73.72
OPT
f=53
TT=71.976
T1=71.77
OPT
f=53
TT=1.201
T1=1.18
OPT
f=53
TT=1.18
T1=1.16
OPT
f=53
TT=0.231
T1=0.21
No dataNo dataOPT
f=53
TT=0.223
T1=0.2
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3020_9.std.opb
OPT
f=41
TT=0.075
T1=0.07
OPT
f=41
TT=44.01
T1=44.02
No dataOPT
f=41
TT=0.075
T1=0.07
OPT
f=41
TT=5.663
T1=6.53
OPT
f=41
TT=1.427
T1=1.43
? (problem)

TT=3.55

? (problem)

TT=0.854

? (problem)

TT=3.5

? (problem)

TT=0.77

? (problem)

TT=3.53

? (problem)

TT=0.81

OPT
f=41
TT=25.802
T1=25.8
OPT
f=41
TT=71.52
T1=71.37
OPT
f=41
TT=3.194
T1=2.74
OPT
f=41
TT=3.069
T1=3.06
OPT
f=41
TT=1.673
T1=0.81
OPT
f=41
TT=41.822
T1=41.82
OPT
f=41
TT=1.583
T1=0.72
OPT
f=41
TT=295.412
T1=295.21
No dataOPT
f=41
TT=2.747
T1=2.35
OPT
f=41
TT=2.134
T1=1.78
OPT
f=41
TT=211.534
T1=211.32
No dataOPT
f=41
TT=2.344
T1=1.34
OPT
f=41
TT=231.172
T1=230.95
OPT
f=41
TT=36.812
T1=36.7
OPT
f=41
TT=4.059
T1=4.07
OPT
f=41
TT=3.226
T1=3.21
No dataNo dataNo dataOPT
f=41
TT=0.413
T1=0.28
No dataNo dataOPT
f=41
TT=0.391
T1=0.26
No dataNo dataNo dataOPT
f=41
TT=2.714
T1=1.44
OPT
f=41
TT=1.674
T1=0.81
SAT
f=41
TT=1.973
T1=0.88
OPT
f=41
TT=59.875
T1=59.66
OPT
f=41
TT=57.764
T1=57.54
OPT
f=41
TT=70.786
T1=70.49
OPT
f=41
TT=1.23
T1=1.21
OPT
f=41
TT=1.179
T1=1.16
OPT
f=41
TT=0.237
T1=0.22
No dataNo dataOPT
f=41
TT=0.228
T1=0.22
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3021_10.std.opb
OPT
f=69
TT=0.078
T1=0.07
OPT
f=69
TT=34.726
T1=34.72
No dataOPT
f=69
TT=0.078
T1=0.07
OPT
f=69
TT=11.908
T1=8.71
OPT
f=69
TT=2.63
T1=2.59
? (problem)

TT=6.43

? (problem)

TT=1.266

? (problem)

TT=6.44

? (problem)

TT=1.17

? (problem)

TT=6.65

? (problem)

TT=1.25

OPT
f=69
TT=23.84
T1=23.82
OPT
f=69
TT=23.137
T1=22.94
OPT
f=69
TT=171.464
T1=172.48
OPT
f=69
TT=3.167
T1=3.15
OPT
f=69
TT=2.064
T1=0.93
OPT
f=69
TT=34.929
T1=34.92
OPT
f=69
TT=2.032
T1=0.93
? (TO)

TT=1801.71

No dataOPT
f=69
TT=173.016
T1=66.57
OPT
f=69
TT=2.755
T1=1.77
?

TT=1790.14

No dataOPT
f=69
TT=3.583
T1=1.37
? (TO)

TT=1802.09

OPT
f=69
TT=17.833
T1=17.77
OPT
f=69
TT=9.189
T1=9.97
OPT
f=69
TT=180.172
T1=210.73
No dataNo dataNo dataOPT
f=69
TT=1.413
T1=0.78
No dataNo dataOPT
f=69
TT=1.398
T1=0.77
No dataNo dataNo dataOPT
f=69
TT=3.814
T1=1.47
OPT
f=69
TT=2.154
T1=0.91
OPT
f=69
TT=2.123
T1=0.89
OPT
f=69
TT=198.749
T1=198.62
OPT
f=69
TT=195.48
T1=195.35
OPT
f=69
TT=248.321
T1=245.79
OPT
f=69
TT=1.415
T1=1.35
OPT
f=69
TT=1.419
T1=1.36
OPT
f=69
TT=0.715
T1=0.71
No dataNo dataOPT
f=69
TT=0.676
T1=0.66
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3029_1.std.opb
OPT
f=85
TT=0.123
T1=0.11
OPT
f=85
TT=31.598
T1=31.52
No dataOPT
f=85
TT=0.123
T1=0.11
OPT
f=85
TT=14.727
T1=14.72
OPT
f=85
TT=8.109
T1=9.02
? (problem)

TT=6.18

? (problem)

TT=3.03

? (problem)

TT=6.84

? (problem)

TT=2.94

? (problem)

TT=6.2

? (problem)

TT=3.22

OPT
f=85
TT=20.983
T1=20.95
OPT
f=85
TT=50.594
T1=50.42
OPT
f=85
TT=149.866
T1=149.91
OPT
f=85
TT=3.989
T1=3.94
OPT
f=85
TT=3.185
T1=1.68
OPT
f=85
TT=32.614
T1=32.55
OPT
f=85
TT=3.323
T1=1.74
? (TO)

TT=1801.48

No data? (TO)

TT=1800.06

OPT
f=85
TT=9.533
T1=25.94
?

TT=1790.19

No dataOPT
f=85
TT=6.143
T1=6.99
? (TO)

TT=1800.9

OPT
f=85
TT=37.41
T1=37.37
OPT
f=85
TT=7.17
T1=5.99
OPT
f=85
TT=138.969
T1=145.11
No dataNo dataNo dataOPT
f=85
TT=2.516
T1=1.34
No dataNo dataOPT
f=85
TT=2.461
T1=1.31
No dataNo dataNo dataOPT
f=85
TT=6.073
T1=3.55
OPT
f=85
TT=2.903
T1=1.35
OPT
f=85
TT=4.393
T1=2.61
OPT
f=85
TT=987.161
T1=983.74
OPT
f=85
TT=976.832
T1=973.4
SAT
f=86
TT=1796.89
T1=1541.3
OPT
f=85
TT=3.924
T1=3.8
OPT
f=85
TT=3.752
T1=3.64
OPT
f=85
TT=1.269
T1=1.26
No dataNo dataOPT
f=85
TT=1.15
T1=1.14
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3037_10.std.opb
OPT
f=81
TT=0.088
T1=0.08
OPT
f=81
TT=36.863
T1=36.87
No dataOPT
f=81
TT=0.088
T1=0.08
OPT
f=81
TT=5.495
T1=5.04
OPT
f=81
TT=3.731
T1=3.62
? (problem)

TT=2.274

? (problem)

TT=1.26

? (problem)

TT=2.268

? (problem)

TT=1.195

? (problem)

TT=2.23

? (problem)

TT=1.28

OPT
f=81
TT=25.132
T1=25.13
OPT
f=81
TT=65.596
T1=65
OPT
f=81
TT=167.434
T1=167.05
OPT
f=81
TT=3.346
T1=3.34
OPT
f=81
TT=2.086
T1=0.98
OPT
f=81
TT=37.735
T1=37.72
OPT
f=81
TT=1.933
T1=0.9
? (TO)

TT=1802.14

No dataOPT
f=81
TT=130.173
T1=68.13
OPT
f=81
TT=2.864
T1=1.81
?

TT=1789.83

No dataOPT
f=81
TT=3.304
T1=1.41
SAT (TO)
f=300
TT=1800.91
T1=1014.59
OPT
f=81
TT=44.713
T1=44.58
OPT
f=81
TT=3.33
T1=3.33
OPT
f=81
TT=73.588
T1=78.56
No dataNo dataNo dataOPT
f=81
TT=1.894
T1=1.03
No dataNo dataOPT
f=81
TT=1.854
T1=1
No dataNo dataNo dataOPT
f=81
TT=3.402
T1=1.47
OPT
f=81
TT=2.134
T1=0.95
SAT
f=81
TT=2.276
T1=0.94
OPT
f=81
TT=356.032
T1=355.83
OPT
f=81
TT=330.789
T1=308.03
OPT
f=81
TT=343.245
T1=343.09
OPT
f=81
TT=1.492
T1=1.42
OPT
f=81
TT=1.484
T1=1.41
OPT
f=81
TT=0.95
T1=0.94
No dataNo dataOPT
f=81
TT=0.881
T1=0.87
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3039_1.std.opb
OPT
f=55
TT=0.077
T1=0.07
OPT
f=55
TT=42.313
T1=42.32
No dataOPT
f=55
TT=0.077
T1=0.07
OPT
f=55
TT=20.898
T1=17.27
OPT
f=55
TT=3.347
T1=4.27
? (problem)

TT=12.45

? (problem)

TT=1.88

? (problem)

TT=12.89

? (problem)

TT=1.94

? (problem)

TT=12.51

? (problem)

TT=1.79

OPT
f=55
TT=28.785
T1=28.79
OPT
f=55
TT=41.488
T1=20.7
OPT
f=55
TT=3.432
T1=2.93
OPT
f=55
TT=3.187
T1=3.18
OPT
f=55
TT=2.225
T1=0.97
OPT
f=55
TT=43.769
T1=43.77
OPT
f=55
TT=1.685
T1=0.78
OPT
f=55
TT=199.319
T1=199
No dataOPT
f=55
TT=3.815
T1=3.42
OPT
f=55
TT=2.234
T1=1.79
OPT
f=55
TT=291.018
T1=290.69
No dataOPT
f=55
TT=3.404
T1=1.41
OPT
f=55
TT=455.548
T1=455.37
OPT
f=55
TT=10.759
T1=10.71
OPT
f=55
TT=17.112
T1=18.37
OPT
f=55
TT=373.764
T1=441.96
No dataNo dataNo dataOPT
f=55
TT=0.44
T1=0.3
No dataNo dataOPT
f=55
TT=0.415
T1=0.28
No dataNo dataNo dataOPT
f=55
TT=3.134
T1=1.45
OPT
f=55
TT=1.775
T1=0.84
OPT
f=55
TT=1.815
T1=0.86
OPT
f=55
TT=129.634
T1=129.28
OPT
f=55
TT=114.433
T1=114.15
OPT
f=55
TT=132.968
T1=132.61
OPT
f=55
TT=1.357
T1=1.33
OPT
f=55
TT=1.35
T1=1.33
OPT
f=55
TT=0.26
T1=0.24
No dataNo dataOPT
f=55
TT=0.25
T1=0.23
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3040_5.std.opb
OPT
f=65
TT=0.077
T1=0.07
OPT
f=65
TT=39.985
T1=39.98
No dataOPT
f=65
TT=0.077
T1=0.07
OPT
f=65
TT=7.262
T1=5.74
OPT
f=65
TT=3.586
T1=2.84
? (problem)

TT=3.93

? (problem)

TT=2.01

? (problem)

TT=4.29

? (problem)

TT=1.83

? (problem)

TT=3.99

? (problem)

TT=1.85

OPT
f=65
TT=27.488
T1=27.45
OPT
f=65
TT=17.566
T1=17.51
OPT
f=65
TT=3.429
T1=2.94
OPT
f=65
TT=3.132
T1=3.13
OPT
f=65
TT=1.793
T1=0.85
OPT
f=65
TT=40.043
T1=40.04
OPT
f=65
TT=1.643
T1=0.77
OPT
f=65
TT=418.464
T1=418.27
No dataOPT
f=65
TT=3.481
T1=3.09
OPT
f=65
TT=2.424
T1=1.79
OPT
f=65
TT=406.441
T1=406.36
No dataOPT
f=65
TT=2.703
T1=1.41
OPT
f=65
TT=419.062
T1=418.89
OPT
f=65
TT=7.738
T1=7.69
OPT
f=65
TT=3.847
T1=4.27
OPT
f=65
TT=109.059
T1=111.7
No dataNo dataNo dataOPT
f=65
TT=0.424
T1=0.29
No dataNo dataOPT
f=65
TT=0.405
T1=0.27
No dataNo dataNo dataOPT
f=65
TT=2.863
T1=1.47
OPT
f=65
TT=1.974
T1=0.88
OPT
f=65
TT=1.642
T1=0.82
OPT
f=65
TT=95.203
T1=94.98
OPT
f=65
TT=87.122
T1=86.89
OPT
f=65
TT=93.974
T1=93.75
OPT
f=65
TT=1.346
T1=1.32
OPT
f=65
TT=1.34
T1=1.32
OPT
f=65
TT=0.249
T1=0.24
No dataNo dataOPT
f=65
TT=0.24
T1=0.23
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3044_1.std.opb
OPT
f=50
TT=0.079
T1=0.07
OPT
f=50
TT=44.277
T1=44.28
No dataOPT
f=50
TT=0.079
T1=0.07
OPT
f=50
TT=12.894
T1=12.73
OPT
f=50
TT=7.762
T1=7.6
? (problem)

TT=6.79

? (problem)

TT=3.938

? (problem)

TT=13.552

? (problem)

TT=3.45

? (problem)

TT=7.52

? (problem)

TT=3.46

OPT
f=50
TT=28.536
T1=27.22
OPT
f=50
TT=46.057
T1=45.96
OPT
f=50
TT=3.672
T1=3.14
OPT
f=50
TT=3.283
T1=3.28
OPT
f=50
TT=2.095
T1=0.93
OPT
f=50
TT=41.943
T1=41.94
OPT
f=50
TT=1.928
T1=0.83
OPT
f=50
TT=324.137
T1=323.95
No dataOPT
f=50
TT=4.477
T1=4.08
OPT
f=50
TT=2.453
T1=1.84
OPT
f=50
TT=269.055
T1=268.84
No dataOPT
f=50
TT=3.134
T1=1.48
OPT
f=50
TT=267.337
T1=267.08
OPT
f=50
TT=25.977
T1=25.89
OPT
f=50
TT=7.02
T1=7.4
OPT
f=50
TT=187.336
T1=201.16
No dataNo dataNo dataOPT
f=50
TT=0.45
T1=0.31
No dataNo dataOPT
f=50
TT=0.424
T1=0.29
No dataNo dataNo dataOPT
f=50
TT=3.296
T1=1.57
OPT
f=50
TT=2.094
T1=1.04
SAT
f=50
TT=2.134
T1=0.93
OPT
f=50
TT=70.966
T1=70.74
OPT
f=50
TT=70.075
T1=69.81
OPT
f=50
TT=87.383
T1=87.05
OPT
f=50
TT=1.415
T1=1.39
OPT
f=50
TT=1.379
T1=1.36
OPT
f=50
TT=0.266
T1=0.25
No dataNo dataOPT
f=50
TT=0.258
T1=0.24
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3046_5.std.opb
OPT
f=57
TT=0.081
T1=0.07
OPT
f=57
TT=41.638
T1=41.64
No dataOPT
f=57
TT=0.081
T1=0.07
OPT
f=57
TT=19.264
T1=15.78
OPT
f=57
TT=9.147
T1=7.47
? (problem)

TT=11.49

? (problem)

TT=6.66

? (problem)

TT=11.91

? (problem)

TT=5.94

? (problem)

TT=11.54

? (problem)

TT=5.87

OPT
f=57
TT=29.501
T1=29.5
OPT
f=57
TT=42.077
T1=41.98
OPT
f=57
TT=3.575
T1=3.04
OPT
f=57
TT=3.389
T1=3.38
OPT
f=57
TT=2.224
T1=0.97
OPT
f=57
TT=38.777
T1=38.78
OPT
f=57
TT=2.155
T1=0.9
? (TO)

TT=1801.32

No dataOPT
f=57
TT=7.27
T1=6.88
OPT
f=57
TT=2.884
T1=1.88
?

TT=1790.1

No dataOPT
f=57
TT=3.513
T1=1.52
OPT
f=57
TT=1314.52
T1=1314.38
OPT
f=57
TT=23.611
T1=23.52
OPT
f=57
TT=10.904
T1=12.69
OPT
f=57
TT=226.589
T1=246.99
No dataNo dataNo dataOPT
f=57
TT=0.528
T1=0.35
No dataNo dataOPT
f=57
TT=0.497
T1=0.33
No dataNo dataNo dataOPT
f=57
TT=3.817
T1=1.6
OPT
f=57
TT=2.135
T1=0.93
OPT
f=57
TT=2.102
T1=0.92
OPT
f=57
TT=104.814
T1=104.58
OPT
f=57
TT=103.025
T1=102.78
OPT
f=57
TT=110.824
T1=110.58
OPT
f=57
TT=1.498
T1=1.43
OPT
f=57
TT=1.419
T1=1.36
OPT
f=57
TT=0.304
T1=0.29
No dataNo dataOPT
f=57
TT=0.295
T1=0.27
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j3047_1.std.opb
OPT
f=58
TT=0.078
T1=0.07
OPT
f=58
TT=48.542
T1=48.54
No dataOPT
f=58
TT=0.078
T1=0.07
OPT
f=58
TT=15.869
T1=15.63
OPT
f=58
TT=10.747
T1=10.53
? (problem)

TT=8.68

? (problem)

TT=7.01

? (problem)

TT=8.87

? (problem)

TT=7.09

? (problem)

TT=8.73

? (problem)

TT=7.01

OPT
f=58
TT=30.458
T1=30.46
OPT
f=58
TT=13.98
T1=13.92
OPT
f=58
TT=3.72
T1=3.19
OPT
f=58
TT=3.324
T1=3.32
OPT
f=58
TT=2.042
T1=0.93
OPT
f=58
TT=43.829
T1=43.83
OPT
f=58
TT=2.014
T1=0.9
OPT
f=58
TT=617.299
T1=617.15
No dataOPT
f=58
TT=5.211
T1=4.82
OPT
f=58
TT=2.543
T1=1.87
OPT
f=58
TT=891.737
T1=891.57
No dataOPT
f=58
TT=3.225
T1=1.52
OPT
f=58
TT=491.822
T1=491.57
OPT
f=58
TT=9.206
T1=9.16
OPT
f=58
TT=9.784
T1=9.9
OPT
f=58
TT=208.668
T1=224.58
No dataNo dataNo dataOPT
f=58
TT=0.458
T1=0.32
No dataNo dataOPT
f=58
TT=0.431
T1=0.29
No dataNo dataNo dataOPT
f=58
TT=3.324
T1=1.56
OPT
f=58
TT=2.104
T1=0.91
SAT
f=58
TT=2.244
T1=0.97
OPT
f=58
TT=109.114
T1=108.9
OPT
f=58
TT=98.294
T1=98.07
OPT
f=58
TT=100.88
T1=100.66
OPT
f=58
TT=1.456
T1=1.48
OPT
f=58
TT=1.388
T1=1.36
OPT
f=58
TT=0.273
T1=0.26
No dataNo dataOPT
f=58
TT=0.264
T1=0.25
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j305_3.std.opb
OPT
f=76
TT=0.085
T1=0.07
OPT
f=76
TT=26.581
T1=26.58
No dataOPT
f=76
TT=0.085
T1=0.07
OPT
f=76
TT=21.974
T1=16.76
OPT
f=76
TT=2.564
T1=2
? (problem)

TT=12.38

? (problem)

TT=1.319

? (problem)

TT=12.79

? (problem)

TT=1.3

? (problem)

TT=12.51

? (problem)

TT=1.44

OPT
f=76
TT=18.666
T1=18.65
OPT
f=76
TT=8.35
T1=8.28
OPT
f=76
TT=144.621
T1=145.15
OPT
f=76
TT=3.25
T1=3.23
OPT
f=76
TT=2.414
T1=1.09
OPT
f=76
TT=26.294
T1=26.28
OPT
f=76
TT=2.443
T1=1.02
? (TO)

TT=1802.12

No data? (TO)

TT=1800.42

OPT
f=76
TT=3.883
T1=3.8
?

TT=1789.92

No dataOPT
f=76
TT=4.842
T1=1.97
?

TT=1796.87

OPT
f=76
TT=3.576
T1=3.55
OPT
f=76
TT=18.697
T1=20.43
OPT
f=76
TT=311.515
T1=397.46
No dataNo dataNo dataOPT
f=76
TT=1.961
T1=1.05
No dataNo dataOPT
f=76
TT=1.962
T1=1.05
No dataNo dataNo dataOPT
f=76
TT=5.563
T1=2.96
OPT
f=76
TT=2.354
T1=1.04
OPT
f=76
TT=4.064
T1=2.51
OPT
f=76
TT=766.645
T1=635.9
OPT
f=76
TT=848.494
T1=767.52
OPT
f=76
TT=774.16
T1=643.63
OPT
f=76
TT=1.658
T1=1.56
OPT
f=76
TT=1.577
T1=1.48
OPT
f=76
TT=0.99
T1=0.97
No dataNo dataOPT
f=76
TT=0.91
T1=0.89
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j307_6.std.opb
OPT
f=35
TT=0.074
T1=0.06
OPT
f=35
TT=30.791
T1=30.79
No dataOPT
f=35
TT=0.074
T1=0.06
OPT
f=35
TT=38.343
T1=40.79
OPT
f=35
TT=3.801
T1=3.39
? (problem)

TT=23.91

? (problem)

TT=2.1

? (problem)

TT=24.49

? (problem)

TT=1.77

? (problem)

TT=24.24

? (problem)

TT=1.98

OPT
f=35
TT=21.462
T1=21.44
OPT
f=35
TT=46.031
T1=45.93
OPT
f=35
TT=3.198
T1=2.75
OPT
f=35
TT=2.996
T1=2.99
OPT
f=35
TT=2.004
T1=0.91
OPT
f=35
TT=29.433
T1=29.43
OPT
f=35
TT=1.735
T1=0.77
OPT
f=35
TT=315.169
T1=314.98
No dataOPT
f=35
TT=3.833
T1=3.44
OPT
f=35
TT=2.344
T1=1.79
OPT
f=35
TT=194.724
T1=194.52
No dataOPT
f=35
TT=3.054
T1=1.38
OPT
f=35
TT=346.81
T1=346.6
OPT
f=35
TT=30.136
T1=30.04
OPT
f=35
TT=31.674
T1=35.8
OPT
f=35
TT=681.55
T1=856.25
No dataNo dataNo dataOPT
f=35
TT=0.417
T1=0.28
No dataNo dataOPT
f=35
TT=0.393
T1=0.26
No dataNo dataNo dataOPT
f=35
TT=3.244
T1=1.45
OPT
f=35
TT=1.792
T1=0.82
OPT
f=35
TT=1.813
T1=0.83
OPT
f=35
TT=54.539
T1=54.33
OPT
f=35
TT=55.712
T1=55.47
OPT
f=35
TT=58.218
T1=57.99
OPT
f=35
TT=1.303
T1=1.28
OPT
f=35
TT=1.296
T1=1.27
OPT
f=35
TT=0.239
T1=0.23
No dataNo dataOPT
f=35
TT=0.231
T1=0.22
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j308_4.std.opb
OPT
f=48
TT=0.073
T1=0.06
OPT
f=48
TT=29.661
T1=29.66
No dataOPT
f=48
TT=0.073
T1=0.06
OPT
f=48
TT=6.448
T1=5.72
OPT
f=48
TT=3.863
T1=4.22
? (problem)

TT=3.53

? (problem)

TT=2.01

? (problem)

TT=3.52

? (problem)

TT=1.84

? (problem)

TT=3.96

? (problem)

TT=2.01

OPT
f=48
TT=20.039
T1=18.58
OPT
f=48
TT=12.607
T1=12.57
OPT
f=48
TT=3.362
T1=2.89
OPT
f=48
TT=3.13
T1=3.12
OPT
f=48
TT=1.753
T1=0.82
OPT
f=48
TT=28.123
T1=28.12
OPT
f=48
TT=1.612
T1=0.74
OPT
f=48
TT=116.683
T1=116.46
No dataOPT
f=48
TT=3.716
T1=3.32
OPT
f=48
TT=2.315
T1=1.77
OPT
f=48
TT=182.2
T1=182.01
No dataOPT
f=48
TT=3.053
T1=1.39
OPT
f=48
TT=193.308
T1=193.09
OPT
f=48
TT=6.546
T1=6.5
OPT
f=48
TT=4.621
T1=4.84
OPT
f=48
TT=111.061
T1=115.37
No dataNo dataNo dataOPT
f=48
TT=0.406
T1=0.28
No dataNo dataOPT
f=48
TT=0.397
T1=0.26
No dataNo dataNo dataOPT
f=48
TT=2.664
T1=1.44
OPT
f=48
TT=1.663
T1=0.82
OPT
f=48
TT=1.705
T1=0.82
OPT
f=48
TT=54.454
T1=54.25
OPT
f=48
TT=54.592
T1=54.37
OPT
f=48
TT=59.831
T1=59.62
OPT
f=48
TT=1.294
T1=1.27
OPT
f=48
TT=1.231
T1=1.25
OPT
f=48
TT=0.239
T1=0.22
No dataNo dataOPT
f=48
TT=0.23
T1=0.21
/OPT-SMALLINT-LIN/
oliveras/j30opt/
normalized-j309_7.std.opb
OPT
f=63
TT=0.14
T1=0.13
OPT
f=63
TT=31.463
T1=31.27
No dataOPT
f=63
TT=0.14
T1=0.13
OPT
f=63
TT=18.39
T1=9.79
OPT
f=63
TT=5.125
T1=5.1
? (problem)

TT=4.75

? (problem)

TT=2.38

? (problem)

TT=4.82

? (problem)

TT=2.36

? (problem)

TT=4.77

? (problem)

TT=2.2

OPT
f=63
TT=20.862
T1=20.69
OPT
f=63
TT=194.766
T1=193.2
OPT
f=63
TT=162.248
T1=163.9
OPT
f=63
TT=3.431
T1=3.36
OPT
f=63
TT=2.743
T1=1.33
OPT
f=63
TT=31.041
T1=30.89
OPT
f=63
TT=3.114
T1=1.52
? (TO)

TT=1800.9

No data? (TO)

TT=1800

OPT
f=63
TT=5.043
T1=9.85
?

TT=1789.98

No dataOPT
f=63
TT=7.103
T1=7.48
SAT
f=300
TT=1797.27
T1=668.75
OPT
f=63
TT=196.459
T1=196.28
OPT
f=63
TT=5.537
T1=5.25
OPT
f=63
TT=127.754
T1=145.08
No dataNo dataNo dataOPT
f=63
TT=2.377
T1=1.27
No dataNo dataOPT
f=63
TT=2.326
T1=1.23
No dataNo dataNo dataOPT
f=63
TT=7.453
T1=6.5
OPT
f=63
TT=2.844
T1=1.25
OPT
f=63
TT=4.592
T1=2.89
OPT
f=63
TT=326.686
T1=326.48
OPT
f=63
TT=309.957
T1=309.79
OPT
f=63
TT=977.455
T1=786.6
OPT
f=63
TT=2.075
T1=1.74
OPT
f=63
TT=1.96
T1=1.64
OPT
f=63
TT=1.207
T1=1.19
No dataNo dataOPT
f=63
TT=1.088
T1=1.08
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6012_9.std.opb
OPT
f=59
TT=0.147
T1=0.13
OPT
f=59
TT=81.676
T1=81.69
No dataOPT
f=59
TT=0.147
T1=0.13
? (problem)

TT=11.22

OPT
f=59
TT=28.602
T1=28.12
? (problem)

TT=9.92

? (problem)

TT=15.2

? (problem)

TT=9.92

? (problem)

TT=13.27

? (problem)

TT=10.17

? (problem)

TT=13.54

OPT
f=59
TT=53.008
T1=53.01
OPT
f=59
TT=34.397
T1=34.38
OPT
f=59
TT=7.184
T1=6.2
OPT
f=59
TT=9.854
T1=9.84
OPT
f=59
TT=2.486
T1=1.21
OPT
f=59
TT=82.162
T1=82.17
OPT
f=59
TT=2.434
T1=1.18
OPT
f=59
TT=1653.55
T1=1653.44
No dataOPT
f=59
TT=15.837
T1=14.31
OPT
f=59
TT=3.234
T1=2.23
OPT
f=59
TT=714.496
T1=714.14
No dataOPT
f=59
TT=3.156
T1=1.77
OPT
f=59
TT=1086.22
T1=1085.77
OPT
f=59
TT=23.316
T1=23.28
OPT
f=59
TT=31.86
T1=33.58
OPT
f=59
TT=656.274
T1=719.75
No dataNo dataNo dataOPT
f=59
TT=0.831
T1=0.58
No dataNo dataOPT
f=59
TT=0.84
T1=0.59
No dataNo dataNo dataOPT
f=59
TT=4.603
T1=2.07
OPT
f=59
TT=2.344
T1=1.16
SAT
f=59
TT=2.697
T1=1.28
OPT
f=59
TT=173.561
T1=173.14
OPT
f=59
TT=232.376
T1=231.79
OPT
f=59
TT=227.995
T1=227.5
OPT
f=59
TT=2.476
T1=2.43
OPT
f=59
TT=2.494
T1=2.45
OPT
f=59
TT=0.489
T1=0.47
No dataNo dataOPT
f=59
TT=0.517
T1=0.5
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6013_4.std.opb
SAT
f=106
TT=1800.05
T1=195.36
SAT
f=108
TT=1798.02
T1=120.34
No data? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (problem)

TT=16.42

? (TO)

TT=1800.02

? (problem)

TT=14.48

? (TO)

TT=1800.39

? (problem)

TT=14.84

SAT (TO)
f=109
TT=1800.04
T1=267.41
SAT (TO)
f=115
TT=1800.11
T1=1585.38
SAT (TO)
f=107
TT=1802.05
T1=498.55
SAT
f=108
TT=1783.01
T1=907.48
SAT (TO)
f=106
TT=1800.7
T1=1150.63
SAT
f=109
TT=1798.02
T1=215.86
SAT (TO)
f=107
TT=1800.34
T1=271.49
?

TT=1795.84

No dataNo Cert.

TT=1800

SAT (TO)
f=107
TT=1800.83
T1=423.45
?

TT=1790.96

No dataSAT (TO)
f=106
TT=1800.2
T1=403.91
? (TO)

TT=1802.1

No Cert.

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=107
TT=1800.05
T1=900.51
No dataNo dataSAT (TO)
f=107
TT=1800.07
T1=900.51
No dataNo dataNo dataSAT (TO)
f=106
TT=1800.09
T1=297.54
SAT (TO)
f=106
TT=1800.05
T1=195.36
SAT (TO)
f=106
TT=1800.06
T1=723.97
?

TT=1797.19

?

TT=1797.15

?

TT=1797.2

? (TO)

TT=1800.05

? (TO)

TT=1800.1

?

TT=1799.96

No dataNo data?

TT=1800.03

/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6019_2.std.opb
OPT
f=83
TT=0.144
T1=0.13
OPT
f=83
TT=99.292
T1=99.3
No dataOPT
f=83
TT=0.144
T1=0.13
OPT
f=83
TT=12.337
T1=12.64
OPT
f=83
TT=4.139
T1=4.11
? (problem)

TT=6.77

? (problem)

TT=2.23

? (problem)

TT=6.77

? (problem)

TT=2.05

? (problem)

TT=6.99

? (problem)

TT=2.06

OPT
f=83
TT=70.175
T1=70.17
OPT
f=83
TT=3.86
T1=3.84
OPT
f=83
TT=7.181
T1=6.14
OPT
f=83
TT=10.228
T1=10.22
OPT
f=83
TT=2.385
T1=1.16
OPT
f=83
TT=98.001
T1=98
OPT
f=83
TT=2.205
T1=1.11
OPT
f=83
TT=1269.71
T1=1269.42
No dataOPT
f=83
TT=8.433
T1=6.92
OPT
f=83
TT=3.156
T1=2.15
OPT
f=83
TT=1715.08
T1=1714.97
No dataOPT
f=83
TT=3.334
T1=1.68
OPT
f=83
TT=1100.83
T1=1100.6
OPT
f=83
TT=1.379
T1=1.41
OPT
f=83
TT=10.382
T1=10.48
OPT
f=83
TT=193.771
T1=228.54
No dataNo dataNo dataOPT
f=83
TT=0.838
T1=0.57
No dataNo dataOPT
f=83
TT=0.772
T1=0.54
No dataNo dataNo dataOPT
f=83
TT=3.993
T1=1.78
OPT
f=83
TT=2.364
T1=1.11
SAT
f=83
TT=2.694
T1=1.3
OPT
f=83
TT=177.03
T1=176.65
OPT
f=83
TT=161.82
T1=161.45
OPT
f=83
TT=165.084
T1=164.74
OPT
f=83
TT=2.347
T1=2.31
OPT
f=83
TT=2.508
T1=2.47
OPT
f=83
TT=0.447
T1=0.42
No dataNo dataOPT
f=83
TT=0.474
T1=0.45
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6021_5.std.opb
OPT
f=89
TT=0.471
T1=0.46
OPT
f=89
TT=105.601
T1=103.76
No dataOPT
f=89
TT=0.471
T1=0.46
OPT
f=89
TT=16.678
T1=12.11
OPT
f=89
TT=11.02
T1=8.09
? (problem)

TT=7.52

? (problem)

TT=4.8

? (problem)

TT=7.47

? (problem)

TT=4.33

? (problem)

TT=8.42

? (problem)

TT=4.54

OPT
f=89
TT=72.912
T1=68.43
OPT
f=89
TT=133.627
T1=131.06
OPT
f=89
TT=321
T1=321.54
OPT
f=89
TT=14.468
T1=13.66
OPT
f=89
TT=5.603
T1=3.37
OPT
f=89
TT=99.263
T1=98.65
OPT
f=89
TT=5.113
T1=3.17
?

TT=1797.21

No data? (TO)

TT=1800.38

OPT
f=89
TT=11.521
T1=21.38
?

TT=1791.7

No dataOPT
f=89
TT=10.103
T1=11.27
?

TT=1797.04

OPT
f=89
TT=165.629
T1=165.6
OPT
f=89
TT=13.094
T1=13.57
OPT
f=89
TT=177.748
T1=196.85
No dataNo dataNo dataOPT
f=89
TT=3.93
T1=2.13
No dataNo dataOPT
f=89
TT=4.304
T1=2.32
No dataNo dataNo dataOPT
f=89
TT=10.353
T1=7.43
OPT
f=89
TT=5.713
T1=3.19
OPT
f=89
TT=8.615
T1=6.39
?

TT=1797.54

?

TT=1797.29

?

TT=1797.33

OPT
f=89
TT=10.541
T1=7.39
OPT
f=89
TT=10.639
T1=7.47
OPT
f=89
TT=2.009
T1=1.99
No dataNo dataOPT
f=89
TT=2.086
T1=2.07
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j602_4.std.opb
OPT
f=78
TT=0.14
T1=0.12
OPT
f=78
TT=77.864
T1=77.87
No dataOPT
f=78
TT=0.14
T1=0.12
OPT
f=78
TT=35.696
T1=37.8
OPT
f=78
TT=3.669
T1=2.93
OPT
f=78
TT=34.745
T1=34.72
? (problem)

TT=2.11

OPT
f=78
TT=31.455
T1=32.21
? (problem)

TT=1.95

OPT
f=78
TT=31.985
T1=32.06
? (problem)

TT=2.12

OPT
f=78
TT=55.38
T1=55.38
OPT
f=78
TT=9.521
T1=9.49
OPT
f=78
TT=6.917
T1=6
OPT
f=78
TT=10.304
T1=10.29
OPT
f=78
TT=2.204
T1=1.11
OPT
f=78
TT=77.836
T1=77.84
OPT
f=78
TT=2.033
T1=1.06
OPT
f=78
TT=1363.43
T1=1363.16
No dataOPT
f=78
TT=9.775
T1=8.25
OPT
f=78
TT=3.164
T1=2.06
OPT
f=78
TT=549.887
T1=549.58
No dataOPT
f=78
TT=2.593
T1=1.54
OPT
f=78
TT=1144.4
T1=1144.07
OPT
f=78
TT=6.518
T1=6.48
OPT
f=78
TT=36.141
T1=51.8
OPT
f=78
TT=652.236
T1=1114.09
No dataNo dataNo dataOPT
f=78
TT=0.826
T1=0.55
No dataNo dataOPT
f=78
TT=0.729
T1=0.5
No dataNo dataNo dataOPT
f=78
TT=3.343
T1=1.69
OPT
f=78
TT=2.354
T1=1.15
OPT
f=78
TT=2.424
T1=1.19
OPT
f=78
TT=365.904
T1=365.38
OPT
f=78
TT=315.603
T1=315.16
OPT
f=78
TT=375.827
T1=375.21
OPT
f=78
TT=2.279
T1=2.24
OPT
f=78
TT=2.435
T1=2.39
OPT
f=78
TT=0.438
T1=0.41
No dataNo dataOPT
f=78
TT=0.445
T1=0.42
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6026_2.std.opb
OPT
f=66
TT=0.167
T1=0.15
OPT
f=66
TT=115.111
T1=115.12
No dataOPT
f=66
TT=0.167
T1=0.15
OPT
f=66
TT=23.73
T1=20.07
OPT
f=66
TT=25.693
T1=26.07
? (problem)

TT=12.14

? (problem)

TT=10.07

? (problem)

TT=12.38

? (problem)

TT=9.1

? (problem)

TT=12.21

? (problem)

TT=10.246

OPT
f=66
TT=73
T1=73.01
OPT
f=66
TT=111.727
T1=111.68
OPT
f=66
TT=444.782
T1=447.12
OPT
f=66
TT=11.161
T1=11.15
OPT
f=66
TT=2.633
T1=1.25
OPT
f=66
TT=108.395
T1=108.4
OPT
f=66
TT=2.534
T1=1.22
? (TO)

TT=1802.28

No dataOPT
f=66
TT=91.789
T1=78.23
OPT
f=66
TT=3.722
T1=2.19
?

TT=1790.14

No dataOPT
f=66
TT=3.544
T1=1.72
?

TT=1797.19

OPT
f=66
TT=83.627
T1=83.63
OPT
f=66
TT=23.989
T1=13.07
OPT
f=66
TT=9.244
T1=8.35
No dataNo dataNo dataOPT
f=66
TT=1.35
T1=0.84
No dataNo dataOPT
f=66
TT=1.189
T1=0.76
No dataNo dataNo dataOPT
f=66
TT=5.085
T1=2.09
OPT
f=66
TT=2.704
T1=1.28
OPT
f=66
TT=2.684
T1=1.27
?

TT=1797.49

?

TT=1797.48

?

TT=1797.45

OPT
f=66
TT=2.67
T1=2.56
OPT
f=66
TT=2.665
T1=2.56
OPT
f=66
TT=0.669
T1=0.65
No dataNo dataOPT
f=66
TT=0.676
T1=0.66
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6027_6.std.opb
OPT
f=64
TT=0.162
T1=0.14
OPT
f=64
TT=98.277
T1=98.28
No dataOPT
f=64
TT=0.162
T1=0.14
OPT
f=64
TT=30.075
T1=29.07
OPT
f=64
TT=21.378
T1=18.06
? (problem)

TT=16.93

? (problem)

TT=11.93

? (problem)

TT=16.63

? (problem)

TT=10.87

? (problem)

TT=16.61

? (problem)

TT=11.13

OPT
f=64
TT=65.067
T1=65.07
OPT
f=64
TT=44.338
T1=44.28
OPT
f=64
TT=7.418
T1=6.36
OPT
f=64
TT=10.71
T1=10.7
OPT
f=64
TT=2.594
T1=1.27
OPT
f=64
TT=101.2
T1=101.21
OPT
f=64
TT=2.366
T1=1.18
?

TT=1799.63

No dataOPT
f=64
TT=23.457
T1=21.94
OPT
f=64
TT=3.364
T1=2.2
?

TT=1790.26

No dataOPT
f=64
TT=3.095
T1=1.74
OPT
f=64
TT=716.14
T1=715.79
OPT
f=64
TT=31.123
T1=31.06
OPT
f=64
TT=23.508
T1=25.36
OPT
f=64
TT=38.32
T1=41.61
No dataNo dataNo dataOPT
f=64
TT=0.857
T1=0.59
No dataNo dataOPT
f=64
TT=0.874
T1=0.62
No dataNo dataNo dataOPT
f=64
TT=3.942
T1=1.93
OPT
f=64
TT=2.36
T1=1.25
OPT
f=64
TT=2.522
T1=1.23
OPT
f=64
TT=444.978
T1=444.38
OPT
f=64
TT=373.073
T1=372.6
OPT
f=64
TT=366.341
T1=365.91
OPT
f=64
TT=2.692
T1=2.65
OPT
f=64
TT=2.714
T1=2.67
OPT
f=64
TT=0.536
T1=0.52
No dataNo dataOPT
f=64
TT=0.542
T1=0.52
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6029_8.std.opb
SAT
f=105
TT=1800.01
T1=53.57
SAT
f=107
TT=1798.02
T1=476.06
No data? (TO)

TT=1800.09

? (TO)

TT=1800.14

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (problem)

TT=20.81

? (TO)

TT=1800.11

? (problem)

TT=18.37

? (TO)

TT=1800.05

? (problem)

TT=21.12

SAT (TO)
f=108
TT=1800.06
T1=93.98
SAT (TO)
f=110
TT=1800.11
T1=1711.25
SAT (TO)
f=106
TT=1802.17
T1=422.87
SAT
f=106
TT=1783.01
T1=197.01
SAT (TO)
f=105
TT=1800.1
T1=1750.54
SAT
f=107
TT=1798.02
T1=238.91
SAT (TO)
f=105
TT=1800.64
T1=985.3
?

TT=1797.33

No data? (TO)

TT=1800.03

SAT (TO)
f=106
TT=1800.51
T1=912.96
?

TT=1789.9

No dataSAT (TO)
f=106
TT=1800.19
T1=136.96
?

TT=1797.2

No Cert.

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=106
TT=1800.1
T1=900.51
No dataNo dataSAT (TO)
f=106
TT=1800.2
T1=900.61
No dataNo dataNo dataSAT (TO)
f=105
TT=1800.01
T1=769.76
SAT (TO)
f=105
TT=1800.64
T1=53.57
SAT (TO)
f=105
TT=1800.72
T1=359.87
?

TT=1797.38

?

TT=1797.41

?

TT=1797.42

SAT
f=106
TT=1526.65
T1=93.35
? (TO)

TT=1800.03

?

TT=1799.59

No dataNo data?

TT=1799.98

/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6031_6.std.opb
OPT
f=72
TT=0.154
T1=0.14
OPT
f=72
TT=101.583
T1=101.59
No dataOPT
f=72
TT=0.154
T1=0.14
? (problem)

TT=14.793

OPT
f=72
TT=25.911
T1=20.41
? (problem)

TT=13.56

? (problem)

TT=16.26

? (problem)

TT=13.26

? (problem)

TT=14.84

? (problem)

TT=13.72

? (problem)

TT=15.08

OPT
f=72
TT=69.072
T1=69.09
OPT
f=72
TT=54.218
T1=54.17
OPT
f=72
TT=7.51
T1=6.47
OPT
f=72
TT=10.663
T1=10.66
OPT
f=72
TT=2.514
T1=1.3
OPT
f=72
TT=93.804
T1=93.82
OPT
f=72
TT=2.443
T1=1.22
? (TO)

TT=1800.48

No dataOPT
f=72
TT=27.274
T1=25.76
OPT
f=72
TT=3.564
T1=2.3
?

TT=1790.59

No dataOPT
f=72
TT=3.244
T1=1.8
OPT
f=72
TT=1440.9
T1=1440.44
OPT
f=72
TT=38.034
T1=38
OPT
f=72
TT=48.917
T1=53.5
OPT
f=72
TT=766.024
T1=1037.69
No dataNo dataNo dataOPT
f=72
TT=0.962
T1=0.67
No dataNo dataOPT
f=72
TT=0.895
T1=0.63
No dataNo dataNo dataOPT
f=72
TT=4.054
T1=2
OPT
f=72
TT=2.775
T1=1.29
OPT
f=72
TT=2.614
T1=1.32
OPT
f=72
TT=274.201
T1=273.78
OPT
f=72
TT=285.301
T1=284.81
OPT
f=72
TT=276.116
T1=275.69
OPT
f=72
TT=2.673
T1=2.63
OPT
f=72
TT=2.693
T1=2.65
OPT
f=72
TT=0.531
T1=0.51
No dataNo dataOPT
f=72
TT=0.559
T1=0.53
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j603_6.std.opb
OPT
f=57
TT=0.144
T1=0.13
OPT
f=57
TT=89.391
T1=89.39
No dataOPT
f=57
TT=0.144
T1=0.13
OPT
f=57
TT=43.042
T1=41.45
OPT
f=57
TT=4.538
T1=4.8
? (problem)

TT=27.82

? (problem)

TT=2.36

? (problem)

TT=28.062

? (problem)

TT=2.18

? (problem)

TT=27.99

? (problem)

TT=2.35

OPT
f=57
TT=52.618
T1=52.62
OPT
f=57
TT=15.344
T1=15.31
OPT
f=57
TT=7.006
T1=6.2
OPT
f=57
TT=10.094
T1=10.08
OPT
f=57
TT=2.204
T1=1.18
OPT
f=57
TT=75.864
T1=75.88
OPT
f=57
TT=1.993
T1=1.04
? (TO)

TT=1802.11

No dataOPT
f=57
TT=10.432
T1=8.89
OPT
f=57
TT=2.633
T1=2.05
?

TT=1790.01

No dataOPT
f=57
TT=2.634
T1=1.53
OPT
f=57
TT=1573.55
T1=1573.46
OPT
f=57
TT=9.183
T1=9.15
OPT
f=57
TT=38.004
T1=54.34
OPT
f=57
TT=684.701
T1=1194.66
No dataNo dataNo dataOPT
f=57
TT=0.847
T1=0.57
No dataNo dataOPT
f=57
TT=0.77
T1=0.53
No dataNo dataNo dataOPT
f=57
TT=3.953
T1=1.86
OPT
f=57
TT=2.163
T1=1.09
SAT
f=57
TT=2.194
T1=1.13
OPT
f=57
TT=350.497
T1=349.97
OPT
f=57
TT=353.401
T1=352.84
OPT
f=57
TT=357.83
T1=357.31
OPT
f=57
TT=2.287
T1=2.25
OPT
f=57
TT=2.41
T1=2.37
OPT
f=57
TT=0.44
T1=0.42
No dataNo dataOPT
f=57
TT=0.463
T1=0.44
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j603_9.std.opb
OPT
f=67
TT=0.143
T1=0.12
OPT
f=67
TT=94.36
T1=94.49
No dataOPT
f=67
TT=0.143
T1=0.12
OPT
f=67
TT=14.764
T1=13.03
OPT
f=67
TT=4.379
T1=3.47
? (problem)

TT=8.31

? (problem)

TT=2.42

? (problem)

TT=7.81

? (problem)

TT=2.25

? (problem)

TT=7.93

? (problem)

TT=2.42

OPT
f=67
TT=60.628
T1=60.64
OPT
f=67
TT=28.279
T1=14.16
OPT
f=67
TT=19.205
T1=18.53
OPT
f=67
TT=19.48
T1=9.79
OPT
f=67
TT=2.235
T1=1.19
OPT
f=67
TT=89.289
T1=89.29
OPT
f=67
TT=2.088
T1=1.05
OPT
f=67
TT=1753.93
T1=1753.72
No dataOPT
f=67
TT=10.622
T1=9.1
OPT
f=67
TT=2.984
T1=2.1
?

TT=1790

No dataOPT
f=67
TT=2.755
T1=1.56
?

TT=1796.99

OPT
f=67
TT=8.332
T1=8.29
OPT
f=67
TT=12.694
T1=13.96
OPT
f=67
TT=225.11
T1=246.28
No dataNo dataNo dataOPT
f=67
TT=1.346
T1=0.81
No dataNo dataOPT
f=67
TT=1.189
T1=0.73
No dataNo dataNo dataOPT
f=67
TT=3.483
T1=1.7
OPT
f=67
TT=2.374
T1=1.11
OPT
f=67
TT=2.065
T1=1.1
OPT
f=67
TT=446.999
T1=446.48
OPT
f=67
TT=356.766
T1=356.34
OPT
f=67
TT=444.885
T1=444.35
OPT
f=67
TT=2.495
T1=2.39
OPT
f=67
TT=2.385
T1=2.28
OPT
f=67
TT=0.64
T1=0.62
No dataNo dataOPT
f=67
TT=0.665
T1=0.64
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6043_1.std.opb
OPT
f=108
TT=0.148
T1=0.13
OPT
f=108
TT=102.931
T1=102.93
No dataOPT
f=108
TT=0.148
T1=0.13
OPT
f=108
TT=20.175
T1=15.7
OPT
f=108
TT=17.573
T1=14.3
OPT
f=108
TT=19.208
T1=14.82
? (problem)

TT=10.03

OPT
f=108
TT=15.58
T1=14.87
? (problem)

TT=9.17

OPT
f=108
TT=16.428
T1=14.81
? (problem)

TT=10.24

OPT
f=108
TT=67.013
T1=67.02
OPT
f=108
TT=99.15
T1=99.11
OPT
f=108
TT=7.629
T1=6.52
OPT
f=108
TT=10.448
T1=10.44
OPT
f=108
TT=2.654
T1=1.32
OPT
f=108
TT=108.079
T1=108.08
OPT
f=108
TT=2.534
T1=1.24
?

TT=1799.93

No dataOPT
f=108
TT=52.065
T1=50.56
OPT
f=108
TT=3.642
T1=2.23
?

TT=1790.23

No dataOPT
f=108
TT=3.513
T1=1.77
OPT
f=108
TT=1154.52
T1=1154.26
OPT
f=108
TT=64.26
T1=64.22
OPT
f=108
TT=16.652
T1=17.4
OPT
f=108
TT=108.843
T1=114.1
No dataNo dataNo dataOPT
f=108
TT=0.931
T1=0.64
No dataNo dataOPT
f=108
TT=0.818
T1=0.58
No dataNo dataNo dataOPT
f=108
TT=4.513
T1=1.99
OPT
f=108
TT=2.884
T1=1.36
OPT
f=108
TT=2.794
T1=1.31
OPT
f=108
TT=212.558
T1=212.04
OPT
f=108
TT=181.425
T1=180.97
OPT
f=108
TT=172.104
T1=171.67
OPT
f=108
TT=2.618
T1=2.58
OPT
f=108
TT=2.734
T1=2.69
OPT
f=108
TT=0.509
T1=0.48
No dataNo dataOPT
f=108
TT=0.536
T1=0.51
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j6044_1.std.opb
OPT
f=84
TT=0.159
T1=0.14
OPT
f=84
TT=105.15
T1=105.16
No dataOPT
f=84
TT=0.159
T1=0.14
OPT
f=84
TT=34.637
T1=28.64
OPT
f=84
TT=18.783
T1=15.1
OPT
f=84
TT=33.257
T1=30.58
OPT
f=84
TT=18.059
T1=14.25
OPT
f=84
TT=24.237
T1=23.23
OPT
f=84
TT=13.963
T1=13.42
OPT
f=84
TT=25.172
T1=23.21
OPT
f=84
TT=15.857
T1=15.4
OPT
f=84
TT=74.323
T1=74.32
OPT
f=84
TT=20.663
T1=20.62
OPT
f=84
TT=7.688
T1=6.57
OPT
f=84
TT=10.91
T1=10.9
OPT
f=84
TT=2.586
T1=1.3
OPT
f=84
TT=104.495
T1=104.51
OPT
f=84
TT=2.343
T1=1.19
OPT
f=84
TT=907.244
T1=906.93
No dataOPT
f=84
TT=15.954
T1=14.43
OPT
f=84
TT=3.423
T1=2.23
OPT
f=84
TT=552.604
T1=552.33
No dataOPT
f=84
TT=3.163
T1=1.76
OPT
f=84
TT=645.577
T1=645.23
OPT
f=84
TT=14.196
T1=14.15
OPT
f=84
TT=26.266
T1=29.95
OPT
f=84
TT=468.743
T1=540.13
No dataNo dataNo dataOPT
f=84
TT=0.963
T1=0.66
No dataNo dataOPT
f=84
TT=0.843
T1=0.59
No dataNo dataNo dataOPT
f=84
TT=3.894
T1=1.87
OPT
f=84
TT=2.745
T1=1.25
OPT
f=84
TT=2.715
T1=1.32
OPT
f=84
TT=171.978
T1=171.58
OPT
f=84
TT=170.806
T1=170.42
OPT
f=84
TT=172.232
T1=171.84
OPT
f=84
TT=2.746
T1=2.7
OPT
f=84
TT=2.66
T1=2.62
OPT
f=84
TT=0.546
T1=0.52
No dataNo dataOPT
f=84
TT=0.551
T1=0.53
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j606_1.std.opb
OPT
f=60
TT=0.146
T1=0.13
OPT
f=60
TT=77.997
T1=78
No dataOPT
f=60
TT=0.146
T1=0.13
OPT
f=60
TT=17.316
T1=14.06
OPT
f=60
TT=12.168
T1=10.3
? (problem)

TT=9.2

? (problem)

TT=7.76

? (problem)

TT=9.15

? (problem)

TT=6.74

? (problem)

TT=10.3

? (problem)

TT=7.05

OPT
f=60
TT=55.274
T1=55.27
OPT
f=60
TT=41.234
T1=41.16
OPT
f=60
TT=7.023
T1=6.2
OPT
f=60
TT=10.16
T1=10.15
OPT
f=60
TT=2.664
T1=1.24
OPT
f=60
TT=77.786
T1=77.79
OPT
f=60
TT=2.563
T1=1.22
?

TT=1798.36

No dataOPT
f=60
TT=25.787
T1=22.82
OPT
f=60
TT=3.375
T1=2.16
?

TT=1790.19

No dataOPT
f=60
TT=3.364
T1=1.65
OPT
f=60
TT=1030.57
T1=1030.22
OPT
f=60
TT=29.546
T1=29.49
OPT
f=60
TT=10.43
T1=11.52
OPT
f=60
TT=237.947
T1=254.54
No dataNo dataNo dataOPT
f=60
TT=0.785
T1=0.55
No dataNo dataOPT
f=60
TT=0.791
T1=0.54
No dataNo dataNo dataOPT
f=60
TT=4.243
T1=1.83
OPT
f=60
TT=2.344
T1=1.17
OPT
f=60
TT=2.494
T1=1.22
OPT
f=60
TT=589.224
T1=588.94
OPT
f=60
TT=620.17
T1=619.92
OPT
f=60
TT=568.953
T1=568.74
OPT
f=60
TT=2.387
T1=2.35
OPT
f=60
TT=2.405
T1=2.36
OPT
f=60
TT=0.471
T1=0.45
No dataNo dataOPT
f=60
TT=0.497
T1=0.47
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/
oliveras/j60opt/
normalized-j609_6.std.opb
SAT
f=111
TT=1802.01
T1=1011.87
SAT
f=112
TT=1798.01
T1=1543.63
No data? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (problem)

TT=11.43

? (problem)

TT=12.33

? (problem)

TT=11.59

? (problem)

TT=10.96

? (problem)

TT=11.25

? (problem)

TT=11.19

SAT (TO)
f=112
TT=1800.09
T1=1446.28
SAT (TO)
f=119
TT=1800.06
T1=1790.97
SAT (TO)
f=111
TT=1802.01
T1=1011.87
SAT
f=112
TT=1783.01
T1=1688.1
SAT (TO)
f=112
TT=1800.01
T1=1541.85
SAT
f=113
TT=1798.02
T1=234.95
SAT (TO)
f=112
TT=1800.4
T1=644.44
?

TT=1799.33

No data? (TO)

TT=1800.16

SAT (TO)
f=112
TT=1800.23
T1=493.19
? (TO)

TT=1802.09

No dataSAT (TO)
f=112
TT=1800.68
T1=119.75
? (TO)

TT=1802.11

No Cert.

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=111
TT=1800.37
T1=900.41
No dataNo dataSAT (TO)
f=113
TT=1800.2
T1=900.51
No dataNo dataNo dataSAT (TO)
f=112
TT=1800.04
T1=788.21
SAT (TO)
f=112
TT=1800.07
T1=1421.15
SAT (TO)
f=111
TT=1800.73
T1=202.61
?

TT=1797.16

?

TT=1797.83

?

TT=1797.18

? (TO)

TT=1800.04

? (TO)

TT=1800.04

?

TT=1799.56

No dataNo data?

TT=1799.83

/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9010_6.std.opb
OPT
f=92
TT=0.222
T1=0.2
OPT
f=92
TT=134.623
T1=134.64
No dataOPT
f=92
TT=0.222
T1=0.2
? (problem)

TT=27.024

OPT
f=92
TT=36.874
T1=38.76
? (problem)

TT=25.7

? (problem)

TT=19.3

? (problem)

TT=32.32

? (problem)

TT=16.88

? (problem)

TT=25.98

? (problem)

TT=16.96

OPT
f=92
TT=87.03
T1=87.05
OPT
f=92
TT=166.642
T1=166.64
OPT
f=92
TT=11.157
T1=9.74
OPT
f=92
TT=22.771
T1=22.76
OPT
f=92
TT=3.154
T1=1.58
OPT
f=92
TT=138.383
T1=138.4
OPT
f=92
TT=3.123
T1=1.47
? (TO)

TT=1802.15

No dataOPT
f=92
TT=551.348
T1=386.15
OPT
f=92
TT=3.974
T1=2.57
? (TO)

TT=1802.09

No dataOPT
f=92
TT=3.733
T1=2.05
? (TO)

TT=1802.11

OPT
f=92
TT=173.058
T1=173.11
OPT
f=92
TT=124.804
T1=125.32
OPT
f=92
TT=1786.01
T1=1790.59
No dataNo dataNo dataOPT
f=92
TT=1.27
T1=0.91
No dataNo dataOPT
f=92
TT=1.259
T1=0.9
No dataNo dataNo dataOPT
f=92
TT=4.663
T1=2.22
OPT
f=92
TT=2.822
T1=1.55
OPT
f=92
TT=3.124
T1=1.58
OPT
f=92
TT=753.326
T1=752.41
OPT
f=92
TT=594.505
T1=593.85
OPT
f=92
TT=609.324
T1=608.67
OPT
f=92
TT=3.907
T1=3.85
OPT
f=92
TT=3.924
T1=3.87
OPT
f=92
TT=0.809
T1=0.78
No dataNo dataOPT
f=92
TT=0.753
T1=0.73
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9013_1.std.opb
SAT
f=146
TT=1801.95
T1=1005.63
SAT
f=150
TT=1798.03
T1=713.93
No data? (TO)

TT=1800.07

? (problem)

TT=40.248

? (TO)

TT=1800.07

? (problem)

TT=37.27

? (problem)

TT=45.31

? (problem)

TT=38.72

? (problem)

TT=38.24

? (problem)

TT=48.92

? (problem)

TT=37.85

SAT (TO)
f=151
TT=1800.07
T1=428.06
SAT (TO)
f=299
TT=1800.05
T1=1464.2
SAT (TO)
f=146
TT=1801.95
T1=1005.63
SAT
f=258
TT=1783.02
T1=1628.07
SAT (TO)
f=152
TT=1800.04
T1=19.81
SAT
f=150
TT=1798.02
T1=1498.38
SAT (TO)
f=151
TT=1801
T1=1167.51
?

TT=1795.98

No dataNo Cert.

TT=1800.01

SAT (TO)
f=150
TT=1800.44
T1=860.38
?

TT=1791.62

No dataSAT (TO)
f=149
TT=1800.03
T1=817.71
? (TO)

TT=1802.19

No Cert.

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=151
TT=1800.06
T1=900.61
No dataNo dataSAT (TO)
f=149
TT=1800.18
T1=900.71
No dataNo dataNo dataSAT (TO)
f=147
TT=1800.75
T1=200.06
SAT (TO)
f=147
TT=1800.08
T1=1680.69
SAT (TO)
f=150
TT=1800.65
T1=240.46
?

TT=1799.03

?

TT=1797.48

?

TT=1797.47

? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1799.98

No dataNo data?

TT=1799.63

/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9016_1.std.opb
OPT
f=85
TT=0.225
T1=0.24
OPT
f=85
TT=144.251
T1=144.27
No dataOPT
f=85
TT=0.225
T1=0.24
? (problem)

TT=37.127

OPT
f=85
TT=59.526
T1=58.88
? (problem)

TT=33.13

? (problem)

TT=28.59

? (problem)

TT=33.13

? (problem)

TT=28.51

? (problem)

TT=33.36

? (problem)

TT=29.05

OPT
f=85
TT=95.832
T1=95.84
OPT
f=85
TT=27.79
T1=27.76
OPT
f=85
TT=11.543
T1=10.09
OPT
f=85
TT=21.163
T1=21.15
OPT
f=85
TT=3.114
T1=1.61
OPT
f=85
TT=141.335
T1=141.37
OPT
f=85
TT=3.015
T1=1.49
OPT
f=85
TT=1502.02
T1=1501.48
No dataOPT
f=85
TT=15.767
T1=12.39
OPT
f=85
TT=3.852
T1=2.6
OPT
f=85
TT=873.689
T1=873.15
No dataOPT
f=85
TT=3.553
T1=2.07
OPT
f=85
TT=983.447
T1=982.85
OPT
f=85
TT=19.862
T1=19.82
OPT
f=85
TT=67.22
T1=39.25
OPT
f=85
TT=44.407
T1=39.59
No dataNo dataNo dataOPT
f=85
TT=1.344
T1=0.96
No dataNo dataOPT
f=85
TT=1.268
T1=0.91
No dataNo dataNo dataOPT
f=85
TT=4.783
T1=2.27
OPT
f=85
TT=2.773
T1=1.52
OPT
f=85
TT=3.084
T1=1.59
OPT
f=85
TT=297.671
T1=297.06
OPT
f=85
TT=306.412
T1=305.79
OPT
f=85
TT=382.156
T1=381.39
OPT
f=85
TT=4.125
T1=4.06
OPT
f=85
TT=3.959
T1=3.9
OPT
f=85
TT=0.841
T1=0.81
No dataNo dataOPT
f=85
TT=0.795
T1=0.77
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9019_6.std.opb
OPT
f=136
TT=0.201
T1=0.18
OPT
f=136
TT=132.731
T1=132.73
No dataOPT
f=136
TT=0.201
T1=0.18
OPT
f=136
TT=11.996
T1=9.27
OPT
f=136
TT=7.476
T1=5.78
? (problem)

TT=6.02

? (problem)

TT=3.9

? (problem)

TT=6.69

? (problem)

TT=4

? (problem)

TT=6.05

? (problem)

TT=4.01

OPT
f=136
TT=86.517
T1=86.53
OPT
f=136
TT=34.487
T1=34.46
OPT
f=136
TT=11.038
T1=9.62
OPT
f=136
TT=21.059
T1=21.05
OPT
f=136
TT=2.994
T1=1.5
OPT
f=136
TT=116.559
T1=116.58
OPT
f=136
TT=2.605
T1=1.36
OPT
f=136
TT=1210.44
T1=1210.15
No dataOPT
f=136
TT=14.357
T1=10.98
OPT
f=136
TT=3.741
T1=2.41
?

TT=1790.24

No dataOPT
f=136
TT=3.593
T1=1.94
OPT
f=136
TT=1496.93
T1=1496.59
OPT
f=136
TT=19.507
T1=19.48
OPT
f=136
TT=8.073
T1=8.23
OPT
f=136
TT=143.431
T1=144.15
No dataNo dataNo dataOPT
f=136
TT=1.099
T1=0.78
No dataNo dataOPT
f=136
TT=1.059
T1=0.75
No dataNo dataNo dataOPT
f=136
TT=4.383
T1=2.05
OPT
f=136
TT=2.792
T1=1.46
OPT
f=136
TT=2.855
T1=1.5
OPT
f=136
TT=259.189
T1=258.64
OPT
f=136
TT=243.129
T1=242.54
OPT
f=136
TT=265.664
T1=265.08
OPT
f=136
TT=3.646
T1=3.59
OPT
f=136
TT=3.492
T1=3.44
OPT
f=136
TT=0.692
T1=0.67
No dataNo dataOPT
f=136
TT=0.718
T1=0.69
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9022_8.std.opb
OPT
f=97
TT=0.236
T1=0.21
OPT
f=97
TT=145.681
T1=145.7
No dataOPT
f=97
TT=0.236
T1=0.21
OPT
f=97
TT=28.172
T1=30.46
? (problem)

TT=18.247

OPT
f=97
TT=25.286
T1=26.4
? (problem)

TT=10.4

OPT
f=97
TT=20.934
T1=20.99
? (problem)

TT=10.38

OPT
f=97
TT=21.973
T1=24.62
? (problem)

TT=10.47

OPT
f=97
TT=102.305
T1=102.31
OPT
f=97
TT=97.651
T1=97.61
OPT
f=97
TT=11.187
T1=9.93
OPT
f=97
TT=22.015
T1=22
OPT
f=97
TT=3.165
T1=1.56
OPT
f=97
TT=166.878
T1=166.9
OPT
f=97
TT=2.875
T1=1.38
? (TO)

TT=1802.17

No dataOPT
f=97
TT=218.046
T1=214.71
OPT
f=97
TT=3.772
T1=2.51
? (TO)

TT=1802.08

No dataOPT
f=97
TT=3.683
T1=2.03
SAT
f=300
TT=1797.36
T1=886.9
OPT
f=97
TT=73.987
T1=73.95
OPT
f=97
TT=17.945
T1=18.83
OPT
f=97
TT=12.034
T1=11.99
No dataNo dataNo dataOPT
f=97
TT=1.259
T1=0.9
No dataNo dataOPT
f=97
TT=1.242
T1=0.88
No dataNo dataNo dataOPT
f=97
TT=4.654
T1=2.19
OPT
f=97
TT=3.095
T1=1.51
SAT
f=97
TT=3.402
T1=1.69
OPT
f=97
TT=607.996
T1=607.23
OPT
f=97
TT=451.684
T1=451.07
OPT
f=97
TT=635.183
T1=634.35
OPT
f=97
TT=3.86
T1=3.8
OPT
f=97
TT=3.824
T1=3.76
OPT
f=97
TT=0.797
T1=0.76
No dataNo dataOPT
f=97
TT=0.738
T1=0.71
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9027_6.std.opb
OPT
f=87
TT=0.226
T1=0.2
OPT
f=87
TT=164.149
T1=164.18
No dataOPT
f=87
TT=0.226
T1=0.2
? (problem)

TT=23.022

OPT
f=87
TT=44.844
T1=45.23
? (problem)

TT=20.38

? (problem)

TT=19.68

? (problem)

TT=23.75

? (problem)

TT=19.61

? (problem)

TT=20.72

? (problem)

TT=19.8

OPT
f=87
TT=114.856
T1=114.87
OPT
f=87
TT=67.467
T1=67.45
OPT
f=87
TT=12.003
T1=10.52
OPT
f=87
TT=22.163
T1=22.15
OPT
f=87
TT=3.234
T1=1.64
OPT
f=87
TT=167.536
T1=167.56
OPT
f=87
TT=3.005
T1=1.51
? (TO)

TT=1802.09

No dataOPT
f=87
TT=67.825
T1=64.46
OPT
f=87
TT=4.092
T1=2.54
? (TO)

TT=1802.15

No dataOPT
f=87
TT=3.872
T1=2.07
? (TO)

TT=1802.11

OPT
f=87
TT=57.981
T1=57.94
OPT
f=87
TT=30.813
T1=16.96
OPT
f=87
TT=19.774
T1=17.64
No dataNo dataNo dataOPT
f=87
TT=1.338
T1=0.95
No dataNo dataOPT
f=87
TT=1.24
T1=0.88
No dataNo dataNo dataOPT
f=87
TT=5.913
T1=2.42
OPT
f=87
TT=2.935
T1=1.53
OPT
f=87
TT=3.134
T1=1.59
OPT
f=87
TT=751.389
T1=750.58
OPT
f=87
TT=588.325
T1=587.68
OPT
f=87
TT=606.889
T1=606.29
OPT
f=87
TT=4.112
T1=4.05
OPT
f=87
TT=3.951
T1=3.9
OPT
f=87
TT=0.836
T1=0.8
No dataNo dataOPT
f=87
TT=0.782
T1=0.76
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9033_3.std.opb
OPT
f=108
TT=0.226
T1=0.2
OPT
f=108
TT=187.657
T1=187.7
No dataOPT
f=108
TT=0.226
T1=0.2
OPT
f=108
TT=8.534
T1=6.77
OPT
f=108
TT=4.741
T1=3.83
? (problem)

TT=4.71

? (problem)

TT=2.61

? (problem)

TT=5.19

? (problem)

TT=2.94

? (problem)

TT=4.78

? (problem)

TT=2.56

OPT
f=108
TT=138.621
T1=138.64
OPT
f=108
TT=3.578
T1=3.56
OPT
f=108
TT=646.577
T1=649.59
OPT
f=108
TT=23.292
T1=23.28
OPT
f=108
TT=3.214
T1=1.61
OPT
f=108
TT=189.518
T1=189.55
OPT
f=108
TT=2.794
T1=1.41
?

TT=1799.47

No dataOPT
f=108
TT=17.985
T1=14.6
OPT
f=108
TT=3.922
T1=2.44
?

TT=1790.35

No dataOPT
f=108
TT=4.003
T1=1.91
?

TT=1797.35

OPT
f=108
TT=0.885
T1=0.86
OPT
f=108
TT=5.687
T1=6.33
OPT
f=108
TT=117.879
T1=124.05
No dataNo dataNo dataOPT
f=108
TT=1.694
T1=1.1
No dataNo dataOPT
f=108
TT=1.68
T1=1.09
No dataNo dataNo dataOPT
f=108
TT=4.865
T1=2.04
OPT
f=108
TT=3.243
T1=1.56
OPT
f=108
TT=3.233
T1=1.63
?

TT=1797.92

?

TT=1797.55

?

TT=1797.47

OPT
f=108
TT=3.684
T1=3.54
OPT
f=108
TT=3.737
T1=3.6
OPT
f=108
TT=1.01
T1=0.98
No dataNo dataOPT
f=108
TT=0.933
T1=0.9
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9036_4.std.opb
OPT
f=79
TT=0.226
T1=0.2
OPT
f=79
TT=186.886
T1=186.92
No dataOPT
f=79
TT=0.226
T1=0.2
OPT
f=79
TT=13.594
T1=11.6
OPT
f=79
TT=9.301
T1=7.53
? (problem)

TT=6.99

? (problem)

TT=5.31

? (problem)

TT=7.09

? (problem)

TT=5.33

? (problem)

TT=7.03

? (problem)

TT=4.94

OPT
f=79
TT=179.573
T1=179.5
OPT
f=79
TT=17.281
T1=17.24
OPT
f=79
TT=12.156
T1=10.51
OPT
f=79
TT=23.81
T1=23.8
OPT
f=79
TT=3.004
T1=1.53
OPT
f=79
TT=189.81
T1=189.84
OPT
f=79
TT=2.664
T1=1.4
? (TO)

TT=1802.14

No dataOPT
f=79
TT=16.136
T1=12.76
OPT
f=79
TT=3.581
T1=2.45
OPT
f=79
TT=1219.99
T1=1219.43
No dataOPT
f=79
TT=3.673
T1=1.97
? (TO)

TT=1802.46

OPT
f=79
TT=13.654
T1=13.6
OPT
f=79
TT=9.655
T1=11.18
OPT
f=79
TT=220.115
T1=227.55
No dataNo dataNo dataOPT
f=79
TT=1.257
T1=0.89
No dataNo dataOPT
f=79
TT=1.184
T1=0.83
No dataNo dataNo dataOPT
f=79
TT=4.612
T1=2.06
OPT
f=79
TT=3.042
T1=1.48
OPT
f=79
TT=2.774
T1=1.53
OPT
f=79
TT=448.493
T1=447.95
OPT
f=79
TT=447.228
T1=446.59
OPT
f=79
TT=436.733
T1=436.15
OPT
f=79
TT=3.811
T1=3.76
OPT
f=79
TT=3.803
T1=3.74
OPT
f=79
TT=0.753
T1=0.72
No dataNo dataOPT
f=79
TT=0.79
T1=0.76
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9038_7.std.opb
OPT
f=85
TT=0.228
T1=0.2
OPT
f=85
TT=188.544
T1=188.58
No dataOPT
f=85
TT=0.228
T1=0.2
OPT
f=85
TT=28.397
T1=28.06
OPT
f=85
TT=20.773
T1=21
? (problem)

TT=12.46

OPT
f=85
TT=18.458
T1=19.82
? (problem)

TT=12.84

OPT
f=85
TT=42.179
T1=41.57
? (problem)

TT=12.82

? (TO)

TT=1800.02

OPT
f=85
TT=181.366
T1=181.41
OPT
f=85
TT=185.714
T1=185.71
OPT
f=85
TT=11.926
T1=10.36
OPT
f=85
TT=22.901
T1=22.89
OPT
f=85
TT=3.284
T1=1.63
OPT
f=85
TT=188.726
T1=188.76
OPT
f=85
TT=3.105
T1=1.55
?

TT=1797.37

No dataOPT
f=85
TT=134.12
T1=113.75
OPT
f=85
TT=4.011
T1=2.53
? (TO)

TT=1802.13

No dataOPT
f=85
TT=3.854
T1=2.07
? (TO)

TT=1802.1

OPT
f=85
TT=91.327
T1=91.34
OPT
f=85
TT=17.704
T1=15.87
OPT
f=85
TT=368.963
T1=376.62
No dataNo dataNo dataOPT
f=85
TT=1.307
T1=0.93
No dataNo dataOPT
f=85
TT=1.231
T1=0.87
No dataNo dataNo dataOPT
f=85
TT=4.913
T1=2.21
OPT
f=85
TT=3.124
T1=1.56
SAT
f=85
TT=3.203
T1=1.65
OPT
f=85
TT=675.009
T1=674.35
OPT
f=85
TT=837.684
T1=836.76
OPT
f=85
TT=661.225
T1=660.63
OPT
f=85
TT=3.862
T1=3.81
OPT
f=85
TT=4.144
T1=4.09
OPT
f=85
TT=0.783
T1=0.76
No dataNo dataOPT
f=85
TT=0.831
T1=0.8
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j9041_1.std.opb
SAT
f=148
TT=1800.04
T1=402.81
SAT
f=160
TT=1798.02
T1=222.85
No data? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (problem)

TT=27.92

? (problem)

TT=18.38

? (problem)

TT=28.53

? (problem)

TT=30.537

? (problem)

TT=27.98

? (problem)

TT=16.94

SAT (TO)
f=157
TT=1800.04
T1=1580.58
SAT (TO)
f=296
TT=1800.05
T1=1563.6
SAT (TO)
f=153
TT=1801.99
T1=390.14
SAT
f=168
TT=1783.02
T1=1542.22
SAT (TO)
f=155
TT=1800.52
T1=36.06
SAT
f=152
TT=1798.03
T1=1547.42
SAT (TO)
f=150
TT=1800.31
T1=1609.91
?

TT=1796.72

No dataNo Cert.

TT=1800.01

SAT (TO)
f=150
TT=1801
T1=864.89
?

TT=1790.37

No dataSAT (TO)
f=149
TT=1800.1
T1=765.98
?

TT=1797.3

No Cert.

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.03

No dataNo dataNo dataSAT (TO)
f=149
TT=1800.11
T1=900.61
No dataNo dataSAT (TO)
f=150
TT=1800.5
T1=900.61
No dataNo dataNo dataSAT (TO)
f=148
TT=1800.76
T1=402.81
SAT (TO)
f=148
TT=1800.04
T1=906.57
SAT (TO)
f=147
TT=1800.07
T1=1469.43
?

TT=1797.32

?

TT=1797.63

?

TT=1797.54

? (TO)

TT=1800.08

? (TO)

TT=1800.07

?

TT=1799.67

No dataNo data?

TT=1799.62

/OPT-SMALLINT-LIN/
oliveras/j90opt/
normalized-j909_4.std.opb
SAT
f=131
TT=1800.85
T1=564.32
SAT
f=140
TT=1798.04
T1=265.49
No data? (TO)

TT=1800.07

? (TO)

TT=1800.12

? (TO)

TT=1800.11

? (problem)

TT=96.17

? (problem)

TT=24.16

? (problem)

TT=96.02

? (problem)

TT=23.51

? (problem)

TT=129.81

? (problem)

TT=24.16

SAT (TO)
f=137
TT=1800.08
T1=353.61
SAT (TO)
f=206
TT=1800.09
T1=1756.65
SAT (TO)
f=135
TT=1802.03
T1=1372.25
SAT
f=144
TT=1783.02
T1=1126.81
SAT (TO)
f=135
TT=1801.4
T1=1667.14
SAT
f=137
TT=1798.02
T1=548.78
SAT (TO)
f=134
TT=1800.79
T1=662.38
?

TT=1797.53

No dataNo Cert.

TT=1800.1

SAT (TO)
f=134
TT=1800.81
T1=844.64
?

TT=1790.4

No dataSAT (TO)
f=134
TT=1800.07
T1=449.58
?

TT=1797.4

No Cert.

TT=1800.02

? (TO)

TT=1800.12

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=135
TT=1800.13
T1=900.61
No dataNo dataSAT (TO)
f=134
TT=1800.49
T1=900.61
No dataNo dataNo dataSAT (TO)
f=132
TT=1800.13
T1=494.05
SAT (TO)
f=131
TT=1800.85
T1=564.32
SAT (TO)
f=134
TT=1800.01
T1=1697.2
?

TT=1797.42

?

TT=1797.48

?

TT=1797.46

? (TO)

TT=1800.08

? (TO)

TT=1800.03

?

TT=1799.61

No dataNo data?

TT=1799.61

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_0null0mast_rapportOE2.0_TMAX180_K67_cod2.opb
SAT
f=-153854
TT=1797.03
T1=1537.54
SAT
f=-11368
TT=1798.02
T1=19.21
No data? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (problem)

TT=9.79

? (TO)

TT=1800.12

? (problem)

TT=10.31

? (TO)

TT=1800.05

? (problem)

TT=10.1

SAT (TO)
f=-11368
TT=1800.12
T1=19.54
SAT (TO)
f=-47062
TT=1800.1
T1=1555.22
? (TO)

TT=1800.12

SAT
f=-6782
TT=1783.03
T1=1783.33
SAT (TO)
f=-78986
TT=1800.62
T1=1230.85
SAT
f=-11368
TT=1798.02
T1=19.17
SAT (TO)
f=-43551
TT=1800.09
T1=2.15
?

TT=1794

No data? (TO)

TT=1800.15

SAT (TO)
f=-114018
TT=1800.08
T1=768.03
?

TT=1789.95

No dataSAT (TO)
f=-114018
TT=1800.12
T1=780.19
?

TT=1797.26

No Cert.

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=-29079
TT=1800.56
T1=900.41
No dataNo data? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=-101098
TT=1800.61
T1=785.75
SAT (TO)
f=-108850
TT=1800.91
T1=196.87
SAT (TO)
f=-82349
TT=1800.66
T1=1510.27
SAT
f=-134546
TT=1797.39
T1=1648.56
SAT
f=-153854
TT=1797.1
T1=1552.31
SAT
f=-153854
TT=1797.03
T1=1537.54
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.42

No dataNo data?

TT=1799.79

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_10null10mast_rapportOE1.0_TMAX120_K67_cod2.opb
SAT
f=-245980
TT=1797.04
T1=374.78
?

TT=1798.03

No data? (TO)

TT=1800

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (problem)

TT=6.98

? (TO)

TT=1800.06

? (problem)

TT=6.83

? (problem)

TT=16.52

? (problem)

TT=7.85

? (TO)

TT=1800.94

SAT (TO)
f=-610
TT=1800.07
T1=19.98
SAT (TO)
f=-49044
TT=1800.09
T1=1517.18
? (TO)

TT=1555.64

SAT
f=-4183
TT=1783.02
T1=1783.32
SAT (TO)
f=-98514
TT=1800.01
T1=1461.21
?

TT=1798.05

SAT (TO)
f=-94943
TT=1800.66
T1=44.44
?

TT=1793.83

No data? (TO)

TT=1800.07

SAT (TO)
f=-2
TT=1800.09
T1=46.97
?

TT=1789.91

No dataSAT (TO)
f=-2
TT=1800
T1=48.44
?

TT=1797.17

No Cert.

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=-30228
TT=1800.57
T1=900.41
No dataNo dataSAT (TO)
f=-67106
TT=1800.17
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-141311
TT=1800.15
T1=597.43
SAT (TO)
f=-66286
TT=1800.77
T1=250.56
SAT (TO)
f=-144882
TT=1800.09
T1=30.31
SAT
f=-245980
TT=1797.04
T1=374.78
SAT
f=-245980
TT=1797.18
T1=393.88
SAT
f=-245980
TT=1797.19
T1=444.97
? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.54

No dataNo data? (TO)

TT=1800.06

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_20null0mast_rapportOE1.0_TMAX180_K67_cod2.opb
SAT
f=-144793
TT=1797.02
T1=1480.54
SAT
f=-5
TT=1798.01
T1=18.06
No data? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (problem)

TT=7.29

? (TO)

TT=1800.13

? (problem)

TT=7.69

? (TO)

TT=1802.34

? (problem)

TT=7.5

SAT (TO)
f=-5
TT=1800.11
T1=19.86
SAT (TO)
f=-37532
TT=1800.12
T1=13.94
? (TO)

TT=1594.08

SAT
f=-7760
TT=1783.02
T1=1783.31
SAT (TO)
f=-74224
TT=1800.02
T1=1582.45
SAT
f=-5
TT=1798.04
T1=20.4
SAT (TO)
f=-75452
TT=1800.8
T1=6.41
?

TT=1793.99

No data? (TO)

TT=1800.14

SAT (TO)
f=-4
TT=1800.05
T1=701.43
?

TT=1790.1

No dataSAT (TO)
f=-4
TT=1800.15
T1=726.66
?

TT=1797.12

No Cert.

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=-59325
TT=1800.48
T1=900.41
No dataNo dataSAT (TO)
f=-32115
TT=1800.08
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-112099
TT=1800.15
T1=810.31
SAT (TO)
f=-107397
TT=1800.02
T1=129.39
SAT (TO)
f=-72521
TT=1800.58
T1=1484.61
SAT
f=-144793
TT=1797.02
T1=1484.15
SAT
f=-144793
TT=1797.02
T1=1480.54
SAT
f=-144793
TT=1797.12
T1=1523.17
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.61

No dataNo data?

TT=1799.57

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_20null10mast_rapportOE2.0_TMAX15_K67_cod2.opb
OPT
f=-22879
TT=20.37
T1=18.48
SAT
f=-6765
TT=1798.09
T1=668.62
No data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.13

? (TO)

TT=1800.13

? (TO)

TT=1800.12

? (TO)

TT=1800

? (TO)

TT=1800.09

OPT
f=-22879
TT=1717.34
T1=1211.18
SAT (TO)
f=-9357
TT=1800.11
T1=1583.53
? (TO)

TT=1800.06

? (TO)

TT=1595.24

SAT
f=-16114
TT=1783.02
T1=1783.33
SAT (TO)
f=-17716
TT=1800.07
T1=1528.44
SAT
f=-6765
TT=1798.03
T1=116.9
SAT (TO)
f=-13763
TT=1800.85
T1=629.76
? (TO)

TT=1802.09

No dataOPT
f=-22879
TT=20.37
T1=18.48
SAT (TO)
f=-1
TT=1800.15
T1=565.13
? (TO)

TT=1802.21

No dataSAT (TO)
f=-9349
TT=1800.06
T1=16.43
?

TT=1797.65

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.17

No dataNo dataSAT (TO)
f=-4935
TT=1800.01
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-11933
TT=1800.03
T1=611.87
SAT (TO)
f=-10946
TT=1800.07
T1=1080.48
SAT (TO)
f=-16347
TT=1800.09
T1=958.27
OPT
f=-22879
TT=847.915
T1=817.43
OPT
f=-22879
TT=841.887
T1=809.85
OPT
f=-22879
TT=783.961
T1=756.15
? (TO)

TT=1800.02

? (TO)

TT=1800.12

?

TT=1799.89

No dataNo data?

TT=1799.51

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null0mast_rapportOE1.0_TMAX120_K67_cod2.opb
SAT
f=-94333
TT=1797.03
T1=1642.74
SAT
f=-987
TT=1798.02
T1=20.44
No data? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (problem)

TT=3.99

? (TO)

TT=1800.08

? (problem)

TT=3.88

? (problem)

TT=16.02

? (problem)

TT=4.28

? (TO)

TT=1800.04

SAT (TO)
f=-987
TT=1800.08
T1=19.58
SAT (TO)
f=-11415
TT=1800.12
T1=26.61
? (TO)

TT=1800.14

SAT
f=-27999
TT=1783.01
T1=1783.31
SAT (TO)
f=-91550
TT=1800.06
T1=152.56
SAT
f=-987
TT=1798.01
T1=20.41
SAT (TO)
f=-52900
TT=1800.24
T1=494.82
?

TT=1793.97

No data? (TO)

TT=1800.29

SAT (TO)
f=-2
TT=1800.15
T1=318
?

TT=1789.98

No dataSAT (TO)
f=-2
TT=1800.02
T1=324.96
?

TT=1797.3

No Cert.

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.02

No dataNo dataNo data? (TO)

TT=1800.07

No dataNo dataSAT (TO)
f=-17475
TT=1800.52
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-60220
TT=1800.18
T1=477.18
SAT (TO)
f=-70556
TT=1800.06
T1=1223.08
SAT (TO)
f=-54963
TT=1800.04
T1=448.67
SAT
f=-91516
TT=1797.29
T1=1591.2
SAT
f=-94333
TT=1797.03
T1=1642.74
SAT
f=-94333
TT=1797.14
T1=1685.86
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.56

No dataNo data?

TT=1799.46

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_fibo_50null50mast_rapportOE2.0_TMAX15_K67_cod2.opb
OPT
f=0
TT=0.395
T1=0.14
OPT
f=0
TT=151.02
T1=77.55
No dataOPT
f=0
TT=0.395
T1=0.14
OPT
f=0
TT=7.489
T1=4
OPT
f=0
TT=6.46
T1=3.3
OPT
f=0
TT=6.578
T1=3.42
OPT
f=0
TT=5.838
T1=2.94
OPT
f=0
TT=4.163
T1=3.63
OPT
f=0
TT=4.319
T1=3.19
OPT
f=0
TT=3.786
T1=3.35
OPT
f=0
TT=4.046
T1=2.94
OPT
f=0
TT=82.29
T1=66.53
SAT (TO)
f=0
TT=1800.03
T1=73.7
? (TO)

TT=1800.11

OPT
f=0
TT=61.293
T1=48.1
OPT
f=0
TT=4.932
T1=1.32
OPT
f=0
TT=123.876
T1=71.52
OPT
f=0
TT=6.083
T1=3.55
?

TT=1793.35

No dataOPT
f=0
TT=22.883
T1=20.99
OPT
f=0
TT=29.872
T1=9.9
?

TT=1790.21

No dataOPT
f=0
TT=20.361
T1=5.89
?

TT=1797.37

No Cert.

TT=1800.07

OPT
f=0
TT=6.36
T1=1.79
OPT
f=0
TT=2.613
T1=2.17
No dataNo dataNo dataOPT
f=0
TT=14.628
T1=7.44
No dataNo dataOPT
f=0
TT=9.658
T1=4.95
No dataNo dataNo dataOPT
f=0
TT=48.368
T1=19.06
OPT
f=0
TT=21.811
T1=17.1
SAT
f=0
TT=6.243
T1=3.15
OPT
f=0
TT=1546.46
T1=1546.18
OPT
f=0
TT=1399.59
T1=1399.35
OPT
f=0
TT=1348.72
T1=1348.41
OPT
f=0
TT=579.855
T1=151.15
OPT
f=0
TT=605.064
T1=159.69
?

TT=1799.57

No dataNo data?

TT=1799.6

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_0null0mast_rapportOE1.0_TMAX15_K67_cod1.opb
OPT
f=-192
TT=265.857
T1=1.29
SAT
f=-4
TT=1798.04
T1=1629.73
No dataOPT
f=-192
TT=314.081
T1=14.15
? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (problem)

TT=1061.36

? (problem)

TT=19.89

? (problem)

TT=944.02

? (problem)

TT=20.74

? (problem)

TT=1055.03

? (problem)

TT=20.47

SAT (TO)
f=-12
TT=1800.1
T1=1606.55
Signal

TT=2.362

? (TO)

TT=1800.09

SAT
f=-32
TT=1783.02
T1=1783.29
SAT (TO)
f=-180
TT=1801.77
T1=1582.64
SAT
f=-6
TT=1798.02
T1=356.53
SAT (TO)
f=-128
TT=1800.09
T1=1196.01
?

TT=1794.28

No dataOPT
f=-192
TT=265.857
T1=264.04
SAT (TO)
f=-192
TT=1800.79
T1=17.85
?

TT=1789.98

No dataSAT (TO)
f=-192
TT=1800.18
T1=5.03
OPT
f=-192
TT=880.176
T1=880.22
No Cert.

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.16
T1=900.51
No dataNo dataSAT (TO)
f=-10
TT=1800.08
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-192
TT=1800.2
T1=2.28
SAT (TO)
f=-192
TT=1800.02
T1=1.29
SAT (TO)
f=-192
TT=1800.05
T1=1206.67
OPT
f=-192
TT=686.126
T1=686.04
OPT
f=-192
TT=659.316
T1=659.22
OPT
f=-192
TT=684.189
T1=684.09
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.43

No dataNo data?

TT=1799.37

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_0null0mast_rapportOE2.0_TMAX120_K67_cod1.opb
SAT
f=-564
TT=1797.58
T1=1564.46
?

TT=1798.7

No data? (TO)

TT=1800.05

? (TO)

TT=1800.11

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (problem)

TT=12.11

? (TO)

TT=1800.03

? (problem)

TT=12.16

? (TO)

TT=1800.07

? (problem)

TT=11.04

? (TO)

TT=1800.03

Signal

TT=2.381

? (TO)

TT=1800.11

SAT
f=-133
TT=1783.34
T1=1783.64
No Cert.

TT=572.208

?

TT=1798.02

SAT (TO)
f=-336
TT=1800.57
T1=35.45
?

TT=1794.24

No data? (TO)

TT=1800.24

SAT (TO)
f=-400
TT=1800.02
T1=47.34
?

TT=1790.01

No dataSAT (TO)
f=-256
TT=1800.11
T1=18.67
?

TT=1797.02

No Cert.

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=-58
TT=1800.02
T1=900.41
No dataNo dataSAT (TO)
f=-62
TT=1800.2
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-298
TT=1800.64
T1=44.09
SAT (TO)
f=-157
TT=1800.06
T1=45.66
SAT (TO)
f=-203
TT=1800.77
T1=200.6
SAT
f=-564
TT=1797.74
T1=1783.7
SAT
f=-564
TT=1797.7
T1=1564.46
SAT
f=-564
TT=1797.58
T1=1575.72
? (TO)

TT=1800.08

? (TO)

TT=1800.04

?

TT=1799.56

No dataNo data?

TT=1799.39

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_0null10mast_rapportOE1.0_TMAX120_K67_cod3.opb
OPT
f=-5256
TT=1663.14
T1=745.39
?

TT=1798.03

No data? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (problem)

TT=11.7

? (problem)

TT=14.92

? (problem)

TT=10.67

? (problem)

TT=15.25

? (problem)

TT=11.89

? (problem)

TT=15.34

? (TO)

TT=1800.03

Signal

TT=2.408

? (TO)

TT=1800.09

SAT
f=-270
TT=1783.13
T1=1783.41
No Cert.

TT=1290.11

?

TT=1798.03

SAT (TO)
f=-2130
TT=1800.1
T1=27.51
?

TT=1794.21

No dataOPT
f=-5256
TT=1663.14
T1=745.39
SAT (TO)
f=-2176
TT=1800.81
T1=17.89
?

TT=1789.89

No dataSAT (TO)
f=-2176
TT=1800.2
T1=5.4
?

TT=1799.41

No Cert.

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=-557
TT=1800.04
T1=900.41
No dataNo dataSAT (TO)
f=-795
TT=1800.01
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-1458
TT=1800.15
T1=628.12
SAT (TO)
f=-1301
TT=1800.66
T1=199.96
SAT (TO)
f=-1190
TT=1800
T1=386.68
SAT
f=-5136
TT=1797.64
T1=1626.35
SAT (TO)
f=-5136
TT=1800.12
T1=1580.39
SAT
f=-5056
TT=1797.99
T1=1032.9
? (TO)

TT=1800.11

? (TO)

TT=1800.09

?

TT=1799.51

No dataNo data?

TT=1799.36

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_0null20mast_rapportOE2.0_TMAX120_K67_cod2.opb
OPT
f=-2832
TT=362.299
T1=163.77
?

TT=1798.01

No data? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (problem)

TT=6.11

? (problem)

TT=70.18

? (problem)

TT=6.22

? (TO)

TT=1800.07

? (problem)

TT=6.4

? (TO)

TT=1800.09

SAT (TO)
f=-2304
TT=1800.05
T1=598.7
? (TO)

TT=1778.25

SAT
f=-776
TT=1783.04
T1=1783.31
SAT (TO)
f=-819
TT=1800.03
T1=3.78
?

TT=1798.01

SAT (TO)
f=-1040
TT=1800.39
T1=1.78
?

TT=1794.01

No dataOPT
f=-2832
TT=362.299
T1=163.77
SAT (TO)
f=-2070
TT=1801.37
T1=241.13
?

TT=1789.99

No dataSAT (TO)
f=-2560
TT=1800.04
T1=465.03
?

TT=1796.92

No Cert.

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.03

No dataNo dataNo data? (TO)

TT=1800.15

No dataNo data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-1920
TT=1800.38
T1=829.97
SAT (TO)
f=-1024
TT=1800.05
T1=8.44
SAT (TO)
f=-2816
TT=1800.79
T1=388.95
SAT
f=-2832
TT=1797.04
T1=786.02
SAT
f=-2832
TT=1797.17
T1=725.09
SAT
f=-2832
TT=1797.37
T1=845.1
? (TO)

TT=1800.02

? (TO)

TT=1800.01

?

TT=1799.64

No dataNo data?

TT=1799.55

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_0null20mast_rapportOE2.0_TMAX300_K67_cod2.opb
OPT
f=-7364
TT=772.329
T1=426.65
SAT
f=-287
TT=1798.08
T1=19.1
No data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.05

? (problem)

TT=7.22

? (TO)

TT=1800.1

? (problem)

TT=7.57

? (TO)

TT=1800.06

? (problem)

TT=7.21

SAT (TO)
f=-287
TT=1800.04
T1=20.01
SAT (TO)
f=-2648
TT=1800.1
T1=31.91
? (TO)

TT=1800.21

SAT
f=-278
TT=1783.02
T1=1783.31
SAT (TO)
f=-4252
TT=1800.06
T1=20.55
SAT
f=-287
TT=1798.06
T1=19.12
SAT (TO)
f=-6273
TT=1800.7
T1=66.46
?

TT=1793.87

No dataOPT
f=-7364
TT=772.329
T1=426.65
SAT (TO)
f=-4
TT=1800.1
T1=703.21
?

TT=1790

No dataSAT (TO)
f=-4
TT=1800.14
T1=717.69
?

TT=1796.87

No Cert.

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=-1782
TT=1800.54
T1=900.41
No dataNo dataSAT (TO)
f=-2892
TT=1800.56
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-5440
TT=1801
T1=365.04
SAT (TO)
f=-5377
TT=1800.9
T1=68.01
SAT (TO)
f=-5266
TT=1800
T1=1698.05
OPT
f=-7364
TT=915.809
T1=913.01
OPT
f=-7364
TT=1081.33
T1=1078.03
OPT
f=-7364
TT=1064.07
T1=1060.76
? (TO)

TT=1800.02

? (TO)

TT=1800.1

?

TT=1799.84

No dataNo data?

TT=1799.59

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null0mast_rapportOE1.0_TMAX120_K67_cod1.opb
SAT
f=-536
TT=1798.31
T1=1419.45
SAT
f=-111
TT=1797.98
T1=1604.19
No data? (TO)

TT=1800

? (TO)

TT=1800.13

? (TO)

TT=1800.04

? (problem)

TT=11.67

? (problem)

TT=132.4

? (problem)

TT=10.78

? (problem)

TT=91.43

? (problem)

TT=11.84

? (problem)

TT=91.95

? (TO)

TT=1800.09

Signal

TT=2.411

? (TO)

TT=1377.12

SAT
f=-46
TT=1788.99
T1=1789.27
SAT (TO)
f=-448
TT=1801.66
T1=40.23
?

TT=1798.09

SAT (TO)
f=-462
TT=1800.75
T1=2.21
?

TT=1794.27

No data? (TO)

TT=1800.1

SAT (TO)
f=-416
TT=1800.08
T1=2.89
?

TT=1790.07

No dataSAT (TO)
f=-360
TT=1800.15
T1=2.58
SAT
f=-536
TT=1798.31
T1=1419.45
No Cert.

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.09

No dataNo dataNo dataSAT (TO)
f=-115
TT=1800.16
T1=900.51
No dataNo dataSAT (TO)
f=-140
TT=1800.2
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-401
TT=1800.19
T1=280.15
SAT (TO)
f=-327
TT=1800.79
T1=94.96
SAT (TO)
f=-209
TT=1800.71
T1=199.41
SAT
f=-524
TT=1797.78
T1=1661.65
SAT
f=-524
TT=1797.77
T1=1736.33
SAT
f=-524
TT=1797.38
T1=1331.85
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.7

No dataNo data?

TT=1799.64

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null0mast_rapportOE1.0_TMAX60_K67_cod1.opb
SAT
f=-440
TT=1797.4
T1=714.56
?

TT=1798.02

No data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.12

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.02

Signal

TT=2.441

? (TO)

TT=1561.71

SAT
f=-32
TT=1784.12
T1=1784.42
SAT (TO)
f=-268
TT=1802.26
T1=2.49
?

TT=1798.17

SAT (TO)
f=-2
TT=1800.68
T1=971.17
?

TT=1794.54

No data? (TO)

TT=1800.21

? (TO)

TT=1800.78

?

TT=1790.13

No data? (TO)

TT=1800.09

SAT
f=-304
TT=1797.5
T1=1444.41
No Cert.

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.13

No dataNo dataNo data? (TO)

TT=1800.42

No dataNo data? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=-164
TT=1800.23
T1=9.25
? (TO)

TT=1800.57

SAT (TO)
f=-83
TT=1800.65
T1=1312.34
SAT
f=-440
TT=1797.4
T1=714.56
SAT
f=-440
TT=1797.7
T1=799.97
SAT
f=-440
TT=1797.88
T1=838.64
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.55

No dataNo data?

TT=1799.43

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null0mast_rapportOE2.0_TMAX60_K67_cod1.opb
SAT
f=-345
TT=1797.54
T1=1585.09
?

TT=1798.01

No data? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (problem)

TT=1503.34

? (TO)

TT=1800.06

? (problem)

TT=1549.54

? (TO)

TT=1800.06

? (problem)

TT=1469.49

? (TO)

TT=1800.09

? (TO)

TT=1800.04

Signal

TT=2.384

? (TO)

TT=1800.13

SAT
f=-16
TT=1784.28
T1=1784.55
SAT (TO)
f=-272
TT=1801.54
T1=69.5
?

TT=1798.03

? (TO)

TT=1800.67

?

TT=1794.33

No data? (TO)

TT=1800.27

SAT (TO)
f=-129
TT=1800.08
T1=38.51
?

TT=1790.05

No dataSAT (TO)
f=-129
TT=1800.07
T1=39.7
SAT
f=-317
TT=1797.87
T1=1481.76
No Cert.

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.14

No dataNo data? (TO)

TT=1800.52

No dataNo dataNo dataSAT (TO)
f=-129
TT=1800.83
T1=33.28
SAT (TO)
f=0
TT=1800.97
T1=1.28
SAT (TO)
f=-52
TT=1800.7
T1=583.65
SAT
f=-345
TT=1797.57
T1=1788.7
SAT
f=-345
TT=1797.54
T1=1585.09
SAT
f=-345
TT=1797.55
T1=1735.32
? (TO)

TT=1800.06

? (TO)

TT=1800.11

?

TT=1799.85

No dataNo data?

TT=1799.41

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null10mast_rapportOE2.0_TMAX120_K67_cod1.opb
OPT
f=-2624
TT=1380.24
T1=1066.34
?

TT=1798.08

No data? (TO)

TT=1800

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (problem)

TT=149.61

? (TO)

TT=1800.09

? (problem)

TT=101.09

? (TO)

TT=1800.08

? (problem)

TT=101.54

? (TO)

TT=1800.1

Signal

TT=2.386

? (TO)

TT=1800.22

SAT
f=-260
TT=1783.57
T1=1783.89
SAT
f=-1146
TT=1191.41
T1=5.05
?

TT=1798.31

SAT (TO)
f=-864
TT=1800.06
T1=18.55
?

TT=1794.45

No data? (TO)

TT=1800.21

SAT (TO)
f=-1088
TT=1800.14
T1=149.3
?

TT=1789.97

No dataSAT (TO)
f=-2
TT=1800.19
T1=55.64
SAT
f=-696
TT=1797.66
T1=1635.77
? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-85
TT=1800.44
T1=900.41
No dataNo dataSAT (TO)
f=-263
TT=1800.5
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-526
TT=1800.7
T1=202.07
SAT (TO)
f=-783
TT=1800.01
T1=517.81
SAT (TO)
f=-799
TT=1800.52
T1=1350.81
OPT
f=-2624
TT=1410.59
T1=1103.22
OPT
f=-2624
TT=1576.62
T1=1229.69
OPT
f=-2624
TT=1380.24
T1=1066.34
? (TO)

TT=1800.02

? (TO)

TT=1800.11

?

TT=1799.53

No dataNo data?

TT=1799.55

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null10mast_rapportOE2.0_TMAX15_K67_cod1.opb
OPT
f=-80
TT=223.147
T1=89.9
?

TT=1798

No dataOPT
f=-80
TT=223.147
T1=89.9
? (TO)

TT=1800.03

? (TO)

TT=1800.14

? (problem)

TT=184.93

? (TO)

TT=1800.08

? (problem)

TT=174.41

? (TO)

TT=1800.1

? (problem)

TT=187.67

? (TO)

TT=1800.09

SAT (TO)
f=-7
TT=1800.13
T1=1230.12
Signal

TT=2.385

? (TO)

TT=1800.08

SAT
f=-32
TT=1783.01
T1=1783.29
SAT (TO)
f=-48
TT=1801.06
T1=459.89
?

TT=1798.13

SAT (TO)
f=-48
TT=1800.88
T1=284.89
SAT (TO)
f=0
TT=1802.09
T1=652.16
No dataOPT
f=-80
TT=1526.05
T1=701.36
SAT (TO)
f=-66
TT=1800.76
T1=835.66
?

TT=1790.64

No dataSAT (TO)
f=-49
TT=1800.03
T1=800.55
?

TT=1797.07

No Cert.

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=-4
TT=1800.45
T1=900.41
No dataNo dataSAT (TO)
f=-2
TT=1800.11
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-66
TT=1800.15
T1=605.59
OPT
f=-80
TT=1084.92
T1=453.82
SAT (TO)
f=-80
TT=1800.03
T1=1337.72
SAT
f=-60
TT=1797.47
T1=1162.35
SAT
f=-60
TT=1797.79
T1=1352
SAT
f=-60
TT=1797.82
T1=1289.37
? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.47

No dataNo data?

TT=1799.46

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_10null10mast_rapportOE2.0_TMAX60_K67_cod3.opb
OPT
f=-1296
TT=285.746
T1=268.78
?

TT=1798.04

No data? (TO)

TT=1800.1

? (TO)

TT=1800.13

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.05

Signal

TT=2.383

? (TO)

TT=1800.03

SAT
f=-48
TT=1783.02
T1=1783.3
SAT (TO)
f=0
TT=1801.83
T1=361.42
?

TT=1798.01

SAT (TO)
f=-1
TT=1800.63
T1=68.08
?

TT=1794.42

No dataOPT
f=-1296
TT=285.746
T1=268.78
SAT (TO)
f=-1
TT=1800.18
T1=27.82
?

TT=1790.02

No dataSAT (TO)
f=-1
TT=1800.18
T1=28.83
OPT
f=-1296
TT=1471.08
T1=1447.42
? (TO)

TT=1800.05

? (TO)

TT=1800.12

? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.19

No dataNo data? (TO)

TT=1800.42

No dataNo dataNo dataSAT (TO)
f=-1
TT=1800.09
T1=26.42
? (TO)

TT=1800.02

SAT (TO)
f=-258
TT=1800.73
T1=1643.29
OPT
f=-1296
TT=986.362
T1=956.14
OPT
f=-1296
TT=1020.85
T1=978.74
OPT
f=-1296
TT=874.247
T1=844.31
? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.45

No dataNo data?

TT=1799.46

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_20null0mast_rapportOE1.0_TMAX60_K67_cod2.opb
SAT
f=-472
TT=1797.09
T1=1578.15
?

TT=1797.92

No data? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (problem)

TT=4.36

? (problem)

TT=187.19

? (problem)

TT=4.31

? (problem)

TT=185.78

? (problem)

TT=4.74

? (problem)

TT=182.22

? (TO)

TT=1800.04

? (TO)

TT=1800.12

? (TO)

TT=1800.04

SAT
f=-144
TT=1783.02
T1=1783.34
SAT (TO)
f=-128
TT=1800.69
T1=549.59
?

TT=1798.05

SAT (TO)
f=-4
TT=1800.04
T1=105.58
?

TT=1793.92

No data? (TO)

TT=1800.34

SAT (TO)
f=-1
TT=1801.11
T1=247.18
?

TT=1789.98

No dataSAT (TO)
f=-1
TT=1800.15
T1=259.2
?

TT=1797.2

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.5

No dataNo dataNo dataSAT (TO)
f=-16
TT=1800.11
T1=690.8
? (TO)

TT=1800.06

SAT (TO)
f=-160
TT=1800.1
T1=1216.73
SAT
f=-472
TT=1797.12
T1=1626.48
SAT
f=-472
TT=1797.09
T1=1578.15
SAT
f=-472
TT=1797.2
T1=1643.66
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.66

No dataNo data?

TT=1799.96

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_20null0mast_rapportOE2.0_TMAX180_K67_cod1.opb
SAT
f=-590
TT=1797.08
T1=1737.58
SAT
f=-206
TT=1798.09
T1=518.07
No data? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.14

? (TO)

TT=1800.07

? (problem)

TT=13.05

? (TO)

TT=1800.07

? (problem)

TT=13.07

? (TO)

TT=1800.06

? (problem)

TT=12.12

SAT (TO)
f=-111
TT=1800.08
T1=1735.15
Signal

TT=2.399

? (TO)

TT=1800.1

SAT
f=-46
TT=1783.9
T1=1784.17
No Cert.

TT=1639.24

SAT
f=-209
TT=1798.02
T1=77.06
SAT (TO)
f=-536
TT=1801.21
T1=2.03
?

TT=1794.45

No data? (TO)

TT=1800.11

SAT (TO)
f=-508
TT=1800.16
T1=2.72
?

TT=1789.96

No dataSAT (TO)
f=-552
TT=1800.14
T1=6.31
SAT
f=-590
TT=1797.08
T1=1737.58
? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=-213
TT=1800.01
T1=900.41
No dataNo dataSAT (TO)
f=-273
TT=1800.37
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-528
TT=1800.19
T1=3.4
SAT (TO)
f=-321
TT=1800.06
T1=2
SAT (TO)
f=-259
TT=1800.77
T1=656.18
SAT
f=-580
TT=1797.33
T1=1404.89
SAT
f=-580
TT=1797.33
T1=1369.14
SAT
f=-580
TT=1797.59
T1=1490.75
? (TO)

TT=1800.07

? (TO)

TT=1800.07

?

TT=1799.49

No dataNo data?

TT=1799.8

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_20null0mast_rapportOE2.0_TMAX300_K67_cod2.opb
SAT
f=-440
TT=1800.1
T1=11.6
SAT
f=-139
TT=1798.02
T1=19.23
No data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.11

? (problem)

TT=13.72

? (problem)

TT=8.88

? (problem)

TT=14.23

? (problem)

TT=8.75

? (problem)

TT=14.23

? (problem)

TT=8.7

SAT (TO)
f=-139
TT=1800.08
T1=20.21
SAT (TO)
f=-208
TT=1800.12
T1=850.55
? (TO)

TT=1800.12

SAT
f=-177
TT=1783.01
T1=1783.31
SAT (TO)
f=-254
TT=1800.26
T1=1775.39
SAT
f=-139
TT=1798.02
T1=20.06
SAT (TO)
f=-196
TT=1800
T1=129.19
?

TT=1793.75

No data? (TO)

TT=1800.18

SAT (TO)
f=-4
TT=1800.08
T1=346.4
?

TT=1790.07

No dataSAT (TO)
f=-4
TT=1800.1
T1=353.45
?

TT=1797.17

No Cert.

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.04

No dataNo dataNo dataSAT (TO)
f=-118
TT=1800.09
T1=900.41
No dataNo dataSAT (TO)
f=-127
TT=1800.18
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-403
TT=1800.18
T1=914.91
SAT (TO)
f=-440
TT=1800.1
T1=11.6
SAT (TO)
f=-231
TT=1800.78
T1=603.66
SAT
f=-348
TT=1797.1
T1=1206.95
SAT
f=-348
TT=1797.13
T1=1189.07
SAT
f=-348
TT=1797.07
T1=1289.3
? (TO)

TT=1800.11

? (TO)

TT=1800.1

?

TT=1799.58

No dataNo data?

TT=1799.55

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_20null10mast_rapportOE1.0_TMAX180_K67_cod1.opb
SAT
f=-6444
TT=1797.56
T1=1787.22
SAT
f=-912
TT=1798.03
T1=48.72
No data? (TO)

TT=1800.08

? (TO)

TT=1800.02

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (problem)

TT=899.19

? (TO)

TT=1800.07

? (problem)

TT=666.841

? (TO)

TT=1800.07

? (problem)

TT=662.04

SAT (TO)
f=-313
TT=1800.06
T1=26.72
Signal

TT=2.372

? (TO)

TT=1800.13

SAT
f=-315
TT=1783.1
T1=1783.38
No Cert.

TT=1341.77

SAT
f=-313
TT=1798.02
T1=27.25
SAT (TO)
f=-5160
TT=1800.69
T1=4.47
?

TT=1794.42

No data? (TO)

TT=1800.3

SAT (TO)
f=-4656
TT=1801.44
T1=5.55
?

TT=1790.11

No dataSAT (TO)
f=-5056
TT=1800.18
T1=762.66
? (TO)

TT=1802.17

No Cert.

TT=1800.01

? (TO)

TT=1800.12

? (TO)

TT=1800.11

No dataNo dataNo dataSAT (TO)
f=-1638
TT=1800.13
T1=900.41
No dataNo dataSAT (TO)
f=-1753
TT=1800.42
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-4888
TT=1800.05
T1=623.32
SAT (TO)
f=-2086
TT=1800.99
T1=71.01
SAT (TO)
f=-2400
TT=1800.04
T1=1277.89
SAT
f=-6444
TT=1797.56
T1=1787.22
SAT
f=-6416
TT=1797.55
T1=1557.01
SAT
f=-5224
TT=1797.66
T1=1648.98
? (TO)

TT=1800.03

? (TO)

TT=1800.1

?

TT=1799.45

No dataNo data?

TT=1799.79

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_20null10mast_rapportOE1.0_TMAX60_K67_cod3.opb
OPT
f=-2372
TT=1011.7
T1=505.07
?

TT=1798.02

No data? (TO)

TT=1800.1

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (problem)

TT=154.02

? (TO)

TT=1800.04

? (problem)

TT=153.44

? (TO)

TT=1800.09

? (problem)

TT=221.43

? (TO)

TT=1800.1

? (TO)

TT=1800.05

Signal

TT=2.39

? (TO)

TT=1800.13

? (TO)

TT=1800.07

SAT (TO)
f=-52
TT=1801.64
T1=12.68
?

TT=1798.01

? (TO)

TT=1800.84

?

TT=1794.43

No dataOPT
f=-2372
TT=1011.7
T1=505.07
SAT (TO)
f=-256
TT=1800.19
T1=434.72
?

TT=1790.02

No dataSAT (TO)
f=-256
TT=1800.19
T1=431.15
SAT
f=-2372
TT=1797.22
T1=918.63
? (TO)

TT=1800.04

? (TO)

TT=1800

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.54

No dataNo data? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=-256
TT=1800.75
T1=233.72
? (TO)

TT=1800.82

SAT (TO)
f=-633
TT=1800.01
T1=462.52
OPT
f=-2372
TT=1530.35
T1=791.93
OPT
f=-2372
TT=1447.53
T1=743.41
OPT
f=-2372
TT=1567.67
T1=804.18
? (TO)

TT=1800.02

? (TO)

TT=1800.08

?

TT=1799.8

No dataNo data?

TT=1799.46

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_50null0mast_rapportOE1.0_TMAX300_K67_cod2.opb
SAT
f=-439
TT=1783.01
T1=1783.37
SAT
f=-251
TT=1798.04
T1=20.06
No data? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (problem)

TT=7.39

? (TO)

TT=1800.13

? (problem)

TT=7.87

? (TO)

TT=1800.06

? (problem)

TT=7.34

SAT (TO)
f=-375
TT=1800.15
T1=21.9
SAT (TO)
f=-225
TT=1800.07
T1=26.45
? (TO)

TT=1800.05

SAT
f=-439
TT=1783.01
T1=1783.37
? (exit code)

TT=1580.06

SAT
f=-229
TT=1798.06
T1=21.13
SAT (TO)
f=-333
TT=1801.49
T1=5.91
?

TT=1793.95

No data? (TO)

TT=1800.25

SAT (TO)
f=-2
TT=1800.15
T1=227.15
?

TT=1790.03

No dataSAT (TO)
f=-2
TT=1800.13
T1=230.45
?

TT=1797.11

No Cert.

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.12

No dataNo dataNo dataSAT (TO)
f=-207
TT=1800.12
T1=900.41
No dataNo dataSAT (TO)
f=-212
TT=1800.12
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-347
TT=1800.3
T1=926.96
SAT (TO)
f=-403
TT=1800.01
T1=619.87
SAT (TO)
f=-366
TT=1800.02
T1=182.91
?

TT=1797.06

?

TT=1796.99

?

TT=1797.01

? (TO)

TT=1800.02

? (TO)

TT=1800.01

?

TT=1799.82

No dataNo data?

TT=1799.5

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_50null50mast_rapportOE1.0_TMAX300_K67_cod1.opb
OPT
f=-57
TT=200.271
T1=198.47
SAT
f=-43
TT=1798.05
T1=92.9
No data? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (problem)

TT=304.67

? (problem)

TT=17.51

? (problem)

TT=224.26

? (problem)

TT=17.68

? (problem)

TT=313.47

? (problem)

TT=15.45

SAT (TO)
f=-41
TT=1800.03
T1=29.64
Signal

TT=2.37

? (TO)

TT=1800.19

SAT
f=-30
TT=1783.55
T1=1783.82
No Cert.

TT=798.39

SAT
f=-44
TT=1798.04
T1=210.42
SAT (TO)
f=-54
TT=1800.55
T1=825.98
? (TO)

TT=1802.19

No dataOPT
f=-57
TT=200.271
T1=198.47
SAT (TO)
f=-45
TT=1800.18
T1=129.69
?

TT=1790.28

No dataSAT (TO)
f=-43
TT=1800.1
T1=823.91
OPT
f=-57
TT=1651.36
T1=1651.4
? (TO)

TT=1800.06

? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=-54
TT=1800.59
T1=900.51
No dataNo dataSAT (TO)
f=-54
TT=1800.19
T1=900.51
No dataNo dataNo dataSAT (TO)
f=-42
TT=1800.13
T1=97.29
SAT (TO)
f=-17
TT=1800.02
T1=7.5
SAT (TO)
f=-56
TT=1800.01
T1=390.07
OPT
f=-57
TT=1013.99
T1=1013.53
OPT
f=-57
TT=1044.45
T1=1043.76
OPT
f=-57
TT=1035.17
T1=1034.62
? (TO)

TT=1800.11

? (TO)

TT=1800.12

?

TT=1799.58

No dataNo data? (TO)

TT=1800.09

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_luby_50null50mast_rapportOE2.0_TMAX120_K67_cod2.opb
OPT
f=-11
TT=25.813
T1=23.92
?

TT=1798.01

No data? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (problem)

TT=4.12

? (problem)

TT=11.469

? (problem)

TT=3.79

? (problem)

TT=7.62

? (problem)

TT=4.11

? (problem)

TT=7.82

? (TO)

TT=1800.09

SAT (TO)
f=-3
TT=1800.1
T1=44.59
? (TO)

TT=1800.11

SAT
f=-6
TT=1783.05
T1=1783.39
SAT (TO)
f=-9
TT=1800.01
T1=15.7
?

TT=1798.01

SAT (TO)
f=-3
TT=1800.03
T1=1.49
?

TT=1793.96

No dataOPT
f=-11
TT=25.813
T1=23.92
OPT
f=-11
TT=1120.02
T1=566.2
?

TT=1790.08

No dataSAT (TO)
f=-3
TT=1800.02
T1=527.94
?

TT=1798.73

No Cert.

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.2

No dataNo data? (TO)

TT=1800.16

No dataNo dataNo dataSAT (TO)
f=-8
TT=1800.13
T1=547.1
SAT (TO)
f=-7
TT=1800.74
T1=20.98
SAT (TO)
f=-11
TT=1800.1
T1=7.65
OPT
f=-11
TT=828.538
T1=828.38
OPT
f=-11
TT=840.454
T1=840.25
OPT
f=-11
TT=978.854
T1=978.61
? (TO)

TT=1800.01

? (TO)

TT=1800.08

?

TT=1799.96

No dataNo data?

TT=1799.61

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_10null10mast_rapportOE1.0_TMAX60_K67_cod2.opb
SAT
f=-23167
TT=1796.9
T1=1541.63
?

TT=1798.02

No data? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (problem)

TT=8.82

? (problem)

TT=99.64

? (problem)

TT=8.27

? (problem)

TT=97.72

? (problem)

TT=8.3

? (problem)

TT=98.6

? (TO)

TT=1800.12

? (TO)

TT=1800.04

? (TO)

TT=1589.86

? (TO)

TT=1800.07

SAT (TO)
f=-9064
TT=1800.66
T1=637.64
?

TT=1798.01

SAT (TO)
f=-10771
TT=1800.68
T1=1016.15
?

TT=1793.79

No data? (TO)

TT=1800.07

SAT (TO)
f=-34
TT=1800.06
T1=379.21
?

TT=1789.95

No dataSAT (TO)
f=-34
TT=1800.02
T1=386.62
?

TT=1796.91

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.06

No dataNo dataNo data? (TO)

TT=1800.45

No dataNo data? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=-34
TT=1800.65
T1=154.95
SAT (TO)
f=0
TT=1800.07
T1=15.87
SAT (TO)
f=-10678
TT=1800.06
T1=993.85
SAT
f=-23167
TT=1796.9
T1=1587.93
SAT
f=-23167
TT=1797.1
T1=1541.63
SAT
f=-23167
TT=1797.1
T1=1598.9
? (TO)

TT=1800.02

? (TO)

TT=1800.11

?

TT=1799.57

No dataNo data?

TT=1799.53

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null0mast_rapportOE1.0_TMAX180_K67_cod2.opb
SAT
f=-31135
TT=1800.71
T1=4.15
SAT
f=-766
TT=1798.04
T1=19.47
No data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (problem)

TT=9.1

? (TO)

TT=1800.03

? (problem)

TT=8.67

? (TO)

TT=1800.05

? (problem)

TT=8.29

SAT (TO)
f=-766
TT=1800.14
T1=19.87
SAT (TO)
f=-19296
TT=1800.12
T1=137.87
? (TO)

TT=1800.11

SAT
f=-10819
TT=1783.04
T1=1783.35
SAT (TO)
f=-31135
TT=1800.71
T1=4.15
SAT
f=-766
TT=1798.02
T1=18.66
SAT (TO)
f=-28162
TT=1800.02
T1=119.85
?

TT=1794.25

No data? (TO)

TT=1800.2

SAT (TO)
f=-49
TT=1800.08
T1=649.54
?

TT=1789.95

No dataSAT (TO)
f=-49
TT=1800.06
T1=682.32
?

TT=1796.91

No Cert.

TT=1800.03

? (TO)

TT=1800.02

? (TO)

TT=1800.02

No dataNo dataNo dataSAT (TO)
f=-23093
TT=1800.52
T1=900.41
No dataNo dataSAT (TO)
f=-18460
TT=1800.08
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-25504
TT=1800.06
T1=907.99
SAT (TO)
f=-27017
TT=1800.04
T1=942
SAT (TO)
f=-28145
TT=1800.03
T1=1566.65
?

TT=1797.16

?

TT=1797.02

?

TT=1797.14

? (TO)

TT=1800.01

? (TO)

TT=1800.02

?

TT=1799.56

No dataNo data?

TT=1799.48

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_20null10mast_rapportOE2.0_TMAX180_K67_cod2.opb
SAT
f=-22783
TT=1800.04
T1=1365.82
SAT
f=-18993
TT=1798.01
T1=1745.34
No data? (TO)

TT=1800

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (problem)

TT=8.07

? (TO)

TT=1800.07

? (problem)

TT=8.15

? (TO)

TT=1800.07

? (problem)

TT=8.43

SAT (TO)
f=-627
TT=1800.12
T1=19.51
SAT (TO)
f=-18107
TT=1800.05
T1=1159.44
? (TO)

TT=1800.14

SAT
f=-13609
TT=1783.02
T1=1783.35
SAT (TO)
f=-17694
TT=1800.31
T1=31.07
SAT
f=-17976
TT=1798.03
T1=410.45
SAT (TO)
f=-22783
TT=1800.04
T1=1365.82
?

TT=1794.07

No data? (TO)

TT=1800.25

SAT (TO)
f=-8
TT=1800.05
T1=149.14
?

TT=1790.02

No dataSAT (TO)
f=-8
TT=1800.16
T1=152.38
?

TT=1797.02

No Cert.

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.06

No dataNo dataNo dataSAT (TO)
f=-9024
TT=1800.17
T1=900.41
No dataNo data? (TO)

TT=1800.57

No dataNo dataNo dataSAT (TO)
f=-10975
TT=1800.48
T1=845.72
SAT (TO)
f=-13277
TT=1800.08
T1=1541.81
SAT (TO)
f=-19644
TT=1800.59
T1=1056.63
?

TT=1797.31

?

TT=1797.11

?

TT=1797.19

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.6

No dataNo data?

TT=1799.96

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_50null0mast_rapportOE1.0_TMAX180_K67_cod2.opb
SAT
f=-33662
TT=1800.03
T1=7.41
SAT
f=-965
TT=1798.04
T1=19.69
No data? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (problem)

TT=6.38

? (TO)

TT=1800.05

? (problem)

TT=6.69

? (TO)

TT=1800.05

? (problem)

TT=6.73

SAT (TO)
f=-965
TT=1800.1
T1=20.11
SAT (TO)
f=-25971
TT=1800.13
T1=172.88
? (TO)

TT=1720.52

SAT
f=-24940
TT=1783.02
T1=1783.34
SAT (TO)
f=-33662
TT=1800.03
T1=7.41
SAT
f=-965
TT=1798.06
T1=20.62
SAT (TO)
f=-25830
TT=1800.7
T1=718.07
?

TT=1793.9

No data? (TO)

TT=1800.08

SAT (TO)
f=-8
TT=1800.77
T1=847.05
?

TT=1790.23

No dataSAT (TO)
f=-8
TT=1800.51
T1=883.15
?

TT=1797.1

No Cert.

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=-23165
TT=1800.08
T1=900.41
No dataNo dataSAT (TO)
f=-20114
TT=1800.47
T1=900.41
No dataNo dataNo dataSAT (TO)
f=-26982
TT=1800.37
T1=922.22
SAT (TO)
f=-31366
TT=1800.04
T1=1433.7
SAT (TO)
f=-32151
TT=1800.09
T1=547.93
?

TT=1797.05

?

TT=1797.17

?

TT=1796.88

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1799.96

No dataNo data?

TT=1799.99

/OPT-SMALLINT-LIN/sroussel/BA/
normalized-BA_RDC4.dot_unif_50null50mast_rapportOE2.0_TMAX15_K67_cod1.opb
OPT
f=0
TT=1.815
T1=0.22
SAT (TO)
f=0
TT=1800.12
T1=285.84
No dataOPT
f=0
TT=1.815
T1=0.22
? (TO)

TT=1800.12

? (problem)

TT=1.764

? (problem)

TT=743.65

? (problem)

TT=1.71

? (problem)

TT=695

? (problem)

TT=1.67

? (problem)

TT=740.46

? (problem)

TT=1.62

OPT
f=0
TT=1274.93
T1=116.05
Signal

TT=2.376

? (TO)

TT=1800.08

OPT
f=0
TT=1542.27
T1=69.59
OPT
f=0
TT=183.791
T1=8.16
OPT
f=0
TT=1037.52
T1=247.97
SAT (TO)
f=0
TT=1800.07
T1=42.59
? (TO)

TT=1802.07

No dataOPT
f=0
TT=195.523
T1=193.73
SAT (TO)
f=0
TT=1800.76
T1=114.43
?

TT=1790.58

No dataOPT
f=0
TT=860.192
T1=8.42
OPT
f=0
TT=1439.27
T1=1223.94
No Cert.

TT=1800.11

? (TO)

TT=1800.11

OPT
f=0
TT=1704.31
T1=829.6
No dataNo dataNo dataOPT
f=0
TT=1560.36
T1=780.49
No dataNo dataSAT (TO)
f=0
TT=1800.02
T1=900.41
No dataNo dataNo dataOPT
f=0
TT=410.762
T1=12.79
OPT
f=0
TT=109.748
T1=32.31
OPT
f=0
TT=22.962
T1=4.34
OPT
f=0
TT=1089.41
T1=1046.16
OPT
f=0
TT=1039.66
T1=996.74
OPT
f=0
TT=1042.34
T1=999.42
? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.62

No dataNo data?

TT=1799.76

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_50null0mast_rapportOE2.0_TMAX120_K192_cod2.opb
SAT
f=-1995
TT=1801.02
T1=597.82
?

TT=1798.51

No data? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.09

Signal

TT=34.417

? (TO)

TT=1679.11

SAT
f=0
TT=1783.1
T1=502.76
SAT (TO)
f=-1995
TT=1801.02
T1=597.82
?

TT=1798.05

? (TO)

TT=1800.57

? (TO)

TT=1802.2

No data? (TO)

TT=1800.1

? (TO)

TT=1800.18

?

TT=1792.93

No data? (TO)

TT=1800.04

? (TO)

TT=1802.3

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.17

No dataNo data? (TO)

TT=1800.65

No dataNo dataNo data? (TO)

TT=1800.1

? (TO)

TT=1800.09

SAT (TO)
f=-5779
TT=1800.33
T1=533.17
? (TO)

TT=1802.07

? (TO)

TT=1802.1

? (TO)

TT=1802.13

? (TO)

TT=1800.02

? (TO)

TT=1800.11

?

TT=1799.62

No dataNo data?

TT=1800.07

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_fibo_50null50mast_rapportOE2.0_TMAX120_K192_cod2.opb
SAT
f=-6736
TT=1801.43
T1=195.39
?

TT=1798.14

No data? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.11

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.08

Signal

TT=34.504

? (TO)

TT=1650.7

SAT
f=0
TT=1783.1
T1=504.77
SAT (TO)
f=-6736
TT=1801.43
T1=195.39
?

TT=1798.3

? (TO)

TT=1800.09

? (TO)

TT=1802.29

No data? (TO)

TT=1800.09

SAT (TO)
f=0
TT=1801.13
T1=11.78
?

TT=1799.54

No dataSAT (TO)
f=0
TT=1800.53
T1=11.64
? (TO)

TT=1802.26

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.04

No dataNo data? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.39
T1=12.4
? (TO)

TT=1800.58

SAT (TO)
f=-9262
TT=1800.39
T1=846.12
? (TO)

TT=1802.11

? (TO)

TT=1802.13

? (TO)

TT=1802.2

? (TO)

TT=1800.01

? (TO)

TT=1800.09

?

TT=1799.67

No dataNo data?

TT=1799.68

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null0mast_rapportOE1.0_TMAX60_K192_cod2.opb
SAT
f=0
TT=1783.1
T1=503.3
?

TT=1798.22

No data? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.11

? (TO)

TT=1800.08

? (TO)

TT=1800.08

Signal

TT=69.074

? (TO)

TT=1648.2

SAT
f=0
TT=1783.1
T1=503.3
? (TO)

TT=1800.09

?

TT=1798.75

? (TO)

TT=1800.56

? (TO)

TT=1802.27

No data? (exit code)

TT=1213.36

? (TO)

TT=1800.15

?

TT=1796.89

No data? (TO)

TT=1800.17

? (TO)

TT=1802.19

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.02

? (TO)

TT=1800.07

SAT (TO)
f=-123
TT=1800.32
T1=1205.58
? (TO)

TT=1802.17

? (TO)

TT=1802.16

? (TO)

TT=1802.17

? (TO)

TT=1800.11

? (TO)

TT=1800.01

?

TT=1800.06

No dataNo data?

TT=1799.96

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX15_K192_cod2.opb
SAT
f=-4
TT=1801.44
T1=102.23
?

TT=1798.3

No data? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.1

Signal

TT=34.718

? (TO)

TT=1521.65

SAT
f=0
TT=1783.09
T1=533.01
SAT (TO)
f=-1
TT=1801.85
T1=1005.15
?

TT=1798.2

? (TO)

TT=1800.09

? (TO)

TT=1802.3

No data? (TO)

TT=1800.2

SAT (TO)
f=0
TT=1801.07
T1=11.94
?

TT=1792.02

No dataSAT (TO)
f=0
TT=1800.55
T1=11.37
? (TO)

TT=1802.26

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo data? (TO)

TT=1800.48

No dataNo data? (TO)

TT=1800.63

No dataNo dataNo dataSAT (TO)
f=-4
TT=1801.44
T1=102.23
? (TO)

TT=1800.4

SAT (TO)
f=-1024
TT=1800.39
T1=719.66
? (TO)

TT=1802.12

? (TO)

TT=1802.07

? (TO)

TT=1802.11

? (TO)

TT=1800.11

? (TO)

TT=1800.11

? (TO)

TT=1800.44

No dataNo data?

TT=1799.66

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE1.0_TMAX300_K192_cod2.opb
SAT
f=-15627
TT=1800.32
T1=898.82
SAT
f=-7387
TT=1798.38
T1=957.15
No data? (TO)

TT=1800.08

? (problem)

TT=40.192

? (TO)

TT=1800.09

? (problem)

TT=40.7

? (TO)

TT=1800.04

? (problem)

TT=39.75

? (TO)

TT=1800.09

? (problem)

TT=40.44

? (TO)

TT=1800.05

SAT (TO)
f=0
TT=1800.17
T1=185.51
Signal

TT=34.448

? (TO)

TT=1562.56

SAT
f=-4276
TT=1783.09
T1=1783.35
SAT (TO)
f=-5258
TT=1800.85
T1=565.42
SAT
f=-1172
TT=1798.64
T1=448.9
SAT (TO)
f=-15627
TT=1800.32
T1=898.82
? (TO)

TT=1802.15

No data? (exit code)

TT=1227.25

SAT (TO)
f=-1
TT=1800.41
T1=56.12
? (TO)

TT=1802.12

No dataSAT (TO)
f=-1
TT=1800.49
T1=54.3
? (TO)

TT=1802.19

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.09

No dataNo data? (TO)

TT=1800.16

No dataNo dataNo dataSAT (TO)
f=-1
TT=1801.09
T1=53.13
? (TO)

TT=1800.1

SAT (TO)
f=-25886
TT=1800.38
T1=130.75
? (TO)

TT=1802.17

? (TO)

TT=1802.06

? (TO)

TT=1802.15

? (TO)

TT=1800.02

? (TO)

TT=1800.03

?

TT=1799.76

No dataNo data?

TT=1799.48

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null10mast_rapportOE2.0_TMAX180_K192_cod2.opb
SAT
f=-3088
TT=1800.85
T1=247.85
? (TO)

TT=1800.09

No data? (TO)

TT=1800

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800.06

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.03

Signal

TT=36.079

? (TO)

TT=1508.66

SAT
f=0
TT=1783.1
T1=508.28
SAT (TO)
f=-3088
TT=1800.85
T1=247.85
?

TT=1798.36

? (TO)

TT=1800.74

? (TO)

TT=1802.19

No data? (exit code)

TT=1516.24

SAT (TO)
f=-1
TT=1800.44
T1=22.04
? (TO)

TT=1802.12

No dataSAT (TO)
f=-1
TT=1800.4
T1=21.53
? (TO)

TT=1802.2

No Cert.

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.15

No dataNo dataNo dataSAT (TO)
f=-2
TT=1800.52
T1=197.01
? (TO)

TT=1800.95

SAT (TO)
f=-15366
TT=1800.35
T1=483.87
? (TO)

TT=1802.2

? (TO)

TT=1802.2

? (TO)

TT=1802.07

? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1800

No dataNo data?

TT=1799.64

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX180_K192_cod2.opb
OPT
f=-36224
TT=989.98
T1=808.67
? (TO)

TT=1800.09

No data? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.05

Signal

TT=34.638

? (TO)

TT=1710.67

? (TO)

TT=1800.05

SAT (TO)
f=-23552
TT=1800.84
T1=738.84
?

TT=1798.51

SAT (TO)
f=0
TT=1800.37
T1=19.09
? (TO)

TT=1802.29

No dataOPT
f=-36224
TT=989.98
T1=808.67
SAT (TO)
f=0
TT=1800.82
T1=12.62
? (TO)

TT=1800.15

No dataSAT (TO)
f=0
TT=1800.38
T1=11.75
? (TO)

TT=1802.2

? (TO)

TT=1800.02

? (TO)

TT=1800.08

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.56

No dataNo data? (TO)

TT=1800.16

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.91
T1=12.53
? (TO)

TT=1800.03

SAT (TO)
f=-28673
TT=1800.88
T1=900.52
? (TO)

TT=1802.07

? (TO)

TT=1802.21

? (TO)

TT=1802.14

? (TO)

TT=1800.09

? (TO)

TT=1800.12

?

TT=1799.99

No dataNo data?

TT=1800.02

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
OPT
f=-60544
TT=1010.68
T1=829.59
SAT
f=-12361
TT=1798.36
T1=201.86
No data? (TO)

TT=1800.06

? (problem)

TT=33.781

? (TO)

TT=1800.03

? (problem)

TT=32.82

? (TO)

TT=1800.05

? (problem)

TT=32.47

? (TO)

TT=1800.06

? (problem)

TT=31.52

? (TO)

TT=1800.04

SAT (TO)
f=0
TT=1800.16
T1=187.67
Signal

TT=34.256

? (TO)

TT=1690.66

SAT
f=-9299
TT=1783.09
T1=1783.47
SAT (TO)
f=-45344
TT=1801.44
T1=108.93
SAT
f=-12361
TT=1798.08
T1=202.05
SAT (TO)
f=-34272
TT=1800.91
T1=950.99
? (TO)

TT=1802.16

No dataOPT
f=-60544
TT=1010.68
T1=829.59
SAT (TO)
f=0
TT=1800.36
T1=12.14
? (TO)

TT=1800.14

No dataSAT (TO)
f=0
TT=1800.41
T1=11.43
? (TO)

TT=1802.31

? (TO)

TT=1800.02

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.19

No dataNo data? (TO)

TT=1800.18

No dataNo dataNo dataSAT (TO)
f=0
TT=1801.01
T1=12.9
? (TO)

TT=1800.06

SAT (TO)
f=-27887
TT=1800.8
T1=104.65
? (TO)

TT=1802.22

? (TO)

TT=1800.15

? (TO)

TT=1802.11

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.93

No dataNo data?

TT=1800.04

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_10null20mast_rapportOE1.0_TMAX60_K192_cod2.opb
OPT
f=-11680
TT=1314.51
T1=1052.31
? (TO)

TT=1800.1

No data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.1

Signal

TT=34.467

? (TO)

TT=1708.48

SAT
f=0
TT=1783.1
T1=540.26
SAT (TO)
f=0
TT=1800.89
T1=142.89
?

TT=1798.28

? (TO)

TT=1800.77

? (TO)

TT=1802.38

No dataOPT
f=-11680
TT=1314.51
T1=1052.31
? (TO)

TT=1800.03

?

TT=1799.18

No data? (TO)

TT=1800.06

? (TO)

TT=1802.2

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.12

No dataNo data? (TO)

TT=1800.47

No dataNo dataNo data? (TO)

TT=1800.38

SAT (TO)
f=0
TT=1800.32
T1=888.21
SAT (TO)
f=-11392
TT=1800.33
T1=1563.14
? (TO)

TT=1802.14

? (TO)

TT=1802.19

? (TO)

TT=1802.05

? (TO)

TT=1800.03

? (TO)

TT=1800.09

?

TT=1799.99

No dataNo data?

TT=1799.65

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null0mast_rapportOE2.0_TMAX300_K192_cod2.opb
SAT
f=-451
TT=1800.75
T1=962.19
SAT
f=-153
TT=1798.14
T1=195.72
No data? (TO)

TT=1800.09

? (problem)

TT=34.571

? (TO)

TT=1800.02

? (problem)

TT=33.55

? (TO)

TT=1800.08

? (problem)

TT=33.91

? (TO)

TT=1800.03

? (problem)

TT=32.76

? (TO)

TT=1800.05

SAT (TO)
f=0
TT=1800.14
T1=186.55
Signal

TT=34.207

? (TO)

TT=1710.62

SAT
f=-76
TT=1783.12
T1=1783.4
SAT (TO)
f=-451
TT=1800.75
T1=962.19
SAT
f=-153
TT=1798.1
T1=196.02
SAT (TO)
f=-42
TT=1801.04
T1=339.7
? (TO)

TT=1802.18

No dataNo Cert.

TT=1800.01

? (TO)

TT=1800.7

?

TT=1792.44

No data? (TO)

TT=1800.2

? (TO)

TT=1802.28

No Cert.

TT=1800.07

? (TO)

TT=1800.03

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.56

No dataNo data? (TO)

TT=1800.46

No dataNo dataNo data? (TO)

TT=1800.54

? (TO)

TT=1800

SAT (TO)
f=-339
TT=1800.34
T1=1038.4
? (TO)

TT=1802.06

? (TO)

TT=1802.22

? (TO)

TT=1802.08

? (TO)

TT=1800.02

? (TO)

TT=1800.12

?

TT=1799.92

No dataNo data?

TT=1799.96

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null10mast_rapportOE1.0_TMAX180_K192_cod2.opb
OPT
f=-36160
TT=746.157
T1=565.04
SAT
f=-5242
TT=1798.16
T1=210.02
No data? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.02

Signal

TT=34.487

? (TO)

TT=1674.38

SAT
f=0
TT=1783.13
T1=503.46
SAT (TO)
f=-1024
TT=1800.96
T1=1223.45
SAT
f=-6275
TT=1798.58
T1=207.64
SAT (TO)
f=0
TT=1800.93
T1=17.47
? (TO)

TT=1802.29

No dataOPT
f=-36160
TT=746.157
T1=565.04
SAT (TO)
f=0
TT=1801.24
T1=11.87
? (TO)

TT=1802.03

No dataSAT (TO)
f=0
TT=1800.49
T1=11.65
? (TO)

TT=1802.22

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.47

No dataNo data? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=0
TT=1801
T1=12.53
? (TO)

TT=1800.9

SAT (TO)
f=-35843
TT=1800.35
T1=1162.6
? (TO)

TT=1802.07

? (TO)

TT=1802.11

? (TO)

TT=1802.19

? (TO)

TT=1800.08

? (TO)

TT=1800.1

?

TT=1799.67

No dataNo data?

TT=1799.65

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_20null50mast_rapportOE1.0_TMAX15_K192_cod2.opb
SAT
f=-1051
TT=1800.29
T1=901.81
?

TT=1798.71

No data? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.05

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.06

? (TO)

TT=1800

? (TO)

TT=1800

? (TO)

TT=1800.1

Signal

TT=34.289

? (TO)

TT=1470.03

SAT
f=0
TT=1783.1
T1=500.59
SAT (TO)
f=-1024
TT=1800.94
T1=1013.47
?

TT=1798.51

? (TO)

TT=1800.72

? (TO)

TT=1802.18

No data? (TO)

TT=1800.01

SAT (TO)
f=0
TT=1800.51
T1=12.19
? (TO)

TT=1800.12

No dataSAT (TO)
f=0
TT=1800.56
T1=11.7
? (TO)

TT=1802.17

? (TO)

TT=1800.03

? (TO)

TT=1800.09

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.59

No dataNo dataSAT (TO)
f=-1051
TT=1800.29
T1=901.81
No dataNo dataNo dataSAT (TO)
f=0
TT=1800.42
T1=12.68
? (TO)

TT=1800.32

SAT (TO)
f=-1033
TT=1800.33
T1=1780.25
? (TO)

TT=1802.06

? (TO)

TT=1802.17

? (TO)

TT=1802.19

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1800.01

No dataNo data?

TT=1799.74

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null0mast_rapportOE1.0_TMAX15_K192_cod2.opb
OPT
f=-432
TT=780.628
T1=599.32
?

TT=1798.75

No data? (TO)

TT=1800.05

? (TO)

TT=1800.06

? (TO)

TT=1800.08

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.03

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.1

Signal

TT=34.434

? (TO)

TT=1635.3

SAT
f=-34
TT=1783.18
T1=1783.45
? (TO)

TT=1800.03

?

TT=1798.01

? (TO)

TT=1800.38

? (TO)

TT=1802.31

No dataOPT
f=-432
TT=780.628
T1=599.32
? (TO)

TT=1800.05

? (TO)

TT=1802.12

No data? (TO)

TT=1800.19

? (TO)

TT=1802.26

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.46

No dataNo data? (TO)

TT=1800.19

No dataNo dataNo dataSAT (TO)
f=-1
TT=1800.58
T1=362.61
? (TO)

TT=1800.5

SAT (TO)
f=-72
TT=1800.32
T1=1540.91
? (TO)

TT=1802.06

? (TO)

TT=1802.16

? (TO)

TT=1802.12

? (TO)

TT=1800.02

? (TO)

TT=1800.09

?

TT=1800.02

No dataNo data?

TT=1799.69

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null20mast_rapportOE2.0_TMAX60_K192_cod2.opb
OPT
f=-5280
TT=1781.2
T1=1599.93
? (TO)

TT=1800.08

No data? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.1

Signal

TT=34.465

? (TO)

TT=1393.63

SAT
f=0
TT=1783.09
T1=502.13
SAT (TO)
f=-1168
TT=1801.09
T1=23.29
?

TT=1798.24

? (TO)

TT=1800.82

? (TO)

TT=1802.3

No dataOPT
f=-5280
TT=1781.2
T1=1599.93
SAT (TO)
f=0
TT=1800.52
T1=11.48
? (TO)

TT=1800.11

No dataSAT (TO)
f=0
TT=1800.57
T1=12.32
? (TO)

TT=1802.19

? (TO)

TT=1800.07

? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.51

No dataNo data? (TO)

TT=1800.55

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.38
T1=12.43
? (TO)

TT=1800.57

SAT (TO)
f=-5126
TT=1800.34
T1=1486.37
? (TO)

TT=1802.19

? (TO)

TT=1802.15

? (TO)

TT=1802.2

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1800.04

No dataNo data?

TT=1799.68

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null50mast_rapportOE1.0_TMAX180_K192_cod2.opb
SAT
f=-12288
TT=1800.71
T1=738.41
?

TT=1798.5

No data? (TO)

TT=1800.09

? (TO)

TT=1800

? (TO)

TT=1800.01

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.05

Signal

TT=34.147

? (TO)

TT=1443.06

SAT
f=0
TT=1783.11
T1=503.7
SAT (TO)
f=-12288
TT=1800.71
T1=738.41
?

TT=1798.59

? (TO)

TT=1800.67

? (TO)

TT=1802.19

No dataNo Cert.

TT=1800.01

SAT (TO)
f=0
TT=1800.44
T1=13.28
?

TT=1799.84

No dataSAT (TO)
f=0
TT=1800.55
T1=12.04
? (TO)

TT=1802.29

? (TO)

TT=1800.08

? (TO)

TT=1800.06

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.52

No dataNo data? (TO)

TT=1800.5

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.47
T1=13.72
? (TO)

TT=1800.04

SAT (TO)
f=-32768
TT=1800.31
T1=155.64
? (TO)

TT=1802.06

? (TO)

TT=1802.17

? (TO)

TT=1802.13

? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1800.05

No dataNo data?

TT=1799.66

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null50mast_rapportOE1.0_TMAX300_K192_cod2.opb
OPT
f=-1888
TT=1146.44
T1=965.51
SAT
f=-704
TT=1798.49
T1=194.86
No data? (TO)

TT=1800.06

? (problem)

TT=39.091

? (TO)

TT=1800.08

? (problem)

TT=38.67

? (TO)

TT=1800.08

? (problem)

TT=38.6

? (TO)

TT=1800.04

? (problem)

TT=41.67

? (TO)

TT=1800.08

SAT (TO)
f=0
TT=1800.11
T1=186.5
Signal

TT=34.515

? (TO)

TT=1458.32

SAT
f=-768
TT=1783.14
T1=1783.4
SAT (TO)
f=-992
TT=1801.13
T1=553.3
SAT
f=-704
TT=1798.15
T1=194.8
SAT (TO)
f=-1760
TT=1800.34
T1=56.22
? (TO)

TT=1802.19

No dataOPT
f=-1888
TT=1146.44
T1=965.51
SAT (TO)
f=-1
TT=1800.54
T1=311.3
?

TT=1799.77

No dataSAT (TO)
f=-1
TT=1800.46
T1=328.84
? (TO)

TT=1802.28

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.55

No dataNo data? (TO)

TT=1800.18

No dataNo dataNo dataSAT (TO)
f=-32
TT=1801.06
T1=450.97
? (TO)

TT=1800.44

SAT (TO)
f=-1696
TT=1800.93
T1=21.48
? (TO)

TT=1802.16

? (TO)

TT=1802.14

? (TO)

TT=1802.14

? (TO)

TT=1800.11

? (TO)

TT=1800.09

?

TT=1800.08

No dataNo data?

TT=1799.95

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_luby_50null50mast_rapportOE2.0_TMAX120_K192_cod2.opb
SAT
f=-8192
TT=1800.93
T1=20.71
?

TT=1798.53

No data? (TO)

TT=1800.09

? (TO)

TT=1800.01

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.1

Signal

TT=34.481

? (TO)

TT=1637.03

SAT
f=0
TT=1783.12
T1=541.79
SAT (TO)
f=-6144
TT=1801.04
T1=100.84
?

TT=1798.1

SAT (TO)
f=-8192
TT=1800.93
T1=20.71
? (TO)

TT=1802.31

No dataNo Cert.

TT=1800.09

SAT (TO)
f=0
TT=1800.52
T1=12.65
?

TT=1799.44

No dataSAT (TO)
f=0
TT=1800.43
T1=12.49
? (TO)

TT=1802.27

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.02

No dataNo data? (TO)

TT=1800.1

No dataNo dataNo dataSAT (TO)
f=0
TT=1801.06
T1=13.31
? (TO)

TT=1800.02

SAT (TO)
f=-9216
TT=1800.38
T1=298.14
? (TO)

TT=1802.12

? (TO)

TT=1802.18

? (TO)

TT=1802.14

? (TO)

TT=1800.02

? (TO)

TT=1800.11

?

TT=1800.2

No dataNo data?

TT=1799.69

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_0null10mast_rapportOE1.0_TMAX60_K192_cod2.opb
OPT
f=-45746
TT=1633.63
T1=1452.73
?

TT=1798.67

No data? (TO)

TT=1800

? (TO)

TT=1800.06

? (TO)

TT=1800.03

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.1

? (TO)

TT=1800.07

? (TO)

TT=1800.01

? (TO)

TT=1800.08

Signal

TT=34.206

? (TO)

TT=1044.14

SAT
f=0
TT=1783.09
T1=501.79
SAT (TO)
f=-5202
TT=1801.43
T1=1265.39
?

TT=1798.15

? (TO)

TT=1800.05

? (TO)

TT=1802.19

No dataOPT
f=-45746
TT=1633.63
T1=1452.73
SAT (TO)
f=0
TT=1800.37
T1=11.85
? (TO)

TT=1802.04

No dataSAT (TO)
f=0
TT=1800.53
T1=11.74
? (TO)

TT=1802.29

? (TO)

TT=1800.02

? (TO)

TT=1800.13

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.08

No dataNo data? (TO)

TT=1800.62

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.34
T1=12.65
? (TO)

TT=1800.07

SAT (TO)
f=-12112
TT=1800.85
T1=1632.22
? (TO)

TT=1802.06

? (TO)

TT=1802.2

? (TO)

TT=1802.09

? (TO)

TT=1800.1

? (TO)

TT=1800.11

?

TT=1799.83

No dataNo data? (TO)

TT=1800.15

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_10null0mast_rapportOE2.0_TMAX15_K192_cod2.opb
OPT
f=-11801
TT=626.328
T1=445.19
?

TT=1798.18

No data? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.06

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.05

? (TO)

TT=1800.03

? (TO)

TT=1800.01

? (TO)

TT=1800.11

Signal

TT=35.029

? (TO)

TT=1442.8

SAT
f=0
TT=1783.16
T1=502.73
SAT (TO)
f=-264
TT=1800.91
T1=1474.93
?

TT=1798.11

? (TO)

TT=1800.03

? (TO)

TT=1802.31

No dataOPT
f=-11801
TT=626.328
T1=445.19
? (TO)

TT=1800.83

?

TT=1797.23

No data? (TO)

TT=1800.19

? (TO)

TT=1802.18

? (TO)

TT=1800.08

? (TO)

TT=1800.13

? (TO)

TT=1800

No dataNo dataNo data? (TO)

TT=1800.01

No dataNo data? (TO)

TT=1800.18

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.94
T1=277.81
SAT (TO)
f=-716
TT=1800.88
T1=1626.46
SAT (TO)
f=-929
TT=1800.27
T1=1413.37
? (TO)

TT=1802.06

? (TO)

TT=1802.14

? (TO)

TT=1802.08

? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.44

No dataNo data?

TT=1799.64

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_10null20mast_rapportOE1.0_TMAX300_K192_cod2.opb
SAT
f=-98026
TT=1800.85
T1=466.06
SAT
f=-20270
TT=1798.26
T1=672.54
No data? (TO)

TT=1800.08

? (problem)

TT=33.771

? (TO)

TT=1800.09

? (problem)

TT=33.18

? (TO)

TT=1800.04

? (problem)

TT=34.02

? (TO)

TT=1800.06

? (problem)

TT=33.9

? (TO)

TT=1800.02

SAT (TO)
f=0
TT=1800.18
T1=187.91
Signal

TT=34.322

? (TO)

TT=1517.72

Signal

TT=1597.48

SAT (TO)
f=-98026
TT=1800.85
T1=466.06
SAT
f=-20270
TT=1798.53
T1=388.63
SAT (TO)
f=-34476
TT=1800.37
T1=1164.82
? (TO)

TT=1802.3

No data?

TT=1800.06

SAT (TO)
f=0
TT=1801.42
T1=12
?

TT=1792.66

No dataSAT (TO)
f=0
TT=1800.49
T1=12.25
? (TO)

TT=1802.27

? (TO)

TT=1800.1

? (TO)

TT=1800.11

? (TO)

TT=1800.04

No dataNo dataNo data? (TO)

TT=1800.14

No dataNo data? (TO)

TT=1800.6

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.86
T1=11.89
? (TO)

TT=1800.05

SAT (TO)
f=-63672
TT=1800.31
T1=508.42
? (TO)

TT=1802.15

? (TO)

TT=1802.12

? (TO)

TT=1802.13

? (TO)

TT=1800.03

? (TO)

TT=1800.11

?

TT=1799.67

No dataNo data?

TT=1799.69

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_10null20mast_rapportOE2.0_TMAX60_K192_cod2.opb
SAT
f=0
TT=1783.09
T1=11.57
?

TT=1798.08

No data? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.01

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.07

? (TO)

TT=1800.02

? (TO)

TT=1800.05

Signal

TT=34.465

? (TO)

TT=1721.69

SAT
f=0
TT=1783.09
T1=502
SAT (TO)
f=0
TT=1800.91
T1=16.49
?

TT=1798.21

? (TO)

TT=1800.08

? (TO)

TT=1802.3

No dataNo Cert.

TT=1800

SAT (TO)
f=0
TT=1800.45
T1=11.92
? (TO)

TT=1802.08

No dataSAT (TO)
f=0
TT=1800.53
T1=11.57
? (TO)

TT=1802.2

? (TO)

TT=1800.01

? (TO)

TT=1800.11

? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.62

No dataNo data? (TO)

TT=1800.05

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.41
T1=11.9
? (TO)

TT=1800.42

SAT (TO)
f=-4162
TT=1800.35
T1=968.5
? (TO)

TT=1802.08

? (TO)

TT=1802.16

? (TO)

TT=1802.13

? (TO)

TT=1800.1

? (TO)

TT=1800.02

? (TO)

TT=1800.16

No dataNo data? (TO)

TT=1800.13

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null0mast_rapportOE1.0_TMAX300_K192_cod2.opb
SAT
f=-78535
TT=1800.71
T1=1663.48
SAT
f=-13217
TT=1799.5
T1=732.06
No data? (TO)

TT=1800.08

? (problem)

TT=83.275

? (TO)

TT=1800.05

? (problem)

TT=66.7

? (TO)

TT=1800.06

? (problem)

TT=67.08

? (TO)

TT=1800

? (problem)

TT=68.8

? (TO)

TT=1800.1

SAT (TO)
f=-12751
TT=1800.16
T1=187.07
Signal

TT=34.505

? (TO)

TT=1523.31

SAT
f=-23283
TT=1783.12
T1=1783.4
SAT (TO)
f=-78535
TT=1800.71
T1=1663.48
SAT
f=-16079
TT=1798.12
T1=345.53
SAT (TO)
f=-12808
TT=1800.32
T1=1209.31
? (TO)

TT=1802.18

No data? (TO)

TT=1800.01

SAT (TO)
f=-3
TT=1800.42
T1=828.47
?

TT=1792.06

No dataSAT (TO)
f=-3
TT=1800.42
T1=834.48
? (TO)

TT=1802.19

? (TO)

TT=1800.04

? (TO)

TT=1800.01

? (TO)

TT=1800.08

No dataNo dataNo dataSAT (TO)
f=-48992
TT=1800.26
T1=902.11
No dataNo data? (TO)

TT=1800.07

No dataNo dataNo dataSAT (TO)
f=-3
TT=1800.49
T1=784.6
? (TO)

TT=1800.02

SAT (TO)
f=-68173
TT=1800.79
T1=318.91
? (TO)

TT=1802.07

? (TO)

TT=1802.16

? (TO)

TT=1802.1

? (TO)

TT=1800.11

? (TO)

TT=1800.02

?

TT=1800.1

No dataNo data? (TO)

TT=1800.34

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null0mast_rapportOE2.0_TMAX180_K192_cod2.opb
SAT
f=-21805
TT=1800.77
T1=392.57
SAT
f=-5602
TT=1798.18
T1=209.6
No data? (TO)

TT=1800.08

? (TO)

TT=1800.05

? (TO)

TT=1800.09

? (TO)

TT=1800

? (TO)

TT=1800.01

? (TO)

TT=1800.06

? (TO)

TT=1800.01

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.06

Signal

TT=34.238

? (TO)

TT=1679.46

SAT
f=0
TT=1787.32
T1=532.17
SAT (TO)
f=-21805
TT=1800.77
T1=392.57
SAT
f=-13525
TT=1799.87
T1=208.13
? (TO)

TT=1800.54

? (TO)

TT=1802.18

No dataNo Cert.

TT=1800.01

SAT (TO)
f=0
TT=1800.55
T1=10.65
?

TT=1793.13

No dataSAT (TO)
f=0
TT=1800.58
T1=9.92
? (TO)

TT=1802.2

? (TO)

TT=1800.01

? (TO)

TT=1800.09

? (TO)

TT=1800.07

No dataNo dataNo data? (TO)

TT=1800.18

No dataNo data? (TO)

TT=1800.49

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.94
T1=10.35
? (TO)

TT=1800.02

SAT (TO)
f=-25484
TT=1800.39
T1=176.23
? (TO)

TT=1802.08

? (TO)

TT=1802.2

? (TO)

TT=1802.21

? (TO)

TT=1800.1

? (TO)

TT=1800.1

?

TT=1800.31

No dataNo data?

TT=1799.64

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null20mast_rapportOE1.0_TMAX120_K192_cod2.opb
SAT
f=0
TT=1783.1
T1=11.44
?

TT=1798.01

No data? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.08

? (TO)

TT=1800

? (TO)

TT=1800.09

? (TO)

TT=1800.09

? (TO)

TT=1800.03

? (TO)

TT=1800.06

? (TO)

TT=1800.09

Signal

TT=34.729

? (TO)

TT=1754.84

SAT
f=0
TT=1783.1
T1=505.05
? (TO)

TT=1800.02

?

TT=1798.76

SAT (TO)
f=0
TT=1800.94
T1=16.64
? (TO)

TT=1802.15

No dataNo Cert.

TT=1800.01

SAT (TO)
f=0
TT=1800.48
T1=12.55
?

TT=1793.45

No dataSAT (TO)
f=0
TT=1800.56
T1=11.44
? (TO)

TT=1802.3

? (TO)

TT=1800.09

? (TO)

TT=1800.02

? (TO)

TT=1800.05

No dataNo dataNo data? (TO)

TT=1800.2

No dataNo data? (TO)

TT=1800.51

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.57
T1=12.77
? (TO)

TT=1800.99

SAT (TO)
f=-18633
TT=1800.31
T1=685.53
? (TO)

TT=1802.16

? (TO)

TT=1802.19

? (TO)

TT=1802.29

? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (TO)

TT=1800.04

No dataNo data?

TT=1799.59

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX15_K192_cod2.opb
OPT
f=-10175
TT=591.962
T1=410.81
?

TT=1798.03

No data? (TO)

TT=1800.09

? (TO)

TT=1800.07

? (TO)

TT=1800.11

? (TO)

TT=1800.09

? (TO)

TT=1800.1

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.04

? (TO)

TT=1800.06

? (TO)

TT=1800.07

Signal

TT=34.823

? (TO)

TT=1636.37

SAT
f=0
TT=1783.09
T1=503.42
SAT (TO)
f=-2959
TT=1801.41
T1=1711.82
?

TT=1798.06

SAT (TO)
f=-378
TT=1800.94
T1=15.86
? (TO)

TT=1802.19

No dataOPT
f=-10175
TT=591.962
T1=410.81
SAT (TO)
f=-2957
TT=1800.57
T1=200.77
?

TT=1792.99

No dataSAT (TO)
f=0
TT=1800.42
T1=18.92
? (TO)

TT=1802.18

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.13

No dataNo dataNo data? (TO)

TT=1800.11

No dataNo data? (TO)

TT=1800.66

No dataNo dataNo dataSAT (TO)
f=-886
TT=1800.48
T1=85.86
SAT (TO)
f=-258
TT=1801.44
T1=184.63
SAT (TO)
f=-903
TT=1800.93
T1=1720.46
? (TO)

TT=1802.07

? (TO)

TT=1802.14

? (TO)

TT=1802.09

? (TO)

TT=1800.11

? (TO)

TT=1800.1

? (TO)

TT=1800.56

No dataNo data?

TT=1799.75

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null20mast_rapportOE2.0_TMAX300_K192_cod2.opb
SAT
f=-25980
TT=1801.09
T1=954.55
SAT
f=-12374
TT=1798.66
T1=191.07
No data? (TO)

TT=1800.08

? (problem)

TT=33.417

? (TO)

TT=1800.02

? (problem)

TT=30.96

? (TO)

TT=1800.07

? (problem)

TT=32.73

? (TO)

TT=1800.01

? (problem)

TT=32.77

? (TO)

TT=1800.07

SAT (TO)
f=0
TT=1800.15
T1=186.43
Signal

TT=34.288

? (TO)

TT=1718.5

SAT
f=-12717
TT=1783.09
T1=1783.42
SAT (TO)
f=-25980
TT=1801.09
T1=954.55
SAT
f=-12374
TT=1798.59
T1=191.49
SAT (TO)
f=-21404
TT=1800.37
T1=187.23
? (TO)

TT=1802.18

No data? (TO)

TT=1800.01

SAT (TO)
f=0
TT=1800.5
T1=12.44
?

TT=1792.62

No dataSAT (TO)
f=0
TT=1800.49
T1=11.25
? (TO)

TT=1802.23

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.09

No dataNo dataNo data? (TO)

TT=1800.54

No dataNo data? (TO)

TT=1800.14

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.89
T1=12.87
? (TO)

TT=1800.09

SAT (TO)
f=-40868
TT=1800.55
T1=296.45
? (TO)

TT=1802.19

? (TO)

TT=1802.1

? (TO)

TT=1802.15

? (TO)

TT=1800.1

? (TO)

TT=1800.08

?

TT=1799.97

No dataNo data?

TT=1799.79

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null0mast_rapportOE2.0_TMAX60_K192_cod2.opb
SAT
f=-9733
TT=1801.26
T1=1469.2
?

TT=1798.18

No data? (TO)

TT=1800.1

? (TO)

TT=1800.15

? (TO)

TT=1800.07

? (TO)

TT=1800.06

? (TO)

TT=1800.07

? (TO)

TT=1800.04

? (TO)

TT=1800.02

? (TO)

TT=1800.05

? (TO)

TT=1800.04

? (TO)

TT=1800.07

Signal

TT=34.431

? (TO)

TT=1476.12

SAT
f=0
TT=1783.08
T1=507.32
SAT (TO)
f=-9733
TT=1801.26
T1=1469.2
?

TT=1798.03

SAT (TO)
f=0
TT=1800.68
T1=17.89
? (TO)

TT=1802.18

No data? (exit code)

TT=1146.85

? (TO)

TT=1800.02

? (TO)

TT=1802.19

No data? (TO)

TT=1800.08

? (TO)

TT=1802.28

? (TO)

TT=1800.06

? (TO)

TT=1800.02

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.6

No dataNo data? (TO)

TT=1800.41

No dataNo dataNo data? (TO)

TT=1800.72

? (TO)

TT=1800.09

SAT (TO)
f=-6978
TT=1800.35
T1=339.18
? (TO)

TT=1802.16

? (TO)

TT=1802.17

? (TO)

TT=1802.15

? (TO)

TT=1800.12

? (TO)

TT=1800.02

? (TO)

TT=1800.06

No dataNo data? (TO)

TT=1800.48

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null20mast_rapportOE1.0_TMAX15_K192_cod2.opb
OPT
f=-11389
TT=619.196
T1=438.11
?

TT=1799.23

No data? (TO)

TT=1800.01

? (TO)

TT=1800.05

? (TO)

TT=1800.01

? (TO)

TT=1800.08

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.03

? (TO)

TT=1800.04

? (TO)

TT=1800.09

? (TO)

TT=1800.08

Signal

TT=36.219

? (TO)

TT=1599.41

SAT
f=0
TT=1783.09
T1=581.79
SAT (TO)
f=-1621
TT=1800.5
T1=1656.73
?

TT=1798.28

? (TO)

TT=1800.45

? (TO)

TT=1802.32

No dataOPT
f=-11389
TT=619.196
T1=438.11
? (TO)

TT=1800.56

? (TO)

TT=1802.16

No dataSAT (TO)
f=-1000
TT=1800.72
T1=882.29
? (TO)

TT=1802.17

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.08

No dataNo dataNo data? (TO)

TT=1800.08

No dataNo data? (TO)

TT=1800.17

No dataNo dataNo data? (TO)

TT=1800.17

? (TO)

TT=1800

SAT (TO)
f=-658
TT=1800.38
T1=35.2
? (TO)

TT=1802.12

? (TO)

TT=1802.17

? (TO)

TT=1802.19

? (TO)

TT=1800.02

? (TO)

TT=1800.02

?

TT=1799.74

No dataNo data? (TO)

TT=1800.39

Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null20mast_rapportOE2.0_TMAX120_K192_cod2.opb
SAT
f=-4565
TT=1800.5
T1=446.4
?

TT=1798.41

No data? (TO)

TT=1800.09

? (TO)

TT=1800.04

? (TO)

TT=1800.07

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.1

? (TO)

TT=1800.08

? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.08

Signal

TT=34.387

? (TO)

TT=1794.27

SAT
f=0
TT=1783.11
T1=540.87
SAT (TO)
f=-4565
TT=1800.5
T1=446.4
?

TT=1798.88

? (TO)

TT=1800.05

? (TO)

TT=1802.31

No data? (TO)

TT=1800.01

SAT (TO)
f=0
TT=1801.29
T1=12.2
?

TT=1792.63

No dataSAT (TO)
f=0
TT=1800.53
T1=11.25
? (TO)

TT=1802.21

? (TO)

TT=1800.1

? (TO)

TT=1800.01

? (TO)

TT=1800.11

No dataNo dataNo data? (TO)

TT=1800.13

No dataNo data? (TO)

TT=1800.13

No dataNo dataNo dataSAT (TO)
f=0
TT=1801.05
T1=12.55
? (TO)

TT=1800.08

SAT (TO)
f=-8000
TT=1800.33
T1=671.1
? (TO)

TT=1802.15

? (TO)

TT=1802.09

? (TO)

TT=1802.12

? (TO)

TT=1800.1

? (TO)

TT=1800.09

? (TO)

TT=1800.15

No dataNo data?

TT=1800.09

/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null50mast_rapportOE1.0_TMAX180_K192_cod2.opb
OPT
f=-35819
TT=746.384
T1=565.37
?

TT=1798.44

No data? (TO)

TT=1800.09

? (TO)

TT=1800.08

? (TO)

TT=1800.03

? (TO)

TT=1800.05

? (TO)

TT=1800.02

? (TO)

TT=1800.04

? (TO)

TT=1800.03

? (TO)

TT=1800.08

? (TO)

TT=1800.07

? (TO)

TT=1800.09

Signal

TT=34.645

? (TO)

TT=1431.87

SAT
f=0
TT=1783.32
T1=506.19
SAT (TO)
f=-9000
TT=1800.47
T1=441.15
?

TT=1798.06

SAT (TO)
f=0
TT=1800.88
T1=22.4
? (TO)

TT=1802.32

No dataOPT
f=-35819
TT=746.384
T1=565.37
SAT (TO)
f=0
TT=1801.37
T1=12.62
?

TT=1799.91

No dataSAT (TO)
f=0
TT=1800.47
T1=11.94
? (TO)

TT=1802.18

? (TO)

TT=1800.07

? (TO)

TT=1800.05

? (TO)

TT=1800.1

No dataNo dataNo data? (TO)

TT=1800.15

No dataNo data? (TO)

TT=1800.2

No dataNo dataNo dataSAT (TO)
f=0
TT=1800.95
T1=12.91
? (TO)

TT=1800.05

SAT (TO)
f=-35819
TT=1800.84
T1=576.84
? (TO)

TT=1802.06

? (TO)

TT=1802.15

? (TO)

TT=1802.21

? (TO)

TT=1800.09

? (TO)

TT=1800.02

?

TT=1800.07

No dataNo data?

TT=1800.05

/OPT-SMALLINT-NLC/oren/
keeloq_tasca_instances/
normalized-90_rounds_0_errors.opb
OPT
f=0
TT=0.045
T1=0.03
SAT
f=26
TT=1798.02
T1=317.05
No dataOPT
f=0
TT=0.595
T1=0.59
OPT
f=0
TT=1.368
T1=1.51
OPT
f=0
TT=1.425
T1=1.42
? (problem)

TT=0.97

? (problem)

TT=1.11

? (problem)

TT=0.96

? (problem)

TT=1.11

? (problem)

TT=0.96

? (problem)

TT=1.08

? (TO)

TT=1800.12

SAT (TO)
f=18
TT=1800.1
T1=1518.46
SAT (TO)
f=27
TT=1802.1
T1=1550.9
OPT
f=0
TT=0.1
T1=0.1
OPT
f=0
TT=1.193
T1=0.55
Wrong Opt.
f=33
TT=329.696
T1=124.24
OPT
f=0
TT=1.013
T1=0.52
OPT
f=0
TT=80.93
T1=80.92
No dataOPT
f=0
TT=12.305
T1=12.29
OPT
f=0
TT=1.174
T1=1.48
OPT
f=0
TT=27.595
T1=27.56
No dataOPT
f=0
TT=1.293
T1=1
OPT
f=0
TT=15.942
T1=15.89
?

TT=0.007

OPT
f=0
TT=5.412
T1=5.41
OPT
f=0
TT=5.347
T1=5.34
No dataNo dataNo dataNo dataNo dataOPT
f=0
TT=0.073
T1=0.04
No dataNo dataNo dataOPT
f=0
TT=0.071
T1=0.04
OPT
f=0
TT=1.324
T1=1.01
OPT
f=0
TT=0.926
T1=0.48
SAT (TO)
f=32
TT=1800.38
T1=1687.5
OPT
f=0
TT=15.044
T1=15.01
OPT
f=0
TT=11.921
T1=11.89
OPT
f=0
TT=13.983
T1=13.94
OPT
f=0
TT=0.105
T1=0.11
OPT
f=0
TT=0.114
T1=0.11
No dataOPT
f=0
TT=0.045
T1=0.03
OPT
f=0
TT=0.045
T1=0.03
No data
/OPT-SMALLINT-NLC/oren/
keeloq_tasca_instances/
normalized-90_rounds_10_errors.opb
OPT
f=10
TT=19.745
T1=19.7
SAT
f=31
TT=1798.01
T1=191.73
No dataSAT (TO)
f=31
TT=1800.02
T1=1660.01
? (TO)

TT=1800.13

? (TO)

TT=1800.11

? (problem)

TT=0.9

? (problem)

TT=4.45

? (problem)

TT=0.92

? (problem)

TT=4.5

? (problem)

TT=0.91

? (problem)

TT=4.47

SAT (TO)
f=55
TT=1800.05
T1=83.08
SAT (TO)
f=25
TT=1800.01
T1=1603.51
SAT (TO)
f=34
TT=1802.09
T1=755.61
SAT
f=23
TT=1783.01
T1=1515.09
SAT (TO)
f=37
TT=1800.03
T1=573.98
Wrong Opt.
f=35
TT=455.467
T1=72.54
SAT (TO)
f=38
TT=1800.6
T1=1481
OPT
f=10
TT=30.455
T1=30.45
No dataOPT
f=10
TT=7.636
T1=7.62
SAT (TO)
f=35
TT=1800.8
T1=857.94
OPT
f=10
TT=92.415
T1=92.39
No dataSAT (TO)
f=37
TT=1800.01
T1=583.8
OPT
f=10
TT=29.663
T1=29.63
?

TT=0.006

? (TO)

TT=1800.1

? (TO)

TT=1800.08

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=35
TT=1800.05
T1=900.41
No dataNo dataNo dataSAT (TO)
f=37
TT=1800.33
T1=900.31
SAT (TO)
f=33
TT=1800.18
T1=128
SAT (TO)
f=29
TT=1800.06
T1=514.68
SAT (TO)
f=33
TT=1800.59
T1=1749.96
OPT
f=10
TT=19.756
T1=19.72
OPT
f=10
TT=19.745
T1=19.7
OPT
f=10
TT=20.15
T1=20.12
? (TO)

TT=1800.03

? (TO)

TT=1800.05

No data?

TT=1799.84

?

TT=1799.57

No data
/OPT-SMALLINT-NLC/oren/
keeloq_tasca_instances/
normalized-90_rounds_15_errors.opb
OPT
f=15
TT=49.981
T1=45.15
SAT
f=26
TT=1798.04
T1=1025.11
No dataSAT (TO)
f=32
TT=1800.03
T1=1114.4
? (TO)

TT=1800.14

? (TO)

TT=1800.13

? (problem)

TT=0.9

? (problem)

TT=2.23

? (problem)

TT=0.85

? (problem)

TT=2.11

? (problem)

TT=0.86

? (problem)

TT=2.2

SAT (TO)
f=59
TT=1800.11
T1=3.24
OPT
f=15
TT=995.053
T1=979.09
SAT (TO)
f=40
TT=1800.14
T1=656.79
SAT
f=24
TT=1783
T1=685
SAT (TO)
f=36
TT=1800.08
T1=1343.88
Wrong Opt.
f=34
TT=74.321
T1=4.18
SAT (TO)
f=40
TT=1801.09
T1=277.72
SAT (TO)
f=43
TT=1800.06
T1=1432.37
No data? (TO)

TT=1800.17

SAT (TO)
f=34
TT=1800.82
T1=944.71
?

TT=1789.76

No dataSAT (TO)
f=30
TT=1800.54
T1=917.98
OPT
f=15
TT=681.7
T1=673.07
?

TT=0.004

? (TO)

TT=1800.08

? (TO)

TT=1800.1

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=36
TT=1800.11
T1=900.81
No dataNo dataNo dataSAT (TO)
f=37
TT=1800.17
T1=900.81
SAT (TO)
f=34
TT=1800.05
T1=694.39
SAT (TO)
f=30
TT=1800.05
T1=1445.52
SAT (TO)
f=33
TT=1800.64
T1=1663.55
OPT
f=15
TT=1789.57
T1=1789.82
OPT
f=15
TT=49.981
T1=45.15
?

TT=1796.77

? (TO)

TT=1800.07

? (TO)

TT=1800.08

No data?

TT=1799.59

?

TT=1799.95

No data
/OPT-SMALLINT-NLC/oren/
keeloq_tasca_instances/
normalized-90_rounds_5_errors.opb
OPT
f=5
TT=1.695
T1=0.1
SAT
f=23
TT=1798
T1=1356.02
No dataSAT (TO)
f=30
TT=1800.03
T1=1435.6
? (TO)

TT=1800.12

? (TO)

TT=1800.12

? (problem)

TT=7.86

? (problem)

TT=4.87

? (problem)

TT=8.47

? (problem)

TT=4.92

? (problem)

TT=8.19

? (problem)

TT=4.44

? (TO)

TT=1800.13

SAT (TO)
f=21
TT=1800.12
T1=1794.11
SAT (TO)
f=30
TT=1802.08
T1=1516.22
SAT
f=16
TT=1783.01
T1=1734.82
SAT (TO)
f=34
TT=1800.07
T1=1414.84
Wrong Opt.
f=36
TT=66.826
T1=42.82
SAT (TO)
f=37
TT=1800.75
T1=1095.23
OPT
f=5
TT=42.254
T1=42.24
No dataOPT
f=5
TT=7.318
T1=7.31
OPT
f=5
TT=1761.45
T1=943.27
OPT
f=5
TT=13.61
T1=13.57
No dataOPT
f=5
TT=535.72
T1=284.96
OPT
f=5
TT=9.218
T1=9.18
?

TT=0.005

? (TO)

TT=1800.07

? (TO)

TT=1800.07

No dataNo dataNo dataNo dataNo dataSAT (TO)
f=31
TT=1800.13
T1=900.41
No dataNo dataNo dataSAT (TO)
f=30
TT=1800.45
T1=900.61
OPT
f=5
TT=5.453
T1=3.53
SAT (TO)
f=27
TT=1800.1
T1=1670.9
SAT (TO)
f=30
TT=1800.61
T1=1370.11
OPT
f=5
TT=15.801
T1=15.77
OPT
f=5
TT=11.128
T1=11.09
OPT
f=5
TT=15.509
T1=15.48
OPT
f=5
TT=1.695
T1=0.1
OPT
f=5
TT=1.745
T1=0.11
No data?

TT=1799.94

?

TT=1799.6

No data



Statisticsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
clasp
2.0.6-R5325 (opt)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
wbo
1.72
(complete)
Number of times the solver is able to give the best known answer605266366358682228496223491201433260649498606618186372912495937766262647936685704143951441652280206535022619657777483796767036903725112256464491
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
26111199412581904453183636223415158675328755662402150019391211776123581935291432312970