PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Graph Problems

This page displays the results of the different solvers for each benchmark for category no optimisation, small integers, linear constraints (DEC-SMALLINT-LIN), subcategory Handmade, subsubcategory Graph Problems

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (dec) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: borg-pb 10.05.30 (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: borg pb-dec-11.04.03 (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
PBPASSolver-CARD.DP 2012-05-28 (complete)
PBPASSolver-CARD.SN 2012-05-28 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench nameBest results
on this
instance
bsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_1.opb.PB06.opb
SAT
TT=0.874
T1=0.86
SAT
TT=23.916
T1=23.91
SAT
TT=5.508
T1=5.5
? (problem)
TT=6.242

SAT
TT=20.775
T1=20.79
? (problem)
TT=6.324

SAT
TT=20.793
T1=20.86
? (problem)
TT=6.349

SAT
TT=20.447
T1=20.41
? (problem)
TT=6.321

SAT
TT=21.119
T1=21.27
SAT
TT=21.359
T1=21.37
SAT
TT=16.713
T1=16.69
SAT
TT=15.361
T1=13.94
SAT
TT=3.591
T1=3.67
SAT
TT=3.562
T1=2.36
SAT
TT=25.856
T1=25.85
SAT
TT=3.574
T1=2.16
?
TT=1795.85

SAT
TT=1.066
T1=2.12
SAT
TT=48.33
T1=48.31
SAT
TT=4.703
T1=3.31
?
TT=1791.13

SAT
TT=10.025
T1=11.22
SAT
TT=4.672
T1=2.9
?
TT=1797.18

SAT
TT=8.28
T1=8.26
? (problem)
TT=1.719

? (problem)
TT=1.674

? (MO)
TT=276.77

? (MO)
TT=271.77

SAT
TT=0.906
T1=0.89
SAT
TT=0.919
T1=0.91
SAT
TT=5.005
T1=3
SAT
TT=3.234
T1=2.41
SAT
TT=3.333
T1=2.15
SAT
TT=1502.77
T1=1502.3
SAT
TT=1235.79
T1=1235.38
SAT
TT=1292.62
T1=1292.24
SAT
TT=8.034
T1=7.99
SAT
TT=15.294
T1=7.67
SAT
TT=0.874
T1=0.86
SAT
TT=0.906
T1=0.9
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_2.opb.PB06.opb
SAT
TT=0.875
T1=0.87
SAT
TT=23.77
T1=23.78
SAT
TT=5.539
T1=5.53
? (problem)
TT=6.603

SAT
TT=25.788
T1=25.74
? (problem)
TT=6.525

SAT
TT=26.399
T1=26.34
? (problem)
TT=6.468

SAT
TT=26.32
T1=26.27
? (problem)
TT=6.403

SAT
TT=30.02
T1=29.94
SAT
TT=24.668
T1=24.7
SAT
TT=13.726
T1=13.82
SAT
TT=15.124
T1=13.7
SAT
TT=3.733
T1=3.73
SAT
TT=3.573
T1=2.34
SAT
TT=25.809
T1=25.8
SAT
TT=3.544
T1=2.14
?
TT=1796.33

SAT
TT=0.908
T1=1.19
SAT
TT=48.908
T1=48.89
SAT
TT=5.023
T1=3.27
?
TT=1790.32

SAT
TT=9.682
T1=10.42
SAT
TT=4.664
T1=2.78
?
TT=1798.5

SAT
TT=5.733
T1=5.71
? (problem)
TT=1.708

? (problem)
TT=1.708

? (MO)
TT=274.82

? (MO)
TT=281.23

SAT
TT=0.904
T1=0.9
SAT
TT=0.92
T1=0.91
SAT
TT=5.124
T1=3.11
SAT
TT=3.214
T1=2.1
SAT
TT=3.263
T1=2.11
SAT
TT=1029
T1=1028.61
SAT
TT=1166.59
T1=1166.15
SAT
TT=1180.89
T1=1180.48
SAT
TT=7.998
T1=7.97
SAT
TT=7.676
T1=7.64
SAT
TT=0.875
T1=0.87
SAT
TT=0.938
T1=0.93
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_3.opb.PB06.opb
SAT
TT=0.875
T1=0.87
SAT
TT=25.223
T1=25.23
SAT
TT=5.579
T1=5.57
? (problem)
TT=7.034

SAT
TT=40.353
T1=40.96
? (problem)
TT=6.578

SAT
TT=39.471
T1=39.54
? (problem)
TT=6.551

SAT
TT=39.567
T1=39.61
? (problem)
TT=6.57

SAT
TT=32.13
T1=32.07
SAT
TT=22.396
T1=22.4
SAT
TT=13.233
T1=13.22
SAT
TT=16.627
T1=15.22
SAT
TT=4.704
T1=4.79
SAT
TT=3.593
T1=2.42
SAT
TT=25.833
T1=25.83
SAT
TT=3.582
T1=2.16
?
TT=1798.76

SAT
TT=0.921
T1=1.06
SAT
TT=16.545
T1=16.53
SAT
TT=5.323
T1=3.3
? (TO)
TT=1800.94

SAT
TT=9.55
T1=9.61
SAT
TT=4.565
T1=2.95
?
TT=1799

SAT
TT=8.223
T1=8.19
? (problem)
TT=1.655

? (problem)
TT=1.653

? (MO)
TT=273.28

? (MO)
TT=426.27

SAT
TT=0.905
T1=0.89
SAT
TT=0.908
T1=0.9
SAT
TT=5.754
T1=3.09
SAT
TT=3.397
T1=2.13
SAT
TT=3.321
T1=2.15
SAT
TT=1072.5
T1=1071.92
SAT
TT=1299.79
T1=1299.25
SAT
TT=531.979
T1=531.3
SAT
TT=7.949
T1=7.92
SAT
TT=8.164
T1=8.13
SAT
TT=0.875
T1=0.87
SAT
TT=0.943
T1=0.93
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_8.opb.PB06.opb
SAT
TT=0.876
T1=0.86
SAT
TT=25.254
T1=25.25
SAT
TT=5.573
T1=5.57
? (problem)
TT=6.231

SAT
TT=40.582
T1=40.54
? (problem)
TT=6.23

SAT
TT=40.419
T1=40.36
? (problem)
TT=6.66

SAT
TT=40.406
T1=40.57
? (problem)
TT=6.09

SAT
TT=40.323
T1=40.27
SAT
TT=21.927
T1=21.93
SAT
TT=16.189
T1=16.16
SAT
TT=16.936
T1=15.5
SAT
TT=16.589
T1=16.71
SAT
TT=3.526
T1=2.34
SAT
TT=25.575
T1=25.57
SAT
TT=3.522
T1=2.14
?
TT=1795.8

SAT
TT=1.076
T1=2.21
SAT
TT=146.15
T1=99.16
SAT
TT=4.482
T1=3.28
?
TT=1793.23

SAT
TT=9.568
T1=10.76
SAT
TT=4.352
T1=2.88
?
TT=1798.26

SAT
TT=3.707
T1=3.74
? (problem)
TT=1.74

? (problem)
TT=1.715

? (MO)
TT=271.58

? (MO)
TT=432.15

SAT
TT=0.907
T1=0.9
SAT
TT=0.907
T1=0.9
SAT
TT=5.753
T1=2.96
SAT
TT=3.293
T1=2.38
SAT
TT=3.233
T1=2.13
SAT
TT=1517.06
T1=1516.68
?
TT=1797.7

SAT
TT=1346.21
T1=1345.57
SAT
TT=8.043
T1=8.01
SAT
TT=7.759
T1=7.73
SAT
TT=0.876
T1=0.86
SAT
TT=0.906
T1=0.9
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v30_e350_d15_mw10_9.opb.PB06.opb
SAT
TT=0.876
T1=0.86
SAT
TT=21.78
T1=21.78
SAT
TT=4.471
T1=4.47
? (problem)
TT=7.087

SAT
TT=31.115
T1=31.19
? (problem)
TT=6.628

SAT
TT=30.884
T1=30.94
? (problem)
TT=6.742

SAT
TT=30.395
T1=30.36
? (problem)
TT=6.669

SAT
TT=25.199
T1=25.53
SAT
TT=21.758
T1=21.76
SAT
TT=12.86
T1=12.91
SAT
TT=15.09
T1=13.69
SAT
TT=33.603
T1=33.61
SAT
TT=3.682
T1=2.4
SAT
TT=22.775
T1=22.77
SAT
TT=3.316
T1=2.06
? (TO)
TT=1800.98

SAT
TT=0.919
T1=1.03
SAT
TT=49.601
T1=49.58
SAT
TT=4.673
T1=3.29
?
TT=1791.4

SAT
TT=9.631
T1=9.69
SAT
TT=4.624
T1=2.9
SAT
TT=1438.54
T1=1438.08
SAT
TT=5.793
T1=5.77
? (problem)
TT=1.731

? (problem)
TT=1.682

? (MO)
TT=275.16

? (MO)
TT=437.35

SAT
TT=0.919
T1=0.91
SAT
TT=0.907
T1=0.9
SAT
TT=5.323
T1=3.03
SAT
TT=3.234
T1=2.08
SAT
TT=3.294
T1=2.12
SAT
TT=1497.65
T1=1497.12
SAT
TT=1623.85
T1=1623.29
SAT
TT=1245.64
T1=1245.1
SAT
TT=7.905
T1=7.87
SAT
TT=7.659
T1=7.62
SAT
TT=0.876
T1=0.86
SAT
TT=0.904
T1=0.89
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_0.opb.PB06.opb
SAT
TT=1.443
T1=1.53
SAT
TT=150.932
T1=150.98
SAT
TT=32.234
T1=32.25
? (problem)
TT=19.431

? (TO)
TT=1800.04

? (problem)
TT=20.071

? (TO)
TT=1800.01

? (problem)
TT=19.02

? (TO)
TT=1800.09

? (problem)
TT=18.848

? (TO)
TT=1800.04

SAT
TT=140.954
T1=141.02
SAT
TT=35.288
T1=35.25
SAT
TT=66.434
T1=61.97
SAT
TT=13.215
T1=13.2
SAT
TT=7.773
T1=5.67
SAT
TT=154.355
T1=154.36
SAT
TT=7.355
T1=5.07
? (TO)
TT=1802.09

SAT
TT=1.443
T1=1.53
SAT
TT=197.465
T1=197.46
SAT
TT=10.573
T1=7
?
TT=1792.23

SAT
TT=25.431
T1=23.18
SAT
TT=8.743
T1=6.36
? (TO)
TT=1800.05

SAT
TT=13.951
T1=13.91
? (problem)
TT=5.281

? (problem)
TT=5.332

? (MO)
TT=276.38

? (MO)
TT=275.98

SAT
TT=2.799
T1=2.78
SAT
TT=2.799
T1=2.78
SAT
TT=9.784
T1=6.47
SAT
TT=6.714
T1=5.08
SAT
TT=6.835
T1=5.19
?
TT=1799.75

?
TT=1799.83

?
TT=1799.15

SAT
TT=22.716
T1=22.64
SAT
TT=23.697
T1=23.61
SAT
TT=2.709
T1=2.69
SAT
TT=2.877
T1=2.86
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_2.opb.PB06.opb
SAT
TT=1.506
T1=2.46
SAT
TT=152.205
T1=152.21
SAT
TT=26.353
T1=26.35
? (problem)
TT=21.754

? (TO)
TT=1800.06

? (problem)
TT=20.018

? (TO)
TT=1800.07

? (problem)
TT=19.928

? (TO)
TT=1800.08

? (problem)
TT=19.892

? (TO)
TT=1800.05

SAT
TT=173.345
T1=173.42
SAT
TT=42.192
T1=42.16
SAT
TT=54.472
T1=49.74
SAT
TT=12.972
T1=12.96
SAT
TT=8.122
T1=5.83
SAT
TT=181.906
T1=181.91
SAT
TT=7.384
T1=5.09
? (TO)
TT=1802.04

SAT
TT=1.506
T1=2.46
? (exit code)
TT=325.031

SAT
TT=10.341
T1=7.06
?
TT=1791.88

SAT
TT=24.408
T1=21.96
SAT
TT=8.565
T1=6.53
? (TO)
TT=1802.09

SAT
TT=10.138
T1=10.09
? (problem)
TT=5.198

? (problem)
TT=5.318

? (MO)
TT=275.19

? (MO)
TT=439.26

SAT
TT=2.932
T1=2.91
SAT
TT=2.798
T1=2.78
SAT
TT=9.842
T1=6.77
SAT
TT=6.503
T1=4.99
SAT
TT=6.692
T1=5.12
? (TO)
TT=1800.02

? (TO)
TT=1800.04

? (TO)
TT=1802.11

SAT
TT=23.557
T1=23.48
SAT
TT=23.473
T1=23.38
SAT
TT=2.704
T1=2.68
SAT
TT=2.763
T1=2.74
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_5.opb.PB06.opb
SAT
TT=1.407
T1=1.49
SAT
TT=150.401
T1=150.41
SAT
TT=26.4
T1=26.39
? (problem)
TT=19.093

? (TO)
TT=1800.07

? (problem)
TT=19.316

? (TO)
TT=1800.07

? (problem)
TT=19.301

? (TO)
TT=1800.02

? (problem)
TT=18.863

? (TO)
TT=1800

SAT
TT=137.823
T1=137.9
SAT
TT=84.567
T1=84.59
SAT
TT=48.982
T1=44.53
SAT
TT=12.996
T1=13.11
SAT
TT=8.012
T1=5.96
SAT
TT=150.221
T1=150.23
SAT
TT=7.552
T1=5.22
? (TO)
TT=1802.05

SAT
TT=1.407
T1=1.49
? (exit code)
TT=176.095

SAT
TT=10.482
T1=7.03
? (TO)
TT=1802.02

SAT
TT=24.792
T1=23.28
SAT
TT=8.493
T1=6.5
? (TO)
TT=1802.04

SAT
TT=13.814
T1=13.77
? (problem)
TT=5.203

? (problem)
TT=5.135

? (MO)
TT=275.45

? (MO)
TT=277.74

SAT
TT=2.808
T1=2.79
SAT
TT=2.8
T1=2.79
SAT
TT=9.762
T1=6.57
SAT
TT=6.661
T1=5.12
SAT
TT=6.983
T1=5.49
? (TO)
TT=1800.13

? (TO)
TT=1800.11

? (TO)
TT=1800.06

SAT
TT=23.623
T1=23.52
SAT
TT=22.947
T1=22.87
SAT
TT=2.706
T1=2.69
SAT
TT=2.776
T1=2.76
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_6.opb.PB06.opb
SAT
TT=1.479
T1=1.69
SAT
TT=168.827
T1=168.9
SAT
TT=26.391
T1=26.38
? (problem)
TT=20.053

? (TO)
TT=1800.01

? (problem)
TT=20.321

? (TO)
TT=1800.04

? (problem)
TT=20.546

? (TO)
TT=1800.05

? (problem)
TT=20.309

? (TO)
TT=1800.06

SAT
TT=182.128
T1=182.18
SAT
TT=77.392
T1=77.38
SAT
TT=57.06
T1=52.53
SAT
TT=13.901
T1=13.99
SAT
TT=8.144
T1=5.81
SAT
TT=181.914
T1=181.92
SAT
TT=7.182
T1=5.03
? (TO)
TT=1802.11

SAT
TT=1.479
T1=1.69
? (exit code)
TT=227.689

SAT
TT=10.772
T1=7.11
?
TT=1791.24

SAT
TT=24.38
T1=23.18
SAT
TT=8.623
T1=6.42
? (TO)
TT=1800.11

SAT
TT=12.421
T1=12.55
? (problem)
TT=5.153

? (problem)
TT=5.146

? (MO)
TT=275.63

? (MO)
TT=287.45

SAT
TT=2.796
T1=2.78
SAT
TT=2.955
T1=2.93
SAT
TT=10.701
T1=6.69
SAT
TT=6.882
T1=5.25
SAT
TT=6.994
T1=5.3
?
TT=1799.25

?
TT=1799.6

? (TO)
TT=1802.14

SAT
TT=23.081
T1=23
SAT
TT=23.983
T1=23.89
SAT
TT=2.709
T1=2.69
SAT
TT=2.822
T1=2.81
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v40_e600_d20_mw10_9.opb.PB06.opb
SAT
TT=1.429
T1=1.54
SAT
TT=137.022
T1=137.1
SAT
TT=33.881
T1=33.89
? (problem)
TT=19.053

? (TO)
TT=1800.01

? (problem)
TT=18.962

? (TO)
TT=1800.05

? (problem)
TT=18.275

? (TO)
TT=1800.09

? (problem)
TT=18.722

? (TO)
TT=1800.08

SAT
TT=153.326
T1=153.33
SAT
TT=39.693
T1=39.67
SAT
TT=57.652
T1=53.2
SAT
TT=12.986
T1=13.08
SAT
TT=7.672
T1=5.58
SAT
TT=181.923
T1=181.93
SAT
TT=7.113
T1=4.99
? (TO)
TT=1802.13

SAT
TT=1.429
T1=1.54
SAT
TT=249.801
T1=249.79
SAT
TT=10.472
T1=7.09
?
TT=1791.54

SAT
TT=23.894
T1=21.71
SAT
TT=8.763
T1=6.49
?
TT=1798.9

SAT
TT=8.682
T1=8.63
? (problem)
TT=5.071

? (problem)
TT=5.185

? (MO)
TT=273.64

? (MO)
TT=434.52

SAT
TT=2.799
T1=2.79
SAT
TT=2.813
T1=2.79
SAT
TT=9.683
T1=7.02
SAT
TT=6.503
T1=4.95
SAT
TT=6.913
T1=5.27
? (TO)
TT=1800.04

? (TO)
TT=1800.04

? (TO)
TT=1800.04

SAT
TT=23.724
T1=23.62
SAT
TT=22.794
T1=22.72
SAT
TT=2.707
T1=2.69
SAT
TT=2.823
T1=2.81
Bench nameBest resultsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_1.opb.PB06.opb
SAT
TT=2.634
T1=2.78
SAT
TT=186.519
T1=186.61
SAT
TT=133.291
T1=133.42
? (problem)
TT=55.44

? (MO)
TT=154.82

? (problem)
TT=56.636

? (MO)
TT=163.91

? (problem)
TT=52.126

? (MO)
TT=148.62

? (problem)
TT=52.844

? (MO)
TT=149.29

SAT
TT=187.548
T1=187.55
SAT
TT=82.343
T1=82.28
SAT
TT=190.142
T1=178.05
SAT
TT=271.113
T1=271.25
SAT
TT=17.941
T1=13.14
SAT
TT=186.858
T1=186.95
SAT
TT=16.131
T1=11.24
? (TO)
TT=1802.16

SAT
TT=2.634
T1=2.78
? (exit code)
TT=294.327

SAT
TT=21.751
T1=14.96
? (TO)
TT=1802.25

SAT
TT=271.087
T1=412.03
SAT
TT=19.53
T1=14.21
? (TO)
TT=1802.15

SAT
TT=119.661
T1=119.67
? (problem)
TT=13.537

? (problem)
TT=14.022

? (MO)
TT=290.85

? (MO)
TT=290.25

SAT
TT=7.292
T1=7.27
SAT
TT=7.295
T1=7.27
SAT
TT=23.011
T1=16.11
SAT
TT=14.102
T1=11.14
SAT
TT=15.031
T1=11.85
? (TO)
TT=1802.24

? (TO)
TT=1802.19

? (TO)
TT=1802.22

SAT
TT=58.646
T1=58.45
SAT
TT=59.118
T1=58.94
SAT
TT=7.035
T1=7.01
SAT
TT=7.378
T1=7.35
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_3.opb.PB06.opb
SAT
TT=2.738
T1=3.85
SAT
TT=186.586
T1=186.58
SAT
TT=134.828
T1=134.9
? (problem)
TT=59.971

? (MO)
TT=153.47

? (problem)
TT=56.172

? (MO)
TT=165.31

? (problem)
TT=56.061

? (MO)
TT=151.87

? (problem)
TT=55.087

? (MO)
TT=155.63

SAT
TT=187.658
T1=187.74
SAT
TT=315.417
T1=315.53
SAT
TT=156.715
T1=143.79
SAT
TT=47.67
T1=47.67
SAT
TT=17.069
T1=12.93
SAT
TT=186.748
T1=186.83
SAT
TT=17
T1=11.56
? (TO)
TT=1802.16

SAT
TT=2.738
T1=3.85
? (exit code)
TT=86.182

SAT
TT=21.5
T1=14.89
?
TT=1795.01

SAT
TT=268.989
T1=460.73
SAT
TT=19.78
T1=14.23
? (TO)
TT=1802.15

SAT
TT=24.735
T1=24.81
? (problem)
TT=13.632

? (problem)
TT=13.604

? (MO)
TT=461.53

? (MO)
TT=459.5

SAT
TT=7.661
T1=7.62
SAT
TT=7.482
T1=7.45
SAT
TT=24.461
T1=17.23
SAT
TT=14.864
T1=11.43
SAT
TT=14.842
T1=11.84
? (TO)
TT=1800.14

? (TO)
TT=1802.14

? (TO)
TT=1802.16

SAT
TT=58.152
T1=57.98
SAT
TT=58.572
T1=58.4
SAT
TT=7.057
T1=7.03
SAT
TT=7.622
T1=7.58
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_5.opb.PB06.opb
SAT
TT=2.601
T1=2.65
SAT
TT=186.547
T1=186.68
SAT
TT=129.336
T1=129.41
? (problem)
TT=60.337

? (MO)
TT=152.89

? (problem)
TT=60.918

? (MO)
TT=150.65

? (problem)
TT=58.194

? (MO)
TT=149.77

? (problem)
TT=59.32

? (MO)
TT=152.15

SAT
TT=187.451
T1=187.44
SAT
TT=77.727
T1=77.7
SAT
TT=207.36
T1=195.03
SAT
TT=45.024
T1=45
SAT
TT=17.102
T1=13.11
SAT
TT=186.598
T1=186.69
SAT
TT=16.92
T1=11.59
? (TO)
TT=1802.24

SAT
TT=2.601
T1=2.65
? (exit code)
TT=179.494

SAT
TT=21.481
T1=14.91
? (TO)
TT=1802.15

SAT
TT=268.864
T1=399.32
SAT
TT=19.811
T1=14.24
? (TO)
TT=1800.26

SAT
TT=118.039
T1=117.96
? (problem)
TT=13.318

? (problem)
TT=13.67

? (MO)
TT=306.98

? (MO)
TT=472.61

SAT
TT=7.357
T1=7.33
SAT
TT=7.463
T1=7.43
SAT
TT=25.191
T1=17.39
SAT
TT=14.312
T1=11.37
SAT
TT=14.632
T1=11.52
? (TO)
TT=1802.27

? (TO)
TT=1800.26

? (TO)
TT=1802.22

SAT
TT=61.163
T1=60.93
SAT
TT=60.715
T1=60.5
SAT
TT=7.082
T1=7.05
SAT
TT=7.368
T1=7.33
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_6.opb.PB06.opb
SAT
TT=2.724
T1=2.8
SAT
TT=186.652
T1=186.71
SAT
TT=131.784
T1=131.86
? (problem)
TT=53.542

? (MO)
TT=150.25

? (problem)
TT=53.215

? (MO)
TT=150.17

? (problem)
TT=53.022

? (MO)
TT=151.54

? (problem)
TT=52.635

? (MO)
TT=149.84

SAT
TT=187.458
T1=187.52
SAT
TT=218.273
T1=218.23
SAT
TT=221.268
T1=209.12
SAT
TT=202.634
T1=202.7
SAT
TT=16.78
T1=12.68
SAT
TT=186.914
T1=186.9
SAT
TT=17.033
T1=11.72
? (TO)
TT=1802.23

SAT
TT=2.724
T1=2.8
? (exit code)
TT=115.55

SAT
TT=21.511
T1=14.83
? (TO)
TT=1802.12

SAT
TT=267.788
T1=382.55
SAT
TT=19.941
T1=14.41
? (TO)
TT=1802.15

SAT
TT=139.526
T1=139.46
? (problem)
TT=13.739

? (problem)
TT=13.483

? (MO)
TT=461.29

? (MO)
TT=291.28

SAT
TT=7.336
T1=7.3
SAT
TT=7.463
T1=7.43
SAT
TT=23.314
T1=16.45
SAT
TT=14.742
T1=11.36
SAT
TT=15.192
T1=11.97
? (TO)
TT=1800.22

? (TO)
TT=1802.2

? (TO)
TT=1802.14

SAT
TT=58.841
T1=58.66
SAT
TT=58.664
T1=58.47
SAT
TT=7.049
T1=7.01
SAT
TT=7.215
T1=7.18
normalized-PB06/SATUNSAT-SMALLINT/
submitted-PB06/liu/dbst/
normalized-dbst_v50_e1000_d25_mw10_9.opb.PB06.opb
SAT
TT=2.653
T1=2.69
SAT
TT=186.49
T1=186.56
SAT
TT=133.525
T1=133.6
? (problem)
TT=56.683

? (MO)
TT=150.58

? (problem)
TT=57.92

? (MO)
TT=148.68

? (problem)
TT=56.927

? (MO)
TT=150.49

? (problem)
TT=57.404

? (MO)
TT=97

SAT
TT=187.275
T1=187.41
SAT
TT=188.441
T1=188.43
SAT
TT=192.083
T1=179.84
SAT
TT=41.162
T1=41.14
SAT
TT=16.682
T1=12.7
SAT
TT=186.76
T1=186.86
SAT
TT=15.833
T1=11.17
? (TO)
TT=1802.22

SAT
TT=2.653
T1=2.69
? (exit code)
TT=183.062

SAT
TT=21.741
T1=14.88
? (TO)
TT=1802.21

SAT
TT=268.242
T1=392.74
SAT
TT=20.282
T1=14.52
? (TO)
TT=1802.23

SAT
TT=12.024
T1=12.18
? (problem)
TT=13.509

? (problem)
TT=13.715

? (MO)
TT=307.69

? (MO)
TT=309.68

SAT
TT=7.295
T1=7.27
SAT
TT=7.382
T1=7.35
SAT
TT=25.111
T1=17.54
SAT
TT=14.45
T1=11.26
SAT
TT=14.712
T1=11.55
? (TO)
TT=1800.25

? (TO)
TT=1802.19

? (TO)
TT=1802.28

SAT
TT=60.682
T1=60.46
SAT
TT=58.835
T1=58.64
SAT
TT=7.047
T1=7.02
SAT
TT=7.384
T1=7.35



Statisticsbsolo
3.2
(complete)
clasp
2.0.6-R5325 (dec)
(complete)
npSolver
1.0
(complete)
npSolver
1.0 (fixed)
(complete)
npSolver
inc
(complete)
npSolver
inc (fixed)
(complete)
npSolver
inc-topDown
(complete)
npSolver
inc-topDown (fixed)
(complete)
npSolver
inc-topdown-quickBound
(complete)
npSolver
inc-topdown-quickBound (fixed)
(complete)
PB07: bsolo
3.0.17
(complete)
PB07: minisat+
1.14
(complete)
PB07: PB-clasp
2007-04-10
(complete)
PB07: Pueblo
1.4
(incomplete)
PB07: SAT4JPseudoResolution
2007-03-23
(complete)
PB09: bsolo
3.1
(complete)
PB09: SAT4J Pseudo Resolution
2.1.1
(complete)
PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)
PB10: borg-pb
10.05.30
(complete)
PB10: pb_cplex
2010-06-29
(complete)
PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)
PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)
PB11: borg
pb-dec-11.04.03
(complete)
PB11: Sat4j Res//CP
2.3.0
(complete)
PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)
PB12: minisatp
1.0-2-g022594c
(complete)
pb2sat
2012-05-19
(complete)
pb2satCp2
2012-05-19
(complete)
PBPASSolver-CARD.DP
2012-05-28
(complete)
PBPASSolver-CARD.SN
2012-05-28
(complete)
pwbo
2.0
(complete)
pwbo
2.02
(complete)
SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)
Sat 4j PB Resolution
2.3.2 Snapshot
(complete)
SAT4J PB specific settings
2.3.2 snapshot
(complete)
SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)
SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)
toysat
2012-05-17
(complete)
toysat
2012-06-01
(complete)
wbo
1.7
(complete)
wbo
1.72
(complete)
Number of times the solver is able to give the best known answer151505050505151515151501501571501515115000015151515155450151515
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)
0000000000000000001000000000000000000000050