PB'12 competition: satisfaction and optimization track: results by benchmark

Results by benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Travelling Tournament Problem

This page displays the results of the different solvers for each benchmark for category optimisation, small integers, linear constraints (OPT-SMALLINT-LIN), subcategory Handmade, subsubcategory Travelling Tournament Problem

REMINDER

Keep in mind that the 'Best result' columns only provide the best result given by one of the solvers. This 'Best result' may be wrong in case of an UNSATISFIABLE or OPTIMUM FOUND answer (because there's no efficient way to check these answers).

Description of a cell contents:

Cell exampleMeaning
AnswerSolver result
f=...value of the objective function for the model reported by the solver
TT=...Total Time (TT): this is the CPU time (in seconds) used by the solver until termination. This time is only meaningful for complete solvers because incomplete solvers will always run until they time out
Remember that CPU time and wall clock time are two very different notions. The CPU time represents the time during which the instructions of the solver were executed by the processor. The wall clock time represents how much time ellapsed on the clock. For a same event, the CPU time may be either smaller or greater than the wall clock time depending on the number of threads of execution and the number of processors.

Meaning of some abbreviations:

AbbreviationMeaning
f=...Value of the objective function
TOTime Out
MOMem. Out (out of memory)

Meaning of the different colors:

ColorMeaning
textthe solver cannot handle this instance
textthe solver gave no answer
textthe solver could give an answer (SAT)
textthe solver gave a definitive answer (OPTIMUM FOUND or UNSAT)
textthe solver performed better than the other ones on that instance (complete solvers point of view)
textthe solver performed better than the other ones on that instance (incomplete solvers point of view)
textthe solver was ended by a signal or other problem
textthe solver gave an incomplete answer
textthe solver gave a wrong answer

For better readability, you may choose to hide some solvers:
bsolo 3.2 (complete)
clasp 2.0.6-R5325 (opt) (complete)
npSolver 1.0 (complete)
npSolver 1.0 (fixed) (complete)
npSolver inc (complete)
npSolver inc (fixed) (complete)
npSolver inc-topDown (complete)
npSolver inc-topDown (fixed) (complete)
npSolver inc-topdown-quickBound (complete)
npSolver inc-topdown-quickBound (fixed) (complete)
PB07: bsolo 3.0.17 (complete)
PB07: minisat+ 1.14 (complete)
PB07: PB-clasp 2007-04-10 (complete)
PB07: Pueblo 1.4 (incomplete)
PB07: SAT4JPseudoResolution 2007-03-23 (complete)
PB09: bsolo 3.1 (complete)
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)
PB09: SCIPspx SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009) (complete)
PB10: pb_cplex 2010-06-29 (complete)
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)
PB10: SCIPspx SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)
PB11: Sat4j Res//CP 2.3.0 (complete)
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)
PB12: minisatp 1.0-2-g022594c (complete)
pb2sat 2012-05-19 (complete)
pb2satCp2 2012-05-19 (complete)
pwbo 2.0 (complete)
pwbo 2.02 (complete)
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)
Sat 4j PB Resolution 2.3.2 Snapshot (complete)
SAT4J PB specific settings 2.3.2 snapshot (complete)
SCIP spx SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed (complete)
SCIP spx E SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed (complete)
SCIP spx standard SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed (complete)
toysat 2012-05-17 (complete)
toysat 2012-06-01 (complete)
wbo 1.7 (complete)
wbo 1.72 (complete)

Bench nameBest results
on this
instance		bsolo
3.2
(complete)		clasp
2.0.6-R5325 (opt)
(complete)		npSolver
1.0
(complete)		npSolver
1.0 (fixed)
(complete)		npSolver
inc
(complete)		npSolver
inc (fixed)
(complete)		npSolver
inc-topDown
(complete)		npSolver
inc-topDown (fixed)
(complete)		npSolver
inc-topdown-quickBound
(complete)		npSolver
inc-topdown-quickBound (fixed)
(complete)		PB07: bsolo
3.0.17
(complete)		PB07: minisat+
1.14
(complete)		PB07: PB-clasp
2007-04-10
(complete)		PB07: Pueblo
1.4
(incomplete)		PB07: SAT4JPseudoResolution
2007-03-23
(complete)		PB09: bsolo
3.1
(complete)		PB09: SAT4J Pseudo Resolution
2.1.1
(complete)		PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)		PB10: pb_cplex
2010-06-29
(complete)		PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		PB11: Sat4j Res//CP
2.3.0
(complete)		PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)		PB12: minisatp
1.0-2-g022594c
(complete)		pb2sat
2012-05-19
(complete)		pb2satCp2
2012-05-19
(complete)		pwbo
2.0
(complete)		pwbo
2.02
(complete)		SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)		Sat 4j PB Resolution
2.3.2 Snapshot
(complete)		SAT4J PB specific settings
2.3.2 snapshot
(complete)		SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)		SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)		SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)		toysat
2012-05-17
(complete)		toysat
2012-06-01
(complete)		wbo
1.7
(complete)		wbo
1.72
(complete)
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/ttp/
normalized-circ10_3.opb 		SAT
f=334
TT=1800.1
T1=1612.48
 SAT
f=360
TT=1798.01
T1=223.66
 SAT (TO)
f=334
TT=1800.1
T1=1612.48
 ? (TO)

TT=1800.03

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.01

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.02

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.03

 ? (TO)

TT=1800.06

 SAT (TO)
f=356
TT=1800.13
T1=157.04
 SAT (TO)
f=338
TT=1800.08
T1=821.47
 SAT (TO)
f=350
TT=1802.11
T1=1551.47
 SAT
f=346
TT=1783.01
T1=260.27
 SAT (TO)
f=348
TT=1800.03
T1=527.52
 SAT
f=354
TT=1798.05
T1=1669.51
 SAT (TO)
f=352
TT=1800.96
T1=1595.23
 ?

TT=1794.12

 SAT
f=392
TT=1798.86
T1=1799.14
 SAT (TO)
f=336
TT=1800.8
T1=266.05
 ?

TT=1789.86

 SAT (TO)
f=344
TT=1800.15
T1=22.3
 ?

TT=1797.18

 SAT (TO)
f=348
TT=1800.07
T1=1800.5
 ? (TO)

TT=1800.04

 ? (TO)

TT=1800.04

 SAT (TO)
f=334
TT=1800.07
T1=900.51
 SAT (TO)
f=338
TT=1800.12
T1=900.51
 SAT (TO)
f=336
TT=1800.04
T1=570.38
 SAT (TO)
f=340
TT=1800.03
T1=410.81
 SAT (TO)
f=344
TT=1800.09
T1=713.62
 ?

TT=1796.91

 ?

TT=1796.93

 ?

TT=1796.9

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.09

 ?

TT=1799.55

 ?

TT=1799.55
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-circ4_3.opb 		OPT
f=20
TT=0.049
T1=0
 OPT
f=20
TT=0.657
T1=0.06
 OPT
f=20
TT=0.049
T1=0
 OPT
f=20
TT=0.213
T1=0.09
 OPT
f=20
TT=0.22
T1=0.08
 OPT
f=20
TT=0.218
T1=0.06
 OPT
f=20
TT=0.181
T1=0.06
 OPT
f=20
TT=0.136
T1=0.05
 OPT
f=20
TT=0.123
T1=0.05
 OPT
f=20
TT=0.137
T1=0.05
 OPT
f=20
TT=0.126
T1=0.06
 OPT
f=20
TT=0.426
T1=0.01
 OPT
f=20
TT=0.145
T1=0.03
 OPT
f=20
TT=0.299
T1=0.1
 OPT
f=20
TT=0.087
T1=0
 OPT
f=20
TT=0.983
T1=0.27
 OPT
f=20
TT=0.495
T1=0.05
 OPT
f=20
TT=1.213
T1=0.23
 OPT
f=20
TT=6.006
T1=1.75
 OPT
f=20
TT=1.951
T1=0.68
 OPT
f=20
TT=2.143
T1=1.22
 OPT
f=20
TT=6.119
T1=0.25
 OPT
f=20
TT=1.876
T1=0.76
 OPT
f=20
TT=4.801
T1=1.28
 OPT
f=20
TT=0.099
T1=0.1
 OPT
f=20
TT=0.182
T1=0.11
 OPT
f=20
TT=0.106
T1=0.03
 OPT
f=20
TT=0.183
T1=0.08
 OPT
f=20
TT=0.183
T1=0.09
 OPT
f=20
TT=1.804
T1=0.74
 OPT
f=20
TT=0.787
T1=0.26
 OPT
f=20
TT=0.875
T1=0.34
 OPT
f=20
TT=4.771
T1=0.35
 OPT
f=20
TT=4.97
T1=0.3
 OPT
f=20
TT=3.442
T1=1.01
 OPT
f=20
TT=0.515
T1=0.02
 OPT
f=20
TT=0.518
T1=0.02
 OPT
f=20
TT=0.225
T1=0.22
 OPT
f=20
TT=0.213
T1=0.21
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-circ6_3.opb 		SAT
f=64
TT=1800.03
T1=51.22
 SAT
f=68
TT=1798.02
T1=1372.1
 SAT (TO)
f=64
TT=1800.03
T1=1263.93
 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.11

 ? (TO)

TT=1800.13

 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.13

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.13

 ? (TO)

TT=1800.01

 SAT (TO)
f=68
TT=1800.04
T1=258.59
 SAT (TO)
f=66
TT=1800.01
T1=612.38
 SAT (TO)
f=64
TT=1802.08
T1=185.72
 SAT
f=66
TT=1783
T1=726.02
 SAT (TO)
f=68
TT=1800.02
T1=1692.02
 SAT
f=68
TT=1797.91
T1=227.17
 SAT (TO)
f=66
TT=1800
T1=1128.24
 SAT
f=72
TT=1798.07
T1=479.2
 ? (TO)

TT=1800.35

 SAT (TO)
f=68
TT=1800.27
T1=5.39
 SAT
f=74
TT=1789.75
T1=5.09
 SAT (TO)
f=64
TT=1800.11
T1=51.22
 SAT
f=72
TT=1796.78
T1=946.25
 SAT (TO)
f=66
TT=1800.11
T1=1800.4
 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.13

 SAT (TO)
f=66
TT=1800.16
T1=900.31
 SAT (TO)
f=68
TT=1800.16
T1=900.31
 SAT (TO)
f=68
TT=1800.92
T1=127.56
 SAT (TO)
f=64
TT=1800.73
T1=52.53
 SAT (TO)
f=64
TT=1800.05
T1=431.99
 SAT
f=70
TT=1796.77
T1=4.99
 SAT
f=70
TT=1796.77
T1=5.42
 SAT
f=72
TT=1796.77
T1=1118.85
 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.11

 ?

TT=1799.54

 ?

TT=1799.91
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-circ8_3.opb 		SAT
f=148
TT=1800.05
T1=362.78
 SAT
f=168
TT=1798.04
T1=823.48
 SAT (TO)
f=158
TT=1800.03
T1=2.07
 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.13

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.12

 SAT (TO)
f=176
TT=1800.1
T1=18.81
 SAT (TO)
f=172
TT=1800.04
T1=322.99
 SAT (TO)
f=168
TT=1802.12
T1=324.97
 SAT
f=158
TT=1783.01
T1=1389.47
 SAT (TO)
f=170
TT=1800.15
T1=1213.16
 SAT
f=174
TT=1798.02
T1=1662.48
 SAT (TO)
f=172
TT=1800.3
T1=458.6
 SAT
f=192
TT=1792.79
T1=424.93
 ? (TO)

TT=1800.39

 SAT (TO)
f=158
TT=1800.04
T1=11.61
 SAT
f=200
TT=1790.33
T1=1347.32
 SAT (TO)
f=148
TT=1800.05
T1=362.78
 SAT
f=202
TT=1796.78
T1=672.71
 SAT (TO)
f=154
TT=1800.01
T1=1800.4
 ? (TO)

TT=1800.02

 ? (TO)

TT=1800.11

 SAT (TO)
f=160
TT=1800.02
T1=900.31
 SAT (TO)
f=160
TT=1800.16
T1=900.41
 SAT (TO)
f=150
TT=1800.57
T1=749.93
 SAT (TO)
f=154
TT=1800.05
T1=9.86
 SAT (TO)
f=166
TT=1800.02
T1=863.42
 ?

TT=1796.79

 ?

TT=1796.77

 ?

TT=1796.76

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.06

 ?

TT=1799.47

 ?

TT=1799.92
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/ttp/
normalized-data10_3.opb 		SAT
f=76666
TT=1800.16
T1=917.88
 SAT
f=77525
TT=1798.01
T1=684.2
 SAT (TO)
f=77636
TT=1800.11
T1=443.27
 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.14

 ? (TO)

TT=1800.04

 ? (TO)

TT=1800.06

 SAT (TO)
f=82252
TT=1800.16
T1=20.4
 SAT (TO)
f=79979
TT=1800.08
T1=929.18
 SAT (TO)
f=80802
TT=1802.09
T1=1540.64
 SAT
f=79920
TT=1783
T1=1561.11
 SAT (TO)
f=80523
TT=1800.02
T1=1667.71
 SAT
f=80036
TT=1798.05
T1=60.64
 SAT (TO)
f=79879
TT=1800.99
T1=1594.77
 ?

TT=1794.15

 ? (TO)

TT=1800.2

 SAT (TO)
f=79541
TT=1800.22
T1=370.86
 ?

TT=1789.86

 SAT (TO)
f=76666
TT=1800.16
T1=917.88
 ?

TT=1796.91

 SAT (TO)
f=79179
TT=1800.01
T1=1800.5
 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.12

 SAT (TO)
f=79455
TT=1800.15
T1=900.41
 SAT (TO)
f=79721
TT=1800.05
T1=900.41
 SAT (TO)
f=76795
TT=1800.09
T1=728.69
 SAT (TO)
f=82763
TT=1800.09
T1=2.14
 SAT (TO)
f=77134
TT=1800.09
T1=1595.82
 ?

TT=1796.9

 ?

TT=1796.93

 ?

TT=1796.86

 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.07

 ?

TT=1799.61

 ?

TT=1799.58
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-data4_3.opb 		OPT
f=8276
TT=0.058
T1=0.01
 OPT
f=8276
TT=0.669
T1=0.04
 OPT
f=8276
TT=0.058
T1=0.03
 OPT
f=8276
TT=6.278
T1=3.64
 OPT
f=8276
TT=6.369
T1=2.27
 OPT
f=8276
TT=5.894
T1=3.3
 OPT
f=8276
TT=12.194
T1=2.24
 OPT
f=8276
TT=1.674
T1=1.13
 OPT
f=8276
TT=0.861
T1=0.35
 OPT
f=8276
TT=1.684
T1=1.14
 OPT
f=8276
TT=0.881
T1=0.34
 OPT
f=8276
TT=0.465
T1=0.01
 OPT
f=8276
TT=1.201
T1=0.64
 OPT
f=8276
TT=0.401
T1=0.23
 OPT
f=8276
TT=0.151
T1=0.01
 OPT
f=8276
TT=1.087
T1=0.45
 OPT
f=8276
TT=0.499
T1=0.03
 OPT
f=8276
TT=1.296
T1=0.34
 OPT
f=8276
TT=7.581
T1=2.82
 OPT
f=8276
TT=3.894
T1=2.11
 OPT
f=8276
TT=2.066
T1=3.22
 OPT
f=8276
TT=7.565
T1=3.03
 OPT
f=8276
TT=1.926
T1=1.75
 OPT
f=8276
TT=4.204
T1=1.4
 OPT
f=8276
TT=0.642
T1=0.64
 OPT
f=8276
TT=5.92
T1=2.59
 OPT
f=8276
TT=2.425
T1=1.88
 OPT
f=8276
TT=0.223
T1=0.11
 OPT
f=8276
TT=0.245
T1=0.12
 OPT
f=8276
TT=1.953
T1=2.26
 OPT
f=8276
TT=0.816
T1=0.33
 OPT
f=8276
TT=0.924
T1=0.33
 OPT
f=8276
TT=4.045
T1=1.71
 OPT
f=8276
TT=4.023
T1=1.71
 OPT
f=8276
TT=6.476
T1=2.63
 OPT
f=8276
TT=0.873
T1=0.02
 OPT
f=8276
TT=0.868
T1=0.02
 ?

TT=1799.72

 ?

TT=1799.93
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-data6_3.opb 		SAT
f=23954
TT=1800.02
T1=1063.69
 SAT
f=24973
TT=1798
T1=281.68
 SAT (TO)
f=23954
TT=1800.02
T1=1063.69
 ? (TO)

TT=1800.11

 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.06

 ? (TO)

TT=1800.12

 ? (TO)

TT=1800.06

 SAT (TO)
f=25177
TT=1800.04
T1=924.89
 SAT (TO)
f=25361
TT=1800.08
T1=1600.69
 SAT (TO)
f=25011
TT=1800.1
T1=566.18
 SAT
f=24674
TT=1783.01
T1=322.31
 SAT (TO)
f=25341
TT=1800.38
T1=1515.78
 SAT
f=25836
TT=1798.02
T1=388.9
 SAT (TO)
f=25174
TT=1800.03
T1=734.66
 SAT
f=26962
TT=1798.19
T1=1408.72
 ? (TO)

TT=1800.08

 SAT (TO)
f=24491
TT=1800.01
T1=571.2
 SAT
f=27108
TT=1789.77
T1=1089.59
 SAT (TO)
f=25049
TT=1800.18
T1=171.64
 SAT
f=25981
TT=1796.77
T1=93.23
 SAT (TO)
f=25338
TT=1800.08
T1=1800.4
 ? (TO)

TT=1800.11

 ? (TO)

TT=1800.13

 SAT (TO)
f=24310
TT=1800.54
T1=900.31
 SAT (TO)
f=25084
TT=1800.04
T1=900.21
 SAT (TO)
f=24720
TT=1800.05
T1=592.85
 SAT (TO)
f=24892
TT=1800.08
T1=1555.01
 SAT (TO)
f=24415
TT=1800.03
T1=140.95
 SAT
f=26854
TT=1796.75
T1=4.88
 SAT
f=26263
TT=1796.76
T1=557.16
 SAT
f=26108
TT=1796.75
T1=1319.87
 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.1

 ?

TT=1799.57

 ?

TT=1799.84
normalized-PB06/OPT-SMALLINT/
submitted-PB05/manquinho/
ttp/normalized-data8_3.opb 		SAT
f=43606
TT=1800.05
T1=528.2
 SAT
f=49214
TT=1798.05
T1=745.15
 SAT (TO)
f=45835
TT=1800.11
T1=890.61
 ? (TO)

TT=1800.11

 ? (TO)

TT=1800.1

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.09

 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.05

 ? (TO)

TT=1800.09

 SAT (TO)
f=48865
TT=1800.09
T1=209.85
 SAT (TO)
f=48117
TT=1800.04
T1=1330.94
 SAT (TO)
f=47945
TT=1802.1
T1=690.13
 SAT
f=46692
TT=1783.01
T1=896.02
 SAT (TO)
f=48273
TT=1800.07
T1=671.1
 SAT
f=50284
TT=1798.02
T1=593.25
 SAT (TO)
f=48582
TT=1800.02
T1=1519.36
 ?

TT=1794.48

 ? (TO)

TT=1800.39

 SAT (TO)
f=44677
TT=1801.17
T1=477.67
 ?

TT=1789.74

 SAT (TO)
f=46507
TT=1800.03
T1=2.14
 SAT
f=51736
TT=1796.79
T1=858.78
 SAT (TO)
f=48235
TT=1800.1
T1=1800.5
 ? (TO)

TT=1800.07

 ? (TO)

TT=1800.08

 SAT (TO)
f=47545
TT=1800.43
T1=900.31
 SAT (TO)
f=47861
TT=1800.08
T1=900.31
 SAT (TO)
f=45233
TT=1800.16
T1=40.42
 SAT (TO)
f=43606
TT=1800.05
T1=528.2
 SAT (TO)
f=47882
TT=1800.55
T1=364.9
 SAT
f=52253
TT=1796.8
T1=204.87
 SAT
f=52253
TT=1796.77
T1=203.45
 SAT
f=52253
TT=1796.77
T1=201.51
 ? (TO)

TT=1800.08

 ? (TO)

TT=1800.05

 ?

TT=1799.77

 ?

TT=1799.97



Statisticsbsolo
3.2
(complete)		clasp
2.0.6-R5325 (opt)
(complete)		npSolver
1.0
(complete)		npSolver
1.0 (fixed)
(complete)		npSolver
inc
(complete)		npSolver
inc (fixed)
(complete)		npSolver
inc-topDown
(complete)		npSolver
inc-topDown (fixed)
(complete)		npSolver
inc-topdown-quickBound
(complete)		npSolver
inc-topdown-quickBound (fixed)
(complete)		PB07: bsolo
3.0.17
(complete)		PB07: minisat+
1.14
(complete)		PB07: PB-clasp
2007-04-10
(complete)		PB07: Pueblo
1.4
(incomplete)		PB07: SAT4JPseudoResolution
2007-03-23
(complete)		PB09: bsolo
3.1
(complete)		PB09: SAT4J Pseudo Resolution
2.1.1
(complete)		PB09: SCIPspx
SCIP 1.1.0.7 with SoPLEX 1.4.1(24.4.2009)
(complete)		PB10: pb_cplex
2010-06-29
(complete)		PB10: SAT4J PB RES // CP
2.2.0 2010-05-31
(complete)		PB10: SCIPspx
SCIP 1.2.1.3 with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver
(complete)		PB11: Sat4j Res//CP
2.3.0
(complete)		PB11: SCIP spx E_2
2011-06-10 (fixed)
(complete)		PB12: minisatp
1.0-2-g022594c
(complete)		pb2sat
2012-05-19
(complete)		pb2satCp2
2012-05-19
(complete)		pwbo
2.0
(complete)		pwbo
2.02
(complete)		SAT 4j PB RES // CP
2.3.2 Snapshot
(complete)		Sat 4j PB Resolution
2.3.2 Snapshot
(complete)		SAT4J PB specific settings
2.3.2 snapshot
(complete)		SCIP spx
SCIP 2.1.1.4. with SoPlex 1.6.0.3 fixed
(complete)		SCIP spx E
SCIP 2.1.1.4. Exp with SoPlex 1.6.0.3 fixed
(complete)		SCIP spx standard
SCIP 2.1.1.4. with SoPlex 1.6.0.3 standard fixed
(complete)		toysat
2012-05-17
(complete)		toysat
2012-06-01
(complete)		wbo
1.7
(complete)		wbo
1.72
(complete)
Number of times the solver is able to give the best known answer25222222220232202022252222022402222201
Number of times the solver is the best solver from a complete solver point of view
(i.e. best known answer and best TT time)		05000000000010000000030000000200000000