PB'12 competition: satisfaction and optimization track: solvers results per benchmarks

Result page for benchmark

Jump to solvers results

General information on the benchmark

Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark0.031994
Has Objective FunctionYES
(Un)Satisfiability was provedYES
Best value of the objective function 3
Optimality of the best value was proved YES
Number of variables90
Total number of constraints11
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints11
Minimum length of a constraint6
Maximum length of a constraint48
Number of terms in the objective function 6
Biggest coefficient in the objective function 32
Number of bits for the biggest coefficient in the objective function 6
Sum of the numbers in the objective function 63
Number of bits of the sum of numbers in the objective function 6
Biggest number in a constraint 2048
Number of bits of the biggest number in a constraint 12
Biggest sum of numbers in a constraint 8064
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)180
Sum of products size (including duplicates)360
Number of different products180
Sum of products size360

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerobjective functionCPU timeWall clock time
PB07: minisat+ 1.14 (complete)3721660OPT3 0.031994 0.0316279
SCIP spx standard SCIP with SoPlex standard fixed (complete)3693833OPT3 0.047991 0.0492709
SCIP spx SCIP with SoPlex fixed (complete)3691501OPT3 0.072988 0.074497
SCIP spx E SCIP Exp with SoPlex fixed (complete)3692667OPT3 0.081987 0.0834051
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)3736691OPT3 0.098984 0.098883
PB10: SCIPspx SCIP with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)3736689OPT3 0.226965 0.230301
PB07: Pueblo 1.4 (incomplete)3720411OPT3 0.602908 0.604308
pwbo 2.0 (complete)3704545OPT3 0.722889 0.358852
clasp 2.0.6-R5325 (opt) (complete)3709669OPT3 0.850869 0.851677
npSolver inc-topDown (fixed) (complete)3747778OPT3 0.857868 0.863595
wbo 1.72 (complete)3728042OPT3 0.932858 0.930412
wbo 1.7 (complete)3705741OPT3 0.933857 0.932135
npSolver inc (fixed) (complete)3749374OPT3 1.04784 1.05203
pwbo 2.02 (complete)3726846OPT3 1.06284 0.528534
PB09: SCIPspx SCIP with SoPLEX 1.4.1(24.4.2009) (complete)3736685OPT3 1.09783 1.09926
npSolver 1.0 (fixed) (complete)3750970OPT3 1.20182 1.19556
Sat 4j PB Resolution 2.3.2 Snapshot (complete)3688595OPT3 1.3128 0.954371
PB07: SAT4JPseudoResolution 2007-03-23 (complete)3736683OPT3 1.66275 1.2963
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)3736686OPT3 2.10468 1.66579
bsolo 3.2 (complete)3708503OPT3 2.86156 2.86425
PB07: bsolo 3.0.17 (complete)3736682OPT3 3.85041 3.85686
PB07: PB-clasp 2007-04-10 (complete)3736681OPT3 4.05538 4.06785
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)3688594OPT3 4.80427 1.68387
PB11: Sat4j Res//CP 2.3.0 (complete)3736690OPT3 5.06523 2.19596
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)3736687OPT3 6.31304 3.22785
pb2sat 2012-05-19 (complete)3697025OPT3 17.8833 17.8946
pb2satCp2 2012-05-19 (complete)3695429OPT3 21.7277 22.6501
toysat 2012-06-01 (complete)3725710OPT3 39.1391 39.1467
toysat 2012-05-17 (complete)3707337OPT3 92.8069 92.8254
npSolver inc (complete)3700217OPT3 1786.39 1786.72
SAT4J PB specific settings 2.3.2 snapshot (complete)3711265SAT3 2.04469 1.4531
PB12: minisatp 1.0-2-g022594c (complete)3724114? 0.004998 0.00794093
npSolver inc-topdown-quickBound (complete)3703409? (TO) 1800.06 1800.52
npSolver inc-topdown-quickBound (fixed) (complete)3752566? (TO) 1800.09 1807.71
npSolver inc-topDown (complete)3698621? (TO) 1800.1 1800.51
npSolver 1.0 (complete)3701813? (TO) 1800.11 1801.21
PB10: pb_cplex 2010-06-29 (complete)3736688? (TO) 1800.23 637.425
PB09: bsolo 3.1 (complete)3736684Wrong UNSAT 0.278957 0.278834

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

objective function: 3
Solution found:
x1 x2 -x3 -x4 -x5 -x6 x7 x8 x9 x10 -x11 x12 x13 x14 -x15 -x16 -x17 -x18 x19 x20 -x21 -x22 -x23 -x24 x25 x26 -x27 -x28 -x29 -x30 x31 x32 -x33
-x34 -x35 -x36 x91 x92 -x93 -x94 -x95 -x96 x97 x98 -x99 -x100 -x101 -x102 x103 x104 -x105 -x106 -x107 -x108 x109 x110 -x111 -x112 -x113
-x114 -x115 -x116 -x117 -x118 -x119 -x120 x121 x122 -x123 -x124 -x125 -x126 x37 -x38 x39 x40 -x41 -x42 -x61 x62 -x63 -x64 -x65 -x66 x127
-x128 x129 x130 -x131 -x132 x133 -x134 x135 x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151
-x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 x43 x44 x45 -x46 -x47 x48 -x67 -x68 -x69 -x70 -x71 -x72 x163 x164 x165
-x166 -x167 x168 x169 x170 x171 -x172 -x173 x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189
-x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 x49 -x50 x51 -x52 x53 x54 x73 -x74 -x75 -x76 -x77 -x78 x199 -x200 x201 -x202 x203 x204
x205 -x206 x207 -x208 x209 x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228
-x229 -x230 -x231 -x232 -x233 -x234 x55 x56 x57 x58 x59 -x60 -x79 x80 -x81 -x82 -x83 -x84 x235 x236 x237 x238 x239 -x240 x241 x242 x243 x244
x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267
-x268 -x269 -x270 x85 -x86 -x87 -x88 -x89 -x90