PB'12 competition: satisfaction and optimization track: solvers results per benchmarks

Result page for benchmark

Jump to solvers results

General information on the benchmark

Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark0.017996
Has Objective FunctionYES
(Un)Satisfiability was provedYES
Best value of the objective function 3
Optimality of the best value was proved YES
Number of variables42
Total number of constraints5
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints5
Minimum length of a constraint7
Maximum length of a constraint63
Number of terms in the objective function 7
Biggest coefficient in the objective function 64
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 127
Number of bits of the sum of numbers in the objective function 7
Biggest number in a constraint 8192
Number of bits of the biggest number in a constraint 14
Biggest sum of numbers in a constraint 32512
Number of bits of the biggest sum of numbers15
Number of products (including duplicates)98
Sum of products size (including duplicates)196
Number of different products98
Sum of products size196

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerobjective functionCPU timeWall clock time
PB07: minisat+ 1.14 (complete)3721650OPT3 0.017996 0.0181571
SCIP spx SCIP with SoPlex fixed (complete)3691505OPT3 0.037993 0.038894
SCIP spx standard SCIP with SoPlex standard fixed (complete)3693837OPT3 0.045992 0.0468901
SCIP spx E SCIP Exp with SoPlex fixed (complete)3692671OPT3 0.05799 0.058936
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)3736581OPT3 0.079987 0.0814749
clasp 2.0.6-R5325 (opt) (complete)3709673OPT3 0.132978 0.133646
PB10: SCIPspx SCIP with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)3736579OPT3 0.153976 0.153563
npSolver inc (fixed) (complete)3749378OPT3 0.217966 0.221462
wbo 1.7 (complete)3705745OPT3 0.231964 0.229974
wbo 1.72 (complete)3728046OPT3 0.232964 0.229589
npSolver 1.0 (fixed) (complete)3750974OPT3 0.252961 0.257284
PB07: Pueblo 1.4 (incomplete)3720401OPT3 0.31795 0.321456
pwbo 2.0 (complete)3704549OPT3 0.341947 0.168687
pwbo 2.02 (complete)3726850OPT3 0.381941 0.190191
PB07: PB-clasp 2007-04-10 (complete)3736571OPT3 0.436933 0.445696
PB09: SCIPspx SCIP with SoPLEX 1.4.1(24.4.2009) (complete)3736575OPT3 0.451931 0.453421
PB07: bsolo 3.0.17 (complete)3736572OPT3 0.471927 0.478358
Sat 4j PB Resolution 2.3.2 Snapshot (complete)3688575OPT3 0.6539 0.430495
PB07: SAT4JPseudoResolution 2007-03-23 (complete)3736573OPT3 0.831872 0.588582
npSolver inc-topDown (fixed) (complete)3747782OPT3 0.944855 0.945757
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)3736576OPT3 0.954853 0.624501
bsolo 3.2 (complete)3708507OPT3 1.2998 1.30229
toysat 2012-05-17 (complete)3707341OPT3 2.10668 2.1078
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)3688574OPT3 2.11468 2.67372
toysat 2012-06-01 (complete)3725714OPT3 2.12268 2.1241
PB11: Sat4j Res//CP 2.3.0 (complete)3736580OPT3 3.00554 2.18113
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)3736577OPT3 3.2585 3.20758
PB10: pb_cplex 2010-06-29 (complete)3736578OPT3 8.5367 2.96304
pb2sat 2012-05-19 (complete)3697029OPT3 178.458 178.661
pb2satCp2 2012-05-19 (complete)3695433OPT3 181.278 181.49
npSolver inc-topDown (complete)3698625OPT3 353.993 354.732
npSolver 1.0 (complete)3701817OPT3 612.692 613.069
npSolver inc (complete)3700221OPT3 963.687 964.065
SAT4J PB specific settings 2.3.2 snapshot (complete)3711269SAT3 0.923858 0.580083
PB12: minisatp 1.0-2-g022594c (complete)3724118? 0.004998 0.00713907
npSolver inc-topdown-quickBound (fixed) (complete)3752570? (TO) 1800.07 1802.41
npSolver inc-topdown-quickBound (complete)3703413? (TO) 1800.07 1801.12
PB09: bsolo 3.1 (complete)3736574Wrong UNSAT 0.39194 0.391263

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

objective function: 3
Solution found:
x1 x2 -x3 -x4 -x5 -x6 -x7 x8 -x9 -x10 x11 x12 -x13 x14 x15 x16 -x17 -x18 -x19 -x20 -x21 x43 x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53
-x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 x64 x65 -x66 -x67 -x68 -x69 -x70 x71 x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82
-x83 -x84 x85 x86 -x87 -x88 -x89 -x90 -x91 x22 x23 -x24 x25 -x26 -x27 -x28 -x29 x30 -x31 -x32 -x33 -x34 -x35 x92 x93 -x94 x95 -x96 -x97 -x98
x99 x100 -x101 x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122
-x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x36 -x37 -x38 -x39 -x40 -x41