PB'12 competition: satisfaction and optimization track: solvers results per benchmarks

Result page for benchmark

Jump to solvers results

General information on the benchmark

Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-146
Best CPU time to get the best result obtained on this benchmark1796.74
Has Objective FunctionYES
(Un)Satisfiability was provedYES
Best value of the objective function -136
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1501
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)12636
Sum of products size (including duplicates)25272
Number of different products6318
Sum of products size12636

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerobjective functionCPU timeWall clock time
SCIP spx E SCIP Exp with SoPlex fixed (complete)3692586SAT-146 1796.74 1797.04
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)3737571SAT-145 1796.74 1797.06
PB07: Pueblo 1.4 (incomplete)3720491SAT-119 1783.01 1783.31
clasp 2.0.6-R5325 (opt) (complete)3709588SAT (TO)-115 1800.11 1800.41
PB07: minisat+ 1.14 (complete)3721740SAT (TO)-110 1800.06 1800.51
bsolo 3.2 (complete)3708422SAT-108 1798.03 1798.72
PB09: bsolo 3.1 (complete)3737564SAT-105 1798.02 1798.66
SAT4J PB specific settings 2.3.2 snapshot (complete)3711184SAT (TO)-101 1800.45 1787.05
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)3688754SAT (TO)-99 1800.1 932.14
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)3737567SAT (TO)-91 1800.22 932.738
PB11: Sat4j Res//CP 2.3.0 (complete)3737570SAT (TO)-91 1800.36 918.834
Sat 4j PB Resolution 2.3.2 Snapshot (complete)3688755SAT (TO)-78 1800.07 1779.75
pwbo 2.0 (complete)3704464SAT (TO)-77 1800.16 900.453
pwbo 2.02 (complete)3726765SAT (TO)-67 1800.5 900.357
SCIP spx SCIP with SoPlex fixed (complete)3691420SAT-16 1796.82 1797.11
SCIP spx standard SCIP with SoPlex standard fixed (complete)3693752SAT-16 1796.86 1797.14
PB07: bsolo 3.0.17 (complete)3737562SAT (TO)-14 1800.05 1800.92
PB10: SCIPspx SCIP with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)3737569SAT-12 1789.91 1790.2
PB09: SCIPspx SCIP with SoPLEX 1.4.1(24.4.2009) (complete)3737565SAT-12 1793.69 1793.99
PB12: minisatp 1.0-2-g022594c (complete)3724033? 0.004998 0.00748391
PB07: SAT4JPseudoResolution 2007-03-23 (complete)3737563? 2.35264 1.77435
wbo 1.72 (complete)3727961? 1799.21 1800.04
wbo 1.7 (complete)3705660? 1799.36 1800.03
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)3737566? (exit code) 574.09 566.723
npSolver inc-topdown-quickBound (fixed) (complete)3752485? (TO) 1800.05 1800.62
PB07: PB-clasp 2007-04-10 (complete)3737561? (TO) 1800.07 1889.23
toysat 2012-06-01 (complete)3725629? (TO) 1800.07 1800.41
npSolver inc-topdown-quickBound (complete)3703328? (TO) 1800.09 1800.51
npSolver inc (fixed) (complete)3749293? (TO) 1800.09 1800.41
npSolver 1.0 (fixed) (complete)3750889? (TO) 1800.09 1800.41
toysat 2012-05-17 (complete)3707256? (TO) 1800.1 1800.41
npSolver inc (complete)3700136? (TO) 1800.1 1800.41
pb2satCp2 2012-05-19 (complete)3695348? (TO) 1800.1 1800.51
npSolver inc-topDown (complete)3698540? (TO) 1800.11 1800.51
npSolver inc-topDown (fixed) (complete)3747697? (TO) 1800.11 1800.51
npSolver 1.0 (complete)3701732? (TO) 1800.12 1800.41
pb2sat 2012-05-19 (complete)3696944? (TO) 1800.12 1800.51
PB10: pb_cplex 2010-06-29 (complete)3737568? (TO) 1800.39 856.516

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

objective function: -146
Solution found:
x924 -x695 -x907 -x875 -x752 x713 x910 -x845 -x665 x855 -x801 x838 -x663 x688 x824 -x610 x911 -x637 -x586 -x958 -x943 -x705 -x936 -x593 x986
-x996 -x906 -x654 x697 -x763 x878 -x987 x657 -x577 -x983 x883 -x769 x956 -x990 x977 -x753 x742 -x721 -x681 -x655 -x951 x912 x745 -x672 x978
x719 -x826 -x616 -x792 -x848 -x575 -x939 x758 x984 x784 -x718 -x766 x850 -x761 -x633 -x564 -x621 -x642 x775 -x970 -x808 x980 x715 -x791
-x768 -x947 -x963 x902 x831 x813 -x558 x604 -x594 x762 -x892 -x790 -x972 x901 -x786 -x550 -x693 -x840 -x779 -x667 -x648 -x686 -x833 -x961
x950 x976 -x573 -x798 -x817 x788 x649 -x634 x609 -x584 -x834 x804 -x959 x909 x749 x704 -x658 x581 -x846 -x760 -x827 x962 -x615 -x885 -x643
-x861 -x748 -x995 -x579 -x542 x899 x641 -x536 -x617 -x723 x886 -x973 x793 x949 -x732 -x687 -x921 -x659 -x651 -x628 -x534 x964 x881 -x545
-x706 -x940 -x600 -x820 -x533 -x756 -x714 -x843 -x711 -x660 -x913 x888 x919 -x680 x994 x889 -x795 -x735 -x582 -x946 x608 x877 x985 x770 x701
-x630 -x555 -x967 -x596 x960 x948 -x669 -x646 x603 -x700 x664 -x661 -x895 -x934 -x931 x979 x932 -x867 -x547 -x882 -x632 -x974 -x572 x551
x897 -x683 -x563 x925 -x759 -x750 -x717 -x703 -x599 -x562 -x627 -x821 -x525 -x635 -x554 -x537 -x606 x811 -x812 -x923 -x569 -x844 -x890 -x741
-x702 -x666 -x553 -x800 -x829 -x623 -x612 -x849 x856 -x698 -x853 x734 -x526 -x670 -x955 -x591 -x645 -x522 -x954 x597 x567 -x565 x773 -x1000
-x991 x971 -x918 -x521 -x731 -x707 -x870 -x689 -x629 -x539 -x640 -x944 -x905 -x644 -x929 -x819 -x519 x839 -x726 -x685 -x580 -x576 -x530
-x859 x622 -x908 -x776 -x518 -x743 x725 -x605 -x574 -x552 x860 x728 -x992 x674 -x988 x915 -x535 -x694 -x851 x842 x729 -x765 -x516 -x682 x638
x989 x880 -x556 x952 -x746 x619 -x797 -x876 -x810 -x767 -x739 -x696 -x678 -x841 -x709 -x830 -x733 -x514 -x662 -x656 x872 -x529 -x966 x854
-x969 -x823 -x736 x557 -x857 x928 x772 -x618 x744 x708 -x639 -x613 -x520 x941 x620 -x945 x690 x866 x942 -x787 -x511 -x965 -x722 -x631 -x781
x653 x818 x903 x598 x602 -x968 x510 -x873 x532 -x571 x796 x587 -x727 x513 -x740 -x509 x982 -x862 -x799 -x774 -x747 -x684 -x601 -x677 -x561
-x933 -x900 -x755 -x652 -x904 -x789 -x508 x975 x879 -x802 -x771 -x524 x679 -x777 -x809 -x588 x751 x865 x935 -x868 -x815 x891 -x832 -x822
x647 -x614 -x611 -x595 -x589 x546 -x583 -x625 x858 x814 -x847 -x837 -x506 -x780 x738 x507 x828 -x585 -x926 -x806 -x782 -x997 -x671 -x505
-x896 -x893 -x720 -x549 -x540 -x981 -x592 -x527 -x914 -x871 x816 -x825 -x699 -x538 -x785 -x504 -x937 -x917 -x864 x710 -x676 -x675 -x578
-x515 -x920 -x874 x730 -x543 x512 -x957 x894 -x668 -x570 -x503 x998 -x953 -x898 x835 x757 -x754 -x626 -x566 x559 x523 -x803 -x636 -x624
-x531 -x783 x930 -x568 -x502 -x999 -x805 -x869 -x712 -x737 x673 -x541 x927 -x764 -x560 x691 -x528 -x501 -x938 -x852 x807 -x724 -x716 -x692
-x607 -x590 -x548 -x544 -x517 x863 x922 -x650 -x993 x836 -x794 -x916 -x778 -x887 x884 x500 x499 -x498 x497 x496 x495 -x494 x493 x492 -x491
x490 -x489 -x488 x487 -x486 -x485 -x484 x483 -x482 x481 -x480 -x479 -x478 -x477 -x476 -x475 -x474 x473 -x472 -x471 x470 -x469 x468 -x467
x466 -x465 -x464 x463 -x462 -x461 -x460 x459 -x458 x457 -x456 -x455 x454 x453 -x452 x451 -x450 -x449 -x448 x447 x446 -x445 x444 x443 -x442
-x441 -x440 x439 -x438 -x437 x436 -x435 -x434 -x433 -x432 -x431 -x430 x429 -x428 -x427 -x426 -x425 -x424 -x423 -x422 -x421 x420 -x419 -x418
x417 -x416 -x415 x414 -x413 -x412 -x411 -x410 -x409 x408 -x407 x406 x405 -x404 -x403 -x402 -x401 x400 -x399 x398 -x397 -x396 x395 -x394 x393
-x392 -x391 -x390 -x389 -x388 -x387 -x386 x385 -x384 -x383 x382 -x381 -x380 -x379 -x378 -x377 x376 x375 -x374 -x373 -x372 x371 -x370 x369
x368 x367 -x366 -x365 -x364 -x363 x362 -x361 -x360 x359 -x358 -x357 -x356 -x355 -x354 x353 x352 -x351 -x350 -x349 x348 -x347 x346 -x345 x344
x343 -x342 x341 x340 -x339 -x338 -x337 -x336 -x335 -x334 -x333 x332 -x331 -x330 x329 -x328 x327 -x326 -x325 -x324 x323 -x322 x321 x320 -x319
-x318 -x317 -x316 x315 -x314 -x313 x312 -x311 x310 -x309 -x308 -x307 -x306 -x305 -x304 x303 -x302 -x301 -x300 x299 -x298 x297 -x296 -x295
-x294 -x293 -x292 -x291 -x290 -x289 -x288 -x287 -x286 -x285 -x284 x283 -x282 -x281 -x280 -x279 -x278 x277 x276 -x275 x274 -x273 -x272 -x271
-x270 -x269 x268 -x267 -x266 x265 x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 -x256 -x255 x254 -x253 -x252 -x251 x250 -x249 x248 x247
x246 -x245 -x244 -x243 -x242 -x241 -x240 x239 -x238 x237 -x236 x235 -x234 x233 x232 x231 -x230 -x229 -x228 x227 -x226 -x225 x224 x223 -x222
-x221 x220 -x219 x218 x217 -x216 -x215 x214 -x213 -x212 -x211 -x210 x209 -x208 x207 -x206 -x205 -x204 x203 -x202 -x201 -x200 -x199 x198
-x197 -x196 -x195 -x194 x193 x192 -x191 -x190 -x189 -x188 -x187 -x186 x185 -x184 x183 x182 x181 x180 -x179 x178 x177 -x176 -x175 -x174 -x173
x172 x171 -x170 x169 -x168 x167 x166 x165 -x164 -x163 -x162 -x161 -x160 x159 -x158 -x157 x156 x155 x154 -x153 -x152 -x151 -x150 -x149 -x148
-x147 -x146 -x145 x144 -x143 -x142 -x141 -x140 -x139 -x138 x137 -x136 -x135 x134 -x133 -x132 -x131 -x130 -x129 x128 -x127 -x126 -x125 -x124
x123 -x122 -x121 -x120 -x119 -x118 -x117 x116 x115 -x114 -x113 -x112 -x111 x110 -x109 -x108 -x107 x106 x105 -x104 -x103 -x102 -x101 -x100
x99 -x98 -x97 -x96 -x95 x94 -x93 x92 -x91 -x90 -x89 -x88 -x87 -x86 -x85 -x84 -x83 x82 -x81 -x80 -x79 -x78 x77 -x76 x75 x74 -x73 -x72 -x71
-x70 -x69 -x68 -x67 x66 -x65 -x64 x63 -x62 -x61 -x60 -x59 -x58 -x57 -x56 -x55 -x54 -x53 -x52 -x51 -x50 -x49 x48 -x47 -x46 -x45 x44 -x43 -x42
-x41 -x40 x39 -x38 -x37 -x36 -x35 -x34 x33 -x32 -x31 -x30 -x29 -x28 -x27 -x26 x25 x24 -x23 -x22 x21 x20 -x19 -x18 -x17 -x16 x15 -x14 -x13
-x12 -x11 -x10 x9 -x8 -x7 -x6 x5 -x4 -x3 -x2 -x1