PB'12 competition: satisfaction and optimization track: solvers results per benchmarks

Result page for benchmark

Jump to solvers results

General information on the benchmark

Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-146
Best CPU time to get the best result obtained on this benchmark1796.83
Has Objective FunctionYES
(Un)Satisfiability was provedYES
Best value of the objective function -139
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1501
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)12632
Sum of products size (including duplicates)25264
Number of different products6316
Sum of products size12632

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerobjective functionCPU timeWall clock time
SCIP spx E SCIP Exp with SoPlex fixed (complete)3692588SAT-146 1796.83 1797.12
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)3737494SAT-146 1796.85 1797.16
clasp 2.0.6-R5325 (opt) (complete)3709590SAT (TO)-116 1800.11 1800.41
PB07: minisat+ 1.14 (complete)3721733SAT (TO)-115 1800.03 1800.41
bsolo 3.2 (complete)3708424SAT-107 1798.01 1798.58
PB09: bsolo 3.1 (complete)3737487SAT-106 1798.02 1798.66
SAT4J PB specific settings 2.3.2 snapshot (complete)3711186SAT (TO)-103 1800.08 1787.65
PB07: Pueblo 1.4 (incomplete)3720484SAT-100 1783.01 1783.33
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)3688740SAT (TO)-98 1800.15 940.039
PB11: Sat4j Res//CP 2.3.0 (complete)3737493SAT (TO)-94 1800.23 919.161
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)3737490SAT (TO)-94 1800.45 937.027
pwbo 2.0 (complete)3704466SAT (TO)-81 1800.05 900.341
Sat 4j PB Resolution 2.3.2 Snapshot (complete)3688741SAT (TO)-74 1800.03 1788.66
pwbo 2.02 (complete)3726767SAT (TO)-72 1800.58 900.462
PB10: SCIPspx SCIP with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)3737492SAT-20 1789.79 1790.07
PB07: bsolo 3.0.17 (complete)3737485SAT (TO)-16 1800.12 1802.98
SCIP spx standard SCIP with SoPlex standard fixed (complete)3693754SAT-15 1796.77 1797.07
SCIP spx SCIP with SoPlex fixed (complete)3691422SAT-15 1796.78 1797.08
PB09: SCIPspx SCIP with SoPLEX 1.4.1(24.4.2009) (complete)3737488SAT-14 1794.22 1794.51
PB12: minisatp 1.0-2-g022594c (complete)3724035? 0.003999 0.00701404
PB07: SAT4JPseudoResolution 2007-03-23 (complete)3737486? 2.36264 1.79381
wbo 1.72 (complete)3727963? 1799.41 1800.1
wbo 1.7 (complete)3705662? 1799.56 1800.06
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)3737489? (exit code) 1040.3 1031.44
PB07: PB-clasp 2007-04-10 (complete)3737484? (TO) 1514.6 2093.53
npSolver inc (fixed) (complete)3749295? (TO) 1800.04 1800.51
npSolver inc-topDown (fixed) (complete)3747699? (TO) 1800.06 1800.41
toysat 2012-06-01 (complete)3725631? (TO) 1800.07 1800.41
toysat 2012-05-17 (complete)3707258? (TO) 1800.07 1800.41
npSolver inc-topdown-quickBound (fixed) (complete)3752487? (TO) 1800.08 1800.41
npSolver inc-topDown (complete)3698542? (TO) 1800.09 1800.41
npSolver inc-topdown-quickBound (complete)3703330? (TO) 1800.09 1800.41
npSolver inc (complete)3700138? (TO) 1800.09 1800.41
pb2satCp2 2012-05-19 (complete)3695350? (TO) 1800.1 1800.51
PB10: pb_cplex 2010-06-29 (complete)3737491? (TO) 1800.1 1076.32
npSolver 1.0 (fixed) (complete)3750891? (TO) 1800.13 1800.62
pb2sat 2012-05-19 (complete)3696946? (TO) 1800.13 1800.51
npSolver 1.0 (complete)3701734? (TO) 1800.15 1800.62

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

objective function: -146
Solution found:
x972 -x966 -x919 -x636 -x861 -x917 -x717 -x934 -x847 -x605 -x902 -x677 -x979 x779 -x987 x849 -x662 -x701 x629 x888 -x913 -x850 x995 -x879
-x881 -x935 x971 x929 -x901 -x756 -x710 -x818 -x865 -x631 x680 -x589 x718 -x798 -x910 x767 -x719 -x764 -x706 -x583 -x801 x813 -x870 -x597
-x666 -x909 -x856 -x880 -x612 -x797 -x954 x980 -x961 -x873 -x698 -x577 x915 -x556 -x864 -x760 -x725 x632 -x615 -x670 -x651 x946 -x885 -x735
x942 x630 -x897 -x592 x552 -x758 -x693 -x997 x793 x943 -x694 x561 -x794 -x904 x857 -x679 -x600 -x560 -x911 x827 -x752 -x696 x982 -x755 -x884
-x628 x922 -x551 -x555 -x546 x970 -x959 -x585 x784 -x674 -x686 -x860 -x683 x825 x641 -x624 -x608 -x547 x721 x749 x668 -x862 -x918 x736 x832
x895 x606 -x903 x763 -x619 x722 -x855 x957 -x947 -x744 x682 -x566 -x541 -x730 -x754 x587 -x834 -x780 x1000 -x688 -x609 x990 -x663 -x819
-x713 x731 x673 -x635 -x921 -x581 -x665 -x965 -x729 -x610 -x690 -x633 -x891 x930 -x912 -x697 -x650 -x700 -x664 x958 x676 -x720 -x598 -x595
-x750 -x703 -x726 -x766 -x738 x550 x815 -x675 -x578 -x528 x768 -x621 -x584 -x709 -x981 -x527 -x773 -x611 -x787 -x596 x839 x705 -x920 -x853
-x711 -x593 x762 -x778 -x928 -x733 -x525 -x848 x753 -x742 -x734 x808 -x962 -x821 -x833 x823 -x524 -x892 -x772 -x751 -x554 -x538 -x659 -x846
-x876 -x989 -x534 -x523 x977 -x967 -x824 -x820 x814 -x656 -x654 x618 -x639 -x645 -x564 -x599 x692 -x974 x956 -x940 -x836 x580 -x530 -x800
-x843 -x667 -x840 x571 -x520 x810 -x594 -x851 -x607 -x708 -x714 -x545 -x519 x933 -x644 -x620 -x775 -x985 x657 -x518 x932 -x788 -x770 x614
-x601 x548 -x844 x828 x944 -x789 -x748 -x991 x875 -x783 x671 x575 x691 x533 -x893 x811 -x712 -x949 -x771 -x952 -x627 x590 -x563 -x988 -x785
-x732 -x890 x660 x586 -x704 -x536 -x514 x964 x863 -x521 x515 -x723 -x746 -x716 -x602 x871 x852 -x945 -x689 x544 -x513 -x937 x869 x829 -x582
-x532 -x526 -x535 -x931 -x739 -x553 x950 -x973 -x795 -x512 -x845 -x803 x616 -x565 -x543 -x672 -x724 -x681 -x804 x728 -x817 -x511 -x777 -x737
-x684 -x678 -x558 -x522 -x622 -x994 -x899 x830 -x510 x960 -x638 x540 -x537 -x806 x757 -x984 -x646 -x874 -x999 x769 x907 -x927 -x509 -x841
-x761 x626 -x613 -x604 -x539 x914 -x992 x741 x727 x707 x905 -x978 -x567 x854 x868 -x826 -x792 -x617 -x517 -x816 x743 x812 -x951 -x998 -x882
x867 -x661 x658 -x623 -x568 x924 -x809 x634 x878 x968 -x572 x872 x642 x506 x831 x936 -x805 -x687 x786 -x837 -x898 -x549 -x838 x625 -x790
-x505 -x906 x883 -x835 x796 x699 -x685 -x647 -x570 -x557 -x529 -x900 x983 -x923 -x653 -x782 -x948 -x889 -x588 -x993 -x649 -x504 -x953 -x807
-x781 -x745 -x640 -x695 -x569 -x791 -x579 -x916 -x562 -x507 x975 -x637 x715 -x503 -x963 -x887 x652 x576 -x559 x508 x955 -x799 -x969 x938
x886 x648 -x774 x759 x939 -x643 -x502 -x996 -x655 -x542 -x516 -x896 x702 x976 -x842 -x603 x740 x894 -x925 -x501 x908 -x866 x858 -x822 -x776
-x591 -x574 -x531 x859 x765 -x802 -x877 -x573 x926 -x941 -x669 -x986 -x747 -x500 -x499 -x498 x497 -x496 -x495 x494 x493 x492 x491 -x490
-x489 x488 -x487 -x486 x485 x484 -x483 -x482 x481 -x480 x479 -x478 -x477 -x476 -x475 x474 -x473 -x472 -x471 -x470 -x469 -x468 x467 x466 x465
-x464 x463 x462 -x461 -x460 x459 -x458 -x457 -x456 -x455 -x454 x453 x452 x451 -x450 -x449 -x448 x447 -x446 x445 -x444 -x443 -x442 x441 -x440
-x439 -x438 x437 -x436 -x435 x434 -x433 -x432 -x431 -x430 -x429 -x428 -x427 -x426 x425 -x424 x423 -x422 x421 x420 -x419 -x418 -x417 -x416
-x415 -x414 x413 -x412 -x411 -x410 -x409 -x408 -x407 x406 -x405 -x404 x403 -x402 x401 -x400 x399 -x398 x397 x396 -x395 -x394 x393 -x392 x391
-x390 -x389 -x388 x387 -x386 x385 -x384 -x383 -x382 -x381 -x380 x379 -x378 -x377 x376 -x375 x374 -x373 -x372 -x371 x370 -x369 -x368 -x367
-x366 x365 -x364 -x363 -x362 -x361 -x360 -x359 -x358 -x357 -x356 -x355 -x354 x353 -x352 x351 -x350 -x349 x348 x347 -x346 x345 x344 x343 x342
x341 -x340 -x339 -x338 -x337 -x336 -x335 x334 x333 -x332 -x331 -x330 -x329 -x328 -x327 -x326 -x325 -x324 -x323 x322 x321 -x320 -x319 -x318
-x317 -x316 -x315 -x314 -x313 -x312 -x311 -x310 -x309 -x308 -x307 x306 -x305 -x304 -x303 x302 -x301 x300 -x299 -x298 -x297 -x296 x295 x294
-x293 -x292 x291 -x290 x289 -x288 x287 -x286 -x285 -x284 x283 x282 x281 x280 -x279 -x278 x277 x276 -x275 -x274 x273 -x272 x271 -x270 -x269
-x268 -x267 -x266 -x265 -x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 x256 x255 -x254 -x253 -x252 x251 -x250 -x249 -x248 -x247 -x246 -x245
-x244 -x243 -x242 -x241 -x240 x239 x238 -x237 -x236 x235 -x234 -x233 x232 -x231 x230 x229 -x228 -x227 -x226 x225 x224 x223 -x222 -x221 x220
x219 -x218 -x217 -x216 -x215 x214 -x213 -x212 -x211 -x210 x209 x208 -x207 x206 -x205 -x204 -x203 -x202 -x201 x200 -x199 x198 x197 -x196
-x195 -x194 -x193 -x192 -x191 -x190 -x189 -x188 -x187 -x186 x185 x184 -x183 -x182 -x181 -x180 -x179 -x178 x177 -x176 x175 -x174 -x173 -x172
-x171 x170 x169 -x168 -x167 x166 -x165 x164 x163 x162 x161 -x160 -x159 -x158 -x157 x156 x155 -x154 x153 -x152 x151 -x150 x149 -x148 x147
x146 x145 -x144 x143 -x142 -x141 x140 -x139 -x138 -x137 -x136 -x135 -x134 x133 -x132 x131 -x130 -x129 -x128 -x127 -x126 -x125 x124 x123
-x122 -x121 -x120 x119 -x118 -x117 -x116 x115 -x114 x113 -x112 x111 -x110 -x109 -x108 x107 -x106 x105 -x104 -x103 -x102 -x101 -x100 -x99
-x98 -x97 -x96 -x95 x94 x93 -x92 -x91 -x90 -x89 x88 -x87 -x86 x85 -x84 x83 x82 -x81 -x80 -x79 x78 x77 -x76 -x75 -x74 x73 x72 -x71 -x70 -x69
-x68 -x67 -x66 -x65 x64 x63 x62 -x61 -x60 x59 -x58 -x57 -x56 -x55 -x54 x53 -x52 -x51 -x50 -x49 -x48 -x47 -x46 x45 -x44 -x43 -x42 -x41 -x40
-x39 -x38 -x37 -x36 -x35 x34 -x33 x32 -x31 -x30 -x29 -x28 -x27 -x26 -x25 x24 -x23 -x22 -x21 -x20 -x19 -x18 -x17 x16 -x15 -x14 -x13 -x12 -x11
-x10 -x9 -x8 -x7 -x6 -x5 -x4 -x3 -x2 -x1