PB'12 competition: satisfaction and optimization track: solvers results per benchmarks

Result page for benchmark

Jump to solvers results

General information on the benchmark

Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-144
Best CPU time to get the best result obtained on this benchmark1796.77
Has Objective FunctionYES
(Un)Satisfiability was provedYES
Best value of the objective function -139
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1501
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)12652
Sum of products size (including duplicates)25304
Number of different products6326
Sum of products size12652

Results of the different solvers on this benchmark

Solver NameTraceIDAnswerobjective functionCPU timeWall clock time
SCIP spx E SCIP Exp with SoPlex fixed (complete)3692589SAT-144 1796.77 1797.05
PB11: SCIP spx E_2 2011-06-10 (fixed) (complete)3737417SAT-144 1796.89 1797.18
clasp 2.0.6-R5325 (opt) (complete)3709591SAT (TO)-115 1800.11 1800.41
PB07: minisat+ 1.14 (complete)3721726SAT (TO)-109 1800.05 1800.62
PB09: bsolo 3.1 (complete)3737410SAT-106 1798.03 1798.89
PB07: Pueblo 1.4 (incomplete)3720477SAT-105 1783.01 1783.33
bsolo 3.2 (complete)3708425SAT-105 1798.01 1798.63
SAT4J PB specific settings 2.3.2 snapshot (complete)3711187SAT (TO)-103 1800.07 1788.35
SAT 4j PB RES // CP 2.3.2 Snapshot (complete)3688726SAT (TO)-98 1800.56 934.439
PB11: Sat4j Res//CP 2.3.0 (complete)3737416SAT (TO)-95 1800.12 922.032
PB10: SAT4J PB RES // CP 2.2.0 2010-05-31 (complete)3737413SAT (TO)-90 1800.08 941.828
pwbo 2.0 (complete)3704467SAT (TO)-87 1800.16 900.43
Sat 4j PB Resolution 2.3.2 Snapshot (complete)3688727SAT (TO)-78 1800.06 1765.46
pwbo 2.02 (complete)3726768SAT (TO)-69 1800.38 900.357
PB07: bsolo 3.0.17 (complete)3737408SAT (TO)-24 1800.16 1801.08
PB10: SCIPspx SCIP with SoPlex 1.4.2 (CVS Version 30.5.2010) as LP solver (complete)3737415SAT-19 1789.73 1790.07
SCIP spx SCIP with SoPlex fixed (complete)3691423SAT-18 1796.77 1797.06
SCIP spx standard SCIP with SoPlex standard fixed (complete)3693755SAT-18 1796.79 1797.08
PB09: SCIPspx SCIP with SoPLEX 1.4.1(24.4.2009) (complete)3737411SAT-12 1794.46 1794.74
PB12: minisatp 1.0-2-g022594c (complete)3724036? 0.004998 0.00655488
PB07: SAT4JPseudoResolution 2007-03-23 (complete)3737409? 2.35364 1.79665
wbo 1.72 (complete)3727964? 1799.38 1800.05
wbo 1.7 (complete)3705663? 1799.87 1800.03
PB09: SAT4J Pseudo Resolution 2.1.1 (complete)3737412? (exit code) 489.51 483.23
PB07: PB-clasp 2007-04-10 (complete)3737407? (TO) 1647.23 1900.02
npSolver inc-topdown-quickBound (complete)3703331? (TO) 1800.05 1800.41
pb2satCp2 2012-05-19 (complete)3695351? (TO) 1800.05 1800.51
toysat 2012-05-17 (complete)3707259? (TO) 1800.06 1800.41
npSolver inc (complete)3700139? (TO) 1800.07 1800.41
toysat 2012-06-01 (complete)3725632? (TO) 1800.09 1800.41
npSolver 1.0 (complete)3701735? (TO) 1800.09 1800.41
npSolver inc-topDown (fixed) (complete)3747700? (TO) 1800.09 1800.62
npSolver 1.0 (fixed) (complete)3750892? (TO) 1800.1 1800.41
pb2sat 2012-05-19 (complete)3696947? (TO) 1800.1 1800.62
npSolver inc (fixed) (complete)3749296? (TO) 1800.11 1800.41
npSolver inc-topdown-quickBound (fixed) (complete)3752488? (TO) 1800.13 1800.51
npSolver inc-topDown (complete)3698543? (TO) 1800.14 1800.62
PB10: pb_cplex 2010-06-29 (complete)3737414? (TO) 1800.31 818.516

Additionnal information

This section presents information obtained from the best job displayed in the list (i.e. solvers whose names are not hidden).

objective function: -144
Solution found:
-x774 -x830 -x914 -x753 -x818 x636 x812 x906 x737 x923 -x729 -x684 x946 -x993 -x964 -x917 x733 -x683 -x713 -x643 -x761 x735 x723 -x829 -x726
-x804 -x615 -x797 -x859 -x846 x580 -x659 -x828 -x611 x594 x995 -x744 x944 x870 -x572 -x831 -x743 -x736 -x998 x931 -x835 -x567 -x861 x971
-x680 -x576 -x656 -x895 x740 -x901 -x646 -x706 x698 -x626 -x562 -x867 x728 x722 -x565 x929 -x789 -x686 -x658 x760 -x838 -x814 -x558 -x691
x666 -x862 -x925 x694 x709 -x952 -x891 -x677 -x759 -x734 x552 -x583 -x936 -x582 -x796 -x834 -x913 -x654 x619 -x960 -x875 -x564 x911 -x782
-x618 x621 -x662 -x857 -x793 -x710 -x872 x958 x751 -x772 x876 -x788 -x672 -x937 -x881 x652 -x651 x863 -x550 -x839 -x791 -x767 x588 -x561
-x675 x673 -x924 -x877 -x837 x978 -x624 x1000 -x790 -x918 x750 -x935 -x548 -x919 x630 -x900 -x546 -x581 -x637 -x850 -x535 -x649 -x786 x832
x747 x840 -x851 -x534 x898 -x858 -x536 x957 -x809 -x968 -x533 -x951 -x941 -x909 -x908 -x856 -x720 -x977 x604 -x833 -x916 -x799 x540 -x953
-x600 -x593 -x687 -x617 -x824 -x554 -x836 -x606 x975 -x644 -x991 -x887 x930 x642 -x934 x693 -x665 -x607 -x899 x779 -x989 -x762 -x892 -x622
-x531 x585 -x805 -x625 -x586 -x551 x928 x841 x685 -x739 -x525 x704 -x689 -x579 -x549 -x669 x959 -x855 x890 -x667 -x616 x871 x888 -x696 x976
-x523 x792 -x629 -x566 -x596 -x956 -x559 -x522 x716 -x714 -x553 -x702 x768 -x539 -x781 x985 -x820 x843 -x543 -x813 -x922 -x794 -x563 -x530
-x520 -x938 -x764 -x610 x758 -x614 x866 x992 -x773 x708 -x647 -x592 -x663 -x547 x674 x730 x896 x979 -x518 -x798 -x731 -x653 -x641 x587 -x590
x803 -x679 -x770 x860 x682 -x785 -x608 -x577 -x639 x655 -x578 -x516 -x893 -x854 -x745 -x645 -x602 -x542 -x638 -x849 -x921 -x869 -x724 -x537
-x515 -x598 -x852 -x987 -x660 x910 -x771 -x514 -x950 -x882 -x842 -x815 x727 x711 -x670 -x632 x556 -x927 -x884 x826 -x664 -x885 x983 x949
-x920 x766 -x756 -x695 -x668 -x571 x589 x945 -x712 x981 -x697 x765 -x980 -x521 -x512 -x954 x819 -x808 -x776 -x717 -x865 -x897 -x853 -x678
x627 -x513 -x879 x511 -x816 x810 x763 x699 -x544 -x703 x742 x707 x967 -x681 -x671 -x609 x986 -x940 x878 -x847 -x749 -x825 -x912 -x990 -x889
-x746 -x705 x528 -x524 -x657 x806 -x661 x868 x933 -x988 -x800 -x634 x947 -x807 x778 -x754 -x752 -x612 -x569 -x939 x974 -x603 -x997 -x591
-x907 x970 -x966 x783 x628 -x575 -x527 -x508 -x640 -x692 x932 -x994 x573 x732 x738 -x506 -x999 -x633 -x509 -x817 x507 -x755 x996 -x787 x873
x822 -x568 -x948 x690 -x505 -x972 -x963 -x701 -x560 -x517 -x748 -x844 -x973 -x599 x943 -x532 -x845 x676 -x777 -x880 -x504 x926 -x801 -x784
x613 -x601 -x595 -x570 x962 -x984 x725 x795 -x620 -x700 -x757 x905 x874 -x503 -x848 -x688 -x635 -x557 -x631 -x821 -x721 -x883 -x823 x719
-x574 -x780 -x969 -x605 -x502 -x961 -x894 x769 -x741 -x648 -x597 x519 -x718 -x650 -x902 x942 x903 x915 -x904 -x965 -x715 -x955 x501 -x982
-x811 -x623 x555 -x541 -x510 -x545 x886 -x529 -x526 x538 x864 x827 -x775 -x584 x802 -x500 x499 x498 -x497 -x496 -x495 -x494 x493 -x492 -x491
-x490 -x489 x488 x487 -x486 -x485 x484 -x483 x482 -x481 -x480 -x479 -x478 x477 -x476 -x475 -x474 x473 x472 -x471 -x470 -x469 -x468 -x467
-x466 x465 x464 x463 -x462 x461 x460 -x459 -x458 -x457 x456 -x455 x454 -x453 -x452 -x451 x450 -x449 x448 -x447 -x446 -x445 -x444 -x443 -x442
x441 x440 x439 x438 -x437 -x436 -x435 -x434 -x433 -x432 -x431 -x430 -x429 -x428 -x427 -x426 -x425 -x424 -x423 -x422 x421 x420 -x419 x418
x417 -x416 -x415 x414 x413 x412 -x411 -x410 x409 -x408 x407 -x406 -x405 x404 -x403 -x402 x401 x400 -x399 -x398 -x397 -x396 x395 x394 x393
x392 x391 -x390 -x389 -x388 -x387 -x386 -x385 x384 x383 -x382 x381 x380 -x379 -x378 x377 -x376 x375 -x374 -x373 x372 -x371 -x370 x369 -x368
-x367 -x366 -x365 -x364 -x363 x362 x361 -x360 -x359 x358 -x357 -x356 x355 x354 -x353 -x352 x351 x350 x349 x348 -x347 x346 -x345 x344 -x343
x342 -x341 -x340 -x339 -x338 x337 -x336 -x335 -x334 x333 -x332 -x331 -x330 -x329 x328 -x327 -x326 -x325 x324 -x323 -x322 x321 x320 -x319
x318 x317 -x316 -x315 -x314 -x313 -x312 -x311 -x310 x309 x308 x307 -x306 x305 x304 -x303 -x302 -x301 -x300 x299 x298 -x297 -x296 -x295 x294
-x293 -x292 -x291 -x290 -x289 -x288 x287 -x286 x285 -x284 -x283 -x282 x281 x280 -x279 -x278 x277 -x276 -x275 -x274 -x273 x272 -x271 -x270
-x269 -x268 -x267 -x266 -x265 -x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 x256 x255 x254 -x253 x252 -x251 -x250 -x249 x248 -x247 x246
-x245 -x244 -x243 -x242 x241 -x240 x239 -x238 -x237 x236 -x235 x234 -x233 -x232 -x231 -x230 x229 -x228 -x227 x226 -x225 x224 -x223 -x222
x221 -x220 -x219 -x218 -x217 -x216 -x215 -x214 -x213 -x212 -x211 -x210 -x209 -x208 -x207 -x206 -x205 -x204 -x203 x202 x201 x200 -x199 -x198
-x197 -x196 x195 -x194 -x193 -x192 x191 -x190 -x189 -x188 -x187 -x186 -x185 -x184 x183 -x182 x181 -x180 x179 x178 -x177 -x176 x175 -x174
-x173 -x172 x171 x170 -x169 -x168 x167 -x166 -x165 -x164 -x163 -x162 x161 x160 x159 x158 -x157 x156 -x155 -x154 -x153 -x152 -x151 x150 -x149
-x148 -x147 x146 x145 -x144 -x143 -x142 x141 -x140 x139 x138 x137 -x136 -x135 -x134 -x133 x132 -x131 -x130 -x129 -x128 -x127 -x126 x125
-x124 -x123 -x122 -x121 -x120 -x119 -x118 -x117 x116 -x115 x114 -x113 -x112 -x111 x110 x109 -x108 -x107 -x106 -x105 -x104 -x103 -x102 -x101
-x100 -x99 -x98 -x97 x96 x95 -x94 -x93 x92 x91 -x90 -x89 -x88 -x87 -x86 -x85 -x84 -x83 x82 x81 -x80 -x79 x78 -x77 -x76 -x75 -x74 -x73 -x72
-x71 -x70 x69 -x68 -x67 -x66 -x65 -x64 -x63 -x62 x61 -x60 -x59 -x58 x57 -x56 -x55 x54 -x53 -x52 x51 -x50 x49 -x48 -x47 -x46 -x45 -x44 -x43
x42 -x41 -x40 -x39 -x38 -x37 -x36 -x35 -x34 -x33 x32 -x31 -x30 -x29 -x28 -x27 -x26 -x25 -x24 -x23 -x22 -x21 -x20 -x19 -x18 -x17 x16 -x15
-x14 -x13 -x12 -x11 -x10 -x9 -x8 -x7 -x6 -x5 -x4 x3 -x2 -x1