Trace number 51137

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerObjective functionCPU timeWall clock time
PB-smodels 1.31SAT (TO)105 1800.08 1800.43

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/
bounded_golomb_rulers/normalized-bogr_10.opb
MD5SUMdd415565c40b70127defa3137ccd18d3
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark55
Best CPU time to get the best result obtained on this benchmark1671.99
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 55
Optimality of the best value was proved YES
Number of variables895
Total number of constraints1660
Number of constraints which are clauses1
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1659
Minimum length of a constraint1
Maximum length of a constraint29
Number of terms in the objective function 7
Biggest coefficient in the objective function 45
Number of bits for the biggest coefficient in the objective function 6
Sum of the numbers in the objective function 108
Number of bits of the sum of numbers in the objective function 7
Biggest number in a constraint 144
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 741
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data (download as text)

0.00	c Running pbsmodels-v1.31
557.38	o 105
1800.42	c Somebody sent me a SIGTERM
1800.43	smodels-2.31: no process killed
1800.44	pb2smodels: no process killed
1800.44	s SATISFIABLE
1800.44	v x3 x4 x5 x6 x895 x56 x62 x63 x69 x50 x51 x52 x53 x54 x890 x43 x44 x45 x46 x47 x882 x881 x879 x878 x877 x876 x875 x36 x41 x871 x867 x866
1800.44	v x865 x864 x862 x861 x860 x859 x858 x857 x856 x855 x854 x853 x852 x851 x850 x849 x848 x847 x846 x845 x31 x33 x24 x26 x784 x774 x773
1800.44	v x760 x759 x758 x743 x742 x741 x740 x724 x723 x722 x721 x719 x718 x717 x716 x715 x714 x713 x712 x711 x710 x709 x708 x707 x706 x704
1800.44	v x703 x702 x701 x700 x699 x10 x12 x692 x682 x681 x680 x679 x666 x665 x664 x663 x662 x661 x646 x645 x644 x643 x642 x641 x640 x639
1800.44	v x623 x622 x621 x620 x618 x617 x616 x615 x612 x611 x610 x609 x608 x607 x606 x605 x604 x603 x602 x601 x600 x598 x597 x596 x595 x594
1800.44	v x593 x592 x591 x590 x589 x588 x587 x586 x585 x584 x583 x582 x581 x580 x579 x578 x577 x576 x575 x574 x573 x571 x570 x569 x568 x567
1800.44	v x566 x565 x564 x563 x562 x561 x560 x559 x16 x18 x517 x500 x496 x495 x492 x491 x473 x468 x467 x463 x462 x452 x448 x443 x442 x441
1800.44	v x440 x439 x438 x437 x436 x435 x434 x433 x432 x431 x430 x429 x428 x427 x426 x419 x418 x415 x414 x410 x409 x408 x407 x406 x405 x404
1800.44	v x403 x402 x401 x400 x399 x397 x396 x395 x394 x393 x392 x387 x384 x383 x380 x379 x375 x374 x373 x372 x371 x370 x369 x368 x367 x366
1800.44	v x365 x364 x362 x361 x360 x359 x358 x357 x307 x278 x277 x244 x243 x224 x223 x222 x218 x217 x216 x212 x211 x210 x206 x205 x204 x203
1800.44	v x202 x201 x185 x184 x183 x179 x178 x177 x172 x171 x170 x165 x164 x163 x162 x161 x160 x143 x142 x141 x137 x136 x135 x130 x129 x128
1800.44	v x127 x122 x121 x120 x119 x118 x117 x111 x108 x107 x104 x103 x99 x98 x97 x96 x95 x94 x93 x92 x91 x90 x89 x88 x86 x85 x84 x83 x82 x81
1800.44	v x78 x77 x76 x75 x74 x73 x72 x71 x70 -x1 -x2 -x57 -x58 -x59 -x60 -x61 -x64 -x65 -x66 -x67 -x68 -x894 -x49 -x55 -x893 -x892 -x891
1800.44	v -x889 -x42 -x48 -x888 -x887 -x886 -x885 -x884 -x883 -x880 -x35 -x37 -x38 -x39 -x40 -x874 -x873 -x872 -x870 -x869 -x868 -x863
1800.44	v -x28 -x29 -x30 -x32 -x34 -x844 -x843 -x842 -x841 -x840 -x839 -x838 -x837 -x836 -x835 -x834 -x833 -x832 -x831 -x830 -x829 -x828
1800.44	v -x827 -x826 -x825 -x824 -x823 -x822 -x821 -x820 -x819 -x818 -x817 -x816 -x815 -x814 -x813 -x812 -x811 -x810 -x809 -x808 -x807
1800.44	v -x806 -x805 -x804 -x803 -x802 -x801 -x800 -x799 -x798 -x797 -x796 -x795 -x794 -x793 -x792 -x791 -x790 -x21 -x22 -x23 -x25
1800.44	v -x27 -x789 -x788 -x787 -x786 -x785 -x783 -x782 -x781 -x780 -x779 -x778 -x777 -x776 -x775 -x772 -x771 -x770 -x769 -x768 -x767
1800.44	v -x766 -x765 -x764 -x763 -x762 -x761 -x757 -x756 -x755 -x754 -x753 -x752 -x751 -x750 -x749 -x748 -x747 -x746 -x745 -x744 -x739
1800.44	v -x738 -x737 -x736 -x735 -x734 -x733 -x732 -x731 -x730 -x729 -x728 -x727 -x726 -x725 -x720 -x705 -x7 -x8 -x9 -x11 -x13 -x698
1800.44	v -x697 -x696 -x695 -x694 -x693 -x691 -x690 -x689 -x688 -x687 -x686 -x685 -x684 -x683 -x678 -x677 -x676 -x675 -x674 -x673 -x672
1800.44	v -x671 -x670 -x669 -x668 -x667 -x660 -x659 -x658 -x657 -x656 -x655 -x654 -x653 -x652 -x651 -x650 -x649 -x648 -x647 -x638 -x637
1800.44	v -x636 -x635 -x634 -x633 -x632 -x631 -x630 -x629 -x628 -x627 -x626 -x625 -x624 -x619 -x614 -x613 -x599 -x572 -x14 -x15 -x17
1800.44	v -x19 -x20 -x558 -x557 -x556 -x555 -x554 -x553 -x552 -x551 -x550 -x549 -x548 -x547 -x546 -x545 -x544 -x543 -x542 -x541 -x540
1800.44	v -x539 -x538 -x537 -x536 -x535 -x534 -x533 -x532 -x531 -x530 -x529 -x528 -x527 -x526 -x525 -x524 -x523 -x522 -x521 -x520 -x519
1800.44	v -x518 -x516 -x515 -x514 -x513 -x512 -x511 -x510 -x509 -x508 -x507 -x506 -x505 -x504 -x503 -x502 -x501 -x499 -x498 -x497 -x494
1800.44	v -x493 -x490 -x489 -x488 -x487 -x486 -x485 -x484 -x483 -x482 -x481 -x480 -x479 -x478 -x477 -x476 -x475 -x474 -x472 -x471 -x470
1800.44	v -x469 -x466 -x465 -x464 -x461 -x460 -x459 -x458 -x457 -x456 -x455 -x454 -x453 -x451 -x450 -x449 -x447 -x446 -x445 -x444 -x425
1800.44	v -x424 -x423 -x422 -x421 -x420 -x417 -x416 -x413 -x412 -x411 -x398 -x391 -x390 -x389 -x388 -x386 -x385 -x382 -x381 -x378 -x377
1800.44	v -x376 -x363 -x356 -x355 -x354 -x353 -x352 -x351 -x350 -x349 -x348 -x347 -x346 -x345 -x344 -x343 -x342 -x341 -x340 -x339 -x338
1800.44	v -x337 -x336 -x335 -x334 -x333 -x332 -x331 -x330 -x329 -x328 -x327 -x326 -x325 -x324 -x323 -x322 -x321 -x320 -x319 -x318 -x317
1800.44	v -x316 -x315 -x314 -x313 -x312 -x311 -x310 -x309 -x308 -x306 -x305 -x304 -x303 -x302 -x301 -x300 -x299 -x298 -x297 -x296 -x295
1800.44	v -x294 -x293 -x292 -x291 -x290 -x289 -x288 -x287 -x286 -x285 -x284 -x283 -x282 -x281 -x280 -x279 -x276 -x275 -x274 -x273 -x272
1800.44	v -x271 -x270 -x269 -x268 -x267 -x266 -x265 -x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 -x256 -x255 -x254 -x253 -x252 -x251
1800.44	v -x250 -x249 -x248 -x247 -x246 -x245 -x242 -x241 -x240 -x239 -x238 -x237 -x236 -x235 -x234 -x233 -x232 -x231 -x230 -x229 -x228
1800.44	v -x227 -x226 -x225 -x221 -x220 -x219 -x215 -x214 -x213 -x209 -x208 -x207 -x200 -x199 -x198 -x197 -x196 -x195 -x194 -x193 -x192
1800.44	v -x191 -x190 -x189 -x188 -x187 -x186 -x182 -x181 -x180 -x176 -x175 -x174 -x173 -x169 -x168 -x167 -x166 -x159 -x158 -x157 -x156
1800.44	v -x155 -x154 -x153 -x152 -x151 -x150 -x149 -x148 -x147 -x146 -x145 -x144 -x140 -x139 -x138 -x134 -x133 -x132 -x131 -x126 -x125
1800.44	v -x124 -x123 -x116 -x115 -x114 -x113 -x112 -x110 -x109 -x106 -x105 -x102 -x101 -x100 -x87 -x80 -x79

Verifier Data (download as text)

OK	105

Watcher Data (download as text)

Enforcing CPU limit (will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime (will send SIGXCPU) limit: 1830 seconds
Enforcing Stack size limit: 67108864 bytes

runsolver version 3.0.3 (c) roussel@cril.univ-artois.fr

Enforcing memory limit (will send SIGKILL): 1843200 Kb
Enforcing VSIZE limit: 1887436800 bytes
command line: runsolver --timestamp -w ROOT/results/node60/watcher-51137-1154113012 -o ROOT/results/node60/solver-51137-1154113012 -C 1800 -M 1800 -S 64 ROOT/solvers/PB/PB06final/user4/pbsmodels-v1.31/runpbsmodels ROOT/tmp/node60/51137-1154113012/instance-51137-1154113012.opb 832051642 ROOT/tmp/node60/51137-1154113012 

Current StackSize limit: 67108864 bytes

/proc/loadavg: 1.00 1.00 1.00 3/64 1783
/proc/meminfo: memFree=1489464/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5356 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) R 1781 1783 1732 0 -1 4194304 263 0 0 0 0 0 0 0 19 0 1 0 158171040 5484544 229 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 4573744 0 0 4100 65536 0 0 0 17 1 0 0
/proc/1783/statm: 1339 230 193 169 0 50 0

[startup+10.0017 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486104/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=9.79
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 707 0 0 0 979 0 0 0 25 0 1 0 158171041 4259840 671 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553323 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 671 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 10.26
Current children cumulated vsize (Kb) 39412

[startup+20.0087 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486104/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=19.79
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 710 0 0 0 1979 0 0 0 25 0 1 0 158171041 4259840 674 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134550998 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 674 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 20.26
Current children cumulated vsize (Kb) 39412

[startup+30.0157 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486168/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=29.8
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 714 0 0 0 2980 0 0 0 25 0 1 0 158171041 4259840 678 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553486 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 678 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 30.27
Current children cumulated vsize (Kb) 39412

[startup+40.0227 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486168/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=39.8
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 715 0 0 0 3980 0 0 0 25 0 1 0 158171041 4259840 679 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553296 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 679 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 40.27
Current children cumulated vsize (Kb) 39412

[startup+50.0297 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486232/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=49.81
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 718 0 0 0 4981 0 0 0 25 0 1 0 158171041 4259840 682 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553200 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 682 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 50.28
Current children cumulated vsize (Kb) 39412

[startup+60.0357 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486232/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=59.81
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 719 0 0 0 5981 0 0 0 25 0 1 0 158171041 4259840 683 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553391 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 683 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 60.28
Current children cumulated vsize (Kb) 39412

[startup+70.0417 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486232/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=69.81
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 720 0 0 0 6981 0 0 0 25 0 1 0 158171041 4259840 684 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134551026 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 684 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 70.28
Current children cumulated vsize (Kb) 39412

[startup+80.0486 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486232/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=79.82
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 722 0 0 0 7982 0 0 0 25 0 1 0 158171041 4259840 686 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134552466 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1040 686 211 21 0 476 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 429 0 0 0 0 0 0 0 15 0 1 0 158171041 12562432 389 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 389 301 3 0 167 0
Current children cumulated CPU time (s) 80.29
Current children cumulated vsize (Kb) 39412

[startup+90.0546 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1788
/proc/meminfo: memFree=1486232/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4160 CPUtime=89.82
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 723 0 0 0 8982 0 0 0 25 0 1 0 158171041 4259840 687 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553423 0 0 4096 0 0 0 0 17 1 0 0

################
# More data... #
################

/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179254 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134533111 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1793.04
Current children cumulated vsize (Kb) 39676

[startup+1794.37 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1793.57
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179354 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553538 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1794.04
Current children cumulated vsize (Kb) 39676

[startup+1795.38 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1794.58
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179455 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134529387 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1795.05
Current children cumulated vsize (Kb) 39676

[startup+1796.38 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1795.58
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179555 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134529387 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1796.05
Current children cumulated vsize (Kb) 39676

[startup+1797.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1796.59
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179656 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134532711 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1797.06
Current children cumulated vsize (Kb) 39676

[startup+1798.39 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1797.59
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179756 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134532887 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1798.06
Current children cumulated vsize (Kb) 39676

[startup+1799.4 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1798.6
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179857 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134553320 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1799.07
Current children cumulated vsize (Kb) 39676

[startup+1800.4 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1799.6
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179957 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134532711 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (Kb) 39676



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.41 s]
/proc/loadavg: 1.00 1.00 1.00 2/68 1993
/proc/meminfo: memFree=1485656/2055920 swapFree=4184148/4192956
[pid=1783] ppid=1781 vsize=5360 CPUtime=0
/proc/1783/stat : 1783 (runpbsmodels) S 1781 1783 1732 0 -1 4194304 287 0 0 0 0 0 0 0 19 0 1 0 158171040 5488640 234 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1783/statm: 1340 234 195 169 0 51 0
[pid=1784] ppid=1783 vsize=12268 CPUtime=0
/proc/1784/stat : 1784 (pbsmodels-v1.31) S 1783 1783 1732 0 -1 4194304 425 0 0 0 0 0 0 0 18 0 1 0 158171040 12562432 383 18446744073709551615 4194304 4206940 548682069024 18446744073709551615 271903145876 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/1784/statm: 3067 383 293 3 0 167 0
[pid=1785] ppid=1784 vsize=5356 CPUtime=0.47
/proc/1785/stat : 1785 (sh) S 1784 1783 1732 0 -1 4194304 309 522 0 0 0 0 47 0 16 0 1 0 158171041 5484544 227 18446744073709551615 4194304 4889804 548682069040 18446744073709551615 271894242116 0 65536 4100 65538 18446744071563356171 0 0 17 1 0 0
/proc/1785/statm: 1339 227 188 169 0 50 0
[pid=1787] ppid=1785 vsize=4424 CPUtime=1799.61
/proc/1787/stat : 1787 (smodels-2.31) R 1785 1783 1732 0 -1 4194304 771 0 0 0 179958 3 0 0 25 0 1 0 158171041 4530176 735 18446744073709551615 134512640 134599567 4294956656 18446744073709551615 134552447 0 0 4096 0 0 0 0 17 1 0 0
/proc/1787/statm: 1106 735 214 21 0 542 0
[pid=1788] ppid=1785 vsize=12268 CPUtime=0
/proc/1788/stat : 1788 (pbout.new.pl) S 1785 1783 1732 0 -1 4194304 467 0 0 0 0 0 0 0 16 0 1 0 158171041 12562432 427 18446744073709551615 4194304 4206940 548682069056 18446744073709551615 271903141986 0 0 4224 0 18446744071563648864 0 0 17 0 0 0
/proc/1788/statm: 3067 427 333 3 0 167 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (Kb) 39676

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Child ended because it received signal 15 (SIGTERM)

!!! problem with CPU time !!!
wait4(...,&childrusage) returns 1783 and gives childrusage.ru_utime.tv_sec=0 childrusage.ru_utime.tv_usec=999 childrusage.ru_stime.tv_sec=0 childrusage.ru_stime.tv_usec=999
CPU time returned by wait4() is 0.001998
while last known CPU time is 1800.08

Solver probably didn't/couldn't wait for its children
Using last known CPU time as value...

Real time (s): 1800.43
CPU time (s): 1800.08
CPU user time (s): 1800.05
CPU system time (s): 0.03
CPU usage (%): 99.9806
Max. virtual memory (cumulated for all children) (Kb): 39676
The end

Launcher Data (download as text)

Begin job on node60 on Fri Jul 28 18:56:52 UTC 2006


FILE ID= 51137-1154113012

PBS_JOBID= 886585

BENCH NAME= HOME/pub/bench/PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/bounded_golomb_rulers/normalized-bogr_10.opb
COMMAND LINE= ROOT/solvers/PB/PB06final/user4/pbsmodels-v1.31/runpbsmodels ROOT/tmp/node60/51137-1154113012/instance-51137-1154113012.opb 832051642  ROOT/tmp/node60/51137-1154113012
RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node60/watcher-51137-1154113012 -o ROOT/results/node60/solver-51137-1154113012 -C 1800 -M 1800 -S 64  ROOT/solvers/PB/PB06final/user4/pbsmodels-v1.31/runpbsmodels ROOT/tmp/node60/51137-1154113012/instance-51137-1154113012.opb 832051642  ROOT/tmp/node60/51137-1154113012

MD5SUM SOLVER= 95562bc622ddb1f976359072aec5ad24 7fcd858753252b26b88f3383e979819a c732bc4c3aeda9195daa74a308a1f78e b7e54d975d35ab28450b6de5c14d303e f7da3270b2cd5190fa0cd9af9b854ca4
MD5SUM BENCH=  dd415565c40b70127defa3137ccd18d3

RANDOM SEED= 832051642

TIMEOUT= 1800 seconds


/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1489672 kB
Buffers:         32576 kB
Cached:         459072 kB
SwapCached:       2576 kB
Active:          53640 kB
Inactive:       446604 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1489672 kB
SwapTotal:     4192956 kB
SwapFree:      4184148 kB
Dirty:             172 kB
Writeback:           0 kB
Mapped:          14588 kB
Slab:            51940 kB
Committed_AS:  1124672 kB
PageTables:       1480 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB


End job on node60 on Fri Jul 28 19:26:53 UTC 2006