Trace number 3725955

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)13 1800.04 900.346

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/
benchmarks/radar/normalized-10:20:4.5:0.95:100.opb
MD5SUMf9ec307a3c8f55679d3b9ab693efbd4c
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark0.182971
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1
Optimality of the best value was proved YES
Number of variables934
Total number of constraints1063
Number of constraints which are clauses879
Number of constraints which are cardinality constraints (but not clauses)184
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint20
Number of terms in the objective function 934
Biggest coefficient in the objective function 546
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 2594
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 546
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 2594
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3725955-1338654229.opb.
0.00/0.00	c Instance file HOME/instance-3725955-1338654229.opb
0.00/0.00	c File size is 44836 bytes.
0.00/0.00	c Cost Offset: -546
0.00/0.00	c Highest Coefficient sum: 23
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      934                                                 |
0.00/0.00	c |  Number Clauses:        880                                                 |
0.00/0.00	c |  Number Cardinality:    183                                                 |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.04/900.31	o 94
1800.04/900.31	o 45
1800.04/900.31	o 31
1800.04/900.31	o 29
1800.04/900.31	o 26
1800.04/900.31	o 18
1800.04/900.31	o 14
1800.04/900.31	o 13
1800.04/900.31	c ===============================================================================
1800.04/900.31	c Wall Clock Time: 900.31 s
1800.04/900.31	c Best Solution: 13
1800.04/900.31	s SATISFIABLE
1800.04/900.31	v x854 -x783 -x198 -x103 x22 x3 x856 -x104 x2 -x786 -x385 -x273 -x197 x21 x4 x857 -x787 -x77 -x56 x24 x5 -x384 -x276 x203 -x76 -x55 -x12 x764 -x388 -x277 -x201 -x57 x25 x6 x763 -x248 -x151 x78 -x58 -x27 x7 x765 -x614 -x389 -x202 -x80 x59 x40 -x28 -x8 x766 -x613 -x514 -x251 -x206 -x150 x66 x39 x767 x619 -x252 -x81 -x60 x41 -x774 x618 -x513 -x327 -x156 -x126 x83 -x61 x42 x768 -x620 -x154 x84 -x62 x43 -x769 x624 -x594 -x574 x519 x129 -x50 -x770 x623 -x578 x517 -x155 -x130 x44 -x730 -x621 -x597 x577 -x159 x45 -x622 -x598 x518 x46 -x882 x729 x522 x853 -x782 -x193 -x105 x18 x858 -x788 x538 -x469 -x272 -x199 x23 -x15 -x542 -x72 x26 x16 x860 -x386 -x278 x204 -x109 -x71 x30 -x11 -x861 -x390 -x29 -x791 -x247 -x207 -x146 x79 x69 -x9 -x205 -x82 x70 -x812 -x777 -x639 -x509 -x392 -x323 -x281 -x253 -x152 x86 x65 -x778 -x643 -x615 -x393 x85 -x773 -x616 -x515 -x326 -x157 -x125 x63 x53 x617 x54 -x771 x628 -x593 x520 -x256 -x160 x131 -x49 -x573 -x158 -x878 -x599 -x575 x523 -x47 x579 x521 -x881 x731 -x134 -x602 x855 -x784 -x465 -x268 -x106 -x14 x859 -x380 -x192 x17 -x13 x863 -x789 x537 -x489 -x468 -x379 -x274 -x194 -x110 x19 x862 -x541 -x493 x200 -x108 x20 -x792 -x387 -x279 -x243 x196 x68 -x34 -x790 -x391 x208 -x73 x67 -x808 -x776 x395 -x302 x282 -x249 -x74 -x10 -x775 -x394 -x280 -x145 x75 -x811 -x638 -x322 x254 x147 -x121 -x90 -x52 -x642 -x508 x153 -x51 -x631 -x589 -x510 -x328 -x257 x149 -x127 x64 -x632 -x516 -x255 -x161 -x772 -x627 x595 x512 x132 -x726 x524 -x877 -x725 -x710 -x625 x600 -x331 x135 -x48 -x576 -x133 -x883 x732 -x603 -x587 -x601 x583 -x901 x733 x582 -x905 x734 x852 -x780 -x464 -x423 -x107 x851 -x785 -x427 -x267 -x111 -x867 -x781 -x663 x539 -x488 x470 -x269 -x178 x37 -x793 -x667 -x543 -x492 -x381 -x275 x195 x38 -x382 -x298 x271 -x223 x216 -x33 x383 x283 -x242 -x227 -x212 -x807 -x545 -x473 x399 -x318 -x301 -x244 -x211 -x93 -x31 -x546 x250 x94 -x813 -x640 -x630 -x324 x246 -x89 -x644 -x629 x258 x148 -x120 -x914 x837 x329 -x169 x122 -x87 -x918 -x588 x511 -x165 x128 x873 -x816 -x706 -x646 -x590 x532 -x348 -x332 -x164 x124 -x647 x596 x528 -x352 -x330 x136 -x879 -x709 -x626 x592 -x584 x527 x727 x604 -x586 -x96 x884 x728 -x95 -x900 x885 x738 -x580 x904 -x886 x870 -x534 -x466 x422 x174 -x119 -x36 x871 -x779 -x426 -x115 -x35 -x866 -x801 -x662 x540 x490 x471 -x213 -x177 -x114 -x797 -x666 -x544 -x494 x270 -x215 -x864 -x803 -x796 x548 -x474 -x451 x402 -x297 x291 -x222 -x92 -x634 x547 -x472 x403 x287 -x226 -x91 x809 -x633 -x496 x398 x303 -x286 -x209 -x32 -x497 -x317 -x245 -x833 x814 -x753 x641 -x396 -x319 x266 -x210 -x166 x645 x325 x262 -x168 -x913 x836 -x817 x649 -x529 x321 -x306 -x261 -x88 -x917 -x815 x648 -x531 -x333 x123 -x705 -x347 -x162 x144 x872 x591 -x585 -x351 -x140 x874 -x711 x612 x525 -x163 -x139 x880 -x608 x876 x741 -x607 -x562 x526 x887 x742 -x566 x97 -x902 x737 -x714 -x581 x98 x906 -x868 -x798 x485 -x462 x424 x173 -x118 -x800 -x533 -x467 -x428 -x214 -x664 -x535 x491 x463 -x447 -x401 x293 -x288 -x179 -x112 -x668 x536 -x495 x475 -x400 x290 -x865 -x794 -x552 x499 -x450 -x430 -x299 x224 -x113 -x802 -x498 -x431 x228 -x804 -x795 -x749 -x688 -x670 x304 -x284 -x263 x182 x810 -x692 -x671 -x635 x265 -x167 -x832 x806 -x752 x636 -x397 -x307 -x285 -x230 x818 x637 -x530 x320 -x305 -x231 -x915 x838 -x701 -x653 x341 -x259 x141 -x919 x337 x143 -x707 -x609 -x349 x336 -x260 -x611 -x353 -x921 -x841 -x740 x712 -x413 -x372 -x137 -x922 -x897 x875 x739 -x376 -x896 x895 x715 -x605 -x561 -x355 -x138 x891 -x713 -x565 -x356 x903 x890 x735 -x606 -x101 x907 x102 -x869 -x799 -x659 x425 x175 -x116 x484 x461 -x429 -x289 -x218 -x665 -x555 x486 -x483 -x446 -x433 x217 -x180 -x669 -x556 x487 -x479 -x432 x292 -x673 -x551 -x503 -x478 -x452 x294 x225 x183 -x672 x300 -x264 x229 x181 -x828 -x748 -x687 -x549 x296 x233 -x909 x805 x691 x308 -x232 -x908 -x834 x826 -x754 -x656 -x455 x338 x822 -x657 -x343 x340 x142 -x916 x839 x821 -x652 x342 -x920 -x700 -x610 -x924 -x842 -x757 -x702 -x650 -x409 -x350 x334 -x923 -x840 -x708 -x354 x892 x704 -x412 -x371 -x358 x335 x894 x716 x375 -x357 x563 -x100 x898 -x567 -x99 x899 x888 x736 -x554 -x480 x442 -x421 x171 -x117 -x658 -x553 -x482 x420 x176 -x660 -x506 -x448 -x437 x172 -x661 -x507 x219 x184 -x744 -x677 -x502 -x476 -x453 x220 x295 x221 -x823 -x750 -x689 -x655 -x550 -x500 -x477 x456 x316 -x237 -x827 x825 x693 -x654 x454 -x339 -x312 x829 -x755 -x311 -x910 -x835 -x911 x831 -x819 -x758 -x695 -x912 -x843 -x756 -x696 x344 -x928 -x820 -x651 x408 x345 x893 -x703 -x558 x346 x724 -x557 -x414 -x373 x362 -x720 x377 -x719 x564 -x568 -x889 x569 -x417 x570 -x505 -x481 x438 -x504 x441 x440 x170 -x680 x443 -x436 x191 -x683 -x681 -x449 x188 -x682 -x676 x445 -x434 -x313 x240 x187 -x824 -x743 x457 -x315 x241 -x745 x690 -x674 -x501 -x236 x751 x694 x747 x698 -x309 -x234 x830 x759 x697 -x931 x850 x406 -x310 -x932 -x847 -x368 -x927 -x846 x721 x410 -x367 x365 x723 x366 -x925 x415 -x374 x361 -x559 x378 x933 -x717 -x560 -x418 x359 -x416 -x718 -x679 x439 x190 -x678 x189 x239 x444 -x314 x238 x460 -x435 x185 -x684 x458 x685 -x675 x459 x186 x746 x686 -x930 x849 x762 x699 -x235 -x929 x848 x760 -x761 x364 x722 x405 x363 -x844 x404 x411 -x369 -x926 -x845 x407 -x370 x419 x572 x934 x360 x571 x1

Verifier Data 

OK	13

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3725955-1338654229/watcher-3725955-1338654229 -o /tmp/evaluation-result-3725955-1338654229/solver-3725955-1338654229 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725955-1338654229.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.84 3.97 3.84 3/178 32723
/proc/meminfo: memFree=28356560/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=4500 CPUtime=0 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) R 32721 32723 30509 0 -1 4202496 458 0 0 0 0 0 0 0 20 0 1 0 331547348 4608000 411 33554432000 4194304 5964478 140733446106416 140736578294376 5136490 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 1125 412 169 433 0 678 0

[startup+0.0499171 s]
/proc/loadavg: 3.84 3.97 3.84 3/178 32723
/proc/meminfo: memFree=28356560/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=172920 CPUtime=0.08 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 5562 0 0 0 6 2 0 0 20 0 3 0 331547348 177070080 5465 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 43230 5465 204 433 0 42794 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 172920

[startup+0.100209 s]
/proc/loadavg: 3.84 3.97 3.84 3/178 32723
/proc/meminfo: memFree=28356560/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=184736 CPUtime=0.17 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 10813 0 0 0 10 7 0 0 20 0 3 0 331547348 189169664 10703 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 46184 10703 204 433 0 45748 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 184736

[startup+0.300169 s]
/proc/loadavg: 3.84 3.97 3.84 3/178 32723
/proc/meminfo: memFree=28356560/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191012 CPUtime=0.57 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 13238 0 0 0 48 9 0 0 20 0 3 0 331547348 195596288 13992 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47753 13992 205 433 0 47317 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 191012

[startup+0.700169 s]
/proc/loadavg: 3.84 3.97 3.84 3/178 32723
/proc/meminfo: memFree=28356560/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191012 CPUtime=1.38 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 14458 0 0 0 127 11 0 0 20 0 3 0 331547348 195596288 14695 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47753 14695 206 433 0 47317 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 191012

[startup+1.5003 s]
/proc/loadavg: 3.84 3.97 3.84 5/181 32726
/proc/meminfo: memFree=28297616/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191012 CPUtime=2.97 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 15711 0 0 0 286 11 0 0 20 0 3 0 331547348 195596288 15486 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47753 15486 206 433 0 47317 0
[pid=32723/tid=32725] ppid=32721 vsize=191012 CPUtime=1.47 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 3758 0 0 0 146 1 0 0 20 0 3 0 331547348 195596288 15486 33554432000 4194304 5964478 140733446106416 140696542341464 4403727 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=191012 CPUtime=1.48 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 11002 0 0 0 137 11 0 0 20 0 3 0 331547348 195596288 15486 33554432000 4194304 5964478 140733446106416 140696531851624 4403411 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 191012

[startup+3.10029 s]
/proc/loadavg: 3.84 3.97 3.84 5/181 32726
/proc/meminfo: memFree=28292704/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191012 CPUtime=6.17 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 16657 0 0 0 605 12 0 0 20 0 3 0 331547348 195596288 16358 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47753 16358 206 433 0 47317 0
[pid=32723/tid=32725] ppid=32721 vsize=191012 CPUtime=3.07 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 4615 0 0 0 306 1 0 0 20 0 3 0 331547348 195596288 16358 33554432000 4194304 5964478 140733446106416 140696542341656 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=191012 CPUtime=3.07 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 11091 0 0 0 296 11 0 0 20 0 3 0 331547348 195596288 16358 33554432000 4194304 5964478 140733446106416 140696531851384 4392882 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 191012

[startup+6.30037 s]
/proc/loadavg: 3.86 3.97 3.84 5/181 32726
/proc/meminfo: memFree=28284652/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191012 CPUtime=12.57 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 18216 0 0 0 1244 13 0 0 20 0 3 0 331547348 195596288 17916 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47753 17916 206 433 0 47317 0
[pid=32723/tid=32725] ppid=32721 vsize=191012 CPUtime=6.27 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 5939 0 0 0 625 2 0 0 20 0 3 0 331547348 195596288 17916 33554432000 4194304 5964478 140733446106416 140696542341656 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=191012 CPUtime=6.26 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 11326 0 0 0 615 11 0 0 20 0 3 0 331547348 195596288 17916 33554432000 4194304 5964478 140733446106416 140696531851384 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 191012

[startup+12.7004 s]
/proc/loadavg: 3.87 3.97 3.84 5/181 32726
/proc/meminfo: memFree=28273864/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191012 CPUtime=25.37 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 20971 0 0 0 2522 15 0 0 20 0 3 0 331547348 195596288 20594 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47753 20594 206 433 0 47317 0
[pid=32723/tid=32725] ppid=32721 vsize=191012 CPUtime=12.64 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 8247 0 0 0 1261 3 0 0 20 0 3 0 331547348 195596288 20594 33554432000 4194304 5964478 140733446106416 140696542341656 4403671 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=191012 CPUtime=12.64 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 11773 0 0 0 1253 11 0 0 20 0 3 0 331547348 195596288 20594 33554432000 4194304 5964478 140733446106416 140696531851624 4400010 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 191012

[startup+25.5004 s]
/proc/loadavg: 3.90 3.97 3.84 5/181 32726
/proc/meminfo: memFree=28259092/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=191496 CPUtime=50.96 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 24161 0 0 0 5079 17 0 0 20 0 3 0 331547348 196091904 23784 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 47874 23784 206 433 0 47438 0
[pid=32723/tid=32725] ppid=32721 vsize=191496 CPUtime=25.41 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 10552 0 0 0 2537 4 0 0 20 0 3 0 331547348 196091904 23784 33554432000 4194304 5964478 140733446106416 140696542340920 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=191496 CPUtime=25.41 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 12658 0 0 0 2529 12 0 0 20 0 3 0 331547348 196091904 23784 33554432000 4194304 5964478 140733446106416 140696531851384 4399938 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 191496

[startup+51.1004 s]
/proc/loadavg: 3.93 3.97 3.84 5/181 32726
/proc/meminfo: memFree=28225084/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=192616 CPUtime=102.15 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 32821 0 0 0 10193 22 0 0 20 0 3 0 331547348 197238784 32444 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 48154 32444 206 433 0 47718 0
[pid=32723/tid=32725] ppid=32721 vsize=192616 CPUtime=50.94 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 17418 0 0 0 5086 8 0 0 20 0 3 0 331547348 197238784 32444 33554432000 4194304 5964478 140733446106416 140696542341112 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=192616 CPUtime=50.94 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 14452 0 0 0 5080 14 0 0 20 0 3 0 331547348 197238784 32444 33554432000 4194304 5964478 140733446106416 140696531851096 4399854 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.15
Current children cumulated vsize (KiB) 192616

[startup+102.307 s]
/proc/loadavg: 3.97 3.97 3.85 5/181 32726
/proc/meminfo: memFree=28151208/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=259412 CPUtime=204.55 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 47482 0 0 0 20415 40 0 0 20 0 3 0 331547348 265637888 47105 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 64853 47105 206 433 0 64417 0
[pid=32723/tid=32725] ppid=32721 vsize=259412 CPUtime=102.02 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 28408 0 0 0 10181 21 0 0 20 0 3 0 331547348 265637888 47105 33554432000 4194304 5964478 140733446106416 140696542341112 4399912 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=259412 CPUtime=102.02 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 18123 0 0 0 10182 20 0 0 20 0 3 0 331547348 265637888 47105 33554432000 4194304 5964478 140733446106416 140696531851624 4399915 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.55
Current children cumulated vsize (KiB) 259412

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.85 5/181 32726
/proc/meminfo: memFree=28073256/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=392060 CPUtime=324.53 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 60540 0 0 0 32396 57 0 0 20 0 3 0 331547348 401469440 60163 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 98015 60163 206 433 0 97579 0
[pid=32723/tid=32725] ppid=32721 vsize=392060 CPUtime=161.86 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 36960 0 0 0 16152 34 0 0 20 0 3 0 331547348 401469440 60163 33554432000 4194304 5964478 140733446106416 140696542341112 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=392060 CPUtime=161.86 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 22629 0 0 0 16160 26 0 0 20 0 3 0 331547348 401469440 60163 33554432000 4194304 5964478 140733446106416 140696531851576 4399915 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.53
Current children cumulated vsize (KiB) 392060

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.86 5/181 32726
/proc/meminfo: memFree=27919660/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=392456 CPUtime=444.5 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 72858 0 0 0 44381 69 0 0 20 0 3 0 331547348 401874944 72481 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 98114 72481 206 433 0 97678 0
[pid=32723/tid=32725] ppid=32721 vsize=392456 CPUtime=221.71 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 44911 0 0 0 22128 43 0 0 20 0 3 0 331547348 401874944 72481 33554432000 4194304 5964478 140733446106416 140696542340712 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=392456 CPUtime=221.7 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 26996 0 0 0 22139 31 0 0 20 0 3 0 331547348 401874944 72481 33554432000 4194304 5964478 140733446106416 140696531851576 4399915 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.5
Current children cumulated vsize (KiB) 392456

[startup+282.3 s]
/proc/loadavg: 3.99 3.97 3.86 5/181 32726
/proc/meminfo: memFree=27805392/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=459748 CPUtime=564.48 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 86467 0 0 0 56364 84 0 0 20 0 3 0 331547348 470781952 86090 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 114937 86090 206 433 0 114501 0
[pid=32723/tid=32725] ppid=32721 vsize=459748 CPUtime=281.55 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 51238 0 0 0 28104 51 0 0 20 0 3 0 331547348 470781952 86090 33554432000 4194304 5964478 140733446106416 140696542340920 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=459748 CPUtime=281.55 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 34278 0 0 0 28115 40 0 0 20 0 3 0 331547348 470781952 86090 33554432000 4194304 5964478 140733446106416 140696531851576 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.48
Current children cumulated vsize (KiB) 459748

[startup+342.3 s]
/proc/loadavg: 3.93 3.94 3.86 5/181 300
/proc/meminfo: memFree=28540192/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=525696 CPUtime=684.41 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 98415 0 0 0 68342 99 0 0 20 0 3 0 331547348 538312704 98330 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 131424 98330 206 433 0 130988 0

################
# More data... #
################

[pid=32723/tid=32726] ppid=32721 vsize=525696 CPUtime=341.36 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 40489 0 0 0 34088 48 0 0 20 0 3 0 331547348 538312704 98330 33554432000 4194304 5964478 140733446106416 140696531851576 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.41
Current children cumulated vsize (KiB) 525696

[startup+402.3 s]
/proc/loadavg: 3.97 3.95 3.86 5/182 303
/proc/meminfo: memFree=28359792/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=592600 CPUtime=804.32 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 113847 0 0 0 80309 123 0 0 20 0 3 0 331547348 606822400 113895 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 148150 113895 206 433 0 147714 0
[pid=32723/tid=32725] ppid=32721 vsize=592600 CPUtime=401.17 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 66968 0 0 0 40039 78 0 0 20 0 3 0 331547348 606822400 113895 33554432000 4194304 5964478 140733446106416 140696542341112 5136420 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=592600 CPUtime=401.21 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 45928 0 0 0 40064 57 0 0 20 0 3 0 331547348 606822400 113895 33554432000 4194304 5964478 140733446106416 140696531851624 4387996 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.32
Current children cumulated vsize (KiB) 592600

[startup+462.3 s]
/proc/loadavg: 3.99 3.96 3.87 5/181 303
/proc/meminfo: memFree=28269060/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=595104 CPUtime=924.26 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 126834 0 0 0 92287 139 0 0 20 0 3 0 331547348 609386496 126821 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 148776 126821 206 433 0 148340 0
[pid=32723/tid=32725] ppid=32721 vsize=595104 CPUtime=461 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 72702 0 0 0 46015 85 0 0 20 0 3 0 331547348 609386496 126821 33554432000 4194304 5964478 140733446106416 140696542340920 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=595104 CPUtime=461.02 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 53181 0 0 0 46037 65 0 0 20 0 3 0 331547348 609386496 126821 33554432000 4194304 5964478 140733446106416 140696531851576 4392863 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.26
Current children cumulated vsize (KiB) 595104

[startup+522.3 s]
/proc/loadavg: 3.99 3.96 3.88 5/181 303
/proc/meminfo: memFree=28106108/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=661040 CPUtime=1044.2 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 139303 0 0 0 104266 154 0 0 20 0 3 0 331547348 676904960 140488 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 165260 140488 206 433 0 164824 0
[pid=32723/tid=32725] ppid=32721 vsize=661040 CPUtime=520.81 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 78188 0 0 0 51987 94 0 0 20 0 3 0 331547348 676904960 140488 33554432000 4194304 5964478 140733446106416 140696542341112 5244295 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=661040 CPUtime=520.86 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 60164 0 0 0 52013 73 0 0 20 0 3 0 331547348 676904960 140489 33554432000 4194304 5964478 140733446106416 140696531851576 4392745 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.2
Current children cumulated vsize (KiB) 661040

[startup+582.3 s]
/proc/loadavg: 3.99 3.97 3.88 5/181 303
/proc/meminfo: memFree=27933344/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=728552 CPUtime=1164.18 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 156929 0 0 0 116244 174 0 0 20 0 3 0 331547348 746037248 158114 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 182138 158114 206 433 0 181702 0
[pid=32723/tid=32725] ppid=32721 vsize=728552 CPUtime=580.66 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 84566 0 0 0 57963 103 0 0 20 0 3 0 331547348 746037248 158114 33554432000 4194304 5964478 140733446106416 140696542340920 4392707 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=728552 CPUtime=580.7 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 71412 0 0 0 57984 86 0 0 20 0 3 0 331547348 746037248 158114 33554432000 4194304 5964478 140733446106416 140696531851576 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.18
Current children cumulated vsize (KiB) 728552

[startup+642.3 s]
/proc/loadavg: 3.99 3.97 3.89 5/181 304
/proc/meminfo: memFree=27811976/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=795472 CPUtime=1284.17 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 164790 0 0 0 128232 185 0 0 20 0 3 0 331547348 814563328 165974 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 198868 165974 206 433 0 198432 0
[pid=32723/tid=32725] ppid=32721 vsize=795472 CPUtime=640.51 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 87428 0 0 0 63941 110 0 0 20 0 3 0 331547348 814563328 165974 33554432000 4194304 5964478 140733446106416 140696542340920 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=795472 CPUtime=640.56 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 76411 0 0 0 63964 92 0 0 20 0 3 0 331547348 814563328 165974 33554432000 4194304 5964478 140733446106416 140696531851576 4399915 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.17
Current children cumulated vsize (KiB) 795472

[startup+702.3 s]
/proc/loadavg: 4.05 3.99 3.90 5/182 305
/proc/meminfo: memFree=27688064/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=796600 CPUtime=1404.14 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 176848 0 0 0 140212 202 0 0 20 0 3 0 331547348 815718400 178032 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 199150 178032 206 433 0 198714 0
[pid=32723/tid=32725] ppid=32721 vsize=796600 CPUtime=700.35 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 93052 0 0 0 69915 120 0 0 20 0 3 0 331547348 815718400 178032 33554432000 4194304 5964478 140733446106416 140696542340920 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=796600 CPUtime=700.4 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 82845 0 0 0 69938 102 0 0 20 0 3 0 331547348 815718400 178032 33554432000 4194304 5964478 140733446106416 140696531851576 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.14
Current children cumulated vsize (KiB) 796600

[startup+762.307 s]
/proc/loadavg: 4.02 3.99 3.90 5/181 305
/proc/meminfo: memFree=27558272/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=921040 CPUtime=1524.13 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 196085 0 0 0 152169 244 0 0 20 0 3 0 331547348 943144960 195810 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 230260 195810 206 433 0 229824 0
[pid=32723/tid=32725] ppid=32721 vsize=921040 CPUtime=760.2 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 103782 0 0 0 75864 156 0 0 20 0 3 0 331547348 943144960 195810 33554432000 4194304 5964478 140733446106416 140696542341656 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=921040 CPUtime=760.25 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 91352 0 0 0 75915 110 0 0 20 0 3 0 331547348 943144960 195810 33554432000 4194304 5964478 140733446106416 140696531851576 4400059 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.13
Current children cumulated vsize (KiB) 921040

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 305
/proc/meminfo: memFree=27452284/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=923088 CPUtime=1644.11 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 204764 0 0 0 164154 257 0 0 20 0 3 0 331547348 945242112 204489 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 230772 204489 206 433 0 230336 0
[pid=32723/tid=32725] ppid=32721 vsize=923088 CPUtime=820.04 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 103879 0 0 0 81847 157 0 0 20 0 3 0 331547348 945242112 204489 33554432000 4194304 5964478 140733446106416 140696542341656 4400001 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=923088 CPUtime=820.09 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 99934 0 0 0 81886 123 0 0 20 0 3 0 331547348 945242112 204489 33554432000 4194304 5964478 140733446106416 140696531851624 4403343 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.11
Current children cumulated vsize (KiB) 923088

[startup+882.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 305
/proc/meminfo: memFree=27351888/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=988624 CPUtime=1764.05 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 211465 0 0 0 176136 269 0 0 20 0 3 0 331547348 1012350976 211183 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 247156 211183 206 433 0 246720 0
[pid=32723/tid=32725] ppid=32721 vsize=988624 CPUtime=879.89 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 104049 0 0 0 87831 158 0 0 20 0 3 0 331547348 1012350976 211183 33554432000 4194304 5964478 140733446106416 140696542341656 4400006 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=988624 CPUtime=879.9 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 106465 0 0 0 87854 136 0 0 20 0 3 0 331547348 1012350976 211183 33554432000 4194304 5964478 140733446106416 140696531851576 4399915 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.05
Current children cumulated vsize (KiB) 988624



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 305
/proc/meminfo: memFree=27324452/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=988624 CPUtime=1800.04 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 214494 0 0 0 179730 274 0 0 20 0 3 0 331547348 1012350976 214215 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 247156 214215 206 433 0 246720 0
[pid=32723/tid=32725] ppid=32721 vsize=988624 CPUtime=897.85 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 104049 0 0 0 89627 158 0 0 20 0 3 0 331547348 1012350976 214215 33554432000 4194304 5964478 140733446106416 140696542341656 4399952 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=988624 CPUtime=897.85 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 109494 0 0 0 89643 142 0 0 20 0 3 0 331547348 1012350976 214215 33554432000 4194304 5964478 140733446106416 140696531851576 4399854 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 988624

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 305
/proc/meminfo: memFree=27324452/32873844 swapFree=7644/7644
[pid=32723] ppid=32721 vsize=988624 CPUtime=1800.04 cores=0,2,4,6
/proc/32723/stat : 32723 (pwbo2.02) S 32721 32723 30509 0 -1 4202496 214494 0 0 0 179730 274 0 0 20 0 3 0 331547348 1012350976 214215 33554432000 4194304 5964478 140733446106416 140733446105936 4546685 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32723/statm: 247156 214215 206 433 0 246720 0
[pid=32723/tid=32725] ppid=32721 vsize=988624 CPUtime=897.85 cores=0,2,4,6
/proc/32723/task/32725/stat : 32725 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 104049 0 0 0 89627 158 0 0 20 0 3 0 331547348 1012350976 214215 33554432000 4194304 5964478 140733446106416 140696542341656 4399952 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32723/tid=32726] ppid=32721 vsize=988624 CPUtime=897.85 cores=0,2,4,6
/proc/32723/task/32726/stat : 32726 (pwbo2.02) R 32721 32723 30509 0 -1 4202560 109494 0 0 0 89643 142 0 0 20 0 3 0 331547348 1012350976 214215 33554432000 4194304 5964478 140733446106416 140696531851576 4399854 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 988624

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32723 and gives
#  childrusage.ru_utime.tv_sec=1792
#  childrusage.ru_utime.tv_usec=723464
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=54535
# CPU time returned by wait4() is 1795.78
# while last known CPU time is 1800.04
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.346
CPU time (s): 1800.04
CPU user time (s): 1797.3
CPU system time (s): 2.74
CPU usage (%): 199.928
Max. virtual memory (cumulated for all children) (KiB): 988624

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1792.72
system time used= 3.05454
maximum resident set size= 856864
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 214495
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 651
involuntary context switches= 1981

runsolver used 1.79973 second user time and 5.2672 second system time

The end

Launcher Data 

Begin job on node147 at 2012-06-02 18:23:49
IDJOB=3725955
IDBENCH=2227
IDSOLVER=2309
FILE ID=node147/3725955-1338654229
RUNJOBID= node147-1338651516-32281
PBS_JOBID= 14636433
Free space on /tmp= 70780 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/benchmarks/radar/normalized-10:20:4.5:0.95:100.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3725955-1338654229/watcher-3725955-1338654229 -o /tmp/evaluation-result-3725955-1338654229/solver-3725955-1338654229 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725955-1338654229.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f9ec307a3c8f55679d3b9ab693efbd4c
RANDOM SEED=1815066888

node147.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.87
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.951
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28356560 kB
Buffers:          424184 kB
Cached:          2469192 kB
SwapCached:         3380 kB
Active:          2176588 kB
Inactive:        1481928 kB
Active(anon):     760956 kB
Inactive(anon):     5920 kB
Active(file):    1415632 kB
Inactive(file):  1476008 kB
Unevictable:        7644 kB
Mlocked:            7644 kB
SwapTotal:      67108856 kB
SwapFree:       67100236 kB
Dirty:              5448 kB
Writeback:             0 kB
AnonPages:        769572 kB
Mapped:            10580 kB
Shmem:                 0 kB
Slab:             719644 kB
SReclaimable:     160904 kB
SUnreclaim:       558740 kB
KernelStack:        1472 kB
PageTables:         5420 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     170928 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    397312 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70772 MiB
End job on node147 at 2012-06-02 18:38:52