Trace number 3703649

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)4053 1800.19 900.332

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/
~walser/benchmarks/course-ass/normalized-ws97-5.opb
MD5SUMed36462db2ffa04ea65b986069441496
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark2642
Best CPU time to get the best result obtained on this benchmark0.050991
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 2642
Optimality of the best value was proved YES
Number of variables907
Total number of constraints403
Number of constraints which are clauses126
Number of constraints which are cardinality constraints (but not clauses)277
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint134
Number of terms in the objective function 748
Biggest coefficient in the objective function 240
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 33855
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 240
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 33855
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703649-1338091036.opb.
0.00/0.00	c Instance file HOME/instance-3703649-1338091036.opb
0.00/0.00	c File size is 32858 bytes.
0.00/0.00	c Cost Offset: -415
0.00/0.00	c Highest Coefficient sum: 182
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      907                                                 |
0.00/0.00	c |  Number Clauses:        387                                                 |
0.00/0.00	c |  Number Cardinality:    276                                                 |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    PB Constraint                                       |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.19/900.31	o 5950
1800.19/900.31	o 5474
1800.19/900.31	o 4858
1800.19/900.31	o 4455
1800.19/900.31	o 4358
1800.19/900.31	o 4258
1800.19/900.31	o 4154
1800.19/900.31	o 4057
1800.19/900.31	o 4055
1800.19/900.31	o 4053
1800.19/900.31	c ===============================================================================
1800.19/900.31	c Wall Clock Time: 900.31 s
1800.19/900.31	c Best Solution: 4053
1800.19/900.31	s SATISFIABLE
1800.19/900.31	v -x2 x128 -x506 -x641 x775 -x5 x257 x509 -x6 -x132 x258 -x384 x510 -x7 x133 -x259 -x511 x8 -x134 -x513 x9 -x135 -x514 x389 x517 x12 -x138 -x518 -x13 x139 x519 x15 -x393 -x521 -x16 x142 -x268 -x522 -x17 x395 x523 x18 -x144 -x524 x19 -x397 -x525 -x20 -x526 x660 -x21 x147 x527 x22 -x274 -x528 -x23 -x529 x663 -x24 x150 x530 -x25 x151 x531 -x26 -x152 x404 x532 x27 -x153 -x533 -x28 x154 x534 -x29 x407 x535 -x30 x408 x536 x31 -x157 -x537 -x32 x158 -x538 x33 -x159 x673 -x807 -x34 x160 -x286 x540 -x35 x161 x541 -x288 x414 -x37 x163 x543 -x38 x164 x544 -x39 x165 x545 -x40 -x546 -x680 x814 -x41 x167 x547 x42 -x420 -x548 -x43 x169 x549 -x44 x422 x550 -x45 x171 x551 x552 -x46 x172 -x553 x687 x47 -x173 -x554 -x48 x174 -x426 x555 -x49 -x175 x427 -x556 x50 -x176 -x557 x429 -x52 -x178 x559 -x53 x179 x560 x432 x695 -x829 -x55 -x181 x433 -x562 -x56 x434 x563 -x57 x309 -x564 -x698 x832 -x58 x436 x565 -x59 x437 x566 x567 -x60 x186 x568 x569 x61 -x570 -x704 x838 -x62 x188 x571 -x63 -x315 x441 x572 -x706 -x840 x64 -x190 -x573 x65 -x317 -x574 x66 -x318 -x575 x67 -x319 -x576 -x68 x194 -x577 x711 -x69 -x195 x321 -x578 x712 -x846 -x70 x196 -x448 x579 x71 -x197 -x580 x72 -x581 x715 x73 -x199 -x582 x74 -x583 x75 -x201 -x584 -x76 x202 x585 x77 -x203 -x586 -x79 -x205 -x331 x457 -x588 -x80 x458 -x589 x723 -x590 -x82 -x208 x334 -x460 -x591 x83 -x335 -x592 -x84 x336 -x462 -x593 x727 x728 -x862 -x86 x212 -x595 x729 -x863 -x87 -x213 x465 x596 -x88 x214 -x597 -x731 x865 x89 -x215 -x598 x90 -x468 -x599 x733 -x91 -x217 x469 x600 -x601 -x93 x219 x603 -x94 x220 x604 x95 -x221 -x605 x739 -x873 -x97 x223 x607 x350 -x476 x742 x99 -x225 -x609 -x100 x352 -x478 -x610 x744 -x878 -x227 -x745 x879 x228 -x746 x880 -x103 -x229 x355 -x481 x613 -x104 -x230 x356 -x482 -x614 x105 -x615 x749 -x106 -x232 -x358 x484 -x616 -x107 x617 -x108 -x234 x486 x618 x109 -x235 -x619 -x110 x236 -x620 x754 -x111 -x237 -x363 x489 -x621 -x755 x889 x757 -x891 -x114 x366 x624 -x241 -x116 x242 -x494 -x626 x760 -x117 x243 x627 -x628 -x762 x896 x118 -x496 -x629 -x119 x371 -x631 -x765 x899 -x120 x632 -x766 -x900 x121 -x247 -x633 x767 -x901 -x122 x374 x634 -x123 x375 -x501 -x635 x124 -x636 x904 -x125 -x377 x503 -x637 x771 -x905 x772 -x906 -x127 -x639 x773 -x3 -x129 -x507 -x4 -x508 -x642 -x131 -x643 -x777 -x644 -x778 -x385 -x645 x779 -x646 x780 -x260 x647 -x781 -x261 -x387 x648 -x782 -x262 x388 -x137 -x390 -x265 -x391 -x653 -x787 x655 -x789 -x656 x790 -x143 -x657 -x791 -x270 -x658 x792 -x271 -x659 x793 -x146 -x272 -x273 -x399 -x661 -x795 -x148 -x400 -x662 x796 -x149 -x401 -x276 -x664 -x798 -x277 -x403 -x665 -x799 -x278 -x666 -x800 -x279 -x405 x667 -x801 -x280 -x406 -x668 -x802 -x155 -x281 -x669 -x803 -x156 -x282 -x670 -x804 -x284 -x410 -x672 x806 -x412 -x287 -x413 -x675 -x809 -x676 x810 -x290 -x416 -x678 -x812 -x291 -x417 -x679 -x813 -x166 x292 -x418 -x293 -x681 -x815 -x295 -x421 -x683 -x817 -x170 -x684 -x818 -x297 -x423 -x685 -x819 -x686 -x820 -x298 -x424 -x821 -x300 -x689 -x823 -x301 x690 -x824 -x302 -x428 x691 -x825 -x51 -x177 -x303 -x558 x692 -x826 x304 -x430 -x693 -x827 -x305 -x431 -x694 -x828 -x54 -x180 -x306 -x561 -x307 x696 -x830 -x182 -x697 -x831 -x183 -x435 -x184 -x310 -x699 -x833 -x185 -x311 -x701 -x835 -x312 -x438 -x702 -x836 -x703 -x837 -x187 -x313 -x439 -x314 -x440 -x705 -x839 -x189 -x316 -x707 x841 -x191 -x443 -x708 x842 -x192 -x444 -x193 -x445 x710 -x844 -x320 -x446 -x845 -x447 -x322 -x847 -x323 -x449 x714 -x848 -x198 -x324 -x450 -x325 -x451 x716 -x850 -x326 -x717 x851 -x327 -x453 x718 -x852 -x328 -x454 -x719 -x853 -x329 -x455 -x720 x854 x722 -x856 -x206 -x332 -x857 -x207 -x725 x859 -x209 -x461 -x338 -x464 -x339 -x730 -x864 -x340 -x466 -x341 -x467 x732 -x866 -x216 -x342 -x867 -x343 -x734 -x868 -x218 -x345 -x737 -x871 -x346 -x472 -x738 -x872 -x347 -x473 -x348 x740 -x874 -x349 -x741 -x875 -x351 -x477 x743 -x877 -x226 -x353 x479 -x354 -x480 -x747 -x881 x748 -x882 -x750 x884 -x485 -x751 -x885 -x360 -x361 -x487 -x753 x887 -x362 -x488 -x888 x756 -x890 -x239 -x491 -x492 -x758 -x892 -x115 x367 -x493 -x625 -x368 -x894 -x369 -x495 -x761 -x895 -x244 -x370 x763 -x897 -x246 -x498 -x373 -x499 -x248 -x500 -x768 -x902 -x376 -x502 -x126 -x638 -x253 x379 -x505 -x907 x1 -x10 -x11 -x14 -x36 -x78 -x81 -x85 -x92 -x96 -x98 -x101 -x102 -x112 -x113 -x130 -x136 -x140 -x141 -x145 -x162 -x168 -x200 -x204 -x210 -x211 -x222 -x224 -x231 -x233 -x238 -x240 -x245 -x249 -x250 -x251 -x252 -x254 x255 -x256 -x263 -x264 x266 -x267 -x269 x275 -x283 -x285 -x289 -x294 -x296 -x299 -x308 -x330 -x333 x337 -x344 -x357 x359 x364 x365 x372 -x378 -x380 -x381 x382 -x383 -x386 -x392 -x394 -x396 x398 -x402 -x409 -x411 -x415 -x419 -x425 -x442 -x452 x456 x459 -x463 x470 -x471 x474 -x475 -x483 -x490 -x497 x504 -x512 -x515 -x516 -x520 -x539 -x542 x587 -x594 -x602 -x606 -x608 -x611 -x612 -x622 -x623 -x630 -x640 -x649 x650 -x651 -x652 -x654 x671 -x674 -x677 -x682 -x688 -x700 -x709 -x713 -x721 -x724 -x726 x735 x736 -x752 -x759 -x764 x769 -x770 x774 x776 x783 -x784 -x785 x786 x788 -x794 -x797 -x805 -x808 -x811 x816 x822 -x834 x843 -x849 -x855 x858 x860 -x861 -x869 -x870 -x876 -x883 -x886 x893 x898 -x903

Verifier Data 

OK	4053

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703649-1338091036/watcher-3703649-1338091036 -o /tmp/evaluation-result-3703649-1338091036/solver-3703649-1338091036 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703649-1338091036.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.85 3.97 3.90 4/178 7604
/proc/meminfo: memFree=29746784/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=11576 CPUtime=0 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) R 7602 7604 7054 0 -1 4202496 935 0 0 0 0 0 0 0 20 0 1 0 275232164 11853824 879 33554432000 4194304 5965102 140733826326368 140733826324344 5137146 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 2894 888 169 433 0 2458 0

[startup+0.0774399 s]
/proc/loadavg: 3.85 3.97 3.90 4/178 7604
/proc/meminfo: memFree=29746784/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163300 CPUtime=0.14 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 2203 0 0 0 14 0 0 0 20 0 3 0 275232164 167219200 2081 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40825 2081 199 433 0 40389 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 163300

[startup+0.100306 s]
/proc/loadavg: 3.85 3.97 3.90 4/178 7604
/proc/meminfo: memFree=29746784/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163300 CPUtime=0.18 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 2452 0 0 0 18 0 0 0 20 0 3 0 275232164 167219200 2323 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40825 2323 199 433 0 40389 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 163300

[startup+0.300276 s]
/proc/loadavg: 3.85 3.97 3.90 4/178 7604
/proc/meminfo: memFree=29746784/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163300 CPUtime=0.58 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 4148 0 0 0 57 1 0 0 20 0 3 0 275232164 167219200 4019 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40825 4020 199 433 0 40389 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 163300

[startup+0.700273 s]
/proc/loadavg: 3.85 3.97 3.90 4/178 7604
/proc/meminfo: memFree=29746784/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163300 CPUtime=1.38 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 5510 0 0 0 137 1 0 0 20 0 3 0 275232164 167219200 5373 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40825 5373 199 433 0 40389 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 163300

[startup+1.50035 s]
/proc/loadavg: 3.85 3.97 3.90 5/181 7607
/proc/meminfo: memFree=29724292/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163300 CPUtime=2.98 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 7064 0 0 0 296 2 0 0 20 0 3 0 275232164 167219200 6927 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40825 6927 199 433 0 40389 0
[pid=7604/tid=7605] ppid=7602 vsize=163300 CPUtime=1.47 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 1885 0 0 0 147 0 0 0 20 0 3 0 275232165 167219200 6927 33554432000 4194304 5965102 140733826326368 140432989628952 4401096 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=163300 CPUtime=1.48 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 4227 0 0 0 146 2 0 0 20 0 3 0 275232165 167219200 6927 33554432000 4194304 5965102 140733826326368 140432979138872 5137076 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 163300

[startup+3.10034 s]
/proc/loadavg: 3.85 3.97 3.90 5/181 7607
/proc/meminfo: memFree=29712636/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163516 CPUtime=6.18 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 11056 0 0 0 614 4 0 0 20 0 3 0 275232164 167440384 10919 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40879 10919 199 433 0 40443 0
[pid=7604/tid=7605] ppid=7602 vsize=163516 CPUtime=3.07 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 2085 0 0 0 307 0 0 0 20 0 3 0 275232165 167440384 10919 33554432000 4194304 5965102 140733826326368 140432989628760 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=163516 CPUtime=3.07 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 8019 0 0 0 304 3 0 0 20 0 3 0 275232165 167440384 10919 33554432000 4194304 5965102 140733826326368 140432979138872 4390196 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 163516

[startup+6.30033 s]
/proc/loadavg: 3.87 3.97 3.90 5/181 7607
/proc/meminfo: memFree=29685348/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=163784 CPUtime=12.58 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 17176 0 0 0 1250 8 0 0 20 0 3 0 275232164 167714816 17039 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 40946 17039 199 433 0 40510 0
[pid=7604/tid=7605] ppid=7602 vsize=163784 CPUtime=6.26 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 3137 0 0 0 624 2 0 0 20 0 3 0 275232165 167714816 17039 33554432000 4194304 5965102 140733826326368 140432989628408 4401472 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=163784 CPUtime=6.26 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 13087 0 0 0 621 5 0 0 20 0 3 0 275232165 167714816 17039 33554432000 4194304 5965102 140733826326368 140432979138872 5137076 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 163784

[startup+12.7003 s]
/proc/loadavg: 3.88 3.97 3.90 5/181 7648
/proc/meminfo: memFree=30545616/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=229680 CPUtime=25.36 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 24196 0 0 0 2524 12 0 0 20 0 3 0 275232164 235192320 24096 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 57420 24096 199 433 0 56984 0
[pid=7604/tid=7605] ppid=7602 vsize=229680 CPUtime=12.64 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 5162 0 0 0 1261 3 0 0 20 0 3 0 275232165 235192320 24096 33554432000 4194304 5965102 140733826326368 140432989628456 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=229680 CPUtime=12.65 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 18082 0 0 0 1257 8 0 0 20 0 3 0 275232165 235192320 24096 33554432000 4194304 5965102 140733826326368 140432979138872 4390880 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 229680

[startup+25.5003 s]
/proc/loadavg: 3.90 3.97 3.91 5/181 7648
/proc/meminfo: memFree=30484972/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=230340 CPUtime=50.95 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 34640 0 0 0 5068 27 0 0 20 0 3 0 275232164 235868160 34213 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 57585 34213 199 433 0 57149 0
[pid=7604/tid=7605] ppid=7602 vsize=230340 CPUtime=25.39 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 8920 0 0 0 2534 5 0 0 20 0 3 0 275232165 235868160 34213 33554432000 4194304 5965102 140733826326368 140432989628952 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=230340 CPUtime=25.41 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 24768 0 0 0 2520 21 0 0 20 0 3 0 275232165 235868160 34213 33554432000 4194304 5965102 140733826326368 140432979138872 4404738 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.95
Current children cumulated vsize (KiB) 230340

[startup+51.1003 s]
/proc/loadavg: 3.81 3.94 3.90 5/181 7688
/proc/meminfo: memFree=30389212/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=231312 CPUtime=102.13 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 34877 0 0 0 10186 27 0 0 20 0 3 0 275232164 236863488 34220 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 57828 34220 199 433 0 57392 0
[pid=7604/tid=7605] ppid=7602 vsize=231312 CPUtime=50.93 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 8921 0 0 0 5088 5 0 0 20 0 3 0 275232165 236863488 34220 33554432000 4194304 5965102 140733826326368 140432989628952 4399330 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=231312 CPUtime=50.93 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 25004 0 0 0 5072 21 0 0 20 0 3 0 275232165 236863488 34220 33554432000 4194304 5965102 140733826326368 140432979138632 4392534 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.13
Current children cumulated vsize (KiB) 231312

[startup+102.307 s]
/proc/loadavg: 3.92 3.95 3.90 5/181 7688
/proc/meminfo: memFree=30180768/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=297704 CPUtime=204.5 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 49124 0 0 0 20415 35 0 0 20 0 3 0 275232164 304848896 48687 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 74426 48687 199 433 0 73990 0
[pid=7604/tid=7605] ppid=7602 vsize=297704 CPUtime=102 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 9186 0 0 0 10194 6 0 0 20 0 3 0 275232165 304848896 48687 33554432000 4194304 5965102 140733826326368 140432989628408 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=297704 CPUtime=101.98 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 38986 0 0 0 10167 31 0 0 20 0 3 0 275232165 304848896 48687 33554432000 4194304 5965102 140733826326368 140432979138872 4401026 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.5
Current children cumulated vsize (KiB) 297704

[startup+162.3 s]
/proc/loadavg: 3.97 3.95 3.91 5/181 7688
/proc/meminfo: memFree=29982100/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=301208 CPUtime=324.47 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 69621 0 0 0 32398 49 0 0 20 0 3 0 275232164 308436992 66453 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 75302 66453 199 433 0 74866 0
[pid=7604/tid=7605] ppid=7602 vsize=301208 CPUtime=161.84 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 14131 0 0 0 16172 12 0 0 20 0 3 0 275232165 308436992 66453 33554432000 4194304 5965102 140733826326368 140432989629368 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=301208 CPUtime=161.82 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 54538 0 0 0 16142 40 0 0 20 0 3 0 275232165 308436992 66453 33554432000 4194304 5965102 140733826326368 140432979138872 4432993 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.47
Current children cumulated vsize (KiB) 301208

[startup+222.3 s]
/proc/loadavg: 3.99 3.96 3.91 5/182 7691
/proc/meminfo: memFree=29941696/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=302488 CPUtime=444.45 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 70483 0 0 0 44396 49 0 0 20 0 3 0 275232164 309747712 66635 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 75622 66635 199 433 0 75186 0
[pid=7604/tid=7605] ppid=7602 vsize=302488 CPUtime=221.68 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 14212 0 0 0 22155 13 0 0 20 0 3 0 275232165 309747712 66635 33554432000 4194304 5965102 140733826326368 140432989629256 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=302488 CPUtime=221.67 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 55319 0 0 0 22126 41 0 0 20 0 3 0 275232165 309747712 66635 33554432000 4194304 5965102 140733826326368 140432979138632 4392808 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.45
Current children cumulated vsize (KiB) 302488

[startup+282.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/182 7714
/proc/meminfo: memFree=29772092/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=437376 CPUtime=564.43 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 84576 0 0 0 56384 59 0 0 20 0 3 0 275232164 447873024 80727 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 109344 80727 199 433 0 108908 0
[pid=7604/tid=7605] ppid=7602 vsize=437376 CPUtime=281.52 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 17401 0 0 0 28135 17 0 0 20 0 3 0 275232165 447873024 80727 33554432000 4194304 5965102 140733826326368 140432989628456 4401107 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=437376 CPUtime=281.52 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 66223 0 0 0 28103 49 0 0 20 0 3 0 275232165 447873024 80727 33554432000 4194304 5965102 140733826326368 140432979138872 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.43
Current children cumulated vsize (KiB) 437376

[startup+342.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/181 7715
/proc/meminfo: memFree=29722180/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=437376 CPUtime=684.41 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 90963 0 0 0 68373 68 0 0 20 0 3 0 275232164 447873024 87404 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 109344 87404 199 433 0 108908 0

################
# More data... #
################

[pid=7604/tid=7606] ppid=7602 vsize=437376 CPUtime=341.36 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 66227 0 0 0 34086 50 0 0 20 0 3 0 275232165 447873024 87404 33554432000 4194304 5965102 140733826326368 140432979138904 4390187 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.41
Current children cumulated vsize (KiB) 437376

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/181 7715
/proc/meminfo: memFree=29658412/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=503376 CPUtime=804.37 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 102656 0 0 0 80360 77 0 0 20 0 3 0 275232164 515457024 99311 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 125844 99311 199 433 0 125408 0
[pid=7604/tid=7605] ppid=7602 vsize=503376 CPUtime=401.2 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 28493 0 0 0 40086 34 0 0 20 0 3 0 275232165 515457024 99311 33554432000 4194304 5965102 140733826326368 140432989628456 4390112 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=503376 CPUtime=401.2 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 73211 0 0 0 40066 54 0 0 20 0 3 0 275232165 515457024 99311 33554432000 4194304 5965102 140733826326368 140432979138632 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.37
Current children cumulated vsize (KiB) 503376

[startup+462.3 s]
/proc/loadavg: 4.04 3.99 3.91 5/181 7715
/proc/meminfo: memFree=29484992/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=570080 CPUtime=924.32 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 115060 0 0 0 92344 88 0 0 20 0 3 0 275232164 583761920 111770 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 142520 111770 199 433 0 142084 0
[pid=7604/tid=7605] ppid=7602 vsize=570080 CPUtime=461.02 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 33364 0 0 0 46060 42 0 0 20 0 3 0 275232165 583761920 111770 33554432000 4194304 5965102 140733826326368 140432989628216 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=570080 CPUtime=461.04 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 80744 0 0 0 46045 59 0 0 20 0 3 0 275232165 583761920 111770 33554432000 4194304 5965102 140733826326368 140432979138872 4401046 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.32
Current children cumulated vsize (KiB) 570080

[startup+522.3 s]
/proc/loadavg: 4.01 3.99 3.91 5/181 7715
/proc/meminfo: memFree=29454384/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=570080 CPUtime=1044.29 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 116970 0 0 0 104336 93 0 0 20 0 3 0 275232164 583761920 113747 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 142520 113747 199 433 0 142084 0
[pid=7604/tid=7605] ppid=7602 vsize=570080 CPUtime=520.86 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 35256 0 0 0 52039 47 0 0 20 0 3 0 275232165 583761920 113747 33554432000 4194304 5965102 140733826326368 140432989628008 4400952 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=570080 CPUtime=520.87 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 80762 0 0 0 52027 60 0 0 20 0 3 0 275232165 583761920 113747 33554432000 4194304 5965102 140733826326368 140432979138872 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.29
Current children cumulated vsize (KiB) 570080

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7715
/proc/meminfo: memFree=29446808/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=570080 CPUtime=1164.27 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 118641 0 0 0 116331 96 0 0 20 0 3 0 275232164 583761920 115514 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 142520 115514 199 433 0 142084 0
[pid=7604/tid=7605] ppid=7602 vsize=570080 CPUtime=580.7 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 36807 0 0 0 58020 50 0 0 20 0 3 0 275232165 583761920 115514 33554432000 4194304 5965102 140733826326368 140432989628408 4401131 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=570080 CPUtime=580.71 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 80882 0 0 0 58010 61 0 0 20 0 3 0 275232165 583761920 115514 33554432000 4194304 5965102 140733826326368 140432979138872 4380032 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.27
Current children cumulated vsize (KiB) 570080

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7716
/proc/meminfo: memFree=29429724/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=570080 CPUtime=1284.26 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 123219 0 0 0 128321 105 0 0 20 0 3 0 275232164 583761920 116019 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 142520 116019 199 433 0 142084 0
[pid=7604/tid=7605] ppid=7602 vsize=570080 CPUtime=640.55 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 41385 0 0 0 63994 61 0 0 20 0 3 0 275232165 583761920 116019 33554432000 4194304 5965102 140733826326368 140432989628408 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=570080 CPUtime=640.57 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 80882 0 0 0 63995 62 0 0 20 0 3 0 275232165 583761920 116019 33554432000 4194304 5965102 140733826326368 140432979138904 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.26
Current children cumulated vsize (KiB) 570080

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7716
/proc/meminfo: memFree=29413756/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=571520 CPUtime=1404.24 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 125318 0 0 0 140315 109 0 0 20 0 3 0 275232164 585236480 118118 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 142880 118118 199 433 0 142444 0
[pid=7604/tid=7605] ppid=7602 vsize=571520 CPUtime=700.39 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 43177 0 0 0 69974 65 0 0 20 0 3 0 275232165 585236480 118118 33554432000 4194304 5965102 140733826326368 140432989628408 5137076 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=571520 CPUtime=700.41 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 81189 0 0 0 69978 63 0 0 20 0 3 0 275232165 585236480 118118 33554432000 4194304 5965102 140733826326368 140432979138632 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.24
Current children cumulated vsize (KiB) 571520

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7716
/proc/meminfo: memFree=29345956/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=574408 CPUtime=1524.23 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 137860 0 0 0 152301 122 0 0 20 0 3 0 275232164 588193792 130657 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 143602 130657 199 433 0 143166 0
[pid=7604/tid=7605] ppid=7602 vsize=574408 CPUtime=760.24 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 46695 0 0 0 75953 71 0 0 20 0 3 0 275232165 588193792 130657 33554432000 4194304 5965102 140733826326368 140432989628280 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=574408 CPUtime=760.26 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 90213 0 0 0 75954 72 0 0 20 0 3 0 275232165 588193792 130657 33554432000 4194304 5965102 140733826326368 140432979138872 4401668 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.23
Current children cumulated vsize (KiB) 574408

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/182 7719
/proc/meminfo: memFree=29300760/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=705480 CPUtime=1644.2 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 145128 0 0 0 164289 131 0 0 20 0 3 0 275232164 722411520 137922 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 176370 137922 199 433 0 175934 0
[pid=7604/tid=7605] ppid=7602 vsize=705480 CPUtime=820.08 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 49065 0 0 0 81933 75 0 0 20 0 3 0 275232165 722411520 137922 33554432000 4194304 5965102 140733826326368 140432989628216 4401155 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=705480 CPUtime=820.1 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 95111 0 0 0 81931 79 0 0 20 0 3 0 275232165 722411520 137922 33554432000 4194304 5965102 140733826326368 140432979138872 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.2
Current children cumulated vsize (KiB) 705480

[startup+882.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7719
/proc/meminfo: memFree=29262832/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=705480 CPUtime=1764.18 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 153473 0 0 0 176282 136 0 0 20 0 3 0 275232164 722411520 146266 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 176370 146266 199 433 0 175934 0
[pid=7604/tid=7605] ppid=7602 vsize=705480 CPUtime=879.92 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 51915 0 0 0 87912 80 0 0 20 0 3 0 275232165 722411520 146266 33554432000 4194304 5965102 140733826326368 140432989628216 4400972 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=705480 CPUtime=879.95 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 100606 0 0 0 87913 82 0 0 20 0 3 0 275232165 722411520 146266 33554432000 4194304 5965102 140733826326368 140432979138392 4401462 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.18
Current children cumulated vsize (KiB) 705480



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7719
/proc/meminfo: memFree=29252664/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=706204 CPUtime=1800.19 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 155391 0 0 0 179879 140 0 0 20 0 3 0 275232164 723152896 148184 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 176551 148184 199 433 0 176115 0
[pid=7604/tid=7605] ppid=7602 vsize=706204 CPUtime=897.88 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 53833 0 0 0 89705 83 0 0 20 0 3 0 275232165 723152896 148184 33554432000 4194304 5965102 140733826326368 140432989628216 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=706204 CPUtime=897.91 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 100606 0 0 0 89709 82 0 0 20 0 3 0 275232165 723152896 148184 33554432000 4194304 5965102 140733826326368 140432979138392 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 706204

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 7719
/proc/meminfo: memFree=29252664/32873844 swapFree=7108/7108
[pid=7604] ppid=7602 vsize=706204 CPUtime=1800.19 cores=1,3,5,7
/proc/7604/stat : 7604 (pwbo2.0) S 7602 7604 7054 0 -1 4202496 155391 0 0 0 179879 140 0 0 20 0 3 0 275232164 723152896 148184 33554432000 4194304 5965102 140733826326368 140733826325888 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/7604/statm: 176551 148184 199 433 0 176115 0
[pid=7604/tid=7605] ppid=7602 vsize=706204 CPUtime=897.88 cores=1,3,5,7
/proc/7604/task/7605/stat : 7605 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 53833 0 0 0 89705 83 0 0 20 0 3 0 275232165 723152896 148184 33554432000 4194304 5965102 140733826326368 140432989628216 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=7604/tid=7606] ppid=7602 vsize=706204 CPUtime=897.91 cores=1,3,5,7
/proc/7604/task/7606/stat : 7606 (pwbo2.0) R 7602 7604 7054 0 -1 4202560 100606 0 0 0 89709 82 0 0 20 0 3 0 275232165 723152896 148184 33554432000 4194304 5965102 140733826326368 140432979138392 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 706204

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7604 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=151247
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=690742
# CPU time returned by wait4() is 1795.84
# while last known CPU time is 1800.19
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.332
CPU time (s): 1800.19
CPU user time (s): 1798.79
CPU system time (s): 1.4
CPU usage (%): 199.947
Max. virtual memory (cumulated for all children) (KiB): 706204

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.15
system time used= 1.69074
maximum resident set size= 592744
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 155393
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 345
involuntary context switches= 1890

runsolver used 1.92171 second user time and 5.44417 second system time

The end

Launcher Data 

Begin job on node102 at 2012-05-27 05:57:16
IDJOB=3703649
IDBENCH=2231
IDSOLVER=2279
FILE ID=node102/3703649-1338091036
RUNJOBID= node102-1338087425-7071
PBS_JOBID= 14624443
Free space on /tmp= 71532 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/benchmarks/course-ass/normalized-ws97-5.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703649-1338091036/watcher-3703649-1338091036 -o /tmp/evaluation-result-3703649-1338091036/solver-3703649-1338091036 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703649-1338091036.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ed36462db2ffa04ea65b986069441496
RANDOM SEED=567570321

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.35
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.178
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29747040 kB
Buffers:          312336 kB
Cached:          1065972 kB
SwapCached:            0 kB
Active:          1731848 kB
Inactive:         569016 kB
Active(anon):     913796 kB
Inactive(anon):    11040 kB
Active(file):     818052 kB
Inactive(file):   557976 kB
Unevictable:        7108 kB
Mlocked:            7108 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:              5464 kB
Writeback:             0 kB
AnonPages:        929284 kB
Mapped:            15140 kB
Shmem:               200 kB
Slab:             685704 kB
SReclaimable:     128112 kB
SUnreclaim:       557592 kB
KernelStack:        1480 kB
PageTables:         5856 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     171092 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    708608 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71528 MiB
End job on node102 at 2012-05-27 06:12:19