Trace number 3728521

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.02MSAT (TO) 1800.2 900.326

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/
normalized-chnl15_25_pb.cnf.cr--soft-33-100-0.wbo
MD5SUM4fda08e2dc650152cad1c676f7fa8f96
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark15
Best CPU time to get the best result obtained on this benchmark0.242962
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables750
Total number of constraints80
Number of soft constraints54
Number of constraints which are clauses50
Number of constraints which are cardinality constraints (but not clauses)30
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint15
Maximum length of a constraint25
Top cost 2808
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 2807
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 26
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728521-1338670388.wbo.
0.00/0.00	c Instance file HOME/instance-3728521-1338670388.wbo
0.00/0.00	c File size is 12903 bytes.
0.00/0.00	c Highest Coefficient sum: 26
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      804                                                 |
0.00/0.00	c |  Number Clauses:        50                                                  |
0.00/0.00	c |  Number Cardinality:    11                                                  |
0.00/0.00	c |  Number PB Constraints: 19                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.20/900.31	o 325
1800.20/900.31	o 148
1800.20/900.31	o 118
1800.20/900.31	o 112
1800.20/900.31	o 89
1800.20/900.31	o 53
1800.20/900.31	o 15
1800.20/900.31	c ===============================================================================
1800.20/900.31	c Wall Clock Time: 900.31 s
1800.20/900.31	c Best Solution: 15
1800.20/900.31	s SATISFIABLE
1800.20/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 x60 -x61 -x62 -x63 -x64 x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 x117 -x118 -x119 -x120 -x121 x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 x221 -x222 -x223 -x224 -x225 x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 x339 -x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 x435 -x436 x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 x468 -x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 x495 -x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 x510 -x511 -x512 -x513 -x514 -x515 -x516 -x517 -x518 -x519 -x520 -x521 x522 -x523 -x524 -x525 -x526 -x527 -x528 x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 -x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 -x550 -x551 x552 -x553 -x554 -x555 -x556 -x557 -x558 -x559 -x560 x561 -x562 -x563 -x564 -x565 -x566 -x567 -x568 -x569 -x570 -x571 -x572 -x573 -x574 -x575 -x576 -x577 -x578 -x579 -x580 -x581 x582 -x583 -x584 -x585 -x586 -x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 x597 -x598 -x599 -x600 -x601 -x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 x615 x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 -x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 x634 -x635 -x636 -x637 -x638 -x639 -x640 -x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 -x653 x654 -x655 -x656 -x657 -x658 -x659 -x660 -x661 -x662 -x663 -x664 -x665 -x666 -x667 -x668 -x669 -x670 -x671 -x672 -x673 -x674 x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 -x684 -x685 x686 -x687 -x688 -x689 -x690 -x691 -x692 -x693 -x694 -x695 -x696 -x697 -x698 -x699 -x700 -x701 x702 -x703 -x704 -x705 -x706 -x707 -x708 -x709 -x710 -x711 -x712 -x713 -x714 -x715 -x716 -x717 -x718 x719 -x720 -x721 -x722 -x723 -x724 -x725 -x726 -x727 -x728 -x729 -x730 -x731 -x732 -x733 -x734 x735 -x736 -x737 -x738 -x739 -x740 -x741 -x742 x743 -x744 -x745 -x746 -x747 -x748 -x749 -x750

Verifier Data 

OK	15

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728521-1338670388/watcher-3728521-1338670388 -o /tmp/evaluation-result-3728521-1338670388/solver-3728521-1338670388 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728521-1338670388.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.83 3.19 2/174 3993
/proc/meminfo: memFree=28476704/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=162792 CPUtime=0 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 1050 0 0 0 0 0 0 0 20 0 3 0 333163174 166699008 998 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 40698 998 194 433 0 40262 0
[pid=3993/tid=3994] ppid=3991 vsize=162792 CPUtime=0 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 110 0 0 0 0 0 0 0 20 0 3 0 333163175 166699008 998 33554432000 4194304 5964478 140734186852496 139680070302280 4381553 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=162792 CPUtime=0 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 83 0 0 0 0 0 0 0 20 0 3 0 333163175 166699008 999 33554432000 4194304 5964478 140734186852496 139680059812200 4391397 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.083478 s]
/proc/loadavg: 3.68 3.83 3.19 2/174 3993
/proc/meminfo: memFree=28476704/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=180996 CPUtime=0.15 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 8774 0 0 0 12 3 0 0 20 0 3 0 333163174 185339904 8642 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 45249 8648 205 433 0 44813 0
[pid=3993/tid=3994] ppid=3991 vsize=180996 CPUtime=0.06 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 325 0 0 0 6 0 0 0 20 0 3 0 333163175 185339904 8649 33554432000 4194304 5964478 140734186852496 139680070301736 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=180996 CPUtime=0.06 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 7609 0 0 0 4 2 0 0 20 0 3 0 333163175 185339904 8660 33554432000 4194304 5964478 140734186852496 139680059811400 4395266 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 180996

[startup+0.100391 s]
/proc/loadavg: 3.68 3.83 3.19 2/174 3993
/proc/meminfo: memFree=28476704/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=184396 CPUtime=0.18 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 10331 0 0 0 14 4 0 0 20 0 3 0 333163174 188821504 10175 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 46099 10179 205 433 0 45663 0
[pid=3993/tid=3994] ppid=3991 vsize=184396 CPUtime=0.08 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 366 0 0 0 8 0 0 0 20 0 3 0 333163175 188821504 10182 33554432000 4194304 5964478 140734186852496 139680070301688 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=184396 CPUtime=0.08 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 9118 0 0 0 4 4 0 0 20 0 3 0 333163175 188821504 10184 33554432000 4194304 5964478 140734186852496 139680059811400 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 184396

[startup+0.300398 s]
/proc/loadavg: 3.68 3.83 3.19 2/174 3993
/proc/meminfo: memFree=28476704/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=190904 CPUtime=0.57 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 13506 0 0 0 49 8 0 0 20 0 3 0 333163174 195485696 13860 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 47726 13860 206 433 0 47290 0
[pid=3993/tid=3994] ppid=3991 vsize=190904 CPUtime=0.28 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 704 0 0 0 26 2 0 0 20 0 3 0 333163175 195485696 13861 33554432000 4194304 5964478 140734186852496 139680070301688 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=190904 CPUtime=0.28 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 11945 0 0 0 21 7 0 0 20 0 3 0 333163175 195485696 13861 33554432000 4194304 5964478 140734186852496 139680059812072 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 190904

[startup+0.700393 s]
/proc/loadavg: 3.68 3.83 3.19 2/174 3993
/proc/meminfo: memFree=28476704/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=190904 CPUtime=1.38 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 13984 0 0 0 129 9 0 0 20 0 3 0 333163174 195485696 14338 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 47726 14338 206 433 0 47290 0
[pid=3993/tid=3994] ppid=3991 vsize=190904 CPUtime=0.68 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 1051 0 0 0 65 3 0 0 20 0 3 0 333163175 195485696 14338 33554432000 4194304 5964478 140734186852496 139680070301688 4381692 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=190904 CPUtime=0.68 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 12076 0 0 0 61 7 0 0 20 0 3 0 333163175 195485696 14338 33554432000 4194304 5964478 140734186852496 139680059812072 4400010 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 190904

[startup+1.5004 s]
/proc/loadavg: 3.68 3.83 3.19 5/181 4036
/proc/meminfo: memFree=28388192/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=190904 CPUtime=2.97 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 15329 0 0 0 287 10 0 0 20 0 3 0 333163174 195485696 15999 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 47726 15999 206 433 0 47290 0
[pid=3993/tid=3994] ppid=3991 vsize=190904 CPUtime=1.47 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 1602 0 0 0 144 3 0 0 20 0 3 0 333163175 195485696 15999 33554432000 4194304 5964478 140734186852496 139680070301688 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=190904 CPUtime=1.47 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 12870 0 0 0 140 7 0 0 20 0 3 0 333163175 195485696 15999 33554432000 4194304 5964478 140734186852496 139680059811960 4392863 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 190904

[startup+3.10032 s]
/proc/loadavg: 3.68 3.83 3.19 5/181 4036
/proc/meminfo: memFree=28376520/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=191192 CPUtime=6.17 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 17038 0 0 0 606 11 0 0 20 0 3 0 333163174 195780608 17708 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 47798 17708 206 433 0 47362 0
[pid=3993/tid=3994] ppid=3991 vsize=191192 CPUtime=3.07 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 2432 0 0 0 303 4 0 0 20 0 3 0 333163175 195780608 17708 33554432000 4194304 5964478 140734186852496 139680070301688 4400109 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=191192 CPUtime=3.07 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 13749 0 0 0 300 7 0 0 20 0 3 0 333163175 195780608 17708 33554432000 4194304 5964478 140734186852496 139680059812152 4382021 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 191192

[startup+6.30031 s]
/proc/loadavg: 3.70 3.83 3.20 5/181 4036
/proc/meminfo: memFree=28358292/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=191264 CPUtime=12.57 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 19132 0 0 0 1245 12 0 0 20 0 3 0 333163174 195854336 19802 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 47816 19802 206 433 0 47380 0
[pid=3993/tid=3994] ppid=3991 vsize=191264 CPUtime=6.26 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 2914 0 0 0 622 4 0 0 20 0 3 0 333163175 195854336 19802 33554432000 4194304 5964478 140734186852496 139680070301496 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=191264 CPUtime=6.26 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 15361 0 0 0 618 8 0 0 20 0 3 0 333163175 195854336 19802 33554432000 4194304 5964478 140734186852496 139680059812152 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 191264

[startup+12.7003 s]
/proc/loadavg: 3.73 3.83 3.20 5/181 4036
/proc/meminfo: memFree=28342608/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=191696 CPUtime=25.36 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 21086 0 0 0 2523 13 0 0 20 0 3 0 333163174 196296704 21754 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 47924 21754 206 433 0 47488 0
[pid=3993/tid=3994] ppid=3991 vsize=191696 CPUtime=12.64 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 3491 0 0 0 1260 4 0 0 20 0 3 0 333163175 196296704 21754 33554432000 4194304 5964478 140734186852496 139680070301688 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=191696 CPUtime=12.64 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 16738 0 0 0 1256 8 0 0 20 0 3 0 333163175 196296704 21754 33554432000 4194304 5964478 140734186852496 139680059812152 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 191696

[startup+25.5004 s]
/proc/loadavg: 3.79 3.84 3.21 5/181 4036
/proc/meminfo: memFree=28311724/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=192244 CPUtime=50.96 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 24831 0 0 0 5079 17 0 0 20 0 3 0 333163174 196857856 25509 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 48061 25509 206 433 0 47625 0
[pid=3993/tid=3994] ppid=3991 vsize=192244 CPUtime=25.41 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 5887 0 0 0 2534 7 0 0 20 0 3 0 333163175 196857856 25509 33554432000 4194304 5964478 140734186852496 139680070301496 4400018 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=192244 CPUtime=25.4 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 18087 0 0 0 2531 9 0 0 20 0 3 0 333163175 196857856 25509 33554432000 4194304 5964478 140734186852496 139680059812152 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 192244

[startup+51.1003 s]
/proc/loadavg: 3.86 3.85 3.23 5/181 4036
/proc/meminfo: memFree=28273332/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=194356 CPUtime=102.14 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 29373 0 0 0 10192 22 0 0 20 0 3 0 333163174 199020544 31809 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 48589 31809 206 433 0 48153 0
[pid=3993/tid=3994] ppid=3991 vsize=194356 CPUtime=50.94 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 8763 0 0 0 5084 10 0 0 20 0 3 0 333163175 199020544 31809 33554432000 4194304 5964478 140734186852496 139680070301736 4400056 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=194356 CPUtime=50.93 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 19753 0 0 0 5082 11 0 0 20 0 3 0 333163175 199020544 31809 33554432000 4194304 5964478 140734186852496 139680059812152 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 194356

[startup+102.307 s]
/proc/loadavg: 3.94 3.87 3.27 5/181 4036
/proc/meminfo: memFree=28192840/32873844 swapFree=7636/7636
[pid=3993] ppid=3991 vsize=267220 CPUtime=204.54 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 40903 0 0 0 20421 33 0 0 20 0 3 0 333163174 273633280 43320 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 66805 43320 206 433 0 66369 0
[pid=3993/tid=3994] ppid=3991 vsize=267220 CPUtime=102.01 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 12864 0 0 0 10184 17 0 0 20 0 3 0 333163175 273633280 43320 33554432000 4194304 5964478 140734186852496 139680070301496 4400069 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=267220 CPUtime=102.01 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 27182 0 0 0 10184 17 0 0 20 0 3 0 333163175 273633280 43320 33554432000 4194304 5964478 140734186852496 139680059812200 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 267220

[startup+162.3 s]
/proc/loadavg: 3.98 3.89 3.31 5/181 4036
/proc/meminfo: memFree=28133448/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=271880 CPUtime=324.49 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 47853 0 0 0 32408 41 0 0 20 0 3 0 333163174 278405120 50405 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 67970 50405 206 433 0 67534 0
[pid=3993/tid=3994] ppid=3991 vsize=271880 CPUtime=161.83 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 14163 0 0 0 16163 20 0 0 20 0 3 0 333163175 278405120 50405 33554432000 4194304 5964478 140734186852496 139680070301688 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=271880 CPUtime=161.85 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 32833 0 0 0 16161 24 0 0 20 0 3 0 333163175 278405120 50405 33554432000 4194304 5964478 140734186852496 139680059812152 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.49
Current children cumulated vsize (KiB) 271880

[startup+222.3 s]
/proc/loadavg: 3.99 3.91 3.35 5/181 4036
/proc/meminfo: memFree=28103516/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=274084 CPUtime=444.46 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 51195 0 0 0 44401 45 0 0 20 0 3 0 333163174 280662016 53872 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 68521 53872 206 433 0 68085 0
[pid=3993/tid=3994] ppid=3991 vsize=274084 CPUtime=221.67 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 14775 0 0 0 22144 23 0 0 20 0 3 0 333163175 280662016 53872 33554432000 4194304 5964478 140734186852496 139680070301736 4400067 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=274084 CPUtime=221.68 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 35563 0 0 0 22140 28 0 0 20 0 3 0 333163175 280662016 53872 33554432000 4194304 5964478 140734186852496 139680059811960 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.46
Current children cumulated vsize (KiB) 274084

################
# More data... #
################

[pid=3993/tid=3995] ppid=3991 vsize=355456 CPUtime=341.37 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 42279 0 0 0 34100 37 0 0 20 0 3 0 333163175 363986944 67261 33554432000 4194304 5964478 140734186852496 139680059812152 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.42
Current children cumulated vsize (KiB) 355456

[startup+402.3 s]
/proc/loadavg: 4.00 3.95 3.46 5/181 4037
/proc/meminfo: memFree=27970448/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=431512 CPUtime=804.39 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 73312 0 0 0 80362 77 0 0 20 0 3 0 333163174 441868288 76022 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 107878 76022 206 433 0 107442 0
[pid=3993/tid=3994] ppid=3991 vsize=431512 CPUtime=401.19 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 24088 0 0 0 40074 45 0 0 20 0 3 0 333163175 441868288 76022 33554432000 4194304 5964478 140734186852496 139680070301736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=431512 CPUtime=401.22 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 48367 0 0 0 40079 43 0 0 20 0 3 0 333163175 441868288 76022 33554432000 4194304 5964478 140734186852496 139680059812152 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.39
Current children cumulated vsize (KiB) 431512

[startup+462.3 s]
/proc/loadavg: 4.00 3.96 3.49 5/182 4040
/proc/meminfo: memFree=27905736/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=443896 CPUtime=924.36 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 85046 0 0 0 92350 86 0 0 20 0 3 0 333163174 454549504 87794 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 110974 87794 206 433 0 110538 0
[pid=3993/tid=3994] ppid=3991 vsize=443896 CPUtime=461.03 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 27160 0 0 0 46054 49 0 0 20 0 3 0 333163175 454549504 87794 33554432000 4194304 5964478 140734186852496 139680070301736 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=443896 CPUtime=461.06 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 57029 0 0 0 46055 51 0 0 20 0 3 0 333163175 454549504 87794 33554432000 4194304 5964478 140734186852496 139680059812152 4400067 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.36
Current children cumulated vsize (KiB) 443896

[startup+522.3 s]
/proc/loadavg: 4.00 3.96 3.52 5/182 4063
/proc/meminfo: memFree=27851052/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=515916 CPUtime=1044.34 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 96516 0 0 0 104332 102 0 0 20 0 3 0 333163174 528297984 99264 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 128979 99264 206 433 0 128543 0
[pid=3993/tid=3994] ppid=3991 vsize=515916 CPUtime=520.87 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 29518 0 0 0 52034 53 0 0 20 0 3 0 333163175 528297984 99264 33554432000 4194304 5964478 140734186852496 139680070301496 4400069 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=515916 CPUtime=520.91 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 66141 0 0 0 52029 62 0 0 20 0 3 0 333163175 528297984 99264 33554432000 4194304 5964478 140734186852496 139680059812152 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.34
Current children cumulated vsize (KiB) 515916

[startup+582.3 s]
/proc/loadavg: 4.00 3.97 3.55 5/181 4063
/proc/meminfo: memFree=27825176/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=523048 CPUtime=1164.33 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 104016 0 0 0 116323 110 0 0 20 0 3 0 333163174 535601152 106764 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 130762 106764 206 433 0 130326 0
[pid=3993/tid=3994] ppid=3991 vsize=523048 CPUtime=580.71 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 29655 0 0 0 58017 54 0 0 20 0 3 0 333163175 535601152 106764 33554432000 4194304 5964478 140734186852496 139680070301496 4400097 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=523048 CPUtime=580.75 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 73504 0 0 0 58004 71 0 0 20 0 3 0 333163175 535601152 106764 33554432000 4194304 5964478 140734186852496 139680059812200 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.33
Current children cumulated vsize (KiB) 523048

[startup+642.3 s]
/proc/loadavg: 4.00 3.97 3.57 5/181 4064
/proc/meminfo: memFree=27803280/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=526828 CPUtime=1284.32 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 106625 0 0 0 128319 113 0 0 20 0 3 0 333163174 539471872 109373 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 131707 109373 206 433 0 131271 0
[pid=3993/tid=3994] ppid=3991 vsize=526828 CPUtime=640.56 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 29948 0 0 0 64001 55 0 0 20 0 3 0 333163175 539471872 109373 33554432000 4194304 5964478 140734186852496 139680070301736 4400091 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=526828 CPUtime=640.61 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 75820 0 0 0 63986 75 0 0 20 0 3 0 333163175 539471872 109373 33554432000 4194304 5964478 140734186852496 139680059811960 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.32
Current children cumulated vsize (KiB) 526828

[startup+702.3 s]
/proc/loadavg: 4.00 3.97 3.60 5/181 4064
/proc/meminfo: memFree=27761296/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=531548 CPUtime=1404.27 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 114085 0 0 0 140301 126 0 0 20 0 3 0 333163174 544305152 116992 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 132887 116992 206 433 0 132451 0
[pid=3993/tid=3994] ppid=3991 vsize=531548 CPUtime=700.4 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 35150 0 0 0 69973 67 0 0 20 0 3 0 333163175 544305152 116992 33554432000 4194304 5964478 140734186852496 139680070301496 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=531548 CPUtime=700.43 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 78078 0 0 0 69965 78 0 0 20 0 3 0 333163175 544305152 116992 33554432000 4194304 5964478 140734186852496 139680059812152 4400516 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.27
Current children cumulated vsize (KiB) 531548

[startup+762.307 s]
/proc/loadavg: 4.06 3.99 3.63 5/181 4064
/proc/meminfo: memFree=27737976/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=533256 CPUtime=1524.24 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 116995 0 0 0 152294 130 0 0 20 0 3 0 333163174 546054144 120090 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 133314 120090 206 433 0 132878 0
[pid=3993/tid=3994] ppid=3991 vsize=533256 CPUtime=760.23 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 35195 0 0 0 75955 68 0 0 20 0 3 0 333163175 546054144 120090 33554432000 4194304 5964478 140734186852496 139680070301736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=533256 CPUtime=760.27 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 80943 0 0 0 75943 84 0 0 20 0 3 0 333163175 546054144 120090 33554432000 4194304 5964478 140734186852496 139680059812152 4400067 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.24
Current children cumulated vsize (KiB) 533256

[startup+822.3 s]
/proc/loadavg: 4.02 3.99 3.65 5/181 4064
/proc/meminfo: memFree=27714664/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=607528 CPUtime=1644.21 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 122904 0 0 0 164283 138 0 0 20 0 3 0 333163174 622108672 125999 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 151882 125999 206 433 0 151446 0
[pid=3993/tid=3994] ppid=3991 vsize=607528 CPUtime=820.07 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 35455 0 0 0 81938 69 0 0 20 0 3 0 333163175 622108672 125999 33554432000 4194304 5964478 140734186852496 139680070301736 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=607528 CPUtime=820.11 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 86592 0 0 0 81918 93 0 0 20 0 3 0 333163175 622108672 125999 33554432000 4194304 5964478 140734186852496 139680059812152 4400001 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.21
Current children cumulated vsize (KiB) 607528

[startup+882.3 s]
/proc/loadavg: 4.01 3.99 3.66 5/181 4064
/proc/meminfo: memFree=27687880/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=609968 CPUtime=1764.19 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 128243 0 0 0 176272 147 0 0 20 0 3 0 333163174 624607232 131338 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 152492 131338 206 433 0 152056 0
[pid=3993/tid=3994] ppid=3991 vsize=609968 CPUtime=879.91 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 36138 0 0 0 87920 71 0 0 20 0 3 0 333163175 624607232 131338 33554432000 4194304 5964478 140734186852496 139680070301688 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=609968 CPUtime=879.96 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 91248 0 0 0 87895 101 0 0 20 0 3 0 333163175 624607232 131338 33554432000 4194304 5964478 140734186852496 139680059812152 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.19
Current children cumulated vsize (KiB) 609968



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.67 5/181 4064
/proc/meminfo: memFree=27677464/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=676168 CPUtime=1800.2 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 130326 0 0 0 179869 151 0 0 20 0 3 0 333163174 692396032 133421 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 169042 133421 206 433 0 168606 0
[pid=3993/tid=3994] ppid=3991 vsize=676168 CPUtime=897.87 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 36913 0 0 0 89714 73 0 0 20 0 3 0 333163175 692396032 133421 33554432000 4194304 5964478 140734186852496 139680070301688 4400069 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=676168 CPUtime=897.92 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 92556 0 0 0 89690 102 0 0 20 0 3 0 333163175 692396032 133421 33554432000 4194304 5964478 140734186852496 139680059812152 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.2
Current children cumulated vsize (KiB) 676168

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.67 5/181 4064
/proc/meminfo: memFree=27677464/32873844 swapFree=7632/7632
[pid=3993] ppid=3991 vsize=676168 CPUtime=1800.2 cores=1,3,5,7
/proc/3993/stat : 3993 (pwbo2.02) S 3991 3993 3617 0 -1 4202496 130326 0 0 0 179869 151 0 0 20 0 3 0 333163174 692396032 133421 33554432000 4194304 5964478 140734186852496 140734186852016 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3993/statm: 169042 133421 206 433 0 168606 0
[pid=3993/tid=3994] ppid=3991 vsize=676168 CPUtime=897.87 cores=1,3,5,7
/proc/3993/task/3994/stat : 3994 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 36913 0 0 0 89714 73 0 0 20 0 3 0 333163175 692396032 133421 33554432000 4194304 5964478 140734186852496 139680070301688 4400069 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3993/tid=3995] ppid=3991 vsize=676168 CPUtime=897.92 cores=1,3,5,7
/proc/3993/task/3995/stat : 3995 (pwbo2.02) R 3991 3993 3617 0 -1 4202560 92556 0 0 0 89690 102 0 0 20 0 3 0 333163175 692396032 133421 33554432000 4194304 5964478 140734186852496 139680059812152 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.2
Current children cumulated vsize (KiB) 676168

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3993 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=49263
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=790727
# CPU time returned by wait4() is 1795.84
# while last known CPU time is 1800.2
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.326
CPU time (s): 1800.2
CPU user time (s): 1798.69
CPU system time (s): 1.51
CPU usage (%): 199.95
Max. virtual memory (cumulated for all children) (KiB): 676168

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.05
system time used= 1.79073
maximum resident set size= 533688
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 130327
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 524
involuntary context switches= 1903

runsolver used 1.62175 second user time and 6.01408 second system time

The end

Launcher Data 

Begin job on node141 at 2012-06-02 22:53:08
IDJOB=3728521
IDBENCH=78687
IDSOLVER=2316
FILE ID=node141/3728521-1338670388
RUNJOBID= node141-1338669486-3912
PBS_JOBID= 14636518
Free space on /tmp= 70716 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/normalized-chnl15_25_pb.cnf.cr--soft-33-100-0.wbo
COMMAND LINE= pwbo2.02 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728521-1338670388/watcher-3728521-1338670388 -o /tmp/evaluation-result-3728521-1338670388/solver-3728521-1338670388 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728521-1338670388.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4fda08e2dc650152cad1c676f7fa8f96
RANDOM SEED=547991272

node141.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28477324 kB
Buffers:          383080 kB
Cached:          3120488 kB
SwapCached:          216 kB
Active:          1216216 kB
Inactive:        2300148 kB
Active(anon):       3620 kB
Inactive(anon):    11300 kB
Active(file):    1212596 kB
Inactive(file):  2288848 kB
Unevictable:        7632 kB
Mlocked:            7632 kB
SwapTotal:      67108856 kB
SwapFree:       67108640 kB
Dirty:              5492 kB
Writeback:            40 kB
AnonPages:         19848 kB
Mapped:            10620 kB
Shmem:               172 kB
Slab:             738976 kB
SReclaimable:     181036 kB
SUnreclaim:       557940 kB
KernelStack:        1424 kB
PageTables:         3868 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     137344 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70712 MiB
End job on node141 at 2012-06-02 23:08:11