Trace number 3712438

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.27 900.218

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/
normalized-chnl20_21_pb.cnf.cr--soft-33-100-0.wbo
MD5SUMfbd3a39d50404986b242d7bfefa0e7f6
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark6
Best CPU time to get the best result obtained on this benchmark0.260959
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables840
Total number of constraints82
Number of soft constraints55
Number of constraints which are clauses42
Number of constraints which are cardinality constraints (but not clauses)40
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint20
Maximum length of a constraint21
Top cost 2274
Min constraint cost 1
Max constraint cost 99
Sum of constraints costs 2273
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 22
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712438-1338190516.wbo.
0.00/0.00	c Instance file HOME/instance-3712438-1338190516.wbo
0.00/0.00	c File size is 14367 bytes.
0.00/0.00	c Highest Coefficient sum: 22
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      895                                                 |
0.00/0.00	c |  Number Clauses:        42                                                  |
0.00/0.00	c |  Number Cardinality:    10                                                  |
0.00/0.00	c |  Number PB Constraints: 30                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.01/900.21	o 57
1800.01/900.21	o 55
1800.01/900.21	o 38
1800.01/900.21	o 33
1800.01/900.21	o 20
1800.01/900.21	o 8
1800.01/900.21	o 7
1800.01/900.21	o 6
1800.01/900.21	c ===============================================================================
1800.01/900.21	c Wall Clock Time: 900.21 s
1800.01/900.21	c Best Solution: 6
1800.01/900.21	s SATISFIABLE
1800.01/900.21	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 x278 -x279 -x280 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x302 x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 -x339 x340 -x341 -x342 x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 -x354 -x355 -x356 -x357 -x358 -x359 -x360 x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 -x403 -x404 -x405 -x406 x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 x433 -x434 -x435 -x436 -x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 -x457 -x458 x459 -x460 -x461 x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 -x493 -x494 -x495 -x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 x510 -x511 -x512 -x513 -x514 -x515 -x516 -x517 -x518 -x519 -x520 -x521 -x522 -x523 -x524 -x525 -x526 -x527 -x528 -x529 -x530 -x531 -x532 -x533 x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 -x542 -x543 -x544 -x545 x546 -x547 -x548 -x549 -x550 -x551 -x552 -x553 -x554 -x555 -x556 -x557 -x558 -x559 -x560 -x561 -x562 -x563 -x564 -x565 -x566 -x567 -x568 -x569 -x570 -x571 -x572 -x573 -x574 x575 -x576 -x577 -x578 -x579 -x580 -x581 -x582 -x583 -x584 -x585 -x586 -x587 -x588 x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 -x599 -x600 -x601 -x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 -x615 -x616 -x617 -x618 -x619 x620 -x621 -x622 -x623 -x624 -x625 x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 -x634 -x635 -x636 -x637 -x638 -x639 -x640 -x641 -x642 -x643 -x644 x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 -x653 -x654 -x655 -x656 -x657 -x658 -x659 -x660 -x661 -x662 -x663 -x664 -x665 -x666 -x667 -x668 x669 -x670 -x671 -x672 -x673 -x674 -x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 -x684 -x685 -x686 -x687 -x688 -x689 -x690 -x691 -x692 -x693 -x694 x695 -x696 -x697 -x698 -x699 -x700 -x701 -x702 -x703 -x704 -x705 -x706 -x707 -x708 -x709 -x710 x711 -x712 -x713 -x714 -x715 -x716 -x717 -x718 -x719 -x720 -x721 -x722 -x723 -x724 -x725 -x726 -x727 -x728 -x729 -x730 x731 -x732 -x733 -x734 -x735 -x736 -x737 -x738 -x739 -x740 -x741 -x742 -x743 -x744 -x745 -x746 -x747 -x748 -x749 -x750 -x751 -x752 -x753 -x754 -x755 x756 -x757 -x758 -x759 -x760 -x761 -x762 -x763 -x764 -x765 -x766 -x767 x768 -x769 -x770 -x771 -x772 -x773 -x774 -x775 -x776 -x777 -x778 -x779 -x780 -x781 -x782 -x783 -x784 -x785 -x786 -x787 -x788 -x789 -x790 -x791 -x792 -x793 -x794 -x795 -x796 x797 -x798 -x799 -x800 -x801 -x802 -x803 -x804 -x805 -x806 -x807 -x808 -x809 -x810 -x811 -x812 x813 -x814 -x815 -x816 -x817 -x818 -x819 -x820 -x821 -x822 -x823 -x824 -x825 -x826 -x827 -x828 -x829 -x830 -x831 -x832 -x833 -x834 -x835 -x836 -x837 -x838 x839 -x840

Verifier Data 

OK	6

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712438-1338190516/watcher-3712438-1338190516 -o /tmp/evaluation-result-3712438-1338190516/solver-3712438-1338190516 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712438-1338190516.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.04 4.00 3.93 3/174 27276
/proc/meminfo: memFree=31029092/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=162864 CPUtime=0 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 1129 0 0 0 0 0 0 0 20 0 3 0 285177517 166772736 1078 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 40716 1080 197 433 0 40280 0
[pid=27276/tid=27279] ppid=27274 vsize=163024 CPUtime=0 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 117 0 0 0 0 0 0 0 20 0 3 0 285177517 166936576 1099 33554432000 4194304 5964478 140736015011552 139666051053560 4409204 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=163024 CPUtime=0 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 186 0 0 0 0 0 0 0 20 0 3 0 285177517 166936576 1112 33554432000 4194304 5964478 140736015011552 139666040563784 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0

[startup+0.0389779 s]
/proc/loadavg: 4.04 4.00 3.93 3/174 27276
/proc/meminfo: memFree=31029092/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=165656 CPUtime=0.06 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 3649 0 0 0 6 0 0 0 20 0 3 0 285177517 169631744 3598 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41414 3601 202 433 0 40978 0
[pid=27276/tid=27279] ppid=27274 vsize=165656 CPUtime=0.02 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 238 0 0 0 2 0 0 0 20 0 3 0 285177517 169631744 3603 33554432000 4194304 5964478 140736015011552 139666051053608 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=165656 CPUtime=0.02 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 2558 0 0 0 2 0 0 0 20 0 3 0 285177517 169631744 3604 33554432000 4194304 5964478 140736015011552 139666040562328 5248554 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 165656

[startup+0.10034 s]
/proc/loadavg: 4.04 4.00 3.93 3/174 27276
/proc/meminfo: memFree=31029092/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=166932 CPUtime=0.18 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 5199 0 0 0 17 1 0 0 20 0 3 0 285177517 170938368 5147 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41733 5147 203 433 0 41297 0
[pid=27276/tid=27279] ppid=27274 vsize=166932 CPUtime=0.08 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 413 0 0 0 8 0 0 0 20 0 3 0 285177517 170938368 5147 33554432000 4194304 5964478 140736015011552 139666051053368 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=166932 CPUtime=0.08 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 3926 0 0 0 7 1 0 0 20 0 3 0 285177517 170938368 5147 33554432000 4194304 5964478 140736015011552 139666040563832 4393428 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 166932

[startup+0.300284 s]
/proc/loadavg: 4.04 4.00 3.93 3/174 27276
/proc/meminfo: memFree=31029092/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=166932 CPUtime=0.58 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 6015 0 0 0 57 1 0 0 20 0 3 0 285177517 170938368 5963 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41733 5963 203 433 0 41297 0
[pid=27276/tid=27279] ppid=27274 vsize=166932 CPUtime=0.28 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 878 0 0 0 28 0 0 0 20 0 3 0 285177517 170938368 5963 33554432000 4194304 5964478 140736015011552 139666051053560 4400073 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=166932 CPUtime=0.28 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 4277 0 0 0 27 1 0 0 20 0 3 0 285177517 170938368 5963 33554432000 4194304 5964478 140736015011552 139666040564072 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 166932

[startup+0.700301 s]
/proc/loadavg: 4.04 4.00 3.93 3/174 27276
/proc/meminfo: memFree=31029092/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=166932 CPUtime=1.39 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 7424 0 0 0 137 2 0 0 20 0 3 0 285177517 170938368 7372 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41733 7372 203 433 0 41297 0
[pid=27276/tid=27279] ppid=27274 vsize=166932 CPUtime=0.68 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 1655 0 0 0 68 0 0 0 20 0 3 0 285177517 170938368 7372 33554432000 4194304 5964478 140736015011552 139666051053560 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=166932 CPUtime=0.68 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 4909 0 0 0 66 2 0 0 20 0 3 0 285177517 170938368 7372 33554432000 4194304 5964478 140736015011552 139666040564024 4400071 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 166932

[startup+1.50027 s]
/proc/loadavg: 4.04 4.00 3.93 5/181 27286
/proc/meminfo: memFree=30973236/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=166932 CPUtime=2.98 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 9219 0 0 0 296 2 0 0 20 0 3 0 285177517 170938368 9167 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41733 9167 203 433 0 41297 0
[pid=27276/tid=27279] ppid=27274 vsize=166932 CPUtime=1.48 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 2782 0 0 0 148 0 0 0 20 0 3 0 285177517 170938368 9167 33554432000 4194304 5964478 140736015011552 139666051053560 5179243 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=166932 CPUtime=1.48 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 5577 0 0 0 146 2 0 0 20 0 3 0 285177517 170938368 9167 33554432000 4194304 5964478 140736015011552 139666040563832 4400099 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 166932

[startup+3.10033 s]
/proc/loadavg: 4.04 4.00 3.93 5/181 27286
/proc/meminfo: memFree=30953604/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=166932 CPUtime=6.19 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 10357 0 0 0 616 3 0 0 20 0 3 0 285177517 170938368 10305 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41733 10305 203 433 0 41297 0
[pid=27276/tid=27279] ppid=27274 vsize=166932 CPUtime=3.08 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 3270 0 0 0 308 0 0 0 20 0 3 0 285177517 170938368 10305 33554432000 4194304 5964478 140736015011552 139666051053368 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=166932 CPUtime=3.08 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 6227 0 0 0 306 2 0 0 20 0 3 0 285177517 170938368 10305 33554432000 4194304 5964478 140736015011552 139666040564024 4400071 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 166932

[startup+6.30035 s]
/proc/loadavg: 4.04 4.00 3.93 5/181 27286
/proc/meminfo: memFree=30925740/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=167220 CPUtime=12.57 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 11500 0 0 0 1254 3 0 0 20 0 3 0 285177517 171233280 11447 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41805 11447 203 433 0 41369 0
[pid=27276/tid=27279] ppid=27274 vsize=167220 CPUtime=6.27 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 3670 0 0 0 627 0 0 0 20 0 3 0 285177517 171233280 11447 33554432000 4194304 5964478 140736015011552 139666051053368 4400099 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=167220 CPUtime=6.28 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 6970 0 0 0 625 3 0 0 20 0 3 0 285177517 171233280 11447 33554432000 4194304 5964478 140736015011552 139666040563960 4400051 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 167220

[startup+12.7003 s]
/proc/loadavg: 4.11 4.02 3.94 5/181 27286
/proc/meminfo: memFree=30883140/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=167220 CPUtime=25.37 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 14460 0 0 0 2532 5 0 0 20 0 3 0 285177517 171233280 14407 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 41805 14407 203 433 0 41369 0
[pid=27276/tid=27279] ppid=27274 vsize=167220 CPUtime=12.67 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 5215 0 0 0 1265 2 0 0 20 0 3 0 285177517 171233280 14407 33554432000 4194304 5964478 140736015011552 139666051053368 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=167220 CPUtime=12.68 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 8385 0 0 0 1264 4 0 0 20 0 3 0 285177517 171233280 14407 33554432000 4194304 5964478 140736015011552 139666040564024 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 167220

[startup+25.5004 s]
/proc/loadavg: 4.09 4.02 3.94 5/181 27286
/proc/meminfo: memFree=30810988/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=168092 CPUtime=50.96 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 18853 0 0 0 5089 7 0 0 20 0 3 0 285177517 172126208 18838 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 42023 18838 203 433 0 41587 0
[pid=27276/tid=27279] ppid=27274 vsize=168092 CPUtime=25.47 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 6445 0 0 0 2544 3 0 0 20 0 3 0 285177517 172126208 18838 33554432000 4194304 5964478 140736015011552 139666051053560 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=168092 CPUtime=25.47 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 11548 0 0 0 2542 5 0 0 20 0 3 0 285177517 172126208 18838 33554432000 4194304 5964478 140736015011552 139666040564024 4400071 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 168092

[startup+51.1004 s]
/proc/loadavg: 4.06 4.01 3.94 5/181 27286
/proc/meminfo: memFree=30719304/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=235056 CPUtime=102.14 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 28017 0 0 0 10201 13 0 0 20 0 3 0 285177517 240697344 28140 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 58764 28140 203 433 0 58328 0
[pid=27276/tid=27279] ppid=27274 vsize=235056 CPUtime=51.07 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 8870 0 0 0 5102 5 0 0 20 0 3 0 285177517 240697344 28140 33554432000 4194304 5964478 140736015011552 139666051053368 4400793 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=235056 CPUtime=51.05 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 18287 0 0 0 5097 8 0 0 20 0 3 0 285177517 240697344 28140 33554432000 4194304 5964478 140736015011552 139666040564024 4400081 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 235056

[startup+102.3 s]
/proc/loadavg: 4.02 4.01 3.94 5/181 27286
/proc/meminfo: memFree=30519348/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=303576 CPUtime=204.53 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 49453 0 0 0 20426 27 0 0 20 0 3 0 285177517 310861824 50784 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 75894 50784 203 433 0 75458 0
[pid=27276/tid=27279] ppid=27274 vsize=303576 CPUtime=102.27 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 13905 0 0 0 10217 10 0 0 20 0 3 0 285177517 310861824 50784 33554432000 4194304 5964478 140736015011552 139666051053608 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=303576 CPUtime=102.26 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 34688 0 0 0 10205 21 0 0 20 0 3 0 285177517 310861824 50784 33554432000 4194304 5964478 140736015011552 139666040564024 4220672 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 204.53
Current children cumulated vsize (KiB) 303576

[startup+162.3 s]
/proc/loadavg: 4.08 4.02 3.94 5/181 27286
/proc/meminfo: memFree=30367972/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=373512 CPUtime=324.5 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 68333 0 0 0 32409 41 0 0 20 0 3 0 285177517 382476288 69664 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 93378 69664 203 433 0 92942 0
[pid=27276/tid=27279] ppid=27274 vsize=373512 CPUtime=162.27 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 18009 0 0 0 16212 15 0 0 20 0 3 0 285177517 382476288 69664 33554432000 4194304 5964478 140736015011552 139666051053560 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=373512 CPUtime=162.24 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 49464 0 0 0 16192 32 0 0 20 0 3 0 285177517 382476288 69664 33554432000 4194304 5964478 140736015011552 139666040564024 4399930 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 324.5
Current children cumulated vsize (KiB) 373512

[startup+222.307 s]
/proc/loadavg: 4.03 4.01 3.94 5/181 27286
/proc/meminfo: memFree=30144928/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=442648 CPUtime=444.5 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 79641 0 0 0 44396 54 0 0 20 0 3 0 285177517 453271552 80972 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 110662 80972 203 433 0 110226 0
[pid=27276/tid=27279] ppid=27274 vsize=442648 CPUtime=222.27 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 18718 0 0 0 22211 16 0 0 20 0 3 0 285177517 453271552 80972 33554432000 4194304 5964478 140736015011552 139666051053560 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=442648 CPUtime=222.24 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60063 0 0 0 22179 45 0 0 20 0 3 0 285177517 453271552 80972 33554432000 4194304 5964478 140736015011552 139666040564024 4399904 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 444.5
Current children cumulated vsize (KiB) 442648

################
# More data... #
################

/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 18983 0 0 0 28208 18 0 0 20 0 3 0 285177517 454672384 81899 33554432000 4194304 5964478 140736015011552 139666051053368 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=444016 CPUtime=282.23 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60387 0 0 0 28176 47 0 0 20 0 3 0 285177517 454672384 81899 33554432000 4194304 5964478 140736015011552 139666040564024 4400071 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.46
Current children cumulated vsize (KiB) 444016

[startup+342.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/182 27290
/proc/meminfo: memFree=29984632/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=444376 CPUtime=684.41 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 80836 0 0 0 68384 57 0 0 20 0 3 0 285177517 455041024 82720 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 111094 82720 203 433 0 110658 0
[pid=27276/tid=27279] ppid=27274 vsize=444376 CPUtime=342.26 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 19516 0 0 0 34206 20 0 0 20 0 3 0 285177517 455041024 82720 33554432000 4194304 5964478 140736015011552 139666051053560 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=444376 CPUtime=342.2 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60460 0 0 0 34172 48 0 0 20 0 3 0 285177517 455041024 82720 33554432000 4194304 5964478 140736015011552 139666040563832 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.41
Current children cumulated vsize (KiB) 444376

[startup+402.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/181 27290
/proc/meminfo: memFree=29923452/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=446140 CPUtime=804.37 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 82963 0 0 0 80377 60 0 0 20 0 3 0 285177517 456847360 84989 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 111535 84989 203 433 0 111099 0
[pid=27276/tid=27279] ppid=27274 vsize=446140 CPUtime=402.25 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 21426 0 0 0 40201 24 0 0 20 0 3 0 285177517 456847360 84989 33554432000 4194304 5964478 140736015011552 139666051053560 4400075 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=446140 CPUtime=402.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60677 0 0 0 40169 49 0 0 20 0 3 0 285177517 456847360 84989 33554432000 4194304 5964478 140736015011552 139666040564072 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.37
Current children cumulated vsize (KiB) 446140

[startup+462.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/180 27290
/proc/meminfo: memFree=29901308/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=446788 CPUtime=924.33 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 83502 0 0 0 92373 60 0 0 20 0 3 0 285177517 457510912 85589 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 111697 85589 203 433 0 111261 0
[pid=27276/tid=27279] ppid=27274 vsize=446788 CPUtime=462.24 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 21896 0 0 0 46198 26 0 0 20 0 3 0 285177517 457510912 85589 33554432000 4194304 5964478 140736015011552 139666051053560 4399953 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=446788 CPUtime=462.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60746 0 0 0 46168 50 0 0 20 0 3 0 285177517 457510912 85589 33554432000 4194304 5964478 140736015011552 139666040563832 4400051 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.33
Current children cumulated vsize (KiB) 446788

[startup+522.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/181 27291
/proc/meminfo: memFree=29894268/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=451000 CPUtime=1044.32 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 84318 0 0 0 104371 61 0 0 20 0 3 0 285177517 461824000 86911 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 112750 86911 203 433 0 112314 0
[pid=27276/tid=27279] ppid=27274 vsize=451000 CPUtime=522.24 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 22673 0 0 0 52198 26 0 0 20 0 3 0 285177517 461824000 86911 33554432000 4194304 5964478 140736015011552 139666051053608 4399922 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=451000 CPUtime=522.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60785 0 0 0 52168 50 0 0 20 0 3 0 285177517 461824000 86911 33554432000 4194304 5964478 140736015011552 139666040563832 4400053 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.32
Current children cumulated vsize (KiB) 451000

[startup+582.3 s]
/proc/loadavg: 4.00 4.00 3.94 5/180 27291
/proc/meminfo: memFree=29835528/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=452932 CPUtime=1164.3 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 88152 0 0 0 116365 65 0 0 20 0 3 0 285177517 463802368 90745 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 113233 90745 203 433 0 112797 0
[pid=27276/tid=27279] ppid=27274 vsize=452932 CPUtime=582.23 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 26483 0 0 0 58192 31 0 0 20 0 3 0 285177517 463802368 90745 33554432000 4194304 5964478 140736015011552 139666051053560 4379280 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=452932 CPUtime=582.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60809 0 0 0 58167 51 0 0 20 0 3 0 285177517 463802368 90745 33554432000 4194304 5964478 140736015011552 139666040564072 4400051 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.3
Current children cumulated vsize (KiB) 452932

[startup+642.3 s]
/proc/loadavg: 4.08 4.02 3.95 5/181 27292
/proc/meminfo: memFree=29587180/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=453616 CPUtime=1284.28 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 89054 0 0 0 128362 66 0 0 20 0 3 0 285177517 464502784 91647 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 113404 91647 203 433 0 112968 0
[pid=27276/tid=27279] ppid=27274 vsize=453616 CPUtime=642.23 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 27345 0 0 0 64190 33 0 0 20 0 3 0 285177517 464502784 91647 33554432000 4194304 5964478 140736015011552 139666051053368 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=453616 CPUtime=642.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60849 0 0 0 64166 52 0 0 20 0 3 0 285177517 464502784 91647 33554432000 4194304 5964478 140736015011552 139666040564072 4400075 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.28
Current children cumulated vsize (KiB) 453616

[startup+702.3 s]
/proc/loadavg: 4.03 4.01 3.95 5/181 27292
/proc/meminfo: memFree=29561788/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=455648 CPUtime=1404.26 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 89769 0 0 0 140360 66 0 0 20 0 3 0 285177517 466583552 92362 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 113912 92362 203 433 0 113476 0
[pid=27276/tid=27279] ppid=27274 vsize=455648 CPUtime=702.23 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 27969 0 0 0 70189 34 0 0 20 0 3 0 285177517 466583552 92362 33554432000 4194304 5964478 140736015011552 139666051053368 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=455648 CPUtime=702.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60940 0 0 0 70165 53 0 0 20 0 3 0 285177517 466583552 92362 33554432000 4194304 5964478 140736015011552 139666040564072 4400053 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.26
Current children cumulated vsize (KiB) 455648

[startup+762.3 s]
/proc/loadavg: 4.01 4.00 3.95 5/181 27292
/proc/meminfo: memFree=29543056/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=459856 CPUtime=1524.25 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 94451 0 0 0 152350 75 0 0 20 0 3 0 285177517 470892544 97039 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 114964 97039 203 433 0 114528 0
[pid=27276/tid=27279] ppid=27274 vsize=459856 CPUtime=762.24 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 32599 0 0 0 76179 45 0 0 20 0 3 0 285177517 470892544 97039 33554432000 4194304 5964478 140736015011552 139666051053560 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=459856 CPUtime=762.19 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 60992 0 0 0 76165 54 0 0 20 0 3 0 285177517 470892544 97039 33554432000 4194304 5964478 140736015011552 139666040564072 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.25
Current children cumulated vsize (KiB) 459856

[startup+822.3 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27292
/proc/meminfo: memFree=29539560/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=460504 CPUtime=1644.22 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 94832 0 0 0 164346 76 0 0 20 0 3 0 285177517 471556096 97420 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 115126 97420 203 433 0 114690 0
[pid=27276/tid=27279] ppid=27274 vsize=460504 CPUtime=822.23 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 32969 0 0 0 82177 46 0 0 20 0 3 0 285177517 471556096 97420 33554432000 4194304 5964478 140736015011552 139666051053608 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=460504 CPUtime=822.18 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 61003 0 0 0 82163 55 0 0 20 0 3 0 285177517 471556096 97420 33554432000 4194304 5964478 140736015011552 139666040564072 4400071 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.22
Current children cumulated vsize (KiB) 460504

[startup+882.307 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27292
/proc/meminfo: memFree=29458936/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=461636 CPUtime=1764.22 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 95088 0 0 0 176346 76 0 0 20 0 3 0 285177517 472715264 97676 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 115409 97676 203 433 0 114973 0
[pid=27276/tid=27279] ppid=27274 vsize=461636 CPUtime=882.23 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 33203 0 0 0 88176 47 0 0 20 0 3 0 285177517 472715264 97676 33554432000 4194304 5964478 140736015011552 139666051053608 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=461636 CPUtime=882.19 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 61025 0 0 0 88163 56 0 0 20 0 3 0 285177517 472715264 97676 33554432000 4194304 5964478 140736015011552 139666040564072 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.22
Current children cumulated vsize (KiB) 461636



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.2 s]
/proc/loadavg: 4.00 4.00 3.95 5/182 27296
/proc/meminfo: memFree=29436352/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=461960 CPUtime=1800.01 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 95159 0 0 0 179925 76 0 0 20 0 3 0 285177517 473047040 97747 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 115490 97747 203 433 0 115054 0
[pid=27276/tid=27279] ppid=27274 vsize=461960 CPUtime=900.13 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 33274 0 0 0 89966 47 0 0 20 0 3 0 285177517 473047040 97747 33554432000 4194304 5964478 140736015011552 139666051053608 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=461960 CPUtime=900.09 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 61025 0 0 0 89953 56 0 0 20 0 3 0 285177517 473047040 97747 33554432000 4194304 5964478 140736015011552 139666040564072 4400075 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 461960

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.2 s]
/proc/loadavg: 4.00 4.00 3.95 5/182 27296
/proc/meminfo: memFree=29436352/32873648 swapFree=7112/7112
[pid=27276] ppid=27274 vsize=461960 CPUtime=1800.01 cores=1,3,5,7
/proc/27276/stat : 27276 (pwbo2.01) S 27274 27276 26380 0 -1 4202496 95159 0 0 0 179925 76 0 0 20 0 3 0 285177517 473047040 97747 33554432000 4194304 5964478 140736015011552 140736015011072 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27276/statm: 115490 97747 203 433 0 115054 0
[pid=27276/tid=27279] ppid=27274 vsize=461960 CPUtime=900.13 cores=1,3,5,7
/proc/27276/task/27279/stat : 27279 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 33274 0 0 0 89966 47 0 0 20 0 3 0 285177517 473047040 97747 33554432000 4194304 5964478 140736015011552 139666051053608 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27276/tid=27280] ppid=27274 vsize=461960 CPUtime=900.09 cores=1,3,5,7
/proc/27276/task/27280/stat : 27280 (pwbo2.01) R 27274 27276 26380 0 -1 4202560 61025 0 0 0 89953 56 0 0 20 0 3 0 285177517 473047040 97747 33554432000 4194304 5964478 140736015011552 139666040564072 4400075 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 461960

Child status: 0
Real time (s): 900.218
CPU time (s): 1800.27
CPU user time (s): 1799.21
CPU system time (s): 1.06184
CPU usage (%): 199.982
Max. virtual memory (cumulated for all children) (KiB): 461960

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.21
system time used= 1.06184
maximum resident set size= 390992
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 95160
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 362
involuntary context switches= 3345

runsolver used 1.9537 second user time and 5.06323 second system time

The end

Launcher Data 

Begin job on node126 at 2012-05-28 09:35:16
IDJOB=3712438
IDBENCH=78693
IDSOLVER=2292
FILE ID=node126/3712438-1338190516
RUNJOBID= node126-1338182394-26397
PBS_JOBID= 14624566
Free space on /tmp= 71360 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/normalized-chnl20_21_pb.cnf.cr--soft-33-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712438-1338190516/watcher-3712438-1338190516 -o /tmp/evaluation-result-3712438-1338190516/solver-3712438-1338190516 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712438-1338190516.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fbd3a39d50404986b242d7bfefa0e7f6
RANDOM SEED=1209949112

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31029720 kB
Buffers:          333552 kB
Cached:           680888 kB
SwapCached:        17756 kB
Active:           763244 kB
Inactive:         272840 kB
Active(anon):       2780 kB
Inactive(anon):    20452 kB
Active(file):     760464 kB
Inactive(file):   252388 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67086932 kB
Dirty:             10908 kB
Writeback:             0 kB
AnonPages:         11236 kB
Mapped:             9048 kB
Shmem:                 0 kB
Slab:             669512 kB
SReclaimable:     113840 kB
SUnreclaim:       555672 kB
KernelStack:        1440 kB
PageTables:         3888 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     103980 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71348 MiB
End job on node126 at 2012-05-28 09:50:18