Trace number 3703711

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)133 1800.05 900.324

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/logic_synthesis/normalized-lin.rom.r.opb
MD5SUM3183c84355c854880486b3d148840656
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark120
Best CPU time to get the best result obtained on this benchmark0.184971
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 120
Optimality of the best value was proved YES
Number of variables1076
Total number of constraints1030
Number of constraints which are clauses1030
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint40
Number of terms in the objective function 1076
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1076
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1076
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703711-1338093255.opb.
0.00/0.00	c Instance file HOME/instance-3703711-1338093255.opb
0.00/0.00	c File size is 95666 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 41
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      1076                                                |
0.00/0.01	c |  Number Clauses:        1030                                                |
0.00/0.01	c |  Number Cardinality:    0                                                   |
0.00/0.01	c |  Number PB Constraints: 0                                                   |
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Problem Type:          Optimization                                        |
0.00/0.01	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.01	c |                                                                             |
0.00/0.01	c ===============================================================================
1800.05/900.31	o 178
1800.05/900.31	o 173
1800.05/900.31	o 169
1800.05/900.31	o 161
1800.05/900.31	o 160
1800.05/900.31	o 154
1800.05/900.31	o 150
1800.05/900.31	o 146
1800.05/900.31	o 144
1800.05/900.31	o 141
1800.05/900.31	o 139
1800.05/900.31	o 138
1800.05/900.31	o 137
1800.05/900.31	o 136
1800.05/900.31	o 135
1800.05/900.31	o 133
1800.05/900.31	c ===============================================================================
1800.05/900.31	c Wall Clock Time: 900.31 s
1800.05/900.31	c Best Solution: 133
1800.05/900.31	s SATISFIABLE
1800.05/900.31	v x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 x75 -x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 x104 x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 -x180 -x181 x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 x250 -x251 -x252 -x253 -x254 -x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 -x268 -x269 -x270 -x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 -x283 -x284 x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 x298 -x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 -x329 -x330 x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 -x339 -x340 x341 x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 -x354 x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 x373 -x374 -x375 x376 -x377 -x378 -x379 -x380 -x381 -x382 -x383 x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 x403 -x404 x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 x417 -x418 -x419 -x420 -x421 -x422 -x423 -x424 -x425 -x426 -x427 -x428 -x429 -x430 x431 -x432 -x433 -x434 -x435 -x436 -x437 -x438 -x439 x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 x449 x450 -x451 -x452 -x453 x454 -x455 -x456 -x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 -x469 -x470 -x471 -x472 -x473 -x474 x475 -x476 -x477 -x478 x479 -x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 -x490 -x491 -x492 x493 -x494 -x495 -x496 -x497 -x498 -x499 x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 -x510 -x511 -x512 x513 -x514 -x515 -x516 -x517 -x518 -x519 -x520 -x521 -x522 x523 -x524 -x525 -x526 x527 -x528 -x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 -x550 x551 -x552 -x553 -x554 -x555 -x556 -x557 -x558 -x559 -x560 -x561 -x562 x563 -x564 -x565 -x566 -x567 -x568 -x569 -x570 -x571 -x572 x573 -x574 -x575 -x576 x577 x578 -x579 -x580 -x581 -x582 -x583 -x584 x585 x586 -x587 -x588 -x589 -x590 x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 x599 -x600 -x601 x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 x612 -x613 -x614 -x615 x616 -x617 -x618 x619 -x620 x621 -x622 -x623 x624 -x625 -x626 -x627 -x628 x629 -x630 -x631 -x632 -x633 x634 -x635 -x636 -x637 -x638 -x639 x640 -x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 x650 x651 -x652 -x653 -x654 x655 x656 -x657 -x658 -x659 -x660 -x661 -x662 x663 -x664 -x665 -x666 x667 -x668 -x669 -x670 x671 x672 -x673 -x674 -x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 x684 -x685 -x686 -x687 -x688 x689 -x690 -x691 -x692 -x693 -x694 -x695 -x696 -x697 x698 -x699 -x700 -x701 -x702 -x703 -x704 -x705 -x706 -x707 -x708 x709 -x710 x711 -x712 -x713 -x714 -x715 -x716 -x717 x718 -x719 -x720 -x721 -x722 -x723 -x724 x725 -x726 x727 -x728 -x729 -x730 -x731 x732 x733 -x734 -x735 -x736 -x737 -x738 -x739 -x740 -x741 x742 -x743 -x744 -x745 x746 -x747 -x748 -x749 -x750 x751 -x752 -x753 -x754 -x755 -x756 -x757 x758 -x759 -x760 -x761 -x762 -x763 -x764 -x765 -x766 -x767 -x768 -x769 -x770 -x771 x772 -x773 -x774 -x775 -x776 -x777 -x778 -x779 x780 -x781 -x782 x783 -x784 -x785 x786 -x787 -x788 -x789 x790 -x791 -x792 x793 -x794 -x795 -x796 x797 -x798 -x799 -x800 x801 -x802 x803 -x804 -x805 -x806 -x807 -x808 -x809 -x810 -x811 -x812 -x813 -x814 -x815 x816 -x817 -x818 -x819 -x820 x821 -x822 -x823 x824 -x825 -x826 -x827 -x828 -x829 -x830 -x831 -x832 -x833 -x834 -x835 -x836 -x837 -x838 -x839 x840 -x841 -x842 -x843 -x844 -x845 -x846 -x847 -x848 -x849 x850 -x851 -x852 -x853 -x854 -x855 -x856 -x857 -x858 -x859 -x860 x861 -x862 -x863 -x864 -x865 -x866 -x867 -x868 -x869 -x870 x871 -x872 -x873 -x874 x875 -x876 x877 -x878 -x879 -x880 -x881 -x882 -x883 -x884 -x885 -x886 -x887 -x888 -x889 -x890 -x891 x892 x893 -x894 -x895 -x896 -x897 -x898 -x899 -x900 -x901 -x902 -x903 -x904 -x905 -x906 -x907 -x908 -x909 -x910 -x911 x912 -x913 -x914 -x915 -x916 x917 -x918 -x919 -x920 -x921 -x922 -x923 -x924 -x925 -x926 -x927 -x928 -x929 -x930 x931 -x932 -x933 -x934 -x935 -x936 -x937 x938 -x939 -x940 -x941 -x942 -x943 -x944 -x945 -x946 -x947 x948 -x949 -x950 -x951 -x952 -x953 x954 -x955 -x956 -x957 x958 -x959 -x960 -x961 x962 -x963 -x964 -x965 -x966 -x967 -x968 -x969 -x970 x971 -x972 x973 -x974 -x975 -x976 -x977 -x978 -x979 -x980 -x981 -x982 -x983 -x984 x985 -x986 -x987 -x988 -x989 -x990 -x991 -x992 x993 -x994 -x995 x996 -x997 -x998 x999 -x1000 -x1001 -x1002 -x1003 -x1004 -x1005 -x1006 -x1007 x1008 -x1009 -x1010 -x1011 -x1012 -x1013 x1014 -x1015 -x1016 -x1017 -x1018 x1019 -x1020 -x1021 -x1022 x1023 -x1024 -x1025 -x1026 -x1027 -x1028 -x1029 -x1030 x1031 -x1032 -x1033 -x1034 -x1035 -x1036 -x1037 -x1038 -x1039 -x1040 x1041 -x1042 -x1043 -x1044 -x1045 -x1046 -x1047 -x1048 -x1049 x1050 -x1051 -x1052 -x1053 x1054 -x1055 -x1056 -x1057 -x1058 -x1059 x1060 -x1061 -x1062 -x1063 x1064 -x1065 x1066 -x1067 -x1068 -x1069 -x1070 x1071 -x1072 -x1073 x1074 x1075 -x1076

Verifier Data 

OK	133

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703711-1338093255/watcher-3703711-1338093255 -o /tmp/evaluation-result-3703711-1338093255/solver-3703711-1338093255 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703711-1338093255.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.87 3.97 3.92 4/178 21388
/proc/meminfo: memFree=31358784/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=4424 CPUtime=0 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) R 21386 21388 19605 0 -1 4202496 408 0 0 0 0 0 0 0 20 0 1 0 275451212 4530176 360 33554432000 4194304 5965102 140733817659376 140735353773736 5137146 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 1106 360 170 433 0 646 0

[startup+0.0968289 s]
/proc/loadavg: 3.87 3.97 3.92 4/178 21388
/proc/meminfo: memFree=31358784/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171704 CPUtime=0.17 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 5134 0 0 0 15 2 0 0 20 0 3 0 275451212 175824896 5039 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42926 5039 203 433 0 42490 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 171704

[startup+0.10026 s]
/proc/loadavg: 3.87 3.97 3.92 4/178 21388
/proc/meminfo: memFree=31358784/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171704 CPUtime=0.18 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 5134 0 0 0 16 2 0 0 20 0 3 0 275451212 175824896 5039 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42926 5039 203 433 0 42490 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 171704

[startup+0.300215 s]
/proc/loadavg: 3.87 3.97 3.92 4/178 21388
/proc/meminfo: memFree=31358784/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171704 CPUtime=0.58 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 5401 0 0 0 56 2 0 0 20 0 3 0 275451212 175824896 5278 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42926 5278 206 433 0 42490 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 171704

[startup+0.7002 s]
/proc/loadavg: 3.87 3.97 3.92 4/178 21388
/proc/meminfo: memFree=31358784/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171704 CPUtime=1.37 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 6029 0 0 0 135 2 0 0 20 0 3 0 275451212 175824896 5906 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42926 5906 206 433 0 42490 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 171704

[startup+1.50039 s]
/proc/loadavg: 3.87 3.97 3.92 5/181 21391
/proc/meminfo: memFree=31334464/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171704 CPUtime=2.98 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 6773 0 0 0 295 3 0 0 20 0 3 0 275451212 175824896 6650 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42926 6650 206 433 0 42490 0
[pid=21388/tid=21390] ppid=21386 vsize=171704 CPUtime=1.47 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 1849 0 0 0 146 1 0 0 20 0 3 0 275451213 175824896 6650 33554432000 4194304 5965102 140733817659376 140540087781368 4404456 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=171704 CPUtime=1.48 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 3997 0 0 0 146 2 0 0 20 0 3 0 275451213 175824896 6650 33554432000 4194304 5965102 140733817659376 140540077291880 4404383 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 171704

[startup+3.10037 s]
/proc/loadavg: 3.87 3.97 3.92 5/181 21391
/proc/meminfo: memFree=31332108/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171848 CPUtime=6.17 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 7987 0 0 0 614 3 0 0 20 0 3 0 275451212 175972352 7864 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42962 7864 206 433 0 42526 0
[pid=21388/tid=21390] ppid=21386 vsize=171848 CPUtime=3.07 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 2914 0 0 0 305 2 0 0 20 0 3 0 275451213 175972352 7864 33554432000 4194304 5965102 140733817659376 140540087781368 4390125 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=171848 CPUtime=3.07 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 4146 0 0 0 305 2 0 0 20 0 3 0 275451213 175972352 7864 33554432000 4194304 5965102 140733817659376 140540077291880 4404383 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 171848

[startup+6.30038 s]
/proc/loadavg: 3.88 3.97 3.92 5/181 21391
/proc/meminfo: memFree=31321444/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=171920 CPUtime=12.58 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 9908 0 0 0 1253 5 0 0 20 0 3 0 275451212 176046080 9785 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 42980 9785 206 433 0 42544 0
[pid=21388/tid=21390] ppid=21386 vsize=171920 CPUtime=6.25 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 4537 0 0 0 623 2 0 0 20 0 3 0 275451213 176046080 9785 33554432000 4194304 5965102 140733817659376 140540087781368 4390112 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=171920 CPUtime=6.26 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 4444 0 0 0 624 2 0 0 20 0 3 0 275451213 176046080 9785 33554432000 4194304 5965102 140733817659376 140540077291640 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 171920

[startup+12.7004 s]
/proc/loadavg: 3.89 3.97 3.92 5/181 21391
/proc/meminfo: memFree=31299148/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=172136 CPUtime=25.37 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 16355 0 0 0 2529 8 0 0 20 0 3 0 275451212 176267264 16232 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 43034 16232 206 433 0 42598 0
[pid=21388/tid=21390] ppid=21386 vsize=172136 CPUtime=12.64 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 10393 0 0 0 1259 5 0 0 20 0 3 0 275451213 176267264 16233 33554432000 4194304 5965102 140733817659376 140540087781368 5137076 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=172136 CPUtime=12.64 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 5036 0 0 0 1262 2 0 0 20 0 3 0 275451213 176267264 16233 33554432000 4194304 5965102 140733817659376 140540077291832 4400894 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 172136

[startup+25.5004 s]
/proc/loadavg: 3.92 3.97 3.92 5/181 21391
/proc/meminfo: memFree=31257668/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=237888 CPUtime=50.96 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 25843 0 0 0 5083 13 0 0 20 0 3 0 275451212 243597312 25720 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 59472 25720 206 433 0 59036 0
[pid=21388/tid=21390] ppid=21386 vsize=237888 CPUtime=25.41 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 18456 0 0 0 2532 9 0 0 20 0 3 0 275451213 243597312 25720 33554432000 4194304 5965102 140733817659376 140540087781368 4401131 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=237888 CPUtime=25.41 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 6460 0 0 0 2537 4 0 0 20 0 3 0 275451213 243597312 25720 33554432000 4194304 5965102 140733817659376 140540077291976 4400894 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 237888

[startup+51.1004 s]
/proc/loadavg: 3.94 3.97 3.92 5/181 21391
/proc/meminfo: memFree=31218408/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=238208 CPUtime=102.16 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 34970 0 0 0 10193 23 0 0 20 0 3 0 275451212 243924992 34847 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 59552 34847 206 433 0 59116 0
[pid=21388/tid=21390] ppid=21386 vsize=238208 CPUtime=50.94 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 24839 0 0 0 5080 14 0 0 20 0 3 0 275451213 243924992 34847 33554432000 4194304 5965102 140733817659376 140540087781416 4390169 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=238208 CPUtime=50.94 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 9204 0 0 0 5086 8 0 0 20 0 3 0 275451213 243924992 34847 33554432000 4194304 5965102 140733817659376 140540077291832 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.16
Current children cumulated vsize (KiB) 238208

[startup+102.307 s]
/proc/loadavg: 3.97 3.97 3.92 5/181 21472
/proc/meminfo: memFree=31266400/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=304536 CPUtime=204.54 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 48011 0 0 0 20417 37 0 0 20 0 3 0 275451212 311844864 48131 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 76134 48131 206 433 0 75698 0
[pid=21388/tid=21390] ppid=21386 vsize=304536 CPUtime=102 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 35440 0 0 0 10175 25 0 0 20 0 3 0 275451213 311844864 48131 33554432000 4194304 5965102 140733817659376 140540087781176 4400992 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=304536 CPUtime=102.02 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 11644 0 0 0 10189 13 0 0 20 0 3 0 275451213 311844864 48131 33554432000 4194304 5965102 140733817659376 140540077291832 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 304536

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21472
/proc/meminfo: memFree=31119612/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=371656 CPUtime=324.45 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 69322 0 0 0 32386 59 0 0 20 0 3 0 275451212 380575744 69636 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 92914 69636 206 433 0 92478 0
[pid=21388/tid=21390] ppid=21386 vsize=371656 CPUtime=161.8 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 48608 0 0 0 16143 37 0 0 20 0 3 0 275451213 380575744 69636 33554432000 4194304 5965102 140733817659376 140540087781368 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=371656 CPUtime=161.84 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 19787 0 0 0 16159 25 0 0 20 0 3 0 275451213 380575744 69636 33554432000 4194304 5965102 140733817659376 140540077291832 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 324.45
Current children cumulated vsize (KiB) 371656

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21472
/proc/meminfo: memFree=30982496/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=438980 CPUtime=444.37 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 85282 0 0 0 44359 78 0 0 20 0 3 0 275451212 449515520 85570 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 109745 85570 206 433 0 109309 0
[pid=21388/tid=21390] ppid=21386 vsize=438980 CPUtime=221.61 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 56062 0 0 0 22117 44 0 0 20 0 3 0 275451213 449515520 85570 33554432000 4194304 5965102 140733817659376 140540087781416 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=438980 CPUtime=221.67 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 28293 0 0 0 22127 40 0 0 20 0 3 0 275451213 449515520 85570 33554432000 4194304 5965102 140733817659376 140540077291880 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 444.37
Current children cumulated vsize (KiB) 438980

[startup+282.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21473
/proc/meminfo: memFree=30897988/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=442604 CPUtime=564.35 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 91154 0 0 0 56352 83 0 0 20 0 3 0 275451212 453226496 92635 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 110651 92635 206 433 0 110215 0
[pid=21388/tid=21390] ppid=21386 vsize=442604 CPUtime=281.45 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 61909 0 0 0 28095 50 0 0 20 0 3 0 275451213 453226496 92635 33554432000 4194304 5965102 140733817659376 140540087781176 4400978 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=442604 CPUtime=281.51 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 28318 0 0 0 28110 41 0 0 20 0 3 0 275451213 453226496 92635 33554432000 4194304 5965102 140733817659376 140540077291592 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 564.35
Current children cumulated vsize (KiB) 442604

[startup+342.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21473
/proc/meminfo: memFree=30772160/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=514084 CPUtime=684.34 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 102773 0 0 0 68340 94 0 0 20 0 3 0 275451212 526422016 104254 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 128521 104254 206 433 0 128085 0

################
# More data... #
################

[pid=21388/tid=21391] ppid=21386 vsize=514084 CPUtime=341.36 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 28338 0 0 0 34094 42 0 0 20 0 3 0 275451213 526422016 104254 33554432000 4194304 5965102 140733817659376 140540077291592 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 684.34
Current children cumulated vsize (KiB) 514084

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/182 21476
/proc/meminfo: memFree=30749736/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=514228 CPUtime=804.32 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 103118 0 0 0 80338 94 0 0 20 0 3 0 275451212 526569472 104599 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 128557 104599 206 433 0 128121 0
[pid=21388/tid=21390] ppid=21386 vsize=514228 CPUtime=401.15 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 73850 0 0 0 40053 62 0 0 20 0 3 0 275451213 526569472 104599 33554432000 4194304 5965102 140733817659376 140540087781176 4400952 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=514228 CPUtime=401.2 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 28341 0 0 0 40077 43 0 0 20 0 3 0 275451213 526569472 104599 33554432000 4194304 5965102 140733817659376 140540077291592 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 804.32
Current children cumulated vsize (KiB) 514228

[startup+462.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21476
/proc/meminfo: memFree=30619984/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=580832 CPUtime=924.3 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 118163 0 0 0 92322 108 0 0 20 0 3 0 275451212 594771968 119644 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 145208 119644 206 433 0 144772 0
[pid=21388/tid=21390] ppid=21386 vsize=580832 CPUtime=460.99 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 88871 0 0 0 46022 77 0 0 20 0 3 0 275451213 594771968 119644 33554432000 4194304 5965102 140733817659376 140540087781368 4401155 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=580832 CPUtime=461.05 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 28365 0 0 0 46061 44 0 0 20 0 3 0 275451213 594771968 119644 33554432000 4194304 5965102 140733817659376 140540077291592 4400960 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 924.3
Current children cumulated vsize (KiB) 580832

[startup+522.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21476
/proc/meminfo: memFree=30565224/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=583028 CPUtime=1044.24 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 119505 0 0 0 104314 110 0 0 20 0 3 0 275451212 597020672 121161 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 145757 121161 206 433 0 145321 0
[pid=21388/tid=21390] ppid=21386 vsize=583028 CPUtime=520.8 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 89438 0 0 0 52002 78 0 0 20 0 3 0 275451213 597020672 121161 33554432000 4194304 5965102 140733817659376 140540087781176 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=583028 CPUtime=520.89 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 29140 0 0 0 52043 46 0 0 20 0 3 0 275451213 597020672 121161 33554432000 4194304 5965102 140733817659376 140540077291832 4400978 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1044.24
Current children cumulated vsize (KiB) 583028

[startup+582.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21517
/proc/meminfo: memFree=30957576/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=659420 CPUtime=1164.17 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 133658 0 0 0 116291 126 0 0 20 0 3 0 275451212 675246080 135365 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 164855 135365 206 433 0 164419 0
[pid=21388/tid=21390] ppid=21386 vsize=659420 CPUtime=580.62 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 103562 0 0 0 57967 95 0 0 20 0 3 0 275451213 675246080 135365 33554432000 4194304 5965102 140733817659376 140540087781320 4401127 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=659420 CPUtime=580.72 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 29169 0 0 0 58025 47 0 0 20 0 3 0 275451213 675246080 135365 33554432000 4194304 5965102 140733817659376 140540077291656 4400894 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1164.17
Current children cumulated vsize (KiB) 659420

[startup+642.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21517
/proc/meminfo: memFree=30885576/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=662400 CPUtime=1284.15 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 140955 0 0 0 128281 134 0 0 20 0 3 0 275451212 678297600 142661 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 165600 142661 206 433 0 165164 0
[pid=21388/tid=21390] ppid=21386 vsize=662400 CPUtime=640.46 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 110834 0 0 0 63942 104 0 0 20 0 3 0 275451213 678297600 142661 33554432000 4194304 5965102 140733817659376 140540087781416 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=662400 CPUtime=640.57 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 29194 0 0 0 64009 48 0 0 20 0 3 0 275451213 678297600 142661 33554432000 4194304 5965102 140733817659376 140540077291656 4401648 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1284.15
Current children cumulated vsize (KiB) 662400

[startup+702.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21517
/proc/meminfo: memFree=30832104/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=663036 CPUtime=1404.11 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 146960 0 0 0 140264 147 0 0 20 0 3 0 275451212 678948864 148674 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 165759 148674 206 433 0 165323 0
[pid=21388/tid=21390] ppid=21386 vsize=663036 CPUtime=700.28 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 110977 0 0 0 69923 105 0 0 20 0 3 0 275451213 678948864 148674 33554432000 4194304 5965102 140733817659376 140540087781416 4400960 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=663036 CPUtime=700.41 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 35056 0 0 0 69980 61 0 0 20 0 3 0 275451213 678948864 148674 33554432000 4194304 5965102 140733817659376 140540077291832 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1404.11
Current children cumulated vsize (KiB) 663036

[startup+762.307 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21517
/proc/meminfo: memFree=30782380/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=729536 CPUtime=1524.1 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 153974 0 0 0 152249 161 0 0 20 0 3 0 275451212 747044864 155688 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 182384 155688 206 433 0 181948 0
[pid=21388/tid=21390] ppid=21386 vsize=729536 CPUtime=760.14 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 111073 0 0 0 75908 106 0 0 20 0 3 0 275451213 747044864 155688 33554432000 4194304 5965102 140733817659376 140540087781416 4399524 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=729536 CPUtime=760.26 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 41974 0 0 0 75949 77 0 0 20 0 3 0 275451213 747044864 155688 33554432000 4194304 5965102 140733817659376 140540077291880 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1524.1
Current children cumulated vsize (KiB) 729536

[startup+822.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/181 21517
/proc/meminfo: memFree=30783408/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=699072 CPUtime=1644.08 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 153984 0 0 0 164246 162 0 0 20 0 3 0 275451212 715849728 149542 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 174768 149542 206 433 0 174332 0
[pid=21388/tid=21390] ppid=21386 vsize=699072 CPUtime=819.97 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 111080 0 0 0 81890 107 0 0 20 0 3 0 275451213 715849728 149542 33554432000 4194304 5965102 140733817659376 140540087782328 4390150 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=699072 CPUtime=820.1 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 41977 0 0 0 81932 78 0 0 20 0 3 0 275451213 715849728 149542 33554432000 4194304 5965102 140733817659376 140540077291880 4400955 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1644.08
Current children cumulated vsize (KiB) 699072

[startup+882.3 s]
/proc/loadavg: 4.03 3.99 3.93 5/181 21558
/proc/meminfo: memFree=30900292/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=699208 CPUtime=1764.05 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 154035 0 0 0 176243 162 0 0 20 0 3 0 275451212 715988992 149590 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 174802 149590 206 433 0 174366 0
[pid=21388/tid=21390] ppid=21386 vsize=699208 CPUtime=879.82 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 111088 0 0 0 87874 108 0 0 20 0 3 0 275451213 715988992 149590 33554432000 4194304 5965102 140733817659376 140540087782328 4390129 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=699208 CPUtime=879.95 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 42020 0 0 0 87916 79 0 0 20 0 3 0 275451213 715988992 149590 33554432000 4194304 5965102 140733817659376 140540077291592 4400927 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1764.05
Current children cumulated vsize (KiB) 699208



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.02 3.99 3.93 5/181 21558
/proc/meminfo: memFree=30880504/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=699208 CPUtime=1800.05 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 154044 0 0 0 179843 162 0 0 20 0 3 0 275451212 715988992 149594 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 174802 149594 206 433 0 174366 0
[pid=21388/tid=21390] ppid=21386 vsize=699208 CPUtime=897.77 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 111093 0 0 0 89669 108 0 0 20 0 3 0 275451213 715988992 149594 33554432000 4194304 5965102 140733817659376 140540087782328 4401096 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=699208 CPUtime=897.91 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 42024 0 0 0 89712 79 0 0 20 0 3 0 275451213 715988992 149594 33554432000 4194304 5965102 140733817659376 140540077291592 4404383 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 699208

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.02 3.99 3.93 5/181 21558
/proc/meminfo: memFree=30880504/32873844 swapFree=7112/7112
[pid=21388] ppid=21386 vsize=699208 CPUtime=1800.05 cores=1,3,5,7
/proc/21388/stat : 21388 (pwbo2.0) S 21386 21388 19605 0 -1 4202496 154044 0 0 0 179843 162 0 0 20 0 3 0 275451212 715988992 149594 33554432000 4194304 5965102 140733817659376 140733817658896 4547341 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/21388/statm: 174802 149594 206 433 0 174366 0
[pid=21388/tid=21390] ppid=21386 vsize=699208 CPUtime=897.77 cores=1,3,5,7
/proc/21388/task/21390/stat : 21390 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 111093 0 0 0 89669 108 0 0 20 0 3 0 275451213 715988992 149594 33554432000 4194304 5965102 140733817659376 140540087782328 4401096 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=21388/tid=21391] ppid=21386 vsize=699208 CPUtime=897.91 cores=1,3,5,7
/proc/21388/task/21391/stat : 21391 (pwbo2.0) R 21386 21388 19605 0 -1 4202560 42024 0 0 0 89712 79 0 0 20 0 3 0 275451213 715988992 149594 33554432000 4194304 5965102 140733817659376 140540077291592 4404383 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 699208

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21388 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=844294
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=901710
# CPU time returned by wait4() is 1795.75
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.324
CPU time (s): 1800.05
CPU user time (s): 1798.43
CPU system time (s): 1.62
CPU usage (%): 199.934
Max. virtual memory (cumulated for all children) (KiB): 729536

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.84
system time used= 1.90171
maximum resident set size= 622752
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 154046
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 468
involuntary context switches= 1900

runsolver used 2.99354 second user time and 4.64329 second system time

The end

Launcher Data 

Begin job on node119 at 2012-05-27 06:34:15
IDJOB=3703711
IDBENCH=2871
IDSOLVER=2279
FILE ID=node119/3703711-1338093255
RUNJOBID= node119-1338085105-19622
PBS_JOBID= 14624426
Free space on /tmp= 71604 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/logic_synthesis/normalized-lin.rom.r.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703711-1338093255/watcher-3703711-1338093255 -o /tmp/evaluation-result-3703711-1338093255/solver-3703711-1338093255 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703711-1338093255.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3183c84355c854880486b3d148840656
RANDOM SEED=1645290886

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31359312 kB
Buffers:          256144 kB
Cached:           270140 kB
SwapCached:         1776 kB
Active:           660628 kB
Inactive:          57764 kB
Active(anon):     192140 kB
Inactive(anon):     1972 kB
Active(file):     468488 kB
Inactive(file):    55792 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100168 kB
Dirty:              5860 kB
Writeback:             0 kB
AnonPages:        197216 kB
Mapped:            12588 kB
Shmem:                 8 kB
Slab:             656204 kB
SReclaimable:      98028 kB
SUnreclaim:       558176 kB
KernelStack:        1504 kB
PageTables:         4452 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     200816 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    149504 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71600 MiB
End job on node119 at 2012-05-27 06:49:18