Trace number 3712528

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.52 900.362

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/roussel/
normalized-pigeon-cardinality-35-30--soft-33-100-0.wbo
MD5SUM515e8ce2c7c31d2b78b34efd1db422a9
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark9
Best CPU time to get the best result obtained on this benchmark0.336948
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables1050
Total number of constraints65
Number of soft constraints44
Number of constraints which are clauses35
Number of constraints which are cardinality constraints (but not clauses)30
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint30
Maximum length of a constraint35
Top cost 2588
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 2587
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 36
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712528-1338193061.wbo.
0.00/0.00	c Instance file HOME/instance-3712528-1338193061.wbo
0.00/0.00	c File size is 17653 bytes.
0.00/0.00	c Highest Coefficient sum: 36
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      1094                                                |
0.00/0.00	c |  Number Clauses:        35                                                  |
0.00/0.00	c |  Number Cardinality:    10                                                  |
0.00/0.00	c |  Number PB Constraints: 20                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.12/900.31	o 258
1800.12/900.31	o 92
1800.12/900.31	o 79
1800.12/900.31	o 70
1800.12/900.31	o 14
1800.12/900.31	o 9
1800.12/900.31	c ===============================================================================
1800.12/900.31	c Wall Clock Time: 900.31 s
1800.12/900.31	c Best Solution: 9
1800.12/900.31	s SATISFIABLE
1800.12/900.31	v x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 -x118 -x119 -x120 x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 x175 -x176 -x177 -x178 -x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 -x230 -x231 -x232 -x233 -x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 -x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 -x263 -x264 -x265 -x266 -x267 -x268 -x269 -x270 x271 -x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 -x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 -x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300 -x301 -x302 -x303 -x304 -x305 -x306 -x307 -x308 -x309 -x310 -x311 -x312 -x313 -x314 -x315 -x316 -x317 -x318 -x319 -x320 -x321 -x322 -x323 -x324 -x325 -x326 -x327 -x328 x329 -x330 -x331 -x332 -x333 -x334 -x335 -x336 -x337 -x338 -x339 -x340 -x341 -x342 -x343 -x344 -x345 -x346 -x347 -x348 -x349 -x350 -x351 -x352 -x353 x354 -x355 -x356 -x357 -x358 -x359 -x360 -x361 -x362 -x363 -x364 -x365 -x366 -x367 -x368 -x369 -x370 -x371 -x372 -x373 -x374 -x375 -x376 -x377 -x378 -x379 x380 -x381 -x382 -x383 -x384 -x385 -x386 -x387 -x388 -x389 -x390 -x391 -x392 -x393 -x394 -x395 -x396 -x397 -x398 -x399 -x400 -x401 -x402 x403 -x404 -x405 -x406 -x407 -x408 -x409 -x410 -x411 -x412 -x413 -x414 -x415 -x416 -x417 -x418 -x419 -x420 -x421 -x422 -x423 x424 -x425 -x426 -x427 -x428 -x429 -x430 -x431 -x432 -x433 -x434 -x435 -x436 -x437 -x438 -x439 -x440 -x441 -x442 -x443 -x444 -x445 -x446 -x447 -x448 -x449 -x450 -x451 -x452 -x453 -x454 -x455 -x456 -x457 -x458 -x459 -x460 -x461 -x462 -x463 -x464 -x465 -x466 -x467 -x468 x469 -x470 -x471 -x472 -x473 -x474 -x475 -x476 -x477 -x478 -x479 -x480 -x481 -x482 -x483 -x484 -x485 -x486 -x487 -x488 -x489 x490 -x491 -x492 -x493 -x494 -x495 -x496 -x497 -x498 -x499 -x500 -x501 -x502 -x503 -x504 -x505 -x506 -x507 -x508 -x509 -x510 -x511 -x512 -x513 -x514 x515 -x516 -x517 -x518 -x519 -x520 -x521 -x522 -x523 -x524 -x525 -x526 -x527 -x528 -x529 -x530 -x531 -x532 -x533 -x534 -x535 -x536 -x537 -x538 -x539 -x540 -x541 -x542 -x543 -x544 -x545 -x546 -x547 -x548 -x549 -x550 -x551 -x552 -x553 -x554 -x555 -x556 -x557 -x558 -x559 -x560 -x561 -x562 -x563 -x564 -x565 -x566 -x567 -x568 -x569 x570 x571 -x572 -x573 -x574 -x575 -x576 -x577 -x578 -x579 -x580 -x581 -x582 -x583 -x584 -x585 -x586 -x587 -x588 -x589 -x590 -x591 -x592 -x593 -x594 -x595 -x596 -x597 -x598 -x599 -x600 x601 -x602 -x603 -x604 -x605 -x606 -x607 -x608 -x609 -x610 -x611 -x612 -x613 -x614 -x615 -x616 -x617 -x618 -x619 -x620 -x621 -x622 -x623 -x624 -x625 -x626 -x627 -x628 -x629 -x630 -x631 -x632 -x633 -x634 -x635 -x636 -x637 -x638 -x639 -x640 -x641 -x642 -x643 -x644 -x645 -x646 -x647 -x648 -x649 -x650 -x651 -x652 x653 -x654 -x655 -x656 -x657 -x658 -x659 -x660 -x661 -x662 -x663 -x664 -x665 -x666 -x667 -x668 -x669 -x670 -x671 -x672 -x673 x674 -x675 -x676 -x677 -x678 -x679 -x680 -x681 -x682 -x683 -x684 -x685 -x686 -x687 -x688 -x689 -x690 x691 -x692 -x693 -x694 -x695 -x696 -x697 -x698 -x699 -x700 -x701 -x702 -x703 -x704 -x705 -x706 -x707 -x708 -x709 -x710 -x711 -x712 -x713 -x714 -x715 -x716 -x717 -x718 -x719 -x720 -x721 -x722 -x723 -x724 -x725 -x726 x727 -x728 -x729 -x730 -x731 -x732 -x733 -x734 -x735 -x736 -x737 -x738 -x739 -x740 -x741 -x742 -x743 -x744 -x745 -x746 -x747 -x748 -x749 -x750 -x751 -x752 -x753 -x754 -x755 -x756 -x757 -x758 x759 -x760 -x761 -x762 -x763 -x764 -x765 -x766 -x767 -x768 -x769 -x770 -x771 -x772 -x773 -x774 -x775 -x776 -x777 -x778 -x779 -x780 -x781 -x782 -x783 -x784 -x785 -x786 -x787 -x788 -x789 -x790 -x791 -x792 -x793 -x794 -x795 -x796 -x797 x798 -x799 -x800 -x801 -x802 -x803 -x804 -x805 -x806 -x807 -x808 -x809 -x810 -x811 -x812 -x813 -x814 -x815 -x816 -x817 -x818 -x819 -x820 -x821 -x822 -x823 -x824 -x825 x826 -x827 -x828 -x829 -x830 -x831 -x832 -x833 -x834 -x835 -x836 -x837 -x838 -x839 -x840 -x841 -x842 -x843 -x844 -x845 -x846 -x847 -x848 -x849 -x850 -x851 -x852 -x853 -x854 -x855 -x856 -x857 -x858 -x859 -x860 -x861 x862 -x863 -x864 -x865 -x866 -x867 -x868 -x869 -x870 -x871 -x872 -x873 -x874 -x875 x876 -x877 -x878 -x879 -x880 -x881 -x882 -x883 -x884 -x885 -x886 -x887 -x888 -x889 -x890 -x891 -x892 -x893 -x894 -x895 -x896 -x897 -x898 -x899 -x900 -x901 -x902 -x903 -x904 -x905 -x906 -x907 -x908 -x909 -x910 x911 -x912 -x913 -x914 -x915 -x916 -x917 -x918 -x919 -x920 -x921 -x922 -x923 -x924 -x925 -x926 -x927 -x928 -x929 -x930 -x931 -x932 x933 -x934 -x935 -x936 -x937 -x938 -x939 -x940 -x941 -x942 -x943 -x944 -x945 -x946 -x947 -x948 -x949 -x950 -x951 -x952 -x953 -x954 -x955 -x956 -x957 -x958 -x959 -x960 -x961 -x962 -x963 -x964 -x965 -x966 -x967 -x968 -x969 -x970 -x971 -x972 -x973 -x974 -x975 -x976 -x977 -x978 -x979 -x980 -x981 -x982 -x983 -x984 -x985 -x986 x987 -x988 -x989 -x990 -x991 -x992 -x993 -x994 -x995 -x996 -x997 -x998 -x999 -x1000 -x1001 -x1002 -x1003 -x1004 -x1005 -x1006 -x1007 -x1008 -x1009 -x1010 -x1011 -x1012 -x1013 -x1014 -x1015 -x1016 -x1017 x1018 -x1019 -x1020 -x1021 x1022 -x1023 -x1024 -x1025 -x1026 -x1027 -x1028 -x1029 -x1030 -x1031 -x1032 -x1033 -x1034 -x1035 -x1036 -x1037 -x1038 -x1039 -x1040 -x1041 -x1042 -x1043 -x1044 -x1045 -x1046 -x1047 -x1048 -x1049 -x1050

Verifier Data 

OK	9

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712528-1338193061/watcher-3712528-1338193061 -o /tmp/evaluation-result-3712528-1338193061/solver-3712528-1338193061 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712528-1338193061.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.93 3.60 3/172 20548
/proc/meminfo: memFree=29924788/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=163152 CPUtime=0 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 1256 0 0 0 0 0 0 0 20 0 3 0 285430190 167067648 1203 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 40788 1207 198 433 0 40352 0
[pid=20548/tid=20551] ppid=20545 vsize=163152 CPUtime=0 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 141 0 0 0 0 0 0 0 20 0 3 0 285430191 167067648 1211 33554432000 4194304 5964478 140734703518832 140391644805032 5133698 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=163152 CPUtime=0 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 232 0 0 0 0 0 0 0 20 0 3 0 285430191 167067648 1214 33554432000 4194304 5964478 140734703518832 140391634315176 5244295 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.10021 s]
/proc/loadavg: 3.68 3.93 3.60 3/172 20548
/proc/meminfo: memFree=29924788/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=184668 CPUtime=0.17 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 10800 0 0 0 13 4 0 0 20 0 3 0 285430190 189100032 10715 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 46167 10718 206 433 0 45731 0
[pid=20548/tid=20551] ppid=20545 vsize=184668 CPUtime=0.08 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 411 0 0 0 8 0 0 0 20 0 3 0 285430191 189100032 10720 33554432000 4194304 5964478 140734703518832 140391644805112 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=184668 CPUtime=0.08 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 9503 0 0 0 4 4 0 0 20 0 3 0 285430191 189100032 10722 33554432000 4194304 5964478 140734703518832 140391634314664 5244295 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 184668

[startup+0.200346 s]
/proc/loadavg: 3.68 3.93 3.60 3/172 20548
/proc/meminfo: memFree=29924788/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=191156 CPUtime=0.37 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 12599 0 0 0 32 5 0 0 20 0 3 0 285430190 195743744 12513 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 47789 12513 207 433 0 47353 0
[pid=20548/tid=20551] ppid=20545 vsize=191156 CPUtime=0.18 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 690 0 0 0 16 2 0 0 20 0 3 0 285430191 195743744 12513 33554432000 4194304 5964478 140734703518832 140391644805160 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=191156 CPUtime=0.18 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 11015 0 0 0 13 5 0 0 20 0 3 0 285430191 195743744 12513 33554432000 4194304 5964478 140734703518832 140391634315496 4392902 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.37
Current children cumulated vsize (KiB) 191156

[startup+0.30042 s]
/proc/loadavg: 3.68 3.93 3.60 3/172 20548
/proc/meminfo: memFree=29924788/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=191156 CPUtime=0.57 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 12904 0 0 0 52 5 0 0 20 0 3 0 285430190 195743744 12818 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 47789 12818 207 433 0 47353 0
[pid=20548/tid=20551] ppid=20545 vsize=191156 CPUtime=0.28 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 923 0 0 0 26 2 0 0 20 0 3 0 285430191 195743744 12818 33554432000 4194304 5964478 140734703518832 140391644805160 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=191156 CPUtime=0.28 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 11087 0 0 0 23 5 0 0 20 0 3 0 285430191 195743744 12818 33554432000 4194304 5964478 140734703518832 140391634315496 4399899 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 191156

[startup+0.700295 s]
/proc/loadavg: 3.68 3.93 3.60 3/172 20548
/proc/meminfo: memFree=29924788/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=191156 CPUtime=1.37 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 14296 0 0 0 131 6 0 0 20 0 3 0 285430190 195743744 14210 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 47789 14211 207 433 0 47353 0
[pid=20548/tid=20551] ppid=20545 vsize=191156 CPUtime=0.68 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 1759 0 0 0 66 2 0 0 20 0 3 0 285430191 195743744 14211 33554432000 4194304 5964478 140734703518832 140391644805112 4400099 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=191156 CPUtime=0.68 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 11644 0 0 0 63 5 0 0 20 0 3 0 285430191 195743744 14211 33554432000 4194304 5964478 140734703518832 140391634315576 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 191156

[startup+1.50025 s]
/proc/loadavg: 3.68 3.93 3.60 5/181 20571
/proc/meminfo: memFree=29849764/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=191156 CPUtime=2.97 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 17218 0 0 0 289 8 0 0 20 0 3 0 285430190 195743744 17132 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 47789 17132 207 433 0 47353 0
[pid=20548/tid=20551] ppid=20545 vsize=191156 CPUtime=1.48 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 3242 0 0 0 145 3 0 0 20 0 3 0 285430191 195743744 17132 33554432000 4194304 5964478 140734703518832 140391644805112 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=191156 CPUtime=1.48 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 13082 0 0 0 143 5 0 0 20 0 3 0 285430191 195743744 17132 33554432000 4194304 5964478 140734703518832 140391634315576 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 191156

[startup+3.10024 s]
/proc/loadavg: 3.68 3.93 3.60 5/181 20571
/proc/meminfo: memFree=29834364/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=191516 CPUtime=6.17 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 20993 0 0 0 607 10 0 0 20 0 3 0 285430190 196112384 20907 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 47879 20907 207 433 0 47443 0
[pid=20548/tid=20551] ppid=20545 vsize=191516 CPUtime=3.08 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 4516 0 0 0 304 4 0 0 20 0 3 0 285430191 196112384 20907 33554432000 4194304 5964478 140734703518832 140391644804920 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=191516 CPUtime=3.08 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 15583 0 0 0 301 7 0 0 20 0 3 0 285430191 196112384 20907 33554432000 4194304 5964478 140734703518832 140391634315384 5244295 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 191516

[startup+6.30033 s]
/proc/loadavg: 3.71 3.93 3.60 5/181 20571
/proc/meminfo: memFree=29802532/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=191696 CPUtime=12.57 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 26553 0 0 0 1245 12 0 0 20 0 3 0 285430190 196296704 26467 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 47924 26468 207 433 0 47488 0
[pid=20548/tid=20551] ppid=20545 vsize=191696 CPUtime=6.28 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 6266 0 0 0 623 5 0 0 20 0 3 0 285430191 196296704 26468 33554432000 4194304 5964478 140734703518832 140391644805112 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=191696 CPUtime=6.28 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 19394 0 0 0 620 8 0 0 20 0 3 0 285430191 196296704 26468 33554432000 4194304 5964478 140734703518832 140391634315576 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 191696

[startup+12.7003 s]
/proc/loadavg: 3.81 3.95 3.61 5/181 20571
/proc/meminfo: memFree=29755484/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=257392 CPUtime=25.36 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 36808 0 0 0 2519 17 0 0 20 0 3 0 285430190 263569408 36715 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 64348 36715 207 433 0 63912 0
[pid=20548/tid=20551] ppid=20545 vsize=257392 CPUtime=12.67 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 9756 0 0 0 1260 7 0 0 20 0 3 0 285430191 263569408 36715 33554432000 4194304 5964478 140734703518832 140391644804920 4400099 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=257392 CPUtime=12.68 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 26158 0 0 0 1257 11 0 0 20 0 3 0 285430191 263569408 36715 33554432000 4194304 5964478 140734703518832 140391634315384 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 257392

[startup+25.5067 s]
/proc/loadavg: 3.85 3.95 3.61 5/181 20571
/proc/meminfo: memFree=29673404/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=323708 CPUtime=50.96 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 54319 0 0 0 5072 24 0 0 20 0 3 0 285430190 331476992 54220 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 80927 54220 207 433 0 80491 0
[pid=20548/tid=20551] ppid=20545 vsize=323708 CPUtime=25.47 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 17515 0 0 0 2536 11 0 0 20 0 3 0 285430191 331476992 54220 33554432000 4194304 5964478 140734703518832 140391644805112 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=323708 CPUtime=25.48 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 35910 0 0 0 2534 14 0 0 20 0 3 0 285430191 331476992 54220 33554432000 4194304 5964478 140734703518832 140391634315576 4400051 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 323708

[startup+51.1004 s]
/proc/loadavg: 3.90 3.96 3.62 5/181 20571
/proc/meminfo: memFree=29573788/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=390456 CPUtime=102.13 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 75787 0 0 0 10176 37 0 0 20 0 3 0 285430190 399826944 76226 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 97614 76226 207 433 0 97178 0
[pid=20548/tid=20551] ppid=20545 vsize=390456 CPUtime=51.05 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 22826 0 0 0 5091 14 0 0 20 0 3 0 285430191 399826944 76226 33554432000 4194304 5964478 140734703518832 140391644804920 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=390456 CPUtime=51.07 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 52067 0 0 0 5083 24 0 0 20 0 3 0 285430191 399826944 76226 33554432000 4194304 5964478 140734703518832 140391634315576 4400500 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.13
Current children cumulated vsize (KiB) 390456

[startup+102.3 s]
/proc/loadavg: 3.96 3.96 3.64 5/181 20572
/proc/meminfo: memFree=29426412/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=522900 CPUtime=204.49 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 107130 0 0 0 20390 59 0 0 20 0 3 0 285430190 535449600 108563 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 130725 108563 207 433 0 130289 0
[pid=20548/tid=20551] ppid=20545 vsize=522900 CPUtime=102.25 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 31137 0 0 0 10204 21 0 0 20 0 3 0 285430191 535449600 108563 33554432000 4194304 5964478 140734703518832 140391644805112 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=522900 CPUtime=102.26 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 75099 0 0 0 10185 41 0 0 20 0 3 0 285430191 535449600 108563 33554432000 4194304 5964478 140734703518832 140391634315624 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.49
Current children cumulated vsize (KiB) 522900

[startup+162.3 s]
/proc/loadavg: 3.98 3.97 3.66 5/182 20575
/proc/meminfo: memFree=29303752/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=656492 CPUtime=324.47 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 132429 0 0 0 32363 84 0 0 20 0 3 0 285430190 672247808 134560 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 164123 134560 207 433 0 163687 0
[pid=20548/tid=20551] ppid=20545 vsize=656492 CPUtime=162.25 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 37628 0 0 0 16195 30 0 0 20 0 3 0 285430191 672247808 134560 33554432000 4194304 5964478 140734703518832 140391644804920 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=656492 CPUtime=162.26 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 93907 0 0 0 16167 59 0 0 20 0 3 0 285430191 672247808 134560 33554432000 4194304 5964478 140734703518832 140391634315576 4400053 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.47
Current children cumulated vsize (KiB) 656492

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.68 5/181 20575
/proc/meminfo: memFree=29177496/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=728784 CPUtime=444.44 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 159625 0 0 0 44333 111 0 0 20 0 3 0 285430190 746274816 162186 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 182196 162186 207 433 0 181760 0
[pid=20548/tid=20551] ppid=20545 vsize=728784 CPUtime=222.25 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 48281 0 0 0 22182 43 0 0 20 0 3 0 285430191 746274816 162187 33554432000 4194304 5964478 140734703518832 140391644805112 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=728784 CPUtime=222.25 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 110451 0 0 0 22149 76 0 0 20 0 3 0 285430191 746274816 162187 33554432000 4194304 5964478 140734703518832 140391634315576 4400071 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.44
Current children cumulated vsize (KiB) 728784

################
# More data... #
################

/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 53913 0 0 0 28176 48 0 0 20 0 3 0 285430191 883154944 187256 33554432000 4194304 5964478 140734703518832 140391644804920 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=862456 CPUtime=282.22 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 129560 0 0 0 28126 96 0 0 20 0 3 0 285430191 883154944 187256 33554432000 4194304 5964478 140734703518832 140391634315576 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.38
Current children cumulated vsize (KiB) 862456

[startup+342.307 s]
/proc/loadavg: 4.10 4.00 3.72 5/181 20575
/proc/meminfo: memFree=28950636/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=930512 CPUtime=684.34 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 209417 0 0 0 68268 166 0 0 20 0 3 0 285430190 952844288 212483 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 232628 212483 207 433 0 232192 0
[pid=20548/tid=20551] ppid=20545 vsize=930512 CPUtime=342.23 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 64146 0 0 0 34159 64 0 0 20 0 3 0 285430191 952844288 212483 33554432000 4194304 5964478 140734703518832 140391644805112 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=930512 CPUtime=342.21 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 144377 0 0 0 34107 114 0 0 20 0 3 0 285430191 952844288 212483 33554432000 4194304 5964478 140734703518832 140391634315576 4399922 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.34
Current children cumulated vsize (KiB) 930512

[startup+402.3 s]
/proc/loadavg: 4.03 4.00 3.74 5/181 20616
/proc/meminfo: memFree=28823780/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=999396 CPUtime=804.28 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 223806 0 0 0 80236 192 0 0 20 0 3 0 285430190 1023381504 226953 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 249849 226953 207 433 0 249413 0
[pid=20548/tid=20551] ppid=20545 vsize=999396 CPUtime=402.21 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 64921 0 0 0 40156 65 0 0 20 0 3 0 285430191 1023381504 226953 33554432000 4194304 5964478 140734703518832 140391644804920 4400385 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=999396 CPUtime=402.19 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 157991 0 0 0 40079 140 0 0 20 0 3 0 285430191 1023381504 226953 33554432000 4194304 5964478 140734703518832 140391634315384 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.28
Current children cumulated vsize (KiB) 999396

[startup+462.3 s]
/proc/loadavg: 4.01 4.00 3.75 5/181 20616
/proc/meminfo: memFree=28441568/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1004956 CPUtime=924.24 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 237823 0 0 0 92209 215 0 0 20 0 3 0 285430190 1029074944 240970 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 251239 240970 207 433 0 250803 0
[pid=20548/tid=20551] ppid=20545 vsize=1004956 CPUtime=462.21 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 64939 0 0 0 46155 66 0 0 20 0 3 0 285430191 1029074944 240970 33554432000 4194304 5964478 140734703518832 140391644804920 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1004956 CPUtime=462.17 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 171990 0 0 0 46053 164 0 0 20 0 3 0 285430191 1029074944 240970 33554432000 4194304 5964478 140734703518832 140391634315576 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.24
Current children cumulated vsize (KiB) 1004956

[startup+522.3 s]
/proc/loadavg: 4.00 4.00 3.76 5/181 20616
/proc/meminfo: memFree=28204044/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1140120 CPUtime=1044.23 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 256646 0 0 0 104185 238 0 0 20 0 3 0 285430190 1167482880 259816 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 285030 259816 207 433 0 284594 0
[pid=20548/tid=20551] ppid=20545 vsize=1140120 CPUtime=522.21 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 66402 0 0 0 52153 68 0 0 20 0 3 0 285430191 1167482880 259816 33554432000 4194304 5964478 140734703518832 140391644805112 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1140120 CPUtime=522.18 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 189350 0 0 0 52033 185 0 0 20 0 3 0 285430191 1167482880 259816 33554432000 4194304 5964478 140734703518832 140391634315576 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.23
Current children cumulated vsize (KiB) 1140120

[startup+582.3 s]
/proc/loadavg: 4.00 4.00 3.77 5/181 20616
/proc/meminfo: memFree=27856492/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1209652 CPUtime=1164.2 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 271189 0 0 0 116160 260 0 0 20 0 3 0 285430190 1238683648 274355 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 302413 274355 207 433 0 301977 0
[pid=20548/tid=20551] ppid=20545 vsize=1209652 CPUtime=582.21 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 69095 0 0 0 58150 71 0 0 20 0 3 0 285430191 1238683648 274355 33554432000 4194304 5964478 140734703518832 140391644805160 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1209652 CPUtime=582.18 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 201200 0 0 0 58012 206 0 0 20 0 3 0 285430191 1238683648 274355 33554432000 4194304 5964478 140734703518832 140391634315576 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.2
Current children cumulated vsize (KiB) 1209652

[startup+642.3 s]
/proc/loadavg: 4.00 4.00 3.78 5/181 20616
/proc/meminfo: memFree=27768236/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1282344 CPUtime=1284.19 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 283335 0 0 0 128133 286 0 0 20 0 3 0 285430190 1313120256 286501 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 320586 286501 207 433 0 320150 0
[pid=20548/tid=20551] ppid=20545 vsize=1282344 CPUtime=642.22 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 70216 0 0 0 64150 72 0 0 20 0 3 0 285430191 1313120256 286501 33554432000 4194304 5964478 140734703518832 140391644805160 4379280 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1282344 CPUtime=642.19 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 212225 0 0 0 63986 233 0 0 20 0 3 0 285430191 1313120256 286501 33554432000 4194304 5964478 140734703518832 140391634315576 5136404 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.19
Current children cumulated vsize (KiB) 1282344

[startup+702.3 s]
/proc/loadavg: 4.00 4.00 3.79 5/181 20617
/proc/meminfo: memFree=27636700/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1350256 CPUtime=1404.17 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 300902 0 0 0 140091 326 0 0 20 0 3 0 285430190 1382662144 304068 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 337564 304068 207 433 0 337128 0
[pid=20548/tid=20551] ppid=20545 vsize=1350256 CPUtime=702.22 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 72493 0 0 0 70147 75 0 0 20 0 3 0 285430191 1382662144 304068 33554432000 4194304 5964478 140734703518832 140391644805112 4382003 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1350256 CPUtime=702.19 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 227515 0 0 0 69947 272 0 0 20 0 3 0 285430191 1382662144 304068 33554432000 4194304 5964478 140734703518832 140391634315576 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.17
Current children cumulated vsize (KiB) 1350256

[startup+762.3 s]
/proc/loadavg: 4.00 4.00 3.81 5/182 20620
/proc/meminfo: memFree=27548420/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1356484 CPUtime=1524.15 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 322690 0 0 0 152053 362 0 0 20 0 3 0 285430190 1389039616 325856 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 339121 325856 207 433 0 338685 0
[pid=20548/tid=20551] ppid=20545 vsize=1356484 CPUtime=762.21 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 81329 0 0 0 76137 84 0 0 20 0 3 0 285430191 1389039616 325856 33554432000 4194304 5964478 140734703518832 140391644804920 4400090 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1356484 CPUtime=762.19 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 240467 0 0 0 75918 301 0 0 20 0 3 0 285430191 1389039616 325856 33554432000 4194304 5964478 140734703518832 140391634315384 4399922 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.15
Current children cumulated vsize (KiB) 1356484

[startup+822.3 s]
/proc/loadavg: 4.03 4.01 3.82 5/181 20620
/proc/meminfo: memFree=27512748/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1422308 CPUtime=1644.13 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 328588 0 0 0 164035 378 0 0 20 0 3 0 285430190 1456443392 331754 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 355577 331754 207 433 0 355141 0
[pid=20548/tid=20551] ppid=20545 vsize=1422308 CPUtime=822.22 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 81339 0 0 0 82137 85 0 0 20 0 3 0 285430191 1456443392 331754 33554432000 4194304 5964478 140734703518832 140391644804920 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1422308 CPUtime=822.2 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 246355 0 0 0 81902 318 0 0 20 0 3 0 285430191 1456443392 331754 33554432000 4194304 5964478 140734703518832 140391634315576 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.13
Current children cumulated vsize (KiB) 1422308

[startup+882.3 s]
/proc/loadavg: 4.01 4.01 3.83 5/181 20620
/proc/meminfo: memFree=27324792/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1489320 CPUtime=1764.12 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 338485 0 0 0 176022 390 0 0 20 0 3 0 285430190 1525063680 341651 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 372330 341651 207 433 0 371894 0
[pid=20548/tid=20551] ppid=20545 vsize=1489320 CPUtime=882.22 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 91151 0 0 0 88124 98 0 0 20 0 3 0 285430191 1525063680 341651 33554432000 4194304 5964478 140734703518832 140391644805112 4400075 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1489320 CPUtime=882.21 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 246440 0 0 0 87902 319 0 0 20 0 3 0 285430191 1525063680 341651 33554432000 4194304 5964478 140734703518832 140391634315624 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.12
Current children cumulated vsize (KiB) 1489320



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.01 4.00 3.83 5/181 20620
/proc/meminfo: memFree=27326868/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1489392 CPUtime=1800.12 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 338527 0 0 0 179622 390 0 0 20 0 3 0 285430190 1525137408 341693 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 372348 341693 207 433 0 371912 0
[pid=20548/tid=20551] ppid=20545 vsize=1489392 CPUtime=900.22 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 91167 0 0 0 89924 98 0 0 20 0 3 0 285430191 1525137408 341693 33554432000 4194304 5964478 140734703518832 140391644805112 4389044 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1489392 CPUtime=900.21 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 246466 0 0 0 89702 319 0 0 20 0 3 0 285430191 1525137408 341693 33554432000 4194304 5964478 140734703518832 140391634315624 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 1489392

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.01 4.00 3.83 5/181 20620
/proc/meminfo: memFree=27326868/32873648 swapFree=7368/7368
[pid=20548] ppid=20545 vsize=1489392 CPUtime=1800.12 cores=1,3,5,7
/proc/20548/stat : 20548 (pwbo2.01) S 20545 20548 20320 0 -1 4202496 338527 0 0 0 179622 390 0 0 20 0 3 0 285430190 1525137408 341693 33554432000 4194304 5964478 140734703518832 140734703518352 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20548/statm: 372348 341693 207 433 0 371912 0
[pid=20548/tid=20551] ppid=20545 vsize=1489392 CPUtime=900.22 cores=1,3,5,7
/proc/20548/task/20551/stat : 20551 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 91167 0 0 0 89924 98 0 0 20 0 3 0 285430191 1525137408 341693 33554432000 4194304 5964478 140734703518832 140391644805112 4389044 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20548/tid=20552] ppid=20545 vsize=1489392 CPUtime=900.21 cores=1,3,5,7
/proc/20548/task/20552/stat : 20552 (pwbo2.01) R 20545 20548 20320 0 -1 4202560 246466 0 0 0 89702 319 0 0 20 0 3 0 285430191 1525137408 341693 33554432000 4194304 5964478 140734703518832 140391634315624 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 1489392

Child status: 0
Real time (s): 900.362
CPU time (s): 1800.52
CPU user time (s): 1796.28
CPU system time (s): 4.24235
CPU usage (%): 199.977
Max. virtual memory (cumulated for all children) (KiB): 1489392

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1796.28
system time used= 4.24235
maximum resident set size= 1366780
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 338529
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1095
involuntary context switches= 1827

runsolver used 2.00969 second user time and 5.08523 second system time

The end

Launcher Data 

Begin job on node149 at 2012-05-28 10:17:41
IDJOB=3712528
IDBENCH=78704
IDSOLVER=2292
FILE ID=node149/3712528-1338193061
RUNJOBID= node149-1338191256-20337
PBS_JOBID= 14624573
Free space on /tmp= 71692 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/roussel/normalized-pigeon-cardinality-35-30--soft-33-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712528-1338193061/watcher-3712528-1338193061 -o /tmp/evaluation-result-3712528-1338193061/solver-3712528-1338193061 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712528-1338193061.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 515e8ce2c7c31d2b78b34efd1db422a9
RANDOM SEED=969293961

node149.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.145
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29925060 kB
Buffers:          382672 kB
Cached:          1737452 kB
SwapCached:         2448 kB
Active:           856944 kB
Inactive:        1274320 kB
Active(anon):       2680 kB
Inactive(anon):     9340 kB
Active(file):     854264 kB
Inactive(file):  1264980 kB
Unevictable:        7368 kB
Mlocked:            7368 kB
SwapTotal:      67108856 kB
SwapFree:       67104880 kB
Dirty:              5496 kB
Writeback:             0 kB
AnonPages:         14920 kB
Mapped:            13848 kB
Shmem:                96 kB
Slab:             680708 kB
SReclaimable:     125168 kB
SUnreclaim:       555540 kB
KernelStack:        1440 kB
PageTables:         3564 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     103480 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71688 MiB
End job on node149 at 2012-05-28 10:32:43