Trace number 3725933

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)-45 1800.05 900.555

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/
~kexu/benchmarks/frb50-23-opb/normalized-frb50-23-2.opb
MD5SUM669011fc499ae56e44c354cc6cddc4c7
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-47
Best CPU time to get the best result obtained on this benchmark1800.04
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -49
Optimality of the best value was proved NO
Number of variables1150
Total number of constraints80851
Number of constraints which are clauses80851
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint2
Number of terms in the objective function 1150
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1150
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1150
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3725933-1338655058.opb.
0.00/0.00	c Instance file HOME/instance-3725933-1338655058.opb
0.00/0.00	c File size is 1957484 bytes.
0.09/0.14	c Cost Offset: -1150
0.09/0.14	c Highest Coefficient sum: 3
0.09/0.14	c ============================[ Problem Statistics ]=============================
0.09/0.14	c |                                                                             |
0.09/0.14	c |  Parsing time:          0.14         s                                      |
0.09/0.14	c |  Number Variables:      1150                                                |
0.09/0.14	c |  Number Clauses:        80851                                               |
0.09/0.14	c |  Number Cardinality:    0                                                   |
0.09/0.14	c |  Number PB Constraints: 0                                                   |
0.09/0.14	c |                                                                             |
0.09/0.18	c |  Problem Type:          Optimization                                        |
0.09/0.18	c |  Objective Function:    Cardinality Constraint                              |
0.09/0.18	c |                                                                             |
0.09/0.18	c ===============================================================================
1800.05/900.51	o -36
1800.05/900.51	o -37
1800.05/900.51	o -38
1800.05/900.51	o -39
1800.05/900.51	o -40
1800.05/900.51	o -41
1800.05/900.51	o -42
1800.05/900.51	o -43
1800.05/900.51	o -44
1800.05/900.51	o -45
1800.05/900.51	c ===============================================================================
1800.05/900.51	c Wall Clock Time: 900.51 s
1800.05/900.51	c Best Solution: -45
1800.05/900.51	s SATISFIABLE
1800.05/900.51	v -x1150 -x1149 -x1148 -x1147 -x1146 -x1145 -x1144 x1143 -x1142 -x1141 -x1140 -x1139 -x1138 -x1137 -x1136 -x1135 -x1134 -x1133 -x1132 -x1131 -x1130 -x1129 -x1128 -x1127 -x1126 -x1125 -x1124 -x1123 -x1122 -x1121 -x1120 -x1119 -x1118 x1117 -x1116 -x1115 -x1114 -x1113 -x1112 -x1111 -x1110 -x1109 -x1108 -x1107 -x1106 -x1105 -x1104 -x1103 -x1102 -x1101 -x1100 x1099 -x1098 -x1097 -x1096 -x1095 -x1094 -x1093 -x1092 -x1091 -x1090 -x1089 -x1088 -x1087 -x1086 -x1085 -x1084 -x1083 -x1082 -x1081 -x1080 -x1079 -x1078 -x1077 -x1076 -x1075 -x1074 -x1073 -x1072 -x1071 -x1070 -x1069 -x1068 -x1067 -x1066 -x1065 -x1064 -x1063 -x1062 x1061 -x1060 -x1059 -x1058 x1057 -x1056 -x1055 -x1054 -x1053 -x1052 -x1051 -x1050 -x1049 -x1048 -x1047 -x1046 -x1045 -x1044 -x1043 -x1042 -x1041 -x1040 -x1039 -x1038 -x1037 -x1036 -x1035 -x1034 -x1033 -x1032 -x1031 -x1030 -x1029 -x1028 -x1027 -x1026 -x1025 -x1024 -x1023 -x1022 -x1021 -x1020 -x1019 -x1018 -x1017 -x1016 x1015 -x1014 -x1013 -x1012 -x1011 -x1010 -x1009 -x1008 -x1007 -x1006 -x1005 -x1004 -x1003 x1002 -x1001 -x1000 -x999 -x998 -x997 -x996 -x995 -x994 -x993 -x992 -x991 -x990 -x989 -x988 -x987 -x986 -x985 -x984 -x983 -x982 -x981 -x980 -x979 -x978 -x977 -x976 -x975 -x974 x973 -x972 -x971 -x970 -x969 -x968 -x967 -x966 -x965 -x964 -x963 -x962 -x961 -x960 -x959 -x958 -x957 -x956 -x955 -x954 -x953 -x952 -x951 -x950 -x949 -x948 -x947 -x946 -x945 x944 -x943 -x942 -x941 -x940 -x939 -x938 -x937 -x936 -x935 -x934 -x933 -x932 -x931 -x930 -x929 -x928 -x927 -x926 x925 -x924 -x923 -x922 -x921 -x920 -x919 -x918 -x917 -x916 -x915 -x914 -x913 -x912 -x911 -x910 -x909 -x908 -x907 -x906 -x905 -x904 -x903 -x902 -x901 x900 -x899 -x898 -x897 -x896 x895 -x894 -x893 -x892 -x891 -x890 -x889 -x888 -x887 -x886 -x885 -x884 -x883 -x882 -x881 -x880 -x879 -x878 -x877 -x876 -x875 -x874 -x873 -x872 -x871 -x870 -x869 -x868 -x867 -x866 -x865 -x864 -x863 -x862 -x861 -x860 -x859 -x858 -x857 -x856 -x855 x854 -x853 -x852 -x851 -x850 -x849 -x848 -x847 -x846 -x845 -x844 -x843 -x842 -x841 -x840 -x839 -x838 -x837 -x836 -x835 -x834 -x833 -x832 -x831 -x830 -x829 -x828 -x827 -x826 -x825 -x824 -x823 x822 -x821 -x820 -x819 -x818 -x817 -x816 -x815 -x814 -x813 -x812 -x811 -x810 -x809 -x808 -x807 -x806 -x805 -x804 -x803 -x802 -x801 -x800 -x799 -x798 -x797 -x796 -x795 -x794 -x793 -x792 -x791 -x790 -x789 -x788 x787 -x786 -x785 -x784 -x783 -x782 -x781 -x780 -x779 -x778 -x777 -x776 -x775 -x774 -x773 -x772 -x771 -x770 -x769 -x768 -x767 -x766 -x765 x764 -x763 -x762 -x761 -x760 -x759 -x758 -x757 -x756 -x755 -x754 -x753 -x752 -x751 -x750 -x749 -x748 -x747 x746 -x745 -x744 -x743 -x742 -x741 -x740 -x739 -x738 -x737 x736 -x735 -x734 -x733 -x732 -x731 -x730 -x729 -x728 -x727 -x726 -x725 -x724 -x723 -x722 -x721 -x720 -x719 -x718 -x717 -x716 -x715 -x714 -x713 -x712 -x711 -x710 -x709 -x708 x707 -x706 -x705 -x704 -x703 -x702 -x701 -x700 -x699 -x698 -x697 -x696 -x695 -x694 -x693 -x692 -x691 -x690 -x689 -x688 -x687 -x686 -x685 -x684 -x683 -x682 -x681 -x680 -x679 -x678 -x677 -x676 -x675 -x674 -x673 -x672 -x671 -x670 -x669 x668 -x667 -x666 -x665 -x664 -x663 -x662 -x661 -x660 -x659 -x658 -x657 -x656 -x655 -x654 -x653 -x652 -x651 -x650 x649 -x648 -x647 -x646 -x645 x644 -x643 -x642 -x641 -x640 -x639 -x638 -x637 -x636 -x635 -x634 -x633 -x632 -x631 -x630 -x629 -x628 -x627 -x626 -x625 -x624 -x623 -x622 -x621 -x620 -x619 -x618 -x617 -x616 -x615 -x614 -x613 x612 -x611 -x610 -x609 -x608 -x607 -x606 -x605 -x604 -x603 -x602 -x601 -x600 -x599 -x598 -x597 -x596 -x595 -x594 -x593 x592 -x591 -x590 -x589 -x588 -x587 -x586 -x585 -x584 -x583 -x582 -x581 -x580 -x579 -x578 -x577 -x576 -x575 x574 -x573 -x572 -x571 -x570 -x569 -x568 -x567 -x566 -x565 -x564 -x563 -x562 -x561 -x560 -x559 -x558 -x557 -x556 -x555 -x554 -x553 x552 -x551 -x550 -x549 -x548 -x547 -x546 -x545 -x544 -x543 -x542 -x541 -x540 -x539 -x538 -x537 -x536 -x535 -x534 -x533 -x532 -x531 -x530 -x529 -x528 -x527 -x526 -x525 -x524 x523 -x522 -x521 -x520 -x519 -x518 -x517 -x516 -x515 -x514 -x513 -x512 -x511 -x510 -x509 -x508 -x507 -x506 -x505 -x504 -x503 -x502 x501 -x500 -x499 -x498 -x497 -x496 -x495 -x494 -x493 -x492 -x491 -x490 -x489 -x488 -x487 -x486 -x485 -x484 -x483 -x482 -x481 -x480 -x479 -x478 -x477 -x476 -x475 -x474 -x473 -x472 -x471 -x470 -x469 -x468 -x467 -x466 -x465 x464 -x463 -x462 -x461 -x460 -x459 -x458 -x457 -x456 x455 -x454 -x453 -x452 -x451 -x450 -x449 -x448 -x447 -x446 -x445 -x444 -x443 -x442 -x441 -x440 -x439 -x438 -x437 -x436 -x435 -x434 -x433 -x432 -x431 -x430 -x429 -x428 -x427 -x426 -x425 -x424 -x423 -x422 x421 -x420 -x419 -x418 -x417 -x416 -x415 -x414 -x413 -x412 -x411 -x410 -x409 -x408 x407 -x406 -x405 -x404 -x403 -x402 -x401 -x400 -x399 -x398 -x397 -x396 -x395 -x394 -x393 -x392 -x391 -x390 -x389 -x388 -x387 -x386 x385 -x384 -x383 -x382 -x381 -x380 -x379 -x378 -x377 -x376 -x375 -x374 -x373 -x372 -x371 -x370 -x369 -x368 -x367 -x366 -x365 -x364 -x363 -x362 -x361 -x360 -x359 -x358 x357 -x356 -x355 -x354 -x353 -x352 -x351 -x350 -x349 -x348 -x347 -x346 -x345 -x344 -x343 -x342 -x341 -x340 -x339 -x338 -x337 -x336 -x335 -x334 -x333 -x332 -x331 -x330 -x329 -x328 -x327 -x326 -x325 -x324 x323 -x322 -x321 -x320 -x319 -x318 -x317 -x316 -x315 -x314 -x313 -x312 -x311 -x310 -x309 -x308 -x307 -x306 -x305 -x304 -x303 -x302 -x301 -x300 -x299 -x298 -x297 -x296 -x295 -x294 -x293 -x292 -x291 -x290 -x289 -x288 -x287 -x286 -x285 -x284 -x283 -x282 -x281 -x280 -x279 -x278 -x277 -x276 -x275 -x274 -x273 -x272 -x271 -x270 -x269 -x268 -x267 -x266 -x265 -x264 -x263 -x262 -x261 -x260 -x259 -x258 -x257 -x256 -x255 x254 -x253 -x252 -x251 -x250 -x249 -x248 -x247 -x246 -x245 -x244 -x243 -x242 -x241 -x240 -x239 -x238 x237 -x236 -x235 -x234 -x233 -x232 -x231 -x230 -x229 -x228 -x227 -x226 -x225 -x224 -x223 -x222 -x221 -x220 -x219 -x218 -x217 -x216 x215 -x214 -x213 -x212 -x211 -x210 -x209 -x208 -x207 -x206 -x205 x204 -x203 -x202 -x201 -x200 -x199 -x198 -x197 -x196 -x195 -x194 -x193 -x192 -x191 -x190 -x189 -x188 -x187 -x186 -x185 x184 -x183 -x182 -x181 -x180 -x179 -x178 -x177 -x176 -x175 -x174 -x173 -x172 -x171 -x170 -x169 -x168 -x167 -x166 -x165 -x164 -x163 -x162 -x161 -x160 -x159 -x158 -x157 -x156 -x155 -x154 -x153 -x152 -x151 -x150 -x149 -x148 -x147 -x146 -x145 -x144 -x143 -x142 -x141 -x140 -x139 -x138 -x137 x136 -x135 -x134 -x133 -x132 -x131 -x130 -x129 -x128 -x127 -x126 -x125 -x124 -x123 -x122 -x121 -x120 -x119 -x118 -x117 -x116 -x115 -x114 -x113 -x112 -x111 -x110 -x109 -x108 -x107 -x106 -x105 -x104 -x103 -x102 -x101 -x100 -x99 -x98 -x97 -x96 -x95 -x94 -x93 -x92 -x91 -x90 -x89 -x88 -x87 -x86 -x85 -x84 -x83 -x82 -x81 -x80 -x79 x78 -x77 -x76 -x75 -x74 -x73 -x72 -x71 -x70 -x69 -x68 -x67 -x66 -x65 -x64 -x63 -x62 -x61 -x60 -x59 -x58 -x57 -x56 -x55 -x54 -x53 -x52 -x51 x50 -x49 -x48 -x47 -x46 -x45 -x44 -x43 -x42 -x41 -x40 -x39 -x38 -x37 -x36 -x35 -x34 -x33 -x32 -x31 -x30 -x29 x28 -x27 -x26 -x25 -x24 -x23 x22 -x21 -x20 -x19 -x18 -x17 -x16 -x15 -x14 -x13 -x12 -x11 -x10 -x9 -x8 -x7 -x6 -x5 -x4 -x3 -x2 -x1

Verifier Data 

OK	-45

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3725933-1338655058/watcher-3725933-1338655058 -o /tmp/evaluation-result-3725933-1338655058/solver-3725933-1338655058 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725933-1338655058.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.04 4.00 3.91 4/178 5725
/proc/meminfo: memFree=26677184/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=6240 CPUtime=0 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) R 5723 5725 3386 0 -1 4202496 405 0 0 0 0 0 0 0 20 0 1 0 331634295 6389760 357 33554432000 4194304 5964478 140736885825328 140736885823272 5136490 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 1560 358 162 433 0 646 0

[startup+0.0538271 s]
/proc/loadavg: 4.04 4.00 3.91 4/178 5725
/proc/meminfo: memFree=26677184/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=10828 CPUtime=0.04 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) R 5723 5725 3386 0 -1 4202496 1657 0 0 0 4 0 0 0 20 0 1 0 331634295 11087872 1610 33554432000 4194304 5964478 140736885825328 140736885823272 4344768 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 2707 1611 321 433 0 1793 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 10828

[startup+0.10031 s]
/proc/loadavg: 4.04 4.00 3.91 4/178 5725
/proc/meminfo: memFree=26677184/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=14968 CPUtime=0.09 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) R 5723 5725 3386 0 -1 4202496 2934 0 0 0 9 0 0 0 20 0 1 0 331634295 15327232 2820 33554432000 4194304 5964478 140736885825328 140736885823272 4344768 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 3742 2821 479 433 0 2828 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 14968

[startup+0.300158 s]
/proc/loadavg: 4.04 4.00 3.91 4/178 5725
/proc/meminfo: memFree=26677184/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=0.4 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 16735 0 0 0 34 6 0 0 20 0 3 0 331634295 189538304 15692 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 15692 200 433 0 45838 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 185096

[startup+0.700165 s]
/proc/loadavg: 4.04 4.00 3.91 4/178 5725
/proc/meminfo: memFree=26677184/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=1.2 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 16858 0 0 0 114 6 0 0 20 0 3 0 331634295 189538304 15815 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 15815 201 433 0 45838 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 185096

[startup+1.50029 s]
/proc/loadavg: 4.04 4.00 3.91 3/177 5729
/proc/meminfo: memFree=29087476/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=2.79 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 16950 0 0 0 273 6 0 0 20 0 3 0 331634295 189538304 15907 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 15907 201 433 0 45838 0
[pid=5725/tid=5727] ppid=5723 vsize=185096 CPUtime=1.32 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 5185 0 0 0 128 4 0 0 20 0 3 0 331634309 189538304 15907 33554432000 4194304 5964478 140736885825328 139851692272152 4419547 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=185096 CPUtime=1.33 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 7050 0 0 0 131 2 0 0 20 0 3 0 331634309 189538304 15907 33554432000 4194304 5964478 140736885825328 139851681782120 4399986 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 185096

[startup+3.10035 s]
/proc/loadavg: 4.04 4.00 3.91 3/177 5729
/proc/meminfo: memFree=29086856/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=5.99 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 17162 0 0 0 593 6 0 0 20 0 3 0 331634295 189538304 16119 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 16119 201 433 0 45838 0
[pid=5725/tid=5727] ppid=5723 vsize=185096 CPUtime=2.92 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 5312 0 0 0 288 4 0 0 20 0 3 0 331634309 189538304 16119 33554432000 4194304 5964478 140736885825328 139851692272152 5236855 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=185096 CPUtime=2.93 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 7135 0 0 0 291 2 0 0 20 0 3 0 331634309 189538304 16119 33554432000 4194304 5964478 140736885825328 139851681782120 4399915 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 5.99
Current children cumulated vsize (KiB) 185096

[startup+6.30035 s]
/proc/loadavg: 4.04 4.00 3.91 5/181 5769
/proc/meminfo: memFree=28992856/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=12.4 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 17730 0 0 0 1233 7 0 0 20 0 3 0 331634295 189538304 16687 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 16687 201 433 0 45838 0
[pid=5725/tid=5727] ppid=5723 vsize=185096 CPUtime=6.11 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 5692 0 0 0 607 4 0 0 20 0 3 0 331634309 189538304 16687 33554432000 4194304 5964478 140736885825328 139851692272072 5139166 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=185096 CPUtime=6.12 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 7323 0 0 0 610 2 0 0 20 0 3 0 331634309 189538304 16687 33554432000 4194304 5964478 140736885825328 139851681781880 4399854 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.4
Current children cumulated vsize (KiB) 185096

[startup+12.7003 s]
/proc/loadavg: 4.03 4.00 3.91 5/181 5769
/proc/meminfo: memFree=28977296/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=25.2 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 23280 0 0 0 2510 10 0 0 20 0 3 0 331634295 189538304 20273 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 20273 201 433 0 45838 0
[pid=5725/tid=5727] ppid=5723 vsize=185096 CPUtime=12.5 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 8738 0 0 0 1245 5 0 0 20 0 3 0 331634309 189538304 20273 33554432000 4194304 5964478 140736885825328 139851692272152 4394826 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=185096 CPUtime=12.5 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 9827 0 0 0 1246 4 0 0 20 0 3 0 331634309 189538304 20273 33554432000 4194304 5964478 140736885825328 139851681782072 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.2
Current children cumulated vsize (KiB) 185096

[startup+25.5004 s]
/proc/loadavg: 4.02 4.00 3.91 5/181 5769
/proc/meminfo: memFree=28922604/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=185096 CPUtime=50.78 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 41539 0 0 0 5054 24 0 0 20 0 3 0 331634295 189538304 31462 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 46274 31463 202 433 0 45838 0
[pid=5725/tid=5727] ppid=5723 vsize=185096 CPUtime=25.26 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 18477 0 0 0 2518 8 0 0 20 0 3 0 331634309 189538304 31463 33554432000 4194304 5964478 140736885825328 139851692272024 4419535 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=185096 CPUtime=25.26 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 18348 0 0 0 2511 15 0 0 20 0 3 0 331634309 189538304 31463 33554432000 4194304 5964478 140736885825328 139851681782072 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.78
Current children cumulated vsize (KiB) 185096

[startup+51.1003 s]
/proc/loadavg: 4.02 4.00 3.91 5/181 5769
/proc/meminfo: memFree=28773880/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=251716 CPUtime=101.93 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 72968 0 0 0 10143 50 0 0 20 0 3 0 331634295 257757184 52780 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 62929 52780 202 433 0 62493 0
[pid=5725/tid=5727] ppid=5723 vsize=251716 CPUtime=50.78 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 33863 0 0 0 5065 13 0 0 20 0 3 0 331634309 257757184 52780 33554432000 4194304 5964478 140736885825328 139851692272152 4400038 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=251716 CPUtime=50.77 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 34390 0 0 0 5041 36 0 0 20 0 3 0 331634309 257757184 52780 33554432000 4194304 5964478 140736885825328 139851681782072 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 101.93
Current children cumulated vsize (KiB) 251716

[startup+102.306 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5769
/proc/meminfo: memFree=28513836/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=449396 CPUtime=204.28 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 103231 0 0 0 20351 77 0 0 20 0 3 0 331634295 460181504 83009 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 112349 83009 202 433 0 111913 0
[pid=5725/tid=5727] ppid=5723 vsize=449396 CPUtime=101.83 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 41831 0 0 0 10165 18 0 0 20 0 3 0 331634309 460181504 83009 33554432000 4194304 5964478 140736885825328 139851692271416 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=449396 CPUtime=101.83 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 56685 0 0 0 10123 60 0 0 20 0 3 0 331634309 460181504 83009 33554432000 4194304 5964478 140736885825328 139851681782072 4400078 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.28
Current children cumulated vsize (KiB) 449396

[startup+162.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/182 5772
/proc/meminfo: memFree=28247340/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=516284 CPUtime=324.24 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 134301 0 0 0 32304 120 0 0 20 0 3 0 331634295 528674816 114572 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 129071 114572 202 433 0 128635 0
[pid=5725/tid=5727] ppid=5723 vsize=516284 CPUtime=161.67 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 47625 0 0 0 16142 25 0 0 20 0 3 0 331634309 528674816 114572 33554432000 4194304 5964478 140736885825328 139851692271416 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=516284 CPUtime=161.67 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 81961 0 0 0 16070 97 0 0 20 0 3 0 331634309 528674816 114572 33554432000 4194304 5964478 140736885825328 139851681782072 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.24
Current children cumulated vsize (KiB) 516284

[startup+222.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5773
/proc/meminfo: memFree=28108008/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=582088 CPUtime=444.23 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 143014 0 0 0 44295 128 0 0 20 0 3 0 331634295 596058112 123282 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 145522 123282 202 433 0 145086 0
[pid=5725/tid=5727] ppid=5723 vsize=582088 CPUtime=221.51 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 50010 0 0 0 22123 28 0 0 20 0 3 0 331634309 596058112 123282 33554432000 4194304 5964478 140736885825328 139851692272024 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=582088 CPUtime=221.51 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 88289 0 0 0 22046 105 0 0 20 0 3 0 331634309 596058112 123282 33554432000 4194304 5964478 140736885825328 139851681781832 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.23
Current children cumulated vsize (KiB) 582088

[startup+282.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5773
/proc/meminfo: memFree=28048144/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=647900 CPUtime=564.21 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 149479 0 0 0 56283 138 0 0 20 0 3 0 331634295 663449600 129745 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 161975 129745 202 433 0 161539 0
[pid=5725/tid=5727] ppid=5723 vsize=647900 CPUtime=281.36 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 55574 0 0 0 28098 38 0 0 20 0 3 0 331634309 663449600 129745 33554432000 4194304 5964478 140736885825328 139851692272024 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=647900 CPUtime=281.36 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 89190 0 0 0 28030 106 0 0 20 0 3 0 331634309 663449600 129745 33554432000 4194304 5964478 140736885825328 139851681782072 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 564.21
Current children cumulated vsize (KiB) 647900

[startup+342.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5773
/proc/meminfo: memFree=27855104/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=779380 CPUtime=684.19 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 185604 0 0 0 68234 185 0 0 20 0 3 0 331634295 798085120 165870 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 194845 165872 202 433 0 194409 0

################
# More data... #
################

[pid=5725/tid=5728] ppid=5723 vsize=779380 CPUtime=341.21 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 118264 0 0 0 33978 143 0 0 20 0 3 0 331634309 798085120 165872 33554432000 4194304 5964478 140736885825328 139851681782072 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.19
Current children cumulated vsize (KiB) 779380

[startup+402.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5773
/proc/meminfo: memFree=27609596/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=912380 CPUtime=804.16 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 217444 0 0 0 80197 219 0 0 20 0 3 0 331634295 934277120 197719 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 228095 197719 202 433 0 227659 0
[pid=5725/tid=5727] ppid=5723 vsize=912380 CPUtime=401.05 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 74251 0 0 0 40041 64 0 0 20 0 3 0 331634309 934277120 197719 33554432000 4194304 5964478 140736885825328 139851692271416 4388228 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=912380 CPUtime=401.04 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 138478 0 0 0 39939 165 0 0 20 0 3 0 331634309 934277120 197719 33554432000 4194304 5964478 140736885825328 139851681782216 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.16
Current children cumulated vsize (KiB) 912380

[startup+462.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5773
/proc/meminfo: memFree=27489592/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=912516 CPUtime=924.08 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 219081 0 0 0 92188 220 0 0 20 0 3 0 331634295 934416384 199632 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 228129 199632 202 433 0 227693 0
[pid=5725/tid=5727] ppid=5723 vsize=912516 CPUtime=460.88 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 75844 0 0 0 46023 65 0 0 20 0 3 0 331634309 934416384 199632 33554432000 4194304 5964478 140736885825328 139851692271416 4403568 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=912516 CPUtime=460.85 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 138522 0 0 0 45920 165 0 0 20 0 3 0 331634309 934416384 199632 33554432000 4194304 5964478 140736885825328 139851681781832 4221072 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.08
Current children cumulated vsize (KiB) 912516

[startup+522.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5774
/proc/meminfo: memFree=27397612/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=912648 CPUtime=1044.01 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 219783 0 0 0 104181 220 0 0 20 0 3 0 331634295 934551552 200481 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 228162 200481 202 433 0 227726 0
[pid=5725/tid=5727] ppid=5723 vsize=912648 CPUtime=520.69 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 76488 0 0 0 52003 66 0 0 20 0 3 0 331634309 934551552 200481 33554432000 4194304 5964478 140736885825328 139851692271416 4400067 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=912648 CPUtime=520.68 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 138580 0 0 0 51902 166 0 0 20 0 3 0 331634309 934551552 200481 33554432000 4194304 5964478 140736885825328 139851681781832 4400091 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.01
Current children cumulated vsize (KiB) 912648

[startup+582.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5774
/proc/meminfo: memFree=27324356/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=912780 CPUtime=1163.93 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 226164 0 0 0 116162 231 0 0 20 0 3 0 331634295 934686720 206825 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 228195 206825 202 433 0 227759 0
[pid=5725/tid=5727] ppid=5723 vsize=912780 CPUtime=580.53 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 82787 0 0 0 57975 78 0 0 20 0 3 0 331634309 934686720 206825 33554432000 4194304 5964478 140736885825328 139851692271208 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=912780 CPUtime=580.47 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 138662 0 0 0 57880 167 0 0 20 0 3 0 331634309 934686720 206825 33554432000 4194304 5964478 140736885825328 139851681781832 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1163.93
Current children cumulated vsize (KiB) 912780

[startup+642.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5774
/proc/meminfo: memFree=27184636/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1044160 CPUtime=1283.86 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 255059 0 0 0 128124 262 0 0 20 0 3 0 331634295 1069219840 235675 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 261040 235675 202 433 0 260604 0
[pid=5725/tid=5727] ppid=5723 vsize=1044160 CPUtime=640.36 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 91714 0 0 0 63947 89 0 0 20 0 3 0 331634309 1069219840 235675 33554432000 4194304 5964478 140736885825328 139851692271608 4400087 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1044160 CPUtime=640.28 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 158630 0 0 0 63839 189 0 0 20 0 3 0 331634309 1069219840 235675 33554432000 4194304 5964478 140736885825328 139851681782120 5136420 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1283.86
Current children cumulated vsize (KiB) 1044160

[startup+702.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5774
/proc/meminfo: memFree=27051240/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1175372 CPUtime=1403.76 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 288477 0 0 0 140079 297 0 0 20 0 3 0 331634295 1203580928 269044 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 293843 269044 202 433 0 293407 0
[pid=5725/tid=5727] ppid=5723 vsize=1175372 CPUtime=700.18 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 99718 0 0 0 69917 101 0 0 20 0 3 0 331634309 1203580928 269044 33554432000 4194304 5964478 140736885825328 139851692271608 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1175372 CPUtime=700.07 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 184044 0 0 0 69792 215 0 0 20 0 3 0 331634309 1203580928 269044 33554432000 4194304 5964478 140736885825328 139851681782024 4399920 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1403.76
Current children cumulated vsize (KiB) 1175372

[startup+762.307 s]
/proc/loadavg: 4.00 4.00 3.91 5/182 5777
/proc/meminfo: memFree=26955408/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1307576 CPUtime=1523.69 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 312126 0 0 0 152055 314 0 0 20 0 3 0 331634295 1338957824 292647 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 326894 292647 202 433 0 326458 0
[pid=5725/tid=5727] ppid=5723 vsize=1307576 CPUtime=760.03 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 102315 0 0 0 75899 104 0 0 20 0 3 0 331634309 1338957824 292647 33554432000 4194304 5964478 140736885825328 139851692271416 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1307576 CPUtime=759.86 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 205096 0 0 0 75755 231 0 0 20 0 3 0 331634309 1338957824 292647 33554432000 4194304 5964478 140736885825328 139851681782072 4399920 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1523.69
Current children cumulated vsize (KiB) 1307576

[startup+822.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 5778
/proc/meminfo: memFree=26878448/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1372192 CPUtime=1643.66 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 331736 0 0 0 164036 330 0 0 20 0 3 0 331634295 1405124608 311823 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 343048 311823 202 433 0 342612 0
[pid=5725/tid=5727] ppid=5723 vsize=1372192 CPUtime=819.87 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 102784 0 0 0 81882 105 0 0 20 0 3 0 331634309 1405124608 311823 33554432000 4194304 5964478 140736885825328 139851692272568 4400103 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1372192 CPUtime=819.69 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 224237 0 0 0 81721 248 0 0 20 0 3 0 331634309 1405124608 311823 33554432000 4194304 5964478 140736885825328 139851681782072 4400089 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1643.66
Current children cumulated vsize (KiB) 1372192

[startup+882.3 s]
/proc/loadavg: 4.04 4.01 3.92 5/181 5778
/proc/meminfo: memFree=26744092/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1437868 CPUtime=1763.64 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 351175 0 0 0 176017 347 0 0 20 0 3 0 331634295 1472376832 331457 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 359467 331457 202 433 0 359031 0
[pid=5725/tid=5727] ppid=5723 vsize=1437868 CPUtime=879.72 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 102784 0 0 0 87866 106 0 0 20 0 3 0 331634309 1472376832 331457 33554432000 4194304 5964478 140736885825328 139851692272568 4399920 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1437868 CPUtime=879.53 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 243676 0 0 0 87687 266 0 0 20 0 3 0 331634309 1472376832 331457 33554432000 4194304 5964478 140736885825328 139851681782072 4399920 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1763.64
Current children cumulated vsize (KiB) 1437868



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.5 s]
/proc/loadavg: 4.02 4.01 3.92 5/181 5778
/proc/meminfo: memFree=26701984/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1503404 CPUtime=1800.05 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 357709 0 0 0 179652 353 0 0 20 0 3 0 331634295 1539485696 337991 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 375851 337991 202 433 0 375415 0
[pid=5725/tid=5727] ppid=5723 vsize=1503404 CPUtime=897.88 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 102784 0 0 0 89682 106 0 0 20 0 3 0 331634309 1539485696 337991 33554432000 4194304 5964478 140736885825328 139851692272568 4400504 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1503404 CPUtime=897.69 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 250210 0 0 0 89497 272 0 0 20 0 3 0 331634309 1539485696 337991 33554432000 4194304 5964478 140736885825328 139851681782072 4399969 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 1503404

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.5 s]
/proc/loadavg: 4.02 4.01 3.92 5/181 5778
/proc/meminfo: memFree=26701984/32873844 swapFree=6872/6872
[pid=5725] ppid=5723 vsize=1503404 CPUtime=1800.05 cores=0,2,4,6
/proc/5725/stat : 5725 (pwbo2.02) S 5723 5725 3386 0 -1 4202496 357709 0 0 0 179652 353 0 0 20 0 3 0 331634295 1539485696 337991 33554432000 4194304 5964478 140736885825328 140736885824848 4546685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/5725/statm: 375851 337991 202 433 0 375415 0
[pid=5725/tid=5727] ppid=5723 vsize=1503404 CPUtime=897.88 cores=0,2,4,6
/proc/5725/task/5727/stat : 5727 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 102784 0 0 0 89682 106 0 0 20 0 3 0 331634309 1539485696 337991 33554432000 4194304 5964478 140736885825328 139851692272568 4400504 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=5725/tid=5728] ppid=5723 vsize=1503404 CPUtime=897.69 cores=0,2,4,6
/proc/5725/task/5728/stat : 5728 (pwbo2.02) R 5723 5725 3386 0 -1 4202560 250210 0 0 0 89497 272 0 0 20 0 3 0 331634309 1539485696 337991 33554432000 4194304 5964478 140736885825328 139851681782072 4399969 0 0 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 1503404

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5725 and gives
#  childrusage.ru_utime.tv_sec=1791
#  childrusage.ru_utime.tv_usec=941583
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=848414
# CPU time returned by wait4() is 1795.79
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.555
CPU time (s): 1800.05
CPU user time (s): 1796.52
CPU system time (s): 3.53
CPU usage (%): 199.882
Max. virtual memory (cumulated for all children) (KiB): 1503404

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1791.94
system time used= 3.84841
maximum resident set size= 1351972
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 357711
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1937
involuntary context switches= 2027

runsolver used 1.76173 second user time and 4.98424 second system time

The end

Launcher Data 

Begin job on node106 at 2012-06-02 18:37:38
IDJOB=3725933
IDBENCH=2264
IDSOLVER=2309
FILE ID=node106/3725933-1338655058
RUNJOBID= node106-1338651441-5233
PBS_JOBID= 14636474
Free space on /tmp= 70860 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.nlsde.buaa.edu.cn/~kexu/benchmarks/frb50-23-opb/normalized-frb50-23-2.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3725933-1338655058/watcher-3725933-1338655058 -o /tmp/evaluation-result-3725933-1338655058/solver-3725933-1338655058 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725933-1338655058.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 669011fc499ae56e44c354cc6cddc4c7
RANDOM SEED=879805862

node106.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26677556 kB
Buffers:          262960 kB
Cached:          2612648 kB
SwapCached:         1936 kB
Active:          3391756 kB
Inactive:        1958980 kB
Active(anon):    2472236 kB
Inactive(anon):     4868 kB
Active(file):     919520 kB
Inactive(file):  1954112 kB
Unevictable:        6872 kB
Mlocked:            6872 kB
SwapTotal:      67108856 kB
SwapFree:       67100520 kB
Dirty:              7496 kB
Writeback:             0 kB
AnonPages:       2481192 kB
Mapped:             9668 kB
Shmem:                 0 kB
Slab:             698700 kB
SReclaimable:     140924 kB
SUnreclaim:       557776 kB
KernelStack:        1464 kB
PageTables:         9236 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     218080 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    894976 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70852 MiB
End job on node106 at 2012-06-02 18:52:41