Trace number 3725953

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)7 1800.16 900.331

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/
benchmarks/radar/normalized-10:10:4.5:0.95:98.opb
MD5SUM7acfcd4d612717a490c27c9a55b3f455
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark0.032994
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1
Optimality of the best value was proved YES
Number of variables411
Total number of constraints477
Number of constraints which are clauses387
Number of constraints which are cardinality constraints (but not clauses)90
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint16
Number of terms in the objective function 411
Biggest coefficient in the objective function 268
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 1129
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 268
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 1129
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3725953-1338654213.opb.
0.00/0.00	c Instance file HOME/instance-3725953-1338654213.opb
0.00/0.00	c File size is 19110 bytes.
0.00/0.00	c Cost Offset: -268
0.00/0.00	c Highest Coefficient sum: 19
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      411                                                 |
0.00/0.00	c |  Number Clauses:        388                                                 |
0.00/0.00	c |  Number Cardinality:    89                                                  |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.16/900.31	o 44
1800.16/900.31	o 22
1800.16/900.31	o 12
1800.16/900.31	o 11
1800.16/900.31	o 10
1800.16/900.31	o 9
1800.16/900.31	o 7
1800.16/900.31	c ===============================================================================
1800.16/900.31	c Wall Clock Time: 900.31 s
1800.16/900.31	c Best Solution: 7
1800.16/900.31	s SATISFIABLE
1800.16/900.31	v x295 -x231 -x206 x191 x139 x294 x211 x192 -x143 -x359 x302 -x279 -x235 x210 x196 x296 -x233 x195 x358 x297 -x213 x193 -x119 x362 x298 -x234 -x214 -x194 x180 -x83 -x238 x217 x179 -x164 -x118 -x82 x363 -x215 -x122 x84 -x216 x181 -x163 x85 x184 x168 -x123 x86 -x305 -x275 x230 x190 x138 x306 -x205 x189 -x142 -x385 -x301 -x278 x236 -x207 x200 x212 x360 -x313 -x299 -x239 x209 -x37 x364 -x317 -x237 x218 -x175 -x174 x120 -x124 -x366 x182 -x165 -x89 -x367 x183 x167 x90 x381 -x303 -x274 -x228 x203 x140 -x354 x232 x204 -x144 -x384 -x353 x280 x229 x199 -x33 -x240 x208 -x114 x361 -x312 -x300 x226 -x197 x146 -x113 -x36 x365 -x316 -x222 -x159 x147 x369 x283 -x221 -x158 x121 -x88 x368 x176 x125 -x87 -x342 x177 x166 x126 -x71 x178 x169 x127 -x75 x380 -x304 x276 -x201 x141 -x227 -x145 -x397 -x386 x281 x248 -x223 x149 -x32 -x401 -x355 x244 -x225 x148 -x356 -x314 x284 x243 -x198 -x38 -x8 x357 -x318 x282 -x115 -x12 -x389 x373 -x338 -x219 x116 -x101 -x160 x117 -x341 -x320 -x220 x187 x161 x131 -x70 -x41 -x321 x188 x162 -x74 x382 -x272 x245 -x202 x137 -x28 -x308 x277 x247 -x224 x136 -x396 -x387 -x307 x273 x153 -x34 -x400 x285 -x390 x376 -x315 -x241 -x97 -x39 -x7 -x388 x377 -x319 -x11 x372 -x337 -x323 -x242 -x186 x134 -x100 -x42 -x322 x185 x135 -x40 x370 x343 -x255 -x172 -x130 -x72 -x259 x173 x76 -x379 x265 x246 x156 x383 -x271 x157 -x27 -x398 -x375 -x293 x152 -x29 x402 x391 -x374 -x309 -x289 -x35 -x333 -x310 -x288 -x150 -x133 -x96 x31 x9 -x311 -x132 -x66 -x43 -x13 -x404 x339 -x327 -x171 -x102 -x65 -x405 -x170 -x371 x344 x254 -x128 -x73 x61 -x15 -x258 x77 -x16 -x290 x264 x154 -x378 -x292 -x3 -x399 -x92 -x2 x403 x395 -x30 x407 -x394 -x330 -x286 -x151 x98 -x51 x10 x406 -x332 -x331 x47 -x14 x334 -x326 -x287 -x103 -x57 -x46 -x18 x340 x67 -x17 x336 -x324 x256 -x129 -x104 x68 x60 x345 -x260 -x105 x69 -x291 x266 -x155 -x329 -x48 -x328 x91 -x50 -x4 x411 -x392 x268 x93 -x5 -x250 x99 x6 -x393 -x249 x95 -x56 -x44 x22 x335 -x106 x352 -x325 x257 -x80 x62 -x45 x348 x261 -x81 -x49 x269 x267 x410 -x54 -x25 x94 x26 x408 -x349 x112 -x79 -x58 x21 -x351 x251 x109 -x78 x252 x107 x63 x19 x346 x253 x270 -x24 -x23 x111 -x350 x110 x53 -x409 x52 -x59 -x263 x108 x55 x20 x347 -x262 -x64 x1

Verifier Data 

OK	7

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3725953-1338654213/watcher-3725953-1338654213 -o /tmp/evaluation-result-3725953-1338654213/solver-3725953-1338654213 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725953-1338654213.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.68 3.93 3.83 4/178 12738
/proc/meminfo: memFree=28263344/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=162800 CPUtime=0 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 1061 0 0 0 0 0 0 0 20 0 3 0 331545896 166707200 1008 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 40700 1018 203 433 0 40264 0
[pid=12738/tid=12739] ppid=12736 vsize=162800 CPUtime=0 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 101 0 0 0 0 0 0 0 20 0 3 0 331545897 166707200 1021 33554432000 4194304 5964478 140736461820432 140033902000472 5244295 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=162800 CPUtime=0 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 146 0 0 0 0 0 0 0 20 0 3 0 331545897 166707200 1021 33554432000 4194304 5964478 140736461820432 140033891510056 5244295 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.0524179 s]
/proc/loadavg: 3.68 3.93 3.83 4/178 12738
/proc/meminfo: memFree=28263344/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172548 CPUtime=0.08 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 5228 0 0 0 8 0 0 0 20 0 3 0 331545896 176689152 5105 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43137 5105 204 433 0 42701 0
[pid=12738/tid=12739] ppid=12736 vsize=172548 CPUtime=0.03 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 340 0 0 0 3 0 0 0 20 0 3 0 331545897 176689152 5105 33554432000 4194304 5964478 140736461820432 140033902000472 5236855 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172548 CPUtime=0.03 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4061 0 0 0 3 0 0 0 20 0 3 0 331545897 176689152 5105 33554432000 4194304 5964478 140736461820432 140033891509928 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 172548

[startup+0.100426 s]
/proc/loadavg: 3.68 3.93 3.83 4/178 12738
/proc/meminfo: memFree=28263344/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=0.18 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 5491 0 0 0 18 0 0 0 20 0 3 0 331545896 177061888 5367 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 5367 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=0.08 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 525 0 0 0 8 0 0 0 20 0 3 0 331545897 177061888 5367 33554432000 4194304 5964478 140736461820432 140033902000472 4388976 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=0.08 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4139 0 0 0 8 0 0 0 20 0 3 0 331545897 177061888 5367 33554432000 4194304 5964478 140736461820432 140033891509928 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 172912

[startup+0.300367 s]
/proc/loadavg: 3.68 3.93 3.83 4/178 12738
/proc/meminfo: memFree=28263344/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=0.59 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 6000 0 0 0 58 1 0 0 20 0 3 0 331545896 177061888 5839 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 5840 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=0.28 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 943 0 0 0 28 0 0 0 20 0 3 0 331545897 177061888 5840 33554432000 4194304 5964478 140736461820432 140033902000472 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=0.28 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4231 0 0 0 28 0 0 0 20 0 3 0 331545897 177061888 5840 33554432000 4194304 5964478 140736461820432 140033891509928 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 172912

[startup+0.700369 s]
/proc/loadavg: 3.68 3.93 3.83 4/178 12738
/proc/meminfo: memFree=28263344/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=1.38 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 6351 0 0 0 137 1 0 0 20 0 3 0 331545896 177061888 6190 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 6190 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=0.68 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 1253 0 0 0 68 0 0 0 20 0 3 0 331545897 177061888 6190 33554432000 4194304 5964478 140736461820432 140033902000472 4392707 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=0.68 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4271 0 0 0 68 0 0 0 20 0 3 0 331545897 177061888 6190 33554432000 4194304 5964478 140736461820432 140033891509928 4399873 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 172912

[startup+1.50037 s]
/proc/loadavg: 3.68 3.93 3.83 5/181 12741
/proc/meminfo: memFree=28233404/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=2.98 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 6865 0 0 0 296 2 0 0 20 0 3 0 331545896 177061888 6704 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 6704 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=1.48 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 1677 0 0 0 146 2 0 0 20 0 3 0 331545897 177061888 6704 33554432000 4194304 5964478 140736461820432 140033902000664 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=1.48 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4361 0 0 0 148 0 0 0 20 0 3 0 331545897 177061888 6704 33554432000 4194304 5964478 140736461820432 140033891510584 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 172912

[startup+3.10043 s]
/proc/loadavg: 3.68 3.93 3.83 5/181 12741
/proc/meminfo: memFree=28227948/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=6.18 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 7921 0 0 0 614 4 0 0 20 0 3 0 331545896 177061888 7760 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 7760 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=3.07 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 2549 0 0 0 304 3 0 0 20 0 3 0 331545897 177061888 7760 33554432000 4194304 5964478 140736461820432 140033901999928 4393808 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=3.07 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4545 0 0 0 307 0 0 0 20 0 3 0 331545897 177061888 7760 33554432000 4194304 5964478 140736461820432 140033891510520 4400137 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 172912

[startup+6.30043 s]
/proc/loadavg: 3.71 3.93 3.83 5/181 12741
/proc/meminfo: memFree=28207364/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=12.58 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 9938 0 0 0 1252 6 0 0 20 0 3 0 331545896 177061888 9731 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 9731 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=6.26 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4182 0 0 0 621 5 0 0 20 0 3 0 331545897 177061888 9731 33554432000 4194304 5964478 140736461820432 140033902001080 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=6.26 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4929 0 0 0 626 0 0 0 20 0 3 0 331545897 177061888 9731 33554432000 4194304 5964478 140736461820432 140033891510584 4400010 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 172912

[startup+12.7004 s]
/proc/loadavg: 3.73 3.94 3.83 5/181 12741
/proc/meminfo: memFree=28186464/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=173236 CPUtime=25.38 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 11410 0 0 0 2531 7 0 0 20 0 3 0 331545896 177393664 11203 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43309 11203 206 433 0 42873 0
[pid=12738/tid=12739] ppid=12736 vsize=173236 CPUtime=12.65 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 4786 0 0 0 1259 6 0 0 20 0 3 0 331545897 177393664 11203 33554432000 4194304 5964478 140736461820432 140033901999928 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=173236 CPUtime=12.65 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 5797 0 0 0 1264 1 0 0 20 0 3 0 331545897 177393664 11203 33554432000 4194304 5964478 140736461820432 140033891510584 4373423 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 173236

[startup+25.5005 s]
/proc/loadavg: 3.79 3.94 3.83 5/181 12741
/proc/meminfo: memFree=28144468/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=172912 CPUtime=50.97 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 16323 0 0 0 5085 12 0 0 20 0 3 0 331545896 177061888 16032 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43228 16032 206 433 0 42792 0
[pid=12738/tid=12739] ppid=12736 vsize=172912 CPUtime=25.41 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 8021 0 0 0 2533 8 0 0 20 0 3 0 331545897 177061888 16032 33554432000 4194304 5964478 140736461820432 140033902000664 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=172912 CPUtime=25.41 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 7475 0 0 0 2537 4 0 0 20 0 3 0 331545897 177061888 16032 33554432000 4194304 5964478 140736461820432 140033891510392 4403411 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 172912

[startup+51.1005 s]
/proc/loadavg: 3.86 3.94 3.83 5/181 12741
/proc/meminfo: memFree=28088692/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=173180 CPUtime=102.16 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 20775 0 0 0 10200 16 0 0 20 0 3 0 331545896 177336320 20484 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 43295 20484 206 433 0 42859 0
[pid=12738/tid=12739] ppid=12736 vsize=173180 CPUtime=50.95 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 10122 0 0 0 5085 10 0 0 20 0 3 0 331545897 177336320 20484 33554432000 4194304 5964478 140736461820432 140033902000472 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=173180 CPUtime=50.95 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 9826 0 0 0 5089 6 0 0 20 0 3 0 331545897 177336320 20484 33554432000 4194304 5964478 140736461820432 140033891510456 4387939 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.16
Current children cumulated vsize (KiB) 173180

[startup+102.3 s]
/proc/loadavg: 3.94 3.95 3.84 5/181 12742
/proc/meminfo: memFree=27925000/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=240428 CPUtime=204.52 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 39261 0 0 0 20420 32 0 0 20 0 3 0 331545896 246198272 39262 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 60107 39262 206 433 0 59671 0
[pid=12738/tid=12739] ppid=12736 vsize=240428 CPUtime=101.99 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 23568 0 0 0 10177 22 0 0 20 0 3 0 331545897 246198272 39262 33554432000 4194304 5964478 140736461820432 140033902000120 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=240428 CPUtime=102.02 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 14866 0 0 0 10191 11 0 0 20 0 3 0 331545897 246198272 39262 33554432000 4194304 5964478 140736461820432 140033891510584 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.52
Current children cumulated vsize (KiB) 240428

[startup+162.3 s]
/proc/loadavg: 3.98 3.95 3.85 5/181 12742
/proc/meminfo: memFree=27786956/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=372752 CPUtime=324.44 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 59611 0 0 0 32389 55 0 0 20 0 3 0 331545896 381698048 59708 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 93188 59708 206 433 0 92752 0
[pid=12738/tid=12739] ppid=12736 vsize=372752 CPUtime=161.81 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 34862 0 0 0 16145 36 0 0 20 0 3 0 331545897 381698048 59708 33554432000 4194304 5964478 140736461820432 140033902000168 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=372752 CPUtime=161.83 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 23922 0 0 0 16160 23 0 0 20 0 3 0 331545897 381698048 59708 33554432000 4194304 5964478 140736461820432 140033891510632 4400519 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.44
Current children cumulated vsize (KiB) 372752

[startup+222.307 s]
/proc/loadavg: 3.99 3.96 3.85 5/181 12742
/proc/meminfo: memFree=27674612/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=372892 CPUtime=444.43 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 74965 0 0 0 44370 73 0 0 20 0 3 0 331545896 381841408 76768 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 93223 76768 206 433 0 92787 0
[pid=12738/tid=12739] ppid=12736 vsize=372892 CPUtime=221.66 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 42903 0 0 0 22120 46 0 0 20 0 3 0 331545897 381841408 76768 33554432000 4194304 5964478 140736461820432 140033902000168 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=372892 CPUtime=221.68 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 31235 0 0 0 22136 32 0 0 20 0 3 0 331545897 381841408 76768 33554432000 4194304 5964478 140736461820432 140033891510632 4392851 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.43
Current children cumulated vsize (KiB) 372892

################
# More data... #
################

[pid=12738/tid=12740] ppid=12736 vsize=437476 CPUtime=281.52 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 31258 0 0 0 28119 33 0 0 20 0 3 0 331545897 447975424 90537 33554432000 4194304 5964478 140736461820432 140033891510344 4399854 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.4
Current children cumulated vsize (KiB) 437476

[startup+342.3 s]
/proc/loadavg: 4.02 3.98 3.87 5/181 12742
/proc/meminfo: memFree=27573744/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=437872 CPUtime=684.38 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 89130 0 0 0 68353 85 0 0 20 0 3 0 331545896 448380928 90667 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 109468 90667 206 433 0 109032 0
[pid=12738/tid=12739] ppid=12736 vsize=437872 CPUtime=341.34 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 56961 0 0 0 34074 60 0 0 20 0 3 0 331545897 448380928 90667 33554432000 4194304 5964478 140736461820432 140033902001080 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=437872 CPUtime=341.37 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 31342 0 0 0 34103 34 0 0 20 0 3 0 331545897 448380928 90667 33554432000 4194304 5964478 140736461820432 140033891510344 4400097 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.38
Current children cumulated vsize (KiB) 437872

[startup+402.3 s]
/proc/loadavg: 4.00 3.98 3.87 5/182 12746
/proc/meminfo: memFree=27496292/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=504260 CPUtime=804.34 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 99907 0 0 0 80333 101 0 0 20 0 3 0 331545896 516362240 101425 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 126065 101425 206 433 0 125629 0
[pid=12738/tid=12739] ppid=12736 vsize=504260 CPUtime=401.18 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57016 0 0 0 40057 61 0 0 20 0 3 0 331545897 516362240 101425 33554432000 4194304 5964478 140736461820432 140033902001080 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=504260 CPUtime=401.21 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 42064 0 0 0 40069 52 0 0 20 0 3 0 331545897 516362240 101425 33554432000 4194304 5964478 140736461820432 140033891510584 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.34
Current children cumulated vsize (KiB) 504260

[startup+462.3 s]
/proc/loadavg: 4.00 3.98 3.88 5/181 12746
/proc/meminfo: memFree=27464956/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=504400 CPUtime=924.29 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 102024 0 0 0 92325 104 0 0 20 0 3 0 331545896 516505600 103480 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 126100 103480 206 433 0 125664 0
[pid=12738/tid=12739] ppid=12736 vsize=504400 CPUtime=461.02 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57049 0 0 0 46041 61 0 0 20 0 3 0 331545897 516505600 103480 33554432000 4194304 5964478 140736461820432 140033902000968 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=504400 CPUtime=461.02 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 44148 0 0 0 46046 56 0 0 20 0 3 0 331545897 516505600 103480 33554432000 4194304 5964478 140736461820432 140033891510632 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.29
Current children cumulated vsize (KiB) 504400

[startup+522.3 s]
/proc/loadavg: 4.00 3.98 3.89 5/181 12746
/proc/meminfo: memFree=27452936/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=504684 CPUtime=1044.27 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 102079 0 0 0 104323 104 0 0 20 0 3 0 331545896 516796416 103854 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 126171 103854 206 433 0 125735 0
[pid=12738/tid=12739] ppid=12736 vsize=504684 CPUtime=520.87 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57049 0 0 0 52025 62 0 0 20 0 3 0 331545897 516796416 103854 33554432000 4194304 5964478 140736461820432 140033902000968 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=504684 CPUtime=520.87 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 44203 0 0 0 52031 56 0 0 20 0 3 0 331545897 516796416 103854 33554432000 4194304 5964478 140736461820432 140033891510344 4399854 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.27
Current children cumulated vsize (KiB) 504684

[startup+582.3 s]
/proc/loadavg: 4.03 4.00 3.90 5/181 12746
/proc/meminfo: memFree=27407780/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=504900 CPUtime=1164.24 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 102130 0 0 0 116320 104 0 0 20 0 3 0 331545896 517017600 103916 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 126225 103916 206 433 0 125789 0
[pid=12738/tid=12739] ppid=12736 vsize=504900 CPUtime=580.71 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57056 0 0 0 58008 63 0 0 20 0 3 0 331545897 517017600 103916 33554432000 4194304 5964478 140736461820432 140033902000968 4379008 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=504900 CPUtime=580.71 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 44247 0 0 0 58014 57 0 0 20 0 3 0 331545897 517017600 103916 33554432000 4194304 5964478 140736461820432 140033891510344 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.24
Current children cumulated vsize (KiB) 504900

[startup+642.3 s]
/proc/loadavg: 4.01 4.00 3.90 5/181 12746
/proc/meminfo: memFree=27351480/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=505324 CPUtime=1284.23 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 106867 0 0 0 128313 110 0 0 20 0 3 0 331545896 517451776 108653 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 126331 108653 206 433 0 125895 0
[pid=12738/tid=12739] ppid=12736 vsize=505324 CPUtime=640.55 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57057 0 0 0 63991 64 0 0 20 0 3 0 331545897 517451776 108653 33554432000 4194304 5964478 140736461820432 140033902000968 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=505324 CPUtime=640.56 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 48983 0 0 0 63992 64 0 0 20 0 3 0 331545897 517451776 108653 33554432000 4194304 5964478 140736461820432 140033891510584 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.23
Current children cumulated vsize (KiB) 505324

[startup+702.3 s]
/proc/loadavg: 4.00 4.00 3.91 5/182 12748
/proc/meminfo: memFree=27305248/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=572120 CPUtime=1404.21 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 116190 0 0 0 140297 124 0 0 20 0 3 0 331545896 585850880 117975 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 143030 117975 206 433 0 142594 0
[pid=12738/tid=12739] ppid=12736 vsize=572120 CPUtime=700.4 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57057 0 0 0 69975 65 0 0 20 0 3 0 331545897 585850880 117975 33554432000 4194304 5964478 140736461820432 140033902000968 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=572120 CPUtime=700.41 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 58306 0 0 0 69962 79 0 0 20 0 3 0 331545897 585850880 117975 33554432000 4194304 5964478 140736461820432 140033891510584 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.21
Current children cumulated vsize (KiB) 572120

[startup+762.3 s]
/proc/loadavg: 4.06 4.01 3.91 5/181 12748
/proc/meminfo: memFree=27256028/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=637964 CPUtime=1524.2 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 127059 0 0 0 152283 137 0 0 20 0 3 0 331545896 653275136 128785 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 159491 128785 206 433 0 159055 0
[pid=12738/tid=12739] ppid=12736 vsize=637964 CPUtime=760.25 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57057 0 0 0 75959 66 0 0 20 0 3 0 331545897 653275136 128785 33554432000 4194304 5964478 140736461820432 140033902000968 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=637964 CPUtime=760.26 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 69175 0 0 0 75933 93 0 0 20 0 3 0 331545897 653275136 128785 33554432000 4194304 5964478 140736461820432 140033891510584 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.2
Current children cumulated vsize (KiB) 637964

[startup+822.3 s]
/proc/loadavg: 4.02 4.00 3.91 5/181 12748
/proc/meminfo: memFree=27140052/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=638344 CPUtime=1644.17 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 139179 0 0 0 164266 151 0 0 20 0 3 0 331545896 653664256 140905 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 159586 140905 206 433 0 159150 0
[pid=12738/tid=12739] ppid=12736 vsize=638344 CPUtime=820.09 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57057 0 0 0 81942 67 0 0 20 0 3 0 331545897 653664256 140905 33554432000 4194304 5964478 140736461820432 140033902000968 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=638344 CPUtime=820.1 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 81295 0 0 0 81902 108 0 0 20 0 3 0 331545897 653664256 140905 33554432000 4194304 5964478 140736461820432 140033891510584 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.17
Current children cumulated vsize (KiB) 638344

[startup+882.307 s]
/proc/loadavg: 4.00 4.00 3.91 5/181 12748
/proc/meminfo: memFree=27062360/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=704160 CPUtime=1764.16 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 148650 0 0 0 176252 164 0 0 20 0 3 0 331545896 721059840 150376 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 176040 150376 206 433 0 175604 0
[pid=12738/tid=12739] ppid=12736 vsize=704160 CPUtime=879.95 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57057 0 0 0 87927 68 0 0 20 0 3 0 331545897 721059840 150376 33554432000 4194304 5964478 140736461820432 140033902000664 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=704160 CPUtime=879.95 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 90766 0 0 0 87873 122 0 0 20 0 3 0 331545897 721059840 150376 33554432000 4194304 5964478 140736461820432 140033891510584 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.16
Current children cumulated vsize (KiB) 704160



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.91 3/178 12749
/proc/meminfo: memFree=27666528/32873844 swapFree=7108/7108
[pid=12738] ppid=12736 vsize=704324 CPUtime=1800.16 cores=1,3,5,7
/proc/12738/stat : 12738 (pwbo2.02) S 12736 12738 10982 0 -1 4202496 151813 0 0 0 179848 168 0 0 20 0 3 0 331545896 721227776 153539 33554432000 4194304 5964478 140736461820432 140736461819952 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/12738/statm: 176081 153539 206 433 0 175645 0
[pid=12738/tid=12739] ppid=12736 vsize=704324 CPUtime=897.9 cores=1,3,5,7
/proc/12738/task/12739/stat : 12739 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 57057 0 0 0 89722 68 0 0 20 0 3 0 331545897 721227776 153539 33554432000 4194304 5964478 140736461820432 140033902000664 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=12738/tid=12740] ppid=12736 vsize=704324 CPUtime=897.9 cores=1,3,5,7
/proc/12738/task/12740/stat : 12740 (pwbo2.02) R 12736 12738 10982 0 -1 4202560 93929 0 0 0 89664 126 0 0 20 0 3 0 331545897 721227776 153539 33554432000 4194304 5964478 140736461820432 140033891510584 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 704324

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12738 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=880288
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=979699
# CPU time returned by wait4() is 1795.86
# while last known CPU time is 1800.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.331
CPU time (s): 1800.16
CPU user time (s): 1798.48
CPU system time (s): 1.68
CPU usage (%): 199.944
Max. virtual memory (cumulated for all children) (KiB): 704324

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.88
system time used= 1.9797
maximum resident set size= 614164
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 151815
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 372
involuntary context switches= 1909

runsolver used 1.89071 second user time and 5.54416 second system time

The end

Launcher Data 

Begin job on node139 at 2012-06-02 18:23:33
IDJOB=3725953
IDBENCH=2226
IDSOLVER=2309
FILE ID=node139/3725953-1338654213
RUNJOBID= node139-1338651500-12376
PBS_JOBID= 14636441
Free space on /tmp= 71092 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/benchmarks/radar/normalized-10:10:4.5:0.95:98.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3725953-1338654213/watcher-3725953-1338654213 -o /tmp/evaluation-result-3725953-1338654213/solver-3725953-1338654213 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3725953-1338654213.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7acfcd4d612717a490c27c9a55b3f455
RANDOM SEED=1920246526

node139.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28268816 kB
Buffers:          483200 kB
Cached:          3224672 kB
SwapCached:          828 kB
Active:          1635752 kB
Inactive:        2096440 kB
Active(anon):      17860 kB
Inactive(anon):     7964 kB
Active(file):    1617892 kB
Inactive(file):  2088476 kB
Unevictable:        7108 kB
Mlocked:            7108 kB
SwapTotal:      67108856 kB
SwapFree:       67104688 kB
Dirty:             10912 kB
Writeback:             0 kB
AnonPages:         29560 kB
Mapped:            11952 kB
Shmem:                 8 kB
Slab:             731704 kB
SReclaimable:     173792 kB
SUnreclaim:       557912 kB
KernelStack:        1456 kB
PageTables:         4156 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     163072 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71088 MiB
End job on node139 at 2012-06-02 18:38:36