Trace number 3703652

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)7 1800.16 900.326

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/
benchmarks/radar/normalized-10:10:4.5:0.95:98.opb
MD5SUM7acfcd4d612717a490c27c9a55b3f455
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark0.032994
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1
Optimality of the best value was proved YES
Number of variables411
Total number of constraints477
Number of constraints which are clauses387
Number of constraints which are cardinality constraints (but not clauses)90
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint16
Number of terms in the objective function 411
Biggest coefficient in the objective function 268
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 1129
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 268
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 1129
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703652-1338090789.opb.
0.00/0.00	c Instance file HOME/instance-3703652-1338090789.opb
0.00/0.00	c File size is 19110 bytes.
0.00/0.00	c Cost Offset: -268
0.00/0.00	c Highest Coefficient sum: 19
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      411                                                 |
0.00/0.00	c |  Number Clauses:        388                                                 |
0.00/0.00	c |  Number Cardinality:    89                                                  |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.16/900.31	o 44
1800.16/900.31	o 22
1800.16/900.31	o 12
1800.16/900.31	o 11
1800.16/900.31	o 10
1800.16/900.31	o 9
1800.16/900.31	o 7
1800.16/900.31	c ===============================================================================
1800.16/900.31	c Wall Clock Time: 900.31 s
1800.16/900.31	c Best Solution: 7
1800.16/900.31	s SATISFIABLE
1800.16/900.31	v x295 -x231 -x206 x191 x139 x294 x211 x192 -x143 -x359 x302 -x279 -x235 x210 x196 x296 -x233 x195 x358 x297 -x213 x193 -x119 x362 x298 -x234 -x214 -x194 x180 -x83 -x238 x217 x179 -x164 -x118 -x82 x363 -x215 -x122 x84 -x216 x181 -x163 x85 x184 x168 -x123 x86 -x305 -x275 x230 x190 x138 x306 -x205 x189 -x142 -x385 -x301 -x278 x236 -x207 x200 x212 x360 -x313 -x299 -x239 x209 -x37 x364 -x317 -x237 x218 -x175 -x174 x120 -x124 -x366 x182 -x165 -x89 -x367 x183 x167 x90 x381 -x303 -x274 -x228 x203 x140 -x354 x232 x204 -x144 -x384 -x353 x280 x229 x199 -x33 -x240 x208 -x114 x361 -x312 -x300 x226 -x197 x146 -x113 -x36 x365 -x316 -x222 -x159 x147 x369 x283 -x221 -x158 x121 -x88 x368 x176 x125 -x87 -x342 x177 x166 x126 -x71 x178 x169 x127 -x75 x380 -x304 x276 -x201 x141 -x227 -x145 -x397 -x386 x281 x248 -x223 x149 -x32 -x401 -x355 x244 -x225 x148 -x356 -x314 x284 x243 -x198 -x38 -x8 x357 -x318 x282 -x115 -x12 -x389 x373 -x338 -x219 x116 -x101 -x160 x117 -x341 -x320 -x220 x187 x161 x131 -x70 -x41 -x321 x188 x162 -x74 x382 -x272 x245 -x202 x137 -x28 -x308 x277 x247 -x224 x136 -x396 -x387 -x307 x273 x153 -x34 -x400 x285 -x390 x376 -x315 -x241 -x97 -x39 -x7 -x388 x377 -x319 -x11 x372 -x337 -x323 -x242 -x186 x134 -x100 -x42 -x322 x185 x135 -x40 x370 x343 -x255 -x172 -x130 -x72 -x259 x173 x76 -x379 x265 x246 x156 x383 -x271 x157 -x27 -x398 -x375 -x293 x152 -x29 x402 x391 -x374 -x309 -x289 -x35 -x333 -x310 -x288 -x150 -x133 -x96 x31 x9 -x311 -x132 -x66 -x43 -x13 -x404 x339 -x327 -x171 -x102 -x65 -x405 -x170 -x371 x344 x254 -x128 -x73 x61 -x15 -x258 x77 -x16 -x290 x264 x154 -x378 -x292 -x3 -x399 -x92 -x2 x403 x395 -x30 x407 -x394 -x330 -x286 -x151 x98 -x51 x10 x406 -x332 -x331 x47 -x14 x334 -x326 -x287 -x103 -x57 -x46 -x18 x340 x67 -x17 x336 -x324 x256 -x129 -x104 x68 x60 x345 -x260 -x105 x69 -x291 x266 -x155 -x329 -x48 -x328 x91 -x50 -x4 x411 -x392 x268 x93 -x5 -x250 x99 x6 -x393 -x249 x95 -x56 -x44 x22 x335 -x106 x352 -x325 x257 -x80 x62 -x45 x348 x261 -x81 -x49 x269 x267 x410 -x54 -x25 x94 x26 x408 -x349 x112 -x79 -x58 x21 -x351 x251 x109 -x78 x252 x107 x63 x19 x346 x253 x270 -x24 -x23 x111 -x350 x110 x53 -x409 x52 -x59 -x263 x108 x55 x20 x347 -x262 -x64 x1

Verifier Data 

OK	7

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703652-1338090789/watcher-3703652-1338090789 -o /tmp/evaluation-result-3703652-1338090789/solver-3703652-1338090789 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703652-1338090789.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 3.99 3.91 2/174 18553
/proc/meminfo: memFree=31337044/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=163004 CPUtime=0 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 1114 0 0 0 0 0 0 0 20 0 3 0 275203425 166916096 1062 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 40751 1063 205 433 0 40315 0
[pid=18553/tid=18554] ppid=18551 vsize=163004 CPUtime=0 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 105 0 0 0 0 0 0 0 20 0 3 0 275203425 166916096 1070 33554432000 4194304 5965102 140734274532304 140066860939720 5137076 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=163004 CPUtime=0 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 193 0 0 0 0 0 0 0 20 0 3 0 275203425 166916096 1073 33554432000 4194304 5965102 140734274532304 140066850449592 5137076 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0

[startup+0.0381581 s]
/proc/loadavg: 4.00 3.99 3.91 2/174 18553
/proc/meminfo: memFree=31337044/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=171108 CPUtime=0.06 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 4566 0 0 0 5 1 0 0 20 0 3 0 275203425 175214592 4444 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 42777 4449 205 433 0 42341 0
[pid=18553/tid=18554] ppid=18551 vsize=171108 CPUtime=0.02 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 277 0 0 0 2 0 0 0 20 0 3 0 275203425 175214592 4450 33554432000 4194304 5965102 140734274532304 140066860939608 5131557 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=171108 CPUtime=0.02 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 3471 0 0 0 0 2 0 0 20 0 3 0 275203425 175214592 4453 33554432000 4194304 5965102 140734274532304 140066850448712 5244967 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 171108

[startup+0.100403 s]
/proc/loadavg: 4.00 3.99 3.91 2/174 18553
/proc/meminfo: memFree=31337044/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=172912 CPUtime=0.18 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 5514 0 0 0 17 1 0 0 20 0 3 0 275203425 177061888 5391 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43228 5392 208 433 0 42792 0
[pid=18553/tid=18554] ppid=18551 vsize=172912 CPUtime=0.08 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 524 0 0 0 8 0 0 0 20 0 3 0 275203425 177061888 5392 33554432000 4194304 5965102 140734274532304 140066860939608 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=172912 CPUtime=0.08 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 4164 0 0 0 6 2 0 0 20 0 3 0 275203425 177061888 5392 33554432000 4194304 5965102 140734274532304 140066850449528 5137146 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 172912

[startup+0.300336 s]
/proc/loadavg: 4.00 3.99 3.91 2/174 18553
/proc/meminfo: memFree=31337044/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=172912 CPUtime=0.58 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 6006 0 0 0 57 1 0 0 20 0 3 0 275203425 177061888 5846 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43228 5846 208 433 0 42792 0
[pid=18553/tid=18554] ppid=18551 vsize=172912 CPUtime=0.28 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 942 0 0 0 28 0 0 0 20 0 3 0 275203425 177061888 5846 33554432000 4194304 5965102 140734274532304 140066860939608 5136313 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=172912 CPUtime=0.28 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 4237 0 0 0 26 2 0 0 20 0 3 0 275203425 177061888 5846 33554432000 4194304 5965102 140734274532304 140066850449528 4404383 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 172912

[startup+0.700329 s]
/proc/loadavg: 4.00 3.99 3.91 2/174 18553
/proc/meminfo: memFree=31337044/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=172912 CPUtime=1.38 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 6369 0 0 0 136 2 0 0 20 0 3 0 275203425 177061888 6209 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43228 6209 208 433 0 42792 0
[pid=18553/tid=18554] ppid=18551 vsize=172912 CPUtime=0.68 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 1252 0 0 0 68 0 0 0 20 0 3 0 275203425 177061888 6209 33554432000 4194304 5965102 140734274532304 140066860939608 4410108 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=172912 CPUtime=0.68 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 4290 0 0 0 66 2 0 0 20 0 3 0 275203425 177061888 6209 33554432000 4194304 5965102 140734274532304 140066850449720 4401050 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 172912

[startup+1.50034 s]
/proc/loadavg: 4.00 3.99 3.91 3/177 18556
/proc/meminfo: memFree=31312848/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=172912 CPUtime=2.98 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 6911 0 0 0 295 3 0 0 20 0 3 0 275203425 177061888 6751 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43228 6751 208 433 0 42792 0
[pid=18553/tid=18554] ppid=18551 vsize=172912 CPUtime=1.48 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 1676 0 0 0 148 0 0 0 20 0 3 0 275203425 177061888 6751 33554432000 4194304 5965102 140734274532304 140066860939592 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=172912 CPUtime=1.48 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 4408 0 0 0 146 2 0 0 20 0 3 0 275203425 177061888 6751 33554432000 4194304 5965102 140734274532304 140066850449720 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 172912

[startup+3.10033 s]
/proc/loadavg: 3.84 3.95 3.90 5/181 18596
/proc/meminfo: memFree=31256580/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=172912 CPUtime=6.18 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 8082 0 0 0 615 3 0 0 20 0 3 0 275203425 177061888 7922 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43228 7922 208 433 0 42792 0
[pid=18553/tid=18554] ppid=18551 vsize=172912 CPUtime=3.07 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 2620 0 0 0 306 1 0 0 20 0 3 0 275203425 177061888 7922 33554432000 4194304 5965102 140734274532304 140066860939064 4404407 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=172912 CPUtime=3.08 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 4635 0 0 0 305 3 0 0 20 0 3 0 275203425 177061888 7922 33554432000 4194304 5965102 140734274532304 140066850449720 4393958 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 172912

[startup+6.30033 s]
/proc/loadavg: 3.84 3.95 3.90 5/181 18596
/proc/meminfo: memFree=31236972/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=172912 CPUtime=12.57 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 10099 0 0 0 1253 4 0 0 20 0 3 0 275203425 177061888 10184 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43228 10184 208 433 0 42792 0
[pid=18553/tid=18554] ppid=18551 vsize=172912 CPUtime=6.26 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 4186 0 0 0 624 2 0 0 20 0 3 0 275203425 177061888 10184 33554432000 4194304 5965102 140734274532304 140066860940216 4401510 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=172912 CPUtime=6.27 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 5086 0 0 0 624 3 0 0 20 0 3 0 275203425 177061888 10184 33554432000 4194304 5965102 140734274532304 140066850449528 4393922 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 172912

[startup+12.7003 s]
/proc/loadavg: 3.86 3.95 3.90 5/181 18596
/proc/meminfo: memFree=31217360/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=173236 CPUtime=25.37 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 12515 0 0 0 2531 6 0 0 20 0 3 0 275203425 177393664 12600 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43309 12600 208 433 0 42873 0
[pid=18553/tid=18554] ppid=18551 vsize=173236 CPUtime=12.64 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 5489 0 0 0 1261 3 0 0 20 0 3 0 275203425 177393664 12600 33554432000 4194304 5965102 140734274532304 140066860939256 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=173236 CPUtime=12.65 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 6199 0 0 0 1262 3 0 0 20 0 3 0 275203425 177393664 12600 33554432000 4194304 5965102 140734274532304 140066850449720 4388976 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.37
Current children cumulated vsize (KiB) 173236

[startup+25.5004 s]
/proc/loadavg: 3.88 3.96 3.90 5/181 18596
/proc/meminfo: memFree=31168272/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=173396 CPUtime=50.96 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 17416 0 0 0 5086 10 0 0 20 0 3 0 275203425 177557504 17456 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43349 17456 208 433 0 42913 0
[pid=18553/tid=18554] ppid=18551 vsize=173396 CPUtime=25.4 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 8024 0 0 0 2536 4 0 0 20 0 3 0 275203425 177557504 17456 33554432000 4194304 5965102 140734274532304 140066860939800 4400963 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=173396 CPUtime=25.41 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 8565 0 0 0 2535 6 0 0 20 0 3 0 275203425 177557504 17456 33554432000 4194304 5965102 140734274532304 140066850449720 4401146 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 173396

[startup+51.1003 s]
/proc/loadavg: 3.92 3.96 3.90 5/181 18596
/proc/meminfo: memFree=31113060/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=173660 CPUtime=102.14 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 21427 0 0 0 10202 12 0 0 20 0 3 0 275203425 177827840 23170 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 43415 23170 208 433 0 42979 0
[pid=18553/tid=18554] ppid=18551 vsize=173660 CPUtime=50.94 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 10733 0 0 0 5089 5 0 0 20 0 3 0 275203425 177827840 23170 33554432000 4194304 5965102 140734274532304 140066860939304 4401824 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=173660 CPUtime=50.94 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 9867 0 0 0 5087 7 0 0 20 0 3 0 275203425 177827840 23170 33554432000 4194304 5965102 140734274532304 140066850449592 4401441 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 173660

[startup+102.307 s]
/proc/loadavg: 3.97 3.96 3.91 5/181 18596
/proc/meminfo: memFree=30965608/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=306728 CPUtime=204.54 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 46558 0 0 0 20422 32 0 0 20 0 3 0 275203425 314089472 48301 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 76682 48301 208 433 0 76246 0
[pid=18553/tid=18554] ppid=18551 vsize=306728 CPUtime=102.01 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 24358 0 0 0 10184 17 0 0 20 0 3 0 275203425 314089472 48301 33554432000 4194304 5965102 140734274532304 140066860939256 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=306728 CPUtime=102.01 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 21373 0 0 0 10185 16 0 0 20 0 3 0 275203425 314089472 48301 33554432000 4194304 5965102 140734274532304 140066850449528 4401582 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 204.54
Current children cumulated vsize (KiB) 306728

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/181 18596
/proc/meminfo: memFree=30850832/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=372900 CPUtime=324.5 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 68611 0 0 0 32399 51 0 0 20 0 3 0 275203425 381849600 70410 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 93225 70410 208 433 0 92789 0
[pid=18553/tid=18554] ppid=18551 vsize=372900 CPUtime=161.84 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 36532 0 0 0 16155 29 0 0 20 0 3 0 275203425 381849600 70410 33554432000 4194304 5965102 140734274532304 140066860939256 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=372900 CPUtime=161.84 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 31252 0 0 0 16159 25 0 0 20 0 3 0 275203425 381849600 70410 33554432000 4194304 5965102 140734274532304 140066850449720 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 324.5
Current children cumulated vsize (KiB) 372900

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.91 5/181 18596
/proc/meminfo: memFree=30803764/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=373044 CPUtime=444.45 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 75705 0 0 0 44386 59 0 0 20 0 3 0 275203425 381997056 77682 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 93261 77682 208 433 0 92825 0
[pid=18553/tid=18554] ppid=18551 vsize=373044 CPUtime=221.66 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 43568 0 0 0 22128 38 0 0 20 0 3 0 275203425 381997056 77682 33554432000 4194304 5965102 140734274532304 140066860939064 4400955 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=373044 CPUtime=221.68 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 31310 0 0 0 22142 26 0 0 20 0 3 0 275203425 381997056 77682 33554432000 4194304 5965102 140734274532304 140066850449480 4400955 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 444.45
Current children cumulated vsize (KiB) 373044

################
# More data... #
################

[pid=18553/tid=18555] ppid=18551 vsize=504420 CPUtime=341.36 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 44144 0 0 0 34097 39 0 0 20 0 3 0 275203425 516526080 103788 33554432000 4194304 5965102 140734274532304 140066850449720 4389719 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 684.39
Current children cumulated vsize (KiB) 504420

[startup+402.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 18597
/proc/meminfo: memFree=30548224/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=504748 CPUtime=804.37 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 102059 0 0 0 80360 77 0 0 20 0 3 0 275203425 516861952 103834 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 126187 103834 208 433 0 125751 0
[pid=18553/tid=18554] ppid=18551 vsize=504748 CPUtime=401.16 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57001 0 0 0 40067 49 0 0 20 0 3 0 275203425 516861952 103834 33554432000 4194304 5965102 140734274532304 140066860940104 4401096 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=504748 CPUtime=401.2 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 44231 0 0 0 40080 40 0 0 20 0 3 0 275203425 516861952 103834 33554432000 4194304 5965102 140734274532304 140066850449480 4400894 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 804.37
Current children cumulated vsize (KiB) 504748

[startup+462.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/182 18600
/proc/meminfo: memFree=30504884/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=505176 CPUtime=924.36 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 105822 0 0 0 92354 82 0 0 20 0 3 0 275203425 517300224 107597 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 126294 107597 208 433 0 125858 0
[pid=18553/tid=18554] ppid=18551 vsize=505176 CPUtime=461.01 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57001 0 0 0 46051 50 0 0 20 0 3 0 275203425 517300224 107597 33554432000 4194304 5965102 140734274532304 140066860940104 4401582 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=505176 CPUtime=461.05 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 47994 0 0 0 46060 45 0 0 20 0 3 0 275203425 517300224 107597 33554432000 4194304 5965102 140734274532304 140066850449720 4393903 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 924.36
Current children cumulated vsize (KiB) 505176

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/182 18623
/proc/meminfo: memFree=30430900/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=572268 CPUtime=1044.34 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 117990 0 0 0 104338 96 0 0 20 0 3 0 275203425 586002432 119765 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 143067 119765 208 433 0 142631 0
[pid=18553/tid=18554] ppid=18551 vsize=572268 CPUtime=520.85 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57001 0 0 0 52035 50 0 0 20 0 3 0 275203425 586002432 119765 33554432000 4194304 5965102 140734274532304 140066860940104 4401155 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=572268 CPUtime=520.9 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 60162 0 0 0 52031 59 0 0 20 0 3 0 275203425 586002432 119765 33554432000 4194304 5965102 140734274532304 140066850449720 4400955 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1044.34
Current children cumulated vsize (KiB) 572268

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 18624
/proc/meminfo: memFree=30340560/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=637960 CPUtime=1164.32 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 132913 0 0 0 116322 110 0 0 20 0 3 0 275203425 653271040 134703 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 159490 134703 208 433 0 159054 0
[pid=18553/tid=18554] ppid=18551 vsize=637960 CPUtime=580.69 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57002 0 0 0 58018 51 0 0 20 0 3 0 275203425 653271040 134703 33554432000 4194304 5965102 140734274532304 140066860940104 4401107 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=637960 CPUtime=580.74 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 75084 0 0 0 58000 74 0 0 20 0 3 0 275203425 653271040 134703 33554432000 4194304 5965102 140734274532304 140066850449720 4400986 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1164.32
Current children cumulated vsize (KiB) 637960

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 18624
/proc/meminfo: memFree=30255152/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=704152 CPUtime=1284.28 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 146698 0 0 0 128304 124 0 0 20 0 3 0 275203425 721051648 148479 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 176038 148479 208 433 0 175602 0
[pid=18553/tid=18554] ppid=18551 vsize=704152 CPUtime=640.54 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57049 0 0 0 64002 52 0 0 20 0 3 0 275203425 721051648 148479 33554432000 4194304 5965102 140734274532304 140066860940104 4390125 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=704152 CPUtime=640.56 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 88822 0 0 0 63967 89 0 0 20 0 3 0 275203425 721051648 148479 33554432000 4194304 5965102 140734274532304 140066850449720 4391896 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1284.28
Current children cumulated vsize (KiB) 704152

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.91 5/181 18624
/proc/meminfo: memFree=30195536/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=771100 CPUtime=1404.21 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 163367 0 0 0 140283 138 0 0 20 0 3 0 275203425 789606400 165057 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 192775 165057 208 433 0 192339 0
[pid=18553/tid=18554] ppid=18551 vsize=771100 CPUtime=700.37 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57063 0 0 0 69984 53 0 0 20 0 3 0 275203425 789606400 165057 33554432000 4194304 5965102 140734274532304 140066860940104 4401096 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=771100 CPUtime=700.37 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 105477 0 0 0 69933 104 0 0 20 0 3 0 275203425 789606400 165057 33554432000 4194304 5965102 140734274532304 140066850449768 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1404.21
Current children cumulated vsize (KiB) 771100

[startup+762.307 s]
/proc/loadavg: 4.07 4.00 3.92 5/181 18624
/proc/meminfo: memFree=30096236/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=836636 CPUtime=1524.21 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 182507 0 0 0 152267 154 0 0 20 0 3 0 275203425 856715264 184187 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 209159 184187 208 433 0 208723 0
[pid=18553/tid=18554] ppid=18551 vsize=836636 CPUtime=760.21 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57063 0 0 0 75967 54 0 0 20 0 3 0 275203425 856715264 184187 33554432000 4194304 5965102 140734274532304 140066860940104 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=836636 CPUtime=760.21 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 124617 0 0 0 75900 121 0 0 20 0 3 0 275203425 856715264 184187 33554432000 4194304 5965102 140734274532304 140066850449720 4401004 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1524.21
Current children cumulated vsize (KiB) 836636

[startup+822.3 s]
/proc/loadavg: 4.02 4.00 3.92 5/181 18624
/proc/meminfo: memFree=30075372/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=836636 CPUtime=1644.17 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 182514 0 0 0 164263 154 0 0 20 0 3 0 275203425 856715264 184346 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 209159 184346 208 433 0 208723 0
[pid=18553/tid=18554] ppid=18551 vsize=836636 CPUtime=820.05 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57064 0 0 0 81950 55 0 0 20 0 3 0 275203425 856715264 184346 33554432000 4194304 5965102 140734274532304 140066860939800 4380351 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=836636 CPUtime=820.05 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 124623 0 0 0 81883 122 0 0 20 0 3 0 275203425 856715264 184346 33554432000 4194304 5965102 140734274532304 140066850449720 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1644.17
Current children cumulated vsize (KiB) 836636

[startup+882.3 s]
/proc/loadavg: 4.01 4.00 3.92 5/181 18625
/proc/meminfo: memFree=30048340/32873844 swapFree=6080/6080
[pid=18553] ppid=18551 vsize=837100 CPUtime=1764.15 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 182608 0 0 0 176261 154 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 209275 184440 208 433 0 208839 0
[pid=18553/tid=18554] ppid=18551 vsize=837100 CPUtime=879.89 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57064 0 0 0 87933 56 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140066860939800 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=837100 CPUtime=879.9 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 124717 0 0 0 87867 123 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140066850449480 4401096 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1764.15
Current children cumulated vsize (KiB) 837100



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/181 18625
/proc/meminfo: memFree=30033584/32873844 swapFree=6076/6076
[pid=18553] ppid=18551 vsize=837100 CPUtime=1800.16 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 182608 0 0 0 179862 154 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 209275 184440 208 433 0 208839 0
[pid=18553/tid=18554] ppid=18551 vsize=837100 CPUtime=897.85 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57064 0 0 0 89729 56 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140066860939800 4401668 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=837100 CPUtime=897.86 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 124717 0 0 0 89663 123 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140066850449480 4222416 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 837100

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.92 5/181 18625
/proc/meminfo: memFree=30033584/32873844 swapFree=6076/6076
[pid=18553] ppid=18551 vsize=837100 CPUtime=1800.16 cores=0,2,4,6
/proc/18553/stat : 18553 (pwbo2.0) S 18551 18553 18125 0 -1 4202496 182608 0 0 0 179862 154 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140734274531824 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/18553/statm: 209275 184440 208 433 0 208839 0
[pid=18553/tid=18554] ppid=18551 vsize=837100 CPUtime=897.85 cores=0,2,4,6
/proc/18553/task/18554/stat : 18554 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 57064 0 0 0 89729 56 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140066860939800 4401668 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=18553/tid=18555] ppid=18551 vsize=837100 CPUtime=897.86 cores=0,2,4,6
/proc/18553/task/18555/stat : 18555 (pwbo2.0) R 18551 18553 18125 0 -1 4202560 124717 0 0 0 89663 123 0 0 20 0 3 0 275203425 857190400 184440 33554432000 4194304 5965102 140734274532304 140066850449480 4222416 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 837100

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18553 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=929281
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=830721
# CPU time returned by wait4() is 1795.76
# while last known CPU time is 1800.16
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.326
CPU time (s): 1800.16
CPU user time (s): 1798.62
CPU system time (s): 1.54
CPU usage (%): 199.945
Max. virtual memory (cumulated for all children) (KiB): 837100

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.93
system time used= 1.83072
maximum resident set size= 737768
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 182610
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 476
involuntary context switches= 1947

runsolver used 1.86172 second user time and 4.87426 second system time

The end

Launcher Data 

Begin job on node139 at 2012-05-27 05:53:09
IDJOB=3703652
IDBENCH=2226
IDSOLVER=2279
FILE ID=node139/3703652-1338090789
RUNJOBID= node139-1338087173-18141
PBS_JOBID= 14624436
Free space on /tmp= 71656 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/web/www.ps.uni-sb.de/~walser/benchmarks/radar/normalized-10:10:4.5:0.95:98.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703652-1338090789/watcher-3703652-1338090789 -o /tmp/evaluation-result-3703652-1338090789/solver-3703652-1338090789 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703652-1338090789.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7acfcd4d612717a490c27c9a55b3f455
RANDOM SEED=442028537

node139.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.750
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31336672 kB
Buffers:          294428 kB
Cached:           403912 kB
SwapCached:          284 kB
Active:           591844 kB
Inactive:         117224 kB
Active(anon):       5168 kB
Inactive(anon):     8052 kB
Active(file):     586676 kB
Inactive(file):   109172 kB
Unevictable:        6080 kB
Mlocked:            6080 kB
SwapTotal:      67108856 kB
SwapFree:       67106400 kB
Dirty:              5472 kB
Writeback:             0 kB
AnonPages:         16380 kB
Mapped:            11764 kB
Shmem:                 8 kB
Slab:             688396 kB
SReclaimable:     130668 kB
SUnreclaim:       557728 kB
KernelStack:        1440 kB
PageTables:         3608 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     135920 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71648 MiB
End job on node139 at 2012-05-27 06:08:11