Trace number 3712637

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.19 900.321

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/wcsp/coloring/
normalized-myciel5g-3_wcsp.wbo
MD5SUM2db150696fc8aa7bc9f51554db7714aa
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark16
Best CPU time to get the best result obtained on this benchmark226.727
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables141
Total number of constraints755
Number of soft constraints708
Number of constraints which are clauses708
Number of constraints which are cardinality constraints (but not clauses)47
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint3
Top cost 237
Min constraint cost 1
Max constraint cost 1
Sum of constraints costs 708
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 4
Number of bits of the biggest sum of numbers3
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712637-1338206238.wbo.
0.00/0.00	c Instance file HOME/instance-3712637-1338206238.wbo
0.00/0.00	c File size is 20151 bytes.
0.00/0.00	c Highest Coefficient sum: 4
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      849                                                 |
0.00/0.00	c |  Number Clauses:        755                                                 |
0.00/0.00	c |  Number Cardinality:    47                                                  |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.19/900.31	o 49
1800.19/900.31	o 43
1800.19/900.31	o 41
1800.19/900.31	o 29
1800.19/900.31	o 27
1800.19/900.31	o 26
1800.19/900.31	o 25
1800.19/900.31	o 24
1800.19/900.31	o 23
1800.19/900.31	o 22
1800.19/900.31	o 21
1800.19/900.31	o 20
1800.19/900.31	o 17
1800.19/900.31	o 16
1800.19/900.31	c ===============================================================================
1800.19/900.31	c Wall Clock Time: 900.31 s
1800.19/900.31	c Best Solution: 16
1800.19/900.31	s SATISFIABLE
1800.19/900.31	v x1 -x2 -x3 x4 -x5 -x6 x7 -x8 -x9 x10 -x11 -x12 x13 -x14 -x15 -x16 -x17 x18 -x19 -x20 x21 -x22 -x23 x24 -x25 -x26 x27 -x28 -x29 x30 x31 -x32 -x33 -x34 x35 -x36 -x37 x38 -x39 -x40 x41 -x42 -x43 x44 -x45 -x46 x47 -x48 -x49 -x50 x51 -x52 -x53 x54 -x55 -x56 x57 -x58 -x59 x60 -x61 -x62 x63 -x64 x65 -x66 x67 -x68 -x69 -x70 x71 -x72 -x73 x74 -x75 -x76 x77 -x78 -x79 x80 -x81 -x82 x83 -x84 -x85 -x86 x87 -x88 -x89 x90 -x91 -x92 x93 -x94 -x95 x96 -x97 -x98 x99 -x100 x101 -x102 -x103 x104 -x105 -x106 x107 -x108 -x109 x110 -x111 -x112 x113 -x114 -x115 x116 -x117 -x118 x119 -x120 -x121 x122 -x123 -x124 -x125 x126 -x127 x128 -x129 -x130 -x131 x132 -x133 x134 -x135 x136 -x137 -x138 x139 -x140 -x141

Verifier Data 

OK	16

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712637-1338206238/watcher-3712637-1338206238 -o /tmp/evaluation-result-3712637-1338206238/solver-3712637-1338206238 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712637-1338206238.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.85 3.94 3.93 4/178 20341
/proc/meminfo: memFree=31350300/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=162768 CPUtime=0 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 1070 0 0 0 0 0 0 0 20 0 3 0 286749310 166674432 1017 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 40692 1017 191 433 0 40256 0
[pid=20341/tid=20342] ppid=20339 vsize=162768 CPUtime=0 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 130 0 0 0 0 0 0 0 20 0 3 0 286749310 166674432 1017 33554432000 4194304 5964478 140736754105376 140285616667336 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=162768 CPUtime=0 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 88 0 0 0 0 0 0 0 20 0 3 0 286749310 166674432 1017 33554432000 4194304 5964478 140736754105376 140285606177128 4570821 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.0663539 s]
/proc/loadavg: 3.85 3.94 3.93 4/178 20341
/proc/meminfo: memFree=31350300/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168380 CPUtime=0.12 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 3409 0 0 0 12 0 0 0 20 0 3 0 286749310 172421120 3331 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42095 3331 206 433 0 41659 0
[pid=20341/tid=20342] ppid=20339 vsize=168380 CPUtime=0.05 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 276 0 0 0 5 0 0 0 20 0 3 0 286749310 172421120 3331 33554432000 4194304 5964478 140736754105376 140285616667176 4389154 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168380 CPUtime=0.05 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2281 0 0 0 5 0 0 0 20 0 3 0 286749310 172421120 3331 33554432000 4194304 5964478 140736754105376 140285606176040 4400748 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.12
Current children cumulated vsize (KiB) 168380

[startup+0.100361 s]
/proc/loadavg: 3.85 3.94 3.93 4/178 20341
/proc/meminfo: memFree=31350300/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168380 CPUtime=0.18 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 3441 0 0 0 18 0 0 0 20 0 3 0 286749310 172421120 3363 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42095 3363 206 433 0 41659 0
[pid=20341/tid=20342] ppid=20339 vsize=168380 CPUtime=0.08 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 300 0 0 0 8 0 0 0 20 0 3 0 286749310 172421120 3363 33554432000 4194304 5964478 140736754105376 140285616667176 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168380 CPUtime=0.08 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2289 0 0 0 8 0 0 0 20 0 3 0 286749310 172421120 3363 33554432000 4194304 5964478 140736754105376 140285606176040 4403327 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 168380

[startup+0.300286 s]
/proc/loadavg: 3.85 3.94 3.93 4/178 20341
/proc/meminfo: memFree=31350300/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168380 CPUtime=0.58 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 3842 0 0 0 58 0 0 0 20 0 3 0 286749310 172421120 3764 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42095 3764 206 433 0 41659 0
[pid=20341/tid=20342] ppid=20339 vsize=168380 CPUtime=0.28 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 669 0 0 0 28 0 0 0 20 0 3 0 286749310 172421120 3764 33554432000 4194304 5964478 140736754105376 140285616667176 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168380 CPUtime=0.28 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2321 0 0 0 28 0 0 0 20 0 3 0 286749310 172421120 3764 33554432000 4194304 5964478 140736754105376 140285606176040 4400151 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 168380

[startup+0.700289 s]
/proc/loadavg: 3.85 3.94 3.93 4/178 20341
/proc/meminfo: memFree=31350300/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168380 CPUtime=1.38 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 4459 0 0 0 138 0 0 0 20 0 3 0 286749310 172421120 4381 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42095 4381 206 433 0 41659 0
[pid=20341/tid=20342] ppid=20339 vsize=168380 CPUtime=0.68 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 1214 0 0 0 68 0 0 0 20 0 3 0 286749310 172421120 4381 33554432000 4194304 5964478 140736754105376 140285616666952 4389148 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168380 CPUtime=0.68 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2393 0 0 0 68 0 0 0 20 0 3 0 286749310 172421120 4381 33554432000 4194304 5964478 140736754105376 140285606177128 4400696 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 168380

[startup+1.50028 s]
/proc/loadavg: 3.87 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31330940/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168380 CPUtime=2.98 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 4618 0 0 0 298 0 0 0 20 0 3 0 286749310 172421120 4540 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42095 4541 206 433 0 41659 0
[pid=20341/tid=20342] ppid=20339 vsize=168380 CPUtime=1.48 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 1226 0 0 0 148 0 0 0 20 0 3 0 286749310 172421120 4541 33554432000 4194304 5964478 140736754105376 140285616666952 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168380 CPUtime=1.48 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2541 0 0 0 148 0 0 0 20 0 3 0 286749310 172421120 4541 33554432000 4194304 5964478 140736754105376 140285606177128 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 168380

[startup+3.10029 s]
/proc/loadavg: 3.87 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31323500/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168380 CPUtime=6.18 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 6340 0 0 0 617 1 0 0 20 0 3 0 286749310 172421120 6262 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42095 6262 206 433 0 41659 0
[pid=20341/tid=20342] ppid=20339 vsize=168380 CPUtime=3.07 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2685 0 0 0 307 0 0 0 20 0 3 0 286749310 172421120 6262 33554432000 4194304 5964478 140736754105376 140285616666424 4403624 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168380 CPUtime=3.07 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 2803 0 0 0 307 0 0 0 20 0 3 0 286749310 172421120 6262 33554432000 4194304 5964478 140736754105376 140285606177080 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 168380

[startup+6.30031 s]
/proc/loadavg: 3.88 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31290868/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=168740 CPUtime=12.59 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 9030 0 0 0 1256 3 0 0 20 0 3 0 286749310 172789760 8952 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42185 8952 206 433 0 41749 0
[pid=20341/tid=20342] ppid=20339 vsize=168740 CPUtime=6.26 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 4917 0 0 0 624 2 0 0 20 0 3 0 286749310 172789760 8952 33554432000 4194304 5964478 140736754105376 140285616666424 5136474 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=168740 CPUtime=6.26 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 3261 0 0 0 626 0 0 0 20 0 3 0 286749310 172789760 8952 33554432000 4194304 5964478 140736754105376 140285606177080 4399922 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 168740

[startup+12.7003 s]
/proc/loadavg: 3.89 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31240788/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=169328 CPUtime=25.38 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 13459 0 0 0 2533 5 0 0 20 0 3 0 286749310 173391872 13381 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42332 13381 206 433 0 41896 0
[pid=20341/tid=20342] ppid=20339 vsize=169328 CPUtime=12.65 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 8421 0 0 0 1262 3 0 0 20 0 3 0 286749310 173391872 13381 33554432000 4194304 5964478 140736754105376 140285616666616 4389144 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=169328 CPUtime=12.65 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 4186 0 0 0 1264 1 0 0 20 0 3 0 286749310 173391872 13381 33554432000 4194304 5964478 140736754105376 140285606177128 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 169328

[startup+25.5003 s]
/proc/loadavg: 3.90 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31172020/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=170228 CPUtime=50.98 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 20768 0 0 0 5089 9 0 0 20 0 3 0 286749310 174313472 20618 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42557 20618 206 433 0 42121 0
[pid=20341/tid=20342] ppid=20339 vsize=170228 CPUtime=25.41 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 14242 0 0 0 2534 7 0 0 20 0 3 0 286749310 174313472 20618 33554432000 4194304 5964478 140736754105376 140285616666680 4222464 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=170228 CPUtime=25.41 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 5674 0 0 0 2539 2 0 0 20 0 3 0 286749310 174313472 20618 33554432000 4194304 5964478 140736754105376 140285606177080 4399922 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 170228

[startup+51.1003 s]
/proc/loadavg: 3.94 3.95 3.93 5/180 20344
/proc/meminfo: memFree=31114072/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=170668 CPUtime=102.17 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 21366 0 0 0 10208 9 0 0 20 0 3 0 286749310 174764032 21216 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 42667 21216 206 433 0 42231 0
[pid=20341/tid=20342] ppid=20339 vsize=170668 CPUtime=50.95 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 14287 0 0 0 5088 7 0 0 20 0 3 0 286749310 174764032 21216 33554432000 4194304 5964478 140736754105376 140285616667576 4403640 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=170668 CPUtime=50.95 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 6227 0 0 0 5093 2 0 0 20 0 3 0 286749310 174764032 21216 33554432000 4194304 5964478 140736754105376 140285606177128 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.17
Current children cumulated vsize (KiB) 170668

[startup+102.307 s]
/proc/loadavg: 4.02 3.97 3.94 5/181 20345
/proc/meminfo: memFree=30986576/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=238288 CPUtime=204.56 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 34851 0 0 0 20435 21 0 0 20 0 3 0 286749310 244006912 34701 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 59572 34701 206 433 0 59136 0
[pid=20341/tid=20342] ppid=20339 vsize=238288 CPUtime=102.02 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 25767 0 0 0 10184 18 0 0 20 0 3 0 286749310 244006912 34701 33554432000 4194304 5964478 140736754105376 140285616666424 4389131 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=238288 CPUtime=102.02 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 8232 0 0 0 10197 5 0 0 20 0 3 0 286749310 244006912 34701 33554432000 4194304 5964478 140736754105376 140285606177080 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.56
Current children cumulated vsize (KiB) 238288

[startup+162.3 s]
/proc/loadavg: 4.01 3.97 3.94 5/181 20345
/proc/meminfo: memFree=30918684/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=239336 CPUtime=324.52 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 38782 0 0 0 32425 27 0 0 20 0 3 0 286749310 245080064 38677 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 59834 38677 206 433 0 59398 0
[pid=20341/tid=20342] ppid=20339 vsize=239336 CPUtime=161.85 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 25920 0 0 0 16166 19 0 0 20 0 3 0 286749310 245080064 38677 33554432000 4194304 5964478 140736754105376 140285616667576 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=239336 CPUtime=161.86 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12010 0 0 0 16174 12 0 0 20 0 3 0 286749310 245080064 38677 33554432000 4194304 5964478 140736754105376 140285606177080 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.52
Current children cumulated vsize (KiB) 239336

[startup+222.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/182 20348
/proc/meminfo: memFree=30839704/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=239492 CPUtime=444.46 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 39106 0 0 0 44418 28 0 0 20 0 3 0 286749310 245239808 39014 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 59873 39014 206 433 0 59437 0
[pid=20341/tid=20342] ppid=20339 vsize=239492 CPUtime=221.67 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 26012 0 0 0 22147 20 0 0 20 0 3 0 286749310 245239808 39014 33554432000 4194304 5964478 140736754105376 140285616667576 4221984 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=239492 CPUtime=221.7 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12242 0 0 0 22157 13 0 0 20 0 3 0 286749310 245239808 39014 33554432000 4194304 5964478 140736754105376 140285606176840 4392902 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.46
Current children cumulated vsize (KiB) 239492

################
# More data... #
################

[pid=20341/tid=20343] ppid=20339 vsize=306472 CPUtime=341.38 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12340 0 0 0 34123 15 0 0 20 0 3 0 286749310 313827328 54640 33554432000 4194304 5964478 140736754105376 140285606176840 4400503 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.42
Current children cumulated vsize (KiB) 306472

[startup+402.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/181 20372
/proc/meminfo: memFree=30595428/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=307248 CPUtime=804.4 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 61877 0 0 0 80383 57 0 0 20 0 3 0 286749310 314621952 63487 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 76812 63487 206 433 0 76376 0
[pid=20341/tid=20342] ppid=20339 vsize=307248 CPUtime=401.2 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 48652 0 0 0 40068 52 0 0 20 0 3 0 286749310 314621952 63487 33554432000 4194304 5964478 140736754105376 140285616666424 4400385 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=307248 CPUtime=401.23 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12373 0 0 0 40107 16 0 0 20 0 3 0 286749310 314621952 63487 33554432000 4194304 5964478 140736754105376 140285606176840 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.4
Current children cumulated vsize (KiB) 307248

[startup+462.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/181 20372
/proc/meminfo: memFree=30550488/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=373584 CPUtime=924.38 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 68174 0 0 0 92372 66 0 0 20 0 3 0 286749310 382550016 69784 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 93396 69784 206 433 0 92960 0
[pid=20341/tid=20342] ppid=20339 vsize=373584 CPUtime=461.05 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 54780 0 0 0 46044 61 0 0 20 0 3 0 286749310 382550016 69784 33554432000 4194304 5964478 140736754105376 140285616666424 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=373584 CPUtime=461.08 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12542 0 0 0 46091 17 0 0 20 0 3 0 286749310 382550016 69784 33554432000 4194304 5964478 140736754105376 140285606176840 4403274 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.38
Current children cumulated vsize (KiB) 373584

[startup+522.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/181 20372
/proc/meminfo: memFree=30459776/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=373728 CPUtime=1044.37 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 75589 0 0 0 104362 75 0 0 20 0 3 0 286749310 382697472 77199 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 93432 77199 206 433 0 92996 0
[pid=20341/tid=20342] ppid=20339 vsize=373728 CPUtime=520.9 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 62154 0 0 0 52019 71 0 0 20 0 3 0 286749310 382697472 77199 33554432000 4194304 5964478 140736754105376 140285616666664 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=373728 CPUtime=520.92 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12583 0 0 0 52075 17 0 0 20 0 3 0 286749310 382697472 77199 33554432000 4194304 5964478 140736754105376 140285606176840 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.37
Current children cumulated vsize (KiB) 373728

[startup+582.3 s]
/proc/loadavg: 4.05 3.99 3.94 5/180 20372
/proc/meminfo: memFree=30434364/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=440048 CPUtime=1164.35 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 81869 0 0 0 116349 86 0 0 20 0 3 0 286749310 450609152 83479 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 110012 83479 206 433 0 109576 0
[pid=20341/tid=20342] ppid=20339 vsize=440048 CPUtime=580.74 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 68246 0 0 0 57991 83 0 0 20 0 3 0 286749310 450609152 83479 33554432000 4194304 5964478 140736754105376 140285616666664 4399899 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=440048 CPUtime=580.77 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 12771 0 0 0 58058 19 0 0 20 0 3 0 286749310 450609152 83479 33554432000 4194304 5964478 140736754105376 140285606176840 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.35
Current children cumulated vsize (KiB) 440048

[startup+642.3 s]
/proc/loadavg: 4.02 3.99 3.94 5/181 20373
/proc/meminfo: memFree=30351564/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=440188 CPUtime=1284.29 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 90165 0 0 0 128329 100 0 0 20 0 3 0 286749310 450752512 92010 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 110047 92010 206 433 0 109611 0
[pid=20341/tid=20342] ppid=20339 vsize=440188 CPUtime=640.55 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 74447 0 0 0 63961 94 0 0 20 0 3 0 286749310 450752512 92010 33554432000 4194304 5964478 140736754105376 140285616666664 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=440188 CPUtime=640.62 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 14866 0 0 0 64038 24 0 0 20 0 3 0 286749310 450752512 92010 33554432000 4194304 5964478 140736754105376 140285606177128 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.29
Current children cumulated vsize (KiB) 440188

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20374
/proc/meminfo: memFree=30282980/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=440996 CPUtime=1404.25 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 93847 0 0 0 140318 107 0 0 20 0 3 0 286749310 451579904 95785 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 110249 95785 206 433 0 109813 0
[pid=20341/tid=20342] ppid=20339 vsize=440996 CPUtime=700.37 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 77667 0 0 0 69936 101 0 0 20 0 3 0 286749310 451579904 95785 33554432000 4194304 5964478 140736754105376 140285616666424 4389148 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=440996 CPUtime=700.46 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 15328 0 0 0 70021 25 0 0 20 0 3 0 286749310 451579904 95785 33554432000 4194304 5964478 140736754105376 140285606177080 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.25
Current children cumulated vsize (KiB) 440996

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20374
/proc/meminfo: memFree=30230684/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=506960 CPUtime=1524.24 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 104577 0 0 0 152299 125 0 0 20 0 3 0 286749310 519127040 106523 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 126740 106523 206 433 0 126304 0
[pid=20341/tid=20342] ppid=20339 vsize=506960 CPUtime=760.21 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 88312 0 0 0 75901 120 0 0 20 0 3 0 286749310 519127040 106523 33554432000 4194304 5964478 140736754105376 140285616666216 4399838 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=506960 CPUtime=760.31 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 15413 0 0 0 76005 26 0 0 20 0 3 0 286749310 519127040 106523 33554432000 4194304 5964478 140736754105376 140285606176840 4400117 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.24
Current children cumulated vsize (KiB) 506960

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/182 20377
/proc/meminfo: memFree=30211104/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=507172 CPUtime=1644.2 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 109535 0 0 0 164287 133 0 0 20 0 3 0 286749310 519344128 111593 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 126793 111593 206 433 0 126357 0
[pid=20341/tid=20342] ppid=20339 vsize=507172 CPUtime=820.05 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 93224 0 0 0 81876 129 0 0 20 0 3 0 286749310 519344128 111593 33554432000 4194304 5964478 140736754105376 140285616666424 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=507172 CPUtime=820.15 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 15459 0 0 0 81988 27 0 0 20 0 3 0 286749310 519344128 111593 33554432000 4194304 5964478 140736754105376 140285606176840 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.2
Current children cumulated vsize (KiB) 507172

[startup+882.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20377
/proc/meminfo: memFree=30186588/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=508240 CPUtime=1764.18 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 115565 0 0 0 176273 145 0 0 20 0 3 0 286749310 520437760 117623 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 127060 117623 206 433 0 126624 0
[pid=20341/tid=20342] ppid=20339 vsize=508240 CPUtime=879.9 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 98074 0 0 0 87850 140 0 0 20 0 3 0 286749310 520437760 117623 33554432000 4194304 5964478 140736754105376 140285616666424 4389154 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=508240 CPUtime=879.99 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 16639 0 0 0 87969 30 0 0 20 0 3 0 286749310 520437760 117623 33554432000 4194304 5964478 140736754105376 140285606177128 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.18
Current children cumulated vsize (KiB) 508240



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20418
/proc/meminfo: memFree=30928948/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=508240 CPUtime=1800.19 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 116177 0 0 0 179873 146 0 0 20 0 3 0 286749310 520437760 118301 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 127060 118301 206 433 0 126624 0
[pid=20341/tid=20342] ppid=20339 vsize=508240 CPUtime=897.86 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 98183 0 0 0 89646 140 0 0 20 0 3 0 286749310 520437760 118301 33554432000 4194304 5964478 140736754105376 140285616666424 4409201 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=508240 CPUtime=897.95 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 17142 0 0 0 89764 31 0 0 20 0 3 0 286749310 520437760 118301 33554432000 4194304 5964478 140736754105376 140285606177080 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 508240

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20418
/proc/meminfo: memFree=30928948/32873648 swapFree=7116/7116
[pid=20341] ppid=20339 vsize=508240 CPUtime=1800.19 cores=1,3,5,7
/proc/20341/stat : 20341 (pwbo2.01) S 20339 20341 14514 0 -1 4202496 116177 0 0 0 179873 146 0 0 20 0 3 0 286749310 520437760 118301 33554432000 4194304 5964478 140736754105376 140736754104896 4546669 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20341/statm: 127060 118301 206 433 0 126624 0
[pid=20341/tid=20342] ppid=20339 vsize=508240 CPUtime=897.86 cores=1,3,5,7
/proc/20341/task/20342/stat : 20342 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 98183 0 0 0 89646 140 0 0 20 0 3 0 286749310 520437760 118301 33554432000 4194304 5964478 140736754105376 140285616666424 4409201 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20341/tid=20343] ppid=20339 vsize=508240 CPUtime=897.95 cores=1,3,5,7
/proc/20341/task/20343/stat : 20343 (pwbo2.01) R 20339 20341 14514 0 -1 4202560 17142 0 0 0 89764 31 0 0 20 0 3 0 286749310 520437760 118301 33554432000 4194304 5964478 140736754105376 140285606177080 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 508240

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20341 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=120252
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=739735
# CPU time returned by wait4() is 1795.86
# while last known CPU time is 1800.19
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.321
CPU time (s): 1800.19
CPU user time (s): 1798.73
CPU system time (s): 1.46
CPU usage (%): 199.95
Max. virtual memory (cumulated for all children) (KiB): 508240

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.12
system time used= 1.73974
maximum resident set size= 473208
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 116178
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 278
involuntary context switches= 1840

runsolver used 1.9617 second user time and 5.01424 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-28 13:57:18
IDJOB=3712637
IDBENCH=79442
IDSOLVER=2292
FILE ID=node123/3712637-1338206238
RUNJOBID= node123-1338195143-14531
PBS_JOBID= 14624606
Free space on /tmp= 71676 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/wcsp/coloring/normalized-myciel5g-3_wcsp.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712637-1338206238/watcher-3712637-1338206238 -o /tmp/evaluation-result-3712637-1338206238/solver-3712637-1338206238 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712637-1338206238.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2db150696fc8aa7bc9f51554db7714aa
RANDOM SEED=899009007

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31350548 kB
Buffers:          314560 kB
Cached:           281564 kB
SwapCached:          956 kB
Active:           376072 kB
Inactive:         308588 kB
Active(anon):      82024 kB
Inactive(anon):     8336 kB
Active(file):     294048 kB
Inactive(file):   300252 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67102956 kB
Dirty:             11572 kB
Writeback:             0 kB
AnonPages:        184484 kB
Mapped:            11084 kB
Shmem:                 0 kB
Slab:             700960 kB
SReclaimable:     144608 kB
SUnreclaim:       556352 kB
KernelStack:        1504 kB
PageTables:         4248 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     158056 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     92160 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71672 MiB
End job on node123 at 2012-05-28 14:12:21