Trace number 3712639

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.12 900.325

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/wcsp/coloring/
normalized-myciel5g-5_wcsp.wbo
MD5SUM02dbb62de02783c13bf2d3c63ea9332f
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark37.5703
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables235
Total number of constraints1227
Number of soft constraints1180
Number of constraints which are clauses1180
Number of constraints which are cardinality constraints (but not clauses)47
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint5
Top cost 237
Min constraint cost 1
Max constraint cost 1
Sum of constraints costs 1180
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 6
Number of bits of the biggest sum of numbers3
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712639-1338206229.wbo.
0.00/0.00	c Instance file HOME/instance-3712639-1338206229.wbo
0.00/0.00	c File size is 34012 bytes.
0.00/0.00	c Highest Coefficient sum: 6
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.01         s                                      |
0.00/0.00	c |  Number Variables:      1415                                                |
0.00/0.00	c |  Number Clauses:        1227                                                |
0.00/0.00	c |  Number Cardinality:    47                                                  |
0.00/0.00	c |  Number PB Constraints: 0                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.12/900.31	o 5
1800.12/900.31	o 3
1800.12/900.31	o 2
1800.12/900.31	o 1
1800.12/900.31	c ===============================================================================
1800.12/900.31	c Wall Clock Time: 900.31 s
1800.12/900.31	c Best Solution: 1
1800.12/900.31	s SATISFIABLE
1800.12/900.31	v -x1 -x2 -x3 -x4 x5 -x6 -x7 -x8 x9 -x10 -x11 -x12 -x13 -x14 x15 -x16 -x17 -x18 x19 -x20 -x21 -x22 -x23 x24 -x25 x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 x34 -x35 x36 -x37 -x38 -x39 -x40 x41 -x42 -x43 -x44 -x45 x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 x55 -x56 -x57 x58 -x59 -x60 -x61 -x62 -x63 x64 -x65 -x66 -x67 -x68 -x69 x70 -x71 -x72 x73 -x74 -x75 -x76 -x77 x78 -x79 -x80 -x81 -x82 x83 -x84 -x85 -x86 -x87 -x88 x89 -x90 -x91 -x92 x93 -x94 -x95 -x96 -x97 x98 -x99 -x100 -x101 -x102 x103 -x104 -x105 -x106 -x107 -x108 -x109 x110 -x111 x112 -x113 -x114 -x115 -x116 x117 -x118 -x119 -x120 -x121 -x122 -x123 x124 -x125 -x126 x127 -x128 -x129 -x130 -x131 x132 -x133 -x134 -x135 -x136 x137 -x138 -x139 -x140 -x141 x142 -x143 -x144 -x145 -x146 x147 -x148 -x149 -x150 -x151 x152 -x153 -x154 -x155 -x156 x157 -x158 -x159 -x160 -x161 x162 -x163 -x164 -x165 -x166 -x167 -x168 -x169 x170 -x171 -x172 -x173 -x174 x175 -x176 -x177 -x178 x179 -x180 -x181 -x182 x183 -x184 -x185 -x186 -x187 x188 -x189 -x190 -x191 -x192 x193 -x194 -x195 -x196 -x197 x198 -x199 -x200 -x201 -x202 -x203 x204 -x205 -x206 -x207 x208 -x209 -x210 -x211 -x212 x213 -x214 -x215 -x216 -x217 x218 -x219 -x220 -x221 -x222 -x223 -x224 x225 -x226 x227 -x228 -x229 -x230 x231 -x232 -x233 -x234 -x235

Verifier Data 

OK	1

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712639-1338206229/watcher-3712639-1338206229 -o /tmp/evaluation-result-3712639-1338206229/solver-3712639-1338206229 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712639-1338206229.wbo 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.84 3.94 3.93 3/178 20301
/proc/meminfo: memFree=29824624/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=162964 CPUtime=0 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 988 0 0 0 0 0 0 0 20 0 3 0 286748414 166875136 931 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 40741 937 178 433 0 40305 0
[pid=20301/tid=20302] ppid=20299 vsize=162964 CPUtime=0 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 3 0 286748415 166875136 951 33554432000 4194304 5964478 140736351051008 140551793945128 5244295 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=162964 CPUtime=0 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 62 0 0 0 0 0 0 0 20 0 3 0 286748415 166875136 959 33554432000 4194304 5964478 140736351051008 140551783455272 5136474 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0

[startup+0.0119359 s]
/proc/loadavg: 3.84 3.94 3.93 3/178 20301
/proc/meminfo: memFree=29824624/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=163216 CPUtime=0.01 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 1437 0 0 0 1 0 0 0 20 0 3 0 286748414 167133184 1380 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 40804 1383 199 433 0 40368 0
[pid=20301/tid=20302] ppid=20299 vsize=163216 CPUtime=0 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 207 0 0 0 0 0 0 0 20 0 3 0 286748415 167133184 1384 33554432000 4194304 5964478 140736351051008 140551793945112 4400099 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=163216 CPUtime=0 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 329 0 0 0 0 0 0 0 20 0 3 0 286748415 167133184 1385 33554432000 4194304 5964478 140736351051008 140551783452520 5136404 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 163216

[startup+0.100284 s]
/proc/loadavg: 3.84 3.94 3.93 3/178 20301
/proc/meminfo: memFree=29824624/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=163472 CPUtime=0.18 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 2194 0 0 0 18 0 0 0 20 0 3 0 286748414 167395328 2106 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 40868 2106 201 433 0 40432 0
[pid=20301/tid=20302] ppid=20299 vsize=163472 CPUtime=0.08 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 526 0 0 0 8 0 0 0 20 0 3 0 286748415 167395328 2106 33554432000 4194304 5964478 140736351051008 140551793944616 4373400 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=163472 CPUtime=0.08 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 762 0 0 0 8 0 0 0 20 0 3 0 286748415 167395328 2106 33554432000 4194304 5964478 140736351051008 140551783455032 5136404 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 163472

[startup+0.300232 s]
/proc/loadavg: 3.84 3.94 3.93 3/178 20301
/proc/meminfo: memFree=29824624/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=163472 CPUtime=0.59 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 3057 0 0 0 58 1 0 0 20 0 3 0 286748414 167395328 2969 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 40868 2969 201 433 0 40432 0
[pid=20301/tid=20302] ppid=20299 vsize=163472 CPUtime=0.28 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 940 0 0 0 28 0 0 0 20 0 3 0 286748415 167395328 2969 33554432000 4194304 5964478 140736351051008 140551793944616 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=163472 CPUtime=0.28 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 1211 0 0 0 28 0 0 0 20 0 3 0 286748415 167395328 2969 33554432000 4194304 5964478 140736351051008 140551783454968 4400093 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 163472

[startup+0.700286 s]
/proc/loadavg: 3.84 3.94 3.93 3/178 20301
/proc/meminfo: memFree=29824624/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=163472 CPUtime=1.38 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 4143 0 0 0 137 1 0 0 20 0 3 0 286748414 167395328 4055 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 40868 4056 201 433 0 40432 0
[pid=20301/tid=20302] ppid=20299 vsize=163472 CPUtime=0.68 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 1476 0 0 0 68 0 0 0 20 0 3 0 286748415 167395328 4056 33554432000 4194304 5964478 140736351051008 140551793944568 5136404 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=163472 CPUtime=0.68 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 1762 0 0 0 68 0 0 0 20 0 3 0 286748415 167395328 4056 33554432000 4194304 5964478 140736351051008 140551783455032 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 163472

[startup+1.50031 s]
/proc/loadavg: 3.84 3.94 3.93 5/181 20304
/proc/meminfo: memFree=29803140/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=163604 CPUtime=2.98 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 6421 0 0 0 296 2 0 0 20 0 3 0 286748414 167530496 6333 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 40901 6333 201 433 0 40465 0
[pid=20301/tid=20302] ppid=20299 vsize=163604 CPUtime=1.47 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 2484 0 0 0 147 0 0 0 20 0 3 0 286748415 167530496 6333 33554432000 4194304 5964478 140736351051008 140551793944568 4381704 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=163604 CPUtime=1.48 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 3031 0 0 0 146 2 0 0 20 0 3 0 286748415 167530496 6333 33554432000 4194304 5964478 140736351051008 140551783455032 4399916 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 163604

[startup+3.10027 s]
/proc/loadavg: 3.84 3.94 3.93 5/181 20304
/proc/meminfo: memFree=29789004/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=164164 CPUtime=6.19 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 10673 0 0 0 613 6 0 0 20 0 3 0 286748414 168103936 10585 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 41041 10585 201 433 0 40605 0
[pid=20301/tid=20302] ppid=20299 vsize=164164 CPUtime=3.07 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 4391 0 0 0 306 1 0 0 20 0 3 0 286748415 168103936 10585 33554432000 4194304 5964478 140736351051008 140551793944568 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=164164 CPUtime=3.07 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 5376 0 0 0 303 4 0 0 20 0 3 0 286748415 168103936 10585 33554432000 4194304 5964478 140736351051008 140551783455032 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 164164

[startup+6.30028 s]
/proc/loadavg: 3.85 3.94 3.93 5/181 20304
/proc/meminfo: memFree=29755772/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=164652 CPUtime=12.58 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 16208 0 0 0 1248 10 0 0 20 0 3 0 286748414 168603648 16120 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 41163 16120 201 433 0 40727 0
[pid=20301/tid=20302] ppid=20299 vsize=164652 CPUtime=6.26 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 6552 0 0 0 624 2 0 0 20 0 3 0 286748415 168603648 16120 33554432000 4194304 5964478 140736351051008 140551793944568 4400416 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=164652 CPUtime=6.26 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 8750 0 0 0 618 8 0 0 20 0 3 0 286748415 168603648 16120 33554432000 4194304 5964478 140736351051008 140551783455032 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 164652

[startup+12.7003 s]
/proc/loadavg: 3.87 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31314836/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=165008 CPUtime=25.38 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 24411 0 0 0 2522 16 0 0 20 0 3 0 286748414 168968192 24323 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 41252 24325 201 433 0 40816 0
[pid=20301/tid=20302] ppid=20299 vsize=165008 CPUtime=12.65 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 10431 0 0 0 1260 5 0 0 20 0 3 0 286748415 168968192 24325 33554432000 4194304 5964478 140736351051008 140551793944568 5136404 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=165008 CPUtime=12.64 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 13076 0 0 0 1254 10 0 0 20 0 3 0 286748415 168968192 24325 33554432000 4194304 5964478 140736351051008 140551783455032 4400075 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 165008

[startup+25.5003 s]
/proc/loadavg: 3.89 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31226652/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=231436 CPUtime=50.97 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 34418 0 0 0 5076 21 0 0 20 0 3 0 286748414 236990464 34606 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 57859 34606 201 433 0 57423 0
[pid=20301/tid=20302] ppid=20299 vsize=231436 CPUtime=25.41 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 16001 0 0 0 2534 7 0 0 20 0 3 0 286748415 236990464 34606 33554432000 4194304 5964478 140736351051008 140551793944568 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=231436 CPUtime=25.4 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 17511 0 0 0 2527 13 0 0 20 0 3 0 286748415 236990464 34606 33554432000 4194304 5964478 140736351051008 140551783455032 4400040 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 231436

[startup+51.1003 s]
/proc/loadavg: 3.93 3.94 3.93 5/181 20344
/proc/meminfo: memFree=31151032/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=298496 CPUtime=102.13 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 49361 0 0 0 10185 28 0 0 20 0 3 0 286748414 305659904 49543 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 74624 49543 201 433 0 74188 0
[pid=20301/tid=20302] ppid=20299 vsize=298496 CPUtime=50.92 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 25938 0 0 0 5080 12 0 0 20 0 3 0 286748415 305659904 49543 33554432000 4194304 5964478 140736351051008 140551793944568 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=298496 CPUtime=50.93 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 22517 0 0 0 5077 16 0 0 20 0 3 0 286748415 305659904 49543 33554432000 4194304 5964478 140736351051008 140551783454792 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.13
Current children cumulated vsize (KiB) 298496

[startup+102.307 s]
/proc/loadavg: 4.02 3.97 3.94 5/181 20345
/proc/meminfo: memFree=31007672/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=366368 CPUtime=204.5 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 71671 0 0 0 20407 43 0 0 20 0 3 0 286748414 375160832 71827 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 91592 71827 201 433 0 91156 0
[pid=20301/tid=20302] ppid=20299 vsize=366368 CPUtime=101.99 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 37731 0 0 0 10180 19 0 0 20 0 3 0 286748415 375160832 71827 33554432000 4194304 5964478 140736351051008 140551793944568 4400040 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=366368 CPUtime=101.98 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 33034 0 0 0 10172 26 0 0 20 0 3 0 286748415 375160832 71827 33554432000 4194304 5964478 140736351051008 140551783454856 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 204.5
Current children cumulated vsize (KiB) 366368

[startup+162.3 s]
/proc/loadavg: 4.01 3.97 3.94 5/181 20345
/proc/meminfo: memFree=30935688/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=433652 CPUtime=324.46 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 84248 0 0 0 32395 51 0 0 20 0 3 0 286748414 444059648 85589 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 108413 85589 201 433 0 107977 0
[pid=20301/tid=20302] ppid=20299 vsize=433652 CPUtime=161.83 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 44655 0 0 0 16158 25 0 0 20 0 3 0 286748415 444059648 85589 33554432000 4194304 5964478 140736351051008 140551793944568 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=433652 CPUtime=161.79 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 38687 0 0 0 16150 29 0 0 20 0 3 0 286748415 444059648 85589 33554432000 4194304 5964478 140736351051008 140551783454840 4400051 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 324.46
Current children cumulated vsize (KiB) 433652

[startup+222.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/182 20348
/proc/meminfo: memFree=30839900/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=566848 CPUtime=444.44 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 106967 0 0 0 44369 75 0 0 20 0 3 0 286748414 580452352 108308 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 141712 108308 201 433 0 141276 0
[pid=20301/tid=20302] ppid=20299 vsize=566848 CPUtime=221.68 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 51534 0 0 0 22137 31 0 0 20 0 3 0 286748415 580452352 108308 33554432000 4194304 5964478 140736351051008 140551793944568 4400081 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=566848 CPUtime=221.64 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 54527 0 0 0 22115 49 0 0 20 0 3 0 286748415 580452352 108308 33554432000 4194304 5964478 140736351051008 140551783455032 4400071 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 444.44
Current children cumulated vsize (KiB) 566848

################
# More data... #
################

[pid=20301/tid=20303] ppid=20299 vsize=569144 CPUtime=341.29 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 63873 0 0 0 34069 60 0 0 20 0 3 0 286748415 582803456 127445 33554432000 4194304 5964478 140736351051008 140551783455032 4400071 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 684.36
Current children cumulated vsize (KiB) 569144

[startup+402.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/181 20372
/proc/meminfo: memFree=30595816/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=635956 CPUtime=804.32 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 143700 0 0 0 80324 108 0 0 20 0 3 0 286748414 651218944 145079 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 158989 145079 201 433 0 158553 0
[pid=20301/tid=20302] ppid=20299 vsize=635956 CPUtime=401.18 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 78817 0 0 0 40061 57 0 0 20 0 3 0 286748415 651218944 145079 33554432000 4194304 5964478 140736351051008 140551793944568 4400051 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=635956 CPUtime=401.13 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 63977 0 0 0 40051 62 0 0 20 0 3 0 286748415 651218944 145079 33554432000 4194304 5964478 140736351051008 140551783454840 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 804.32
Current children cumulated vsize (KiB) 635956

[startup+462.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/181 20372
/proc/meminfo: memFree=30559168/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=636172 CPUtime=924.27 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 146504 0 0 0 92317 110 0 0 20 0 3 0 286748414 651440128 147869 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 159043 147869 201 433 0 158607 0
[pid=20301/tid=20302] ppid=20299 vsize=636172 CPUtime=461 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 78852 0 0 0 46042 58 0 0 20 0 3 0 286748415 651440128 147869 33554432000 4194304 5964478 140736351051008 140551793944568 4221120 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=636172 CPUtime=460.98 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 66746 0 0 0 46035 63 0 0 20 0 3 0 286748415 651440128 147869 33554432000 4194304 5964478 140736351051008 140551783455032 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 924.27
Current children cumulated vsize (KiB) 636172

[startup+522.3 s]
/proc/loadavg: 4.00 3.97 3.94 5/181 20372
/proc/meminfo: memFree=30468832/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=767568 CPUtime=1044.24 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 164055 0 0 0 104300 124 0 0 20 0 3 0 286748414 785989632 165419 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 191892 165419 201 433 0 191456 0
[pid=20301/tid=20302] ppid=20299 vsize=767568 CPUtime=520.84 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 86727 0 0 0 52020 64 0 0 20 0 3 0 286748415 785989632 165419 33554432000 4194304 5964478 140736351051008 140551793944568 4400008 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=767568 CPUtime=520.82 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 76422 0 0 0 52008 74 0 0 20 0 3 0 286748415 785989632 165419 33554432000 4194304 5964478 140736351051008 140551783455032 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1044.24
Current children cumulated vsize (KiB) 767568

[startup+582.3 s]
/proc/loadavg: 4.06 3.99 3.94 5/180 20372
/proc/meminfo: memFree=30442796/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=768072 CPUtime=1164.22 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 164161 0 0 0 116298 124 0 0 20 0 3 0 286748414 786505728 165524 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 192018 165524 201 433 0 191582 0
[pid=20301/tid=20302] ppid=20299 vsize=768072 CPUtime=580.69 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 86745 0 0 0 58004 65 0 0 20 0 3 0 286748415 786505728 165524 33554432000 4194304 5964478 140736351051008 140551793944616 4399936 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=768072 CPUtime=580.66 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 76510 0 0 0 57991 75 0 0 20 0 3 0 286748415 786505728 165524 33554432000 4194304 5964478 140736351051008 140551783455080 4400071 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1164.22
Current children cumulated vsize (KiB) 768072

[startup+642.3 s]
/proc/loadavg: 4.02 3.99 3.94 5/181 20373
/proc/meminfo: memFree=30374024/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=768772 CPUtime=1284.22 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 172214 0 0 0 128291 131 0 0 20 0 3 0 286748414 787222528 173577 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 192193 173577 201 433 0 191757 0
[pid=20301/tid=20302] ppid=20299 vsize=768772 CPUtime=640.54 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 94767 0 0 0 63982 72 0 0 20 0 3 0 286748415 787222528 173577 33554432000 4194304 5964478 140736351051008 140551793944568 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=768772 CPUtime=640.51 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 76541 0 0 0 63975 76 0 0 20 0 3 0 286748415 787222528 173577 33554432000 4194304 5964478 140736351051008 140551783455080 4400099 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1284.22
Current children cumulated vsize (KiB) 768772

[startup+702.3 s]
/proc/loadavg: 4.01 3.99 3.94 5/181 20374
/proc/meminfo: memFree=30290640/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=900220 CPUtime=1404.19 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 187595 0 0 0 140274 145 0 0 20 0 3 0 286748414 921825280 188958 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 225055 188958 201 433 0 224619 0
[pid=20301/tid=20302] ppid=20299 vsize=900220 CPUtime=700.38 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 101523 0 0 0 69958 80 0 0 20 0 3 0 286748415 921825280 188958 33554432000 4194304 5964478 140736351051008 140551793944568 4400067 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=900220 CPUtime=700.34 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 85166 0 0 0 69949 85 0 0 20 0 3 0 286748415 921825280 188958 33554432000 4194304 5964478 140736351051008 140551783455032 5136404 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1404.19
Current children cumulated vsize (KiB) 900220

[startup+762.307 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20374
/proc/meminfo: memFree=30243028/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=900220 CPUtime=1524.18 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 191481 0 0 0 152269 149 0 0 20 0 3 0 286748414 921825280 192844 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 225055 192844 201 433 0 224619 0
[pid=20301/tid=20302] ppid=20299 vsize=900220 CPUtime=760.24 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 101534 0 0 0 75943 81 0 0 20 0 3 0 286748415 921825280 192844 33554432000 4194304 5964478 140736351051008 140551793944568 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=900220 CPUtime=760.19 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 89041 0 0 0 75929 90 0 0 20 0 3 0 286748415 921825280 192844 33554432000 4194304 5964478 140736351051008 140551783455032 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1524.18
Current children cumulated vsize (KiB) 900220

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/182 20377
/proc/meminfo: memFree=30211604/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=900472 CPUtime=1644.15 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 191531 0 0 0 164266 149 0 0 20 0 3 0 286748414 922083328 192894 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 225118 192894 201 433 0 224682 0
[pid=20301/tid=20302] ppid=20299 vsize=900472 CPUtime=820.08 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 101572 0 0 0 81926 82 0 0 20 0 3 0 286748415 922083328 192894 33554432000 4194304 5964478 140736351051008 140551793944616 4399904 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=900472 CPUtime=820.03 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 89053 0 0 0 81912 91 0 0 20 0 3 0 286748415 922083328 192894 33554432000 4194304 5964478 140736351051008 140551783455032 4400053 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1644.15
Current children cumulated vsize (KiB) 900472

[startup+882.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20377
/proc/meminfo: memFree=30187844/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=900580 CPUtime=1764.12 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 191598 0 0 0 176262 150 0 0 20 0 3 0 286748414 922193920 192942 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 225145 192942 201 433 0 224709 0
[pid=20301/tid=20302] ppid=20299 vsize=900580 CPUtime=879.92 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 101588 0 0 0 87909 83 0 0 20 0 3 0 286748415 922193920 192942 33554432000 4194304 5964478 140736351051008 140551793944616 4400051 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=900580 CPUtime=879.85 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 89104 0 0 0 87893 92 0 0 20 0 3 0 286748415 922193920 192942 33554432000 4194304 5964478 140736351051008 140551783455080 4399953 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1764.12
Current children cumulated vsize (KiB) 900580



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20377
/proc/meminfo: memFree=30185208/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=900652 CPUtime=1800.12 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 191624 0 0 0 179862 150 0 0 20 0 3 0 286748414 922267648 192958 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 225163 192958 201 433 0 224727 0
[pid=20301/tid=20302] ppid=20299 vsize=900652 CPUtime=897.87 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 101611 0 0 0 89704 83 0 0 20 0 3 0 286748415 922267648 192958 33554432000 4194304 5964478 140736351051008 140551793944616 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=900652 CPUtime=897.81 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 89107 0 0 0 89689 92 0 0 20 0 3 0 286748415 922267648 192958 33554432000 4194304 5964478 140736351051008 140551783455080 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 900652

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 20377
/proc/meminfo: memFree=30185208/32873648 swapFree=7116/7116
[pid=20301] ppid=20299 vsize=900652 CPUtime=1800.12 cores=0,2,4,6
/proc/20301/stat : 20301 (pwbo2.01) S 20299 20301 14514 0 -1 4202496 191624 0 0 0 179862 150 0 0 20 0 3 0 286748414 922267648 192958 33554432000 4194304 5964478 140736351051008 140736351050528 4546669 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/20301/statm: 225163 192958 201 433 0 224727 0
[pid=20301/tid=20302] ppid=20299 vsize=900652 CPUtime=897.87 cores=0,2,4,6
/proc/20301/task/20302/stat : 20302 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 101611 0 0 0 89704 83 0 0 20 0 3 0 286748415 922267648 192958 33554432000 4194304 5964478 140736351051008 140551793944616 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=20301/tid=20303] ppid=20299 vsize=900652 CPUtime=897.81 cores=0,2,4,6
/proc/20301/task/20303/stat : 20303 (pwbo2.01) R 20299 20301 14514 0 -1 4202560 89107 0 0 0 89689 92 0 0 20 0 3 0 286748415 922267648 192958 33554432000 4194304 5964478 140736351051008 140551783455080 4399904 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 900652

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20301 and gives
#  childrusage.ru_utime.tv_sec=1793
#  childrusage.ru_utime.tv_usec=961276
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=780729
# CPU time returned by wait4() is 1795.74
# while last known CPU time is 1800.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.325
CPU time (s): 1800.12
CPU user time (s): 1798.62
CPU system time (s): 1.5
CPU usage (%): 199.941
Max. virtual memory (cumulated for all children) (KiB): 900652

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1793.96
system time used= 1.78073
maximum resident set size= 771836
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 191625
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 532
involuntary context switches= 2005

runsolver used 1.87071 second user time and 5.05623 second system time

The end

Launcher Data 

Begin job on node123 at 2012-05-28 13:57:09
IDJOB=3712639
IDBENCH=79440
IDSOLVER=2292
FILE ID=node123/3712639-1338206229
RUNJOBID= node123-1338195143-14530
PBS_JOBID= 14624606
Free space on /tmp= 71676 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/wcsp/coloring/normalized-myciel5g-5_wcsp.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712639-1338206229/watcher-3712639-1338206229 -o /tmp/evaluation-result-3712639-1338206229/solver-3712639-1338206229 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712639-1338206229.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 02dbb62de02783c13bf2d3c63ea9332f
RANDOM SEED=936136928

node123.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.43
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.217
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29824880 kB
Buffers:          314528 kB
Cached:           281828 kB
SwapCached:          956 kB
Active:          1899648 kB
Inactive:         308296 kB
Active(anon):    1605452 kB
Inactive(anon):     8336 kB
Active(file):     294196 kB
Inactive(file):   299960 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67102956 kB
Dirty:              5884 kB
Writeback:             0 kB
AnonPages:       1618136 kB
Mapped:            11056 kB
Shmem:                 0 kB
Slab:             701024 kB
SReclaimable:     144656 kB
SUnreclaim:       556368 kB
KernelStack:        1496 kB
PageTables:         6816 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     169072 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    671744 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71672 MiB
End job on node123 at 2012-05-28 14:12:12