Trace number 3728515

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.02MSAT (TO) 1800.06 900.218

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/
normalized-chnl10_15_pb.cnf.cr--soft-33-100-0.wbo
MD5SUM9dd19a07ee6b8e6f4864d631925ae108
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark21
Best CPU time to get the best result obtained on this benchmark0.126979
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables300
Total number of constraints50
Number of soft constraints35
Number of constraints which are clauses30
Number of constraints which are cardinality constraints (but not clauses)20
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint10
Maximum length of a constraint15
Top cost 1837
Min constraint cost 1
Max constraint cost 98
Sum of constraints costs 1836
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 16
Number of bits of the biggest sum of numbers5
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3728515-1338669486.wbo.
0.00/0.00	c Instance file HOME/instance-3728515-1338669486.wbo
0.00/0.00	c File size is 5389 bytes.
0.00/0.00	c Highest Coefficient sum: 16
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      335                                                 |
0.00/0.00	c |  Number Clauses:        30                                                  |
0.00/0.00	c |  Number Cardinality:    5                                                   |
0.00/0.00	c |  Number PB Constraints: 15                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.06/900.21	o 668
1800.06/900.21	o 21
1800.06/900.21	c ===============================================================================
1800.06/900.21	c Wall Clock Time: 900.21 s
1800.06/900.21	c Best Solution: 21
1800.06/900.21	s SATISFIABLE
1800.06/900.21	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 x8 -x9 -x10 -x11 -x12 -x13 -x14 x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 x47 -x48 -x49 -x50 -x51 -x52 x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 x80 -x81 -x82 -x83 -x84 -x85 x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 x96 -x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 -x145 -x146 -x147 -x148 x149 -x150 -x151 -x152 -x153 -x154 x155 -x156 -x157 -x158 -x159 -x160 -x161 -x162 x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 x179 -x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 x205 -x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 -x226 -x227 -x228 -x229 x230 -x231 -x232 -x233 x234 -x235 -x236 -x237 -x238 -x239 -x240 -x241 x242 -x243 -x244 -x245 -x246 -x247 -x248 -x249 -x250 -x251 -x252 -x253 -x254 x255 -x256 -x257 -x258 -x259 -x260 -x261 -x262 x263 -x264 -x265 -x266 -x267 -x268 -x269 -x270 -x271 x272 -x273 -x274 -x275 -x276 -x277 -x278 -x279 -x280 x281 -x282 -x283 -x284 -x285 -x286 -x287 -x288 -x289 -x290 x291 -x292 -x293 -x294 -x295 -x296 -x297 -x298 -x299 -x300

Verifier Data

OK	21

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3728515-1338669486/watcher-3728515-1338669486 -o /tmp/evaluation-result-3728515-1338669486/solver-3728515-1338669486 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728515-1338669486.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 2.01 1.97 3/175 3938
/proc/meminfo: memFree=28477748/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=163396 CPUtime=0 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 1272 0 0 0 0 0 0 0 20 0 3 0 333072939 167317504 1222 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 40849 1223 204 433 0 40413 0
[pid=3938/tid=3939] ppid=3934 vsize=163396 CPUtime=0 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 62 0 0 0 0 0 0 0 20 0 3 0 333072939 167317504 1229 33554432000 4194304 5964478 140733574282288 139678184974264 4409085 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=163396 CPUtime=0 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 441 0 0 0 0 0 0 0 20 0 3 0 333072939 167317504 1231 33554432000 4194304 5964478 140733574282288 139678174484136 5136490 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.0300019 s]
/proc/loadavg: 2.01 2.01 1.97 3/175 3938
/proc/meminfo: memFree=28477748/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=169308 CPUtime=0.05 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 3731 0 0 0 4 1 0 0 20 0 3 0 333072939 173371392 3668 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 42327 3672 205 433 0 41891 0
[pid=3938/tid=3939] ppid=3934 vsize=169308 CPUtime=0.01 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 126 0 0 0 1 0 0 0 20 0 3 0 333072939 173371392 3674 33554432000 4194304 5964478 140733574282288 139678184974136 4400097 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=169308 CPUtime=0.01 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 2836 0 0 0 0 1 0 0 20 0 3 0 333072939 173371392 3677 33554432000 4194304 5964478 140733574282288 139678174484280 4395266 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 169308

[startup+0.100408 s]
/proc/loadavg: 2.01 2.01 1.97 3/175 3938
/proc/meminfo: memFree=28477748/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=181532 CPUtime=0.18 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 7810 0 0 0 16 2 0 0 20 0 3 0 333072939 185888768 7747 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 45383 7747 206 433 0 44947 0
[pid=3938/tid=3939] ppid=3934 vsize=181532 CPUtime=0.08 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 240 0 0 0 8 0 0 0 20 0 3 0 333072939 185888768 7747 33554432000 4194304 5964478 140733574282288 139678184974376 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=181532 CPUtime=0.08 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 6792 0 0 0 5 3 0 0 20 0 3 0 333072939 185888768 7747 33554432000 4194304 5964478 140733574282288 139678174485096 4392696 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 181532

[startup+0.30036 s]
/proc/loadavg: 2.01 2.01 1.97 3/175 3938
/proc/meminfo: memFree=28477748/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=181532 CPUtime=0.59 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 8174 0 0 0 56 3 0 0 20 0 3 0 333072939 185888768 8111 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 45383 8111 206 433 0 44947 0
[pid=3938/tid=3939] ppid=3934 vsize=181532 CPUtime=0.28 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 423 0 0 0 28 0 0 0 20 0 3 0 333072939 185888768 8111 33554432000 4194304 5964478 140733574282288 139678184974328 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=181532 CPUtime=0.28 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 6973 0 0 0 25 3 0 0 20 0 3 0 333072939 185888768 8111 33554432000 4194304 5964478 140733574282288 139678174484792 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 181532

[startup+0.700282 s]
/proc/loadavg: 2.01 2.01 1.97 3/175 3938
/proc/meminfo: memFree=28477748/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=181532 CPUtime=1.38 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 8657 0 0 0 135 3 0 0 20 0 3 0 333072939 185888768 8594 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 45383 8594 206 433 0 44947 0
[pid=3938/tid=3939] ppid=3934 vsize=181532 CPUtime=0.68 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 649 0 0 0 68 0 0 0 20 0 3 0 333072939 185888768 8594 33554432000 4194304 5964478 140733574282288 139678184974328 4403706 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=181532 CPUtime=0.68 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 7230 0 0 0 65 3 0 0 20 0 3 0 333072939 185888768 8594 33554432000 4194304 5964478 140733574282288 139678174484728 4400106 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 181532

[startup+1.50024 s]
/proc/loadavg: 2.01 2.01 1.97 6/181 3944
/proc/meminfo: memFree=28420132/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=181532 CPUtime=2.98 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 9323 0 0 0 295 3 0 0 20 0 3 0 333072939 185888768 9260 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 45383 9260 206 433 0 44947 0
[pid=3938/tid=3939] ppid=3934 vsize=181532 CPUtime=1.48 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 1031 0 0 0 148 0 0 0 20 0 3 0 333072939 185888768 9260 33554432000 4194304 5964478 140733574282288 139678184974328 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=181532 CPUtime=1.48 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 7514 0 0 0 145 3 0 0 20 0 3 0 333072939 185888768 9260 33554432000 4194304 5964478 140733574282288 139678174484792 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 181532

[startup+3.10027 s]
/proc/loadavg: 2.17 2.04 1.98 6/181 3944
/proc/meminfo: memFree=28402384/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=181676 CPUtime=6.18 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 10180 0 0 0 614 4 0 0 20 0 3 0 333072939 186036224 10413 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 45419 10413 206 433 0 44983 0
[pid=3938/tid=3939] ppid=3934 vsize=181676 CPUtime=3.07 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 1441 0 0 0 307 0 0 0 20 0 3 0 333072939 186036224 10413 33554432000 4194304 5964478 140733574282288 139678184974136 4400103 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=181676 CPUtime=3.07 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 7961 0 0 0 304 3 0 0 20 0 3 0 333072939 186036224 10413 33554432000 4194304 5964478 140733574282288 139678174484600 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 181676

[startup+6.30032 s]
/proc/loadavg: 2.17 2.04 1.98 6/181 3944
/proc/meminfo: memFree=28377212/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=182240 CPUtime=12.57 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 11585 0 0 0 1251 6 0 0 20 0 3 0 333072939 186613760 11818 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 45560 11818 206 433 0 45124 0
[pid=3938/tid=3939] ppid=3934 vsize=182240 CPUtime=6.26 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 1905 0 0 0 625 1 0 0 20 0 3 0 333072939 186613760 11818 33554432000 4194304 5964478 140733574282288 139678184974136 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=182240 CPUtime=6.26 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 8902 0 0 0 621 5 0 0 20 0 3 0 333072939 186613760 11818 33554432000 4194304 5964478 140733574282288 139678174484792 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.57
Current children cumulated vsize (KiB) 182240

[startup+12.7004 s]
/proc/loadavg: 2.45 2.10 2.01 6/181 3944
/proc/meminfo: memFree=28328536/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=184364 CPUtime=25.38 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 13478 0 0 0 2530 8 0 0 20 0 3 0 333072939 188788736 13711 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 46091 13711 206 433 0 45655 0
[pid=3938/tid=3939] ppid=3934 vsize=184364 CPUtime=12.65 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 2663 0 0 0 1264 1 0 0 20 0 3 0 333072939 188788736 13711 33554432000 4194304 5964478 140733574282288 139678184974136 4400056 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=184364 CPUtime=12.65 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 10037 0 0 0 1259 6 0 0 20 0 3 0 333072939 188788736 13711 33554432000 4194304 5964478 140733574282288 139678174484600 4399932 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 184364

[startup+25.5004 s]
/proc/loadavg: 2.69 2.17 2.03 6/181 3944
/proc/meminfo: memFree=28271828/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=185352 CPUtime=50.96 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 15893 0 0 0 5086 10 0 0 20 0 3 0 333072939 189800448 16716 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 46338 16716 206 433 0 45902 0
[pid=3938/tid=3939] ppid=3934 vsize=185352 CPUtime=25.41 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 4382 0 0 0 2539 2 0 0 20 0 3 0 333072939 189800448 16716 33554432000 4194304 5964478 140733574282288 139678184974328 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=185352 CPUtime=25.41 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 10733 0 0 0 2534 7 0 0 20 0 3 0 333072939 189800448 16716 33554432000 4194304 5964478 140733574282288 139678174484600 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.96
Current children cumulated vsize (KiB) 185352

[startup+51.1004 s]
/proc/loadavg: 3.13 2.31 2.08 6/181 3944
/proc/meminfo: memFree=28162508/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=187724 CPUtime=102.16 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 19459 0 0 0 10201 15 0 0 20 0 3 0 333072939 192229376 21988 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 46931 21988 206 433 0 46495 0
[pid=3938/tid=3939] ppid=3934 vsize=187724 CPUtime=50.94 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 6699 0 0 0 5088 6 0 0 20 0 3 0 333072939 192229376 21988 33554432000 4194304 5964478 140733574282288 139678184974376 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=187724 CPUtime=50.94 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 11982 0 0 0 5086 8 0 0 20 0 3 0 333072939 192229376 21988 33554432000 4194304 5964478 140733574282288 139678174484792 4399932 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.16
Current children cumulated vsize (KiB) 187724

[startup+102.307 s]
/proc/loadavg: 3.65 2.59 2.19 6/181 3944
/proc/meminfo: memFree=28024292/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=195760 CPUtime=204.56 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 24007 0 0 0 20437 19 0 0 20 0 3 0 333072939 200458240 26488 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 48940 26488 206 433 0 48504 0
[pid=3938/tid=3939] ppid=3934 vsize=195760 CPUtime=102.02 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 8763 0 0 0 10193 9 0 0 20 0 3 0 333072939 200458240 26488 33554432000 4194304 5964478 140733574282288 139678184974328 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=195760 CPUtime=102.02 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 14466 0 0 0 10191 11 0 0 20 0 3 0 333072939 200458240 26488 33554432000 4194304 5964478 140733574282288 139678174484792 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.56
Current children cumulated vsize (KiB) 195760

[startup+162.3 s]
/proc/loadavg: 3.86 2.83 2.29 6/181 3947
/proc/meminfo: memFree=27833484/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=201520 CPUtime=324.52 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 27976 0 0 0 32428 24 0 0 20 0 3 0 333072939 206356480 30457 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 50380 30457 206 433 0 49944 0
[pid=3938/tid=3939] ppid=3934 vsize=201520 CPUtime=161.85 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 11381 0 0 0 16172 13 0 0 20 0 3 0 333072939 206356480 30457 33554432000 4194304 5964478 140733574282288 139678184974376 4400097 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=201520 CPUtime=161.86 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 15817 0 0 0 16172 14 0 0 20 0 3 0 333072939 206356480 30457 33554432000 4194304 5964478 140733574282288 139678174484600 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.52
Current children cumulated vsize (KiB) 201520

[startup+222.3 s]
/proc/loadavg: 3.95 3.05 2.40 6/181 3948
/proc/meminfo: memFree=27774628/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=206348 CPUtime=444.51 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 31027 0 0 0 44422 29 0 0 20 0 3 0 333072939 211300352 33508 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 51587 33509 206 433 0 51151 0
[pid=3938/tid=3939] ppid=3934 vsize=206348 CPUtime=221.7 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 13226 0 0 0 22153 17 0 0 20 0 3 0 333072939 211300352 33509 33554432000 4194304 5964478 140733574282288 139678184974376 4400538 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=206348 CPUtime=221.71 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 17024 0 0 0 22154 17 0 0 20 0 3 0 333072939 211300352 33509 33554432000 4194304 5964478 140733574282288 139678174484792 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.51
Current children cumulated vsize (KiB) 206348

################
# More data... #
################

[pid=3938/tid=3940] ppid=3934 vsize=208540 CPUtime=281.54 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 17994 0 0 0 28134 20 0 0 20 0 3 0 333072939 213544960 35869 33554432000 4194304 5964478 140733574282288 139678174484792 4400087 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.45
Current children cumulated vsize (KiB) 208540

[startup+342.3 s]
/proc/loadavg: 3.99 3.36 2.59 6/181 3949
/proc/meminfo: memFree=27680092/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=211844 CPUtime=684.43 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 36418 0 0 0 68404 39 0 0 20 0 3 0 333072939 216928256 38933 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 52961 38933 206 433 0 52525 0
[pid=3938/tid=3939] ppid=3934 vsize=211844 CPUtime=341.36 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 16375 0 0 0 34110 26 0 0 20 0 3 0 333072939 216928256 38933 33554432000 4194304 5964478 140733574282288 139678184974328 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=211844 CPUtime=341.39 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 19265 0 0 0 34116 23 0 0 20 0 3 0 333072939 216928256 38933 33554432000 4194304 5964478 140733574282288 139678174484840 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.43
Current children cumulated vsize (KiB) 211844

[startup+402.3 s]
/proc/loadavg: 4.10 3.50 2.68 6/181 3949
/proc/meminfo: memFree=27537272/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=215808 CPUtime=804.41 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 39923 0 0 0 80396 45 0 0 20 0 3 0 333072939 220987392 42433 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 53952 42433 206 433 0 53516 0
[pid=3938/tid=3939] ppid=3934 vsize=215808 CPUtime=401.2 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 18773 0 0 0 40089 31 0 0 20 0 3 0 333072939 220987392 42433 33554432000 4194304 5964478 140733574282288 139678184974328 4400091 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=215808 CPUtime=401.24 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 20372 0 0 0 40098 26 0 0 20 0 3 0 333072939 220987392 42433 33554432000 4194304 5964478 140733574282288 139678174484792 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.41
Current children cumulated vsize (KiB) 215808

[startup+462.3 s]
/proc/loadavg: 4.03 3.59 2.76 6/181 3949
/proc/meminfo: memFree=27530108/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=218144 CPUtime=924.4 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 41661 0 0 0 92391 49 0 0 20 0 3 0 333072939 223379456 44171 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 54536 44171 206 433 0 54100 0
[pid=3938/tid=3939] ppid=3934 vsize=218144 CPUtime=461.05 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 19868 0 0 0 46070 35 0 0 20 0 3 0 333072939 223379456 44171 33554432000 4194304 5964478 140733574282288 139678184974376 4400067 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=218144 CPUtime=461.08 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 21015 0 0 0 46080 28 0 0 20 0 3 0 333072939 223379456 44171 33554432000 4194304 5964478 140733574282288 139678174484792 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.4
Current children cumulated vsize (KiB) 218144

[startup+522.3 s]
/proc/loadavg: 4.01 3.66 2.83 6/181 3949
/proc/meminfo: memFree=27504208/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=286016 CPUtime=1044.38 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 43792 0 0 0 104385 53 0 0 20 0 3 0 333072939 292880384 46302 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 71504 46302 206 433 0 71068 0
[pid=3938/tid=3939] ppid=3934 vsize=286016 CPUtime=520.89 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 21246 0 0 0 52051 38 0 0 20 0 3 0 333072939 292880384 46302 33554432000 4194304 5964478 140733574282288 139678184974328 4400091 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=286016 CPUtime=520.93 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 21768 0 0 0 52064 29 0 0 20 0 3 0 333072939 292880384 46302 33554432000 4194304 5964478 140733574282288 139678174484792 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.38
Current children cumulated vsize (KiB) 286016

[startup+582.3 s]
/proc/loadavg: 4.00 3.72 2.91 6/181 3949
/proc/meminfo: memFree=27365204/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=287072 CPUtime=1164.37 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 45368 0 0 0 116380 57 0 0 20 0 3 0 333072939 293961728 47878 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 71768 47878 206 433 0 71332 0
[pid=3938/tid=3939] ppid=3934 vsize=287072 CPUtime=580.73 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 21970 0 0 0 58033 40 0 0 20 0 3 0 333072939 293961728 47878 33554432000 4194304 5964478 140733574282288 139678184974376 4400089 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=287072 CPUtime=580.78 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 22620 0 0 0 58046 32 0 0 20 0 3 0 333072939 293961728 47878 33554432000 4194304 5964478 140733574282288 139678174484840 4400795 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.37
Current children cumulated vsize (KiB) 287072

[startup+642.3 s]
/proc/loadavg: 4.00 3.77 2.97 6/181 3950
/proc/meminfo: memFree=27350696/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=290452 CPUtime=1284.36 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 46529 0 0 0 128377 59 0 0 20 0 3 0 333072939 297422848 49039 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 72613 49039 206 433 0 72177 0
[pid=3938/tid=3939] ppid=3934 vsize=290452 CPUtime=640.58 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 22170 0 0 0 64016 42 0 0 20 0 3 0 333072939 297422848 49039 33554432000 4194304 5964478 140733574282288 139678184974136 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=290452 CPUtime=640.63 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 23581 0 0 0 64029 34 0 0 20 0 3 0 333072939 297422848 49039 33554432000 4194304 5964478 140733574282288 139678174484792 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.36
Current children cumulated vsize (KiB) 290452

[startup+702.3 s]
/proc/loadavg: 4.00 3.81 3.03 6/181 3950
/proc/meminfo: memFree=27241744/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=292204 CPUtime=1404.32 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 48373 0 0 0 140369 63 0 0 20 0 3 0 333072939 299216896 50895 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 73051 50895 206 433 0 72615 0
[pid=3938/tid=3939] ppid=3934 vsize=292204 CPUtime=700.41 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 23614 0 0 0 69995 46 0 0 20 0 3 0 333072939 299216896 50895 33554432000 4194304 5964478 140733574282288 139678184974328 4400097 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=292204 CPUtime=700.47 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 23981 0 0 0 70011 36 0 0 20 0 3 0 333072939 299216896 50895 33554432000 4194304 5964478 140733574282288 139678174484792 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.32
Current children cumulated vsize (KiB) 292204

[startup+762.307 s]
/proc/loadavg: 4.00 3.84 3.09 6/182 3953
/proc/meminfo: memFree=27147652/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=292888 CPUtime=1524.3 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 49884 0 0 0 152364 66 0 0 20 0 3 0 333072939 299917312 52410 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 73222 52410 206 433 0 72786 0
[pid=3938/tid=3939] ppid=3934 vsize=292888 CPUtime=760.25 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 24728 0 0 0 75975 50 0 0 20 0 3 0 333072939 299917312 52410 33554432000 4194304 5964478 140733574282288 139678184974328 4400087 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=292888 CPUtime=760.32 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 24378 0 0 0 75994 38 0 0 20 0 3 0 333072939 299917312 52410 33554432000 4194304 5964478 140733574282288 139678174484792 4400432 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.3
Current children cumulated vsize (KiB) 292888

[startup+822.3 s]
/proc/loadavg: 4.00 3.86 3.14 6/181 3953
/proc/meminfo: memFree=27059304/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=359592 CPUtime=1644.26 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 51264 0 0 0 164358 68 0 0 20 0 3 0 333072939 368222208 53785 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 89898 53785 206 433 0 89462 0
[pid=3938/tid=3939] ppid=3934 vsize=359592 CPUtime=820.09 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 25579 0 0 0 81957 52 0 0 20 0 3 0 333072939 368222208 53785 33554432000 4194304 5964478 140733574282288 139678184974376 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=359592 CPUtime=820.16 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 24907 0 0 0 81977 39 0 0 20 0 3 0 333072939 368222208 53785 33554432000 4194304 5964478 140733574282288 139678174484840 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.26
Current children cumulated vsize (KiB) 359592

[startup+882.3 s]
/proc/loadavg: 4.00 3.89 3.20 6/181 3953
/proc/meminfo: memFree=27023992/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=361352 CPUtime=1764.24 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 52073 0 0 0 176355 69 0 0 20 0 3 0 333072939 370024448 54594 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 90338 54594 206 433 0 89902 0
[pid=3938/tid=3939] ppid=3934 vsize=361352 CPUtime=879.93 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 25883 0 0 0 87939 54 0 0 20 0 3 0 333072939 370024448 54594 33554432000 4194304 5964478 140733574282288 139678184974376 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=361352 CPUtime=880 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 25412 0 0 0 87959 41 0 0 20 0 3 0 333072939 370024448 54594 33554432000 4194304 5964478 140733574282288 139678174484792 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.24
Current children cumulated vsize (KiB) 361352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.2 s]
/proc/loadavg: 4.00 3.89 3.21 5/180 3953
/proc/meminfo: memFree=27020248/32873844 swapFree=7632/7632
[pid=3938] ppid=3934 vsize=362584 CPUtime=1800.06 cores=1,3,5,7
/proc/3938/stat : 3938 (pwbo2.02) S 3934 3938 3617 0 -1 4202496 52923 0 0 0 179934 72 0 0 20 0 3 0 333072939 371286016 55444 33554432000 4194304 5964478 140733574282288 140733574281808 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/3938/statm: 90646 55444 206 433 0 90210 0
[pid=3938/tid=3939] ppid=3934 vsize=362584 CPUtime=897.79 cores=1,3,5,7
/proc/3938/task/3939/stat : 3939 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 26608 0 0 0 89723 56 0 0 20 0 3 0 333072939 371286016 55444 33554432000 4194304 5964478 140733574282288 139678184974328 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=3938/tid=3940] ppid=3934 vsize=362584 CPUtime=897.86 cores=1,3,5,7
/proc/3938/task/3940/stat : 3940 (pwbo2.02) R 3934 3938 3617 0 -1 4202560 25537 0 0 0 89745 41 0 0 20 0 3 0 333072939 371286016 55444 33554432000 4194304 5964478 140733574282288 139678174484792 4400056 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 362584

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 3938 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=698164
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=847
# CPU time returned by wait4() is 1795.7
# while last known CPU time is 1800.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 900.218
CPU time (s): 1800.06
CPU user time (s): 1799.34
CPU system time (s): 0.72
CPU usage (%): 199.958
Max. virtual memory (cumulated for all children) (KiB): 362584

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.7
system time used= 1.00085
maximum resident set size= 221780
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 52924
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 231
involuntary context switches= 1942

runsolver used 2.14167 second user time and 5.05523 second system time

The end

Launcher Data

Begin job on node141 at 2012-06-02 22:38:06
IDJOB=3728515
IDBENCH=78665
IDSOLVER=2316
FILE ID=node141/3728515-1338669486
RUNJOBID= node141-1338669486-3912
PBS_JOBID= 14636518
Free space on /tmp= 70720 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/normalized-chnl10_15_pb.cnf.cr--soft-33-100-0.wbo
COMMAND LINE= pwbo2.02 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3728515-1338669486/watcher-3728515-1338669486 -o /tmp/evaluation-result-3728515-1338669486/solver-3728515-1338669486 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=wbo -verbosity=0 HOME/instance-3728515-1338669486.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9dd19a07ee6b8e6f4864d631925ae108
RANDOM SEED=1606742943

node141.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28478756 kB
Buffers:          382848 kB
Cached:          3120196 kB
SwapCached:          216 kB
Active:          1214140 kB
Inactive:        2299956 kB
Active(anon):       1932 kB
Inactive(anon):    11300 kB
Active(file):    1212208 kB
Inactive(file):  2288656 kB
Unevictable:        7632 kB
Mlocked:            7632 kB
SwapTotal:      67108856 kB
SwapFree:       67108640 kB
Dirty:             10856 kB
Writeback:            16 kB
AnonPages:        118376 kB
Mapped:             9956 kB
Shmem:               172 kB
Slab:             738904 kB
SReclaimable:     181012 kB
SUnreclaim:       557892 kB
KernelStack:        1416 kB
PageTables:         3580 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     105540 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    100352 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70712 MiB
End job on node141 at 2012-06-02 22:53:08