Trace number 3712429

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pwbo 2.01MSAT (TO) 1800.34 900.218

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/
normalized-chnl10_11_pb.cnf.cr--soft-33-100-0.wbo
MD5SUM0b915fd051dbce2f3b4ec1d342cdefca
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark0.116981
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables220
Total number of constraints42
Number of soft constraints30
Number of constraints which are clauses22
Number of constraints which are cardinality constraints (but not clauses)20
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint10
Maximum length of a constraint11
Top cost 1595
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 1594
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 12
Number of bits of the biggest sum of numbers4
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.01 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing wbo file format. File HOME/instance-3712429-1338189614.wbo.
0.00/0.00	c Instance file HOME/instance-3712429-1338189614.wbo
0.00/0.00	c File size is 4029 bytes.
0.00/0.00	c Highest Coefficient sum: 12
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      250                                                 |
0.00/0.00	c |  Number Clauses:        22                                                  |
0.00/0.00	c |  Number Cardinality:    4                                                   |
0.00/0.00	c |  Number PB Constraints: 16                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.06/900.21	o 96
1800.06/900.21	o 84
1800.06/900.21	o 55
1800.06/900.21	o 24
1800.06/900.21	o 19
1800.06/900.21	o 3
1800.06/900.21	c ===============================================================================
1800.06/900.21	c Wall Clock Time: 900.21 s
1800.06/900.21	c Best Solution: 3
1800.06/900.21	s SATISFIABLE
1800.06/900.21	v -x1 -x2 -x3 -x4 -x5 x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 x27 -x28 -x29 -x30 x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 x50 -x51 x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 x97 -x98 -x99 -x100 -x101 -x102 -x103 -x104 -x105 -x106 -x107 -x108 x109 -x110 -x111 -x112 -x113 x114 -x115 -x116 -x117 -x118 -x119 -x120 -x121 -x122 -x123 -x124 x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 -x133 x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 -x144 x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 x157 -x158 -x159 -x160 -x161 -x162 x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 x175 -x176 -x177 -x178 -x179 -x180 x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 -x197 -x198 -x199 x200 -x201 -x202 -x203 -x204 -x205 x206 -x207 -x208 -x209 -x210 -x211 -x212 -x213 -x214 x215 -x216 -x217 -x218 -x219 -x220

Verifier Data 

OK	3

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3712429-1338189614/watcher-3712429-1338189614 -o /tmp/evaluation-result-3712429-1338189614/solver-3712429-1338189614 -C 1800 -W 1900 -M 15500 pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712429-1338189614.wbo 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 3.97 3.92 4/179 27194
/proc/meminfo: memFree=30983332/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=163272 CPUtime=0 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 1276 0 0 0 0 0 0 0 20 0 3 0 285087283 167190528 1215 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 40818 1216 205 433 0 40382 0
[pid=27194/tid=27195] ppid=27192 vsize=163272 CPUtime=0 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 60 0 0 0 0 0 0 0 20 0 3 0 285087284 167190528 1218 33554432000 4194304 5964478 140736316421488 140304325515304 4388330 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=163656 CPUtime=0 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 459 0 0 0 0 0 0 0 20 0 3 0 285087284 167583744 1223 33554432000 4194304 5964478 140736316421488 140304315025064 5179243 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0

[startup+0.105307 s]
/proc/loadavg: 4.00 3.97 3.92 4/179 27194
/proc/meminfo: memFree=30983332/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=175724 CPUtime=0.2 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 6885 0 0 0 18 2 0 0 20 0 3 0 285087283 179941376 6823 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 43931 6823 207 433 0 43495 0
[pid=27194/tid=27195] ppid=27192 vsize=175724 CPUtime=0.09 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 301 0 0 0 9 0 0 0 20 0 3 0 285087284 179941376 6823 33554432000 4194304 5964478 140736316421488 140304325515304 5136404 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=175724 CPUtime=0.09 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 5818 0 0 0 6 3 0 0 20 0 3 0 285087284 179941376 6823 33554432000 4194304 5964478 140736316421488 140304315025160 4388229 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.2
Current children cumulated vsize (KiB) 175724

[startup+0.20038 s]
/proc/loadavg: 4.00 3.97 3.92 4/179 27194
/proc/meminfo: memFree=30983332/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=175724 CPUtime=0.39 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 7084 0 0 0 37 2 0 0 20 0 3 0 285087283 179941376 7022 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 43931 7022 207 433 0 43495 0
[pid=27194/tid=27195] ppid=27192 vsize=175724 CPUtime=0.18 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 409 0 0 0 18 0 0 0 20 0 3 0 285087284 179941376 7022 33554432000 4194304 5964478 140736316421488 140304325515304 4400071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=175724 CPUtime=0.19 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 5909 0 0 0 16 3 0 0 20 0 3 0 285087284 179941376 7022 33554432000 4194304 5964478 140736316421488 140304315025160 4403327 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.39
Current children cumulated vsize (KiB) 175724

[startup+0.300402 s]
/proc/loadavg: 4.00 3.97 3.92 4/179 27194
/proc/meminfo: memFree=30983332/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=175724 CPUtime=0.58 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 7256 0 0 0 56 2 0 0 20 0 3 0 285087283 179941376 7194 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 43931 7194 207 433 0 43495 0
[pid=27194/tid=27195] ppid=27192 vsize=175724 CPUtime=0.28 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 477 0 0 0 28 0 0 0 20 0 3 0 285087284 179941376 7194 33554432000 4194304 5964478 140736316421488 140304325515256 4400073 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=175724 CPUtime=0.29 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 6013 0 0 0 26 3 0 0 20 0 3 0 285087284 179941376 7194 33554432000 4194304 5964478 140736316421488 140304315025528 4400099 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 175724

[startup+0.700249 s]
/proc/loadavg: 4.00 3.97 3.92 4/179 27194
/proc/meminfo: memFree=30983332/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=175724 CPUtime=1.38 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 8009 0 0 0 136 2 0 0 20 0 3 0 285087283 179941376 7947 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 43931 7947 207 433 0 43495 0
[pid=27194/tid=27195] ppid=27192 vsize=175724 CPUtime=0.68 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 857 0 0 0 68 0 0 0 20 0 3 0 285087284 179941376 7947 33554432000 4194304 5964478 140736316421488 140304325515064 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=175724 CPUtime=0.69 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 6386 0 0 0 66 3 0 0 20 0 3 0 285087284 179941376 7947 33554432000 4194304 5964478 140736316421488 140304315025528 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 175724

[startup+1.50025 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30936552/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=175724 CPUtime=2.98 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 8893 0 0 0 295 3 0 0 20 0 3 0 285087283 179941376 8831 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 43931 8831 207 433 0 43495 0
[pid=27194/tid=27195] ppid=27192 vsize=175724 CPUtime=1.48 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 1316 0 0 0 148 0 0 0 20 0 3 0 285087284 179941376 8831 33554432000 4194304 5964478 140736316421488 140304325515256 4388189 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=175724 CPUtime=1.48 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 6811 0 0 0 145 3 0 0 20 0 3 0 285087284 179941376 8831 33554432000 4194304 5964478 140736316421488 140304315025720 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 175724

[startup+3.10018 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30927376/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=176012 CPUtime=6.18 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 9722 0 0 0 615 3 0 0 20 0 3 0 285087283 180236288 9660 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 44003 9660 207 433 0 43567 0
[pid=27194/tid=27195] ppid=27192 vsize=176012 CPUtime=3.08 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 1655 0 0 0 308 0 0 0 20 0 3 0 285087284 180236288 9660 33554432000 4194304 5964478 140736316421488 140304325515064 5179243 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=176012 CPUtime=3.08 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 7301 0 0 0 305 3 0 0 20 0 3 0 285087284 180236288 9660 33554432000 4194304 5964478 140736316421488 140304315025528 4221120 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 176012

[startup+6.30022 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30912304/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=176400 CPUtime=12.58 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 10779 0 0 0 1254 4 0 0 20 0 3 0 285087283 180633600 10717 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 44100 10717 207 433 0 43664 0
[pid=27194/tid=27195] ppid=27192 vsize=176400 CPUtime=6.28 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 2130 0 0 0 627 1 0 0 20 0 3 0 285087284 180633600 10717 33554432000 4194304 5964478 140736316421488 140304325515064 4400081 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=176400 CPUtime=6.28 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 7883 0 0 0 625 3 0 0 20 0 3 0 285087284 180633600 10717 33554432000 4194304 5964478 140736316421488 140304315025720 4400060 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 176400

[startup+12.7002 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30894704/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=177936 CPUtime=25.38 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 12979 0 0 0 2533 5 0 0 20 0 3 0 285087283 182206464 12905 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 44484 12905 207 433 0 44048 0
[pid=27194/tid=27195] ppid=27192 vsize=177936 CPUtime=12.69 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 2737 0 0 0 1267 2 0 0 20 0 3 0 285087284 182206464 12905 33554432000 4194304 5964478 140736316421488 140304325515064 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=177936 CPUtime=12.68 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 9476 0 0 0 1264 4 0 0 20 0 3 0 285087284 182206464 12905 33554432000 4194304 5964478 140736316421488 140304315025528 5136404 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 177936

[startup+25.5004 s]
/proc/loadavg: 4.00 3.97 3.92 5/182 27197
/proc/meminfo: memFree=30864232/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=181616 CPUtime=50.98 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 16329 0 0 0 5091 7 0 0 20 0 3 0 285087283 185974784 16250 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 45404 16250 207 433 0 44968 0
[pid=27194/tid=27195] ppid=27192 vsize=181616 CPUtime=25.48 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 4090 0 0 0 2545 3 0 0 20 0 3 0 285087284 185974784 16250 33554432000 4194304 5964478 140736316421488 140304325515256 4400075 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=181616 CPUtime=25.48 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 11473 0 0 0 2543 5 0 0 20 0 3 0 285087284 185974784 16250 33554432000 4194304 5964478 140736316421488 140304315025768 4399904 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 50.98
Current children cumulated vsize (KiB) 181616

[startup+51.1004 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30825324/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=185524 CPUtime=102.17 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 21093 0 0 0 10206 11 0 0 20 0 3 0 285087283 189976576 20998 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 46381 20998 207 433 0 45945 0
[pid=27194/tid=27195] ppid=27192 vsize=185524 CPUtime=51.08 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 5843 0 0 0 5103 5 0 0 20 0 3 0 285087284 189976576 20998 33554432000 4194304 5964478 140736316421488 140304325515064 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=185524 CPUtime=51.08 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 14484 0 0 0 5101 7 0 0 20 0 3 0 285087284 189976576 20998 33554432000 4194304 5964478 140736316421488 140304315025528 4400062 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 102.17
Current children cumulated vsize (KiB) 185524

[startup+102.3 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30741452/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=194192 CPUtime=204.55 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 27617 0 0 0 20438 17 0 0 20 0 3 0 285087283 198852608 27628 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 48548 27628 207 433 0 48112 0
[pid=27194/tid=27195] ppid=27192 vsize=194192 CPUtime=102.28 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 8967 0 0 0 10218 10 0 0 20 0 3 0 285087284 198852608 27628 33554432000 4194304 5964478 140736316421488 140304325515304 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=194192 CPUtime=102.28 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 17884 0 0 0 10218 10 0 0 20 0 3 0 285087284 198852608 27628 33554432000 4194304 5964478 140736316421488 140304315025720 4400075 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 204.55
Current children cumulated vsize (KiB) 194192

[startup+162.3 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30682132/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=201052 CPUtime=324.5 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 33590 0 0 0 32425 25 0 0 20 0 3 0 285087283 205877248 35509 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 50263 35509 207 433 0 49827 0
[pid=27194/tid=27195] ppid=27192 vsize=201052 CPUtime=162.26 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 11644 0 0 0 16210 16 0 0 20 0 3 0 285087284 205877248 35509 33554432000 4194304 5964478 140736316421488 140304325515256 4400416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=201052 CPUtime=162.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21180 0 0 0 16211 14 0 0 20 0 3 0 285087284 205877248 35509 33554432000 4194304 5964478 140736316421488 140304315025720 4400071 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.5
Current children cumulated vsize (KiB) 201052

[startup+222.307 s]
/proc/loadavg: 4.00 3.97 3.92 5/181 27197
/proc/meminfo: memFree=30646160/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=208688 CPUtime=444.49 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 37313 0 0 0 44419 30 0 0 20 0 3 0 285087283 213696512 39232 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 52172 39232 207 433 0 51736 0
[pid=27194/tid=27195] ppid=27192 vsize=208688 CPUtime=222.27 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 13151 0 0 0 22207 20 0 0 20 0 3 0 285087284 213696512 39232 33554432000 4194304 5964478 140736316421488 140304325515064 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=208688 CPUtime=222.26 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 23396 0 0 0 22208 18 0 0 20 0 3 0 285087284 213696512 39232 33554432000 4194304 5964478 140736316421488 140304315025528 4400051 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.49
Current children cumulated vsize (KiB) 208688

################
# More data... #
################

/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 15305 0 0 0 28198 28 0 0 20 0 3 0 285087284 283852800 42822 33554432000 4194304 5964478 140736316421488 140304325515064 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=277200 CPUtime=282.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 24832 0 0 0 28205 20 0 0 20 0 3 0 285087284 283852800 42822 33554432000 4194304 5964478 140736316421488 140304315025720 4400768 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.46
Current children cumulated vsize (KiB) 277200

[startup+342.3 s]
/proc/loadavg: 4.02 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30544920/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=280572 CPUtime=684.43 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 44755 0 0 0 68395 48 0 0 20 0 3 0 285087283 287305728 46703 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 70143 46703 207 433 0 69707 0
[pid=27194/tid=27195] ppid=27192 vsize=280572 CPUtime=342.25 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 18145 0 0 0 34189 36 0 0 20 0 3 0 285087284 287305728 46703 33554432000 4194304 5964478 140736316421488 140304325515064 4399953 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=280572 CPUtime=342.26 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 25844 0 0 0 34203 23 0 0 20 0 3 0 285087284 287305728 46703 33554432000 4194304 5964478 140736316421488 140304315025768 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.43
Current children cumulated vsize (KiB) 280572

[startup+402.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30487548/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=288532 CPUtime=804.41 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 48102 0 0 0 80389 52 0 0 20 0 3 0 285087283 295456768 50055 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 72133 50055 207 433 0 71697 0
[pid=27194/tid=27195] ppid=27192 vsize=288532 CPUtime=402.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 18978 0 0 0 40184 40 0 0 20 0 3 0 285087284 295456768 50055 33554432000 4194304 5964478 140736316421488 140304325515256 4400073 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=288532 CPUtime=402.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 28358 0 0 0 40199 26 0 0 20 0 3 0 285087284 295456768 50055 33554432000 4194304 5964478 140736316421488 140304315025720 4399922 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.41
Current children cumulated vsize (KiB) 288532

[startup+462.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30414644/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=358124 CPUtime=924.4 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 50768 0 0 0 92383 57 0 0 20 0 3 0 285087283 366718976 52721 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89531 52721 207 433 0 89095 0
[pid=27194/tid=27195] ppid=27192 vsize=358124 CPUtime=462.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 20606 0 0 0 46180 44 0 0 20 0 3 0 285087284 366718976 52721 33554432000 4194304 5964478 140736316421488 140304325515064 4399994 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=358124 CPUtime=462.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 29396 0 0 0 46197 28 0 0 20 0 3 0 285087284 366718976 52721 33554432000 4194304 5964478 140736316421488 140304315025720 4399896 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.4
Current children cumulated vsize (KiB) 358124

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27198
/proc/meminfo: memFree=30377524/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=364344 CPUtime=1044.37 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 53664 0 0 0 104376 61 0 0 20 0 3 0 285087283 373088256 55617 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 91086 55617 207 433 0 90650 0
[pid=27194/tid=27195] ppid=27192 vsize=364344 CPUtime=522.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21419 0 0 0 52178 46 0 0 20 0 3 0 285087284 373088256 55617 33554432000 4194304 5964478 140736316421488 140304325515256 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=364344 CPUtime=522.26 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 31479 0 0 0 52195 31 0 0 20 0 3 0 285087284 373088256 55617 33554432000 4194304 5964478 140736316421488 140304315025768 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.37
Current children cumulated vsize (KiB) 364344

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27199
/proc/meminfo: memFree=30367976/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=348516 CPUtime=1164.36 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 56358 0 0 0 116371 65 0 0 20 0 3 0 285087283 356880384 54422 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 87129 54422 209 433 0 86693 0
[pid=27194/tid=27195] ppid=27192 vsize=348516 CPUtime=582.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21681 0 0 0 58176 48 0 0 20 0 3 0 285087284 356880384 54422 33554432000 4194304 5964478 140736316421488 140304325516216 4400075 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=348516 CPUtime=582.26 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 33911 0 0 0 58192 34 0 0 20 0 3 0 285087284 356880384 54422 33554432000 4194304 5964478 140736316421488 140304315025768 4400053 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.36
Current children cumulated vsize (KiB) 348516

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/182 27202
/proc/meminfo: memFree=30321052/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=352148 CPUtime=1284.32 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 59362 0 0 0 128365 67 0 0 20 0 3 0 285087283 360599552 57538 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 88037 57538 209 433 0 87601 0
[pid=27194/tid=27195] ppid=27192 vsize=352148 CPUtime=642.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 64175 49 0 0 20 0 3 0 285087284 360599552 57538 33554432000 4194304 5964478 140736316421488 140304325516216 4400075 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=352148 CPUtime=642.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 36913 0 0 0 64187 38 0 0 20 0 3 0 285087284 360599552 57538 33554432000 4194304 5964478 140736316421488 140304315025720 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.32
Current children cumulated vsize (KiB) 352148

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27202
/proc/meminfo: memFree=30282380/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=356364 CPUtime=1404.31 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 62277 0 0 0 140361 70 0 0 20 0 3 0 285087283 364916736 60446 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89091 60446 209 433 0 88655 0
[pid=27194/tid=27195] ppid=27192 vsize=356364 CPUtime=702.23 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 70173 50 0 0 20 0 3 0 285087284 364916736 60446 33554432000 4194304 5964478 140736316421488 140304325516216 4400062 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=356364 CPUtime=702.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 39828 0 0 0 70183 42 0 0 20 0 3 0 285087284 364916736 60446 33554432000 4194304 5964478 140736316421488 140304315025768 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.31
Current children cumulated vsize (KiB) 356364

[startup+762.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/181 27202
/proc/meminfo: memFree=30251936/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=356764 CPUtime=1524.31 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 63203 0 0 0 152360 71 0 0 20 0 3 0 285087283 365326336 61372 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89191 61372 209 433 0 88755 0
[pid=27194/tid=27195] ppid=27192 vsize=356764 CPUtime=762.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 76173 51 0 0 20 0 3 0 285087284 365326336 61372 33554432000 4194304 5964478 140736316421488 140304325516216 4400768 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=356764 CPUtime=762.26 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 40754 0 0 0 76183 43 0 0 20 0 3 0 285087284 365326336 61372 33554432000 4194304 5964478 140736316421488 140304315025720 4400406 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.31
Current children cumulated vsize (KiB) 356764

[startup+822.3 s]
/proc/loadavg: 4.00 3.99 3.93 5/182 27203
/proc/meminfo: memFree=30222204/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=357192 CPUtime=1644.27 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 64097 0 0 0 164355 72 0 0 20 0 3 0 285087283 365764608 62266 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89298 62266 209 433 0 88862 0
[pid=27194/tid=27195] ppid=27192 vsize=357192 CPUtime=822.23 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 82171 52 0 0 20 0 3 0 285087284 365764608 62266 33554432000 4194304 5964478 140736316421488 140304325516216 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=357192 CPUtime=822.25 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 41648 0 0 0 82180 45 0 0 20 0 3 0 285087284 365764608 62266 33554432000 4194304 5964478 140736316421488 140304315025720 4400099 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.27
Current children cumulated vsize (KiB) 357192

[startup+882.307 s]
/proc/loadavg: 4.06 4.00 3.93 5/181 27204
/proc/meminfo: memFree=30201436/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=357540 CPUtime=1764.26 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 65074 0 0 0 176353 73 0 0 20 0 3 0 285087283 366120960 63242 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89385 63242 209 433 0 88949 0
[pid=27194/tid=27195] ppid=27192 vsize=357540 CPUtime=882.24 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 88171 53 0 0 20 0 3 0 285087284 366120960 63242 33554432000 4194304 5964478 140736316421488 140304325516216 4399904 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=357540 CPUtime=882.26 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 42625 0 0 0 88178 48 0 0 20 0 3 0 285087284 366120960 63242 33554432000 4194304 5964478 140736316421488 140304315025720 4399904 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.26
Current children cumulated vsize (KiB) 357540



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.2 s]
/proc/loadavg: 4.04 4.00 3.93 4/181 27205
/proc/meminfo: memFree=30563384/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=357812 CPUtime=1800.06 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 65319 0 0 0 179932 74 0 0 20 0 3 0 285087283 366399488 63487 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89453 63487 209 433 0 89017 0
[pid=27194/tid=27195] ppid=27192 vsize=357812 CPUtime=900.14 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 89961 53 0 0 20 0 3 0 285087284 366399488 63487 33554432000 4194304 5964478 140736316421488 140304325516216 4400067 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=357812 CPUtime=900.16 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 42870 0 0 0 89968 48 0 0 20 0 3 0 285087284 366399488 63487 33554432000 4194304 5964478 140736316421488 140304315025720 4400073 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 357812

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.2 s]
/proc/loadavg: 4.04 4.00 3.93 4/181 27205
/proc/meminfo: memFree=30563384/32873648 swapFree=7112/7112
[pid=27194] ppid=27192 vsize=357812 CPUtime=1800.06 cores=1,3,5,7
/proc/27194/stat : 27194 (pwbo2.01) S 27192 27194 26380 0 -1 4202496 65319 0 0 0 179932 74 0 0 20 0 3 0 285087283 366399488 63487 33554432000 4194304 5964478 140736316421488 140736316421008 4546669 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/27194/statm: 89453 63487 209 433 0 89017 0
[pid=27194/tid=27195] ppid=27192 vsize=357812 CPUtime=900.14 cores=1,3,5,7
/proc/27194/task/27195/stat : 27195 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 21683 0 0 0 89961 53 0 0 20 0 3 0 285087284 366399488 63487 33554432000 4194304 5964478 140736316421488 140304325516216 4400067 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27194/tid=27196] ppid=27192 vsize=357812 CPUtime=900.16 cores=1,3,5,7
/proc/27194/task/27196/stat : 27196 (pwbo2.01) R 27192 27194 26380 0 -1 4202560 42870 0 0 0 89968 48 0 0 20 0 3 0 285087284 366399488 63487 33554432000 4194304 5964478 140736316421488 140304315025720 4400073 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 357812

Child status: 0
Real time (s): 900.218
CPU time (s): 1800.34
CPU user time (s): 1799.3
CPU system time (s): 1.04084
CPU usage (%): 199.989
Max. virtual memory (cumulated for all children) (KiB): 364612

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.3
system time used= 1.04084
maximum resident set size= 253956
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 65321
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 194
involuntary context switches= 2123

runsolver used 1.70174 second user time and 5.54316 second system time

The end

Launcher Data 

Begin job on node126 at 2012-05-28 09:20:14
IDJOB=3712429
IDBENCH=78690
IDSOLVER=2292
FILE ID=node126/3712429-1338189614
RUNJOBID= node126-1338182394-26397
PBS_JOBID= 14624566
Free space on /tmp= 71356 MiB

SOLVER NAME= pwbo 2.01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB05/aloul/FPGA_SAT05/normalized-chnl10_11_pb.cnf.cr--soft-33-100-0.wbo
COMMAND LINE= pwbo2.01 -file-format=wbo -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3712429-1338189614/watcher-3712429-1338189614 -o /tmp/evaluation-result-3712429-1338189614/solver-3712429-1338189614 -C 1800 -W 1900 -M 15500  pwbo2.01 -file-format=wbo -verbosity=0 HOME/instance-3712429-1338189614.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0b915fd051dbce2f3b4ec1d342cdefca
RANDOM SEED=759869211

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30989920 kB
Buffers:          333428 kB
Cached:           681152 kB
SwapCached:        17756 kB
Active:           805044 kB
Inactive:         270888 kB
Active(anon):      43152 kB
Inactive(anon):    20452 kB
Active(file):     761892 kB
Inactive(file):   250436 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67086932 kB
Dirty:             11100 kB
Writeback:             0 kB
AnonPages:         52056 kB
Mapped:            10168 kB
Shmem:                 0 kB
Slab:             669800 kB
SReclaimable:     113960 kB
SUnreclaim:       555840 kB
KernelStack:        1440 kB
PageTables:         3784 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     177384 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71348 MiB
End job on node126 at 2012-05-28 09:35:16