Trace number 3726054

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02SAT (TO)7 1800.48 900.32

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_5_40_1.opb
MD5SUM5bf563c7058af01702ea80887f1d43ad
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark1789.91
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1
Optimality of the best value was proved NO
Number of variables120
Total number of constraints10
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints10
Minimum length of a constraint55
Maximum length of a constraint56
Number of terms in the objective function 80
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 2550
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1086
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 3768
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3726054-1338656836.opb.
0.00/0.00	c Instance file HOME/instance-3726054-1338656836.opb
0.00/0.00	c File size is 5459 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 3768
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      120                                                 |
0.00/0.00	c |  Number Clauses:        0                                                   |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 10                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.16/900.31	o 1090
1800.16/900.31	o 1039
1800.16/900.31	o 952
1800.16/900.31	o 536
1800.16/900.31	o 494
1800.16/900.31	o 485
1800.16/900.31	o 377
1800.16/900.31	o 340
1800.16/900.31	o 320
1800.16/900.31	o 312
1800.16/900.31	o 279
1800.16/900.31	o 274
1800.16/900.31	o 262
1800.16/900.31	o 195
1800.16/900.31	o 193
1800.16/900.31	o 184
1800.16/900.31	o 182
1800.16/900.31	o 178
1800.16/900.31	o 160
1800.16/900.31	o 153
1800.16/900.31	o 148
1800.16/900.31	o 146
1800.16/900.31	o 122
1800.16/900.31	o 120
1800.16/900.31	o 115
1800.16/900.31	o 105
1800.16/900.31	o 93
1800.16/900.31	o 89
1800.16/900.31	o 83
1800.16/900.31	o 81
1800.16/900.31	o 62
1800.16/900.31	o 60
1800.16/900.31	o 48
1800.16/900.31	o 45
1800.16/900.31	o 41
1800.16/900.31	o 30
1800.16/900.31	o 28
1800.16/900.31	o 27
1800.16/900.31	o 22
1800.16/900.31	o 21
1800.16/900.31	o 13
1800.16/900.31	o 12
1800.16/900.31	o 10
1800.16/900.31	o 8
1800.16/900.31	o 7
1800.16/900.31	c ===============================================================================
1800.16/900.31	c Wall Clock Time: 900.31 s
1800.16/900.31	c Best Solution: 7
1800.16/900.31	s SATISFIABLE
1800.16/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 x26 -x27 -x28 -x29 -x30 -x31 -x32 x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 x65 x66 -x67 -x68 -x69 -x70 -x71 -x72 -x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 x81 x82 x83 -x84 -x85 -x86 -x87 -x88 x89 -x91 -x92 -x93 -x94 x95 x96 -x97 -x98 x99 -x100 -x101 x102 x103 -x104 -x105 x106 x107 -x108 x109 x110 x111 x112 x113 -x114 x115 x116 x117 x118 -x119 x120 -x90

Verifier Data 

OK	7

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3726054-1338656836/watcher-3726054-1338656836 -o /tmp/evaluation-result-3726054-1338656836/solver-3726054-1338656836 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726054-1338656836.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.00 4.00 3.95 4/178 27184
/proc/meminfo: memFree=31082092/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=162948 CPUtime=0 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 1139 0 0 0 0 0 0 0 20 0 3 0 331810574 166858752 1089 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 40737 1092 203 433 0 40301 0
[pid=27184/tid=27185] ppid=27182 vsize=162948 CPUtime=0 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 3 0 331810574 166858752 1096 33554432000 4194304 5964478 140737076188912 140720100047768 4389107 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=163140 CPUtime=0 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 355 0 0 0 0 0 0 0 20 0 3 0 331810574 167055360 1099 33554432000 4194304 5964478 140737076188912 140720089557096 5179243 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.071934 s]
/proc/loadavg: 4.00 4.00 3.95 4/178 27184
/proc/meminfo: memFree=31082092/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=180524 CPUtime=0.13 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 7781 0 0 0 11 2 0 0 20 0 3 0 331810574 184856576 7652 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 45131 7659 204 433 0 44695 0
[pid=27184/tid=27185] ppid=27182 vsize=180524 CPUtime=0.05 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 216 0 0 0 5 0 0 0 20 0 3 0 331810574 184856576 7668 33554432000 4194304 5964478 140737076188912 140720100046360 4389320 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=180524 CPUtime=0.05 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 6831 0 0 0 3 2 0 0 20 0 3 0 331810574 184856576 7670 33554432000 4194304 5964478 140737076188912 140720089556552 5136420 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.13
Current children cumulated vsize (KiB) 180524

[startup+0.100458 s]
/proc/loadavg: 4.00 4.00 3.95 4/178 27184
/proc/meminfo: memFree=31082092/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=189488 CPUtime=0.18 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 10574 0 0 0 15 3 0 0 20 0 3 0 331810574 194035712 10445 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47372 10451 204 433 0 46936 0
[pid=27184/tid=27185] ppid=27182 vsize=189488 CPUtime=0.08 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 287 0 0 0 8 0 0 0 20 0 3 0 331810574 194035712 10454 33554432000 4194304 5964478 140737076188912 140720100046840 4382271 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=189488 CPUtime=0.08 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 9546 0 0 0 5 3 0 0 20 0 3 0 331810574 194035712 10456 33554432000 4194304 5964478 140737076188912 140720089556776 4395406 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 189488

[startup+0.300402 s]
/proc/loadavg: 4.00 4.00 3.95 4/178 27184
/proc/meminfo: memFree=31082092/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190476 CPUtime=0.59 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 12503 0 0 0 55 4 0 0 20 0 3 0 331810574 195047424 12885 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47619 12885 205 433 0 47183 0
[pid=27184/tid=27185] ppid=27182 vsize=190476 CPUtime=0.28 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 727 0 0 0 28 0 0 0 20 0 3 0 331810574 195047424 12886 33554432000 4194304 5964478 140737076188912 140720100046888 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190476 CPUtime=0.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11025 0 0 0 25 3 0 0 20 0 3 0 331810574 195047424 12886 33554432000 4194304 5964478 140737076188912 140720089557224 4369832 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.59
Current children cumulated vsize (KiB) 190476

[startup+0.700396 s]
/proc/loadavg: 4.00 4.00 3.95 4/178 27184
/proc/meminfo: memFree=31082092/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190620 CPUtime=1.38 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 13168 0 0 0 134 4 0 0 20 0 3 0 331810574 195194880 13550 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47655 13550 205 433 0 47219 0
[pid=27184/tid=27185] ppid=27182 vsize=190620 CPUtime=0.68 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 1349 0 0 0 68 0 0 0 20 0 3 0 331810574 195194880 13550 33554432000 4194304 5964478 140737076188912 140720100046888 4388192 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190620 CPUtime=0.68 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11067 0 0 0 65 3 0 0 20 0 3 0 331810574 195194880 13550 33554432000 4194304 5964478 140737076188912 140720089557224 4399854 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 190620

[startup+1.50039 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27187
/proc/meminfo: memFree=31027692/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190620 CPUtime=2.98 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 13610 0 0 0 294 4 0 0 20 0 3 0 331810574 195194880 13992 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47655 13992 205 433 0 47219 0
[pid=27184/tid=27185] ppid=27182 vsize=190620 CPUtime=1.48 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 1710 0 0 0 148 0 0 0 20 0 3 0 331810574 195194880 13992 33554432000 4194304 5964478 140737076188912 140720100046648 4381702 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190620 CPUtime=1.49 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11148 0 0 0 145 4 0 0 20 0 3 0 331810574 195194880 13992 33554432000 4194304 5964478 140737076188912 140720089557304 4399915 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 190620

[startup+3.10045 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27187
/proc/meminfo: memFree=31023452/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190692 CPUtime=6.18 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 14462 0 0 0 614 4 0 0 20 0 3 0 331810574 195268608 14844 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47673 14844 205 433 0 47237 0
[pid=27184/tid=27185] ppid=27182 vsize=190692 CPUtime=3.08 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 2462 0 0 0 307 1 0 0 20 0 3 0 331810574 195268608 14845 33554432000 4194304 5964478 140737076188912 140720100046840 5136420 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190692 CPUtime=3.09 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11249 0 0 0 305 4 0 0 20 0 3 0 331810574 195268608 14845 33554432000 4194304 5964478 140737076188912 140720089557352 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 190692

[startup+6.30039 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27187
/proc/meminfo: memFree=31015524/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190800 CPUtime=12.58 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 16190 0 0 0 1253 5 0 0 20 0 3 0 331810574 195379200 16572 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47700 16572 205 433 0 47264 0
[pid=27184/tid=27185] ppid=27182 vsize=190800 CPUtime=6.28 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 4066 0 0 0 626 2 0 0 20 0 3 0 331810574 195379200 16572 33554432000 4194304 5964478 140737076188912 140720100046888 4400115 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190800 CPUtime=6.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11372 0 0 0 624 4 0 0 20 0 3 0 331810574 195379200 16572 33554432000 4194304 5964478 140737076188912 140720089557304 4220672 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 190800

[startup+12.7004 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27187
/proc/meminfo: memFree=31000768/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190960 CPUtime=25.38 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 18409 0 0 0 2530 8 0 0 20 0 3 0 331810574 195543040 18791 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47740 18791 205 433 0 47304 0
[pid=27184/tid=27185] ppid=27182 vsize=190960 CPUtime=12.68 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 6092 0 0 0 1263 5 0 0 20 0 3 0 331810574 195543040 18791 33554432000 4194304 5964478 140737076188912 140720100046840 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190960 CPUtime=12.68 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11565 0 0 0 1264 4 0 0 20 0 3 0 331810574 195543040 18791 33554432000 4194304 5964478 140737076188912 140720089557304 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 190960

[startup+25.5004 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27187
/proc/meminfo: memFree=30981652/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=190960 CPUtime=50.97 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 21511 0 0 0 5085 12 0 0 20 0 3 0 331810574 195543040 21893 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 47740 21893 205 433 0 47304 0
[pid=27184/tid=27185] ppid=27182 vsize=190960 CPUtime=25.48 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 8878 0 0 0 2539 9 0 0 20 0 3 0 331810574 195543040 21893 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=190960 CPUtime=25.49 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11881 0 0 0 2544 5 0 0 20 0 3 0 331810574 195543040 21893 33554432000 4194304 5964478 140737076188912 140720089557176 4392918 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 190960

[startup+51.1004 s]
/proc/loadavg: 4.00 4.00 3.95 5/181 27187
/proc/meminfo: memFree=30957036/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=192116 CPUtime=102.17 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 27141 0 0 0 10196 21 0 0 20 0 3 0 331810574 196726784 27523 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 48029 27523 205 433 0 47593 0
[pid=27184/tid=27185] ppid=27182 vsize=192116 CPUtime=51.08 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 11807 0 0 0 5094 14 0 0 20 0 3 0 331810574 196726784 27523 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=192116 CPUtime=51.08 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 14582 0 0 0 5101 7 0 0 20 0 3 0 331810574 196726784 27523 33554432000 4194304 5964478 140737076188912 140720089557304 4400016 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 102.17
Current children cumulated vsize (KiB) 192116

[startup+102.307 s]
/proc/loadavg: 4.04 4.01 3.95 5/181 27187
/proc/meminfo: memFree=30891960/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=194984 CPUtime=204.56 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 37338 0 0 0 20419 37 0 0 20 0 3 0 331810574 199663616 37720 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 48746 37720 205 433 0 48310 0
[pid=27184/tid=27185] ppid=27182 vsize=194984 CPUtime=102.28 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 16344 0 0 0 10204 24 0 0 20 0 3 0 331810574 199663616 37720 33554432000 4194304 5964478 140737076188912 140720100046648 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=194984 CPUtime=102.29 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 20242 0 0 0 10213 16 0 0 20 0 3 0 331810574 199663616 37720 33554432000 4194304 5964478 140737076188912 140720089557304 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204.56
Current children cumulated vsize (KiB) 194984

[startup+162.3 s]
/proc/loadavg: 4.01 4.01 3.95 5/181 27187
/proc/meminfo: memFree=30842732/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=330268 CPUtime=324.53 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 46597 0 0 0 32399 54 0 0 20 0 3 0 331810574 338194432 46979 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 82567 46979 205 433 0 82131 0
[pid=27184/tid=27185] ppid=27182 vsize=330268 CPUtime=162.28 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 22311 0 0 0 16191 37 0 0 20 0 3 0 331810574 338194432 46979 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=330268 CPUtime=162.29 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 23534 0 0 0 16207 22 0 0 20 0 3 0 331810574 338194432 46979 33554432000 4194304 5964478 140737076188912 140720089557112 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 324.53
Current children cumulated vsize (KiB) 330268

[startup+222.3 s]
/proc/loadavg: 4.07 4.02 3.96 5/182 27190
/proc/meminfo: memFree=30808872/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=333560 CPUtime=444.52 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 52059 0 0 0 44386 66 0 0 20 0 3 0 331810574 341565440 52436 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 83390 52436 205 433 0 82954 0
[pid=27184/tid=27185] ppid=27182 vsize=333560 CPUtime=222.28 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 25210 0 0 0 22183 45 0 0 20 0 3 0 331810574 341565440 52436 33554432000 4194304 5964478 140737076188912 140720100046888 4410425 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=333560 CPUtime=222.29 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 26097 0 0 0 22201 28 0 0 20 0 3 0 331810574 341565440 52436 33554432000 4194304 5964478 140737076188912 140720089557304 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 444.52
Current children cumulated vsize (KiB) 333560

################
# More data... #
################

/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 29314 0 0 0 28174 53 0 0 20 0 3 0 331810574 343203840 58677 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=335160 CPUtime=282.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 27732 0 0 0 28196 32 0 0 20 0 3 0 331810574 343203840 58677 33554432000 4194304 5964478 140737076188912 140720089557176 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 564.48
Current children cumulated vsize (KiB) 335160

[startup+342.3 s]
/proc/loadavg: 3.98 4.00 3.95 5/181 27232
/proc/meminfo: memFree=31139900/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=336472 CPUtime=684.41 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 60801 0 0 0 68360 81 0 0 20 0 3 0 331810574 344547328 61692 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 84118 61692 205 433 0 83682 0
[pid=27184/tid=27185] ppid=27182 vsize=336472 CPUtime=342.23 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 32215 0 0 0 34164 59 0 0 20 0 3 0 331810574 344547328 61692 33554432000 4194304 5964478 140737076188912 140720100046888 4399923 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=336472 CPUtime=342.27 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 27834 0 0 0 34194 33 0 0 20 0 3 0 331810574 344547328 61692 33554432000 4194304 5964478 140737076188912 140720089557352 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 684.41
Current children cumulated vsize (KiB) 336472

[startup+402.3 s]
/proc/loadavg: 3.99 4.00 3.95 5/181 27232
/proc/meminfo: memFree=31116760/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=402368 CPUtime=804.37 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 63430 0 0 0 80350 87 0 0 20 0 3 0 331810574 412024832 65767 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 100592 65767 205 433 0 100156 0
[pid=27184/tid=27185] ppid=27182 vsize=402368 CPUtime=402.2 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 34829 0 0 0 40154 66 0 0 20 0 3 0 331810574 412024832 65767 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=402368 CPUtime=402.27 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 27849 0 0 0 40193 34 0 0 20 0 3 0 331810574 412024832 65767 33554432000 4194304 5964478 140737076188912 140720089557352 4399975 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 804.37
Current children cumulated vsize (KiB) 402368

[startup+462.3 s]
/proc/loadavg: 3.99 4.00 3.95 5/181 27232
/proc/meminfo: memFree=31088964/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=403700 CPUtime=924.35 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 68401 0 0 0 92337 98 0 0 20 0 3 0 331810574 413388800 70738 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 100925 70738 205 433 0 100489 0
[pid=27184/tid=27185] ppid=27182 vsize=403700 CPUtime=462.2 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 39752 0 0 0 46142 78 0 0 20 0 3 0 331810574 413388800 70738 33554432000 4194304 5964478 140737076188912 140720100046840 4379311 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=403700 CPUtime=462.27 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 27897 0 0 0 46192 35 0 0 20 0 3 0 331810574 413388800 70738 33554432000 4194304 5964478 140737076188912 140720089557352 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 924.35
Current children cumulated vsize (KiB) 403700

[startup+522.3 s]
/proc/loadavg: 3.99 4.00 3.95 5/181 27232
/proc/meminfo: memFree=31064776/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=405336 CPUtime=1044.31 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 72461 0 0 0 104324 107 0 0 20 0 3 0 331810574 415064064 74788 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 101334 74788 205 433 0 100898 0
[pid=27184/tid=27185] ppid=27182 vsize=405336 CPUtime=522.19 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 42088 0 0 0 52135 84 0 0 20 0 3 0 331810574 415064064 74788 33554432000 4194304 5964478 140737076188912 140720100046840 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=405336 CPUtime=522.27 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 29621 0 0 0 52188 39 0 0 20 0 3 0 331810574 415064064 74788 33554432000 4194304 5964478 140737076188912 140720089557112 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1044.31
Current children cumulated vsize (KiB) 405336

[startup+582.3 s]
/proc/loadavg: 3.99 4.00 3.95 5/181 27233
/proc/meminfo: memFree=31033332/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=408552 CPUtime=1164.29 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 77036 0 0 0 116311 118 0 0 20 0 3 0 331810574 418357248 79361 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 102138 79361 205 433 0 101702 0
[pid=27184/tid=27185] ppid=27182 vsize=408552 CPUtime=582.18 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 44891 0 0 0 58126 92 0 0 20 0 3 0 331810574 418357248 79361 33554432000 4194304 5964478 140737076188912 140720100046840 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=408552 CPUtime=582.27 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 31393 0 0 0 58184 43 0 0 20 0 3 0 331810574 418357248 79361 33554432000 4194304 5964478 140737076188912 140720089557304 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1164.29
Current children cumulated vsize (KiB) 408552

[startup+642.3 s]
/proc/loadavg: 3.99 4.00 3.95 5/181 27233
/proc/meminfo: memFree=31011624/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=409924 CPUtime=1284.29 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 81796 0 0 0 128301 128 0 0 20 0 3 0 331810574 419762176 84120 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 102481 84120 205 433 0 102045 0
[pid=27184/tid=27185] ppid=27182 vsize=409924 CPUtime=642.18 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 48216 0 0 0 64117 101 0 0 20 0 3 0 331810574 419762176 84120 33554432000 4194304 5964478 140737076188912 140720100046840 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=409924 CPUtime=642.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 32828 0 0 0 64182 46 0 0 20 0 3 0 331810574 419762176 84120 33554432000 4194304 5964478 140737076188912 140720089557304 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1284.29
Current children cumulated vsize (KiB) 409924

[startup+702.3 s]
/proc/loadavg: 3.99 4.00 3.95 5/181 27233
/proc/meminfo: memFree=30987692/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=476756 CPUtime=1404.25 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 85963 0 0 0 140289 136 0 0 20 0 3 0 331810574 488198144 88287 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 119189 88287 205 433 0 118753 0
[pid=27184/tid=27185] ppid=27182 vsize=476756 CPUtime=702.18 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 51121 0 0 0 70110 108 0 0 20 0 3 0 331810574 488198144 88287 33554432000 4194304 5964478 140737076188912 140720100046840 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=476756 CPUtime=702.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 34090 0 0 0 70179 49 0 0 20 0 3 0 331810574 488198144 88287 33554432000 4194304 5964478 140737076188912 140720089557352 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1404.25
Current children cumulated vsize (KiB) 476756

[startup+762.307 s]
/proc/loadavg: 4.06 4.01 3.96 5/181 27233
/proc/meminfo: memFree=30965852/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=480248 CPUtime=1524.24 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 90011 0 0 0 152280 144 0 0 20 0 3 0 331810574 491773952 92335 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 120062 92335 205 433 0 119626 0
[pid=27184/tid=27185] ppid=27182 vsize=480248 CPUtime=762.18 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 53666 0 0 0 76104 114 0 0 20 0 3 0 331810574 491773952 92335 33554432000 4194304 5964478 140737076188912 140720100046840 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=480248 CPUtime=762.29 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 35593 0 0 0 76176 53 0 0 20 0 3 0 331810574 491773952 92335 33554432000 4194304 5964478 140737076188912 140720089557352 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1524.24
Current children cumulated vsize (KiB) 480248

[startup+822.3 s]
/proc/loadavg: 4.02 4.00 3.96 5/182 27236
/proc/meminfo: memFree=30949564/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=481344 CPUtime=1644.2 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 93611 0 0 0 164269 151 0 0 20 0 3 0 331810574 492896256 95921 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 120336 95921 205 433 0 119900 0
[pid=27184/tid=27185] ppid=27182 vsize=481344 CPUtime=822.16 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 55964 0 0 0 82097 119 0 0 20 0 3 0 331810574 492896256 95921 33554432000 4194304 5964478 140737076188912 140720100046888 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=481344 CPUtime=822.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 36895 0 0 0 82171 57 0 0 20 0 3 0 331810574 492896256 95921 33554432000 4194304 5964478 140737076188912 140720089557304 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1644.2
Current children cumulated vsize (KiB) 481344

[startup+882.3 s]
/proc/loadavg: 4.01 4.00 3.96 5/181 27237
/proc/meminfo: memFree=30920756/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=482536 CPUtime=1764.15 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 97768 0 0 0 176256 159 0 0 20 0 3 0 331810574 494116864 100082 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 120634 100082 205 433 0 120198 0
[pid=27184/tid=27185] ppid=27182 vsize=482536 CPUtime=882.15 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 58876 0 0 0 88089 126 0 0 20 0 3 0 331810574 494116864 100082 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=482536 CPUtime=882.27 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 38140 0 0 0 88166 61 0 0 20 0 3 0 331810574 494116864 100082 33554432000 4194304 5964478 140737076188912 140720089557304 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1764.15
Current children cumulated vsize (KiB) 482536



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.96 6/181 27237
/proc/meminfo: memFree=30914928/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=482804 CPUtime=1800.16 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 98174 0 0 0 179855 161 0 0 20 0 3 0 331810574 494391296 100488 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 120701 100488 205 433 0 120265 0
[pid=27184/tid=27185] ppid=27182 vsize=482804 CPUtime=900.15 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 58885 0 0 0 89889 126 0 0 20 0 3 0 331810574 494391296 100488 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=482804 CPUtime=900.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 38537 0 0 0 89966 62 0 0 20 0 3 0 331810574 494391296 100488 33554432000 4194304 5964478 140737076188912 140720089557304 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 482804

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.00 4.00 3.96 6/181 27237
/proc/meminfo: memFree=30914928/32873844 swapFree=7116/7116
[pid=27184] ppid=27182 vsize=482804 CPUtime=1800.16 cores=1,3,5,7
/proc/27184/stat : 27184 (pwbo2.02) S 27182 27184 24826 0 -1 4202496 98174 0 0 0 179855 161 0 0 20 0 3 0 331810574 494391296 100488 33554432000 4194304 5964478 140737076188912 140737076188432 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/27184/statm: 120701 100488 205 433 0 120265 0
[pid=27184/tid=27185] ppid=27182 vsize=482804 CPUtime=900.15 cores=1,3,5,7
/proc/27184/task/27185/stat : 27185 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 58885 0 0 0 89889 126 0 0 20 0 3 0 331810574 494391296 100488 33554432000 4194304 5964478 140737076188912 140720100046888 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=27184/tid=27186] ppid=27182 vsize=482804 CPUtime=900.28 cores=1,3,5,7
/proc/27184/task/27186/stat : 27186 (pwbo2.02) R 27182 27184 24826 0 -1 4202560 38537 0 0 0 89966 62 0 0 20 0 3 0 331810574 494391296 100488 33554432000 4194304 5964478 140737076188912 140720089557304 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.16
Current children cumulated vsize (KiB) 482804

Child status: 0
Real time (s): 900.32
CPU time (s): 1800.48
CPU user time (s): 1798.57
CPU system time (s): 1.91271
CPU usage (%): 199.982
Max. virtual memory (cumulated for all children) (KiB): 482804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.57
system time used= 1.91271
maximum resident set size= 401960
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 98176
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 403
involuntary context switches= 1842

runsolver used 2.21266 second user time and 5.74413 second system time

The end

Launcher Data 

Begin job on node111 at 2012-06-02 19:07:16
IDJOB=3726054
IDBENCH=2923
IDSOLVER=2309
FILE ID=node111/3726054-1338656836
RUNJOBID= node111-1338651416-26331
PBS_JOBID= 14636469
Free space on /tmp= 67392 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_5_40_1.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3726054-1338656836/watcher-3726054-1338656836 -o /tmp/evaluation-result-3726054-1338656836/solver-3726054-1338656836 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726054-1338656836.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5bf563c7058af01702ea80887f1d43ad
RANDOM SEED=449452573

node111.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.30
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.152
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31082968 kB
Buffers:          150396 kB
Cached:           429044 kB
SwapCached:         1352 kB
Active:           547348 kB
Inactive:         459708 kB
Active(anon):     428756 kB
Inactive(anon):     1120 kB
Active(file):     118592 kB
Inactive(file):   458588 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67100048 kB
Dirty:              5464 kB
Writeback:             0 kB
AnonPages:        433468 kB
Mapped:             9528 kB
Shmem:                 0 kB
Slab:             644280 kB
SReclaimable:      86628 kB
SUnreclaim:       557652 kB
KernelStack:        1480 kB
PageTables:         4936 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     219548 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    311296 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 67380 MiB
End job on node111 at 2012-06-02 19:22:18