Trace number 3703753

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0SAT (TO)6 1800.51 900.321

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_5_40_1.opb
MD5SUM5bf563c7058af01702ea80887f1d43ad
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark1789.91
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1
Optimality of the best value was proved NO
Number of variables120
Total number of constraints10
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints10
Minimum length of a constraint55
Maximum length of a constraint56
Number of terms in the objective function 80
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 2550
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1086
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 3768
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703753-1338094479.opb.
0.00/0.00	c Instance file HOME/instance-3703753-1338094479.opb
0.00/0.00	c File size is 5459 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 3768
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      120                                                 |
0.00/0.00	c |  Number Clauses:        0                                                   |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 10                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.19/900.31	o 1090
1800.19/900.31	o 1039
1800.19/900.31	o 952
1800.19/900.31	o 808
1800.19/900.31	o 562
1800.19/900.31	o 556
1800.19/900.31	o 464
1800.19/900.31	o 335
1800.19/900.31	o 289
1800.19/900.31	o 283
1800.19/900.31	o 281
1800.19/900.31	o 256
1800.19/900.31	o 241
1800.19/900.31	o 239
1800.19/900.31	o 204
1800.19/900.31	o 198
1800.19/900.31	o 118
1800.19/900.31	o 93
1800.19/900.31	o 91
1800.19/900.31	o 89
1800.19/900.31	o 85
1800.19/900.31	o 83
1800.19/900.31	o 79
1800.19/900.31	o 66
1800.19/900.31	o 47
1800.19/900.31	o 34
1800.19/900.31	o 33
1800.19/900.31	o 31
1800.19/900.31	o 26
1800.19/900.31	o 24
1800.19/900.31	o 22
1800.19/900.31	o 19
1800.19/900.31	o 18
1800.19/900.31	o 16
1800.19/900.31	o 12
1800.19/900.31	o 10
1800.19/900.31	o 9
1800.19/900.31	o 8
1800.19/900.31	o 7
1800.19/900.31	o 6
1800.19/900.31	c ===============================================================================
1800.19/900.31	c Wall Clock Time: 900.31 s
1800.19/900.31	c Best Solution: 6
1800.19/900.31	s SATISFIABLE
1800.19/900.31	v -x1 -x2 -x3 -x4 -x5 -x6 -x7 -x8 x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 x17 x18 -x19 -x20 -x21 -x22 -x23 -x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 -x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 x49 -x50 -x51 -x52 -x53 -x54 -x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 -x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 x73 -x74 -x75 -x76 -x77 -x78 -x79 -x80 -x81 -x82 -x83 -x84 x85 -x86 x87 -x88 -x89 -x91 x92 x93 x94 x95 -x96 x97 -x98 x99 x100 x101 -x102 x103 -x104 x105 x106 -x107 x108 -x109 -x110 x111 -x112 x113 x114 -x115 -x116 x117 -x118 -x119 x120 x90

Verifier Data 

OK	6

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703753-1338094479/watcher-3703753-1338094479 -o /tmp/evaluation-result-3703753-1338094479/solver-3703753-1338094479 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703753-1338094479.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.99 3.97 3.93 4/178 8166
/proc/meminfo: memFree=28646704/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=163296 CPUtime=0 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 1291 0 0 0 0 0 0 0 20 0 3 0 275573931 167215104 1195 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 40824 1196 206 433 0 40388 0
[pid=8166/tid=8167] ppid=8164 vsize=163296 CPUtime=0 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 42 0 0 0 0 0 0 0 20 0 3 0 275573931 167215104 1201 33554432000 4194304 5965102 140734539909232 140387355245416 5143689 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=163296 CPUtime=0 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 504 0 0 0 0 0 0 0 20 0 3 0 275573931 167215104 1203 33554432000 4194304 5965102 140734539909232 140387344754648 5137146 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0

[startup+0.058611 s]
/proc/loadavg: 3.99 3.97 3.93 4/178 8166
/proc/meminfo: memFree=28646704/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=176868 CPUtime=0.1 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 6811 0 0 0 9 1 0 0 20 0 3 0 275573931 181112832 6644 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 44217 6649 207 433 0 43781 0
[pid=8166/tid=8167] ppid=8164 vsize=176868 CPUtime=0.04 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 195 0 0 0 4 0 0 0 20 0 3 0 275573931 181112832 6652 33554432000 4194304 5965102 140734539909232 140387355244584 4382778 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=176868 CPUtime=0.04 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 5872 0 0 0 2 2 0 0 20 0 3 0 275573931 181112832 6653 33554432000 4194304 5965102 140734539909232 140387344754152 5137146 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 176868

[startup+0.100355 s]
/proc/loadavg: 3.99 3.97 3.93 4/178 8166
/proc/meminfo: memFree=28646704/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=189452 CPUtime=0.18 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 11171 0 0 0 15 3 0 0 20 0 3 0 275573931 193998848 10964 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47363 10970 207 433 0 46927 0
[pid=8166/tid=8167] ppid=8164 vsize=189452 CPUtime=0.08 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 300 0 0 0 8 0 0 0 20 0 3 0 275573931 193998848 10972 33554432000 4194304 5965102 140734539909232 140387355244584 5137146 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=189452 CPUtime=0.08 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 10130 0 0 0 4 4 0 0 20 0 3 0 275573931 193998848 10976 33554432000 4194304 5965102 140734539909232 140387344754200 5137146 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 189452

[startup+0.30035 s]
/proc/loadavg: 3.99 3.97 3.93 4/178 8166
/proc/meminfo: memFree=28646704/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=190440 CPUtime=0.58 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 12613 0 0 0 53 5 0 0 20 0 3 0 275573931 195010560 12406 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47610 12406 207 433 0 47174 0
[pid=8166/tid=8167] ppid=8164 vsize=190440 CPUtime=0.28 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 716 0 0 0 28 0 0 0 20 0 3 0 275573931 195010560 12406 33554432000 4194304 5965102 140734539909232 140387355244584 5244967 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=190440 CPUtime=0.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 11144 0 0 0 24 4 0 0 20 0 3 0 275573931 195010560 12407 33554432000 4194304 5965102 140734539909232 140387344754936 4393958 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 190440

[startup+0.700303 s]
/proc/loadavg: 3.99 3.97 3.93 4/178 8166
/proc/meminfo: memFree=28646704/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=190584 CPUtime=1.38 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 13293 0 0 0 133 5 0 0 20 0 3 0 275573931 195158016 13086 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47646 13086 207 433 0 47210 0
[pid=8166/tid=8167] ppid=8164 vsize=190584 CPUtime=0.68 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 1313 0 0 0 66 2 0 0 20 0 3 0 275573931 195158016 13086 33554432000 4194304 5965102 140734539909232 140387355244536 4390212 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=190584 CPUtime=0.68 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 11227 0 0 0 64 4 0 0 20 0 3 0 275573931 195158016 13087 33554432000 4194304 5965102 140734539909232 140387344754920 4400955 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1.38
Current children cumulated vsize (KiB) 190584

[startup+1.50036 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8169
/proc/meminfo: memFree=28595592/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=190584 CPUtime=2.99 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 13707 0 0 0 293 6 0 0 20 0 3 0 275573931 195158016 13500 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47646 13500 208 433 0 47210 0
[pid=8166/tid=8167] ppid=8164 vsize=190584 CPUtime=1.48 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 1676 0 0 0 146 2 0 0 20 0 3 0 275573931 195158016 13500 33554432000 4194304 5965102 140734539909232 140387355244344 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=190584 CPUtime=1.48 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 11278 0 0 0 144 4 0 0 20 0 3 0 275573931 195158016 13500 33554432000 4194304 5965102 140734539909232 140387344754872 5137076 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 2.99
Current children cumulated vsize (KiB) 190584

[startup+3.1003 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8169
/proc/meminfo: memFree=28590880/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=190656 CPUtime=6.18 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 14728 0 0 0 612 6 0 0 20 0 3 0 275573931 195231744 14521 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47664 14521 208 433 0 47228 0
[pid=8166/tid=8167] ppid=8164 vsize=190656 CPUtime=3.08 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 2624 0 0 0 306 2 0 0 20 0 3 0 275573931 195231744 14521 33554432000 4194304 5965102 140734539909232 140387355244536 4401058 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=190656 CPUtime=3.08 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 11351 0 0 0 304 4 0 0 20 0 3 0 275573931 195231744 14521 33554432000 4194304 5965102 140734539909232 140387344755144 4400955 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 190656

[startup+6.3003 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8169
/proc/meminfo: memFree=28584192/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=190764 CPUtime=12.58 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 16503 0 0 0 1251 7 0 0 20 0 3 0 275573931 195342336 16296 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47691 16296 208 433 0 47255 0
[pid=8166/tid=8167] ppid=8164 vsize=190764 CPUtime=6.28 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 4303 0 0 0 625 3 0 0 20 0 3 0 275573931 195342336 16296 33554432000 4194304 5965102 140734539909232 140387355244584 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=190764 CPUtime=6.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 11447 0 0 0 624 4 0 0 20 0 3 0 275573931 195342336 16296 33554432000 4194304 5965102 140734539909232 140387344754872 4393958 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 190764

[startup+12.7002 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8169
/proc/meminfo: memFree=28570816/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=191068 CPUtime=25.38 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 19304 0 0 0 2529 9 0 0 20 0 3 0 275573931 195653632 19097 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47767 19097 208 433 0 47331 0
[pid=8166/tid=8167] ppid=8164 vsize=191068 CPUtime=12.68 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 6830 0 0 0 1263 5 0 0 20 0 3 0 275573931 195653632 19097 33554432000 4194304 5965102 140734539909232 140387355244536 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=191068 CPUtime=12.69 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 11721 0 0 0 1264 5 0 0 20 0 3 0 275573931 195653632 19097 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 25.38
Current children cumulated vsize (KiB) 191068

[startup+25.5004 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8210
/proc/meminfo: memFree=28841536/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=191680 CPUtime=50.97 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 23445 0 0 0 5084 13 0 0 20 0 3 0 275573931 196280320 23245 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 47920 23245 208 433 0 47484 0
[pid=8166/tid=8167] ppid=8164 vsize=191680 CPUtime=25.47 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 8982 0 0 0 2540 7 0 0 20 0 3 0 275573931 196280320 23245 33554432000 4194304 5965102 140734539909232 140387355244536 4382742 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=191680 CPUtime=25.48 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 13710 0 0 0 2541 7 0 0 20 0 3 0 275573931 196280320 23245 33554432000 4194304 5965102 140734539909232 140387344754872 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 191680

[startup+51.1002 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8210
/proc/meminfo: memFree=28775876/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=193616 CPUtime=102.14 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 32326 0 0 0 10192 22 0 0 20 0 3 0 275573931 198262784 32595 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 48404 32595 208 433 0 47968 0
[pid=8166/tid=8167] ppid=8164 vsize=193616 CPUtime=51.06 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 13683 0 0 0 5092 14 0 0 20 0 3 0 275573931 198262784 32595 33554432000 4194304 5965102 140734539909232 140387355244584 4401127 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=193616 CPUtime=51.08 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 17890 0 0 0 5098 10 0 0 20 0 3 0 275573931 198262784 32595 33554432000 4194304 5965102 140734539909232 140387344755048 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 102.14
Current children cumulated vsize (KiB) 193616

[startup+102.307 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8211
/proc/meminfo: memFree=28686420/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=262824 CPUtime=204.52 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 42315 0 0 0 20416 36 0 0 20 0 3 0 275573931 269131776 43845 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 65706 43845 208 433 0 65270 0
[pid=8166/tid=8167] ppid=8164 vsize=262824 CPUtime=102.26 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 19274 0 0 0 10202 24 0 0 20 0 3 0 275573931 269131776 43845 33554432000 4194304 5965102 140734539909232 140387355244536 4401668 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=262824 CPUtime=102.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 22288 0 0 0 10213 15 0 0 20 0 3 0 275573931 269131776 43845 33554432000 4194304 5965102 140734539909232 140387344755000 4400992 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 204.52
Current children cumulated vsize (KiB) 262824

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8211
/proc/meminfo: memFree=28611096/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=333988 CPUtime=324.49 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 51411 0 0 0 32395 54 0 0 20 0 3 0 275573931 342003712 52941 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 83497 52941 208 433 0 83061 0
[pid=8166/tid=8167] ppid=8164 vsize=333988 CPUtime=162.26 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 24520 0 0 0 16189 37 0 0 20 0 3 0 275573931 342003712 52941 33554432000 4194304 5965102 140734539909232 140387355244536 5137076 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=333988 CPUtime=162.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 26138 0 0 0 16205 22 0 0 20 0 3 0 275573931 342003712 52941 33554432000 4194304 5965102 140734539909232 140387344754808 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 324.49
Current children cumulated vsize (KiB) 333988

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 8211
/proc/meminfo: memFree=28543368/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=336976 CPUtime=444.44 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 58928 0 0 0 44378 66 0 0 20 0 3 0 275573931 345063424 60490 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 84244 60490 208 433 0 83808 0
[pid=8166/tid=8167] ppid=8164 vsize=336976 CPUtime=222.24 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 29335 0 0 0 22176 48 0 0 20 0 3 0 275573931 345063424 60490 33554432000 4194304 5965102 140734539909232 140387355244584 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=336976 CPUtime=222.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 28840 0 0 0 22201 26 0 0 20 0 3 0 275573931 345063424 60490 33554432000 4194304 5965102 140734539909232 140387344755048 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 444.44
Current children cumulated vsize (KiB) 336976

################
# More data... #
################

/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 32357 0 0 0 28168 54 0 0 20 0 3 0 275573931 346406912 64028 33554432000 4194304 5965102 140734539909232 140387355244536 4400978 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=338288 CPUtime=282.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 29357 0 0 0 28200 27 0 0 20 0 3 0 275573931 346406912 64028 33554432000 4194304 5965102 140734539909232 140387344755048 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 564.42
Current children cumulated vsize (KiB) 338288

[startup+342.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/182 8214
/proc/meminfo: memFree=28464452/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=406144 CPUtime=684.4 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 67481 0 0 0 68360 80 0 0 20 0 3 0 275573931 415891456 69044 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 101536 69044 208 433 0 101100 0
[pid=8166/tid=8167] ppid=8164 vsize=406144 CPUtime=342.22 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 37275 0 0 0 34159 63 0 0 20 0 3 0 275573931 415891456 69044 33554432000 4194304 5965102 140734539909232 140387355244584 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=406144 CPUtime=342.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 29453 0 0 0 34199 28 0 0 20 0 3 0 275573931 415891456 69044 33554432000 4194304 5965102 140734539909232 140387344755048 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 684.4
Current children cumulated vsize (KiB) 406144

[startup+402.3 s]
/proc/loadavg: 4.04 3.99 3.94 5/182 8238
/proc/meminfo: memFree=28432952/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=408300 CPUtime=804.38 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 70490 0 0 0 80353 85 0 0 20 0 3 0 275573931 418099200 72053 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 102075 72053 208 433 0 101639 0
[pid=8166/tid=8167] ppid=8164 vsize=408300 CPUtime=402.22 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 40091 0 0 0 40154 68 0 0 20 0 3 0 275573931 418099200 72053 33554432000 4194304 5965102 140734539909232 140387355244584 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=408300 CPUtime=402.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 29646 0 0 0 40197 30 0 0 20 0 3 0 275573931 418099200 72053 33554432000 4194304 5965102 140734539909232 140387344755048 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 804.38
Current children cumulated vsize (KiB) 408300

[startup+462.3 s]
/proc/loadavg: 4.01 3.99 3.94 5/181 8238
/proc/meminfo: memFree=28397708/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=411172 CPUtime=924.36 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 77417 0 0 0 92339 97 0 0 20 0 3 0 275573931 421040128 78980 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 102793 78980 208 433 0 102357 0
[pid=8166/tid=8167] ppid=8164 vsize=411172 CPUtime=462.22 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 44829 0 0 0 46143 79 0 0 20 0 3 0 275573931 421040128 78980 33554432000 4194304 5965102 140734539909232 140387355244584 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=411172 CPUtime=462.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 31835 0 0 0 46194 33 0 0 20 0 3 0 275573931 421040128 78980 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 924.36
Current children cumulated vsize (KiB) 411172

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 8238
/proc/meminfo: memFree=28356480/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=412700 CPUtime=1044.31 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 81389 0 0 0 104327 104 0 0 20 0 3 0 275573931 422604800 82956 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 103175 82956 208 433 0 102739 0
[pid=8166/tid=8167] ppid=8164 vsize=412700 CPUtime=522.2 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 46630 0 0 0 52137 83 0 0 20 0 3 0 275573931 422604800 82956 33554432000 4194304 5965102 140734539909232 140387355244536 5137076 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=412700 CPUtime=522.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 34006 0 0 0 52191 36 0 0 20 0 3 0 275573931 422604800 82956 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1044.31
Current children cumulated vsize (KiB) 412700

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 8238
/proc/meminfo: memFree=28316348/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=416452 CPUtime=1164.29 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 87356 0 0 0 116315 114 0 0 20 0 3 0 275573931 426446848 88916 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 104113 88916 208 433 0 103677 0
[pid=8166/tid=8167] ppid=8164 vsize=416452 CPUtime=582.19 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 50676 0 0 0 58127 92 0 0 20 0 3 0 275573931 426446848 88916 33554432000 4194304 5965102 140734539909232 140387355244536 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=416452 CPUtime=582.27 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 35927 0 0 0 58187 40 0 0 20 0 3 0 275573931 426446848 88916 33554432000 4194304 5965102 140734539909232 140387344754808 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1164.29
Current children cumulated vsize (KiB) 416452

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 8238
/proc/meminfo: memFree=28284980/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=485300 CPUtime=1284.29 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 91885 0 0 0 128308 121 0 0 20 0 3 0 275573931 496947200 93445 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 121325 93445 208 433 0 120889 0
[pid=8166/tid=8167] ppid=8164 vsize=485300 CPUtime=642.19 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 53020 0 0 0 64123 96 0 0 20 0 3 0 275573931 496947200 93445 33554432000 4194304 5965102 140734539909232 140387355244536 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=485300 CPUtime=642.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 38112 0 0 0 64184 44 0 0 20 0 3 0 275573931 496947200 93445 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1284.29
Current children cumulated vsize (KiB) 485300

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.94 5/181 8239
/proc/meminfo: memFree=28233056/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=487492 CPUtime=1404.25 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 97994 0 0 0 140293 132 0 0 20 0 3 0 275573931 499191808 99554 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 121873 99554 208 433 0 121437 0
[pid=8166/tid=8167] ppid=8164 vsize=487492 CPUtime=702.18 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 57618 0 0 0 70111 107 0 0 20 0 3 0 275573931 499191808 99554 33554432000 4194304 5965102 140734539909232 140387355244536 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=487492 CPUtime=702.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 39623 0 0 0 70181 47 0 0 20 0 3 0 275573931 499191808 99554 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1404.25
Current children cumulated vsize (KiB) 487492

[startup+762.307 s]
/proc/loadavg: 4.04 4.00 3.95 5/181 8239
/proc/meminfo: memFree=28219180/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=488228 CPUtime=1524.25 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 100032 0 0 0 152290 135 0 0 20 0 3 0 275573931 499945472 101592 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 122057 101592 208 433 0 121621 0
[pid=8166/tid=8167] ppid=8164 vsize=488228 CPUtime=762.19 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 58095 0 0 0 76111 108 0 0 20 0 3 0 275573931 499945472 101592 33554432000 4194304 5965102 140734539909232 140387355244584 4400972 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=488228 CPUtime=762.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 41184 0 0 0 76179 49 0 0 20 0 3 0 275573931 499945472 101592 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1524.25
Current children cumulated vsize (KiB) 488228

[startup+822.3 s]
/proc/loadavg: 4.01 4.00 3.95 5/181 8239
/proc/meminfo: memFree=28195152/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=490152 CPUtime=1644.21 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 106271 0 0 0 164275 146 0 0 20 0 3 0 275573931 501915648 107831 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 122538 107831 208 433 0 122102 0
[pid=8166/tid=8167] ppid=8164 vsize=490152 CPUtime=822.18 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 62857 0 0 0 82099 119 0 0 20 0 3 0 275573931 501915648 107831 33554432000 4194304 5965102 140734539909232 140387355244584 4400978 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=490152 CPUtime=822.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 42661 0 0 0 82175 53 0 0 20 0 3 0 275573931 501915648 107831 33554432000 4194304 5965102 140734539909232 140387344755048 4401146 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1644.21
Current children cumulated vsize (KiB) 490152

[startup+882.3 s]
/proc/loadavg: 4.05 4.01 3.95 5/181 8239
/proc/meminfo: memFree=28154292/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=556408 CPUtime=1764.2 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 108803 0 0 0 176269 151 0 0 20 0 3 0 275573931 569761792 110361 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 139102 110361 208 433 0 138666 0
[pid=8166/tid=8167] ppid=8164 vsize=556408 CPUtime=882.18 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 63989 0 0 0 88096 122 0 0 20 0 3 0 275573931 569761792 110361 33554432000 4194304 5965102 140734539909232 140387355244584 4390200 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=556408 CPUtime=882.28 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 44061 0 0 0 88172 56 0 0 20 0 3 0 275573931 569761792 110361 33554432000 4194304 5965102 140734539909232 140387344755000 4400960 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1764.2
Current children cumulated vsize (KiB) 556408



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+900.3 s]
/proc/loadavg: 4.04 4.01 3.95 5/181 8239
/proc/meminfo: memFree=28150416/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=556588 CPUtime=1800.19 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 109289 0 0 0 179868 151 0 0 20 0 3 0 275573931 569946112 110840 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 139147 110840 208 433 0 138711 0
[pid=8166/tid=8167] ppid=8164 vsize=556588 CPUtime=900.17 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 64027 0 0 0 89895 122 0 0 20 0 3 0 275573931 569946112 110840 33554432000 4194304 5965102 140734539909232 140387355244584 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=556588 CPUtime=900.29 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 44509 0 0 0 89973 56 0 0 20 0 3 0 275573931 569946112 110840 33554432000 4194304 5965102 140734539909232 140387344755000 4404767 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 556588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+900.3 s]
/proc/loadavg: 4.04 4.01 3.95 5/181 8239
/proc/meminfo: memFree=28150416/32873648 swapFree=7372/7372
[pid=8166] ppid=8164 vsize=556588 CPUtime=1800.19 cores=0,2,4,6
/proc/8166/stat : 8166 (pwbo2.0) S 8164 8166 7065 0 -1 4202496 109289 0 0 0 179868 151 0 0 20 0 3 0 275573931 569946112 110840 33554432000 4194304 5965102 140734539909232 140734539908752 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/8166/statm: 139147 110840 208 433 0 138711 0
[pid=8166/tid=8167] ppid=8164 vsize=556588 CPUtime=900.17 cores=0,2,4,6
/proc/8166/task/8167/stat : 8167 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 64027 0 0 0 89895 122 0 0 20 0 3 0 275573931 569946112 110840 33554432000 4194304 5965102 140734539909232 140387355244584 4400960 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=8166/tid=8168] ppid=8164 vsize=556588 CPUtime=900.29 cores=0,2,4,6
/proc/8166/task/8168/stat : 8168 (pwbo2.0) R 8164 8166 7065 0 -1 4202560 44509 0 0 0 89973 56 0 0 20 0 3 0 275573931 569946112 110840 33554432000 4194304 5965102 140734539909232 140387344755000 4404767 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1800.19
Current children cumulated vsize (KiB) 556588

Child status: 0
Real time (s): 900.321
CPU time (s): 1800.51
CPU user time (s): 1798.7
CPU system time (s): 1.81272
CPU usage (%): 199.985
Max. virtual memory (cumulated for all children) (KiB): 556588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.7
system time used= 1.81272
maximum resident set size= 443372
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 109292
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 409
involuntary context switches= 1885

runsolver used 1.88071 second user time and 5.2452 second system time

The end

Launcher Data 

Begin job on node122 at 2012-05-27 06:54:39
IDJOB=3703753
IDBENCH=2923
IDSOLVER=2279
FILE ID=node122/3703753-1338094479
RUNJOBID= node122-1338086209-7081
PBS_JOBID= 14624430
Free space on /tmp= 71692 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_5_40_1.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703753-1338094479/watcher-3703753-1338094479 -o /tmp/evaluation-result-3703753-1338094479/solver-3703753-1338094479 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703753-1338094479.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5bf563c7058af01702ea80887f1d43ad
RANDOM SEED=642649960

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        28646860 kB
Buffers:          278348 kB
Cached:          2830400 kB
SwapCached:            0 kB
Active:          1427736 kB
Inactive:        2016740 kB
Active(anon):     327248 kB
Inactive(anon):    11052 kB
Active(file):    1100488 kB
Inactive(file):  2005688 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:              5452 kB
Writeback:             0 kB
AnonPages:        342868 kB
Mapped:            14528 kB
Shmem:               200 kB
Slab:             643740 kB
SReclaimable:      88076 kB
SUnreclaim:       555664 kB
KernelStack:        1472 kB
PageTables:         4656 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     293184 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    241664 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71684 MiB
End job on node122 at 2012-05-27 07:09:42