Trace number 3727281

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
wbo 1.72? 1799.97 1800.01

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/
MIPLIB/miplib/normalized-mps-v2-20-10-lseu.opb
MD5SUM9b4418c5c34f37121cd9ad7732df64ff
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark1120
Best CPU time to get the best result obtained on this benchmark0.170973
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 1120
Optimality of the best value was proved YES
Number of variables89
Total number of constraints28
Number of constraints which are clauses2
Number of constraints which are cardinality constraints (but not clauses)15
Number of constraints which are nor clauses,nor cardinality constraints11
Minimum length of a constraint2
Maximum length of a constraint47
Number of terms in the objective function 85
Biggest coefficient in the objective function 517
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 15494
Number of bits of the sum of numbers in the objective function 14
Biggest number in a constraint 1656
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 15494
Number of bits of the biggest sum of numbers14
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |   wbo:                     1.72 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3727281-1338652610.opb.
0.00/0.00	c Instance file HOME/instance-3727281-1338652610.opb
0.00/0.00	c File size is 3601 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 12251
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      89                                                  |
0.00/0.00	c |  Number Clauses:        2                                                   |
0.00/0.00	c |  Number Cardinality:    15                                                  |
0.00/0.00	c |  Number PB Constraints: 11                                                  |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    PB Constraint                                       |
0.00/0.00	c |                                                                             |
0.00/0.00	c ============================[ Search Statistics ]==============================
0.00/0.00	c | Time (s)  | ID |      Bound      |               Shared Clauses             |
0.00/0.00	c |           |    | value      type |  expCls         impCls        Lit/impCl  |
0.00/0.00	c ===============================================================================
0.00/0.00	c | 0.00      | 0  | 7            lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 10           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 49           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 69           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 78           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 85           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 86           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 92           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 93           lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 171          lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 172          lb |  0                0                0.00  |
0.00/0.00	c | 0.00      | 0  | 178          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 179          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 257          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 278          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 322          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 323          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 325          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 329          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 330          lb |  0                0                0.00  |
0.00/0.00	c | 0.01      | 0  | 331          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 333          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 334          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 335          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 336          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 337          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 338          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 340          lb |  0                0                0.00  |
0.00/0.01	c | 0.01      | 0  | 341          lb |  0                0                0.00  |
0.00/0.01	c | 0.02      | 0  | 342          lb |  0                0                0.00  |
0.00/0.01	c | 0.02      | 0  | 343          lb |  0                0                0.00  |
0.00/0.01	c | 0.02      | 0  | 344          lb |  0                0                0.00  |
0.00/0.02	c | 0.02      | 0  | 345          lb |  0                0                0.00  |
0.00/0.02	c | 0.02      | 0  | 346          lb |  0                0                0.00  |
0.01/0.02	c | 0.02      | 0  | 348          lb |  0                0                0.00  |
0.01/0.02	c | 0.02      | 0  | 349          lb |  0                0                0.00  |
0.01/0.02	c | 0.03      | 0  | 351          lb |  0                0                0.00  |
0.01/0.02	c | 0.03      | 0  | 352          lb |  0                0                0.00  |
0.01/0.03	c | 0.03      | 0  | 353          lb |  0                0                0.00  |
0.01/0.03	c | 0.03      | 0  | 354          lb |  0                0                0.00  |
0.01/0.03	c | 0.03      | 0  | 355          lb |  0                0                0.00  |
0.01/0.03	c | 0.04      | 0  | 356          lb |  0                0                0.00  |
0.01/0.03	c | 0.04      | 0  | 357          lb |  0                0                0.00  |
0.01/0.04	c | 0.04      | 0  | 358          lb |  0                0                0.00  |
0.01/0.04	c | 0.04      | 0  | 359          lb |  0                0                0.00  |
0.01/0.04	c | 0.04      | 0  | 367          lb |  0                0                0.00  |
0.01/0.04	c | 0.05      | 0  | 368          lb |  0                0                0.00  |
0.01/0.04	c | 0.05      | 0  | 376          lb |  0                0                0.00  |
0.01/0.05	c | 0.05      | 0  | 377          lb |  0                0                0.00  |
0.01/0.05	c | 0.05      | 0  | 378          lb |  0                0                0.00  |
0.01/0.05	c | 0.05      | 0  | 380          lb |  0                0                0.00  |
0.01/0.05	c | 0.06      | 0  | 382          lb |  0                0                0.00  |
0.01/0.06	c | 0.06      | 0  | 383          lb |  0                0                0.00  |
0.01/0.06	c | 0.06      | 0  | 384          lb |  0                0                0.00  |
0.01/0.06	c | 0.07      | 0  | 385          lb |  0                0                0.00  |
0.01/0.07	c | 0.07      | 0  | 386          lb |  0                0                0.00  |
0.01/0.07	c | 0.07      | 0  | 387          lb |  0                0                0.00  |
0.01/0.07	c | 0.08      | 0  | 388          lb |  0                0                0.00  |
0.01/0.08	c | 0.08      | 0  | 389          lb |  0                0                0.00  |
0.01/0.08	c | 0.09      | 0  | 390          lb |  0                0                0.00  |
0.01/0.09	c | 0.09      | 0  | 464          lb |  0                0                0.00  |
0.01/0.09	c | 0.09      | 0  | 465          lb |  0                0                0.00  |
0.01/0.09	c | 0.10      | 0  | 466          lb |  0                0                0.00  |
0.09/0.10	c | 0.10      | 0  | 467          lb |  0                0                0.00  |
0.09/0.10	c | 0.11      | 0  | 468          lb |  0                0                0.00  |
0.09/0.11	c | 0.11      | 0  | 469          lb |  0                0                0.00  |
0.09/0.11	c | 0.12      | 0  | 470          lb |  0                0                0.00  |
0.09/0.12	c | 0.12      | 0  | 471          lb |  0                0                0.00  |
0.09/0.12	c | 0.13      | 0  | 472          lb |  0                0                0.00  |
0.09/0.13	c | 0.13      | 0  | 473          lb |  0                0                0.00  |
0.09/0.13	c | 0.14      | 0  | 477          lb |  0                0                0.00  |
0.09/0.14	c | 0.14      | 0  | 478          lb |  0                0                0.00  |
0.09/0.14	c | 0.14      | 0  | 479          lb |  0                0                0.00  |
0.09/0.15	c | 0.15      | 0  | 480          lb |  0                0                0.00  |
0.09/0.15	c | 0.16      | 0  | 481          lb |  0                0                0.00  |
0.09/0.16	c | 0.16      | 0  | 482          lb |  0                0                0.00  |
0.09/0.16	c | 0.17      | 0  | 483          lb |  0                0                0.00  |
0.09/0.17	c | 0.18      | 0  | 484          lb |  0                0                0.00  |
0.09/0.18	c | 0.19      | 0  | 485          lb |  0                0                0.00  |
0.09/0.19	c | 0.19      | 0  | 486          lb |  0                0                0.00  |
0.09/0.19	c | 0.20      | 0  | 487          lb |  0                0                0.00  |
0.19/0.20	c | 0.20      | 0  | 488          lb |  0                0                0.00  |
0.19/0.21	c | 0.21      | 0  | 489          lb |  0                0                0.00  |
0.19/0.21	c | 0.22      | 0  | 490          lb |  0                0                0.00  |
0.19/0.22	c | 0.23      | 0  | 491          lb |  0                0                0.00  |
0.19/0.23	c | 0.23      | 0  | 493          lb |  0                0                0.00  |
0.19/0.23	c | 0.24      | 0  | 494          lb |  0                0                0.00  |
0.19/0.24	c | 0.25      | 0  | 495          lb |  0                0                0.00  |
0.19/0.25	c | 0.26      | 0  | 496          lb |  0                0                0.00  |
0.19/0.27	c | 0.28      | 0  | 497          lb |  0                0                0.00  |
0.19/0.29	c | 0.29      | 0  | 498          lb |  0                0                0.00  |
0.29/0.30	c | 0.30      | 0  | 499          lb |  0                0                0.00  |
0.29/0.31	c | 0.32      | 0  | 500          lb |  0                0                0.00  |
0.29/0.33	c | 0.33      | 0  | 501          lb |  0                0                0.00  |
0.29/0.35	c | 0.35      | 0  | 502          lb |  0                0                0.00  |
0.29/0.36	c | 0.37      | 0  | 503          lb |  0                0                0.00  |
0.29/0.38	c | 0.39      | 0  | 504          lb |  0                0                0.00  |
0.39/0.40	c | 0.41      | 0  | 505          lb |  0                0                0.00  |
0.39/0.42	c | 0.42      | 0  | 506          lb |  0                0                0.00  |
0.39/0.44	c | 0.44      | 0  | 507          lb |  0                0                0.00  |
0.39/0.45	c | 0.46      | 0  | 508          lb |  0                0                0.00  |
0.39/0.47	c | 0.47      | 0  | 509          lb |  0                0                0.00  |
0.39/0.49	c | 0.49      | 0  | 510          lb |  0                0                0.00  |
0.49/0.51	c | 0.51      | 0  | 511          lb |  0                0                0.00  |
0.49/0.53	c | 0.54      | 0  | 512          lb |  0                0                0.00  |
0.49/0.55	c | 0.55      | 0  | 513          lb |  0                0                0.00  |
0.49/0.57	c | 0.58      | 0  | 514          lb |  0                0                0.00  |
0.59/0.60	c | 0.60      | 0  | 515          lb |  0                0                0.00  |
0.59/0.62	c | 0.62      | 0  | 516          lb |  0                0                0.00  |
0.59/0.64	c | 0.64      | 0  | 517          lb |  0                0                0.00  |
0.59/0.66	c | 0.67      | 0  | 518          lb |  0                0                0.00  |
0.69/0.70	c | 0.70      | 0  | 519          lb |  0                0                0.00  |
0.69/0.72	c | 0.72      | 0  | 520          lb |  0                0                0.00  |
0.69/0.75	c | 0.75      | 0  | 521          lb |  0                0                0.00  |
0.69/0.77	c | 0.77      | 0  | 522          lb |  0                0                0.00  |
0.79/0.80	c | 0.80      | 0  | 523          lb |  0                0                0.00  |
0.79/0.83	c | 0.83      | 0  | 524          lb |  0                0                0.00  |
0.79/0.85	c | 0.85      | 0  | 525          lb |  0                0                0.00  |
0.79/0.87	c | 0.88      | 0  | 526          lb |  0                0                0.00  |
0.79/0.89	c | 0.90      | 0  | 527          lb |  0                0                0.00  |
0.89/0.92	c | 0.93      | 0  | 528          lb |  0                0                0.00  |
0.89/0.94	c | 0.95      | 0  | 529          lb |  0                0                0.00  |
0.89/0.97	c | 0.98      | 0  | 530          lb |  0                0                0.00  |
0.89/1.00	c | 1.00      | 0  | 531          lb |  0                0                0.00  |
0.99/1.02	c | 1.03      | 0  | 532          lb |  0                0                0.00  |
0.99/1.05	c | 1.05      | 0  | 533          lb |  0                0                0.00  |
0.99/1.07	c | 1.08      | 0  | 534          lb |  0                0                0.00  |
1.09/1.11	c | 1.12      | 0  | 535          lb |  0                0                0.00  |
1.09/1.14	c | 1.14      | 0  | 536          lb |  0                0                0.00  |
1.09/1.19	c | 1.19      | 0  | 537          lb |  0                0                0.00  |
1.19/1.27	c | 1.27      | 0  | 538          lb |  0                0                0.00  |
1.39/1.40	c | 1.40      | 0  | 539          lb |  0                0                0.00  |
1.39/1.47	c | 1.48      | 0  | 540          lb |  0                0                0.00  |
1.49/1.55	c | 1.56      | 0  | 541          lb |  0                0                0.00  |
1.78/1.83	c | 1.84      | 0  | 542          lb |  0                0                0.00  |
2.08/2.16	c | 2.17      | 0  | 543          lb |  0                0                0.00  |
2.69/2.77	c | 2.78      | 0  | 544          lb |  0                0                0.00  |
4.19/4.20	c | 4.21      | 0  | 545          lb |  0                0                0.00  |
8.49/8.51	c | 8.51      | 0  | 546          lb |  0                0                0.00  |
19.80/19.90	c | 19.90     | 0  | 547          lb |  0                0                0.00  |
224.24/224.33	c | 224.34    | 0  | 548          lb |  0                0                0.00  |
1799.62/1800.00	c ===============================================================================
1799.62/1800.00	c Wall Clock Time: 1800.00 s
1799.62/1800.00	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3727281-1338652610/watcher-3727281-1338652610 -o /tmp/evaluation-result-3727281-1338652610/solver-3727281-1338652610 -C 1800 -W 1900 -M 15500 wbo1.72 -file-format=opb HOME/instance-3727281-1338652610.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.90 3/175 16291
/proc/meminfo: memFree=28109900/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=0 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 830 0 0 0 0 0 0 0 20 0 2 0 331386887 85585920 782 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 782 191 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=0 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 131 0 0 0 0 0 0 0 20 0 2 0 331386888 85585920 782 33554432000 4194304 5964350 140735167267392 140735127557256 4395259 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0

[startup+0.0234121 s]
/proc/loadavg: 1.92 1.98 1.90 3/175 16291
/proc/meminfo: memFree=28109900/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=0.01 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 996 0 0 0 1 0 0 0 20 0 2 0 331386887 85585920 948 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 948 193 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=0.01 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 297 0 0 0 1 0 0 0 20 0 2 0 331386888 85585920 948 33554432000 4194304 5964350 140735167267392 140735127557256 4222416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 83580

[startup+0.100288 s]
/proc/loadavg: 1.92 1.98 1.90 3/175 16291
/proc/meminfo: memFree=28109900/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=0.09 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 1445 0 0 0 9 0 0 0 20 0 2 0 331386887 85585920 1352 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 1352 194 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=0.08 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 746 0 0 0 8 0 0 0 20 0 2 0 331386888 85585920 1352 33554432000 4194304 5964350 140735167267392 140735127557256 5133600 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 83580

[startup+0.300253 s]
/proc/loadavg: 1.92 1.98 1.90 3/175 16291
/proc/meminfo: memFree=28109900/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=84156 CPUtime=0.29 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 2765 0 0 0 29 0 0 0 20 0 2 0 331386887 86175744 1867 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 21039 1867 195 433 0 20603 0
[pid=16291/tid=16292] ppid=16289 vsize=84156 CPUtime=0.28 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 2066 0 0 0 28 0 0 0 20 0 2 0 331386888 86175744 1867 33554432000 4194304 5964350 140735167267392 140735127557256 4403337 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 84156

[startup+0.700278 s]
/proc/loadavg: 1.92 1.98 1.90 3/175 16291
/proc/meminfo: memFree=28109900/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=0.69 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 3902 0 0 0 69 0 0 0 20 0 2 0 331386887 85585920 2455 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 2455 195 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=0.68 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 3203 0 0 0 68 0 0 0 20 0 2 0 331386888 85585920 2455 33554432000 4194304 5964350 140735167267392 140735127557256 4403544 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 83580

[startup+1.50026 s]
/proc/loadavg: 1.92 1.98 1.90 3/177 16293
/proc/meminfo: memFree=28096600/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=1.49 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 5919 0 0 0 149 0 0 0 20 0 2 0 331386887 85585920 3236 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 3236 195 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=1.48 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 5220 0 0 0 148 0 0 0 20 0 2 0 331386888 85585920 3236 33554432000 4194304 5964350 140735167267392 140061038119752 4392627 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 83580

[startup+3.10026 s]
/proc/loadavg: 1.92 1.98 1.90 3/177 16293
/proc/meminfo: memFree=28088716/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=3.09 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 7398 0 0 0 308 1 0 0 20 0 2 0 331386887 85585920 4166 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 4166 195 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=3.08 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 6699 0 0 0 308 0 0 0 20 0 2 0 331386888 85585920 4166 33554432000 4194304 5964350 140735167267392 140061038119864 4400007 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 83580

[startup+6.30028 s]
/proc/loadavg: 1.93 1.98 1.90 3/177 16293
/proc/meminfo: memFree=28079564/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=6.29 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 8185 0 0 0 628 1 0 0 20 0 2 0 331386887 85585920 4952 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 4952 195 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=6.28 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 7486 0 0 0 627 1 0 0 20 0 2 0 331386888 85585920 4952 33554432000 4194304 5964350 140735167267392 140061038119272 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 83580

[startup+12.7003 s]
/proc/loadavg: 1.93 1.98 1.91 3/177 16293
/proc/meminfo: memFree=28063136/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=83580 CPUtime=12.69 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 9933 0 0 0 1268 1 0 0 20 0 2 0 331386887 85585920 6699 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 20895 6699 195 433 0 20459 0
[pid=16291/tid=16292] ppid=16289 vsize=83580 CPUtime=12.69 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 9234 0 0 0 1267 2 0 0 20 0 2 0 331386888 85585920 6699 33554432000 4194304 5964350 140735167267392 140061038119240 4400539 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 83580

[startup+25.5003 s]
/proc/loadavg: 1.95 1.98 1.91 3/177 16293
/proc/meminfo: memFree=28038924/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=85508 CPUtime=25.49 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 12868 0 0 0 2547 2 0 0 20 0 2 0 331386887 87560192 9308 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 21377 9308 195 433 0 20941 0
[pid=16291/tid=16292] ppid=16289 vsize=85508 CPUtime=25.49 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 12169 0 0 0 2546 3 0 0 20 0 2 0 331386888 87560192 9308 33554432000 4194304 5964350 140735167267392 140061038119272 4222464 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 85508

[startup+51.1004 s]
/proc/loadavg: 1.96 1.98 1.91 3/177 16293
/proc/meminfo: memFree=28015528/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=85508 CPUtime=51.07 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 14379 0 0 0 5105 2 0 0 20 0 2 0 331386887 87560192 10851 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 21377 10851 195 433 0 20941 0
[pid=16291/tid=16292] ppid=16289 vsize=85508 CPUtime=51.07 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 13680 0 0 0 5104 3 0 0 20 0 2 0 331386888 87560192 10851 33554432000 4194304 5964350 140735167267392 140061038118904 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 85508

[startup+102.3 s]
/proc/loadavg: 1.98 1.98 1.91 3/177 16293
/proc/meminfo: memFree=27966804/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=151768 CPUtime=102.27 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 21590 0 0 0 10221 6 0 0 20 0 2 0 331386887 155410432 18302 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 37942 18302 195 433 0 37506 0
[pid=16291/tid=16292] ppid=16289 vsize=151768 CPUtime=102.28 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 20891 0 0 0 10220 8 0 0 20 0 2 0 331386888 155410432 18302 33554432000 4194304 5964350 140735167267392 140061038118712 4400552 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 151768

[startup+162.3 s]
/proc/loadavg: 1.99 1.98 1.91 3/177 16293
/proc/meminfo: memFree=27897392/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=152128 CPUtime=162.25 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 30141 0 0 0 16214 11 0 0 20 0 2 0 331386887 155779072 26905 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 38032 26905 195 433 0 37596 0
[pid=16291/tid=16292] ppid=16289 vsize=152128 CPUtime=162.27 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 29442 0 0 0 16213 14 0 0 20 0 2 0 331386888 155779072 26905 33554432000 4194304 5964350 140735167267392 140061038118904 4403462 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 152128

[startup+222.307 s]
/proc/loadavg: 2.03 2.00 1.91 3/178 16296
/proc/meminfo: memFree=27818596/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=217664 CPUtime=222.24 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 41250 0 0 0 22209 15 0 0 20 0 2 0 331386887 222887936 38014 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 54416 38014 195 433 0 53980 0
[pid=16291/tid=16292] ppid=16289 vsize=217664 CPUtime=222.27 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 40551 0 0 0 22208 19 0 0 20 0 2 0 331386888 222887936 38014 33554432000 4194304 5964350 140735167267392 140061038118968 4481056 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 222.24
Current children cumulated vsize (KiB) 217664

[startup+282.3 s]
/proc/loadavg: 2.06 2.01 1.92 3/178 16320
/proc/meminfo: memFree=27777120/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=216580 CPUtime=282.23 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 44733 0 0 0 28207 16 0 0 20 0 2 0 331386887 221777920 40594 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 54145 40594 195 433 0 53709 0
[pid=16291/tid=16292] ppid=16289 vsize=216580 CPUtime=282.26 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 44034 0 0 0 28205 21 0 0 20 0 2 0 331386888 221777920 40594 33554432000 4194304 5964350 140735167267392 140061038119864 4390798 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 216580

[startup+342.3 s]
/proc/loadavg: 2.02 2.01 1.92 3/177 16320
/proc/meminfo: memFree=27747272/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=216580 CPUtime=342.21 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 44745 0 0 0 34205 16 0 0 20 0 2 0 331386887 221777920 40609 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 54145 40609 195 433 0 53709 0
[pid=16291/tid=16292] ppid=16289 vsize=216580 CPUtime=342.26 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 44046 0 0 0 34204 22 0 0 20 0 2 0 331386888 221777920 40609 33554432000 4194304 5964350 140735167267392 140061038119864 4403501 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 342.21
Current children cumulated vsize (KiB) 216580

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 1.92 3/176 16320
/proc/meminfo: memFree=27717476/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=216580 CPUtime=402.2 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 44746 0 0 0 40204 16 0 0 20 0 2 0 331386887 221777920 40708 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0

################
# More data... #
################

/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 88801 0 0 0 124166 60 0 0 20 0 2 0 331386888 424767488 86173 33554432000 4194304 5964350 140735167267392 140061038118712 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1242.04
Current children cumulated vsize (KiB) 414812

[startup+1302.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16327
/proc/meminfo: memFree=27241140/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=414812 CPUtime=1302.03 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 90669 0 0 0 130160 43 0 0 20 0 2 0 331386887 424767488 87342 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 103703 87342 195 433 0 103267 0
[pid=16291/tid=16292] ppid=16289 vsize=414812 CPUtime=1302.26 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 89970 0 0 0 130164 62 0 0 20 0 2 0 331386888 424767488 87342 33554432000 4194304 5964350 140735167267392 140061038118712 4389080 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1302.03
Current children cumulated vsize (KiB) 414812

[startup+1362.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16327
/proc/meminfo: memFree=27220804/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=414812 CPUtime=1362.02 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 90711 0 0 0 136159 43 0 0 20 0 2 0 331386887 424767488 87384 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 103703 87384 195 433 0 103267 0
[pid=16291/tid=16292] ppid=16289 vsize=414812 CPUtime=1362.26 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 90012 0 0 0 136163 63 0 0 20 0 2 0 331386888 424767488 87384 33554432000 4194304 5964350 140735167267392 140061038118712 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1362.02
Current children cumulated vsize (KiB) 414812

[startup+1422.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/178 16330
/proc/meminfo: memFree=27202320/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=414812 CPUtime=1422.02 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 91409 0 0 0 142159 43 0 0 20 0 2 0 331386887 424767488 88082 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 103703 88082 195 433 0 103267 0
[pid=16291/tid=16292] ppid=16289 vsize=414812 CPUtime=1422.27 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 90710 0 0 0 142162 65 0 0 20 0 2 0 331386888 424767488 88082 33554432000 4194304 5964350 140735167267392 140061038118952 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 414812

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16331
/proc/meminfo: memFree=27161160/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=414812 CPUtime=1482.01 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 99442 0 0 0 148152 49 0 0 20 0 2 0 331386887 424767488 96115 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 103703 96115 195 433 0 103267 0
[pid=16291/tid=16292] ppid=16289 vsize=414812 CPUtime=1482.27 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 98743 0 0 0 148156 71 0 0 20 0 2 0 331386888 424767488 96115 33554432000 4194304 5964350 140735167267392 140061038118712 4400342 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1482.01
Current children cumulated vsize (KiB) 414812

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16331
/proc/meminfo: memFree=27132344/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=414812 CPUtime=1541.99 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 101198 0 0 0 154149 50 0 0 20 0 2 0 331386887 424767488 98107 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 103703 98107 195 433 0 103267 0
[pid=16291/tid=16292] ppid=16289 vsize=414812 CPUtime=1542.26 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 100499 0 0 0 154153 73 0 0 20 0 2 0 331386888 424767488 98107 33554432000 4194304 5964350 140735167267392 140061038118904 4388770 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1541.99
Current children cumulated vsize (KiB) 414812

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16331
/proc/meminfo: memFree=27098196/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=480348 CPUtime=1601.94 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 106734 0 0 0 160140 54 0 0 20 0 2 0 331386887 491876352 103722 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120087 103722 195 433 0 119651 0
[pid=16291/tid=16292] ppid=16289 vsize=480348 CPUtime=1602.23 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 106035 0 0 0 160144 79 0 0 20 0 2 0 331386888 491876352 103722 33554432000 4194304 5964350 140735167267392 140061038118712 4388992 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1601.94
Current children cumulated vsize (KiB) 480348

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16331
/proc/meminfo: memFree=27086156/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=480348 CPUtime=1661.93 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 109347 0 0 0 166137 56 0 0 20 0 2 0 331386887 491876352 106335 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120087 106335 195 433 0 119651 0
[pid=16291/tid=16292] ppid=16289 vsize=480348 CPUtime=1662.23 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 108648 0 0 0 166141 82 0 0 20 0 2 0 331386888 491876352 106335 33554432000 4194304 5964350 140735167267392 140061038118904 4389005 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1661.93
Current children cumulated vsize (KiB) 480348

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16331
/proc/meminfo: memFree=27043500/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1721.92 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 114559 0 0 0 172131 61 0 0 20 0 2 0 331386887 492703744 111547 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 111547 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1722.23 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 113860 0 0 0 172135 88 0 0 20 0 2 0 331386888 492703744 111547 33554432000 4194304 5964350 140735167267392 140061038118712 4399926 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1721.92
Current children cumulated vsize (KiB) 481156

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16332
/proc/meminfo: memFree=27029072/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1781.91 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 114848 0 0 0 178130 61 0 0 20 0 2 0 331386887 492703744 111836 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 111836 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1782.24 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 114149 0 0 0 178135 89 0 0 20 0 2 0 331386888 492703744 111836 33554432000 4194304 5964350 140735167267392 140061038118712 4222416 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1781.91
Current children cumulated vsize (KiB) 481156

Solver just ended. Dumping a history of the last processes samples

[startup+1792.01 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16332
/proc/meminfo: memFree=27028572/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1791.63 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 114983 0 0 0 179101 62 0 0 20 0 2 0 331386887 492703744 111971 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 111971 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1791.94 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 114284 0 0 0 179105 89 0 0 20 0 2 0 331386888 492703744 111971 33554432000 4194304 5964350 140735167267392 140061038118904 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1791.63
Current children cumulated vsize (KiB) 481156

[startup+1795.2 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16332
/proc/meminfo: memFree=27027084/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1794.82 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 115371 0 0 0 179420 62 0 0 20 0 2 0 331386887 492703744 112359 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 112359 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1795.15 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 114672 0 0 0 179426 89 0 0 20 0 2 0 331386888 492703744 112359 33554432000 4194304 5964350 140735167267392 140061038118904 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1794.82
Current children cumulated vsize (KiB) 481156

[startup+1798.4 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16332
/proc/meminfo: memFree=27025596/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1798.01 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 115868 0 0 0 179739 62 0 0 20 0 2 0 331386887 492703744 112856 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 112856 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1798.34 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 115169 0 0 0 179744 90 0 0 20 0 2 0 331386888 492703744 112856 33554432000 4194304 5964350 140735167267392 140061038118904 4400439 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1798.01
Current children cumulated vsize (KiB) 481156

[startup+1799.2 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16371
/proc/meminfo: memFree=27660680/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1798.81 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 116024 0 0 0 179819 62 0 0 20 0 2 0 331386887 492703744 113012 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 113012 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1799.14 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 115325 0 0 0 179824 90 0 0 20 0 2 0 331386888 492703744 113012 33554432000 4194304 5964350 140735167267392 140061038118904 4399774 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1798.81
Current children cumulated vsize (KiB) 481156

[startup+1799.6 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16371
/proc/meminfo: memFree=27652248/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1799.22 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 116065 0 0 0 179860 62 0 0 20 0 2 0 331386887 492703744 113053 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 113053 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1799.55 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 115366 0 0 0 179865 90 0 0 20 0 2 0 331386888 492703744 113053 33554432000 4194304 5964350 140735167267392 140061038118904 4399840 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.22
Current children cumulated vsize (KiB) 481156

[startup+1800 s]
/proc/loadavg: 2.00 2.00 1.93 3/177 16371
/proc/meminfo: memFree=27652248/32873852 swapFree=6856/6856
[pid=16291] ppid=16289 vsize=481156 CPUtime=1799.62 cores=1,3,5,7
/proc/16291/stat : 16291 (wbo1.72) S 16289 16291 14594 0 -1 4202496 116112 0 0 0 179899 63 0 0 20 0 2 0 331386887 492703744 113100 33554432000 4194304 5964350 140735167267392 140735167266912 4546605 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/16291/statm: 120289 113100 195 433 0 119853 0
[pid=16291/tid=16292] ppid=16289 vsize=481156 CPUtime=1799.94 cores=1,3,5,7
/proc/16291/task/16292/stat : 16292 (wbo1.72) R 16289 16291 14594 0 -1 4202560 115413 0 0 0 179904 90 0 0 20 0 2 0 331386888 492703744 113100 33554432000 4194304 5964350 140735167267392 140061038118904 4222464 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.62
Current children cumulated vsize (KiB) 481156

Child status: 255
Real time (s): 1800.01
CPU time (s): 1799.97
CPU user time (s): 1799.05
CPU system time (s): 0.91886
CPU usage (%): 99.9976
Max. virtual memory (cumulated for all children) (KiB): 481156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.05
system time used= 0.91886
maximum resident set size= 452408
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 116114
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 163
involuntary context switches= 1844

runsolver used 3.14352 second user time and 8.78666 second system time

The end

Launcher Data 

Begin job on node128 at 2012-06-02 17:56:50
IDJOB=3727281
IDBENCH=1868
IDSOLVER=2313
FILE ID=node128/3727281-1338652610
RUNJOBID= node128-1338650806-16013
PBS_JOBID= 14636452
Free space on /tmp= 70504 MiB

SOLVER NAME= wbo 1.72
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib/normalized-mps-v2-20-10-lseu.opb
COMMAND LINE= wbo1.72 -file-format=opb BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3727281-1338652610/watcher-3727281-1338652610 -o /tmp/evaluation-result-3727281-1338652610/solver-3727281-1338652610 -C 1800 -W 1900 -M 15500  wbo1.72 -file-format=opb HOME/instance-3727281-1338652610.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9b4418c5c34f37121cd9ad7732df64ff
RANDOM SEED=145129159

node128.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        28110172 kB
Buffers:          522232 kB
Cached:          3328280 kB
SwapCached:          784 kB
Active:          1729556 kB
Inactive:        2143452 kB
Active(anon):      13420 kB
Inactive(anon):    11368 kB
Active(file):    1716136 kB
Inactive(file):  2132084 kB
Unevictable:        6856 kB
Mlocked:            6856 kB
SwapTotal:      67108856 kB
SwapFree:       67106552 kB
Dirty:             11364 kB
Writeback:             0 kB
AnonPages:         28396 kB
Mapped:            14816 kB
Shmem:               200 kB
Slab:             753148 kB
SReclaimable:     194824 kB
SUnreclaim:       558324 kB
KernelStack:        1456 kB
PageTables:         3700 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     142328 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70500 MiB
End job on node128 at 2012-06-02 18:26:50