Trace number 3705403

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
wbo 1.7? 1799.98 1800

General information on the benchmark

Name/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-1000opt.opb
MD5SUM6db624ef9d444e54f2daac91a1bb8591
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-78
Best CPU time to get the best result obtained on this benchmark1.01684
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables2025
Total number of constraints30658
Number of constraints which are clauses30658
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint3
Number of terms in the objective function 135
Biggest coefficient in the objective function 4
Number of bits for the biggest coefficient in the objective function 3
Sum of the numbers in the objective function 327
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 4
Number of bits of the biggest number in a constraint 3
Biggest sum of numbers in a constraint 327
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |   wbo:                    1.7 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3705403-1338106740.opb.
0.00/0.00	c Instance file HOME/instance-3705403-1338106740.opb
0.00/0.00	c File size is 1015615 bytes.
0.00/0.06	c Cost Offset: -327
0.00/0.06	c Highest Coefficient sum: 4
0.00/0.06	c ============================[ Problem Statistics ]=============================
0.00/0.06	c |                                                                             |
0.00/0.06	c |  Parsing time:          0.07         s                                      |
0.00/0.06	c |  Number Variables:      2025                                                |
0.00/0.06	c |  Number Clauses:        30658                                               |
0.00/0.06	c |  Number Cardinality:    0                                                   |
0.00/0.06	c |  Number PB Constraints: 0                                                   |
0.00/0.06	c |                                                                             |
0.00/0.07	c |  Problem Type:          Optimization                                        |
0.00/0.07	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.07	c |                                                                             |
0.00/0.07	c ============================[ Search Statistics ]==============================
0.00/0.07	c | Time (s)  | ID |      Bound      |               Shared Clauses             |
0.00/0.07	c |           |    | value      type |  expCls         impCls        Lit/impCl  |
0.00/0.07	c ===============================================================================
0.00/0.08	c | 0.08      | 0  | -326         lb |  0                0                0.00  |
0.00/0.09	c | 0.09      | 0  | -325         lb |  0                0                0.00  |
0.09/0.10	c | 0.10      | 0  | -324         lb |  0                0                0.00  |
0.09/0.10	c | 0.11      | 0  | -323         lb |  0                0                0.00  |
0.09/0.11	c | 0.12      | 0  | -322         lb |  0                0                0.00  |
0.09/0.12	c | 0.12      | 0  | -321         lb |  0                0                0.00  |
0.09/0.13	c | 0.13      | 0  | -319         lb |  0                0                0.00  |
0.09/0.14	c | 0.14      | 0  | -318         lb |  0                0                0.00  |
0.09/0.15	c | 0.15      | 0  | -316         lb |  0                0                0.00  |
0.09/0.15	c | 0.16      | 0  | -315         lb |  0                0                0.00  |
0.09/0.16	c | 0.17      | 0  | -314         lb |  0                0                0.00  |
0.09/0.17	c | 0.17      | 0  | -313         lb |  0                0                0.00  |
0.09/0.18	c | 0.18      | 0  | -311         lb |  0                0                0.00  |
0.09/0.19	c | 0.19      | 0  | -310         lb |  0                0                0.00  |
0.19/0.20	c | 0.20      | 0  | -309         lb |  0                0                0.00  |
0.19/0.20	c | 0.21      | 0  | -307         lb |  0                0                0.00  |
0.19/0.21	c | 0.22      | 0  | -306         lb |  0                0                0.00  |
0.19/0.22	c | 0.23      | 0  | -305         lb |  0                0                0.00  |
0.19/0.23	c | 0.23      | 0  | -304         lb |  0                0                0.00  |
0.19/0.24	c | 0.24      | 0  | -303         lb |  0                0                0.00  |
0.19/0.25	c | 0.25      | 0  | -302         lb |  0                0                0.00  |
0.19/0.25	c | 0.26      | 0  | -301         lb |  0                0                0.00  |
0.19/0.26	c | 0.27      | 0  | -300         lb |  0                0                0.00  |
0.19/0.27	c | 0.28      | 0  | -299         lb |  0                0                0.00  |
0.19/0.28	c | 0.28      | 0  | -298         lb |  0                0                0.00  |
0.19/0.29	c | 0.29      | 0  | -297         lb |  0                0                0.00  |
0.29/0.30	c | 0.30      | 0  | -294         lb |  0                0                0.00  |
0.29/0.31	c | 0.31      | 0  | -292         lb |  0                0                0.00  |
0.29/0.31	c | 0.32      | 0  | -291         lb |  0                0                0.00  |
0.29/0.32	c | 0.33      | 0  | -290         lb |  0                0                0.00  |
0.29/0.33	c | 0.33      | 0  | -289         lb |  0                0                0.00  |
0.29/0.34	c | 0.34      | 0  | -288         lb |  0                0                0.00  |
0.29/0.35	c | 0.35      | 0  | -286         lb |  0                0                0.00  |
0.29/0.36	c | 0.36      | 0  | -285         lb |  0                0                0.00  |
0.29/0.36	c | 0.37      | 0  | -284         lb |  0                0                0.00  |
0.29/0.37	c | 0.38      | 0  | -282         lb |  0                0                0.00  |
0.29/0.38	c | 0.39      | 0  | -281         lb |  0                0                0.00  |
0.29/0.39	c | 0.39      | 0  | -280         lb |  0                0                0.00  |
0.39/0.40	c | 0.40      | 0  | -278         lb |  0                0                0.00  |
0.39/0.41	c | 0.41      | 0  | -276         lb |  0                0                0.00  |
0.39/0.42	c | 0.42      | 0  | -275         lb |  0                0                0.00  |
0.39/0.42	c | 0.43      | 0  | -274         lb |  0                0                0.00  |
0.39/0.43	c | 0.44      | 0  | -273         lb |  0                0                0.00  |
0.39/0.44	c | 0.45      | 0  | -271         lb |  0                0                0.00  |
0.39/0.45	c | 0.45      | 0  | -270         lb |  0                0                0.00  |
0.39/0.46	c | 0.46      | 0  | -268         lb |  0                0                0.00  |
0.39/0.47	c | 0.47      | 0  | -267         lb |  0                0                0.00  |
0.39/0.48	c | 0.48      | 0  | -266         lb |  0                0                0.00  |
0.39/0.49	c | 0.49      | 0  | -264         lb |  0                0                0.00  |
0.49/0.50	c | 0.50      | 0  | -263         lb |  0                0                0.00  |
0.49/0.50	c | 0.51      | 0  | -262         lb |  0                0                0.00  |
0.49/0.51	c | 0.52      | 0  | -260         lb |  0                0                0.00  |
0.49/0.52	c | 0.53      | 0  | -259         lb |  0                0                0.00  |
0.49/0.53	c | 0.54      | 0  | -256         lb |  0                0                0.00  |
0.49/0.54	c | 0.55      | 0  | -255         lb |  0                0                0.00  |
0.49/0.55	c | 0.56      | 0  | -254         lb |  0                0                0.00  |
0.49/0.56	c | 0.56      | 0  | -251         lb |  0                0                0.00  |
0.49/0.57	c | 0.57      | 0  | -249         lb |  0                0                0.00  |
0.49/0.58	c | 0.58      | 0  | -247         lb |  0                0                0.00  |
0.49/0.59	c | 0.59      | 0  | -246         lb |  0                0                0.00  |
0.59/0.60	c | 0.61      | 0  | -245         lb |  0                0                0.00  |
0.59/0.61	c | 0.62      | 0  | -244         lb |  0                0                0.00  |
0.59/0.62	c | 0.63      | 0  | -243         lb |  0                0                0.00  |
0.59/0.63	c | 0.64      | 0  | -242         lb |  0                0                0.00  |
0.59/0.64	c | 0.65      | 0  | -241         lb |  0                0                0.00  |
0.59/0.66	c | 0.66      | 0  | -240         lb |  0                0                0.00  |
0.59/0.67	c | 0.67      | 0  | -239         lb |  0                0                0.00  |
0.59/0.68	c | 0.68      | 0  | -238         lb |  0                0                0.00  |
0.59/0.69	c | 0.69      | 0  | -237         lb |  0                0                0.00  |
0.69/0.70	c | 0.70      | 0  | -236         lb |  0                0                0.00  |
0.69/0.71	c | 0.72      | 0  | -235         lb |  0                0                0.00  |
0.69/0.72	c | 0.73      | 0  | -234         lb |  0                0                0.00  |
0.69/0.73	c | 0.74      | 0  | -233         lb |  0                0                0.00  |
0.69/0.75	c | 0.75      | 0  | -232         lb |  0                0                0.00  |
0.69/0.76	c | 0.76      | 0  | -231         lb |  0                0                0.00  |
0.69/0.77	c | 0.77      | 0  | -230         lb |  0                0                0.00  |
0.69/0.78	c | 0.79      | 0  | -229         lb |  0                0                0.00  |
0.69/0.79	c | 0.80      | 0  | -228         lb |  0                0                0.00  |
0.79/0.81	c | 0.81      | 0  | -227         lb |  0                0                0.00  |
0.79/0.82	c | 0.82      | 0  | -226         lb |  0                0                0.00  |
0.79/0.83	c | 0.83      | 0  | -225         lb |  0                0                0.00  |
0.79/0.84	c | 0.84      | 0  | -224         lb |  0                0                0.00  |
0.79/0.85	c | 0.86      | 0  | -223         lb |  0                0                0.00  |
0.79/0.87	c | 0.87      | 0  | -222         lb |  0                0                0.00  |
0.79/0.88	c | 0.88      | 0  | -221         lb |  0                0                0.00  |
0.79/0.89	c | 0.89      | 0  | -220         lb |  0                0                0.00  |
0.89/0.90	c | 0.91      | 0  | -219         lb |  0                0                0.00  |
0.89/0.92	c | 0.92      | 0  | -218         lb |  0                0                0.00  |
0.89/0.93	c | 0.93      | 0  | -217         lb |  0                0                0.00  |
0.89/0.94	c | 0.94      | 0  | -216         lb |  0                0                0.00  |
0.89/0.95	c | 0.96      | 0  | -215         lb |  0                0                0.00  |
0.89/0.97	c | 0.97      | 0  | -214         lb |  0                0                0.00  |
0.89/0.98	c | 0.98      | 0  | -213         lb |  0                0                0.00  |
0.89/0.99	c | 0.99      | 0  | -212         lb |  0                0                0.00  |
0.99/1.01	c | 1.01      | 0  | -211         lb |  0                0                0.00  |
0.99/1.02	c | 1.02      | 0  | -210         lb |  0                0                0.00  |
0.99/1.03	c | 1.03      | 0  | -209         lb |  0                0                0.00  |
0.99/1.04	c | 1.05      | 0  | -208         lb |  0                0                0.00  |
0.99/1.06	c | 1.06      | 0  | -207         lb |  0                0                0.00  |
0.99/1.07	c | 1.07      | 0  | -206         lb |  0                0                0.00  |
0.99/1.08	c | 1.09      | 0  | -205         lb |  0                0                0.00  |
0.99/1.10	c | 1.10      | 0  | -204         lb |  0                0                0.00  |
1.09/1.11	c | 1.11      | 0  | -203         lb |  0                0                0.00  |
1.09/1.12	c | 1.13      | 0  | -202         lb |  0                0                0.00  |
1.09/1.13	c | 1.14      | 0  | -201         lb |  0                0                0.00  |
1.09/1.15	c | 1.15      | 0  | -200         lb |  0                0                0.00  |
1.09/1.16	c | 1.17      | 0  | -199         lb |  0                0                0.00  |
1.09/1.18	c | 1.18      | 0  | -198         lb |  0                0                0.00  |
1.09/1.19	c | 1.19      | 0  | -197         lb |  0                0                0.00  |
1.18/1.20	c | 1.21      | 0  | -196         lb |  0                0                0.00  |
1.18/1.21	c | 1.22      | 0  | -195         lb |  0                0                0.00  |
1.18/1.23	c | 1.23      | 0  | -194         lb |  0                0                0.00  |
1.18/1.24	c | 1.25      | 0  | -193         lb |  0                0                0.00  |
1.18/1.25	c | 1.26      | 0  | -192         lb |  0                0                0.00  |
1.18/1.27	c | 1.27      | 0  | -191         lb |  0                0                0.00  |
1.18/1.28	c | 1.28      | 0  | -190         lb |  0                0                0.00  |
1.18/1.29	c | 1.30      | 0  | -189         lb |  0                0                0.00  |
1.28/1.31	c | 1.31      | 0  | -188         lb |  0                0                0.00  |
1.28/1.32	c | 1.32      | 0  | -187         lb |  0                0                0.00  |
1.28/1.33	c | 1.34      | 0  | -186         lb |  0                0                0.00  |
1.28/1.35	c | 1.35      | 0  | -185         lb |  0                0                0.00  |
1.28/1.36	c | 1.36      | 0  | -184         lb |  0                0                0.00  |
1.28/1.37	c | 1.38      | 0  | -183         lb |  0                0                0.00  |
1.28/1.39	c | 1.39      | 0  | -182         lb |  0                0                0.00  |
1.38/1.40	c | 1.41      | 0  | -181         lb |  0                0                0.00  |
1.38/1.42	c | 1.42      | 0  | -180         lb |  0                0                0.00  |
1.38/1.43	c | 1.44      | 0  | -179         lb |  0                0                0.00  |
1.38/1.45	c | 1.45      | 0  | -178         lb |  0                0                0.00  |
1.38/1.46	c | 1.46      | 0  | -177         lb |  0                0                0.00  |
1.38/1.47	c | 1.48      | 0  | -176         lb |  0                0                0.00  |
1.38/1.49	c | 1.49      | 0  | -175         lb |  0                0                0.00  |
1.48/1.50	c | 1.50      | 0  | -174         lb |  0                0                0.00  |
1.48/1.51	c | 1.52      | 0  | -173         lb |  0                0                0.00  |
1.48/1.53	c | 1.53      | 0  | -172         lb |  0                0                0.00  |
1.48/1.54	c | 1.55      | 0  | -171         lb |  0                0                0.00  |
1.48/1.56	c | 1.56      | 0  | -170         lb |  0                0                0.00  |
1.48/1.57	c | 1.57      | 0  | -169         lb |  0                0                0.00  |
1.48/1.58	c | 1.59      | 0  | -168         lb |  0                0                0.00  |
1.58/1.60	c | 1.60      | 0  | -167         lb |  0                0                0.00  |
1.58/1.61	c | 1.61      | 0  | -166         lb |  0                0                0.00  |
1.58/1.63	c | 1.63      | 0  | -165         lb |  0                0                0.00  |
1.58/1.64	c | 1.64      | 0  | -164         lb |  0                0                0.00  |
1.58/1.66	c | 1.66      | 0  | -163         lb |  0                0                0.00  |
1.58/1.67	c | 1.68      | 0  | -162         lb |  0                0                0.00  |
1.58/1.69	c | 1.69      | 0  | -161         lb |  0                0                0.00  |
1.68/1.71	c | 1.71      | 0  | -160         lb |  0                0                0.00  |
1.68/1.72	c | 1.73      | 0  | -159         lb |  0                0                0.00  |
1.68/1.74	c | 1.75      | 0  | -158         lb |  0                0                0.00  |
1.68/1.77	c | 1.77      | 0  | -157         lb |  0                0                0.00  |
1.78/1.81	c | 1.81      | 0  | -156         lb |  0                0                0.00  |
1.78/1.84	c | 1.84      | 0  | -155         lb |  0                0                0.00  |
1.78/1.87	c | 1.87      | 0  | -154         lb |  0                0                0.00  |
1.88/1.95	c | 1.96      | 0  | -153         lb |  0                0                0.00  |
2.28/2.38	c | 2.38      | 0  | -152         lb |  0                0                0.00  |
13.88/13.99	c | 14.00     | 0  | -151         lb |  0                0                0.00  |
318.85/318.98	c | 318.99    | 0  | -150         lb |  0                0                0.00  |
1482.97/1483.39	c | 1483.39   | 0  | -149         lb |  0                0                0.00  |
1501.37/1501.73	c | 1501.74   | 0  | -148         lb |  0                0                0.00  |
1507.87/1508.25	c | 1508.26   | 0  | -147         lb |  0                0                0.00  |
1799.60/1800.00	c ===============================================================================
1799.60/1800.00	c Wall Clock Time: 1800.00 s
1799.60/1800.00	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3705403-1338106740/watcher-3705403-1338106740 -o /tmp/evaluation-result-3705403-1338106740/solver-3705403-1338106740 -C 1800 -W 1900 -M 15500 wbo1.7 -file-format=opb HOME/instance-3705403-1338106740.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 17411
/proc/meminfo: memFree=28260656/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=4604 CPUtime=0 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) R 17409 17411 15878 0 -1 4202496 436 0 0 0 0 0 0 0 20 0 1 0 276798553 4714496 388 33554432000 4194304 5963574 140734076533808 140733839287944 4344320 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 1151 388 172 432 0 468 0

[startup+0.097009 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 17411
/proc/meminfo: memFree=28260656/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=0.09 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 2879 0 0 0 9 0 0 0 20 0 2 0 276798553 88395776 2462 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 2462 194 432 0 21146 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 86324

[startup+0.100209 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 17411
/proc/meminfo: memFree=28260656/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=0.09 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 2941 0 0 0 9 0 0 0 20 0 2 0 276798553 88395776 2524 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 2524 194 432 0 21146 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 86324

[startup+0.300123 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 17411
/proc/meminfo: memFree=28260656/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=0.29 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 3381 0 0 0 29 0 0 0 20 0 2 0 276798553 88395776 2568 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 2568 194 432 0 21146 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 86324

[startup+0.70012 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 17411
/proc/meminfo: memFree=28260656/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=0.69 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 4134 0 0 0 69 0 0 0 20 0 2 0 276798553 88395776 2831 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 2831 194 432 0 21146 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 86324

[startup+1.50027 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17413
/proc/meminfo: memFree=28248728/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=1.48 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 5554 0 0 0 148 0 0 0 20 0 2 0 276798553 88395776 3067 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 3067 198 432 0 21146 0
[pid=17411/tid=17413] ppid=17409 vsize=86324 CPUtime=1.41 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 3870 0 0 0 141 0 0 0 20 0 2 0 276798560 88395776 3068 33554432000 4194304 5963574 140734076533808 139889513835032 4419071 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 86324

[startup+3.10025 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17413
/proc/meminfo: memFree=28243512/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=3.09 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 6955 0 0 0 308 1 0 0 20 0 2 0 276798553 88395776 4032 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 4032 198 432 0 21146 0
[pid=17411/tid=17413] ppid=17409 vsize=86324 CPUtime=3.01 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 5270 0 0 0 301 0 0 0 20 0 2 0 276798560 88395776 4032 33554432000 4194304 5963574 140734076533808 139889513834824 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 86324

[startup+6.30028 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17413
/proc/meminfo: memFree=28216356/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=6.29 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 8188 0 0 0 628 1 0 0 20 0 2 0 276798553 88395776 5265 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 5265 198 432 0 21146 0
[pid=17411/tid=17413] ppid=17409 vsize=86324 CPUtime=6.21 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 6503 0 0 0 620 1 0 0 20 0 2 0 276798560 88395776 5265 33554432000 4194304 5963574 140734076533808 139889513834488 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 86324

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17413
/proc/meminfo: memFree=28175244/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=12.68 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 9728 0 0 0 1267 1 0 0 20 0 2 0 276798553 88395776 6805 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 6805 198 432 0 21146 0
[pid=17411/tid=17413] ppid=17409 vsize=86324 CPUtime=12.61 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 8043 0 0 0 1259 2 0 0 20 0 2 0 276798560 88395776 6805 33554432000 4194304 5963574 140734076533808 139889513834296 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 86324

[startup+25.5003 s]
/proc/loadavg: 2.07 2.02 2.00 3/179 17413
/proc/meminfo: memFree=28160604/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86324 CPUtime=25.49 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 11767 0 0 0 2547 2 0 0 20 0 2 0 276798553 88395776 8844 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21581 8844 198 432 0 21146 0
[pid=17411/tid=17413] ppid=17409 vsize=86324 CPUtime=25.42 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 10082 0 0 0 2539 3 0 0 20 0 2 0 276798560 88395776 8844 33554432000 4194304 5963574 140734076533808 139889513834696 4399574 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 86324

[startup+51.1003 s]
/proc/loadavg: 2.04 2.01 2.00 3/179 17413
/proc/meminfo: memFree=28146172/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=86808 CPUtime=51.08 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 15436 0 0 0 5104 4 0 0 20 0 2 0 276798553 88891392 12512 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 21702 12512 198 432 0 21267 0
[pid=17411/tid=17413] ppid=17409 vsize=86808 CPUtime=51.02 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 13751 0 0 0 5097 5 0 0 20 0 2 0 276798560 88891392 12512 33554432000 4194304 5963574 140734076533808 139889513834296 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 86808

[startup+102.307 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 17416
/proc/meminfo: memFree=28113908/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=152584 CPUtime=102.27 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 23352 0 0 0 10220 7 0 0 20 0 2 0 276798553 156246016 20424 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 38146 20424 198 432 0 37711 0
[pid=17411/tid=17413] ppid=17409 vsize=152584 CPUtime=102.23 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 21667 0 0 0 10214 9 0 0 20 0 2 0 276798560 156246016 20424 33554432000 4194304 5963574 140734076533808 139889513834536 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 152584

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17416
/proc/meminfo: memFree=28091376/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=153428 CPUtime=162.26 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 29071 0 0 0 16214 12 0 0 20 0 2 0 276798553 157110272 26138 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 38357 26138 198 432 0 37922 0
[pid=17411/tid=17413] ppid=17409 vsize=153428 CPUtime=162.22 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 27386 0 0 0 16207 15 0 0 20 0 2 0 276798560 157110272 26138 33554432000 4194304 5963574 140734076533808 139889513834488 4399639 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 153428

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 17416
/proc/meminfo: memFree=28062400/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=155420 CPUtime=222.25 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 35939 0 0 0 22206 19 0 0 20 0 2 0 276798553 159150080 33003 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 38855 33003 198 432 0 38420 0
[pid=17411/tid=17413] ppid=17409 vsize=155420 CPUtime=222.23 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 34254 0 0 0 22200 23 0 0 20 0 2 0 276798560 159150080 33003 33554432000 4194304 5963574 140734076533808 139889513834296 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 155420

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17417
/proc/meminfo: memFree=28039716/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=220956 CPUtime=282.25 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 41780 0 0 0 28200 25 0 0 20 0 2 0 276798553 226258944 38844 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 55239 38844 198 432 0 54804 0
[pid=17411/tid=17413] ppid=17409 vsize=220956 CPUtime=282.23 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 40095 0 0 0 28193 30 0 0 20 0 2 0 276798560 226258944 38844 33554432000 4194304 5963574 140734076533808 139889513834536 4399542 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 220956

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17417
/proc/meminfo: memFree=27996876/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=217396 CPUtime=342.24 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 53270 0 0 0 34193 31 0 0 20 0 2 0 276798553 222613504 49135 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 54349 49135 198 432 0 53914 0
[pid=17411/tid=17413] ppid=17409 vsize=217396 CPUtime=342.23 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 51585 0 0 0 34186 37 0 0 20 0 2 0 276798560 222613504 49135 33554432000 4194304 5963574 140734076533808 139889513835448 4399614 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 217396

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17456
/proc/meminfo: memFree=28906164/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=217396 CPUtime=402.23 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 53313 0 0 0 40192 31 0 0 20 0 2 0 276798553 222613504 49178 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 54349 49178 198 432 0 53914 0
[pid=17411/tid=17413] ppid=17409 vsize=217396 CPUtime=402.23 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 51628 0 0 0 40185 38 0 0 20 0 2 0 276798560 222613504 49178 33554432000 4194304 5963574 140734076533808 139889513835448 4399456 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 217396

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17456
/proc/meminfo: memFree=28829708/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=217396 CPUtime=462.2 cores=1,3,5,7

################
# More data... #
################

/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 90998 0 0 0 130126 93 0 0 20 0 2 0 276798560 426430464 90848 33554432000 4194304 5963574 140734076533808 139889513834296 4399623 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1302
Current children cumulated vsize (KiB) 416436

[startup+1362.3 s]
/proc/loadavg: 2.03 2.06 2.01 3/179 17467
/proc/meminfo: memFree=28176804/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=416436 CPUtime=1361.99 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 96559 0 0 0 136122 77 0 0 20 0 2 0 276798553 426430464 94722 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 104109 94722 198 432 0 103674 0
[pid=17411/tid=17413] ppid=17409 vsize=416436 CPUtime=1362.19 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 94874 0 0 0 136121 98 0 0 20 0 2 0 276798560 426430464 94722 33554432000 4194304 5963574 140734076533808 139889513834296 4399456 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1361.99
Current children cumulated vsize (KiB) 416436

[startup+1422.31 s]
/proc/loadavg: 2.04 2.06 2.01 3/179 17467
/proc/meminfo: memFree=28150128/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=416436 CPUtime=1421.98 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 97204 0 0 0 142121 77 0 0 20 0 2 0 276798553 426430464 95362 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 104109 95362 198 432 0 103674 0
[pid=17411/tid=17413] ppid=17409 vsize=416436 CPUtime=1422.2 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 95519 0 0 0 142121 99 0 0 20 0 2 0 276798560 426430464 95362 33554432000 4194304 5963574 140734076533808 139889513834360 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1421.98
Current children cumulated vsize (KiB) 416436

[startup+1482.3 s]
/proc/loadavg: 2.05 2.06 2.01 3/179 17468
/proc/meminfo: memFree=28147352/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=416436 CPUtime=1481.97 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 97896 0 0 0 148119 78 0 0 20 0 2 0 276798553 426430464 96048 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 104109 96048 198 432 0 103674 0
[pid=17411/tid=17413] ppid=17409 vsize=416436 CPUtime=1482.19 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96211 0 0 0 148118 101 0 0 20 0 2 0 276798560 426430464 96048 33554432000 4194304 5963574 140734076533808 139889513834360 4397928 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1481.97
Current children cumulated vsize (KiB) 416436

[startup+1542.3 s]
/proc/loadavg: 2.05 2.06 2.01 3/179 17468
/proc/meminfo: memFree=28161704/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1541.95 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 97983 0 0 0 154117 78 0 0 20 0 2 0 276798553 423940096 92326 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92326 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1542.18 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96298 0 0 0 154116 102 0 0 20 0 2 0 276798560 423940096 92326 33554432000 4194304 5963574 140734076533808 139889513835032 4399456 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1541.95
Current children cumulated vsize (KiB) 414004

[startup+1602.3 s]
/proc/loadavg: 2.05 2.06 2.01 3/179 17468
/proc/meminfo: memFree=28160952/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1601.94 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98013 0 0 0 160116 78 0 0 20 0 2 0 276798553 423940096 92542 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92542 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1602.19 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96328 0 0 0 160116 103 0 0 20 0 2 0 276798560 423940096 92542 33554432000 4194304 5963574 140734076533808 139889513835032 4399456 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1601.94
Current children cumulated vsize (KiB) 414004

[startup+1662.3 s]
/proc/loadavg: 2.09 2.08 2.01 3/179 17468
/proc/meminfo: memFree=28160928/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1661.92 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 166114 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1662.18 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 166114 104 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4400164 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1661.92
Current children cumulated vsize (KiB) 414004

[startup+1722.3 s]
/proc/loadavg: 2.12 2.09 2.02 3/179 17468
/proc/meminfo: memFree=28160804/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1721.91 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 172113 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1722.18 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 172113 105 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1721.91
Current children cumulated vsize (KiB) 414004

[startup+1782.3 s]
/proc/loadavg: 2.08 2.08 2.02 3/179 17469
/proc/meminfo: memFree=28160780/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1781.9 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 178112 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1782.19 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 178113 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4399462 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1781.9
Current children cumulated vsize (KiB) 414004

Solver just ended. Dumping a history of the last processes samples

[startup+1791.91 s]
/proc/loadavg: 2.15 2.10 2.02 3/179 17469
/proc/meminfo: memFree=28160516/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1791.51 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179073 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1791.79 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179073 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1791.51
Current children cumulated vsize (KiB) 414004

[startup+1795.1 s]
/proc/loadavg: 2.13 2.10 2.02 3/179 17469
/proc/meminfo: memFree=28160640/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1794.71 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179393 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1794.99 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179393 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4399456 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1794.71
Current children cumulated vsize (KiB) 414004

[startup+1798.3 s]
/proc/loadavg: 2.13 2.10 2.02 3/179 17469
/proc/meminfo: memFree=28160640/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1797.9 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179712 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1798.19 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179713 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4399651 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1797.9
Current children cumulated vsize (KiB) 414004

[startup+1799.1 s]
/proc/loadavg: 2.12 2.09 2.02 3/179 17469
/proc/meminfo: memFree=28160640/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1798.7 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179792 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1798.99 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179793 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4399546 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1798.7
Current children cumulated vsize (KiB) 414004

[startup+1799.5 s]
/proc/loadavg: 2.12 2.09 2.02 3/179 17469
/proc/meminfo: memFree=28160640/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1799.11 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179833 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1799.39 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179833 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.11
Current children cumulated vsize (KiB) 414004

[startup+1799.9 s]
/proc/loadavg: 2.12 2.09 2.02 3/179 17469
/proc/meminfo: memFree=28160640/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1799.5 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179872 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1799.79 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179873 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4399456 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.5
Current children cumulated vsize (KiB) 414004

[startup+1800 s]
/proc/loadavg: 2.12 2.09 2.02 3/179 17469
/proc/meminfo: memFree=28160640/32873844 swapFree=7900/7900
[pid=17411] ppid=17409 vsize=414004 CPUtime=1799.6 cores=1,3,5,7
/proc/17411/stat : 17411 (wbo1.7) S 17409 17411 15878 0 -1 4202496 98023 0 0 0 179882 78 0 0 20 0 2 0 276798553 423940096 92582 33554432000 4194304 5963574 140734076533808 140734076533328 4545837 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/17411/statm: 103501 92582 198 432 0 103066 0
[pid=17411/tid=17413] ppid=17409 vsize=414004 CPUtime=1799.89 cores=1,3,5,7
/proc/17411/task/17413/stat : 17413 (wbo1.7) R 17409 17411 15878 0 -1 4202560 96338 0 0 0 179883 106 0 0 20 0 2 0 276798560 423940096 92582 33554432000 4194304 5963574 140734076533808 139889513835032 4220672 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1799.6
Current children cumulated vsize (KiB) 414004

Child status: 255
Real time (s): 1800
CPU time (s): 1799.98
CPU user time (s): 1798.9
CPU system time (s): 1.07284
CPU usage (%): 99.9984
Max. virtual memory (cumulated for all children) (KiB): 416436

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.9
system time used= 1.07284
maximum resident set size= 384440
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 98023
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 124
involuntary context switches= 1861

runsolver used 3.07453 second user time and 9.13961 second system time

The end

Launcher Data 

Begin job on node137 at 2012-05-27 10:19:00
IDJOB=3705403
IDBENCH=71835
IDSOLVER=2283
FILE ID=node137/3705403-1338106740
RUNJOBID= node137-1338083671-15895
PBS_JOBID= 14624423
Free space on /tmp= 71488 MiB

SOLVER NAME= wbo 1.7
BENCH NAME= PB09/normalized-PB09/OPT-SMALLINT-LIN/featureSubscription/normalized-50-750-false-45-90-4-1000opt.opb
COMMAND LINE= wbo1.7 -file-format=opb BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3705403-1338106740/watcher-3705403-1338106740 -o /tmp/evaluation-result-3705403-1338106740/solver-3705403-1338106740 -C 1800 -W 1900 -M 15500  wbo1.7 -file-format=opb HOME/instance-3705403-1338106740.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 6db624ef9d444e54f2daac91a1bb8591
RANDOM SEED=1091111013

node137.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.20
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.600
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28260920 kB
Buffers:          308636 kB
Cached:          2602648 kB
SwapCached:        22060 kB
Active:          1650632 kB
Inactive:        2153708 kB
Active(anon):     872824 kB
Inactive(anon):    22684 kB
Active(file):     777808 kB
Inactive(file):  2131024 kB
Unevictable:        7900 kB
Mlocked:            7900 kB
SwapTotal:      67108856 kB
SwapFree:       67081508 kB
Dirty:              6212 kB
Writeback:            16 kB
AnonPages:        966388 kB
Mapped:            10400 kB
Shmem:                 0 kB
Slab:             666064 kB
SReclaimable:     107696 kB
SUnreclaim:       558368 kB
KernelStack:        1488 kB
PageTables:         5604 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     147312 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    534528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71480 MiB
End job on node137 at 2012-05-27 10:49:00