Trace number 3727707

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
wbo 1.72? 1799.53 1800.01

General information on the benchmark

Name/OPT-SMALLINT-LIN/featureSubscription/
normalized-50-750-false-45-90-4-4000opt.opb
MD5SUM78d7b4bc270e158c16f301038a8fbfa0
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark-82
Best CPU time to get the best result obtained on this benchmark0.642901
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables2025
Total number of constraints30390
Number of constraints which are clauses30390
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint3
Number of terms in the objective function 135
Biggest coefficient in the objective function 4
Number of bits for the biggest coefficient in the objective function 3
Sum of the numbers in the objective function 316
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 4
Number of bits of the biggest number in a constraint 3
Biggest sum of numbers in a constraint 316
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |   wbo:                     1.72 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3727707-1338664281.opb.
0.00/0.00	c Instance file HOME/instance-3727707-1338664281.opb
0.00/0.00	c File size is 1006550 bytes.
0.05/0.06	c Cost Offset: -316
0.05/0.06	c Highest Coefficient sum: 4
0.05/0.06	c ============================[ Problem Statistics ]=============================
0.05/0.06	c |                                                                             |
0.05/0.06	c |  Parsing time:          0.07         s                                      |
0.05/0.06	c |  Number Variables:      2025                                                |
0.05/0.06	c |  Number Clauses:        30390                                               |
0.05/0.06	c |  Number Cardinality:    0                                                   |
0.05/0.06	c |  Number PB Constraints: 0                                                   |
0.05/0.06	c |                                                                             |
0.05/0.07	c |  Problem Type:          Optimization                                        |
0.05/0.07	c |  Objective Function:    Cardinality Constraint                              |
0.05/0.07	c |                                                                             |
0.05/0.07	c ============================[ Search Statistics ]==============================
0.05/0.07	c | Time (s)  | ID |      Bound      |               Shared Clauses             |
0.05/0.07	c |           |    | value      type |  expCls         impCls        Lit/impCl  |
0.05/0.07	c ===============================================================================
0.05/0.08	c | 0.08      | 0  | -315         lb |  0                0                0.00  |
0.05/0.09	c | 0.09      | 0  | -314         lb |  0                0                0.00  |
0.05/0.09	c | 0.10      | 0  | -312         lb |  0                0                0.00  |
0.09/0.10	c | 0.11      | 0  | -311         lb |  0                0                0.00  |
0.09/0.11	c | 0.12      | 0  | -310         lb |  0                0                0.00  |
0.09/0.12	c | 0.12      | 0  | -307         lb |  0                0                0.00  |
0.09/0.13	c | 0.13      | 0  | -306         lb |  0                0                0.00  |
0.09/0.14	c | 0.14      | 0  | -305         lb |  0                0                0.00  |
0.09/0.14	c | 0.15      | 0  | -303         lb |  0                0                0.00  |
0.09/0.15	c | 0.16      | 0  | -301         lb |  0                0                0.00  |
0.09/0.16	c | 0.17      | 0  | -299         lb |  0                0                0.00  |
0.09/0.17	c | 0.17      | 0  | -297         lb |  0                0                0.00  |
0.09/0.18	c | 0.18      | 0  | -296         lb |  0                0                0.00  |
0.09/0.19	c | 0.19      | 0  | -295         lb |  0                0                0.00  |
0.19/0.20	c | 0.20      | 0  | -294         lb |  0                0                0.00  |
0.19/0.20	c | 0.21      | 0  | -293         lb |  0                0                0.00  |
0.19/0.21	c | 0.22      | 0  | -292         lb |  0                0                0.00  |
0.19/0.22	c | 0.23      | 0  | -288         lb |  0                0                0.00  |
0.19/0.23	c | 0.23      | 0  | -287         lb |  0                0                0.00  |
0.19/0.24	c | 0.24      | 0  | -286         lb |  0                0                0.00  |
0.19/0.25	c | 0.25      | 0  | -285         lb |  0                0                0.00  |
0.19/0.26	c | 0.26      | 0  | -284         lb |  0                0                0.00  |
0.19/0.26	c | 0.27      | 0  | -283         lb |  0                0                0.00  |
0.19/0.27	c | 0.28      | 0  | -282         lb |  0                0                0.00  |
0.19/0.28	c | 0.29      | 0  | -281         lb |  0                0                0.00  |
0.19/0.29	c | 0.29      | 0  | -279         lb |  0                0                0.00  |
0.29/0.30	c | 0.30      | 0  | -278         lb |  0                0                0.00  |
0.29/0.31	c | 0.31      | 0  | -277         lb |  0                0                0.00  |
0.29/0.32	c | 0.32      | 0  | -276         lb |  0                0                0.00  |
0.29/0.33	c | 0.33      | 0  | -273         lb |  0                0                0.00  |
0.29/0.33	c | 0.34      | 0  | -272         lb |  0                0                0.00  |
0.29/0.34	c | 0.35      | 0  | -271         lb |  0                0                0.00  |
0.29/0.35	c | 0.35      | 0  | -270         lb |  0                0                0.00  |
0.29/0.36	c | 0.36      | 0  | -268         lb |  0                0                0.00  |
0.29/0.37	c | 0.37      | 0  | -267         lb |  0                0                0.00  |
0.29/0.38	c | 0.38      | 0  | -264         lb |  0                0                0.00  |
0.29/0.39	c | 0.39      | 0  | -261         lb |  0                0                0.00  |
0.29/0.40	c | 0.40      | 0  | -260         lb |  0                0                0.00  |
0.39/0.40	c | 0.41      | 0  | -259         lb |  0                0                0.00  |
0.39/0.41	c | 0.42      | 0  | -258         lb |  0                0                0.00  |
0.39/0.42	c | 0.43      | 0  | -257         lb |  0                0                0.00  |
0.39/0.43	c | 0.43      | 0  | -256         lb |  0                0                0.00  |
0.39/0.44	c | 0.45      | 0  | -255         lb |  0                0                0.00  |
0.39/0.45	c | 0.45      | 0  | -254         lb |  0                0                0.00  |
0.39/0.46	c | 0.46      | 0  | -253         lb |  0                0                0.00  |
0.39/0.47	c | 0.47      | 0  | -252         lb |  0                0                0.00  |
0.39/0.48	c | 0.48      | 0  | -251         lb |  0                0                0.00  |
0.39/0.49	c | 0.49      | 0  | -250         lb |  0                0                0.00  |
0.49/0.50	c | 0.50      | 0  | -249         lb |  0                0                0.00  |
0.49/0.51	c | 0.51      | 0  | -248         lb |  0                0                0.00  |
0.49/0.52	c | 0.53      | 0  | -247         lb |  0                0                0.00  |
0.49/0.53	c | 0.54      | 0  | -246         lb |  0                0                0.00  |
0.49/0.54	c | 0.55      | 0  | -245         lb |  0                0                0.00  |
0.49/0.55	c | 0.56      | 0  | -244         lb |  0                0                0.00  |
0.49/0.56	c | 0.57      | 0  | -243         lb |  0                0                0.00  |
0.49/0.57	c | 0.58      | 0  | -242         lb |  0                0                0.00  |
0.49/0.58	c | 0.59      | 0  | -240         lb |  0                0                0.00  |
0.49/0.59	c | 0.60      | 0  | -239         lb |  0                0                0.00  |
0.59/0.61	c | 0.61      | 0  | -238         lb |  0                0                0.00  |
0.59/0.62	c | 0.62      | 0  | -237         lb |  0                0                0.00  |
0.59/0.63	c | 0.63      | 0  | -236         lb |  0                0                0.00  |
0.59/0.64	c | 0.64      | 0  | -235         lb |  0                0                0.00  |
0.59/0.65	c | 0.65      | 0  | -234         lb |  0                0                0.00  |
0.59/0.66	c | 0.67      | 0  | -233         lb |  0                0                0.00  |
0.59/0.67	c | 0.68      | 0  | -232         lb |  0                0                0.00  |
0.59/0.68	c | 0.69      | 0  | -231         lb |  0                0                0.00  |
0.69/0.70	c | 0.70      | 0  | -230         lb |  0                0                0.00  |
0.69/0.71	c | 0.71      | 0  | -229         lb |  0                0                0.00  |
0.69/0.72	c | 0.72      | 0  | -228         lb |  0                0                0.00  |
0.69/0.73	c | 0.73      | 0  | -226         lb |  0                0                0.00  |
0.69/0.74	c | 0.75      | 0  | -225         lb |  0                0                0.00  |
0.69/0.75	c | 0.76      | 0  | -223         lb |  0                0                0.00  |
0.69/0.77	c | 0.77      | 0  | -222         lb |  0                0                0.00  |
0.69/0.78	c | 0.78      | 0  | -221         lb |  0                0                0.00  |
0.69/0.79	c | 0.79      | 0  | -220         lb |  0                0                0.00  |
0.79/0.80	c | 0.81      | 0  | -219         lb |  0                0                0.00  |
0.79/0.81	c | 0.82      | 0  | -218         lb |  0                0                0.00  |
0.79/0.83	c | 0.83      | 0  | -217         lb |  0                0                0.00  |
0.79/0.84	c | 0.84      | 0  | -216         lb |  0                0                0.00  |
0.79/0.85	c | 0.86      | 0  | -215         lb |  0                0                0.00  |
0.79/0.86	c | 0.87      | 0  | -214         lb |  0                0                0.00  |
0.79/0.88	c | 0.88      | 0  | -213         lb |  0                0                0.00  |
0.79/0.89	c | 0.89      | 0  | -212         lb |  0                0                0.00  |
0.89/0.90	c | 0.91      | 0  | -211         lb |  0                0                0.00  |
0.89/0.92	c | 0.92      | 0  | -210         lb |  0                0                0.00  |
0.89/0.93	c | 0.93      | 0  | -209         lb |  0                0                0.00  |
0.89/0.94	c | 0.94      | 0  | -208         lb |  0                0                0.00  |
0.89/0.95	c | 0.96      | 0  | -206         lb |  0                0                0.00  |
0.89/0.97	c | 0.97      | 0  | -205         lb |  0                0                0.00  |
0.89/0.98	c | 0.98      | 0  | -204         lb |  0                0                0.00  |
0.89/0.99	c | 1.00      | 0  | -203         lb |  0                0                0.00  |
0.99/1.01	c | 1.01      | 0  | -202         lb |  0                0                0.00  |
0.99/1.02	c | 1.02      | 0  | -201         lb |  0                0                0.00  |
0.99/1.03	c | 1.04      | 0  | -200         lb |  0                0                0.00  |
0.99/1.05	c | 1.05      | 0  | -199         lb |  0                0                0.00  |
0.99/1.06	c | 1.06      | 0  | -198         lb |  0                0                0.00  |
0.99/1.07	c | 1.08      | 0  | -197         lb |  0                0                0.00  |
0.99/1.09	c | 1.09      | 0  | -196         lb |  0                0                0.00  |
0.99/1.10	c | 1.10      | 0  | -195         lb |  0                0                0.00  |
1.09/1.11	c | 1.12      | 0  | -194         lb |  0                0                0.00  |
1.09/1.13	c | 1.13      | 0  | -193         lb |  0                0                0.00  |
1.09/1.14	c | 1.15      | 0  | -192         lb |  0                0                0.00  |
1.09/1.15	c | 1.16      | 0  | -191         lb |  0                0                0.00  |
1.09/1.17	c | 1.17      | 0  | -190         lb |  0                0                0.00  |
1.09/1.18	c | 1.19      | 0  | -189         lb |  0                0                0.00  |
1.09/1.19	c | 1.20      | 0  | -188         lb |  0                0                0.00  |
1.19/1.21	c | 1.21      | 0  | -187         lb |  0                0                0.00  |
1.19/1.22	c | 1.23      | 0  | -186         lb |  0                0                0.00  |
1.19/1.23	c | 1.24      | 0  | -185         lb |  0                0                0.00  |
1.19/1.25	c | 1.25      | 0  | -184         lb |  0                0                0.00  |
1.19/1.26	c | 1.27      | 0  | -183         lb |  0                0                0.00  |
1.19/1.28	c | 1.28      | 0  | -182         lb |  0                0                0.00  |
1.19/1.29	c | 1.29      | 0  | -181         lb |  0                0                0.00  |
1.28/1.31	c | 1.31      | 0  | -180         lb |  0                0                0.00  |
1.28/1.32	c | 1.32      | 0  | -179         lb |  0                0                0.00  |
1.28/1.33	c | 1.34      | 0  | -178         lb |  0                0                0.00  |
1.28/1.35	c | 1.35      | 0  | -177         lb |  0                0                0.00  |
1.28/1.36	c | 1.37      | 0  | -176         lb |  0                0                0.00  |
1.28/1.38	c | 1.38      | 0  | -175         lb |  0                0                0.00  |
1.28/1.39	c | 1.39      | 0  | -173         lb |  0                0                0.00  |
1.38/1.40	c | 1.41      | 0  | -172         lb |  0                0                0.00  |
1.38/1.42	c | 1.42      | 0  | -171         lb |  0                0                0.00  |
1.38/1.43	c | 1.44      | 0  | -170         lb |  0                0                0.00  |
1.38/1.45	c | 1.46      | 0  | -169         lb |  0                0                0.00  |
1.38/1.47	c | 1.48      | 0  | -168         lb |  0                0                0.00  |
1.38/1.49	c | 1.49      | 0  | -167         lb |  0                0                0.00  |
1.48/1.51	c | 1.51      | 0  | -166         lb |  0                0                0.00  |
1.48/1.53	c | 1.53      | 0  | -165         lb |  0                0                0.00  |
1.48/1.55	c | 1.55      | 0  | -164         lb |  0                0                0.00  |
1.48/1.58	c | 1.58      | 0  | -163         lb |  0                0                0.00  |
1.58/1.60	c | 1.61      | 0  | -162         lb |  0                0                0.00  |
1.58/1.66	c | 1.67      | 0  | -161         lb |  0                0                0.00  |
1.78/1.86	c | 1.86      | 0  | -160         lb |  0                0                0.00  |
2.28/2.31	c | 2.31      | 0  | -159         lb |  0                0                0.00  |
2.28/2.36	c | 2.36      | 0  | -158         lb |  0                0                0.00  |
7.19/7.25	c | 7.25      | 0  | -157         lb |  0                0                0.00  |
18.89/18.90	c | 18.90     | 0  | -156         lb |  0                0                0.00  |
20.79/20.86	c | 20.86     | 0  | -155         lb |  0                0                0.00  |
27.29/27.35	c | 27.36     | 0  | -154         lb |  0                0                0.00  |
1799.53/1800.00	c ===============================================================================
1799.53/1800.00	c Wall Clock Time: 1800.00 s
1799.53/1800.00	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3727707-1338664281/watcher-3727707-1338664281 -o /tmp/evaluation-result-3727707-1338664281/solver-3727707-1338664281 -C 1800 -W 1900 -M 15500 wbo1.72 -file-format=opb HOME/instance-3727707-1338664281.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 21878
/proc/meminfo: memFree=28724216/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=4616 CPUtime=0 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) R 21876 21878 18556 0 -1 4202496 437 0 0 0 0 0 0 0 20 0 1 0 332556524 4726784 389 33554432000 4194304 5964350 140736114086528 140735989558248 4344195 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 1154 389 170 433 0 472 0

[startup+0.05799 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 21878
/proc/meminfo: memFree=28724216/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=6496 CPUtime=0.05 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) R 21876 21878 18556 0 -1 4202496 1098 0 0 0 5 0 0 0 20 0 1 0 332556524 6651904 1050 33554432000 4194304 5964350 140736114086528 140735989558248 5136410 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 1624 1050 364 433 0 942 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 6496

[startup+0.100161 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 21878
/proc/meminfo: memFree=28724216/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=0.09 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 2931 0 0 0 9 0 0 0 20 0 2 0 332556524 88461312 2517 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 2517 192 433 0 21161 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 86388

[startup+0.300114 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 21878
/proc/meminfo: memFree=28724216/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=0.29 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 3360 0 0 0 29 0 0 0 20 0 2 0 332556524 88461312 2625 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 2625 192 433 0 21161 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 86388

[startup+0.700117 s]
/proc/loadavg: 2.00 2.00 2.00 3/175 21878
/proc/meminfo: memFree=28724216/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=0.69 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 4310 0 0 0 69 0 0 0 20 0 2 0 332556524 88461312 2840 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 2840 192 433 0 21161 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 86388

[startup+1.50031 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28712792/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=1.48 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 5782 0 0 0 148 0 0 0 20 0 2 0 332556524 88461312 3175 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 3175 197 433 0 21161 0
[pid=21878/tid=21880] ppid=21876 vsize=86388 CPUtime=1.41 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 4104 0 0 0 141 0 0 0 20 0 2 0 332556531 88461312 3176 33554432000 4194304 5964350 140736114086528 140184044288840 4419455 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 86388

[startup+3.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28709932/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=3.08 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 6703 0 0 0 308 0 0 0 20 0 2 0 332556524 88461312 3971 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 3971 197 433 0 21161 0
[pid=21878/tid=21880] ppid=21876 vsize=86388 CPUtime=3.01 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 5024 0 0 0 301 0 0 0 20 0 2 0 332556531 88461312 3971 33554432000 4194304 5964350 140736114086528 140184044288536 4400342 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 86388

[startup+6.30033 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28697904/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=6.29 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 8949 0 0 0 628 1 0 0 20 0 2 0 332556524 88461312 6217 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 6217 197 433 0 21161 0
[pid=21878/tid=21880] ppid=21876 vsize=86388 CPUtime=6.2 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 7270 0 0 0 619 1 0 0 20 0 2 0 332556531 88461312 6217 33554432000 4194304 5964350 140736114086528 140184044287992 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 86388

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28688792/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=12.68 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 10067 0 0 0 1267 1 0 0 20 0 2 0 332556524 88461312 7335 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 7335 197 433 0 21161 0
[pid=21878/tid=21880] ppid=21876 vsize=86388 CPUtime=12.58 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 8388 0 0 0 1257 1 0 0 20 0 2 0 332556531 88461312 7335 33554432000 4194304 5964350 140736114086528 140184044287800 4400548 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 86388

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28678012/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86388 CPUtime=25.49 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 12469 0 0 0 2547 2 0 0 20 0 2 0 332556524 88461312 9737 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21597 9737 197 433 0 21161 0
[pid=21878/tid=21880] ppid=21876 vsize=86388 CPUtime=25.35 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 10790 0 0 0 2534 1 0 0 20 0 2 0 332556531 88461312 9737 33554432000 4194304 5964350 140736114086528 140184044288536 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 86388

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28662512/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=86872 CPUtime=51.08 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 16329 0 0 0 5106 2 0 0 20 0 2 0 332556524 88956928 13597 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 21718 13597 197 433 0 21282 0
[pid=21878/tid=21880] ppid=21876 vsize=86872 CPUtime=50.88 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 14650 0 0 0 5086 2 0 0 20 0 2 0 332556531 88956928 13597 33554432000 4194304 5964350 140736114086528 140184044287800 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 86872

[startup+102.306 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28627516/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=152648 CPUtime=102.26 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 24390 0 0 0 10222 4 0 0 20 0 2 0 332556524 156311552 21755 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 38162 21755 197 433 0 37726 0
[pid=21878/tid=21880] ppid=21876 vsize=152648 CPUtime=101.95 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 22711 0 0 0 10190 5 0 0 20 0 2 0 332556531 156311552 21755 33554432000 4194304 5964350 140736114086528 140184044288040 4399987 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 152648

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21880
/proc/meminfo: memFree=28586476/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=153008 CPUtime=162.24 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 33782 0 0 0 16214 10 0 0 20 0 2 0 332556524 156680192 31809 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 38252 31809 197 433 0 37816 0
[pid=21878/tid=21880] ppid=21876 vsize=153008 CPUtime=161.77 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 32103 0 0 0 16166 11 0 0 20 0 2 0 332556531 156680192 31809 33554432000 4194304 5964350 140736114086528 140184044288040 4399921 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 153008

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21881
/proc/meminfo: memFree=28547872/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=219568 CPUtime=222.22 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 41834 0 0 0 22208 14 0 0 20 0 2 0 332556524 224837632 39857 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 54892 39857 197 433 0 54456 0
[pid=21878/tid=21880] ppid=21876 vsize=219568 CPUtime=221.62 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 40155 0 0 0 22145 17 0 0 20 0 2 0 332556531 224837632 39857 33554432000 4194304 5964350 140736114086528 140184044287800 4400704 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 219568

[startup+282.3 s]
/proc/loadavg: 2.04 2.01 2.00 3/177 21881
/proc/meminfo: memFree=28479156/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=285104 CPUtime=282.21 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 53004 0 0 0 28201 20 0 0 20 0 2 0 332556524 291946496 51026 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 71276 51026 197 433 0 70840 0
[pid=21878/tid=21880] ppid=21876 vsize=285104 CPUtime=281.46 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 51325 0 0 0 28122 24 0 0 20 0 2 0 332556531 291946496 51026 33554432000 4194304 5964350 140736114086528 140184044287992 4399840 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 285104

[startup+342.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 21881
/proc/meminfo: memFree=28387520/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=286396 CPUtime=342.2 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 61989 0 0 0 34194 26 0 0 20 0 2 0 332556524 293269504 60011 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 71599 60011 197 433 0 71163 0
[pid=21878/tid=21880] ppid=21876 vsize=286396 CPUtime=341.31 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 60310 0 0 0 34100 31 0 0 20 0 2 0 332556531 293269504 60011 33554432000 4194304 5964350 140736114086528 140184044287992 4399840 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 342.2
Current children cumulated vsize (KiB) 286396

[startup+402.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 21881
/proc/meminfo: memFree=28335440/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=286880 CPUtime=402.19 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 64237 0 0 0 40191 28 0 0 20 0 2 0 332556524 293765120 62258 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 71720 62258 197 433 0 71284 0
[pid=21878/tid=21880] ppid=21876 vsize=286880 CPUtime=401.16 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 62558 0 0 0 40082 34 0 0 20 0 2 0 332556531 293765120 62258 33554432000 4194304 5964350 140736114086528 140184044287800 4400011 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 402.19
Current children cumulated vsize (KiB) 286880

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 21881
/proc/meminfo: memFree=28283236/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=288088 CPUtime=462.19 cores=0,2,4,6

################
# More data... #
################


[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21969
/proc/meminfo: memFree=28372100/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=568976 CPUtime=1421.93 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 136443 0 0 0 142115 78 0 0 20 0 2 0 332556524 582631424 135964 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 142244 135964 197 433 0 141808 0
[pid=21878/tid=21880] ppid=21876 vsize=568976 CPUtime=1418.42 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 134764 0 0 0 141743 99 0 0 20 0 2 0 332556531 582631424 135964 33554432000 4194304 5964350 140736114086528 140184044287864 4400007 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1421.93
Current children cumulated vsize (KiB) 568976

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21969
/proc/meminfo: memFree=28325420/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=570428 CPUtime=1481.89 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 136749 0 0 0 148111 78 0 0 20 0 2 0 332556524 584118272 136486 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 142607 136486 197 433 0 142171 0
[pid=21878/tid=21880] ppid=21876 vsize=570428 CPUtime=1478.24 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 135070 0 0 0 147724 100 0 0 20 0 2 0 332556531 584118272 136486 33554432000 4194304 5964350 140736114086528 140184044287800 4399976 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1481.89
Current children cumulated vsize (KiB) 570428

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21969
/proc/meminfo: memFree=28276736/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=573444 CPUtime=1541.87 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 137638 0 0 0 154109 78 0 0 20 0 2 0 332556524 587206656 137371 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 143361 137371 197 433 0 142925 0
[pid=21878/tid=21880] ppid=21876 vsize=573444 CPUtime=1538.08 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 135959 0 0 0 153707 101 0 0 20 0 2 0 332556531 587206656 137371 33554432000 4194304 5964350 140736114086528 140184044287800 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1541.87
Current children cumulated vsize (KiB) 573444

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21969
/proc/meminfo: memFree=28275124/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=575132 CPUtime=1601.86 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 137993 0 0 0 160108 78 0 0 20 0 2 0 332556524 588935168 137726 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 143783 137726 197 433 0 143347 0
[pid=21878/tid=21880] ppid=21876 vsize=575132 CPUtime=1597.92 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 136314 0 0 0 159690 102 0 0 20 0 2 0 332556531 588935168 137726 33554432000 4194304 5964350 140736114086528 140184044288040 4399840 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1601.86
Current children cumulated vsize (KiB) 575132

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21969
/proc/meminfo: memFree=28274256/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=575856 CPUtime=1661.85 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 138295 0 0 0 166107 78 0 0 20 0 2 0 332556524 589676544 137980 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 143964 137980 197 433 0 143528 0
[pid=21878/tid=21880] ppid=21876 vsize=575856 CPUtime=1657.77 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 136616 0 0 0 165674 103 0 0 20 0 2 0 332556531 589676544 137980 33554432000 4194304 5964350 140736114086528 140184044287864 4220672 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1661.85
Current children cumulated vsize (KiB) 575856

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 21973
/proc/meminfo: memFree=28220932/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=641876 CPUtime=1721.84 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 142082 0 0 0 172103 81 0 0 20 0 2 0 332556524 657281024 141767 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160469 141767 197 433 0 160033 0
[pid=21878/tid=21880] ppid=21876 vsize=641876 CPUtime=1717.62 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 140403 0 0 0 171655 107 0 0 20 0 2 0 332556531 657281024 141767 33554432000 4194304 5964350 140736114086528 140184044287992 4399840 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1721.84
Current children cumulated vsize (KiB) 641876

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21973
/proc/meminfo: memFree=28199488/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1781.84 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147318 0 0 0 178097 87 0 0 20 0 2 0 332556524 657776640 147003 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147003 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1777.46 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145639 0 0 0 177632 114 0 0 20 0 2 0 332556531 657776640 147003 33554432000 4194304 5964350 140736114086528 140184044288040 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1781.84
Current children cumulated vsize (KiB) 642360

Solver just ended. Dumping a history of the last processes samples

[startup+1791.91 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1791.44 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179057 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1787.04 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 178590 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 4378928 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1791.44
Current children cumulated vsize (KiB) 642360

[startup+1795.1 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1794.64 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179377 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1790.24 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 178910 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 5131148 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1794.64
Current children cumulated vsize (KiB) 642360

[startup+1798.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1797.83 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179696 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1793.42 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 179228 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 4221120 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1797.83
Current children cumulated vsize (KiB) 642360

[startup+1799.1 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1798.63 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179776 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1794.22 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 179308 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1798.63
Current children cumulated vsize (KiB) 642360

[startup+1799.5 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1799.04 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179817 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1794.63 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 179349 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1799.04
Current children cumulated vsize (KiB) 642360

[startup+1799.9 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1799.43 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179856 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1795.02 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 179388 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 4400390 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1799.43
Current children cumulated vsize (KiB) 642360

[startup+1800 s]
/proc/loadavg: 2.08 2.02 2.01 3/177 21973
/proc/meminfo: memFree=28197984/32873844 swapFree=6088/6088
[pid=21878] ppid=21876 vsize=642360 CPUtime=1799.53 cores=0,2,4,6
/proc/21878/stat : 21878 (wbo1.72) S 21876 21878 18556 0 -1 4202496 147579 0 0 0 179866 87 0 0 20 0 2 0 332556524 657776640 147264 33554432000 4194304 5964350 140736114086528 140736114086048 4546605 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/21878/statm: 160590 147264 197 433 0 160154 0
[pid=21878/tid=21880] ppid=21876 vsize=642360 CPUtime=1795.12 cores=0,2,4,6
/proc/21878/task/21880/stat : 21880 (wbo1.72) R 21876 21878 18556 0 -1 4202560 145900 0 0 0 179398 114 0 0 20 0 2 0 332556531 657776640 147264 33554432000 4194304 5964350 140736114086528 140184044288040 18446744073699066235 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1799.53
Current children cumulated vsize (KiB) 642360

Child status: 255

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21878 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=53262
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=157823
# CPU time returned by wait4() is 1795.21
# while last known CPU time is 1799.53
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.01
CPU time (s): 1799.53
CPU user time (s): 1798.66
CPU system time (s): 0.87
CPU usage (%): 99.9735
Max. virtual memory (cumulated for all children) (KiB): 642360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.05
system time used= 1.15782
maximum resident set size= 589064
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 147581
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 250
involuntary context switches= 1975

runsolver used 2.95355 second user time and 8.67268 second system time

The end

Launcher Data 

Begin job on node110 at 2012-06-02 21:11:21
IDJOB=3727707
IDBENCH=71821
IDSOLVER=2313
FILE ID=node110/3727707-1338664281
RUNJOBID= node110-1338651355-20282
PBS_JOBID= 14636470
Free space on /tmp= 71128 MiB

SOLVER NAME= wbo 1.72
BENCH NAME= PB09/normalized-PB09/OPT-SMALLINT-LIN/featureSubscription/normalized-50-750-false-45-90-4-4000opt.opb
COMMAND LINE= wbo1.72 -file-format=opb BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3727707-1338664281/watcher-3727707-1338664281 -o /tmp/evaluation-result-3727707-1338664281/solver-3727707-1338664281 -C 1800 -W 1900 -M 15500  wbo1.72 -file-format=opb HOME/instance-3727707-1338664281.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 78d7b4bc270e158c16f301038a8fbfa0
RANDOM SEED=1061500545

node110.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.893
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        28724860 kB
Buffers:          394368 kB
Cached:          2387992 kB
SwapCached:          604 kB
Active:          1769376 kB
Inactive:        1535320 kB
Active(anon):     512324 kB
Inactive(anon):    12328 kB
Active(file):    1257052 kB
Inactive(file):  1522992 kB
Unevictable:        6088 kB
Mlocked:            6088 kB
SwapTotal:      67108856 kB
SwapFree:       67107364 kB
Dirty:              6632 kB
Writeback:             0 kB
AnonPages:        572556 kB
Mapped:            12324 kB
Shmem:                40 kB
Slab:             705388 kB
SReclaimable:     147844 kB
SUnreclaim:       557544 kB
KernelStack:        1472 kB
PageTables:         4872 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     140516 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    493568 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71124 MiB
End job on node110 at 2012-06-02 21:41:21