Trace number 3731642

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.01 574.616

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
wnq/normalized-wnq_n100_mw99_9.opb.PB06.opb
MD5SUM093efae700664f798191c0b27cec34af
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark419
Best CPU time to get the best result obtained on this benchmark1792.04
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 447
Optimality of the best value was proved NO
Number of variables10000
Total number of constraints656900
Number of constraints which are clauses656900
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint100
Number of terms in the objective function 10000
Biggest coefficient in the objective function 99
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 494527
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 99
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 494527
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3731642-1339246911.opb.
0.00/0.00	c Instance file HOME/instance-3731642-1339246911.opb
0.00/0.00	c File size is 17233660 bytes.
11.48/11.58	c Highest Coefficient sum: 101
11.48/11.58	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
11.88/11.93	c ============================[ Problem Statistics ]=============================
11.88/11.93	c |                                                                             |
11.88/11.93	c |  Parsing time:          11.83        s                                      |
11.88/11.93	c |  Number Variables:      10000                                               |
11.99/12.02	c |  Number Constraints:    656900                                              |
11.99/12.02	c ===============================================================================
1799.92/574.61	c Remaining time 1788.09 sec.
1799.92/574.61	c 
1799.92/574.61	c *** INTERRUPTED ***
1799.92/574.61	s UNKNOWN
1799.92/574.61	c Total CPU time              : 1788.57 s
1799.92/574.61	c Memory used           : 1215.93 MB
1799.92/574.61	c CPU time              : 1788.57 s
1799.92/574.61	c 
1799.92/574.61	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731642-1339246911/watcher-3731642-1339246911 -o /tmp/evaluation-result-3731642-1339246911/solver-3731642-1339246911 -C 1800 -W 1900 -M 15500 run HOME/instance-3731642-1339246911.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.57 2.10 0.72 10/185 32152
/proc/meminfo: memFree=29648892/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0

[startup+0.0846781 s]
/proc/loadavg: 7.57 2.10 0.72 10/185 32152
/proc/meminfo: memFree=29648892/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100211 s]
/proc/loadavg: 7.57 2.10 0.72 10/185 32152
/proc/meminfo: memFree=29648892/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300175 s]
/proc/loadavg: 7.57 2.10 0.72 10/185 32152
/proc/meminfo: memFree=29648892/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700177 s]
/proc/loadavg: 7.57 2.10 0.72 10/185 32152
/proc/meminfo: memFree=29648892/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50016 s]
/proc/loadavg: 7.53 2.18 0.75 3/187 32154
/proc/meminfo: memFree=29649720/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=32000 CPUtime=1.49 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 976 0 0 0 149 0 0 0 20 0 1 0 390817061 32768000 931 33554432000 134512640 146736320 4294757504 4294715424 140681199 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 8000 931 308 2985 0 726 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 41148

[startup+3.10022 s]
/proc/loadavg: 7.53 2.18 0.75 9/187 32154
/proc/meminfo: memFree=29645256/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=32132 CPUtime=3.09 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 1010 0 0 0 309 0 0 0 20 0 1 0 390817061 32903168 965 33554432000 134512640 146736320 4294757504 4294715420 140653477 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 8033 965 308 2985 0 759 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 41280

[startup+6.30022 s]
/proc/loadavg: 7.53 2.18 0.75 10/187 32154
/proc/meminfo: memFree=29648124/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=32432 CPUtime=6.28 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 1063 0 0 0 628 0 0 0 20 0 1 0 390817061 33210368 1018 33554432000 134512640 146736320 4294757504 4294715360 141028063 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/32153/statm: 8108 1018 308 2985 0 834 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 41580

[startup+12.7002 s]
/proc/loadavg: 7.67 2.39 0.83 6/187 32154
/proc/meminfo: memFree=29384852/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=315636 CPUtime=12.68 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 68075 0 0 0 1256 12 0 0 20 0 1 0 390817061 323211264 72884 33554432000 134512640 146736320 4294757504 4294754752 136237216 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 78909 72884 627 2985 0 75843 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 324784

[startup+25.5004 s]
/proc/loadavg: 7.80 2.59 0.92 10/192 32175
/proc/meminfo: memFree=29364668/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=389288 CPUtime=50.15 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 118601 0 0 0 4974 41 0 0 20 0 8 0 390817061 398630912 68350 33554432000 134512640 146736320 4294757504 4294751144 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 97322 68350 960 2985 0 94256 0
[pid=32153/tid=32169] ppid=32152 vsize=389288 CPUtime=4.04 cores=0,2,4,6
/proc/32153/task/32169/stat : 32169 (pb_cplex) R 32152 32152 31871 0 -1 4202560 340 0 0 0 403 1 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 3988077008 135464966 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32170] ppid=32152 vsize=389288 CPUtime=3.88 cores=0,2,4,6
/proc/32153/task/32170/stat : 32170 (pb_cplex) R 32152 32152 31871 0 -1 4202560 2301 0 0 0 388 0 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 4075483192 136475800 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32171] ppid=32152 vsize=389288 CPUtime=4.7 cores=0,2,4,6
/proc/32153/task/32171/stat : 32171 (pb_cplex) R 32152 32152 31871 0 -1 4202560 2397 0 0 0 470 0 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 4093441000 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32172] ppid=32152 vsize=389288 CPUtime=4.25 cores=0,2,4,6
/proc/32153/task/32172/stat : 32172 (pb_cplex) R 32152 32152 31871 0 -1 4202560 1811 0 0 0 425 0 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 4052046416 136403117 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32173] ppid=32152 vsize=389288 CPUtime=3.59 cores=0,2,4,6
/proc/32153/task/32173/stat : 32173 (pb_cplex) R 32152 32152 31871 0 -1 4202560 2310 0 0 0 357 2 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 4019536848 136365094 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32174] ppid=32152 vsize=389288 CPUtime=4.7 cores=0,2,4,6
/proc/32153/task/32174/stat : 32174 (pb_cplex) R 32152 32152 31871 0 -1 4202560 991 0 0 0 470 0 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 4009050168 136475791 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32175] ppid=32152 vsize=389288 CPUtime=4.09 cores=0,2,4,6
/proc/32153/task/32175/stat : 32175 (pb_cplex) R 32152 32152 31871 0 -1 4202560 1958 0 0 0 407 2 0 0 20 0 8 0 390818793 398630912 68350 33554432000 134512640 146736320 4294757504 3998566272 137083612 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 50.15
Current children cumulated vsize (KiB) 398436

[startup+51.1004 s]
/proc/loadavg: 7.22 2.87 1.05 3/192 32210
/proc/meminfo: memFree=29131328/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=629744 CPUtime=119.91 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) S 32152 32152 31871 0 -1 4202496 211764 0 0 0 11892 99 0 0 20 0 8 0 390817061 644857856 126094 33554432000 134512640 146736320 4294757504 4294753872 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 157436 126094 976 2985 0 154370 0
[pid=32153/tid=32204] ppid=32152 vsize=629744 CPUtime=6.4 cores=0,2,4,6
/proc/32153/task/32204/stat : 32204 (pb_cplex) S 32152 32152 31871 0 -1 4202560 4774 0 0 0 638 2 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 3998568080 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32205] ppid=32152 vsize=629744 CPUtime=7.83 cores=0,2,4,6
/proc/32153/task/32205/stat : 32205 (pb_cplex) R 32152 32152 31871 0 -1 4202560 610 0 0 0 782 1 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 4009051112 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32206] ppid=32152 vsize=629744 CPUtime=6.49 cores=0,2,4,6
/proc/32153/task/32206/stat : 32206 (pb_cplex) S 32152 32152 31871 0 -1 4202560 2179 0 0 0 648 1 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 4019539600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32207] ppid=32152 vsize=629744 CPUtime=5.62 cores=0,2,4,6
/proc/32153/task/32207/stat : 32207 (pb_cplex) R 32152 32152 31871 0 -1 4202560 8892 0 0 0 560 2 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 4052044804 136385175 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32208] ppid=32152 vsize=629744 CPUtime=5.46 cores=0,2,4,6
/proc/32153/task/32208/stat : 32208 (pb_cplex) R 32152 32152 31871 0 -1 4202560 2349 0 0 0 544 2 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 3764351976 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32209] ppid=32152 vsize=629744 CPUtime=5.75 cores=0,2,4,6
/proc/32153/task/32209/stat : 32209 (pb_cplex) R 32152 32152 31871 0 -1 4202560 718 0 0 0 573 2 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 3753865284 136385179 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32210] ppid=32152 vsize=629744 CPUtime=6.22 cores=0,2,4,6
/proc/32153/task/32210/stat : 32210 (pb_cplex) R 32152 32152 31871 0 -1 4202560 1006 0 0 0 621 1 0 0 20 0 8 0 390820595 644857856 126094 33554432000 134512640 146736320 4294757504 3743379368 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 119.91
Current children cumulated vsize (KiB) 638892

[startup+102.307 s]
/proc/loadavg: 10.30 4.47 1.70 15/193 32211
/proc/meminfo: memFree=29049324/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=705756 CPUtime=281.21 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 447079 0 0 0 27918 203 0 0 20 0 8 0 390817061 722694144 145140 33554432000 134512640 146736320 4294757504 4294750200 136475795 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/32153/statm: 176439 145140 977 2985 0 173373 0
[pid=32153/tid=32204] ppid=32152 vsize=705756 CPUtime=25.64 cores=0,2,4,6
/proc/32153/task/32204/stat : 32204 (pb_cplex) R 32152 32152 31871 0 -1 4202560 42716 0 0 0 2547 17 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 3998564808 136001601 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32205] ppid=32152 vsize=705756 CPUtime=27.42 cores=0,2,4,6
/proc/32153/task/32205/stat : 32205 (pb_cplex) R 32152 32152 31871 0 -1 4202560 29727 0 0 0 2728 14 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 4009051112 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32206] ppid=32152 vsize=705756 CPUtime=26.68 cores=0,2,4,6
/proc/32153/task/32206/stat : 32206 (pb_cplex) R 32152 32152 31871 0 -1 4202560 24659 0 0 0 2655 13 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 4019536872 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32207] ppid=32152 vsize=705756 CPUtime=25.38 cores=0,2,4,6
/proc/32153/task/32207/stat : 32207 (pb_cplex) R 32152 32152 31871 0 -1 4202560 35468 0 0 0 2526 12 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 4052046280 136000710 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32208] ppid=32152 vsize=705756 CPUtime=25.93 cores=0,2,4,6
/proc/32153/task/32208/stat : 32208 (pb_cplex) R 32152 32152 31871 0 -1 4202560 29723 0 0 0 2582 11 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 3764350156 135465102 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32209] ppid=32152 vsize=705756 CPUtime=27.54 cores=0,2,4,6
/proc/32153/task/32209/stat : 32209 (pb_cplex) R 32152 32152 31871 0 -1 4202560 37654 0 0 0 2734 20 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 3753864456 135982430 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32210] ppid=32152 vsize=705756 CPUtime=26.52 cores=0,2,4,6
/proc/32153/task/32210/stat : 32210 (pb_cplex) R 32152 32152 31871 0 -1 4202560 26554 0 0 0 2638 14 0 0 20 0 8 0 390820595 722694144 145140 33554432000 134512640 146736320 4294757504 3743379732 136003499 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 281.21
Current children cumulated vsize (KiB) 714904

############
# WARNING:
# current cumulated CPU time (444.53 s) is less than in the last sample (444.62 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (0.0900269 s) to the 'lost time'.

[startup+145 s]
/proc/loadavg: 12.20 5.70 2.23 10/193 32211
/proc/meminfo: memFree=29034900/32873648 swapFree=7112/7112

################
# More data... #
################

[pid=32153/tid=32237] ppid=32152 vsize=889084 CPUtime=52.33 cores=0,2,4,6
/proc/32153/task/32237/stat : 32237 (pb_cplex) R 32152 32152 31871 0 -1 4202560 74283 0 0 0 5201 32 0 0 20 0 8 0 390832027 910422016 167048 33554432000 134512640 146736320 4294757504 3615712232 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32238] ppid=32152 vsize=889084 CPUtime=54.06 cores=0,2,4,6
/proc/32153/task/32238/stat : 32238 (pb_cplex) R 32152 32152 31871 0 -1 4202560 92428 0 0 0 5369 37 0 0 20 0 8 0 390832027 910422016 167048 33554432000 134512640 146736320 4294757504 3605226112 139046538 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32239] ppid=32152 vsize=889084 CPUtime=52.72 cores=0,2,4,6
/proc/32153/task/32239/stat : 32239 (pb_cplex) R 32152 32152 31871 0 -1 4202560 114131 0 0 0 5236 36 0 0 20 0 8 0 390832027 910422016 167048 33554432000 134512640 146736320 4294757504 3594740712 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 872.69
Current children cumulated vsize (KiB) 898232

[startup+342.3 s]
/proc/loadavg: 11.84 8.72 4.10 11/193 32240
/proc/meminfo: memFree=28830412/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=969968 CPUtime=1069.35 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) S 32152 32152 31871 0 -1 4202496 1652772 0 0 0 106192 743 0 0 20 0 8 0 390817061 993247232 187910 33554432000 134512640 146736320 4294757504 4294753872 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/32153/statm: 242492 187910 1001 2985 0 239426 0
[pid=32153/tid=32233] ppid=32152 vsize=969968 CPUtime=76.55 cores=0,2,4,6
/proc/32153/task/32233/stat : 32233 (pb_cplex) S 32152 32152 31871 0 -1 4202560 141414 0 0 0 7597 58 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 3971677840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32234] ppid=32152 vsize=969968 CPUtime=76.82 cores=0,2,4,6
/proc/32153/task/32234/stat : 32234 (pb_cplex) S 32152 32152 31871 0 -1 4202560 108006 0 0 0 7629 53 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 3982163600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32235] ppid=32152 vsize=969968 CPUtime=75.18 cores=0,2,4,6
/proc/32153/task/32235/stat : 32235 (pb_cplex) S 32152 32152 31871 0 -1 4202560 113247 0 0 0 7467 51 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 4019539600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32236] ppid=32152 vsize=969968 CPUtime=77.33 cores=0,2,4,6
/proc/32153/task/32236/stat : 32236 (pb_cplex) S 32152 32152 31871 0 -1 4202560 170183 0 0 0 7673 60 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 4052049552 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32237] ppid=32152 vsize=969968 CPUtime=76.77 cores=0,2,4,6
/proc/32153/task/32237/stat : 32237 (pb_cplex) S 32152 32152 31871 0 -1 4202560 107755 0 0 0 7627 50 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 3615714960 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32238] ppid=32152 vsize=969968 CPUtime=78.6 cores=0,2,4,6
/proc/32153/task/32238/stat : 32238 (pb_cplex) S 32152 32152 31871 0 -1 4202560 108371 0 0 0 7811 49 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 3605229200 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32239] ppid=32152 vsize=969968 CPUtime=77.31 cores=0,2,4,6
/proc/32153/task/32239/stat : 32239 (pb_cplex) R 32152 32152 31871 0 -1 4202560 137154 0 0 0 7680 51 0 0 20 0 8 0 390832027 993247232 187910 33554432000 134512640 146736320 4294757504 3594735544 136475800 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1069.35
Current children cumulated vsize (KiB) 979116

[startup+402.3 s]
/proc/loadavg: 11.82 9.22 4.55 9/193 32240
/proc/meminfo: memFree=28752052/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=1041412 CPUtime=1257.3 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 1850752 0 0 0 124879 851 0 0 20 0 8 0 390817061 1066405888 206653 33554432000 134512640 146736320 4294757504 4294750056 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/32153/statm: 260353 206653 1001 2985 0 257287 0
[pid=32153/tid=32233] ppid=32152 vsize=1041412 CPUtime=99.84 cores=0,2,4,6
/proc/32153/task/32233/stat : 32233 (pb_cplex) S 32152 32152 31871 0 -1 4202560 143449 0 0 0 9916 68 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 3971677840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32234] ppid=32152 vsize=1041412 CPUtime=101.08 cores=0,2,4,6
/proc/32153/task/32234/stat : 32234 (pb_cplex) S 32152 32152 31871 0 -1 4202560 138694 0 0 0 10041 67 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 3982163600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32235] ppid=32152 vsize=1041412 CPUtime=98.21 cores=0,2,4,6
/proc/32153/task/32235/stat : 32235 (pb_cplex) S 32152 32152 31871 0 -1 4202560 144515 0 0 0 9755 66 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 4019539600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32236] ppid=32152 vsize=1041412 CPUtime=100.15 cores=0,2,4,6
/proc/32153/task/32236/stat : 32236 (pb_cplex) S 32152 32152 31871 0 -1 4202560 172971 0 0 0 9945 70 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 4052049552 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32237] ppid=32152 vsize=1041412 CPUtime=100.84 cores=0,2,4,6
/proc/32153/task/32237/stat : 32237 (pb_cplex) S 32152 32152 31871 0 -1 4202560 121747 0 0 0 10022 62 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 3615714960 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32238] ppid=32152 vsize=1041412 CPUtime=100.9 cores=0,2,4,6
/proc/32153/task/32238/stat : 32238 (pb_cplex) S 32152 32152 31871 0 -1 4202560 123457 0 0 0 10030 60 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 3605229200 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32239] ppid=32152 vsize=1041412 CPUtime=100.53 cores=0,2,4,6
/proc/32153/task/32239/stat : 32239 (pb_cplex) S 32152 32152 31871 0 -1 4202560 192605 0 0 0 9983 70 0 0 20 0 8 0 390832027 1066405888 206653 33554432000 134512640 146736320 4294757504 3594743440 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1257.3
Current children cumulated vsize (KiB) 1050560

[startup+462.3 s]
/proc/loadavg: 11.11 9.53 4.95 17/193 32240
/proc/meminfo: memFree=28681440/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=1107724 CPUtime=1434.69 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 1963528 0 0 0 142530 939 0 0 20 0 8 0 390817061 1134309376 223948 33554432000 134512640 146736320 4294757504 4294751144 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 276931 223948 1001 2985 0 273865 0
[pid=32153/tid=32233] ppid=32152 vsize=1107724 CPUtime=120.71 cores=0,2,4,6
/proc/32153/task/32233/stat : 32233 (pb_cplex) R 32152 32152 31871 0 -1 4202560 152222 0 0 0 11993 78 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 3971675112 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32234] ppid=32152 vsize=1107724 CPUtime=122.97 cores=0,2,4,6
/proc/32153/task/32234/stat : 32234 (pb_cplex) R 32152 32152 31871 0 -1 4202560 158236 0 0 0 12218 79 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 3982161068 137341232 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32235] ppid=32152 vsize=1107724 CPUtime=119.94 cores=0,2,4,6
/proc/32153/task/32235/stat : 32235 (pb_cplex) R 32152 32152 31871 0 -1 4202560 149883 0 0 0 11918 76 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 4019535940 136385167 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32236] ppid=32152 vsize=1107724 CPUtime=123.41 cores=0,2,4,6
/proc/32153/task/32236/stat : 32236 (pb_cplex) R 32152 32152 31871 0 -1 4202560 194229 0 0 0 12259 82 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 4052044172 135465184 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32237] ppid=32152 vsize=1107724 CPUtime=122.72 cores=0,2,4,6
/proc/32153/task/32237/stat : 32237 (pb_cplex) R 32152 32152 31871 0 -1 4202560 125863 0 0 0 12200 72 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 3615712132 135850627 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32238] ppid=32152 vsize=1107724 CPUtime=122.73 cores=0,2,4,6
/proc/32153/task/32238/stat : 32238 (pb_cplex) R 32152 32152 31871 0 -1 4202560 128325 0 0 0 12204 69 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 3605225380 136016728 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32239] ppid=32152 vsize=1107724 CPUtime=122.66 cores=0,2,4,6
/proc/32153/task/32239/stat : 32239 (pb_cplex) R 32152 32152 31871 0 -1 4202560 200010 0 0 0 12187 79 0 0 20 0 8 0 390832027 1134309376 223948 33554432000 134512640 146736320 4294757504 3594740712 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1434.69
Current children cumulated vsize (KiB) 1116872

[startup+522.3 s]
/proc/loadavg: 10.34 9.64 5.28 10/187 32294
/proc/meminfo: memFree=28771512/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=1178932 CPUtime=1626.7 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) R 32152 32152 31871 0 -1 4202496 2129841 0 0 0 161625 1045 0 0 20 0 8 0 390817061 1207226368 241734 33554432000 134512640 146736320 4294757504 4294751144 144757825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/32153/statm: 294733 241734 1001 2985 0 291667 0
[pid=32153/tid=32233] ppid=32152 vsize=1178932 CPUtime=144.29 cores=0,2,4,6
/proc/32153/task/32233/stat : 32233 (pb_cplex) R 32152 32152 31871 0 -1 4202560 170572 0 0 0 14336 93 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 3971674168 136475800 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32234] ppid=32152 vsize=1178932 CPUtime=146.69 cores=0,2,4,6
/proc/32153/task/32234/stat : 32234 (pb_cplex) R 32152 32152 31871 0 -1 4202560 188349 0 0 0 14574 95 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 3982160920 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32235] ppid=32152 vsize=1178932 CPUtime=144.65 cores=0,2,4,6
/proc/32153/task/32235/stat : 32235 (pb_cplex) R 32152 32152 31871 0 -1 4202560 175172 0 0 0 14373 92 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 4019535920 136384857 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32236] ppid=32152 vsize=1178932 CPUtime=147.18 cores=0,2,4,6
/proc/32153/task/32236/stat : 32236 (pb_cplex) R 32152 32152 31871 0 -1 4202560 204239 0 0 0 14623 95 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 4052047744 137085076 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32237] ppid=32152 vsize=1178932 CPUtime=146.07 cores=0,2,4,6
/proc/32153/task/32237/stat : 32237 (pb_cplex) S 32152 32152 31871 0 -1 4202560 138060 0 0 0 14523 84 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 3615714960 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32238] ppid=32152 vsize=1178932 CPUtime=145.22 cores=0,2,4,6
/proc/32153/task/32238/stat : 32238 (pb_cplex) R 32152 32152 31871 0 -1 4202560 142872 0 0 0 14441 81 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 3605224620 135454093 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32153/tid=32239] ppid=32152 vsize=1178932 CPUtime=146.64 cores=0,2,4,6
/proc/32153/task/32239/stat : 32239 (pb_cplex) R 32152 32152 31871 0 -1 4202560 203057 0 0 0 14574 90 0 0 20 0 8 0 390832027 1207226368 241734 33554432000 134512640 146736320 4294757504 3594740912 137344342 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1626.7
Current children cumulated vsize (KiB) 1188080



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+574.6 s]
/proc/loadavg: 8.24 9.16 5.34 3/186 32294
/proc/meminfo: memFree=28691540/32873648 swapFree=7112/7112
[pid=32152] ppid=32150 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32152/stat : 32152 (run) S 32150 32152 31871 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 390817061 9367552 270 33554432000 4194304 5064252 140736418206672 140736418205584 242167211598 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/32152/statm: 2287 270 229 213 0 72 0
[pid=32153] ppid=32152 vsize=1245104 CPUtime=1799.92 cores=0,2,4,6
/proc/32153/stat : 32153 (pb_cplex) S 32152 32152 31871 0 -1 4202496 2260064 0 0 0 178856 1136 0 0 20 0 8 0 390817061 1274986496 258329 33554432000 134512640 146736320 4294757504 4294753872 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/32153/statm: 311276 258329 1001 2985 0 308210 0
[pid=32153/tid=32233] ppid=32152 vsize=1245104 CPUtime=165.82 cores=0,2,4,6
/proc/32153/task/32233/stat : 32233 (pb_cplex) S 32152 32152 31871 0 -1 4202560 179554 0 0 0 16480 102 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 3971677840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32153/tid=32234] ppid=32152 vsize=1245104 CPUtime=168.44 cores=0,2,4,6
/proc/32153/task/32234/stat : 32234 (pb_cplex) S 32152 32152 31871 0 -1 4202560 226846 0 0 0 16730 114 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 3982163600 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32235] ppid=32152 vsize=1245104 CPUtime=166.54 cores=0,2,4,6
/proc/32153/task/32235/stat : 32235 (pb_cplex) R 32152 32152 31871 0 -1 4202560 188588 0 0 0 16552 102 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 4019530768 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32236] ppid=32152 vsize=1245104 CPUtime=168.29 cores=0,2,4,6
/proc/32153/task/32236/stat : 32236 (pb_cplex) S 32152 32152 31871 0 -1 4202560 208116 0 0 0 16724 105 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 4052049552 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32237] ppid=32152 vsize=1245104 CPUtime=167.82 cores=0,2,4,6
/proc/32153/task/32237/stat : 32237 (pb_cplex) S 32152 32152 31871 0 -1 4202560 142713 0 0 0 16689 93 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 3615714960 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32153/tid=32238] ppid=32152 vsize=1245104 CPUtime=166.42 cores=0,2,4,6
/proc/32153/task/32238/stat : 32238 (pb_cplex) S 32152 32152 31871 0 -1 4202560 156868 0 0 0 16551 91 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 3605229200 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32153/tid=32239] ppid=32152 vsize=1245104 CPUtime=167.93 cores=0,2,4,6
/proc/32153/task/32239/stat : 32239 (pb_cplex) S 32152 32152 31871 0 -1 4202560 205869 0 0 0 16696 97 0 0 20 0 8 0 390832027 1274986496 258329 33554432000 134512640 146736320 4294757504 3594743440 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1799.92
Current children cumulated vsize (KiB) 1254252

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32152 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 1799.92
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 0.0900269
#  lost CPU user time (s): 0.120026
#  lost CPU system time (s): -0.03

Real time (s): 574.616
CPU time (s): 1800.01
CPU user time (s): 1788.68
CPU system time (s): 11.33
CPU usage (%): 313.255
Max. virtual memory (cumulated for all children) (KiB): 1254252

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 1.51177 second user time and 3.77443 second system time

The end

Launcher Data 

Begin job on node126 at 2012-06-09 15:01:51
IDJOB=3731642
IDBENCH=1972
IDSOLVER=2325
FILE ID=node126/3731642-1339246911
RUNJOBID= node126-1339246833-31888
PBS_JOBID= 14644355
Free space on /tmp= 70916 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/wnq/normalized-wnq_n100_mw99_9.opb.PB06.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731642-1339246911/watcher-3731642-1339246911 -o /tmp/evaluation-result-3731642-1339246911/solver-3731642-1339246911 -C 1800 -W 1900 -M 15500  run HOME/instance-3731642-1339246911.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 093efae700664f798191c0b27cec34af
RANDOM SEED=1498214333

node126.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29651660 kB
Buffers:          595972 kB
Cached:          1485036 kB
SwapCached:         8292 kB
Active:          2136364 kB
Inactive:         120740 kB
Active(anon):     163776 kB
Inactive(anon):    11060 kB
Active(file):    1972588 kB
Inactive(file):   109680 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67095016 kB
Dirty:             33008 kB
Writeback:             0 kB
AnonPages:        189756 kB
Mapped:            13216 kB
Shmem:                 0 kB
Slab:             824208 kB
SReclaimable:     268284 kB
SUnreclaim:       555924 kB
KernelStack:        1608 kB
PageTables:         4444 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     268656 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     63488 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731642-1339246911.opb

Free space on /tmp at the end= 70896 MiB
End job on node126 at 2012-06-09 15:11:28