Trace number 3734953

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.02 1177.02

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/market-split/normalized-opt-market-split_7_60_2.opb
MD5SUMa70b0edfadf87ffd0bc1b32400cae43b
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark8
Best CPU time to get the best result obtained on this benchmark1798.7
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 18
Optimality of the best value was proved NO
Number of variables172
Total number of constraints14
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints14
Minimum length of a constraint74
Maximum length of a constraint76
Number of terms in the objective function 112
Biggest coefficient in the objective function 128
Number of bits for the biggest coefficient in the objective function 8
Sum of the numbers in the objective function 3570
Number of bits of the sum of numbers in the objective function 12
Biggest number in a constraint 1648
Number of bits of the biggest number in a constraint 11
Biggest sum of numbers in a constraint 5454
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3734953-1339247692.opb.
0.00/0.00	c Instance file HOME/instance-3734953-1339247692.opb
0.00/0.00	c File size is 10354 bytes.
0.00/0.01	c Highest Coefficient sum: 5454
0.00/0.01	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.01         s                                      |
0.00/0.01	c |  Number Variables:      172                                                 |
0.00/0.01	c |  Number Constraints:    14                                                  |
0.00/0.01	c ===============================================================================
1799.98/1177.01	c Remaining time 1799.99 sec.
1799.98/1177.01	c 
1799.98/1177.01	c *** INTERRUPTED ***
1799.98/1177.01	s UNKNOWN
1799.98/1177.01	c Total CPU time              : 1680.96 s
1799.98/1177.01	c Memory used           : 198.75 MB
1799.98/1177.01	c CPU time              : 1680.96 s
1799.98/1177.01	c 
1799.98/1177.01	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3734953-1339247692/watcher-3734953-1339247692 -o /tmp/evaluation-result-3734953-1339247692/solver-3734953-1339247692 -C 1800 -W 1900 -M 15500 run HOME/instance-3734953-1339247692.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.55 8.94 4.84 3/182 11983
/proc/meminfo: memFree=31458844/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0

[startup+0.0595301 s]
/proc/loadavg: 8.55 8.94 4.84 3/182 11983
/proc/meminfo: memFree=31458844/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100178 s]
/proc/loadavg: 8.55 8.94 4.84 3/182 11983
/proc/meminfo: memFree=31458844/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300148 s]
/proc/loadavg: 8.55 8.94 4.84 3/182 11983
/proc/meminfo: memFree=31458844/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700144 s]
/proc/loadavg: 8.55 8.94 4.84 3/182 11983
/proc/meminfo: memFree=31458844/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50036 s]
/proc/loadavg: 8.55 8.94 4.84 5/191 12034
/proc/meminfo: memFree=31444756/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=97920 CPUtime=3.99 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) S 11983 11983 11452 0 -1 4202496 13578 0 0 0 375 24 0 0 20 0 8 0 390894227 100270080 4430 33554432000 134512640 146736320 4293655936 4293652304 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11984/statm: 24480 4430 974 2985 0 21414 0
[pid=11984/tid=12028] ppid=11983 vsize=97920 CPUtime=0.27 cores=0,2,4,6
/proc/11984/task/12028/stat : 12028 (pb_cplex) S 11983 11983 11452 0 -1 4202560 520 0 0 0 25 2 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4130885264 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12029] ppid=11983 vsize=97920 CPUtime=0.22 cores=0,2,4,6
/proc/11984/task/12029/stat : 12029 (pb_cplex) R 11983 11983 11452 0 -1 4202560 310 0 0 0 20 2 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4141364700 144785853 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12030] ppid=11983 vsize=97920 CPUtime=0.28 cores=0,2,4,6
/proc/11984/task/12030/stat : 12030 (pb_cplex) S 11983 11983 11452 0 -1 4202560 203 0 0 0 26 2 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4151856784 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12031] ppid=11983 vsize=97920 CPUtime=0.21 cores=0,2,4,6
/proc/11984/task/12031/stat : 12031 (pb_cplex) S 11983 11983 11452 0 -1 4202560 439 0 0 0 19 2 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12032] ppid=11983 vsize=97920 CPUtime=0.27 cores=0,2,4,6
/proc/11984/task/12032/stat : 12032 (pb_cplex) S 11983 11983 11452 0 -1 4202560 446 0 0 0 26 1 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4106219152 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12033] ppid=11983 vsize=97920 CPUtime=0.22 cores=0,2,4,6
/proc/11984/task/12033/stat : 12033 (pb_cplex) S 11983 11983 11452 0 -1 4202560 365 0 0 0 22 0 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4095733392 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12034] ppid=11983 vsize=97920 CPUtime=0.26 cores=0,2,4,6
/proc/11984/task/12034/stat : 12034 (pb_cplex) S 11983 11983 11452 0 -1 4202560 455 0 0 0 24 2 0 0 20 0 8 0 390894290 100270080 4430 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 3.99
Current children cumulated vsize (KiB) 107068

[startup+3.10033 s]
/proc/loadavg: 8.55 8.94 4.84 4/191 12034
/proc/meminfo: memFree=31443144/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=99212 CPUtime=6.88 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) S 11983 11983 11452 0 -1 4202496 16985 0 0 0 642 46 0 0 20 0 8 0 390894227 101593088 4975 33554432000 134512640 146736320 4293655936 4293652304 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/11984/statm: 24803 4975 974 2985 0 21737 0
[pid=11984/tid=12028] ppid=11983 vsize=99212 CPUtime=0.51 cores=0,2,4,6
/proc/11984/task/12028/stat : 12028 (pb_cplex) S 11983 11983 11452 0 -1 4202560 701 0 0 0 47 4 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4130885264 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12029] ppid=11983 vsize=99212 CPUtime=0.53 cores=0,2,4,6
/proc/11984/task/12029/stat : 12029 (pb_cplex) R 11983 11983 11452 0 -1 4202560 732 0 0 0 49 4 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4141364636 144785853 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12030] ppid=11983 vsize=99212 CPUtime=0.73 cores=0,2,4,6
/proc/11984/task/12030/stat : 12030 (pb_cplex) R 11983 11983 11452 0 -1 4202560 334 0 0 0 68 5 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4151849056 136231473 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12031] ppid=11983 vsize=99212 CPUtime=0.58 cores=0,2,4,6
/proc/11984/task/12031/stat : 12031 (pb_cplex) S 11983 11983 11452 0 -1 4202560 843 0 0 0 55 3 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12032] ppid=11983 vsize=99212 CPUtime=0.69 cores=0,2,4,6
/proc/11984/task/12032/stat : 12032 (pb_cplex) S 11983 11983 11452 0 -1 4202560 1128 0 0 0 64 5 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4106219152 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12033] ppid=11983 vsize=99212 CPUtime=0.57 cores=0,2,4,6
/proc/11984/task/12033/stat : 12033 (pb_cplex) R 11983 11983 11452 0 -1 4202560 1038 0 0 0 53 4 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4095727004 144785853 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12034] ppid=11983 vsize=99212 CPUtime=0.6 cores=0,2,4,6
/proc/11984/task/12034/stat : 12034 (pb_cplex) S 11983 11983 11452 0 -1 4202560 1090 0 0 0 56 4 0 0 20 0 8 0 390894290 101593088 4975 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 6.88
Current children cumulated vsize (KiB) 108360

[startup+6.30034 s]
/proc/loadavg: 8.59 8.94 4.86 8/191 12034
/proc/meminfo: memFree=31440416/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=101528 CPUtime=18.5 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) R 11983 11983 11452 0 -1 4202496 26326 0 0 0 1753 97 0 0 20 0 8 0 390894227 103964672 5469 33554432000 134512640 146736320 4293655936 4293643664 135667420 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/11984/statm: 25382 5469 982 2985 0 22316 0
[pid=11984/tid=12028] ppid=11983 vsize=101528 CPUtime=1.94 cores=0,2,4,6
/proc/11984/task/12028/stat : 12028 (pb_cplex) R 11983 11983 11452 0 -1 4202560 2077 0 0 0 184 10 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4130878364 144785853 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12029] ppid=11983 vsize=101528 CPUtime=1.84 cores=0,2,4,6
/proc/11984/task/12029/stat : 12029 (pb_cplex) R 11983 11983 11452 0 -1 4202560 1979 0 0 0 175 9 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4141363016 136001712 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12030] ppid=11983 vsize=101528 CPUtime=2.23 cores=0,2,4,6
/proc/11984/task/12030/stat : 12030 (pb_cplex) R 11983 11983 11452 0 -1 4202560 1562 0 0 0 211 12 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4151850972 144785853 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12031] ppid=11983 vsize=101528 CPUtime=2.08 cores=0,2,4,6
/proc/11984/task/12031/stat : 12031 (pb_cplex) R 11983 11983 11452 0 -1 4202560 2128 0 0 0 199 9 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4120392604 144785853 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12032] ppid=11983 vsize=101528 CPUtime=2.27 cores=0,2,4,6
/proc/11984/task/12032/stat : 12032 (pb_cplex) R 11983 11983 11452 0 -1 4202560 2324 0 0 0 215 12 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4106213696 137147209 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12033] ppid=11983 vsize=101528 CPUtime=1.89 cores=0,2,4,6
/proc/11984/task/12033/stat : 12033 (pb_cplex) R 11983 11983 11452 0 -1 4202560 1760 0 0 0 180 9 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4095727608 137268602 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12034] ppid=11983 vsize=101528 CPUtime=1.94 cores=0,2,4,6
/proc/11984/task/12034/stat : 12034 (pb_cplex) R 11983 11983 11452 0 -1 4202560 2515 0 0 0 183 11 0 0 20 0 8 0 390894290 103964672 5469 33554432000 134512640 146736320 4293655936 4067415552 136683107 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 18.5
Current children cumulated vsize (KiB) 110676

[startup+12.7003 s]
/proc/loadavg: 7.98 8.81 4.84 4/191 12069
/proc/meminfo: memFree=31433368/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=104856 CPUtime=36.25 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) S 11983 11983 11452 0 -1 4202496 47449 0 0 0 3447 178 0 0 20 0 8 0 390894227 107372544 7494 33554432000 134512640 146736320 4293655936 4293652304 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/11984/statm: 26214 7494 983 2985 0 23148 0
[pid=11984/tid=12063] ppid=11983 vsize=104856 CPUtime=0.92 cores=0,2,4,6
/proc/11984/task/12063/stat : 12063 (pb_cplex) S 11983 11983 11452 0 -1 4202560 1532 0 0 0 89 3 0 0 20 0 8 0 390895175 107372544 7494 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12064] ppid=11983 vsize=104856 CPUtime=0.52 cores=0,2,4,6
/proc/11984/task/12064/stat : 12064 (pb_cplex) R 11983 11983 11452 0 -1 4202560 1677 0 0 0 50 2 0 0 20 0 8 0 390895175 107372544 7498 33554432000 134512640 146736320 4293655936 4095729844 144716523 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12065] ppid=11983 vsize=104856 CPUtime=0.68 cores=0,2,4,6
/proc/11984/task/12065/stat : 12065 (pb_cplex) S 11983 11983 11452 0 -1 4202560 2287 0 0 0 64 4 0 0 20 0 8 0 390895175 107372544 7503 33554432000 134512640 146736320 4293655936 4106219152 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12066] ppid=11983 vsize=104856 CPUtime=0.68 cores=0,2,4,6
/proc/11984/task/12066/stat : 12066 (pb_cplex) S 11983 11983 11452 0 -1 4202560 2209 0 0 0 64 4 0 0 20 0 8 0 390895175 107372544 7500 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12067] ppid=11983 vsize=104856 CPUtime=0.83 cores=0,2,4,6
/proc/11984/task/12067/stat : 12067 (pb_cplex) R 11983 11983 11452 0 -1 4202560 3759 0 0 0 78 5 0 0 20 0 8 0 390895175 107372544 7500 33554432000 134512640 146736320 4293655936 4148155588 135844915 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12068] ppid=11983 vsize=104856 CPUtime=0.68 cores=0,2,4,6
/proc/11984/task/12068/stat : 12068 (pb_cplex) R 11983 11983 11452 0 -1 4202560 877 0 0 0 65 3 0 0 20 0 8 0 390895175 107372544 7501 33554432000 134512640 146736320 4293655936 4137670940 144785853 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12069] ppid=11983 vsize=104856 CPUtime=0.76 cores=0,2,4,6
/proc/11984/task/12069/stat : 12069 (pb_cplex) R 11983 11983 11452 0 -1 4202560 2502 0 0 0 73 3 0 0 20 0 8 0 390895175 107372544 7496 33554432000 134512640 146736320 4293655936 4056934740 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 36.25
Current children cumulated vsize (KiB) 114004

[startup+25.5003 s]
/proc/loadavg: 6.63 8.48 4.79 3/191 12069
/proc/meminfo: memFree=31422108/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=114816 CPUtime=55.52 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) S 11983 11983 11452 0 -1 4202496 114384 0 0 0 5291 261 0 0 20 0 8 0 390894227 117571584 9880 33554432000 134512640 146736320 4293655936 4293652304 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/11984/statm: 28704 9880 983 2985 0 25638 0
[pid=11984/tid=12063] ppid=11983 vsize=114816 CPUtime=3.27 cores=0,2,4,6
/proc/11984/task/12063/stat : 12063 (pb_cplex) S 11983 11983 11452 0 -1 4202560 9547 0 0 0 315 12 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12064] ppid=11983 vsize=114816 CPUtime=2.99 cores=0,2,4,6
/proc/11984/task/12064/stat : 12064 (pb_cplex) S 11983 11983 11452 0 -1 4202560 10625 0 0 0 289 10 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4095733392 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12065] ppid=11983 vsize=114816 CPUtime=2.93 cores=0,2,4,6
/proc/11984/task/12065/stat : 12065 (pb_cplex) S 11983 11983 11452 0 -1 4202560 9663 0 0 0 279 14 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4106219152 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12066] ppid=11983 vsize=114816 CPUtime=2.73 cores=0,2,4,6
/proc/11984/task/12066/stat : 12066 (pb_cplex) S 11983 11983 11452 0 -1 4202560 8096 0 0 0 260 13 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12067] ppid=11983 vsize=114816 CPUtime=3.47 cores=0,2,4,6
/proc/11984/task/12067/stat : 12067 (pb_cplex) R 11983 11983 11452 0 -1 4202560 15009 0 0 0 331 16 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4148155804 144785853 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12068] ppid=11983 vsize=114816 CPUtime=3.26 cores=0,2,4,6
/proc/11984/task/12068/stat : 12068 (pb_cplex) S 11983 11983 11452 0 -1 4202560 10999 0 0 0 311 15 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4137676432 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12069] ppid=11983 vsize=114816 CPUtime=2.85 cores=0,2,4,6
/proc/11984/task/12069/stat : 12069 (pb_cplex) S 11983 11983 11452 0 -1 4202560 8621 0 0 0 272 13 0 0 20 0 8 0 390895175 117571584 9880 33554432000 134512640 146736320 4293655936 4056936080 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 55.52
Current children cumulated vsize (KiB) 123964

[startup+51.1003 s]
/proc/loadavg: 5.46 8.05 4.75 7/191 12070
/proc/meminfo: memFree=31400964/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0

################
# More data... #
################

[pid=11984/tid=12103] ppid=11983 vsize=196952 CPUtime=138.31 cores=0,2,4,6
/proc/11984/task/12103/stat : 12103 (pb_cplex) R 11983 11983 11452 0 -1 4202560 98798 0 0 0 12843 988 0 0 20 0 8 0 390904281 201678848 29246 33554432000 134512640 146736320 4293655936 4109907816 136737306 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12104] ppid=11983 vsize=196952 CPUtime=137.46 cores=0,2,4,6
/proc/11984/task/12104/stat : 12104 (pb_cplex) S 11983 11983 11452 0 -1 4202560 99596 0 0 0 12759 987 0 0 20 0 8 0 390904281 201678848 29246 33554432000 134512640 146736320 4293655936 4099427984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12105] ppid=11983 vsize=196952 CPUtime=138.61 cores=0,2,4,6
/proc/11984/task/12105/stat : 12105 (pb_cplex) S 11983 11983 11452 0 -1 4202560 100158 0 0 0 12864 997 0 0 20 0 8 0 390904281 201678848 29246 33554432000 134512640 146736320 4293655936 4088942224 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1360.57
Current children cumulated vsize (KiB) 206100

[startup+942.3 s]
/proc/loadavg: 1.61 2.22 3.02 4/192 12113
/proc/meminfo: memFree=31302112/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=198012 CPUtime=1449.6 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) S 11983 11983 11452 0 -1 4202496 1310468 0 0 0 135514 9446 0 0 20 0 8 0 390894227 202764288 29376 33554432000 134512640 146736320 4293655936 4293652304 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/11984/statm: 49503 29376 983 2985 0 46437 0
[pid=11984/tid=12099] ppid=11983 vsize=198012 CPUtime=150.61 cores=0,2,4,6
/proc/11984/task/12099/stat : 12099 (pb_cplex) R 11983 11983 11452 0 -1 4202560 106867 0 0 0 13998 1063 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4067421868 144580332 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12100] ppid=11983 vsize=198012 CPUtime=150.29 cores=0,2,4,6
/proc/11984/task/12100/stat : 12100 (pb_cplex) S 11983 11983 11452 0 -1 4202560 106861 0 0 0 13956 1073 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4139773584 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12101] ppid=11983 vsize=198012 CPUtime=149.32 cores=0,2,4,6
/proc/11984/task/12101/stat : 12101 (pb_cplex) S 11983 11983 11452 0 -1 4202560 103342 0 0 0 13853 1079 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4150259344 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12102] ppid=11983 vsize=198012 CPUtime=150.85 cores=0,2,4,6
/proc/11984/task/12102/stat : 12102 (pb_cplex) R 11983 11983 11452 0 -1 4202560 104408 0 0 0 14014 1071 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4120398492 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 1 0 0
[pid=11984/tid=12103] ppid=11983 vsize=198012 CPUtime=148.86 cores=0,2,4,6
/proc/11984/task/12103/stat : 12103 (pb_cplex) R 11983 11983 11452 0 -1 4202560 105005 0 0 0 13821 1065 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4109911576 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12104] ppid=11983 vsize=198012 CPUtime=147.28 cores=0,2,4,6
/proc/11984/task/12104/stat : 12104 (pb_cplex) R 11983 11983 11452 0 -1 4202560 105415 0 0 0 13666 1062 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4099426904 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12105] ppid=11983 vsize=198012 CPUtime=149.28 cores=0,2,4,6
/proc/11984/task/12105/stat : 12105 (pb_cplex) R 11983 11983 11452 0 -1 4202560 106410 0 0 0 13850 1078 0 0 20 0 8 0 390904281 202764288 29376 33554432000 134512640 146736320 4293655936 4088942224 144580073 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1449.6
Current children cumulated vsize (KiB) 207160

[startup+1002.3 s]
/proc/loadavg: 2.32 2.31 3.00 3/191 12114
/proc/meminfo: memFree=31301500/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=199900 CPUtime=1537.48 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) S 11983 11983 11452 0 -1 4202496 1361331 0 0 0 143676 10072 0 0 20 0 8 0 390894227 204697600 29540 33554432000 134512640 146736320 4293655936 4293652304 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11984/statm: 49975 29540 983 2985 0 46909 0
[pid=11984/tid=12099] ppid=11983 vsize=199900 CPUtime=161.11 cores=0,2,4,6
/proc/11984/task/12099/stat : 12099 (pb_cplex) S 11983 11983 11452 0 -1 4202560 112888 0 0 0 14971 1140 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12100] ppid=11983 vsize=199900 CPUtime=161.18 cores=0,2,4,6
/proc/11984/task/12100/stat : 12100 (pb_cplex) S 11983 11983 11452 0 -1 4202560 112944 0 0 0 14964 1154 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4139773584 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12101] ppid=11983 vsize=199900 CPUtime=160.2 cores=0,2,4,6
/proc/11984/task/12101/stat : 12101 (pb_cplex) S 11983 11983 11452 0 -1 4202560 110185 0 0 0 14861 1159 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4150259344 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12102] ppid=11983 vsize=199900 CPUtime=161.32 cores=0,2,4,6
/proc/11984/task/12102/stat : 12102 (pb_cplex) S 11983 11983 11452 0 -1 4202560 110448 0 0 0 14981 1151 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 1 0 0
[pid=11984/tid=12103] ppid=11983 vsize=199900 CPUtime=159.66 cores=0,2,4,6
/proc/11984/task/12103/stat : 12103 (pb_cplex) R 11983 11983 11452 0 -1 4202560 112169 0 0 0 14820 1146 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4109911016 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12104] ppid=11983 vsize=199900 CPUtime=157.73 cores=0,2,4,6
/proc/11984/task/12104/stat : 12104 (pb_cplex) S 11983 11983 11452 0 -1 4202560 111316 0 0 0 14633 1140 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4099427984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12105] ppid=11983 vsize=199900 CPUtime=159.58 cores=0,2,4,6
/proc/11984/task/12105/stat : 12105 (pb_cplex) S 11983 11983 11452 0 -1 4202560 112481 0 0 0 14810 1148 0 0 20 0 8 0 390904281 204697600 29540 33554432000 134512640 146736320 4293655936 4088942224 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1537.48
Current children cumulated vsize (KiB) 209048

[startup+1062.3 s]
/proc/loadavg: 2.13 2.27 2.94 3/191 12114
/proc/meminfo: memFree=31299888/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=201052 CPUtime=1625.71 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) R 11983 11983 11452 0 -1 4202496 1416398 0 0 0 151871 10700 0 0 20 0 8 0 390894227 205877248 29827 33554432000 134512640 146736320 4293655936 4293644800 144785853 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11984/statm: 50263 29827 983 2985 0 47197 0
[pid=11984/tid=12099] ppid=11983 vsize=201052 CPUtime=171.82 cores=0,2,4,6
/proc/11984/task/12099/stat : 12099 (pb_cplex) S 11983 11983 11452 0 -1 4202560 119898 0 0 0 15961 1221 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12100] ppid=11983 vsize=201052 CPUtime=172.01 cores=0,2,4,6
/proc/11984/task/12100/stat : 12100 (pb_cplex) S 11983 11983 11452 0 -1 4202560 120447 0 0 0 15969 1232 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4139773584 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12101] ppid=11983 vsize=201052 CPUtime=170.65 cores=0,2,4,6
/proc/11984/task/12101/stat : 12101 (pb_cplex) S 11983 11983 11452 0 -1 4202560 116331 0 0 0 15825 1240 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4150259344 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12102] ppid=11983 vsize=201052 CPUtime=172.07 cores=0,2,4,6
/proc/11984/task/12102/stat : 12102 (pb_cplex) S 11983 11983 11452 0 -1 4202560 117656 0 0 0 15976 1231 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 1 0 0
[pid=11984/tid=12103] ppid=11983 vsize=201052 CPUtime=169.89 cores=0,2,4,6
/proc/11984/task/12103/stat : 12103 (pb_cplex) S 11983 11983 11452 0 -1 4202560 119077 0 0 0 15766 1223 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4109913744 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12104] ppid=11983 vsize=201052 CPUtime=168.74 cores=0,2,4,6
/proc/11984/task/12104/stat : 12104 (pb_cplex) S 11983 11983 11452 0 -1 4202560 118542 0 0 0 15657 1217 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4099427984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12105] ppid=11983 vsize=201052 CPUtime=170.15 cores=0,2,4,6
/proc/11984/task/12105/stat : 12105 (pb_cplex) R 11983 11983 11452 0 -1 4202560 119739 0 0 0 15788 1227 0 0 20 0 8 0 390904281 205877248 29827 33554432000 134512640 146736320 4293655936 4088934432 144716479 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1625.71
Current children cumulated vsize (KiB) 210200

[startup+1122.3 s]
/proc/loadavg: 1.89 2.16 2.86 4/184 12166
/proc/meminfo: memFree=31101804/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=201364 CPUtime=1716.51 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) R 11983 11983 11452 0 -1 4202496 1503193 0 0 0 160313 11338 0 0 20 0 8 0 390894227 206196736 30194 33554432000 134512640 146736320 4293655936 4293650252 137381081 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/11984/statm: 50341 30194 983 2985 0 47275 0
[pid=11984/tid=12099] ppid=11983 vsize=201364 CPUtime=183.1 cores=0,2,4,6
/proc/11984/task/12099/stat : 12099 (pb_cplex) R 11983 11983 11452 0 -1 4202560 130684 0 0 0 17010 1300 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4067419112 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12100] ppid=11983 vsize=201364 CPUtime=182.96 cores=0,2,4,6
/proc/11984/task/12100/stat : 12100 (pb_cplex) R 11983 11983 11452 0 -1 4202560 130307 0 0 0 16986 1310 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4139770856 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12101] ppid=11983 vsize=201364 CPUtime=181.96 cores=0,2,4,6
/proc/11984/task/12101/stat : 12101 (pb_cplex) R 11983 11983 11452 0 -1 4202560 127821 0 0 0 16878 1318 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4150259344 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12102] ppid=11983 vsize=201364 CPUtime=182.79 cores=0,2,4,6
/proc/11984/task/12102/stat : 12102 (pb_cplex) S 11983 11983 11452 0 -1 4202560 127210 0 0 0 16972 1307 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 1 0 0
[pid=11984/tid=12103] ppid=11983 vsize=201364 CPUtime=180.97 cores=0,2,4,6
/proc/11984/task/12103/stat : 12103 (pb_cplex) S 11983 11983 11452 0 -1 4202560 129963 0 0 0 16794 1303 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4109913744 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12104] ppid=11983 vsize=201364 CPUtime=180.28 cores=0,2,4,6
/proc/11984/task/12104/stat : 12104 (pb_cplex) S 11983 11983 11452 0 -1 4202560 131028 0 0 0 16723 1305 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4099427984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12105] ppid=11983 vsize=201364 CPUtime=181.45 cores=0,2,4,6
/proc/11984/task/12105/stat : 12105 (pb_cplex) S 11983 11983 11452 0 -1 4202560 131052 0 0 0 16837 1308 0 0 20 0 8 0 390904281 206196736 30194 33554432000 134512640 146736320 4293655936 4088942224 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1716.51
Current children cumulated vsize (KiB) 210512



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1177.01 s]
/proc/loadavg: 2.03 2.16 2.82 3/184 12166
/proc/meminfo: memFree=31091680/32873852 swapFree=7632/7632
[pid=11983] ppid=11981 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11983/stat : 11983 (run) S 11981 11983 11452 0 -1 4202496 353 0 0 0 0 0 0 0 20 0 1 0 390894227 9367552 269 33554432000 4194304 5064252 140733619301392 140733619300304 252262901326 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11983/statm: 2287 269 229 213 0 72 0
[pid=11984] ppid=11983 vsize=203520 CPUtime=1799.98 cores=0,2,4,6
/proc/11984/stat : 11984 (pb_cplex) R 11983 11983 11452 0 -1 4202496 1576912 0 0 0 168095 11903 0 0 20 0 8 0 390894227 208404480 30602 33554432000 134512640 146736320 4293655936 4293645916 144785853 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/11984/statm: 50880 30602 983 2985 0 47814 0
[pid=11984/tid=12099] ppid=11983 vsize=203520 CPUtime=193.47 cores=0,2,4,6
/proc/11984/task/12099/stat : 12099 (pb_cplex) S 11983 11983 11452 0 -1 4202560 140770 0 0 0 17979 1368 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4067421840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12100] ppid=11983 vsize=203520 CPUtime=193.06 cores=0,2,4,6
/proc/11984/task/12100/stat : 12100 (pb_cplex) S 11983 11983 11452 0 -1 4202560 139042 0 0 0 17920 1386 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4139773584 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=11984/tid=12101] ppid=11983 vsize=203520 CPUtime=192.11 cores=0,2,4,6
/proc/11984/task/12101/stat : 12101 (pb_cplex) S 11983 11983 11452 0 -1 4202560 136309 0 0 0 17823 1388 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4150259344 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=11984/tid=12102] ppid=11983 vsize=203520 CPUtime=193.65 cores=0,2,4,6
/proc/11984/task/12102/stat : 12102 (pb_cplex) S 11983 11983 11452 0 -1 4202560 136781 0 0 0 17983 1382 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4120399504 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 1 0 0
[pid=11984/tid=12103] ppid=11983 vsize=203520 CPUtime=191.01 cores=0,2,4,6
/proc/11984/task/12103/stat : 12103 (pb_cplex) S 11983 11983 11452 0 -1 4202560 138759 0 0 0 17732 1369 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4109913744 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=11984/tid=12104] ppid=11983 vsize=203520 CPUtime=190.71 cores=0,2,4,6
/proc/11984/task/12104/stat : 12104 (pb_cplex) S 11983 11983 11452 0 -1 4202560 140444 0 0 0 17692 1379 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4099427984 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=11984/tid=12105] ppid=11983 vsize=203520 CPUtime=191.51 cores=0,2,4,6
/proc/11984/task/12105/stat : 12105 (pb_cplex) S 11983 11983 11452 0 -1 4202560 140174 0 0 0 17774 1377 0 0 20 0 8 0 390904281 208404480 30602 33554432000 134512640 146736320 4293655936 4088942224 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1799.98
Current children cumulated vsize (KiB) 212668

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11983 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1799.98
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 0.0399933
#  lost CPU user time (s): 0.0899963
#  lost CPU system time (s): -0.0500002

Real time (s): 1177.02
CPU time (s): 1800.02
CPU user time (s): 1681.04
CPU system time (s): 118.98
CPU usage (%): 152.93
Max. virtual memory (cumulated for all children) (KiB): 212668

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1076
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 353
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 2.88056 second user time and 7.10492 second system time

The end

Launcher Data 

Begin job on node131 at 2012-06-09 15:14:52
IDJOB=3734953
IDBENCH=2924
IDSOLVER=2325
FILE ID=node131/3734953-1339247692
RUNJOBID= node131-1339246832-11469
PBS_JOBID= 14644350
Free space on /tmp= 71096 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-opt-market-split_7_60_2.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3734953-1339247692/watcher-3734953-1339247692 -o /tmp/evaluation-result-3734953-1339247692/solver-3734953-1339247692 -C 1800 -W 1900 -M 15500  run HOME/instance-3734953-1339247692.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a70b0edfadf87ffd0bc1b32400cae43b
RANDOM SEED=2109874812

node131.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        31459544 kB
Buffers:          276648 kB
Cached:           230560 kB
SwapCached:         3456 kB
Active:           335964 kB
Inactive:         194448 kB
Active(anon):      20488 kB
Inactive(anon):     4856 kB
Active(file):     315476 kB
Inactive(file):   189592 kB
Unevictable:        7632 kB
Mlocked:            7632 kB
SwapTotal:      67108856 kB
SwapFree:       67098424 kB
Dirty:             16336 kB
Writeback:             0 kB
AnonPages:         63764 kB
Mapped:            12896 kB
Shmem:                 0 kB
Slab:             744172 kB
SReclaimable:     185100 kB
SUnreclaim:       559072 kB
KernelStack:        1584 kB
PageTables:         4188 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     201992 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:     36864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3734953-1339247692.opb

Free space on /tmp at the end= 71072 MiB
End job on node131 at 2012-06-09 15:34:31