Trace number 3733842

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.08 507.217

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/golomb-rulers/normalized-OGR_16.opb
MD5SUM69b04711942c7a7cbb28264339dbffe2
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark210
Best CPU time to get the best result obtained on this benchmark1800.02
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 223
Optimality of the best value was proved NO
Number of variables5584
Total number of constraints10895
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints10895
Minimum length of a constraint18
Maximum length of a constraint37
Number of terms in the objective function 9
Biggest coefficient in the objective function 256
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 511
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 512
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 2555
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3733842-1339247486.opb.
0.00/0.00	c Instance file HOME/instance-3733842-1339247486.opb
0.00/0.00	c File size is 3082602 bytes.
1.49/1.52	c Highest Coefficient sum: 2555
1.49/1.52	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
1.49/1.54	c ============================[ Problem Statistics ]=============================
1.49/1.54	c |                                                                             |
1.49/1.54	c |  Parsing time:          1.53         s                                      |
1.49/1.54	c |  Number Variables:      5584                                                |
1.49/1.55	c |  Number Constraints:    10895                                               |
1.49/1.55	c ===============================================================================

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3733842-1339247486/watcher-3733842-1339247486 -o /tmp/evaluation-result-3733842-1339247486/solver-3733842-1339247486 -C 1800 -W 1900 -M 15500 run HOME/instance-3733842-1339247486.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 8.66 8.90 4.96 3/177 4014
/proc/meminfo: memFree=29482988/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0

[startup+0.055214 s]
/proc/loadavg: 8.66 8.90 4.96 3/177 4014
/proc/meminfo: memFree=29482988/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.10027 s]
/proc/loadavg: 8.66 8.90 4.96 3/177 4014
/proc/meminfo: memFree=29482988/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300235 s]
/proc/loadavg: 8.66 8.90 4.96 3/177 4014
/proc/meminfo: memFree=29482988/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700237 s]
/proc/loadavg: 8.66 8.90 4.96 3/177 4014
/proc/meminfo: memFree=29482988/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50027 s]
/proc/loadavg: 8.12 8.78 4.95 3/179 4016
/proc/meminfo: memFree=29477176/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=23912 CPUtime=1.49 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 3178 0 0 0 149 0 0 0 20 0 1 0 390877095 24485888 3133 33554432000 134512640 146736320 4293065408 4293063152 134589550 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 5978 3133 1027 2985 0 2159 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 33060

[startup+3.10031 s]
/proc/loadavg: 8.12 8.78 4.95 3/179 4016
/proc/meminfo: memFree=29445240/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=72140 CPUtime=3.08 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 24513 0 0 0 304 4 0 0 20 0 1 0 390877095 73871360 11882 33554432000 134512640 146736320 4293065408 4293061104 135983225 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 18035 11882 805 2985 0 14969 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 81288

[startup+6.30027 s]
/proc/loadavg: 8.12 8.78 4.95 3/179 4016
/proc/meminfo: memFree=29435748/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=84132 CPUtime=6.29 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 48744 0 0 0 618 11 0 0 20 0 1 0 390877095 86151168 15392 33554432000 134512640 146736320 4293065408 4293061704 137298806 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 21033 15392 890 2985 0 17967 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 93280

[startup+12.7003 s]
/proc/loadavg: 7.18 8.56 4.91 3/179 4016
/proc/meminfo: memFree=29368992/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=89212 CPUtime=12.69 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 62685 0 0 0 1254 15 0 0 20 0 1 0 390877095 91353088 16779 33554432000 134512640 146736320 4293065408 4293061048 137177742 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 22303 16779 890 2985 0 19237 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 98360

[startup+25.5003 s]
/proc/loadavg: 6.38 8.34 4.88 3/179 4016
/proc/meminfo: memFree=29344224/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=90372 CPUtime=25.49 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 111766 0 0 0 2520 29 0 0 20 0 1 0 390877095 92540928 17474 33554432000 134512640 146736320 4293065408 4293060992 137149036 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 22593 17474 900 2985 0 19527 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 99520

[startup+51.1005 s]
/proc/loadavg: 6.36 8.16 4.91 9/186 4023
/proc/meminfo: memFree=29076444/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=471496 CPUtime=99.49 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) S 4014 4014 3259 0 -1 4202496 190450 0 0 0 9896 53 0 0 20 0 8 0 390877095 482811904 84154 33554432000 134512640 146736320 4293065408 4293061776 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 117874 84154 945 2985 0 114808 0
[pid=4015/tid=4017] ppid=4014 vsize=471496 CPUtime=8.75 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 3290 0 0 0 873 2 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3978055752 139042977 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=471496 CPUtime=8.8 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 4722 0 0 0 878 2 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3967571964 136506713 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=471496 CPUtime=8.5 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 5640 0 0 0 848 2 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3957084368 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=471496 CPUtime=8.56 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 5827 0 0 0 854 2 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3946599296 135237146 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=471496 CPUtime=8.49 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 6665 0 0 0 848 1 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3936112680 139044581 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=471496 CPUtime=8.71 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 4282 0 0 0 869 2 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3925627272 136388078 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=471496 CPUtime=8.48 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 3122 0 0 0 847 1 0 0 20 0 8 0 390880281 482811904 84154 33554432000 134512640 146736320 4293065408 3915141328 136008299 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 99.49
Current children cumulated vsize (KiB) 480644

[startup+102.307 s]
/proc/loadavg: 7.58 8.17 5.10 10/186 4023
/proc/meminfo: memFree=28888228/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=690332 CPUtime=294.61 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 300414 0 0 0 29367 94 0 0 20 0 8 0 390877095 706899968 129342 33554432000 134512640 146736320 4293065408 4293058048 136018931 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4015/statm: 172583 129342 948 2985 0 169517 0
[pid=4015/tid=4017] ppid=4014 vsize=690332 CPUtime=34.38 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 15134 0 0 0 3433 5 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3978054704 136384895 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=690332 CPUtime=35.39 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 19333 0 0 0 3533 6 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3967570920 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=690332 CPUtime=37.03 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 23988 0 0 0 3696 7 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3957084200 139044552 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=690332 CPUtime=33.07 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 22518 0 0 0 3299 8 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3946598608 136008042 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=690332 CPUtime=31.23 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 15238 0 0 0 3117 6 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3936112848 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=690332 CPUtime=32.67 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 19314 0 0 0 3261 6 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3925626952 139042890 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=690332 CPUtime=31.46 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 16043 0 0 0 3139 7 0 0 20 0 8 0 390880281 706899968 129342 33554432000 134512640 146736320 4293065408 3915141328 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 294.61
Current children cumulated vsize (KiB) 699480

[startup+162.3 s]
/proc/loadavg: 6.83 7.93 5.21 3/186 4023
/proc/meminfo: memFree=28870732/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=704816 CPUtime=514.65 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) S 4014 4014 3259 0 -1 4202496 348431 0 0 0 51353 112 0 0 20 0 8 0 390877095 721731584 133347 33554432000 134512640 146736320 4293065408 4293061776 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 176204 133347 948 2985 0 173138 0
[pid=4015/tid=4017] ppid=4014 vsize=704816 CPUtime=64.33 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) S 4014 4014 3259 0 -1 4202560 22742 0 0 0 6426 7 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3978059408 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=704816 CPUtime=50.41 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) S 4014 4014 3259 0 -1 4202560 21542 0 0 0 5034 7 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3967573648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=704816 CPUtime=64.95 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) S 4014 4014 3259 0 -1 4202560 37966 0 0 0 6484 11 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3957087888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=704816 CPUtime=56.86 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) S 4014 4014 3259 0 -1 4202560 27649 0 0 0 5675 11 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3946602128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=704816 CPUtime=71 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 18507 0 0 0 7092 8 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3936112848 136008212 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=704816 CPUtime=71.93 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) S 4014 4014 3259 0 -1 4202560 28657 0 0 0 7183 10 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3925630608 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=704816 CPUtime=44.38 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) S 4014 4014 3259 0 -1 4202560 17790 0 0 0 4430 8 0 0 20 0 8 0 390880281 721731584 133347 33554432000 134512640 146736320 4293065408 3915144848 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 514.65

################
# More data... #
################

/proc/4015/statm: 174886 139292 948 2985 0 171820 0
[pid=4015/tid=4017] ppid=4014 vsize=699544 CPUtime=92.2 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 28046 0 0 0 9209 11 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3978055888 136008047 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=699544 CPUtime=78.48 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 33526 0 0 0 7836 12 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3967570128 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=699544 CPUtime=92.89 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 43342 0 0 0 9274 15 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3957084800 138423935 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=699544 CPUtime=84.73 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 39051 0 0 0 8457 16 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3946598608 136008050 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=699544 CPUtime=102.73 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 27648 0 0 0 10261 12 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3936112680 139044550 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=699544 CPUtime=99.87 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 34882 0 0 0 9975 12 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3925627088 136008441 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=699544 CPUtime=72.09 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 31154 0 0 0 7194 15 0 0 20 0 8 0 390880281 716333056 139292 33554432000 134512640 146736320 4293065408 3915141328 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 741.87
Current children cumulated vsize (KiB) 708692

[startup+282.301 s]
/proc/loadavg: 6.89 7.76 5.48 5/186 4024
/proc/meminfo: memFree=28838912/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=707872 CPUtime=974.02 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 473168 0 0 0 97239 163 0 0 20 0 8 0 390877095 724860928 141105 33554432000 134512640 146736320 4293065408 4293058120 139042888 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4015/statm: 176968 141105 948 2985 0 173902 0
[pid=4015/tid=4017] ppid=4014 vsize=707872 CPUtime=124.96 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) S 4014 4014 3259 0 -1 4202560 35430 0 0 0 12483 13 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3978059408 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=707872 CPUtime=86.51 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) S 4014 4014 3259 0 -1 4202560 36357 0 0 0 8637 14 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3967573648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=707872 CPUtime=128.12 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) S 4014 4014 3259 0 -1 4202560 53624 0 0 0 12792 20 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3957087888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=707872 CPUtime=93.28 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) S 4014 4014 3259 0 -1 4202560 43040 0 0 0 9311 17 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3946602128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=707872 CPUtime=117.03 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) S 4014 4014 3259 0 -1 4202560 32484 0 0 0 11689 14 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3936116368 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=707872 CPUtime=144.49 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 44506 0 0 0 14434 15 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3925626820 135523306 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=707872 CPUtime=118.17 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 38620 0 0 0 11796 21 0 0 20 0 8 0 390880281 724860928 141105 33554432000 134512640 146736320 4293065408 3915140332 135467851 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 974.02
Current children cumulated vsize (KiB) 717020

[startup+342.3 s]
/proc/loadavg: 8.12 7.93 5.68 10/186 4024
/proc/meminfo: memFree=28851492/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=701252 CPUtime=1199.57 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 547370 0 0 0 119758 199 0 0 20 0 8 0 390877095 718082048 137834 33554432000 134512640 146736320 4293065408 4293058256 136008226 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4015/statm: 175313 137834 948 2985 0 172247 0
[pid=4015/tid=4017] ppid=4014 vsize=701252 CPUtime=150.64 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 45075 0 0 0 15045 19 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3978055888 136008047 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=701252 CPUtime=111.94 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 46875 0 0 0 11175 19 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3967570128 136008309 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=701252 CPUtime=153.99 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 65499 0 0 0 15374 25 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3957084368 136007982 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=701252 CPUtime=119.32 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 52619 0 0 0 11910 22 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3946597120 135468528 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=701252 CPUtime=142.66 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 41625 0 0 0 14246 20 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3936112848 136008454 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=701252 CPUtime=178.19 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 53192 0 0 0 17798 21 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3925627088 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=701252 CPUtime=147.2 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 42022 0 0 0 14697 23 0 0 20 0 8 0 390880281 718082048 137834 33554432000 134512640 146736320 4293065408 3915141328 136008039 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1199.57
Current children cumulated vsize (KiB) 710400

[startup+402.3 s]
/proc/loadavg: 7.16 7.69 5.74 10/186 4024
/proc/meminfo: memFree=28840360/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=706944 CPUtime=1393.74 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 577519 0 0 0 139158 216 0 0 20 0 8 0 390877095 723910656 140425 33554432000 134512640 146736320 4293065408 4293058120 139042902 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4015/statm: 176736 140425 948 2985 0 173670 0
[pid=4015/tid=4017] ppid=4014 vsize=706944 CPUtime=174.14 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 49667 0 0 0 17393 21 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3978055880 136388570 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=706944 CPUtime=138.18 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 47621 0 0 0 13797 21 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3967570128 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=706944 CPUtime=174.72 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 73637 0 0 0 17444 28 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3957084368 136008050 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=706944 CPUtime=150.91 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 55025 0 0 0 15067 24 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3946598608 136008044 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=706944 CPUtime=158.91 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 44848 0 0 0 15868 23 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3936112848 136008170 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=706944 CPUtime=189.71 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 53620 0 0 0 18950 21 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3925627088 136008042 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=706944 CPUtime=189.33 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 49043 0 0 0 18905 28 0 0 20 0 8 0 390880281 723910656 140425 33554432000 134512640 146736320 4293065408 3915141328 136008053 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1393.74
Current children cumulated vsize (KiB) 716092

[startup+462.3 s]
/proc/loadavg: 8.32 7.93 5.94 10/186 4024
/proc/meminfo: memFree=28827996/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=716092 CPUtime=1632.81 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 598474 0 0 0 163052 229 0 0 20 0 8 0 390877095 733278208 142360 33554432000 134512640 146736320 4293065408 4293058140 135854505 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/4015/statm: 179023 142360 948 2985 0 175957 0
[pid=4015/tid=4017] ppid=4014 vsize=716092 CPUtime=203.9 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 56930 0 0 0 20365 25 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3978055840 136006013 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=716092 CPUtime=168.09 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 49255 0 0 0 16785 24 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3967570128 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=716092 CPUtime=204.81 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 79989 0 0 0 20449 32 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3957084384 139028333 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=716092 CPUtime=180.74 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 55134 0 0 0 18049 25 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3946598608 136008039 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=716092 CPUtime=188.66 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 44905 0 0 0 18843 23 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3936113032 136388013 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=716092 CPUtime=219.59 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 53915 0 0 0 21936 23 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3925627088 136008065 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=716092 CPUtime=219.19 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 54227 0 0 0 21888 31 0 0 20 0 8 0 390880281 733278208 142360 33554432000 134512640 146736320 4293065408 3915141328 136008234 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1632.81
Current children cumulated vsize (KiB) 725240



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+507.201 s]
/proc/loadavg: 7.08 7.67 5.94 9/186 4024
/proc/meminfo: memFree=28799660/32873844 swapFree=7384/7384
[pid=4014] ppid=4012 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4014/stat : 4014 (run) S 4012 4014 3259 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390877095 9367552 270 33554432000 4194304 5064252 140736831256096 140736831255008 270118053454 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/4014/statm: 2287 270 229 213 0 72 0
[pid=4015] ppid=4014 vsize=757196 CPUtime=1800.08 cores=0,2,4,6
/proc/4015/stat : 4015 (pb_cplex) R 4014 4014 3259 0 -1 4202496 639020 0 0 0 179759 249 0 0 20 0 8 0 390877095 775368704 149920 33554432000 134512640 146736320 4293065408 4293058088 139044591 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4015/statm: 189299 149920 948 2985 0 186233 0
[pid=4015/tid=4017] ppid=4014 vsize=757196 CPUtime=212.36 cores=0,2,4,6
/proc/4015/task/4017/stat : 4017 (pb_cplex) R 4014 4014 3259 0 -1 4202560 61564 0 0 0 21210 26 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3978055888 136008065 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4018] ppid=4014 vsize=757196 CPUtime=201.03 cores=0,2,4,6
/proc/4015/task/4018/stat : 4018 (pb_cplex) R 4014 4014 3259 0 -1 4202560 55006 0 0 0 20076 27 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3967570312 136388078 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4019] ppid=4014 vsize=757196 CPUtime=207.85 cores=0,2,4,6
/proc/4015/task/4019/stat : 4019 (pb_cplex) R 4014 4014 3259 0 -1 4202560 84786 0 0 0 20751 34 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3957084368 136008065 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4015/tid=4020] ppid=4014 vsize=757196 CPUtime=215.58 cores=0,2,4,6
/proc/4015/task/4020/stat : 4020 (pb_cplex) R 4014 4014 3259 0 -1 4202560 59027 0 0 0 21529 29 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3946599040 139046546 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4015/tid=4021] ppid=4014 vsize=757196 CPUtime=201.02 cores=0,2,4,6
/proc/4015/task/4021/stat : 4021 (pb_cplex) R 4014 4014 3259 0 -1 4202560 49451 0 0 0 20076 26 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3936112848 136008245 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4015/tid=4022] ppid=4014 vsize=757196 CPUtime=246.93 cores=0,2,4,6
/proc/4015/task/4022/stat : 4022 (pb_cplex) R 4014 4014 3259 0 -1 4202560 59080 0 0 0 24667 26 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3925627088 136008042 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4015/tid=4023] ppid=4014 vsize=757196 CPUtime=233.51 cores=0,2,4,6
/proc/4015/task/4023/stat : 4023 (pb_cplex) R 4014 4014 3259 0 -1 4202560 60307 0 0 0 23318 33 0 0 20 0 8 0 390880281 775368704 149920 33554432000 134512640 146736320 4293065408 3915140288 135468697 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 766344

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4014 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 507.217
CPU time (s): 1800.08
CPU user time (s): 1797.59
CPU system time (s): 2.49
CPU usage (%): 354.894
Max. virtual memory (cumulated for all children) (KiB): 766344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.27181 second user time and 3.69444 second system time

The end

Launcher Data 

Begin job on node106 at 2012-06-09 15:11:26
IDJOB=3733842
IDBENCH=2627
IDSOLVER=2325
FILE ID=node106/3733842-1339247486
RUNJOBID= node106-1339246834-3276
PBS_JOBID= 14644375
Free space on /tmp= 71024 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/golomb-rulers/normalized-OGR_16.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3733842-1339247486/watcher-3733842-1339247486 -o /tmp/evaluation-result-3733842-1339247486/solver-3733842-1339247486 -C 1800 -W 1900 -M 15500  run HOME/instance-3733842-1339247486.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 69b04711942c7a7cbb28264339dbffe2
RANDOM SEED=1457295513

node106.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.065
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29483152 kB
Buffers:          476500 kB
Cached:          1878336 kB
SwapCached:         2376 kB
Active:           697664 kB
Inactive:        1744352 kB
Active(anon):      82508 kB
Inactive(anon):     5560 kB
Active(file):     615156 kB
Inactive(file):  1738792 kB
Unevictable:        7384 kB
Mlocked:            7384 kB
SwapTotal:      67108856 kB
SwapFree:       67100756 kB
Dirty:             39684 kB
Writeback:             8 kB
AnonPages:         92420 kB
Mapped:            12020 kB
Shmem:                 0 kB
Slab:             806548 kB
SReclaimable:     247384 kB
SUnreclaim:       559164 kB
KernelStack:        1496 kB
PageTables:         4400 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     281176 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     36864 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3733842-1339247486.opb

Free space on /tmp at the end= 71008 MiB
End job on node106 at 2012-06-09 15:19:53