Trace number 3741482

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.12 547.616

General information on the benchmark

Name/OPT-SMALLINT-LIN/heinz/
normalized-go19.opb
MD5SUMac3a0c512b81d5e532f489853538ca8f
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark84
Best CPU time to get the best result obtained on this benchmark1796.78
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables441
Total number of constraints441
Number of constraints which are clauses361
Number of constraints which are cardinality constraints (but not clauses)80
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint5
Number of terms in the objective function 361
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 361
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 361
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3741482-1339250440.opb.
0.00/0.00	c Instance file HOME/instance-3741482-1339250440.opb
0.00/0.00	c File size is 20573 bytes.
0.00/0.01	c Highest Coefficient sum: 6
0.00/0.01	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.01	c ============================[ Problem Statistics ]=============================
0.00/0.01	c |                                                                             |
0.00/0.01	c |  Parsing time:          0.02         s                                      |
0.00/0.01	c |  Number Variables:      441                                                 |
0.00/0.01	c |  Number Constraints:    441                                                 |
0.00/0.01	c ===============================================================================
1800.12/547.61	c Remaining time 1799.98 sec.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3741482-1339250440/watcher-3741482-1339250440 -o /tmp/evaluation-result-3741482-1339250440/solver-3741482-1339250440 -C 1800 -W 1900 -M 15500 run HOME/instance-3741482-1339250440.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.59 11.08 8.89 3/185 4089
/proc/meminfo: memFree=31045516/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0

[startup+0.037749 s]
/proc/loadavg: 11.59 11.08 8.89 3/185 4089
/proc/meminfo: memFree=31045516/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100253 s]
/proc/loadavg: 11.59 11.08 8.89 3/185 4089
/proc/meminfo: memFree=31045516/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300251 s]
/proc/loadavg: 11.59 11.08 8.89 3/185 4089
/proc/meminfo: memFree=31045516/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700118 s]
/proc/loadavg: 11.59 11.08 8.89 3/185 4089
/proc/meminfo: memFree=31045516/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50033 s]
/proc/loadavg: 11.59 11.08 8.89 17/194 4098
/proc/meminfo: memFree=31002160/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=68340 CPUtime=4.2 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 4495 0 0 0 413 7 0 0 20 0 1 0 391172593 69980160 3027 33554432000 134512640 146736320 4288058208 4288054032 137698804 0 0 4096 16387 0 0 0 17 6 0 0 0 0 0
/proc/4090/statm: 17085 3027 925 2985 0 14019 0
Current children cumulated CPU time (s) 4.2
Current children cumulated vsize (KiB) 77488

[startup+3.10027 s]
/proc/loadavg: 11.62 11.10 8.90 10/187 4098
/proc/meminfo: memFree=30975144/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=136956 CPUtime=6.03 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 15318 0 0 0 586 17 0 0 20 0 8 0 391172593 140242944 14166 33554432000 134512640 146736320 4288058208 4288051324 144757825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/4090/statm: 34239 14166 965 2985 0 31173 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 146104

[startup+6.30044 s]
/proc/loadavg: 11.62 11.10 8.90 10/194 4112
/proc/meminfo: memFree=30889200/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=144448 CPUtime=16.61 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) S 4089 4089 2899 0 -1 4202496 18929 0 0 0 1636 25 0 0 20 0 8 0 391172593 147914752 15892 33554432000 134512640 146736320 4288058208 4288054608 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4090/statm: 36112 15892 967 2985 0 33046 0
[pid=4090/tid=4106] ppid=4089 vsize=144448 CPUtime=1.33 cores=0,2,4,6
/proc/4090/task/4106/stat : 4106 (pb_cplex) R 4089 4089 2899 0 -1 4202560 617 0 0 0 133 0 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4070564840 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4107] ppid=4089 vsize=144448 CPUtime=1.32 cores=0,2,4,6
/proc/4090/task/4107/stat : 4107 (pb_cplex) S 4089 4089 2899 0 -1 4202560 156 0 0 0 132 0 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4137819792 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4108] ppid=4089 vsize=144448 CPUtime=1.28 cores=0,2,4,6
/proc/4090/task/4108/stat : 4108 (pb_cplex) S 4089 4089 2899 0 -1 4202560 604 0 0 0 126 2 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4148305552 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4109] ppid=4089 vsize=144448 CPUtime=1.3 cores=0,2,4,6
/proc/4090/task/4109/stat : 4109 (pb_cplex) S 4089 4089 2899 0 -1 4202560 126 0 0 0 130 0 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4120682128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4110] ppid=4089 vsize=144448 CPUtime=1.27 cores=0,2,4,6
/proc/4090/task/4110/stat : 4110 (pb_cplex) S 4089 4089 2899 0 -1 4202560 703 0 0 0 127 0 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4060081808 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4111] ppid=4089 vsize=144448 CPUtime=1.25 cores=0,2,4,6
/proc/4090/task/4111/stat : 4111 (pb_cplex) S 4089 4089 2899 0 -1 4202560 666 0 0 0 123 2 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4049596048 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4112] ppid=4089 vsize=144448 CPUtime=1.25 cores=0,2,4,6
/proc/4090/task/4112/stat : 4112 (pb_cplex) S 4089 4089 2899 0 -1 4202560 348 0 0 0 125 0 0 0 20 0 8 0 391172818 147914752 15892 33554432000 134512640 146736320 4288058208 4039110288 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 16.61
Current children cumulated vsize (KiB) 153596

[startup+12.7003 s]
/proc/loadavg: 11.43 11.08 8.92 16/194 4112
/proc/meminfo: memFree=30893184/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=145584 CPUtime=37.19 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 19708 0 0 0 3680 39 0 0 20 0 8 0 391172593 149078016 16148 33554432000 134512640 146736320 4288058208 4288051336 136001705 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/4090/statm: 36396 16148 967 2985 0 33330 0
[pid=4090/tid=4106] ppid=4089 vsize=145584 CPUtime=3.86 cores=0,2,4,6
/proc/4090/task/4106/stat : 4106 (pb_cplex) R 4089 4089 2899 0 -1 4202560 786 0 0 0 382 4 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4070564840 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4107] ppid=4089 vsize=145584 CPUtime=3.84 cores=0,2,4,6
/proc/4090/task/4107/stat : 4107 (pb_cplex) R 4089 4089 2899 0 -1 4202560 156 0 0 0 382 2 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4137816256 136470266 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4108] ppid=4089 vsize=145584 CPUtime=3.88 cores=0,2,4,6
/proc/4090/task/4108/stat : 4108 (pb_cplex) S 4089 4089 2899 0 -1 4202560 604 0 0 0 385 3 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4148305552 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4109] ppid=4089 vsize=145584 CPUtime=3.98 cores=0,2,4,6
/proc/4090/task/4109/stat : 4109 (pb_cplex) R 4089 4089 2899 0 -1 4202560 405 0 0 0 395 3 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4120678836 136400762 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4110] ppid=4089 vsize=145584 CPUtime=3.81 cores=0,2,4,6
/proc/4090/task/4110/stat : 4110 (pb_cplex) R 4089 4089 2899 0 -1 4202560 703 0 0 0 379 2 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4060079080 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4111] ppid=4089 vsize=145584 CPUtime=3.76 cores=0,2,4,6
/proc/4090/task/4111/stat : 4111 (pb_cplex) R 4089 4089 2899 0 -1 4202560 791 0 0 0 373 3 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4049593320 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4112] ppid=4089 vsize=145584 CPUtime=3.68 cores=0,2,4,6
/proc/4090/task/4112/stat : 4112 (pb_cplex) R 4089 4089 2899 0 -1 4202560 445 0 0 0 366 2 0 0 20 0 8 0 391172818 149078016 16148 33554432000 134512640 146736320 4288058208 4039106768 136008078 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 37.19
Current children cumulated vsize (KiB) 154732

[startup+25.5004 s]
/proc/loadavg: 11.82 11.17 8.97 11/194 4135
/proc/meminfo: memFree=30896532/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=157620 CPUtime=82.73 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 39444 0 0 0 8205 68 0 0 20 0 8 0 391172593 161402880 19320 33554432000 134512640 146736320 4288058208 4288049280 137467385 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0 0 0
/proc/4090/statm: 39405 19324 987 2985 0 36339 0
[pid=4090/tid=4106] ppid=4089 vsize=157620 CPUtime=9.21 cores=0,2,4,6
/proc/4090/task/4106/stat : 4106 (pb_cplex) R 4089 4089 2899 0 -1 4202560 3465 0 0 0 914 7 0 0 20 0 8 0 391172818 161402880 19324 33554432000 134512640 146736320 4288058208 4070562076 136406064 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4107] ppid=4089 vsize=157620 CPUtime=9.44 cores=0,2,4,6
/proc/4090/task/4107/stat : 4107 (pb_cplex) R 4089 4089 2899 0 -1 4202560 847 0 0 0 939 5 0 0 20 0 8 0 391172818 161402880 19324 33554432000 134512640 146736320 4288058208 4137811272 138420875 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4108] ppid=4089 vsize=157620 CPUtime=9.59 cores=0,2,4,6
/proc/4090/task/4108/stat : 4108 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1283 0 0 0 952 7 0 0 20 0 8 0 391172818 161402880 19324 33554432000 134512640 146736320 4288058208 4148293084 135855165 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4109] ppid=4089 vsize=157620 CPUtime=9.53 cores=0,2,4,6
/proc/4090/task/4109/stat : 4109 (pb_cplex) R 4089 4089 2899 0 -1 4202560 6932 0 0 0 944 9 0 0 20 0 8 0 391172818 161402880 19334 33554432000 134512640 146736320 4288058208 4120675500 144698783 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4110] ppid=4089 vsize=157620 CPUtime=9.64 cores=0,2,4,6
/proc/4090/task/4110/stat : 4110 (pb_cplex) R 4089 4089 2899 0 -1 4202560 3504 0 0 0 959 5 0 0 20 0 8 0 391172818 161402880 19335 33554432000 134512640 146736320 4288058208 4060074236 135526778 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4111] ppid=4089 vsize=157620 CPUtime=9.51 cores=0,2,4,6
/proc/4090/task/4111/stat : 4111 (pb_cplex) R 4089 4089 2899 0 -1 4202560 4501 0 0 0 945 6 0 0 20 0 8 0 391172818 161402880 19335 33554432000 134512640 146736320 4288058208 4049586140 144785853 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4112] ppid=4089 vsize=157620 CPUtime=9.56 cores=0,2,4,6
/proc/4090/task/4112/stat : 4112 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1668 0 0 0 949 7 0 0 20 0 8 0 391172818 161402880 19335 33554432000 134512640 146736320 4288058208 4039101840 136403112 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 82.73
Current children cumulated vsize (KiB) 166768

[startup+51.1004 s]
/proc/loadavg: 11.36 11.12 9.02 17/194 4149
/proc/meminfo: memFree=30889400/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=160776 CPUtime=172.25 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) S 4089 4089 2899 0 -1 4202496 86030 0 0 0 17065 160 0 0 20 0 8 0 391172593 164634624 20404 33554432000 134512640 146736320 4288058208 4288054608 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4090/statm: 40194 20404 988 2985 0 37128 0
[pid=4090/tid=4143] ppid=4089 vsize=160776 CPUtime=1.74 cores=0,2,4,6
/proc/4090/task/4143/stat : 4143 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1 0 0 0 172 2 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4001358044 136009646 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4144] ppid=4089 vsize=160776 CPUtime=1.7 cores=0,2,4,6
/proc/4090/task/4144/stat : 4144 (pb_cplex) S 4089 4089 2899 0 -1 4202560 158 0 0 0 170 0 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4012895888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4145] ppid=4089 vsize=160776 CPUtime=1.78 cores=0,2,4,6
/proc/4090/task/4145/stat : 4145 (pb_cplex) R 4089 4089 2899 0 -1 4202560 4 0 0 0 176 2 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4070564840 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4146] ppid=4089 vsize=160776 CPUtime=1.74 cores=0,2,4,6
/proc/4090/task/4146/stat : 4146 (pb_cplex) S 4089 4089 2899 0 -1 4202560 266 0 0 0 172 2 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4120682128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4147] ppid=4089 vsize=160776 CPUtime=1.7 cores=0,2,4,6
/proc/4090/task/4147/stat : 4147 (pb_cplex) R 4089 4089 2899 0 -1 4202560 196 0 0 0 168 2 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4060079080 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4148] ppid=4089 vsize=160776 CPUtime=1.77 cores=0,2,4,6
/proc/4090/task/4148/stat : 4148 (pb_cplex) R 4089 4089 2899 0 -1 4202560 358 0 0 0 177 0 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4049593320 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4149] ppid=4089 vsize=160776 CPUtime=1.74 cores=0,2,4,6
/proc/4090/task/4149/stat : 4149 (pb_cplex) R 4089 4089 2899 0 -1 4202560 451 0 0 0 173 1 0 0 20 0 8 0 391177292 164634624 20404 33554432000 134512640 146736320 4288058208 4039106728 135982949 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 172.25
Current children cumulated vsize (KiB) 169924

[startup+102.306 s]
/proc/loadavg: 11.65 11.31 9.20 10/193 4157
/proc/meminfo: memFree=30875200/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=167920 CPUtime=336.24 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) S 4089 4089 2899 0 -1 4202496 96385 0 0 0 33317 307 0 0 20 0 8 0 391172593 171950080 22233 33554432000 134512640 146736320 4288058208 4288054608 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0

################
# More data... #
################

/proc/4090/statm: 50409 30706 988 2985 0 47343 0
[pid=4090/tid=4165] ppid=4089 vsize=201636 CPUtime=31.65 cores=0,2,4,6
/proc/4090/task/4165/stat : 4165 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1245 0 0 0 3138 27 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4039107560 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4166] ppid=4089 vsize=201636 CPUtime=31.74 cores=0,2,4,6
/proc/4090/task/4166/stat : 4166 (pb_cplex) R 4089 4089 2899 0 -1 4202560 574 0 0 0 3145 29 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4049593296 136364592 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4167] ppid=4089 vsize=201636 CPUtime=31.51 cores=0,2,4,6
/proc/4090/task/4167/stat : 4167 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1454 0 0 0 3121 30 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4060078932 135983252 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4168] ppid=4089 vsize=201636 CPUtime=31.38 cores=0,2,4,6
/proc/4090/task/4168/stat : 4168 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1723 0 0 0 3106 32 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4120679400 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4169] ppid=4089 vsize=201636 CPUtime=31.5 cores=0,2,4,6
/proc/4090/task/4169/stat : 4169 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1705 0 0 0 3122 28 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4070564296 136001717 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4170] ppid=4089 vsize=201636 CPUtime=31.46 cores=0,2,4,6
/proc/4090/task/4170/stat : 4170 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1331 0 0 0 3119 27 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4012892200 139044550 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4171] ppid=4089 vsize=201636 CPUtime=31.6 cores=0,2,4,6
/proc/4090/task/4171/stat : 4171 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1886 0 0 0 3129 31 0 0 20 0 8 0 391192838 206475264 30706 33554432000 134512640 146736320 4288058208 4001357864 139044580 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 914.88
Current children cumulated vsize (KiB) 210784

[startup+342.3 s]
/proc/loadavg: 13.10 11.92 9.90 11/193 4171
/proc/meminfo: memFree=30738868/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=215196 CPUtime=1102.62 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 138833 0 0 0 109263 999 0 0 20 0 8 0 391172593 220360704 34973 33554432000 134512640 146736320 4288058208 4288051880 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4090/statm: 53799 34973 988 2985 0 50733 0
[pid=4090/tid=4165] ppid=4089 vsize=215196 CPUtime=54.92 cores=0,2,4,6
/proc/4090/task/4165/stat : 4165 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2279 0 0 0 5442 50 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4039106768 136008104 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4166] ppid=4089 vsize=215196 CPUtime=54.78 cores=0,2,4,6
/proc/4090/task/4166/stat : 4166 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1700 0 0 0 5428 50 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4049593320 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4167] ppid=4089 vsize=215196 CPUtime=54.76 cores=0,2,4,6
/proc/4090/task/4167/stat : 4167 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2607 0 0 0 5425 51 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4060078148 136385167 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4168] ppid=4089 vsize=215196 CPUtime=54.39 cores=0,2,4,6
/proc/4090/task/4168/stat : 4168 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2841 0 0 0 5390 49 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4120678608 136008042 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4169] ppid=4089 vsize=215196 CPUtime=54.43 cores=0,2,4,6
/proc/4090/task/4169/stat : 4169 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2839 0 0 0 5392 51 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4070564048 136008065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4170] ppid=4089 vsize=215196 CPUtime=54.75 cores=0,2,4,6
/proc/4090/task/4170/stat : 4170 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2118 0 0 0 5425 50 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4012892368 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4171] ppid=4089 vsize=215196 CPUtime=54.73 cores=0,2,4,6
/proc/4090/task/4171/stat : 4171 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2868 0 0 0 5421 52 0 0 20 0 8 0 391192838 220360704 34973 33554432000 134512640 146736320 4288058208 4001358824 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1102.62
Current children cumulated vsize (KiB) 224344

[startup+402.3 s]
/proc/loadavg: 10.00 11.25 9.79 14/193 4179
/proc/meminfo: memFree=30779536/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=233432 CPUtime=1310.45 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 155267 0 0 0 129854 1191 0 0 20 0 8 0 391172593 239034368 38622 33554432000 134512640 146736320 4288058208 4288051472 136403109 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4090/statm: 58358 38622 988 2985 0 55292 0
[pid=4090/tid=4173] ppid=4089 vsize=233432 CPUtime=12.05 cores=0,2,4,6
/proc/4090/task/4173/stat : 4173 (pb_cplex) S 4089 4089 2899 0 -1 4202560 265 0 0 0 1192 13 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4001361552 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4174] ppid=4089 vsize=233432 CPUtime=11.99 cores=0,2,4,6
/proc/4090/task/4174/stat : 4174 (pb_cplex) S 4089 4089 2899 0 -1 4202560 486 0 0 0 1188 11 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4012895888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4175] ppid=4089 vsize=233432 CPUtime=12.01 cores=0,2,4,6
/proc/4090/task/4175/stat : 4175 (pb_cplex) R 4089 4089 2899 0 -1 4202560 819 0 0 0 1192 9 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4070564840 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4176] ppid=4089 vsize=233432 CPUtime=12.19 cores=0,2,4,6
/proc/4090/task/4176/stat : 4176 (pb_cplex) S 4089 4089 2899 0 -1 4202560 481 0 0 0 1207 12 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4120682128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4177] ppid=4089 vsize=233432 CPUtime=11.98 cores=0,2,4,6
/proc/4090/task/4177/stat : 4177 (pb_cplex) S 4089 4089 2899 0 -1 4202560 703 0 0 0 1188 10 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4060081808 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4178] ppid=4089 vsize=233432 CPUtime=11.99 cores=0,2,4,6
/proc/4090/task/4178/stat : 4178 (pb_cplex) R 4089 4089 2899 0 -1 4202560 295 0 0 0 1188 11 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4049592528 136008039 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4179] ppid=4089 vsize=233432 CPUtime=12.07 cores=0,2,4,6
/proc/4090/task/4179/stat : 4179 (pb_cplex) S 4089 4089 2899 0 -1 4202560 420 0 0 0 1195 12 0 0 20 0 8 0 391209961 239034368 38622 33554432000 134512640 146736320 4288058208 4039110288 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1310.45
Current children cumulated vsize (KiB) 242580

[startup+462.3 s]
/proc/loadavg: 10.29 11.14 9.85 10/186 4229
/proc/meminfo: memFree=30994232/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=246784 CPUtime=1500.58 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 162350 0 0 0 148705 1353 0 0 20 0 8 0 391172593 252706816 41974 33554432000 134512640 146736320 4288058208 4288051880 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4090/statm: 61696 41974 988 2985 0 58630 0
[pid=4090/tid=4173] ppid=4089 vsize=246784 CPUtime=35.78 cores=0,2,4,6
/proc/4090/task/4173/stat : 4173 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1198 0 0 0 3543 35 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4001357880 136475849 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4174] ppid=4089 vsize=246784 CPUtime=35.36 cores=0,2,4,6
/proc/4090/task/4174/stat : 4174 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1164 0 0 0 3504 32 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4012892344 136475505 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4175] ppid=4089 vsize=246784 CPUtime=35.51 cores=0,2,4,6
/proc/4090/task/4175/stat : 4175 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1672 0 0 0 3521 30 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4070564048 136008172 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4176] ppid=4089 vsize=246784 CPUtime=35.81 cores=0,2,4,6
/proc/4090/task/4176/stat : 4176 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1524 0 0 0 3548 33 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4120678456 136475800 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4177] ppid=4089 vsize=246784 CPUtime=35.56 cores=0,2,4,6
/proc/4090/task/4177/stat : 4177 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1415 0 0 0 3527 29 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4060078296 136009190 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4178] ppid=4089 vsize=246784 CPUtime=35.44 cores=0,2,4,6
/proc/4090/task/4178/stat : 4178 (pb_cplex) R 4089 4089 2899 0 -1 4202560 879 0 0 0 3514 30 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4049593320 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4179] ppid=4089 vsize=246784 CPUtime=35.41 cores=0,2,4,6
/proc/4090/task/4179/stat : 4179 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1402 0 0 0 3511 30 0 0 20 0 8 0 391209961 252706816 41974 33554432000 134512640 146736320 4288058208 4039107560 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1500.58
Current children cumulated vsize (KiB) 255932

[startup+522.3 s]
/proc/loadavg: 8.45 10.50 9.70 10/186 4229
/proc/meminfo: memFree=30963860/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=262944 CPUtime=1711.45 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 171141 0 0 0 169631 1514 0 0 20 0 8 0 391172593 269254656 46572 33554432000 134512640 146736320 4288058208 4288051880 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/4090/statm: 65736 46572 988 2985 0 62670 0
[pid=4090/tid=4173] ppid=4089 vsize=262944 CPUtime=62.08 cores=0,2,4,6
/proc/4090/task/4173/stat : 4173 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2405 0 0 0 6152 56 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4001357880 136475800 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4174] ppid=4089 vsize=262944 CPUtime=61.74 cores=0,2,4,6
/proc/4090/task/4174/stat : 4174 (pb_cplex) S 4089 4089 2899 0 -1 4202560 2204 0 0 0 6122 52 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4012895888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4175] ppid=4089 vsize=262944 CPUtime=61.82 cores=0,2,4,6
/proc/4090/task/4175/stat : 4175 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2722 0 0 0 6132 50 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4070563836 135526778 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4176] ppid=4089 vsize=262944 CPUtime=62.33 cores=0,2,4,6
/proc/4090/task/4176/stat : 4176 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2714 0 0 0 6179 54 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4120678456 136475800 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4177] ppid=4089 vsize=262944 CPUtime=61.71 cores=0,2,4,6
/proc/4090/task/4177/stat : 4177 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2399 0 0 0 6123 48 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4060078356 136003493 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4178] ppid=4089 vsize=262944 CPUtime=61.67 cores=0,2,4,6
/proc/4090/task/4178/stat : 4178 (pb_cplex) R 4089 4089 2899 0 -1 4202560 1826 0 0 0 6116 51 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4049593320 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4179] ppid=4089 vsize=262944 CPUtime=61.73 cores=0,2,4,6
/proc/4090/task/4179/stat : 4179 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2594 0 0 0 6124 49 0 0 20 0 8 0 391209961 269254656 46572 33554432000 134512640 146736320 4288058208 4039106768 136008011 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1711.45
Current children cumulated vsize (KiB) 272092



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+547.6 s]
/proc/loadavg: 8.48 10.31 9.66 10/186 4229
/proc/meminfo: memFree=30948708/32873844 swapFree=7116/7116
[pid=4089] ppid=4087 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/4089/stat : 4089 (run) S 4087 4089 2899 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 391172593 9367552 270 33554432000 4194304 5064252 140735695424064 140735695422976 247064061518 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/4089/statm: 2287 270 229 213 0 72 0
[pid=4090] ppid=4089 vsize=270064 CPUtime=1800.12 cores=0,2,4,6
/proc/4090/stat : 4090 (pb_cplex) R 4089 4089 2899 0 -1 4202496 175354 0 0 0 178421 1591 0 0 20 0 8 0 391172593 276545536 48295 33554432000 134512640 146736320 4288058208 4288050788 136016685 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/4090/statm: 67516 48295 988 2985 0 64450 0
[pid=4090/tid=4173] ppid=4089 vsize=270064 CPUtime=73.27 cores=0,2,4,6
/proc/4090/task/4173/stat : 4173 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2927 0 0 0 7260 67 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4001358280 136000767 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=4090/tid=4174] ppid=4089 vsize=270064 CPUtime=72.9 cores=0,2,4,6
/proc/4090/task/4174/stat : 4174 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2657 0 0 0 7226 64 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4012892368 136008178 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4175] ppid=4089 vsize=270064 CPUtime=72.7 cores=0,2,4,6
/proc/4090/task/4175/stat : 4175 (pb_cplex) R 4089 4089 2899 0 -1 4202560 3248 0 0 0 7210 60 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4070564296 136000938 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4176] ppid=4089 vsize=270064 CPUtime=73.4 cores=0,2,4,6
/proc/4090/task/4176/stat : 4176 (pb_cplex) R 4089 4089 2899 0 -1 4202560 3323 0 0 0 7276 64 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4120679400 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=4090/tid=4177] ppid=4089 vsize=270064 CPUtime=72.73 cores=0,2,4,6
/proc/4090/task/4177/stat : 4177 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2846 0 0 0 7213 60 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4060079080 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=4090/tid=4178] ppid=4089 vsize=270064 CPUtime=72.71 cores=0,2,4,6
/proc/4090/task/4178/stat : 4178 (pb_cplex) R 4089 4089 2899 0 -1 4202560 2360 0 0 0 7211 60 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4049592524 136388844 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=4090/tid=4179] ppid=4089 vsize=270064 CPUtime=72.73 cores=0,2,4,6
/proc/4090/task/4179/stat : 4179 (pb_cplex) R 4089 4089 2899 0 -1 4202560 3122 0 0 0 7212 61 0 0 20 0 8 0 391209961 276545536 48295 33554432000 134512640 146736320 4288058208 4039107560 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 279212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4089 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0
# while last known CPU time is 1800.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 547.616
CPU time (s): 1800.12
CPU user time (s): 1784.21
CPU system time (s): 15.91
CPU usage (%): 328.72
Max. virtual memory (cumulated for all children) (KiB): 280752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 354
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 0.857869 second user time and 2.15567 second system time

The end

Launcher Data 

Begin job on node103 at 2012-06-09 16:00:40
IDJOB=3741482
IDBENCH=89865
IDSOLVER=2325
FILE ID=node103/3741482-1339250440
RUNJOBID= node103-1339246832-2915
PBS_JOBID= 14644378
Free space on /tmp= 71248 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/heinz/normalized-go19.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3741482-1339250440/watcher-3741482-1339250440 -o /tmp/evaluation-result-3741482-1339250440/solver-3741482-1339250440 -C 1800 -W 1900 -M 15500  run HOME/instance-3741482-1339250440.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ac3a0c512b81d5e532f489853538ca8f
RANDOM SEED=1899477721

node103.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.37
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5411.36
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.189
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31046052 kB
Buffers:          413292 kB
Cached:           377376 kB
SwapCached:         5468 kB
Active:           824232 kB
Inactive:         108040 kB
Active(anon):     133868 kB
Inactive(anon):     7352 kB
Active(file):     690364 kB
Inactive(file):   100688 kB
Unevictable:        7116 kB
Mlocked:            7116 kB
SwapTotal:      67108856 kB
SwapFree:       67096900 kB
Dirty:             16356 kB
Writeback:             0 kB
AnonPages:        141444 kB
Mapped:            12760 kB
Shmem:                 0 kB
Slab:             754968 kB
SReclaimable:     195500 kB
SUnreclaim:       559468 kB
KernelStack:        1552 kB
PageTables:         4128 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     325448 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     47104 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3741482-1339250440.opb

Free space on /tmp at the end= 71232 MiB
End job on node103 at 2012-06-09 16:09:48