Trace number 3737601

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.11 881.916

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/bsg/normalized-bsg_500_10_5.opb
MD5SUM9b75ee50c2c62e6be495e8bd0a94fa2c
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-146
Best CPU time to get the best result obtained on this benchmark1796.75
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -131
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1501
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)12540
Sum of products size (including duplicates)25080
Number of different products6270
Sum of products size12540

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3737601-1339248721.opb.
0.00/0.00	c Instance file HOME/instance-3737601-1339248721.opb
0.00/0.00	c File size is 563009 bytes.
0.00/0.20	c Highest Coefficient sum: 1000
0.00/0.20	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.21	c ============================[ Problem Statistics ]=============================
0.00/0.21	c |                                                                             |
0.00/0.21	c |  Parsing time:          0.21         s                                      |
0.00/0.21	c |  Number Variables:      7270                                                |
0.00/0.21	c |  Number Constraints:    14041                                               |
0.00/0.21	c ===============================================================================
1800.11/881.91	c Remaining time 1799.79 sec.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3737601-1339248721/watcher-3737601-1339248721 -o /tmp/evaluation-result-3737601-1339248721/solver-3737601-1339248721 -C 1800 -W 1900 -M 15500 run HOME/instance-3737601-1339248721.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.34 5.32 5.92 4/184 20889
/proc/meminfo: memFree=31088152/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0

[startup+0.0850379 s]
/proc/loadavg: 5.34 5.32 5.92 4/184 20889
/proc/meminfo: memFree=31088152/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100214 s]
/proc/loadavg: 5.34 5.32 5.92 4/184 20889
/proc/meminfo: memFree=31088152/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300132 s]
/proc/loadavg: 5.34 5.32 5.92 4/184 20889
/proc/meminfo: memFree=31088152/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70021 s]
/proc/loadavg: 5.34 5.32 5.92 4/184 20889
/proc/meminfo: memFree=31088152/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50022 s]
/proc/loadavg: 5.34 5.32 5.92 4/186 20891
/proc/meminfo: memFree=31061344/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=54428 CPUtime=1.48 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 9929 0 0 0 147 1 0 0 20 0 1 0 390998076 55734272 7514 33554432000 134512640 146736320 4286755856 4286750440 139044572 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 13607 7514 795 2985 0 10541 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 63576

[startup+3.10026 s]
/proc/loadavg: 5.15 5.28 5.90 5/186 20891
/proc/meminfo: memFree=31060724/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=54500 CPUtime=3.08 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 9952 0 0 0 307 1 0 0 20 0 1 0 390998076 55808000 7537 33554432000 134512640 146736320 4286755856 4286751040 139046532 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 13625 7537 795 2985 0 10559 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 63648

[startup+6.30026 s]
/proc/loadavg: 5.15 5.28 5.90 4/186 20891
/proc/meminfo: memFree=31059784/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=54560 CPUtime=6.28 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 9974 0 0 0 627 1 0 0 20 0 1 0 390998076 55869440 7559 33554432000 134512640 146736320 4286755856 4286750608 136008172 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 13640 7559 795 2985 0 10574 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 63708

[startup+12.7003 s]
/proc/loadavg: 4.58 5.15 5.86 4/186 20891
/proc/meminfo: memFree=31054740/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=54580 CPUtime=12.68 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 9986 0 0 0 1267 1 0 0 20 0 1 0 390998076 55889920 8063 33554432000 134512640 146736320 4286755856 4286750856 135999699 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 13645 8063 795 2985 0 10579 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 63728

[startup+25.5001 s]
/proc/loadavg: 4.19 5.05 5.81 4/186 20891
/proc/meminfo: memFree=31044916/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=54680 CPUtime=25.47 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 10016 0 0 0 2546 1 0 0 20 0 1 0 390998076 55992320 9194 33554432000 134512640 146736320 4286755856 4286750620 136389131 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 13670 9194 795 2985 0 10604 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 63828

[startup+51.1003 s]
/proc/loadavg: 3.51 4.82 5.72 4/186 20891
/proc/meminfo: memFree=31015828/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=73560 CPUtime=51.07 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 16342 0 0 0 5105 2 0 0 20 0 1 0 390998076 75325440 13429 33554432000 134512640 146736320 4286755856 4286750152 136000817 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 18390 13429 900 2985 0 15324 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 82708

[startup+102.306 s]
/proc/loadavg: 2.84 4.42 5.53 4/186 20891
/proc/meminfo: memFree=31009072/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=57456 CPUtime=102.27 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 29949 0 0 0 10223 4 0 0 20 0 1 0 390998076 58834944 10432 33554432000 134512640 146736320 4286755856 4286748604 135453262 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 14364 10432 906 2985 0 11298 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 66604

[startup+162.3 s]
/proc/loadavg: 4.16 4.47 5.47 3/179 21001
/proc/meminfo: memFree=31176684/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=57784 CPUtime=162.26 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 31645 0 0 0 16221 5 0 0 20 0 1 0 390998076 59170816 10614 33554432000 134512640 146736320 4286755856 4286749480 139044583 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/20890/statm: 14446 10614 912 2985 0 11380 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 66932

[startup+222.3 s]
/proc/loadavg: 4.04 4.34 5.36 3/193 21029
/proc/meminfo: memFree=31029736/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=200404 CPUtime=264.83 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 73181 0 0 0 26455 28 0 0 20 0 8 0 390998076 205213696 23930 33554432000 134512640 146736320 4286755856 4286748552 139043558 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20890/statm: 50101 23930 970 2985 0 47035 0
[pid=20890/tid=21009] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) S 20889 20889 20024 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4060679824 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) S 20889 20889 20024 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4071165584 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) S 20889 20889 20024 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4081651344 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) S 20889 20889 20024 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4092137104 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) S 20889 20889 20024 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4126506640 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) S 20889 20889 20024 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4116020880 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=200404 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) S 20889 20889 20024 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 8 0 391019714 205213696 23930 33554432000 134512640 146736320 4286755856 4105535120 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 264.83
Current children cumulated vsize (KiB) 209552

[startup+282.3 s]
/proc/loadavg: 5.34 4.59 5.38 7/193 21030
/proc/meminfo: memFree=30991592/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=202056 CPUtime=324.83 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 110521 0 0 0 32448 35 0 0 20 0 8 0 390998076 206905344 26952 33554432000 134512640 146736320 4286755856 4286748548 136385170 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/20890/statm: 50514 26952 970 2985 0 47448 0
[pid=20890/tid=21009] ppid=20889 vsize=202056 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) S 20889 20889 20024 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391019714 206905344 26952 33554432000 134512640 146736320 4286755856 4060679824 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=202056 CPUtime=0 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) S 20889 20889 20024 0 -1 4202560 2 0 0 0 0 0 0 0 20 0 8 0 391019714 206905344 26952 33554432000 134512640 146736320 4286755856 4071165584 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=202056 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/20890/statm: 72817 44332 970 2985 0 69751 0
[pid=20890/tid=21009] ppid=20889 vsize=291268 CPUtime=26.62 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) R 20889 20889 20024 0 -1 4202560 6784 0 0 0 2661 1 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4060675120 136384892 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=291268 CPUtime=26.76 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) R 20889 20889 20024 0 -1 4202560 3495 0 0 0 2675 1 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4071161024 135468697 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=291268 CPUtime=26.7 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) R 20889 20889 20024 0 -1 4202560 15151 0 0 0 2666 4 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4081648072 136001985 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=291268 CPUtime=26.13 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) R 20889 20889 20024 0 -1 4202560 5603 0 0 0 2612 1 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4092132496 136008020 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=291268 CPUtime=26.27 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) R 20889 20889 20024 0 -1 4202560 14869 0 0 0 2623 4 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4126503132 136009724 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=291268 CPUtime=26.48 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) R 20889 20889 20024 0 -1 4202560 6009 0 0 0 2646 2 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4116016120 136475822 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=291268 CPUtime=26.2 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) R 20889 20889 20024 0 -1 4202560 10028 0 0 0 2618 2 0 0 20 0 8 0 391019714 298258432 44332 33554432000 134512640 146736320 4286755856 4105530512 136008450 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 843.49
Current children cumulated vsize (KiB) 300416

[startup+702.3 s]
/proc/loadavg: 11.66 8.88 6.95 10/186 21084
/proc/meminfo: memFree=30772988/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=294396 CPUtime=1083.01 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 300496 0 0 0 108216 85 0 0 20 0 8 0 390998076 301461504 46156 33554432000 134512640 146736320 4286755856 4286748936 136000720 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20890/statm: 73599 46156 970 2985 0 70533 0
[pid=20890/tid=21009] ppid=20889 vsize=294396 CPUtime=56.28 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) R 20889 20889 20024 0 -1 4202560 15021 0 0 0 5623 5 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4060675080 139042981 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=294396 CPUtime=56.85 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) R 20889 20889 20024 0 -1 4202560 20045 0 0 0 5679 6 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4071160976 136008047 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=294396 CPUtime=56.55 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) R 20889 20889 20024 0 -1 4202560 35677 0 0 0 5646 9 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4081646984 136001974 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=294396 CPUtime=55.81 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) R 20889 20889 20024 0 -1 4202560 8500 0 0 0 5579 2 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4092133584 136008056 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=294396 CPUtime=56.27 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) R 20889 20889 20024 0 -1 4202560 20308 0 0 0 5622 5 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4126501888 135655923 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=294396 CPUtime=57.01 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) R 20889 20889 20024 0 -1 4202560 17666 0 0 0 5695 6 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4116014892 135457921 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=294396 CPUtime=55.89 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) R 20889 20889 20024 0 -1 4202560 28550 0 0 0 5583 6 0 0 20 0 8 0 391019714 301461504 46156 33554432000 134512640 146736320 4286755856 4105531600 136008050 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1083.01
Current children cumulated vsize (KiB) 303544

[startup+762.307 s]
/proc/loadavg: 9.97 8.90 7.07 10/186 21084
/proc/meminfo: memFree=30763012/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=295420 CPUtime=1322.59 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 411444 0 0 0 132141 118 0 0 20 0 8 0 390998076 302510080 46257 33554432000 134512640 146736320 4286755856 4286749072 136403109 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/20890/statm: 73855 46257 970 2985 0 70789 0
[pid=20890/tid=21009] ppid=20889 vsize=295420 CPUtime=86.22 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) R 20889 20889 20024 0 -1 4202560 31114 0 0 0 8611 11 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4060675100 135855170 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=295420 CPUtime=86.94 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) R 20889 20889 20024 0 -1 4202560 40010 0 0 0 8682 12 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4071160988 136009853 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=295420 CPUtime=86.66 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) R 20889 20889 20024 0 -1 4202560 57640 0 0 0 8649 17 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4081646804 136003859 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=295420 CPUtime=86.06 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) R 20889 20889 20024 0 -1 4202560 10980 0 0 0 8603 3 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4092133468 135855165 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=295420 CPUtime=86.01 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) R 20889 20889 20024 0 -1 4202560 23638 0 0 0 8594 7 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4126502032 136008069 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=295420 CPUtime=87.05 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) R 20889 20889 20024 0 -1 4202560 34382 0 0 0 8693 12 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4116016288 139028313 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=295420 CPUtime=85.94 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) R 20889 20889 20024 0 -1 4202560 38773 0 0 0 8584 10 0 0 20 0 8 0 391019714 302510080 46257 33554432000 134512640 146736320 4286755856 4105530280 138412031 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1322.59
Current children cumulated vsize (KiB) 304568

[startup+822.3 s]
/proc/loadavg: 9.50 8.95 7.20 10/186 21133
/proc/meminfo: memFree=30947372/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=296444 CPUtime=1562.11 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 490451 0 0 0 156068 143 0 0 20 0 8 0 390998076 303558656 46495 33554432000 134512640 146736320 4286755856 4286747644 135526845 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20890/statm: 74111 46495 970 2985 0 71045 0
[pid=20890/tid=21009] ppid=20889 vsize=296444 CPUtime=116.21 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) R 20889 20889 20024 0 -1 4202560 49104 0 0 0 11604 17 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4060675648 139046496 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=296444 CPUtime=116.81 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) R 20889 20889 20024 0 -1 4202560 44952 0 0 0 11667 14 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4071161224 136001974 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=296444 CPUtime=116.75 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) R 20889 20889 20024 0 -1 4202560 80787 0 0 0 11652 23 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4081646600 139042888 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=296444 CPUtime=116.16 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) R 20889 20889 20024 0 -1 4202560 13496 0 0 0 11612 4 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4092133584 136008106 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=296444 CPUtime=116.01 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) R 20889 20889 20024 0 -1 4202560 27529 0 0 0 11593 8 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4126502416 136403117 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=296444 CPUtime=117.05 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) R 20889 20889 20024 0 -1 4202560 53121 0 0 0 11689 16 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4116016272 136008042 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=296444 CPUtime=115.61 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) R 20889 20889 20024 0 -1 4202560 42394 0 0 0 11549 12 0 0 20 0 8 0 391019714 303558656 46495 33554432000 134512640 146736320 4286755856 4105531392 136018931 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1562.11
Current children cumulated vsize (KiB) 305592



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+881.9 s]
/proc/loadavg: 9.18 8.95 7.31 10/186 21134
/proc/meminfo: memFree=30830176/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=295440 CPUtime=1800.11 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 572390 0 0 0 179844 167 0 0 20 0 8 0 390998076 302530560 46410 33554432000 134512640 146736320 4286755856 4286748936 136000767 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20890/statm: 73860 46410 970 2985 0 70794 0
[pid=20890/tid=21009] ppid=20889 vsize=295440 CPUtime=146.02 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) R 20889 20889 20024 0 -1 4202560 65151 0 0 0 14580 22 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4060676136 139044550 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=295440 CPUtime=146.31 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) R 20889 20889 20024 0 -1 4202560 50849 0 0 0 14614 17 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4071160860 135855174 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=295440 CPUtime=146.61 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) R 20889 20889 20024 0 -1 4202560 107311 0 0 0 14630 31 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4081646736 136008245 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=295440 CPUtime=146.37 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) R 20889 20889 20024 0 -1 4202560 15398 0 0 0 14631 6 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4092133584 136008047 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=295440 CPUtime=145.81 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) R 20889 20889 20024 0 -1 4202560 30294 0 0 0 14570 11 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4126502280 136000930 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=295440 CPUtime=146.63 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) R 20889 20889 20024 0 -1 4202560 75098 0 0 0 14640 23 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4116017360 136008065 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=295440 CPUtime=145.23 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) R 20889 20889 20024 0 -1 4202560 44492 0 0 0 14510 13 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4105531984 136403109 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 304588

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+881.9 s]
/proc/loadavg: 9.18 8.95 7.31 10/186 21134
/proc/meminfo: memFree=30830176/32873648 swapFree=7376/7376
[pid=20889] ppid=20887 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/20889/stat : 20889 (run) S 20887 20889 20024 0 -1 4202496 355 0 0 0 0 0 0 0 20 0 1 0 390998076 9367552 270 33554432000 4194304 5064252 140734787860176 140734787859088 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/20889/statm: 2287 270 229 213 0 72 0
[pid=20890] ppid=20889 vsize=295440 CPUtime=1800.11 cores=1,3,5,7
/proc/20890/stat : 20890 (pb_cplex) R 20889 20889 20024 0 -1 4202496 572390 0 0 0 179844 167 0 0 20 0 8 0 390998076 302530560 46410 33554432000 134512640 146736320 4286755856 4286748936 136000767 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/20890/statm: 73860 46410 970 2985 0 70794 0
[pid=20890/tid=21009] ppid=20889 vsize=295440 CPUtime=146.02 cores=1,3,5,7
/proc/20890/task/21009/stat : 21009 (pb_cplex) R 20889 20889 20024 0 -1 4202560 65151 0 0 0 14580 22 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4060676136 139044550 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21010] ppid=20889 vsize=295440 CPUtime=146.31 cores=1,3,5,7
/proc/20890/task/21010/stat : 21010 (pb_cplex) R 20889 20889 20024 0 -1 4202560 50849 0 0 0 14614 17 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4071160860 135855174 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=20890/tid=21011] ppid=20889 vsize=295440 CPUtime=146.61 cores=1,3,5,7
/proc/20890/task/21011/stat : 21011 (pb_cplex) R 20889 20889 20024 0 -1 4202560 107311 0 0 0 14630 31 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4081646736 136008245 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21012] ppid=20889 vsize=295440 CPUtime=146.37 cores=1,3,5,7
/proc/20890/task/21012/stat : 21012 (pb_cplex) R 20889 20889 20024 0 -1 4202560 15398 0 0 0 14631 6 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4092133584 136008047 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=20890/tid=21013] ppid=20889 vsize=295440 CPUtime=145.81 cores=1,3,5,7
/proc/20890/task/21013/stat : 21013 (pb_cplex) R 20889 20889 20024 0 -1 4202560 30294 0 0 0 14570 11 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4126502280 136000930 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=20890/tid=21014] ppid=20889 vsize=295440 CPUtime=146.63 cores=1,3,5,7
/proc/20890/task/21014/stat : 21014 (pb_cplex) R 20889 20889 20024 0 -1 4202560 75098 0 0 0 14640 23 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4116017360 136008065 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=20890/tid=21015] ppid=20889 vsize=295440 CPUtime=145.23 cores=1,3,5,7
/proc/20890/task/21015/stat : 21015 (pb_cplex) R 20889 20889 20024 0 -1 4202560 44492 0 0 0 14510 13 0 0 20 0 8 0 391019714 302530560 46410 33554432000 134512640 146736320 4286755856 4105531984 136403109 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 304588

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20889 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 881.916
CPU time (s): 1800.11
CPU user time (s): 1798.44
CPU system time (s): 1.67
CPU usage (%): 204.113
Max. virtual memory (cumulated for all children) (KiB): 309156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 355
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 2.12268 second user time and 5.64314 second system time

The end

Launcher Data 

Begin job on node120 at 2012-06-09 15:32:01
IDJOB=3737601
IDBENCH=48268
IDSOLVER=2325
FILE ID=node120/3737601-1339248721
RUNJOBID= node120-1339246833-20042
PBS_JOBID= 14644361
Free space on /tmp= 70828 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/bsg/normalized-bsg_500_10_5.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3737601-1339248721/watcher-3737601-1339248721 -o /tmp/evaluation-result-3737601-1339248721/solver-3737601-1339248721 -C 1800 -W 1900 -M 15500  run HOME/instance-3737601-1339248721.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9b75ee50c2c62e6be495e8bd0a94fa2c
RANDOM SEED=1943485776

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        31089448 kB
Buffers:          439992 kB
Cached:           344884 kB
SwapCached:         5856 kB
Active:           631288 kB
Inactive:         332732 kB
Active(anon):     162608 kB
Inactive(anon):    10444 kB
Active(file):     468680 kB
Inactive(file):   322288 kB
Unevictable:        7376 kB
Mlocked:            7376 kB
SwapTotal:      67108856 kB
SwapFree:       67096152 kB
Dirty:             16312 kB
Writeback:             0 kB
AnonPages:        196032 kB
Mapped:            12860 kB
Shmem:                 0 kB
Slab:             683580 kB
SReclaimable:     127624 kB
SUnreclaim:       555956 kB
KernelStack:        1600 kB
PageTables:         4724 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     228612 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:     57344 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3737601-1339248721.opb

Free space on /tmp at the end= 70808 MiB
End job on node120 at 2012-06-09 15:46:43