Trace number 3729647

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB10: pb_cplex 2010-06-29UNSAT 1156.44 344.655

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
namasivayam/tsp/normalized-t3002.11tsp11.1900561288.opb
MD5SUM4bba9489f2c1cdd3e2419eb13f48915c
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark57.0313
Has Objective FunctionNO
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables231
Total number of constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 625
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.01	c pb_cplex 1.0 - 20100701
0.00/0.01	c Parsing opb file format. File HOME/instance-3729647-1339246836.opb.
0.00/0.01	c Instance file HOME/instance-3729647-1339246836.opb
0.00/0.01	c File size is 83373 bytes.
0.00/0.02	c Highest Coefficient sum: 625
0.00/0.02	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.06	c ============================[ Problem Statistics ]=============================
0.00/0.06	c |                                                                             |
0.00/0.06	c |  Parsing time:          0.01         s                                      |
0.00/0.06	c |  Number Variables:      231                                                 |
0.00/0.06	c |  Number Constraints:    2707                                                |
0.00/0.06	c ===============================================================================
1156.44/344.65	c Remaining time 1799.99 sec.
1156.44/344.65	s UNSATISFIABLE
1156.44/344.65	c Total CPU time              : 1149.74 s

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3729647-1339246836/watcher-3729647-1339246836 -o /tmp/evaluation-result-3729647-1339246836/solver-3729647-1339246836 -C 1800 -W 1900 -M 15500 run HOME/instance-3729647-1339246836.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.16 0.03 0.01 2/172 32100
/proc/meminfo: memFree=31472584/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=11812 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (runsolver) D 32096 32100 32044 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 1 0 390809844 12095488 55 33554432000 4194304 5436572 140734416908048 140734416903928 5057063 0 0 4096 24578 18446744072100588836 0 0 17 4 0 0 0 0 0
/proc/32100/statm: 2953 55 36 304 0 2645 0

[startup+0.0838289 s]
/proc/loadavg: 0.16 0.03 0.01 2/172 32100
/proc/meminfo: memFree=31472584/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100237 s]
/proc/loadavg: 0.16 0.03 0.01 2/172 32100
/proc/meminfo: memFree=31472584/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300229 s]
/proc/loadavg: 0.16 0.03 0.01 2/172 32100
/proc/meminfo: memFree=31472584/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700141 s]
/proc/loadavg: 0.16 0.03 0.01 2/172 32100
/proc/meminfo: memFree=31472584/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 0.16 0.03 0.01 7/192 32120
/proc/meminfo: memFree=31404200/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=72808 CPUtime=2.38 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 12583 0 0 0 230 8 0 0 20 0 1 0 390809845 74555392 4634 33554432000 134512640 146736320 4293708512 4293702716 136017858 0 0 4096 16387 0 0 0 17 2 0 0 1 0 0
/proc/32105/statm: 18202 4634 888 2985 0 15136 0
Current children cumulated CPU time (s) 2.38
Current children cumulated vsize (KiB) 81956

[startup+3.10039 s]
/proc/loadavg: 0.16 0.03 0.01 3/192 32148
/proc/meminfo: memFree=31421560/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=127960 CPUtime=4.83 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 24773 0 0 0 466 17 0 0 20 0 8 0 390809845 131031040 11468 33554432000 134512640 146736320 4293708512 4293700188 135855170 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 1 0 0
/proc/32105/statm: 31990 11468 896 2985 0 28924 0
[pid=32105/tid=32142] ppid=32100 vsize=127960 CPUtime=0.08 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 635 0 0 0 8 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4130405352 139044555 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=127960 CPUtime=0.08 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 486 0 0 0 8 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4140891176 144738703 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=127960 CPUtime=0.09 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 293 0 0 0 9 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4151376984 136007303 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=127960 CPUtime=0.22 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 276 0 0 0 22 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4117770448 136008061 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=127960 CPUtime=0.09 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1000 0 0 0 9 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4097826120 136388102 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=127960 CPUtime=0.1 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 485 0 0 0 10 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4087340560 136403116 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=127960 CPUtime=0.05 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 812 0 0 0 5 0 0 0 20 0 8 0 390810041 131031040 11468 33554432000 134512640 146736320 4293708512 4068467132 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 4.83
Current children cumulated vsize (KiB) 137108

[startup+6.30039 s]
/proc/loadavg: 1.35 0.28 0.09 15/192 32148
/proc/meminfo: memFree=31385756/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=132416 CPUtime=16.73 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 29208 0 0 0 1648 25 0 0 20 0 8 0 390809845 135593984 13035 33554432000 134512640 146736320 4293708512 4293702184 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 1 0 0
/proc/32105/statm: 33104 13035 896 2985 0 30038 0
[pid=32105/tid=32142] ppid=32100 vsize=132416 CPUtime=1.43 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1356 0 0 0 143 0 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4130406992 136403109 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=132416 CPUtime=1.7 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 720 0 0 0 168 2 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4140892312 136007065 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=132416 CPUtime=1.78 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1224 0 0 0 175 3 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4151378920 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=132416 CPUtime=1.55 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 776 0 0 0 155 0 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4117770364 136400477 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=132416 CPUtime=1.24 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1391 0 0 0 124 0 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4097827816 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=132416 CPUtime=1.62 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1055 0 0 0 162 0 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4087341648 136403109 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=132416 CPUtime=1.65 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1225 0 0 0 165 0 0 0 20 0 8 0 390810041 135593984 13035 33554432000 134512640 146736320 4293708512 4068467328 139046532 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 16.73
Current children cumulated vsize (KiB) 141564

[startup+12.7004 s]
/proc/loadavg: 1.80 0.39 0.13 13/192 32148
/proc/meminfo: memFree=31374372/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=139584 CPUtime=37.81 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 36014 0 0 0 3742 39 0 0 20 0 8 0 390809845 142934016 14705 33554432000 134512640 146736320 4293708512 4293701096 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 1 0 0
/proc/32105/statm: 34896 14705 896 2985 0 31830 0
[pid=32105/tid=32142] ppid=32100 vsize=139584 CPUtime=4.02 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1360 0 0 0 399 3 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4130406676 136003328 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=139584 CPUtime=4.29 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1881 0 0 0 425 4 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4140892360 136388561 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=139584 CPUtime=4.36 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1306 0 0 0 432 4 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4151378512 136403112 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=139584 CPUtime=4.19 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 905 0 0 0 416 3 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4117770332 135854505 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=139584 CPUtime=3.89 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 4168 0 0 0 386 3 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4097825964 135454073 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=139584 CPUtime=4.28 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1095 0 0 0 426 2 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4087341208 136007286 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=139584 CPUtime=4.28 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 3804 0 0 0 425 3 0 0 20 0 8 0 390810041 142934016 14705 33554432000 134512640 146736320 4293708512 4068467688 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 37.81
Current children cumulated vsize (KiB) 148732

[startup+25.5005 s]
/proc/loadavg: 4.94 1.16 0.38 3/192 32171
/proc/meminfo: memFree=31361864/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=148968 CPUtime=75.38 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 44193 0 0 0 7476 62 0 0 20 0 8 0 390809845 152543232 16540 33554432000 134512640 146736320 4293708512 4293696080 136403112 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 1 0 0
/proc/32105/statm: 37242 16540 902 2985 0 34176 0
[pid=32105/tid=32142] ppid=32100 vsize=148968 CPUtime=8.44 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) S 32100 32100 32044 0 -1 4202560 1548 0 0 0 839 5 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4130410128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=148968 CPUtime=8.72 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) S 32100 32100 32044 0 -1 4202560 2500 0 0 0 865 7 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4140895888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=148968 CPUtime=8.75 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) S 32100 32100 32044 0 -1 4202560 1311 0 0 0 868 7 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4151381648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=148968 CPUtime=8.54 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) S 32100 32100 32044 0 -1 4202560 909 0 0 0 849 5 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4117773968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=148968 CPUtime=8.26 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) S 32100 32100 32044 0 -1 4202560 6476 0 0 0 820 6 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4097830544 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=148968 CPUtime=8.69 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) S 32100 32100 32044 0 -1 4202560 1098 0 0 0 865 4 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4087344784 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=148968 CPUtime=8.65 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) S 32100 32100 32044 0 -1 4202560 6247 0 0 0 858 7 0 0 20 0 8 0 390810041 152543232 16540 33554432000 134512640 146736320 4293708512 4068470416 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 75.38
Current children cumulated vsize (KiB) 158116

[startup+51.1005 s]
/proc/loadavg: 6.72 1.85 0.63 8/192 32171
/proc/meminfo: memFree=31371832/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=141148 CPUtime=149.85 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 58125 0 0 0 14879 106 0 0 20 0 8 0 390809845 144535552 15325 33554432000 134512640 146736320 4293708512 4293701824 139046467 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 1 0 0
/proc/32105/statm: 35287 15325 903 2985 0 32221 0
[pid=32105/tid=32142] ppid=32100 vsize=141148 CPUtime=17.13 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1593 0 0 0 1703 10 0 0 20 0 8 0 390810041 144535552 15325 33554432000 134512640 146736320 4293708512 4130407960 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=141148 CPUtime=17.33 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 2983 0 0 0 1720 13 0 0 20 0 8 0 390810041 144535552 15325 33554432000 134512640 146736320 4293708512 4140892312 136007627 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=141148 CPUtime=17.14 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1817 0 0 0 1702 12 0 0 20 0 8 0 390810041 144535552 15325 33554432000 134512640 146736320 4293708512 4151378376 135999617 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=141148 CPUtime=17.1 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1504 0 0 0 1698 12 0 0 20 0 8 0 390810041 144535552 15325 33554432000 134512640 146736320 4293708512 4117771836 137366873 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=141148 CPUtime=16.71 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6484 0 0 0 1660 11 0 0 20 0 8 0 390810041 144535552 15325 33554432000 134512640 146736320 4293708512 4097827408 136403116 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=141148 CPUtime=17.38 cores=0,2,4,6

################
# More data... #
################

/proc/loadavg: 10.34 6.77 2.92 13/190 32235
/proc/meminfo: memFree=31338252/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=142172 CPUtime=943.06 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 90254 0 0 0 93769 537 0 0 20 0 8 0 390809845 145584128 15496 33554432000 134512640 146736320 4293708512 4293701256 139042902 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 1 0 0
/proc/32105/statm: 35543 15496 903 2985 0 32477 0
[pid=32105/tid=32142] ppid=32100 vsize=142172 CPUtime=115.63 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6822 0 0 0 11500 63 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4130406608 136008115 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=142172 CPUtime=115.86 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6154 0 0 0 11517 69 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4140892312 136007633 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=142172 CPUtime=115.84 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 4517 0 0 0 11514 70 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4151378968 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=142172 CPUtime=116.11 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) S 32100 32100 32044 0 -1 4202560 9627 0 0 0 11542 69 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4117773968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=142172 CPUtime=114.95 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 12768 0 0 0 11429 66 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4097827816 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=142172 CPUtime=115.75 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1728 0 0 0 11514 61 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4087341264 136008042 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=142172 CPUtime=116.16 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 8750 0 0 0 11554 62 0 0 20 0 8 0 390810041 145584128 15496 33554432000 134512640 146736320 4293708512 4068466780 135854194 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 943.06
Current children cumulated vsize (KiB) 151320

[startup+342.3 s]
/proc/loadavg: 12.49 8.06 3.60 8/191 32236
/proc/meminfo: memFree=31334244/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=142172 CPUtime=1148.69 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) S 32100 32100 32044 0 -1 4202496 97718 0 0 0 114227 642 0 0 20 0 8 0 390809845 145584128 15410 33554432000 134512640 146736320 4293708512 4293704912 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 1 0 0
/proc/32105/statm: 35543 15410 903 2985 0 32477 0
[pid=32105/tid=32142] ppid=32100 vsize=142172 CPUtime=141.15 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) S 32100 32100 32044 0 -1 4202560 8337 0 0 0 14038 77 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4130410128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=142172 CPUtime=141.15 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) S 32100 32100 32044 0 -1 4202560 6421 0 0 0 14033 82 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4140895888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=142172 CPUtime=141.4 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) S 32100 32100 32044 0 -1 4202560 6151 0 0 0 14055 85 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4151381648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=142172 CPUtime=141.72 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) S 32100 32100 32044 0 -1 4202560 11257 0 0 0 14088 84 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4117773968 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=142172 CPUtime=140.58 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 13260 0 0 0 13977 81 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4097826984 135982940 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=142172 CPUtime=141.3 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) S 32100 32100 32044 0 -1 4202560 1729 0 0 0 14054 76 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4087344784 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=142172 CPUtime=141.89 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) S 32100 32100 32044 0 -1 4202560 10675 0 0 0 14113 76 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4068470416 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1148.69
Current children cumulated vsize (KiB) 151320

Solver just ended. Dumping a history of the last processes samples

[startup+342.4 s]
/proc/loadavg: 12.49 8.06 3.60 8/191 32236
/proc/meminfo: memFree=31334244/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=142172 CPUtime=1149.02 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 97718 0 0 0 114260 642 0 0 20 0 8 0 390809845 145584128 15410 33554432000 134512640 146736320 4293708512 4293701256 139042902 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 1 0 0
/proc/32105/statm: 35543 15410 903 2985 0 32477 0
[pid=32105/tid=32142] ppid=32100 vsize=142172 CPUtime=141.19 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 8337 0 0 0 14042 77 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4130406292 136017498 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=142172 CPUtime=141.2 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6421 0 0 0 14038 82 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4140892232 136474418 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=142172 CPUtime=141.43 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6151 0 0 0 14058 85 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4151378072 136007198 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=142172 CPUtime=141.76 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 11257 0 0 0 14092 84 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4117771240 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=142172 CPUtime=140.64 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 13260 0 0 0 13983 81 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4097827816 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=142172 CPUtime=141.32 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1729 0 0 0 14056 76 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4087341208 136007034 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=142172 CPUtime=141.91 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 10675 0 0 0 14115 76 0 0 20 0 8 0 390810041 145584128 15410 33554432000 134512640 146736320 4293708512 4068467688 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1149.02
Current children cumulated vsize (KiB) 151320

[startup+344 s]
/proc/loadavg: 12.29 8.10 3.64 17/191 32236
/proc/meminfo: memFree=31333996/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=142172 CPUtime=1154.55 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 98281 0 0 0 114810 645 0 0 20 0 8 0 390809845 145584128 15387 33554432000 134512640 146736320 4293708512 4293700332 135454118 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 1 0 0
/proc/32105/statm: 35543 15387 903 2985 0 32477 0
[pid=32105/tid=32142] ppid=32100 vsize=142172 CPUtime=141.89 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 8457 0 0 0 14112 77 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4130406472 139042910 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=142172 CPUtime=141.89 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6514 0 0 0 14106 83 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4140892752 136403117 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=142172 CPUtime=142.2 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6151 0 0 0 14135 85 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4151378032 136384857 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=142172 CPUtime=142.42 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 11476 0 0 0 14158 84 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4117770880 139046528 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=142172 CPUtime=141.35 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) R 32100 32100 32044 0 -1 4202560 13391 0 0 0 14054 81 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4097827816 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=142172 CPUtime=141.97 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1729 0 0 0 14120 77 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4087340156 135446502 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=142172 CPUtime=142.56 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 10675 0 0 0 14180 76 0 0 20 0 8 0 390810041 145584128 15387 33554432000 134512640 146736320 4293708512 4068467688 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1154.55
Current children cumulated vsize (KiB) 151320

[startup+344.406 s]
/proc/loadavg: 12.29 8.10 3.64 11/191 32236
/proc/meminfo: memFree=31333872/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=142172 CPUtime=1155.93 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) R 32100 32100 32044 0 -1 4202496 98282 0 0 0 114947 646 0 0 20 0 8 0 390809845 145584128 15388 33554432000 134512640 146736320 4293708512 4293702184 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 1 0 0
/proc/32105/statm: 35543 15388 903 2985 0 32477 0
[pid=32105/tid=32142] ppid=32100 vsize=142172 CPUtime=142.07 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) R 32100 32100 32044 0 -1 4202560 8457 0 0 0 14130 77 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4130406992 136403116 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=142172 CPUtime=142.08 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6514 0 0 0 14125 83 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4140892368 136008020 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=142172 CPUtime=142.36 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) R 32100 32100 32044 0 -1 4202560 6151 0 0 0 14151 85 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4151378920 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=142172 CPUtime=142.58 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 11477 0 0 0 14174 84 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4117770392 136007021 0 2 4096 16387 0 0 0 -1 6 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=142172 CPUtime=141.52 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) S 32100 32100 32044 0 -1 4202560 13391 0 0 0 14071 81 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4097830544 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=142172 CPUtime=142.14 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1729 0 0 0 14137 77 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4087341208 136007620 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=142172 CPUtime=142.75 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 10675 0 0 0 14199 76 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4068467688 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1155.93
Current children cumulated vsize (KiB) 151320

[startup+344.6 s]
/proc/loadavg: 12.29 8.10 3.64 11/191 32236
/proc/meminfo: memFree=31333872/32873852 swapFree=6860/6860
[pid=32100] ppid=32096 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/32100/stat : 32100 (run) S 32096 32100 32044 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390809844 9367552 269 33554432000 4194304 5064252 140735167823328 140735167822240 273448330830 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/32100/statm: 2287 269 229 213 0 72 0
[pid=32105] ppid=32100 vsize=142172 CPUtime=1156.44 cores=0,2,4,6
/proc/32105/stat : 32105 (pb_cplex) S 32100 32100 32044 0 -1 4202496 98479 0 0 0 114998 646 0 0 20 0 8 0 390809845 145584128 15388 33554432000 134512640 146736320 4293708512 4293704912 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 1 0 0
/proc/32105/statm: 35543 15388 903 2985 0 32477 0
[pid=32105/tid=32142] ppid=32100 vsize=142172 CPUtime=142.14 cores=0,2,4,6
/proc/32105/task/32142/stat : 32142 (pb_cplex) S 32100 32100 32044 0 -1 4202560 8654 0 0 0 14137 77 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4130410128 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32143] ppid=32100 vsize=142172 CPUtime=142.19 cores=0,2,4,6
/proc/32105/task/32143/stat : 32143 (pb_cplex) S 32100 32100 32044 0 -1 4202560 6514 0 0 0 14136 83 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4140895888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32144] ppid=32100 vsize=142172 CPUtime=142.46 cores=0,2,4,6
/proc/32105/task/32144/stat : 32144 (pb_cplex) S 32100 32100 32044 0 -1 4202560 6151 0 0 0 14161 85 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4151381648 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32145] ppid=32100 vsize=142172 CPUtime=142.62 cores=0,2,4,6
/proc/32105/task/32145/stat : 32145 (pb_cplex) R 32100 32100 32044 0 -1 4202560 11477 0 0 0 14177 85 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4117774016 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=32105/tid=32146] ppid=32100 vsize=142172 CPUtime=141.54 cores=0,2,4,6
/proc/32105/task/32146/stat : 32146 (pb_cplex) S 32100 32100 32044 0 -1 4202560 13391 0 0 0 14073 81 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4097830544 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=32105/tid=32147] ppid=32100 vsize=142172 CPUtime=142.25 cores=0,2,4,6
/proc/32105/task/32147/stat : 32147 (pb_cplex) R 32100 32100 32044 0 -1 4202560 1729 0 0 0 14148 77 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4087344784 144580073 0 2 4096 16387 0 0 0 -1 2 0 0 0 0 0
[pid=32105/tid=32148] ppid=32100 vsize=142172 CPUtime=142.78 cores=0,2,4,6
/proc/32105/task/32148/stat : 32148 (pb_cplex) R 32100 32100 32044 0 -1 4202560 10675 0 0 0 14202 76 0 0 20 0 8 0 390810041 145584128 15388 33554432000 134512640 146736320 4293708512 4068470416 144580073 0 2 4096 16387 0 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1156.44
Current children cumulated vsize (KiB) 151320

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32100 and gives
#  childrusage.ru_utime.tv_sec=1149
#  childrusage.ru_utime.tv_usec=743212
#  childrusage.ru_stime.tv_sec=6
#  childrusage.ru_stime.tv_usec=678984
# CPU time returned by wait4() is 1156.42
# while last known CPU time is 1156.44
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 344.655
CPU time (s): 1156.44
CPU user time (s): 1149.98
CPU system time (s): 6.46
CPU usage (%): 335.536
Max. virtual memory (cumulated for all children) (KiB): 159276

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1149.74
system time used= 6.67898
maximum resident set size= 67088
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 98856
page faults= 0
swaps= 0
block input operations= 40
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 201171
involuntary context switches= 83557

runsolver used 0.900863 second user time and 2.26666 second system time

The end

Launcher Data 

Begin job on node128 at 2012-06-09 15:00:37
IDJOB=3729647
IDBENCH=1303
IDSOLVER=2325
FILE ID=node128/3729647-1339246836
RUNJOBID= node128-1339246832-32061
PBS_JOBID= 14644353
Free space on /tmp= 70900 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900561288.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3729647-1339246836/watcher-3729647-1339246836 -o /tmp/evaluation-result-3729647-1339246836/solver-3729647-1339246836 -C 1800 -W 1900 -M 15500  run HOME/instance-3729647-1339246836.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4bba9489f2c1cdd3e2419eb13f48915c
RANDOM SEED=1970065403

node128.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.389
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        31474384 kB
Buffers:          349008 kB
Cached:           135432 kB
SwapCached:         1892 kB
Active:           456236 kB
Inactive:          34964 kB
Active(anon):       2140 kB
Inactive(anon):     7036 kB
Active(file):     454096 kB
Inactive(file):    27928 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67100792 kB
Dirty:             33160 kB
Writeback:             0 kB
AnonPages:         12108 kB
Mapped:             8388 kB
Shmem:                 0 kB
Slab:             769748 kB
SReclaimable:     211412 kB
SUnreclaim:       558336 kB
KernelStack:        1400 kB
PageTables:         3996 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     103684 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3729647-1339246836.opb

Free space on /tmp at the end= 70868 MiB
End job on node128 at 2012-06-09 15:06:24